Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[feat](docker)Modify the init_be and start_be scripts to meet the requirements for rapid Docker startup. #45269

Merged
merged 34 commits into from
Dec 13, 2024
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
34 commits
Select commit Hold shift + click to select a range
b7a0cc8
Refactor upgrade documentation
FreeOnePlus Jul 3, 2023
01074ca
Merge branch 'apache:master' into master
FreeOnePlus Jul 4, 2023
9d96f54
Merge branch 'apache:master' into master
FreeOnePlus Aug 15, 2023
c9c7af2
Merge branch 'apache:master' into master
FreeOnePlus Sep 15, 2023
f924fde
Merge branch 'apache:master' into master
FreeOnePlus Nov 13, 2023
bcb7df4
Merge branch 'apache:master' into master
FreeOnePlus Nov 24, 2023
00f1515
Merge branch 'apache:master' into master
FreeOnePlus Dec 10, 2023
027a73d
Merge branch 'apache:master' into master
FreeOnePlus Jan 15, 2024
f575143
Merge branch 'apache:master' into master
FreeOnePlus Jan 24, 2024
58118ce
Merge branch 'apache:master' into master
FreeOnePlus Feb 28, 2024
61a4fbd
Merge branch 'apache:master' into master
FreeOnePlus Mar 2, 2024
cb04baa
Merge branch 'apache:master' into master
FreeOnePlus Mar 4, 2024
21adbbe
Merge branch 'apache:master' into master
FreeOnePlus Mar 7, 2024
4fbfc41
Merge branch 'apache:master' into master
FreeOnePlus Mar 9, 2024
dfc2c71
Merge branch 'apache:master' into master
FreeOnePlus Mar 30, 2024
8ab6526
Merge branch 'apache:master' into master
FreeOnePlus Apr 17, 2024
87717e0
Merge branch 'apache:master' into master
FreeOnePlus Jun 23, 2024
974ce3d
Merge branch 'apache:master' into master
FreeOnePlus Jul 5, 2024
c0a217f
Merge branch 'apache:master' into master
FreeOnePlus Nov 27, 2024
ee98380
Merge branch 'apache:master' into master
FreeOnePlus Dec 7, 2024
b8e25bb
Merge branch 'apache:master' into master
FreeOnePlus Dec 9, 2024
4dd24bf
add skip_check_ulimit config
FreeOnePlus Dec 10, 2024
0f5aebe
add skip_check_ulimit config
FreeOnePlus Dec 10, 2024
f9bc5fe
add skip_check_ulimit config
FreeOnePlus Dec 10, 2024
a6ac46e
add skip_check_ulimit config
FreeOnePlus Dec 10, 2024
6c594f9
add skip_check_ulimit config
FreeOnePlus Dec 11, 2024
8e0df9a
add skip_check_ulimit config
FreeOnePlus Dec 11, 2024
dc645ab
change
FreeOnePlus Dec 11, 2024
8ed12de
change
FreeOnePlus Dec 11, 2024
c37ec4d
Merge branch 'master' into add-skip-check-config
FreeOnePlus Dec 11, 2024
a353fe3
add skip_check_ulimit config
FreeOnePlus Dec 12, 2024
3544072
add skip_check_ulimit config
FreeOnePlus Dec 12, 2024
0ee0d86
add skip_check_ulimit config
FreeOnePlus Dec 12, 2024
334a99a
add skip_check_ulimit config
FreeOnePlus Dec 12, 2024
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
36 changes: 19 additions & 17 deletions bin/start_be.sh
Original file line number Diff line number Diff line change
Expand Up @@ -182,29 +182,31 @@ if [[ "${RUN_VERSION}" -eq 1 ]]; then
exit 0
fi

if [[ "$(uname -s)" != 'Darwin' ]]; then
MAX_MAP_COUNT="$(cat /proc/sys/vm/max_map_count)"
if [[ "${MAX_MAP_COUNT}" -lt 2000000 ]]; then
echo "Set kernel parameter 'vm.max_map_count' to a value greater than 2000000, example: 'sysctl -w vm.max_map_count=2000000'"
exit 1
if [[ "${SKIP_CHECK_ULIMIT:- "false"}" != "true" ]]; then
if [[ "$(uname -s)" != 'Darwin' ]]; then
MAX_MAP_COUNT="$(cat /proc/sys/vm/max_map_count)"
if [[ "${MAX_MAP_COUNT}" -lt 2000000 ]]; then
echo "Set kernel parameter 'vm.max_map_count' to a value greater than 2000000, example: 'sysctl -w vm.max_map_count=2000000'"
exit 1
fi

if [[ "$(swapon -s | wc -l)" -gt 1 ]]; then
echo "Disable swap memory before starting be"
exit 1
fi
fi

if [[ "$(swapon -s | wc -l)" -gt 1 ]]; then
echo "Disable swap memory before starting be"
MAX_FILE_COUNT="$(ulimit -n)"
if [[ "${MAX_FILE_COUNT}" -lt 60000 ]]; then
echo "Set max number of open file descriptors to a value greater than 60000."
echo "Ask your system manager to modify /etc/security/limits.conf and append content like"
echo " * soft nofile 655350"
echo " * hard nofile 655350"
echo "and then run 'ulimit -n 655350' to take effect on current session."
exit 1
fi
fi

MAX_FILE_COUNT="$(ulimit -n)"
if [[ "${MAX_FILE_COUNT}" -lt 60000 ]]; then
echo "Set max number of open file descriptors to a value greater than 60000."
echo "Ask your system manager to modify /etc/security/limits.conf and append content like"
echo " * soft nofile 655350"
echo " * hard nofile 655350"
echo "and then run 'ulimit -n 655350' to take effect on current session."
exit 1
fi

# add java libs
# Must add hadoop libs, because we should load specified jars
# instead of jars in hadoop libs, such as avro
Expand Down
1 change: 1 addition & 0 deletions docker/runtime/be/resource/init_be.sh
Original file line number Diff line number Diff line change
Expand Up @@ -197,6 +197,7 @@ _main() {
fi
check_be_status
doris_note "Ready to start BE!"
export SKIP_CHECK_ULIMIT=true
${DORIS_HOME}/be/bin/start_be.sh --console &
child_pid=$!
wait $child_pid
Expand Down
Loading