-
Notifications
You must be signed in to change notification settings - Fork 3.3k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[fix](memory) Fix metadata memory tracking and profile #44739
[fix](memory) Fix metadata memory tracking and profile #44739
Conversation
Thank you for your contribution to Apache Doris. Please clearly describe your PR:
|
09d18cb
to
bf3fb24
Compare
run buildall |
TPC-H: Total hot run time: 40044 ms
|
TPC-DS: Total hot run time: 191661 ms
|
ClickBench: Total hot run time: 33.1 s
|
bf3fb24
to
db61f10
Compare
run buildall |
PR approved by at least one committer and no changes requested. |
PR approved by anyone and no changes requested. |
TPC-H: Total hot run time: 40089 ms
|
TPC-DS: Total hot run time: 197943 ms
|
ClickBench: Total hot run time: 32.76 s
|
db61f10
to
d44aa87
Compare
run buildall |
TPC-H: Total hot run time: 40012 ms
|
TPC-DS: Total hot run time: 195967 ms
|
ClickBench: Total hot run time: 33.27 s
|
d44aa87
to
0531b4a
Compare
run buildall |
TPC-H: Total hot run time: 40256 ms
|
TPC-DS: Total hot run time: 197723 ms
|
ClickBench: Total hot run time: 33.13 s
|
TeamCity be ut coverage result: |
run buildall |
TPC-H: Total hot run time: 40352 ms
|
TPC-DS: Total hot run time: 190672 ms
|
TeamCity be ut coverage result: |
ClickBench: Total hot run time: 32.64 s
|
PR approved by at least one committer and no changes requested. |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
LGTM
What problem does this PR solve?
Problem Summary:
MemTrackerLimiter
andMemoryProfile
add metadata and cache type.all_segments_mem_tracker
excludes the segments in SegmentCache, and all segments use the same memory calculation method.TODO, Metadata also has some memory that can be allocated using Doris Allocator.
Check List (For Author)
Test
Behavior changed:
Does this need documentation?
Check List (For Reviewer who merge this PR)