Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Optimize merge_sort algorithm for largest data sizes #1977

Open
wants to merge 118 commits into
base: main
Choose a base branch
from

Conversation

SergeyKopienko
Copy link
Contributor

@SergeyKopienko SergeyKopienko commented Dec 19, 2024

In this PR we extends the approach from #1933 to merge_sort algorithm.

…introduce new function __find_start_point_in

Signed-off-by: Sergey Kopienko <[email protected]>
…introduce __parallel_merge_submitter_large for merge of biggest data sizes

Signed-off-by: Sergey Kopienko <[email protected]>
…using __parallel_merge_submitter_large for merge data equal or greater then 4M items

Signed-off-by: Sergey Kopienko <[email protected]>
Signed-off-by: Sergey Kopienko <[email protected]>
…rename template parameter names in __parallel_merge_submitter

Signed-off-by: Sergey Kopienko <[email protected]>
Signed-off-by: Sergey Kopienko <[email protected]>
…introduce __starting_size_limit_for_large_submitter into __parallel_merge

Signed-off-by: Sergey Kopienko <[email protected]>
…introduce _split_point_t type

Signed-off-by: Sergey Kopienko <[email protected]>
…remove usages of std::make_pair

Signed-off-by: Sergey Kopienko <[email protected]>
…optimize evaluation of split-points on base diagonals

Signed-off-by: Sergey Kopienko <[email protected]>
…extract eval_split_points_for_groups function

Signed-off-by: Sergey Kopienko <[email protected]>
…extract run_parallel_merge function

Signed-off-by: Sergey Kopienko <[email protected]>
…using SLM bank size to define chunk in the eval_nd_range_params function

Signed-off-by: Sergey Kopienko <[email protected]>
…using SLM bank size to define chunk in the eval_nd_range_params function (16)

Signed-off-by: Sergey Kopienko <[email protected]>
…restore old implementation of __find_start_point

Signed-off-by: Sergey Kopienko <[email protected]>
…rename: base_diag_part -> steps_between_two_base_diags

Signed-off-by: Sergey Kopienko <[email protected]>
…fix an error in __parallel_merge_submitter_large::eval_split_points_for_groups

Signed-off-by: Sergey Kopienko <[email protected]>
…erge_submitter_large` into one `__parallel_merge_submitter` (#1956)
…fix review comment: remove extra condition check from __find_start_point_in

Signed-off-by: Sergey Kopienko <[email protected]>
…fix review comment: fix condition check in __find_start_point_in

Signed-off-by: Sergey Kopienko <[email protected]>
…apply GitHUB clang format

Signed-off-by: Sergey Kopienko <[email protected]>
….h - fix review comment: using common base diagonal's container for all iterations with the enough big size
….h - fix review comment: using common base diagonal's container for all iterations with the enough big size
….h - fix review comment: add __portions parameter into eval_nd_range_params
….h - fix self-review comment: using own __no_op impl
….h - remove extra changes in __subgroup_bubble_sorter::sort()
….h - fix review comment: using common base diagonal's container for all iterations with the enough big size
….h - fix review comments: remove extra ternary operators
….h - pack __amount_of_base_diagonals into tune_amount_of_base_diagonals
….h - pack __amount_of_base_diagonals into tune_amount_of_base_diagonals
….h - pack __amount_of_base_diagonals into tune_amount_of_base_diagonals (fix compile error)
….h - fix review comment: using __dpl_ceiling_div instead of std::ceil
….h - creates __base_diagonals_sp_storage_t before the first real usage
@SergeyKopienko SergeyKopienko force-pushed the dev/skopienko/optimize_merge_sort_V1 branch from f82da46 to 535ba7a Compare January 16, 2025 11:52
@SergeyKopienko SergeyKopienko force-pushed the dev/skopienko/optimize_merge_sort_V1 branch from 8420e28 to fae5314 Compare January 16, 2025 12:08
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants