Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

fix AsyncQueueSegmentDispatcher performance issue #585

Merged
merged 1 commit into from
May 4, 2024

Conversation

lu-xiaoshuang
Copy link
Contributor

@lu-xiaoshuang lu-xiaoshuang commented Mar 27, 2024

This is a multiple producers multiple consumers (MPMC) problem. Timer and ConcurrentQueue shall be dropped.

@wu-sheng wu-sheng added this to the 2.2.0 milestone Mar 27, 2024
@wu-sheng
Copy link
Member

Mark this on 2.3.0, as @liuhaoyang is planning to run 2.2.0 release, we should stop adding new things.

@wu-sheng wu-sheng modified the milestones: 2.2.0, 2.3.0 Mar 27, 2024
@lu-xiaoshuang lu-xiaoshuang force-pushed the performance branch 2 times, most recently from 36dfc36 to 6b01726 Compare March 29, 2024 01:50
@liuhaoyang
Copy link
Collaborator

Have there been any performance test results ? @lu-xiaoshuang

@lu-xiaoshuang
Copy link
Contributor Author

lu-xiaoshuang commented Apr 15, 2024

shall be dropped.

Have there been any performance test results ? @lu-xiaoshuang

New solution affords 30+k spans per second in normal scenarios (not pressure testing) with following configurations:

QueueSize = 10000, BatchSize = 2000, Parallel = 5, Interval = 50, Reporter = kafka

@liuhaoyang liuhaoyang merged commit 761699c into SkyAPM:main May 4, 2024
2 checks passed
@lu-xiaoshuang lu-xiaoshuang deleted the performance branch June 25, 2024 10:31
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants