-
Notifications
You must be signed in to change notification settings - Fork 101
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Confusing numbers in histogram #249
Comments
giordano
changed the title
Confusing numbers in histogram and mean time has standard deviation larger than average time itself
Confusing numbers in histogram
Aug 20, 2021
Other examples of funny numbers in the histogram: https://discourse.julialang.org/t/why-is-minimum-so-much-faster-than-argmin/66814/8 |
Yea, that's funky. I wonder if it has anything to do with my assumption that times were sorted? In #245 this assumption looks like it could be a bit dodgy. |
#240 times are not sorted |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Trying to reproduce the benchmarks in this discourse post, I've got
The mean time is👈 Yes, I believe the problem is that the distribution isn't normal, there are large outliers only on one side, so the standard deviation is messed up. The issue below still stands though 👇13.660 μs ± 17.326 μs
, I haven't looked at the code but the standard deviation larger than the average time itself looks suspiciously wrong (or maybe large one-sided outliers are screwing it up?).Also, note that the histogram has
53.4 μs
on the left and11.1 μs
on the right: I have no idea how to read this histogram, is it reversed?The text was updated successfully, but these errors were encountered: