You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed: Marked as improvement because 12.1797787645276 < 12.881328863833888.
IsChangePoint: Marked as a change because one of 5/11/2023 1:19:27 PM, 7/6/2023 4:13:54 AM, 7/10/2023 9:23:13 PM falls between 7/1/2023 10:14:52 PM and 7/10/2023 9:23:13 PM.
IsImprovementStdDev: Marked as improvement because 9.144183795461718 (T) = (0 -11.315252204817396) / Math.Sqrt((1.8551249259972662 / (215)) + (0.48569162870324506 / (13))) is greater than 1.9705162426829501 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (215) + (13) - 2, .975) and 0.14770622944232834 = (13.276234786291605 - 11.315252204817396) / 13.276234786291605 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed: Marked as improvement because 10.39898195415345 < 14.92275128471626.
IsChangePoint: Marked as a change because one of 5/11/2023 1:19:27 PM, 7/6/2023 4:13:54 AM, 7/10/2023 9:23:13 PM falls between 7/1/2023 10:14:52 PM and 7/10/2023 9:23:13 PM.
IsImprovementStdDev: Marked as improvement because 42.680214501846656 (T) = (0 -10.418979634775097) / Math.Sqrt((1.2541397439916704 / (215)) + (0.2293302632644102 / (13))) is greater than 1.9705162426829501 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (215) + (13) - 2, .975) and 0.3856049717701993 = (16.958111892269596 - 10.418979634775097) / 16.958111892269596 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed: Marked as improvement because 6.9221504055473035 < 7.685965868663086.
IsChangePoint: Marked as a change because one of 5/11/2023 1:19:27 PM, 7/6/2023 4:13:54 AM, 7/10/2023 9:23:13 PM falls between 7/1/2023 10:14:52 PM and 7/10/2023 9:23:13 PM.
IsImprovementStdDev: Marked as improvement because 7.7230242597889935 (T) = (0 -7.163249107645408) / Math.Sqrt((1.3002807995333439 / (215)) + (0.5422656659177095 / (13))) is greater than 1.9705162426829501 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (215) + (13) - 2, .975) and 0.19068966001749751 = (8.851053488085027 - 7.163249107645408) / 8.851053488085027 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
This looks like dotnet/runtime#87141
Big perf gain in Equals_Bytes_Chars as expected, and smaller gains in Equals_Chars and Equals_Bytes due to removal of extra OR.
Run Information
Improvements in System.Text.Perf_Ascii
Test Report
Repro
General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md
Payloads
Baseline
Compare
System.Text.Perf_Ascii.Equals_Chars(Size: 128)
ETL Files
Baseline
Compare
Histogram
Description of detection logic
JIT Disasms
Baseline
Compare
Diff
System.Text.Perf_Ascii.Equals_Bytes_Chars(Size: 128)
ETL Files
Baseline
Compare
Histogram
Description of detection logic
JIT Disasms
Baseline
Compare
Diff
System.Text.Perf_Ascii.Equals_Bytes(Size: 128)
ETL Files
Baseline
Compare
Histogram
Description of detection logic
JIT Disasms
Baseline
Compare
Diff
Docs
Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository
The text was updated successfully, but these errors were encountered: