diff --git a/README.org b/README.org index dce9060..84d4ad8 100644 --- a/README.org +++ b/README.org @@ -209,17 +209,17 @@ one expression (not several), and there is no special setup argument like atime (which means that the timing must include data setup code which may be irrelevant). -| | Project | Github workflow result display | Comparative benchmarking | Performance testing | +| | Language | Users | Github workflow result display | Comparative benchmarking | Performance testing | |-------------------+-----------------------------+--------------------------------+--------------------------+---------------------| -| [[https://github.com/r-lib/bench][bench]] | R | - | yes | - | +| [[https://github.com/r-lib/bench][bench]] | R | | - | yes | - | | [[https://www.rdocumentation.org/packages/microbenchmark/versions/1.5.0/topics/microbenchmark][microbenchmark]] | R | - | yes | - | -| [[https://stat.ethz.ch/R-manual/R-devel/library/base/html/system.time.html][system.time]] | R | - | yes | - | -| [[https://github.com/cran/rbenchmark][rbenchmark]] | R | - | yes | - | -| [[https://github.com/airspeed-velocity/asv][airspeed velocity]] | Python | [[https://pv.github.io/numpy-bench/][web page]] | - | yes | -| [[https://github.com/conbench/conbench][conbench]] | arrow | - | - | yes | +| [[https://stat.ethz.ch/R-manual/R-devel/library/base/html/system.time.html][system.time]] | R | | - | yes | - | +| [[https://github.com/cran/rbenchmark][rbenchmark]] | R | | - | yes | - | +| [[https://github.com/airspeed-velocity/asv][airspeed velocity]] | Python | numpy | [[https://pv.github.io/numpy-bench/][web page]] | - | yes | +| [[https://github.com/conbench/conbench][conbench]] | any | arrow | [[https://conbench.ursa.dev/][Arrow Conbench]] | - | yes | | [[https://github.com/lorenzwalthert/touchstone][touchstone]] | R | [[https://github.com/lorenzwalthert/touchstone/blob/main/man/figures/screenshot-pr-comment.png][PR comments]] | - | yes | -| [[https://github.com/ionelmc/pytest-benchmark][pytest-benchmark]] | Python projects with pytest | [[https://github.com/ionelmc/pytest-benchmark#screenshots][web page]] | - | yes | -| [[https://github.com/tdhock/atime][atime (proposed)]] | R | [[https://github.com/Rdatatable/data.table/pull/5427#issuecomment-2075471806][PR comments]] | yes | yes | +| [[https://github.com/ionelmc/pytest-benchmark][pytest-benchmark]] | Python | | [[https://github.com/ionelmc/pytest-benchmark#screenshots][web page]] | - | yes | +| [[https://github.com/tdhock/atime][atime (proposed)]] | R | data.table | [[https://github.com/Rdatatable/data.table/pull/5427#issuecomment-2075471806][PR comments]] | yes | yes | See [[https://bencher.dev/docs/reference/prior-art/][Bencher prior art]] for even more related work, and see [[https://bencher.dev/docs/explanation/continuous-benchmarking/][continuous benchmarking]] for a plot that shows how false positives can show up if