add script for benchmarking baseline acquisition functions for full function estimate #351
Conversation
facebook-github-bot
added
the
CLA Signed
|
This pull request was exported from Phabricator. Differential Revision: D57916855 |
wenx-guo
changed the title
wenx-guo
changed the title
…acebookresearch#349) Summary: The run_benchmarks_with_checkpoints function generates an output path featuring the current chunk number. If the benchmarking process restarts, previous outputs will be overwritten. To avoid this and prevent file overwriting, the start_idx argument can be used to initiate chunk counting from a specific index. Reviewed By: crasanders Differential Revision: D57881813
… Letham et al. 2022 (facebookresearch#350) Summary: Additional high-dimensional test functions and real psychophysics task are added to problem.py for benchmarking performance of acquistions functions or GP models. The code and dataset are obtained from https://github.com/facebookresearch/bernoulli_lse/blob/main/problems.py. Differential Revision: D57885175
…unction estimate (facebookresearch#351) Summary: We conducted benchmarking experiments on full function estimate for Sobol sampling, BALV, and BALD acquisition functions. These tests were performed on three distinct functions and a real psychophysics task data set obtained from Letham et al. (2022). Differential Revision: D57916855
wenx-guo
force-pushed
the
export-D57916855
branch
from
5e3c274 to
3e6ad0b
Compare
|
This pull request was exported from Phabricator. Differential Revision: D57916855 |
|
Hi @wenx-guo! Thank you for your pull request. We require contributors to sign our Contributor License Agreement, and yours needs attention. You currently have a record in our system, but the CLA is no longer valid, and will need to be resubmitted. ProcessIn order for us to review and merge your suggested changes, please sign at https://code.facebook.com/cla. If you are contributing on behalf of someone else (eg your employer), the individual CLA may not be sufficient and your employer may need to sign the corporate CLA. Once the CLA is signed, our tooling will perform checks and validations. Afterwards, the pull request will be tagged with If you have received this in error or have any questions, please contact us at [email protected]. Thanks! |
Summary: We conducted benchmarking experiments on full function estimate for Sobol sampling, BALV, and BALD acquisition functions. These tests were performed on three distinct functions and a real psychophysics task data set obtained from Letham et al. (2022).
Differential Revision: D57916855