test success mean and sd to be less sensitive to single runs #5
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
name: Run and Test | |
on: | |
push: | |
branches: ["master"] | |
pull_request: | |
branches: ["master"] | |
jobs: | |
build: | |
runs-on: ubuntu-latest | |
steps: | |
- name: Checkout repo | |
uses: actions/checkout@v4 | |
- name: Set up python | |
uses: actions/setup-python@v5 | |
with: | |
python-version: '3.11' | |
- name: Create results dir | |
run: mkdir results | |
- name: Install dependencies | |
run: pip install -r requirements.txt | |
- name: Run experiment 10 times | |
run: ./run_10.sh | |
- name: Test summary result values | |
run: python test_summary.py | |
- name: Test success rate values | |
run: python test_success_rate.py |