Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Better Plotting of Performance History Data #125

Merged
merged 19 commits into from
Aug 31, 2020
Merged

Better Plotting of Performance History Data #125

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
19 commits
Select commit Hold shift + click to select a range
b2b6c03
Use new-plot branch of ci-perf-kit
qinsoon Aug 12, 2020
9a746fb
Use branch-name action to get branch name as env var
qinsoon Aug 12, 2020
6f2034c
Fix env var
qinsoon Aug 12, 2020
aded778
Publish result to branch dir
qinsoon Aug 12, 2020
3ddf410
Remove destination_dir (keep_files can do the same)
qinsoon Aug 13, 2020
c60235e
Get branch name from GITHUB_REF
qinsoon Aug 13, 2020
2b998ea
Test with history data in self-hosted branch (no commiting)
qinsoon Aug 14, 2020
db12ceb
Use ci-perf-kit 0.3.2
qinsoon Aug 14, 2020
b5e8072
Use ci-perf-kit 0.3.2-fix
qinsoon Aug 16, 2020
7c86a85
Use ci-perf-kit 0.3.3
qinsoon Aug 17, 2020
02972b9
Test with new ci-perf-kit
qinsoon Aug 24, 2020
e7e6d15
Dont run mutator perf
qinsoon Aug 24, 2020
9e11086
Trigger CI
qinsoon Aug 24, 2020
b31e1ad
Test with self-hosted branch
qinsoon Aug 24, 2020
4c79d44
test uploading result
qinsoon Aug 24, 2020
caa6611
Test with ci-perf-kit master
qinsoon Aug 25, 2020
fb9f33c
Upload result to test branch
qinsoon Aug 25, 2020
de9b4ab
Use ci-perf-kit 0.3.5
qinsoon Aug 26, 2020
6f24667
Fix
qinsoon Aug 26, 2020
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
23 changes: 16 additions & 7 deletions .github/workflows/perf-regression-ci.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -28,7 +28,7 @@ jobs:
with:
repository: mmtk/ci-perf-kit
token: ${{ secrets.CI_ACCESS_TOKEN }}
ref: "0.3.1"
ref: "0.3.5"
path: ci-perf-kit
submodules: true
# setup
Expand All @@ -39,6 +39,9 @@ jobs:
./ci-perf-kit/scripts/history-run-setup.sh
mkdir -p ci-perf-kit/running/benchmarks/dacapo
cp /usr/share/benchmarks/dacapo/dacapo-2006-10-MR2.jar ci-perf-kit/running/benchmarks/dacapo
- id: branch
# we cannot use env vars in action input (the deploy step). So put the env var to this step's outputs.
run: echo "::set-output name=branch_name::$(echo ${GITHUB_REF#refs/heads/} | sed 's/\//_/g')"
# run
- name: Performance Run
run: |
Expand All @@ -47,7 +50,7 @@ jobs:
export RESULT_REPO_BRANCH=self-hosted
export RESULT_REPO_ACCESS_TOKEN=${{ secrets.CI_ACCESS_TOKEN }}
export FROM_DATE=2020-07-10
JAVA_HOME=/usr/lib/jvm/java-1.8.0-openjdk-amd64 ./ci-perf-kit/scripts/jikesrvm-history-run.sh ./mmtk-jikesrvm ./reports
JAVA_HOME=/usr/lib/jvm/java-1.8.0-openjdk-amd64 ./ci-perf-kit/scripts/jikesrvm-history-run.sh ./mmtk-jikesrvm ./reports/${{ steps.branch.outputs.branch_name }}
# deploy
- name: Deploy to Github Page
uses: peaceiris/actions-gh-pages@v3
Expand Down Expand Up @@ -79,7 +82,7 @@ jobs:
with:
repository: mmtk/ci-perf-kit
token: ${{ secrets.CI_ACCESS_TOKEN }}
ref: "0.3.1"
ref: "0.3.5"
path: ci-perf-kit
submodules: true
# setup
Expand All @@ -92,6 +95,9 @@ jobs:
cp /usr/share/benchmarks/dacapo/dacapo-2006-10-MR2.jar ci-perf-kit/running/benchmarks/dacapo
sed -i 's/^mmtk[[:space:]]=/#ci:mmtk=/g' mmtk-openjdk/mmtk/Cargo.toml
sed -i 's/^#[[:space:]]mmtk/mmtk/g' mmtk-openjdk/mmtk/Cargo.toml
- id: branch
# we cannot use env vars in action input (the deploy step). So put the env var to this step's outputs.
run: echo "::set-output name=branch_name::$(echo ${GITHUB_REF#refs/heads/} | sed 's/\//_/g')"
# run
- name: Performance Run
run: |
Expand All @@ -100,7 +106,7 @@ jobs:
export RESULT_REPO_BRANCH=self-hosted
export RESULT_REPO_ACCESS_TOKEN=${{ secrets.CI_ACCESS_TOKEN }}
export FROM_DATE=2020-07-10
./ci-perf-kit/scripts/openjdk-history-run.sh ./mmtk-openjdk ./reports
./ci-perf-kit/scripts/openjdk-history-run.sh ./mmtk-openjdk ./reports/${{ steps.branch.outputs.branch_name }}
# deploy
- name: Deploy to Github Page
uses: peaceiris/actions-gh-pages@v3
Expand All @@ -111,7 +117,7 @@ jobs:
publish_branch: gh-pages
keep_files: true

opennjdk-mutator-perf:
openjdk-mutator-perf:
runs-on: [self-hosted, Linux, freq-scaling-off]
steps:
- name: Checkout MMTk Core
Expand All @@ -131,12 +137,15 @@ jobs:
with:
repository: mmtk/ci-perf-kit
token: ${{ secrets.CI_ACCESS_TOKEN }}
ref: "0.3.1"
ref: "0.3.5"
path: ci-perf-kit
submodules: true
# setup
- name: Overwrite MMTk core in openjdk binding
run: cp -r mmtk-core mmtk-openjdk/repos/
- id: branch
# we cannot use env vars in action input (the deploy step). So put the env var to this step's outputs.
run: echo "::set-output name=branch_name::$(echo ${GITHUB_REF#refs/heads/} | sed 's/\//_/g')"
- name: Setup
run: |
./ci-perf-kit/scripts/history-run-setup.sh
Expand All @@ -153,7 +162,7 @@ jobs:
export RESULT_REPO_ACCESS_TOKEN=${{ secrets.CI_ACCESS_TOKEN }}
export FROM_DATE=2020-08-03
export JAVA_HOME=/usr/lib/jvm/java-1.6.0-openjdk-amd64
./ci-perf-kit/scripts/mutator-history-run.sh ./mmtk-openjdk ./reports
./ci-perf-kit/scripts/mutator-history-run.sh ./mmtk-openjdk ./reports/${{ steps.branch.outputs.branch_name }}
# deploy
- name: Deploy to Github Page
uses: peaceiris/actions-gh-pages@v3
Expand Down
4 changes: 2 additions & 2 deletions .github/workflows/post-review-ci.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -86,7 +86,7 @@ jobs:
with:
repository: mmtk/ci-perf-kit
token: ${{ secrets.CI_ACCESS_TOKEN }}
ref: "0.3.1"
ref: "0.3.5"
path: ci-perf-kit
submodules: true
# setup
Expand Down Expand Up @@ -208,7 +208,7 @@ jobs:
with:
repository: mmtk/ci-perf-kit
token: ${{ secrets.CI_ACCESS_TOKEN }}
ref: "0.3.1"
ref: "0.3.5"
path: ci-perf-kit
submodules: true
# setup
Expand Down