forked from facebook/rocksdb
-
Notifications
You must be signed in to change notification settings - Fork 119
Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
Merge pull request #326 from rockset/igor_rocksdb_9.1.1
[SYS-7777] Upgrade RocksDB-Cloud to 9.1.1
- Loading branch information
Showing
855 changed files
with
35,668 additions
and
17,245 deletions.
There are no files selected for viewing
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,7 @@ | ||
| name: build-folly | ||
| runs: | ||
| using: composite | ||
| steps: | ||
| - name: Build folly and dependencies | ||
| run: make build_folly | ||
| shell: bash |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,8 @@ | ||
| name: build-for-benchmarks | ||
| runs: | ||
| using: composite | ||
| steps: | ||
| - uses: "./.github/actions/pre-steps" | ||
| - name: Linux build for benchmarks | ||
| run: make V=1 J=8 -j8 release | ||
| shell: bash |
10 changes: 10 additions & 0 deletions
10
.github/actions/increase-max-open-files-on-macos/action.yml
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,10 @@ | ||
| name: increase-max-open-files-on-macos | ||
| runs: | ||
| using: composite | ||
| steps: | ||
| - name: Increase max open files | ||
| run: |- | ||
| sudo sysctl -w kern.maxfiles=1048576 | ||
| sudo sysctl -w kern.maxfilesperproc=1048576 | ||
| sudo launchctl limit maxfiles 1048576 | ||
| shell: bash |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,7 @@ | ||
| name: install-gflags-on-macos | ||
| runs: | ||
| using: composite | ||
| steps: | ||
| - name: Install gflags on macos | ||
| run: HOMEBREW_NO_AUTO_UPDATE=1 brew install gflags | ||
| shell: bash |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,7 @@ | ||
| name: install-gflags | ||
| runs: | ||
| using: composite | ||
| steps: | ||
| - name: Install gflags | ||
| run: sudo apt-get update -y && sudo apt-get install -y libgflags-dev | ||
| shell: bash |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,9 @@ | ||
| name: install-jdk8-on-macos | ||
| runs: | ||
| using: composite | ||
| steps: | ||
| - name: Install JDK 8 on macos | ||
| run: |- | ||
| HOMEBREW_NO_AUTO_UPDATE=1 brew tap bell-sw/liberica | ||
| HOMEBREW_NO_AUTO_UPDATE=1 brew install --cask liberica-jdk8 | ||
| shell: bash |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,11 @@ | ||
| name: install-maven | ||
| runs: | ||
| using: composite | ||
| steps: | ||
| - name: Install Maven | ||
| run: | | ||
| wget --no-check-certificate https://dlcdn.apache.org/maven/maven-3/3.9.6/binaries/apache-maven-3.9.6-bin.tar.gz | ||
| tar zxf apache-maven-3.9.6-bin.tar.gz | ||
| echo "export M2_HOME=$(pwd)/apache-maven-3.9.6" >> $GITHUB_ENV | ||
| echo "$(pwd)/apache-maven-3.9.6/bin" >> $GITHUB_PATH | ||
| shell: bash |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,22 @@ | ||
| name: perform-benchmarks | ||
| runs: | ||
| using: composite | ||
| steps: | ||
| - name: Test low-variance benchmarks | ||
| run: "./tools/benchmark_ci.py --db_dir ${{ runner.temp }}/rocksdb-benchmark-datadir --output_dir ${{ runner.temp }}/benchmark-results --num_keys 20000000" | ||
| env: | ||
| LD_LIBRARY_PATH: "/usr/local/lib" | ||
| DURATION_RO: 300 | ||
| DURATION_RW: 500 | ||
| NUM_THREADS: 1 | ||
| MAX_BACKGROUND_JOBS: 4 | ||
| CI_TESTS_ONLY: 'true' | ||
| WRITE_BUFFER_SIZE_MB: 16 | ||
| TARGET_FILE_SIZE_BASE_MB: 16 | ||
| MAX_BYTES_FOR_LEVEL_BASE_MB: 64 | ||
| COMPRESSION_TYPE: none | ||
| CACHE_INDEX_AND_FILTER_BLOCKS: 1 | ||
| MIN_LEVEL_TO_COMPRESS: 3 | ||
| CACHE_SIZE_MB: 10240 | ||
| MB_WRITE_PER_SEC: 2 | ||
| shell: bash |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,17 @@ | ||
| name: post-benchmarks | ||
| runs: | ||
| using: composite | ||
| steps: | ||
| - name: Upload Benchmark Results artifact | ||
| uses: actions/[email protected] | ||
| with: | ||
| name: benchmark-results | ||
| path: "${{ runner.temp }}/benchmark-results/**" | ||
| if-no-files-found: error | ||
| - name: Send benchmark report to visualisation | ||
| run: |- | ||
| set +e | ||
| set +o pipefail | ||
| ./build_tools/benchmark_log_tool.py --tsvfile ${{ runner.temp }}/benchmark-results/report.tsv --esdocument https://search-rocksdb-bench-k2izhptfeap2hjfxteolsgsynm.us-west-2.es.amazonaws.com/bench_test3_rix/_doc | ||
| true | ||
| shell: bash |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,38 @@ | ||
| name: post-steps | ||
| description: Steps that are taken after a RocksDB job | ||
| inputs: | ||
| artifact-prefix: | ||
| description: Prefix to append to the name of artifacts that are uploaded | ||
| required: true | ||
| default: "${{ github.job }}" | ||
| runs: | ||
| using: composite | ||
| steps: | ||
| - name: Upload Test Results artifact | ||
| uses: actions/[email protected] | ||
| with: | ||
| name: "${{ inputs.artifact-prefix }}-test-results" | ||
| path: "${{ runner.temp }}/test-results/**" | ||
| - name: Upload DB LOG file artifact | ||
| uses: actions/[email protected] | ||
| with: | ||
| name: "${{ inputs.artifact-prefix }}-db-log-file" | ||
| path: LOG | ||
| - name: Copy Test Logs (on Failure) | ||
| if: ${{ failure() }} | ||
| run: | | ||
| mkdir -p ${{ runner.temp }}/failure-test-logs | ||
| cp -r t/* ${{ runner.temp }}/failure-test-logs | ||
| shell: bash | ||
| - name: Upload Test Logs (on Failure) artifact | ||
| uses: actions/[email protected] | ||
| with: | ||
| name: "${{ inputs.artifact-prefix }}-failure-test-logs" | ||
| path: ${{ runner.temp }}/failure-test-logs/** | ||
| if-no-files-found: ignore | ||
| - name: Upload Core Dumps artifact | ||
| uses: actions/[email protected] | ||
| with: | ||
| name: "${{ inputs.artifact-prefix }}-core-dumps" | ||
| path: "core.*" | ||
| if-no-files-found: ignore |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,5 @@ | ||
| name: pre-steps-macos | ||
| runs: | ||
| using: composite | ||
| steps: | ||
| - uses: "./.github/actions/pre-steps" |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,18 @@ | ||
| name: pre-steps | ||
| runs: | ||
| using: composite | ||
| steps: | ||
| - name: Setup Environment Variables | ||
| run: |- | ||
| echo "GTEST_THROW_ON_FAILURE=0" >> "$GITHUB_ENV" | ||
| echo "GTEST_OUTPUT=\"xml:${{ runner.temp }}/test-results/\"" >> "$GITHUB_ENV" | ||
| echo "SKIP_FORMAT_BUCK_CHECKS=1" >> "$GITHUB_ENV" | ||
| echo "GTEST_COLOR=1" >> "$GITHUB_ENV" | ||
| echo "CTEST_OUTPUT_ON_FAILURE=1" >> "$GITHUB_ENV" | ||
| echo "CTEST_TEST_TIMEOUT=300" >> "$GITHUB_ENV" | ||
| echo "ZLIB_DOWNLOAD_BASE=https://rocksdb-deps.s3.us-west-2.amazonaws.com/pkgs/zlib" >> "$GITHUB_ENV" | ||
| echo "BZIP2_DOWNLOAD_BASE=https://rocksdb-deps.s3.us-west-2.amazonaws.com/pkgs/bzip2" >> "$GITHUB_ENV" | ||
| echo "SNAPPY_DOWNLOAD_BASE=https://rocksdb-deps.s3.us-west-2.amazonaws.com/pkgs/snappy" >> "$GITHUB_ENV" | ||
| echo "LZ4_DOWNLOAD_BASE=https://rocksdb-deps.s3.us-west-2.amazonaws.com/pkgs/lz4" >> "$GITHUB_ENV" | ||
| echo "ZSTD_DOWNLOAD_BASE=https://rocksdb-deps.s3.us-west-2.amazonaws.com/pkgs/zstd" >> "$GITHUB_ENV" | ||
| shell: bash |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,7 @@ | ||
| name: setup-folly | ||
| runs: | ||
| using: composite | ||
| steps: | ||
| - name: Checkout folly sources | ||
| run: make checkout_folly | ||
| shell: bash |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,20 @@ | ||
| name: build-folly | ||
| runs: | ||
| using: composite | ||
| steps: | ||
| - name: Fix repo ownership | ||
| # Needed in some cases, as safe.directory setting doesn't take effect | ||
| # under env -i | ||
| run: chown `whoami` . || true | ||
| shell: bash | ||
| - name: Set upstream | ||
| run: git remote add upstream https://github.com/facebook/rocksdb.git | ||
| shell: bash | ||
| - name: Fetch upstream | ||
| run: git fetch upstream | ||
| shell: bash | ||
| - name: Git status | ||
| # NOTE: some old branch builds under check_format_compatible.sh invoke | ||
| # git under env -i | ||
| run: git status && git remote -v && env -i git branch | ||
| shell: bash |
Oops, something went wrong.