Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

AVRO-3653: [CI] Linux ARM64 on GitHub actions #1964

Merged
merged 24 commits into from
Oct 4, 2023
Merged

AVRO-3653: [CI] Linux ARM64 on GitHub actions #1964

merged 24 commits into from
Oct 4, 2023

Conversation

martin-g
Copy link
Member

@martin-g martin-g commented Nov 14, 2022 •
edited
Loading

AVRO-3653

What is the purpose of the change

  • Build and test Avro SDKs on Linux ARM64 at Github Actions via self-hosted Graviton runner at AWS

Verifying this change

  • The CI workflow should pass

Documentation

  • Does this pull request introduce a new feature? no

@martin-g martin-g force-pushed the avro-3653-arm64-on-github-actions branch 3 times, most recently from ab493b7 to b652897 Compare November 14, 2022 19:51
@martin-g martin-g changed the title AVRO-3653: [CI] LInux ARM64 on GitHub actions AVRO-3653: [CI] Linux ARM64 on GitHub actions Nov 24, 2022
@martin-g martin-g force-pushed the avro-3653-arm64-on-github-actions branch from b652897 to 115c49f Compare April 11, 2023 10:59
@github-actions github-actions bot added the Java Pull Requests for Java binding label Apr 11, 2023
@martin-g martin-g force-pushed the avro-3653-arm64-on-github-actions branch from ce07da9 to 4ac60ae Compare April 11, 2023 13:14
@github-actions github-actions bot added C# and removed Java Pull Requests for Java binding labels Apr 12, 2023
@martin-g martin-g force-pushed the avro-3653-arm64-on-github-actions branch from 74f021c to 8f26edb Compare April 12, 2023 09:28
martin-g added 18 commits October 2, 2023 16:39
@martin-g
AVRO-3653: [CI] Use Github Actions with QEMU for testing on Linux ARM64
9902370 
Migrate the Java build from .travis.yaml

Signed-off-by: Martin Tzvetanov Grigorov <[email protected]>
@martin-g
AVRO-3653: [CI] Add jobs for all SDKs
8c636a3 
Signed-off-by: Martin Tzvetanov Grigorov <[email protected]>
@martin-g
AVRO-3653: [CI] Override env.GITHUB_WORKFLOW
4de41a5 
This is a workaround for uraimo/run-on-arch-action#100

Signed-off-by: Martin Tzvetanov Grigorov <[email protected]>
@martin-g
AVRO-3653: Add ASLv2 for the new workflow file
55df593 
Signed-off-by: Martin Tzvetanov Grigorov <[email protected]>
@martin-g
AVRO-3653: Git push should trigger only if it is on master branch
24339d9 
Signed-off-by: Martin Tzvetanov Grigorov <[email protected]>
@martin-g
AVRO-3653: Can't use ubuntu-20.04-xl
0d0b0cb 
Signed-off-by: Martin Tzvetanov Grigorov <[email protected]>
@martin-g
AVRO-3563: Rust - build only, no tests
b8c434b 
Python: change the default wait time. Just for debugging purposes

Signed-off-by: Martin Tzvetanov Grigorov <[email protected]>
@martin-g
AVRO-3653: Cast the env vars values from string to int
8ddc331 
Signed-off-by: Martin Tzvetanov Grigorov <[email protected]>
@martin-g
AVRO-3653: Build only apache-avro Rust crate
061ece4 
Signed-off-by: Martin Tzvetanov Grigorov <[email protected]>
@martin-g
AVRO-3653: Format the Python code
a56aaa9 
Fixes the CI for Python

Signed-off-by: Martin Tzvetanov Grigorov <[email protected]>
@martin-g
AVRO-3653: Install .NET 7.0
23a5dc0 
Signed-off-by: Martin Tzvetanov Grigorov <[email protected]>
@martin-g
AVRO-3653: Install libyaml-dev for the Ruby job
076d518 
Signed-off-by: Martin Tzvetanov Grigorov <[email protected]>
@martin-g
AVRO-3653: Run the Rust SDK tests
5ef57dd 
Signed-off-by: Martin Tzvetanov Grigorov <[email protected]>
@martin-g
AVRO-3653: Use tox instead of tox-wheel
b39a9be 
Port the improvement from AVRO-3696

Signed-off-by: Martin Tzvetanov Grigorov <[email protected]>
@martin-g
AVRO-3653: Update Maven to 3.9.1
177c435 
Signed-off-by: Martin Tzvetanov Grigorov <[email protected]>
@martin-g
AVRO-3653: Python Tox 4.x uses TOX_OVERRIDE
62cbe79 
tox-dev/tox#2681

Tox 4.x does not support Python 3.6

Signed-off-by: Martin Tzvetanov Grigorov <[email protected]>
@martin-g
AVRO-3653: Try to debug the issue with Snappy code in Java
64f5a43 
Signed-off-by: Martin Tzvetanov Grigorov <[email protected]>
@martin-g
AVRO-3653: Allow passing BENCH_MAX_WRITE_SECONDS and BENCH_MAX_READ_S…
a39ed8e 
…ECONDS to tox

Signed-off-by: Martin Tzvetanov Grigorov <[email protected]>
@martin-g
AVRO-3653: Exclude Snappy codec tests for ARM64
2706b22 
Install python3-distutils for the Python SDK

Signed-off-by: Martin Tzvetanov Grigorov <[email protected]>
@martin-g
AVRO-3653: $(MSBuildThisFileDirectory) already has trailing '/'
f6c8e9e 
Signed-off-by: Martin Tzvetanov Grigorov <[email protected]>
@martin-g
AVRO-3653: Use Ubuntu 22.04 for the ARM64 VMs
a86d89d 
Signed-off-by: Martin Tzvetanov Grigorov <[email protected]>
@martin-g
AVRO-3653: Try with python3.7-distutils
d9764bc 
Signed-off-by: Martin Tzvetanov Grigorov <[email protected]>
@martin-g
AVRO-3653: Exclude TestNettyServer. It fails too often
c56c41e 
Signed-off-by: Martin Tzvetanov Grigorov <[email protected]>
@martin-g martin-g force-pushed the avro-3653-arm64-on-github-actions branch 3 times, most recently from 0e35216 to a36a834 Compare October 2, 2023 20:24
@martin-g martin-g marked this pull request as ready for review October 2, 2023 21:07
@martin-g martin-g force-pushed the avro-3653-arm64-on-github-actions branch from a36a834 to ae3b022 Compare October 3, 2023 06:15
@github-actions github-actions bot removed the C# label Oct 3, 2023
@martin-g martin-g force-pushed the avro-3653-arm64-on-github-actions branch 2 times, most recently from af55099 to 65d7217 Compare October 3, 2023 06:16
@github-actions github-actions bot removed the Python label Oct 3, 2023
@martin-g martin-g force-pushed the avro-3653-arm64-on-github-actions branch 2 times, most recently from dd9c4cf to 8240a6c Compare October 3, 2023 11:08
@martin-g martin-g force-pushed the avro-3653-arm64-on-github-actions branch from 8240a6c to f6fe24c Compare October 3, 2023 11:33
@martin-g martin-g merged commit 119c3fc into master Oct 4, 2023
12 checks passed
@martin-g martin-g deleted the avro-3653-arm64-on-github-actions branch October 4, 2023 08:09
RanbirK pushed a commit to RanbirK/avro that referenced this pull request May 13, 2024
@martin-g
AVRO-3653: [CI] Linux ARM64 on GitHub actions (apache#1964)
d874da5 
* AVRO-3653: [CI] Use Github Actions for testing on Linux ARM64

Migrate the Java build from .travis.yaml

Signed-off-by: Martin Tzvetanov Grigorov <[email protected]>

* AVRO-3653: [CI] Add jobs for all SDKs

Signed-off-by: Martin Tzvetanov Grigorov <[email protected]>

* AVRO-3653: [CI] Override env.GITHUB_WORKFLOW

This is a workaround for uraimo/run-on-arch-action#100

Signed-off-by: Martin Tzvetanov Grigorov <[email protected]>

* AVRO-3653: Add ASLv2 for the new workflow file

Signed-off-by: Martin Tzvetanov Grigorov <[email protected]>

* AVRO-3653: Git push should trigger only if it is on master branch

Signed-off-by: Martin Tzvetanov Grigorov <[email protected]>

* AVRO-3653: Can't use ubuntu-20.04-xl

Signed-off-by: Martin Tzvetanov Grigorov <[email protected]>

* AVRO-3563: Rust - build only, no tests

Python: change the default wait time. Just for debugging purposes

Signed-off-by: Martin Tzvetanov Grigorov <[email protected]>

* AVRO-3653: Cast the env vars values from string to int

Signed-off-by: Martin Tzvetanov Grigorov <[email protected]>

* AVRO-3653: Build only apache-avro Rust crate

Signed-off-by: Martin Tzvetanov Grigorov <[email protected]>

* AVRO-3653: Format the Python code

Fixes the CI for Python

Signed-off-by: Martin Tzvetanov Grigorov <[email protected]>

* AVRO-3653: Install .NET 7.0

Signed-off-by: Martin Tzvetanov Grigorov <[email protected]>

* AVRO-3653: Install libyaml-dev for the Ruby job

Signed-off-by: Martin Tzvetanov Grigorov <[email protected]>

* AVRO-3653: Run the Rust SDK tests

Signed-off-by: Martin Tzvetanov Grigorov <[email protected]>

* AVRO-3653: Use tox instead of tox-wheel

Port the improvement from AVRO-3696

Signed-off-by: Martin Tzvetanov Grigorov <[email protected]>

* AVRO-3653: Update Maven to 3.9.1

Signed-off-by: Martin Tzvetanov Grigorov <[email protected]>

* AVRO-3653: Python Tox 4.x uses TOX_OVERRIDE

tox-dev/tox#2681

Tox 4.x does not support Python 3.6

Signed-off-by: Martin Tzvetanov Grigorov <[email protected]>

* AVRO-3653: Try to debug the issue with Snappy code in Java

Signed-off-by: Martin Tzvetanov Grigorov <[email protected]>

* AVRO-3653: Allow passing BENCH_MAX_WRITE_SECONDS and BENCH_MAX_READ_SECONDS to tox

Signed-off-by: Martin Tzvetanov Grigorov <[email protected]>

* AVRO-3653: Exclude Snappy codec tests for ARM64

Install python3-distutils for the Python SDK

Signed-off-by: Martin Tzvetanov Grigorov <[email protected]>

* AVRO-3653: $(MSBuildThisFileDirectory) already has trailing '/'

Signed-off-by: Martin Tzvetanov Grigorov <[email protected]>

* AVRO-3653: Use Ubuntu 22.04 for the ARM64 VMs

Signed-off-by: Martin Tzvetanov Grigorov <[email protected]>

* AVRO-3653: Try with python3.7-distutils

Signed-off-by: Martin Tzvetanov Grigorov <[email protected]>

* AVRO-3653: Exclude TestNettyServer. It fails too often

Signed-off-by: Martin Tzvetanov Grigorov <[email protected]>

* AVRO-3653: Use the new self-hosted ARM64 nodes provided by ASF Infra

Signed-off-by: Martin Tzvetanov Grigorov <[email protected]>

---------

Signed-off-by: Martin Tzvetanov Grigorov <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
build
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
1 participant
@martin-g