WIP: [R] Verify CRAN release-18.0.0-rc0

[amoeba]

Only using this to trigger crossbow jobs for the CRAN release. Do not merge.

[github-actions]

Thanks for opening a pull request!

If this is not a minor PR. Could you open an issue for this pull request on GitHub? https://github.com/apache/arrow/issues/new/choose

Opening GitHub issues ahead of time contributes to the Openness of the Apache Arrow project.

Then could you also rename the pull request title in the following format?

GH-${GITHUB_ISSUE_ID}: [${COMPONENT}] ${SUMMARY}

or

MINOR: [${COMPONENT}] ${SUMMARY}

In the case of PARQUET issues on JIRA the title also supports:

PARQUET-${JIRA_ISSUE_ID}: [${COMPONENT}] ${SUMMARY}

See also:

• Other pull requests
• Contribution Guidelines - Contributing Overview

[amoeba]

@github-actions crossbow submit -g r

[github-actions]

Revision: f96684f

Submitted crossbow builds: ursacomputing/crossbow @ actions-f88c4a573f

Task	Status
r-binary-packages
test-r-arrow-backwards-compatibility
test-r-clang-sanitizer
test-r-depsource-bundled
test-r-depsource-system
test-r-dev-duckdb
test-r-devdocs
test-r-extra-packages
test-r-gcc-11
test-r-gcc-12
test-r-install-local
test-r-install-local-minsizerel
test-r-linux-as-cran
test-r-linux-rchk
test-r-linux-valgrind
test-r-macos-as-cran
test-r-minimal-build
test-r-offline-maximal
test-r-offline-minimal
test-r-rhub-debian-gcc-devel-lto-latest
test-r-rhub-debian-gcc-release-custom-ccache
test-r-rhub-ubuntu-release-latest
test-r-rocker-r-ver-latest
test-r-rstudio-r-base-4.1-opensuse155
test-r-rstudio-r-base-4.2-focal
test-r-ubuntu-22.04
test-r-versions
test-ubuntu-r-sanitizer

[amoeba]

@github-actions crossbow submit r-recheck-*

[amoeba]

@github-actions crossbow submit -g r

[github-actions]

Revision: 5a57166

Submitted crossbow builds: ursacomputing/crossbow @ actions-b60b8e8d5c

Task	Status
r-binary-packages
test-r-arrow-backwards-compatibility
test-r-clang-sanitizer
test-r-depsource-bundled
test-r-depsource-system
test-r-dev-duckdb
test-r-devdocs
test-r-extra-packages
test-r-gcc-11
test-r-gcc-12
test-r-install-local
test-r-install-local-minsizerel
test-r-linux-as-cran
test-r-linux-rchk
test-r-linux-valgrind
test-r-macos-as-cran
test-r-minimal-build
test-r-offline-maximal
test-r-offline-minimal
test-r-rhub-debian-gcc-devel-lto-latest
test-r-rhub-debian-gcc-release-custom-ccache
test-r-rhub-ubuntu-release-latest
test-r-rocker-r-ver-latest
test-r-rstudio-r-base-4.1-opensuse155
test-r-rstudio-r-base-4.2-focal
test-r-ubuntu-22.04
test-r-versions
test-ubuntu-r-sanitizer

[amoeba]

Crossbow jobs are looking better now but test-r-linux-as-cran is failing on what appears to be downloading Thrift. I took a look at the logs and it looks like it's trying a few mirrors, failing on each, and not trying the rest? According to the cmake docs, all of them should get tried. @assignUser do you have any ideas?

[amoeba]

@github-actions crossbow submit r-recheck-*

[github-actions]

Revision: 0230d89

Submitted crossbow builds: ursacomputing/crossbow @ actions-e6d1ebfdb9

Task	Status
r-recheck-most
r-recheck-strong

[jonkeane]

On the thrift timeout, I just tried each of the URLs that are listed in the logs and while the first one did work for me right now, all the rest 404ed. Which makes me think that something might be wrong with those URLs and we should update them so that we have backups again:

-- Downloading...
   dst='/tmp/RtmpAwPrlt/working_dir/RtmpBltHq0/file743780f417a/thrift_ep-prefix/src/thrift-0.16.0.tar.gz'
   timeout='none'
   inactivity timeout='none'
-- Using src='https://www.apache.org/dyn/closer.cgi?action=download&filename=/thrift/0.16.0/thrift-0.16.0.tar.gz'
-- Using src='https://downloads.apache.org/thrift/0.16.0/thrift-0.16.0.tar.gz'
-- Using src='https://apache.claz.org/thrift/0.16.0/thrift-0.16.0.tar.gz'
-- Using src='https://apache.cs.utah.edu/thrift/0.16.0/thrift-0.16.0.tar.gz'
-- Using src='https://apache.mirrors.lucidnetworks.net/thrift/0.16.0/thrift-0.16.0.tar.gz'
-- Using src='https://apache.osuosl.org/thrift/0.16.0/thrift-0.16.0.tar.gz'
-- [download 0% complete]
-- Using src='https://apache.cs.utah.edu/thrift/0.16.0/thrift-0.16.0.tar.gz'
-- Using src='https://apache.mirrors.lucidnetworks.net/thrift/0.16.0/thrift-0.16.0.tar.gz'
-- Using src='https://ftp.wayne.edu/apache/thrift/0.16.0/thrift-0.16.0.tar.gz'
-- [download 0% complete]
-- Using src='https://apache.cs.utah.edu/thrift/0.16.0/thrift-0.16.0.tar.gz'
-- Using src='https://apache.mirrors.lucidnetworks.net/thrift/0.16.0/thrift-0.16.0.tar.gz'
-- Using src='https://mirror.olnevhost.net/pub/apache/thrift/0.16.0/thrift-0.16.0.tar.gz'
-- [download 0% complete]

[amoeba]

Oh, you're right. I think only the closer.cgi one works for me. I'll look into that.

[amoeba]

Some observations:

• downloads.apache.org only has archives of Thrift 0.20.0 and 0.21.0 (current latest stable is 0.21.0)
• Apache appears to now (since 2021?) have a CDN: https://dlcdn.apache.org/thrift/. That also only has archives of 0.20.0 and 0.21.0.

https://apache.org/history/mirror-history.html gives more context and this sentence may explain why this list of URLs degraded over time:

Any organization that has been hosting an Apache download mirror site, and that finds it useful for its own purposes, may continue to host the mirror site.

So I think by continuing to use these mirror URLs we were living on borrowed time. The CDN is now the recommended way for users to download content from ASF projects.

So I think we actually need to do two things here:

• Change the URL to just use the ASF CDN
• Update our Thrift version in cpp/thirdparty/versions.txt to 0.20.0 or greater. Arrow C++ builds cleanly on my system when using Brew-provided Thrift 0.21.0 so it seems like this may be doable.

[amoeba]

We also use https://archive.apache.org/dist/thrift/ which has older versions (including 0.16.0), though I'm not sure if using it is appropriate.

[assignUser]

@amoeba yes we can use archive.a.o if we need an older version but imo if a newer version works we should update, I will create a blocker issue for 18.0.1

[amoeba]

Thanks @assignUser!

[amoeba]

Closing as we're done with this PR now. See #44496 for context.