[CI][Python][Parquet] Failed to open local file column_chunk_key_value_metadata.parquet

[wgtmac]

Describe the bug, including details regarding any error messages, version, and platform.

https://github.com/apache/arrow/actions/runs/10493727075/job/29068353962?pr=40594

=================================== FAILURES ===================================
_____________________ test_column_chunk_key_value_metadata _____________________

parquet_test_datadir = PosixPath('/Users/runner/work/arrow/arrow/cpp/submodules/parquet-testing/data')

    def test_column_chunk_key_value_metadata(parquet_test_datadir):
>       metadata = pq.read_metadata(parquet_test_datadir /
                                    'column_chunk_key_value_metadata.parquet')

/Library/Frameworks/Python.framework/Versions/3.11/lib/python3.11/site-packages/pyarrow/tests/parquet/test_metadata.py:788: 
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 
/Library/Frameworks/Python.framework/Versions/3.11/lib/python3.11/site-packages/pyarrow/parquet/core.py:2297: in read_metadata
    file_ctx = where = filesystem.open_input_file(where)
pyarrow/_fs.pyx:789: in pyarrow._fs.FileSystem.open_input_file
    ???
pyarrow/error.pxi:155: in pyarrow.lib.pyarrow_internal_check_status
    ???
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 

>   ???
E   FileNotFoundError: [Errno 2] Failed to open local file '/Users/runner/work/arrow/arrow/cpp/submodules/parquet-testing/data/column_chunk_key_value_metadata.parquet'. Detail: [errno 2] No such file or directory

pyarrow/error.pxi:92: FileNotFoundError

Component(s)

Parquet, Python

[wgtmac]

This commit is suspicious: #41580

cc @mapleFU

[wgtmac]

A similar one but with different file: https://github.com/apache/arrow/actions/runs/10493727068/job/29068354546?pr=40594

[ RUN      ] TestArrowReadWrite.FuzzReader
unknown file: Failure
C++ exception with description "IOError: Failed to open local file '/Users/runner/work/arrow/arrow/cpp/submodules/parquet-testing/data/../bad_data/ARROW-GH-41317.parquet'. Detail: [errno 2] No such file or directory" thrown in the test body.
[  FAILED  ] TestArrowReadWrite.FuzzReader (1 ms)

[wgtmac]

Never mind, I made a mistake in the rebase: #40594

[jorisvandenbossche]

This is actually an issue for some of the nightly crossbow builds, see also my comment at #41580 (comment), so going to reuse this issue for that, since it already has the correct title :)

[mapleFU]

I'll tackle this tonigh

[jorisvandenbossche]

I already opened a PR for the wheel tests, but as mentioned in #41580 (comment), also the python-emscriptem test currently is failing because of this (that is not yet tackled in my current PR)

[jorisvandenbossche]

Issue resolved by pull request 43786
#43786