Skip to content

Commit

Permalink
FIX-modin-project#6778: Read parquet files without file extensions us…
Browse files Browse the repository at this point in the history
…ing fastparquet

In supporting fastparquet, modin takes the paths provided, globs them,
and filters them to only look at files with the .parq or .parquet
extension. This commit adds support so that if the path supplied is
explicitly a file, it will be included.

This commit also fixes the formatting issues for the `black` linter.

Signed-off by: Ari Brown <[email protected]>
  • Loading branch information
Ari Brown committed Nov 30, 2023
1 parent 9f186cc commit 1e761ba
Showing 1 changed file with 2 additions and 2 deletions.
4 changes: 2 additions & 2 deletions modin/pandas/test/test_io.py
Original file line number Diff line number Diff line change
Expand Up @@ -1468,14 +1468,14 @@ def comparator(df1, df2):
def test_read_parquet_no_extension(self, engine, make_parquet_file):
with ensure_clean(".parquet") as unique_filename:
# Remove the .parquet extension
no_ext_fname = unique_filename[:unique_filename.index(".parquet")]
no_ext_fname = unique_filename[: unique_filename.index(".parquet")]

make_parquet_file(filename=no_ext_fname)
eval_io(
fn_name="read_parquet",
# read_parquet kwargs
engine=engine,
path=no_ext_fname
path=no_ext_fname,
)

@pytest.mark.parametrize(
Expand Down

0 comments on commit 1e761ba

Please sign in to comment.