Skip to content

Commit

Permalink
too many open files bugfix
Browse files Browse the repository at this point in the history
  • Loading branch information
Jan Škoda committed Sep 3, 2023
1 parent 121807c commit 3cc8168
Show file tree
Hide file tree
Showing 2 changed files with 8 additions and 2 deletions.
6 changes: 6 additions & 0 deletions HISTORY.rst
Original file line number Diff line number Diff line change
Expand Up @@ -2,6 +2,12 @@
History
=======

0.6.3 (2023-08-03)
------------------

* logging fixes
* too many open files bugfix

0.6.2 (2023-08-18)
------------------

Expand Down
4 changes: 2 additions & 2 deletions lakeapi/_read_parquet.py
Original file line number Diff line number Diff line change
Expand Up @@ -53,10 +53,10 @@ def _pyarrow_parquet_file_wrapper(
raise
except pyarrow.ArrowInvalid as ex:
if str(ex) == "Parquet file size is 0 bytes":
_logger.warning("Ignoring empty file = {}", path)
_logger.warning("Ignoring empty file = %s", path)
return None
if str(ex) == "Parquet magic bytes not found in footer. Either the file is corrupted or this is not a parquet file.":
_logger.warning("Ignoring corrupted file = {}", path)
_logger.warning("Ignoring corrupted file = %s", path)
return None
raise

Expand Down

0 comments on commit 3cc8168

Please sign in to comment.