You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
We should make sure the write_clean_file is a relatively sane and generalizable format. At the very least there are a few use cases we should keep in mind:
Generating object key prefix/path to easily handle the required structure for Glue crawler/partitioning.
Easily give the user the ability to just specify a new file extension without worrying about the actual raw filename.
These could be considered generally useful utilities. So they should go in the glue module if that makes sense or they could live in the more general util module or somewhere similar.
The text was updated successfully, but these errors were encountered:
We should make sure the
write_clean_file
is a relatively sane and generalizable format. At the very least there are a few use cases we should keep in mind:These could be considered generally useful utilities. So they should go in the glue module if that makes sense or they could live in the more general
util
module or somewhere similar.The text was updated successfully, but these errors were encountered: