We’d like to announce the release of Hyperleaup 0.1.2, which introduces the following improvements:
- Adds an experimental
LARGEFILE
creation mode option to improve performance when creating a Hyper file for a large dataset. It does this by saving multiple files and using an array of Parquet file paths in the Tableau Hyper APICOPY
command.
Note: This creation mode only works with the Databricks File System (DBFS).
Credits: Dustin Vannoy (@dustinvannoy-db)