0.8.11

Fixes:

• fix the /valid endpoint (errors were counted as cache misses)

0.8.10

Features:

• make warm sleeps until cpu load is under a threshold before warming a new dataset
• add the MAX_LOAD_PCT environment variable to set this threshold

0.8.9

Features:

• warm: only one thread, sleep between two datasets, report the elapsed time for each dataset, only warm non cached dataset
• decrease the log level for anodyne cases

0.8.8

Features:

• enable concurrency, when the cache is persisted
• add the MAX_THREADS environment variable for make warm to specify the number of parallel threads

0.8.7

Fixes:

• CACHE_PERSIST is now prioritary over CACHE_DIRECTORY
• fix style and tests

0.8.6

Breaking:

• change the format of /valid and /cache responses

Features:

• add a script to warm the cache (make warm)
• add CACHE_DIRECTORY and CACHE_PERSIST environment variables to manage cache persistence
• reduce datasets library log level

Fixes:

• fix parsing of boolean env vars
• exceptions are now cached by the memoize decorator

Internals:

• add a test about the generation of cache reports

0.8.5

Features:

• add the /valid endpoint to get the list of valid datasets. A dataset is considered valid if all the possible API calls for this dataset are stored in the cache, return a valid response, and have not expired.

Internals:

• the result of query functions are now memoized, instead of the API responses

Deprecation:

• removed support for private datasets. See b08e649.

0.8.4

Breaking features:

• change the format of the "features" in the /rows endpoint, to ensure the order of features is preserved.

Note: it should have been a major release -> 0.9.0, but I forgot to do it...

0.8.3

Features:

• upgrade datasets dependency which includes:
  • huggingface/datasets#2938: useful to differentiate c4 from allenai/c4 for example
  • huggingface/datasets#2996: should reduce the number of "non implemented" errors

0.8.2

Fixes:

• fix: 🐛 create info instead of relying only on external file. See: #52

Refactor:

• refactor: 💡 rename FeatureItem into FeaturesItem