Add generation caching in TextEnvironment and fix bugs in TextEnvironment#2556

Open

konrad-gerlach wants to merge 20 commits intohuggingface:mainfrom konrad-gerlach:text_environment_caching

+507-47

Commits on Jan 10, 2025

feat: add caching for TextEnvironment and fix bugs
Konrad Gerlach
committed
feat: make TextEnvironment caching optional and add documentation
Konrad Gerlach
committed
fix: failing TextEnvironment tests
Konrad Gerlach
committed
test: add tests for TextEnvironment caching and fix cache combining bug
Konrad Gerlach
committed
test: remove unnecessary parametrized class decorator
Konrad Gerlach
committed
docs: update TextEnvironmentDocs with caching
Konrad Gerlach
committed
fix: run linter on TextEnvironment and TextEnvironment tests
Konrad Gerlach
committed
fix: comment
Konrad Gerlach
committed
fix: Args comment
Konrad Gerlach
committed
fix: TextEnvironment cache combination and batching issue
Konrad Gerlach
committed
tests: make caching test more complex
Konrad Gerlach
committed

Commits on Jan 11, 2025

fix: combine caches of different sequence lengths
Konrad Gerlach
committed

Commits on Jan 12, 2025

Commits on Jan 14, 2025

fix: attended to invalid last generated token and off-by-one in StringStoppingCriteria
Konrad Gerlach
committed

Commits on Jan 15, 2025

Merge branch 'main' into text_environment_caching
konrad-gerlach
authored