v1.13.0

What's Changed

Features

• Support Llama3.2 by @pascal-pfeiffer in #868
• Default model list can be configured with ENV vars by @pascal-pfeiffer in #870

Fixes

• Cap progress to 0.99 if experiment is still running by @us8945 in #861
• Pass settings for hf_transfer & chore by @pascal-pfeiffer in #864
• Fix flash attention in docker image by @pascal-pfeiffer in #857

Documentation

• Updates README.md by @arishokri in #862
• Expand dataset import connectors by @oshi98 in #866
• Add importing dataset with h2o drive by @oshi98 in #859

Chore

• Refactor structure by @pascal-pfeiffer in #838
• app.toml updates by @pascal-pfeiffer in #871

New Contributors

• @us8945 made their first contribution in #861
• @arishokri made their first contribution in #862

Full Changelog: v1.12.1...v1.13.0

Field Installation Instructions

v1.12.1

What's Changed

• [FIX] download routing for BASE_URL by @pascal-pfeiffer in #852

Full Changelog: v1.12.0...v1.12.1

Field Installation Instructions

v1.12.0

What's Changed

• [FEATURE] New default datasets for classification and regression by @psinger in #833
• [FEATURE] Package default datasets into the docker image by @pascal-pfeiffer in #837
• [CHORE] Testing, typing by @pascal-pfeiffer in #841
• [CHORE] update torch, transformers and co by @pascal-pfeiffer in #847
• [CHORE] Update Makersaurus and solve critical vulnerability by @5675sp in #848

Full Changelog: v1.11.1...v1.12.0

Field Installation Instructions

v1.11.1

What's Changed

• [HOTFIX] no logging permissions in docker by @pascal-pfeiffer in #835
• [DOC] Add Runpod template to README by @pascal-pfeiffer in #832
• [CHORE] testing and cleanup by @pascal-pfeiffer in #831
• [CHORE] Raise Error if missing system col in train DataFrame by @pascal-pfeiffer in #834

Full Changelog: v1.11.0...v1.11.1

Field Installation Instructions

v1.11.0

What's Changed

• [FEATURE] Allow larger max settings for token length and num_classes by @pascal-pfeiffer in #812
• [FEATURE] Add option for W&B logging by @pascal-pfeiffer in #811
• [FEATURE] Classification & Regression multilabel by @psinger in #815
• [FEATURE] Min learning rate ratio by @psinger in #821
• [FEATURE] New setting: log_step_size by @psinger in #820
• [FIX] fix typo in HF dataset import by @pascal-pfeiffer in #816
• [FIX] Fixes HF token issue for login by @psinger in #824
• [FIX] Tokenizer config fix by @psinger in #827
• [CHORE] run nvidia-smi at startup by @pascal-pfeiffer in #808
• [CHORE] Update to wave 1.4.0 by @pascal-pfeiffer in #825
• [CHORE] Refactor local logging by @pascal-pfeiffer in #817

Full Changelog: v1.10.0...v1.11.0

v1.10.0

What's Changed

• [FEATURE] Causal Regression Modeling by @psinger in #788
• [FEATURE] New setting HF_transfer by @pascal-pfeiffer in #790
• [FEATURE] Add random validation sample #683 by @sarthak247 in #786
• [FEATURE] Add Rank Stabilization Scaling Factor for Fine-Tuning with LoRA by @pascal-pfeiffer in #791
• [FEATURE] HF Data import by @psinger in #793
• [FEATURE] H2O Danube3 and update to default model list by @pascal-pfeiffer in #800
• [FEATURE] Setting for default device for downloads by @psinger in #795
• [FEATURE] Copy chat to clipboard by @psinger in #804
• [FIX] Minor doc link fixes by @sherenem in #784
• [FIX] Fix dockerimage by @pascal-pfeiffer in #799
• [CHORE] Add wave bundle by @pascal-pfeiffer in #803
• [CHORE] Add more unit tests by @pascal-pfeiffer in #789
• [CHORE] remove packer for cloud images by @pascal-pfeiffer in #802
• [CHORE] Only dark theme by @pascal-pfeiffer in #794

New Contributors

• @sarthak247 made their first contribution in #786

Full Changelog: v1.9.0...v1.10.0

v1.9.0

What's Changed

• [FEATURE] Support for Llama3.1 by @psinger in #777
• [FEATURE] H2O drive support for dataset import by @pascal-pfeiffer in #771
• [FEATURE] CPO & SimPO Loss by @psinger in #749
• [DOCS] Improve LLM Backbone Explanations by @mtanco in #766
• [FEATURE] Add new setting: prompt_column_separator by @pascal-pfeiffer in #724
• [FEATURE] Allow to mask all but last answer by @psinger in #753
• [FIX] Do not break app when experiment folder is missing by @psinger in #776
• [FEATURE] Fine grained options for attention implementation by @psinger in #775

New Contributors

• @mtanco made their first contribution in #766

Full Changelog: v1.8.0...v1.9.0

v1.8.0

What's Changed

• [FEATURE] Grid Search for Hyperparameters by @pascal-pfeiffer in #742
• [CHORE] Update h2o-wave to 1.3.3 by @pascal-pfeiffer in #761
• [DOCS] Add new FAQs by @sherenem in #756

Full Changelog: v1.7.0...v1.8.0

v1.7.0

What's Changed

• [FEATURE] Arrbitrary tokenizer kwargs by @psinger in #718
• [FIX] fix unresponsive app by @pascal-pfeiffer in #720
• [FEATURE] Save each evaluation epoch by @pascal-pfeiffer in #721
• [IMPROVEMENT] Improve dataset import by @pascal-pfeiffer in #717
• [FEATURE] Allow to use DPO without LoRA by @psinger in #726
• [FEATURE] Option to freeze (non lora) and unfreeze (lora) layers by @psinger in #731
• [DOCS] Improve FAQ page by @sherenem in #739
• [FEATURE] Save LoRA adapter for download by @pascal-pfeiffer in #729
• [DOCS] Remove invalid reference to tooltip by @sherenem in #744
• [DOCS] minor fix by @pascal-pfeiffer in #745
• [CHORE] Fully remove RLHF in favor of DPO by @pascal-pfeiffer in #747
• [IMPROVEMENT] Max Length rework by @psinger in #741
• [FIX] Deepseek tokenizer by @psinger in #746
• [FIX] only show default entries once by @pascal-pfeiffer in #751

Full Changelog: v1.6.0...v1.7.0

v1.6.0

What's Changed

• [FEATURE] log lora params with logger by @pascal-pfeiffer in #687
• [CHORE] Add a doc link to the GH repo by @sherenem in #693
• [FEATURE] Save checkpoint options by @psinger in #692
• [CHORE] update all actions to node20 versions by @pascal-pfeiffer in #697
• [DOCS] Minor fixes by @sherenem in #696
• [FEATURE] Apply chat template for HF by @haqishen in #660
• [DOCS] Update experiment-settings.md by @5675sp in #703
• [CHORE] add codeowners by @pascal-pfeiffer in #705
• [FEATURE] Add make command stop-llmstudio by @pascal-pfeiffer in #698
• [CHORE] Add the UI tests to github actions by @pascal-pfeiffer in #708
• [FEATURE] Add DoRA support by @pascal-pfeiffer in #709
• [FIX] remove cast to float32 and float16 when using CPU for pushing to HF by @pascal-pfeiffer in #707
• [FIX] fix tooltips and remove parent id for classification tasks by @pascal-pfeiffer in #712
• [FIX] remove sampling params when do_sample==False by @haqishen in #714

New Contributors

• @5675sp made their first contribution in #703

Full Changelog: v1.5.0...v1.6.0