What's Changed
- [ENH] add strict decoding OAI by @YannDubs in #394
- Add blendaxai-gm-l6-vo31 to AlpacaEval by @ym-blendax-ai in #399
- Added Llama3-PBM-Nova-70B model by @PKU-Baichuan in #395
- Add evaluator weighted_alpaca_eval_gpt-4o-mini-2024-07-18 by @tongyx361 in #401
- Add Shopee-SlimMoA-v1 to AlpacaEval by @LLM-Alignment-sh in #398
- [ENH] add metadata to completion: date, version,... by @YannDubs in #402
- Add REBEL-Llama-3-8B-Instruct-Armo to AlpacaEval by @ZhaolinGao in #403
- Add Llama-3-8B-Instruct-SkillMix to AlpacaEval by @parksimon0808 in #405
- Updated HF Link in model_configs for Llama-3-8B-Instruct-SkillMix by @parksimon0808 in #409
- Add SelfMoA_gemma-2-9b-it-SimPO, SelfMoA_gemma-2-9b-it-WPO-HB to AlpacaEval by @wenzhe-li in #411
- add Self-taught-llama3.1-70B-dpo as a evaluator by @tianlu-wang in #412
- Add GPO-Llama-3-8B-Instruct-GPM-2B and SPPO-Llama-3-8B-Instruct-GPM-2… by @xukp20 in #413
- Add NullModel to AlpacaEval by @xszheng2020 in #414
- Add Llama-3-Instruct-8B-RainbowPO to AlpacaEval by @hanyang1999 in #416
- add example for Llama3 vllm server by @cameron-chen in #404
- Add FuseChat-3.0 models to AlpacaEval by @yangzy39 in #426
- Add TOA to AlpacaEval by @oceanypt in #428
- [BUG] tool_calls by @YannDubs in #429
New Contributors
- @PKU-Baichuan made their first contribution in #395
- @LLM-Alignment-sh made their first contribution in #398
- @parksimon0808 made their first contribution in #405
- @wenzhe-li made their first contribution in #411
- @tianlu-wang made their first contribution in #412
- @xukp20 made their first contribution in #413
- @xszheng2020 made their first contribution in #414
- @hanyang1999 made their first contribution in #416
- @cameron-chen made their first contribution in #404
- @yangzy39 made their first contribution in #426
- @oceanypt made their first contribution in #428
Full Changelog: v0.6.5...v0.6.6
Contributors
tianlu-wang, YannDubs, and 13 other contributors