v0.4.0

What's Changed

• Refactor backends and add load tracking by @IlyasMoutawwakil in #227
• Update readme by @IlyasMoutawwakil in #228
• Update vllm backend to support offline and online serving modes by @IlyasMoutawwakil in #232
• Misc CI updates and multi-platform support by @IlyasMoutawwakil in #233
• Add llama.cpp backend by @baptistecolle in #231
• Misc changes and fixes for llama cpp by @IlyasMoutawwakil in #236
• release by @IlyasMoutawwakil in #237

New Contributors

• @baptistecolle made their first contribution in #231

Full Changelog: v0.3.1...v0.4.0