0.1.111
🚀 Highlights since 0.1.110:
Action agents
Uses the OpenAI function calls API to take actions during a call: see https://docs.vocode.dev/action-agents for docs!
- We currently support a few actions out of the box - sending an email (via Nylas) and transferring a phone call to another number (h/t @sethgw ). We'd love to see more PRs adding more integrations to make Vocode agents more powerful!
Streaming MP3
The ElevenLabs synthesizer now can stream mp3 chunk by chunk! This will greatly improve the performance of ElevenLabs - but it's currently behind an experimental flag since we're still messing around with it:
ElevenLabsSynthesizerConfig.from_output_device(output_device, ..., experimental_streaming=True)
Other highlights
- Vector Database support: connect your Pinecone and have the bot query your knowledge base to inform its responses
- Support for llama.cpp agents: 6c726e7
- Other integrations: Gladia, Vertex AI,
🌆 On the horizon:
- ElevenLabs / Play.ht Input Streaming: https://twitter.com/elevenlabsio/status/1688638033980014592
- More work on sentence splitting: #338
- More releases! We plan to publish the package more often so folks can try out the stuff we experiment with - if we're not sure the version is super stable we'll publish a pre-release and announce it on Discord.
Full Changelog: v0.1.110...v0.1.111
New Contributors
- @zaptrem made their first contribution in #172
- @m-ods made their first contribution in #177
- @yantao0527 made their first contribution in #136
- @reuben made their first contribution in #189
- @AlanLiu96 made their first contribution in #216
- @osilverstein made their first contribution in #242
- @khryniewicz made their first contribution in #247
- @KShah707 made their first contribution in #263
- @Van0SS made their first contribution in #266
- @sethgw made their first contribution in #275
- @ramatronics made their first contribution in #270
- @applebaconsoda123 made their first contribution in #295
- @wwzeng1 made their first contribution in #306
- @divst3r made their first contribution in #325
- @bjquinn made their first contribution in #328
- @arpagon made their first contribution in #335