You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
"CandleEmbed error: embed_batch called with empty texts",
));
}
letmut embeddings = vec![];
for text in texts {
let embedding = self.embed_one(text)?;
embeddings.push(embedding);
}
Ok(embeddings)
}
Perhaps you can add this feature by padding the texts and then unpadding the embeddings? It is just a thought, but I think it would improve performance significantly for real-world use cases!
The text was updated successfully, but these errors were encountered:
Hi @ShelbyJenkins!
I was taking a look at this great crate, and I noticed that
embed_batch
does not use batching.Perhaps you can add this feature by padding the texts and then unpadding the embeddings? It is just a thought, but I think it would improve performance significantly for real-world use cases!
The text was updated successfully, but these errors were encountered: