[BUG]: Error occurred while streaming response. Streaming error

[saisandeepbalbari]

How are you running AnythingLLM?

Docker (remote machine)

What happened?

I'm using OLLAMA's nomic-embed-text as the embedding model and llama3.1:8b as the LLM.

After I upload the documents, when asked a question, it is generating the sentence partially and then giving the streaming error

On checking the logs of the docker are as below:

[Event Logged] - workspace_documents_added
[OllamaEmbedder] Embedding 1 chunks of text with nomic-embed-text:latest.
[STREAM ABORTED] Client requested to abort stream. Exiting LLM stream handler early.
[TELEMETRY SENT] {
event: 'sent_chat',
distinctId: 'xxxxxxxx-xxxx-xxxxx-xxxxxx-xxxxxxxxxxxxxxxx',
properties: {
multiUserMode: false,
LLMSelection: 'ollama',
Embedder: 'ollama',
VectorDbSelection: 'lancedb',
runtime: 'docker'
}
}
[Event Logged] - sent_chat

Are there known steps to reproduce?

No response

[timothycarambat]

Client requested to abort stream. Exiting LLM stream handler early.

This is certainly something on the client side then which would occur from:

• a websocket close
• Browser connection to server interrupted (page reload)

What does frontend inspector > source show? Should be some relevant error there since this is the client dropping the connection and not the server aborting the connection