Gemini 1.5 and Cohere R Context Length Restriction in Workflow Nodes #3452
FarVision2
started this conversation in
General
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
Gemini 1.5 has 1048K, Cohere R has 128K in API. Max Tokens are 8192 and 4096 in the node. Why are the workflow nodes capped so low? It looks like GPT 4 -32K is set correctly. I am getting token cap limit before generation is finished on everything except OpenAI.
If someone could please take a pass with the node entries to match their API and ability that would be great, it's not a complete deal breaker but I would like to extend my generations on some of the workflows.
Beta Was this translation helpful? Give feedback.
All reactions