You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
text-embeddings-router start an embedding serving, but always got the error 【 Input validation error: inputs must have less than 512 tokens】,which param should i use to change max tokens of input?512 is too short, i can not find true param in RAEDME or --help
To solve the issue of 'Input validation error: inputs must have less than 512 tokens', I added the auto truncate parameter to' true 'when starting the Docker image, but the image failed to start. What is the reason for this?
The startup command is as follows:
Docker run -- rm -- gpus all - d - p 18082:80-- name multilingual-e5-large-v 'model mount address'' mirror address' -- model id 'model id' --auto-truncate true
The text was updated successfully, but these errors were encountered:
text-embeddings-router start an embedding serving, but always got the error 【 Input validation error: inputs must have less than 512 tokens】,which param should i use to change max tokens of input?512 is too short, i can not find true param in RAEDME or --help
To solve the issue of 'Input validation error: inputs must have less than 512 tokens', I added the auto truncate parameter to' true 'when starting the Docker image, but the image failed to start. What is the reason for this?
The startup command is as follows:
Docker run -- rm -- gpus all - d - p 18082:80-- name multilingual-e5-large-v 'model mount address'' mirror address' -- model id 'model id' --auto-truncate true
The text was updated successfully, but these errors were encountered: