Skip to content

Issues: awslabs/multi-model-server

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

84 Open 323 Closed
84 Open 323 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

Make healthcheck dependent on models loaded
#1027 opened Apr 23, 2024 by wojciechrauk-plutoflume
1
MMS Server getting stuck while registering the model and says "worker pid is not available yet"
#1025 opened Aug 17, 2023 by suchith-sixsense
How to handle invalid input!
#1022 opened Jul 11, 2023 by xuweidongkobe
1
Overriding the model routing logic
#1017 opened May 15, 2023 by James-UnlikelyAI
readAddress(..) failed: Connection reset by peer
#1016 opened May 9, 2023 by xuweidongkobe
1
Update documentation to establish the difference between backend time and backend response time
#1014 opened Mar 10, 2023 by sachanub
Streaming support on MMS
#1012 opened Feb 27, 2023 by rauldiaz
1
Config option to increase or disable model load timeout
#1009 opened Feb 3, 2023 by svenkata9
1
Invalid Response Headers Set for Non MME Inference Scenario (scikit learn container)
#1007 opened Nov 10, 2022 by Grassycup
Validate MMS process during start
#1005 opened Sep 16, 2022 by nikhil-sk
Model specific custom python package installation
#1004 opened Sep 14, 2022 by salvadiswar02
python version
#1003 opened Sep 9, 2022 by n0thing233
1
Preloading models on Sagemaker multi-model endpoint doesn't work
#1001 opened Aug 5, 2022 by sassarini-marco
Is it supporting Apple M1 Chip ?
#1000 opened May 24, 2022 by jaiswalvineet
Issue: Memory Leak when serving multiple models
#999 opened May 9, 2022 by pratikluitel
4
how to change url format
#997 opened Apr 25, 2022 by xuweidongkobe
log4j2 metrics JsonLayout / QLogLayout logger broken
#994 opened Mar 7, 2022 by lxning
command not found: multi-model-server
#993 opened Feb 16, 2022 by nimafo
1
com.amazonaws.ml.mms.metrics.MetricCollector - java.io.IOException: Broken pipe and error while loading shared libraries: libpython3.7m.so.1.0
#992 opened Feb 4, 2022 by llorenzo-matterport
Remove ineffective log4j 1 references from code
#988 opened Jan 7, 2022 by nikhil-sk
preload_model set in config.properties does not work for load model request
#977 opened Nov 29, 2021 by lxning
Custom plug-in
#976 opened Nov 16, 2021 by HuryanKliashchouTR
Change plugins logic
#975 opened Nov 12, 2021 by UsernameJava
memory utilization increment after every request, worker died, memory issue
#974 opened Oct 31, 2021 by n0thing233
1
How to achieve autoscaling when running MMS on a fargate?
#970 opened May 18, 2021 by sunilkumarmohanty
1
ProTip! Find all open issues with in progress development work with linked:pr.