Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Update AutoScaling Blog to 24.07 #108

Merged
merged 9 commits into from
Oct 9, 2024
Merged

Update AutoScaling Blog to 24.07 #108

Changes from 1 commit
Commits
Show all changes
9 commits
Select commit Hold shift + click to select a range
1145f10
Update AutoScaling Blog to 24.07
indrajit96 Aug 27, 2024
7f7836b
Triton CLI removed
indrajit96 Sep 18, 2024
6e5fad8
Triton CLI removed
indrajit96 Sep 18, 2024
0665326
Triton CLI removed
indrajit96 Sep 18, 2024
2ccfb19
Update triton_trt-llm.containerfile
indrajit96 Sep 20, 2024
53464ac
Remove CLI refrence
indrajit96 Sep 23, 2024
e602365
Merge branch 'ibhosale_update' of github.com:triton-inference-server/…
indrajit96 Sep 23, 2024
ac1df46
Move pvc folder to pvc_aws, replace aws specific names to generic names
indrajit96 Oct 8, 2024
e9c13b8
Edit claim name to be more generic (NON AWS)
indrajit96 Oct 8, 2024
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
4 changes: 2 additions & 2 deletions ...netes/TensorRT-LLM_Autoscaling_and_Load_Balancing/containers/triton_trt-llm.containerfile
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -12,7 +12,7 @@
# See the License for the specific language governing permissions and
# limitations under the License.

ARG BASE_CONTAINER_IMAGE=nvcr.io/nvidia/tritonserver:24.04-trtllm-python-py3
ARG BASE_CONTAINER_IMAGE=nvcr.io/nvidia/tritonserver:24.07-trtllm-python-py3
ARG ENGINE_DEST_PATH=/var/run/engines
ARG HF_HOME=/var/run/cache

Expand Down Expand Up @@ -42,7 +42,7 @@ RUN pip --verbose install \
--no-cache-dir \
--no-color \
--no-input \
git+https://github.com/triton-inference-server/triton_cli.git@jwyman/aslb-mn
git+https://github.com/triton-inference-server/triton_cli.git@ibhosale/aslb-mn

# Copy the server script.
COPY server.py .
Expand Down
Loading