Skip to content

Commit

Permalink
fix: pack linux dependencies (#64)
Browse files Browse the repository at this point in the history
Co-authored-by: vansangpfiev <[email protected]>
  • Loading branch information
vansangpfiev and sangjanai authored Jul 26, 2024
1 parent da919d5 commit 349abb2
Showing 1 changed file with 3 additions and 3 deletions.
6 changes: 3 additions & 3 deletions cpp/Makefile
Original file line number Diff line number Diff line change
Expand Up @@ -48,12 +48,12 @@ else
cd ./tensorrt_llm/cortex.tensorrt-llm && \
mkdir -p cortex.tensorrt-llm && \
cp ../../build/tensorrt_llm/cortex.tensorrt-llm/libengine.so cortex.tensorrt-llm && \
cp /usr/local/tensorrt/targets/x86_64-linux-gnu/lib/libnvinfer.so cortex.tensorrt-llm && \
cp /home/runner/actions-runner/_work/cortex.tensorrt-llm/cortex.tensorrt-llm/cpp/build/tensorrt_llm/plugins/libnvinfer_plugin_tensorrt_llm.so cortex.tensorrt-llm && \
cp /usr/local/tensorrt/targets/x86_64-linux-gnu/lib/libnvinfer.so.10 cortex.tensorrt-llm && \
cp /home/runner/actions-runner/_work/cortex.tensorrt-llm/cortex.tensorrt-llm/cpp/build/tensorrt_llm/plugins/libnvinfer_plugin_tensorrt_llm.so.10 cortex.tensorrt-llm && \
cp /home/runner/actions-runner/_work/cortex.tensorrt-llm/cortex.tensorrt-llm/cpp/build/tensorrt_llm/libtensorrt_llm.so cortex.tensorrt-llm && \
cp /home/runner/actions-runner/_work/cortex.tensorrt-llm/cortex.tensorrt-llm/cpp/build/tensorrt_llm/kernels/decoderMaskedMultiheadAttention/decoderXQAImplJIT/nvrtcWrapper/libtensorrt_llm_nvrtc_wrapper.so cortex.tensorrt-llm && \
cp /opt/hpcx/ompi/lib/libmpi.so cortex.tensorrt-llm && \
cp /usr/lib/x86_64-linux-gnu/libnccl.so cortex.tensorrt-llm
cp /usr/lib/x86_64-linux-gnu/libnccl.so.2 cortex.tensorrt-llm
endif

codesign:
Expand Down

0 comments on commit 349abb2

Please sign in to comment.