Code

add nvidia distribution#565

Code

Draft

cdgamarose-nv wants to merge 16 commits intometa-llama:mainmeta-llama/llama-stack:mainfrom cdgamarose-nv:cdgamarose/add_nvidia_distrocdgamarose-nv/llama-stack:cdgamarose/add_nvidia_distroCopy head branch name to clipboard

+400

Commits

Commits on Nov 4, 2024

• add NVIDIA NIM inference adapter

  mattf

  committed
  2dd8c4b

Commits on Nov 15, 2024

• enable streaming support, use openai-python instead of httpx

  mattf

  committed
  dbe665e

Commits on Nov 16, 2024

• Merge branch 'main' into add-nvidia-inference-adapter

  mattf

  committed
  43262df

Commits on Nov 19, 2024

• Merge branch 'main' into add-nvidia-inference-adapter

  mattf

  committed
  c24f882

• Merge branch 'main' into add-nvidia-inference-adapter

  mattf

  committed
  2a25ace

• map llama model -> provider model id in ModelRegistryHelper

  mattf

  committed
  2980a18

• Merge remote-tracking branch 'mattf/add-nvidia-inference-adapter' into cdgamarose/add_nvidia_distro

  Show description for 18e8f18
  cdgamarose-nv

  committed
  18e8f18

• Add nvidia remote distro

  cdgamarose-nv

  committed
  a5d4130

• align with other remote adapters, rename config base_url -> url

  mattf

  committed
  4ccf4ef

Commits on Nov 20, 2024

• Merge branch 'main' into add-nvidia-inference-adapter

  mattf

  committed
  8a35dc8

• Added distributions for inline and remote

  cdgamarose-nv

  committed
  6759744

• Merge remote-tracking branch 'mattf/add-nvidia-inference-adapter' into cdgamarose/add_nvidia_distro

  cdgamarose-nv

  committed
  3b5ea74

Commits on Dec 4, 2024

• Merge conflicts

  cdgamarose-nv

  committed
  5b027d2

• Reverted outdated changes

  cdgamarose-nv

  committed
  deecc27

• Changing fireworks to nvidia in docs

  cdgamarose-nv

  committed
  091d196

• Added nvidia as remote hosted distro

  cdgamarose-nv

  committed
  1658a5f