Code

fix: inference fault tolerance#108

Code

Merged

Fei-Guo merged 23 commits intomainkaito-project/kaito:mainfrom Ishaan/fix-worker-networking-inferencekaito-project/kaito:Ishaan/fix-worker-networking-inferenceCopy head branch name to clipboardNov 2, 2023

+301-120

Commits

Commits on Oct 26, 2023

• fix: fix networking issue inference

  ishaansehgal99

  committed
  b3eec53

  Copy full SHA for b3eec53

• nit: remove threading

  ishaansehgal99

  committed
  c1d3a18

  Copy full SHA for c1d3a18

Commits on Oct 27, 2023

• fix: ensure child process

  ishaansehgal99

  committed
  32586dd

  Copy full SHA for 32586dd

Commits on Oct 30, 2023

• fix: upgrade nvidia pytorch

  ishaansehgal99

  committed
  933efc6

  Copy full SHA for 933efc6

• fix: lint

  ishaansehgal99

  committed
  86101a8

  Copy full SHA for 86101a8

• fix: naming

  ishaansehgal99

  committed
  b691d9b

  Copy full SHA for b691d9b

• fix: diff

  ishaansehgal99

  committed
  cbbebbd

  Copy full SHA for cbbebbd

• fix: fetch

  ishaansehgal99

  committed
  5248737

  Copy full SHA for 5248737

• fix: log

  ishaansehgal99

  committed
  1690ccc

  Copy full SHA for 1690ccc

Commits on Oct 31, 2023

• feat: add the headless service, add the resliency to ensure cleanup of processes upon termination

  ishaansehgal99

  committed
  2ee601c

  Copy full SHA for 2ee601c

Commits on Nov 1, 2023

• fix: timeout error handling

  ishaansehgal99

  committed
  224416a

  Copy full SHA for 224416a

• fix: remove comments

  ishaansehgal99

  committed
  a91bded

  Copy full SHA for a91bded

• feat: added torchrdzvparams, headless service

  ishaansehgal99

  committed
  fda874a

  Copy full SHA for fda874a

• fix: simplify timeout

  ishaansehgal99

  committed
  cdf10e7

  Copy full SHA for cdf10e7

• fix: headless service variable fixes

  ishaansehgal99

  committed
  a12f16c

  Copy full SHA for a12f16c

• fix: shutdown

  ishaansehgal99

  committed
  2f2821d

  Copy full SHA for 2f2821d

• fix: dockerfile

  ishaansehgal99

  committed
  86ff9e0

  Copy full SHA for 86ff9e0

• fix: update docker file paths to avoid conflicting volume mounts

  ishaansehgal99

  committed
  ca788a4

  Copy full SHA for ca788a4

Commits on Nov 2, 2023

• fix: fix service naming, and add service namespace and ownerreferences which are required

  ishaansehgal99

  committed
  2213d85

  Copy full SHA for 2213d85

• fix: remove logs

  ishaansehgal99

  committed
  8a9b4ae

  Copy full SHA for 8a9b4ae

• fix

  ishaansehgal99

  committed
  c52b40c

  Copy full SHA for c52b40c

• Merge branch 'main' of https://github.com/Azure/kdm into Ishaan/fix-worker-networking-inference

  ishaansehgal99

  committed
  ac0e880

  Copy full SHA for ac0e880

• fix: rename create to useHeadlessService

  ishaansehgal99

  committed
  fd3f9db

  Copy full SHA for fd3f9db