Code

[WIP] Sam integration#7722

Code

Draft

vgrau98 wants to merge 28 commits intoProject-MONAI:gen-ai-devProject-MONAI/MONAI:gen-ai-devfrom vgrau98:sam-integrationvgrau98/MONAI:sam-integrationCopy head branch name to clipboard

+1,383-42

Commits

Commits on Apr 28, 2024

• causal self attention

  Show description for 7acfc69
  vgrau98

  committed
  7acfc69

  Copy full SHA for 7acfc69

• causal selfattention tests

  Show description for 568013c
  vgrau98

  committed
  568013c

  Copy full SHA for 568013c

• integrate flash attention usage

  Show description for 12dca86
  vgrau98

  committed
  12dca86

  Copy full SHA for 12dca86

• transformer block local window attention

  Show description for 71d7c9d
  vgrau98

  committed
  71d7c9d

  Copy full SHA for 71d7c9d

• fix: window partition input shapes

  Show description for a0325e4
  vgrau98

  committed
  a0325e4

  Copy full SHA for a0325e4

• fix: error handling

  Show description for 02c087c
  vgrau98

  committed
  02c087c

  Copy full SHA for 02c087c

• local window attention tests

  Show description for ab4a440
  vgrau98

  committed
  ab4a440

  Copy full SHA for ab4a440

• feat: 3d local window attention

  Show description for b47d71a
  vgrau98

  committed
  b47d71a

  Copy full SHA for b47d71a

• 3d local attention window tests

  Show description for d4fec56
  vgrau98

  committed
  d4fec56

  Copy full SHA for d4fec56

• clean

  Show description for a4ee3f4
  vgrau98

  committed
  a4ee3f4

  Copy full SHA for a4ee3f4

• refacto

  Show description for e417ffe
  vgrau98

  committed
  e417ffe

  Copy full SHA for e417ffe

Commits on May 4, 2024

• feat: layer norm 2d

  Show description for e91c289
  vgrau98

  committed
  e91c289

  Copy full SHA for e91c289

Commits on May 6, 2024

• fix: rel pos embedding with local attention

  Show description for 3726f57
  vgrau98

  committed
  3726f57

  Copy full SHA for 3726f57

• feature: 2D sam image encoder

  Show description for e4778d1
  vgrau98

  committed
  e4778d1

  Copy full SHA for e4778d1

• Merge pull request #1 from vgrau98/sam-integration-img-encoder

  Show description for bd5318e
  vgrau98

  authored
  bd5318e

  Copy full SHA for bd5318e

Commits on May 8, 2024

• sam prompt encoder

  Show description for ce3f32c
  vgrau98

  committed
  ce3f32c

  Copy full SHA for ce3f32c

• Merge pull request #2 from vgrau98/sam-integration-prompt-encoder

  Show description for 47e0eb8
  vgrau98

  authored
  47e0eb8

  Copy full SHA for 47e0eb8

Commits on May 9, 2024

• refacto mlp block for multilayer suppoert

  Show description for 50752a0
  vgrau98

  committed
  50752a0

  Copy full SHA for 50752a0

• mask decoder

  Show description for 0250aef
  vgrau98

  committed
  0250aef

  Copy full SHA for 0250aef

Commits on May 10, 2024

• attention block as defined in sam

  Show description for c6cd2c0
  vgrau98

  committed
  c6cd2c0

  Copy full SHA for c6cd2c0

• two way transformer block and two way attention block

  Show description for 0a6dadb
  vgrau98

  committed
  0a6dadb

  Copy full SHA for 0a6dadb

Commits on May 11, 2024

• fix: mlp block with multiple layers, fix input, output and hidden dimensions

  Show description for 6131995
  vgrau98

  committed
  6131995

  Copy full SHA for 6131995

• fix transformer block

  Show description for 496bf63
  vgrau98

  committed
  496bf63

  Copy full SHA for 496bf63

• Merge pull request #3 from vgrau98/sam-integration-mask-decoder

  Show description for 548c3cc
  vgrau98

  authored
  548c3cc

  Copy full SHA for 548c3cc

• sam network

  Show description for 3809202
  vgrau98

  committed
  3809202

  Copy full SHA for 3809202

• Merge pull request #4 from vgrau98/sam-integration-sam-network

  Show description for f0cd576
  vgrau98

  authored
  f0cd576

  Copy full SHA for f0cd576

Commits on May 12, 2024

• sam weights mapping

  Show description for 0c5d48f
  vgrau98

  committed
  0c5d48f

  Copy full SHA for 0c5d48f

• Merge pull request #5 from vgrau98/sam-integration-weights-mapping

  Show description for 47c6a40
  vgrau98

  authored
  47c6a40

  Copy full SHA for 47c6a40