Code

Ft llama opt#762

Code

Open

dypshong wants to merge 60 commits intoNVIDIA:mainNVIDIA/FasterTransformer:mainfrom shongshong2:ft-llama-optshongshong2/FasterTransformer:ft-llama-optCopy head branch name to clipboard

+5,430-497

Commits

Commits on Sep 11, 2023

• fix readme

  dypshong

  committed
  bf93524

  Copy full SHA for bf93524

• add lamma template

  dypshong

  committed
  6bbba86

  Copy full SHA for 6bbba86

Commits on Sep 12, 2023

• rename varaible

  dypshong

  committed
  a0276fb

  Copy full SHA for a0276fb

• dump

  dypshong

  committed
  a590e94

  Copy full SHA for a590e94

• add examples

  dypshong

  committed
  a763d18

  Copy full SHA for a763d18

Commits on Sep 13, 2023

• llama......

  dypshong

  committed
  2cb06f1

  Copy full SHA for 2cb06f1

• remove gpt dependency

  dypshong

  committed
  ca0a25a

  Copy full SHA for ca0a25a

Commits on Sep 15, 2023

• fix loadModel to load llama & fix invokeGeneralLLaMALayerNorm to invoke RMSNorm

  dypshong

  committed
  662d3b6

  Copy full SHA for 662d3b6

• remove debug code and bug fix

  dypshong

  committed
  dbe0657

  Copy full SHA for dbe0657

• only contextdecoder is necessary

  dypshong

  committed
  29c7b69

  Copy full SHA for 29c7b69

• dump

  dypshong

  committed
  1494d2f

  Copy full SHA for 1494d2f

Commits on Sep 16, 2023

• dump

  dypshong

  committed
  81dc94a

  Copy full SHA for 81dc94a

• for junsik

  dypshong

  committed
  d5b2c12

  Copy full SHA for d5b2c12

• first success

  dypshong

  committed
  8ec39b5

  Copy full SHA for 8ec39b5

• remove debugging code print

  dypshong

  committed
  4434e65

  Copy full SHA for 4434e65

• remove debugging code

  dypshong

  committed
  95a7efe

  Copy full SHA for 95a7efe

Commits on Sep 18, 2023

• LLaMA Constructor fix

  dypshong

  committed
  0a0015d

  Copy full SHA for 0a0015d

• llama-opt

  dypshong

  committed
  6ed3747

  Copy full SHA for 6ed3747

• buf fix

  dypshong

  committed
  321bc73

  Copy full SHA for 321bc73

• dump

  dypshong

  committed
  837e9d7

  Copy full SHA for 837e9d7

• add gemm_cofing.in

  dypshong

  committed
  56c3325

  Copy full SHA for 56c3325

Commits on Sep 19, 2023

• remove backup file trace

  dypshong

  committed
  4a0a9d7

  Copy full SHA for 4a0a9d7

• remove gemm_config.in

  dypshong

  committed
  e63b85b

  Copy full SHA for e63b85b

Commits on Sep 20, 2023

• dumdump

  dypshong

  committed
  3a10308

  Copy full SHA for 3a10308

Commits on Sep 22, 2023

• test done

  dypshong

  committed
  be29883

  Copy full SHA for be29883

Commits on Sep 23, 2023

• debug code

  dypshong

  committed
  d403986

  Copy full SHA for d403986

Commits on Sep 24, 2023

• dump

  dypshong

  committed
  db6efdd

  Copy full SHA for db6efdd

• dmpdmp

  dypshong

  committed
  6e09959

  Copy full SHA for 6e09959

• dp

  dypshong

  committed
  cf8087a

  Copy full SHA for cf8087a

Commits on Sep 25, 2023

• dmp

  dypshong

  committed
  13478f4

  Copy full SHA for 13478f4

• no cache version

  dypshong

  committed
  df743e0

  Copy full SHA for df743e0

• no-cache version bug fix

  dypshong

  committed
  220aec0

  Copy full SHA for 220aec0

• cache version

  dypshong

  committed
  4fb06e7

  Copy full SHA for 4fb06e7

• Merge pull request #1 from shongshong2/llama-cache

  Show description for 5f10b4e
  dypshong

  authored
  5f10b4e

  Copy full SHA for 5f10b4e

• remove logging

  dypshong

  committed
  857d956

  Copy full SHA for 857d956

• Merge branch 'llama-cache' into main

  dypshong

  committed
  2609e97

  Copy full SHA for 2609e97

Commits on Sep 26, 2023

• remove README

  dypshong

  committed
  3074afa

  Copy full SHA for 3074afa

• Merge branch 'main' of https://github.com/shongshong2/FasterTransformer into main

  dypshong

  committed
  d472912

  Copy full SHA for d472912

• overlap

  dypshong

  committed
  8092007

  Copy full SHA for 8092007

Commits on Sep 27, 2023

• overlapping versino

  dypshong

  committed
  1187340

  Copy full SHA for 1187340

Commits on Sep 29, 2023

• start_pos for each sample

  dypshong

  committed
  949c4e7

  Copy full SHA for 949c4e7

• get back start_pos

  dypshong

  committed
  083f3bb

  Copy full SHA for 083f3bb

• debug

  dypshong

  committed
  f08ada9

  Copy full SHA for f08ada9

• chkpt

  dypshong

  committed
  e5d92df

  Copy full SHA for e5d92df

• ckpt

  dypshong

  committed
  433f2c9

  Copy full SHA for 433f2c9

Commits on Sep 30, 2023

• ckpt

  dypshong

  committed
  b63b496

  Copy full SHA for b63b496

• 08:42

  dypshong

  committed
  6ee6105

  Copy full SHA for 6ee6105

• # input check bug fix

  dypshong

  committed
  1955508

  Copy full SHA for 1955508

• code rf

  dypshong

  committed
  57dded4

  Copy full SHA for 57dded4

• add macro

  dypshong

  committed
  d3a83aa

  Copy full SHA for d3a83aa

• 07_03

  dypshong

  committed
  1365462

  Copy full SHA for 1365462

• add multiple devent

  dypshong

  committed
  305540f

  Copy full SHA for 305540f

Commits on Oct 1, 2023

• ft_llama-06_48

  dypshong

  committed
  294a6fc

  Copy full SHA for 294a6fc

• ref

  dypshong

  committed
  a7e7089

  Copy full SHA for a7e7089

• Merge pull request #2 from shongshong2/ft_llama-06_48

  Show description for b8f34e0
  dypshong

  authored
  b8f34e0

  Copy full SHA for b8f34e0

• remove mpi requirement

  dypshong

  committed
  5515d83

  Copy full SHA for 5515d83

• Merge pull request #3 from shongshong2/ft-llama-opt

  Show description for 9b38f6e
  dypshong

  authored
  9b38f6e

  Copy full SHA for 9b38f6e

• add mpi_cxx

  dypshong

  committed
  ce8c72a

  Copy full SHA for ce8c72a

• ref

  dypshong

  committed
  48b35f7

  Copy full SHA for 48b35f7

Commits on Oct 2, 2023

• final

  dypshong

  committed
  baca61b

  Copy full SHA for baca61b