Code

Add Model Zoo testing support#2990

Code

Merged

causten merged 65 commits intodevelopROCm/AMDMIGraphX:developfrom test_dataset_generatorROCm/AMDMIGraphX:test_dataset_generatorCopy head branch name to clipboardJul 2, 2024

+2,418

Commits

Commits on Apr 23, 2024

• Basic test dataset generator

  Show description for 5f12b89
  attila-dusnoki-htec

  committed
  5f12b89

  Copy full SHA for 5f12b89

• Refactored to classes, extended with resnet/optimum

  attila-dusnoki-htec

  committed
  35efda4

  Copy full SHA for 35efda4

• Add more models

  attila-dusnoki-htec

  committed
  e7e70f0

  Copy full SHA for e7e70f0

• Create session at start and re-use

  attila-dusnoki-htec

  committed
  85018a0

  Copy full SHA for 85018a0

• Add SQuAD dataset. Add distilbert and roberta models

  attila-dusnoki-htec

  committed
  96815f5

  Copy full SHA for 96815f5

• Cleanup

  attila-dusnoki-htec

  committed
  1e97979

  Copy full SHA for 1e97979

• Cleanup pt2

  attila-dusnoki-htec

  committed
  a6bc373

  Copy full SHA for a6bc373

• WIP asr dataset

  attila-dusnoki-htec

  committed
  99a828a

  Copy full SHA for 99a828a

• Finish asr dataset, add wav2vec model

  attila-dusnoki-htec

  committed
  f7556b2

  Copy full SHA for f7556b2

• WIP GPTJ

  attila-dusnoki-htec

  committed
  7c64686

  Copy full SHA for 7c64686

• WIP enc-dec monolith

  attila-dusnoki-htec

  committed
  fb326b8

  Copy full SHA for fb326b8

• Add decoder step. Enable Whisper

  attila-dusnoki-htec

  committed
  7ae6a76

  Copy full SHA for 7ae6a76

• move files into modules

  attila-dusnoki-htec

  committed
  18a3455

  Copy full SHA for 18a3455

• split classes into more files

  attila-dusnoki-htec

  committed
  b67df1e

  Copy full SHA for b67df1e

• more refactor, fix imports, add properties

  attila-dusnoki-htec

  committed
  265d85a

  Copy full SHA for 265d85a

• Use cached model if exists

  attila-dusnoki-htec

  committed
  ef48f25

  Copy full SHA for ef48f25

• update download logic

  attila-dusnoki-htec

  committed
  6f6b986

  Copy full SHA for 6f6b986

• Enable GPT-J

  attila-dusnoki-htec

  committed
  ee54bd2

  Copy full SHA for ee54bd2

• add common output folder

  attila-dusnoki-htec

  committed
  942ff9e

  Copy full SHA for 942ff9e

• Fix imagenet preprocess logic

  attila-dusnoki-htec

  committed
  a518015

  Copy full SHA for a518015

• Add hybrid model ClipVit

  attila-dusnoki-htec

  committed
  4e5317c

  Copy full SHA for 4e5317c

• Fix limit logic

  attila-dusnoki-htec

  committed
  b47c811

  Copy full SHA for b47c811

• fix a bug with initial data

  attila-dusnoki-htec

  committed
  0172a6a

  Copy full SHA for 0172a6a

• Add T5 base model

  attila-dusnoki-htec

  committed
  b364f84

  Copy full SHA for b364f84

• Skip model if something goes wrong

  attila-dusnoki-htec

  committed
  8883d86

  Copy full SHA for 8883d86

• Add gemma-2b-it model

  attila-dusnoki-htec

  committed
  1d79631

  Copy full SHA for 1d79631

• Add Llama2-7b-chat-hf model

  attila-dusnoki-htec

  committed
  363b2e3

  Copy full SHA for 363b2e3

• Move text generation logic into a class

  attila-dusnoki-htec

  committed
  59d00fd

  Copy full SHA for 59d00fd

• Add BERT-large-uncased model

  attila-dusnoki-htec

  committed
  4299a9a

  Copy full SHA for 4299a9a

• remove incorrect classmethod decorators

  attila-dusnoki-htec

  committed
  adc3e8a

  Copy full SHA for adc3e8a

• Add rocm based torch to requirements

  attila-dusnoki-htec

  committed
  c94b7aa

  Copy full SHA for c94b7aa

• fix squad url logic

  attila-dusnoki-htec

  committed
  f086594

  Copy full SHA for f086594

• merge two hf download logic

  attila-dusnoki-htec

  committed
  8b27da1

  Copy full SHA for 8b27da1

• make name a staticmethod

  attila-dusnoki-htec

  committed
  3957c7b

  Copy full SHA for 3957c7b

• Rework main to handle argument parsing. Enable specific dataset-models run

  attila-dusnoki-htec

  committed
  f5bb539

  Copy full SHA for f5bb539

• Update README

  attila-dusnoki-htec

  committed
  d16c530

  Copy full SHA for d16c530

• Move it under model_zoo instead of datasets

  attila-dusnoki-htec

  committed
  f1a3f11

  Copy full SHA for f1a3f11

• wording

  attila-dusnoki-htec

  committed
  971918b

  Copy full SHA for 971918b

• license stamper

  attila-dusnoki-htec

  committed
  dcba707

  Copy full SHA for dcba707

• Add model zoo README

  attila-dusnoki-htec

  committed
  066119d

  Copy full SHA for 066119d

• Add support for running ONNX Model Zoo with test_runner.py

  attila-dusnoki-htec

  committed
  4ee9ac5

  Copy full SHA for 4ee9ac5

• rename main to generate

  attila-dusnoki-htec

  committed
  0fb0fcf

  Copy full SHA for 0fb0fcf

• update requirements file

  attila-dusnoki-htec

  committed
  f1d727d

  Copy full SHA for f1d727d

• Add test_models.sh

  attila-dusnoki-htec

  committed
  7fa3a69

  Copy full SHA for 7fa3a69

• fix pyflake warnings

  attila-dusnoki-htec

  committed
  b4c491b

  Copy full SHA for b4c491b

Commits on Apr 24, 2024

• Add Llama3-8b-instruct model

  attila-dusnoki-htec

  committed
  bb21cf5

  Copy full SHA for bb21cf5

Commits on Apr 30, 2024

• Fix type, add more info to model

  attila-dusnoki-htec

  committed
  307108c

  Copy full SHA for 307108c

Commits on May 7, 2024

• Move inference into function

  attila-dusnoki-htec

  committed
  94ed7aa

  Copy full SHA for 94ed7aa

• Add style prompts dataset

  attila-dusnoki-htec

  committed
  0552c44

  Copy full SHA for 0552c44

• Partial diffusion support with SD2.1

  attila-dusnoki-htec

  committed
  575b369

  Copy full SHA for 575b369

• Split generator functions into separate files

  attila-dusnoki-htec

  committed
  40582ac

  Copy full SHA for 40582ac

• Better logging

  attila-dusnoki-htec

  committed
  0213a45

  Copy full SHA for 0213a45

• Add missing import

  attila-dusnoki-htec

  committed
  3578032

  Copy full SHA for 3578032

• text_preprocess_2 fix

  attila-dusnoki-htec

  committed
  540f9ee

  Copy full SHA for 540f9ee

• Add COCO2017 dataset

  attila-dusnoki-htec

  committed
  9c564ff

  Copy full SHA for 9c564ff

• Enable StableDiffusionXL model

  attila-dusnoki-htec

  committed
  23913e8

  Copy full SHA for 23913e8

• cleanup

  attila-dusnoki-htec

  committed
  e72d4f0

  Copy full SHA for e72d4f0

• fix log naming

  attila-dusnoki-htec

  committed
  96fcac8

  Copy full SHA for 96fcac8

• Catch exceptions during creation, not just during download

  attila-dusnoki-htec

  committed
  56f9551

  Copy full SHA for 56f9551

Commits on Jun 13, 2024

• Bump torch version

  attila-dusnoki-htec

  committed
  5b7d9f6

  Copy full SHA for 5b7d9f6

• Address review comments

  attila-dusnoki-htec

  committed
  c1355b9

  Copy full SHA for c1355b9

• Fix missing license issue

  attila-dusnoki-htec

  committed
  6c1348d

  Copy full SHA for 6c1348d

• Merge branch 'develop' into test_dataset_generator

  attila-dusnoki-htec

  authored
  3b80f79

  Copy full SHA for 3b80f79

Commits on Jun 26, 2024

• Update tools/model_zoo/test_generator/requirements.txt

  Show description for 77bec3a
  

  aarushjain29

  and

  causten

  authored
  77bec3a

  Copy full SHA for 77bec3a

Commits on Jul 2, 2024

• Merge branch 'develop' into test_dataset_generator

  causten

  authored
  41d9678

  Copy full SHA for 41d9678