Code

[WIP] ONNX conversion#6

Code

Open

ganik wants to merge 14 commits intomastermicrosoft/DeBERTa:masterfrom onnxmicrosoft/DeBERTa:onnxCopy head branch name to clipboard

+1,170-18

Commits

Commits on Jul 20, 2020

• Replace with Dropout and Softmax

  ganik

  committed
  498db46

  Copy full SHA for 498db46

Commits on Jul 21, 2020

• mask attention scores in Softmax

  ganik

  committed
  3be8289

  Copy full SHA for 3be8289

Commits on Aug 2, 2020

• onnx conversion and training

  ganik

  committed
  dab83af

  Copy full SHA for dab83af

• TBD tight coupling with torch 1.3

  ganik

  committed
  64f068c

  Copy full SHA for 64f068c

Commits on Aug 7, 2020

• opset 12, expand attention mask

  ganik

  committed
  1ce5cc1

  Copy full SHA for 1ce5cc1

• Merge

  ganik

  committed
  efd079b

  Copy full SHA for efd079b

Commits on Aug 8, 2020

• loss is first

  ganik

  committed
  b301b46

  Copy full SHA for b301b46

• commenting out v_ and q_ biases as they are always const

  ganik

  committed
  d2fa9fd

  Copy full SHA for d2fa9fd

Commits on Aug 14, 2020

• Fix Dropout model regression issue

  ganik

  committed
  e4793b8

  Copy full SHA for e4793b8

• Use nn.dropout and nn.softmax by default

  ganik

  committed
  155d966

  Copy full SHA for 155d966

Commits on Sep 29, 2020

• Added ORT Glue based tests

  

  Gani Nazirov

  authored and

  Gani Nazirov

  committed
  95ec7ad

  Copy full SHA for 95ec7ad

• remove onnx path in train.py

  

  Gani Nazirov

  authored and

  Gani Nazirov

  committed
  bf8a3ce

  Copy full SHA for bf8a3ce

• Add Readme

  

  Gani Nazirov

  authored and

  Gani Nazirov

  committed
  c71818b

  Copy full SHA for c71818b

• Use random seed by default

  

  Gani Nazirov

  authored and

  Gani Nazirov

  committed
  7eff1fd

  Copy full SHA for 7eff1fd