ADD roberta_public.pt1

[pku-wuwei]

Steps to reproduce

I am trying to use the RoBERTaNERTask for NER task. So I ran pytext gen-config RoBERTaNERTask to generate default config file and twinkle it with personal settings. With the pretrained_encoder.load_path, I tried to trace the Roberta model given in fairseq, and use it in the experiment, but it does not work.

Could you please provide the traced Roberta model which default to 'manifold://pytext_training/tree/static/models/roberta_public.pt1', so we can use the RoBERTaNERTask . 3Q. ;-)

Observed Results

• What happened? This could be a description, log output, etc.

Expected Results

• What did you expect to happen?

Relevant Code

// TODO(you): code here to reproduce the problem

[mwu1993]

Can you try using

"model": { "RoBERTaEncoder": { "model_path": ... } }

instead of RobertaEncoderJIT?