TreeDecoding

This is the implementation of a underworking paper "Beam Search as Tree Parallel Decoding"

Presequites Important!!!!!
Please use a python virtual environment.
Install requirements with

pip install --no-user -r requirements.txt  

we modified the transformer library for evaluating resource consumption. run benchmark with

cd benchmark
python main.py

the results will be in benchmark/out