Transformer Differential Neural Computer (T-DNC)

Research project to combine a pretrained transformer like BERT with the Differential Neural Computer, to add a memory component to BERT

Name		Name	Last commit message	Last commit date
Latest commit History 188 Commits
.ipynb_checkpoints		.ipynb_checkpoints
__pycache__		__pycache__
squad_data/squad_train		squad_data/squad_train
.gitattributes		.gitattributes
.gitignore		.gitignore
LICENSE		LICENSE
README.md		README.md
argmax_task.py		argmax_task.py
bertgen.py		bertgen.py
berttest.py		berttest.py
copy_task.py		copy_task.py
dnc.py		dnc.py
faiss_index.py		faiss_index.py
file_utils.py		file_utils.py
flann_index.py		flann_index.py
lambada.py		lambada.py
lambada15.py		lambada15.py
lambadan.py		lambadan.py
lambadaskip.py		lambadaskip.py
lambadatest.py		lambadatest.py
memory.py		memory.py
modeling.py		modeling.py
optimization.py		optimization.py
putils.py		putils.py
sam.py		sam.py
samback.py		samback.py
sdnc.py		sdnc.py
sparse_memory.py		sparse_memory.py
sparse_memoryback.py		sparse_memoryback.py
sparse_memoryinter.py		sparse_memoryinter.py
sparse_temporal_memory.py		sparse_temporal_memory.py
sq.py		sq.py
squaddata.py		squaddata.py
testsquaddata.ipynb		testsquaddata.ipynb
tokenization.py		tokenization.py
transformer_memory.py		transformer_memory.py
util.py		util.py
wikitextlm.py		wikitextlm.py

Provide feedback