MAGICS-LAB

All

10 repositories

OutEffHop
Public
[ICML 2024] Outlier-Efficient Hopfield Layers for Large Transformer-Based Models
transformer outliers attention attention-mechanism outlier-removal outlier hopfield-neural-network ptq outlier-treatment modern-hopfield-networks
Python
•
MIT License
•2•18•1•0•Updated Oct 17, 2024Oct 17, 2024
Optimal-Hopfield-Memory
Public
Python
•
MIT License
•0•0•0•0•Updated Oct 16, 2024Oct 16, 2024
DNABERT_2
Public
[ICLR 2024] DNABERT-2: Efficient Foundation Model and Benchmark for Multi-Species Genome
transcription-factors genome splice dna dataset promoters promoter transcription-factor-binding language-model genome-analysis
Shell
•
Apache License 2.0
•63•271•35•5•Updated Aug 23, 2024Aug 23, 2024
UHop
Public
[ICML 2024] Uniform Memory Retrieval with Larger Capacity for Modern Hopfield Models
hopfield-network associative-memory hopfield memory-capacity network-capacity modern-hopfield-networks modern-hopfield-model sparse-hopfield hopfield-model generalized-sparse-hopfield
Python
•
Apache License 2.0
•0•7•0•0•Updated Jun 3, 2024Jun 3, 2024
BiSHop
Public
[ICML 2024] BiSHop: Bi-Directional Cellular Learning for Tabular Data with Generalized Sparse Modern Hopfield Model
hopfield-network tabular hopfield tabular-methods tabular-model modern-hopfield-networks modern-hopfield-model tabular-learn generalized-sparse-modern-hopfield sparse-hopfield
Python
•
Apache License 2.0
•0•6•0•0•Updated May 27, 2024May 27, 2024
DNABERT_S
Public
DNABERT_S: Learning Species-Aware DNA Embedding with Genome Foundation Models
dna embedding dna-embedding
Python
•14•73•2•1•Updated May 13, 2024May 13, 2024
SparseModernHopfield
Public
[NeurIPS 2023] On Sparse Modern Hopfield Model
transformer attention hopfield modern-hopfield-networks modern-hopfield-model
Python
•
MIT License
•12•57•0•0•Updated Mar 26, 2024Mar 26, 2024
STanHop
Public
[ICLR 2024] STanHop: Sparse Tandem Hopfield Model for Memory-Enhanced Time Series Prediction
transformer attention-mechanism hopfield time-series-prediction time-series-forecasting modern-hopfield-networks modern-hopfield-model
Python
•
MIT License
•1•15•1•0•Updated Jan 18, 2024Jan 18, 2024
NonparametricHopfield
Public
Nonparametric Modern Hopfield Models
efficient-transformers efficient-attention modern-hopfield-networks modern-hopfield-model efficient-hopfield-models efficient-hopfield-networks
Jupyter Notebook
•
Other
•0•7•0•0•Updated Jan 8, 2024Jan 8, 2024
DNABERT
Public
[Bioinformatics] DNABERT: pre-trained Bidirectional Encoder Representations from Transformers model for DNA-language in genome
dna
Python
•
Apache License 2.0
•158•7•0•0•Updated Oct 26, 2023Oct 26, 2023