Pinned Loading

1. mit-han-lab/streaming-llm mit-han-lab/streaming-llm Public

   [ICLR 2024] Efficient Streaming Language Models with Attention Sinks

   Python 6.6k 364

2. mit-han-lab/smoothquant mit-han-lab/smoothquant Public

   [ICML 2023] SmoothQuant: Accurate and Efficient Post-Training Quantization for Large Language Models

   Python 1.2k 142

3. mit-han-lab/duo-attention mit-han-lab/duo-attention Public

   DuoAttention: Efficient Long-Context LLM Inference with Retrieval and Streaming Heads

   Python 272 12

4. mit-han-lab/fastcomposer mit-han-lab/fastcomposer Public

   [IJCV] FastComposer: Tuning-Free Multi-Subject Image Generation with Localized Attention

   Python 656 36

5. mit-han-lab/offsite-tuning mit-han-lab/offsite-tuning Public

   Offsite-Tuning: Transfer Learning without Full Model

   Python 367 38

6. torch-int torch-int Public

   This repository contains integer operators on GPUs for PyTorch.

   Python 179 50