Pinned Loading

1. Attention-Viewer Attention-Viewer Public

   A tool for visualizing attention-score heatmap in generative LLMs

   Python 21 1

2. thu-nics/qllm-eval thu-nics/qllm-eval Public

   Code Repository of Evaluating Quantized Large Language Models

   Python 111 5

3. CSKV CSKV Public

   [NeurIPS ENLSP Workshop'24] CSKV: Training-Efficient Channel Shrinking for KV Cache in Long-Context Scenarios

   Python 9