Skip to content

Commit

Permalink
update readme
Browse files Browse the repository at this point in the history
  • Loading branch information
ByronHsu committed Aug 14, 2024
1 parent ae14a87 commit b8f149f
Showing 1 changed file with 2 additions and 2 deletions.
4 changes: 2 additions & 2 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -2,7 +2,7 @@

[![Downloads](https://static.pepy.tech/badge/liger-kernel)](https://pepy.tech/project/liger-kernel) [![PyPI version](https://badge.fury.io/py/liger-kernel.svg)](https://badge.fury.io/py/liger-kernel) [![PyPI version](https://badge.fury.io/py/liger-kernel-nightly.svg)](https://badge.fury.io/py/liger-kernel-nightly)

**Liger (Linkedin GPU Efficient Runtime)Kernel** is a collection of Triton-native kernels designed specifically for LLM training. It aims to be **ease of use**, **exact**, **time- and memory-efficient**, and **lightweight**. We welcome contributions from the community to gather the best kernels for LLM training.
**Liger (Linkedin GPU Efficient Runtime) Kernel** is a collection of Triton-native kernels designed specifically for LLM training. It aims to be **ease of use**, **exact**, **time- and memory-efficient**, and **lightweight**. We welcome contributions from the community to gather the best kernels for LLM training.

## 🌟 Overview

Expand All @@ -19,7 +19,7 @@ Gain +20% throughput and reduce memory usage by 60%. Achieve longer context leng
> 2. HuggingFace models start to OOM at a 4K context length, whereas Liger Kernel scales up to 16K.
> 3. **Fused Linear Cross Entropy Loss** is enabled to significantly reduce memory usage.
### ✨ Patch HF model with one line or take individual kernels
### ✨ Patch HF model with one line or use individual kernels

| 🛠️ Patch Existing HF Model | 🧩 Compose Your Own Model |
|--------------------------|-------------------------|
Expand Down

0 comments on commit b8f149f

Please sign in to comment.