Skip to content

Commit

Permalink
trim and organize
Browse files Browse the repository at this point in the history
  • Loading branch information
Quentin-Anthony committed Sep 20, 2024
1 parent 788e40d commit 371ad80
Showing 1 changed file with 2 additions and 2 deletions.
4 changes: 2 additions & 2 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -14,8 +14,6 @@ to make everything easily searchable.

## Implementation Validation

We've verified the correctness of this implementation via coordinate checks and LR transfer.

### Coordinate Checks

Standard Parameterization:
Expand All @@ -34,6 +32,8 @@ muTransfer:
<img src="assets/mutransfer_lr_shakespeare_char.png" alt="mup-shakespeare"> | <img src="assets/mutransfer_lr_owt.png" alt="mup-owt">


## Citation

If ["The Practitioner’s Guide to the Maximal Update Parameterization"](https://www.cerebras.ai/blog/the-practitioners-guide-to-the-maximal-update-parameterization) or this repository was useful to you, please cite:
```
@misc{cerebras2024mupguide,
Expand Down

0 comments on commit 371ad80

Please sign in to comment.