Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Llama 3B] Support for rotary embedings #165

Open
nvukobratTT opened this issue Aug 23, 2024 · 2 comments
Open

[Llama 3B] Support for rotary embedings #165

nvukobratTT opened this issue Aug 23, 2024 · 2 comments
Assignees
@chandrasekaranpradeep
Labels
enhancement New feature or request
Milestone
[FFE - E2E] Open ...

Comments

@nvukobratTT
Copy link
Contributor

No description provided.

@nvukobratTT nvukobratTT self-assigned this Aug 23, 2024
nvukobratTT added a commit that referenced this issue Aug 23, 2024
@nvukobratTT
[Model] Llama 3B: Include tests with proper setups for main builing b…
e5aae0c 
…locks + minor fix. #123 #124 #125 #126 #165

Main Llama blocks:
- Embeddings
- LM Head
- MLP
- RMS Norm
- Rotary Embeddings
- Self Attention
nvukobratTT added a commit that referenced this issue Aug 26, 2024
@nvukobratTT
[Model] Llama 3B: Include tests with proper setups for main builing b…
8d88845 
…locks + minor fix. #123 #124 #125 #126 #165 (#167)

Main Llama blocks:
- Embeddings
- LM Head
- MLP
- RMS Norm
- Rotary Embeddings
- Self Attention
@staylorTT staylorTT added the enhancement New feature or request label Sep 3, 2024
@nvukobratTT
Copy link
Contributor Author

There are some dynamic shapes on the TVM level when the pure block is extracted.

Merged
@chandrasekaranpradeep
Copy link
Contributor

chandrasekaranpradeep commented Sep 23, 2024 •
edited
Loading

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@chandrasekaranpradeep chandrasekaranpradeep

Labels
enhancement New feature or request
Projects
None yet
Milestone
[FFE - E2E] Open Llama 3B
Development

No branches or pull requests
3 participants
@nvukobratTT @chandrasekaranpradeep @staylorTT