Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

TG Llama3 70b prefill_decode demo #12865

Draft
wants to merge 6 commits into
base: main
Choose a base branch
from
Draft

TG Llama3 70b prefill_decode demo #12865

wants to merge 6 commits into from

Conversation

djordje-tt
Copy link
Contributor

Ticket

Link to Github Issue

Problem description

Provide context for the problem.

What's changed

Describe the approach used to solve the problem.
Summarize the changes made and its impact.

Checklist

  • Post commit CI passes
  • Blackhole Post commit (if applicable)
  • Model regression CI testing passes (if applicable)
  • Device performance regression CI testing passes (if applicable)
  • New/Existing tests provide coverage for changes

@djordje-tt djordje-tt self-assigned this Sep 19, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@cglagovichTT cglagovichTT Awaiting requested review from cglagovichTT cglagovichTT will be requested when the pull request is marked ready for review cglagovichTT is a code owner

@caixunshiren caixunshiren Awaiting requested review from caixunshiren caixunshiren will be requested when the pull request is marked ready for review caixunshiren is a code owner

@uaydonat uaydonat Awaiting requested review from uaydonat uaydonat will be requested when the pull request is marked ready for review uaydonat is a code owner

At least 0 approving reviews are required to merge this pull request.

Assignees

@djordje-tt djordje-tt

Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
2 participants
@djordje-tt @kpaigwar