Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[V3] Fix the bug of text-generation example #903

Open
wants to merge 1 commit into
base: v3
Choose a base branch
from

Conversation

NingW101
Copy link

  • Update the package name to huggingface/transformers
  • Update model file name of distilgpt2
  • Add TextStreamer to handle callback function for TextGenertaionPipeline

@NingW101
Copy link
Author

I tried to test text-generation example with transformers-v3 and found that models could not be successfully fetched from HF because the path of onnx model was not correctly concatenated, besides, the code for dispatching callback function when new token is generated has been changed to use Streamer (including accept cb, decode the new generated tokens), however it has not been implemented in pipeline. I have tested and the example went well.

@xenova PTAL

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant