Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

stream mode supports output schema #801

Open
Undertone0809 opened this issue Jul 19, 2024 · 2 comments
Open

stream mode supports output schema #801

Undertone0809 opened this issue Jul 19, 2024 · 2 comments
Labels
enhancement New feature or request

Comments

@Undertone0809
Copy link
Owner

🚀 Feature Request

Now pne cannot use stream + output_schema. For example:

import pne
from pydantic import BaseModel

class LLMResponse(BaseModel):
    content: str = Field(..., description="LLM response content")

response = pne.chat(model="gpt-4o", stream=True, output_schema=LLMResponse)

It will get error if you run this example.

This feature should build after #625.

@Undertone0809 Undertone0809 added the enhancement New feature or request label Jul 19, 2024
@Undertone0809
Copy link
Owner Author

#625

@Issues-translate-bot
Copy link

Bot detected the issue body's language is not English, translate it automatically.


#625

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
Status: Backlog
Development

No branches or pull requests

2 participants