Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add OpenAI Function Agents & logging capabilities using aimstack #18

Open
wants to merge 4 commits into
base: main
Choose a base branch
from

Conversation

srmsoumya
Copy link
Member

  • Add support for open-ai function agents that better handle parameter passing to tools
  • Log experiments using aimstack - easy to compare runs by different agents
  • Handle exceptions gracefully

@srmsoumya srmsoumya requested a review from sunu August 3, 2023 08:07
@srmsoumya
Copy link
Member Author

@sunu aimstack stores the log in the root of cwd as .aim/.

We can check the logs in a dashboard by aim up that runs on port 43800 by default. Should we have this running as well to check logs periodically?

@sunu
Copy link
Member

sunu commented Aug 3, 2023

Just some initial thoughts:

  • If we're going to run aimstack as a service and monitor multiple experiments, we should see if it supports storing/loading data from something more cloud native - like a GCS bucket for example
  • If we are ok with running aimstack coupled to this particular streamlit app only, then I guess we can try to run it as a sidecar that will share a storage volume with the streamlit app. In theory, it should work, but may require some figuring out.

app.py Outdated Show resolved Hide resolved
@srmsoumya
Copy link
Member Author

If we're going to run aimstack as a service and monitor multiple experiments, we should see if supports storing/loading data from something more cloud native - like a GCS bucket for example

I don't foresee us using aimstack for monitoring other experiments, so we can run this as a one-off for now, we can switch to LangSmith once it is out of public beta.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants