Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add dev container to repo #290

Open
dfberry opened this issue May 5, 2024 · 4 comments
Open

Add dev container to repo #290

dfberry opened this issue May 5, 2024 · 4 comments

Comments

@dfberry
Copy link

dfberry commented May 5, 2024

It would be helpful is the repo had a dev container. Happy to provide though a PR.

@Juzov
Copy link
Collaborator

Juzov commented May 6, 2024

We'd welcome a contribution.

@dfberry
Copy link
Author

dfberry commented May 6, 2024

@chenwanqq can you say more about llama.cpp?

@chenwanqq
Copy link

@chenwanqq can you say more about llama.cpp?

Sorry, I deleted my post before because when I replied, I just did not really understand what a dev container is. Of course, a dev container setting would be very beneficial for this project.
The llm-chain cannot work by itself (unless you use llm-chain-mock). It requires an llm backend. So, if you want to set up a dev container that contains everything a developer needs, you should consider which llm backend should be used.
For example, if you can use llm-chain-openai, then you need to ask developers to provide their own API key. Or, this container could have a compiled llama.cpp inside, so developers can run llm locally. Hmm I think there are many possible scenarios.

@dfberry
Copy link
Author

dfberry commented May 6, 2024

I can't seem to run this in just a rust container and I'm new to langchain. So basically every chain configuration (and the resulting dependency) would need to be accounted for in the dev container. There is no single base that would work. Is that what you are saying?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants