A curated list of awesome Local and Open Source LLM resources, libraries, tools, etc.
The future of LLMs is decentralized, local and open source. This is the ultimate resource for it. Happy to accept contributions!
- MacWhisper - Mac OS tool for running OpenAI's whisper models locally.
Run LLMs locally with a nice UI
- LM Studio - A beautiful UI to install and run LLMs with an easy to use chat interface.
These models run really well on even an M1 Macbook Air!
- Starlink 7B - Comparable to GPT-3.5 for creative writing, STEM, humanities and role play. Struggles with tasks involving reasoning or mathematics and may not always accurately self-identify or ensure the factual correctness of its outputs.
- Draw Things - Run full stable diffusion models on your Macbook and iPhone.