Awesome LocalLLM

A curated list of awesome Local and Open Source LLM resources, libraries, tools, etc.

Contents

• Introduction
• Speech To Text
• LLM Desktop Apps
• 7B Param Models
• Image Generation

Introduction

The future of LLMs is decentralized, local and open source. This is the ultimate resource for it. Happy to accept contributions!

Speech To Text

• MacWhisper - Mac OS tool for running OpenAI's whisper models locally.

LLM Desktop Apps

Run LLMs locally with a nice UI

• LM Studio - A beautiful UI to install and run LLMs with an easy to use chat interface.

7B Param Models

These models run really well on even an M1 Macbook Air!

• Starlink 7B - Comparable to GPT-3.5 for creative writing, STEM, humanities and role play. Struggles with tasks involving reasoning or mathematics and may not always accurately self-identify or ensure the factual correctness of its outputs.

Image Generation

• Draw Things - Run full stable diffusion models on your Macbook and iPhone.