Quick Start and Basic Concept ( Please skip the code)

• Mistral Cookbook
• 1hr Talk Intro to Large Language Models
• Let's reproduce GPT-2 (124M)
• OpenAi API Reference
• RAG From Scratch
• What's next for AI agentic workflows ft. Andrew Ng of AI Fund
• Hugging Face Transformers
• What We’ve Learned From A Year of Building with LLMs
• LLM101n: Let's build a Storyteller
• GPT2 -60line of code

Short Tutorials

Dataset

• FineWeb
• HellaSwag
• 💾 LLM Datasets

Promopt Engineering

• Promopt Engineering with Llama 2
• GenAI Handbook
• LLM from Scratch
• Prompt Survey
• Memory of Thought
• Chain of Thought

RAG

• RAG From Scratch
• Preprocessing Unstructured Data for LLM Applications
• Building Applications with Vector Databases
• advanced retrieval for ai
• Large Language Models with Semantic Search
• Building and Evaluating Advanced RAG
• Vector Databases: from Embeddings to Applications
• Understanding and Applying Text Embeddings

Finetuning

Data Preparation

• LIMA: Less Is More for Alignment
• LoRA Land: 310 Fine-tuned LLMs that Rival GPT-4, A Technical Report

Parameter Efficient Fine Tuning

• P-Tuning
• P-Tuning v2
• LoRA
• IA3
• Finetuning Large Language Models
• Evaluating and Debugging Generative AI
• Efficiently Serving LLMs
• parameter-efficient-fine-tuning
• PEFT
• SFT Examples with QLoRA
• Predibase: Efficiently Server Multiple LoRA Land Adapter.ipynb
• Finetune examples
• Lora Land

RLHF

• Reinforcement Learning From Human Feedback

Deployment

Quantilization

• Quantization Overview
• Quantization Survey
• QAT & PTQ

LLMOps Architecture

• Architectures for LLM applications
• E2E Framework
• ML ops

Orchestration Tools

• DIFY
• LangChain
• Pydantic

Agent

• Functions, Tools and Agents with LangChain
• LLM Agent
• LLM Powered Autonomous Agents
• LLM Powered Autonomous Agents)

Diffusion

• Introduction to Image Generation
• How Diffusion Models Work

Multimodal

• Multimodal Algorithmic Reasoning Workshop
• LLAVA

Hallucination Detection

• awesome-hallucination-detection

Comprehensive Tutorial

• microsoft/generative-ai-for-beginners
• 12 days of no-cost training to learn generative AI this December
• Large Language Models, Part I
• Large Language Models, Part II
• Let's build the GPT Tokenizer
• Stanford CS25
• LLM Course
• Introduction to LangGraph
• Hands-On-Large-Language-Models
• Awesome LLM Apps
• Awesome LLM Strawberry (OpenAI o1)
• Reasoning
• LLMs-from-scratch

Papers

• The Illustrated Transformer
• SFT
• RLHF
• DPO
• ORPO
• RLAIF
• LoRA Paper
• LoRA YouTube
• LoRA Github
• QLoRA
• Gemini: A Family of Highly Capable Multimodal Models
• GPT-4 Technical Report
• ReFT
• Parameter-Efficient Fine-Tuning Methods for Pretrained Language Models: A Critical Review and Assessment
• Lora Land
• AI Scientist

Open Source Model Review

Llama

• Llama 2 Paper

GPT

• GPT-2

SnowFlake Arctic

• [SnowFlake Artic Github] (https://github.com/Snowflake-Labs/snowflake-arctic)

Reference

• MOE review
• DeepSpeed
• Zero-2
• MOE
• Deep Speed MOE
• Switch Transformers: Scaling to Trillion Parameter Models with Simple and Efficient Sparsity
• GlaM
• GShard: Scaling Giant Models with Conditional Computation and Automatic Sharding
• Mixture-of-Experts Meets Instruction Tuning: A Winning Combination for Large Language Models
• AdamW

Other Useful Resources

• awesome-generative-ai-guide
• Awesome-Multimodal-Large-Language-Models
• AI Collection
• Awesome-LLMOps
• Awesome-LLM-Inference
• Awesome-LLM
• Awesome Generative AI
• LLM for autonomous driving
• Awesome LLM agents
• Awesome Generative AI

Popular Github

• RD Agent
• DsPy
• Auto-GPT
• Auto/gen
• MetaGPT
• MeMGPT
• Open Devin
• Devika
• AIOS
• Agent OPS
• FinGPT
• DeepSeek
• GPT Computer Assistant
• LitGPT
• Open Interpreter
• AI tools
• Contrastive Learning
• Lil Log
• O1 Engineer
• [LLM Course] (https://github.com/mlabonne/llm-course)
• [Awesome LLM Reasoning] (https://github.com/atfortes/Awesome-LLM-Reasoning)
• 🗣️ Large Language Model Course