feat: Update requirements.txt with versioned dependencies and categories

- Add version specifications for all packages
- Categorize dependencies (LLM APIs, Viz, Core, Optional)
- Add development dependencies
- Include system monitoring tools
- Add helpful comments for clarity

Part of SakanaAI#158

Co-Authored-By: Erkin Alp Güney <[email protected]>

requirements.txt

@@ -1,17 +1,36 @@
 # LLM APIs
-anthropic
-aider-chat
-backoff
-openai
+anthropic>=0.5.0
+backoff>=2.2.0
+google-cloud-aiplatform>=1.35.0
+litellm>=1.10.0
+openai>=1.0.0
+python-dotenv>=1.0.0
+
 # Viz
-matplotlib
-pypdf
-pymupdf4llm
+matplotlib>=3.7.0
+pypdf>=3.0.0
+pymupdf>=1.23.0
+pymupdf4llm>=1.0.0
+
 # Common Requirements
-torch
-numpy
-transformers
-datasets
-tiktoken
-wandb
-tqdm
+torch>=2.0.0
+numpy>=1.24.0
+transformers>=4.30.0
+datasets>=2.14.0
+tiktoken>=0.5.0
+wandb>=0.15.0
+tqdm>=4.65.0
+semantic-scholar>=0.5.0
+
+# System Monitoring
+psutil>=5.9.0
+
+# Optional Dependencies
+ollama>=0.1.0
+
+# Development Dependencies
+pytest>=7.0.0
+black>=22.0.0
+isort>=5.10.0
+flake8>=4.0.0
+mypy>=0.990