feat: add mlflow

superlinear-ai · Oct 17, 2023 · 1ecf83e · 1ecf83e
1 parent 8e162dd
commit 1ecf83e
Show file tree

Hide file tree

Showing 6 changed files with 1,036 additions and 106 deletions.
diff --git a/.gitignore b/.gitignore
@@ -65,4 +65,5 @@ __pycache__/
 
 # Project
 keys
-openai_key
+openai_key
+*mlruns/
diff --git a/README.md b/README.md
@@ -15,10 +15,9 @@ Evaluates LLM-based applications.
 - [x] Streamlit page to view the evaluation results.
 - [x] Combine the evaluation results into a single metric.
 - [x] Evaluate and compare different LLM apps (GPT-3.5, GPT-4, with RAG)
-- [ ] Streamlit page to visualize the comparison.
+- [x] Integrate with MLflow for experiment tracking.
 - [ ] Streamlit page to view, edit and add test cases.
-- [ ] Integrate with MLflow for experiment tracking (?)
-
+- [ ] Refactor Evaluator.
 
 ## Using