Added multiple pages

.pre-commit-config.yaml

@@ -20,8 +20,8 @@ repos:
       - id: check-symlinks
       - id: destroyed-symlinks
       # - id: no-commit-to-branch # personal project - just do main directly for now
-  - repo: https://github.com/fastai/nbdev
-    rev: 2.3.13
-    hooks:
-      - id: nbdev_clean
-      # - id: nbdev_export - no library needed
+  # - repo: https://github.com/fastai/nbdev
+  #   rev: 2.3.13
+  #   hooks:
+  #    # - id: nbdev_clean - i'll keep the notebook output for now
+  #    # - id: nbdev_export - no library needed

README.md

@@ -12,6 +12,8 @@ helpful for you too.
 - [LinkedIn/mudiarto](https://www.linkedin.com/in/mudiarto/)
 - [Twitter/mudiarto](https://twitter.com/mudiarto)
 
-#### Credits
+#### License
+- The license for my notebooks/writing is [CC BY-SA 4.0](https://creativecommons.org/licenses/by-sa/4.0/)
 
-- This page was created using [nbdev](https://nbdev.fast.ai/).
+#### Credits
+- Notebooks structure and pages are created using [nbdev](https://nbdev.fast.ai/) and [quarto](https://quarto.org/).

nbs/_quarto.yml

@@ -22,6 +22,8 @@ website:
         text: Home
       - section: Notes
         contents: notes/*
+      - section: Tools
+        contents: tools/*
       - section: Extras
         contents: extras/*
   favicon: assets/favicon.jpg
@@ -34,6 +36,8 @@ website:
         href: index.qmd
       - text: "Notes"
         href: notes/index.qmd
+      - text: "Tools"
+        href: tools/index.qmd
       - text: "Extras"
         href: extras/index.qmd
       - text: "Help"
@@ -45,8 +49,9 @@ website:
     right:
       - icon: github
         href: "https://github.com/mudiarto"
+        aria-label: Mudiarto at Github
       - icon: twitter
         href: https://twitter.com/mudiarto
-        aria-label: Fast.ai Twitter
+        aria-label: Mudiarto at Twitter
 
 metadata-files: [nbdev.yml]

nbs/extras/20240430-mlflow-experiment.qmd

@@ -0,0 +1,42 @@
+# mlflow experiment (wip)
+
+### Goals
+
+- I want to keep track of my experiments, whether LLM experiments, or other experiments as well.
+- I want to be able to compare the result of different prompts, different scenario, different models, etc.
+- I'd like to be able to do experiment with [Langchain](https://python.langchain.com) as well.
+
+### Tools/Architecture
+
+- [MLFlow](https://mlflow.org/) for keeping track of the experiments
+- [Langchain](https://python.langchain.com)
+- some kind of inference server, probably [llama.cpp server](https://github.com/ggerganov/llama.cpp/tree/master/examples/server),
+  or others
+- [MLFlow + Langchain)(https://mlflow.org/docs/latest/llms/langchain/index.html)
+
+
+I want those tools to be simple to setup in my local, and can be inspected in the future as well, so I'll try to
+make it run with docker and store the result locally & version-controlled so it can be inspected by others.
+
+I'd need couple other tools to do it:
+
+- git
+- git-lfs (to store sqlite db cleanly)
+- ~~docker & docker compose~~ - I originally wants to run it in docker, but it turned out running it natively is easier
+(w.r.t. installation & file permission issue)
+- ~~[minio](https://min.io/) - to simulate S3, but store it locally~~ - I thought I need minio to simulate s3, but it
+turned out mlflow can use local storage directly, and it makes everything easy
+
+
+## Setup
+
+### MLFlow setup
+
+- mlflow is installed locally - using `pip install mlflow`. see [requirements.txt](https://github.com/mudiarto/ml-notebooks/blob/dev/requirements.txt)
+  - I tried to install using conda and it worked, but somehow
+I got weird error: ["You are very likely running the MLflow server using a source installation of the Python MLflow
+package"](https://github.com/mlflow/mlflow/issues/3631) - so I just uninstall it and use pip installation
+  - See the environment variables I use to run here: 
+https://github.com/mudiarto/ml-notebooks/blob/43838aacb986f090de5f1b5a3395b5fec8b07602/justfile#L70-L75- 
+
+- 

nbs/extras/index.qmd

@@ -1,5 +1,5 @@
 ---
-order: 2
+order: 3
 title: Extras
 listing:
   fields: [title, description]

nbs/index.qmd

@@ -1,6 +1,5 @@
 # @mudiarto's notebooks
 
-
 A place to keep my notes and experiment with what I learn. I hope it is helpful for you too.
 
 ## Notes
@@ -14,5 +13,9 @@ A place to keep my notes and experiment with what I learn. I hope it is helpful
 - [Twitter/mudiarto](https://twitter.com/mudiarto)
 
 
+##### License
+- The license for my notebooks/writings is [CC BY-SA 4.0](https://creativecommons.org/licenses/by-sa/4.0/)
+- The license for original codes/scripts created by me in this notebook is [MIT](https://opensource.org/license/mit)
+
 #### Credits
-* This page was created using [nbdev](https://nbdev.fast.ai/).
+- Notebooks structure and pages are created using [nbdev](https://nbdev.fast.ai/) and [quarto](https://quarto.org/).

nbs/nbdev.yml

@@ -3,7 +3,7 @@ project:
 
 website:
   title: "@mudiarto's notebooks"
-  site-url: "https://mudiarto.github.io/mudiarto.github.io"
+  site-url: "https://kusno.mudiarto.com"
   description: "Kusno Mudiarto's Notebooks"
   repo-branch: main
   repo-url: "https://github.com/mudiarto/mudiarto.github.io"

nbs/notes/20240427-update-resume.qmd

@@ -1,4 +1,4 @@
-# Updating My Resume
+# Updating My Resume (wip)
 
 My resume is a bit outdated, [the last version (atm) was made in 2013](https://github.com/mudiarto/resume/tree/c263795bd5683e640a0a7d2f4572f74256e0ae40). I need to update it, and while I'm learning ML & LLM, I suppose it is a good way to experiment and using it to update my resume.
 
@@ -14,3 +14,4 @@ The input of the LLM will be somewhat unstructured data of projects i've done, t
 ### Steps:
 
 - [Install and experiment with llama.cpp](/extras/20240427-llamacpp-experiment.html)
+- TBD

nbs/sidebar.yml

@@ -4,10 +4,16 @@ website:
       - index.qmd
       - section: extras
         contents:
-          - extras/index.qmd
           - extras/20240427-how-to-download-and-run-models-from-huggingface.qmd
           - extras/20240427-llamacpp-experiment.qmd
+          - extras/20240430-mlflow-experiment.qmd
+        href: extras/index.qmd
       - section: notes
         contents:
-          - notes/index.qmd
           - notes/20240427-update-resume.qmd
+        href: notes/index.qmd
+      - section: tools
+        contents:
+          - tools/cli-tools.qmd
+          - tools/mlai-tools.qmd
+        href: tools/index.qmd

nbs/tools/cli-tools.qmd

@@ -0,0 +1,37 @@
+# CLI Tools/Links (wip)
+
+List of the tools that I use, and the configurations in the dotfiles.
+
+
+
+## dotfiles
+
+I have a huge set of configurations on my private repo, built over the years, but it is not very organized.
+I want to cleanup and make it public so I can clone it easily when I work on a new terminal.
+The old config files are based on [stow](https://www.gnu.org/software/stow/stow.html),
+and I want to change it to use [chezmoi](https://www.chezmoi.io/)
+
+- [My dotfiles - wip](https://github.com/mudiarto/dotfiles)
+
+
+## tools that I use daily
+
+### shell
+
+- zsh
+- xonsh
+
+### version control
+
+- git
+- stgit
+
+### editor
+
+- nvim
+
+
+### communication
+
+- ssh
+- assh

nbs/tools/index.qmd

@@ -0,0 +1,12 @@
+---
+order: 2
+title: Tools
+listing:
+  fields: [title, description]
+  type: table
+  sort-ui: false
+  filter-ui: false
+---
+# My semi organized list of tools
+
+["If the only tool you have is a hammer, it is tempting to treat everything as if it were a nail"](https://en.wikipedia.org/wiki/Law_of_the_instrument)

nbs/tools/mlai-tools.qmd

@@ -0,0 +1,12 @@
+# ML/AI Tools/Links
+
+Links and my comments on tools that I found interesting around the web
+
+## Refs:
+- [Mudiarto ML/AI stars](https://github.com/stars/mudiarto/lists/ml-ai) - My collection of ML/AI stars as I stumbled upon them
+
+## Tools I use
+- TBD
+
+## Tools that seems useful
+- TBD