README.md

Hi EveryOne, This is Awesome-LLM is a curated list of papers about large language models, especially relating to ChatGPT. It also contains frameworks for LLM training, tools to deploy LLM, courses and tutorials about LLM and all publicly available LLM checkpoints and APIs. The repository is maintained by mr-rakesh-ranjan on GitHub.

Process for Installing

• Steps

  1. Create Virtual environments using 'python -m venv v_env'
  2. Activate virtual environments using In powershell 'v_env\Scripts\Activate.ps1' In cmd 'v_env\Scripts\activate.bat'
  3. Install all requirements.txt using 'pip install -r requirements.txt'
  4. After all installments Dowonload 'ggml-gpt4all-j-v1.3-groovy.bin' file from this link. ggml-gpt4all-j-v1.3-groovy
  5. Save that .bin file to the root folder.

  7. Create a .env file for creating the environments for LLMs MODEL_TYPE=GPT4All MODEL_PATH='add_model_path' EMBEDDINGS_MODEL-NAME=all-MiniLM-L6-v2 MODEL_N_CTX=1000 MODEL_N_BATCH=8 TARGET_SOURCE_CHUNKS=4

  7. Now Run the vector.py using 'python vector.py' -> After running previous command, a folder is created with name 'faiss-index-250' which contains two file 1. index.faiss and 2. index.pkl

     

  8. Lastly Run the app.py using 'python app.py' and ASK YOUR QUESTIONS FROM THE PDF