Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Phases #13

Open
ChakshuGautam opened this issue Sep 26, 2023 · 4 comments
Open

Phases #13

ChakshuGautam opened this issue Sep 26, 2023 · 4 comments
Assignees

Comments

@ChakshuGautam
Copy link

Dimensions

  1. Complexity of PDFs structure => Single PDF, 2 Delinked PDFs, Linked PDFs, PDFs with Images, PDFs with Tables.
  2. Complexity of Questions => Fact Parrot, Neural Coref, Reasoning, Calculations.
  3. Complexity of Ingestion of PDF - Reading, Chunking in the most simplest way
  4. Complexity of Retrieval - Em only, Rank reeval, Hybrid, ColBERT, ...
  5. Automation of 1 and 2

Evaluation

  1. User Feedback
  2. Maximum Content => Breadth

Plan

  1. Start with one PDF and then add more

  2. Ingestion - manual first and then automated

  3. Stages to production

    • PM Testing
    • User Testing
    • Production
  4. Simpler PDF getting ingested => Working for a

@aashutosh-samagra
Copy link

aashutosh-samagra commented Oct 3, 2023

Release 1.0 (User Functionalities)

  • Login - Phone number
  • Mobile responsiveness - PWA
  • Converse with multiple chatbots - Simple fact search without reasoning and calculations
  • Personalized responses - referring to previous question/answer (neural coref)
  • User is able to view the highlighted content across PDFs
  • View Chat History
  • User Feedback - thumbs up/thumbs down

Release 1.0 (Admin Functionality)

  • Admin Login
  • Monitor user data
  • Ingest and train simple PDF files
  • Delete already uploaded files

Release 2.0 (User Functionalities) - Accuracy >90%

  • Converse on WhatsApp
  • Converse with chatbot - Advanced search with basic reasoning and calculations
  • View Chat History in WhatsApp

@ChakshuGautam
Copy link
Author

@aashutosh-samagra
Copy link

Objective:

To provide answers to queries raised by employees from PDFs maintained on Zoho - Core & Constructs, PD, Seamless Operations, Well-being and Org Policies.

The launch has been divided into 3 phases –

V1 – Launch for townhall

Current Status of V1 :

  1. The bot has been developed as a progressive web app link, where the employees will ask questions and also view the highlighted chunk of content from where the answer is picked up.

  2. Currently, the accuracy is around 70%. The bot will be able to answer the following types of questions:

Simple fact check ✔️

  • How many leaves are there in maternity leave?
  • What are the Panchsutras for time management?
  1. Features yet to be developed for V1:
  • Login via OTP
  • Training multiple PDFs
  • Admin panel with the option of ingesting and auto-training simple PDFs by the user

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants