GraphMate is a web application designed to assist blind individuals in understanding graphical data through sound. This project utilizes Flask for the backend, OpenAI for natural language processing (NLP), and takes audio input using the Speech-to-Text function in JavaScript to generate sound output based on interpreted equations.
- Auditory Graph Interpretation: Convert audio input into descriptive audio representations of graphical data.
- NLP Integration: Leverage the power of OpenAI's NLP to interpret spoken equations.
- Interactive Exploration: Allow users to interact with and explore graphs using keyboard shortcuts or voice commands.
- Speech-to-Text: Utilize the Speech-to-Text function in JavaScript for converting spoken input to text.
- Backend: Flask
- Frontend: HTML, CSS, Javascript
- NLP: OpenAI API
- Graph Processing: Function Developed using Python
- Audio Processing: TextToSpeech-Python
- Speech-to-Text: JavaScript
- Ensure you have Python installed.
- Install Flask by running
pip install Flask
. - Clone this repository to your local machine.
- Navigate to the project directory.
- Run
pip install -r requirements.txt
to install Python dependencies.
- Start the Flask server by running
python app.py
. - Open your browser and visit
http://localhost:5000
to access GraphMate.
We welcome contributions! If you would like to contribute to GraphMate, please follow our contribution guidelines.
Your feedback is valuable. If you encounter any issues or have suggestions for improvement, please open an issue.
- Special thanks to Pranav Sridhar, Rehaan Shaweez and Neelalohit who have helped to make GraphMate .