Gnu/Linux-ai-voice-assistant is a versatile terminal based interface that utilizes various open source tools, offering a seamless interaction with a llms, a variety of services and features. The main components of the Assistant are :
- Vosk - An open-source speech recognition toolkit.
- Piper - A fast, local neural text to speech system that sounds great.
- Shellgpt - A command-line productivity tool powered by AI large language models (LLM).
- Nerd-Dictation - This is a utility that provides simple access speech to text for using in Linux without being tied to a desktop environment, using the excellent VOSK-API.
GLAVA is not just a tool for passing the Turing test, it's a dynamic command-line assistant, ready to assist you with a multitude of tasks and queries . At its heart lies the power of Large Language Models (LLMs), a sea of knowledge waiting to be harnessed.
Its is not just a tool for information retrieval. It's a companion, ready to assist you with a wide array of tasks, making your command-line experience more enjoyable and efficient.
With its multimodal interaction, it can interact with you in a text or voice format. It can pull information from various sources, generate shell commands,images, and even browse the web. It's your go-to assistant for all your information and entertainment needs.
GLAVA harnesses the power of LLMs to provide a wide array of functionalities. Whether you prefer to interact with it using keystrokes or voice, GLAVA has your back. It responds in both text and voice format, ensuring a seamless interaction.
GLAVA allows you to dictate your commands using voice, or type them out.
For voice recognition, we use Vosk, a free. lightweight , efficient and open-source toolkit for speech recognition. Vosk runs as a REST websocket, ensuring accurate and real-time transcription.
For your ears to be satisfied, GLAVA is not just a talker, it's a master of Text-to-Speech (TTS). It uses Piper, a powerful tool that can be used with HTTP websockets, where text is curled to get voice, or by using the Piper binary.
Listen to voice samples here
GLAVA can do speech to text typing ,using the Nerd Dictation which is very accurate and can be easily customized with python scripts which act as config .(uses Vosk-Api)
Here is the config that this project uses which enable , "start writing" , "stop writing" commands for enabling/Disabling voice Dictation , along with few punctuations , word capitalisation etc.
User can query for information and calculations using Wolfram Alpha Api.
Glava can query for news from NewsAPI and Google News, and get the result in both text and voice format, making learning and staying updated in a delightful journey.
GLAVA is not just a tool for information retrieval. It can generate shell commands and execute them, allowing you to edit, abort, and execute commands with ease. It's like having a personal assistant, ready to help you out with tasks that might otherwise take time and effort.
GLAVA can open a web browser to various websites, making your browsing experience a breeze. It can search various websites and Wikipedia for information, providing you with the information you need, when you need it.
Browse your favorite websites like YouTube, GitHub, Wikipedia, Amazon, and Reddit, or use DuckDuckGo with custom search parameters as the default search engine.
GLAVA can play any song or video from YouTube sources, using yt-dlp, mpd, and mpv. It can play them in both audio and video format, making it your personal playlist creator.
GLAVA can query information about any movie from IMDb, providing you with a wealth of information about the movie, including its plot, cast, and ratings.
GLAVA can help you generate images with text by using free services of https://pollinations.ai/
Before you begin, ensure you have met the following requirements:
- Python 3.6 or higher.
- pip.
- Gnu/Linux system.
- mpv,mpd(for audio,optional),yt-dlp (for youuthube playback)
- Shellgpt
Follow these steps to install and set up the project:
-
Clone the repository:
git clone https://github.com/akhil3417/glava -
Navigate to the project directory:
cd glava -
Run the installation script:
chmod +x installer.sh ./installer.sh -
Note, the installer script only installs vosk-model-small-en-us-0.15(voice_recognition) and en_US-hfc_female-medium(tts) models. To add your additional models, download them from Piper , Vosk and extract them to
./extensions/piper/models/or./extensions/voskdirectory.
You can listen to voice samples for Piper tts here for piper , and download the preferred model accordingly.
Make sure you have Shellgpt up and running if not see Shellgpt Installation .
You can now start the project with following command:
./start.sh
or
. .env/bin/activate
python3 main.py
All the user queries are match with keys in commands dictionary , if it exists then the corresponding function is executed , if nothing matches shellgpt takes over.
For more info , see the commands dict in main.py.
You can now interact with the project using voice commands or your keystrokes.
User can edit the config.ini as per their needs(assistant name , api-keys etc).
If you'd like to contribute to this project, please adhere to the following guidelines:
- Fork the project.
- Create your feature branch:
git checkout -b feature/AmazingFeature. - Commit your changes:
git commit -m 'Add some AmazingFeature'. - Push to the branch:
git push origin feature/AmazingFeature. - Open a pull request.
This Project is in early development so bugs are expected and will be fixed in future .
Here a few more tools ,based on vosk.
- https://git.sr.ht/~geb/sprec
- https://git.sr.ht/~geb/numen
- https://k2-fsa.github.io/sherpa/onnx/tts/apk-engine.html
This project is licensed under the MIT License. For more details, please refer to the LICENSE.md file in the repository.
For any inquiries or suggestions, feel free to reach out to the project maintainer at [will add soon]. I'd be happy to assist you with your needs.