Skip to content

Changing LLM Models in Alwrity AI Writer

AJ!! edited this page Apr 6, 2024 · 2 revisions

Changing LLM Models in Alwrity AI Writer

Alwrity AI Writer provides users with the flexibility to switch between different Language Model (LLM) providers and select from a range of supported models. This capability allows users to tailor their text generation experience based on their specific requirements and preferences.

OpenAI

  • GPT-3: Developed by OpenAI, GPT-3 is one of the most advanced LLMs available, capable of generating human-like text across a wide range of topics.
  • GPT-4: An upgraded version of GPT-3, offering enhanced capabilities and improved performance in text generation tasks.

Google

  • Google Gemini Pro: Bidirectional Encoder Representations from Transformers (BERT) is a pre-trained LLM developed by Google, known for its effectiveness in natural language understanding tasks.
  • Google T5: Text-To-Text Transfer Transformer (T5) is another powerful LLM from Google, capable of performing a wide range of text generation tasks.

Minstral - WIP

  • Minstral M1: Minstral M1 is a proprietary LLM developed by Minstral Inc., designed to offer high-quality text generation with a focus on specific industries or domains.
  • Minstral M2: Building upon the capabilities of Minstral M1, Minstral M2 introduces advanced features and optimizations for improved performance.

Changing LLM Models

To change the LLM model in Alwrity AI Writer, follow these steps:

  1. Set the GPT_PROVIDER Environment Variable: Determine which LLM provider and model you want to use and set the GPT_PROVIDER environment variable accordingly. For example, to switch to the GPT-4 model from OpenAI, set GPT_PROVIDER to openai and specify model=gpt-4 in the configuration.
export GPT_PROVIDER=openai
  1. Update Configuration: If necessary, update the Alwrity AI Writer configuration file to reflect the changes in the LLM provider and model. Ensure that the configuration is correctly set up to use the selected provider and model.
# Choose one of following: Openai, Google, Minstral
gpt_provider = google
  1. Restart Alwrity AI Writer: Once the changes are made, restart the Alwrity AI Writer program to apply the new configuration and start using the selected LLM model for text generation.

Using Environment Variable GPT_PROVIDER

One way to change the LLM model in Alwrity AI Writer is by utilizing the GPT_PROVIDER environment variable. By setting this variable to the desired LLM provider, users can seamlessly switch between different providers without making manual changes to the configuration.

Supported LLM Providers and Models

Alwrity AI Writer supports multiple LLM providers, each offering a variety of models to choose from. The following is a list of supported providers and some of the popular models available: