Releases: uptrain-ai/uptrain
v0.2
🚀 UpTrain Feature Release: Version 0.2 🚀
We're excited to announce the super-fast release of UpTrain version 0.2, packed with exciting new features and enhancements to supercharge your ML model monitoring experience! Here's what's new:
✨ Automated Fine-tuning with WeightWatcher: Introducing automated fine-tuning using the WeightWatcher package (https://github.com/CalculatedContent/WeightWatcher). This allows for effortlessly optimizing ML models for improved performance and accuracy by observing the weights of your pre-trained model.
🔪 Feature Slicing: Evaluate the performance of your models on different categories of features with the new feature slicing capability.
📊 New Logging API: We've introduced a powerful new logging API to streamline the ML model monitoring process.
💼 Enterprise Edition (ee) Folder: For enterprise users, we've introduced the ee folder, providing enhanced efficiency and scalability for managing large-scale ML monitoring operations. This allows enterprises to monitor their models at scale with ease.
🌟 Golden Testing Dataset: Now, you can evaluate new LLM models and prompts with confidence using a curated golden testing dataset. This ensures that freshly minted models meet the highest standards of performance and accuracy.
Upgrade the UpTrain package now and take your ML model monitoring to the next level! 🚀🔥
Note: As always, we value your feedback and are committed to delivering the best ML monitoring experience. Please share your thoughts and suggestions with us to help us continue improving UpTrain. Happy monitoring! 😊👩💻👨💻
v0.1.2
v0.1.1
🚀 UpTrain Feature Release 🚀
We're excited to announce a new release of UpTrain with some exciting features! Here's what's new:
📝 Grammar Check: We've added a new integrity check to our Language Model Monitoring (LLM) outputs. Now, you can check for grammatical errors in your text data to ensure it meets your quality standards.
🔗 Feature Concatenation: We've introduced a new feature concatenation measurable that allows adding monitors on a subset of columns. This will help you measure and monitor the performance of specific subsets of features.
🎤 Automatic Speech Recognition: We've added an example for automatic speech recognition (ASR). With this new feature, you can now monitor the performance of your ASR models and catch issues early.
📈 Hamming Distance: We've added Hamming distance as a distance metric. Now you can use this metric to measure the similarity between binary or categorical data.
We hope these new features help you monitor your ML models more effectively! As always, we welcome your feedback and suggestions for future releases.
v0.1.0
We are excited to announce the latest release of UpTrain with a range of new features to help you better monitor and maintain your machine learning models. Here are some highlights of the new features:
🔍 HDBSCAN Clustering: With our new HDBSCAN clustering option, you can now perform hierarchical density-based clustering on your data with ease.
📈 Z-Score Data Integrity: We've added z-score data integrity to help you identify outliers using statistical methods, making it easier to maintain data integrity.
🔄 Feature Drift with PSI: Our new feature drift using PSI allows you to measure the drift between your training and production data, helping you detect and address potential issues early on.
🆔 Data-point Identification: We've added a new feature to easily identify data-points by their IDs in our data visualizations.
💬 Conversation Summarization Example: We've added a new example showcasing how to use UpTrain to summarize conversations, providing a practical use case for NLP applications.
🧪 Tests for Concept Drift Algorithms: We've also added tests for the ADWIN and DDM concept drift algorithms, ensuring that your models remain accurate and reliable over time.
Upgrade to the latest version of UpTrain today to take advantage of these new features and streamline your machine learning monitoring and maintenance. As always, please let us know if you have any questions or feedback. Happy training!
v0.0.11
🚀 New UpTrain Release 🚀
In the next feature release of UpTrain, users can look forward to several exciting updates and improvements that enhance the software's functionality 🚀. This new release focuses on enhancing user experience, improving performance, and expanding the software's capabilities to better serve the needs of the machine learning community 🌟.
- Added documentation to the GitHub repository 📚: Makes it easier for users and contributors to understand and improve UpTrain by providing comprehensive documentation on the GitHub repository.
- Removed duplicated code from t-SNE and UMAP 🧹: Streamlines the codebase by eliminating redundant code, leading to a more efficient and maintainable software package.
- Logging and monitoring in background process ⏳: Enables users to log and monitor model performance and other metrics without interrupting their workflow.
- Added concept drift detection with ADWIN 📊: Enhances concept drift detection by incorporating the ADaptive WINdowing (ADWIN) algorithm for more accurate and responsive drift detection.
- Removed package dependency on UMAP and SHAP 🛠️: Simplifies the installation process and reduces potential conflicts by removing the need for the UMAP and SHAP packages.
- Better naming for edge cases 🏷️: Introduces clearer naming conventions for edge cases, making identifying and managing them easier.
- Logging Args put together 🗂️: Streamlines argument logging, making it easier to manage and track settings for your machine learning models.
- Several bug-fixes 🐛: Addresses various issues to improve the overall stability and performance of UpTrain.
v0.0.10
v0.0.9
🚀 New UpTrain Release 🚀
This release includes improvements such as a better naming convention, regression accuracy measures, SHAP explainability and bug fixes.
- 📊 Added SHAP explainability as a feature: Users can now understand how their models work and make more informed decisions by using SHAP (SHapley Additive exPlanations) explainability.
- 📈 Added accuracy measures for regression tasks: Users can easily evaluate model performance on regression tasks.
- 📖 Added Readme for text summarization and fine-tuning LLM examples: Comprehensive documentation is now available for text summarization and fine-tuning LLM examples.
- 💻 Code cleanup and refactoring: Improvements such as fixing inheritance, better abstraction, and adding hover_text for graphs make it easier for users to work with UpTrain.
- 📝 Better naming convention, such as "monitors" instead of "anomaly": The improved naming convention provides a more accurate description of the feature's functionality.
- 🐞 Bug fixes: Several bugs were fixed in this release, improving the overall stability and performance of UpTrain.
- 📑 Added data integrity to text summarization example: The text summarization example now provides accurate and reliable results for users.
v0.0.8
UpTrain has recently released an exciting new set of features to enhance its monitoring capabilities. One such feature is the addition of t-SNE dimensionality reduction and visualization, allowing users to gain deeper insights into their machine learning models. With t-SNE, users can now visualize high-dimensional embeddings in 2D or 3D, making it easier to spot patterns and anomalies in their data. This release also fixes a bug for using custom monitors with UpTrain statistics.
In addition, UpTrain now includes a finetuning for LLMs example, which demonstrates how to fine-tune large language models such as BERT and GPT-2 using UpTrain's monitoring framework. This example provides a step-by-step guide on how to set up and run a finetuning experiment. With this new example, UpTrain users can now easily adapt and improve their language models with confidence.
v0.0.7
0.0.6
UpTrain announces a new feature release with the following features:
- Deprecated Tensorboard: UpTrain has replaced Tensorboard with Streamlit for a better and more user-friendly experience.
- Slack Alerts: UpTrain now offers Slack alerts for model monitoring, making tracking progress and staying informed about any issues easier.
- Customizable Port: With this update, users can now set the port number for the UpTrain dashboard according to their preferences.
- A/B Testing: UpTrain now offers functionality for monitoring A/B testing. This feature is particularly useful for businesses looking to compare the performance of different versions of their ML models.