Open-source observability for your LLM application, based on OpenTelemetry

Deepchecks: Tests for Continuous Validation of ML Models & Data. Deepchecks is a holistic open-source solution for all of your AI & ML validation needs, enabling to thoroughly test your data and models from research to production.

nannyml: post-deployment data science in python

[Not Actively Maintained] Whitebox is an open source E2E ML monitoring platform with edge capabilities that plays nicely with kubernetes

The official python package for NimbleBox. Exposes all APIs as CLIs and contains modules to make ML 🌸

Toolkit for evaluating and monitoring AI models in clinical settings

🚀 Stream inferences of real-time ML models in production to any data lake (Experimental)

Version, share, deploy, and monitor models.

A python library to send data to Arize AI!

Experiments with Model Training, Deployment & Monitoring

A modern, enterprise-ready business intelligence web application

This is a capstone project associated with MLOps Zoomcamp. The end goal of the project is to build an end-to-end machine learning project containing feature engineering, training, validation, tracking, modeel deployment, hosting, and general engineering best practices aimed at making house price predictions.

create a robust, simple, effecient, and modern end to end ML Batch Serving Pipeline Using set of modern open-source/free Platforms/Tools

Repo for my MLOps Zoomcamp project

LLM application tracing based on OpenTelemetry

Newron is a data-centric ML platform to easily build, manage, deploy and continuously improve models through data driven development.

fastapi + prometheus + grafana 💣

Python library for monitoring machine learning models, detecting data drift and overfitting to ensure robust and reliable performance.

Repository for the paper "TrustLapse: An Explainable and Actionable Mistrust Scoring Framework for Model Monitoring"