This repository contains a comprehensive list of both open-source and commercial platforms designed to extract insights from user and chatbot model conversations. These platforms facilitate the development and enhancement of large language model (LLM) applications by providing tools for analysis, monitoring, and improvement based on conversational data. 💬
| Product Name | Open Source | Self-Hosted | Enterprise / Team Version | SDK | Unlimited events (on Free tier) |
|---|---|---|---|---|---|
| PostHog-LLM | ✅ | ✅ | ❌ | ✅ | ✅ |
| Langfuse | ✅ | ✅ | ✅ | ✅ | 50k observations / month |
| Trubrics | ❌ | ❌ (✅ if Enterprise) | ✅ | ✅ | 10k events / month |
| phospho | ✅ | *✅ | ✅ | ✅ | ✅ |
| Nebuly | ❌ | ❌ (✅ if Enterprise) | ✅ | ✅ | ❌ |
| Dashbot | ❌ | ❌ | Unclear | ✅ | Unclear |
| simplyanalyze | ❌ | ❌ | Unclear | ❌ | Unclear |
(*) Makes calls to external services