Eval & observability AI tools

Eval, tracing, and monitoring tools for production LLM apps.

How to choose eval & observability AI tools

  • Run one real task you already understand — not a vendor demo
  • Check privacy, retention, and commercial license for your use case
  • Compare two alternatives with the same success check before you commit

Related guides

Showing 4964 of 64 tools · page 2 of 2

ToolPricingSummaryActions
OpenTelemetry GenAIFreeOpenTelemetry GenAI is a evaluation and observability tool for everyday AI workflows. It typically offers a free plan; verify limits, data…DetailsVisit
Opentelemetry JsFreeUse Opentelemetry Js when you need evaluation and observability help with drafts, iteration, and faster first passes. Pricing is a free pla…DetailsVisit
Opik by CometFreemiumOpik by Comet helps with evaluation and observability work across drafting and review loops. Expect a freemium model (free tier plus paid u…DetailsVisit
Phoenix RepoFreeUse Phoenix Repo when you need evaluation and observability help with drafts, iteration, and faster first passes. Pricing is a free plan —…DetailsVisit
PipelinesFreePipelines helps with evaluation and observability work across drafting and review loops. Expect a free plan; compare quality on your own co…DetailsVisit
PlexeFreePlexe helps with evaluation and observability work across drafting and review loops. Expect a free plan; compare quality on your own conten…DetailsVisit
promptfoo RepoFreepromptfoo Repo sits in the Eval & observability category. Teams pick it for evaluation and observability tasks, then apply a human verifica…DetailsVisit
PromptLayerFreemiumPromptLayer is a evaluation and observability tool for everyday AI workflows. It typically offers a freemium model (free tier plus paid upg…DetailsVisit
Seldon CoreFreeAn MLOps framework to package, deploy, monitor and manage thousands of production machine learning modelsDetailsVisit
The ForgeFreeThe Forge Cross-Platform Framework PC Windows, Steamdeck (native), Ray Tracing, macOS / iOS, Android, XBOX, PS4, PS5, Switch, Quest 2DetailsVisit
TraceloopFreemiumUse Traceloop when you need evaluation and observability help with drafts, iteration, and faster first passes. Pricing is a freemium model…DetailsVisit
TruLensFreeTruLens is a evaluation and observability tool for everyday AI workflows. It typically offers a free plan; verify limits, data handling, an…DetailsVisit
UpTrainFreemiumUpTrain sits in the Eval & observability category. Teams pick it for evaluation and observability tasks, then apply a human verification ba…DetailsVisit
W&B WeaveFreemiumW&B Weave is a evaluation and observability tool for everyday AI workflows. It typically offers a freemium model (free tier plus paid upgra…DetailsVisit
WhyHowFreemiumUse WhyHow when you need evaluation and observability help with drafts, iteration, and faster first passes. Pricing is a freemium model (fr…DetailsVisit
WhyLabsFreemiumWhyLabs is a evaluation and observability tool for everyday AI workflows. It typically offers a freemium model (free tier plus paid upgrade…DetailsVisit