observability

The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controlling costs and managing access to models and data.

Prefect is a workflow orchestration framework for building resilient data pipelines in Python.

Build your own AI SRE agents. The open source toolkit for the AI era.

Open-source observability for your GenAI or LLM application, based on OpenTelemetry

Ship AI Agents to Google Cloud in minutes, not months. Production-ready templates with built-in CI/CD, evaluation, and observability.

An AI Gateway, registry, and proxy that sits in front of any MCP, A2A, or REST/gRPC APIs, exposing a unified endpoint with centralized discovery, guardrails and management. Optimizes Agent & Tool calling, and supports plugins.

AI observability platform for production LLM and agent systems.

See what Claude Code and Codex actually send to the API — and what each part costs.

SRE Agent - CNCF Sandbox Project

Better Prometheus alerts for Kubernetes - smart grouping, AI enrichment, and automatic remediation

Open-source, end-to-end platform for evaluating, observing, and improving LLM and AI agent applications. Tracing · Evals · Simulations · Datasets · Gateway · Guardrails. Self-hostable. Apache 2.0.

Easy token price estimates for 400+ LLMs. TokenOps.

0x.Tools: X-Ray vision for Linux systems

Distribute and run AI workloads on Kubernetes magically in Python, like PyTorch for ML infra.

Kubediff: a tool for Kubernetes to show differences between running state and version controlled configuration.

Observe FastAPI app with three pillars of observability: Traces (Tempo), Metrics (Prometheus), Logs (Loki) on Grafana through OpenTelemetry.

LangSmith Client SDK Implementations

A tool for Python developers to easily debug the HTTP(S) client and server requests in a Python program.

A robust streaming log template miner based on the Drain algorithm

Production-Ready MCP Server Framework • Build, deploy & scale secure AI agent infrastructure • Includes Auth, Observability, Debugger, Telemetry & Runtime • Run real-world MCPs powering AI Agents