https://www.datadoghq.com/product/ai/llm-observability/
LLM Observability | Datadog
Deliver LLM applications to production faster with end-to-end tracing across AI agents, structured experiments, and robust quality and security evaluations.
llm observabilitydatadog
https://signoz.io/llm-observability/
LLM Observability - Monitor AI Agents, RAG Pipelines & LLM Performance | SigNoz
Monitor LLM apps and agents with SigNoz. Track AI workflows, RAG pipelines and token usage while correlating traces, logs and metrics in one platform.
llm observabilityai agentsrag pipelinesmonitorperformance
https://signoz.io/blog/llm-observability-opentelemetry/
LLM Observability in the Wild - Why OpenTelemetry should be the Standard | SigNoz
Sep 25, 2025 - LLM Observability breaks in wild today as new libraries like OpenInference don't adhere to OpenTelemetry standards leading to silos and suboptimal performance...
in the wildllm observabilityopentelemetrystandardsignoz
https://www.helicone.ai/
Helicone / AI Gateway & LLM Observability
Routing and monitoring for reliable AI apps - the LLMOps platform behind the fastest-growing AI companies.
ai gatewayllm observability
https://dev.to/iizzyy/why-we-killed-our-saas-to-open-source-llm-observability-for-the-eu-4gb
Why We Killed Our SaaS to Open-Source LLM Observability for the EU - DEV Community
Apr 24, 2026 - The SaaS Dream, Interrupted A few months ago, we were heads-down building PromptMetrics as... Tagged with ai, startup, agents, opensource.
open sourcellm observabilitythe eudev communitykilled
https://docs.helicone.ai/getting-started/quick-start
Quickstart - Helicone OSS LLM Observability
Get your first LLM request logged with Helicone in under 2 minutes using the AI Gateway.
llm observabilityquickstartoss
https://www.langchain.com/langsmith/observability
LangSmith: AI Agent & LLM Observability Platform
Complete AI agent and LLM observability platform with tracing and real-time monitoring. Debug agents, find failures fast, and track costs and latency.
ai agentllm observabilitylangsmithplatform
https://www.evidentlyai.com/
Evidently AI - AI Evaluation & LLM Observability Platform
Ensure your AI is production-ready. Test LLMs and monitor performance across AI applications, RAG systems, and multi-agent workflows. Built on open-source.
ai evaluationllm observabilityplatform
Sponsored https://www.cheekycrush.com/
CheekyCrush
https://www.honeycomb.io/resources/getting-started/what-is-llm-observability
What Is LLM Observability and Monitoring? | Honeycomb
Oct 28, 2025 - Learn more about how LLM observability tracks, analyzes, and improves LLM performance across inputs, models, and outputs—helping teams debug faster.
observability and monitoringwhat isllmhoneycomb
https://arize.com/
LLM Observability & Evaluation Platform
Unified LLM Observability and Agent Evaluation Platform for AI Applications—from development to production.
llm observabilityevaluationplatform
https://openobserve.ai/llm-observability/
LLM Observability - Monitor, Trace, and Debug Your AI Applications in Production
OpenObserve LLM Observability gives you full visibility into every LLM call , token usage, latency, model metadata, and errors captured automatically via...
llm observabilityai applicationsin productionmonitortrace
https://community.ibm.com/community/user/blogs/jinsong-wang/2024/06/14/llm-observability-with-instana
LLM Observability with Instana
llm observabilityinstana
https://sentry.io/solutions/ai-observability/
AI and LLM Observability | Sentry
Monitor your AI agent’s reliability, speed, and cost with Sentry. Get real-time alerts for LLM app errors, latency spikes, and budget overruns—before users...
llm observabilityaisentry
Sponsored https://joi.com/
NSFW Character AI Chat – AI Girlfriend Chat Without Limits | JOI Spicy
Explore AI chat models on JOI AI with virtual characters and digital celebrities. Chat, interact, and customize AI companions for immersive experiences.
https://www.langchain.com/langsmith-platform
LangSmith: AI Agent & LLM Observability and Evals Platform
LangSmith is the complete framework agnostic AI agent and LLM observability, evaluation, and deployment platform.
ai agentllm observabilitylangsmithevalsplatform
https://deepsense.ai/rd-hub/genai-monitor-framework/
GenAI Monitor Framework: End-to-End Observability for LLM Pipelines
Oct 9, 2025 - Track, debug, and optimize generative AI applications with the GenAI Monitor—a robust observability framework designed for enterprise-grade LLM workflows.
genai monitor frameworkendobservabilityllmpipelines
https://www.evidentlyai.com/courses
Evidently AI - LLM Evaluation and AI Observability Courses
Learn about LLM evaluation and AI observability with our free hands-on courses.
llm evaluationaiobservabilitycourses
https://agenta.ai/
Agenta - Prompt Management, Evaluation, and Observability for LLM apps
Agenta is an open-source platform for building robust LLM Application. It provides tools for prompt engineering, evaluation, debugging, and monitoring of...
prompt managementevaluationobservabilityllmapps
Sponsored https://www.milfy.com/
MILFY: Exclusive 4K Videos Featuring Stunning Mature Women
MILFY showcases gorgeous, confident women in premium cinematic scenes. Discover elegant, high-quality experiences with mature stars - captured in stunning 4K...
https://github.com/langfuse/langfuse
GitHub - langfuse/langfuse: 🪢 Open source LLM engineering platform: LLM Observability, metrics,...
🪢 Open source LLM engineering platform: LLM Observability, metrics, evals, prompt management, playground, datasets. Integrates with OpenTelemetry, Langchain,...
open sourcegithublangfusellmengineering
https://www.dynatrace.com/solutions/ai-observability/
AI Observability | LLM Observability
Apr 15, 2026 - Leverage best-in-class end-to-end monitoring of your Generative AI applications, LLMs, and agents.
ai observabilityllm