#Observability

Build, test, and monitor AI features with collaborative experimentation and production observability.

#2

Secra

Security layer that shields AI agents from attacks, prompt injection, and data leaks.

#3

LangGraph Studio

Visual IDE for building, debugging, and inspecting LangGraph agent workflows

#4

Log10

Scale expert LLM evaluation with automated real-time error detection.

#5

Langfuse

An open-source LLM engineering platform offering observability, metrics, evaluations, and prompt management to debug and enhance large language model applica...

#6

Latitude

Build production AI agents from a single prompt with built-in evals and observability.

#7

Dify

Open-source platform for building and orchestrating LLM apps with built-in RAG and agent workflows.

#8

SagenticAI

Unified platform to build, run, and scale autonomous AI agents

#9

NOFireAI

Incident resolution AI copilot for SREs and on-call engineers

#10

Agency AI

Platform and expert services for building reliable AI agents at scale.

#11

LangSmith

A comprehensive platform offering observability, evaluation, and debugging tools for building and optimizing large language model (LLM) applications.

Unified control plane to build, manage, and monitor AI applications

#13

Manifest

Real-time cost observability for OpenClaw agents: track tokens, actions, and spend with self-hosted deployment and alerts.

Build and deploy enterprise AI agents quickly with built-in responsible AI guardrails.

#15

Upulz

Smart uptime and performance monitoring with real-time checks and instant alerts.

#16

2501

Autonomous AI agents for cloud operations and incident response

#17

Restack.io

Developer platform for building, deploying, and scaling production AI agents and workflows.

#18

Hamming AI

Automated testing and observability platform for AI voice agents.

#19

Sedai

Autonomous cloud management that continuously optimizes cost, performance, and availability.

#20

Temperstack

AI-driven reliability platform that automates monitoring, alerting, and incident management across observability stacks.

#21

Burr Framework

Open-source Python framework for building stateful, decision-making applications like agents and chatbots.

#22

SRE.ai

An AI-powered DevOps platform where agents automate CI/CD workflows, incident detection, and context-driven recommendations.

Open-source developer platform for building, testing, and shipping AI features faster.

#24

Mastra

Open-source TypeScript framework for building AI agents, workflows, RAG, memory and MCP, with optional cloud studio and observability.

Real-time security and compliance guardrails for AI applications

Open-source framework and platform for building, deploying, and monitoring reliable LLM-powered agents.

#27

Phonic Voice AI

End-to-end voice AI platform to build, observe, and evaluate reliable conversational voice agents.

#28

ClawWatcher

Real-time OpenClaw monitoring that breaks down token spend, actions, and cost per task so you can spot waste and optimize prompts.

#29

KeywordsAI

Unified developer platform for building, monitoring, and scaling LLM applications.

#30

Cleric

Autonomous AI SRE that triages production alerts and surfaces root causes

Observability and debugging platform for building reliable AI agents

Open-source observability and evaluation platform for tracing and improving AI applications.

#33

Sycamore

Enterprise agent operating system for building, governing, and orchestrating autonomous AI agents.

#34

AgentOps AI

Developer platform for testing, monitoring, and debugging AI agents in production.

#35

Humanloop

Enterprise LLM evaluation and prompt management platform for shipping reliable AI features.

Oversight and performance management platform for AI agents at scale.

Proactive incident prevention and rapid root cause analysis for software teams.

#38

PydanticAI

Python agent framework from the Pydantic team for building production-grade GenAI apps.

#39

LangWatch

LLM optimization studio for monitoring, evaluating, and improving AI applications in production.