#LLM Ops

#1

LangGraph Studio

Visual IDE for building, debugging, and inspecting LangGraph agent workflows

#2

Log10

Scale expert LLM evaluation with automated real-time error detection.

#3

Langfuse

An open-source LLM engineering platform offering observability, metrics, evaluations, and prompt management to debug and enhance large language model applica...

#4

LangSmith

Observability, evaluation, and debugging platform for LLM applications from the LangChain team

#5

Astrolabe

Self-hosted OpenAI-compatible routing gateway for OpenClaw agents with cost and safety policy

Adaptive memory layer that helps AI agents learn from context over time.

Real-time security and compliance guardrails for AI applications

#8

ClawWatcher

Real-time OpenClaw monitoring that breaks down token spend, actions, and cost per task so you can spot waste and optimize prompts.

#9

KeywordsAI

Unified developer platform for building, monitoring, and scaling LLM applications.

Open-source observability and evaluation platform for tracing and improving AI applications.

#11

Humanloop

Enterprise LLM evaluation and prompt management platform for shipping reliable AI features.

#12

LangWatch

LLM optimization studio for monitoring, evaluating, and improving AI applications in production.