#LLM Ops

#1

LangGraph Studio

Visual IDE for building, debugging, and inspecting LangGraph agent workflows

#2

Log10

Scale expert LLM evaluation with automated real-time error detection.

#3

Langfuse

An open-source LLM engineering platform offering observability, metrics, evaluations, and prompt management to debug and enhance large language model applica...

#4

LangSmith

A comprehensive platform offering observability, evaluation, and debugging tools for building and optimizing large language model (LLM) applications.

#5

Astrolabe

Policy-driven OpenAI-compatible routing proxy for OpenClaw that picks the lowest-cost model, adds safety gates, and can escalate once.

Adaptive memory layer that helps AI agents learn from context over time.

Real-time security and compliance guardrails for AI applications

#8

ClawWatcher

Real-time OpenClaw monitoring that breaks down token spend, actions, and cost per task so you can spot waste and optimize prompts.

#9

KeywordsAI

Unified developer platform for building, monitoring, and scaling LLM applications.

Open-source observability and evaluation platform for tracing and improving AI applications.

#11

Humanloop

Enterprise LLM evaluation and prompt management platform for shipping reliable AI features.

#12

LangWatch

LLM optimization studio for monitoring, evaluating, and improving AI applications in production.