LangSmith
ObservabilityTracing
Developer platform for LLM apps. Debug, test, evaluate, and monitor in production. Built by LangChain.
Built with
PythonTypeScriptLLM
Share this part
More in Observability
Guardrails AI
Add guardrails to LLM outputs. Validate, fix, and filter model responses for structure, type, and quality constraints.
Langfuse
Open-source LLM engineering platform. Traces, prompt management, evaluations, and datasets — self-hostable.
Arize Phoenix
Open-source observability for LLMs and ML models. Traces, evals, and datasets in one place with an intuitive UI.
LlamaGuard
Meta LLM-based input/output safeguard model. Classifies safety risks in both user prompts and agent responses in real time.
NeMo Guardrails
NVIDIA toolkit for adding programmable guardrails to LLM apps. Control topical, safety, and security behaviors of conversational agents.
LLM Cost Calculator
Open-source tool to estimate and compare costs across LLM providers. Supports 100+ models from OpenAI, Anthropic, Google, and more.