LlamaGuard

More in Observability

• Guardrails AI

  Add guardrails to LLM outputs. Validate, fix, and filter model responses for structure, type, and quality constraints.

• LLM Cost Calculator

  Open-source tool to estimate and compare costs across LLM providers. Supports 100+ models from OpenAI, Anthropic, Google, and more.

• OpenMeter

  Real-time usage metering for AI APIs. Track token consumption, costs, and quotas per user or team across any LLM provider.

• Langfuse

  Open-source LLM engineering platform. Traces, prompt management, evaluations, and datasets — self-hostable.

• Arize Phoenix

  Open-source observability for LLMs and ML models. Traces, evals, and datasets in one place with an intuitive UI.

• NeMo Guardrails

  NVIDIA toolkit for adding programmable guardrails to LLM apps. Control topical, safety, and security behaviors of conversational agents.