LangWatch
Open-source LLMOps platform for observability, evaluation, and agent simulation.
Description
Short Intro: LangWatch is an open-source LLMOps platform founded in 2023 by Manouk Draisma (CEO, ex-Lightspeed) and Rogerio Chaves (CTO, who built Booking.com's first AI agents), both of whom met during an Antler residency in Amsterdam. The company raised a €1M pre-seed round in February 2025 from Passion Capital, Volta Ventures, and Antler. In April 2026, LangWatch launched an open-source AI red-teaming tool designed to test agent vulnerabilities through systematic multi-turn adversarial interactions rather than single-prompt attacks.
Key Capabilities:
LLM observability and OpenTelemetry-native tracing with full conversation flow and bottleneck visibility
Agent simulation engine that runs thousands of synthetic conversations across scenarios, languages, and edge cases before deployment
Prompt and model management with version control, feature-flag-style rollouts, and complete audit trails
Open-source red-teaming tool for testing AI agents against multi-turn adversarial attacks
DSPy-based optimizer integration for automated prompt improvement
Real-time evaluations with hallucination detection, jailbreak detection, and PII leak monitoring
LangWatch Skills for AI coding agents including Claude Code, enabling 2-minute instrumentation via a paste-in prompt
Non-technical PM and domain expert collaboration workflows built into the platform
Alternative tools
- OpenAI Playground
Browser-based prompt iteration environment for the OpenAI API.
- Galileo AI
Detect hallucinations and agent failures across the full development lifecycle
- Adaline
End-to-end prompt management platform covering iteration, evaluation, deployment, and monitoring.
- Maxim AI
End-to-end AI evaluation platform with pre-production agent simulation and production observability
- Athina AI
Collaborative AI development platform for prototyping, evaluating, and monitoring LLM features.
- Lilypad
Tagline: Python-native LLM versioning and tracing via a single decorator.