Arize AX

 Arize AX is the commercial AI engineering platform from Arize AI, the company founded in 2020 by Jason Lopatecki and Aparna Dhinakaran that also maintains the open-source Phoenix project. It traces LLM and agent applications, evaluates outputs with online and offline evaluators, and monitors quality and drift in production at enterprise scale. Built-in experiments and a prompt workspace tie iteration during development to what the system does live. The platform connects development-time experiments to live production data, giving teams one view of quality across the model lifecycle. Annotation queues and curated datasets turn real failures into evaluation cases that guide the next iteration.

Key Capabilities:

• Tracing for LLM and agent applications through OpenTelemetry

• Online and offline LLM-as-judge evaluations

• Production monitoring for drift, quality, and performance

• Experiments that compare prompts, models, and datasets

• Annotation queues and curated datasets for evaluation

• Enterprise deployment with role-based access and security controls