Tools Directory

Browser-based prompt iteration environment for the OpenAI API.

Detect hallucinations and agent failures across the full development lifecycle

Open-source LLMOps platform for observability, evaluation, and agent simulation.

End-to-end prompt management platform covering iteration, evaluation, deployment, and monitoring.

End-to-end AI evaluation platform with pre-production agent simulation and production observability

Collaborative AI development platform for prototyping, evaluating, and monitoring LLM features.

Tagline: Python-native LLM versioning and tracing via a single decorator.

Open-source agent observability platform with prompt engineering and auto-evaluation.

Automated prompt optimization tool for text and image models — shutting down September 2026.

Git-style version control and collaboration platform for LLM prompts.

MIT-licensed LLMOps platform for prompt engineering, evaluation, and tracing.

LLM development platform for prompt engineering, testing, and deployment.

Test and red team LLM applications from the command line

Open-source LLMOps platform for prompt management and instant deployments.

Prompt management platform for engineers and domain experts.

Open-source AI code agent for IDE and CI

Open-source LLM engineering platform for tracing, evaluation, and prompt management.

Prompt engineering workbench for crafting and evaluating LLM prompts.