Pezzo
Open-source LLMOps platform for prompt management and instant deployments.
Description
Pezzo is an open-source LLMOps platform maintained by Pezzo Labs, released under the Apache 2.0 license and built entirely on open-source infrastructure including PostgreSQL, ClickHouse, Redis, and Supertokens. The platform lets engineering teams version, test, and publish prompts to production without code redeploys, and adds observability over execution history, cost, and latency. It runs via Docker Compose for local evaluation or self-hosted deployment.
Key Capabilities:
Prompt versioning with environment-specific publishing and instant production deploys
Execution logs with cost, latency, and token usage metrics per prompt run
Time travel troubleshooting to fix failed prompt executions and republish instantly
Playground for testing prompts with variables and real-time model output
Python and TypeScript SDKs for integrating prompt fetching with minimal code changes
Multi-provider support via UniLLM, an OpenAI-compatible interface for any LLM
Self-hostable via Docker Compose with no proprietary runtime dependencies
Apache 2.0 license with full commercial use rights
Alternative tools
- OpenAI Playground
Browser-based prompt iteration environment for the OpenAI API.
- Galileo AI
Detect hallucinations and agent failures across the full development lifecycle
- LangWatch
Open-source LLMOps platform for observability, evaluation, and agent simulation.
- Adaline
End-to-end prompt management platform covering iteration, evaluation, deployment, and monitoring.
- Maxim AI
End-to-end AI evaluation platform with pre-production agent simulation and production observability
- Athina AI
Collaborative AI development platform for prototyping, evaluating, and monitoring LLM features.