Pezzo
Open-source LLMOps platform for prompt management and instant deployments.
Description
Pezzo is an open-source LLMOps platform maintained by Pezzo Labs, released under the Apache 2.0 license and built entirely on open-source infrastructure including PostgreSQL, ClickHouse, Redis, and Supertokens. The platform lets engineering teams version, test, and publish prompts to production without code redeploys, and adds observability over execution history, cost, and latency. It runs via Docker Compose for local evaluation or self-hosted deployment.
Key Capabilities:
Prompt versioning with environment-specific publishing and instant production deploys
Execution logs with cost, latency, and token usage metrics per prompt run
Time travel troubleshooting to fix failed prompt executions and republish instantly
Playground for testing prompts with variables and real-time model output
Python and TypeScript SDKs for integrating prompt fetching with minimal code changes
Multi-provider support via UniLLM, an OpenAI-compatible interface for any LLM
Self-hostable via Docker Compose with no proprietary runtime dependencies
Apache 2.0 license with full commercial use rights
Alternative tools
- OpenAI Playground
Browser-based prompt iteration environment for the OpenAI API.
- Sourcegraph Cody
Enterprise AI coding assistant with multi-repository context retrieval
- Arize Phoenix
Trace every step your LLM agent takes, from prompt to response
- Helicone
Open-source LLM observability platform with one-line proxy integration.
- PromptLayer
Prompt management platform for engineers and domain experts.