About this project

OpenAI Relay is a lightweight relay service designed to route API requests to different OpenAI-compatible backend services using model prefixes. It is built with the Bun runtime but also maintains compatibility with Deno and Node.js. Key capabilities include: - OpenAI API specification compatibility. - Configuration via environment variables for providers, model mappings, and API keys. - Multiple deployment options including Docker, Helm charts for Kubernetes, and direct execution via Bun, Deno, or Node.js. - Availability on JSR and npm for easy integration.