Open source. Open possibilities.

A lightweight OpenAI API reverse proxy featuring per-key token budgets, rate limiting, cost dashboards, and automatic model downgrading.

Minimal FastAPI proxy for OpenAI Chat Completions and Embeddings APIs. Supports multi-tenant key mapping, streaming, and official SDK compatibility without a database.

CogniGate is a self-hosted, multi-tenant LLM gateway that provides a single OpenAI-compatible endpoint to manage multiple model providers while keeping credentials secure.

RouteTok is a local-first LLM inference router with OpenAI and Anthropic compatible APIs, health-aware failover, multi-provider catalogs, an operations dashboard, and a model sandbox.

Provider-neutral FastAPI gateway for LLM routing, retries, fallbacks, structured output, and usage/cost accounting. Supports Gemini and OpenAI with model aliases, retry policies, and persistent usage tracking.

Example code and guides for common tasks using the OpenAI API, written mostly in Python. Requires an OpenAI account and API key to run the examples.

AI-powered real-time visual novel engine with streaming narrative, character sprites, scene backgrounds, branching choices, and co-creation. Runs as desktop app or browser via FastAPI+SSE.

Xinference is a unified inference library for serving language, speech, and multimodal models. It provides OpenAI-compatible RESTful API, heterogeneous GPU/CPU utilization, distributed deployment, and integrates with LangChain, LlamaIndex, Dify, and Chatbox.

One API is a unified LLM API management and distribution system supporting dozens of mainstream models including OpenAI, Azure, Anthropic Claude, Google Gemini, DeepSeek, and more. It provides a unified OpenAI-compatible interface, token management, channel load balancing, user grouping, and redistribution features, deployable via single binary or Docker in one click.

GPT4Free aggregates multiple language model and media generation providers into a unified interface. It offers Python/JS clients, OpenAI-compatible REST API, GUI, and CLI. Supports text and image generation via various models including gpt-4o-mini and flux.