simple-router

Simple Router is a lightweight, self-hosted gateway built with Next.js that allows users to access various AI providers—including OpenAI, Gemini, Anthropic, Groq, OpenRouter, Alibaba DashScope, and local servers like Ollama or vLLM—through a unified OpenAI-compatible API format. Key capabilities include: - Unified API Endpoints: Supports chat completions, responses, embeddings, image generations, and model listings, making it compatible with existing OpenAI SDKs. - Advanced Routing: Supports multiple routing strategies such as fixed, random, round-robin, weighted, and priority failover. - Virtual Models: API keys can act as virtual models, allowing administrators to define specific model lists and routing strategies for different projects. - Management Tools: Includes an admin dashboard for monitoring metrics, managing providers and keys, tracking usage analytics, and viewing searchable logs. - Rate Limiting and Tracking: Provides per-key rate limits (requests/tokens per minute/day) and cost estimation based on token counts and latency. - Security: Features session-based login, JWT API tokens, and AES-256-GCM encryption for API keys at rest. - Streaming Support: Supports Server-Sent Events (SSE) for chat completions, including format conversion for providers like Anthropic.