Open source. Open possibilities.

RouteTok is a local-first LLM inference router with OpenAI and Anthropic compatible APIs, health-aware failover, multi-provider catalogs, an operations dashboard, and a model sandbox.

Provider-neutral FastAPI gateway for LLM routing, retries, fallbacks, structured output, and usage/cost accounting. Supports Gemini and OpenAI with model aliases, retry policies, and persistent usage tracking.

Production-grade LLM reverse proxy for the Z.AI Claude API with token counting, adaptive rate limiting, Prometheus metrics, and a real-time monitoring dashboard.

An LLM Gateway built with LiteLLM for unified access to multiple AI providers via OpenAI-compatible API, featuring routing, fallbacks, caching, cost tracking, and guardrails.