free-llm-router

Free LLM Router is a Python library and CLI tool that enables users to route requests across multiple free-tier LLM APIs while managing keys, discovering available models, and enforcing economic safety rules. It supports providers like OpenRouter, Gemini, Groq, and others — some requiring manual confirmation of free-tier status. The tool allows configuration via TOML files, secure key storage (files or env vars), and automatic failover when models are unavailable. Users can list, search, and chat with models using the CLI or async/sync Python clients. Safety features include explicit opt-in for trial/paid models, quota grouping to avoid rate limits, and no silent fallback to paid tiers. Development includes testing, linting, and optional speed optimizations. Documentation covers provider-specific setup, architecture, and full config examples. MIT licensed.