smart-slm-routerqmmughal
ADDEDA production-grade, OpenAI-compatible smart LLM router and fallback proxy that optimizes costs by routing simple queries to Small Language Models (SLMs) and complex ones to frontier models.
Discover quality open-source projects, submit projects anonymously, and claim and edit your own project.
A little curiosity. A world of open source.
THE FIRST COLLECTIONA production-grade, OpenAI-compatible smart LLM router and fallback proxy that optimizes costs by routing simple queries to Small Language Models (SLMs) and complex ones to frontier models.