llm-master

LLM Master provides a standardized interface to query multiple AI models through a single API. It simplifies the process of switching between different providers by abstracting the underlying API calls into a unified format. Key capabilities include: - Unified Query Interface: A single method to interact with various LLMs and image generation models. - Fallback Mechanism: Support for specifying fallback models and compatible configurations to ensure reliability when a primary model fails. - Extensible Provider System: A structured framework for adding new API providers, including support for OpenAI-compatible APIs and completely custom non-standard APIs. - Model Registry: A centralized system to manage model configurations, including pricing and rate limits. - Image Generation Support: Integration capabilities for image generation services (e.g., Recraft.AI, Black Forest Labs) including support for polling-based APIs.