Xinference is a unified inference library for serving language, speech, and multimodal models. It provides OpenAI-compatible RESTful API, heterogeneous GPU/CPU utilization, distributed deployment, and integrates with LangChain, LlamaIndex, Dify, and Chatbox.
AI & MLMultimodal AI
Bob is a macOS menu bar translation and OCR tool, supporting selection, screenshot, and input translation, as well as screenshot OCR, silent recognition, QR code recognition, with integration of multiple translation and OCR services, offline recognition, and speech synthesis.
ProductivityAI & MLUtilities