Open source. Open possibilities.

Open-source LLM-powered roleplay simulation engine built as an Electron/NodeJS app. Features persistent world state, dynamic character evolution, scripted behaviors, and compatibility with any language model.

Xinference is a unified inference library for serving language, speech, and multimodal models. It provides OpenAI-compatible RESTful API, heterogeneous GPU/CPU utilization, distributed deployment, and integrates with LangChain, LlamaIndex, Dify, and Chatbox.

UL-SMF is a KV cache compression framework for long-context Transformer inference, claiming up to 384x compression via FSQ and 16D latent mapping. The core compression logic requires a proprietary closed-source binary.