Open source. Open possibilities.

Open-source LLM-powered roleplay simulation engine built as an Electron/NodeJS app. Features persistent world state, dynamic character evolution, scripted behaviors, and compatibility with any language model.

Open-source desktop AI companion app with Live2D/VRM avatars, voice chat, local LLM support, tabletop RPG engine, and autonomous desktop agent capabilities. Runs 100% locally by default.

Otaku is a free, local LLM frontend for roleplay, offering web and terminal interfaces. It supports local and cloud LLMs, manages long context via scene summaries, and imports SillyTavern chats and character cards.

Khoj is an open-source, self-hostable personal AI app that connects to local or online LLMs, answers questions from the web and your documents, and supports custom agents, automations and semantic search across browser, desktop, phone and chat clients.

Xinference is a unified inference library for serving language, speech, and multimodal models. It provides OpenAI-compatible RESTful API, heterogeneous GPU/CPU utilization, distributed deployment, and integrates with LangChain, LlamaIndex, Dify, and Chatbox.

Jan is an open-source desktop app that runs large language models locally for offline, private use, with optional connections to cloud providers and an OpenAI-compatible local API.

RunAnywhere is a cross-platform SDK suite for running AI models fully on-device across phones, browsers, desktops, and servers. It supports LLMs, vision, speech, voice agents, RAG, embeddings, and image generation with a single semantic API.