Open source. Open possibilities.

Open Dungeon is a fully local AI roleplay app that generates stories and inline scene images on your machine using Ollama and FLUX, without cloud services or API keys.

Unsloth is a desktop application and framework for running and training large language models (LLMs) and diffusion models locally across Windows, macOS, and Linux.

Xinference is a unified inference library for serving language, speech, and multimodal models. It provides OpenAI-compatible RESTful API, heterogeneous GPU/CPU utilization, distributed deployment, and integrates with LangChain, LlamaIndex, Dify, and Chatbox.

UL-SMF is a KV cache compression framework for long-context Transformer inference, claiming up to 384x compression via FSQ and 16D latent mapping. The core compression logic requires a proprietary closed-source binary.

LlamaFactory is a Python framework for efficient fine-tuning of 100+ large language and multimodal models, offering zero-code CLI, a Gradio Web UI, LoRA/QLoRA, and multiple training algorithms.

Ollama is a tool that allows users to run, manage, and build with open-source large language models locally on macOS, Windows, and Linux.

Hugging Face Transformers is a model-definition framework for machine learning across text, vision, audio, and multimodal tasks. It provides a unified API for inference and training with over 1 million pretrained checkpoints.