iggy

Apache Iggy is a persistent message streaming platform designed for extreme performance and efficiency. Built from the ground up in Rust, it employs a thread-per-core, shared-nothing architecture and leverages low-level I/O primitives like io_uring and compio to process millions of messages per second with sub-millisecond tail latencies. Unlike many streaming solutions, Iggy is a standalone binary that does not rely on external databases or brokers. Key features include: - Multi-protocol support: Native support for QUIC, WebSocket, TCP, and HTTP (REST API). - High performance: Zero-copy (de)serialization and efficient binary data handling. - Scalability: Supports consumer groups for horizontal scaling and message ordering. - Reliability: Data persistence with configurable retention policies, S3-compatible backups, and Viewstamped Replication (VSR) for clustering. - Extensibility: Includes a modular connector runtime for custom sinks/sources and an MCP (Model Context Protocol) server for LLM integration. - Developer Experience: Comprehensive CLI, built-in benchmarking tools, and SDKs for Rust, C#, Java, Python, Node.js, and Go. - Security: Granular user authentication, Personal Access Tokens (PAT), and optional AES-256-GCM data encryption.