Go library offering bounded Apache Kafka producer, consumer, replay, inspection and transactional building blocks that wrap franz-go without hiding delivery outcomes, lifecycle ownership or topic policy.
Open source. Open possibilities.
Discover quality open-source projects, submit projects anonymously, and claim and edit your own project.
A little curiosity. A world of open source.
THE FIRST COLLECTIONA knowledge refresher project for internet Java engineers, systematically organizing interview and practical knowledge across 5 core backend architecture fields: high-concurrency architecture, distributed systems, high-availability architecture, microservice architecture, and massive data processing.
Kahuna is an open-source distributed systems toolkit providing distributed locking, a fault-tolerant key/value store, and globally ordered ID sequencing, built on Raft consensus and MVCC.
XGBoost is an optimized distributed gradient boosting library that is efficient, flexible, and portable. It implements machine learning algorithms under the Gradient Boosting framework and provides parallel tree boosting (GBDT, GBM) to solve data science problems accurately and quickly. It runs on major distributed environments and supports multiple languages.
Cadence is an open-source distributed orchestration engine for building and running scalable, fault-tolerant, long-running workflows. It includes CLI tools, schema management, benchmarking, and canary health checks.
A curated collection of free resources for learning system design concepts and preparing for interviews, covering core concepts, networking, APIs, databases, caching, distributed systems, architectural patterns, tradeoffs, and interview problems.
AetherGrid is a distributed AI workload orchestrator built with strict Domain-Driven Design, featuring lease-based execution ownership, event-driven reconciliation, API key auth, and a React dashboard.
SovereignKit is open-source Solana infrastructure for measuring transaction accessibility failures, separating RPC acknowledgment from ledger evidence, detecting route asymmetry, and enabling bounded fail-open routing. v0.1 is a controlled proof plus Devnet validation, not a provider ranking.
Redis is an open-source in-memory data structure server used as a cache, NoSQL database, message broker, search and vector query engine. The README covers key use cases, data types, client libraries, quick start, and source build instructions.
LingoFuse is a cross-language RPC communication framework supporting 20+ programming languages to interoperate seamlessly via native FFI or HTTP bridging, without IDL or stub code generation. It features built-in service discovery, load balancing, and streaming, providing a high-speed dynamic communication foundation for AI agents and full-stack systems.
Temporal is a durable execution platform designed to build scalable applications by automatically handling intermittent failures and retrying failed operations.
Apache Dubbo is a Java-based RPC and microservice framework supporting multiple protocols like Triple (gRPC-compatible), Dubbo2 TCP, and REST, with service discovery, traffic management, observability, and Spring Boot integration.
Trino is a fast distributed SQL query engine designed for big data analytics, formerly known as PrestoSQL.
Spacedrive is an open-source cross-platform file explorer built on a Rust virtual distributed filesystem. It indexes local disks, cloud storage and external data sources, syncs metadata peer-to-peer, and provides AI-ready permissioned access across devices.
SafeMesh provides formally verified CRDTs (G-Set, G-Counter, OR-Set, etc.) using Lean 4 proofs and no_std Rust. It offers C, WASM/TS, and Python bindings for small, embeddable state synchronization, requiring users to provide their own transport layer.
Curated reading list on building scalable, reliable, high-performance large-scale systems, with design principles, case studies from tech giants, and interview resources.
Hatchet is an open-source orchestration engine for background tasks, AI agents, and durable workflows. Supports Python, TypeScript, Go, and Ruby via self-hosting or Hatchet Cloud. Features task retries, cron jobs, DAGs, real-time monitoring, and multi-tenancy.
ChaosSQL is a deterministic concurrency and isolation fuzzer for PostgreSQL, MySQL and SQLite. It schedules concurrent transactions, detects invariant violations such as lost updates and write skew, shrinks failures to minimal reproductions, and can guard CI pipelines against regressions.
etcd is a distributed, reliable key-value store written in Go that uses the Raft consensus algorithm for highly available replicated logs. It offers a simple gRPC API, TLS security, and is widely used in production for critical distributed system data, notably with Kubernetes.