OPEN SOURCE, OPEN TO EVERYONE

Open source. Open possibilities.

Discover quality open-source projects, submit projects anonymously, and claim and edit your own project.

Human-curated · Discover open source3940discovered

A little curiosity. A world of open source.

THE FIRST COLLECTION
live_dataLTER-ARC
ADDED

A collection of live data from logger stations within the Arctic Long Term Ecological Research (LTER) network.

Data & databasesStreaming & warehousing

A Python-based real-time e-commerce analytics pipeline that ingests clickstream events from an API into Confluent Cloud Kafka, processes them with batch consumers, and stores results in ClickHouse for sub-second SQL analytics.

Data & databasesStreaming & warehousing
influxdbinfluxdata
ADDED

InfluxDB 3 Core is an open-source time series database designed for real-time events, analytics, and monitoring, powered by Apache Arrow, DataFusion, and Parquet.

Data & databasesSelf-hostedStreaming & warehousing
deltadelta-io
ADDED

Delta Lake is an open-source storage framework enabling Lakehouse architecture. It integrates with compute engines like Spark, PrestoDB, Flink, Trino, and Hive, offering ACID transactions, time travel, and schema evolution for reliable data management.

Data & databasesStreaming & warehousing
ADDED

A shared service for reliable, synchronized Binance order book data via REST API. It solves common trading bot issues like data consistency, redundancy, and multi-language access, scaling from local setups to Kubernetes clusters.

Data & databasesDeveloper toolsStreaming & warehousing
ADDED

Reference implementation of a real‑time website analytics dashboard on Google Cloud. Click‑stream events are published to Pub/Sub, processed by a Dataflow streaming pipeline, stored in Cloud Memorystore (Redis) using HyperLogLog for cardinality, and visualized by a Spring Boot web UI with Google Charts.

Data & databasesDeveloper toolsStreaming & warehousing
tdenginetaosdata
ADDED

Open-source, cloud-native time-series database aimed at IoT, connected vehicles and Industrial IoT, with real-time ingestion, built-in caching and stream processing, distributed clustering, tooling, and an AI agent for forecasting and anomaly detection.

Data & databasesAI & MLStreaming & warehousing
kafkaapache
ADDED

Apache Kafka is an open-source distributed event streaming platform designed for high-performance data pipelines, streaming analytics, and data integration.

Data & databasesStreaming & warehousing
pathwaypathwaycom
ADDED

Pathway is a Python ETL framework for stream processing, real-time analytics, and AI pipelines including LLM and RAG applications. It runs Python code on a Rust engine for incremental computation, supports batch and streaming data with the same code, and deploys via Docker and Kubernetes.

Data & databasesAI & MLStreaming & warehousing
ADDED

Ethereum head watcher is a bot monitoring validator slashing, exits, and forks, sending alerts via Alertmanager to Discord.

Developer toolsData & databasesCLI & terminal
go-kafkafaustbrian
ADDED

Go library offering bounded Apache Kafka producer, consumer, replay, inspection and transactional building blocks that wrap franz-go without hiding delivery outcomes, lifecycle ownership or topic policy.

Developer toolsData & databasesBackend & APIs
seastarscylladb
ADDED

Seastar is an event-driven C++ server-side framework built on futures for writing non-blocking asynchronous code. It offers a userspace TCP/IP stack, optional DPDK support, and multiple build modes, and underpins projects such as ScyllaDB and Redpanda.

Developer toolsData & databasesBackend & APIs
guessit-jsopensubtitles
ADDED

guessit-js is a TypeScript port of Python guessit that extracts metadata (title, year, season, episode, codec, language, etc.) from media filenames. It is 100% compatible with Python guessit 4.4.0, 3.5x faster, and provides a CLI, REST API, and WASM support.

Developer toolsData & databasesCLI & terminal
risingwaverisingwavelabs
ADDED

RisingWave is an event streaming platform designed for agentic AI that integrates ingestion, processing, and serving into a single system.

Data & databasesAI & MLStreaming & warehousing