OPEN SOURCE, OPEN TO EVERYONE

Open source. Open possibilities.

Discover quality open-source projects, submit projects anonymously, and claim and edit your own project.

Human-curated · Discover open source4109discovered

A little curiosity. A world of open source.

THE FIRST COLLECTION
Topic: big-data清除
ADDED

Source code for the Apache Doris official website (doris.apache.org), built with Docusaurus 3. Hosts multilingual documentation, blog posts, and community guides for Apache Doris, a real-time MPP analytical database.

Developer toolsData & databasesTemplates & starters
sparkapache
ADDED

Apache Spark is a unified analytics engine designed for large-scale data processing, offering high-level APIs and an optimized engine for general computation graphs.

Data & databasesData integration
flinkapache
ADDED

Apache Flink is an open-source stream processing framework providing powerful capabilities for both data streaming and batch processing.

Film, Video & MediaVideo editing
beamapache
ADDED

Apache Beam is a unified programming model for defining both batch and streaming data-parallel processing pipelines.

Data & databasesData integration
deltadelta-io
ADDED

Delta Lake is an open-source storage framework enabling Lakehouse architecture. It integrates with compute engines like Spark, PrestoDB, Flink, Trino, and Hive, offering ACID transactions, time travel, and schema evolution for reliable data management.

Data & databasesStreaming & warehousing
arkimearkime
ADDED

Arkime is a large-scale, open-source network analysis and packet capture system for storing and indexing network traffic in PCAP format.

Data & databasesSelf-hostedSearch & indexing
trinotrinodb
ADDED

Trino is a fast distributed SQL query engine designed for big data analytics, formerly known as PrestoSQL.

Data & databasesRelational databases
catboostcatboost
ADDED

CatBoost is Yandex's open-source gradient boosting library for classification, regression and ranking, with native categorical feature support, CPU/GPU training, distributed training via Apache Spark, and APIs for Python, R, Java and C++.

AI & MLTraining & evaluation
awesome-scalabilitybinhnguyennus
ADDED

Curated reading list on building scalable, reliable, high-performance large-scale systems, with design principles, case studies from tech giants, and interview resources.

Developer toolsBackend & APIs
ADDED

Apache DataFusion is an extensible query engine written in Rust that uses Apache Arrow as its in-memory format, providing SQL and DataFrame APIs for building fast analytic systems.

GamesGame engines
ClickHouseClickHouse
ADDED

ClickHouse is an open-source, column-oriented database management system designed for real-time analytical data reporting.

Data & databasesRelational databases
cythoncython
ADDED

Cython is an optimizing Python compiler that translates Python code into C/C++ to create efficient extensions.

Developer toolsTesting & debugging