sparkapache
ADDEDApache Spark is a unified analytics engine designed for large-scale data processing, offering high-level APIs and an optimized engine for general computation graphs.
Discover quality open-source projects, submit projects anonymously, and claim and edit your own project.
A little curiosity. A world of open source.
THE FIRST COLLECTIONApache Spark is a unified analytics engine designed for large-scale data processing, offering high-level APIs and an optimized engine for general computation graphs.
Apache Beam is a unified programming model for defining both batch and streaming data-parallel processing pipelines.
SQLGlot is a pure‑Python SQL parser, transpiler, optimizer, and engine that supports over 30 dialects, enabling formatting, cross‑dialect translation, AST manipulation, and optional C‑extension acceleration for fast SQL processing.