Open source. Open possibilities.

delta-explain visualizes Delta Lake file pruning. It reads transaction logs to show partition pruning and statistics‑based skipping for a given predicate, with CLI, Python API, CI gating, and JSON reporting.

Huey is a static, browser-based data exploration and analysis tool using DuckDB-WASM. Supports CSV, Parquet, JSON, XLSX, and DuckDB files with pivot tables, query builder, and derived attributes. Data stays local for privacy.

Flow is a single-binary, high-performance ETL engine and workflow orchestrator written in Go. It features an embedded visual web builder, declarative XML pipelines, cross-database support, and built-in audit telemetry.

Prefect is a Python-based workflow orchestration framework designed to build, automate, and monitor resilient data pipelines with features like scheduling and retries.

Made With ML is an open-source course and codebase teaching how to design, develop, deploy and iterate on production-grade machine learning applications, covering MLOps, testing, serving, CI/CD and continual learning.

RisingWave is an event streaming platform designed for agentic AI that integrates ingestion, processing, and serving into a single system.

A runnable local real-time analytics pipeline using Kafka-compatible broker (Redpanda) and PySpark Structured Streaming. Simulates clickstream events, performs windowed aggregation with watermarking, all via docker-compose.

Argo Workflows is a container-native workflow engine for orchestrating parallel jobs on Kubernetes, implemented as a Custom Resource Definition (CRD).

Kestra is an open-source, event-driven orchestration platform designed for data, AI, and infrastructure workflows, utilizing a declarative YAML interface.

Taipy is a Python framework designed for data scientists and ML engineers to build and deploy production-ready data and AI-driven web applications without needing to learn front-end languages.

Xonsh is a full-featured, cross-platform shell that uses Python 3 as its language, seamlessly integrating shell commands with Python. It runs on Linux, macOS, Windows, BSD, Jupyter, Android, Raspberry Pi, and Nix, with an extension system and AI-friendly features.

SolarisPKN-Stats is an automated system for collecting, storing, and updating project statistics from multiple platforms into structured JSON files.

CocoIndex is an open-source incremental indexing framework designed to provide AI agents and LLM applications with continuously fresh context by reprocessing only changed data.

Deck Lab is a Python/Flask workspace for building, researching and goldfish-simulating competitive Commander (MTG) decks, with versioned data contracts, isolated QA, and verified container releases.

Great Expectations (GX Core) is an open-source Python library for data quality, providing a framework for creating unit tests for data to ensure consistency and reliability.

A data research and analysis platform that enables users to import custom datasets for visualization and analysis.

Evidence is an open-source, code-based alternative to drag-and-drop BI tools: build fast, interactive reports with SQL and markdown, then publish or self-host the generated static site.

Apache Superset is a modern, enterprise-ready business intelligence web application used for data exploration and visualization.

DataPulse is an open, read-only trust and verification layer for Malaysian public data. It repeatedly probes 418 official datasets, publishes machine-readable evidence on freshness, licence, schema and provenance, and exposes the catalogue to AI agents through a 19-tool read-only MCP server.

Dagster is a cloud-native data pipeline orchestrator designed for the development, production, and observation of data assets throughout their entire lifecycle.