OPEN SOURCE, OPEN TO EVERYONE

Open source. Open possibilities.

Discover quality open-source projects, submit projects anonymously, and claim and edit your own project.

Human-curated · Discover open source4109discovered

A little curiosity. A world of open source.

THE FIRST COLLECTION
Topic: data-engineering清除
kestrakestra-io
ADDED

Kestra is an open-source, event-driven orchestration platform designed for data, AI, and infrastructure workflows, utilizing a declarative YAML interface.

AutomationDeveloper toolsWorkflow automation
taipyAvaiga
ADDED

Taipy is a Python framework designed for data scientists and ML engineers to build and deploy production-ready data and AI-driven web applications without needing to learn front-end languages.

Data & databasesAI & MLAnalytics & BI
xonshxonsh
ADDED

Xonsh is a full-featured, cross-platform shell that uses Python 3 as its language, seamlessly integrating shell commands with Python. It runs on Linux, macOS, Windows, BSD, Jupyter, Android, Raspberry Pi, and Nix, with an extension system and AI-friendly features.

Developer toolsCLI & terminal
ADDED

SolarisPKN-Stats is an automated system for collecting, storing, and updating project statistics from multiple platforms into structured JSON files.

AutomationData & databasesData automation
cocoindexcocoindex-io
ADDED

CocoIndex is an open-source incremental indexing framework designed to provide AI agents and LLM applications with continuously fresh context by reprocessing only changed data.

AI & MLData & databasesRAG & knowledge
deck-labDylnMtthws
ADDED

Deck Lab is a Python/Flask workspace for building, researching and goldfish-simulating competitive Commander (MTG) decks, with versioned data contracts, isolated QA, and verified container releases.

GamesData & databasesGame development tools
ADDED

Great Expectations (GX Core) is an open-source Python library for data quality, providing a framework for creating unit tests for data to ensure consistency and reliability.

Data & databasesDeveloper toolsData integration
data-research-analysis-platformData-Research-Analysis
ADDED

A data research and analysis platform that enables users to import custom datasets for visualization and analysis.

Data & databasesAnalytics & BI
evidenceevidence-dev
ADDED

Evidence is an open-source, code-based alternative to drag-and-drop BI tools: build fast, interactive reports with SQL and markdown, then publish or self-host the generated static site.

Data & databasesAnalytics & BI
supersetapache
ADDED

Apache Superset is a modern, enterprise-ready business intelligence web application used for data exploration and visualization.

Data & databasesAnalytics & BI
ADDED

DataPulse is an open, read-only trust and verification layer for Malaysian public data. It repeatedly probes 418 official datasets, publishes machine-readable evidence on freshness, licence, schema and provenance, and exposes the catalogue to AI agents through a 19-tool read-only MCP server.

AI & MLData & databasesAI agents
dagsterdagster-io
ADDED

Dagster is a cloud-native data pipeline orchestrator designed for the development, production, and observation of data assets throughout their entire lifecycle.

Film, Video & MediaMedia servers
semanticasemantica-agi
ADDED

Semantica is a graph-native infrastructure designed to provide structured context, deterministic reasoning, and full decision provenance for AI systems, serving as a semantic layer for LLMs and agents.

AI & MLDeveloper toolsRAG & knowledge
airflowapache
ADDED

Apache Airflow is a platform to programmatically author, schedule, and monitor workflows as code, commonly used for data pipelines and AI/ML orchestration.

AutomationData & databasesWorkflow automation
delta-explaincdelmonte-zg
ADDED

delta-explain visualizes Delta Lake file pruning. It reads transaction logs to show partition pruning and statistics‑based skipping for a given predicate, with CLI, Python API, CI gating, and JSON reporting.

Developer toolsAutomationCLI & terminal
hueyrpbouman
ADDED

Huey is a static, browser-based data exploration and analysis tool using DuckDB-WASM. Supports CSV, Parquet, JSON, XLSX, and DuckDB files with pivot tables, query builder, and derived attributes. Data stays local for privacy.

Data & databasesAnalytics & BI
go-flowetl-madness
ADDED

Flow is a single-binary, high-performance ETL engine and workflow orchestrator written in Go. It features an embedded visual web builder, declarative XML pipelines, cross-database support, and built-in audit telemetry.

Data & databasesAutomationData integration
prefectPrefectHQ
ADDED

Prefect is a Python-based workflow orchestration framework designed to build, automate, and monitor resilient data pipelines with features like scheduling and retries.

Film, Video & MediaVideo editing
made-with-mlGokuMohandas
ADDED

Made With ML is an open-source course and codebase teaching how to design, develop, deploy and iterate on production-grade machine learning applications, covering MLOps, testing, serving, CI/CD and continual learning.

AI & MLDeveloper toolsTraining & evaluation
risingwaverisingwavelabs
ADDED

RisingWave is an event streaming platform designed for agentic AI that integrates ingestion, processing, and serving into a single system.

Data & databasesAI & MLStreaming & warehousing
Load more projects