OPEN SOURCE, OPEN TO EVERYONE

Open source. Open possibilities.

Discover quality open-source projects, submit projects anonymously, and claim and edit your own project.

Human-curated · Discover open source4109discovered

A little curiosity. A world of open source.

THE FIRST COLLECTION
Topic: pipeline清除
ADDED

nf-core/fastqrepair is a bioinformatics pipeline for recovering corrupted FASTQ.gz files, fixing uncompliant reads, removing unpaired reads, and re-pairing disordered reads. It outputs clean FASTQ files and QC reports.

Data & databasesDeveloper toolsData integration
kestrakestra-io
ADDED

Kestra is an open-source, event-driven orchestration platform designed for data, AI, and infrastructure workflows, utilizing a declarative YAML interface.

AutomationDeveloper toolsWorkflow automation
ADDED

Great Expectations (GX Core) is an open-source Python library for data quality, providing a framework for creating unit tests for data to ensure consistency and reliability.

Data & databasesDeveloper toolsData integration
dotflowdotflow-io
ADDED

Lightweight Python execution pipeline library that uses @action decorators to define tasks, supports retry, parallel execution, observability, and one-click deployment to 34+ cloud platforms including AWS Lambda, GCP Cloud Run, and Kubernetes.

Developer toolsBuild & DevOps
StormByte-BufferStormBytePP
ADDED

StormByte-Buffer is a C++26 library providing FIFO, SharedFIFO, Ring buffers, and pipeline tools for the StormByte suite. Includes thread-safe/non-thread-safe buffers, producer/consumer patterns, and configurable pipeline stages (sync/async/parallel). Requires StormByte Base.

Developer toolsData & databasesComponent libraries
marimomarimo-team
ADDED

marimo is a reactive Python notebook that ensures consistency between code and outputs, stored as pure Python files for git-friendliness and deployability.

Developer toolsData & databasesEditors & IDEs
pipelinetektoncd
ADDED

Tekton Pipelines provides Kubernetes-native resources for declaring CI/CD pipelines. Pipelines are cloud-native, decoupled and typed, using containers as building blocks, with Tasks runnable in isolation and swappable resources.

AutomationDeveloper toolsCI/CD