CocoIndex is an open-source incremental indexing framework designed to provide AI agents and LLM applications with continuously fresh context by reprocessing only changed data.
Open source. Open possibilities.
Discover quality open-source projects, submit projects anonymously, and claim and edit your own project.
A little curiosity. A world of open source.
THE FIRST COLLECTIONNetBox plugin that syncs Proxmox Datacenter Manager (PDM) remotes, views and SDN-adjacent inventory into NetBox via proxbox-api. It creates, updates and prunes PDMRemote rows, never writes back to PDM, and requires netbox-proxbox as a peer plugin.
FiftyOne is an open-source tool for building high-quality datasets and computer vision models. It enables users to visualize, label, evaluate, and curate visual AI data.
DASObjectStore turns old drives and SSDs into a portable S3-compatible object store. Uses SSD for initial writes, then moves data to HDDs with health-aware placement. Supports optional Synoptikon/Mneion integration.
A Python library for FITS file management and manipulation, featuring tools for image reduction, photometry, polarimetry, and spectroscopy.
An MCP server for South Korean listed companies' ESG data, created by a securities analyst. It allows AI agents like Claude and ChatGPT to query ratings from 5 agencies, governance indicators, and GHG emissions from KRX, KIND, and GIR via 12 tools without requiring API keys.
Apache Spark is a unified analytics engine designed for large-scale data processing, offering high-level APIs and an optimized engine for general computation graphs.
Vector is an open-source observability data pipeline written in Rust. It collects, transforms and routes logs and metrics as either an agent or an aggregator, letting teams control where telemetry goes and reduce vendor costs.
OpenRefine is a Java-based open-source power tool designed for cleaning, transforming, and reconciling messy data through a web browser interface.
ceidg is a software repository currently lacking detailed documentation or described capabilities.
newspaper3k is a Python 3 library designed for extracting and curating articles from the web, providing tools for full-text and metadata extraction.
A JSON Schema implementation of the US EPA/USGS WQX standard for water quality data exchange, originally converted from XML by The Gordon Foundation for the DataStream platform.
A curated list of data engineering tools covering databases, data ingestion, stream processing, batch processing, file systems, serialization formats, monitoring, and more.
Deck Lab is a Python/Flask workspace for building, researching and goldfish-simulating competitive Commander (MTG) decks, with versioned data contracts, isolated QA, and verified container releases.
Emburk is an independent, Rust-native bulk data loader inspired by Embulk, designed to provide a safer and more observable execution engine for data transfer.
Canal is Alibaba's open-source MySQL binlog incremental subscription and consumption component. It parses database logs for data synchronization, supports multiple MySQL versions, and delivers to Kafka/RocketMQ.
Excelize is a pure Go library for reading and writing Microsoft Excel spreadsheets in XLAM, XLSM, XLSX, XLTM and XLTX formats. It supports Excel 2007+ files, chart and image insertion, complex spreadsheet components, and a streaming API for large worksheets.
Great Expectations (GX Core) is an open-source Python library for data quality, providing a framework for creating unit tests for data to ensure consistency and reliability.
A popular single-header C++11 JSON library for parsing, serializing, and manipulating JSON with an intuitive STL-like API. Supports JSON Pointer/Patch, arbitrary type conversions, and binary formats (CBOR, MessagePack, UBJSON, BSON, BJData).
Alioth 是一个基于 PostgreSQL 表继承和群论的开源企业级数据模型,用于形式化经济行为。它通过四维正交空间 (Scene, Factor, Function, State) 提供严格的数学基础,适用于交易过程建模、数据治理和复杂业务系统的数据架构设计。