OPEN SOURCE, OPEN TO EVERYONE

Open source. Open possibilities.

Discover quality open-source projects, submit projects anonymously, and claim and edit your own project.

Human-curated · Discover open source4109discovered

A little curiosity. A world of open source.

THE FIRST COLLECTION
Topic: web-crawling清除
node-sdkknownagents
ADDED

The @knownagents/sdk is a Node.js library that lets server‑side applications track AI agent traffic, record LLM referrals, generate up‑to‑date robots.txt files, and identify bots via the Agent Identification API. It supports batch event flushing, MCP call tracking, and integration with ACP/UCP commerce flows.

AI & MLDeveloper toolsAI agents
ADDED

Crawlee is a Python web scraping and browser automation library for building reliable crawlers. It supports HTTP and headless browser crawling, automatic retries, proxy rotation, and data storage for AI/LLM applications.

Developer toolsAI & MLBackend & APIs
ferretMontFerret
ADDED

Ferret is a declarative data automation language and Go runtime for structured extraction workflows, supporting embedding, capability-based access, and cross-source querying.

AutomationDeveloper toolsData automation