crawlee-pythonapify
ADDEDCrawlee is a Python web scraping and browser automation library for building reliable crawlers. It supports HTTP and headless browser crawling, automatic retries, proxy rotation, and data storage for AI/LLM applications.
Discover quality open-source projects, submit projects anonymously, and claim and edit your own project.
A little curiosity. A world of open source.
THE FIRST COLLECTIONCrawlee is a Python web scraping and browser automation library for building reliable crawlers. It supports HTTP and headless browser crawling, automatic retries, proxy rotation, and data storage for AI/LLM applications.
A skill plugin that motivates AI coding agents to persist and proactively troubleshoot using PUA scripts (Chinese) or PIP plans (English), supporting multiple AI tools. It includes debugging methodologies and forced proactivity, with benchmark tests showing increased tool calls and issue discovery. Available in multiple languages and platforms.