About this project

SouShen Hunter is a search skill designed for OpenClaw, aiming to provide high-performance Bing and Google search capabilities without paying API fees. It is based on the Playwright underlying API and supports deep webpage element extraction, including links, forms, buttons, and scripts. Key features include: - Bing Search: Zero API fees, using the Playwright underlying API. - Google Search: Advanced anti-detection strategies to bypass human verification. - Deep Extraction: Automatically extracts page links, forms, buttons, and scripts. - High Performance: Asynchronous architecture for fast responses. - Anti-Detection: Bypasses anti-crawler mechanisms, including user data directory reuse, behavior simulation, and fingerprint spoofing. - OpenClaw Integration: Ready to use out of the box. Installation steps include cloning the repository, copying it to the OpenClaw skills directory, and restarting. The dependency is Playwright; the script automatically detects the Chrome path, or it can be manually specified. Usage includes CLI commands and a Python API. The CLI supports specifying the search engine, result count, deep page analysis, setting the default engine, and viewing configuration. The Python API provides BingSearchAgent and GoogleSearchAgent classes, supporting asynchronous search and deep page analysis. The configuration file `.soushen_config.json` is automatically generated on first run, allowing you to set the default engine and result count. For Google anti-detection, the script employs strategies such as user data directory reuse, browser fingerprint spoofing, behavior simulation, multi-user-agent rotation, and geolocation simulation. If human verification is encountered, you can try using your own Chrome configuration directory, a Chrome with login state, reducing search frequency, or switching to Bing. The project structure includes SKILL.md, README.md, the main entry script soushen, configuration files, and Bing and Google search scripts under the scripts directory. The author is Yinxian (He Runpei), licensed under the MIT License.