web-crawling
Tested projects carrying the web-crawling topic, with their current verdicts. Topics come from each project's own metadata and Argusic's pool tags. Spellings of the same topic are gathered here under one name, so this page holds every project tagged any of them.
Measured by Argusic on a fresh machine every time. Every number links to its evidence.
What Argusic measured in web-crawling
Argusic installed and ran 5 web-crawling projects on clean machines: 4 reached a running state, 1 only ran against stand-in services. Last tested November 7, 2026.
Every tested web-crawling project
| subject | verdict | language | runs | last tested |
|---|---|---|---|---|
| ferret | Runs | Go | 2 | |
| crawlee-python | Runs | Python | 2 | |
| crawl4ai | Runs | Python | 2 | |
| crawler | Runs | PHP | 1 | |
| brightdata-mcp | Runs with mocks | JavaScript | 1 |
All tested projects: subjects.