crawling
Tested projects carrying the crawling topic, with their current verdicts. Topics come from each project's own metadata and Argusic's pool tags. Spellings of the same topic are gathered here under one name, so this page holds every project tagged any of them.
Measured by Argusic on a fresh machine every time. Every number links to its evidence.
What Argusic measured in crawling
Argusic installed and ran 13 crawling projects on clean machines: 12 reached a running state, 1 only ran against stand-in services. Last tested November 6, 2026.
Every tested crawling project
| subject | verdict | language | runs | last tested |
|---|---|---|---|---|
| rod | Runs | Go | 2 | |
| crawlee-python | Runs | Python | 2 | |
| colly | Runs | Go | 2 | |
| scrapy | Runs | Python | 2 | |
| Scrapling | Runs | Python | 2 | |
| crawler | Runs | PHP | 1 | |
| rebrowser-patches | Runs | JavaScript | 2 | |
| deepcrawl | Runs | TypeScript | 1 | |
| seonaut | Runs | Go | 1 | |
| scrapyrt | Runs | Python | 1 | |
| siteone-crawler | Runs | Rust | 1 | |
| newspaper | Runs | Python | 1 | |
| exa-mcp-server | Runs with mocks | TypeScript | 3 |
All tested projects: subjects.