crawler
Norconex Crawlers (or spiders) are flexible web and filesystem crawlers for collecting, parsing, and manipulating data from the web or filesystem to various data repositories such as search engines.
Not yet testedsource: GitHubhomepageJavaApache-2.0commit f71ef79931ba
Java, Apache-2.0 licensed. The project labels itself: crawler, crawler fs, crawler web, crawlers, filesystem crawler, flexible, java and search engine.
crawler has not been verified yet.
Measured by Argusic on a fresh machine every time. Every number links to its evidence.
At a glance
Subject data from GitHub, linked at the top of this page, refreshed . Test data by Argusic (CC BY 4.0); every number links to a run page with the full log, the recording, and their sha256 hashes.
Also tested, in the same area
Every one of these was installed and run by Argusic on a clean machine. Nothing appears here that was not tested.
Run history
No recorded runs.
Topics (from GitHub)
crawlercrawler-fscrawler-webcrawlersfilesystem-crawlerflexiblejavasearch-enginespiderweb-crawler
Embed the badge
Markdown for the project README. It links back here; terms on the terms page.
[](https://argusic.com/subject/crawler)Questions
- Does crawler run?
- crawler has not been fully verified yet. No recorded run has produced a verdict yet.
- How did Argusic test crawler?
- On a fresh, disposable machine, with every command recorded. 0 attempts are recorded, and the full method is on the methodology page.
- Where is the evidence for crawler?
- All 0 recorded runs are on this page, each linking to its full log and terminal recording, stored with a sha256 fingerprint so it cannot be quietly altered.