Used sCrawler for Windows?
Editors’ Review
Download.com staff
Top Recommended Alternative
Pros
- Collects data from directory websites.
- Automated and methodical browsing.
- Gathers large amounts of information.
- Gathers intricate information.
- Performs URL normalization to avoid duplicates.
Cons
- Focused crawling performance depends on link richness.
- May ignore resources with a query string.
