Used Crawler4j for Windows?


Editors’ Review

Download.com staff
Crawler4j is an open source Java web crawler designed for rapid, multi-threaded crawling. Set up your custom crawler in minutes with its straightforward interface.
  • Pros

    • Open source Java web crawler
    • Simple interface for web crawling
    • Setup multi-threaded crawler in 5 minutes
    • Extensible WebCrawler class
    • Control over URL crawling and page handling
  • Cons

    No Cons available


Used Crawler4j for Windows?


Explore More


Full Specifications

GENERAL
Release
Latest update
Version
3.3
OPERATING SYSTEMS
Platform
Windows
Operating System
  • Windows 2003
  • Windows Vista
  • Windows 7
  • Windows 10
  • Windows XP
Additional Requirements
None
POPULARITY
Total Downloads
263
Downloads Last Week
17

Report Software

Program available in other languages


Last Updated


Developer’s Description

Incorporate web crawling option for web pages.
Crawler4j is an open source Java crawler which provides a simple interface for the Web crawling. You can setup a multi-threaded web crawler in 5 minutes. You can create a crawler class that extends WebCrawler and it decides which URLs should be crawled and handles the downloaded page.

Download.com
Your review for Crawler4j