Ex-Crawler is divided into 3 subprojects (Crawler Daemon, distributed gui Client, (web) search engine) which together provide a flexible and powerful search engine supporting distributed computing. More informations: http://ex-crawler.sourceforge.net

Features

  • Fast web and image crawler written in Java which follows new links automaticly on a priority algorithm and can run 24h a day.
  • Uses MySQL, MSSQL, PostgreSQL or even SQLlite Database to store informations
  • Comes with a web frontend search engine, direct website analysis and more (in development - SVN)
  • Support for distributed crawling with a graphical frontend for non-advanced users (de.excrawler.distributed.client in svn)
  • Comes with it's own server where you can add new sites and much more including UserManagement and more.
  • Comes with an plugin interface, with it you can easily add your own features in no time
  • And much more

Project Samples

Project Activity

See All Activity >

License

GNU General Public License version 3.0 (GPLv3)

Follow Ex-Crawler

Ex-Crawler Web Site

Other Useful Business Software
All-in-One Payroll and HR Platform Icon
All-in-One Payroll and HR Platform

For small and mid-sized businesses that need a comprehensive payroll and HR solution with personalized support

We design our technology to make workforce management easier. APS offers core HR, payroll, benefits administration, attendance, recruiting, employee onboarding, and more.
Rate This Project
Login To Rate This Project

User Ratings

★★★★★
★★★★
★★★
★★
1
0
0
0
0
ease 1 of 5 2 of 5 3 of 5 4 of 5 5 of 5 0 / 5
features 1 of 5 2 of 5 3 of 5 4 of 5 5 of 5 0 / 5
design 1 of 5 2 of 5 3 of 5 4 of 5 5 of 5 0 / 5
support 1 of 5 2 of 5 3 of 5 4 of 5 5 of 5 0 / 5

User Reviews

  • Ex-crawler is good! Thanks.
    1 user found this review helpful.
Read more reviews >

Additional Project Details

Operating Systems

Solaris, Linux, Mac, Windows

Languages

English

Intended Audience

Science/Research, Education, Advanced End Users, System Administrators, Developers, End Users/Desktop

User Interface

Java Swing, Web-based, Non-interactive (Daemon), Command-line

Programming Language

PHP, Java

Database Environment

JDBC, MySQL, PostgreSQL (pgsql), SQLite, Microsoft SQL Server

Related Categories

PHP Search Engines, PHP Distributed Computing Software, PHP Information Analysis Software, Java Search Engines, Java Distributed Computing Software, Java Information Analysis Software

Registered

2010-03-02