GitHub - meshaabi/webspider

Branches Tags

Name		Name	Last commit message	Last commit date
Latest commit History 203 Commits
Output/Spider		Output/Spider
dist		dist
doc		doc
report		report
src		src
test/webspider/core/crawler		test/webspider/core/crawler
webspider		webspider
README		README
WebSpider.jar		WebSpider.jar
stopfile.txt		stopfile.txt

Repository files navigation

This project Web Spider contains 

WEB-CRAWLER that crawles a site given a base url and outputs links it found to separate files
INDEXER that load pages found by the webrawler and creates a searchable index for it
USER-INTERFACE that can be loaded for all modules, or loaded separately per for the crawler and indexer. The program works with command line interface too

See Report