GitHub - yunlong/crowdspider: crowdspider is a web crawler. crowdspider is (just) a web crawler, NOT an indexer. You have to write some code yourself in order to save pages or index them in a database.

yunlong / crowdspider Public

crowdspider is a web crawler. crowdspider is (just) a web crawler, NOT an indexer. You have to write some code yourself in order to save pages or index them in a database.

0 stars 0 forks Branches Tags Activity

Notifications

Name		Name	Last commit message	Last commit date
Latest commit History 1 Commit
build		build
config		config
libhtmlparser		libhtmlparser
libspider		libspider
Makefile		Makefile
README		README
README.md		README.md

Repository files navigation

crowdspider

About

crowdspider is a web crawler. crowdspider is (just) a web crawler, NOT an indexer. You have to write some code yourself in order to save pages or index them in a database.

Report repository

Releases

No releases published

Packages

No packages published

Languages