Search found 1 match

by fredrik
Mon Jun 06, 2011 6:48 am
Forum: Q/A
Topic: run crawlers in batch mode?
Replies: 1
Views: 9732

run crawlers in batch mode?

I want to use Helium Scraper to run on hundreds of sites each day. What is the best way to achieve this, can I run the crawlers in batch mode? i.e. put all my crawler files in a folder and create a script that runs all of them one after the other or several at a time?

Thanks

Fred