Hi all ...
I have several B2B directories I want to scrape data from.
It is easy to do on a directory by directory basis, but each project is quite different from one another.
How could I run all these projects at once (I don't necessarily care about having parallel processes, etc), and ideally having all the data in one table ?
Thanks ...
Running several projects at once ...
Re: Running several projects at once ...
You can do this by using the command line. You can probably create a batch file or use the windows task scheduler. See the Command Line section in the documentation. Also, you can have several projects use the same database by using the Export Database and Connect to Database File buttons in the database panel.
Juan Soldi
The Helium Scraper Team
The Helium Scraper Team