help for email scraping project

Questions and answers about anything related to Helium Scraper
Post Reply
Posts: 1
Joined: Tue Sep 20, 2011 4:26 pm

help for email scraping project

Post by johndsouza » Tue Sep 20, 2011 4:33 pm

Dear Sir,

I am trying to create email scarping program, kindly check and help for going to inside the link as well as going to next record and next pages and extracting all the emails from that link.

request for early help and kindly send me final complete project

Thanks & Best Regards.
John Dsouza
email scarper project.hsp
(286 KiB) Downloaded 191 times

Site Admin
Posts: 501
Joined: Mon Dec 06, 2010 8:39 am

Re: help for email scraping project

Post by webmaster » Wed Sep 21, 2011 8:08 pm

Hi John,

To set up this kind of navigation logic is really simple. Here is a typical Navigate Each Link / Navigate Next pattern:
EachAndNext.jpg (8.2 KiB) Viewed 1851 times
This example would navigate each link, perform an extraction inside each and then go to the next page. On this particular case it would do it for 10 pages (notice the Repeat 10 times action on top).

The attached project is a variation on yours and uses the very same pattern as in the picture. Also, if you go to Project -> Options you'll see that I've set a navigation timeout of 20 seconds. This is because this project navigates to random pages that we don't know if they will all complete loading in a reasonable time. The 20 seconds timeout will prevent it from getting stuck at any page for more than 20 seconds.
(327.15 KiB) Downloaded 183 times
Juan Soldi
The Helium Scraper Team

Post Reply