Dear Sir,
I am trying to create email scarping program, kindly check and help for going to inside the link as well as going to next record and next pages and extracting all the emails from that link.
request for early help and kindly send me final complete project
Thanks & Best Regards.
John Dsouza
help for email scraping project
-
johndsouza
- Posts: 1
- Joined: Tue Sep 20, 2011 4:26 pm
help for email scraping project
- Attachments
-
email scarper project.hsp- (286 KiB) Downloaded 1014 times
Re: help for email scraping project
Hi John,
To set up this kind of navigation logic is really simple. Here is a typical Navigate Each Link / Navigate Next pattern:
This example would navigate each link, perform an extraction inside each and then go to the next page. On this particular case it would do it for 10 pages (notice the Repeat 10 times action on top).
The attached project is a variation on yours and uses the very same pattern as in the picture. Also, if you go to Project -> Options you'll see that I've set a navigation timeout of 20 seconds. This is because this project navigates to random pages that we don't know if they will all complete loading in a reasonable time. The 20 seconds timeout will prevent it from getting stuck at any page for more than 20 seconds.
To set up this kind of navigation logic is really simple. Here is a typical Navigate Each Link / Navigate Next pattern:
This example would navigate each link, perform an extraction inside each and then go to the next page. On this particular case it would do it for 10 pages (notice the Repeat 10 times action on top).
The attached project is a variation on yours and uses the very same pattern as in the picture. Also, if you go to Project -> Options you'll see that I've set a navigation timeout of 20 seconds. This is because this project navigates to random pages that we don't know if they will all complete loading in a reasonable time. The 20 seconds timeout will prevent it from getting stuck at any page for more than 20 seconds.
- Attachments
-
Emails.hsp- (327.15 KiB) Downloaded 1029 times
Juan Soldi
The Helium Scraper Team
The Helium Scraper Team