How Can I scrape a list of URLS?

Questions and answers about anything related to Helium Scraper
Post Reply
luisantafe
Posts: 10
Joined: Tue May 03, 2011 9:15 pm

How Can I scrape a list of URLS?

Post by luisantafe » Fri Jul 15, 2011 5:11 am

Hey Juan, thks for all your help in my lasts questions. I have one more. I have a list of URLS and I want to scrape some info in each one. I guess I can do that using the "navigate URLS" option, but I Could not do it work :oops: Do you have an example for me, pls? THanks again.

webmaster
Site Admin
Posts: 496
Joined: Mon Dec 06, 2010 8:39 am
Contact:

Re: How Can I scrape a list of URLS?

Post by webmaster » Fri Jul 15, 2011 5:41 pm

Is it not navigating through the URLs? I'm guessing you are setting your extract or whatever actions you want to perform in the pages after the Navigate URLs action instead of inside. Whatever actions you would like to perform in each page needs to be as a child node of the Navigate URLs action, such as the Extract action in this picture:
Sample.jpg
Sample.jpg (7.59 KiB) Viewed 2398 times
If this is not the problem you are having please let me know and if possible send me a sample project.
Juan Soldi
The Helium Scraper Team

luisantafe
Posts: 10
Joined: Tue May 03, 2011 9:15 pm

Re: How Can I scrape a list of URLS?

Post by luisantafe » Fri Jul 15, 2011 6:11 pm

I got it!!! The problem was that I did not save the URLS table before executing the process. When I was making the file for you, I save that table and it is working now. Thanks alot

Post Reply