Dynamic URL

Here you can ask anything related to JavaScript as applied to Helium Scraper.
Post Reply
seja
Posts: 1
Joined: Tue May 08, 2012 8:23 am

Dynamic URL

Post by seja » Tue May 08, 2012 8:26 am

I am using the Helium Scraper GUI and I was wondering how I can dynamically go to web addresses. For example I want to visit the following web addresses:
http://www.nettiauto.com/4739952
http://www.nettiauto.com/4739953
http://www.nettiauto.com/4739954
http://www.nettiauto.com/4739955
http://www.nettiauto.com/4739956

where I am constantly adding 1 to the id number at the end of the URL. Thanks!

webmaster
Site Admin
Posts: 491
Joined: Mon Dec 06, 2010 8:39 am
Contact:

Re: Dynamic URL

Post by webmaster » Thu May 10, 2012 1:55 am

Hi,

Just use the URL Variations premade at File -> Online Premades or at New Action -> Execute Actions Tree -> More... in any actions tree.
Juan Soldi
The Helium Scraper Team

euromann
Posts: 1
Joined: Sun Nov 10, 2013 5:00 pm

Re: Dynamic URL

Post by euromann » Sun Nov 10, 2013 5:06 pm

Hi,

I have a related problem. I want to scrape a supplier's website gathering data on product pages. This works so far, but I really want to get the translations of item name and description as well. So I would go from the generic product detail page www.someurl.com/product.php?artnr=4711 to the variations
www.someurl.com/product.php?artnr=4711&clang=fr
www.someurl.com/product.php?artnr=4711&clang=en
www.someurl.com/product.php?artnr=4711&clang=dt

and extract only title and description there, ideally in the same row.

Any hint

Best regards

Post Reply