Page 1 of 1

Dynamic URL

Posted: Tue May 08, 2012 8:26 am
by seja
I am using the Helium Scraper GUI and I was wondering how I can dynamically go to web addresses. For example I want to visit the following web addresses:
http://www.nettiauto.com/4739952
http://www.nettiauto.com/4739953
http://www.nettiauto.com/4739954
http://www.nettiauto.com/4739955
http://www.nettiauto.com/4739956

where I am constantly adding 1 to the id number at the end of the URL. Thanks!

Re: Dynamic URL

Posted: Thu May 10, 2012 1:55 am
by webmaster
Hi,

Just use the URL Variations premade at File -> Online Premades or at New Action -> Execute Actions Tree -> More... in any actions tree.

Re: Dynamic URL

Posted: Sun Nov 10, 2013 5:06 pm
by euromann
Hi,

I have a related problem. I want to scrape a supplier's website gathering data on product pages. This works so far, but I really want to get the translations of item name and description as well. So I would go from the generic product detail page www.someurl.com/product.php?artnr=4711 to the variations
www.someurl.com/product.php?artnr=4711&clang=fr
www.someurl.com/product.php?artnr=4711&clang=en
www.someurl.com/product.php?artnr=4711&clang=dt

and extract only title and description there, ideally in the same row.

Any hint

Best regards