Helium Scraper

Thanks Chuck, Hah! Hah! Sounds like you have a lot of workaround tools in your toolbelt. Handy. :D The problem does seem related to search results formatted into multiple tables. Not all sites, of course, run into this problem. Scraping Google search results works fine for me. Scraping search result...

cw42, It looks like the reply you got from Webmaster was meant to answer my question, "How do I use a table of URLs as my starting point?" and mistakenly posted as a reply to yours. Interestingly, I'm now experiencing the same thing you are, with rows for each type rather than for each "record," whi...

I'm looking for a way to scrape only the URLs listed in a linked table as a way to check previously scraped pages for updated content. So, for example, assume I've scraped some place listing pages from yp. One month later, I want to go back and check a filtered set of these pages for updated content...

Keeps getting better and better. I love it. These relational database type features (linking multiple tables via table IDs) are terrific. Thanks for the videos. Very helpful.

Yup, that did it. Thank you!

I'm using the "Easy deep Yellow Pages extraction" file, but am now getting the following error message every time I run the script: Requirements not met when selecting 'ypBusinessInput'. Required Items: 1 Items Found: 0 I get this error even if I download a fresh copy of the YellowPages2.hsp file fr...

Excellent! Thank you. That's a more elegant solution.

Would it be possible to add the number of pages variable to the input table? For example, if my input table includes Schools and Restaurants, the schools may only require 1 page of search results while the restaurants may need 5 or 6. If I could define the pages per input record (i.e., "Input.Busine...

Yes! That's it. Thanks for a quick response.

Love this custom script. For some reason though, it stops on the fourth page of listings, so I only get 120 listing (with their accompanying details). The repeat value on the "Search in YP" action is set to 2. I can set it to 3 or 4, but it doesn't make a difference--so I'm not sure how that number ...