Actions right arrow Actions List right arrow Navigate URLs

Navigates through a set of URLs taken from the specified column in a data table, execute its child nodes in each of the navigated pages, and then returns to the starting page. The selected column must contain links to the pages you want Helium Scraper to navigate to.

If an ID Column is given, the id corresponding to the current URL will be accessible from the ID_{Table Name} property gatherer in every child Extract action, where {Table Name} is the table from which the URLs are being read.

In the Advanced tab, a custom SQL query can be entered that will be used to retrieve URLs, and if given, their corresponding IDs. Helium Scraper will look for a column named URL from which to read the URLs, and a column named ID from which to read the IDs. If your actual column names don't match these names, an SQL alias can be used, such is in the following query:


SELECT [MyURLs] AS [URL],
       [MyIDs]  AS [ID]
FROM   [URLsTable]
WHERE  [MyIDs] NOT IN (SELECT [MyExtractedIDs]
                       FROM   [ExtractedURLsTable])