Frame Reset Issues?
Posted: Thu May 03, 2012 9:29 pm
Please see attached file for screenshot. I would love to give you access to the problem site, but it's sign-on protected.
I'm trying to scrape a third party tool's web-based CRM interface. The tool grabs the result of Twitter search (i.e.: hashtags). I'm trying to scrape the resulting screen of tweets, user info. The display only shows 30 records of each with "Next" navigation button to move to the next page. By clicking on each user handle, a new window opens with detailed user info - Following, Follower, etc. The "Kind" for both #1 handle result and #2 additional user info upon using "Navigate Each" for each of the 30 handle kinds (from #1) works great for the first page. However, when I am using "Navigate: Next Page" to go to the next page to re-scrape the #1 and #2, for some strange reason, after grabbing the first instance of #2, the page resets to the first page.
I am guessing there is some javascript in the background that resets to the first search page. Is there a workaround so that the "Navigate Each" behaves closer to "Simulated Clicks" - I have selected "Simulated Clicks" under Navigate Each, but there may be something else that is resetting this thing. Thank you for your help.
I'm trying to scrape a third party tool's web-based CRM interface. The tool grabs the result of Twitter search (i.e.: hashtags). I'm trying to scrape the resulting screen of tweets, user info. The display only shows 30 records of each with "Next" navigation button to move to the next page. By clicking on each user handle, a new window opens with detailed user info - Following, Follower, etc. The "Kind" for both #1 handle result and #2 additional user info upon using "Navigate Each" for each of the 30 handle kinds (from #1) works great for the first page. However, when I am using "Navigate: Next Page" to go to the next page to re-scrape the #1 and #2, for some strange reason, after grabbing the first instance of #2, the page resets to the first page.
I am guessing there is some javascript in the background that resets to the first search page. Is there a workaround so that the "Navigate Each" behaves closer to "Simulated Clicks" - I have selected "Simulated Clicks" under Navigate Each, but there may be something else that is resetting this thing. Thank you for your help.