Running Out of Resources (Auto scrolling to bottom of page)
Posted: Wed Jun 08, 2016 6:17 pm
I am attempting to scrape a page which requires me to scroll many times to get to the bottom of the page (in order to load all of the data I wish to scrape.) I came up with a way to autoscroll to the bottom of the page executing javascript: var scroll = setInterval(function(){ window.scrollBy(0, 100); }, 2000).
This seems to work; however, I cannot complete the process because I keep getting the error that HS is running out of resources. HS then freezes and crashes. What is the way around this?
Please note, I'm not a coder and am pretty new to this - speak to me in small words, any step-by-step help would be appreciated.
Thanks
This seems to work; however, I cannot complete the process because I keep getting the error that HS is running out of resources. HS then freezes and crashes. What is the way around this?
Please note, I'm not a coder and am pretty new to this - speak to me in small words, any step-by-step help would be appreciated.
Thanks