Is there a way to resume a session for where it stopped at all? I had to stop a scrape before it was finished, but it had been running for quite a while and I'd like to continue from where it stopped..
Thanks.
Resuming?
Re: Resuming?
There is no built in way unless you get the choice to pause the execution instead of stopping it (like when requirements are not met).
But maybe this project will help. Pretty much, every time you have a Navigate URLs (that works even if the Simulate Click option is off; if it only works when Simulate Click is on, the link is likely using javascript to navigate and therefore there is no URL to extract), you can instead extract the Link property of the links you'd navigate through to a table and after done, use this project to extract from these URLs. This will automatically continue from where you stopped if you're forced to stop, and will also make the extraction faster by using multiple processes.
Let me know if you need any help with this project.
But maybe this project will help. Pretty much, every time you have a Navigate URLs (that works even if the Simulate Click option is off; if it only works when Simulate Click is on, the link is likely using javascript to navigate and therefore there is no URL to extract), you can instead extract the Link property of the links you'd navigate through to a table and after done, use this project to extract from these URLs. This will automatically continue from where you stopped if you're forced to stop, and will also make the extraction faster by using multiple processes.
Let me know if you need any help with this project.
Juan Soldi
The Helium Scraper Team
The Helium Scraper Team