Search found 17 matches

by jafuli
Mon Aug 22, 2016 8:36 am
Forum: Q/A
Topic: REPEAT (a number of time - variable depending)
Replies: 1
Views: 6588

Re: REPEAT (a number of time - variable depending)

Another explanation :

- I navigate to a specific URL
- I extract one value VAL
- I want to calculate a number using this value, like newVAL = INT(VAL/20)+1
- I want now to begin a loop using this new value, like :

Repeat (newVAL) > do this, extract that > do loop till end

any idea ?
by jafuli
Fri Aug 19, 2016 12:48 pm
Forum: Q/A
Topic: REPEAT (a number of time - variable depending)
Replies: 1
Views: 6588

REPEAT (a number of time - variable depending)

Hi all !

I need to run a repeat loop, but the number of iteration is variable : ideally, I should get this number from a specific table.
Something like:
DataTable (URL to scrape from - nb of iteration)

Any idea of how to to that ?

Thank you !
by jafuli
Thu Aug 27, 2015 3:16 pm
Forum: Q/A
Topic: Helium + TOR ?
Replies: 0
Views: 17308

Helium + TOR ?

Hi all !

is it possible to use Helium Scraper while on TOR network ?

If I give the right (proxy + SOCKS) parameters to Internet Explorer, would that work ?

Thank you !
by jafuli
Tue Apr 30, 2013 8:33 pm
Forum: Q/A
Topic: Selecting an object which appears only when the mouse is on
Replies: 0
Views: 2998

Selecting an object which appears only when the mouse is on

I have a site which show some data only when the mouse is above a specific area (onmouseover). And I want to select a URL in these data. And the roll-over effect work inside Helium only when the select tool is NOT selected. Well ... I am sure you understand the question ... (like it would be cool to...
by jafuli
Tue Apr 02, 2013 7:43 pm
Forum: Q/A
Topic: Running several projects at once ...
Replies: 1
Views: 1782

Running several projects at once ...

Hi all ... I have several B2B directories I want to scrape data from. It is easy to do on a directory by directory basis, but each project is quite different from one another. How could I run all these projects at once (I don't necessarily care about having parallel processes, etc), and ideally havi...
by jafuli
Mon Apr 02, 2012 1:30 pm
Forum: Q/A
Topic: Number of repeat
Replies: 1
Views: 1323

Number of repeat

I have the following situation : (classical beginning) a web page showing 50 links to specific data sheet I navigate to each of the data sheet some data to scrape there, and one multi layered chart with data in it. You go to the next layer by clicking a link (http://WWW.html#) depending on the data ...
by jafuli
Wed Mar 28, 2012 10:23 am
Forum: Feedback
Topic: WAIT : random suggestion
Replies: 4
Views: 5273

Re: WAIT : random suggestion

cool ... thanx ... will integrate that quickly.
by jafuli
Thu Mar 22, 2012 8:47 am
Forum: Feedback
Topic: WAIT : random suggestion
Replies: 4
Views: 5273

Re: WAIT : random suggestion

some websites react badly when you scrape them with a very regular pattern. It's just some kind of camouflage.
by jafuli
Wed Mar 21, 2012 4:29 pm
Forum: Feedback
Topic: WAIT : random suggestion
Replies: 4
Views: 5273

WAIT : random suggestion

The WAIT action is useful but uses a fixed value ...
It could be interesting to be able to set the WAIT value to a random value (like, select random or fixed, if random, you select the MIN and MAX, in millisecond).

a few seconds of coding, a small improvement :)
by jafuli
Mon Mar 05, 2012 2:00 pm
Forum: Bug report
Topic: Memory/Resources problem with new version
Replies: 12
Views: 15538

Re: Memory/Resources problem with new version

I sent you a mail ... Also : I was able to get all the data by running the project twice, at two different points in the scrapped webpage (launching the software anew everytime). The error message comes after some time (I have some 475 links to scrap ; first pass blocks around 250, and it does not s...