Crashes

[jley]

I'm experiencing crashes. I think all is going fine until about 300 items are in the database, then Helium stops responding. I'm not sure about the 300 items - I've just seen roughly this number 2x when I had refreshed the window prior to the crash. This happens when I don't refresh (or even look at the data table as well). I'm attempting to collect a database of about 6/7 thousand, so I start the collection and go do other stuff - then come back to find a Windows error box:

"Helium Scraper has stopped working. A problem caused the program to stop working correctly. Windows will close the program and notify you if a solution is available."

The collected data is not saved. I'm running Windows 7 Enterprise 64-bit SP1 on an AMD Athlon 64 X2 5200+ with 4G of RAM.

[jley]

More crash info from system logs:

Faulting application name: Helium Scraper.exe, version: 2.0.3.8, time stamp: 0x4e4e2621
Faulting module name: KERNELBASE.dll, version: 6.1.7601.17651, time stamp: 0x4e211319
Exception code: 0xe0434352
Fault offset: 0x0000b9bc
Faulting process id: 0x22f4
Faulting application start time: 0x01cc81058d952c96
Faulting application path: C:\Users\Jim\AppData\Local\Apps\2.0\E0KZVMV3.10M\63W34TYD.8X6\heli..tion_396408bb93e86a68_0002.0000_754ffe2ad893335c\Helium Scraper.exe
Faulting module path: C:\Windows\syswow64\KERNELBASE.dll
Report Id: ac648aec-ecfe-11e0-a38d-00accafd0e61

-------------------------

Faulting application name: Helium Scraper.exe, version: 2.0.3.8, time stamp: 0x4e4e2621
Faulting module name: unknown, version: 0.0.0.0, time stamp: 0x00000000
Exception code: 0xc0000005
Fault offset: 0x837761e6
Faulting process id: 0x10e4
Faulting application start time: 0x01cc80b04813860a
Faulting application path: C:\Users\Jim\AppData\Local\Apps\2.0\E0KZVMV3.10M\63W34TYD.8X6\heli..tion_396408bb93e86a68_0002.0000_754ffe2ad893335c\Helium Scraper.exe
Faulting module path: unknown
Report Id: 0c528d9f-ecb6-11e0-a38d-00accafd0e61

------------------------

Faulting application name: Helium Scraper.exe, version: 2.0.3.8, time stamp: 0x4e4e2621
Faulting module name: unknown, version: 0.0.0.0, time stamp: 0x00000000
Exception code: 0xc0000005
Fault offset: 0xfa5a592f
Faulting process id: 0x2110
Faulting application start time: 0x01cc80aba8d60f59
Faulting application path: C:\Users\Jim\AppData\Local\Apps\2.0\E0KZVMV3.10M\63W34TYD.8X6\heli..tion_396408bb93e86a68_0002.0000_754ffe2ad893335c\Helium Scraper.exe
Faulting module path: unknown
Report Id: 5891c9e0-eca3-11e0-a38d-00accafd0e61

----------------------

Faulting application name: Helium Scraper.exe, version: 2.0.3.8, time stamp: 0x4e4e2621
Faulting module name: KERNELBASE.dll, version: 6.1.7601.17651, time stamp: 0x4e211319
Exception code: 0xe06d7363
Fault offset: 0x0000b9bc
Faulting process id: 0x1f80
Faulting application start time: 0x01cc7bef49eb80d0
Faulting application path: C:\Users\Jim\AppData\Local\Apps\2.0\E0KZVMV3.10M\63W34TYD.8X6\heli..tion_396408bb93e86a68_0002.0000_754ffe2ad893335c\Helium Scraper.exe
Faulting module path: C:\Windows\syswow64\KERNELBASE.dll
Report Id: 0e696184-e7e6-11e0-adcc-00accafd0e61

[webmaster]

Hi,

This is, almost 100% sure, an out of memory error. It's been reported to happen on Manta and a few other sites, and per your other posts I know you've been working with Manta. There seems to be a solution (have not been fully tested but so far it worked) which involves installing IE9 and doing a small change on the registry. This will be done automatically in the next update, but for now can be done manually.

All it does is set Helium Scraper to use the IE9 component when IE9 is installed. Let me know if you wish to make these changes and I'll send you detailed instructions on how to update your registry after IE9 has been installed.

[jley]

Juan,
IE9 installed now. Let me know what tweaks need to happen and I'll give that a try.

Thanks,
Jim

[webmaster]

Hi,

Here is the change that needs to be done to the registry:

1. Click Start -> Run.
2. Type regedit and press OK.
3. Navigate to the "HKEY_CURRENT_USER\Software\Microsoft\Internet Explorer\Main\FeatureControl\FEATURE_BROWSER_EMULATION" folder from the left panel.
4. Make sure the "FEATURE_BROWSER_EMULATION" folder is selected, and from the main menu, go to Edit -> New -> DWORD (32-bit) Value.
5. Rename the new value added to Helium Scraper.exe.
6. Double click Helium Scraper.exe.
7. Select the Decimal base.
8. Set the Value data to 9000 and press OK.

[jley]

After installing IE9 and making the registry changes I have the following errors. If this kind of feedback is helpful, I'll continue to post - let me know. Otherwise, my reply is the fix didn't work.


Event 1000, Applicaion Error:
Faulting application name: Helium Scraper.exe, version: 2.0.3.8, time stamp: 0x4e4e2621
Faulting module name: unknown, version: 0.0.0.0, time stamp: 0x00000000
Exception code: 0xc0000005
Fault offset: 0xb0036acb
Faulting process id: 0x928
Faulting application start time: 0x01cc823658757724
Faulting application path: C:\Users\Jim\AppData\Local\Apps\2.0\E0KZVMV3.10M\63W34TYD.8X6\heli..tion_396408bb93e86a68_0002.0000_754ffe2ad893335c\Helium Scraper.exe
Faulting module path: unknown
Report Id: 861f6a8a-ee31-11e0-bf7f-00accafd0e61

Details:
- System

- Provider

[ Name] Application Error

- EventID 1000

[ Qualifiers] 0

Level 2

Task 100

Keywords 0x80000000000000

- TimeCreated

[ SystemTime] 2011-10-04T02:35:30.000000000Z

EventRecordID 44620

Channel Application

Computer Jim-Desktop

Security


- EventData

Helium Scraper.exe
2.0.3.8
4e4e2621
unknown
0.0.0.0
00000000
c0000005
b0036acb
928
01cc823658757724
C:\Users\Jim\AppData\Local\Apps\2.0\E0KZVMV3.10M\63W34TYD.8X6\heli..tion_396408bb93e86a68_0002.0000_754ffe2ad893335c\Helium Scraper.exe
unknown
861f6a8a-ee31-11e0-bf7f-00accafd0e61


And then:
Event ID 1001 Windows Error Reporting:
General Description:
Fault bucket 2395631753, type 5
Event Name: BEX
Response: Not available
Cab Id: 0

Problem signature:
P1: Helium Scraper.exe
P2: 2.0.3.8
P3: 4e4e2621
P4: StackHash_df79
P5: 0.0.0.0
P6: 00000000
P7: b0036acb
P8: c0000005
P9: 00000008
P10:

Attached files:
C:\Users\Jim\AppData\Local\Temp\WERA0DF.tmp.WERInternalMetadata.xml

These files may be available here:
C:\Users\Jim\AppData\Local\Microsoft\Windows\WER\ReportArchive\AppCrash_Helium Scraper.e_16a77625f63f4451f13fdb0e45f514960dcd5b_0e71e5c8

Analysis symbol:
Rechecking for solution: 0
Report Id: 861f6a8a-ee31-11e0-bf7f-00accafd0e61

Details
- System

- Provider

[ Name] Windows Error Reporting

- EventID 1001

[ Qualifiers] 0

Level 4

Task 0

Keywords 0x80000000000000

- TimeCreated

[ SystemTime] 2011-10-04T02:35:48.000000000Z

EventRecordID 44621

Channel Application

Computer Jim-Desktop

Security


- EventData

2395631753
5
BEX
Not available
0
Helium Scraper.exe
2.0.3.8
4e4e2621
StackHash_df79
0.0.0.0
00000000
b0036acb
c0000005
00000008

C:\Users\Jim\AppData\Local\Temp\WERA0DF.tmp.WERInternalMetadata.xml
C:\Users\Jim\AppData\Local\Microsoft\Windows\WER\ReportArchive\AppCrash_Helium Scraper.e_16a77625f63f4451f13fdb0e45f514960dcd5b_0e71e5c8

0
861f6a8a-ee31-11e0-bf7f-00accafd0e61
0

[webmaster]

Hi,

Thanks for your feedback. Unfortunately, that log doesn't tell me much. Do you get a "Send error" window with the button "View Report"? If so, the file that opens when you click on the "View Report" button could help me identify the problem.

Also, would you mind looking at your task manager to see how much memory is Helium Scraper using?

[jley]

With respect to the error, that's the total of what I get. No option to send and no details available.

On loading without an project, HS settles in at 47.440K. Loading the project previously discussed brings it to 65,008k. Running that project uses between 30 and 65% of the processing available while the memory (Private Working Set) continues to climb with each new page load and processing. I'm watching this as I type and can see where it's heading - at the moment it's at 1,856,000K and rising.

An interesting side note - no idea if it's related - Firefox memory usage is also steadily climbing - not nearly as fast, but almost as steadily as Helium. It's 203,800K at the moment. This one does give up some memory usage from time to time, but not much. All that's happening (that I can see) in Firefox is I've got the HS board open I'm typing this reply in - just one tab.

I looked away to type here and when I looked back at the task manager, I found that HS had given up almost half it's memory usage - we're now back down to 1,050,000K, but climbing again.

I opened the data table being collected and hit the refresh button. HS errored out with the previously described error - with 1,333,128K of memory in use.

I will download the new version that I see is available this AM and see if that makes a difference.

[webmaster]

Hi,

Thank you for the detailed information. Are you using the Manta project I sent you untouched? If not, would you mind sending me your project so I can reproduce here?

[jley]

I was not using the project you sent untouched because for some reason that project was collecting only one kind (Company) in the database. (That is true even now - I just downloaded it again to test.) The information I sent you in the previous post reflected Kinds that I'd modified so they were working. I've been messing with it so much now I don't know what exact version of the project I was using this AM when I sent that info. I have NOT downloaded the new version of HS as yet, but I'm wondering if that might be the thing to do. If you want me to keep the prior version installed and retest let me know. If not, I'll grab the latest and document issues that arise (if any) for you.

Jim