Task 16341424

Name	hadam3p_eu_i2az_2013_1_008551691_0
Workunit	8699203
Created	5 Mar 2014, 16:41:51 UTC
Sent	7 Mar 2014, 19:33:30 UTC
Report deadline	18 Feb 2015, 0:53:30 UTC
Received	9 Mar 2014, 2:40:28 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	0 (0x00000000)
Computer ID	1242224
Run time	18 hours 19 min 13 sec
CPU time	17 hours 52 min 51 sec
Validate state	Invalid
Credit	1,194.02
Device peak FLOPS	5.39 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Europe v6.09 windows_intelx86
Stderr	<core_client_version>7.3.9</core_client_version> <![CDATA[ <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4032, selfPID=4032, iMonCtr=2 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5224, selfPID=5224, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Out Of Memory (C++ Exception) (0xe06d7363) at address 0x772FC41F Engaging BOINC Windows Runtime Debugger... ****************** BOINC Windows Runtime Debugger Version 6.13.0 Dump Timestamp : 03/09/14 03:01:56 Install Directory : Data Directory : H:\BOINC Project Symstore : LoadLibraryA( H:\BOINC\dbghelp.dll ): GetLastError = 126 Loaded Library : dbghelp.dll LoadLibraryA( H:\BOINC\symsrv.dll ): GetLastError = 126 LoadLibraryA( symsrv.dll ): GetLastError = 126 LoadLibraryA( H:\BOINC\srcsrv.dll ): GetLastError = 126 LoadLibraryA( srcsrv.dll ): GetLastError = 126 LoadLibraryA( H:\BOINC\version.dll ): GetLastError = 126 Loaded Library : version.dll Debugger Engine : 4.0.5.0 Symbol Search Path: H:\BOINC\projects\climateprediction.net\hadam3p_eu_i2az_2013_1_008551691;H:\BOINC\projects\climateprediction.net ModLoad: 00340000 008d3000 H:\BOINC\projects\climateprediction.net\hadrm3p_eu_um_6.09_windows_intelx86.exe (-nosymbols- Symbols Loaded) Linked PDB Filename : d:\cpdn\cpdnboinc\cpdnprecis\test\projects\reqs.comlab.ox.ac.uk_cpdn\hadrm3p_eu_um_6.09_windows_intelx86.pdb ModLoad: 77b70000 00180000 C:\Windows\SysWOW64\ntdll.dll (6.1.7601.18247) (-exported- Symbols Loaded) Linked PDB Filename : wntdll.pdb File Version : 6.1.7600.16385 (win7_rtm.090713-1255) Company Name : Microsoft Corporation Product Name : Système dexploitation Microsoft® Windows® Product Version : 6.1.7600.16385 ModLoad: 76f20000 00110000 C:\Windows\syswow64\kernel32.dll (6.1.7601.18229) (-exported- Symbols Loaded) Linked PDB Filename : wkernel32.pdb File Version : 6.1.7601.18229 (win7sp1_gdr.130801-1533) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.1.7601.18229 ModLoad: 772f0000 00047000 C:\Windows\syswow64\KERNELBASE.dll (6.1.7601.18229) (-exported- Symbols Loaded) Linked PDB Filename : wkernelbase.pdb File Version : 6.1.7601.18229 (win7sp1_gdr.130801-1533) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.1.7601.18229 ModLoad: 75650000 00100000 C:\Windows\syswow64\USER32.dll (6.1.7601.17514) (-exported- Symbols Loaded) Linked PDB Filename : wuser32.pdb File Version : 6.1.7601.17514 (win7sp1_rtm.101119-1850) Company Name : Microsoft Corporation Product Name : Système dexploitation Microsoft® Windows® Product Version : 6.1.7601.17514 ModLoad: 76640000 00090000 C:\Windows\syswow64\GDI32.dll (6.1.7601.18275) (-exported- Symbols Loaded) Linked PDB Filename : wgdi32.pdb File Version : 6.1.7601.18275 (win7sp1_gdr.131002-1533) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.1.7601.18275 ModLoad: 77b40000 0000a000 C:\Windows\syswow64\LPK.dll (6.1.7601.18177) (-exported- Symbols Loaded) Linked PDB Filename : wlpk.pdb File Version : 6.1.7601.18177 (win7sp1_gdr.130605-1534) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.1.7601.18177 ModLoad: 76760000 0009d000 C:\Windows\syswow64\USP10.dll (1.626.7601.18009) (-nosymbols- Symbols Loaded) Linked PDB Filename : usp10.pdb File Version : 1.0626.7601.18009 (win7sp1_gdr.121121-1431) Company Name : Microsoft Corporation Product Name : Microsoft(R) Uniscribe Unicode script processor Product Version : 1.0626.7601.18009 ModLoad: 76dd0000 000ac000 C:\Windows\syswow64\msvcrt.dll (7.0.7601.17744) (-nosymbols- Symbols Loaded) Linked PDB Filename : msvcrt.pdb File Version : 7.0.7601.17744 (win7sp1_gdr.111215-1535) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 7.0.7601.17744 ModLoad: 76e80000 000a0000 C:\Windows\syswow64\ADVAPI32.dll (6.1.7601.18247) (-nosymbols- Symbols Loaded) Linked PDB Filename : advapi32.pdb File Version : 6.1.7601.18247 (win7sp1_gdr.130828-1532) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.1.7601.18247 * Dump of the Process Statistics: * - I/O Operations Counters - Read: 0, Write: 0, Other 0 - I/O Transfers Counters - Read: 0, Write: 0, Other 0 - Paged Pool Usage - QuotaPagedPoolUsage: 0, QuotaPeakPagedPoolUsage: 0 QuotaNonPagedPoolUsage: 0, QuotaPeakNonPagedPoolUsage: 0 - Virtual Memory Usage - VirtualSize: 0, PeakVirtualSize: 0 - Pagefile Usage - PagefileUsage: 0, PeakPagefileUsage: 0 - Working Set Size - WorkingSetSize: 0, PeakWorkingSetSize: 0, PageFaultCount: 0 * Dump of thread ID 4972 (state: Initialized): * - Information - Status: Base Priority: Normal, Priority: Normal, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 0.000000 - Unhandled Exception Record - Reason: Out Of Memory (C++ Exception) (0xe06d7363) at address 0x772FC41F - Registers - eax=110ef70c ebx=7efde000 ecx=00000003 edx=00000000 esi=007c4e48 edi=00000000 eip=772fc41f esp=110ef70c ebp=110ef75c cs=0023 ss=002b ds=002b es=002b fs=0053 gs=002b efl=00000206 - Callstack - ChildEBP RetAddr Args to Child 110ef75c 00661793 e06d7363 00000001 00000003 110ef788 KERNELBASE!RaiseException+0x0 110ef794 0065e9b5 110ef7a4 006fcee0 006ce0dc 006f9214 hadrm3p_eu_um_6.09_windows_inte!+0x0 110ef7b0 00348322 01000000 0034985b 00000000 0069b3f4 hadrm3p_eu_um_6.09_windows_inte!+0x0 110ef80c 00660893 00000002 12e51b10 12e51b98 fcbad51c hadrm3p_eu_um_6.09_windows_inte!+0x0 110ef854 76f3336a 7efde000 110ef8a0 77ba9f72 7efde000 hadrm3p_eu_um_6.09_windows_inte!+0x0 110ef860 77ba9f72 7efde000 72ff489c 00000000 00000000 kernel32!BaseThreadInitThunk+0x0 110ef8a0 77ba9f45 006608ea 7efde000 00000000 00000000 ntdll!RtlInitializeExceptionChain+0x0 110ef8b8 00000000 006608ea 7efde000 00000000 00000000 ntdll!RtlInitializeExceptionChain+0x0 * Dump of thread ID 3860 (state: Initialized): * - Information - Status: Base Priority: Normal, Priority: Normal, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 0.000000 - Registers - eax=005eb2e0 ebx=00000000 ecx=00000000 edx=00000000 esi=3518fb14 edi=00000000 eip=77b8fd91 esp=3518fad0 ebp=3518fb38 cs=0023 ss=002b ds=002b es=002b fs=0053 gs=002b efl=00000246 - Callstack - ChildEBP RetAddr Args to Child 3518fb38 77304498 00000064 00000000 3518fb54 005eb2f4 ntdll!ZwDelayExecution+0x0 3518fb48 005eb2f4 00000064 3518fb60 76f3336a 00000000 KERNELBASE!Sleep+0x0 3518fb54 76f3336a 00000000 3518fba0 77ba9f72 00000000 hadrm3p_eu_um_6.09_windows_inte!+0x0 3518fb60 77ba9f72 00000000 56e94b9c 00000000 00000000 kernel32!BaseThreadInitThunk+0x0 3518fba0 77ba9f45 005eb2e0 00000000 00000000 00000000 ntdll!RtlInitializeExceptionChain+0x0 3518fbb8 00000000 005eb2e0 00000000 00000000 00000000 ntdll!RtlInitializeExceptionChain+0x0 * Debug Message Dump ** * Foreground Window Data *** Window Name : Window Class : Window Process ID: 0 Window Thread ID : 0 Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=7304, selfPID=2344, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Called boinc_finish </stderr_txt> <message> upload failure: <file_xfer_error> <file_name>hadam3p_eu_i2az_2013_1_008551691_0_7.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_eu_i2az_2013_1_008551691_0_8.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_eu_i2az_2013_1_008551691_0_9.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_eu_i2az_2013_1_008551691_0_10.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_eu_i2az_2013_1_008551691_0_11.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_eu_i2az_2013_1_008551691_0_12.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> </message> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
08 Mar 2014 20:36:58	1242224	16341424	hadam3p_eu_i2az_2013_1_008551691_0	69,216	62,416	0.9018
08 Mar 2014 17:49:48	1242224	16341424	hadam3p_eu_i2az_2013_1_008551691_0	57,696	52,028	0.9018
08 Mar 2014 12:10:55	1242224	16341424	hadam3p_eu_i2az_2013_1_008551691_0	46,176	41,797	0.9052
08 Mar 2014 06:09:07	1242224	16341424	hadam3p_eu_i2az_2013_1_008551691_0	34,656	31,395	0.9059
08 Mar 2014 02:48:01	1242224	16341424	hadam3p_eu_i2az_2013_1_008551691_0	23,136	20,893	0.9031
07 Mar 2014 23:51:46	1242224	16341424	hadam3p_eu_i2az_2013_1_008551691_0	11,616	10,541	0.9075