Task 19136537

Name	hadam3p_pnw_xjd3_200912_12_010215239_1
Workunit	10215239
Created	6 Dec 2015, 3:49:04 UTC
Sent	6 Dec 2015, 3:49:45 UTC
Report deadline	17 Nov 2016, 9:09:45 UTC
Received	8 Dec 2015, 13:50:21 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	0 (0x00000000)
Computer ID	1328863
Run time	1 days 10 hours 51 min 14 sec
CPU time	1 days 9 hours 53 min 7 sec
Validate state	Invalid
Credit	256.81
Device peak FLOPS	1.25 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Pacific North West v7.27 windows_intelx86
Stderr	<core_client_version>7.6.9</core_client_version> <![CDATA[ <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3564, selfPID=3564, iMonCtr=2 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Unhandled ExcUnhandled Exception Detected... - Unhandled Exception Record - Reason: Out Of Memory (C++ Exception) (0xe06d7363) at address 0x7C81EB33 Engaging BOINC Windows Runtime Debugger... ****************** BOINC Windows Runtime Debugger Version 7.5.1 Dump Timestamp : 12/08/15 04:13:26 Install Directory : C:\Program Files\BOINC\ Data Directory : C:\Documents and Settings\All Users\Application Data\BOINC Project Symstore : eption Detected... - Unhandled Exception Record - Reason: Out Of Memory (C++ Exception) (0xe06d7363) at address 0x7C81EB33 Engaging BOINC Windows Runtime Debugger... **************** BOINC Windows Runtime Debugger Version 7.5.1 Dump Timestamp : 12/08/15 04:13:26 Install Directory : C:\Program Files\BOINC\ Data Directory : C:\Documents and Settings\All Users\Application Data\BOINC Project Symstore : LoadLibraryA( C:\Program Files\BOINC\\dbghelp.dll ): GetLastError = 126 s\BOINC\\dbghelp.dll ): GetLastError = 126 Loaded Library : dbghelp.dll LoadLibraryA( C:\Program Files\BOINC\\symsrv.dll ): GetLastError = 126 oaded Library : dbghelp.dll LoadLibraryA( C:\Program Files\BOINC\\symsrv.dll ): GetLastError = 126 LoadadLibraryA( symsrv.dll ): GetLastError = 12 6 LoadLibraryA( C:\Program FileB\BOINC\\srcsrv.dll ): GetLastError = 126 OINC\\srcsrv.dll ): GetLastError = 126 LoadLibraryA( srcsrv.dll ): GetLastError = 126 LoadLibraryA( C:\Program Files\BOINC\\version.dll ): GetLastError = 126 Loaded Library : version.dll oadLibraryA( srcsrv.dll ): GetLastError = 126 LoadLibraryA( C:\Program Files\BOINC\\version.dll ): GetLastError = 126 Loaded Library : version.dll Debugger Engine : 4.0.5.0 Symbol Search Path: C:\Documents and Settings\All Users\Application Data\BOINC\projects\climateprediction.net\hadam3p_pnw_xjd3_200912_12_01021523D;C:\Documents and Settings\All Users\Application Data\BOINC\projects\climateprediction.net SymGetModuleInfo(): GetLastError = 87 ugger Engine : 4.0.5.0 Symbol Search Path: C:\Documents and Settings\All Users\Application Data\BOINC\projects\climateprediction.net\hadam3p_pnw_xjd3_200912_12_010215239;C:\Documents and Settings\All Users\Application Data\BOINC\projects\climateprediction.net SymGetModuleInfo(): GetLastError = 87 ModLoad: 000000000M00dLoad: 0000000000000000 0000000000000000 ( Symbols Loaded) Linked PDB Filename : SymGetModuleInfo(): GetLastError = 87 0000 0000000000000000 ( Symbols Loaded) Linked PDB Filename : SymGetModuleInfo(): GetLastError = 87 ModLoad: 0000000000000000 0000000000000000 ( Symbols Loaded) Linked PDB Filename : SymGetModuleInfo(): GetLastError = 87 ModLoad: 0000000000000000 0000000000000000 ( Symbols Loaded) Linked PDB Filename : SymGetModuleInfo(): GetLastError = 87 ModLoad: 0000000000000000 0000000000000000 ( Symbols Loaded) Linked PDB Filename : SymGetModuleInfo(): GetLastError = 87 ModLoad: 0000000000000000 0000000000000000 ( Symbols Loaded) Linked PDB Filename : SymGetModuleInfo(): GetLastError = 87 ModLoad: 0000000000000000 0000000000000000 ( Symbols Loaded) Linked PDB Filename : SymGetModuleInfo(): GetLastError = 87 ModLoad: 0000000000000000 0000000000000000 ( Symbols Loaded) Linked PDB Filename : SymGetModuleInfo(): GetLastError = 87 ModLoad: 0000000000000000 0000000000000000 ( Symbols Loaded) Linked PDB Filename : SymGetModuleInfo(): GetLastError = 87M odLoad: 0000000000000000 0000000000000000 ( Symbols Loaded) Linked PDB Filename : SymGetModuleInfo(): GetLastError = 87 ModLoad: 0000000000000000 0000000000000000 ( Symbols Loaded) Linked PDB Filename : SymGetModuleInfo(): GeModLoad: 000087 000000000000 0000000000000000 ( Symbols Loaded) Linked PDB Filename : SymGetModuleInfo(): GetLastError = 87 ModLoad: 0000000000000000 0000000000000000 ( Symbols Loaded) Linked PDB Filename : SymGetModuleInfo(): GetLastError = 87 ModLoad: 0000000000000000 0000000000000000 ( Symbols Loaded) Linked PDB Filename : SymGetModuleInfo(): GetLastError = 87 ModLoad: 0000000000000000 0000000000000000 ( Symbols Loaded) Linked PDB Filename : SymGetModuleInfo(): GetLastError = 87 ModLoad: 0000000000000000 0000000000000000 ( Symbols Loaded) Linked PDB Filename : SymGetModuleInfo(): GetLastError = 87 ModLoad: 0000000000000000 0000000000000000 ( Symbols Loaded) Linked PDB Filename : SymGetModuleInfo(): GetLastError = 87 nked PDB Filename : SymGetModuleInfo(): GetLastError = 87 ModLoad: 0000000000000000 0000000000000000 ( Symbols Loaded) LinkedodLoad: 0000000000000000 0000000000000000 ( Symbols Loaded) Linked PDB Filen mDB Filename : SymGetModuleInfo(): GetLastError = 87 e : SymGetModuleInfo(): GetLastError = 87 ModLoad: 0000000000000000 0000000000000000 ( Symbols LoadedM Linked PDB Filename : SymGetModuleInfo(): GetLastError = 87 odLoad: 0000000000000000 0000000000000000 ( Symbols Loaded) Linked PDB Filename : SymGetModuleInfo(): GetLastError = 87 ModLoad: 0000000000000000 0000000000000000 ( Symbols Loaded) Linked PDB Filename : * Dump of the ProceModLoad: 0000000000000000 0000000000000000 ( Symbols Loaded) Linked PDB Filename : * Dump of the Process Statistics: * - I/O Operations Counters - Read: 5, Write: 0, Other 186 - I/O Transfers Counters - Read: 0, Write: 66, Other 0 - Paged Pool Usage - QuotaPagedPoolUsage: 48800, QuotaPeakPagedPoolUsage: 48800 QuotaNonPagedPoolUsage: 1800, QuotaPeakNonPagedPoolUsage: 2480 - Virtual Memory Usage - VirtualSize: 942407680, PeakVirtualSize: 942407680 - Pagefile U age - PagefileUsage: 24481792, PeakPagefileStatist4cs: * - I/O Operations C005056 - Working Set Size - WorkingSetSize: 1073152, PeakWorkingSetSize: 1130496, PageFaultCount: 660 * Dump of thread ID 3732 (state: Waiting): * - Information - Status: Wait Reason: UserRequest, , Kernel Time: ounters - Read: 5, Write: 0, Other 186 - I/O Transfers Counters - Read: 0, Write: 66, Other 0 - Paged Pool Usage - QuotaPagedPoolUsage: 49000, QuotaPeakPagedPoolUsage: 49000 QuotaNonPagedPoolUsage: 1760, QuotaPeakNonPagedPoolUsage: 2480 - Virtual Memory Usage - VirtualSize: 925831168, PeakVirtualSize: 925831168 - Pagefile Usage - PagefileUsage: 7712768, PeakPagefileUsage: 24395776 - Working Set Size - WorkingSetSize: 958464, PeakWorkingSetSize: 1069056, PageFaultCount: 715 * Dump of thread ID 4056 (state: Ready): * - Information - Status: Base Priority: Above Normal, Priority: Above Normal, , Kernel Time: 781250.000000, User Time: 0.000000, Wait Time: 64974836.000000 - Unhandled Exception Record - Reason: Out Of Memory (C++ Exception) (0xe06d7363) at address 0x7C81EB33 - Registers - eax=1241fa6c ebx=00000000 ecx=00000000 edx=00893298 esi=1241faf4 edi=00892840 eip=7c81eb33 esp=1241fa68 ebp=1241fabc cs=001b ss=0023 ds=0023 es=0023 fs=003b gs=0000 efl=00000206 - Callstack - ChildEBP RetAddr Args to Child 312500.000000, User Time: 0.000000, Wait Time: 64974836.000000 - Unhandled Exception Record - Reason: Out Of Memory (C++ Exception) (0xe06d7363) at address 0x7C81EB33 - Registers - eax=123dfa58 ebx=7ffd9000 ecx=00000000 edx=0085fba0 esi=123dfae0 edi=0085f148 eip=7c81eb33 esp=123dfa54 ebp=123dfaa8 cs=001b ss=0023 ds=0023 es=0023 fs=003b gs=0000 efl=00000206 - Callstack - ChildEBP RetAddr Args to Child 1241fabc 0073e2e7 e06d7363 00000001 00000003 1241fae8 !RaiseException+0x0 SymGetModuleInfo(): GetLastError = '87' Address = '7c81eb33' 1241faf4 0073b492 1241fb04 007b32b4 00796770 007ab38c !+0x0 SymGetModuleInfo(): GetLastError = '87' Address = '0073e2e7' 1241fb14 00409382 01000000 00052311 00052395 000523ba !+0x0 SymGetModuleInfo(): GetLastError = '87' Address = '0073b492' 1241ff30 0073d1ea 00400000 00000000 00052395 0000000a !+0x0 SymGetModuleInfo(): GetLastError = '87' Address = '00409382' 1241ffc0 7c816d4f 23dfaa8 00710a97 7ffdf000 e06d7363 !+0x0 SymGetModuleInfo(): GetLastError = '87' Address = '0073d1ea' 1241fff0 00000000 0073d23d 00000000 00000000 00000000 !RegisterWaitForInputIdle+0x0 SymGetModuleInfo(): GetLastError = '87' Address = '7c816d4f' * Dump of thread ID 2328 (state: Waiting): * - Information - Status: Wait Reason: ExecutionDelay, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 64974832.000000 e06d7isters - ea3=3 00000001 00000003 123dfad4 !RaiseException+0x0 SymGetModuleInfo(): GetLastError = '87' Address = '7c81eb33' 123dfae0 0070dc42 123dfaf0 00785bf4 007690b0 0077dd2c !+0x0 SymGetModuleInfo(): GetLastError = '87' Address = '00710a97' 123dfb00 00408271 00fd9f80 01000000 00407b49 128f0000 !+0x0 SymGetModuleInfo(): GetLastError = '87' 000012 ebx=00000000 ecx=0000000a edx=00000008 esi=00000000 edi=36effd4c eip=7c90eb94 esp=36effd1c ebp=36effd74 cs=001b ss=0023 ds=0023 es=0023 fs=003b gs=0000 efl=00000202 - Callstack - ChildEBP RetAddr Args to Child 36effd74 7c802451 00000064 00000000 36efffb4 006c26a4 !KiFastSystemCallRet+0x0 SymGetModuleInfo(): GetLastError = '87' Address = '7c90eb94' 36effd84 006c26a4 00000064 00346b38 626f6c47 00000000 !Sleep+0x0 SymGetModuleInfo(): GetLastError = '87' Address = '7c802451' 36efffb4 7c80b50b 00000000 00346b38 626f6c47 00000000 !+0x0 SymGetModuleInfo(): GetLastError = '87' Address = '006c26a4' 36efffec 00000000 006c2680 00000000 00000000 000000c8 070dc42' 123dff30 0070fa6d 00400000 00000000 00052395 0000000a !+0x0 SymGetModuleInfo(): GetLastError = '87' Address = '00408271' 123dffc0 7c816d4f 7c90253a 0012f424 7ffd9000 e06d7363 !+0x0 SymGetModuleInfo(): GetLastError = '87' Address = '0070fa6d' 123dfff0 00000000 0070fac0 00000000 00000000 00000000 !RegisterWaitForInputIdle+0x0 SymGetModuleInfo(): GetLastError = '87' Address = '7c816d4f' * Dump of thread ID 2612 (state: Waiting): * - Information - Status: Wait Reason: ExecutionDelay, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 64974836.000000 -!GetModuleFileNameA+0x0 SymGetModuleInfo(): GetLastError = sters - eax=36ebfd38 ebx=000087' Address = '7c80b5=00000000 esi=00000000 edi=36ebfd4c eip=7c90eb94 esp=36ebfd1c ebp=36ebfd74 cs=001b ss=0023 ds=0023 es=0023 fs=003b gs=0000 efl=00000202 - Callstack - ChildEBP RetAddr Args to Child 36ebfd74 7c802451 00000064 00000000 36ebffb4 006927c4 !KiFastSystemCallRet+0x0 SymGetModuleInfo(): GetLastError = '87' Address = '7c90eb94' 36ebfd84 006927c4 00000064 00346468 626f6c47 00000000 !Sleep+0x0 SymGetModuleInfo(): GetLastError = '87' Address = '7c802451' 36ebffb4 7c80b50b 00000000 00346468 626f6c47 00000000 !+0x0 SymGetModuleInfo(): GetLastError = '87' Address = '006927c4' 36ebffec 00000000 006927a0 00000000 00000000 00300' * Debug Message Dump ** * Foreground Window Data * Window Name : Window Class : Window Process ID: 0 Window Thread ID : 0 Exiting... 050 !GetModuleFileNameA+0x0 SymGetModuleInfo(): GetLastError = '87' Address = '7c80b50b' * Debug Message Dump ** * Foreground Window Data *** Window Name : Window Class : Window Process ID: 0 Window Thread ID : 0 Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2152, selfPID=600, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... 04:15:09 (600): called boinc_finish(0) </stderr_txt> <message> upload failure: <file_xfer_error> <file_name>hadam3p_pnw_xjd3_200912_12_010215239_1_2.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_pnw_xjd3_200912_12_010215239_1_3.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_pnw_xjd3_200912_12_010215239_1_4.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_pnw_xjd3_200912_12_010215239_1_5.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_pnw_xjd3_200912_12_010215239_1_6.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_pnw_xjd3_200912_12_010215239_1_7.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_pnw_xjd3_200912_12_010215239_1_8.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_pnw_xjd3_200912_12_010215239_1_9.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_pnw_xjd3_200912_12_010215239_1_10.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_pnw_xjd3_200912_12_010215239_1_11.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_pnw_xjd3_200912_12_010215239_1_12.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> </message> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
07 Dec 2015 17:27:53	1328863	19136537	hadam3p_pnw_xjd3_200912_12_010215239_1	11,819	87,802	7.4289