Task 15156876

Name	hadam3p_eu_98ka_1973_1_008158238_0
Workunit	8313362
Created	20 Aug 2012, 12:22:38 UTC
Sent	20 Aug 2012, 12:39:01 UTC
Report deadline	2 Aug 2013, 17:59:01 UTC
Received	30 Aug 2012, 8:11:47 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	0 (0x00000000)
Computer ID	1233288
Run time	1 days 20 hours 30 min 2 sec
CPU time	1 days 18 hours 59 min 35 sec
Validate state	Invalid
Credit	399.11
Device peak FLOPS	1.51 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Europe v6.09 windows_intelx86
Stderr	<core_client_version>7.0.28</core_client_version> <![CDATA[ <stderr_txt> diagnostics_init_unhandled_exception_monitor(): Creating hExceptionMonitorThread failed, errno 12 WARNING: BOINC Windows Runtime Debugger has been disabled. diagnostics_init_unhandled_exception_monitor(): Creating hExceptionMonitorThread failed, errno 12 WARNING: BOINC Windows Runtime Debugger has been disabled. 15:19:26 (3476): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... diagnostics_init_unhandled_exception_monitor(): Creating hExceptionMonitorThread failed, errno 12 WARNING: BOINC Windows Runtime Debugger has been disabled. 15:20:28 (5984): start_timer_thread(): CreateThread() failed, errno 0 Suspended CPDN Monitor - Suspend request from BOINC... 18:18:03 (5248): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... 18:18:05 (5248): No heartbeat from core client for 30 sec - exiting 02:54:56 (1984): start_timer_thread(): CreateThread() failed, errno 0 03:13:57 (4800): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... diagnostics_init_unhandled_exception_monitor(): Creating hExceptionMonitorThread failed, errno 12 WARNING: BOINC Windows Runtime Debugger has been disabled. 03:15:01 (5080): start_timer_thread(): CreateThread() failed, errno 0 Suspended CPDN Monitor - Suspend request from BOINC... 06:12:33 (5112): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... 06:12:34 (5112): No heartbeat from core client for 30 sec - exiting 08:14:27 (5680): start_timer_thread(): CreateThread() failed, errno 0 Suspended CPDN Monitor - Suspend request from BOINC... 09:11:12 (4636): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... 09:11:13 (4636): No heartbeat from core client for 30 sec - exiting diagnostics_init_unhandled_exception_monitor(): Creating hExceptionMonitorThread failed, errno 12 WARNING: BOINC Windows Runtime Debugger has been disabled. 12:09:52 (4164): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:09:53 (4164): No heartbeat from core client for 30 sec - exiting diagnostics_init_unhandled_exception_monitor(): Creating hExceptionMonitorThread failed, errno 12 WARNING: BOINC Windows Runtime Debugger has been disabled. Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 15:08:32 (4556): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 18:07:12 (1596): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... 118::37:7:0 (2340):):ststrt_timer_thread(): CreateThrered(d( fafaled, ererno 0 rno 0 Suspended CPDN Monitor - Suspend request from BOINC... 21:05:57 (6088): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:06:59 (5476): start_timer_thread(): CreateThread() failed, errno 0 21:07:00 (5220): start_timer_thread(): CreateThread() failed, errno 0 Suspended CPDN Monitor - Suspend request from BOINC... 00:04:30 (4240): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:05:30 (2504): start_timer_thread(): CreateThread() failed, errno 0 00:05:30 (2520): start_timer_thread(): CreateThread() failed, errno 0 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 03:03:10 (5816): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... 03:03:11 (5816): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 06:01:50 (3092): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 09:00:28 (2180): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 11:59:10 (4572): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 14:57:46 (4040): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 17:56:29 (5420): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 20:55:07 (5832): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... diagnostics_init_unhandled_exception_monitor(): Creating hExceptionMonitorThread failed, errno 12 WARNING: BOINC Windows Runtime Debugger has been disabled. 21:07:06 (4436): start_timer_thread(): CreateThread() failed, errno 0 21:07:07 (4720): start_timer_thread(): CreateThread() failed, errno 0 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 23:53:43 (3112): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 02:52:22 (5296): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... 03:13:34 (6008): start_timer_thread(): CreateThread() failed, errno 0 03:13:34 (3036): start_timer_thread(): CreateThread() failed, errno 0 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 05:51:03 (2176): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 08:49:41 (2820): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:50:41 (2980): start_timer_thread(): CreateThread() failed, errno 0 08:50:41 (3916): start_timer_thread(): CreateThread() failed, errno 0 11:48:20 (5196): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:47:00 (4576): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:48:00 (3556): start_timer_thread(): CreateThread() failed, errno 0 14:48:00 (1792): start_timer_thread(): CreateThread() failed, errno 0 17:45:39 (3032): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:44:18 (5980): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5768, selfPID=5768, iMonCtr=2 diagnostics_init_unhandled_exception_monitor(): Creating hExceptionMonitorThread failed, errno 12 WARNING: BOINC Windows Runtime Debugger has been disabled. 20:45:15 (5776): start_timer_thread(): CreateThread() failed, errno 0 23:42:56 (5736): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:41:38 (5204): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 05:40:15 (4744): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... 14:36:09 (4156): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:37:26 (4300): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 10:42:01 (960): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... diagnostics_init_unhandled_exception_monitor(): Creating hExceptionMonitorThread failed, errno 12 WARNING: BOINC Windows Runtime Debugger has been disabled. 10:44:29 (3284): start_timer_thread(): CreateThread() failed, errno 0 10:44:30 (3508): start_timer_thread(): CreateThread() failed, errno 0 13:23:21 (3772): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:21:58 (3192): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:23:45 (668): start_timer_thread(): CreateThread() failed, errno 0 Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3416, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=668, selfPID=3168, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Suspended CPDN Monitor - Suspend request from BOINC... 12:30:54 (3156): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:35:20 (4056): start_timer_thread(): CreateThread() failed, errno 0 15:29:44 (2520): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:29:45 (2520): No heartbeat from core client for 30 sec - exiting 15:29:46 (2520): No heartbeat from core client for 30 sec - exiting 15:29:47 (2520): No heartbeat from core client for 30 sec - exiting diagnostics_init_unhandled_exception_monitor(): Creating hExceptionMonitorThread failed, errno 12 WARNING: BOINC Windows Runtime Debugger has been disabled. 15:33:24 (2964): start_timer_thread(): CreateThread() failed, errno 0 15:33:25 (332): start_timer_thread(): CreateThread() failed, errno 0 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=332, selfPID=2356, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... 10:11:17 (2648): start_timer_thread(): CreateThread() failed, errno 0 forrtl: severe (24): end-of-file during read, unit 9, file C:\ProgramData\BOINC\projects\climateprediction.net\hadam3p_eu_98ka_1973_1_008158238\tmp\xaakg.namelists Image PC Routine Line Source hadrm3p_eu_um_6.0 0040C52A Unknown Unknown Unknown hadrm3p_eu_um_6.0 003B4460 Unknown Unknown Unknown hadrm3p_eu_um_6.0 003B362A Unknown Unknown Unknown hadrm3p_eu_um_6.0 00392469 Unknown Unknown Unknown hadrm3p_eu_um_6.0 002966EB Unknown Unknown Unknown hadrm3p_eu_um_6.0 00332AE2 Unknown Unknown Unknown hadrm3p_eu_um_6.0 003335AF Unknown Unknown Unknown hadrm3p_eu_um_6.0 000D9860 Unknown Unknown Unknown hadrm3p_eu_um_6.0 003F0893 Unknown Unknown Unknown kernel32.dll 770ED309 Unknown Unknown Unknown ntdll.dll 76F61603 Unknown Unknown Unknown ntdll.dll 76F615D6 Unknown Unknown Unknown forrtl: severe (24): end-of-file during read, unit 9, file C:\ProgramData\BOINC\projects\climateprediction.net\hadam3p_eu_98ka_1973_1_008158238\tmp\xaakm.namelists Image PC Routine Line Source hadam3p_eu_um_6.0 00DCA39A Unknown Unknown Unknown hadam3p_eu_um_6.0 00D72CD0 Unknown Unknown Unknown hadam3p_eu_um_6.0 00D71E9A Unknown Unknown Unknown hadam3p_eu_um_6.0 00D52819 Unknown Unknown Unknown hadam3p_eu_um_6.0 00C52287 Unknown Unknown Unknown hadam3p_eu_um_6.0 00CEE7B2 Unknown Unknown Unknown hadam3p_eu_um_6.0 00CEF2DA Unknown Unknown Unknown hadam3p_eu_um_6.0 00A69BD2 Unknown Unknown Unknown hadam3p_eu_um_6.0 00DAE638 Unknown Unknown Unknown kernel32.dll 770ED309 Unknown Unknown Unknown ntdll.dll 76F61603 Unknown Unknown Unknown ntdll.dll 76F615D6 Unknown Unknown Unknown Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2648, selfPID=3612, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Called boinc_finish </stderr_txt> <message> upload failure: <file_xfer_error> <file_name>hadam3p_eu_98ka_1973_1_008158238_0_3.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_eu_98ka_1973_1_008158238_0_4.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_eu_98ka_1973_1_008158238_0_5.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_eu_98ka_1973_1_008158238_0_6.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_eu_98ka_1973_1_008158238_0_7.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_eu_98ka_1973_1_008158238_0_8.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_eu_98ka_1973_1_008158238_0_9.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_eu_98ka_1973_1_008158238_0_10.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_eu_98ka_1973_1_008158238_0_11.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_eu_98ka_1973_1_008158238_0_12.zip</file_name> <error_code>-161</error_code> </file_xfer_error> </message> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
24 Aug 2012 14:02:20	1233288	15156876	hadam3p_eu_98ka_1973_1_008158238_0	23,136	119,950	5.1846
23 Aug 2012 10:06:41	1233288	15156876	hadam3p_eu_98ka_1973_1_008158238_0	11,616	61,209	5.2694