Task 15589260

Name	hadcm3n_4jms_1940_40_008303627_0
Workunit	8454762
Created	6 Feb 2013, 23:32:31 UTC
Sent	6 Feb 2013, 23:33:30 UTC
Report deadline	9 May 2013, 7:00:41 UTC
Received	9 Apr 2013, 9:56:48 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	193 (0x000000C1) EXIT_SIGNAL
Computer ID	1231624
Run time	3 days 5 hours 11 min 29 sec
CPU time	3 days 1 hours 15 min 43 sec
Validate state	Invalid
Credit	3,110.40
Device peak FLOPS	4.18 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>7.0.28</core_client_version> <![CDATA[ <message> - exit code 193 (0xc1) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=8348, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5672, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 15:03:55 (3932): No heartbeat from core client for 30 sec - exiting 15:03:56 (3932): No heartbeat from core client for 30 sec - exiting 15:03:57 (3932): No heartbeat from core client for 30 sec - exiting 15:03:58 (3932): No heartbeat from core client for 30 sec - exiting 15:03:59 (3932): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 16:57:45 (5864): No heartbeat from core client for 30 sec - exiting 16:57:46 (5864): No heartbeat from core client for 30 sec - exiting 16:57:47 (5864): No heartbeat from core client for 30 sec - exiting 16:57:48 (5864): No heartbeat from core client for 30 sec - exiting 16:57:49 (5864): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 19:25:21 (5692): No heartbeat from core client for 30 sec - exiting 19:25:23 (5692): No heartbeat from core client for 30 sec - exiting 19:25:24 (5692): No heartbeat from core client for 30 sec - exiting 19:25:25 (5692): No heartbeat from core client for 30 sec - exiting 19:25:26 (5692): No heartbeat from core client for 30 sec - exiting 19:25:27 (5692): No heartbeat from core client for 30 sec - exiting 19:25:28 (5692): No heartbeat from core client for 30 sec - exiting 19:25:29 (5692): No heartbeat from core client for 30 sec - exiting 19:25:30 (5692): No heartbeat from core client for 30 sec - exiting 19:25:31 (5692): No heartbeat from core client for 30 sec - exiting 19:25:32 (5692): No heartbeat from core client for 30 sec - exiting 19:25:33 (5692): No heartbeat from core client for 30 sec - exiting 19:25:34 (5692): No heartbeat from core client for 30 sec - exiting 19:25:35 (5692): No heartbeat from core client for 30 sec - exiting 19:25:36 (5692): No heartbeat from core client for 30 sec - exiting 19:25:37 (5692): No heartbeat from core client for 30 sec - exiting 19:25:38 (5692): No heartbeat from core client for 30 sec - exiting 19:25:39 (5692): No heartbeat from core client for 30 sec - exiting 19:25:40 (5692): No heartbeat from core client for 30 sec - exiting 19:25:41 (5692): No heartbeat from core client for 30 sec - exiting 19:25:42 (5692): No heartbeat from core client for 30 sec - exiting 19:25:43 (5692): No heartbeat from core client for 30 sec - exiting 19:25:44 (5692): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CCPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6080, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5244, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 19:10:45 (5996): No heartbeat from core client for 30 sec - exiting 19:10:46 (5996): No heartbeat from core client for 30 sec - exiting 19:10:47 (5996): No heartbeat from core client for 30 sec - exiting 19:10:48 (5996): No heartbeat from core client for 30 sec - exiting 19:10:49 (5996): No heartbeat from core client for 30 sec - exiting 19:10:50 (5996): No heartbeat from core client for 30 sec - exiting 19:10:51 (5996): No heartbeat from core client for 30 sec - exiting 19:10:52 (5996): No heartbeat from core client for 30 sec - exiting 19:10:53 (5996): No heartbeat from core client for 30 sec - exiting 19:10:54 (5996): No heartbeat from core client for 30 sec - exiting 19:10:55 (5996): No heartbeat from core client for 30 sec - exiting 19:10:56 (5996): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:15:23 (6120): No heartbeat from core client for 30 sec - exiting 19:15:24 (6120): No heartbeat from core client for 30 sec - exiting 19:15:25 (6120): No heartbeat from core client for 30 sec - exiting 19:15:26 (6120): No heartbeat from core client for 30 sec - exiting 19:15:27 (6120): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x770D3AB3 read attempt to address 0x40D20431 Engaging BOINC Windows Runtime Debugger... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x77313AB3 read attempt to address 0x40D20431 Engaging BOINC Windows Runtime Debugger... Cannot serialize file E:\ProgramData\BOINC/projects/climateprediction.net/hadcm3n_4jms_1940_40_008303627/dataout/shmem_restart.day Signal 11 received, exiting... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
09 Apr 2013 10:00:27	1231624	15589260	hadcm3n_4jms_1940_40_008303627_0	259,200	263,322	1.0159
07 Mar 2013 08:15:33	1231624	15589260	hadcm3n_4jms_1940_40_008303627_0	233,280	239,136	1.0251
27 Feb 2013 00:34:50	1231624	15589260	hadcm3n_4jms_1940_40_008303627_0	207,360	213,703	1.0306
25 Feb 2013 19:23:45	1231624	15589260	hadcm3n_4jms_1940_40_008303627_0	181,440	188,001	1.0362
21 Feb 2013 01:53:08	1231624	15589260	hadcm3n_4jms_1940_40_008303627_0	155,520	161,757	1.0401
16 Feb 2013 21:39:13	1231624	15589260	hadcm3n_4jms_1940_40_008303627_0	129,600	135,728	1.0473
13 Feb 2013 22:48:21	1231624	15589260	hadcm3n_4jms_1940_40_008303627_0	103,680	109,694	1.0580
13 Feb 2013 14:05:21	1231624	15589260	hadcm3n_4jms_1940_40_008303627_0	77,760	82,877	1.0658
11 Feb 2013 23:57:27	1231624	15589260	hadcm3n_4jms_1940_40_008303627_0	51,840	54,885	1.0587
07 Feb 2013 17:07:12	1231624	15589260	hadcm3n_4jms_1940_40_008303627_0	25,920	26,157	1.0091