Task 15979579

Name	hadcm3n_7qvr_1980_40_008446122_0
Workunit	8596978
Created	30 Aug 2013, 12:44:32 UTC
Sent	30 Aug 2013, 12:57:08 UTC
Report deadline	29 Nov 2013, 20:24:19 UTC
Received	10 Sep 2013, 23:41:42 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	193 (0x000000C1) EXIT_SIGNAL
Computer ID	1254699
Run time	9 days 2 hours 10 min 3 sec
CPU time	5 days 17 hours 58 min 29 sec
Validate state	Invalid
Credit	3,110.40
Device peak FLOPS	2.29 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>7.0.64</core_client_version> <![CDATA[ <message> (unknown error) - exit code 193 (0xc1) </message> <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 09:05:15 (7664): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... 09:05:16 (7664): No heartbeat from core client for 30 sec - exiting 09:05:17 (7664): No heartbeat from core client for 30 sec - exiting 09:05:18 (7664): No heartbeat from core client for 30 sec - exiting 09:05:19 (7664): No heartbeat from core client for 30 sec - exiting 09:05:20 (7664): No heartbeat from core client for 30 sec - exiting 09:05:21 (7664): No heartbeat from core client for 30 sec - exiting 09:05:22 (7664): No heartbeat from core client for 30 sec - exiting 09:05:23 (7664): No heartbeat from core client for 30 sec - exiting 09:05:24 (7664): No heartbeat from core client for 30 sec - exiting 09:05:25 (7664): No heartbeat from core client for 30 sec - exiting 09:05:26 (7664): No heartbeat from core client for 30 sec - exiting 09:05:27 (7664): No heartbeat from core client for 30 sec - exiting 09:05:28 (7664): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 22:08:43 (6916): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:08:44 (6916): No heartbeat from core client for 30 sec - exiting 22:08:45 (6916): No heartbeat from core client for 30 sec - exiting 22:08:46 (6916): No heartbeat from core client for 30 sec - exiting 22:08:47 (6916): No heartbeat from core client for 30 sec - exiting 22:08:48 (6916): No heartbeat from core client for 30 sec - exiting 22:08:49 (6916): No heartbeat from core client for 30 sec - exiting 22:08:50 (6916): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 23:29:42 (5188): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 08:28:11 (8136): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 01:08:49 (5684): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:08:50 (5684): No heartbeat from core client for 30 sec - exiting 01:08:57 (6224): Can't acquire lockfile (32) - waiting 35s Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 06:18:17 (6224): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... 06:18:18 (6224): No heartbeat from core client for 30 sec - exiting 06:18:19 (6224): No heartbeat from core client for 30 sec - exiting 06:18:20 (6224): No heartbeat from core client for 30 sec - exiting 06:18:21 (6224): No heartbeat from core client for 30 sec - exiting 06:18:22 (6224): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 10:26:33 (6248): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 12:10:50 (5176): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... 12:10:52 (5176): No heartbeat from core client for 30 sec - exiting 12:10:53 (5176): No heartbeat from core client for 30 sec - exiting 12:10:54 (5176): No heartbeat from core client for 30 sec - exiting 12:10:55 (5176): No heartbeat from core client for 30 sec - exiting 12:10:57 (5176): No heartbeat from core client for 30 sec - exiting 12:10:58 (5176): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 16:59:32 (4344): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:59:33 (4344): No heartbeat from core client for 30 sec - exiting 16:59:34 (4344): No heartbeat from core client for 30 sec - exiting 16:59:35 (4344): No heartbeat from core client for 30 sec - exiting 16:59:36 (4344): No heartbeat from core client for 30 sec - exiting 16:59:37 (4344): No heartbeat from core client for 30 sec - exiting 17:00:01 (6164): Can't acquire lockfile (32) - waiting 35s Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 08:57:33 (6164): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:57:35 (6164): No heartbeat from core client for 30 sec - exiting 08:57:36 (6164): No heartbeat from core client for 30 sec - exiting 00:14:19 (7056): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:14:20 (7056): No heartbeat from core client for 30 sec - exiting 13:24:23 (1520): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:24:24 (1520): No heartbeat from core client for 30 sec - exiting 13:24:25 (1520): No heartbeat from core client for 30 sec - exiting 13:31:49 (8760): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:45:47 (5996): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:13:09 (8756): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:17:24 (7656): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:39:15 (8768): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:37:20 (8568): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:37:22 (8568): No heartbeat from core client for 30 sec - exiting 15:40:47 (4252): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:40:50 (4252): No heartbeat from core client for 30 sec - exiting 16:09:21 (10000): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:09:22 (10000): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 22:21:49 (6048): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... 22:21:50 (6048): No heartbeat from core client for 30 sec - exiting 22:21:52 (6048): No heartbeat from core client for 30 sec - exiting 22:21:53 (6048): No heartbeat from core client for 30 sec - exiting 22:21:54 (6048): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 00:17:44 (8880): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... 00:17:45 (8880): No heartbeat from core client for 30 sec - exiting 00:17:46 (8880): No heartbeat from core client for 30 sec - exiting 00:17:47 (8880): No heartbeat from core client for 30 sec - exiting 00:17:48 (8880): No heartbeat from core client for 30 sec - exiting 00:17:49 (8880): No heartbeat from core client for 30 sec - exiting 00:17:50 (8880): No heartbeat from core client for 30 sec - exiting 00:17:51 (8880): No heartbeat from core client for 30 sec - exiting 00:17:52 (8880): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 20:01:55 (8264): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... 20:01:56 (8264): No heartbeat from core client for 30 sec - exiting 20:01:57 (8264): No heartbeat from core client for 30 sec - exiting 20:01:58 (8264): No heartbeat from core client for 30 sec - exiting 20:01:59 (8264): No heartbeat from core client for 30 sec - exiting 20:02:00 (8264): No heartbeat from core client for 30 sec - exiting 20:02:01 (8264): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 20:14:18 (10360): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:14:19 (10360): No heartbeat from core client for 30 sec - exiting 20:14:20 (10360): No heartbeat from core client for 30 sec - exiting 20:14:21 (10360): No heartbeat from core client for 30 sec - exiting 20:14:22 (10360): No heartbeat from core client for 30 sec - exiting 20:14:23 (10360): No heartbeat from core client for 30 sec - exiting 20:14:24 (10360): No heartbeat from core client for 30 sec - exiting 20:14:25 (10360): No heartbeat from core client for 30 sec - exiting 20:14:26 (10360): No heartbeat from core client for 30 sec - exiting 20:14:27 (10360): No heartbeat from core client for 30 sec - exiting 20:14:30 (8840): Can't acquire lockfile (32) - waiting 35s 20:59:10 (8840): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:06:23 (6408): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=11896, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 09:11:13 (6140): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:11:14 (6140): No heartbeat from core client for 30 sec - exiting Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5280, iMonCtr=1 Model crash detected, will try to restart... 12:19:21 (8164): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:19:22 (8164): No heartbeat from core client for 30 sec - exiting 12:19:23 (8164): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 19:08:19 (7568): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:08:20 (7568): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 00:50:03 (5864): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... 00:50:04 (5864): No heartbeat from core client for 30 sec - exiting 00:50:06 (5864): No heartbeat from core client for 30 sec - exiting 00:50:07 (5864): No heartbeat from core client for 30 sec - exiting 00:50:08 (5864): No heartbeat from core client for 30 sec - exiting 00:50:10 (5864): No heartbeat from core client for 30 sec - exiting 00:50:11 (5864): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 18:56:53 (7628): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... 18:56:55 (7628): No heartbeat from core client for 30 sec - exiting 18:56:56 (7628): No heartbeat from core client for 30 sec - exiting 18:56:57 (7628): No heartbeat from core client for 30 sec - exiting 18:56:58 (7628): No heartbeat from core client for 30 sec - exiting 18:56:59 (7628): No heartbeat from core client for 30 sec - exiting 18:57:00 (7628): No heartbeat from core client for 30 sec - exiting 18:57:01 (7628): No heartbeat from core client for 30 sec - exiting 18:57:02 (7628): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Signal 11 received, exiting... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
10 Sep 2013 22:18:07	1254699	15979579	hadcm3n_7qvr_1980_40_008446122_0	259,200	496,692	1.9163
09 Sep 2013 18:13:18	1254699	15979579	hadcm3n_7qvr_1980_40_008446122_0	233,280	447,616	1.9188
08 Sep 2013 16:14:11	1254699	15979579	hadcm3n_7qvr_1980_40_008446122_0	207,360	400,172	1.9298
07 Sep 2013 18:21:58	1254699	15979579	hadcm3n_7qvr_1980_40_008446122_0	181,440	350,807	1.9335
06 Sep 2013 19:15:36	1254699	15979579	hadcm3n_7qvr_1980_40_008446122_0	155,520	302,433	1.9447
05 Sep 2013 23:58:17	1254699	15979579	hadcm3n_7qvr_1980_40_008446122_0	129,600	248,876	1.9203
05 Sep 2013 09:53:23	1254699	15979579	hadcm3n_7qvr_1980_40_008446122_0	103,680	194,116	1.8723
04 Sep 2013 17:24:25	1254699	15979579	hadcm3n_7qvr_1980_40_008446122_0	77,760	145,701	1.8737
02 Sep 2013 14:46:45	1254699	15979579	hadcm3n_7qvr_1980_40_008446122_0	51,840	97,071	1.8725
31 Aug 2013 09:45:13	1254699	15979579	hadcm3n_7qvr_1980_40_008446122_0	25,920	48,447	1.8691