Task 15479388

Name	hadcm3n_zckp_1880_40_008249846_4
Workunit	8404970
Created	15 Dec 2012, 5:31:05 UTC
Sent	15 Dec 2012, 5:31:10 UTC
Report deadline	16 Mar 2013, 12:58:21 UTC
Received	28 Dec 2012, 10:38:51 UTC
Server state	Over
Outcome	Computation error
Client state	Aborted by user
Exit status	203 (0x000000CB) EXIT_ABORTED_VIA_GUI
Computer ID	1254699
Run time	4 days 16 hours 24 min 49 sec
CPU time	3 days 22 hours 35 min 41 sec
Validate state	Invalid
Credit	2,177.28
Device peak FLOPS	2.29 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>7.0.28</core_client_version> <![CDATA[ <message> aborted by user </message> <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=952, iMonCtr=1 Model crash detected, will try to restart... 12:16:39 (468): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:19:05 (2736): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 11:49:14 (5116): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:49:19 (5116): No heartbeat from core client for 30 sec - exiting 11:49:20 (5116): No heartbeat from core client for 30 sec - exiting 11:49:21 (5116): No heartbeat from core client for 30 sec - exiting 11:49:22 (5116): No heartbeat from core client for 30 sec - exiting 11:49:23 (5116): No heartbeat from core client for 30 sec - exiting 11:49:24 (5116): No heartbeat from core client for 30 sec - exiting 11:49:25 (5116): No heartbeat from core client for 30 sec - exiting 11:49:26 (5116): No heartbeat from core client for 30 sec - exiting 11:49:27 (5116): No heartbeat from core client for 30 sec - exiting 11:49:28 (5116): No heartbeat from core client for 30 sec - exiting 11:49:29 (5116): No heartbeat from core client for 30 sec - exiting 11:49:30 (5116): No heartbeat from core client for 30 sec - exiting 11:49:31 (5116): No heartbeat from core client for 30 sec - exiting 11:49:32 (5116): No heartbeat from core client for 30 sec - exiting 11:49:33 (5116): No heartbeat from core client for 30 sec - exiting 11:53:16 (10044): No heartbeat from core client for 30 sec - exiting 11:53:21 (10044): No heartbeat from core client for 30 sec - exiting 11:53:22 (10044): No heartbeat from core client for 30 sec - exiting 11:53:23 (10044): No heartbeat from core client for 30 sec - exiting 11:53:24 (10044): No heartbeat from core client for 30 sec - exiting 11:53:25 (10044): No heartbeat from core client for 30 sec - exiting 11:54:41 (10044): No heartbeat from core client for 30 sec - exiting 11:54:42 (10044): No heartbeat from core client for 30 sec - exiting 11:54:43 (10044): No heartbeat from core client for 30 sec - exiting 11:54:44 (10044): No heartbeat from core client for 30 sec - exiting 11:54:45 (10044): No heartbeat from core client for 30 sec - exiting 11:54:46 (10044): No heartbeat from core client for 30 sec - exiting 11:54:47 (10044): No heartbeat from core client for 30 sec - exiting 11:54:48 (10044): No heartbeat from core client for 30 sec - exiting 11:54:49 (10044): No heartbeat from core client for 30 sec - exiting 11:54:50 (10044): No heartbeat from core client for 30 sec - exiting 11:54:51 (10044): No heartbeat from core client for 30 sec - exiting 11:54:52 (10044): No heartbeat from core client for 30 sec - exiting 11:54:53 (10044): No heartbeat from core client for 30 sec - exiting 11:54:54 (10044): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:54:55 (10044): No heartbeat from core client for 30 sec - exiting 11:56:05 (6796): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:57:40 (9960): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:57:43 (9960): No heartbeat from core client for 30 sec - exiting 11:57:44 (9960): No heartbeat from core client for 30 sec - exiting 11:57:45 (9960): No heartbeat from core client for 30 sec - exiting 11:58:22 (9504): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:58:59 (9160): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:59:00 (9160): No heartbeat from core client for 30 sec - exiting 11:59:01 (9160): No heartbeat from core client for 30 sec - exiting 11:59:02 (9160): No heartbeat from core client for 30 sec - exiting 11:59:03 (9160): No heartbeat from core client for 30 sec - exiting 11:59:04 (9160): No heartbeat from core client for 30 sec - exiting 12:00:36 (5480): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:00:40 (5480): No heartbeat from core client for 30 sec - exiting 12:00:41 (5480): No heartbeat from core client for 30 sec - exiting 12:00:42 (5480): No heartbeat from core client for 30 sec - exiting 12:00:43 (5480): No heartbeat from core client for 30 sec - exiting 12:00:44 (5480): No heartbeat from core client for 30 sec - exiting 12:00:45 (5480): No heartbeat from core client for 30 sec - exiting 12:01:58 (7644): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:01:59 (7644): No heartbeat from core client for 30 sec - exiting 12:02:00 (7644): No heartbeat from core client for 30 sec - exiting 12:03:14 (9772): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:03:21 (9772): No heartbeat from core client for 30 sec - exiting 12:03:22 (9772): No heartbeat from core client for 30 sec - exiting 12:03:23 (9772): No heartbeat from core client for 30 sec - exiting 12:03:24 (9772): No heartbeat from core client for 30 sec - exiting 12:03:25 (9772): No heartbeat from core client for 30 sec - exiting 12:04:03 (3120): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:04:09 (3120): No heartbeat from core client for 30 sec - exiting 12:04:10 (3120): No heartbeat from core client for 30 sec - exiting 12:05:15 (9972): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:05:19 (9972): No heartbeat from core client for 30 sec - exiting 12:05:20 (9972): No heartbeat from core client for 30 sec - exiting 12:05:21 (9972): No heartbeat from core client for 30 sec - exiting 12:06:31 (5812): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:07:46 (10052): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:08:52 (9256): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:10:15 (7964): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:11:09 (10180): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:11:46 (7232): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:13:21 (7528): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:14:04 (9828): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:14:58 (9388): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:16:01 (6796): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:16:55 (7652): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:18:53 (9760): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:19:48 (9664): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:20:23 (9468): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:21:03 (9180): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:23:16 (4880): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:24:20 (3600): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:25:08 (9796): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:26:13 (9156): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:27:02 (6316): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:28:33 (9828): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:29:46 (9720): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:29:49 (9720): No heartbeat from core client for 30 sec - exiting 12:29:50 (9720): No heartbeat from core client for 30 sec - exiting 12:29:51 (9720): No heartbeat from core client for 30 sec - exiting 12:31:40 (9380): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:33:47 (9128): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:35:24 (10172): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:36:04 (4352): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:36:50 (9428): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:39:46 (9496): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:40:37 (572): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:41:18 (7584): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:41:54 (10228): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:42:39 (9688): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:44:51 (9944): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:46:31 (3632): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:47:19 (9284): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:49:15 (9076): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:50:49 (9548): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:51:41 (10136): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:53:21 (6564): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:55:20 (7100): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:56:37 (6976): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:57:49 (10112): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:26:32 (1200): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:28:28 (4760): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:28:36 (4760): No heartbeat from core client for 30 sec - exiting 13:28:37 (4760): No heartbeat from core client for 30 sec - exiting 13:28:38 (4760): No heartbeat from core client for 30 sec - exiting 13:28:39 (4760): No heartbeat from core client for 30 sec - exiting 13:28:40 (4760): No heartbeat from core client for 30 sec - exiting 13:28:41 (4760): No heartbeat from core client for 30 sec - exiting 13:28:42 (4760): No heartbeat from core client for 30 sec - exiting 13:28:43 (4760): No heartbeat from core client for 30 sec - exiting 13:28:44 (4760): No heartbeat from core client for 30 sec - exiting 13:29:24 (8060): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:29:30 (8060): No heartbeat from core client for 30 sec - exiting 13:29:31 (8060): No heartbeat from core client for 30 sec - exiting 13:29:32 (8060): No heartbeat from core client for 30 sec - exiting 13:32:01 (9668): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:32:43 (9232): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5380, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5380, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7872, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 11:47:55 (7872): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... 11:48:32 (7872): No heartbeat from core client for 30 sec - exiting 11:48:33 (7872): No heartbeat from core client for 30 sec - exiting 11:48:34 (7872): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Abort request from BOINC... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
19 Dec 2012 07:46:44	1254699	15479388	hadcm3n_zckp_1880_40_008249846_4	181,440	331,150	1.8251
18 Dec 2012 18:36:30	1254699	15479388	hadcm3n_zckp_1880_40_008249846_4	155,520	286,093	1.8396
18 Dec 2012 04:00:51	1254699	15479388	hadcm3n_zckp_1880_40_008249846_4	129,600	236,971	1.8285
17 Dec 2012 13:55:25	1254699	15479388	hadcm3n_zckp_1880_40_008249846_4	103,680	189,125	1.8241
16 Dec 2012 23:42:57	1254699	15479388	hadcm3n_zckp_1880_40_008249846_4	77,760	141,091	1.8144
16 Dec 2012 10:09:50	1254699	15479388	hadcm3n_zckp_1880_40_008249846_4	51,840	95,761	1.8472
15 Dec 2012 19:35:00	1254699	15479388	hadcm3n_zckp_1880_40_008249846_4	25,920	46,478	1.7931