Task 15461965

Name	hadcm3n_zis8_1880_40_008253768_1
Workunit	8408892
Created	26 Nov 2012, 12:35:27 UTC
Sent	26 Nov 2012, 12:38:20 UTC
Report deadline	25 Feb 2013, 20:05:31 UTC
Received	19 Feb 2013, 3:35:48 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	-226 (0xFFFFFF1E) ERR_TOO_MANY_EXITS
Computer ID	1207199
Run time	4 days 16 hours 29 min 3 sec
CPU time	4 days 10 hours 22 min 43 sec
Validate state	Invalid
Credit	3,421.44
Device peak FLOPS	3.33 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>7.0.28</core_client_version> <![CDATA[ <message> too many exit(0)s </message> <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6060, iMonCtr=1 Model crash detected, will try to restart... 18:11:03 (3280): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:11:04 (3280): No heartbeat from core client for 30 sec - exiting 18:11:05 (3280): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4112, iMonCtr=1 Model crash detected, will try to restart... 14:54:04 (4648): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4416, iMonCtr=1 Model crash detected, will try to restart... 19:39:53 (5264): No heartbeat from core client for 30 sec - exiting 19:39:54 (5264): No heartbeat from core client for 30 sec - exiting 19:39:55 (5264): No heartbeat from core client for 30 sec - exiting 19:39:56 (5264): No heartbeat from core client for 30 sec - exiting 19:39:58 (5264): No heartbeat from core client for 30 sec - exiting 19:39:59 (5264): No heartbeat from core client for 30 sec - exiting 19:40:00 (5264): No heartbeat from core client for 30 sec - exiting 19:40:01 (5264): No heartbeat from core client for 30 sec - exiting 19:40:02 (5264): No heartbeat from core client for 30 sec - exiting 19:40:03 (5264): No heartbeat from core client for 30 sec - exiting 19:40:04 (5264): No heartbeat from core client for 30 sec - exiting 19:40:05 (5264): No heartbeat from core client for 30 sec - exiting 19:40:06 (5264): No heartbeat from core client for 30 sec - exiting 19:40:07 (5264): No heartbeat from core client for 30 sec - exiting 19:40:08 (5264): No heartbeat from core client for 30 sec - exiting 19:40:10 (5264): No heartbeat from core client for 30 sec - exiting 19:40:11 (5264): No heartbeat from core client for 30 sec - exiting 19:40:12 (5264): No heartbeat from core client for 30 sec - exiting 19:40:13 (5264): No heartbeat from core client for 30 sec - exiting 19:40:14 (5264): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 20:37:01 (2132): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 11:12:48 (4620): No heartbeat from core client for 30 sec - exiting 11:12:50 (4620): No heartbeat from core client for 30 sec - exiting 11:12:51 (4620): No heartbeat from core client for 30 sec - exiting 11:12:52 (4620): No heartbeat from core client for 30 sec - exiting 11:12:53 (4620): No heartbeat from core client for 30 sec - exiting 11:12:54 (4620): No heartbeat from core client for 30 sec - exiting 11:12:55 (4620): No heartbeat from core client for 30 sec - exiting 11:12:56 (4620): No heartbeat from core client for 30 sec - exiting 11:12:57 (4620): No heartbeat from core client for 30 sec - exiting 11:12:59 (4620): No heartbeat from core client for 30 sec - exiting 11:13:00 (4620): No heartbeat from core client for 30 sec - exiting 11:13:01 (4620): No heartbeat from core client for 30 sec - exiting 11:13:02 (4620): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:48:41 (3884): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2688, iMonCtr=1 Model crash detected, will try to restart... 20:59:15 (4788): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:39:49 (6136): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 07:55:12 (1704): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 14:09:00 (2444): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:09:01 (2444): No heartbeat from core client for 30 sec - exiting 14:09:02 (2444): No heartbeat from core client for 30 sec - exiting 14:09:03 (2444): No heartbeat from core client for 30 sec - exiting 14:09:04 (2444): No heartbeat from core client for 30 sec - exiting 14:09:06 (2444): No heartbeat from core client for 30 sec - exiting 14:09:07 (2444): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 08:12:17 (5596): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:12:18 (5596): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... 20:33:53 (4344): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:33:56 (4344): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 17:50:28 (5424): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:50:32 (5424): No heartbeat from core client for 30 sec - exiting 17:50:33 (5424): No heartbeat from core client for 30 sec - exiting 17:50:34 (5424): No heartbeat from core client for 30 sec - exiting 17:50:35 (5424): No heartbeat from core client for 30 sec - exiting 17:50:36 (5424): No heartbeat from core client for 30 sec - exiting 17:50:37 (5424): No heartbeat from core client for 30 sec - exiting 17:50:38 (5424): No heartbeat from core client for 30 sec - exiting 17:50:39 (5424): No heartbeat from core client for 30 sec - exiting 17:50:41 (5424): No heartbeat from core client for 30 sec - exiting 17:50:42 (5424): No heartbeat from core client for 30 sec - exiting 17:50:43 (5424): No heartbeat from core client for 30 sec - exiting 17:50:44 (5424): No heartbeat from core client for 30 sec - exiting 17:50:45 (5424): No heartbeat from core client for 30 sec - exiting 17:53:34 (5448): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
03 Feb 2013 23:55:43	1207199	15461965	hadcm3n_zis8_1880_40_008253768_1	285,120	353,396	1.2395
30 Jan 2013 23:59:07	1207199	15461965	hadcm3n_zis8_1880_40_008253768_1	259,200	324,405	1.2516
19 Jan 2013 00:08:17	1207199	15461965	hadcm3n_zis8_1880_40_008253768_1	233,280	291,629	1.2501
31 Dec 2012 22:39:03	1207199	15461965	hadcm3n_zis8_1880_40_008253768_1	207,360	258,816	1.2481
28 Dec 2012 20:10:31	1207199	15461965	hadcm3n_zis8_1880_40_008253768_1	181,440	225,920	1.2451
23 Dec 2012 00:46:23	1207199	15461965	hadcm3n_zis8_1880_40_008253768_1	155,520	193,415	1.2437
19 Dec 2012 01:55:42	1207199	15461965	hadcm3n_zis8_1880_40_008253768_1	129,600	160,995	1.2422
15 Dec 2012 20:05:30	1207199	15461965	hadcm3n_zis8_1880_40_008253768_1	103,680	129,092	1.2451
07 Dec 2012 16:13:16	1207199	15461965	hadcm3n_zis8_1880_40_008253768_1	77,760	96,598	1.2423
30 Nov 2012 18:27:02	1207199	15461965	hadcm3n_zis8_1880_40_008253768_1	51,840	65,162	1.2570
28 Nov 2012 02:35:20	1207199	15461965	hadcm3n_zis8_1880_40_008253768_1	25,920	32,837	1.2669