Task 15432906

Name	hadcm3n_o4iy_2060_40_008242050_2
Workunit	8397174
Created	11 Nov 2012, 9:55:51 UTC
Sent	11 Nov 2012, 9:55:53 UTC
Report deadline	10 Feb 2013, 17:23:04 UTC
Received	2 Jan 2013, 13:42:52 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	193 (0x000000C1) EXIT_SIGNAL
Computer ID	1232502
Run time	6 days 2 hours 39 min 26 sec
CPU time	5 days 10 hours 33 min 2 sec
Validate state	Invalid
Credit	3,110.40
Device peak FLOPS	2.33 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>7.0.28</core_client_version> <![CDATA[ <message> - exit code 193 (0xc1) </message> <stderr_txt> 11:57:15 (11260): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:57:16 (11260): No heartbeat from core client for 30 sec - exiting 11:57:17 (11260): No heartbeat from core client for 30 sec - exiting 12:05:42 (6888): No heartbeat from core client for 30 sec - exiting 12:05:43 (6888): No heartbeat from core client for 30 sec - exiting 12:05:44 (6888): No heartbeat from core client for 30 sec - exiting 12:05:45 (6888): No heartbeat from core client for 30 sec - exiting 12:05:46 (6888): No heartbeat from core client for 30 sec - exiting 12:05:47 (6888): No heartbeat from core client for 30 sec - exiting 12:05:48 (6888): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:05:49 (6888): No heartbeat from core client for 30 sec - exiting 12:15:44 (1216): No heartbeat from core client for 30 sec - exiting 12:15:46 (1216): No heartbeat from core client for 30 sec - exiting 12:15:53 (1216): No heartbeat from core client for 30 sec - exiting 12:16:00 (1216): No heartbeat from core client for 30 sec - exiting 12:16:07 (1216): No heartbeat from core client for 30 sec - exiting 12:16:14 (1216): No heartbeat from core client for 30 sec - exiting 12:16:16 (1216): No heartbeat from core client for 30 sec - exiting 12:16:18 (1216): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:29:09 (5324): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:29:22 (5324): No heartbeat from core client for 30 sec - exiting 13:17:47 (9220): No heartbeat from core client for 30 sec - exiting 13:17:48 (9220): No heartbeat from core client for 30 sec - exiting 13:17:52 (9220): No heartbeat from core client for 30 sec - exiting 13:17:54 (9220): No heartbeat from core client for 30 sec - exiting 13:17:56 (9220): No heartbeat from core client for 30 sec - exiting 13:17:57 (9220): No heartbeat from core client for 30 sec - exiting 13:17:58 (9220): No heartbeat from core client for 30 sec - exiting 13:17:59 (9220): No heartbeat from core client for 30 sec - exiting 13:18:02 (9220): No heartbeat from core client for 30 sec - exiting 13:18:07 (9220): No heartbeat from core client for 30 sec - exiting 13:18:11 (9220): No heartbeat from core client for 30 sec - exiting 13:18:16 (9220): No heartbeat from core client for 30 sec - exiting 13:18:21 (9220): No heartbeat from core client for 30 sec - exiting 13:18:27 (9220): No heartbeat from core client for 30 sec - exiting 13:19:02 (9220): No heartbeat from core client for 30 sec - exiting 13:19:05 (9220): No heartbeat from core client for 30 sec - exiting 13:19:11 (9220): No heartbeat from core client for 30 sec - exiting 13:19:15 (9220): No heartbeat from core client for 30 sec - exiting 13:19:20 (9220): No heartbeat from core client for 30 sec - exiting 13:19:22 (9220): No heartbeat from core client for 30 sec - exiting 13:19:27 (9220): No heartbeat from core client for 30 sec - exiting 13:19:31 (9220): No heartbeat from core client for 30 sec - exiting 13:19:35 (9220): No heartbeat from core client for 30 sec - exiting 13:19:38 (9220): No heartbeat from core client for 30 sec - exiting 13:19:40 (9220): No heartbeat from core client for 30 sec - exiting 13:19:43 (9220): No heartbeat from core client for 30 sec - exiting 13:19:44 (9220): No heartbeat from core client for 30 sec - exiting 13:19:45 (9220): No heartbeat from core client for 30 sec - exiting 13:19:49 (9220): No heartbeat from core client for 30 sec - exiting 13:19:53 (9220): No heartbeat from core client for 30 sec - exiting 13:19:57 (9220): No heartbeat from core client for 30 sec - exiting 13:20:03 (9220): No heartbeat from core client for 30 sec - exiting 13:20:07 (9220): No heartbeat from core client for 30 sec - exiting 13:20:12 (9220): No heartbeat from core client for 30 sec - exiting 13:20:17 (9220): No heartbeat from core client for 30 sec - exiting 13:20:20 (9220): No heartbeat from core client for 30 sec - exiting 13:20:25 (9220): No heartbeat from core client for 30 sec - exiting 13:20:30 (9220): No heartbeat from core client for 30 sec - exiting 13:20:34 (9220): No heartbeat from core client for 30 sec - exiting 13:20:37 (9220): No heartbeat from core client for 30 sec - exiting 13:20:42 (9220): No heartbeat from core client for 30 sec - exiting 13:20:48 (9220): No heartbeat from core client for 30 sec - exiting 13:20:53 (9220): No heartbeat from core client for 30 sec - exiting 13:20:58 (9220): No heartbeat from core client for 30 sec - exiting 13:21:03 (9220): No heartbeat from core client for 30 sec - exiting 13:21:07 (9220): No heartbeat from core client for 30 sec - exiting 13:21:09 (9220): No heartbeat from core client for 30 sec - exiting 13:21:14 (9220): No heartbeat from core client for 30 sec - exiting 13:21:16 (9220): No heartbeat from core client for 30 sec - exiting 13:21:20 (9220): No heartbeat from core client for 30 sec - exiting 13:21:24 (9220): No heartbeat from core client for 30 sec - exiting 13:21:29 (9220): No heartbeat from core client for 30 sec - exiting 13:21:33 (9220): No heartbeat from core client for 30 sec - exiting 13:21:39 (9220): No heartbeat from core client for 30 sec - exiting 13:21:41 (9220): No heartbeat from core client for 30 sec - exiting 13:21:46 (9220): No heartbeat from core client for 30 sec - exiting 13:21:49 (9220): No heartbeat from core client for 30 sec - exiting 13:21:51 (9220): No heartbeat from core client for 30 sec - exiting 13:21:54 (9220): No heartbeat from core client for 30 sec - exiting 13:21:58 (9220): No heartbeat from core client for 30 sec - exiting 13:22:01 (9220): No heartbeat from core client for 30 sec - exiting 13:22:04 (9220): No heartbeat from core client for 30 sec - exiting 13:22:07 (9220): No heartbeat from core client for 30 sec - exiting 13:22:17 (9220): No heartbeat from core client for 30 sec - exiting 13:22:45 (9220): No heartbeat from core client for 30 sec - exiting 13:22:48 (9220): No heartbeat from core client for 30 sec - exiting 13:22:52 (9220): No heartbeat from core client for 30 sec - exiting 13:22:56 (9220): No heartbeat from core client for 30 sec - exiting 13:22:58 (9220): No heartbeat from core client for 30 sec - exiting 13:23:01 (9220): No heartbeat from core client for 30 sec - exiting 13:23:04 (9220): No heartbeat from core client for 30 sec - exiting 13:23:08 (9220): No heartbeat from core client for 30 sec - exiting 13:23:11 (9220): No heartbeat from core client for 30 sec - exiting 13:23:13 (9220): No heartbeat from core client for 30 sec - exiting 13:23:18 (9220): No heartbeat from core client for 30 sec - exiting 13:23:23 (9220): No heartbeat from core client for 30 sec - exiting 13:23:30 (9220): No heartbeat from core client for 30 sec - exiting 13:23:35 (9220): No heartbeat from core client for 30 sec - exiting 13:23:41 (9220): No heartbeat from core client for 30 sec - exiting 13:23:47 (9220): No heartbeat from core client for 30 sec - exiting 13:23:53 (9220): No heartbeat from core client for 30 sec - exiting 13:23:58 (9220): No heartbeat from core client for 30 sec - exiting 13:24:48 (9220): No heartbeat from core client for 30 sec - exiting 13:24:53 (9220): No heartbeat from core client for 30 sec - exiting 13:24:59 (9220): No heartbeat from core client for 30 sec - exiting 13:25:05 (9220): No heartbeat from core client for 30 sec - exiting 13:25:11 (9220): No heartbeat from core client for 30 sec - exiting 13:25:17 (9220): No heartbeat from core client for 30 sec - exiting 13:25:22 (9220): No heartbeat from core client for 30 sec - exiting 13:25:28 (9220): No heartbeat from core client for 30 sec - exiting 13:25:34 (9220): No heartbeat from core client for 30 sec - exiting 13:25:39 (9220): No heartbeat from core client for 30 sec - exiting 13:25:42 (9220): No heartbeat from core client for 30 sec - exiting 13:25:43 (9220): No heartbeat from core client for 30 sec - exiting 13:25:44 (9220): No heartbeat from core client for 30 sec - exiting 13:25:46 (9220): No heartbeat from core client for 30 sec - exiting 13:25:48 (9220): No heartbeat from core client for 30 sec - exiting 13:25:50 (9220): No heartbeat from core client for 30 sec - exiting 13:25:52 (9220): No heartbeat from core client for 30 sec - exiting 13:25:53 (9220): No heartbeat from core client for 30 sec - exiting 13:25:54 (9220): No heartbeat from core client for 30 sec - exiting 13:25:55 (9220): No heartbeat from core client for 30 sec - exiting 13:25:56 (9220): No heartbeat from core client for 30 sec - exiting 13:25:58 (9220): No heartbeat from core client for 30 sec - exiting 13:25:59 (9220): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:26:00 (9220): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 18:04:29 (5016): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4416, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4336, iMonCtr=1 Model crash detected, will try to restart... 09:00:27 (3504): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:00:28 (3504): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... 09:18:49 (4288): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:18:50 (4288): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5368, iMonCtr=1 Model crash detected, will try to restart... 09:19:03 (3532): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:52:12 (3244): No heartbeat from core client for 30 sec - exiting 19:52:13 (3244): No heartbeat from core client for 30 sec - exiting 19:52:14 (3244): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:04:29 (29436): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=39888, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4384, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4572, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 09:49:56 (552): No heartbeat from core client for 30 sec - exiting 09:49:57 (552): No heartbeat from core client for 30 sec - exiting 09:49:58 (552): No heartbeat from core client for 30 sec - exiting 09:49:59 (552): No heartbeat from core client for 30 sec - exiting 09:50:00 (552): No heartbeat from core client for 30 sec - exiting 09:50:01 (552): No heartbeat from core client for 30 sec - exiting 09:50:02 (552): No heartbeat from core client for 30 sec - exiting 09:50:03 (552): No heartbeat from core client for 30 sec - exiting 09:50:04 (552): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Signal 11 received, exiting... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
02 Jan 2013 13:10:49	1232502	15432906	hadcm3n_o4iy_2060_40_008242050_2	259,200	469,972	1.8132
01 Jan 2013 08:06:13	1232502	15432906	hadcm3n_o4iy_2060_40_008242050_2	233,280	423,929	1.8173
30 Dec 2012 16:46:14	1232502	15432906	hadcm3n_o4iy_2060_40_008242050_2	207,360	366,997	1.7699
29 Dec 2012 10:05:39	1232502	15432906	hadcm3n_o4iy_2060_40_008242050_2	181,440	310,844	1.7132
24 Nov 2012 20:52:10	1232502	15432906	hadcm3n_o4iy_2060_40_008242050_2	155,520	266,497	1.7136
20 Nov 2012 22:12:06	1232502	15432906	hadcm3n_o4iy_2060_40_008242050_2	129,600	221,963	1.7127
18 Nov 2012 11:25:10	1232502	15432906	hadcm3n_o4iy_2060_40_008242050_2	103,680	176,646	1.7038
17 Nov 2012 11:45:51	1232502	15432906	hadcm3n_o4iy_2060_40_008242050_2	77,760	133,056	1.7111
15 Nov 2012 17:05:34	1232502	15432906	hadcm3n_o4iy_2060_40_008242050_2	51,840	89,658	1.7295
13 Nov 2012 16:44:29	1232502	15432906	hadcm3n_o4iy_2060_40_008242050_2	25,920	43,275	1.6696