Task 12732324

Name	hadcm3n_o06t_1900_40_007195576_0
Workunit	7393856
Created	28 Mar 2011, 13:56:07 UTC
Sent	3 Apr 2011, 9:30:22 UTC
Report deadline	3 Jul 2011, 16:57:33 UTC
Received	20 Apr 2011, 16:05:32 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	-226 (0xFFFFFF1E) ERR_TOO_MANY_EXITS
Computer ID	1101937
Run time
CPU time	13 days 7 hours 17 min 47 sec
Validate state	Invalid
Credit	4,665.60
Device peak FLOPS	0.27 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>6.2.28</core_client_version> <![CDATA[ <message> too many exit(0)s </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 09:33:12 (6564): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:17:22 (6816): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 14:52:09 (5384): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 22:49:08 (6672): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:49:48 (6672): No heartbeat from core client for 30 sec - exiting 23:19:58 (7160): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:20:58 (5936): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:34:54 (6056): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:32:31 (5256): No heartbeat from core client for 30 sec - exiting 07:32:32 (5256): No heartbeat from core client for 30 sec - exiting 07:32:33 (5256): No heartbeat from core client for 30 sec - exiting 07:32:34 (5256): No heartbeat from core client for 30 sec - exiting 07:32:35 (5256): No heartbeat from core client for 30 sec - exiting 07:32:36 (5256): No heartbeat from core client for 30 sec - exiting 07:32:37 (5256): No heartbeat from core client for 30 sec - exiting 07:32:38 (5256): No heartbeat from core client for 30 sec - exiting 07:32:39 (5256): No heartbeat from core client for 30 sec - exiting 07:32:40 (5256): No heartbeat from core client for 30 sec - exiting 07:32:41 (5256): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:32:42 (5256): No heartbeat from core client for 30 sec - exiting 07:32:43 (5256): No heartbeat from core client for 30 sec - exiting 07:32:44 (5256): No heartbeat from core client for 30 sec - exiting 07:32:45 (5256): No heartbeat from core client for 30 sec - exiting 08:15:33 (724): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:15:35 (724): No heartbeat from core client for 30 sec - exiting 08:15:36 (724): No heartbeat from core client for 30 sec - exiting 08:15:37 (724): No heartbeat from core client for 30 sec - exiting 08:15:38 (724): No heartbeat from core client for 30 sec - exiting 08:16:26 (2724): No heartbeat from core client for 30 sec - exiting 08:16:27 (2724): No heartbeat from core client for 30 sec - exiting 08:16:28 (2724): No heartbeat from core client for 30 sec - exiting 08:16:29 (2724): No heartbeat from core client for 30 sec - exiting 08:16:30 (2724): No heartbeat from core client for 30 sec - exiting 08:16:31 (2724): No heartbeat from core client for 30 sec - exiting 08:16:32 (2724): No heartbeat from core client for 30 sec - exiting 08:16:33 (2724): No heartbeat from core client for 30 sec - exiting 08:16:34 (2724): No heartbeat from core client for 30 sec - exiting 08:16:35 (2724): No heartbeat from core client for 30 sec - exiting 08:16:36 (2724): No heartbeat from core client for 30 sec - exiting 08:16:37 (2724): No heartbeat from core client for 30 sec - exiting 08:16:38 (2724): No heartbeat from core client for 30 sec - exiting 08:16:39 (2724): No heartbeat from core client for 30 sec - exiting 08:16:40 (2724): No heartbeat from core client for 30 sec - exiting 08:16:41 (2724): No heartbeat from core client for 30 sec - exiting 08:16:42 (2724): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=7904, selfPID=7904, iMonCtr=1 16:26:28 (7300): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:26:30 (7300): No heartbeat from core client for 30 sec - exiting 16:26:31 (7300): No heartbeat from core client for 30 sec - exiting 05:52:00 (6796): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:52:01 (6796): No heartbeat from core client for 30 sec - exiting 06:42:15 (4676): No heartbeat from core client for 30 sec - exiting 06:42:16 (4676): No heartbeat from core client for 30 sec - exiting 06:42:17 (4676): No heartbeat from core client for 30 sec - exiting 06:42:18 (4676): No heartbeat from core client for 30 sec - exiting 06:42:19 (4676): No heartbeat from core client for 30 sec - exiting 06:42:20 (4676): No heartbeat from core client for 30 sec - exiting 06:42:21 (4676): No heartbeat from core client for 30 sec - exiting 06:42:22 (4676): No heartbeat from core client for 30 sec - exiting 06:42:23 (4676): No heartbeat from core client for 30 sec - exiting 06:42:24 (4676): No heartbeat from core client for 30 sec - exiting 06:42:25 (4676): No heartbeat from core client for 30 sec - exiting 06:42:26 (4676): No heartbeat from core client for 30 sec - exiting 06:42:27 (4676): No heartbeat from core client for 30 sec - exiting 06:42:28 (4676): No heartbeat from core client for 30 sec - exiting 06:42:29 (4676): No heartbeat from core client for 30 sec - exiting 06:42:30 (4676): No heartbeat from core client for 30 sec - exiting 06:42:31 (4676): No heartbeat from core client for 30 sec - exiting 06:42:32 (4676): No heartbeat from core client for 30 sec - exiting 06:42:33 (4676): No heartbeat from core client for 30 sec - exiting 06:42:34 (4676): No heartbeat from core client for 30 sec - exiting 06:42:35 (4676): No heartbeat from core client for 30 sec - exiting 06:42:36 (4676): No heartbeat from core client for 30 sec - exiting 06:42:37 (4676): No heartbeat from core client for 30 sec - exiting 06:42:38 (4676): No heartbeat from core client for 30 sec - exiting 06:42:39 (4676): No heartbeat from core client for 30 sec - exiting 06:42:40 (4676): No heartbeat from core client for 30 sec - exiting 06:42:41 (4676): No heartbeat from core client for 30 sec - exiting 06:42:42 (4676): No heartbeat from core client for 30 sec - exiting 06:42:43 (4676): No heartbeat from core client for 30 sec - exiting 06:42:44 (4676): No heartbeat from core client for 30 sec - exiting 06:42:45 (4676): No heartbeat from core client for 30 sec - exiting 06:42:46 (4676): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:26:19 (5760): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:32:06 (7680): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:32:58 (3364): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:18:01 (9508): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:18:02 (9508): No heartbeat from core client for 30 sec - exiting 09:19:28 (6428): No heartbeat from core client for 30 sec - exiting 09:19:29 (6428): No heartbeat from core client for 30 sec - exiting 09:19:30 (6428): No heartbeat from core client for 30 sec - exiting 09:19:31 (6428): No heartbeat from core client for 30 sec - exiting 09:19:32 (6428): No heartbeat from core client for 30 sec - exiting 09:19:33 (6428): No heartbeat from core client for 30 sec - exiting 09:19:34 (6428): No heartbeat from core client for 30 sec - exiting 09:19:35 (6428): No heartbeat from core client for 30 sec - exiting 09:19:37 (6428): No heartbeat from core client for 30 sec - exiting 09:19:38 (6428): No heartbeat from core client for 30 sec - exiting 09:19:39 (6428): No heartbeat from core client for 30 sec - exiting 09:19:40 (6428): No heartbeat from core client for 30 sec - exiting 09:19:41 (6428): No heartbeat from core client for 30 sec - exiting 09:19:42 (6428): No heartbeat from core client for 30 sec - exiting 09:19:43 (6428): No heartbeat from core client for 30 sec - exiting 09:19:44 (6428): No heartbeat from core client for 30 sec - exiting 09:19:45 (6428): No heartbeat from core client for 30 sec - exiting 09:19:46 (6428): No heartbeat from core client for 30 sec - exiting 09:19:47 (6428): No heartbeat from core client for 30 sec - exiting 09:19:48 (6428): No heartbeat from core client for 30 sec - exiting 09:19:49 (6428): No heartbeat from core client for 30 sec - exiting 09:19:50 (6428): No heartbeat from core client for 30 sec - exiting 09:19:51 (6428): No heartbeat from core client for 30 sec - exiting 09:19:52 (6428): No heartbeat from core client for 30 sec - exiting 09:19:53 (6428): No heartbeat from core client for 30 sec - exiting 09:19:54 (6428): No heartbeat from core client for 30 sec - exiting 09:19:55 (6428): No heartbeat from core client for 30 sec - exiting 09:19:57 (6428): No heartbeat from core client for 30 sec - exiting 09:19:58 (6428): No heartbeat from core client for 30 sec - exiting 09:19:59 (6428): No heartbeat from core client for 30 sec - exiting 09:20:00 (6428): No heartbeat from core client for 30 sec - exiting 09:20:01 (6428): No heartbeat from core client for 30 sec - exiting 09:20:02 (6428): No heartbeat from core client for 30 sec - exiting 09:20:03 (6428): No heartbeat from core client for 30 sec - exiting 09:20:04 (6428): No heartbeat from core client for 30 sec - exiting 09:20:05 (6428): No heartbeat from core client for 30 sec - exiting 09:20:06 (6428): No heartbeat from core client for 30 sec - exiting 09:20:07 (6428): No heartbeat from core client for 30 sec - exiting 09:20:08 (6428): No heartbeat from core client for 30 sec - exiting 09:20:09 (6428): No heartbeat from core client for 30 sec - exiting 09:20:10 (6428): No heartbeat from core client for 30 sec - exiting 09:20:11 (6428): No heartbeat from core client for 30 sec - exiting 09:20:12 (6428): No heartbeat from core client for 30 sec - exiting 09:20:13 (6428): No heartbeat from core client for 30 sec - exiting 09:20:14 (6428): No heartbeat from core client for 30 sec - exiting 09:20:15 (6428): No heartbeat from core client for 30 sec - exiting 09:20:16 (6428): No heartbeat from core client for 30 sec - exiting 09:20:17 (6428): No heartbeat from core client for 30 sec - exiting 09:20:18 (6428): No heartbeat from core client for 30 sec - exiting 09:20:19 (6428): No heartbeat from core client for 30 sec - exiting 09:20:20 (6428): No heartbeat from core client for 30 sec - exiting 09:20:21 (6428): No heartbeat from core client for 30 sec - exiting 09:20:22 (6428): No heartbeat from core client for 30 sec - exiting 09:20:23 (6428): No heartbeat from core client for 30 sec - exiting 09:20:24 (6428): No heartbeat from core client for 30 sec - exiting 09:20:25 (6428): No heartbeat from core client for 30 sec - exiting 09:20:26 (6428): No heartbeat from core client for 30 sec - exiting 09:20:27 (6428): No heartbeat from core client for 30 sec - exiting 09:20:28 (6428): No heartbeat from core client for 30 sec - exiting 09:20:29 (6428): No heartbeat from core client for 30 sec - exiting 09:20:30 (6428): No heartbeat from core client for 30 sec - exiting 09:20:31 (6428): No heartbeat from core client for 30 sec - exiting 09:20:32 (6428): No heartbeat from core client for 30 sec - exiting 09:20:33 (6428): No heartbeat from core client for 30 sec - exiting 09:20:34 (6428): No heartbeat from core client for 30 sec - exiting 09:20:35 (6428): No heartbeat from core client for 30 sec - exiting 09:20:36 (6428): No heartbeat from core client for 30 sec - exiting 09:20:37 (6428): No heartbeat from core client for 30 sec - exiting 09:20:38 (6428): No heartbeat from core client for 30 sec - exiting 09:20:39 (6428): No heartbeat from core client for 30 sec - exiting 09:20:40 (6428): No heartbeat from core client for 30 sec - exiting 09:20:41 (6428): No heartbeat from core client for 30 sec - exiting 09:20:42 (6428): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:20:43 (6428): No heartbeat from core client for 30 sec - exiting 09:20:44 (6428): No heartbeat from core client for 30 sec - exiting 09:33:02 (9356): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:33:04 (9356):09:34:10 (10232): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:23:17 (9588): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:24:13 (7408): No heartbeat from core client for 30 sec - exiting 12:24:14 (7408): No heartbeat from core client for 30 sec - exiting 12:24:15 (7408): No heartbeat from core client for 30 sec - exiting 12:24:16 (7408): No heartbeat from core client for 30 sec - exiting 12:24:17 (7408): No heartbeat from core client for 30 sec - exiting 12:24:18 (7408): No heartbeat from core client for 30 sec - exiting 12:24:19 (7408): No heartbeat from core client for 30 sec - exiting 12:24:20 (7408): No heartbeat from core client for 30 sec - exiting 12:24:21 (7408): No heartbeat from core client for 30 sec - exiting 12:24:22 (7408): No heartbeat from core client for 30 sec - exiting 12:24:23 (7408): No heartbeat from core client for 30 sec - exiting 12:24:24 (7408): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:24:25 (7408): No heartbeat from core client for 30 sec - exiting 12:24:26 (7408): No heartbeat from core client for 30 sec - exiting 12:24:27 (7408): No heartbeat from core client for 30 sec - exiting </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
20 Apr 2011 16:11:17	1101937	12732324	hadcm3n_o06t_1900_40_007195576_0	388,800	1,106,119	2.8450
20 Apr 2011 16:11:16	1101937	12732324	hadcm3n_o06t_1900_40_007195576_0	362,880	1,043,427	2.8754
20 Apr 2011 16:11:15	1101937	12732324	hadcm3n_o06t_1900_40_007195576_0	336,960	979,218	2.9060
20 Apr 2011 16:11:14	1101937	12732324	hadcm3n_o06t_1900_40_007195576_0	311,040	847,973	2.7263
13 Apr 2011 03:13:45	1101937	12732324	hadcm3n_o06t_1900_40_007195576_0	285,120	726,314	2.5474
12 Apr 2011 07:59:00	1101937	12732324	hadcm3n_o06t_1900_40_007195576_0	259,200	665,304	2.5668
10 Apr 2011 16:06:51	1101937	12732324	hadcm3n_o06t_1900_40_007195576_0	233,280	555,358	2.3806
10 Apr 2011 00:08:56	1101937	12732324	hadcm3n_o06t_1900_40_007195576_0	207,360	500,905	2.4156
09 Apr 2011 09:06:49	1101937	12732324	hadcm3n_o06t_1900_40_007195576_0	181,440	449,031	2.4748
08 Apr 2011 05:45:52	1101937	12732324	hadcm3n_o06t_1900_40_007195576_0	155,520	367,916	2.3657
07 Apr 2011 05:14:53	1101937	12732324	hadcm3n_o06t_1900_40_007195576_0	129,600	298,203	2.3009
06 Apr 2011 10:57:35	1101937	12732324	hadcm3n_o06t_1900_40_007195576_0	103,680	238,134	2.2968
05 Apr 2011 16:03:38	1101937	12732324	hadcm3n_o06t_1900_40_007195576_0	77,760	178,281	2.2927
04 Apr 2011 23:03:58	1101937	12732324	hadcm3n_o06t_1900_40_007195576_0	51,840	120,098	2.3167
04 Apr 2011 06:01:13	1101937	12732324	hadcm3n_o06t_1900_40_007195576_0	25,920	62,317	2.4042