Task 13475924

Name	hadcm3n_u412_1980_40_007459652_2
Workunit	7657155
Created	12 Oct 2011, 19:01:46 UTC
Sent	12 Oct 2011, 19:01:50 UTC
Report deadline	12 Jan 2012, 2:29:01 UTC
Received	18 Nov 2011, 16:45:29 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	193 (0x000000C1) EXIT_SIGNAL
Computer ID	859190
Run time	19 days 14 hours 51 min 13 sec
CPU time	17 days 23 hours 55 min 16 sec
Validate state	Invalid
Credit	11,508.48
Device peak FLOPS	1.76 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 i686-pc-linux-gnu
Stderr	<core_client_version>6.10.17</core_client_version> <![CDATA[ <message> process exited with code 193 (0xc1, -63) </message> <stderr_txt> Signal 15 received, exiting... Called boinc_finish 10:39:32 (2778): No heartbeat from core client for 30 sec - exiting 10:39:33 (2778): No heartbeat from core client for 30 sec - exiting 10:39:34 (2778): No heartbeat from core client for 30 sec - exiting 10:39:35 (2778): No heartbeat from core client for 30 sec - exiting 10:39:36 (2778): No heartbeat from core client for 30 sec - exiting 10:39:37 (2778): No heartbeat from core client for 30 sec - exiting 10:39:38 (2778): No heartbeat from core client for 30 sec - exiting 10:39:39 (2778): No heartbeat from core client for 30 sec - exiting 10:39:40 (2778): No heartbeat from core client for 30 sec - exiting 10:39:41 (2778): No heartbeat from core client for 30 sec - exiting 10:39:42 (2778): No heartbeat from core client for 30 sec - exiting 10:39:43 (2778): No heartbeat from core client for 30 sec - exiting 10:39:44 (2778): No heartbeat from core client for 30 sec - exiting 10:39:45 (2778): No heartbeat from core client for 30 sec - exiting 10:39:46 (2778): No heartbeat from core client for 30 sec - exiting 10:39:47 (2778): No heartbeat from core client for 30 sec - exiting 10:39:48 (2778): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Signal 15 received, exiting... Called boinc_finish 23:21:45 (2530): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:21:46 (2530): No heartbeat from core client for 30 sec - exiting BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 63 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 64 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 65 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 66 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 67 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 68 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 69 - Return code = 1 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 11:05:42 (3158): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 10:28:14 (2850): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:36:36 (2857): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Signal 15 received, exiting... Called boinc_finish 10:41:40 (2673): No heartbeat from core client for 30 sec - exiting 10:41:41 (2673): No heartbeat from core client for 30 sec - exiting 10:41:42 (2673): No heartbeat from core client for 30 sec - exiting 10:41:43 (2673): No heartbeat from core client for 30 sec - exiting 10:41:45 (2673): No heartbeat from core client for 30 sec - exiting 10:41:46 (2673): No heartbeat from core client for 30 sec - exiting 10:41:47 (2673): No heartbeat from core client for 30 sec - exiting 10:41:48 (2673): No heartbeat from core client for 30 sec - exiting 10:41:49 (2673): No heartbeat from core client for 30 sec - exiting 10:41:50 (2673): No heartbeat from core client for 30 sec - exiting 10:41:51 (2673): No heartbeat from core client for 30 sec - exiting 10:41:52 (2673): No heartbeat from core client for 30 sec - exiting 10:41:53 (2673): No heartbeat from core client for 30 sec - exiting 10:41:54 (2673): No heartbeat from core client for 30 sec - exiting 10:41:55 (2673): No heartbeat from core client for 30 sec - exiting 10:41:56 (2673): No heartbeat from core client for 30 sec - exiting 10:41:57 (2673): No heartbeat from core client for 30 sec - exiting 10:41:58 (2673): No heartbeat from core client for 30 sec - exiting 10:41:59 (2673): No heartbeat from core client for 30 sec - exiting 10:42:00 (2673): No heartbeat from core client for 30 sec - exiting 10:42:01 (2673): No heartbeat from core client for 30 sec - exiting 10:42:02 (2673): No heartbeat from core client for 30 sec - exiting 10:42:03 (2673): No heartbeat from core client for 30 sec - exiting 10:42:04 (2673): No heartbeat from core client for 30 sec - exiting 10:42:05 (2673): No heartbeat from core client for 30 sec - exiting 10:42:06 (2673): No heartbeat from core client for 30 sec - exiting 10:42:07 (2673): No heartbeat from core client for 30 sec - exiting 10:42:08 (2673): No heartbeat from core client for 30 sec - exiting 10:42:09 (2673): No heartbeat from core client for 30 sec - exiting 10:42:10 (2673): No heartbeat from core client for 30 sec - exiting 10:42:11 (2673): No heartbeat from core client for 30 sec - exiting 10:42:12 (2673): No heartbeat from core client for 30 sec - exiting 10:42:13 (2673): No heartbeat from core client for 30 sec - exiting 10:42:14 (2673): No heartbeat from core client for 30 sec - exiting 10:42:15 (2673): No heartbeat from core client for 30 sec - exiting 10:42:16 (2673): No heartbeat from core client for 30 sec - exiting 10:42:17 (2673): No heartbeat from core client for 30 sec - exiting 10:42:18 (2673): No heartbeat from core client for 30 sec - exiting 10:42:19 (2673): No heartbeat from core client for 30 sec - exiting 10:42:20 (2673): No heartbeat from core client for 30 sec - exiting 10:42:21 (2673): No heartbeat from core client for 30 sec - exiting 10:42:22 (2673): No heartbeat from core client for 30 sec - exiting 10:42:23 (2673): No heartbeat from core client for 30 sec - exiting 10:42:24 (2673): No heartbeat from core client for 30 sec - exiting 10:42:25 (2673): No heartbeat from core client for 30 sec - exiting 10:42:26 (2673): No heartbeat from core client for 30 sec - exiting 10:42:27 (2673): No heartbeat from core client for 30 sec - exiting 10:42:28 (2673): No heartbeat from core client for 30 sec - exiting 10:42:29 (2673): No heartbeat from core client for 30 sec - exiting 10:42:30 (2673): No heartbeat from core client for 30 sec - exiting 10:42:31 (2673): No heartbeat from core client for 30 sec - exiting 10:42:32 (2673): No heartbeat from core client for 30 sec - exiting 10:42:33 (2673): No heartbeat from core client for 30 sec - exiting 10:42:34 (2673): No heartbeat from core client for 30 sec - exiting 10:42:35 (2673): No heartbeat from core client for 30 sec - exiting 10:42:36 (2673): No heartbeat from core client for 30 sec - exiting 10:42:37 (2673): No heartbeat from core client for 30 sec - exiting 10:42:38 (2673): No heartbeat from core client for 30 sec - exiting 10:42:39 (2673): No heartbeat from core client for 30 sec - exiting 10:42:40 (2673): No heartbeat from core client for 30 sec - exiting 10:42:41 (2673): No heartbeat from core client for 30 sec - exiting 10:42:42 (2673): No heartbeat from core client for 30 sec - exiting 10:42:43 (2673): No heartbeat from core client for 30 sec - exiting 10:42:44 (2673): No heartbeat from core client for 30 sec - exiting 10:42:45 (2673): No heartbeat from core client for 30 sec - exiting 10:42:46 (2673): No heartbeat from core client for 30 sec - exiting 10:42:47 (2673): No heartbeat from core client for 30 sec - exiting 10:42:48 (2673): No heartbeat from core client for 30 sec - exiting 10:42:49 (2673): No heartbeat from core client for 30 sec - exiting 10:42:50 (2673): No heartbeat from core client for 30 sec - exiting 10:42:51 (2673): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Signal 15 received, exiting... Called boinc_finish 10:32:39 (2649): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:33:36 (2942): No heartbeat from core client for 30 sec - exiting 10:33:37 (2942): No heartbeat from core client for 30 sec - exiting 10:33:38 (2942): No heartbeat from core client for 30 sec - exiting 10:33:40 (2942): No heartbeat from core client for 30 sec - exiting 10:33:41 (2942): No heartbeat from core client for 30 sec - exiting 10:33:42 (2942): No heartbeat from core client for 30 sec - exiting 10:33:43 (2942): No heartbeat from core client for 30 sec - exiting 10:33:44 (2942): No heartbeat from core client for 30 sec - exiting 10:33:45 (2942): No heartbeat from core client for 30 sec - exiting 10:33:46 (2942): No heartbeat from core client for 30 sec - exiting 10:33:47 (2942): No heartbeat from core client for 30 sec - exiting 10:33:48 (2942): No heartbeat from core client for 30 sec - exiting 10:33:49 (2942): No heartbeat from core client for 30 sec - exiting 10:33:50 (2942): No heartbeat from core client for 30 sec - exiting 10:33:51 (2942): No heartbeat from core client for 30 sec - exiting 10:33:52 (2942): No heartbeat from core client for 30 sec - exiting 10:33:53 (2942): No heartbeat from core client for 30 sec - exiting 10:33:54 (2942): No heartbeat from core client for 30 sec - exiting 10:33:55 (2942): No heartbeat from core client for 30 sec - exiting 10:33:56 (2942): No heartbeat from core client for 30 sec - exiting 10:33:57 (2942): No heartbeat from core client for 30 sec - exiting 10:33:58 (2942): No heartbeat from core client for 30 sec - exiting 10:34:43 (2942): No heartbeat from core client for 30 sec - exiting 10:34:44 (2942): No heartbeat from core client for 30 sec - exiting 10:34:45 (2942): No heartbeat from core client for 30 sec - exiting 10:34:46 (2942): No heartbeat from core client for 30 sec - exiting 10:34:47 (2942): No heartbeat from core client for 30 sec - exiting 10:34:48 (2942): No heartbeat from core client for 30 sec - exiting 10:34:49 (2942): No heartbeat from core client for 30 sec - exiting 10:34:50 (2942): No heartbeat from core client for 30 sec - exiting 10:34:51 (2942): No heartbeat from core client for 30 sec - exiting 10:34:52 (2942): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:57:17 (2837): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:58:01 (3106): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Signal 1 received, exiting... 07:27:43 (2479): No heartbeat from core client for 30 sec - exiting 07:27:47 (2479): No heartbeat from core client for 30 sec - exiting 07:27:48 (2479): No heartbeat from core client for 30 sec - exiting 07:27:49 (2479): No heartbeat from core client for 30 sec - exiting 07:27:50 (2479): No heartbeat from core client for 30 sec - exiting 07:27:51 (2479): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Signal 15 received, exiting... Called boinc_finish Signal 15 received, exiting... Called boinc_finish 05:20:58 (1857): No heartbeat from core client for 30 sec - exiting 05:20:59 (1857): No heartbeat from core client for 30 sec - exiting 05:21:00 (1857): No heartbeat from core client for 30 sec - exiting 05:21:01 (1857): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 15:27:03 (2168): No heartbeat from core client for 30 sec - exiting 15:27:05 (2168): No heartbeat from core client for 30 sec - exiting 15:27:06 (2168): No heartbeat from core client for 30 sec - exiting 15:27:07 (2168): No heartbeat from core client for 30 sec - exiting 15:27:08 (2168): No heartbeat from core client for 30 sec - exiting 15:27:09 (2168): No heartbeat from core client for 30 sec - exiting 15:27:10 (2168): No heartbeat from core client for 30 sec - exiting 15:27:11 (2168): No heartbeat from core client for 30 sec - exiting 15:27:12 (2168): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Signal 15 received, exiting... Called boinc_finish Signal 15 received, exiting... Called boinc_finish 11:56:29 (2232): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Signal 15 received, exiting... Called boinc_finish 11:50:36 (2207): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Signal 15 received, exiting... Called boinc_finish 12:23:36 (2210): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Signal 15 received, exiting... Called boinc_finish 06:31:38 (2395): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Signal 15 received, exiting... Called boinc_finish CPDN Monitor - Quit request from BOINC... Signal 15 received, exiting... Called boinc_finish CPDN Monitor - Quit request from BOINC... Signal 15 received, exiting... Called boinc_finish Signal 15 received, exiting... Called boinc_finish CPDN Monitor - Quit request from BOINC... Signal 15 received, exiting... Called boinc_finish Signal 15 received, exiting... Called boinc_finish Signal 15 received, exiting... Called boinc_finish Signal 15 received, exiting... Called boinc_finish Signal 15 received, exiting... Called boinc_finish Signal 15 received, exiting... Called boinc_finish Signal 15 received, exiting... Called boinc_finish Signal 15 received, exiting... Called boinc_finish 10:30:49 (2161): No heartbeat from core client for 30 sec - exiting 10:30:51 (2161): No heartbeat from core client for 30 sec - exiting 10:30:52 (2161): No heartbeat from core client for 30 sec - exiting 10:30:53 (2161): No heartbeat from core client for 30 sec - exiting 10:30:54 (2161): No heartbeat from core client for 30 sec - exiting 10:30:55 (2161): No heartbeat from core client for 30 sec - exiting 10:30:56 (2161): No heartbeat from core client for 30 sec - exiting 10:30:57 (2161): No heartbeat from core client for 30 sec - exiting 10:30:58 (2161): No heartbeat from core client for 30 sec - exiting 10:30:59 (2161): No heartbeat from core client for 30 sec - exiting 10:31:00 (2161): No heartbeat from core client for 30 sec - exiting 10:31:01 (2161): No heartbeat from core client for 30 sec - exiting 10:31:02 (2161): No heartbeat from core client for 30 sec - exiting 10:31:03 (2161): No heartbeat from core client for 30 sec - exiting 10:31:04 (2161): No heartbeat from core client for 30 sec - exiting 10:31:05 (2161): No heartbeat from core client for 30 sec - exiting 10:31:06 (2161): No heartbeat from core client for 30 sec - exiting 10:31:07 (2161): No heartbeat from core client for 30 sec - exiting 10:31:08 (2161): No heartbeat from core client for 30 sec - exiting 10:31:09 (2161): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Signal 15 received, exiting... Called boinc_finish CPDN Monitor - Quit request from BOINC... Signal 15 received, exiting... Called boinc_finish CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Signal 15 received, exiting... Called boinc_finish CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Signal 1 received, exiting... CPDN Monitor - Quit request from BOINC... Signal 15 received, exiting... Called boinc_finish Signal 15 received, exiting... Called boinc_finish CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Signal 15 received, exiting... Called boinc_finish CPDN Monitor - Quit request from BOINC... Signal 3 received, exiting... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
16 Nov 2011 23:05:47	859190	13475924	hadcm3n_u412_1980_40_007459652_2	959,040	1,528,842	1.5941
16 Nov 2011 03:27:27	859190	13475924	hadcm3n_u412_1980_40_007459652_2	933,120	1,494,037	1.6011
15 Nov 2011 18:14:10	859190	13475924	hadcm3n_u412_1980_40_007459652_2	907,200	1,459,266	1.6085
15 Nov 2011 17:07:52	859190	13475924	hadcm3n_u412_1980_40_007459652_2	881,280	1,424,500	1.6164
15 Nov 2011 17:07:51	859190	13475924	hadcm3n_u412_1980_40_007459652_2	855,360	1,389,773	1.6248
15 Nov 2011 17:07:51	859190	13475924	hadcm3n_u412_1980_40_007459652_2	829,440	1,354,991	1.6336
15 Nov 2011 17:07:50	859190	13475924	hadcm3n_u412_1980_40_007459652_2	803,520	1,319,691	1.6424
15 Nov 2011 17:07:51	859190	13475924	hadcm3n_u412_1980_40_007459652_2	777,600	1,285,168	1.6527
15 Nov 2011 17:07:50	859190	13475924	hadcm3n_u412_1980_40_007459652_2	751,680	1,250,564	1.6637
15 Nov 2011 17:07:52	859190	13475924	hadcm3n_u412_1980_40_007459652_2	725,760	1,215,898	1.6753
09 Nov 2011 23:52:21	859190	13475924	hadcm3n_u412_1980_40_007459652_2	699,840	1,181,061	1.6876
09 Nov 2011 03:57:53	859190	13475924	hadcm3n_u412_1980_40_007459652_2	673,920	1,146,259	1.7009
08 Nov 2011 18:06:18	859190	13475924	hadcm3n_u412_1980_40_007459652_2	648,000	1,111,535	1.7153
07 Nov 2011 22:02:10	859190	13475924	hadcm3n_u412_1980_40_007459652_2	622,080	1,076,903	1.7311
07 Nov 2011 02:33:53	859190	13475924	hadcm3n_u412_1980_40_007459652_2	596,160	1,042,006	1.7479
06 Nov 2011 08:51:13	859190	13475924	hadcm3n_u412_1980_40_007459652_2	570,240	1,007,211	1.7663
05 Nov 2011 21:38:53	859190	13475924	hadcm3n_u412_1980_40_007459652_2	544,320	972,285	1.7862
05 Nov 2011 10:41:57	859190	13475924	hadcm3n_u412_1980_40_007459652_2	518,400	937,670	1.8088
05 Nov 2011 00:33:17	859190	13475924	hadcm3n_u412_1980_40_007459652_2	492,480	903,092	1.8338
04 Nov 2011 03:44:53	859190	13475924	hadcm3n_u412_1980_40_007459652_2	466,560	868,355	1.8612