Task 12746265

Name	hadcm3n_o5jw_1900_40_007202527_1
Workunit	7400807
Created	28 Mar 2011, 14:14:00 UTC
Sent	29 Mar 2011, 19:19:11 UTC
Report deadline	29 Jun 2011, 2:46:22 UTC
Received	27 Sep 2011, 8:44:36 UTC
Server state	Over
Outcome	Computation error
Client state	Aborted by user
Exit status	-197 (0xFFFFFF3B) ERR_ABORTED_VIA_GUI
Computer ID	1069880
Run time	10 days 3 hours 27 min 27 sec
CPU time	10 days 3 hours 27 min 27 sec
Validate state	Invalid
Credit	5,909.76
Device peak FLOPS	2.80 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>6.10.18</core_client_version> <![CDATA[ <message> aborted by user </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 13:10:56 (5016): No heartbeat from core client for 30 sec - exiting 13:10:57 (5016): No heartbeat from core client for 30 sec - exiting 13:10:58 (5016): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:10:59 (5016): No heartbeat from core client for 30 sec - exiting 13:11:00 (5016): No heartbeat from core client for 30 sec - exiting 13:11:02 (5016): No heartbeat from core client for 30 sec - exiting 13:11:03 (5016): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... 21:36:59 (2312): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 17:10:41 (380): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 17:58:05 (5972): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 14:00:05 (1276): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Atmos Hold Restart file rename failed on atmos_restart.hold CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 10:00:26 (5092): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:00:27 (5092): No heartbeat from core client for 30 sec - exiting 10:00:28 (5092): No heartbeat from core client for 30 sec - exiting 10:00:29 (5092): No heartbeat from core client for 30 sec - exiting 10:00:30 (5092): No heartbeat from core client for 30 sec - exiting 10:00:31 (5092): No heartbeat from core client for 30 sec - exiting 10:00:32 (5092): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... 07:58:37 (4672): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 14:04:24 (1000): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:04:25 (1000): No heartbeat from core client for 30 sec - exiting 14:04:26 (1000): No heartbeat from core client for 30 sec - exiting 14:04:27 (1000): No heartbeat from core client for 30 sec - exiting 14:04:28 (1000): No heartbeat from core client for 30 sec - exiting 14:04:29 (1000): No heartbeat from core client for 30 sec - exiting 14:04:30 (1000): No heartbeat from core client for 30 sec - exiting 14:04:31 (1000): No heartbeat from core client for 30 sec - exiting 14:04:33 (1000): No heartbeat from core client for 30 sec - exiting 14:04:34 (1000): No heartbeat from core client for 30 sec - exiting 14:04:35 (1000): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 13:36:40 (4388): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:38:28 (2484): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:38:29 (2484): No heartbeat from core client for 30 sec - exiting 11:39:36 (4348): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3096, iMonCtr=1 Model crash detected, will try to restart... 16:31:05 (4872): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:42:13 (4832): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4332, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... 18:55:55 (5008): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 15:09:36 (776): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:12:53 (5060): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 21:59:28 (2844): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:00:37 (4600): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 10:58:14 (4836): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:58:15 (4836): No heartbeat from core client for 30 sec - exiting 10:58:16 (4836): No heartbeat from core client for 30 sec - exiting 10:59:52 (4236): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 15:04:12 (4188): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:19:46 (4764): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5080, iMonCtr=1 Model crash detected, will try to restart... 18:58:22 (3332): No heartbeat from core client for 30 sec - exiting 18:58:23 (3332): No heartbeat from core client for 30 sec - exiting 18:58:24 (3332): No heartbeat from core client for 30 sec - exiting 18:58:25 (3332): No heartbeat from core client for 30 sec - exiting 18:58:26 (3332): No heartbeat from core client for 30 sec - exiting 18:58:27 (3332): No heartbeat from core client for 30 sec - exiting 18:58:28 (3332): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:58:29 (3332): No heartbeat from core client for 30 sec - exiting 18:58:30 (3332): No heartbeat from core client for 30 sec - exiting 18:58:32 (3332): No heartbeat from core client for 30 sec - exiting 18:58:33 (3332): No heartbeat from core client for 30 sec - exiting 18:58:34 (3332): No heartbeat from core client for 30 sec - exiting 18:58:35 (3332): No heartbeat from core client for 30 sec - exiting 18:58:36 (3332): No heartbeat from core client for 30 sec - exiting 18:58:37 (3332): No heartbeat from core client for 30 sec - exiting 18:58:38 (3332): No heartbeat from core client for 30 sec - exiting 18:58:39 (3332): No heartbeat from core client for 30 sec - exiting 19:01:14 (4300): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:11:19 (3176): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:09:57 (5008): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:10:47 (3852): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:04:39 (5108): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 00:10:09 (6756): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:57:15 (4892): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 15:00:44 (5000): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:50:20 (4500): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:50:21 (4500): No heartbeat from core client for 30 sec - exiting 20:50:22 (4500): No heartbeat from core client for 30 sec - exiting 09:53:10 (3928): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 15:04:46 (4376): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... C10:58:24 (3852): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:00:00 (760): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:10:20 (4980): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:36:00 (728): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:36:47 (4060): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... C09:16:48 (4260): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:24:03 (4924): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:25:04 (4660): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:26:51 (3028): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:29:31 (5768): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 02:59:01 (5488): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:01:48 (5916): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 23:35:13 (4556): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:36:13 (3412): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:38:16 (4780): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:29:35 (4336): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:30:50 (4068): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:32:56 (2764): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:35:48 (3800): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:40:11 (4552): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:24:41 (2136): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... BUFFIN: C I/O Error feof - Unit 63 - Return code = 16 BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 BUFFIN: C I/O Error feof - Unit 65 - Return code = 16 BUFFIN: C I/O Error feof - Unit 66 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 Error converting file to netcdf: dataout/o5jwko.pjb9c10 Error converting file to netcdf: dataout/o5jwko.pib9c10 Error converting file to netcdf: dataout/o5jwko.pfb9c10 Error converting file to netcdf: dataout/o5jwka.phb9c10 Error converting file to netcdf: dataout/o5jwka.pgb9c10 Error converting file to netcdf: dataout/o5jwka.peb9c10 Error converting file to netcdf: dataout/o5jwka.pdb9c10 21:21:27 (4388): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:22:54 (4392): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:25:00 (2948): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 18:17:58 (4312): No heartbeat from core client for 30 sec - exiting 18:17:59 (4312): No heartbeat from core client for 30 sec - exiting 18:18:00 (4312): No heartbeat from core client for 30 sec - exiting 18:18:01 (4312): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1720, iMonCtr=1 Model crash detected, will try to restart... 09:40:14 (4776): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Abort request from BOINC... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
26 Sep 2011 09:15:05	1069880	12746265	hadcm3n_o5jw_1900_40_007202527_1	492,480	844,922	1.7156
26 Sep 2011 09:15:05	1069880	12746265	hadcm3n_o5jw_1900_40_007202527_1	466,560	813,451	1.7435
26 Sep 2011 09:15:05	1069880	12746265	hadcm3n_o5jw_1900_40_007202527_1	440,640	782,075	1.7749
26 Sep 2011 09:15:05	1069880	12746265	hadcm3n_o5jw_1900_40_007202527_1	414,720	747,710	1.8029
26 Sep 2011 09:15:05	1069880	12746265	hadcm3n_o5jw_1900_40_007202527_1	388,800	712,632	1.8329
26 Sep 2011 09:15:05	1069880	12746265	hadcm3n_o5jw_1900_40_007202527_1	362,880	674,417	1.8585
21 Sep 2011 09:16:48	1069880	12746265	hadcm3n_o5jw_1900_40_007202527_1	336,960	626,823	1.8602
20 Sep 2011 10:59:42	1069880	12746265	hadcm3n_o5jw_1900_40_007202527_1	311,040	579,551	1.8633
19 Sep 2011 09:38:37	1069880	12746265	hadcm3n_o5jw_1900_40_007202527_1	285,120	532,383	1.8672
18 Sep 2011 09:42:47	1069880	12746265	hadcm3n_o5jw_1900_40_007202527_1	259,200	482,841	1.8628
16 Sep 2011 18:35:57	1069880	12746265	hadcm3n_o5jw_1900_40_007202527_1	233,280	432,085	1.8522
15 Sep 2011 19:21:30	1069880	12746265	hadcm3n_o5jw_1900_40_007202527_1	207,360	381,276	1.8387
14 Sep 2011 12:59:38	1069880	12746265	hadcm3n_o5jw_1900_40_007202527_1	181,440	330,296	1.8204
13 Sep 2011 12:27:44	1069880	12746265	hadcm3n_o5jw_1900_40_007202527_1	155,520	280,931	1.8064
31 Jul 2011 15:24:53	1069880	12746265	hadcm3n_o5jw_1900_40_007202527_1	129,600	231,699	1.7878
29 Jul 2011 10:53:43	1069880	12746265	hadcm3n_o5jw_1900_40_007202527_1	103,680	185,652	1.7906
28 Jul 2011 11:17:16	1069880	12746265	hadcm3n_o5jw_1900_40_007202527_1	77,760	139,314	1.7916
07 Jul 2011 17:56:36	1069880	12746265	hadcm3n_o5jw_1900_40_007202527_1	51,840	95,273	1.8378
03 Jun 2011 15:26:59	1069880	12746265	hadcm3n_o5jw_1900_40_007202527_1	25,920	48,978	1.8896