Task 16053085

Name	hadcm3n_o2gz_1940_40_008395613_1
Workunit	8546472
Created	2 Oct 2013, 3:13:30 UTC
Sent	2 Oct 2013, 3:53:03 UTC
Report deadline	1 Jan 2014, 11:20:14 UTC
Received	27 Nov 2013, 14:57:30 UTC
Server state	Over
Outcome	Success
Client state	Done
Exit status	0 (0x00000000)
Computer ID	1149310
Run time	27 days 13 hours 36 min 3 sec
CPU time	24 days 6 hours 19 min 54 sec
Validate state	Valid
Credit	12,441.60
Device peak FLOPS	1.96 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>7.0.64</core_client_version> <![CDATA[ <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 10:31:24 (5696): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:31:26 (5696): No heartbeat from core client for 30 sec - exiting 10:31:27 (5696): No heartbeat from core client for 30 sec - exiting 10:32:40 (8492): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:36:24 (5552): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:41:30 (7736): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:42:52 (10248): No heartbeat from core client for 30 sec - exiting 10:42:53 (10248): No heartbeat from core client for 30 sec - exiting 10:42:54 (10248): No heartbeat from core client for 30 sec - exiting 10:42:55 (10248): No heartbeat from core client for 30 sec - exiting 10:42:56 (10248): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:46:24 (10060): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:46:27 (10060): No heartbeat from core client for 30 sec - exiting 10:46:28 (10060): No heartbeat from core client for 30 sec - exiting 10:47:50 (2832): No heartbeat from core client for 30 sec - exiting 10:47:51 (2832): No heartbeat from core client for 30 sec - exiting 10:47:52 (2832): No heartbeat from core client for 30 sec - exiting 10:47:53 (2832): No heartbeat from core client for 30 sec - exiting 10:47:54 (2832): No heartbeat from core client for 30 sec - exiting 10:47:55 (2832): No heartbeat from core client for 30 sec - exiting 10:47:56 (2832): No heartbeat from core client for 30 sec - exiting 10:47:57 (2832): No heartbeat from core client for 30 sec - exiting 10:47:58 (2832): No heartbeat from core client for 30 sec - exiting 10:47:59 (2832): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:51:24 (2496): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:51:26 (2496): No heartbeat from core client for 30 sec - exiting 10:51:27 (2496): No heartbeat from core client for 30 sec - exiting 10:53:10 (7660): No heartbeat from core client for 30 sec - exiting 10:53:11 (7660): No heartbeat from core client for 30 sec - exiting 10:53:12 (7660): No heartbeat from core client for 30 sec - exiting 10:53:13 (7660): No heartbeat from core client for 30 sec - exiting 10:53:14 (7660): No heartbeat from core client for 30 sec - exiting 10:53:15 (7660): No heartbeat from core client for 30 sec - exiting 10:53:16 (7660): No heartbeat from core client for 30 sec - exiting 10:53:17 (7660): No heartbeat from core client for 30 sec - exiting 10:53:18 (7660): No heartbeat from core client for 30 sec - exiting 10:53:19 (7660): No heartbeat from core client for 30 sec - exiting 10:53:20 (7660): No heartbeat from core client for 30 sec - exiting 10:53:21 (7660): No heartbeat from core client for 30 sec - exiting 10:53:22 (7660): No heartbeat from core client for 30 sec - exiting 10:53:23 (7660): No heartbeat from core client for 30 sec - exiting 10:53:24 (7660): No heartbeat from core client for 30 sec - exiting 10:53:25 (7660): No heartbeat from core client for 30 sec - exiting 10:53:26 (7660): No heartbeat from core client for 30 sec - exiting 10:53:27 (7660): No heartbeat from core client for 30 sec - exiting 10:53:28 (7660): No heartbeat from core client for 30 sec - exiting 10:53:29 (7660): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:53:30 (7660): No heartbeat from core client for 30 sec - exiting 10:56:26 (8944): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:56:28 (8944): No heartbeat from core client for 30 sec - exiting 10:56:29 (8944): No heartbeat from core client for 30 sec - exiting 11:01:25 (11032): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:01:26 (11032): No heartbeat from core client for 30 sec - exiting 11:01:27 (11032): No heartbeat from core client for 30 sec - exiting 11:03:17 (10784): No heartbeat from core client for 30 sec - exiting 11:03:18 (10784): No heartbeat from core client for 30 sec - exiting 11:03:19 (10784): No heartbeat from core client for 30 sec - exiting 11:03:20 (10784): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 11:06:02 (8844): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... 22:32:08 (10432): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 01:37:21 (10116): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:24:13 (12852): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 04:49:42 (15164): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 16:43:21 (7036): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 01:56:21 (6240): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=13172, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6500, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... 11:20:44 (6492): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... BUFFIN: C I/O Error feof - Unit 63 - Return code = 16 BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 BUFFIN: C I/O Error feof - Unit 65 - Return code = 16 BUFFIN: C I/O Error feof - Unit 66 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 Error converting file to netcdf: dataout/o2gzko.pjf8c10 Error converting file to netcdf: dataout/o2gzko.pif8c10 Error converting file to netcdf: dataout/o2gzko.pff8c10 Error converting file to netcdf: dataout/o2gzka.phf8c10 Error converting file to netcdf: dataout/o2gzka.pgf8c10 Error converting file to netcdf: dataout/o2gzka.pef8c10 Error converting file to netcdf: dataout/o2gzka.pdf8c10 23:26:42 (8484): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 16:14:13 (7576): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 14:27:47 (12436): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 11:57:36 (27236): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:44:00 (31484): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 11:47:35 (14568): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:02:02 (13264): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 14:25:29 (10932): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:20:40 (6536): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:33:29 (1140): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:37:49 (9528): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 10:42:22 (11908): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:42:24 (11908): No heartbeat from core client for 30 sec - exiting 10:42:25 (11908): No heartbeat from core client for 30 sec - exiting 10:47:22 (12644): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:47:24 (12644): No heartbeat from core client for 30 sec - exiting 10:52:23 (15236): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:52:26 (15236): No heartbeat from core client for 30 sec - exiting 10:52:27 (15236): No heartbeat from core client for 30 sec - exiting 10:52:28 (15236): No heartbeat from core client for 30 sec - exiting 10:57:26 (14224): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:01:37 (14340): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 00:14:00 (15060): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Atmos Hold Restart file rename failed on atmos_restart.hold 00:44:34 (12716): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 22:32:14 (4176): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 01:09:23 (1004): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:00:34 (8884): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 11:01:18 (9308): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
27 Nov 2013 15:00:59	1149310	16053085	hadcm3n_o2gz_1940_40_008395613_1	1,036,800	2,095,756	2.0214
26 Nov 2013 12:40:03	1149310	16053085	hadcm3n_o2gz_1940_40_008395613_1	1,010,880	2,045,051	2.0230
25 Nov 2013 21:27:37	1149310	16053085	hadcm3n_o2gz_1940_40_008395613_1	984,960	1,995,683	2.0262
24 Nov 2013 13:02:36	1149310	16053085	hadcm3n_o2gz_1940_40_008395613_1	959,040	1,947,090	2.0302
23 Nov 2013 20:08:43	1149310	16053085	hadcm3n_o2gz_1940_40_008395613_1	933,120	1,897,098	2.0331
22 Nov 2013 18:35:59	1149310	16053085	hadcm3n_o2gz_1940_40_008395613_1	907,200	1,847,482	2.0365
22 Nov 2013 01:23:20	1149310	16053085	hadcm3n_o2gz_1940_40_008395613_1	881,280	1,798,889	2.0412
21 Nov 2013 10:58:13	1149310	16053085	hadcm3n_o2gz_1940_40_008395613_1	855,360	1,750,509	2.0465
19 Nov 2013 21:23:25	1149310	16053085	hadcm3n_o2gz_1940_40_008395613_1	829,440	1,700,608	2.0503
19 Nov 2013 05:28:15	1149310	16053085	hadcm3n_o2gz_1940_40_008395613_1	803,520	1,651,406	2.0552
17 Nov 2013 08:03:14	1149310	16053085	hadcm3n_o2gz_1940_40_008395613_1	777,600	1,599,889	2.0575
16 Nov 2013 04:39:24	1149310	16053085	hadcm3n_o2gz_1940_40_008395613_1	751,680	1,546,257	2.0571
15 Nov 2013 11:16:20	1149310	16053085	hadcm3n_o2gz_1940_40_008395613_1	725,760	1,493,567	2.0579
13 Nov 2013 15:43:04	1149310	16053085	hadcm3n_o2gz_1940_40_008395613_1	699,840	1,441,686	2.0600
12 Nov 2013 23:19:08	1149310	16053085	hadcm3n_o2gz_1940_40_008395613_1	673,920	1,389,544	2.0619
12 Nov 2013 08:01:40	1149310	16053085	hadcm3n_o2gz_1940_40_008395613_1	648,000	1,338,132	2.0650
11 Nov 2013 15:27:28	1149310	16053085	hadcm3n_o2gz_1940_40_008395613_1	622,080	1,286,210	2.0676
10 Nov 2013 10:28:19	1149310	16053085	hadcm3n_o2gz_1940_40_008395613_1	596,160	1,241,663	2.0828
07 Nov 2013 16:31:20	1149310	16053085	hadcm3n_o2gz_1940_40_008395613_1	570,240	1,189,540	2.0860
06 Nov 2013 08:37:32	1149310	16053085	hadcm3n_o2gz_1940_40_008395613_1	544,320	1,137,834	2.0904