Task 12821416

Name	hadcm3n_p2fv_1900_40_007220747_0
Workunit	7418987
Created	26 Apr 2011, 15:21:06 UTC
Sent	2 May 2011, 13:30:33 UTC
Report deadline	1 Aug 2011, 20:57:44 UTC
Received	19 Jul 2011, 18:29:41 UTC
Server state	Over
Outcome	Success
Client state	Done
Exit status	0 (0x00000000)
Computer ID	1144202
Run time	11 days 6 hours 44 min 7 sec
CPU time	10 days 18 hours 42 min 46 sec
Validate state	Valid
Credit	12,441.60
Device peak FLOPS	3.92 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>6.12.33</core_client_version> <![CDATA[ <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7288, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN proceCPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 23:44:03 (6616): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:51:06 (9400): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:51:07 (9400): No heartbeat from core client for 30 sec - exiting 00:44:56 (10512): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:44:57 (10512): No heartbeat from core client for 30 sec - exiting 00:44:58 (10512): No heartbeat from core client for 30 sec - exiting 00:44:59 (10512): No heartbeat from core client for 30 sec - exiting 00:45:00 (10512): No heartbeat from core client for 30 sec - exiting 00:45:01 (10512): No heartbeat from core client for 30 sec - exiting 04:15:19 (10412): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:15:20 (10412): No heartbeat from core client for 30 sec - exiting 04:15:21 (10412): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=8412, selfPID=8412, iMonCtr=1 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 Error converting file to netcdf: dataout/p2fvko.pja5c10 CPDN Monitor - Quit request from BOINC... BUFFIN: C I/O Error feof - Unit 63 - Return code = 16 BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 BUFFIN: C I/O Error feof - Unit 65 - Return code = 16 BUFFIN: C I/O Error feof - Unit 66 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 Error converting file to netcdf: dataout/p2fvko.pja5c10 Error converting file to netcdf: dataout/p2fvko.pia5c10 Error converting file to netcdf: dataout/p2fvko.pfa5c10 Error converting file to netcdf: dataout/p2fvka.pha5c10 Error converting file to netcdf: dataout/p2fvka.pga5c10 Error converting file to netcdf: dataout/p2fvka.pea5c10 Error converting file to netcdf: dataout/p2fvka.pda5c10 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1796, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=9680, iMonCtr=1 Model crash detected, will try to restart... CCPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 10:47:34 (10028): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5968, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6788, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 12:45:32 (8388): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 20:02:49 (7760): No heartbeat from core client for 30 sec - exiting 20:02:50 (7760): No heartbeat from core client for 30 sec - exiting 20:02:51 (7760): No heartbeat from core client for 30 sec - exiting 20:02:52 (7760): No heartbeat from core client for 30 sec - exiting 20:02:53 (7760): No heartbeat from core client for 30 sec - exiting 20:02:54 (7760): No heartbeat from core client for 30 sec - exiting 20:02:55 (7760): No heartbeat from core client for 30 sec - exiting 20:02:56 (7760): No heartbeat from core client for 30 sec - exiting 20:02:57 (7760): No heartbeat from core client for 30 sec - exiting 20:02:58 (7760): No heartbeat from core client for 30 sec - exiting 20:02:59 (7760): No heartbeat from core client for 30 sec - exiting 20:03:00 (7760): No heartbeat from core client for 30 sec - exiting 20:03:01 (7760): No heartbeat from core client for 30 sec - exiting 20:03:02 (7760): No heartbeat from core client for 30 sec - exiting 20:03:03 (7760): No heartbeat from core client for 30 sec - exiting 20:03:04 (7760): No heartbeat from core client for 30 sec - exiting 20:03:05 (7760): No heartbeat from core client for 30 sec - exiting 20:03:06 (7760): No heartbeat from core client for 30 sec - exiting 20:03:07 (7760): No heartbeat from core client for 30 sec - exiting 20:03:08 (7760): No heartbeat from core client for 30 sec - exiting 20:03:09 (7760): No heartbeat from core client for 30 sec - exiting 20:03:10 (7760): No heartbeat from core client for 30 sec - exiting 20:03:11 (7760): No heartbeat from core client for 30 sec - exiting 20:03:12 (7760): No heartbeat from core client for 30 sec - exiting 20:03:13 (7760): No heartbeat from core client for 30 sec - exiting 20:03:14 (7760): No heartbeat from core client for 30 sec - exiting 20:03:15 (7760): No heartbeat from core client for 30 sec - exiting 20:03:16 (7760): No heartbeat from core client for 30 sec - exiting 20:03:17 (7760): No heartbeat from core client for 30 sec - exiting 20:03:18 (7760): No heartbeat from core client for 30 sec - exiting 20:03:19 (7760): No heartbeat from core client for 30 sec - exiting 20:03:20 (7760): No heartbeat from core client for 30 sec - exiting 20:03:21 (7760): No heartbeat from core client for 30 sec - exiting 20:03:22 (7760): No heartbeat from core client for 30 sec - exiting 20:03:23 (7760): No heartbeat from core client for 30 sec - exiting 20:03:24 (7760): No heartbeat from core client for 30 sec - exiting 20:03:25 (7760): No heartbeat from core client for 30 sec - exiting 20:03:26 (7760): No heartbeat from core client for 30 sec - exiting 20:03:27 (7760): No heartbeat from core client for 30 sec - exiting 20:03:28 (7760): No heartbeat from core client for 30 sec - exiting 20:03:29 (7760): No heartbeat from core client for 30 sec - exiting 20:03:30 (7760): No heartbeat from core client for 30 sec - exiting 20:03:31 (7760): No heartbeat from core client for 30 sec - exiting 20:03:32 (7760): No heartbeat from core client for 30 sec - exiting 20:03:33 (7760): No heartbeat from core client for 30 sec - exiting 20:03:34 (7760): No heartbeat from core client for 30 sec - exiting 20:03:35 (7760): No heartbeat from core client for 30 sec - exiting 20:03:36 (7760): No heartbeat from core client for 30 sec - exiting 20:03:37 (7760): No heartbeat from core client for 30 sec - exiting 20:03:38 (7760): No heartbeat from core client for 30 sec - exiting 20:03:39 (7760): No heartbeat from core client for 30 sec - exiting 20:03:40 (7760): No heartbeat from core client for 30 sec - exiting 20:03:41 (7760): No heartbeat from core client for 30 sec - exiting 20:03:42 (7760): No heartbeat from core client for 30 sec - exiting 20:03:43 (7760): No heartbeat from core client for 30 sec - exiting 20:03:44 (7760): No heartbeat from core client for 30 sec - exiting 20:03:45 (7760): No heartbeat from core client for 30 sec - exiting 20:03:46 (7760): No heartbeat from core client for 30 sec - exiting 20:03:47 (7760): No heartbeat from core client for 30 sec - exiting 20:03:48 (7760): No heartbeat from core client for 30 sec - exiting 20:03:49 (7760): No heartbeat from core client for 30 sec - exiting 20:03:50 (7760): No heartbeat from core client for 30 sec - exiting 20:03:51 (7760): No heartbeat from core client for 30 sec - exiting 20:03:52 (7760): No heartbeat from core client for 30 sec - exiting 20:03:53 (7760): No heartbeat from core client for 30 sec - exiting 20:03:54 (7760): No heartbeat from core client for 30 sec - exiting 20:03:55 (7760): No heartbeat from core client for 30 sec - exiting 20:03:56 (7760): No heartbeat from core client for 30 sec - exiting 20:03:57 (7760): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 17:16:46 (8696): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3852, iMonCtr=1 Model crash detected, will try to restart... 07:28:35 (7296): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:33:13 (4780): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:36:24 (9544): No heartbeat from core client for 30 sec - exiting 07:36:25 (9544): No heartbeat from core client for 30 sec - exiting 07:36:26 (9544): No heartbeat from core client for 30 sec - exiting 07:36:27 (9544): No heartbeat from core client for 30 sec - exiting 07:36:28 (9544): No heartbeat from core client for 30 sec - exiting 07:36:29 (9544): No heartbeat from core client for 30 sec - exiting 07:36:30 (9544): No heartbeat from core client for 30 sec - exiting 07:36:31 (9544): No heartbeat from core client for 30 sec - exiting 07:36:32 (9544): No heartbeat from core client for 30 sec - exiting 07:36:33 (9544): No heartbeat from core client for 30 sec - exiting 07:36:34 (9544): No heartbeat from core client for 30 sec - exiting 07:36:35 (9544): No heartbeat from core client for 30 sec - exiting 07:36:36 (9544): No heartbeat from core client for 30 sec - exiting 07:36:37 (9544): No heartbeat from core client for 30 sec - exiting 07:36:38 (9544): No heartbeat from core client for 30 sec - exiting 07:36:39 (9544): No heartbeat from core client for 30 sec - exiting 07:36:40 (9544): No heartbeat from core client for 30 sec - exiting 07:36:41 (9544): No heartbeat from core client for 30 sec - exiting 07:36:42 (9544): No heartbeat from core client for 30 sec - exiting 07:36:43 (9544): No heartbeat from core client for 30 sec - exiting 07:36:44 (9544): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:40:17 (7988): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:42:56 (1092): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:46:07 (8648): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:48:27 (10396): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:45:34 (8808): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:51:48 (1152): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:55:29 (11180): No heartbeat from core client for 30 sec - exiting 16:55:30 (11180): No heartbeat from core client for 30 sec - exiting 16:55:31 (11180): No heartbeat from core client for 30 sec - exiting 16:55:32 (11180): No heartbeat from core client for 30 sec - exiting 16:55:33 (11180): No heartbeat from core client for 30 sec - exiting 16:55:34 (11180): No heartbeat from core client for 30 sec - exiting 16:55:35 (11180): No heartbeat from core client for 30 sec - exiting 16:55:36 (11180): No heartbeat from core client for 30 sec - exiting 16:55:37 (11180): No heartbeat from core client for 30 sec - exiting 16:55:38 (11180): No heartbeat from core client for 30 sec - exiting 16:55:40 (11180): No heartbeat from core client for 30 sec - exiting 16:55:41 (11180): No heartbeat from core client for 30 sec - exiting 16:55:42 (11180): No heartbeat from core client for 30 sec - exiting 16:55:43 (11180): No heartbeat from core client for 30 sec - exiting 16:55:44 (11180): No heartbeat from core client for 30 sec - exiting 16:55:45 (11180): No heartbeat from core client for 30 sec - exiting 16:55:46 (11180): No heartbeat from core client for 30 sec - exiting 16:55:47 (11180): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1620, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=8356, iMonCtr=1 Model crash detected, will try to restart... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
25 Jul 2011 18:11:28	1144202	12821416	hadcm3n_p2fv_1900_40_007220747_0	1,036,800	931,325	0.8983
25 Jul 2011 16:21:33	1144202	12821416	hadcm3n_p2fv_1900_40_007220747_0	1,010,880	908,244	0.8985
25 Jul 2011 16:06:05	1144202	12821416	hadcm3n_p2fv_1900_40_007220747_0	984,960	885,513	0.8990
25 Jul 2011 15:36:40	1144202	12821416	hadcm3n_p2fv_1900_40_007220747_0	959,040	861,653	0.8985
25 Jul 2011 14:41:31	1144202	12821416	hadcm3n_p2fv_1900_40_007220747_0	933,120	834,464	0.8943
08 Jul 2011 14:23:54	1144202	12821416	hadcm3n_p2fv_1900_40_007220747_0	907,200	806,287	0.8888
28 Jun 2011 07:33:20	1144202	12821416	hadcm3n_p2fv_1900_40_007220747_0	881,280	777,163	0.8819
20 Jun 2011 10:10:46	1144202	12821416	hadcm3n_p2fv_1900_40_007220747_0	855,360	753,454	0.8809
11 Jun 2011 00:21:05	1144202	12821416	hadcm3n_p2fv_1900_40_007220747_0	829,440	730,613	0.8809
05 Jun 2011 20:34:35	1144202	12821416	hadcm3n_p2fv_1900_40_007220747_0	803,520	710,901	0.8847
05 Jun 2011 15:28:02	1144202	12821416	hadcm3n_p2fv_1900_40_007220747_0	777,600	690,049	0.8874
03 Jun 2011 15:52:12	1144202	12821416	hadcm3n_p2fv_1900_40_007220747_0	751,680	665,421	0.8852
02 Jun 2011 15:52:34	1144202	12821416	hadcm3n_p2fv_1900_40_007220747_0	725,760	642,781	0.8857
02 Jun 2011 09:03:09	1144202	12821416	hadcm3n_p2fv_1900_40_007220747_0	699,840	619,036	0.8845
31 May 2011 18:22:45	1144202	12821416	hadcm3n_p2fv_1900_40_007220747_0	673,920	594,260	0.8818
29 May 2011 19:03:41	1144202	12821416	hadcm3n_p2fv_1900_40_007220747_0	648,000	569,691	0.8792
27 May 2011 16:57:47	1144202	12821416	hadcm3n_p2fv_1900_40_007220747_0	622,080	547,033	0.8794
20 May 2011 05:47:20	1144202	12821416	hadcm3n_p2fv_1900_40_007220747_0	596,160	523,276	0.8777
19 May 2011 19:26:07	1144202	12821416	hadcm3n_p2fv_1900_40_007220747_0	570,240	496,051	0.8699
18 May 2011 16:58:09	1144202	12821416	hadcm3n_p2fv_1900_40_007220747_0	544,320	472,157	0.8674