Task 13022364

Name	hadcm3n_t2rx_1940_40_007314814_1
Workunit	7512244
Created	28 Jun 2011, 18:05:41 UTC
Sent	28 Jun 2011, 18:10:06 UTC
Report deadline	28 Sep 2011, 1:37:17 UTC
Received	13 Aug 2011, 18:45:17 UTC
Server state	Over
Outcome	Success
Client state	Done
Exit status	0 (0x00000000)
Computer ID	1091364
Run time	18 days 4 hours 25 min 19 sec
CPU time	15 days 19 hours 13 min 52 sec
Validate state	Valid
Credit	12,441.60
Device peak FLOPS	2.97 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>6.12.33</core_client_version> <![CDATA[ <stderr_txt> Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4392, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4392, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4392, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2548, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2548, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2548, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4516, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4516, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4516, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4628, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4628, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4628, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4628, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4628, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4576, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4360, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4360, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4360, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4360, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4472, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4472, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4472, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4472, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4688, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4688, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4688, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4688, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4276, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4276, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4276, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4276, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4964, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4964, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4964, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 10:03:48 (4448): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... 10:03:53 (4448): No heartbeat from core client for 30 sec - exiting 10:03:55 (4448): No heartbeat from core client for 30 sec - exiting 10:03:56 (4448): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
13 Aug 2011 17:54:48	1091364	13022364	hadcm3n_t2rx_1940_40_007314814_1	1,036,800	1,364,693	1.3163
12 Aug 2011 19:26:37	1091364	13022364	hadcm3n_t2rx_1940_40_007314814_1	1,010,880	1,331,451	1.3171
12 Aug 2011 08:56:12	1091364	13022364	hadcm3n_t2rx_1940_40_007314814_1	984,960	1,299,347	1.3192
11 Aug 2011 14:40:05	1091364	13022364	hadcm3n_t2rx_1940_40_007314814_1	959,040	1,266,977	1.3211
10 Aug 2011 17:49:42	1091364	13022364	hadcm3n_t2rx_1940_40_007314814_1	933,120	1,234,670	1.3232
09 Aug 2011 17:48:27	1091364	13022364	hadcm3n_t2rx_1940_40_007314814_1	907,200	1,201,065	1.3239
08 Aug 2011 21:08:32	1091364	13022364	hadcm3n_t2rx_1940_40_007314814_1	881,280	1,168,507	1.3259
08 Aug 2011 10:46:58	1091364	13022364	hadcm3n_t2rx_1940_40_007314814_1	855,360	1,137,434	1.3298
07 Aug 2011 09:33:43	1091364	13022364	hadcm3n_t2rx_1940_40_007314814_1	829,440	1,105,338	1.3326
06 Aug 2011 12:21:44	1091364	13022364	hadcm3n_t2rx_1940_40_007314814_1	803,520	1,073,083	1.3355
05 Aug 2011 14:17:28	1091364	13022364	hadcm3n_t2rx_1940_40_007314814_1	777,600	1,041,035	1.3388
04 Aug 2011 18:47:14	1091364	13022364	hadcm3n_t2rx_1940_40_007314814_1	751,680	1,009,090	1.3424
04 Aug 2011 08:03:57	1091364	13022364	hadcm3n_t2rx_1940_40_007314814_1	725,760	975,841	1.3446
03 Aug 2011 08:22:36	1091364	13022364	hadcm3n_t2rx_1940_40_007314814_1	699,840	940,455	1.3438
31 Jul 2011 16:16:09	1091364	13022364	hadcm3n_t2rx_1940_40_007314814_1	673,920	904,907	1.3428
30 Jul 2011 20:35:46	1091364	13022364	hadcm3n_t2rx_1940_40_007314814_1	648,000	870,136	1.3428
29 Jul 2011 15:18:32	1091364	13022364	hadcm3n_t2rx_1940_40_007314814_1	622,080	834,600	1.3416
28 Jul 2011 15:34:15	1091364	13022364	hadcm3n_t2rx_1940_40_007314814_1	596,160	799,502	1.3411
27 Jul 2011 19:12:27	1091364	13022364	hadcm3n_t2rx_1940_40_007314814_1	570,240	764,240	1.3402
27 Jul 2011 08:26:10	1091364	13022364	hadcm3n_t2rx_1940_40_007314814_1	544,320	730,285	1.3416