Task 13151439

Name	hadam3p_pnw_2xkh_2000_1_007364030_0
Workunit	7561460
Created	23 Jul 2011, 10:16:43 UTC
Sent	27 Jul 2011, 14:53:42 UTC
Report deadline	8 Jul 2012, 20:13:42 UTC
Received	12 Oct 2011, 22:34:55 UTC
Server state	Over
Outcome	Success
Client state	Done
Exit status	0 (0x00000000)
Computer ID	1149987
Run time	4 days 10 hours 27 min 23 sec
CPU time	4 days 8 hours 3 min 56 sec
Validate state	Initial
Credit	3,005.92
Device peak FLOPS	2.76 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Pacific North West v6.09 windows_intelx86
Stderr	<core_client_version>6.12.26</core_client_version> <![CDATA[ <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5992, selfPID=5992, iMonCtr=2 CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5648, selfPID=5648, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6032, selfPID=6032, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6108, selfPID=5844, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5760, iMonCtr=2 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CController:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5280, selfPID=4072, iMonCtr=1 Model crash detected, will try to restart... 18:53:52 (4512): No heartbeat from core client for 30 sec - exiting 18:53:54 (4512): No heartbeat from core client for 30 sec - exiting 18:53:55 (4512): No heartbeat from core client for 30 sec - exiting 18:53:56 (4512): No heartbeat from core client for 30 sec - exiting 18:53:57 (4512): No heartbeat from core client for 30 sec - exiting 18:53:58 (4512): No heartbeat from core client for 30 sec - exiting 18:53:59 (4512): No heartbeat from core client for 30 sec - exiting 18:54:00 (4512): No heartbeat from core client for 30 sec - exiting 18:54:01 (4512): No heartbeat from core client for 30 sec - exiting 18:54:02 (4512): No heartbeat from core client for 30 sec - exiting 18:54:03 (4512): No heartbeat from core client for 30 sec - exiting 18:54:04 (4512): No heartbeat from core client for 30 sec - exiting 18:54:05 (4512): No heartbeat from core client for 30 sec - exiting 18:54:40 (4512): No heartbeat from core client for 30 sec - exiting 18:54:41 (4512): No heartbeat from core client for 30 sec - exiting 18:54:42 (4512): No heartbeat from core client for 30 sec - exiting 18:54:43 (4512): No heartbeat from core client for 30 sec - exiting 18:54:44 (4512): No heartbeat from core client for 30 sec - exiting 18:54:45 (4512): No heartbeat from core client for 30 sec - exiting 18:54:46 (4512): No heartbeat from core client for 30 sec - exiting 18:54:47 (4512): No heartbeat from core client for 30 sec - exiting 18:54:48 (4512): No heartbeat from core client for 30 sec - exiting 18:54:49 (4512): No heartbeat from core client for 30 sec - exiting 18:54:51 (4512): No heartbeat from core client for 30 sec - exiting 18:54:52 (4512): No heartbeat from core client for 30 sec - exiting 18:54:53 (4512): No heartbeat from core client for 30 sec - exiting 18:54:54 (4512): No heartbeat from core client for 30 sec - exiting 18:54:55 (4512): No heartbeat from core client for 30 sec - exiting 18:54:56 (4512): No heartbeat from core client for 30 sec - exiting 18:54:57 (4512): No heartbeat from core client for 30 sec - exiting 18:54:58 (4512): No heartbeat from core client for 30 sec - exiting 18:54:59 (4512): No heartbeat from core client for 30 sec - exiting 18:55:00 (4512): No heartbeat from core client for 30 sec - exiting 18:55:01 (4512): No heartbeat from core client for 30 sec - exiting 18:55:03 (4512): No heartbeat from core client for 30 sec - exiting 18:55:04 (4512): No heartbeat from core client for 30 sec - exiting 18:55:05 (4512): No heartbeat from core client for 30 sec - exiting 18:55:06 (4512): No heartbeat from core client for 30 sec - exiting 18:55:07 (4512): No heartbeat from core client for 30 sec - exiting 18:55:08 (4512): No heartbeat from core client for 30 sec - exiting 18:55:09 (4512): No heartbeat from core client for 30 sec - exiting 18:55:10 (4512): No heartbeat from core client for 30 sec - exiting 18:55:11 (4512): No heartbeat from core client for 30 sec - exiting 18:55:12 (4512): No heartbeat from core client for 30 sec - exiting 18:55:13 (4512): No heartbeat from core client for 30 sec - exiting 18:55:15 (4512): No heartbeat from core client for 30 sec - exiting 18:55:16 (4512): No heartbeat from core client for 30 sec - exiting 18:55:17 (4512): No heartbeat from core client for 30 sec - exiting 18:55:18 (4512): No heartbeat from core client for 30 sec - exiting 18:55:19 (4512): No heartbeat from core client for 30 sec - exiting 18:55:20 (4512): No heartbeat from core client for 30 sec - exiting 18:55:21 (4512): No heartbeat from core client for 30 sec - exiting 18:55:22 (4512): No heartbeat from core client for 30 sec - exiting 18:55:23 (4512): No heartbeat from core client for 30 sec - exiting 18:55:24 (4512): No heartbeat from core client for 30 sec - exiting 18:55:25 (4512): No heartbeat from core client for 30 sec - exiting 18:55:27 (4512): No heartbeat from core client for 30 sec - exiting 18:55:28 (4512): No heartbeat from core client for 30 sec - exiting 18:55:29 (4512): No heartbeat from core client for 30 sec - exiting 18:55:30 (4512): No heartbeat from core client for 30 sec - exiting 18:55:31 (4512): No heartbeat from core client for 30 sec - exiting 18:55:32 (4512): No heartbeat from core client for 30 sec - exiting 18:55:33 (4512): No heartbeat from core client for 30 sec - exiting 18:55:34 (4512): No heartbeat from core client for 30 sec - exiting 18:55:35 (4512): No heartbeat from core client for 30 sec - exiting 18:55:36 (4512): No heartbeat from core client for 30 sec - exiting 18:55:37 (4512): No heartbeat from core client for 30 sec - exiting 18:55:39 (4512): No heartbeat from core client for 30 sec - exiting 18:55:40 (4512): No heartbeat from core client for 30 sec - exiting 18:55:41 (4512): No heartbeat from core client for 30 sec - exiting 18:55:42 (4512): No heartbeat from core client for 30 sec - exiting 18:55:43 (4512): No heartbeat from core client for 30 sec - exiting 18:55:44 (4512): No heartbeat from core client for 30 sec - exiting 18:55:45 (4512): No heartbeat from core client for 30 sec - exiting 18:55:46 (4512): No heartbeat from core client for 30 sec - exiting 18:55:47 (4512): No heartbeat from core client for 30 sec - exiting 18:55:48 (4512): No heartbeat from core client for 30 sec - exiting 18:55:49 (4512): No heartbeat from core client for 30 sec - exiting 18:55:51 (4512): No heartbeat from core client for 30 sec - exiting 18:55:52 (4512): No heartbeat from core client for 30 sec - exiting 18:55:53 (4512): No heartbeat from core client for 30 sec - exiting 18:55:54 (4512): No heartbeat from core client for 30 sec - exiting 18:55:55 (4512): No heartbeat from core client for 30 sec - exiting 18:55:56 (4512): No heartbeat from core client for 30 sec - exiting 18:55:57 (4512): No heartbeat from core client for 30 sec - exiting 18:55:58 (4512): No heartbeat from core client for 30 sec - exiting 18:55:59 (4512): No heartbeat from core client for 30 sec - exiting 18:56:00 (4512): No heartbeat from core client for 30 sec - exiting 18:56:01 (4512): No heartbeat from core client for 30 sec - exiting 18:56:03 (4512): No heartbeat from core client for 30 sec - exiting 18:56:04 (4512): No heartbeat from core client for 30 sec - exiting 18:56:05 (4512): No heartbeat from core client for 30 sec - exiting 18:56:06 (4512): No heartbeat from core client for 30 sec - exiting 18:56:07 (4512): No heartbeat from core client for 30 sec - exiting 18:56:08 (4512): No heartbeat from core client for 30 sec - exiting 18:56:09 (4512): No heartbeat from core client for 30 sec - exiting 18:56:10 (4512): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:56:11 (4512): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2980, selfPID=2980, iMonCtr=2 CPDN Monitor - Quit request from BOINC... Regional WorkerCPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5252, selfPID=5252, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3524, selfPID=3524, iMonCtr=2 CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is nController:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5876, selfPID=3776, iMonCtr=1 Model crash detected, will try to restart... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2984, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4696, selfPID=1464, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4928, selfPID=4928, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3840, selfPID=3840, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4768, selfPID=4768, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4680, selfPID=4680, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 12:37:04 (4684): No heartbeat from core client for 30 sec - exiting 12:37:05 (4684): No heartbeat from core client for 30 sec - exiting 12:37:07 (4684): No heartbeat from core client for 30 sec - exiting 12:37:08 (4684): No heartbeat from core client for 30 sec - exiting 12:37:09 (4684): No heartbeat from core client for 30 sec - exiting 12:37:10 (4684): No heartbeat from core client for 30 sec - exiting 12:37:11 (4684): No heartbeat from core client for 30 sec - exiting 12:37:44 (4684): No heartbeat from core client for 30 sec - exiting 12:37:45 (4684): No heartbeat from core client for 30 sec - exiting 12:37:46 (4684): No heartbeat from core client for 30 sec - exiting 12:37:48 (4684): No heartbeat from core client for 30 sec - exiting 12:37:49 (4684): No heartbeat from core client for 30 sec - exiting 12:37:50 (4684): No heartbeat from core client for 30 sec - exiting 12:37:51 (4684): No heartbeat from core client for 30 sec - exiting 12:37:52 (4684): No heartbeat from core client for 30 sec - exiting 12:37:53 (4684): No heartbeat from core client for 30 sec - exiting 12:37:54 (4684): No heartbeat from core client for 30 sec - exiting 12:37:55 (4684): No heartbeat from core client for 30 sec - exiting 12:37:56 (4684): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:37:57 (4684): No heartbeat from core client for 30 sec - exiting 12:37:59 (4684): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3976, selfPID=3976, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=248, selfPID=248, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 09:22:23 (4696): No heartbeat from core client for 30 sec - exiting 09:22:26 (4696): No heartbeat from core client for 30 sec - exiting 09:22:27 (4696): No heartbeat from core client for 30 sec - exiting 09:22:28 (4696): No heartbeat from core client for 30 sec - exiting 09:22:29 (4696): No heartbeat from core client for 30 sec - exiting 09:22:30 (4696): No heartbeat from core client for 30 sec - exiting 09:22:31 (4696): No heartbeat from core client for 30 sec - exiting 09:22:32 (4696): No heartbeat from core client for 30 sec - exiting 09:22:33 (4696): No heartbeat from core client for 30 sec - exiting 09:22:35 (4696): No heartbeat from core client for 30 sec - exiting 09:22:36 (4696): No heartbeat from core client for 30 sec - exiting 09:22:37 (4696): No heartbeat from core client for 30 sec - exiting 09:22:38 (4696): No heartbeat from core client for 30 sec - exiting 09:22:39 (4696): No heartbeat from core client for 30 sec - exiting 09:22:40 (4696): No heartbeat from core client for 30 sec - exiting 09:22:41 (4696): No heartbeat from core client for 30 sec - exiting 09:22:42 (4696): No heartbeat from core client for 30 sec - exiting 09:22:43 (4696): No heartbeat from core client for 30 sec - exiting 09:22:44 (4696): No heartbeat from core client for 30 sec - exiting 09:22:45 (4696): No heartbeat from core client for 30 sec - exiting 09:22:47 (4696): No heartbeat from core client for 30 sec - exiting 09:22:48 (4696): No heartbeat from core client for 30 sec - exiting 09:22:49 (4696): No heartbeat from core client for 30 sec - exiting 09:22:50 (4696): No heartbeat from core client for 30 sec - exiting 09:22:51 (4696): No heartbeat from core client for 30 sec - exiting 09:22:52 (4696): No heartbeat from core client for 30 sec - exiting 09:22:53 (4696): No heartbeat from core client for 30 sec - exiting 09:22:54 (4696): No heartbeat from core client for 30 sec - exiting 09:22:55 (4696): No heartbeat from core client for 30 sec - exiting 09:22:56 (4696): No heartbeat from core client for 30 sec - exiting 09:22:57 (4696): No heartbeat from core client for 30 sec - exiting 09:22:59 (4696): No heartbeat from core client for 30 sec - exiting 09:23:00 (4696): No heartbeat from core client for 30 sec - exiting 09:23:01 (4696): No heartbeat from core client for 30 sec - exiting 09:23:02 (4696): No heartbeat from core client for 30 sec - exiting 09:23:03 (4696): No heartbeat from core client for 30 sec - exiting 09:23:04 (4696): No heartbeat from core client for 30 sec - exiting 09:23:05 (4696): No heartbeat from core client for 30 sec - exiting 09:23:06 (4696): No heartbeat from core client for 30 sec - exiting 09:23:07 (4696): No heartbeat from core client for 30 sec - exiting 09:23:08 (4696): No heartbeat from core client for 30 sec - exiting 09:23:09 (4696): No heartbeat from core client for 30 sec - exiting 09:23:11 (4696): No heartbeat from core client for 30 sec - exiting 09:23:12 (4696): No heartbeat from core client for 30 sec - exiting 09:23:13 (4696): No heartbeat from core client for 30 sec - exiting 09:23:14 (4696): No heartbeat from core client for 30 sec - exiting 09:23:15 (4696): No heartbeat from core client for 30 sec - exiting 09:23:16 (4696): No heartbeat from core client for 30 sec - exiting 09:23:17 (4696): No heartbeat from core client for 30 sec - exiting 09:23:18 (4696): No heartbeat from core client for 30 sec - exiting 09:23:19 (4696): No heartbeat from core client for 30 sec - exiting 09:24:00 (4696): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:24:01 (4696): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5904, selfPID=5904, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3712, selfPID=3712, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3204, selfPID=3204, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Leaving CPDN_Main::Monitor... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
12 Oct 2011 22:38:57	1149987	13151439	hadam3p_pnw_2xkh_2000_1_007364030_0	138,338	373,861	2.7025
12 Oct 2011 21:37:02	1149987	13151439	hadam3p_pnw_2xkh_2000_1_007364030_0	138,336	373,562	2.7004
04 Oct 2011 18:08:44	1149987	13151439	hadam3p_pnw_2xkh_2000_1_007364030_0	126,816	347,738	2.7421
29 Sep 2011 17:15:43	1149987	13151439	hadam3p_pnw_2xkh_2000_1_007364030_0	115,296	321,451	2.7880
25 Sep 2011 21:32:27	1149987	13151439	hadam3p_pnw_2xkh_2000_1_007364030_0	103,776	293,467	2.8279
21 Sep 2011 21:25:23	1149987	13151439	hadam3p_pnw_2xkh_2000_1_007364030_0	92,256	264,980	2.8722
17 Sep 2011 09:40:41	1149987	13151439	hadam3p_pnw_2xkh_2000_1_007364030_0	80,736	236,787	2.9329
11 Sep 2011 14:34:55	1149987	13151439	hadam3p_pnw_2xkh_2000_1_007364030_0	69,216	205,121	2.9635
05 Aug 2011 19:13:28	1149987	13151439	hadam3p_pnw_2xkh_2000_1_007364030_0	57,696	171,393	2.9706
02 Aug 2011 00:08:52	1149987	13151439	hadam3p_pnw_2xkh_2000_1_007364030_0	46,176	137,400	2.9756
31 Jul 2011 15:45:19	1149987	13151439	hadam3p_pnw_2xkh_2000_1_007364030_0	34,656	102,905	2.9693
30 Jul 2011 10:17:57	1149987	13151439	hadam3p_pnw_2xkh_2000_1_007364030_0	23,136	68,672	2.9682
29 Jul 2011 11:14:09	1149987	13151439	hadam3p_pnw_2xkh_2000_1_007364030_0	11,616	34,471	2.9675