Task 15119205

Name	hadam3p_pnw_2yv0_1960_1_008145548_0
Workunit	8300672
Created	14 Aug 2012, 20:40:36 UTC
Sent	14 Aug 2012, 20:52:30 UTC
Report deadline	28 Jul 2013, 2:12:30 UTC
Received	17 Oct 2012, 19:16:14 UTC
Server state	Over
Outcome	Success
Client state	Done
Exit status	0 (0x00000000)
Computer ID	1088606
Run time	5 days 20 hours 9 min 31 sec
CPU time	5 days 13 hours 17 min 11 sec
Validate state	Workunit error - check skipped
Credit	3,005.88
Device peak FLOPS	2.40 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Pacific North West v6.09 windows_intelx86
Stderr	<core_client_version>6.10.56</core_client_version> <![CDATA[ <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 07:56:05 (4744): No heartbeat from core client for 30 sec - exiting 07:56:06 (4744): No heartbeat from core client for 30 sec - exiting 07:56:08 (4744): No heartbeat from core client for 30 sec - exiting 07:56:09 (4744): No heartbeat from core client for 30 sec - exiting 07:56:10 (4744): No heartbeat from core client for 30 sec - exiting 07:56:11 (4744): No heartbeat from core client for 30 sec - exiting 07:56:12 (4744): No heartbeat from core client for 30 sec - exiting 07:56:13 (4744): No heartbeat from core client for 30 sec - exiting 07:56:14 (4744): No heartbeat from core client for 30 sec - exiting 07:56:15 (4744): No heartbeat from core client for 30 sec - exiting 07:56:16 (4744): No heartbeat from core client for 30 sec - exiting 07:56:17 (4744): No heartbeat from core client for 30 sec - exiting 07:56:18 (4744): No heartbeat from core client for 30 sec - exiting 07:56:19 (4744): No heartbeat from core client for 30 sec - exiting 07:56:21 (4744): No heartbeat from core client for 30 sec - exiting 07:56:22 (4744): No heartbeat from core client for 30 sec - exiting 07:56:23 (4744): No heartbeat from core client for 30 sec - exiting 07:56:24 (4744): No heartbeat from core client for 30 sec - exiting 07:56:25 (4744): No heartbeat from core client for 30 sec - exiting 07:56:26 (4744): No heartbeat from core client for 30 sec - exiting 07:56:27 (4744): No heartbeat from core client for 30 sec - exiting 07:56:28 (4744): No heartbeat from core client for 30 sec - exiting 07:56:29 (4744): No heartbeat from core client for 30 sec - exiting 07:56:30 (4744): No heartbeat from core client for 30 sec - exiting 07:56:31 (4744): No heartbeat from core client for 30 sec - exiting 07:56:32 (4744): No heartbeat from core client for 30 sec - exiting 07:56:34 (4744): No heartbeat from core client for 30 sec - exiting 07:56:35 (4744): No heartbeat from core client for 30 sec - exiting 07:56:36 (4744): No heartbeat from core client for 30 sec - exiting 07:56:37 (4744): No heartbeat from core client for 30 sec - exiting 07:56:38 (4744): No heartbeat from core client for 30 sec - exiting 07:56:39 (4744): No heartbeat from core client for 30 sec - exiting 07:56:40 (4744): No heartbeat from core client for 30 sec - exiting 07:56:41 (4744): No heartbeat from core client for 30 sec - exiting 07:56:42 (4744): No heartbeat from core client for 30 sec - exiting 07:56:43 (4744): No heartbeat from core client for 30 sec - exiting 07:56:44 (4744): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:56:45 (4744): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 11:18:50 (4880): Can't acquire lockfile (32) - waiting 35s CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2676, selfPID=2676, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5748, selfPID=5748, iMonCtr=2 CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6036, selfPID=6036, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 08:32:27 (3412): No heartbeat from core client for 30 sec - exiting 08:32:28 (3412): No heartbeat from core client for 30 sec - exiting 08:32:29 (3412): No heartbeat from core client for 30 sec - exiting 08:32:30 (3412): No heartbeat from core client for 30 sec - exiting 08:32:31 (3412): No heartbeat from core client for 30 sec - exiting 08:32:32 (3412): No heartbeat from core client for 30 sec - exiting 08:32:33 (3412): No heartbeat from core client for 30 sec - exiting 08:32:34 (3412): No heartbeat from core client for 30 sec - exiting 08:32:35 (3412): No heartbeat from core client for 30 sec - exiting 08:32:36 (3412): No heartbeat from core client for 30 sec - exiting 08:32:37 (3412): No heartbeat from core client for 30 sec - exiting 08:32:38 (3412): No heartbeat from core client for 30 sec - exiting 08:32:39 (3412): No heartbeat from core client for 30 sec - exiting 08:32:40 (3412): No heartbeat from core client for 30 sec - exiting 08:32:41 (3412): No heartbeat from core client for 30 sec - exiting 08:32:42 (3412): No heartbeat from core client for 30 sec - exiting 08:32:43 (3412): No heartbeat from core client for 30 sec - exiting 08:32:44 (3412): No heartbeat from core client for 30 sec - exiting 08:32:45 (3412): No heartbeat from core client for 30 sec - exiting 08:32:46 (3412): No heartbeat from core client for 30 sec - exiting 08:32:47 (3412): No heartbeat from core client for 30 sec - exiting 08:32:48 (3412): No heartbeat from core client for 30 sec - exiting 08:32:49 (3412): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5840, selfPID=5840, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5804, selfPID=5804, iMonCtr=2 CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=328, selfPID=328, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 16:38:55 (5240): Can't acquire lockfile (32) - waiting 35s Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2776, selfPID=5648, iMonCtr=1 Model crash detected, will try to restart... 07:57:20 (4528): No heartbeat from core client for 30 sec - exiting 07:57:21 (4528): No heartbeat from core client for 30 sec - exiting 07:57:22 (4528): No heartbeat from core client for 30 sec - exiting 07:57:23 (4528): No heartbeat from core client for 30 sec - exiting 07:57:24 (4528): No heartbeat from core client for 30 sec - exiting 07:57:25 (4528): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3396, selfPID=3396, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1688, selfPID=1688, iMonCtr=2 07:54:43 (4336): No heartbeat from core client for 30 sec - exiting 07:54:44 (4336): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:54:45 (4336): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 07:54:09 (4620): No heartbeat from core client for 30 sec - exiting 07:54:10 (4620): No heartbeat from core client for 30 sec - exiting 07:54:11 (4620): No heartbeat from core client for 30 sec - exiting 07:54:12 (4620): No heartbeat from core client for 30 sec - exiting 07:54:13 (4620): No heartbeat from core client for 30 sec - exiting 07:54:14 (4620): No heartbeat from core client for 30 sec - exiting 07:54:15 (4620): No heartbeat from core client for 30 sec - exiting 07:54:16 (4620): No heartbeat from core client for 30 sec - exiting 07:54:17 (4620): No heartbeat from core client for 30 sec - exiting 07:54:18 (4620): No heartbeat from core client for 30 sec - exiting 07:54:19 (4620): No heartbeat from core client for 30 sec - exiting 07:54:20 (4620): No heartbeat from core client for 30 sec - exiting 07:54:21 (4620): No heartbeat from core client for 30 sec - exiting 07:54:22 (4620): No heartbeat from core client for 30 sec - exiting 07:54:23 (4620): No heartbeat from core client for 30 sec - exiting 07:54:24 (4620): No heartbeat from core client for 30 sec - exiting 07:54:25 (4620): No heartbeat from core client for 30 sec - exiting 07:54:26 (4620): No heartbeat from core client for 30 sec - exiting 07:54:27 (4620): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4580, iMonCtr=2 Model crash detected, will try to restart... 07:56:24 (4640): No heartbeat from core client for 30 sec - exiting 07:56:25 (4640): No heartbeat from core client for 30 sec - exiting 07:56:26 (4640): No heartbeat from core client for 30 sec - exiting 07:56:27 (4640): No heartbeat from core client for 30 sec - exiting 07:56:28 (4640): No heartbeat from core client for 30 sec - exiting 07:56:29 (4640): No heartbeat from core client for 30 sec - exiting 07:56:30 (4640): No heartbeat from core client for 30 sec - exiting 07:56:31 (4640): No heartbeat from core client for 30 sec - exiting 07:56:32 (4640): No heartbeat from core client for 30 sec - exiting 07:56:33 (4640): No heartbeat from core client for 30 sec - exiting 07:56:34 (4640): No heartbeat from core client for 30 sec - exiting 07:56:35 (4640): No heartbeat from core client for 30 sec - exiting 07:56:36 (4640): No heartbeat from core client for 30 sec - exiting 07:56:37 (4640): No heartbeat from core client for 30 sec - exiting 07:56:38 (4640): No heartbeat from core client for 30 sec - exiting 07:56:39 (4640): No heartbeat from core client for 30 sec - exiting 07:56:40 (4640): No heartbeat from core client for 30 sec - exiting 07:56:41 (4640): No heartbeat from core client for 30 sec - exiting 07:56:42 (4640): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... No PrCPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 07:58:35 (4896): No heartbeat from core client for 30 sec - exiting 07:58:36 (4896): No heartbeat from core client for 30 sec - exiting 07:58:37 (4896): No heartbeat from core client for 30 sec - exiting 07:58:39 (4896): No heartbeat from core client for 30 sec - exiting 07:58:40 (4896): No heartbeat from core client for 30 sec - exiting 07:58:41 (4896): No heartbeat from core client for 30 sec - exiting 07:58:42 (4896): No heartbeat from core client for 30 sec - exiting 07:58:43 (4896): No heartbeat from core client for 30 sec - exiting 07:58:44 (4896): No heartbeat from core client for 30 sec - exiting 07:58:45 (4896): No heartbeat from core client for 30 sec - exiting 07:58:46 (4896): No heartbeat from core client for 30 sec - exiting 07:58:47 (4896): No heartbeat from core client for 30 sec - exiting 07:58:48 (4896): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 11:41:00 (6908): Can't acquire lockfile (32) - waiting 35s CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 16:35:54 (3580): Can't acquire lockfile (32) - waiting 35s 07:59:29 (4368): No heartbeat from core client for 30 sec - exiting 07:59:30 (4368): No heartbeat from core client for 30 sec - exiting 07:59:31 (4368): No heartbeat from core client for 30 sec - exiting 07:59:32 (4368): No heartbeat from core client for 30 sec - exiting 07:59:33 (4368): No heartbeat from core client for 30 sec - exiting 07:59:34 (4368): No heartbeat from core client for 30 sec - exiting 07:59:35 (4368): No heartbeat from core client for 30 sec - exiting 07:59:36 (4368): No heartbeat from core client for 30 sec - exiting 07:59:37 (4368): No heartbeat from core client for 30 sec - exiting 07:59:38 (4368): No heartbeat from core client for 30 sec - exiting 07:59:39 (4368): No heartbeat from core client for 30 sec - exiting 07:59:40 (4368): No heartbeat from core client for 30 sec - exiting 07:59:41 (4368): No heartbeat from core client for 30 sec - exiting 07:59:42 (4368): No heartbeat from core client for 30 sec - exiting 07:59:43 (4368): No heartbeat from core client for 30 sec - exiting 07:59:44 (4368): No heartbeat from core client for 30 sec - exiting 07:59:45 (4368): No heartbeat from core client for 30 sec - exiting 07:59:46 (4368): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3464, selfPID=3464, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5924, selfPID=3620, iMonCtr=1 Model crash detected, will try to restart... 07:47:12 (4352): No heartbeat from core client for 30 sec - exiting 07:47:13 (4352): No heartbeat from core client for 30 sec - exiting 07:47:14 (4352): No heartbeat from core client for 30 sec - exiting 07:47:15 (4352): No heartbeat from core client for 30 sec - exiting 07:47:16 (4352): No heartbeat from core client for 30 sec - exiting 07:47:17 (4352): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:47:49 (1268): Can't acquire lockfile (32) - waiting 35s CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2720, selfPID=2720, iMonCtr=2 07:51:34 (4292): No heartbeat from core client for 30 sec - exiting 07:51:35 (4292): No heartbeat from core client for 30 sec - exiting 07:51:36 (4292): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:52:14 (452): Can't acquire lockfile (32) - waiting 35s 07:49:14 (4960): No heartbeat from core client for 30 sec - exiting 07:49:15 (4960): No heartbeat from core client for 30 sec - exiting 07:49:16 (4960): No heartbeat from core client for 30 sec - exiting 07:49:17 (4960): No heartbeat from core client for 30 sec - exiting 07:49:18 (4960): No heartbeat from core client for 30 sec - exiting 07:49:19 (4960): No heartbeat from core client for 30 sec - exiting 07:49:20 (4960): No heartbeat from core client for 30 sec - exiting 07:49:21 (4960): No heartbeat from core client for 30 sec - exiting 07:49:22 (4960): No heartbeat from core client for 30 sec - exiting 07:49:23 (4960): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:49:57 (4748): No heartbeat from core client for 30 sec - exiting 07:49:58 (4748): No heartbeat from core client for 30 sec - exiting 07:49:59 (4748): No heartbeat from core client for 30 sec - exiting 07:50:00 (4748): No heartbeat from core client for 30 sec - exiting 07:50:01 (4748): No heartbeat from core client for 30 sec - exiting 07:50:02 (4748): No heartbeat from core client for 30 sec - exiting 07:50:03 (4748): No heartbeat from core client for 30 sec - exiting 07:50:04 (4748): No heartbeat from core client for 30 sec - exiting 07:50:05 (4748): No heartbeat from core client for 30 sec - exiting 07:50:06 (4748): No heartbeat from core client for 30 sec - exiting 07:50:07 (4748): No heartbeat from core client for 30 sec - exiting 07:50:08 (4748): No heartbeat from core client for 30 sec - exiting 07:50:09 (4748): No heartbeat from core client for 30 sec - exiting 07:50:10 (4748): No heartbeat from core client for 30 sec - exiting 07:50:11 (4748): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4984, selfPID=4984, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 08:14:22 (4904): No heartbeat from core client for 30 sec - exiting 08:14:24 (4904): No heartbeat from core client for 30 sec - exiting 08:14:25 (4904): No heartbeat from core client for 30 sec - exiting 08:14:26 (4904): No heartbeat from core client for 30 sec - exiting 08:14:27 (4904): No heartbeat from core client for 30 sec - exiting 08:14:28 (4904): No heartbeat from core client for 30 sec - exiting 08:14:29 (4904): No heartbeat from core client for 30 sec - exiting 08:14:30 (4904): No heartbeat from core client for 30 sec - exiting 08:14:31 (4904): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 07:41:32 (4928): No heartbeat from core client for 30 sec - exiting 07:41:33 (4928): No heartbeat from core client for 30 sec - exiting 07:41:34 (4928): No heartbeat from core client for 30 sec - exiting 07:41:35 (4928): No heartbeat from core client for 30 sec - exiting 07:41:36 (4928): No heartbeat from core client for 30 sec - exiting 07:41:37 (4928): No heartbeat from core client for 30 sec - exiting 07:41:38 (4928): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Leaving CPDN_Main::Monitor... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
17 Oct 2012 16:16:47	1088606	15119205	hadam3p_pnw_2yv0_1960_1_008145548_0	138,336	478,897	3.4618
16 Oct 2012 13:25:28	1088606	15119205	hadam3p_pnw_2yv0_1960_1_008145548_0	126,816	438,913	3.4610
12 Oct 2012 18:42:31	1088606	15119205	hadam3p_pnw_2yv0_1960_1_008145548_0	115,296	400,213	3.4712
11 Oct 2012 16:07:02	1088606	15119205	hadam3p_pnw_2yv0_1960_1_008145548_0	103,776	360,864	3.4773
10 Oct 2012 13:57:10	1088606	15119205	hadam3p_pnw_2yv0_1960_1_008145548_0	92,256	321,264	3.4823
08 Oct 2012 19:44:15	1088606	15119205	hadam3p_pnw_2yv0_1960_1_008145548_0	80,736	281,627	3.4882
05 Oct 2012 17:46:16	1088606	15119205	hadam3p_pnw_2yv0_1960_1_008145548_0	69,220	242,045	3.4967
05 Oct 2012 16:39:50	1088606	15119205	hadam3p_pnw_2yv0_1960_1_008145548_0	69,216	241,637	3.4911
04 Oct 2012 13:54:17	1088606	15119205	hadam3p_pnw_2yv0_1960_1_008145548_0	57,696	201,788	3.4974
02 Oct 2012 20:48:52	1088606	15119205	hadam3p_pnw_2yv0_1960_1_008145548_0	46,176	161,367	3.4946
28 Sep 2012 21:28:01	1088606	15119205	hadam3p_pnw_2yv0_1960_1_008145548_0	34,656	120,996	3.4913
27 Sep 2012 12:04:52	1088606	15119205	hadam3p_pnw_2yv0_1960_1_008145548_0	23,136	79,913	3.4541
26 Sep 2012 14:10:06	1088606	15119205	hadam3p_pnw_2yv0_1960_1_008145548_0	11,616	39,990	3.4427