Task 13312069

Name	hadam3p_saf_286p_1997_1_007430747_1
Workunit	7628250
Created	29 Aug 2011, 7:02:58 UTC
Sent	29 Aug 2011, 7:17:45 UTC
Report deadline	10 Aug 2012, 12:37:45 UTC
Received	6 Dec 2011, 12:45:30 UTC
Server state	Over
Outcome	Success
Client state	Done
Exit status	0 (0x00000000)
Computer ID	1091933
Run time	4 days 11 hours 42 min 52 sec
CPU time	4 days 3 hours 12 min 22 sec
Validate state	Workunit error - check skipped
Credit	2,244.09
Device peak FLOPS	2.79 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Southern Africa v6.09 windows_intelx86
Stderr	<core_client_version>6.10.58</core_client_version> <![CDATA[ <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=8080, selfPID=5368, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1872, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1468, selfPID=5660, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=676, iMonCtr=2 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 12:38:06 (4068): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 08:06:27 (3868): No heartbeat from core client for 30 sec - exiting 08:06:29 (3868): No heartbeat from core client for 30 sec - exiting 08:06:30 (3868): No heartbeat from core client for 30 sec - exiting 08:06:31 (3868): No heartbeat from core client for 30 sec - exiting 08:06:32 (3868): No heartbeat from core client for 30 sec - exiting 08:06:33 (3868): No heartbeat from core client for 30 sec - exiting 08:06:34 (3868): No heartbeat from core client for 30 sec - exiting 08:06:35 (3868): No heartbeat from core client for 30 sec - exiting 08:06:36 (3868): No heartbeat from core client for 30 sec - exiting 08:06:37 (3868): No heartbeat from core client for 30 sec - exiting 08:06:38 (3868): No heartbeat from core client for 30 sec - exiting 08:06:40 (3868): No heartbeat from core client for 30 sec - exiting 08:06:41 (3868): No heartbeat from core client for 30 sec - exiting 08:06:42 (3868): No heartbeat from core client for 30 sec - exiting 08:06:43 (3868): No heartbeat from core client for 30 sec - exiting 08:06:44 (3868): No heartbeat from core client for 30 sec - exiting 08:06:45 (3868): No heartbeat from core client for 30 sec - exiting 08:06:46 (3868): No heartbeat from core client for 30 sec - exiting 08:06:47 (3868): No heartbeat from core client for 30 sec - exiting 08:06:48 (3868): No heartbeat from core client for 30 sec - exiting 08:06:49 (3868): No heartbeat from core client for 30 sec - exiting 08:06:50 (3868): No heartbeat from core client for 30 sec - exiting 08:06:51 (3868): No heartbeat from core client for 30 sec - exiting 08:06:52 (3868): No heartbeat from core client for 30 sec - exiting 08:06:53 (3868): No heartbeat from core client for 30 sec - exiting 08:06:55 (3868): No heartbeat from core client for 30 sec - exiting 08:06:56 (3868): No heartbeat from core client for 30 sec - exiting 08:06:57 (3868): No heartbeat from core client for 30 sec - exiting 08:06:58 (3868): No heartbeat from core client for 30 sec - exiting 08:06:59 (3868): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1952, iMonCtr=2 07:04:21 (2616): No heartbeat from core client for 30 sec - exiting 07:04:22 (2616): No heartbeat from core client for 30 sec - exiting 07:04:23 (2616): No heartbeat from core client for 30 sec - exiting 07:04:24 (2616): No heartbeat from core client for 30 sec - exiting 07:04:25 (2616): No heartbeat from core client for 30 sec - exiting 07:04:26 (2616): No heartbeat from core client for 30 sec - exiting 07:04:27 (2616): No heartbeat from core client for 30 sec - exiting 07:04:28 (2616): No heartbeat from core client for 30 sec - exiting 07:04:29 (2616): No heartbeat from core client for 30 sec - exiting 07:04:30 (2616): No heartbeat from core client for 30 sec - exiting 07:04:32 (2616): No heartbeat from core client for 30 sec - exiting 07:04:33 (2616): No heartbeat from core client for 30 sec - exiting 07:04:34 (2616): No heartbeat from core client for 30 sec - exiting 07:04:35 (2616): No heartbeat from core client for 30 sec - exiting 07:04:36 (2616): No heartbeat from core client for 30 sec - exiting 07:04:37 (2616): No heartbeat from core client for 30 sec - exiting 07:04:38 (2616): No heartbeat from core client for 30 sec - exiting 07:04:39 (2616): No heartbeat from core client for 30 sec - exiting 07:04:40 (2616): No heartbeat from core client for 30 sec - exiting 07:04:41 (2616): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3412, iMonCtr=2 07:11:36 (2460): No heartbeat from core client for 30 sec - exiting 07:11:37 (2460): No heartbeat from core client for 30 sec - exiting 07:11:38 (2460): No heartbeat from core client for 30 sec - exiting 07:11:40 (2460): No heartbeat from core client for 30 sec - exiting 07:11:41 (2460): No heartbeat from core client for 30 sec - exiting 07:11:42 (2460): No heartbeat from core client for 30 sec - exiting 07:11:43 (2460): No heartbeat from core client for 30 sec - exiting 07:11:44 (2460): No heartbeat from core client for 30 sec - exiting 07:11:45 (2460): No heartbeat from core client for 30 sec - exiting 07:11:46 (2460): No heartbeat from core client for 30 sec - exiting 07:11:47 (2460): No heartbeat from core client for 30 sec - exiting 07:11:48 (2460): No heartbeat from core client for 30 sec - exiting 07:11:49 (2460): No heartbeat from core client for 30 sec - exiting 07:11:51 (2460): No heartbeat from core client for 30 sec - exiting 07:11:52 (2460): No heartbeat from core client for 30 sec - exiting 07:11:53 (2460): No heartbeat from core client for 30 sec - exiting 07:11:54 (2460): No heartbeat from core client for 30 sec - exiting 07:11:55 (2460): No heartbeat from core client for 30 sec - exiting 07:11:56 (2460): No heartbeat from core client for 30 sec - exiting 07:11:57 (2460): No heartbeat from core client for 30 sec - exiting 07:11:58 (2460): No heartbeat from core client for 30 sec - exiting 07:11:59 (2460): No heartbeat from core client for 30 sec - exiting 07:12:00 (2460): No heartbeat from core client for 30 sec - exiting 07:12:02 (2460): No heartbeat from core client for 30 sec - exiting 07:12:03 (2460): No heartbeat from core client for 30 sec - exiting 07:12:04 (2460): No heartbeat from core client for 30 sec - exiting 07:12:05 (2460): No heartbeat from core client for 30 sec - exiting 07:12:06 (2460): No heartbeat from core client for 30 sec - exiting 07:12:07 (2460): No heartbeat from core client for 30 sec - exiting 07:12:08 (2460): No heartbeat from core client for 30 sec - exiting 07:12:09 (2460): No heartbeat from core client for 30 sec - exiting 07:12:10 (2460): No heartbeat from core client for 30 sec - exiting 07:12:11 (2460): No heartbeat from core client for 30 sec - exiting 07:12:12 (2460): No heartbeat from core client for 30 sec - exiting 07:12:14 (2460): No heartbeat from core client for 30 sec - exiting 07:12:15 (2460): No heartbeat from core client for 30 sec - exiting 07:12:16 (2460): No heartbeat from core client for 30 sec - exiting 07:12:17 (2460): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:13:09 (4592): Can't acquire lockfile (32) - waiting 35s Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5288, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5296, selfPID=4592, iMonCtr=1 Model crash detected, will try to restart... 07:13:19 (2164): No heartbeat from core client for 30 sec - exiting 07:13:20 (2164): No heartbeat from core client for 30 sec - exiting 07:13:21 (2164): No heartbeat from core client for 30 sec - exiting 07:13:22 (2164): No heartbeat from core client for 30 sec - exiting 07:13:23 (2164): No heartbeat from core client for 30 sec - exiting 07:13:25 (2164): No heartbeat from core client for 30 sec - exiting 07:13:26 (2164): No heartbeat from core client for 30 sec - exiting 07:13:27 (2164): No heartbeat from core client for 30 sec - exiting 07:13:28 (2164): No heartbeat from core client for 30 sec - exiting 07:13:29 (2164): No heartbeat from core client for 30 sec - exiting 07:13:30 (2164): No heartbeat from core client for 30 sec - exiting 07:13:31 (2164): No heartbeat from core client for 30 sec - exiting 07:13:32 (2164): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 07:50:04 (296): No heartbeat from core client for 30 sec - exiting 07:50:06 (296): No heartbeat from core client for 30 sec - exiting 07:50:07 (296): No heartbeat from core client for 30 sec - exiting 07:50:08 (296): No heartbeat from core client for 30 sec - exiting 07:50:09 (296): No heartbeat from core client for 30 sec - exiting 07:50:10 (296): No heartbeat from core client for 30 sec - exiting 07:50:11 (296): No heartbeat from core client for 30 sec - exiting 07:50:12 (296): No heartbeat from core client for 30 sec - exiting 07:50:13 (296): No heartbeat from core client for 30 sec - exiting 07:50:14 (296): No heartbeat from core client for 30 sec - exiting 07:50:15 (296): No heartbeat from core client for 30 sec - exiting 07:50:16 (296): No heartbeat from core client for 30 sec - exiting 07:50:18 (296): No heartbeat from core client for 30 sec - exiting 07:50:19 (296): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 07:16:43 (408): No heartbeat from core client for 30 sec - exiting 07:16:45 (408): No heartbeat from core client for 30 sec - exiting 07:16:46 (408): No heartbeat from core client for 30 sec - exiting 07:16:47 (408): No heartbeat from core client for 30 sec - exiting 07:16:48 (408): No heartbeat from core client for 30 sec - exiting 07:16:49 (408): No heartbeat from core client for 30 sec - exiting 07:16:50 (408): No heartbeat from core client for 30 sec - exiting 07:16:51 (408): No heartbeat from core client for 30 sec - exiting 07:16:52 (408): No heartbeat from core client for 30 sec - exiting 07:16:53 (408): No heartbeat from core client for 30 sec - exiting 07:16:54 (408): No heartbeat from core client for 30 sec - exiting 07:16:56 (408): No heartbeat from core client for 30 sec - exiting 07:16:57 (408): No heartbeat from core client for 30 sec - exiting 07:16:58 (408): No heartbeat from core client for 30 sec - exiting 07:16:59 (408): No heartbeat from core client for 30 sec - exiting 07:17:00 (408): No heartbeat from core client for 30 sec - exiting 07:17:01 (408): No heartbeat from core client for 30 sec - exiting 07:17:02 (408): No heartbeat from core client for 30 sec - exiting 07:17:03 (408): No heartbeat from core client for 30 sec - exiting 07:17:04 (408): No heartbeat from core client for 30 sec - exiting 07:17:05 (408): No heartbeat from core client for 30 sec - exiting 07:17:06 (408): No heartbeat from core client for 30 sec - exiting 07:17:08 (408): No heartbeat from core client for 30 sec - exiting 07:17:09 (408): No heartbeat from core client for 30 sec - exiting 07:17:10 (408): No heartbeat from core client for 30 sec - exiting 07:17:11 (408): No heartbeat from core client for 30 sec - exiting 07:17:12 (408): No heartbeat from core client for 30 sec - exiting 07:17:13 (408): No heartbeat from core client for 30 sec - exiting 07:17:14 (408): No heartbeat from core client for 30 sec - exiting 07:17:15 (408): No heartbeat from core client for 30 sec - exiting 07:17:16 (408): No heartbeat from core client for 30 sec - exiting 07:17:17 (408): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4748, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4704, iMonCtr=2 Model crash detected, will try to restart... 07:13:30 (3324): No heartbeat from core client for 30 sec - exiting 07:13:31 (3324): No heartbeat from core client for 30 sec - exiting 07:13:33 (3324): No heartbeat from core client for 30 sec - exiting 07:13:34 (3324): No heartbeat from core client for 30 sec - exiting 07:13:35 (3324): No heartbeat from core client for 30 sec - exiting 07:13:36 (3324): No heartbeat from core client for 30 sec - exiting 07:13:37 (3324): No heartbeat from core client for 30 sec - exiting 07:13:38 (3324): No heartbeat from core client for 30 sec - exiting 07:13:39 (3324): No heartbeat from core client for 30 sec - exiting 07:13:40 (3324): No heartbeat from core client for 30 sec - exiting 07:13:41 (3324): No heartbeat from core client for 30 sec - exiting 07:13:42 (3324): No heartbeat from core client for 30 sec - exiting 07:13:43 (3324): No heartbeat from core client for 30 sec - exiting 07:13:45 (3324): No heartbeat from core client for 30 sec - exiting 07:13:46 (3324): No heartbeat from core client for 30 sec - exiting 07:13:47 (3324): No heartbeat from core client for 30 sec - exiting 07:13:48 (3324): No heartbeat from core client for 30 sec - exiting 07:13:49 (3324): No heartbeat from core client for 30 sec - exiting 07:13:50 (3324): No heartbeat from core client for 30 sec - exiting 07:13:51 (3324): No heartbeat from core client for 30 sec - exiting 07:13:52 (3324): No heartbeat from core client for 30 sec - exiting 07:13:53 (3324): No heartbeat from core client for 30 sec - exiting 07:13:54 (3324): No heartbeat from core client for 30 sec - exiting 07:13:55 (3324): No heartbeat from core client for 30 sec - exiting 07:13:57 (3324): No heartbeat from core client for 30 sec - exiting 07:13:58 (3324): No heartbeat from core client for 30 sec - exiting 07:13:59 (3324): No heartbeat from core client for 30 sec - exiting 07:14:00 (3324): No heartbeat from core client for 30 sec - exiting 07:14:01 (3324): No heartbeat from core client for 30 sec - exiting 07:14:02 (3324): No heartbeat from core client for 30 sec - exiting 07:14:03 (3324): No heartbeat from core client for 30 sec - exiting 07:14:04 (3324): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 07:15:48 (696): No heartbeat from core client for 30 sec - exiting 07:15:50 (696): No heartbeat from core client for 30 sec - exiting 07:15:51 (696): No heartbeat from core client for 30 sec - exiting 07:15:52 (696): No heartbeat from core client for 30 sec - exiting 07:15:53 (696): No heartbeat from core client for 30 sec - exiting 07:15:54 (696): No heartbeat from core client for 30 sec - exiting 07:15:55 (696): No heartbeat from core client for 30 sec - exiting 07:15:56 (696): No heartbeat from core client for 30 sec - exiting 07:15:57 (696): No heartbeat from core client for 30 sec - exiting 07:15:58 (696): No heartbeat from core client for 30 sec - exiting 07:15:59 (696): No heartbeat from core client for 30 sec - exiting 07:16:00 (696): No heartbeat from core client for 30 sec - exiting 07:16:02 (696): No heartbeat from core client for 30 sec - exiting 07:16:03 (696): No heartbeat from core client for 30 sec - exiting 07:16:04 (696): No heartbeat from core client for 30 sec - exiting 07:16:05 (696): No heartbeat from core client for 30 sec - exiting 07:16:06 (696): No heartbeat from core client for 30 sec - exiting 07:16:07 (696): No heartbeat from core client for 30 sec - exiting 07:16:08 (696): No heartbeat from core client for 30 sec - exiting 07:16:09 (696): No heartbeat from core client for 30 sec - exiting 07:16:10 (696): No heartbeat from core client for 30 sec - exiting 07:16:11 (696): No heartbeat from core client for 30 sec - exiting 07:16:13 (696): No heartbeat from core client for 30 sec - exiting 07:16:14 (696): No heartbeat from core client for 30 sec - exiting 07:16:15 (696): No heartbeat from core client for 30 sec - exiting 07:16:16 (696): No heartbeat from core client for 30 sec - exiting 07:16:17 (696): No heartbeat from core client for 30 sec - exiting 07:16:18 (696): No heartbeat from core client for 30 sec - exiting 07:16:19 (696): No heartbeat from core client for 30 sec - exiting 07:16:20 (696): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 07:16:19 (2060): No heartbeat from core client for 30 sec - exiting 07:16:21 (2060): No heartbeat from core client for 30 sec - exiting 07:16:22 (2060): No heartbeat from core client for 30 sec - exiting 07:16:23 (2060): No heartbeat from core client for 30 sec - exiting 07:16:24 (2060): No heartbeat from core client for 30 sec - exiting 07:16:25 (2060): No heartbeat from core client for 30 sec - exiting 07:16:26 (2060): No heartbeat from core client for 30 sec - exiting 07:16:27 (2060): No heartbeat from core client for 30 sec - exiting 07:16:28 (2060): No heartbeat from core client for 30 sec - exiting 07:16:29 (2060): No heartbeat from core client for 30 sec - exiting 07:16:30 (2060): No heartbeat from core client for 30 sec - exiting 07:16:32 (2060): No heartbeat from core client for 30 sec - exiting 07:16:33 (2060): No heartbeat from core client for 30 sec - exiting 07:16:34 (2060): No heartbeat from core client for 30 sec - exiting 07:16:35 (2060): No heartbeat from core client for 30 sec - exiting 07:16:36 (2060): No heartbeat from core client for 30 sec - exiting 07:16:37 (2060): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Leaving CPDN_Main::Monitor... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
06 Dec 2011 11:20:39	1091933	13312069	hadam3p_saf_286p_1997_1_007430747_1	138,336	356,552	2.5774
01 Dec 2011 12:07:16	1091933	13312069	hadam3p_saf_286p_1997_1_007430747_1	126,816	326,551	2.5750
30 Nov 2011 07:31:15	1091933	13312069	hadam3p_saf_286p_1997_1_007430747_1	115,296	296,261	2.5696
28 Nov 2011 09:45:54	1091933	13312069	hadam3p_saf_286p_1997_1_007430747_1	103,776	267,729	2.5799
22 Nov 2011 09:54:04	1091933	13312069	hadam3p_saf_286p_1997_1_007430747_1	92,256	238,247	2.5825
16 Nov 2011 13:41:03	1091933	13312069	hadam3p_saf_286p_1997_1_007430747_1	80,736	209,009	2.5888
09 Nov 2011 09:43:55	1091933	13312069	hadam3p_saf_286p_1997_1_007430747_1	69,216	180,170	2.6030
03 Nov 2011 14:17:26	1091933	13312069	hadam3p_saf_286p_1997_1_007430747_1	57,696	151,139	2.6196
02 Nov 2011 07:54:09	1091933	13312069	hadam3p_saf_286p_1997_1_007430747_1	46,176	121,692	2.6354
31 Oct 2011 17:08:30	1091933	13312069	hadam3p_saf_286p_1997_1_007430747_1	34,656	91,302	2.6345
18 Oct 2011 05:36:14	1091933	13312069	hadam3p_saf_286p_1997_1_007430747_1	23,136	61,541	2.6600
10 Oct 2011 08:49:21	1091933	13312069	hadam3p_saf_286p_1997_1_007430747_1	11,616	31,228	2.6884