Task 12229310

Name	hadam3p_saf_1g4r_1986_1_006948739_0
Workunit	7152055
Created	22 Nov 2010, 16:41:28 UTC
Sent	8 Mar 2011, 20:42:15 UTC
Report deadline	19 Feb 2012, 2:02:15 UTC
Received	20 Apr 2011, 19:27:38 UTC
Server state	Over
Outcome	Didn't need
Client state	Compute error
Exit status	0 (0x00000000)
Computer ID	1017586
Run time	3 days 20 hours 17 min 1 sec
CPU time	30 min 40 sec
Validate state	Invalid
Credit	1,683.45
Device peak FLOPS	2.67 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Southern Africa v6.08 windows_intelx86
Stderr	<core_client_version>6.10.36</core_client_version> <![CDATA[ <stderr_txt> Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=7288, selfPID=4944, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4412, selfPID=4124, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5720, selfPID=5720, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 18:15:44 (5448): No heartbeat from core client for 30 sec - exiting 18:15:45 (5448): No heartbeat from core client for 30 sec - exiting 18:15:46 (5448): No heartbeat from core client for 30 sec - exiting 18:15:47 (5448): No heartbeat from core client for 30 sec - exiting 18:15:48 (5448): No heartbeat from core client for 30 sec - exiting 18:15:49 (5448): No heartbeat from core client for 30 sec - exiting 18:15:50 (5448): No heartbeat from core client for 30 sec - exiting 18:15:51 (5448): No heartbeat from core client for 30 sec - exiting 18:15:52 (5448): No heartbeat from core client for 30 sec - exiting 18:15:53 (5448): No heartbeat from core client for 30 sec - exiting 18:15:54 (5448): No heartbeat from core client for 30 sec - exiting 18:15:55 (5448): No heartbeat from core client for 30 sec - exiting 18:15:56 (5448): No heartbeat from core client for 30 sec - exiting 18:15:57 (5448): No heartbeat from core client for 30 sec - exiting 18:15:58 (5448): No heartbeat from core client for 30 sec - exiting 18:15:59 (5448): No heartbeat from core client for 30 sec - exiting 18:16:00 (5448): No heartbeat from core client for 30 sec - exiting 18:16:01 (5448): No heartbeat from core client for 30 sec - exiting 18:16:02 (5448): No heartbeat from core client for 30 sec - exiting 18:16:03 (5448): No heartbeat from core client for 30 sec - exiting 18:16:04 (5448): No heartbeat from core client for 30 sec - exiting 18:16:05 (5448): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 09:30:37 (5676): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 09:08:56 (4804): No heartbeat from core client for 30 sec - exiting 09:08:57 (4804): No heartbeat from core client for 30 sec - exiting 09:08:58 (4804): No heartbeat from core client for 30 sec - exiting 09:08:59 (4804): No heartbeat from core client for 30 sec - exiting 09:09:00 (4804): No heartbeat from core client for 30 sec - exiting 09:09:01 (4804): No heartbeat from core client for 30 sec - exiting 09:09:02 (4804): No heartbeat from core client for 30 sec - exiting 09:09:03 (4804): No heartbeat from core client for 30 sec - exiting 09:09:04 (4804): No heartbeat from core client for 30 sec - exiting 09:09:05 (4804): No heartbeat from core client for 30 sec - exiting 09:09:06 (4804): No heartbeat from core client for 30 sec - exiting 09:09:07 (4804): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 06:37:36 (4948): No heartbeat from core client for 30 sec - exiting 06:37:37 (4948): No heartbeat from core client for 30 sec - exiting 06:37:38 (4948): No heartbeat from core client for 30 sec - exiting 06:37:39 (4948): No heartbeat from core client for 30 sec - exiting 06:37:40 (4948): No heartbeat from core client for 30 sec - exiting 06:37:41 (4948): No heartbeat from core client for 30 sec - exiting 06:37:42 (4948): No heartbeat from core client for 30 sec - exiting 06:37:43 (4948): No heartbeat from core client for 30 sec - exiting 06:37:44 (4948): No heartbeat from core client for 30 sec - exiting 06:37:45 (4948): No heartbeat from core client for 30 sec - exiting 06:37:46 (4948): No heartbeat from core client for 30 sec - exiting 06:37:47 (4948): No heartbeat from core client for 30 sec - exiting 06:37:48 (4948): No heartbeat from core client for 30 sec - exiting 06:37:49 (4948): No heartbeat from core client for 30 sec - exiting 06:37:50 (4948): No heartbeat from core client for 30 sec - exiting 06:37:51 (4948): No heartbeat from core client for 30 sec - exiting 06:37:52 (4948): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 06:38:35 (4600): No heartbeat from core client for 30 sec - exiting 06:38:36 (4600): No heartbeat from core client for 30 sec - exiting 06:38:37 (4600): No heartbeat from core client for 30 sec - exiting 06:38:38 (4600): No heartbeat from core client for 30 sec - exiting 06:38:39 (4600): No heartbeat from core client for 30 sec - exiting 06:38:40 (4600): No heartbeat from core client for 30 sec - exiting 06:38:41 (4600): No heartbeat from core client for 30 sec - exiting 06:38:42 (4600): No heartbeat from core client for 30 sec - exiting 06:38:43 (4600): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6228, selfPID=6796, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=7340, selfPID=3380, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7908, iMonCtr=2 Model crash detected, will try to restart... 07:01:20 (5036): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:37:36 (2752): No heartbeat from core client for 30 sec - exiting 17:37:37 (2752): No heartbeat from core client for 30 sec - exiting 17:37:38 (2752): No heartbeat from core client for 30 sec - exiting 17:37:39 (2752): No heartbeat from core client for 30 sec - exiting 17:37:40 (2752): No heartbeat from core client for 30 sec - exiting 17:37:41 (2752): No heartbeat from core client for 30 sec - exiting 17:37:42 (2752): No heartbeat from core client for 30 sec - exiting 17:37:43 (2752): No heartbeat from core client for 30 sec - exiting 17:37:44 (2752): No heartbeat from core client for 30 sec - exiting 17:37:45 (2752): No heartbeat from core client for 30 sec - exiting 17:37:46 (2752): No heartbeat from core client for 30 sec - exiting 17:37:47 (2752): No heartbeat from core client for 30 sec - exiting 17:37:48 (2752): No heartbeat from core client for 30 sec - exiting 17:37:49 (2752): No heartbeat from core client for 30 sec - exiting 17:37:50 (2752): No heartbeat from core client for 30 sec - exiting 17:37:51 (2752): No heartbeat from core client for 30 sec - exiting 17:37:52 (2752): No heartbeat from core client for 30 sec - exiting 17:37:53 (2752): No heartbeat from core client for 30 sec - exiting 17:37:54 (2752): No heartbeat from core client for 30 sec - exiting 17:37:55 (2752): No heartbeat from core client for 30 sec - exiting 17:37:56 (2752): No heartbeat from core client for 30 sec - exiting 17:37:57 (2752): No heartbeat from core client for 30 sec - exiting 17:37:58 (2752): No heartbeat from core client for 30 sec - exiting 17:37:59 (2752): No heartbeat from core client for 30 sec - exiting 17:38:00 (2752): No heartbeat from core client for 30 sec - exiting 17:38:01 (2752): No heartbeat from core client for 30 sec - exiting 17:38:02 (2752): No heartbeat from core client for 30 sec - exiting 17:38:03 (2752): No heartbeat from core client for 30 sec - exiting 17:38:04 (2752): No heartbeat from core client for 30 sec - exiting 17:38:05 (2752): No heartbeat from core client for 30 sec - exiting 17:38:06 (2752): No heartbeat from core client for 30 sec - exiting 17:38:07 (2752): No heartbeat from core client for 30 sec - exiting 17:38:08 (2752): No heartbeat from core client for 30 sec - exiting 17:38:09 (2752): No heartbeat from core client for 30 sec - exiting 17:38:10 (2752): No heartbeat from core client for 30 sec - exiting 17:38:11 (2752): No heartbeat from core client for 30 sec - exiting 17:38:12 (2752): No heartbeat from core client for 30 sec - exiting 17:38:13 (2752): No heartbeat from core client for 30 sec - exiting 17:38:14 (2752): No heartbeat from core client for 30 sec - exiting 17:38:15 (2752): No heartbeat from core client for 30 sec - exiting 17:38:16 (2752): No heartbeat from core client for 30 sec - exiting 17:38:17 (2752): No heartbeat from core client for 30 sec - exiting 17:38:18 (2752): No heartbeat from core client for 30 sec - exiting 17:38:19 (2752): No heartbeat from core client for 30 sec - exiting 17:38:20 (2752): No heartbeat from core client for 30 sec - exiting 17:38:21 (2752): No heartbeat from core client for 30 sec - exiting 17:38:22 (2752): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6112, selfPID=6112, iMonCtr=2 18:34:37 (4808): No heartbeat from core client for 30 sec - exiting 18:34:38 (4808): No heartbeat from core client for 30 sec - exiting 18:34:39 (4808): No heartbeat from core client for 30 sec - exiting 18:34:40 (4808): No heartbeat from core client for 30 sec - exiting 18:34:41 (4808): No heartbeat from core client for 30 sec - exiting 18:34:42 (4808): No heartbeat from core client for 30 sec - exiting 18:34:43 (4808): No heartbeat from core client for 30 sec - exiting 18:34:44 (4808): No heartbeat from core client for 30 sec - exiting 18:34:45 (4808): No heartbeat from core client for 30 sec - exiting 18:34:46 (4808): No heartbeat from core client for 30 sec - exiting 18:34:47 (4808): No heartbeat from core client for 30 sec - exiting 18:34:48 (4808): No heartbeat from core client for 30 sec - exiting 18:34:49 (4808): No heartbeat from core client for 30 sec - exiting 18:34:50 (4808): No heartbeat from core client for 30 sec - exiting 18:34:51 (4808): No heartbeat from core client for 30 sec - exiting 18:34:52 (4808): No heartbeat from core client for 30 sec - exiting 18:34:53 (4808): No heartbeat from core client for 30 sec - exiting Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4360, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3432, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5200, selfPID=5320, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 19:10:04 (6864): Can't acquire lockfile (32) - waiting 35s CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... GController:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5312, selfPID=4960, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6884, selfPID=6884, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6584, selfPID=5832, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 18:46:24 (6088): No heartbeat from core client for 30 sec - exiting 18:46:26 (6088): No heartbeat from core client for 30 sec - exiting 18:46:27 (6088): No heartbeat from core client for 30 sec - exiting 18:46:28 (6088): No heartbeat from core client for 30 sec - exiting 18:46:29 (6088): No heartbeat from core client for 30 sec - exiting 18:46:30 (6088): No heartbeat from core client for 30 sec - exiting 18:46:31 (6088): No heartbeat from core client for 30 sec - exiting 18:46:32 (6088): No heartbeat from core client for 30 sec - exiting 18:46:33 (6088): No heartbeat from core client for 30 sec - exiting 18:46:34 (6088): No heartbeat from core client for 30 sec - exiting 18:46:35 (6088): No heartbeat from core client for 30 sec - exiting 18:46:36 (6088): No heartbeat from core client for 30 sec - exiting 18:46:37 (6088): No heartbeat from core client for 30 sec - exiting 18:46:38 (6088): No heartbeat from core client for 30 sec - exiting 18:46:39 (6088): No heartbeat from core client for 30 sec - exiting 18:46:40 (6088): No heartbeat from core client for 30 sec - exiting 18:46:41 (6088): No heartbeat from core client for 30 sec - exiting 18:46:42 (6088): No heartbeat from core client for 30 sec - exiting 18:46:43 (6088): No heartbeat from core client for 30 sec - exiting 18:46:44 (6088): No heartbeat from core client for 30 sec - exiting 18:46:45 (6088): No heartbeat from core client for 30 sec - exiting 18:46:46 (6088): No heartbeat from core client for 30 sec - exiting 18:46:47 (6088): No heartbeat from core client for 30 sec - exiting 18:46:48 (6088): No heartbeat from core client for 30 sec - exiting 18:46:49 (6088): No heartbeat from core client for 30 sec - exiting 18:46:50 (6088): No heartbeat from core client for 30 sec - exiting 18:46:51 (6088): No heartbeat from core client for 30 sec - exiting 18:46:52 (6088): No heartbeat from core client for 30 sec - exiting 18:46:53 (6088): No heartbeat from core client for 30 sec - exiting 18:46:54 (6088): No heartbeat from core client for 30 sec - exiting 18:46:55 (6088): No heartbeat from core client for 30 sec - exiting 18:46:56 (6088): No heartbeat from core client for 30 sec - exiting 18:46:57 (6088): No heartbeat from core client for 30 sec - exiting 18:46:58 (6088): No heartbeat from core client for 30 sec - exiting 18:46:59 (6088): No heartbeat from core client for 30 sec - exiting 18:47:00 (6088): No heartbeat from core client for 30 sec - exiting 18:47:01 (6088): No heartbeat from core client for 30 sec - exiting 18:47:02 (6088): No heartbeat from core client for 30 sec - exiting 18:47:03 (6088): No heartbeat from core client for 30 sec - exiting 18:47:04 (6088): No heartbeat from core client for 30 sec - exiting 18:47:05 (6088): No heartbeat from core client for 30 sec - exiting 18:47:06 (6088): No heartbeat from core client for 30 sec - exiting 18:47:07 (6088): No heartbeat from core client for 30 sec - exiting 18:47:08 (6088): No heartbeat from core client for 30 sec - exiting 18:47:09 (6088): No heartbeat from core client for 30 sec - exiting 18:47:10 (6088): No heartbeat from core client for 30 sec - exiting 18:47:11 (6088): No heartbeat from core client for 30 sec - exiting 18:47:12 (6088): No heartbeat from core client for 30 sec - exiting 18:47:13 (6088): No heartbeat from core client for 30 sec - exiting 18:47:14 (6088): No heartbeat from core client for 30 sec - exiting 18:47:15 (6088): No heartbeat from core client for 30 sec - exiting 18:47:16 (6088): No heartbeat from core client for 30 sec - exiting 18:47:17 (6088): No heartbeat from core client for 30 sec - exiting 18:47:18 (6088): No heartbeat from core client for 30 sec - exiting 18:47:19 (6088): No heartbeat from core client for 30 sec - exiting 18:47:20 (6088): No heartbeat from core client for 30 sec - exiting 18:47:21 (6088): No heartbeat from core client for 30 sec - exiting 18:47:22 (6088): No heartbeat from core client for 30 sec - exiting 18:47:23 (6088): No heartbeat from core client for 30 sec - exiting 18:47:24 (6088): No heartbeat from core client for 30 sec - exiting 18:47:25 (6088): No heartbeat from core client for 30 sec - exiting 18:47:26 (6088): No heartbeat from core client for 30 sec - exiting 18:47:27 (6088): No heartbeat from core client for 30 sec - exiting 18:47:28 (6088): No heartbeat from core client for 30 sec - exiting 18:47:29 (6088): No heartbeat from core client for 30 sec - exiting 18:47:30 (6088): No heartbeat from core client for 30 sec - exiting 18:47:31 (6088): No heartbeat from core client for 30 sec - exiting 18:47:32 (6088): No heartbeat from core client for 30 sec - exiting 18:47:33 (6088): No heartbeat from core client for 30 sec - exiting 18:47:34 (6088): No heartbeat from core client for 30 sec - exiting 18:47:35 (6088): No heartbeat from core client for 30 sec - exiting 18:47:36 (6088): No heartbeat from core client for 30 sec - exiting 18:47:37 (6088): No heartbeat from core client for 30 sec - exiting 18:47:38 (6088): No heartbeat from core client for 30 sec - exiting 18:47:39 (6088): No heartbeat from core client for 30 sec - exiting 18:47:40 (6088): No heartbeat from core client for 30 sec - exiting 18:47:41 (6088): No heartbeat from core client for 30 sec - exiting 18:47:42 (6088): No heartbeat from core client for 30 sec - exiting 18:47:43 (6088): No heartbeat from core client for 30 sec - exiting 18:47:44 (6088): No heartbeat from core client for 30 sec - exiting 18:47:45 (6088): No heartbeat from core client for 30 sec - exiting 18:47:46 (6088): No heartbeat from core client for 30 sec - exiting 18:47:47 (6088): No heartbeat from core client for 30 sec - exiting 18:47:48 (6088): No heartbeat from core client for 30 sec - exiting 18:47:49 (6088): No heartbeat from core client for 30 sec - exiting 18:47:50 (6088): No heartbeat from core client for 30 sec - exiting 18:47:51 (6088): No heartbeat from core client for 30 sec - exiting 18:47:52 (6088): No heartbeat from core client for 30 sec - exiting 18:47:53 (6088): No heartbeat from core client for 30 sec - exiting 18:47:54 (6088): No heartbeat from core client for 30 sec - exiting 18:47:55 (6088): No heartbeat from core client for 30 sec - exiting 18:47:56 (6088): No heartbeat from core client for 30 sec - exiting 18:47:57 (6088): No heartbeat from core client for 30 sec - exiting 18:47:58 (6088): No heartbeat from core client for 30 sec - exiting 18:47:59 (6088): No heartbeat from core client for 30 sec - exiting 18:48:00 (6088): No heartbeat from core client for 30 sec - exiting 18:48:01 (6088): No heartbeat from core client for 30 sec - exiting 18:48:02 (6088): No heartbeat from core client for 30 sec - exiting 18:48:03 (6088): No heartbeat from core client for 30 sec - exiting 18:48:04 (6088): No heartbeat from core client for 30 sec - exiting 18:48:05 (6088): No heartbeat from core client for 30 sec - exiting 18:48:06 (6088): No heartbeat from core client for 30 sec - exiting 18:48:07 (6088): No heartbeat from core client for 30 sec - exiting 18:48:08 (6088): No heartbeat from core client for 30 sec - exiting 18:48:09 (6088): No heartbeat from core client for 30 sec - exiting 18:48:10 (6088): No heartbeat from core client for 30 sec - exiting 18:48:11 (6088): No heartbeat from core client for 30 sec - exiting 18:48:12 (6088): No heartbeat from core client for 30 sec - exiting 18:48:13 (6088): No heartbeat from core client for 30 sec - exiting 18:48:14 (6088): No heartbeat from core client for 30 sec - exiting 18:48:15 (6088): No heartbeat from core client for 30 sec - exiting 18:48:16 (6088): No heartbeat from core client for 30 sec - exiting 18:48:17 (6088): No heartbeat from core client for 30 sec - exiting 18:48:18 (6088): No heartbeat from core client for 30 sec - exiting 18:48:19 (6088): No heartbeat from core client for 30 sec - exiting 18:48:20 (6088): No heartbeat from core client for 30 sec - exiting 18:48:21 (6088): No heartbeat from core client for 30 sec - exiting 18:48:22 (6088): No heartbeat from core client for 30 sec - exiting 18:48:23 (6088): No heartbeat from core client for 30 sec - exiting 18:48:24 (6088): No heartbeat from core client for 30 sec - exiting 18:48:25 (6088): No heartbeat from core client for 30 sec - exiting 18:48:26 (6088): No heartbeat from core client for 30 sec - exiting 18:48:27 (6088): No heartbeat from core client for 30 sec - exiting 18:48:28 (6088): No heartbeat from core client for 30 sec - exiting 18:48:29 (6088): No heartbeat from core client for 30 sec - exiting 18:48:30 (6088): No heartbeat from core client for 30 sec - exiting 18:48:31 (6088): No heartbeat from core client for 30 sec - exiting 18:48:32 (6088): No heartbeat from core client for 30 sec - exiting 18:48:33 (6088): No heartbeat from core client for 30 sec - exiting 18:48:34 (6088): No heartbeat from core client for 30 sec - exiting 18:48:35 (6088): No heartbeat from core client for 30 sec - exiting 18:48:36 (6088): No heartbeat from core client for 30 sec - exiting 18:48:37 (6088): No heartbeat from core client for 30 sec - exiting 18:48:38 (6088): No heartbeat from core client for 30 sec - exiting 18:48:39 (6088): No heartbeat from core client for 30 sec - exiting 18:48:40 (6088): No heartbeat from core client for 30 sec - exiting 18:48:41 (6088): No heartbeat from core client for 30 sec - exiting 18:48:42 (6088): No heartbeat from core client for 30 sec - exiting 18:48:43 (6088): No heartbeat from core client for 30 sec - exiting 18:48:44 (6088): No heartbeat from core client for 30 sec - exiting 18:48:45 (6088): No heartbeat from core client for 30 sec - exiting 18:48:46 (6088): No heartbeat from core client for 30 sec - exiting 18:48:47 (6088): No heartbeat from core client for 30 sec - exiting 18:48:48 (6088): No heartbeat from core client for 30 sec - exiting 18:48:49 (6088): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6688, selfPID=2384, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... 07:06:39 (7148): No heartbeat from core client for 30 sec - exiting 07:06:40 (7148): No heartbeat from core client for 30 sec - exiting 07:06:41 (7148): No heartbeat from core client for 30 sec - exiting 07:06:42 (7148): No heartbeat from core client for 30 sec - exiting 07:06:43 (7148): No heartbeat from core client for 30 sec - exiting 07:06:44 (7148): No heartbeat from core client for 30 sec - exiting 07:06:45 (7148): No heartbeat from core client for 30 sec - exiting 07:06:46 (7148): No heartbeat from core client for 30 sec - exiting 07:06:47 (7148): No heartbeat from core client for 30 sec - exiting 07:06:48 (7148): No heartbeat from core client for 30 sec - exiting 07:06:49 (7148): No heartbeat from core client for 30 sec - exiting 07:06:50 (7148): No heartbeat from core client for 30 sec - exiting 07:06:51 (7148): No heartbeat from core client for 30 sec - exiting 07:06:52 (7148): No heartbeat from core client for 30 sec - exiting 07:06:53 (7148): No heartbeat from core client for 30 sec - exiting 07:06:54 (7148): No heartbeat from core client for 30 sec - exiting 07:06:55 (7148): No heartbeat from core client for 30 sec - exiting 07:06:56 (7148): No heartbeat from core client for 30 sec - exiting 07:06:57 (7148): No heartbeat from core client for 30 sec - exiting 07:06:58 (7148): No heartbeat from core client for 30 sec - exiting 07:06:59 (7148): No heartbeat from core client for 30 sec - exiting 07:07:00 (7148): No heartbeat from core client for 30 sec - exiting 07:07:01 (7148): No heartbeat from core client for 30 sec - exiting 07:07:02 (7148): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5332, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... GController:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3152, selfPID=4216, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=7356, selfPID=7332, iMonCtr=1 Model crash detected, will try to restart... 07:15:52 (6332): Can't acquire lockfile (32) - waiting 35s 07:20:06 (7908): Can't acquire lockfile (32) - waiting 35s 07:22:08 (6148): Can't acquire lockfile (32) - waiting 35s CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... No Process Handle Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=0, iMonCtr=1 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 07:30:34 (7852): Can't acquire lockfile (32) - waiting 35s CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=7252, selfPID=4512, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5416, selfPID=4400, iMonCtr=1 Model crash detected, will try to restart... 15:42:02 (5708): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=7560, selfPID=7560, iMonCtr=2 17:13:33 (5516): Can't acquire lockfile (32) - waiting 35s 17:14:23 (692): Can't acquire lockfile (32) - waiting 35s Regional Worker:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 forrtl: Access is denied. CPDN Monitor - Quit request from BOINC... No Process Handle Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5980, selfPID=5980, iMonCtr=1 CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=7196, selfPID=7196, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6400, selfPID=6400, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6824, selfPID=6824, iMonCtr=2 CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3288, selfPID=3288, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 17:47:48 (7724): Can't acquire lockfile (32) - waiting 35s CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6604, selfPID=6604, iMonCtr=2 CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4132, selfPID=4132, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=7964, selfPID=7964, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5580, selfPID=5580, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2096, selfPID=2096, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5944, selfPID=5944, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3464, selfPID=3464, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 18:57:40 (5880): Can't acquire lockfile (32) - waiting 35s CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=7352, selfPID=7352, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4880, selfPID=4880, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=536, selfPID=536, iMonCtr=2 CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6848, selfPID=6848, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=8004, selfPID=8004, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6724, selfPID=7700, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=7176, selfPID=7176, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 11:48:27 (7840): Can't acquire lockfile (32) - waiting 35s CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=188, selfPID=5340, iMonCtr=1 Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=188, selfPID=188, iMonCtr=1 CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3504, selfPID=3504, iMonCtr=2 12:39:57 (5736): Can't acquire lockfile (32) - waiting 35s CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3676, selfPID=3676, iMonCtr=2 12:53:52 (3076): Can't acquire lockfile (32) - waiting 35s CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=7892, selfPID=7892, iMonCtr=2 CPDN Monitor - Quit request from BOINC... No Process Handle Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=0, iMonCtr=1 CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5984, selfPID=5984, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 13:27:47 (6884): Can't acquire lockfile (32) - waiting 35s CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1784, selfPID=1784, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=8020, selfPID=8020, iMonCtr=2 13:35:51 (4432): Can't acquire lockfile (32) - waiting 35s 13:37:02 (2984): Can't acquire lockfile (32) - waiting 35s CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 11:00:04 (4816): Can't acquire lockfile (32) - waiting 35s CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=7140, selfPID=5620, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3692, selfPID=3692, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5520, selfPID=5620, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4436, selfPID=4436, iMonCtr=2 CPDN Monitor - Quit request from BOINC... 21:53:31 (7748): Can't acquire lockfile (32) - waiting 35s CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 22:01:43 (8020): Can't acquire lockfile (32) - waiting 35s CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1584, selfPID=1584, iMonCtr=2 06:55:13 (7672): Can't acquire lockfile (32) - waiting 35s 06:59:53 (4868): No heartbeat from core client for 30 sec - exiting 06:59:54 (4868): No heartbeat from core client for 30 sec - exiting 06:59:55 (4868): No heartbeat from core client for 30 sec - exiting 06:59:56 (4868): No heartbeat from core client for 30 sec - exiting 06:59:57 (4868): No heartbeat from core client for 30 sec - exiting 06:59:58 (4868): No heartbeat from core client for 30 sec - exiting 06:59:59 (4868): No heartbeat from core client for 30 sec - exiting 07:00:00 (4868): No heartbeat from core client for 30 sec - exiting 07:00:01 (4868): No heartbeat from core client for 30 sec - exiting 07:00:02 (4868): No heartbeat from core client for 30 sec - exiting 07:00:03 (4868): No heartbeat from core client for 30 sec - exiting 07:00:04 (4868): No heartbeat from core client for 30 sec - exiting 07:00:05 (4868): No heartbeat from core client for 30 sec - exiting 07:00:06 (4868): No heartbeat from core client for 30 sec - exiting 07:00:07 (4868): No heartbeat from core client for 30 sec - exiting 07:00:08 (4868): No heartbeat from core client for 30 sec - exiting 07:00:09 (4868): No heartbeat from core client for 30 sec - exiting 07:00:10 (4868): No heartbeat from core client for 30 sec - exiting 07:00:11 (4868): No heartbeat from core client for 30 sec - exiting 07:00:12 (4868): No heartbeat from core client for 30 sec - exiting 07:00:13 (4868): No heartbeat from core client for 30 sec - exiting 07:00:14 (4868): No heartbeat from core client for 30 sec - exiting 07:00:15 (4868): No heartbeat from core client for 30 sec - exiting 07:00:16 (4868): No heartbeat from core client for 30 sec - exiting 07:00:17 (4868): No heartbeat from core client for 30 sec - exiting 07:00:18 (4868): No heartbeat from core client for 30 sec - exiting 07:00:19 (4868): No heartbeat from core client for 30 sec - exiting 07:00:20 (4868): No heartbeat from core client for 30 sec - exiting 07:00:21 (4868): No heartbeat from core client for 30 sec - exiting 07:00:22 (4868): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5568, selfPID=5568, iMonCtr=2 CPDN Monitor - Quit request from BOINC... 07:18:51 (4348): No heartbeat from core client for 30 sec - exiting 07:18:52 (4348): No heartbeat from core client for 30 sec - exiting 07:18:53 (4348): No heartbeat from core client for 30 sec - exiting 07:18:54 (4348): No heartbeat from core client for 30 sec - exiting 07:18:55 (4348): No heartbeat from core client for 30 sec - exiting 07:18:56 (4348): No heartbeat from core client for 30 sec - exiting 07:18:57 (4348): No heartbeat from core client for 30 sec - exiting 07:18:58 (4348): No heartbeat from core client for 30 sec - exiting 07:18:59 (4348): No heartbeat from core client for 30 sec - exiting 07:19:00 (4348): No heartbeat from core client for 30 sec - exiting 07:19:01 (4348): No heartbeat from core client for 30 sec - exiting 07:19:02 (4348): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6696, selfPID=6696, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7900, iMonCtr=2 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6948, selfPID=7816, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6068, selfPID=6068, iMonCtr=2 CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=7612, selfPID=7612, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5412, selfPID=5412, iMonCtr=2 CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=7952, selfPID=5192, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2232, selfPID=5132, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1764, selfPID=6820, iMonCtr=1 Model crash detected, will try to restart... GCobal Worker:: ColN plecess CsPDoN rprnocgeses tisg nbott rlun ni nhgckPIxi0, sg,f bDRe50Va l o= t1, checkPID=0, selfPID=6072, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6512, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... 18:44:26 (6512): called boinc_finish CPDN Monitor - Quit request from BOINC... </stderr_txt> <message> <file_xfer_error> <file_name>hadam3p_saf_1g4r_1986_1_006948739_0_10.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_saf_1g4r_1986_1_006948739_0_11.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_saf_1g4r_1986_1_006948739_0_12.zip</file_name> <error_code>-161</error_code> </file_xfer_error> </message> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
20 Apr 2011 19:30:04	1017586	12229310	hadam3p_saf_1g4r_1986_1_006948739_0	103,776	250,477	2.4136
12 Apr 2011 17:55:45	1017586	12229310	hadam3p_saf_1g4r_1986_1_006948739_0	92,256	222,916	2.4163
10 Apr 2011 10:30:37	1017586	12229310	hadam3p_saf_1g4r_1986_1_006948739_0	80,753	196,237	2.4301
10 Apr 2011 10:18:09	1017586	12229310	hadam3p_saf_1g4r_1986_1_006948739_0	80,736	195,840	2.4257
08 Apr 2011 21:36:46	1017586	12229310	hadam3p_saf_1g4r_1986_1_006948739_0	69,216	168,653	2.4366
06 Apr 2011 21:04:26	1017586	12229310	hadam3p_saf_1g4r_1986_1_006948739_0	57,696	140,894	2.4420
05 Apr 2011 18:04:49	1017586	12229310	hadam3p_saf_1g4r_1986_1_006948739_0	46,176	112,812	2.4431
28 Mar 2011 06:01:18	1017586	12229310	hadam3p_saf_1g4r_1986_1_006948739_0	34,700	85,020	2.4501
27 Mar 2011 09:52:52	1017586	12229310	hadam3p_saf_1g4r_1986_1_006948739_0	34,688	84,576	2.4382
25 Mar 2011 18:04:49	1017586	12229310	hadam3p_saf_1g4r_1986_1_006948739_0	34,668	84,176	2.4281
25 Mar 2011 07:34:57	1017586	12229310	hadam3p_saf_1g4r_1986_1_006948739_0	34,656	83,763	2.4170
18 Mar 2011 07:12:41	1017586	12229310	hadam3p_saf_1g4r_1986_1_006948739_0	23,137	55,797	2.4116
18 Mar 2011 07:02:32	1017586	12229310	hadam3p_saf_1g4r_1986_1_006948739_0	23,136	55,426	2.3957
14 Mar 2011 18:53:51	1017586	12229310	hadam3p_saf_1g4r_1986_1_006948739_0	11,616	27,873	2.3995