Task 13491394

Name	hadam3p_eu_6ocf_1999_1_007498820_0
Workunit	7696295
Created	14 Oct 2011, 19:53:39 UTC
Sent	17 Oct 2011, 4:40:52 UTC
Report deadline	28 Sep 2012, 10:00:52 UTC
Received	5 Jan 2012, 3:59:32 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	0 (0x00000000)
Computer ID	1096158
Run time	3 days 2 hours 23 min 25 sec
CPU time	2 days 15 hours 49 min 16 sec
Validate state	Invalid
Credit	1,392.75
Device peak FLOPS	2.39 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Europe v6.09 windows_intelx86
Stderr	<core_client_version>6.12.33</core_client_version> <![CDATA[ <stderr_txt> CPDN Monitor - Quit request from BOINC... 21:06:09 (1044): No heartbeat from core client for 30 sec - exiting 21:06:10 (1044): No heartbeat from core client for 30 sec - exiting 21:06:11 (1044): No heartbeat from core client for 30 sec - exiting 21:06:13 (1044): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 21:48:58 (5992): No heartbeat from core client for 30 sec - exiting 21:48:59 (5992): No heartbeat from core client for 30 sec - exiting 21:49:00 (5992): No heartbeat from core client for 30 sec - exiting 21:49:01 (5992): No heartbeat from core client for 30 sec - exiting 21:49:02 (5992): No heartbeat from core client for 30 sec - exiting 21:49:03 (5992): No heartbeat from core client for 30 sec - exiting 21:49:04 (5992): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1040, selfPID=1040, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=320, selfPID=320, iMonCtr=2 CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1256, selfPID=1256, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4744, selfPID=4744, iMonCtr=2 22:10:42 (944): No heartbeat from core client for 30 sec - exiting 22:10:43 (944): No heartbeat from core client for 30 sec - exiting 22:10:44 (944): No heartbeat from core client for 30 sec - exiting 22:10:45 (944): No heartbeat from core client for 30 sec - exiting 22:10:46 (944): No heartbeat from core client for 30 sec - exiting 22:10:47 (944): No heartbeat from core client for 30 sec - exiting 22:10:48 (944): No heartbeat from core client for 30 sec - exiting 22:10:49 (944): No heartbeat from core client for 30 sec - exiting 22:10:51 (944): No heartbeat from core client for 30 sec - exiting 22:10:52 (944): No heartbeat from core client for 30 sec - exiting 22:10:53 (944): No heartbeat from core client for 30 sec - exiting 22:10:54 (944): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1080, selfPID=1080, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 20:30:37 (4068): No heartbeat from core client for 30 sec - exiting 20:30:39 (4068): No heartbeat from core client for 30 sec - exiting 20:30:40 (4068): No heartbeat from core client for 30 sec - exiting 20:30:41 (4068): No heartbeat from core client for 30 sec - exiting 20:30:42 (4068): No heartbeat from core client for 30 sec - exiting 20:30:43 (4068): No heartbeat from core client for 30 sec - exiting 20:30:44 (4068): No heartbeat from core client for 30 sec - exiting 20:30:45 (4068): No heartbeat from core client for 30 sec - exiting 20:30:46 (4068): No heartbeat from core client for 30 sec - exiting 20:30:47 (4068): No heartbeat from core client for 30 sec - exiting 20:30:48 (4068): No heartbeat from core client for 30 sec - exiting 20:30:49 (4068): No heartbeat from core client for 30 sec - exiting 20:30:50 (4068): No heartbeat from core client for 30 sec - exiting 20:30:51 (4068): No heartbeat from core client for 30 sec - exiting 20:30:52 (4068): No heartbeat from core client for 30 sec - exiting 20:30:53 (4068): No heartbeat from core client for 30 sec - exiting 20:30:54 (4068): No heartbeat from core client for 30 sec - exiting 20:30:55 (4068): No heartbeat from core client for 30 sec - exiting 20:30:56 (4068): No heartbeat from core client for 30 sec - exiting 20:30:57 (4068): No heartbeat from core client for 30 sec - exiting 20:30:58 (4068): No heartbeat from core client for 30 sec - exiting 20:30:59 (4068): No heartbeat from core client for 30 sec - exiting 20:31:00 (4068): No heartbeat from core client for 30 sec - exiting 20:31:01 (4068): No heartbeat from core client for 30 sec - exiting 20:31:02 (4068): No heartbeat from core client for 30 sec - exiting 20:31:03 (4068): No heartbeat from core client for 30 sec - exiting 20:31:04 (4068): No heartbeat from core client for 30 sec - exiting 20:31:05 (4068): No heartbeat from core client for 30 sec - exiting 20:31:06 (4068): No heartbeat from core client for 30 sec - exiting 20:31:07 (4068): No heartbeat from core client for 30 sec - exiting 20:31:08 (4068): No heartbeat from core client for 30 sec - exiting 20:31:09 (4068): No heartbeat from core client for 30 sec - exiting 20:31:10 (4068): No heartbeat from core client for 30 sec - exiting 20:31:11 (4068): No heartbeat from core client for 30 sec - exiting 20:31:12 (4068): No heartbeat from core client for 30 sec - exiting 20:31:13 (4068): No heartbeat from core client for 30 sec - exiting 20:31:14 (4068): No heartbeat from core client for 30 sec - exiting 20:31:15 (4068): No heartbeat from core client for 30 sec - exiting 20:31:16 (4068): No heartbeat from core client for 30 sec - exiting 20:31:17 (4068): No heartbeat from core client for 30 sec - exiting 20:31:18 (4068): No heartbeat from core client for 30 sec - exiting 20:31:19 (4068): No heartbeat from core client for 30 sec - exiting 20:31:20 (4068): No heartbeat from core client for 30 sec - exiting 20:31:21 (4068): No heartbeat from core client for 30 sec - exiting 20:31:22 (4068): No heartbeat from core client for 30 sec - exiting 20:31:23 (4068): No heartbeat from core client for 30 sec - exiting 20:31:24 (4068): No heartbeat from core client for 30 sec - exiting 20:31:25 (4068): No heartbeat from core client for 30 sec - exiting 20:31:26 (4068): No heartbeat from core client for 30 sec - exiting 20:31:27 (4068): No heartbeat from core client for 30 sec - exiting 20:31:28 (4068): No heartbeat from core client for 30 sec - exiting 20:31:29 (4068): No heartbeat from core client for 30 sec - exiting 20:31:30 (4068): No heartbeat from core client for 30 sec - exiting 20:31:31 (4068): No heartbeat from core client for 30 sec - exiting 20:31:32 (4068): No heartbeat from core client for 30 sec - exiting 20:31:33 (4068): No heartbeat from core client for 30 sec - exiting 20:31:34 (4068): No heartbeat from core client for 30 sec - exiting 20:31:35 (4068): No heartbeat from core client for 30 sec - exiting 20:31:36 (4068): No heartbeat from core client for 30 sec - exiting 20:31:37 (4068): No heartbeat from core client for 30 sec - exiting 20:31:38 (4068): No heartbeat from core client for 30 sec - exiting 20:31:39 (4068): No heartbeat from core client for 30 sec - exiting 20:31:40 (4068): No heartbeat from core client for 30 sec - exiting 20:31:41 (4068): No heartbeat from core client for 30 sec - exiting 20:31:43 (4068): No heartbeat from core client for 30 sec - exiting 20:31:44 (4068): No heartbeat from core client for 30 sec - exiting 20:31:45 (4068): No heartbeat from core client for 30 sec - exiting 20:31:46 (4068): No heartbeat from core client for 30 sec - exiting 20:31:47 (4068): No heartbeat from core client for 30 sec - exiting 20:56:22 (5664): No heartbeat from core client for 30 sec - exiting 20:56:23 (5664): No heartbeat from core client for 30 sec - exiting 20:56:24 (5664): No heartbeat from core client for 30 sec - exiting 20:56:25 (5664): No heartbeat from core client for 30 sec - exiting 20:56:26 (5664): No heartbeat from core client for 30 sec - exiting 20:56:27 (5664): No heartbeat from core client for 30 sec - exiting 20:56:28 (5664): No heartbeat from core client for 30 sec - exiting 20:56:29 (5664): No heartbeat from core client for 30 sec - exiting 20:56:30 (5664): No heartbeat from core client for 30 sec - exiting 20:56:31 (5664): No heartbeat from core client for 30 sec - exiting 20:56:32 (5664): No heartbeat from core client for 30 sec - exiting 20:56:33 (5664): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 22:02:24 (4108): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 22:31:32 (6608): No heartbeat from core client for 30 sec - exiting 22:31:33 (6608): No heartbeat from core client for 30 sec - exiting 22:31:34 (6608): No heartbeat from core client for 30 sec - exiting 22:31:35 (6608): No heartbeat from core client for 30 sec - exiting 22:31:36 (6608): No heartbeat from core client for 30 sec - exiting 22:31:37 (6608): No heartbeat from core client for 30 sec - exiting 22:31:38 (6608): No heartbeat from core client for 30 sec - exiting 22:31:39 (6608): No heartbeat from core client for 30 sec - exiting 22:31:40 (6608): No heartbeat from core client for 30 sec - exiting 22:31:41 (6608): No heartbeat from core client for 30 sec - exiting 22:31:42 (6608): No heartbeat from core client for 30 sec - exiting 22:31:43 (6608): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 20:36:55 (5772): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3124, selfPID=3124, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1252, selfPID=1252, iMonCtr=2 00:59:37 (6564): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2332, selfPID=2332, iMonCtr=2 CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5936, selfPID=5936, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5924, selfPID=5924, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5676, selfPID=5676, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 23:43:47 (1248): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5988, selfPID=5988, iMonCtr=2 Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1336, selfPID=1336, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 18:41:19 (3564): No heartbeat from core client for 30 sec - exiting 18:41:20 (3564): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2580, selfPID=2580, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4196, selfPID=4196, iMonCtr=2 CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 00:01:56 (3704): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6880, selfPID=6880, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=200, selfPID=200, iMonCtr=2 Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5940, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3948, selfPID=3948, iMonCtr=2 CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3924, selfPID=3924, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1232, selfPID=1232, iMonCtr=2 CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5536, selfPID=5536, iMonCtr=2 21:51:58 (1076): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4496, selfPID=4496, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5724, selfPID=5724, iMonCtr=2 Suspended CPDN Monitor - Suspend request from BOINC... 16:12:00 (4508): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6004, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4072, iMonCtr=2 Model crash detected, will try to restart... 19:41:25 (5344): No heartbeat from core client for 30 sec - exiting 19:41:26 (5344): No heartbeat from core client for 30 sec - exiting 19:41:27 (5344): No heartbeat from core client for 30 sec - exiting 19:41:28 (5344): No heartbeat from core client for 30 sec - exiting 19:41:29 (5344): No heartbeat from core client for 30 sec - exiting 19:41:30 (5344): No heartbeat from core client for 30 sec - exiting 19:41:31 (5344): No heartbeat from core client for 30 sec - exiting 19:41:32 (5344): No heartbeat from core client for 30 sec - exiting 19:41:33 (5344): No heartbeat from core client for 30 sec - exiting 19:41:34 (5344): No heartbeat from core client for 30 sec - exiting 19:41:35 (5344): No heartbeat from core client for 30 sec - exiting 19:41:36 (5344): No heartbeat from core client for 30 sec - exiting 19:41:37 (5344): No heartbeat from core client for 30 sec - exiting 19:41:38 (5344): No heartbeat from core client for 30 sec - exiting 19:41:39 (5344): No heartbeat from core client for 30 sec - exiting 19:41:40 (5344): No heartbeat from core client for 30 sec - exiting 19:41:41 (5344): No heartbeat from core client for 30 sec - exiting 19:41:42 (5344): No heartbeat from core client for 30 sec - exiting 19:41:43 (5344): No heartbeat from core client for 30 sec - exiting 19:41:44 (5344): No heartbeat from core client for 30 sec - exiting 19:41:45 (5344): No heartbeat from core client for 30 sec - exiting 19:41:46 (5344): No heartbeat from core client for 30 sec - exiting 19:41:47 (5344): No heartbeat from core client for 30 sec - exiting 19:41:48 (5344): No heartbeat from core client for 30 sec - exiting 19:41:49 (5344): No heartbeat from core client for 30 sec - exiting 19:41:50 (5344): No heartbeat from core client for 30 sec - exiting 19:41:51 (5344): No heartbeat from core client for 30 sec - exiting 19:41:52 (5344): No heartbeat from core client for 30 sec - exiting 19:41:53 (5344): No heartbeat from core client for 30 sec - exiting 19:41:54 (5344): No heartbeat from core client for 30 sec - exiting 19:41:55 (5344): No heartbeat from core client for 30 sec - exiting 19:41:57 (5344): No heartbeat from core client for 30 sec - exiting 19:41:58 (5344): No heartbeat from core client for 30 sec - exiting 19:41:59 (5344): No heartbeat from core client for 30 sec - exiting 19:42:00 (5344): No heartbeat from core client for 30 sec - exiting 19:42:01 (5344): No heartbeat from core client for 30 sec - exiting 19:42:02 (5344): No heartbeat from core client for 30 sec - exiting 19:42:03 (5344): No heartbeat from core client for 30 sec - exiting 19:42:04 (5344): No heartbeat from core client for 30 sec - exiting 19:42:05 (5344): No heartbeat from core client for 30 sec - exiting 19:42:06 (5344): No heartbeat from core client for 30 sec - exiting 19:42:07 (5344): No heartbeat from core client for 30 sec - exiting 19:42:08 (5344): No heartbeat from core client for 30 sec - exiting 19:42:09 (5344): No heartbeat from core client for 30 sec - exiting 19:42:10 (5344): No heartbeat from core client for 30 sec - exiting 19:42:11 (5344): No heartbeat from core client for 30 sec - exiting 19:42:12 (5344): No heartbeat from core client for 30 sec - exiting 19:42:13 (5344): No heartbeat from core client for 30 sec - exiting 19:42:14 (5344): No heartbeat from core client for 30 sec - exiting 19:42:15 (5344): No heartbeat from core client for 30 sec - exiting 19:42:16 (5344): No heartbeat from core client for 30 sec - exiting 19:42:17 (5344): No heartbeat from core client for 30 sec - exiting 19:42:18 (5344): No heartbeat from core client for 30 sec - exiting 19:42:19 (5344): No heartbeat from core client for 30 sec - exiting 19:42:20 (5344): No heartbeat from core client for 30 sec - exiting 19:42:21 (5344): No heartbeat from core client for 30 sec - exiting 19:42:22 (5344): No heartbeat from core client for 30 sec - exiting 19:42:23 (5344): No heartbeat from core client for 30 sec - exiting 19:42:24 (5344): No heartbeat from core client for 30 sec - exiting 19:42:25 (5344): No heartbeat from core client for 30 sec - exiting 19:42:26 (5344): No heartbeat from core client for 30 sec - exiting 19:42:27 (5344): No heartbeat from core client for 30 sec - exiting 19:42:28 (5344): No heartbeat from core client for 30 sec - exiting 19:42:29 (5344): No heartbeat from core client for 30 sec - exiting 19:42:30 (5344): No heartbeat from core client for 30 sec - exiting 19:42:31 (5344): No heartbeat from core client for 30 sec - exiting 19:42:32 (5344): No heartbeat from core client for 30 sec - exiting 19:42:33 (5344): No heartbeat from core client for 30 sec - exiting 19:42:34 (5344): No heartbeat from core client for 30 sec - exiting 19:42:35 (5344): No heartbeat from core client for 30 sec - exiting 19:42:36 (5344): No heartbeat from core client for 30 sec - exiting 19:42:37 (5344): No heartbeat from core client for 30 sec - exiting 19:42:38 (5344): No heartbeat from core client for 30 sec - exiting 19:42:39 (5344): No heartbeat from core client for 30 sec - exiting 19:42:40 (5344): No heartbeat from core client for 30 sec - exiting 19:42:41 (5344): No heartbeat from core client for 30 sec - exiting 19:42:42 (5344): No heartbeat from core client for 30 sec - exiting 19:42:43 (5344): No heartbeat from core client for 30 sec - exiting 19:42:44 (5344): No heartbeat from core client for 30 sec - exiting 20:01:28 (4880): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3432, selfPID=3432, iMonCtr=2 CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5700, selfPID=5700, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1116, selfPID=1116, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=212, selfPID=212, iMonCtr=2 CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2932, selfPID=2932, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5320, selfPID=5320, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6068, selfPID=6068, iMonCtr=2 CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 00:08:13 (5628): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2612, selfPID=2612, iMonCtr=2 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5908, selfPID=2632, iMonCtr=1 Model crash detected, will try to restart... 19:29:34 (2412): No heartbeat from core client for 30 sec - exiting 19:29:35 (2412): No heartbeat from core client for 30 sec - exiting 19:29:36 (2412): No heartbeat from core client for 30 sec - exiting 19:29:37 (2412): No heartbeat from core client for 30 sec - exiting 19:29:39 (2412): No heartbeat from core client for 30 sec - exiting 19:29:40 (2412): No heartbeat from core client for 30 sec - exiting 19:29:41 (2412): No heartbeat from core client for 30 sec - exiting 19:29:42 (2412): No heartbeat from core client for 30 sec - exiting 19:29:43 (2412): No heartbeat from core client for 30 sec - exiting 19:29:44 (2412): No heartbeat from core client for 30 sec - exiting 19:29:45 (2412): No heartbeat from core client for 30 sec - exiting 19:29:46 (2412): No heartbeat from core client for 30 sec - exiting 19:29:47 (2412): No heartbeat from core client for 30 sec - exiting 19:29:48 (2412): No heartbeat from core client for 30 sec - exiting 19:29:49 (2412): No heartbeat from core client for 30 sec - exiting 19:29:51 (2412): No heartbeat from core client for 30 sec - exiting 19:29:52 (2412): No heartbeat from core client for 30 sec - exiting 19:29:53 (2412): No heartbeat from core client for 30 sec - exiting 19:29:54 (2412): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3280, selfPID=3280, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3280, selfPID=920, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Called boinc_finish </stderr_txt> <message> upload failure: <file_xfer_error> <file_name>hadam3p_eu_6ocf_1999_1_007498820_0_8.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_eu_6ocf_1999_1_007498820_0_9.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_eu_6ocf_1999_1_007498820_0_10.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_eu_6ocf_1999_1_007498820_0_11.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_eu_6ocf_1999_1_007498820_0_12.zip</file_name> <error_code>-161</error_code> </file_xfer_error> </message> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
02 Jan 2012 08:49:50	1096158	13491394	hadam3p_eu_6ocf_1999_1_007498820_0	80,736	205,503	2.5454
21 Dec 2011 10:13:15	1096158	13491394	hadam3p_eu_6ocf_1999_1_007498820_0	69,216	176,452	2.5493
19 Dec 2011 03:16:27	1096158	13491394	hadam3p_eu_6ocf_1999_1_007498820_0	57,696	147,051	2.5487
17 Dec 2011 21:04:46	1096158	13491394	hadam3p_eu_6ocf_1999_1_007498820_0	46,176	117,485	2.5443
13 Dec 2011 07:05:19	1096158	13491394	hadam3p_eu_6ocf_1999_1_007498820_0	34,660	88,201	2.5447
13 Dec 2011 05:54:50	1096158	13491394	hadam3p_eu_6ocf_1999_1_007498820_0	34,656	87,810	2.5338
09 Dec 2011 06:52:09	1096158	13491394	hadam3p_eu_6ocf_1999_1_007498820_0	23,136	58,622	2.5338
04 Dec 2011 08:04:46	1096158	13491394	hadam3p_eu_6ocf_1999_1_007498820_0	11,616	29,583	2.5467