Task 16780409

Name	hadam3p_eu_h5a0_2013_1_008860665_0
Workunit	9006594
Created	9 Jul 2014, 9:49:00 UTC
Sent	16 Jul 2014, 18:48:48 UTC
Report deadline	29 Jun 2015, 0:08:48 UTC
Received	7 Aug 2014, 18:02:55 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	0 (0x00000000)
Computer ID	1317294
Run time	2 days 12 hours 40 min 49 sec
CPU time	2 days 5 hours 41 min 56 sec
Validate state	Invalid
Credit	1,194.35
Device peak FLOPS	2.70 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Europe v6.09 windows_intelx86
Stderr	<core_client_version>7.2.42</core_client_version> <![CDATA[ <stderr_txt> 19:51:53 (11268): start_timer_thread(): CreateThread() failed, errno 0 19:51:53 (9872): start_timer_thread(): CreateThread() failed, errno 0 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=11268, selfPID=11268, iMonCtr=2 22:37:42 (6288): start_timer_thread(): CreateThread() failed, errno 0 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 06:54:21 (6932): start_timer_thread(): CreateThread() failed, errno 0 06:54:21 (13028): start_timer_thread(): CreateThread() failed, errno 0 Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 22:13:54 (9884): start_timer_thread(): CreateThread() failed, errno 0 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4740, selfPID=4740, iMonCtr=2 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=11576, selfPID=11576, iMonCtr=2 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=9696, selfPID=2980, iMonCtr=1 Model crash detected, will try to restart... 21:31:06 (7900): No heartbeat from core client for 30 sec - exiting 21:31:07 (7900): No heartbeat from core client for 30 sec - exiting 21:31:08 (7900): No heartbeat from core client for 30 sec - exiting 21:31:09 (7900): No heartbeat from core client for 30 sec - exiting 21:31:10 (7900): No heartbeat from core client for 30 sec - exiting 21:31:11 (7900): No heartbeat from core client for 30 sec - exiting 21:31:12 (7900): No heartbeat from core client for 30 sec - exiting 21:31:13 (7900): No heartbeat from core client for 30 sec - exiting 21:31:14 (7900): No heartbeat from core client for 30 sec - exiting 21:31:15 (7900): No heartbeat from core client for 30 sec - exiting 21:31:16 (7900): No heartbeat from core client for 30 sec - exiting 21:31:17 (7900): No heartbeat from core client for 30 sec - exiting 21:31:18 (7900): No heartbeat from core client for 30 sec - exiting 21:31:19 (7900): No heartbeat from core client for 30 sec - exiting 21:31:20 (7900): No heartbeat from core client for 30 sec - exiting 21:31:21 (7900): No heartbeat from core client for 30 sec - exiting 21:31:22 (7900): No heartbeat from core client for 30 sec - exiting 21:31:23 (7900): No heartbeat from core client for 30 sec - exiting 21:31:24 (7900): No heartbeat from core client for 30 sec - exiting 21:31:25 (7900): No heartbeat from core client for 30 sec - exiting 21:31:26 (7900): No heartbeat from core client for 30 sec - exiting 21:31:27 (7900): No heartbeat from core client for 30 sec - exiting 21:31:28 (7900): No heartbeat from core client for 30 sec - exiting 21:31:29 (7900): No heartbeat from core client for 30 sec - exiting 21:31:30 (7900): No heartbeat from core client for 30 sec - exiting 21:31:31 (7900): No heartbeat from core client for 30 sec - exiting 21:31:32 (7900): No heartbeat from core client for 30 sec - exiting 21:31:33 (7900): No heartbeat from core client for 30 sec - exiting 21:31:34 (7900): No heartbeat from core client for 30 sec - exiting 21:31:35 (7900): No heartbeat from core client for 30 sec - exiting 21:31:36 (7900): No heartbeat from core client for 30 sec - exiting 21:31:37 (7900): No heartbeat from core client for 30 sec - exiting 21:31:38 (7900): No heartbeat from core client for 30 sec - exiting 21:31:39 (7900): No heartbeat from core client for 30 sec - exiting 21:31:40 (7900): No heartbeat from core client for 30 sec - exiting 21:31:41 (7900): No heartbeat from core client for 30 sec - exiting 21:31:42 (7900): No heartbeat from core client for 30 sec - exiting 21:31:43 (7900): No heartbeat from core client for 30 sec - exiting 21:31:44 (7900): No heartbeat from core client for 30 sec - exiting 21:31:45 (7900): No heartbeat from core client for 30 sec - exiting 21:31:46 (7900): No heartbeat from core client for 30 sec - exiting 21:31:47 (7900): No heartbeat from core client for 30 sec - exiting 21:31:48 (7900): No heartbeat from core client for 30 sec - exiting 21:31:49 (7900): No heartbeat from core client for 30 sec - exiting 21:31:50 (7900): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:31:51 (7900): No heartbeat from core client for 30 sec - exiting 21:31:52 (7900): No heartbeat from core client for 30 sec - exiting 21:31:53 (7900): No heartbeat from core client for 30 sec - exiting 21:31:54 (7900): No heartbeat from core client for 30 sec - exiting 21:31:55 (7900): No heartbeat from core client for 30 sec - exiting 21:31:56 (7900): No heartbeat from core client for 30 sec - exiting 21:31:57 (7900): No heartbeat from core client for 30 sec - exiting 21:31:58 (7900): No heartbeat from core client for 30 sec - exiting 21:31:59 (7900): No heartbeat from core client for 30 sec - exiting 21:32:00 (7900): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 09:25:38 (6904): start_timer_thread(): CreateThread() failed, errno 0 Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 14:16:28 (7512): start_timer_thread(): CreateThread() failed, errno 0 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 09:40:13 (9824): start_timer_thread(): CreateThread() failed, errno 0 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 12:03:13 (10512): start_timer_thread(): CreateThread() failed, errno 0 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 18:28:38 (9168): start_timer_thread(): CreateThread() failed, errno 0 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=9168, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=14084, selfPID=4228, iMonCtr=1 Model crash detected, will try to restart... 19:42:25 (4180): No heartbeat from core client for 30 sec - exiting 19:42:26 (4180): No heartbeat from core client for 30 sec - exiting 19:42:27 (4180): No heartbeat from core client for 30 sec - exiting 19:42:28 (4180): No heartbeat from core client for 30 sec - exiting 19:42:29 (4180): No heartbeat from core client for 30 sec - exiting 19:42:30 (4180): No heartbeat from core client for 30 sec - exiting 19:42:31 (4180): No heartbeat from core client for 30 sec - exiting 19:42:32 (4180): No heartbeat from core client for 30 sec - exiting 19:42:33 (4180): No heartbeat from core client for 30 sec - exiting 19:42:34 (4180): No heartbeat from core client for 30 sec - exiting 19:42:35 (4180): No heartbeat from core client for 30 sec - exiting 19:42:36 (4180): No heartbeat from core client for 30 sec - exiting 19:42:37 (4180): No heartbeat from core client for 30 sec - exiting 19:42:38 (4180): No heartbeat from core client for 30 sec - exiting 19:42:39 (4180): No heartbeat from core client for 30 sec - exiting 19:42:40 (4180): No heartbeat from core client for 30 sec - exiting 19:42:41 (4180): No heartbeat from core client for 30 sec - exiting 19:42:42 (4180): No heartbeat from core client for 30 sec - exiting 19:42:43 (4180): No heartbeat from core client for 30 sec - exiting 19:42:44 (4180): No heartbeat from core client for 30 sec - exiting 19:42:45 (4180): No heartbeat from core client for 30 sec - exiting 19:42:46 (4180): No heartbeat from core client for 30 sec - exiting 19:42:47 (4180): No heartbeat from core client for 30 sec - exiting 19:42:48 (4180): No heartbeat from core client for 30 sec - exiting 19:42:49 (4180): No heartbeat from core client for 30 sec - exiting 19:42:50 (4180): No heartbeat from core client for 30 sec - exiting 19:42:51 (4180): No heartbeat from core client for 30 sec - exiting 19:42:52 (4180): No heartbeat from core client for 30 sec - exiting 19:42:53 (4180): No heartbeat from core client for 30 sec - exiting 19:42:54 (4180): No heartbeat from core client for 30 sec - exiting 19:42:55 (4180): No heartbeat from core client for 30 sec - exiting 19:42:56 (4180): No heartbeat from core client for 30 sec - exiting 19:42:57 (4180): No heartbeat from core client for 30 sec - exiting 19:42:58 (4180): No heartbeat from core client for 30 sec - exiting 19:42:59 (4180): No heartbeat from core client for 30 sec - exiting 19:43:00 (4180): No heartbeat from core client for 30 sec - exiting 19:43:01 (4180): No heartbeat from core client for 30 sec - exiting 19:43:02 (4180): No heartbeat from core client for 30 sec - exiting 19:43:03 (4180): No heartbeat from core client for 30 sec - exiting 19:43:04 (4180): No heartbeat from core client for 30 sec - exiting 19:43:05 (4180): No heartbeat from core client for 30 sec - exiting 19:43:06 (4180): No heartbeat from core client for 30 sec - exiting 19:43:07 (4180): No heartbeat from core client for 30 sec - exiting 19:43:08 (4180): No heartbeat from core client for 30 sec - exiting 19:43:09 (4180): No heartbeat from core client for 30 sec - exiting 19:43:10 (4180): No heartbeat from core client for 30 sec - exiting 19:43:11 (4180): No heartbeat from core client for 30 sec - exiting 19:43:12 (4180): No heartbeat from core client for 30 sec - exiting 19:43:13 (4180): No heartbeat from core client for 30 sec - exiting 19:43:14 (4180): No heartbeat from core client for 30 sec - exiting 19:43:15 (4180): No heartbeat from core client for 30 sec - exiting 19:43:16 (4180): No heartbeat from core client for 30 sec - exiting 19:43:17 (4180): No heartbeat from core client for 30 sec - exiting 19:43:18 (4180): No heartbeat from core client for 30 sec - exiting 19:43:19 (4180): No heartbeat from core client for 30 sec - exiting 19:43:20 (4180): No heartbeat from core client for 30 sec - exiting 19:43:21 (4180): No heartbeat from core client for 30 sec - exiting 19:43:22 (4180): No heartbeat from core client for 30 sec - exiting 19:43:23 (4180): No heartbeat from core client for 30 sec - exiting 19:43:24 (4180): No heartbeat from core client for 30 sec - exiting 19:43:25 (4180): No heartbeat from core client for 30 sec - exiting 19:43:26 (4180): No heartbeat from core client for 30 sec - exiting 19:43:27 (4180): No heartbeat from core client for 30 sec - exiting 19:43:28 (4180): No heartbeat from core client for 30 sec - exiting 19:43:30 (4180): No heartbeat from core client for 30 sec - exiting 19:43:31 (4180): No heartbeat from core client for 30 sec - exiting 19:43:32 (4180): No heartbeat from core client for 30 sec - exiting 19:43:33 (4180): No heartbeat from core client for 30 sec - exiting 19:43:34 (4180): No heartbeat from core client for 30 sec - exiting 19:43:35 (4180): No heartbeat from core client for 30 sec - exiting 19:43:36 (4180): No heartbeat from core client for 30 sec - exiting 19:43:37 (4180): No heartbeat from core client for 30 sec - exiting 19:43:38 (4180): No heartbeat from core client for 30 sec - exiting 19:43:39 (4180): No heartbeat from core client for 30 sec - exiting 19:43:40 (4180): No heartbeat from core client for 30 sec - exiting 19:43:41 (4180): No heartbeat from core client for 30 sec - exiting 19:43:42 (4180): No heartbeat from core client for 30 sec - exiting 19:43:43 (4180): No heartbeat from core client for 30 sec - exiting 19:43:44 (4180): No heartbeat from core client for 30 sec - exiting 19:43:45 (4180): No heartbeat from core client for 30 sec - exiting 19:43:46 (4180): No heartbeat from core client for 30 sec - exiting 19:43:47 (4180): No heartbeat from core client for 30 sec - exiting 19:43:48 (4180): No heartbeat from core client for 30 sec - exiting 19:43:49 (4180): No heartbeat from core client for 30 sec - exiting 19:43:50 (4180): No heartbeat from core client for 30 sec - exiting 19:43:51 (4180): No heartbeat from core client for 30 sec - exiting 19:43:52 (4180): No heartbeat from core client for 30 sec - exiting 19:43:53 (4180): No heartbeat from core client for 30 sec - exiting 19:43:54 (4180): No heartbeat from core client for 30 sec - exiting 19:43:55 (4180): No heartbeat from core client for 30 sec - exiting 19:43:56 (4180): No heartbeat from core client for 30 sec - exiting 19:43:57 (4180): No heartbeat from core client for 30 sec - exiting 19:43:58 (4180): No heartbeat from core client for 30 sec - exiting 19:43:59 (4180): No heartbeat from core client for 30 sec - exiting 19:44:00 (4180): No heartbeat from core client for 30 sec - exiting 19:44:01 (4180): No heartbeat from core client for 30 sec - exiting 19:44:02 (4180): No heartbeat from core client for 30 sec - exiting 19:44:03 (4180): No heartbeat from core client for 30 sec - exiting 19:44:04 (4180): No heartbeat from core client for 30 sec - exiting 19:44:05 (4180): No heartbeat from core client for 30 sec - exiting 19:44:06 (4180): No heartbeat from core client for 30 sec - exiting 19:44:07 (4180): No heartbeat from core client for 30 sec - exiting 19:44:08 (4180): No heartbeat from core client for 30 sec - exiting 19:44:09 (4180): No heartbeat from core client for 30 sec - exiting 19:44:10 (4180): No heartbeat from core client for 30 sec - exiting 19:44:11 (4180): No heartbeat from core client for 30 sec - exiting 19:44:12 (4180): No heartbeat from core client for 30 sec - exiting 19:44:13 (4180): No heartbeat from core client for 30 sec - exiting 19:44:14 (4180): No heartbeat from core client for 30 sec - exiting 19:44:15 (4180): No heartbeat from core client for 30 sec - exiting 19:44:16 (4180): No heartbeat from core client for 30 sec - exiting 19:44:17 (4180): No heartbeat from core client for 30 sec - exiting 19:44:18 (4180): No heartbeat from core client for 30 sec - exiting 19:44:19 (4180): No heartbeat from core client for 30 sec - exiting 19:44:20 (4180): No heartbeat from core client for 30 sec - exiting 19:44:21 (4180): No heartbeat from core client for 30 sec - exiting 19:44:22 (4180): No heartbeat from core client for 30 sec - exiting 19:44:23 (4180): No heartbeat from core client for 30 sec - exiting 19:44:24 (4180): No heartbeat from core client for 30 sec - exiting 19:44:25 (4180): No heartbeat from core client for 30 sec - exiting 19:44:26 (4180): No heartbeat from core client for 30 sec - exiting 19:44:27 (4180): No heartbeat from core client for 30 sec - exiting 19:44:28 (4180): No heartbeat from core client for 30 sec - exiting 19:44:29 (4180): No heartbeat from core client for 30 sec - exiting 19:44:30 (4180): No heartbeat from core client for 30 sec - exiting 19:44:31 (4180): No heartbeat from core client for 30 sec - exiting 19:44:32 (4180): No heartbeat from core client for 30 sec - exiting 19:44:33 (4180): No heartbeat from core client for 30 sec - exiting 19:44:34 (4180): No heartbeat from core client for 30 sec - exiting 19:44:35 (4180): No heartbeat from core client for 30 sec - exiting 19:44:36 (4180): No heartbeat from core client for 30 sec - exiting 19:44:37 (4180): No heartbeat from core client for 30 sec - exiting 19:44:38 (4180): No heartbeat from core client for 30 sec - exiting 19:44:39 (4180): No heartbeat from core client for 30 sec - exiting 19:44:40 (4180): No heartbeat from core client for 30 sec - exiting 19:44:41 (4180): No heartbeat from core client for 30 sec - exiting 19:44:42 (4180): No heartbeat from core client for 30 sec - exiting 19:44:43 (4180): No heartbeat from core client for 30 sec - exiting 19:44:44 (4180): No heartbeat from core client for 30 sec - exiting 19:44:45 (4180): No heartbeat from core client for 30 sec - exiting 19:44:46 (4180): No heartbeat from core client for 30 sec - exiting 19:44:47 (4180): No heartbeat from core client for 30 sec - exiting 19:44:48 (4180): No heartbeat from core client for 30 sec - exiting 19:44:49 (4180): No heartbeat from core client for 30 sec - exiting 19:44:50 (4180): No heartbeat from core client for 30 sec - exiting 19:44:51 (4180): No heartbeat from core client for 30 sec - exiting 19:44:52 (4180): No heartbeat from core client for 30 sec - exiting 19:44:53 (4180): No heartbeat from core client for 30 sec - exiting 19:44:54 (4180): No heartbeat from core client for 30 sec - exiting 19:44:55 (4180): No heartbeat from core client for 30 sec - exiting 19:44:56 (4180): No heartbeat from core client for 30 sec - exiting 19:44:57 (4180): No heartbeat from core client for 30 sec - exiting 19:44:58 (4180): No heartbeat from core client for 30 sec - exiting 19:44:59 (4180): No heartbeat from core client for 30 sec - exiting 19:45:00 (4180): No heartbeat from core client for 30 sec - exiting 19:45:01 (4180): No heartbeat from core client for 30 sec - exiting 19:45:02 (4180): No heartbeat from core client for 30 sec - exiting 19:45:03 (4180): No heartbeat from core client for 30 sec - exiting 19:45:04 (4180): No heartbeat from core client for 30 sec - exiting 19:45:05 (4180): No heartbeat from core client for 30 sec - exiting 19:45:06 (4180): No heartbeat from core client for 30 sec - exiting 19:45:07 (4180): No heartbeat from core client for 30 sec - exiting 19:45:08 (4180): No heartbeat from core client for 30 sec - exiting 19:45:09 (4180): No heartbeat from core client for 30 sec - exiting 19:45:10 (4180): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 19:48:25 (3596): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... 19:48:56 (7972): start_timer_thread(): CreateThread() failed, errno 0 19:48:56 (7000): start_timer_thread(): CreateThread() failed, errno 0 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=7000, selfPID=7000, iMonCtr=2 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 22:03:55 (11004): start_timer_thread(): CreateThread() failed, errno 0 22:03:55 (9600): start_timer_thread(): CreateThread() failed, errno 0 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 20:34:54 (6316): start_timer_thread(): CreateThread() failed, errno 0 20:34:54 (11244): start_timer_thread(): CreateThread() failed, errno 0 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 21:58:06 (124): start_timer_thread(): CreateThread() failed, errno 0 Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 20:26:07 (2640): start_timer_thread(): CreateThread() failed, errno 0 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 21:17:29 (9184): start_timer_thread(): CreateThread() failed, errno 0 21:17:29 (3416): start_timer_thread(): CreateThread() failed, errno 0 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 23:07:49 (8580): start_timer_thread(): CreateThread() failed, errno 0 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 077:3::39 (1812):6): start_timer_thread(): CreateTead(hread() failed, er rno 0 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=10580, selfPID=10580, iMonCtr=2 15:19:07 (7816): start_timer_thread(): CreateThread() failed, errno 0 Suspended CPDN Monitor - Suspend request from BOINC... 15:36:42 (7684): No heartbeat from core client for 30 sec - exiting 15:36:43 (7684): No heartbeat from core client for 30 sec - exiting 15:36:44 (7684): No heartbeat from core client for 30 sec - exiting 15:36:45 (7684): No heartbeat from core client for 30 sec - exiting 15:36:46 (7684): No heartbeat from core client for 30 sec - exiting 15:36:47 (7684): No heartbeat from core client for 30 sec - exiting 15:36:48 (7684): No heartbeat from core client for 30 sec - exiting 15:36:49 (7684): No heartbeat from core client for 30 sec - exiting 15:36:50 (7684): No heartbeat from core client for 30 sec - exiting 15:36:51 (7684): No heartbeat from core client for 30 sec - exiting 15:36:52 (7684): No heartbeat from core client for 30 sec - exiting 15:36:53 (7684): No heartbeat from core client for 30 sec - exiting 15:36:54 (7684): No heartbeat from core client for 30 sec - exiting 15:36:55 (7684): No heartbeat from core client for 30 sec - exiting 15:36:56 (7684): No heartbeat from core client for 30 sec - exiting 15:36:57 (7684): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... SETPOS: Seek Failed: Invalid argument SETPOS: Unit 61 to Word Address -198 Failed with Error Code -1 Model crashed: SETPOS: Unit 61 to Word Address -198 Failed with Error Code -1 Leaving CPDN_Main::Monitor... Called boinc_finish </stderr_txt> <message> upload failure: <file_xfer_error> <file_name>hadam3p_eu_h5a0_2013_1_008860665_0_7.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_eu_h5a0_2013_1_008860665_0_8.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_eu_h5a0_2013_1_008860665_0_9.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_eu_h5a0_2013_1_008860665_0_10.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_eu_h5a0_2013_1_008860665_0_11.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_eu_h5a0_2013_1_008860665_0_12.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> </message> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
04 Aug 2014 20:25:35	1317294	16780409	hadam3p_eu_h5a0_2013_1_008860665_0	69,235	182,821	2.6406
03 Aug 2014 21:50:59	1317294	16780409	hadam3p_eu_h5a0_2013_1_008860665_0	69,216	182,367	2.6348
29 Jul 2014 21:04:26	1317294	16780409	hadam3p_eu_h5a0_2013_1_008860665_0	57,696	152,938	2.6508
29 Jul 2014 11:15:08	1317294	16780409	hadam3p_eu_h5a0_2013_1_008860665_0	46,194	122,176	2.6448
29 Jul 2014 09:23:54	1317294	16780409	hadam3p_eu_h5a0_2013_1_008860665_0	46,176	121,797	2.6377
27 Jul 2014 11:16:05	1317294	16780409	hadam3p_eu_h5a0_2013_1_008860665_0	34,656	91,157	2.6303
26 Jul 2014 02:33:50	1317294	16780409	hadam3p_eu_h5a0_2013_1_008860665_0	23,136	60,474	2.6138
24 Jul 2014 02:30:58	1317294	16780409	hadam3p_eu_h5a0_2013_1_008860665_0	11,616	30,127	2.5936