Task 18280579

Name	hadam3p_anz_d8jx_2013_1_009725718_0
Workunit	9799015
Created	8 Apr 2015, 18:27:27 UTC
Sent	9 Apr 2015, 22:35:28 UTC
Report deadline	22 Mar 2016, 3:55:28 UTC
Received	6 Jun 2015, 2:38:04 UTC
Server state	Over
Outcome	Success
Client state	Done
Exit status	0 (0x00000000)
Computer ID	1348678
Run time	12 days 6 hours 8 min 48 sec
CPU time	9 days 12 hours 16 min 52 sec
Validate state	Workunit error - check skipped
Credit	5,974.74
Device peak FLOPS	3.04 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Australia New Zealand v6.10 windows_intelx86
Stderr	<core_client_version>7.2.47</core_client_version> <![CDATA[ <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... 20:46:42 (6556): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... 20:46:53 (6556): No heartbeat from core client for 30 sec - exiting 20:46:56 (6556): No heartbeat from core client for 30 sec - exiting 20:46:57 (6556): No heartbeat from core client for 30 sec - exiting 20:46:58 (6556): No heartbeat from core client for 30 sec - exiting 20:46:59 (6556): No heartbeat from core client for 30 sec - exiting 20:47:00 (6556): No heartbeat from core client for 30 sec - exiting 20:47:01 (6556): No heartbeat from core client for 30 sec - exiting 20:47:02 (6556): No heartbeat from core client for 30 sec - exiting 20:47:03 (6556): No heartbeat from core client for 30 sec - exiting 20:47:04 (6556): No heartbeat from core client for 30 sec - exiting 20:47:05 (6556): No heartbeat from core client for 30 sec - exiting 20:47:06 (6556): No heartbeat from core client for 30 sec - exiting 20:50:53 (6388): No heartbeat from core client for 30 sec - exiting 20:50:54 (6388): No heartbeat from core client for 30 sec - exiting 20:50:55 (6388): No heartbeat from core client for 30 sec - exiting 20:50:56 (6388): No heartbeat from core client for 30 sec - exiting 20:50:57 (6388): No heartbeat from core client for 30 sec - exiting 20:50:58 (6388): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 18:27:53 (3908): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 19:54:53 (6076): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:54:57 (6076): No heartbeat from core client for 30 sec - exiting 19:54:58 (6076): No heartbeat from core client for 30 sec - exiting 19:54:59 (6076): No heartbeat from core client for 30 sec - exiting 19:55:00 (6076): No heartbeat from core client for 30 sec - exiting 19:55:01 (6076): No heartbeat from core client for 30 sec - exiting 19:55:02 (6076): No heartbeat from core client for 30 sec - exiting 19:55:03 (6076): No heartbeat from core client for 30 sec - exiting 19:55:04 (6076): No heartbeat from core client for 30 sec - exiting 19:55:05 (6076): No heartbeat from core client for 30 sec - exiting 19:55:06 (6076): No heartbeat from core client for 30 sec - exiting 19:55:07 (6076): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 21:41:16 (5276): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6580, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6608, selfPID=6536, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5216, iMonCtr=2 18:19:05 (5100): No heartbeat from core client for 30 sec - exiting 18:19:06 (5100): No heartbeat from core client for 30 sec - exiting 18:19:07 (5100): No heartbeat from core client for 30 sec - exiting 18:19:08 (5100): No heartbeat from core client for 30 sec - exiting 18:19:09 (5100): No heartbeat from core client for 30 sec - exiting 18:19:10 (5100): No heartbeat from core client for 30 sec - exiting 18:19:12 (5100): No heartbeat from core client for 30 sec - exiting 18:19:13 (5100): No heartbeat from core client for 30 sec - exiting 18:19:14 (5100): No heartbeat from core client for 30 sec - exiting 18:19:15 (5100): No heartbeat from core client for 30 sec - exiting 18:19:16 (5100): No heartbeat from core client for 30 sec - exiting 18:19:17 (5100): No heartbeat from core client for 30 sec - exiting 18:19:18 (5100): No heartbeat from core client for 30 sec - exiting 18:19:19 (5100): No heartbeat from core client for 30 sec - exiting 18:19:20 (5100): No heartbeat from core client for 30 sec - exiting 18:19:21 (5100): No heartbeat from core client for 30 sec - exiting 18:19:23 (5100): No heartbeat from core client for 30 sec - exiting 18:19:24 (5100): No heartbeat from core client for 30 sec - exiting 18:19:25 (5100): No heartbeat from core client for 30 sec - exiting 18:19:26 (5100): No heartbeat from core client for 30 sec - exiting 18:19:27 (5100): No heartbeat from core client for 30 sec - exiting 18:19:28 (5100): No heartbeat from core client for 30 sec - exiting 18:19:29 (5100): No heartbeat from core client for 30 sec - exiting 18:19:30 (5100): No heartbeat from core client for 30 sec - exiting 18:19:31 (5100): No heartbeat from core client for 30 sec - exiting 18:19:32 (5100): No heartbeat from core client for 30 sec - exiting 18:19:33 (5100): No heartbeat from core client for 30 sec - exiting 18:19:35 (5100): No heartbeat from core client for 30 sec - exiting 18:19:36 (5100): No heartbeat from core client for 30 sec - exiting 18:19:37 (5100): No heartbeat from core client for 30 sec - exiting 18:19:38 (5100): No heartbeat from core client for 30 sec - exiting 18:19:39 (5100): No heartbeat from core client for 30 sec - exiting 18:19:40 (5100): No heartbeat from core client for 30 sec - exiting 18:19:41 (5100): No heartbeat from core client for 30 sec - exiting 18:19:42 (5100): No heartbeat from core client for 30 sec - exiting 18:19:43 (5100): No heartbeat from core client for 30 sec - exiting 18:19:44 (5100): No heartbeat from core client for 30 sec - exiting 18:19:45 (5100): No heartbeat from core client for 30 sec - exiting 18:19:47 (5100): No heartbeat from core client for 30 sec - exiting 18:19:48 (5100): No heartbeat from core client for 30 sec - exiting 18:19:49 (5100): No heartbeat from core client for 30 sec - exiting 18:19:50 (5100): No heartbeat from core client for 30 sec - exiting 18:19:51 (5100): No heartbeat from core client for 30 sec - exiting 18:19:52 (5100): No heartbeat from core client for 30 sec - exiting 18:19:53 (5100): No heartbeat from core client for 30 sec - exiting 18:19:54 (5100): No heartbeat from core client for 30 sec - exiting 18:19:55 (5100): No heartbeat from core client for 30 sec - exiting 18:19:56 (5100): No heartbeat from core client for 30 sec - exiting 18:19:57 (5100): No heartbeat from core client for 30 sec - exiting 18:19:59 (5100): No heartbeat from core client for 30 sec - exiting 18:20:00 (5100): No heartbeat from core client for 30 sec - exiting 18:20:01 (5100): No heartbeat from core client for 30 sec - exiting 18:20:02 (5100): No heartbeat from core client for 30 sec - exiting 18:20:03 (5100): No heartbeat from core client for 30 sec - exiting 18:20:04 (5100): No heartbeat from core client for 30 sec - exiting 18:20:05 (5100): No heartbeat from core client for 30 sec - exiting 18:20:06 (5100): No heartbeat from core client for 30 sec - exiting 18:20:07 (5100): No heartbeat from core client for 30 sec - exiting 18:20:08 (5100): No heartbeat from core client for 30 sec - exiting 18:20:09 (5100): No heartbeat from core client for 30 sec - exiting 18:20:11 (5100): No heartbeat from core client for 30 sec - exiting 18:20:12 (5100): No heartbeat from core client for 30 sec - exiting 18:20:13 (5100): No heartbeat from core client for 30 sec - exiting 18:20:14 (5100): No heartbeat from core client for 30 sec - exiting 18:20:15 (5100): No heartbeat from core client for 30 sec - exiting 18:20:16 (5100): No heartbeat from core client for 30 sec - exiting 18:20:17 (5100): No heartbeat from core client for 30 sec - exiting 18:20:18 (5100): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:42:27 (5876): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4720, iMonCtr=2 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=7012, selfPID=5080, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 18:23:24 (3756): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4736, iMonCtr=2 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2864, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4924, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4272, iMonCtr=2 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4072, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1236, selfPID=4712, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4872, selfPID=4704, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4912, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1156, selfPID=4832, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1328, iMonCtr=2 Model crash detected, will try to restart... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1484, iMonCtr=2 Leaving CPDN_Main::Monitor... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5736, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3288, iMonCtr=2 Model crash detected, will try to restart... 18:31:53 (4808): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6028, selfPID=6028, iMonCtr=2 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6104, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4456, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2768, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4340, iMonCtr=2 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 20:27:58 (5016): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:28:00 (5016): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 20:43:24 (2688): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:43:25 (2688): No heartbeat from core client for 30 sec - exiting 20:48:22 (5540): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6652, iMonCtr=2 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5012, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... 13:45:06 (4156): No heartbeat from core client for 30 sec - exiting 13:45:07 (4156): No heartbeat from core client for 30 sec - exiting 13:45:08 (4156): No heartbeat from core client for 30 sec - exiting 13:45:09 (4156): No heartbeat from core client for 30 sec - exiting 13:45:10 (4156): No heartbeat from core client for 30 sec - exiting 13:45:11 (4156): No heartbeat from core client for 30 sec - exiting 13:45:12 (4156): No heartbeat from core client for 30 sec - exiting 13:45:13 (4156): No heartbeat from core client for 30 sec - exiting 13:45:14 (4156): No heartbeat from core client for 30 sec - exiting 13:45:15 (4156): No heartbeat from core client for 30 sec - exiting 13:45:16 (4156): No heartbeat from core client for 30 sec - exiting 13:45:17 (4156): No heartbeat from core client for 30 sec - exiting 13:45:18 (4156): No heartbeat from core client for 30 sec - exiting 13:45:19 (4156): No heartbeat from core client for 30 sec - exiting 13:45:20 (4156): No heartbeat from core client for 30 sec - exiting 13:45:21 (4156): No heartbeat from core client for 30 sec - exiting 13:45:22 (4156): No heartbeat from core client for 30 sec - exiting 13:45:23 (4156): No heartbeat from core client for 30 sec - exiting 13:45:24 (4156): No heartbeat from core client for 30 sec - exiting 13:45:25 (4156): No heartbeat from core client for 30 sec - exiting 13:45:26 (4156): No heartbeat from core client for 30 sec - exiting 13:45:27 (4156): No heartbeat from core client for 30 sec - exiting 13:45:28 (4156): No heartbeat from core client for 30 sec - exiting 13:45:29 (4156): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5724, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5700, selfPID=5820, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4964, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4556, selfPID=3480, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=168, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4492, iMonCtr=2 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4360, selfPID=3424, iMonCtr=1 Model crash detected, will try to restart... 18:15:19 (4768): No heartbeat from core client for 30 sec - exiting 18:15:20 (4768): No heartbeat from core client for 30 sec - exiting 18:15:21 (4768): No heartbeat from core client for 30 sec - exiting 18:15:22 (4768): No heartbeat from core client for 30 sec - exiting 18:15:23 (4768): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker18:25:21 (5412): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:25:32 (5412): No heartbeat from core client for 30 sec - exiting 18:25:33 (5412): No heartbeat from core client for 30 sec - exiting 18:25:34 (5412): No heartbeat from core client for 30 sec - exiting 18:25:35 (5412): No heartbeat from core client for 30 sec - exiting 18:25:36 (5412): No heartbeat from core client for 30 sec - exiting 18:25:37 (5412): No heartbeat from core client for 30 sec - exiting 18:25:38 (5412): No heartbeat from core client for 30 sec - exiting 18:25:39 (5412): No heartbeat from core client for 30 sec - exiting 18:25:41 (5412): No heartbeat from core client for 30 sec - exiting 18:25:42 (5412): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1968, selfPID=5324, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5160, selfPID=4444, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4932, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4652, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5380, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5420, selfPID=2260, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3480, selfPID=4960, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7048, iMonCtr=2 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 21:43:37 (5080): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... CGlobal Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6352, iMonCtr=2 ontroller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5624, iMonCtr=2 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5276, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1468, selfPID=4488, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4720, iMonCtr=2 Model crash detected, will try to restart... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4236, iMonCtr=2 Leaving CPDN_Main::Monitor... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 20:48:36 (3856): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:48:38 (3856): No heartbeat from core client for 30 sec - exiting 20:48:39 (3856): No heartbeat from core client for 30 sec - exiting 20:48:40 (3856): No heartbeat from core client for 30 sec - exiting 20:48:41 (3856): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6904, selfPID=6924, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6532, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4736, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4420, iMonCtr=2 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1904, iMonCtr=2 Model crash detected, will try to restart... 17:58:31 (5668): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2204, selfPID=2204, iMonCtr=2 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Clobalontrokerr::: PDN CPDcess is not running, exiting, ting, bRetVal = 1, checkPID=0, sel292fPID=462tr=2 4, iMonCtr=2 Model crash detected, will try to restart... 17:57:59 (4540): No heartbeat from core client for 30 sec - exiting 17:58:00 (4540): No heartbeat from core client for 30 sec - exiting 17:58:02 (4540): No heartbeat from core client for 30 sec - exiting 17:58:03 (4540): No heartbeat from core client for 30 sec - exiting 17:58:04 (4540): No heartbeat from core client for 30 sec - exiting 17:58:05 (4540): No heartbeat from core client for 30 sec - exiting 17:58:06 (4540): No heartbeat from core client for 30 sec - exiting 17:58:07 (4540): No heartbeat from core client for 30 sec - exiting 17:58:08 (4540): No heartbeat from core client for 30 sec - exiting 17:58:09 (4540): No heartbeat from core client for 30 sec - exiting 17:58:10 (4540): No heartbeat from core client for 30 sec - exiting 17:58:11 (4540): No heartbeat from core client for 30 sec - exiting 17:58:13 (4540): No heartbeat from core client for 30 sec - exiting 17:58:14 (4540): No heartbeat from core client for 30 sec - exiting 17:58:15 (4540): No heartbeat from core client for 30 sec - exiting 17:58:16 (4540): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5724, selfPID=5724, iMonCtr=2 17:59:16 (5856): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Leaving CPDN_Main::Monitor... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
06 Jun 2015 01:35:27	1348678	18280579	hadam3p_anz_d8jx_2013_1_009725718_0	138,539	821,337	5.9286
31 May 2015 03:53:13	1348678	18280579	hadam3p_anz_d8jx_2013_1_009725718_0	127,019	754,061	5.9366
25 May 2015 22:28:40	1348678	18280579	hadam3p_anz_d8jx_2013_1_009725718_0	115,499	684,100	5.9230
23 May 2015 03:26:56	1348678	18280579	hadam3p_anz_d8jx_2013_1_009725718_0	103,979	616,175	5.9260
18 May 2015 22:10:13	1348678	18280579	hadam3p_anz_d8jx_2013_1_009725718_0	92,459	549,287	5.9409
13 May 2015 01:19:07	1348678	18280579	hadam3p_anz_d8jx_2013_1_009725718_0	80,939	480,155	5.9323
08 May 2015 19:24:44	1348678	18280579	hadam3p_anz_d8jx_2013_1_009725718_0	69,419	412,662	5.9445
08 May 2015 19:08:48	1348678	18280579	hadam3p_anz_d8jx_2013_1_009725718_0	57,899	344,317	5.9469
08 May 2015 19:02:25	1348678	18280579	hadam3p_anz_d8jx_2013_1_009725718_0	46,379	276,061	5.9523
26 Apr 2015 04:45:23	1348678	18280579	hadam3p_anz_d8jx_2013_1_009725718_0	34,859	207,943	5.9653
22 Apr 2015 00:39:50	1348678	18280579	hadam3p_anz_d8jx_2013_1_009725718_0	23,339	139,876	5.9932
17 Apr 2015 01:55:21	1348678	18280579	hadam3p_anz_d8jx_2013_1_009725718_0	11,819	71,902	6.0836