Task 17788184

Name	hadam3p_anz_a1cv_2013_1_009460062_0
Workunit	9542296
Created	14 Jan 2015, 10:41:39 UTC
Sent	21 Jan 2015, 13:20:18 UTC
Report deadline	3 Jan 2016, 18:40:18 UTC
Received	21 Mar 2015, 11:44:22 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	194 (0x000000C2) EXIT_ABORTED_BY_CLIENT
Computer ID	1333820
Run time	11 days 6 hours 25 min 8 sec
CPU time	8 days 21 hours 40 min 32 sec
Validate state	Invalid
Credit	4,981.10
Device peak FLOPS	2.77 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Australia New Zealand v6.10 windows_intelx86
Stderr	<core_client_version>7.4.27</core_client_version> <![CDATA[ <message> finish file present too long </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4112, selfPID=4112, iMonCtr=2 14:32:31 (6632): No heartbeat from core client for 30 sec - exiting 14:32:32 (6632): No heartbeat from core client for 30 sec - exiting 14:32:33 (6632): No heartbeat from core client for 30 sec - exiting 14:32:34 (6632): No heartbeat from core client for 30 sec - exiting 14:32:35 (6632): No heartbeat from core client for 30 sec - exiting 14:32:36 (6632): No heartbeat from core client for 30 sec - exiting 14:32:37 (6632): No heartbeat from core client for 30 sec - exiting 14:32:38 (6632): No heartbeat from core client for 30 sec - exiting 14:32:39 (6632): No heartbeat from core client for 30 sec - exiting 14:32:40 (6632): No heartbeat from core client for 30 sec - exiting 14:32:41 (6632): No heartbeat from core client for 30 sec - exiting 14:32:42 (6632): No heartbeat from core client for 30 sec - exiting 14:32:43 (6632): No heartbeat from core client for 30 sec - exiting 14:32:44 (6632): No heartbeat from core client for 30 sec - exiting 14:32:45 (6632): No heartbeat from core client for 30 sec - exiting 14:32:46 (6632): No heartbeat from core client for 30 sec - exiting 14:32:47 (6632): No heartbeat from core client for 30 sec - exiting 14:32:48 (6632): No heartbeat from core client for 30 sec - exiting 14:32:49 (6632): No heartbeat from core client for 30 sec - exiting 14:32:50 (6632): No heartbeat from core client for 30 sec - exiting 14:32:51 (6632): No heartbeat from core client for 30 sec - exiting 14:32:52 (6632): No heartbeat from core client for 30 sec - exiting 14:32:53 (6632): No heartbeat from core client for 30 sec - exiting 14:32:54 (6632): No heartbeat from core client for 30 sec - exiting 14:32:56 (6632): No heartbeat from core client for 30 sec - exiting 14:32:57 (6632): No heartbeat from core client for 30 sec - exiting 14:32:58 (6632): No heartbeat from core client for 30 sec - exiting 14:32:59 (6632): No heartbeat from core client for 30 sec - exiting 14:33:00 (6632): No heartbeat from core client for 30 sec - exiting 14:33:01 (6632): No heartbeat from core client for 30 sec - exiting 14:33:02 (6632): No heartbeat from core client for 30 sec - exiting 14:33:03 (6632): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... ColontroWorker:: CPDNr process notsrunsingotexitini, b, texl t i,ngh, kbRDet, se =PID,6 1checkPID=0, selfPID=3224, iMonCtr=2 2, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Called boinc_finish 13:16:46 (624): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7060, iMonCtr=2 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... 00:27:33 (4244): No heartbeat from core client for 30 sec - exiting 00:27:34 (4244): No heartbeat from core client for 30 sec - exiting 00:27:35 (4244): No heartbeat from core client for 30 sec - exiting 00:27:36 (4244): No heartbeat from core client for 30 sec - exiting 00:27:37 (4244): No heartbeat from core client for 30 sec - exiting 00:27:38 (4244): No heartbeat from core client for 30 sec - exiting 00:27:39 (4244): No heartbeat from core client for 30 sec - exiting 00:27:40 (4244): No heartbeat from core client for 30 sec - exiting 00:27:41 (4244): No heartbeat from core client for 30 sec - exiting 00:27:42 (4244): No heartbeat from core client for 30 sec - exiting 00:27:43 (4244): No heartbeat from core client for 30 sec - exiting 00:27:44 (4244): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5464, selfPID=5464, iMonCtr=2 CPDN Monitor - Quit request from BOINC... 08:38:02 (4764): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=7668, selfPID=7724, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6580, selfPID=5092, iMonCtr=1 Model crash detected, will try to restart... 14:51:19 (5932): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 10:21:08 (5560): No heartbeat from core client for 30 sec - exiting 10:21:09 (5560): No heartbeat from core client for 30 sec - exiting 10:21:10 (5560): No heartbeat from core client for 30 sec - exiting 10:21:11 (5560): No heartbeat from core client for 30 sec - exiting 10:21:12 (5560): No heartbeat from core client for 30 sec - exiting 10:21:13 (5560): No heartbeat from core client for 30 sec - exiting 10:21:14 (5560): No heartbeat from core client for 30 sec - exiting 10:21:15 (5560): No heartbeat from core client for 30 sec - exiting 10:21:16 (5560): No heartbeat from core client for 30 sec - exiting 10:21:17 (5560): No heartbeat from core client for 30 sec - exiting 10:21:19 (5560): No heartbeat from core client for 30 sec - exiting 10:21:20 (5560): No heartbeat from core client for 30 sec - exiting 10:21:21 (5560): No heartbeat from core client for 30 sec - exiting 10:21:22 (5560): No heartbeat from core client for 30 sec - exiting 10:21:23 (5560): No heartbeat from core client for 30 sec - exiting 10:21:24 (5560): No heartbeat from core client for 30 sec - exiting 10:21:25 (5560): No heartbeat from core client for 30 sec - exiting 10:21:26 (5560): No heartbeat from core client for 30 sec - exiting 10:21:27 (5560): No heartbeat from core client for 30 sec - exiting 10:21:28 (5560): No heartbeat from core client for 30 sec - exiting 10:21:30 (5560): No heartbeat from core client for 30 sec - exiting 10:21:31 (5560): No heartbeat from core client for 30 sec - exiting 10:21:32 (5560): No heartbeat from core client for 30 sec - exiting 10:21:33 (5560): No heartbeat from core client for 30 sec - exiting 10:21:34 (5560): No heartbeat from core client for 30 sec - exiting 10:21:35 (5560): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1624, selfPID=5616, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... GController:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=8408, iMonCtr=2 Model crash detected, will try to restart... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2380, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3840, selfPID=5144, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 00:50:26 (6552): No heartbeat from core client for 30 sec - exiting 00:50:27 (6552): No heartbeat from core client for 30 sec - exiting 00:50:28 (6552): No heartbeat from core client for 30 sec - exiting 00:50:29 (6552): No heartbeat from core client for 30 sec - exiting 00:50:30 (6552): No heartbeat from core client for 30 sec - exiting 00:50:31 (6552): No heartbeat from core client for 30 sec - exiting 00:50:32 (6552): No heartbeat from core client for 30 sec - exiting 00:50:33 (6552): No heartbeat from core client for 30 sec - exiting 00:50:34 (6552): No heartbeat from core client for 30 sec - exiting 00:50:35 (6552): No heartbeat from core client for 30 sec - exiting 00:50:36 (6552): No heartbeat from core client for 30 sec - exiting 00:50:37 (6552): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=8240, selfPID=8240, iMonCtr=2 11:00:24 (3716): No heartbeat from core client for 30 sec - exiting 11:00:25 (3716): No heartbeat from core client for 30 sec - exiting 11:00:26 (3716): No heartbeat from core client for 30 sec - exiting 11:00:27 (3716): No heartbeat from core client for 30 sec - exiting 11:00:28 (3716): No heartbeat from core client for 30 sec - exiting 11:00:29 (3716): No heartbeat from core client for 30 sec - exiting 11:00:30 (3716): No heartbeat from core client for 30 sec - exiting 11:00:31 (3716): No heartbeat from core client for 30 sec - exiting 11:00:32 (3716): No heartbeat from core client for 30 sec - exiting 11:00:34 (3716): No heartbeat from core client for 30 sec - exiting 11:00:35 (3716): No heartbeat from core client for 30 sec - exiting 11:00:36 (3716): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3656, iMonCtr=2 Model crash detected, will try to restart... 15:33:32 (8084): No heartbeat from core client for 30 sec - exiting 15:33:33 (8084): No heartbeat from core client for 30 sec - exiting 15:33:34 (8084): No heartbeat from core client for 30 sec - exiting 15:33:35 (8084): No heartbeat from core client for 30 sec - exiting 15:33:36 (8084): No heartbeat from core client for 30 sec - exiting 15:33:37 (8084): No heartbeat from core client for 30 sec - exiting 15:33:38 (8084): No heartbeat from core client for 30 sec - exiting 15:33:39 (8084): No heartbeat from core client for 30 sec - exiting 15:33:40 (8084): No heartbeat from core client for 30 sec - exiting 15:33:41 (8084): No heartbeat from core client for 30 sec - exiting 15:33:42 (8084): No heartbeat from core client for 30 sec - exiting 15:33:43 (8084): No heartbeat from core client for 30 sec - exiting 15:33:44 (8084): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 10:32:57 (6460): No heartbeat from core client for 30 sec - exiting 10:32:58 (6460): No heartbeat from core client for 30 sec - exiting 10:32:59 (6460): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:01:37 (5492): No heartbeat from core client for 30 sec - exiting 12:01:38 (5492): No heartbeat from core client for 30 sec - exiting 12:01:39 (5492): No heartbeat from core client for 30 sec - exiting 12:01:40 (5492): No heartbeat from core client for 30 sec - exiting 12:01:41 (5492): No heartbeat from core client for 30 sec - exiting 12:01:42 (5492): No heartbeat from core client for 30 sec - exiting 12:01:43 (5492): No heartbeat from core client for 30 sec - exiting 12:01:44 (5492): No heartbeat from core client for 30 sec - exiting 12:01:46 (5492): No heartbeat from core client for 30 sec - exiting 12:01:47 (5492): No heartbeat from core client for 30 sec - exiting 12:01:48 (5492): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7952, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7880, iMonCtr=2 Model crash detected, will try to restart... 10:13:47 (6164): No heartbeat from core client for 30 sec - exiting 10:13:48 (6164): No heartbeat from core client for 30 sec - exiting 10:13:49 (6164): No heartbeat from core client for 30 sec - exiting 10:13:50 (6164): No heartbeat from core client for 30 sec - exiting 10:13:51 (6164): No heartbeat from core client for 30 sec - exiting 10:13:52 (6164): No heartbeat from core client for 30 sec - exiting 10:13:53 (6164): No heartbeat from core client for 30 sec - exiting 10:13:54 (6164): No heartbeat from core client for 30 sec - exiting 10:13:55 (6164): No heartbeat from core client for 30 sec - exiting 10:13:56 (6164): No heartbeat from core client for 30 sec - exiting 10:13:57 (6164): No heartbeat from core client for 30 sec - exiting 10:13:58 (6164): No heartbeat from core client for 30 sec - exiting 10:14:00 (6164): No heartbeat from core client for 30 sec - exiting 10:14:01 (6164): No heartbeat from core client for 30 sec - exiting 10:14:02 (6164): No heartbeat from core client for 30 sec - exiting 10:14:03 (6164): No heartbeat from core client for 30 sec - exiting 10:14:05 (6164): No heartbeat from core client for 30 sec - exiting 10:14:06 (6164): No heartbeat from core client for 30 sec - exiting 10:14:07 (6164): No heartbeat from core client for 30 sec - exiting 10:14:08 (6164): No heartbeat from core client for 30 sec - exiting 10:14:09 (6164): No heartbeat from core client for 30 sec - exiting 10:14:10 (6164): No heartbeat from core client for 30 sec - exiting 10:14:11 (6164): No heartbeat from core client for 30 sec - exiting 10:14:12 (6164): No heartbeat from core client for 30 sec - exiting 10:14:13 (6164): No heartbeat from core client for 30 sec - exiting 10:14:15 (6164): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:14:16 (6164): No heartbeat from core client for 30 sec - exiting Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=8592, selfPID=8304, iMonCtr=1 Model crash detected, will try to restart... 10:28:42 (5072): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=8476, selfPID=8476, iMonCtr=2 10:54:49 (1848): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:54:50 (1848): No heartbeat from core client for 30 sec - exiting Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=8356, selfPID=9104, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... 16:33:02 (5648): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=8076, selfPID=8076, iMonCtr=2 CPDN Monitor - Quit request from BOINC... 14:48:18 (1476): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=8332, selfPID=8332, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=7484, selfPID=8968, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=8344, selfPID=4672, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6916, selfPID=7780, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4296, selfPID=2036, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... CPDN Monitor - Quit request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2796, iMonCtr=2 Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=8772, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=8868, selfPID=5752, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3524, iMonCtr=2 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6340, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1772, selfPID=6184, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6792, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=9048, selfPID=6960, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=8760, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=8788, selfPID=4460, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5796, selfPID=6232, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2224, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... 11:38:08 (6396): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=8624, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5504, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... 08:37:26 (5940): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2696, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5804, iMonCtr=2 Model crash detected, will try to restart... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=8520, iMonCtr=2 Leaving CPDN_Main::Monitor... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=8600, selfPID=6736, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5588, selfPID=5836, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... CPDN Monitor - Quit request from BOINC... 01:23:56 (9220): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:23:57 (9220):Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=508, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4108, iMonCtr=2 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 07:16:44 (5480): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=8304, selfPID=8304, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=10420, iMonCtr=2 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=8008, selfPID=6228, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... GController:: CPDN process is not running, exiting, bRetVal = 1, checkPID=10256, selfPID=9836, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=952, iMonCtr=2 Model crash detected, will try to restart... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=9128, iMonCtr=2 Leaving CPDN_Main::Monitor... 21:53:02 (6876): No heartbeat from core client for 30 sec - exiting 21:53:03 (6876): No heartbeat from core client for 30 sec - exiting 21:53:06 (6876): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:49:19 (7576): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:49:21 (7576): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... 13:33:26 (2864): No heartbeat from core client for 30 sec - exiting 13:33:27 (2864): No heartbeat from core client for 30 sec - exiting 13:33:28 (2864): No heartbeat from core client for 30 sec - exiting 13:33:29 (2864): No heartbeat from core client for 30 sec - exiting 13:33:30 (2864): No heartbeat from core client for 30 sec - exiting 13:33:31 (2864): No heartbeat from core client for 30 sec - exiting 13:33:32 (2864): No heartbeat from core client for 30 sec - exiting 13:33:33 (2864): No heartbeat from core client for 30 sec - exiting 13:33:34 (2864): No heartbeat from core client for 30 sec - exiting 13:33:35 (2864): No heartbeat from core client for 30 sec - exiting 13:33:36 (2864): No heartbeat from core client for 30 sec - exiting 13:33:37 (2864): No heartbeat from core client for 30 sec - exiting 13:33:38 (2864): No heartbeat from core client for 30 sec - exiting 13:33:39 (2864): No heartbeat from core client for 30 sec - exiting 13:33:40 (2864): No heartbeat from core client for 30 sec - exiting 13:33:41 (2864): No heartbeat from core client for 30 sec - exiting 13:33:42 (2864): No heartbeat from core client for 30 sec - exiting 13:33:43 (2864): No heartbeat from core client for 30 sec - exiting 13:33:44 (2864): No heartbeat from core client for 30 sec - exiting 13:33:45 (2864): No heartbeat from core client for 30 sec - exiting 13:33:46 (2864): No heartbeat from core client for 30 sec - exiting 13:33:47 (2864): No heartbeat from core client for 30 sec - exiting 13:33:48 (2864): No heartbeat from core client for 30 sec - exiting 13:33:50 (2864): No heartbeat from core client for 30 sec - exiting 13:33:51 (2864): No heartbeat from core client for 30 sec - exiting 13:33:52 (2864): No heartbeat from core client for 30 sec - exiting 13:33:53 (2864): No heartbeat from core client for 30 sec - exiting 13:33:54 (2864): No heartbeat from core client for 30 sec - exiting 13:33:55 (2864): No heartbeat from core client for 30 sec - exiting 13:33:56 (2864): No heartbeat from core client for 30 sec - exiting 13:33:57 (2864): No heartbeat from core client for 30 sec - exiting 13:33:58 (2864): No heartbeat from core client for 30 sec - exiting 13:33:59 (2864): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:34:01 (2864): No heartbeat from core client for 30 sec - exiting Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2188, selfPID=5704, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... 20:15:19 (6000): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3104, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=8048, selfPID=1760, iMonCtr=1 Model crash detected, will try to restart... Colobal Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=8436, iMonCtr=2 ntroller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6992, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... 12:12:43 (5512): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=7188, selfPID=7188, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4712, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... C16:35:54 (7096): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5380, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... GCPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 15:19:07 (5460): No heartbeat from core client for 30 sec - exiting 15:19:09 (5460): No heartbeat from core client for 30 sec - exiting 15:19:10 (5460): No heartbeat from core client for 30 sec - exiting 15:19:11 (5460): No heartbeat from core client for 30 sec - exiting 15:19:12 (5460): No heartbeat from core client for 30 sec - exiting 15:19:13 (5460): No heartbeat from core client for 30 sec - exiting 15:19:14 (5460): No heartbeat from core client for 30 sec - exiting 15:19:15 (5460): No heartbeat from core client for 30 sec - exiting 15:19:16 (5460): No heartbeat from core client for 30 sec - exiting 15:19:17 (5460): No heartbeat from core client for 30 sec - exiting 15:19:19 (5460): No heartbeat from core client for 30 sec - exiting 15:19:20 (5460): No heartbeat from core client for 30 sec - exiting 15:19:21 (5460): No heartbeat from core client for 30 sec - exiting 15:19:22 (5460): No heartbeat from core client for 30 sec - exiting 15:19:23 (5460): No heartbeat from core client for 30 sec - exiting 15:19:24 (5460): No heartbeat from core client for 30 sec - exiting 15:19:25 (5460): No heartbeat from core client for 30 sec - exiting 15:19:26 (5460): No heartbeat from core client for 30 sec - exiting 15:19:27 (5460): No heartbeat from core client for 30 sec - exiting 15:19:28 (5460): No heartbeat from core client for 30 sec - exiting 15:19:29 (5460): No heartbeat from core client for 30 sec - exiting 15:19:31 (5460): No heartbeat from core client for 30 sec - exiting 15:19:32 (5460): No heartbeat from core client for 30 sec - exiting 15:19:33 (5460): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=7320, selfPID=6412, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6152, selfPID=5384, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4220, selfPID=4220, iMonCtr=2 CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6948, selfPID=6948, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=12100, selfPID=4672, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=7800, selfPID=5032, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5984, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7152, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... 22:26:03 (6428): No heartbeat from core client for 30 sec - exiting 22:26:04 (6428): No heartbeat from core client for 30 sec - exiting 22:26:05 (6428): No heartbeat from core client for 30 sec - exiting 22:26:06 (6428): No heartbeat from core client for 30 sec - exiting 22:26:07 (6428): No heartbeat from core client for 30 sec - exiting 22:26:08 (6428): No heartbeat from core client for 30 sec - exiting 22:26:09 (6428): No heartbeat from core client for 30 sec - exiting 22:26:10 (6428): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=7760, selfPID=7744, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3064, iMonCtr=2 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... GCobal Worker::r CPDN process is n not running,exiting, bRetVal = 1,, checckPID=0, slfPID=808, iMonCtr=2 =2 Model crash detected, will try to restart... 00:07:38 (6972): No heartbeat from core client for 30 sec - exiting 00:07:39 (6972): No heartbeat from core client for 30 sec - exiting 00:07:40 (6972): No heartbeat from core client for 30 sec - exiting 00:07:41 (6972): No heartbeat from core client for 30 sec - exiting 00:07:42 (6972): No heartbeat from core client for 30 sec - exiting 00:07:43 (6972): No heartbeat from core client for 30 sec - exiting 00:07:44 (6972): No heartbeat from core client for 30 sec - exiting 00:07:45 (6972): No heartbeat from core client for 30 sec - exiting 00:07:46 (6972): No heartbeat from core client for 30 sec - exiting 00:07:47 (6972): No heartbeat from core client for 30 sec - exiting 00:07:49 (6972): No heartbeat from core client for 30 sec - exiting 00:07:50 (6972): No heartbeat from core client for 30 sec - exiting 00:07:51 (6972): No heartbeat from core client for 30 sec - exiting 00:07:52 (6972): No heartbeat from core client for 30 sec - exiting 00:07:53 (6972): No heartbeat from core client for 30 sec - exiting 00:07:54 (6972): No heartbeat from core client for 30 sec - exiting 00:07:55 (6972): No heartbeat from core client for 30 sec - exiting 00:07:56 (6972): No heartbeat from core client for 30 sec - exiting 00:07:57 (6972): No heartbeat from core client for 30 sec - exiting 00:07:58 (6972): No heartbeat from core client for 30 sec - exiting 00:08:00 (6972): No heartbeat from core client for 30 sec - exiting 00:08:01 (6972): No heartbeat from core client for 30 sec - exiting 00:08:02 (6972): No heartbeat from core client for 30 sec - exiting 00:08:04 (6972): No heartbeat from core client for 30 sec - exiting 00:08:05 (6972): No heartbeat from core client for 30 sec - exiting 00:08:06 (6972): No heartbeat from core client for 30 sec - exiting 00:08:07 (6972): No heartbeat from core client for 30 sec - exiting 00:08:08 (6972): No heartbeat from core client for 30 sec - exiting 00:08:09 (6972): No heartbeat from core client for 30 sec - exiting 00:08:10 (6972): No heartbeat from core client for 30 sec - exiting 00:08:11 (6972): No heartbeat from core client for 30 sec - exiting 00:08:12 (6972): No heartbeat from core client for 30 sec - exiting 00:08:13 (6972): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:36:59 (1976): No heartbeat from core client for 30 sec - exiting 07:37:00 (1976): No heartbeat from core client for 30 sec - exiting 07:37:01 (1976): No heartbeat from core client for 30 sec - exiting 07:37:02 (1976): No heartbeat from core client for 30 sec - exiting 07:37:03 (1976): No heartbeat from core client for 30 sec - exiting 07:37:04 (1976): No heartbeat from core client for 30 sec - exiting 07:37:05 (1976): No heartbeat from core client for 30 sec - exiting 07:37:06 (1976): No heartbeat from core client for 30 sec - exiting 07:37:07 (1976): No heartbeat from core client for 30 sec - exiting 07:37:08 (1976): No heartbeat from core client for 30 sec - exiting 07:37:09 (1976): No heartbeat from core client for 30 sec - exiting 07:37:10 (1976): No heartbeat from core client for 30 sec - exiting 07:37:11 (1976): No heartbeat from core client for 30 sec - exiting 07:37:12 (1976): No heartbeat from core client for 30 sec - exiting 07:37:13 (1976): No heartbeat from core client for 30 sec - exiting 07:37:14 (1976): No heartbeat from core client for 30 sec - exiting 07:37:15 (1976): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=8520, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=8548, selfPID=6616, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... 17:47:37 (6476): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6820, selfPID=7580, iMonCtr=1 Model crash detected, will try to restart... 05:46:37 (6164): No heartbeat from core client for 30 sec - exiting 05:46:38 (6164): No heartbeat from core client for 30 sec - exiting 05:46:39 (6164): No heartbeat from core client for 30 sec - exiting 05:46:41 (6164): No heartbeat from core client for 30 sec - exiting 05:46:42 (6164): No heartbeat from core client for 30 sec - exiting 05:46:43 (6164): No heartbeat from core client for 30 sec - exiting 05:46:44 (6164): No heartbeat from core client for 30 sec - exiting 05:46:45 (6164): No heartbeat from core client for 30 sec - exiting 05:46:46 (6164): No heartbeat from core client for 30 sec - exiting 05:46:47 (6164): No heartbeat from core client for 30 sec - exiting 05:46:48 (6164): No heartbeat from core client for 30 sec - exiting 05:46:49 (6164): No heartbeat from core client for 30 sec - exiting 05:46:50 (6164): No heartbeat from core client for 30 sec - exiting 05:46:51 (6164): No heartbeat from core client for 30 sec - exiting 05:46:53 (6164): No heartbeat from core client for 30 sec - exiting 05:46:54 (6164): No heartbeat from core client for 30 sec - exiting 05:46:55 (6164): No heartbeat from core client for 30 sec - exiting 05:46:56 (6164): No heartbeat from core client for 30 sec - exiting 05:46:57 (6164): No heartbeat from core client for 30 sec - exiting 05:46:58 (6164): No heartbeat from core client for 30 sec - exiting 05:46:59 (6164): No heartbeat from core client for 30 sec - exiting 05:47:00 (6164): No heartbeat from core client for 30 sec - exiting 05:47:01 (6164): No heartbeat from core client for 30 sec - exiting 05:47:02 (6164): No heartbeat from core client for 30 sec - exiting 05:47:03 (6164): No heartbeat from core client for 30 sec - exiting 05:47:05 (6164): No heartbeat from core client for 30 sec - exiting 05:47:06 (6164): No heartbeat from core client for 30 sec - exiting 05:47:07 (6164): No heartbeat from core client for 30 sec - exiting 05:47:08 (6164): No heartbeat from core client for 30 sec - exiting 05:47:09 (6164): No heartbeat from core client for 30 sec - exiting 05:47:10 (6164): No heartbeat from core client for 30 sec - exiting 05:47:11 (6164): No heartbeat from core client for 30 sec - exiting 05:47:12 (6164): No heartbeat from core client for 30 sec - exiting 05:47:13 (6164): No heartbeat from core client for 30 sec - exiting 05:47:14 (6164): No heartbeat from core client for 30 sec - exiting 05:47:16 (6164): No heartbeat from core client for 30 sec - exiting 05:47:17 (6164): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:39:41 (7084): No heartbeat from core client for 30 sec - exiting 09:39:42 (7084): No heartbeat from core client for 30 sec - exiting 09:39:43 (7084): No heartbeat from core client for 30 sec - exiting 09:39:44 (7084): No heartbeat from core client for 30 sec - exiting 09:39:45 (7084): No heartbeat from core client for 30 sec - exiting 09:39:46 (7084): No heartbeat from core client for 30 sec - exiting 09:39:47 (7084): No heartbeat from core client for 30 sec - exiting 09:39:48 (7084): No heartbeat from core client for 30 sec - exiting 09:39:49 (7084): No heartbeat from core client for 30 sec - exiting 09:39:50 (7084): No heartbeat from core client for 30 sec - exiting 09:39:51 (7084): No heartbeat from core client for 30 sec - exiting 09:39:52 (7084): No heartbeat from core client for 30 sec - exiting 09:39:53 (7084): No heartbeat from core client for 30 sec - exiting 09:39:54 (7084): No heartbeat from core client for 30 sec - exiting 09:39:55 (7084): No heartbeat from core client for 30 sec - exiting 09:39:56 (7084): No heartbeat from core client for 30 sec - exiting 09:39:57 (7084): No heartbeat from core client for 30 sec - exiting 09:39:58 (7084): No heartbeat from core client for 30 sec - exiting 09:39:59 (7084): No heartbeat from core client for 30 sec - exiting 09:40:00 (7084): No heartbeat from core client for 30 sec - exiting 09:40:01 (7084): No heartbeat from core client for 30 sec - exiting 09:40:02 (7084): No heartbeat from core client for 30 sec - exiting 09:40:03 (7084): No heartbeat from core client for 30 sec - exiting 09:40:04 (7084): No heartbeat from core client for 30 sec - exiting 09:40:05 (7084): No heartbeat from core client for 30 sec - exiting 09:40:06 (7084): No heartbeat from core client for 30 sec - exiting 09:40:08 (7084): No heartbeat from core client for 30 sec - exiting 09:40:09 (7084): No heartbeat from core client for 30 sec - exiting 09:40:10 (7084): No heartbeat from core client for 30 sec - exiting 09:40:11 (7084): No heartbeat from core client for 30 sec - exiting 09:40:12 (7084): No heartbeat from core client for 30 sec - exiting 09:40:13 (7084): No heartbeat from core client for 30 sec - exiting 09:40:14 (7084): No heartbeat from core client for 30 sec - exiting 09:40:15 (7084): No heartbeat from core client for 30 sec - exiting 09:40:16 (7084): No heartbeat from core client for 30 sec - exiting 09:40:17 (7084): No heartbeat from core client for 30 sec - exiting 09:40:18 (7084): No heartbeat from core client for 30 sec - exiting 09:40:19 (7084): No heartbeat from core client for 30 sec - exiting 09:40:20 (7084): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=9456, iMonCtr=2 Model crash detected, will try to restart... Glontrollero: CPDN proc:ss is not runnings not running, exiting, bRetVal = 1, checID=3424, iMonCtr=2 4, iMonCtr=2 detected, will try to restart... Leaving CPDN_Main::Monitor... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=8416, selfPID=9108, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=8320, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=8560, selfPID=9004, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7044, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7112, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1028, selfPID=5892, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... CPDN Monitor - Quit request from BOINC... GController:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7596, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2352, selfPID=4140, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=9044, iMonCtr=2 Model crash detected, will try to restart... GController:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6580, selfPID=4848, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
19 Mar 2015 04:41:45	1333820	17788184	hadam3p_anz_a1cv_2013_1_009460062_0	115,499	713,964	6.1816
16 Mar 2015 09:18:26	1333820	17788184	hadam3p_anz_a1cv_2013_1_009460062_0	103,979	644,817	6.2014
11 Mar 2015 10:47:10	1333820	17788184	hadam3p_anz_a1cv_2013_1_009460062_0	92,459	577,201	6.2428
10 Mar 2015 16:27:33	1333820	17788184	hadam3p_anz_a1cv_2013_1_009460062_0	80,939	508,919	6.2877
28 Feb 2015 22:43:30	1333820	17788184	hadam3p_anz_a1cv_2013_1_009460062_0	69,419	433,846	6.2497
24 Feb 2015 23:37:43	1333820	17788184	hadam3p_anz_a1cv_2013_1_009460062_0	57,899	360,187	6.2210
15 Feb 2015 22:51:34	1333820	17788184	hadam3p_anz_a1cv_2013_1_009460062_0	46,379	286,596	6.1794
10 Feb 2015 20:10:08	1333820	17788184	hadam3p_anz_a1cv_2013_1_009460062_0	34,859	215,006	6.1679
06 Feb 2015 22:53:58	1333820	17788184	hadam3p_anz_a1cv_2013_1_009460062_0	23,339	145,252	6.2236
31 Jan 2015 22:34:12	1333820	17788184	hadam3p_anz_a1cv_2013_1_009460062_0	11,819	74,251	6.2823