Task 12239533

Name	hadam3p_pnw_zdb8_1979_1_006957372_0
Workunit	7160688
Created	23 Nov 2010, 9:35:41 UTC
Sent	20 Feb 2011, 5:52:02 UTC
Report deadline	2 Feb 2012, 11:12:02 UTC
Received	3 Apr 2011, 16:31:23 UTC
Server state	Over
Outcome	No reply
Client state	Compute error
Exit status	0 (0x00000000)
Computer ID	1016212
Run time	9 days 1 hours 1 min 5 sec
CPU time	4 days 0 hours 23 min 2 sec
Validate state	Invalid
Credit	1,503.98
Device peak FLOPS	1.62 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Pacific North West v6.08 windows_intelx86
Stderr	<core_client_version>6.6.38</core_client_version> <![CDATA[ <stderr_txt> Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6064, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=816, selfPID=1704, iMonCtr=1 Model crash detected, will try to restart... 18:19:06 (4012): No heartbeat from core client for 30 sec - exiting 18:19:07 (4012): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=504, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1544, selfPID=5260, iMonCtr=1 Model crash detected, will try to restart... 16:37:21 (3980): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4308, selfPID=4308, iMonCtr=2 CPDN Monitor - Quit request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4368, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6076, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Regional yearly means requires 12 input files got 1 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5196, selfPID=5912, iMonCtr=1 Model crash detected, will try to restart... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4856, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5880, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Regional yearly means requires 12 input files got 1 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4744, selfPID=4100, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Regional yearly means requires 12 input files got 1 CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4964, selfPID=4268, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Regional yearly means requires 12 input files got 1 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5944, selfPID=1920, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Regional yearly means requires 12 input files got 1 Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2692, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5760, selfPID=4268, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Regional yearly means requires 12 input files got 1 Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3080, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3644, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Regional yearly means requires 12 input files got 1 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4956, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Regional yearly means requires 12 input files got 1 CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2736, selfPID=2736, iMonCtr=2 GController:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6104, selfPID=5968, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Regional yearly means requires 12 input files got 1 07:57:41 (4252): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5320, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Regional yearly means requires 12 input files got 2 CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3932, iMonCtr=2 Model crash detected, will try to restart... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6100, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5848, iMonCtr=2 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5776, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4428, selfPID=5288, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not ruGlobal Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5484, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=7684, selfPID=4412, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Regional yearly means requires 12 input files got 2 Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2008, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2332, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Regional yearly means requires 12 input files got 3 CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5084, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Regional yearly means requires 12 input files got 3 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3248, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Regional yearly means requires 12 input files got 3 Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5556, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3044, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Regional yearly means requires 12 input files got 3 Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4916, iMonCtr=2 Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=684, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5000, iMonCtr=2 Model crash detected, will try to restart... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2840, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3420, selfPID=5796, iMonCtr=1 Model crash detected, will try to restart... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2500, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4632, selfPID=3160, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5176, selfPID=6124, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1680, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2224, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Regional yearly means requires 12 input files got 3 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4344, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Regional yearly means requires 12 input files got 3 Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5892, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6084, iMonCtr=2 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1480, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2140, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3540, selfPID=6136, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Regional yearly means requires 12 input files got 3 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2648, iMonCtr=2 Model crash detected, will try to restart... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3084, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2232, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Regional yearly means requires 12 input files got 3 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5432, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5248, selfPID=5936, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Regional yearly means requires 12 input files got 3 CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5460, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Regional yearly means requires 12 input files got 4 CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3664, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Regional yearly means requires 12 input files got 4 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4380, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3756, iMonCtr=2 Model crash detected, will try to restart... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5864, iMonCtr=2 Leaving CPDN_Main::Monitor... Regional yearly means requires 12 input files got 4 Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3796, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3376, selfPID=5888, iMonCtr=1 Model crash detected, will try to restart... GlontoollerWorkerDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4624, iMonCtr=2 Model crash detected, will try to restart... :: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2180, iMonCtr=2 Leaving CPDN_Main::Monitor... Regional yearly means requires 12 input files got 4 Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5704, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4360, selfPID=6120, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Regional yearly means requires 12 input files got 4 05:23:53 (5236): No heartbeat from core client for 30 sec - exiting 05:23:54 (5236): No heartbeat from core client for 30 sec - exiting 05:23:55 (5236): No heartbeat from core client for 30 sec - exiting 05:23:56 (5236): No heartbeat from core client for 30 sec - exiting 05:23:57 (5236): No heartbeat from core client for 30 sec - exiting 05:23:58 (5236): No heartbeat from core client for 30 sec - exiting 05:23:59 (5236): No heartbeat from core client for 30 sec - exiting 05:24:00 (5236): No heartbeat from core client for 30 sec - exiting 05:24:01 (5236): No heartbeat from core client for 30 sec - exiting 05:24:03 (5236): No heartbeat from core client for 30 sec - exiting 05:24:04 (5236): No heartbeat from core client for 30 sec - exiting 05:24:05 (5236): No heartbeat from core client for 30 sec - exiting 05:24:06 (5236): No heartbeat from core client for 30 sec - exiting 05:24:07 (5236): No heartbeat from core client for 30 sec - exiting 05:24:08 (5236): No heartbeat from core client for 30 sec - exiting 05:24:09 (5236): No heartbeat from core client for 30 sec - exiting 05:24:10 (5236): No heartbeat from core client for 30 sec - exiting 05:24:11 (5236): No heartbeat from core client for 30 sec - exiting 05:24:12 (5236): No heartbeat from core client for 30 sec - exiting 05:24:14 (5236): No heartbeat from core client for 30 sec - exiting 05:24:15 (5236): No heartbeat from core client for 30 sec - exiting 05:24:16 (5236): No heartbeat from core client for 30 sec - exiting 05:24:17 (5236): No heartbeat from core client for 30 sec - exiting 05:24:18 (5236): No heartbeat from core client for 30 sec - exiting 05:24:19 (5236): No heartbeat from core client for 30 sec - exiting 05:24:20 (5236): No heartbeat from core client for 30 sec - exiting 05:24:21 (5236): No heartbeat from core client for 30 sec - exiting 05:24:22 (5236): No heartbeat from core client for 30 sec - exiting 05:24:23 (5236): No heartbeat from core client for 30 sec - exiting 05:24:24 (5236): No heartbeat from core client for 30 sec - exiting 05:24:26 (5236): No heartbeat from core client for 30 sec - exiting 05:24:27 (5236): No heartbeat from core client for 30 sec - exiting 05:24:28 (5236): No heartbeat from core client for 30 sec - exiting 05:24:29 (5236): No heartbeat from core client for 30 sec - exiting 05:24:30 (5236): No heartbeat from core client for 30 sec - exiting 05:24:31 (5236): No heartbeat from core client for 30 sec - exiting 05:24:32 (5236): No heartbeat from core client for 30 sec - exiting 05:24:33 (5236): No heartbeat from core client for 30 sec - exiting 05:24:34 (5236): No heartbeat from core client for 30 sec - exiting 05:24:35 (5236): No heartbeat from core client for 30 sec - exiting 05:24:36 (5236): No heartbeat from core client for 30 sec - exiting 05:24:38 (5236): No heartbeat from core client for 30 sec - exiting 05:24:39 (5236): No heartbeat from core client for 30 sec - exiting 05:24:40 (5236): No heartbeat from core client for 30 sec - exiting 05:24:41 (5236): No heartbeat from core client for 30 sec - exiting 05:24:42 (5236): No heartbeat from core client for 30 sec - exiting 05:24:43 (5236): No heartbeat from core client for 30 sec - exiting 05:24:44 (5236): No heartbeat from core client for 30 sec - exiting 05:24:45 (5236): No heartbeat from core client for 30 sec - exiting 05:24:46 (5236): No heartbeat from core client for 30 sec - exiting 05:24:47 (5236): No heartbeat from core client for 30 sec - exiting 05:24:48 (5236): No heartbeat from core client for 30 sec - exiting 05:24:50 (5236): No heartbeat from core client for 30 sec - exiting 05:24:51 (5236): No heartbeat from core client for 30 sec - exiting 05:24:52 (5236): No heartbeat from core client for 30 sec - exiting 05:24:53 (5236): No heartbeat from core client for 30 sec - exiting 05:24:54 (5236): No heartbeat from core client for 30 sec - exiting 05:24:55 (5236): No heartbeat from core client for 30 sec - exiting 05:24:56 (5236): No heartbeat from core client for 30 sec - exiting 05:24:57 (5236): No heartbeat from core client for 30 sec - exiting 05:24:58 (5236): No heartbeat from core client for 30 sec - exiting 05:24:59 (5236): No heartbeat from core client for 30 sec - exiting 05:25:00 (5236): No heartbeat from core client for 30 sec - exiting 05:25:02 (5236): No heartbeat from core client for 30 sec - exiting 05:25:03 (5236): No heartbeat from core client for 30 sec - exiting 05:25:04 (5236): No heartbeat from core client for 30 sec - exiting 05:25:05 (5236): No heartbeat from core client for 30 sec - exiting 05:25:06 (5236): No heartbeat from core client for 30 sec - exiting 05:25:07 (5236): No heartbeat from core client for 30 sec - exiting 05:25:08 (5236): No heartbeat from core client for 30 sec - exiting 05:25:09 (5236): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1224, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5036, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Regional yearly means requires 12 input files got 4 Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4192, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4736, selfPID=5696, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Regional yearly means requires 12 input files got 4 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2580, selfPID=3964, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3824, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4280, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Regional yearly means requires 12 input files got 4 Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5932, iMonCtr=2 Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5652, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2836, selfPID=4620, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2108, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5824, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5496, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Regional yearly means requires 12 input files got 5 Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5704, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5464, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Regional yearly means requires 12 input files got 5 Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1168, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4176, selfPID=4132, iMonCtr=1 Model crash detected, will try to restart... 05:36:12 (3756): No heartbeat from core client for 30 sec - exiting 05:36:13 (3756): No heartbeat from core client for 30 sec - exiting 05:36:14 (3756): No heartbeat from core client for 30 sec - exiting 05:36:15 (3756): No heartbeat from core client for 30 sec - exiting 05:36:16 (3756): No heartbeat from core client for 30 sec - exiting 05:36:17 (3756): No heartbeat from core client for 30 sec - exiting 05:36:18 (3756): No heartbeat from core client for 30 sec - exiting 05:36:20 (3756): No heartbeat from core client for 30 sec - exiting 05:36:21 (3756): No heartbeat from core client for 30 sec - exiting 05:36:22 (3756): No heartbeat from core client for 30 sec - exiting 05:36:23 (3756): No heartbeat from core client for 30 sec - exiting 05:36:24 (3756): No heartbeat from core client for 30 sec - exiting 05:36:25 (3756): No heartbeat from core client for 30 sec - exiting 05:36:26 (3756): No heartbeat from core client for 30 sec - exiting 05:36:27 (3756): No heartbeat from core client for 30 sec - exiting 05:36:28 (3756): No heartbeat from core client for 30 sec - exiting 05:36:29 (3756): No heartbeat from core client for 30 sec - exiting 05:36:31 (3756): No heartbeat from core client for 30 sec - exiting 05:36:32 (3756): No heartbeat from core client for 30 sec - exiting 05:36:33 (3756): No heartbeat from core client for 30 sec - exiting 05:36:34 (3756): No heartbeat from core client for 30 sec - exiting 05:36:35 (3756): No heartbeat from core client for 30 sec - exiting 05:36:36 (3756): No heartbeat from core client for 30 sec - exiting 05:36:37 (3756): No heartbeat from core client for 30 sec - exiting 05:36:38 (3756): No heartbeat from core client for 30 sec - exiting 05:36:40 (3756): No heartbeat from core client for 30 sec - exiting 05:36:41 (3756): No heartbeat from core client for 30 sec - exiting 05:36:42 (3756): No heartbeat from core client for 30 sec - exiting 05:36:43 (3756): No heartbeat from core client for 30 sec - exiting 05:36:44 (3756): No heartbeat from core client for 30 sec - exiting 05:36:45 (3756): No heartbeat from core client for 30 sec - exiting 05:36:46 (3756): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2180, selfPID=4688, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5932, iMonCtr=2 Model crash detected, will try to restart... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3016, iMonCtr=2 C05:28:58 (4152): No heartbeat from core client for 30 sec - exiting 05:28:59 (4152): No heartbeat from core client for 30 sec - exiting 05:29:00 (4152): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Global Worker:: CPDN process is not running, exitgng, bRetVal = 1, checkPID=0, selfPID=5432, iMonCtr=2 , bRetVal = 1, checkPID=0, selfPID=4644, iMonCtr=2 Model crash detected, will try to restart... 10:12:24 (4408): No heartbeat from core client for 30 sec - exiting 10:12:25 (4408): No heartbeat from core client for 30 sec - exiting 10:12:27 (4408): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Global Worker:: CPDN process is not runningontroller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5652, iMonCtr=2 Model crash detected, will try to restart... , exiting, bController:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2652, selfPID=5928, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6084, selfPID=2472, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3464, selfPID=5104, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Regional yearly means requires 12 input files got 5 Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2852, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4920, selfPID=4520, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4316, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Regional yearly means requires 12 input files got 5 GCobal Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1776, iMonCtr=2 ontroller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6080, iMonCtr=2 Model crash detected, will try to restart... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=556, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4936, selfPID=4640, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5076, selfPID=6136, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Regional yearly means requires 12 input files got 5 Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3448, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3508, selfPID=5968, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5168, iMonCtr=2 CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4200, iMonCtr=2 Model crash detected, will try to restart... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3820, iMonCtr=2 Leaving CPDN_Main::Monitor... Regional yearly means requires 12 input files got 6 CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5844, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Regional yearly means requires 12 input files got 6 cpdnmonitor: cannot open input file C:\ProgramData\BOINC/projects/climateprediction.net/hadam3p_pnw_zdb8_1979_1_006957372/dataout/atmos_restart.day after 11 attempts cpdnmonitor: cannot open input file C:\ProgramData\BOINC/projects/climateprediction.net/hadam3p_pnw_zdb8_1979_1_006957372/dataout/region_restart.day after 11 attempts Model crashed: READHIST: End of file in READ from history file for namelist NLIHISTO tmp/xaakm.pipe_dummy 2048 Leaving CPDN_Main::Monitor... Regional yearly means requires 12 input files got 6 15:48:20 (2836): called boinc_finish </stderr_txt> <message> <file_xfer_error> <file_name>hadam3p_pnw_zdb8_1979_1_006957372_0_7.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_pnw_zdb8_1979_1_006957372_0_8.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_pnw_zdb8_1979_1_006957372_0_9.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_pnw_zdb8_1979_1_006957372_0_10.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_pnw_zdb8_1979_1_006957372_0_11.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_pnw_zdb8_1979_1_006957372_0_12.zip</file_name> <error_code>-161</error_code> </file_xfer_error> </message> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
31 Mar 2011 07:13:57	1016212	12239533	hadam3p_pnw_zdb8_1979_1_006957372_0	69,216	342,169	4.9435
23 Mar 2011 20:23:45	1016212	12239533	hadam3p_pnw_zdb8_1979_1_006957372_0	57,702	284,070	4.9231
23 Mar 2011 07:28:13	1016212	12239533	hadam3p_pnw_zdb8_1979_1_006957372_0	57,696	283,318	4.9105
16 Mar 2011 18:09:36	1016212	12239533	hadam3p_pnw_zdb8_1979_1_006957372_0	46,176	225,551	4.8846
08 Mar 2011 10:36:21	1016212	12239533	hadam3p_pnw_zdb8_1979_1_006957372_0	34,657	168,374	4.8583
08 Mar 2011 10:36:21	1016212	12239533	hadam3p_pnw_zdb8_1979_1_006957372_0	34,656	167,689	4.8387
08 Mar 2011 10:36:21	1016212	12239533	hadam3p_pnw_zdb8_1979_1_006957372_0	23,142	111,308	4.8098
08 Mar 2011 10:36:21	1016212	12239533	hadam3p_pnw_zdb8_1979_1_006957372_0	23,136	110,594	4.7802
22 Feb 2011 15:24:20	1016212	12239533	hadam3p_pnw_zdb8_1979_1_006957372_0	11,616	54,048	4.6529