Task 12770627

Name	hadam3p_pnw_zc6f_1998_1_006955903_1
Workunit	7159219
Created	3 Apr 2011, 9:29:24 UTC
Sent	4 Apr 2011, 1:11:48 UTC
Report deadline	16 Mar 2012, 6:31:48 UTC
Received	28 Jun 2011, 12:13:29 UTC
Server state	Over
Outcome	Success
Client state	Done
Exit status	0 (0x00000000)
Computer ID	1061885
Run time	12 days 11 hours 32 min 49 sec
CPU time	10 days 4 hours 22 min 26 sec
Validate state	Workunit error - check skipped
Credit	3,005.88
Device peak FLOPS	1.57 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Pacific North West v6.09 windows_intelx86
Stderr	<core_client_version>6.10.18</core_client_version> <![CDATA[ <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1140, selfPID=6112, iMonCtr=1 Model crash detected, will try to restart... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5876, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5808, iMonCtr=2 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1420, selfPID=5960, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... 08:02:18 (4296): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:02:19 (4296): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 06:54:01 (5248): No heartbeat from core client for 30 sec - exiting 06:54:02 (5248): No heartbeat from core client for 30 sec - exiting 06:54:03 (5248): No heartbeat from core client for 30 sec - exiting 06:54:04 (5248): No heartbeat from core client for 30 sec - exiting 06:54:05 (5248): No heartbeat from core client for 30 sec - exiting 06:54:06 (5248): No heartbeat from core client for 30 sec - exiting 06:54:07 (5248): No heartbeat from core client for 30 sec - exiting 06:54:08 (5248): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:20:01 (5988): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:20:02 (5988): No heartbeat from core client for 30 sec - exiting 11:20:03 (5988): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4488, iMonCtr=2 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4236, iMonCtr=2 Model crash detected, will try to restart... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4140, iMonCtr=2 CPDN Monitor - Quit request from BOINC... 21:04:43 (5884): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:04:44 (5884): No heartbeat from core client for 30 sec - exiting 21:04:45 (5884): No heartbeat from core client for 30 sec - exiting 21:04:46 (5884): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5640, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2200, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3348, iMonCtr=2 Model crash detected, will try to restart... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4328, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5296, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... 19:36:31 (5476): No heartbeat from core client for 30 sec - exiting 19:36:32 (5476): No heartbeat from core client for 30 sec - exiting 19:36:33 (5476): No heartbeat from core client for 30 sec - exiting 19:36:34 (5476): No heartbeat from core client for 30 sec - exiting 19:36:36 (5476): No heartbeat from core client for 30 sec - exiting 19:36:37 (5476): No heartbeat from core client for 30 sec - exiting 19:36:38 (5476): No heartbeat from core client for 30 sec - exiting 19:36:39 (5476): No heartbeat from core client for 30 sec - exiting 19:36:40 (5476): No heartbeat from core client for 30 sec - exiting 19:36:41 (5476): No heartbeat from core client for 30 sec - exiting 19:36:42 (5476): No heartbeat from core client for 30 sec - exiting 19:36:43 (5476): No heartbeat from core client for 30 sec - exiting 19:36:44 (5476): No heartbeat from core client for 30 sec - exiting 19:36:45 (5476): No heartbeat from core client for 30 sec - exiting 19:36:46 (5476): No heartbeat from core client for 30 sec - exiting 19:36:48 (5476): No heartbeat from core client for 30 sec - exiting 19:36:49 (5476): No heartbeat from core client for 30 sec - exiting 19:36:50 (5476): No heartbeat from core client for 30 sec - exiting 19:36:51 (5476): No heartbeat from core client for 30 sec - exiting 19:36:52 (5476): No heartbeat from core client for 30 sec - exiting 19:36:53 (5476): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Global Worker:: CPDN process is not running, exiting, bController:: CPDN process is not running, exiting, etVal = 1RetVal = 1, checkPID=0, selfPID=5440, iMonCtr, Model crash detected, will try to restart... checkPID=0, selfPID=4228, iMonCtr=2 Leaving CPDN_Main::Monitor... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3196, iMonCtr=2 06:54:29 (5652): No heartbeat from core client for 30 sec - exiting 06:54:30 (5652): No heartbeat from core client for 30 sec - exiting 06:54:31 (5652): No heartbeat from core client for 30 sec - exiting 06:54:33 (5652): No heartbeat from core client for 30 sec - exiting 06:54:34 (5652): No heartbeat from core client for 30 sec - exiting 06:54:35 (5652): No heartbeat from core client for 30 sec - exiting 06:54:36 (5652): No heartbeat from core client for 30 sec - exiting 06:54:37 (5652): No heartbeat from core client for 30 sec - exiting 06:54:38 (5652): No heartbeat from core client for 30 sec - exiting 06:54:39 (5652): No heartbeat from core client for 30 sec - exiting 06:54:40 (5652): No heartbeat from core client for 30 sec - exiting 06:54:41 (5652): No heartbeat from core client for 30 sec - exiting 06:54:43 (5652): No heartbeat from core client for 30 sec - exiting 06:54:44 (5652): No heartbeat from core client for 30 sec - exiting 06:54:45 (5652): No heartbeat from core client for 30 sec - exiting 06:54:46 (5652): No heartbeat from core client for 30 sec - exiting 06:54:47 (5652): No heartbeat from core client for 30 sec - exiting 06:54:48 (5652): No heartbeat from core client for 30 sec - exiting 06:54:49 (5652): No heartbeat from core client for 30 sec - exiting 06:54:50 (5652): No heartbeat from core client for 30 sec - exiting 06:54:51 (5652): No heartbeat from core client for 30 sec - exiting 06:54:53 (5652): No heartbeat from core client for 30 sec - exiting 06:54:54 (5652): No heartbeat from core client for 30 sec - exiting 06:54:55 (5652): No heartbeat from core client for 30 sec - exiting 06:54:56 (5652): No heartbeat from core client for 30 sec - exiting 06:54:57 (5652): No heartbeat from core client for 30 sec - exiting 06:54:58 (5652): No heartbeat from core client for 30 sec - exiting 06:54:59 (5652): No heartbeat from core client for 30 sec - exiting 06:55:00 (5652): No heartbeat from core client for 30 sec - exiting 06:55:01 (5652): No heartbeat from core client for 30 sec - exiting 06:55:02 (5652): No heartbeat from core client for 30 sec - exiting 06:55:03 (5652): No heartbeat from core client for 30 sec - exiting 06:55:05 (5652): No heartbeat from core client for 30 sec - exiting 06:55:06 (5652): No heartbeat from core client for 30 sec - exiting 06:55:07 (5652): No heartbeat from core client for 30 sec - exiting 06:55:08 (5652): No heartbeat from core client for 30 sec - exiting 06:55:09 (5652): No heartbeat from core client for 30 sec - exiting 06:55:10 (5652): No heartbeat from core client for 30 sec - exiting 06:55:11 (5652): No heartbeat from core client for 30 sec - exiting 06:55:12 (5652): No heartbeat from core client for 30 sec - exiting 06:55:13 (5652): No heartbeat from core client for 30 sec - exiting 06:55:14 (5652): No heartbeat from core client for 30 sec - exiting 06:55:16 (5652): No heartbeat from core client for 30 sec - exiting 06:55:17 (5652): No heartbeat from core client for 30 sec - exiting 06:55:18 (5652): No heartbeat from core client for 30 sec - exiting 06:55:19 (5652): No heartbeat from core client for 30 sec - exiting 06:55:20 (5652): No heartbeat from core client for 30 sec - exiting 06:55:21 (5652): No heartbeat from core client for 30 sec - exiting 06:55:22 (5652): No heartbeat from core client for 30 sec - exiting 06:55:23 (5652): No heartbeat from core client for 30 sec - exiting 06:55:24 (5652): No heartbeat from core client for 30 sec - exiting 06:55:25 (5652): No heartbeat from core client for 30 sec - exiting 06:55:26 (5652): No heartbeat from core client for 30 sec - exiting 06:55:28 (5652): No heartbeat from core client for 30 sec - exiting 06:55:29 (5652): No heartbeat from core client for 30 sec - exiting 06:55:30 (5652): No heartbeat from core client for 30 sec - exiting 06:55:31 (5652): No heartbeat from core client for 30 sec - exiting 06:55:32 (5652): No heartbeat from core client for 30 sec - exiting 06:55:33 (5652): No heartbeat from core client for 30 sec - exiting 06:55:34 (5652): No heartbeat from core client for 30 sec - exiting 06:55:35 (5652): No heartbeat from core client for 30 sec - exiting 06:55:36 (5652): No heartbeat from core client for 30 sec - exiting 06:55:37 (5652): No heartbeat from core client for 30 sec - exiting 06:55:39 (5652): No heartbeat from core client for 30 sec - exiting 06:55:40 (5652): No heartbeat from core client for 30 sec - exiting 06:55:41 (5652): No heartbeat from core client for 30 sec - exiting 06:55:42 (5652): No heartbeat from core client for 30 sec - exiting 06:55:43 (5652): No heartbeat from core client for 30 sec - exiting 06:55:44 (5652): No heartbeat from core client for 30 sec - exiting 06:55:45 (5652): No heartbeat from core client for 30 sec - exiting 06:55:46 (5652): No heartbeat from core client for 30 sec - exiting 06:55:47 (5652): No heartbeat from core client for 30 sec - exiting 06:55:48 (5652): No heartbeat from core client for 30 sec - exiting 06:55:49 (5652): No heartbeat from core client for 30 sec - exiting 06:55:51 (5652): No heartbeat from core client for 30 sec - exiting 06:55:52 (5652): No heartbeat from core client for 30 sec - exiting 06:55:53 (5652): No heartbeat from core client for 30 sec - exiting 06:55:54 (5652): No heartbeat from core client for 30 sec - exiting 06:55:55 (5652): No heartbeat from core client for 30 sec - exiting 06:55:56 (5652): No heartbeat from core client for 30 sec - exiting 06:55:57 (5652): No heartbeat from core client for 30 sec - exiting 06:55:58 (5652): No heartbeat from core client for 30 sec - exiting 06:55:59 (5652): No heartbeat from core client for 30 sec - exiting 06:56:00 (5652): No heartbeat from core client for 30 sec - exiting 06:56:01 (5652): No heartbeat from core client for 30 sec - exiting 06:56:03 (5652): No heartbeat from core client for 30 sec - exiting 06:56:04 (5652): No heartbeat from core client for 30 sec - exiting 06:56:05 (5652): No heartbeat from core client for 30 sec - exiting 06:56:06 (5652): No heartbeat from core client for 30 sec - exiting 06:56:07 (5652): No heartbeat from core client for 30 sec - exiting 06:56:08 (5652): No heartbeat from core client for 30 sec - exiting 06:56:09 (5652): No heartbeat from core client for 30 sec - exiting 06:56:10 (5652): No heartbeat from core client for 30 sec - exiting 06:56:11 (5652): No heartbeat from core client for 30 sec - exiting 06:56:12 (5652): No heartbeat from core client for 30 sec - exiting 06:56:13 (5652): No heartbeat from core client for 30 sec - exiting 06:56:15 (5652): No heartbeat from core client for 30 sec - exiting 06:56:16 (5652): No heartbeat from core client for 30 sec - exiting 06:56:17 (5652): No heartbeat from core client for 30 sec - exiting 06:56:18 (5652): No heartbeat from core client for 30 sec - exiting 06:56:19 (5652): No heartbeat from core client for 30 sec - exiting 06:56:20 (5652): No heartbeat from core client for 30 sec - exiting 06:56:21 (5652): No heartbeat from core client for 30 sec - exiting 06:56:22 (5652): No heartbeat from core client for 30 sec - exiting 06:56:23 (5652): No heartbeat from core client for 30 sec - exiting 06:56:24 (5652): No heartbeat from core client for 30 sec - exiting 06:56:26 (5652): No heartbeat from core client for 30 sec - exiting 06:56:27 (5652): No heartbeat from core client for 30 sec - exiting 06:56:28 (5652): No heartbeat from core client for 30 sec - exiting 06:56:29 (5652): No heartbeat from core client for 30 sec - exiting 06:56:30 (5652): No heartbeat from core client for 30 sec - exiting 06:56:31 (5652): No heartbeat from core client for 30 sec - exiting 06:56:32 (5652): No heartbeat from core client for 30 sec - exiting 06:56:33 (5652): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:22:38 (5684): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2384, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4156, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Regional yearly means requires 12 input files got 4 GCobal Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4756, iMonCtr=2 ontroller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4336, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Regional yearly means requires 12 input files got 5 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5036, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4444, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Regional yearly means requires 12 input files got 5 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 07:55:02 (5564): No heartbeat from core client for 30 sec - exiting 07:55:03 (5564): No heartbeat from core client for 30 sec - exiting 07:55:04 (5564): No heartbeat from core client for 30 sec - exiting 07:55:05 (5564): No heartbeat from core client for 30 sec - exiting 07:55:06 (5564): No heartbeat from core client for 30 sec - exiting 07:55:07 (5564): No heartbeat from core client for 30 sec - exiting 07:55:08 (5564): No heartbeat from core client for 30 sec - exiting 07:55:09 (5564): No heartbeat from core client for 30 sec - exiting 07:55:10 (5564): No heartbeat from core client for 30 sec - exiting 07:55:11 (5564): No heartbeat from core client for 30 sec - exiting 07:55:12 (5564): No heartbeat from core client for 30 sec - exiting 07:55:13 (5564): No heartbeat from core client for 30 sec - exiting 07:55:14 (5564): No heartbeat from core client for 30 sec - exiting 07:55:15 (5564): No heartbeat from core client for 30 sec - exiting 07:55:16 (5564): No heartbeat from core client for 30 sec - exiting 07:55:17 (5564): No heartbeat from core client for 30 sec - exiting 07:55:18 (5564): No heartbeat from core client for 30 sec - exiting 07:55:19 (5564): No heartbeat from core client for 30 sec - exiting 07:55:20 (5564): No heartbeat from core client for 30 sec - exiting 07:55:21 (5564): No heartbeat from core client for 30 sec - exiting 07:55:22 (5564): No heartbeat from core client for 30 sec - exiting 07:55:24 (5564): No heartbeat from core client for 30 sec - exiting 07:55:25 (5564): No heartbeat from core client for 30 sec - exiting 07:55:26 (5564): No heartbeat from core client for 30 sec - exiting 07:55:27 (5564): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4208, selfPID=4208, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3328, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Regional yearly means requires 12 input files got 5 CGnorobaler::ker CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=156, iMonCtr=2 Model crash detected, will try to restart... : CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5844, iMonCtr=2 Leaving CPDN_Main::Monitor... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... GCobontroller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4380, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Regional yearly means requires 12 input files got 7 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4216, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1264, selfPID=5736, iMonCtr=1 Model crash detected, will try to restart... 15:24:47 (4976): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5208, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Regional yearly means requires 12 input files got 7 Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5948, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5200, iMonCtr=2 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5180, iMonCtr=2 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4936, iMonCtr=2 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... 15:35:01 (4268): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1076, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5480, iMonCtr=2 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1032, iMonCtr=2 Model crash detected, will try to restart... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=464, iMonCtr=2 Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4776, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4872, iMonCtr=2 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4696, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Regional yearly means requires 12 input files got 8 Glontroller::orker:: CPDN process is not running, exiting, bRetVal = 1checkPID=0, selfPID=5260, iMonCtr=2 =2 del crash detected, will try to restart... Leaving CPDN_Main::Monitor... CPDN Monitor - Quit request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6128, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1564, selfPID=4956, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5764, iMonCtr=2 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=312, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4860, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5732, iMonCtr=2 Model crash detected, will try to restart... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4796, iMonCtr=2 CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, eg, exiting, bRetVal = 1, kPID=0, selfPID=6060, iMonCtr=2 Model crash detected, will try to restart... checkPID=0, selfPID=4584, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4892, iMonCtr=2 Model crash detected, will try to restart... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6012, iMonCtr=2 Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2088, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3592, selfPID=4800, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Regional yearly means requires 12 input files got 9 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5824, iMonCtr=2 Model crash detected, will try to restart... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6024, iMonCtr=2 Leaving CPDN_Main::Monitor... Regional yearly means requires 12 input files got 9 Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4488, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4300, iMonCtr=2 Model crash detected, will try to restart... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6008, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5360, iMonCtr=2 Model crash detected, will try to restart... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4692, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5672, iMonCtr=2 Model crash detected, will try to restart... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6132, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5208, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Regional yearly means requires 12 input files got 9 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4644, selfPID=3560, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4912, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Regional yearly means requires 12 input files got 9 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Global Worker:: CPDN process is notCrunning,troller:: CPDN process is not running, exiting, bRetVal = 1, check PID=0, selfPID=5728, iMonCtr=2 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5200, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Regional yearly means requires 12 input files got 9 17:09:39 (5428): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:09:41 (5428): No heartbeat from core client for 30 sec - exiting 17:09:42 (5428): No heartbeat from core client for 30 sec - exiting 17:09:43 (5428): No heartbeat from core client for 30 sec - exiting 17:09:44 (5428): No heartbeat from core client for 30 sec - exiting 17:09:45 (5428): No heartbeat from core client for 30 sec - exiting 17:09:46 (5428): No heartbeat from core client for 30 sec - exiting 17:09:47 (5428): No heartbeat from core client for 30 sec - exiting 17:09:48 (5428): No heartbeat from core client for 30 sec - exiting 17:09:49 (5428): No heartbeat from core client for 30 sec - exiting 17:09:50 (5428): No heartbeat from core client for 30 sec - exiting Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5832, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3788, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Regional yearly means requires 12 input files got 10 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2692, iMonCtr=2 Model crash detected, will try to restart... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5232, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4504, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Regional yearly means requires 12 input files got 10 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5576, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Regional yearly means requires 12 input files got 10 Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3620, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5536, iMonCtr=2 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4556, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Regional yearly means requires 12 input files got 10 Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4240, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5628, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Regional yearly means requires 12 input files got 10 14:45:47 (4876): No heartbeat from core client for 30 sec - exiting 14:45:48 (4876): No heartbeat from core client for 30 sec - exiting 14:45:49 (4876): No heartbeat from core client for 30 sec - exiting 14:45:50 (4876): No heartbeat from core client for 30 sec - exiting 14:45:51 (4876): No heartbeat from core client for 30 sec - exiting 14:45:52 (4876): No heartbeat from core client for 30 sec - exiting 14:45:53 (4876): No heartbeat from core client for 30 sec - exiting 14:45:55 (4876): No heartbeat from core client for 30 sec - exiting 14:45:56 (4876): No heartbeat from core client for 30 sec - exiting 14:45:57 (4876): No heartbeat from core client for 30 sec - exiting 14:45:58 (4876): No heartbeat from core client for 30 sec - exiting 14:45:59 (4876): No heartbeat from core client for 30 sec - exiting 14:46:00 (4876): No heartbeat from core client for 30 sec - exiting 14:46:01 (4876): No heartbeat from core client for 30 sec - exiting 14:46:02 (4876): No heartbeat from core client for 30 sec - exiting 14:46:03 (4876): No heartbeat from core client for 30 sec - exiting 14:46:04 (4876): No heartbeat from core client for 30 sec - exiting 14:46:05 (4876): No heartbeat from core client for 30 sec - exiting 14:46:07 (4876): No heartbeat from core client for 30 sec - exiting 14:46:08 (4876): No heartbeat from core client for 30 sec - exiting 14:46:09 (4876): No heartbeat from core client for 30 sec - exiting 14:46:10 (4876): No heartbeat from core client for 30 sec - exiting 14:46:11 (4876): No heartbeat from core client for 30 sec - exiting 14:46:12 (4876): No heartbeat from core client for 30 sec - exiting 14:46:13 (4876): No heartbeat from core client for 30 sec - exiting 14:46:14 (4876): No heartbeat from core client for 30 sec - exiting 14:46:15 (4876): No heartbeat from core client for 30 sec - exiting 14:46:16 (4876): No heartbeat from core client for 30 sec - exiting 14:46:17 (4876): No heartbeat from core client for 30 sec - exiting 14:46:19 (4876): No heartbeat from core client for 30 sec - exiting 14:46:20 (4876): No heartbeat from core client for 30 sec - exiting 14:46:21 (4876): No heartbeat from core client for 30 sec - exiting 14:46:22 (4876): No heartbeat from core client for 30 sec - exiting 14:46:23 (4876): No heartbeat from core client for 30 sec - exiting 14:46:24 (4876): No heartbeat from core client for 30 sec - exiting 14:46:25 (4876): No heartbeat from core client for 30 sec - exiting 14:46:26 (4876): No heartbeat from core client for 30 sec - exiting 14:46:27 (4876): No heartbeat from core client for 30 sec - exiting 14:46:28 (4876): No heartbeat from core client for 30 sec - exiting 14:46:29 (4876): No heartbeat from core client for 30 sec - exiting 14:46:31 (4876): No heartbeat from core client for 30 sec - exiting 14:46:32 (4876): No heartbeat from core client for 30 sec - exiting 14:46:33 (4876): No heartbeat from core client for 30 sec - exiting 14:46:34 (4876): No heartbeat from core client for 30 sec - exiting 14:46:35 (4876): No heartbeat from core client for 30 sec - exiting 14:46:36 (4876): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5808, iMonCtr=2 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3388, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Regional yearly means requires 12 input files got 10 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5808, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... 10:50:39 (5532): No heartbeat from core client for 30 sec - exiting 10:50:41 (5532): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=992, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Regional yearly means requires 12 input files got 11 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Leaving CPDN_Main::Monitor... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
23 Jun 2011 18:41:21	1061885	12770627	hadam3p_pnw_zc6f_1998_1_006955903_1	138,336	878,134	6.3478
21 Jun 2011 14:33:33	1061885	12770627	hadam3p_pnw_zc6f_1998_1_006955903_1	126,816	805,438	6.3512
10 Jun 2011 00:48:37	1061885	12770627	hadam3p_pnw_zc6f_1998_1_006955903_1	115,296	731,416	6.3438
30 May 2011 14:40:47	1061885	12770627	hadam3p_pnw_zc6f_1998_1_006955903_1	103,793	657,260	6.3324
30 May 2011 04:57:35	1061885	12770627	hadam3p_pnw_zc6f_1998_1_006955903_1	103,783	656,354	6.3243
30 May 2011 04:32:30	1061885	12770627	hadam3p_pnw_zc6f_1998_1_006955903_1	103,776	655,429	6.3158
12 May 2011 23:11:05	1061885	12770627	hadam3p_pnw_zc6f_1998_1_006955903_1	92,260	581,021	6.2976
12 May 2011 21:54:38	1061885	12770627	hadam3p_pnw_zc6f_1998_1_006955903_1	92,256	580,044	6.2873
06 May 2011 20:27:54	1061885	12770627	hadam3p_pnw_zc6f_1998_1_006955903_1	80,742	506,874	6.2777
06 May 2011 20:27:54	1061885	12770627	hadam3p_pnw_zc6f_1998_1_006955903_1	80,736	505,979	6.2671
28 Apr 2011 14:01:09	1061885	12770627	hadam3p_pnw_zc6f_1998_1_006955903_1	69,216	434,341	6.2752
25 Apr 2011 16:04:15	1061885	12770627	hadam3p_pnw_zc6f_1998_1_006955903_1	57,696	359,589	6.2325
20 Apr 2011 17:54:58	1061885	12770627	hadam3p_pnw_zc6f_1998_1_006955903_1	46,176	287,677	6.2300
20 Apr 2011 17:54:47	1061885	12770627	hadam3p_pnw_zc6f_1998_1_006955903_1	34,656	214,503	6.1895
11 Apr 2011 15:53:23	1061885	12770627	hadam3p_pnw_zc6f_1998_1_006955903_1	23,136	140,239	6.0615
06 Apr 2011 18:12:03	1061885	12770627	hadam3p_pnw_zc6f_1998_1_006955903_1	11,616	71,433	6.1495