Task 16118395

Name	hadam3p_eu_izln_2001_1_008491328_0
Workunit	8642141
Created	3 Dec 2013, 21:08:35 UTC
Sent	4 Dec 2013, 19:20:28 UTC
Report deadline	17 Nov 2014, 0:40:28 UTC
Received	11 Feb 2014, 16:09:24 UTC
Server state	Over
Outcome	Success
Client state	Done
Exit status	0 (0x00000000)
Computer ID	1255851
Run time	7 days 7 hours 8 min 21 sec
CPU time	6 days 2 hours 15 min 14 sec
Validate state	Workunit error - check skipped
Credit	2,386.55
Device peak FLOPS	2.14 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Europe v6.09 windows_intelx86
Stderr	<core_client_version>7.2.33</core_client_version> <![CDATA[ <stderr_txt> Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6540, iMonCtr=2 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5404, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1728, selfPID=2072, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7480, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3528, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... 15:43:34 (4664): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=632, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... 11:48:19 (7096): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6628, selfPID=6628, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7068, iMonCtr=2 Model crash detected, will try to restart... 19:01:40 (8124): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... GController:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4720, selfPID=5032, iMonCtr=1 Model crash detected, will try to restart... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6060, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2288, selfPID=5388, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4968, selfPID=2844, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6644, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... 22:16:46 (7920): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=7840, selfPID=7524, iMonCtr=1 Model crash detected, will try to restart... 17:36:15 (2816): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=8096, selfPID=8096, iMonCtr=2 Glontroller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2796, iMonCtr=2 Model crash detected, will try to restart... obal Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2592, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3980, iMonCtr=2 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=7940, selfPID=1496, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1596, selfPID=4248, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6304, selfPID=7768, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=7448, selfPID=7700, iMonCtr=1 Model crash detected, will try to restart... 21:25:02 (7956): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5156, selfPID=5628, iMonCtr=1 Model crash detected, will try to restart... 16:58:48 (1796): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:13:56 (4984): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:13:57 (4984): No heartbeat from core client for 30 sec - exiting 17:15:41 (2256): No heartbeat from core client for 30 sec - exiting 17:15:42 (2256): No heartbeat from core client for 30 sec - exiting 17:15:43 (2256): No heartbeat from core client for 30 sec - exiting 17:15:44 (2256): No heartbeat from core client for 30 sec - exiting 17:15:45 (2256): No heartbeat from core client for 30 sec - exiting 17:15:46 (2256): No heartbeat from core client for 30 sec - exiting 17:15:47 (2256): No heartbeat from core client for 30 sec - exiting 17:15:48 (2256): No heartbeat from core client for 30 sec - exiting 17:15:49 (2256): No heartbeat from core client for 30 sec - exiting 17:15:50 (2256): No heartbeat from core client for 30 sec - exiting 17:15:51 (2256): No heartbeat from core client for 30 sec - exiting 17:15:52 (2256): No heartbeat from core client for 30 sec - exiting 17:15:53 (2256): No heartbeat from core client for 30 sec - exiting 17:15:54 (2256): No heartbeat from core client for 30 sec - exiting 17:15:55 (2256): No heartbeat from core client for 30 sec - exiting 17:15:56 (2256): No heartbeat from core client for 30 sec - exiting 17:15:57 (2256): No heartbeat from core client for 30 sec - exiting 17:15:58 (2256): No heartbeat from core client for 30 sec - exiting 17:15:59 (2256): No heartbeat from core client for 30 sec - exiting 17:16:00 (2256): No heartbeat from core client for 30 sec - exiting 17:16:01 (2256): No heartbeat from core client for 30 sec - exiting 17:16:02 (2256): No heartbeat from core client for 30 sec - exiting 17:16:03 (2256): No heartbeat from core client for 30 sec - exiting 17:16:04 (2256): No heartbeat from core client for 30 sec - exiting 17:16:05 (2256): No heartbeat from core client for 30 sec - exiting 17:16:06 (2256): No heartbeat from core client for 30 sec - exiting 17:16:07 (2256): No heartbeat from core client for 30 sec - exiting 17:16:08 (2256): No heartbeat from core client for 30 sec - exiting 17:16:09 (2256): No heartbeat from core client for 30 sec - exiting 17:16:10 (2256): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5420, selfPID=9528, iMonCtr=1 Model crash detected, will try to restart... CGntroller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7360, iMonCtr=2 Model crash detected, will try to restart... lobal Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4252, iMonCtr=2 17:47:46 (7408): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:47:47 (7408): No heartbeat from core client for 30 sec - exiting Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=9220, selfPID=3032, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6056, selfPID=8024, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2160, selfPID=6516, iMonCtr=1 Model crash detected, will try to restart... GController:: CPDN process is not running, exiting, bRetVal = 1, checkPID=7012, selfPID=600, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... 10:42:53 (4996): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:01:50 (7216): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=7560, selfPID=7560, iMonCtr=2 13:01:51 (7216): No heartbeat from core client for 30 sec - exiting 13:02:42 (6988): No heartbeat from core client for 30 sec - exiting 13:02:43 (6988): No heartbeat from core client for 30 sec - exiting 13:02:44 (6988): No heartbeat from core client for 30 sec - exiting 13:02:45 (6988): No heartbeat from core client for 30 sec - exiting 13:02:46 (6988): No heartbeat from core client for 30 sec - exiting 13:02:47 (6988): No heartbeat from core client for 30 sec - exiting 13:02:48 (6988): No heartbeat from core client for 30 sec - exiting 13:02:49 (6988): No heartbeat from core client for 30 sec - exiting 13:02:50 (6988): No heartbeat from core client for 30 sec - exiting 13:02:52 (6988): No heartbeat from core client for 30 sec - exiting 13:02:53 (6988): No heartbeat from core client for 30 sec - exiting 13:02:54 (6988): No heartbeat from core client for 30 sec - exiting 13:02:55 (6988): No heartbeat from core client for 30 sec - exiting 13:02:56 (6988): No heartbeat from core client for 30 sec - exiting 13:02:57 (6988): No heartbeat from core client for 30 sec - exiting 13:02:58 (6988): No heartbeat from core client for 30 sec - exiting 13:02:59 (6988): No heartbeat from core client for 30 sec - exiting 13:03:00 (6988): No heartbeat from core client for 30 sec - exiting 13:03:01 (6988): No heartbeat from core client for 30 sec - exiting 13:03:02 (6988): No heartbeat from core client for 30 sec - exiting 13:03:03 (6988): No heartbeat from core client for 30 sec - exiting 13:03:04 (6988): No heartbeat from core client for 30 sec - exiting 13:03:05 (6988): No heartbeat from core client for 30 sec - exiting 13:03:06 (6988): No heartbeat from core client for 30 sec - exiting 13:03:07 (6988): No heartbeat from core client for 30 sec - exiting 13:03:08 (6988): No heartbeat from core client for 30 sec - exiting 13:03:09 (6988): No heartbeat from core client for 30 sec - exiting 13:03:10 (6988): No heartbeat from core client for 30 sec - exiting 13:03:11 (6988): No heartbeat from core client for 30 sec - exiting 13:03:12 (6988): No heartbeat from core client for 30 sec - exiting 13:03:13 (6988): No heartbeat from core client for 30 sec - exiting 13:03:14 (6988): No heartbeat from core client for 30 sec - exiting 13:03:15 (6988): No heartbeat from core client for 30 sec - exiting 13:03:16 (6988): No heartbeat from core client for 30 sec - exiting 13:03:17 (6988): No heartbeat from core client for 30 sec - exiting 13:03:18 (6988): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:58:01 (7080): No heartbeat from core client for 30 sec - exiting 14:58:02 (7080): No heartbeat from core client for 30 sec - exiting 14:58:03 (7080): No heartbeat from core client for 30 sec - exiting 14:58:04 (7080): No heartbeat from core client for 30 sec - exiting 14:58:05 (7080): No heartbeat from core client for 30 sec - exiting 14:58:06 (7080): No heartbeat from core client for 30 sec - exiting 14:58:07 (7080): No heartbeat from core client for 30 sec - exiting 14:58:08 (7080): No heartbeat from core client for 30 sec - exiting 14:58:09 (7080): No heartbeat from core client for 30 sec - exiting 14:58:10 (7080): No heartbeat from core client for 30 sec - exiting 14:58:11 (7080): No heartbeat from core client for 30 sec - exiting 14:58:12 (7080): No heartbeat from core client for 30 sec - exiting 14:58:13 (7080): No heartbeat from core client for 30 sec - exiting 14:58:14 (7080): No heartbeat from core client for 30 sec - exiting 14:58:15 (7080): No heartbeat from core client for 30 sec - exiting 14:58:16 (7080): No heartbeat from core client for 30 sec - exiting 14:58:17 (7080): No heartbeat from core client for 30 sec - exiting 14:58:18 (7080): No heartbeat from core client for 30 sec - exiting 14:58:19 (7080): No heartbeat from core client for 30 sec - exiting 14:58:20 (7080): No heartbeat from core client for 30 sec - exiting 14:58:21 (7080): No heartbeat from core client for 30 sec - exiting 14:58:22 (7080): No heartbeat from core client for 30 sec - exiting 14:58:23 (7080): No heartbeat from core client for 30 sec - exiting 14:58:24 (7080): No heartbeat from core client for 30 sec - exiting 14:58:25 (7080): No heartbeat from core client for 30 sec - exiting 14:58:26 (7080): No heartbeat from core client for 30 sec - exiting 14:58:27 (7080): No heartbeat from core client for 30 sec - exiting 14:58:28 (7080): No heartbeat from core client for 30 sec - exiting 14:58:29 (7080): No heartbeat from core client for 30 sec - exiting 14:58:30 (7080): No heartbeat from core client for 30 sec - exiting 14:58:31 (7080): No heartbeat from core client for 30 sec - exiting 14:58:32 (7080): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=364, selfPID=7980, iMonCtr=1 Model crash detected, will try to restart... 15:10:47 (8088): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:26:20 (7696): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:26:21 (7696): No heartbeat from core client for 30 sec - exiting 19:05:35 (7024): No heartbeat from core client for 30 sec - exiting 19:05:36 (7024): No heartbeat from core client for 30 sec - exiting 19:05:37 (7024): No heartbeat from core client for 30 sec - exiting 19:05:38 (7024): No heartbeat from core client for 30 sec - exiting 19:05:39 (7024): No heartbeat from core client for 30 sec - exiting 19:05:40 (7024): No heartbeat from core client for 30 sec - exiting 19:05:41 (7024): No heartbeat from core client for 30 sec - exiting 19:05:42 (7024): No heartbeat from core client for 30 sec - exiting 19:05:43 (7024): No heartbeat from core client for 30 sec - exiting 19:05:44 (7024): No heartbeat from core client for 30 sec - exiting 19:05:45 (7024): No heartbeat from core client for 30 sec - exiting 19:05:46 (7024): No heartbeat from core client for 30 sec - exiting 19:05:47 (7024): No heartbeat from core client for 30 sec - exiting 19:05:48 (7024): No heartbeat from core client for 30 sec - exiting 19:05:49 (7024): No heartbeat from core client for 30 sec - exiting 19:05:50 (7024): No heartbeat from core client for 30 sec - exiting 19:05:51 (7024): No heartbeat from core client for 30 sec - exiting 19:05:52 (7024): No heartbeat from core client for 30 sec - exiting 19:05:53 (7024): No heartbeat from core client for 30 sec - exiting 19:05:54 (7024): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4908, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2784, selfPID=3776, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6068, selfPID=4648, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6108, selfPID=8008, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7768, iMonCtr=2 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6740, selfPID=7412, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... 17:21:53 (4948): No heartbeat from core client for 30 sec - exiting 17:21:54 (4948): No heartbeat from core client for 30 sec - exiting 17:21:55 (4948): No heartbeat from core client for 30 sec - exiting 17:21:56 (4948): No heartbeat from core client for 30 sec - exiting 17:21:57 (4948): No heartbeat from core client for 30 sec - exiting 17:21:58 (4948): No heartbeat from core client for 30 sec - exiting 17:21:59 (4948): No heartbeat from core client for 30 sec - exiting 17:22:00 (4948): No heartbeat from core client for 30 sec - exiting 17:22:01 (4948): No heartbeat from core client for 30 sec - exiting 17:22:02 (4948): No heartbeat from core client for 30 sec - exiting 17:22:03 (4948): No heartbeat from core client for 30 sec - exiting 17:22:04 (4948): No heartbeat from core client for 30 sec - exiting 17:22:05 (4948): No heartbeat from core client for 30 sec - exiting 17:22:06 (4948): No heartbeat from core client for 30 sec - exiting 17:22:07 (4948): No heartbeat from core client for 30 sec - exiting 17:22:08 (4948): No heartbeat from core client for 30 sec - exiting 17:22:09 (4948): No heartbeat from core client for 30 sec - exiting 17:22:10 (4948): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:24:49 (3948): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 13:00:36 (2484): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=8504, selfPID=8504, iMonCtr=2 13:00:37 (2484): No heartbeat from core client for 30 sec - exiting 13:00:38 (2484): No heartbeat from core client for 30 sec - exiting 13:00:39 (2484): No heartbeat from core client for 30 sec - exiting 13:02:10 (7832): No heartbeat from core client for 30 sec - exiting 13:02:11 (7832): No heartbeat from core client for 30 sec - exiting 13:02:12 (7832): No heartbeat from core client for 30 sec - exiting 13:02:13 (7832): No heartbeat from core client for 30 sec - exiting 13:02:14 (7832): No heartbeat from core client for 30 sec - exiting 13:02:15 (7832): No heartbeat from core client for 30 sec - exiting 13:02:16 (7832): No heartbeat from core client for 30 sec - exiting 13:02:17 (7832): No heartbeat from core client for 30 sec - exiting 13:02:19 (7832): No heartbeat from core client for 30 sec - exiting 13:02:20 (7832): No heartbeat from core client for 30 sec - exiting 13:02:21 (7832): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... GController:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6712, selfPID=2688, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7496, iMonCtr=2 Model crash detected, will try to restart... 18:06:56 (6812): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:47:50 (2732): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:47:52 (2732): No heartbeat from core client for 30 sec - exiting 20:48:48 (8516): No heartbeat from core client for 30 sec - exiting 20:48:49 (8516): No heartbeat from core client for 30 sec - exiting 20:48:50 (8516): No heartbeat from core client for 30 sec - exiting 20:48:51 (8516): No heartbeat from core client for 30 sec - exiting 20:48:52 (8516): No heartbeat from core client for 30 sec - exiting 20:48:53 (8516): No heartbeat from core client for 30 sec - exiting 20:48:54 (8516): No heartbeat from core client for 30 sec - exiting 20:48:55 (8516): No heartbeat from core client for 30 sec - exiting 20:48:56 (8516): No heartbeat from core client for 30 sec - exiting 20:48:57 (8516): No heartbeat from core client for 30 sec - exiting 20:48:58 (8516): No heartbeat from core client for 30 sec - exiting 20:48:59 (8516): No heartbeat from core client for 30 sec - exiting 20:49:00 (8516): No heartbeat from core client for 30 sec - exiting 20:49:01 (8516): No heartbeat from core client for 30 sec - exiting 20:49:02 (8516): No heartbeat from core client for 30 sec - exiting 20:49:03 (8516): No heartbeat from core client for 30 sec - exiting 20:49:04 (8516): No heartbeat from core client for 30 sec - exiting 20:49:05 (8516): No heartbeat from core client for 30 sec - exiting 20:49:06 (8516): No heartbeat from core client for 30 sec - exiting 20:49:07 (8516): No heartbeat from core client for 30 sec - exiting 20:49:08 (8516): No heartbeat from core client for 30 sec - exiting 20:49:09 (8516): No heartbeat from core client for 30 sec - exiting 20:49:10 (8516): No heartbeat from core client for 30 sec - exiting 20:49:11 (8516): No heartbeat from core client for 30 sec - exiting 20:49:12 (8516): No heartbeat from core client for 30 sec - exiting 20:49:13 (8516): No heartbeat from core client for 30 sec - exiting 20:49:14 (8516): No heartbeat from core client for 30 sec - exiting 20:49:15 (8516): No heartbeat from core client for 30 sec - exiting 20:49:16 (8516): No heartbeat from core client for 30 sec - exiting 20:49:17 (8516): No heartbeat from core client for 30 sec - exiting 20:49:18 (8516): No heartbeat from core client for 30 sec - exiting 20:49:19 (8516): No heartbeat from core client for 30 sec - exiting 20:49:20 (8516): No heartbeat from core client for 30 sec - exiting 20:49:21 (8516): No heartbeat from core client for 30 sec - exiting 20:49:22 (8516): No heartbeat from core client for 30 sec - exiting 20:49:23 (8516): No heartbeat from core client for 30 sec - exiting 20:49:24 (8516): No heartbeat from core client for 30 sec - exiting 20:49:25 (8516): No heartbeat from core client for 30 sec - exiting 20:49:26 (8516): No heartbeat from core client for 30 sec - exiting 20:49:28 (8516): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=8084, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4836, selfPID=3744, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1652, selfPID=3608, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... 15:16:43 (6108): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:16:44 (6108): No heartbeat from core client for 30 sec - exiting 15:16:45 (6108): No heartbeat from core client for 30 sec - exiting Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1444, selfPID=9444, iMonCtr=1 Model crash detected, will try to restart... GController:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4540, selfPID=6452, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3820, selfPID=2920, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5872, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5964, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2964, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... GController:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6864, selfPID=6944, iMonCtr=1 Model crash detected, will try to restart... 14:46:13 (6584): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:46:14 (6584): No heartbeat from core client for 30 sec - exiting Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=9248, iMonCtr=2 Model crash detected, will try to restart... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1072, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6476, selfPID=7308, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Suspended CPDN Monitor - Suspend request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7028, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6564, selfPID=5308, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... 20:30:03 (6548): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4780, selfPID=4780, iMonCtr=2 20:52:19 (6668): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:52:21 (6668): No heartbeat from core client for 30 sec - exiting Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=9452, selfPID=6872, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... 18:05:34 (5088): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7868, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... GController:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5280, selfPID=4996, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5688, selfPID=3816, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... 18:37:34 (6912): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=9064, iMonCtr=2 Model crash detected, will try to restart... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5636, iMonCtr=2 20:20:22 (6368): No heartbeat from core client for 30 sec - exiting 20:20:24 (6368): No heartbeat from core client for 30 sec - exiting 20:20:25 (6368): No heartbeat from core client for 30 sec - exiting 20:20:26 (6368): No heartbeat from core client for 30 sec - exiting 20:20:27 (6368): No heartbeat from core client for 30 sec - exiting 20:20:28 (6368): No heartbeat from core client for 30 sec - exiting 20:20:29 (6368): No heartbeat from core client for 30 sec - exiting 20:20:30 (6368): No heartbeat from core client for 30 sec - exiting 20:20:31 (6368): No heartbeat from core client for 30 sec - exiting 20:20:32 (6368): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4912, iMonCtr=2 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2260, selfPID=3208, iMonCtr=1 Model crash detected, will try to restart... 15:05:16 (5468): No heartbeat from core client for 30 sec - exiting 15:05:17 (5468): No heartbeat from core client for 30 sec - exiting 15:05:18 (5468): No heartbeat from core client for 30 sec - exiting 15:05:19 (5468): No heartbeat from core client for 30 sec - exiting 15:05:20 (5468): No heartbeat from core client for 30 sec - exiting 15:05:21 (5468): No heartbeat from core client for 30 sec - exiting 15:05:22 (5468): No heartbeat from core client for 30 sec - exiting 15:05:23 (5468): No heartbeat from core client for 30 sec - exiting 15:05:24 (5468): No heartbeat from core client for 30 sec - exiting 15:05:25 (5468): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:08:02 (7472): No heartbeat from core client for 30 sec - exiting 15:08:03 (7472): No heartbeat from core client for 30 sec - exiting 15:08:04 (7472): No heartbeat from core client for 30 sec - exiting 15:08:05 (7472): No heartbeat from core client for 30 sec - exiting 15:08:06 (7472): No heartbeat from core client for 30 sec - exiting 15:08:07 (7472): No heartbeat from core client for 30 sec - exiting 15:08:08 (7472): No heartbeat from core client for 30 sec - exiting 15:08:09 (7472): No heartbeat from core client for 30 sec - exiting 15:08:10 (7472): No heartbeat from core client for 30 sec - exiting 15:08:11 (7472): No heartbeat from core client for 30 sec - exiting 15:08:12 (7472): No heartbeat from core client for 30 sec - exiting 15:08:13 (7472): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:08:14 (7472): No heartbeat from core client for 30 sec - exiting Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5468, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6628, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5452, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... GController:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4000, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2312, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... 22:19:40 (5688): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:19:41 (5688): No heartbeat from core client for 30 sec - exiting Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=8428, iMonCtr=2 Model crash detected, will try to restart... 17:36:27 (7464): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:36:29 (7464): No heartbeat from core client for 30 sec - exiting 17:36:30 (7464): No heartbeat from core client for 30 sec - exiting 17:36:31 (7464): No heartbeat from core client for 30 sec - exiting 17:36:32 (7464): No heartbeat from core client for 30 sec - exiting 17:36:33 (7464): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=9180, selfPID=9180, iMonCtr=2 17:58:12 (6384): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:00:21 (6440): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3268, selfPID=3268, iMonCtr=2 19:00:22 (6440): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CGlobal Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6932, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=7132, selfPID=7892, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=868, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1368, selfPID=9160, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=8044, iMonCtr=2 Model crash detected, will try to restart... 11:25:25 (7368): No heartbeat from core client for 30 sec - exiting 11:25:27 (7368): No heartbeat from core client for 30 sec - exiting 11:25:28 (7368): No heartbeat from core client for 30 sec - exiting 11:25:29 (7368): No heartbeat from core client for 30 sec - exiting 11:25:30 (7368): No heartbeat from core client for 30 sec - exiting 11:25:31 (7368): No heartbeat from core client for 30 sec - exiting 11:25:32 (7368): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3236, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5740, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=7556, selfPID=4336, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1708, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Leaving CPDN_Main::Monitor... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
11 Feb 2014 09:01:01	1255851	16118395	hadam3p_eu_izln_2001_1_008491328_0	138,345	525,700	3.7999
10 Feb 2014 20:53:46	1255851	16118395	hadam3p_eu_izln_2001_1_008491328_0	138,336	525,145	3.7962
06 Feb 2014 17:52:04	1255851	16118395	hadam3p_eu_izln_2001_1_008491328_0	126,816	483,154	3.8099
30 Jan 2014 16:42:23	1255851	16118395	hadam3p_eu_izln_2001_1_008491328_0	115,296	441,033	3.8252
16 Jan 2014 19:43:40	1255851	16118395	hadam3p_eu_izln_2001_1_008491328_0	103,815	397,782	3.8316
16 Jan 2014 18:18:03	1255851	16118395	hadam3p_eu_izln_2001_1_008491328_0	103,793	397,139	3.8263
16 Jan 2014 17:42:34	1255851	16118395	hadam3p_eu_izln_2001_1_008491328_0	103,776	396,527	3.8210
12 Jan 2014 13:39:39	1255851	16118395	hadam3p_eu_izln_2001_1_008491328_0	92,256	352,694	3.8230
07 Jan 2014 17:50:32	1255851	16118395	hadam3p_eu_izln_2001_1_008491328_0	80,736	308,670	3.8232
03 Jan 2014 18:10:26	1255851	16118395	hadam3p_eu_izln_2001_1_008491328_0	69,231	265,471	3.8346
03 Jan 2014 17:09:45	1255851	16118395	hadam3p_eu_izln_2001_1_008491328_0	69,216	264,881	3.8269
28 Dec 2013 22:25:23	1255851	16118395	hadam3p_eu_izln_2001_1_008491328_0	57,696	222,333	3.8535
19 Dec 2013 20:09:52	1255851	16118395	hadam3p_eu_izln_2001_1_008491328_0	46,176	177,846	3.8515
15 Dec 2013 17:49:10	1255851	16118395	hadam3p_eu_izln_2001_1_008491328_0	34,656	133,461	3.8510
10 Dec 2013 16:35:16	1255851	16118395	hadam3p_eu_izln_2001_1_008491328_0	23,136	89,338	3.8614
07 Dec 2013 17:16:38	1255851	16118395	hadam3p_eu_izln_2001_1_008491328_0	11,616	45,847	3.9469