Task 14848280

Name	hadcm3n_zmec_1880_40_008026488_1
Workunit	8181602
Created	29 Jun 2012, 17:23:31 UTC
Sent	29 Jun 2012, 17:23:36 UTC
Report deadline	29 Sep 2012, 0:50:47 UTC
Received	6 Nov 2012, 19:57:53 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	1143449
Run time	22 days 11 hours 53 min 36 sec
CPU time	20 days 23 hours 4 min 17 sec
Validate state	Invalid
Credit	12,130.56
Device peak FLOPS	2.58 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>7.0.28</core_client_version> <![CDATA[ <message> The device does not recognize the command. (0x16) - exit code 22 (0x16) </message> <stderr_txt> c - exiting 18:55:23 (1248): No heartbeat from core client for 30 sec - exiting 18:55:24 (1248): No heartbeat from core client for 30 sec - exiting 18:55:25 (1248): No heartbeat from core client for 30 sec - exiting 18:55:26 (1248): No heartbeat from core client for 30 sec - exiting 18:55:27 (1248): No heartbeat from core client for 30 sec - exiting 18:55:28 (1248): No heartbeat from core client for 30 sec - exiting 18:55:29 (1248): No heartbeat from core client for 30 sec - exiting 18:55:30 (1248): No heartbeat from core client for 30 sec - exiting 18:55:31 (1248): No heartbeat from core client for 30 sec - exiting 18:55:32 (1248): No heartbeat from core client for 30 sec - exiting 18:55:33 (1248): No heartbeat from core client for 30 sec - exiting 18:55:34 (1248): No heartbeat from core client for 30 sec - exiting 18:55:35 (1248): No heartbeat from core client for 30 sec - exiting 18:55:36 (1248): No heartbeat from core client for 30 sec - exiting 18:55:37 (1248): No heartbeat from core client for 30 sec - exiting 18:55:38 (1248): No heartbeat from core client for 30 sec - exiting 18:55:39 (1248): No heartbeat from core client for 30 sec - exiting 18:55:40 (1248): No heartbeat from core client for 30 sec - exiting 18:55:41 (1248): No heartbeat from core client for 30 sec - exiting 18:55:42 (1248): No heartbeat from core client for 30 sec - exiting 18:55:43 (1248): No heartbeat from core client for 30 sec - exiting 18:55:44 (1248): No heartbeat from core client for 30 sec - exiting 18:55:45 (1248): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 10:52:30 (5632): No heartbeat from core client for 30 sec - exiting 10:52:31 (5632): No heartbeat from core client for 30 sec - exiting 10:52:32 (5632): No heartbeat from core client for 30 sec - exiting 10:52:33 (5632): No heartbeat from core client for 30 sec - exiting 10:52:34 (5632): No heartbeat from core client for 30 sec - exiting 10:52:35 (5632): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:52:36 (5632): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5976, iMonCtr=1 Model crash detected, will try to restart... 14:38:56 (5616): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 19:31:52 (5612): No heartbeat from core client for 30 sec - exiting 19:31:53 (5612): No heartbeat from core client for 30 sec - exiting 19:31:54 (5612): No heartbeat from core client for 30 sec - exiting 19:31:55 (5612): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 19:57:39 (6096): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4460, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6240, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6240, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6240, iMonCtr=1 Model crash detected, will try to restart... 20:43:39 (5984): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:43:40 (5984): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3344, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5816, iMonCtr=1 Model crash detected, will try to restart... 15:21:05 (5992): No heartbeat from core client for 30 sec - exiting 15:21:06 (5992): No heartbeat from core client for 30 sec - exiting 15:21:07 (5992): No heartbeat from core client for 30 sec - exiting 15:21:08 (5992): No heartbeat from core client for 30 sec - exiting 15:21:09 (5992): No heartbeat from core client for 30 sec - exiting 15:21:10 (5992): No heartbeat from core client for 30 sec - exiting 15:21:11 (5992): No heartbeat from core client for 30 sec - exiting 15:21:12 (5992): No heartbeat from core client for 30 sec - exiting 15:21:13 (5992): No heartbeat from core client for 30 sec - exiting 15:21:14 (5992): No heartbeat from core client for 30 sec - exiting 15:21:15 (5992): No heartbeat from core client for 30 sec - exiting 15:21:16 (5992): No heartbeat from core client for 30 sec - exiting 15:21:17 (5992): No heartbeat from core client for 30 sec - exiting 15:21:18 (5992): No heartbeat from core client for 30 sec - exiting 15:21:19 (5992): No heartbeat from core client for 30 sec - exiting 15:21:20 (5992): No heartbeat from core client for 30 sec - exiting 15:21:21 (5992): No heartbeat from core client for 30 sec - exiting 15:21:22 (5992): No heartbeat from core client for 30 sec - exiting 15:21:23 (5992): No heartbeat from core client for 30 sec - exiting 15:21:24 (5992): No heartbeat from core client for 30 sec - exiting 15:21:25 (5992): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3972, iMonCtr=1 Model crash detected, will try to restart... 17:14:06 (5380): No heartbeat from core client for 30 sec - exiting 17:14:07 (5380): No heartbeat from core client for 30 sec - exiting 17:14:08 (5380): No heartbeat from core client for 30 sec - exiting 17:14:09 (5380): No heartbeat from core client for 30 sec - exiting 17:14:10 (5380): No heartbeat from core client for 30 sec - exiting 17:14:11 (5380): No heartbeat from core client for 30 sec - exiting 17:14:12 (5380): No heartbeat from core client for 30 sec - exiting 17:14:13 (5380): No heartbeat from core client for 30 sec - exiting 17:14:14 (5380): No heartbeat from core client for 30 sec - exiting 17:14:15 (5380): No heartbeat from core client for 30 sec - exiting 17:14:16 (5380): No heartbeat from core client for 30 sec - exiting 17:14:17 (5380): No heartbeat from core client for 30 sec - exiting 17:14:18 (5380): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3892, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 12:11:50 (1632): No heartbeat from core client for 30 sec - exiting 12:11:51 (1632): No heartbeat from core client for 30 sec - exiting 12:11:52 (1632): No heartbeat from core client for 30 sec - exiting 12:11:53 (1632): No heartbeat from core client for 30 sec - exiting 12:11:54 (1632): No heartbeat from core client for 30 sec - exiting 12:11:55 (1632): No heartbeat from core client for 30 sec - exiting 12:11:56 (1632): No heartbeat from core client for 30 sec - exiting 12:11:57 (1632): No heartbeat from core client for 30 sec - exiting 12:11:58 (1632): No heartbeat from core client for 30 sec - exiting 12:11:59 (1632): No heartbeat from core client for 30 sec - exiting 12:12:00 (1632): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6552, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 10:31:35 (2692): No heartbeat from core client for 30 sec - exiting 10:31:37 (2692): No heartbeat from core client for 30 sec - exiting 10:31:38 (2692): No heartbeat from core client for 30 sec - exiting 10:31:39 (2692): No heartbeat from core client for 30 sec - exiting 10:31:40 (2692): No heartbeat from core client for 30 sec - exiting 10:31:41 (2692): No heartbeat from core client for 30 sec - exiting 10:31:42 (2692): No heartbeat from core client for 30 sec - exiting 10:31:43 (2692): No heartbeat from core client for 30 sec - exiting 10:31:44 (2692): No heartbeat from core client for 30 sec - exiting 10:31:45 (2692): No heartbeat from core client for 30 sec - exiting 10:31:46 (2692): No heartbeat from core client for 30 sec - exiting 10:31:47 (2692): No heartbeat from core client for 30 sec - exiting 10:31:48 (2692): No heartbeat from core client for 30 sec - exiting 10:31:49 (2692): No heartbeat from core client for 30 sec - exiting 10:31:50 (2692): No heartbeat from core client for 30 sec - exiting 10:31:51 (2692): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5952, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 11:51:57 (6116): No heartbeat from core client for 30 sec - exiting 11:51:58 (6116): No heartbeat from core client for 30 sec - exiting 11:51:59 (6116): No heartbeat from core client for 30 sec - exiting 11:52:00 (6116): No heartbeat from core client for 30 sec - exiting 11:52:01 (6116): No heartbeat from core client for 30 sec - exiting 11:52:02 (6116): No heartbeat from core client for 30 sec - exiting 11:52:03 (6116): No heartbeat from core client for 30 sec - exiting 11:52:04 (6116): No heartbeat from core client for 30 sec - exiting 11:52:05 (6116): No heartbeat from core client for 30 sec - exiting 11:52:06 (6116): No heartbeat from core client for 30 sec - exiting 11:52:07 (6116): No heartbeat from core client for 30 sec - exiting 11:52:08 (6116): No heartbeat from core client for 30 sec - exiting 11:52:09 (6116): No heartbeat from core client for 30 sec - exiting 11:52:10 (6116): No heartbeat from core client for 30 sec - exiting 11:52:11 (6116): No heartbeat from core client for 30 sec - exiting 11:52:12 (6116): No heartbeat from core client for 30 sec - exiting 11:52:13 (6116): No heartbeat from core client for 30 sec - exiting 11:52:14 (6116): No heartbeat from core client for 30 sec - exiting 11:52:15 (6116): No heartbeat from core client for 30 sec - exiting 11:52:16 (6116): No heartbeat from core client for 30 sec - exiting 11:52:17 (6116): No heartbeat from core client for 30 sec - exiting 11:52:18 (6116): No heartbeat from core client for 30 sec - exiting 11:52:19 (6116): No heartbeat from core client for 30 sec - exiting 11:52:20 (6116): No heartbeat from core client for 30 sec - exiting 11:52:21 (6116): No heartbeat from core client for 30 sec - exiting 11:52:22 (6116): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6748, iMonCtr=1 Model crash detected, will try to restart... 22:05:30 (5416): No heartbeat from core client for 30 sec - exiting 22:05:31 (5416): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 15:08:18 (4704): No heartbeat from core client for 30 sec - exiting 15:08:19 (4704): No heartbeat from core client for 30 sec - exiting 15:08:20 (4704): No heartbeat from core client for 30 sec - exiting 15:08:21 (4704): No heartbeat from core client for 30 sec - exiting 15:08:22 (4704): No heartbeat from core client for 30 sec - exiting 15:08:23 (4704): No heartbeat from core client for 30 sec - exiting 15:08:24 (4704): No heartbeat from core client for 30 sec - exiting 15:08:25 (4704): No heartbeat from core client for 30 sec - exiting 15:08:26 (4704): No heartbeat from core client for 30 sec - exiting 15:08:27 (4704): No heartbeat from core client for 30 sec - exiting 15:08:28 (4704): No heartbeat from core client for 30 sec - exiting 15:08:29 (4704): No heartbeat from core client for 30 sec - exiting 15:08:30 (4704): No heartbeat from core client for 30 sec - exiting 15:08:31 (4704): No heartbeat from core client for 30 sec - exiting 15:08:32 (4704): No heartbeat from core client for 30 sec - exiting 15:08:33 (4704): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3840, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5684, iMonCtr=1 Model crash detected, will try to restart... 19:56:57 (3688): No heartbeat from core client for 30 sec - exiting 19:56:58 (3688): No heartbeat from core client for 30 sec - exiting 19:56:59 (3688): No heartbeat from core client for 30 sec - exiting 19:57:00 (3688): No heartbeat from core client for 30 sec - exiting 19:57:01 (3688): No heartbeat from core client for 30 sec - exiting 19:57:02 (3688): No heartbeat from core client for 30 sec - exiting 19:57:03 (3688): No heartbeat from core client for 30 sec - exiting 19:57:04 (3688): No heartbeat from core client for 30 sec - exiting 19:57:05 (3688): No heartbeat from core client for 30 sec - exiting 19:57:06 (3688): No heartbeat from core client for 30 sec - exiting 19:57:07 (3688): No heartbeat from core client for 30 sec - exiting 19:57:08 (3688): No heartbeat from core client for 30 sec - exiting 19:57:09 (3688): No heartbeat from core client for 30 sec - exiting 19:57:10 (3688): No heartbeat from core client for 30 sec - exiting 19:57:11 (3688): No heartbeat from core client for 30 sec - exiting 19:57:12 (3688): No heartbeat from core client for 30 sec - exiting 19:57:13 (3688): No heartbeat from core client for 30 sec - exiting 19:57:14 (3688): No heartbeat from core client for 30 sec - exiting 19:57:15 (3688): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 11:52:10 (4488): No heartbeat from core client for 30 sec - exiting 11:52:11 (4488): No heartbeat from core client for 30 sec - exiting 11:52:12 (4488): No heartbeat from core client for 30 sec - exiting 11:52:13 (4488): No heartbeat from core client for 30 sec - exiting 11:52:14 (4488): No heartbeat from core client for 30 sec - exiting 11:52:15 (4488): No heartbeat from core client for 30 sec - exiting 11:52:16 (4488): No heartbeat from core client for 30 sec - exiting 11:52:17 (4488): No heartbeat from core client for 30 sec - exiting 11:52:18 (4488): No heartbeat from core client for 30 sec - exiting 11:52:19 (4488): No heartbeat from core client for 30 sec - exiting 11:52:20 (4488): No heartbeat from core client for 30 sec - exiting 11:52:21 (4488): No heartbeat from core client for 30 sec - exiting 11:52:22 (4488): No heartbeat from core client for 30 sec - exiting 11:52:23 (4488): No heartbeat from core client for 30 sec - exiting 11:52:24 (4488): No heartbeat from core client for 30 sec - exiting 11:52:25 (4488): No heartbeat from core client for 30 sec - exiting 11:52:26 (4488): No heartbeat from core client for 30 sec - exiting 11:52:27 (4488): No heartbeat from core client for 30 sec - exiting 11:52:28 (4488): No heartbeat from core client for 30 sec - exiting 11:52:29 (4488): No heartbeat from core client for 30 sec - exiting 11:52:30 (4488): No heartbeat from core client for 30 sec - exiting 11:52:31 (4488): No heartbeat from core client for 30 sec - exiting 11:52:32 (4488): No heartbeat from core client for 30 sec - exiting 11:52:33 (4488): No heartbeat from core client for 30 sec - exiting 11:52:34 (4488): No heartbeat from core client for 30 sec - exiting 11:52:35 (4488): No heartbeat from core client for 30 sec - exiting 11:52:36 (4488): No heartbeat from core client for 30 sec - exiting 11:52:37 (4488): No heartbeat from core client for 30 sec - exiting 11:52:38 (4488): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 12:25:26 (5360): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6784, iMonCtr=1 Model crash detected, will try to restart... 12:09:06 (6148): No heartbeat from core client for 30 sec - exiting 12:09:07 (6148): No heartbeat from core client for 30 sec - exiting 12:09:08 (6148): No heartbeat from core client for 30 sec - exiting 12:09:09 (6148): No heartbeat from core client for 30 sec - exiting 12:09:10 (6148): No heartbeat from core client for 30 sec - exiting 12:09:11 (6148): No heartbeat from core client for 30 sec - exiting 12:09:12 (6148): No heartbeat from core client for 30 sec - exiting 12:09:13 (6148): No heartbeat from core client for 30 sec - exiting 12:09:14 (6148): No heartbeat from core client for 30 sec - exiting 12:09:15 (6148): No heartbeat from core client for 30 sec - exiting 12:09:16 (6148): No heartbeat from core client for 30 sec - exiting 12:09:17 (6148): No heartbeat from core client for 30 sec - exiting 12:09:18 (6148): No heartbeat from core client for 30 sec - exiting 12:09:19 (6148): No heartbeat from core client for 30 sec - exiting 12:09:20 (6148): No heartbeat from core client for 30 sec - exiting 12:09:21 (6148): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6988, iMonCtr=1 Model crash detected, will try to restart... 15:17:35 (5804): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6676, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... 11:38:16 (5532): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7716, iMonCtr=1 Model crash detected, will try to restart... 20:22:28 (5224): No heartbeat from core client for 30 sec - exiting 20:22:29 (5224): No heartbeat from core client for 30 sec - exiting 20:22:30 (5224): No heartbeat from core client for 30 sec - exiting 20:22:31 (5224): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:22:32 (5224): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 17:05:10 (4324): No heartbeat from core client for 30 sec - exiting 17:05:11 (4324): No heartbeat from core client for 30 sec - exiting 17:05:12 (4324): No heartbeat from core client for 30 sec - exiting 17:05:13 (4324): No heartbeat from core client for 30 sec - exiting 17:05:14 (4324): No heartbeat from core client for 30 sec - exiting 17:05:15 (4324): No heartbeat from core client for 30 sec - exiting 17:05:16 (4324): No heartbeat from core client for 30 sec - exiting 17:05:17 (4324): No heartbeat from core client for 30 sec - exiting 17:05:18 (4324): No heartbeat from core client for 30 sec - exiting 17:05:19 (4324): No heartbeat from core client for 30 sec - exiting 17:05:20 (4324): No heartbeat from core client for 30 sec - exiting 17:05:21 (4324): No heartbeat from core client for 30 sec - exiting 17:05:22 (4324): No heartbeat from core client for 30 sec - exiting 17:05:23 (4324): No heartbeat from core client for 30 sec - exiting 17:05:24 (4324): No heartbeat from core client for 30 sec - exiting 17:05:25 (4324): No heartbeat from core client for 30 sec - exiting 17:05:26 (4324): No heartbeat from core client for 30 sec - exiting 17:05:27 (4324): No heartbeat from core client for 30 sec - exiting 17:05:28 (4324): No heartbeat from core client for 30 sec - exiting 17:05:29 (4324): No heartbeat from core client for 30 sec - exiting 17:05:30 (4324): No heartbeat from core client for 30 sec - exiting 17:05:31 (4324): No heartbeat from core client for 30 sec - exiting 17:05:32 (4324): No heartbeat from core client for 30 sec - exiting 17:05:33 (4324): No heartbeat from core client for 30 sec - exiting 17:05:34 (4324): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7324, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... 16:45:07 (5356): No heartbeat from core client for 30 sec - exiting 16:45:08 (5356): No heartbeat from core client for 30 sec - exiting 16:45:09 (5356): No heartbeat from core client for 30 sec - exiting 16:45:10 (5356): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4716, iMonCtr=1 Model crash detected, will try to restart... 20:42:37 (5708): No heartbeat from core client for 30 sec - exiting 20:42:39 (5708): No heartbeat from core client for 30 sec - exiting 20:42:40 (5708): No heartbeat from core client for 30 sec - exiting 20:42:41 (5708): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1312, iMonCtr=1 Model crash detected, will try to restart... 22:01:53 (652): No heartbeat from core client for 30 sec - exiting 22:01:54 (652): No heartbeat from core client for 30 sec - exiting 22:01:55 (652): No heartbeat from core client for 30 sec - exiting 22:01:56 (652): No heartbeat from core client for 30 sec - exiting 22:01:57 (652): No heartbeat from core client for 30 sec - exiting 22:01:59 (652): No heartbeat from core client for 30 sec - exiting 22:02:00 (652): No heartbeat from core client for 30 sec - exiting 22:02:01 (652): No heartbeat from core client for 30 sec - exiting 22:02:02 (652): No heartbeat from core client for 30 sec - exiting 22:02:03 (652): No heartbeat from core client for 30 sec - exiting 22:02:04 (652): No heartbeat from core client for 30 sec - exiting 22:02:05 (652): No heartbeat from core client for 30 sec - exiting 22:02:06 (652): No heartbeat from core client for 30 sec - exiting 22:02:07 (652): No heartbeat from core client for 30 sec - exiting 22:02:08 (652): No heartbeat from core client for 30 sec - exiting 22:02:10 (652): No heartbeat from core client for 30 sec - exiting 22:02:11 (652): No heartbeat from core client for 30 sec - exiting 22:02:12 (652): No heartbeat from core client for 30 sec - exiting 22:02:13 (652): No heartbeat from core client for 30 sec - exiting 22:02:14 (652): No heartbeat from core client for 30 sec - exiting 22:02:15 (652): No heartbeat from core client for 30 sec - exiting 22:02:16 (652): No heartbeat from core client for 30 sec - exiting 22:02:17 (652): No heartbeat from core client for 30 sec - exiting 22:02:18 (652): No heartbeat from core client for 30 sec - exiting 22:02:19 (652): No heartbeat from core client for 30 sec - exiting 22:02:20 (652): No heartbeat from core client for 30 sec - exiting 22:02:21 (652): No heartbeat from core client for 30 sec - exiting 22:02:22 (652): No heartbeat from core client for 30 sec - exiting 22:02:23 (652): No heartbeat from core client for 30 sec - exiting 22:02:24 (652): No heartbeat from core client for 30 sec - exiting 22:02:25 (652): No heartbeat from core client for 30 sec - exiting 22:02:26 (652): No heartbeat from core client for 30 sec - exiting 22:02:27 (652): No heartbeat from core client for 30 sec - exiting 22:02:28 (652): No heartbeat from core client for 30 sec - exiting 22:02:29 (652): No heartbeat from core client for 30 sec - exiting 22:02:30 (652): No heartbeat from core client for 30 sec - exiting 22:02:31 (652): No heartbeat from core client for 30 sec - exiting 22:02:32 (652): No heartbeat from core client for 30 sec - exiting 22:02:33 (652): No heartbeat from core client for 30 sec - exiting 22:02:34 (652): No heartbeat from core client for 30 sec - exiting 22:02:35 (652): No heartbeat from core client for 30 sec - exiting 22:02:36 (652): No heartbeat from core client for 30 sec - exiting 22:02:37 (652): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5312, iMonCtr=1 Model crash detected, will try to restart... 21:07:06 (3612): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:07:07 (3612): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6108, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7024, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7024, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1700, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 19:37:08 (5556): No heartbeat from core client for 30 sec - exiting 19:37:09 (5556): No heartbeat from core client for 30 sec - exiting 19:37:10 (5556): No heartbeat from core client for 30 sec - exiting 19:37:11 (5556): No heartbeat from core client for 30 sec - exiting 19:37:12 (5556): No heartbeat from core client for 30 sec - exiting 19:37:13 (5556): No heartbeat from core client for 30 sec - exiting 19:37:14 (5556): No heartbeat from core client for 30 sec - exiting 19:37:15 (5556): No heartbeat from core client for 30 sec - exiting 19:37:16 (5556): No heartbeat from core client for 30 sec - exiting 19:37:17 (5556): No heartbeat from core client for 30 sec - exiting 19:37:18 (5556): No heartbeat from core client for 30 sec - exiting 19:37:19 (5556): No heartbeat from core client for 30 sec - exiting 19:37:20 (5556): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 17:38:57 (5408): No heartbeat from core client for 30 sec - exiting 17:38:58 (5408): No heartbeat from core client for 30 sec - exiting 17:38:59 (5408): No heartbeat from core client for 30 sec - exiting 17:39:00 (5408): No heartbeat from core client for 30 sec - exiting 17:39:01 (5408): No heartbeat from core client for 30 sec - exiting 17:39:02 (5408): No heartbeat from core client for 30 sec - exiting 17:39:03 (5408): No heartbeat from core client for 30 sec - exiting 17:39:04 (5408): No heartbeat from core client for 30 sec - exiting 17:39:05 (5408): No heartbeat from core client for 30 sec - exiting 17:39:06 (5408): No heartbeat from core client for 30 sec - exiting 17:39:07 (5408): No heartbeat from core client for 30 sec - exiting 17:39:08 (5408): No heartbeat from core client for 30 sec - exiting 17:39:09 (5408): No heartbeat from core client for 30 sec - exiting 17:39:10 (5408): No heartbeat from core client for 30 sec - exiting 17:39:11 (5408): No heartbeat from core client for 30 sec - exiting 17:39:12 (5408): No heartbeat from core client for 30 sec - exiting 17:39:13 (5408): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 11:26:59 (2424): No heartbeat from core client for 30 sec - exiting 11:27:00 (2424): No heartbeat from core client for 30 sec - exiting 11:27:01 (2424): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6952, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6952, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6080, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 12:12:33 (5060): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4756, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5268, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5504, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7504, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7504, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7504, iMonCtr=1 Model crash detected, will try to restart... 11:20:45 (4460): No heartbeat from core client for 30 sec - exiting 11:20:46 (4460): No heartbeat from core client for 30 sec - exiting 11:20:47 (4460): No heartbeat from core client for 30 sec - exiting 11:20:48 (4460): No heartbeat from core client for 30 sec - exiting 11:20:49 (4460): No heartbeat from core client for 30 sec - exiting 11:20:50 (4460): No heartbeat from core client for 30 sec - exiting 11:20:51 (4460): No heartbeat from core client for 30 sec - exiting 11:20:52 (4460): No heartbeat from core client for 30 sec - exiting 11:20:53 (4460): No heartbeat from core client for 30 sec - exiting 11:20:54 (4460): No heartbeat from core client for 30 sec - exiting 11:20:55 (4460): No heartbeat from core client for 30 sec - exiting 11:20:56 (4460): No heartbeat from core client for 30 sec - exiting 11:20:57 (4460): No heartbeat from core client for 30 sec - exiting 11:20:58 (4460): No heartbeat from core client for 30 sec - exiting 11:20:59 (4460): No heartbeat from core client for 30 sec - exiting 11:21:00 (4460): No heartbeat from core client for 30 sec - exiting 11:21:01 (4460): No heartbeat from core client for 30 sec - exiting 11:21:02 (4460): No heartbeat from core client for 30 sec - exiting 11:21:03 (4460): No heartbeat from core client for 30 sec - exiting 11:21:04 (4460): No heartbeat from core client for 30 sec - exiting 11:21:05 (4460): No heartbeat from core client for 30 sec - exiting 11:21:06 (4460): No heartbeat from core client for 30 sec - exiting 11:21:07 (4460): No heartbeat from core client for 30 sec - exiting 11:21:09 (4460): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6792, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3880, iMonCtr=1 Model crash detected, will try to restart... 16:38:43 (4892): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4496, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5792, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6296, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3512, iMonCtr=1 Model crash detected, will try to restart... 11:12:18 (5336): No heartbeat from core client for 30 sec - exiting 11:12:20 (5336): No heartbeat from core client for 30 sec - exiting 11:12:21 (5336): No heartbeat from core client for 30 sec - exiting 11:12:22 (5336): No heartbeat from core client for 30 sec - exiting 11:12:23 (5336): No heartbeat from core client for 30 sec - exiting 11:12:24 (5336): No heartbeat from core client for 30 sec - exiting 11:12:25 (5336): No heartbeat from core client for 30 sec - exiting 11:12:26 (5336): No heartbeat from core client for 30 sec - exiting 11:12:27 (5336): No heartbeat from core client for 30 sec - exiting 11:12:28 (5336): No heartbeat from core client for 30 sec - exiting 11:12:29 (5336): No heartbeat from core client for 30 sec - exiting 11:12:30 (5336): No heartbeat from core client for 30 sec - exiting 11:12:31 (5336): No heartbeat from core client for 30 sec - exiting 11:12:32 (5336): No heartbeat from core client for 30 sec - exiting 11:12:33 (5336): No heartbeat from core client for 30 sec - exiting 11:12:34 (5336): No heartbeat from core client for 30 sec - exiting 11:12:35 (5336): No heartbeat from core client for 30 sec - exiting 11:12:36 (5336): No heartbeat from core client for 30 sec - exiting 11:12:37 (5336): No heartbeat from core client for 30 sec - exiting 11:12:38 (5336): No heartbeat from core client for 30 sec - exiting 11:12:39 (5336): No heartbeat from core client for 30 sec - exiting 11:12:40 (5336): No heartbeat from core client for 30 sec - exiting 11:12:41 (5336): No heartbeat from core client for 30 sec - exiting 11:12:42 (5336): No heartbeat from core client for 30 sec - exiting 11:12:43 (5336): No heartbeat from core client for 30 sec - exiting 11:12:44 (5336): No heartbeat from core client for 30 sec - exiting 11:12:45 (5336): No heartbeat from core client for 30 sec - exiting 11:12:46 (5336): No heartbeat from core client for 30 sec - exiting 11:12:47 (5336): No heartbeat from core client for 30 sec - exiting 11:12:48 (5336): No heartbeat from core client for 30 sec - exiting 11:12:49 (5336): No heartbeat from core client for 30 sec - exiting 11:12:50 (5336): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:12:51 (5336): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3212, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5736, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4108, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4160, iMonCtr=1 Model crash detected, will try to restart... 17:24:45 (6516): No heartbeat from core client for 30 sec - exiting 17:24:46 (6516): No heartbeat from core client for 30 sec - exiting 17:24:47 (6516): No heartbeat from core client for 30 sec - exiting 17:24:48 (6516): No heartbeat from core client for 30 sec - exiting 17:24:49 (6516): No heartbeat from core client for 30 sec - exiting 17:24:50 (6516): No heartbeat from core client for 30 sec - exiting 17:24:51 (6516): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6080, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6504, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 20:26:13 (4692): No heartbeat from core client for 30 sec - exiting 20:26:14 (4692): No heartbeat from core client for 30 sec - exiting 20:26:15 (4692): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3140, iMonCtr=1 Model crash detected, will try to restart... 11:05:07 (5804): No heartbeat from core client for 30 sec - exiting 11:05:08 (5804): No heartbeat from core client for 30 sec - exiting 11:05:09 (5804): No heartbeat from core client for 30 sec - exiting 11:05:10 (5804): No heartbeat from core client for 30 sec - exiting 11:05:11 (5804): No heartbeat from core client for 30 sec - exiting 11:05:12 (5804): No heartbeat from core client for 30 sec - exiting 11:05:13 (5804): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Model crashed: REPLANCA: PP HEADERS ON ANCILLARY FILE DO NOT MATCH tmp/pipe_dummy 2048 Model crashed: REPLANCA: PP HEADERS ON ANCILLARY FILE DO NOT MATCH tmp/pipe_dummy 2048 Model crashed: REPLANCA: PP HEADERS ON ANCILLARY FILE DO NOT MATCH tmp/pipe_dummy 2048 Model crashed: REPLANCA: PP HEADERS ON ANCILLARY FILE DO NOT MATCH tmp/pipe_dummy 2048 Model crashed: REPLANCA: PP HEADERS ON ANCILLARY FILE DO NOT MATCH tmp/pipe_dummy 2048 Model crashed: REPLANCA: PP HEADERS ON ANCILLARY FILE DO NOT MATCH tmp/pipe_dummy 2048 Sorry, too many model crashes! :-( Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
06 Nov 2012 11:31:01	1143449	14848280	hadcm3n_zmec_1880_40_008026488_1	1,010,880	1,808,691	1.7892
04 Nov 2012 10:45:55	1143449	14848280	hadcm3n_zmec_1880_40_008026488_1	984,960	1,761,157	1.7880
02 Nov 2012 13:45:37	1143449	14848280	hadcm3n_zmec_1880_40_008026488_1	959,040	1,713,241	1.7864
29 Oct 2012 09:01:29	1143449	14848280	hadcm3n_zmec_1880_40_008026488_1	933,120	1,665,277	1.7846
28 Oct 2012 18:50:04	1143449	14848280	hadcm3n_zmec_1880_40_008026488_1	907,200	1,618,921	1.7845
28 Oct 2012 05:13:33	1143449	14848280	hadcm3n_zmec_1880_40_008026488_1	881,280	1,571,146	1.7828
27 Oct 2012 15:57:06	1143449	14848280	hadcm3n_zmec_1880_40_008026488_1	855,360	1,524,170	1.7819
26 Oct 2012 11:58:31	1143449	14848280	hadcm3n_zmec_1880_40_008026488_1	829,440	1,480,810	1.7853
25 Oct 2012 12:25:26	1143449	14848280	hadcm3n_zmec_1880_40_008026488_1	803,520	1,441,228	1.7936
19 Oct 2012 14:07:10	1143449	14848280	hadcm3n_zmec_1880_40_008026488_1	777,600	1,394,327	1.7931
14 Oct 2012 20:17:41	1143449	14848280	hadcm3n_zmec_1880_40_008026488_1	751,680	1,347,221	1.7923
10 Oct 2012 20:07:17	1143449	14848280	hadcm3n_zmec_1880_40_008026488_1	725,760	1,301,610	1.7934
08 Oct 2012 12:26:51	1143449	14848280	hadcm3n_zmec_1880_40_008026488_1	699,840	1,256,868	1.7959
05 Oct 2012 17:55:35	1143449	14848280	hadcm3n_zmec_1880_40_008026488_1	673,920	1,210,020	1.7955
03 Oct 2012 16:13:05	1143449	14848280	hadcm3n_zmec_1880_40_008026488_1	648,000	1,162,804	1.7945
03 Oct 2012 03:10:28	1143449	14848280	hadcm3n_zmec_1880_40_008026488_1	622,080	1,116,430	1.7947
30 Sep 2012 18:50:30	1143449	14848280	hadcm3n_zmec_1880_40_008026488_1	596,160	1,069,594	1.7941
26 Sep 2012 17:44:37	1143449	14848280	hadcm3n_zmec_1880_40_008026488_1	570,240	1,022,673	1.7934
23 Sep 2012 17:31:21	1143449	14848280	hadcm3n_zmec_1880_40_008026488_1	544,320	976,302	1.7936
21 Sep 2012 11:48:30	1143449	14848280	hadcm3n_zmec_1880_40_008026488_1	518,400	928,318	1.7907