Task 15988874

Name	hadcm3n_7xt3_1980_40_008455098_0
Workunit	8605954
Created	30 Aug 2013, 18:14:13 UTC
Sent	14 Sep 2013, 16:34:08 UTC
Report deadline	15 Dec 2013, 0:01:19 UTC
Received	10 Oct 2013, 13:36:44 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	1275748
Run time	9 days 20 hours 30 min 28 sec
CPU time	9 days 18 hours 20 min 1 sec
Validate state	Invalid
Credit	9,642.24
Device peak FLOPS	3.48 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>7.0.64</core_client_version> <![CDATA[ <message> El dispositivo no reconoce el comando. (0x16) - exit code 22 (0x16) </message> <stderr_txt> 20:42:54 (2196): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:17:02 (3224): No heartbeat from core client for 30 sec - exiting 12:17:03 (3224): No heartbeat from core client for 30 sec - exiting 12:17:04 (3224): No heartbeat from core client for 30 sec - exiting 12:17:05 (3224): No heartbeat from core client for 30 sec - exiting 12:17:06 (3224): No heartbeat from core client for 30 sec - exiting 12:17:07 (3224): No heartbeat from core client for 30 sec - exiting 12:17:09 (3224): No heartbeat from core client for 30 sec - exiting 12:17:10 (3224): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 16:43:37 (4364): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:43:38 (4364): No heartbeat from core client for 30 sec - exiting 16:43:40 (4364): No heartbeat from core client for 30 sec - exiting 16:43:41 (4364): No heartbeat from core client for 30 sec - exiting 16:43:42 (4364): No heartbeat from core client for 30 sec - exiting 16:43:43 (4364): No heartbeat from core client for 30 sec - exiting 16:43:44 (4364): No heartbeat from core client for 30 sec - exiting 16:43:45 (4364): No heartbeat from core client for 30 sec - exiting 16:43:46 (4364): No heartbeat from core client for 30 sec - exiting 16:43:47 (4364): No heartbeat from core client for 30 sec - exiting 16:43:48 (4364): No heartbeat from core client for 30 sec - exiting 16:45:47 (4984): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:45:48 (4984): No heartbeat from core client for 30 sec - exiting 16:45:49 (4984): No heartbeat from core client for 30 sec - exiting 16:45:50 (4984): No heartbeat from core client for 30 sec - exiting 16:45:51 (4984): No heartbeat from core client for 30 sec - exiting 16:46:47 (5356): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:46:48 (5356): No heartbeat from core client for 30 sec - exiting 16:46:49 (5356): No heartbeat from core client for 30 sec - exiting 16:47:45 (4620): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:47:46 (4620): No heartbeat from core client for 30 sec - exiting 16:47:47 (4620): No heartbeat from core client for 30 sec - exiting 16:47:48 (4620): No heartbeat from core client for 30 sec - exiting 16:47:49 (4620): No heartbeat from core client for 30 sec - exiting 16:47:51 (4620): No heartbeat from core client for 30 sec - exiting 16:48:36 (4364): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:48:37 (4364): No heartbeat from core client for 30 sec - exiting 16:49:33 (3956): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:49:34 (3956): No heartbeat from core client for 30 sec - exiting 16:49:35 (3956): No heartbeat from core client for 30 sec - exiting 16:49:36 (3956): No heartbeat from core client for 30 sec - exiting 16:49:38 (3956): No heartbeat from core client for 30 sec - exiting 16:49:39 (3956): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 10:45:14 (5528): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Atmos Hold Restart file rename failed on atmos_restart.hold CPDN Monitor - Quit request from BOINC... Atmos Hold Restart file rename failed on atmos_restart.hold Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5284, iMonCtr=1 Model crash detected, will try to restart... 09:57:19 (3972): No heartbeat from core client for 30 sec - exiting 09:57:20 (3972): No heartbeat from core client for 30 sec - exiting 09:57:22 (3972): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:00:02 (4128): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:00:07 (4128): No heartbeat from core client for 30 sec - exiting 10:00:08 (4128): No heartbeat from core client for 30 sec - exiting 10:00:09 (4128): No heartbeat from core client for 30 sec - exiting 10:00:10 (4128): No heartbeat from core client for 30 sec - exiting 10:14:08 (2720): No heartbeat from core client for 30 sec - exiting 10:14:09 (2720): No heartbeat from core client for 30 sec - exiting 10:14:10 (2720): No heartbeat from core client for 30 sec - exiting 10:14:11 (2720): No heartbeat from core client for 30 sec - exiting 10:14:12 (2720): No heartbeat from core client for 30 sec - exiting 10:14:13 (2720): No heartbeat from core client for 30 sec - exiting 10:14:14 (2720): No heartbeat from core client for 30 sec - exiting 10:14:16 (2720): No heartbeat from core client for 30 sec - exiting 10:14:17 (2720): No heartbeat from core client for 30 sec - exiting 10:14:18 (2720): No heartbeat from core client for 30 sec - exiting 10:14:19 (2720): No heartbeat from core client for 30 sec - exiting 10:14:20 (2720): No heartbeat from core client for 30 sec - exiting 10:14:21 (2720): No heartbeat from core client for 30 sec - exiting 10:14:22 (2720): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 15:03:22 (2892): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... 15:03:23 (2892): No heartbeat from core client for 30 sec - exiting 15:03:24 (2892): No heartbeat from core client for 30 sec - exiting 15:03:25 (2892): No heartbeat from core client for 30 sec - exiting 15:03:26 (2892): No heartbeat from core client for 30 sec - exiting 15:03:27 (2892): No heartbeat from core client for 30 sec - exiting 15:03:28 (2892): No heartbeat from core client for 30 sec - exiting 15:03:29 (2892): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 01:44:29 (2828): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:45:06 (5960): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 16:10:19 (4328): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:53:14 (4740): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:55:13 (5936): No heartbeat from core client for 30 sec - exiting 16:55:14 (5936): No heartbeat from core client for 30 sec - exiting 16:55:15 (5936): No heartbeat from core client for 30 sec - exiting 16:55:16 (5936): No heartbeat from core client for 30 sec - exiting 16:55:17 (5936): No heartbeat from core client for 30 sec - exiting 16:55:18 (5936): No heartbeat from core client for 30 sec - exiting 16:55:19 (5936): No heartbeat from core client for 30 sec - exiting 16:55:20 (5936): No heartbeat from core client for 30 sec - exiting 16:55:22 (5936): No heartbeat from core client for 30 sec - exiting 16:55:23 (5936): No heartbeat from core client for 30 sec - exiting 16:55:24 (5936): No heartbeat from core client for 30 sec - exiting 16:55:25 (5936): No heartbeat from core client for 30 sec - exiting 16:55:26 (5936): No heartbeat from core client for 30 sec - exiting 16:55:27 (5936): No heartbeat from core client for 30 sec - exiting 16:55:28 (5936): No heartbeat from core client for 30 sec - exiting 16:55:29 (5936): No heartbeat from core client for 30 sec - exiting 16:55:30 (5936): No heartbeat from core client for 30 sec - exiting 16:55:31 (5936): No heartbeat from core client for 30 sec - exiting 16:55:33 (5936): No heartbeat from core client for 30 sec - exiting 16:55:34 (5936): No heartbeat from core client for 30 sec - exiting 16:55:35 (5936): No heartbeat from core client for 30 sec - exiting 16:55:36 (5936): No heartbeat from core client for 30 sec - exiting 16:55:37 (5936): No heartbeat from core client for 30 sec - exiting 16:55:38 (5936): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:55:39 (5936): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 23:03:14 (6124): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:03:15 (6124): No heartbeat from core client for 30 sec - exiting 23:03:16 (6124): No heartbeat from core client for 30 sec - exiting 23:03:18 (6124): No heartbeat from core client for 30 sec - exiting 23:03:19 (6124): No heartbeat from core client for 30 sec - exiting 23:03:20 (6124): No heartbeat from core client for 30 sec - exiting 23:03:21 (6124): No heartbeat from core client for 30 sec - exiting 23:03:22 (6124): No heartbeat from core client for 30 sec - exiting 23:03:23 (6124): No heartbeat from core client for 30 sec - exiting 23:03:24 (6124): No heartbeat from core client for 30 sec - exiting 23:03:25 (6124): No heartbeat from core client for 30 sec - exiting 06:18:03 (1048): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:19:08 (4992): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Atmos Hold Restart file rename failed on atmos_restart.hold CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1572, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1572, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1572, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1572, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1572, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1572, iMonCtr=1 Model crash detected, will try to restart... Sorry, too many model crashes! :-( Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
09 Oct 2013 04:15:48	1275748	15988874	hadcm3n_7xt3_1980_40_008455098_0	803,520	828,650	1.0313
08 Oct 2013 18:50:36	1275748	15988874	hadcm3n_7xt3_1980_40_008455098_0	777,600	802,007	1.0314
08 Oct 2013 07:38:27	1275748	15988874	hadcm3n_7xt3_1980_40_008455098_0	751,680	775,162	1.0312
07 Oct 2013 16:48:03	1275748	15988874	hadcm3n_7xt3_1980_40_008455098_0	725,760	748,174	1.0309
03 Oct 2013 05:19:42	1275748	15988874	hadcm3n_7xt3_1980_40_008455098_0	699,840	721,682	1.0312
02 Oct 2013 21:45:49	1275748	15988874	hadcm3n_7xt3_1980_40_008455098_0	673,920	694,915	1.0312
02 Oct 2013 14:25:04	1275748	15988874	hadcm3n_7xt3_1980_40_008455098_0	648,000	668,816	1.0321
02 Oct 2013 06:43:12	1275748	15988874	hadcm3n_7xt3_1980_40_008455098_0	622,080	641,918	1.0319
01 Oct 2013 23:04:49	1275748	15988874	hadcm3n_7xt3_1980_40_008455098_0	596,160	614,840	1.0313
01 Oct 2013 08:00:23	1275748	15988874	hadcm3n_7xt3_1980_40_008455098_0	570,240	587,903	1.0310
30 Sep 2013 03:37:56	1275748	15988874	hadcm3n_7xt3_1980_40_008455098_0	544,320	561,085	1.0308
26 Sep 2013 14:04:53	1275748	15988874	hadcm3n_7xt3_1980_40_008455098_0	518,400	534,331	1.0307
26 Sep 2013 03:29:59	1275748	15988874	hadcm3n_7xt3_1980_40_008455098_0	492,480	506,987	1.0295
25 Sep 2013 09:26:07	1275748	15988874	hadcm3n_7xt3_1980_40_008455098_0	466,560	479,259	1.0272
25 Sep 2013 09:21:22	1275748	15988874	hadcm3n_7xt3_1980_40_008455098_0	440,640	451,796	1.0253
24 Sep 2013 06:33:06	1275748	15988874	hadcm3n_7xt3_1980_40_008455098_0	414,720	424,606	1.0238
23 Sep 2013 22:59:01	1275748	15988874	hadcm3n_7xt3_1980_40_008455098_0	388,800	397,295	1.0218
23 Sep 2013 15:18:47	1275748	15988874	hadcm3n_7xt3_1980_40_008455098_0	362,880	369,990	1.0196
20 Sep 2013 15:17:43	1275748	15988874	hadcm3n_7xt3_1980_40_008455098_0	336,960	343,203	1.0185
20 Sep 2013 05:28:03	1275748	15988874	hadcm3n_7xt3_1980_40_008455098_0	311,040	316,687	1.0182