Task 13408152

Name	hadcm3n_u0mb_1980_40_007458916_1
Workunit	7656419
Created	22 Sep 2011, 16:58:25 UTC
Sent	22 Sep 2011, 17:11:24 UTC
Report deadline	23 Dec 2011, 0:38:35 UTC
Received	25 Oct 2011, 20:35:20 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	193 (0x000000C1) EXIT_SIGNAL
Computer ID	1167838
Run time	4 days 5 hours 20 min 26 sec
CPU time	3 days 23 hours 53 min 22 sec
Validate state	Invalid
Credit	3,110.40
Device peak FLOPS	2.81 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>6.12.34</core_client_version> <![CDATA[ <message> - exit code 193 (0xc1) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5840, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 20:52:48 (164): No heartbeat from core client for 30 sec - exiting 20:52:50 (164): No heartbeat from core client for 30 sec - exiting 20:52:51 (164): No heartbeat from core client for 30 sec - exiting 20:52:52 (164): No heartbeat from core client for 30 sec - exiting 20:52:53 (164): No heartbeat from core client for 30 sec - exiting 20:52:54 (164): No heartbeat from core client for 30 sec - exiting 20:52:55 (164): No heartbeat from core client for 30 sec - exiting 20:52:56 (164): No heartbeat from core client for 30 sec - exiting 20:52:57 (164): No heartbeat from core client for 30 sec - exiting 20:52:58 (164): No heartbeat from core client for 30 sec - exiting 20:52:59 (164): No heartbeat from core client for 30 sec - exiting 20:53:00 (164): No heartbeat from core client for 30 sec - exiting 20:53:01 (164): No heartbeat from core client for 30 sec - exiting 20:53:02 (164): No heartbeat from core client for 30 sec - exiting 20:53:03 (164): No heartbeat from core client for 30 sec - exiting 20:53:04 (164): No heartbeat from core client for 30 sec - exiting 20:53:05 (164): No heartbeat from core client for 30 sec - exiting 20:53:06 (164): No heartbeat from core client for 30 sec - exiting 20:53:07 (164): No heartbeat from core client for 30 sec - exiting 20:53:08 (164): No heartbeat from core client for 30 sec - exiting 20:53:09 (164): No heartbeat from core client for 30 sec - exiting 20:53:10 (164): No heartbeat from core client for 30 sec - exiting 20:53:11 (164): No heartbeat from core client for 30 sec - exiting 20:53:12 (164): No heartbeat from core client for 30 sec - exiting 20:53:13 (164): No heartbeat from core client for 30 sec - exiting 20:53:14 (164): No heartbeat from core client for 30 sec - exiting 20:53:15 (164): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:53:16 (164): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 23:15:47 (5268): No heartbeat from core client for 30 sec - exiting 23:15:49 (5268): No heartbeat from core client for 30 sec - exiting 23:15:50 (5268): No heartbeat from core client for 30 sec - exiting 23:15:51 (5268): No heartbeat from core client for 30 sec - exiting 23:15:52 (5268): No heartbeat from core client for 30 sec - exiting 23:15:53 (5268): No heartbeat from core client for 30 sec - exiting 23:15:54 (5268): No heartbeat from core client for 30 sec - exiting 23:15:55 (5268): No heartbeat from core client for 30 sec - exiting 23:15:56 (5268): No heartbeat from core client for 30 sec - exiting 23:15:57 (5268): No heartbeat from core client for 30 sec - exiting 23:15:58 (5268): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 06:31:20 (1240): No heartbeat from core client for 30 sec - exiting 06:31:21 (1240): No heartbeat from core client for 30 sec - exiting 06:31:22 (1240): No heartbeat from core client for 30 sec - exiting 06:31:23 (1240): No heartbeat from core client for 30 sec - exiting 06:31:24 (1240): No heartbeat from core client for 30 sec - exiting 06:31:25 (1240): No heartbeat from core client for 30 sec - exiting 06:31:26 (1240): No heartbeat from core client for 30 sec - exiting 06:31:27 (1240): No heartbeat from core client for 30 sec - exiting 06:31:28 (1240): No heartbeat from core client for 30 sec - exiting 06:31:29 (1240): No heartbeat from core client for 30 sec - exiting 06:31:30 (1240): No heartbeat from core client for 30 sec - exiting 06:31:31 (1240): No heartbeat from core client for 30 sec - exiting 06:31:32 (1240): No heartbeat from core client for 30 sec - exiting 06:31:33 (1240): No heartbeat from core client for 30 sec - exiting 06:31:34 (1240): No heartbeat from core client for 30 sec - exiting 06:31:35 (1240): No heartbeat from core client for 30 sec - exiting 06:31:36 (1240): No heartbeat from core client for 30 sec - exiting 06:31:37 (1240): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 19:59:18 (4484): No heartbeat from core client for 30 sec - exiting 19:59:19 (4484): No heartbeat from core client for 30 sec - exiting 19:59:20 (4484): No heartbeat from core client for 30 sec - exiting 19:59:21 (4484): No heartbeat from core client for 30 sec - exiting 19:59:22 (4484): No heartbeat from core client for 30 sec - exiting 19:59:23 (4484): No heartbeat from core client for 30 sec - exiting 19:59:24 (4484): No heartbeat from core client for 30 sec - exiting 19:59:25 (4484): No heartbeat from core client for 30 sec - exiting 19:59:26 (4484): No heartbeat from core client for 30 sec - exiting 19:59:27 (4484): No heartbeat from core client for 30 sec - exiting 19:59:28 (4484): No heartbeat from core client for 30 sec - exiting 19:59:29 (4484): No heartbeat from core client for 30 sec - exiting 19:59:30 (4484): No heartbeat from core client for 30 sec - exiting 19:59:31 (4484): No heartbeat from core client for 30 sec - exiting 19:59:32 (4484): No heartbeat from core client for 30 sec - exiting 19:59:33 (4484): No heartbeat from core client for 30 sec - exiting 19:59:34 (4484): No heartbeat from core client for 30 sec - exiting 19:59:35 (4484): No heartbeat from core client for 30 sec - exiting 19:59:36 (4484): No heartbeat from core client for 30 sec - exiting 19:59:37 (4484): No heartbeat from core client for 30 sec - exiting 19:59:38 (4484): No heartbeat from core client for 30 sec - exiting 19:59:39 (4484): No heartbeat from core client for 30 sec - exiting 19:59:40 (4484): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 06:39:38 (4380): No heartbeat from core client for 30 sec - exiting 06:39:40 (4380): No heartbeat from core client for 30 sec - exiting 06:39:41 (4380): No heartbeat from core client for 30 sec - exiting 06:39:42 (4380): No heartbeat from core client for 30 sec - exiting 06:39:43 (4380): No heartbeat from core client for 30 sec - exiting 06:39:44 (4380): No heartbeat from core client for 30 sec - exiting 06:39:45 (4380): No heartbeat from core client for 30 sec - exiting 06:39:46 (4380): No heartbeat from core client for 30 sec - exiting 06:39:47 (4380): No heartbeat from core client for 30 sec - exiting 06:39:48 (4380): No heartbeat from core client for 30 sec - exiting 06:39:49 (4380): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 13:17:20 (4372): No heartbeat from core client for 30 sec - exiting 13:17:21 (4372): No heartbeat from core client for 30 sec - exiting 13:17:22 (4372): No heartbeat from core client for 30 sec - exiting 13:17:23 (4372): No heartbeat from core client for 30 sec - exiting 13:17:24 (4372): No heartbeat from core client for 30 sec - exiting 13:17:25 (4372): No heartbeat from core client for 30 sec - exiting 13:17:26 (4372): No heartbeat from core client for 30 sec - exiting 13:17:27 (4372): No heartbeat from core client for 30 sec - exiting 13:17:28 (4372): No heartbeat from core client for 30 sec - exiting 13:17:29 (4372): No heartbeat from core client for 30 sec - exiting 13:17:30 (4372): No heartbeat from core client for 30 sec - exiting 13:17:31 (4372): No heartbeat from core client for 30 sec - exiting 13:17:32 (4372): No heartbeat from core client for 30 sec - exiting 13:17:33 (4372): No heartbeat from core client for 30 sec - exiting 13:17:34 (4372): No heartbeat from core client for 30 sec - exiting 13:17:35 (4372): No heartbeat from core client for 30 sec - exiting 13:17:36 (4372): No heartbeat from core client for 30 sec - exiting 13:17:37 (4372): No heartbeat from core client for 30 sec - exiting 13:17:38 (4372): No heartbeat from core client for 30 sec - exiting 13:17:39 (4372): No heartbeat from core client for 30 sec - exiting 13:17:40 (4372): No heartbeat from core client for 30 sec - exiting 13:17:41 (4372): No heartbeat from core client for 30 sec - exiting 13:17:42 (4372): No heartbeat from core client for 30 sec - exiting 13:17:43 (4372): No heartbeat from core client for 30 sec - exiting 13:17:44 (4372): No heartbeat from core client for 30 sec - exiting 13:17:45 (4372): No heartbeat from core client for 30 sec - exiting 13:17:46 (4372): No heartbeat from core client for 30 sec - exiting 13:17:47 (4372): No heartbeat from core client for 30 sec - exiting 13:17:48 (4372): No heartbeat from core client for 30 sec - exiting 13:17:49 (4372): No heartbeat from core client for 30 sec - exiting 13:17:50 (4372): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 06:59:49 (4392): No heartbeat from core client for 30 sec - exiting 06:59:50 (4392): No heartbeat from core client for 30 sec - exiting 06:59:51 (4392): No heartbeat from core client for 30 sec - exiting 06:59:52 (4392): No heartbeat from core client for 30 sec - exiting 06:59:53 (4392): No heartbeat from core client for 30 sec - exiting 06:59:54 (4392): No heartbeat from core client for 30 sec - exiting 06:59:55 (4392): No heartbeat from core client for 30 sec - exiting 06:59:56 (4392): No heartbeat from core client for 30 sec - exiting 06:59:57 (4392): No heartbeat from core client for 30 sec - exiting 06:59:58 (4392): No heartbeat from core client for 30 sec - exiting 06:59:59 (4392): No heartbeat from core client for 30 sec - exiting 07:00:00 (4392): No heartbeat from core client for 30 sec - exiting 07:00:01 (4392): No heartbeat from core client for 30 sec - exiting 07:00:02 (4392): No heartbeat from core client for 30 sec - exiting 07:00:03 (4392): No heartbeat from core client for 30 sec - exiting 07:00:04 (4392): No heartbeat from core client for 30 sec - exiting 07:00:05 (4392): No heartbeat from core client for 30 sec - exiting 07:00:06 (4392): No heartbeat from core client for 30 sec - exiting 07:00:07 (4392): No heartbeat from core client for 30 sec - exiting 07:00:08 (4392): No heartbeat from core client for 30 sec - exiting 07:00:09 (4392): No heartbeat from core client for 30 sec - exiting 07:00:10 (4392): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2964, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x77C03A93 read attempt to address 0x40B6DA4D Engaging BOINC Windows Runtime Debugger... Cannot serialize file C:\ProgramData\BOINC/projects/climateprediction.net/hadcm3n_u0mb_1980_40_007458916/dataout/shmem_restart.day Signal 11 received, exiting... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
31 Oct 2011 15:16:39	1167838	13408152	hadcm3n_u0mb_1980_40_007458916_1	259,200	345,200	1.3318
31 Oct 2011 15:16:39	1167838	13408152	hadcm3n_u0mb_1980_40_007458916_1	233,280	310,732	1.3320
19 Oct 2011 04:10:52	1167838	13408152	hadcm3n_u0mb_1980_40_007458916_1	207,360	276,236	1.3322
17 Oct 2011 11:29:02	1167838	13408152	hadcm3n_u0mb_1980_40_007458916_1	181,440	241,892	1.3332
16 Oct 2011 03:58:27	1167838	13408152	hadcm3n_u0mb_1980_40_007458916_1	155,520	207,341	1.3332
13 Oct 2011 19:05:54	1167838	13408152	hadcm3n_u0mb_1980_40_007458916_1	129,600	172,438	1.3305
09 Oct 2011 21:02:54	1167838	13408152	hadcm3n_u0mb_1980_40_007458916_1	103,680	137,997	1.3310
09 Oct 2011 10:53:34	1167838	13408152	hadcm3n_u0mb_1980_40_007458916_1	77,760	103,454	1.3304
04 Oct 2011 07:50:44	1167838	13408152	hadcm3n_u0mb_1980_40_007458916_1	51,840	68,859	1.3283
30 Sep 2011 22:18:26	1167838	13408152	hadcm3n_u0mb_1980_40_007458916_1	25,920	34,414	1.3277