Task 13590373

Name	hadcm3n_ybut_1900_40_007525409_4
Workunit	7722884
Created	3 Nov 2011, 14:14:31 UTC
Sent	3 Nov 2011, 14:25:02 UTC
Report deadline	2 Feb 2012, 21:52:13 UTC
Received	16 Nov 2011, 8:48:21 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	193 (0x000000C1) EXIT_SIGNAL
Computer ID	1126170
Run time	6 days 15 hours 1 min 9 sec
CPU time	6 days 10 hours 19 min 3 sec
Validate state	Invalid
Credit	3,110.40
Device peak FLOPS	2.19 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 i686-pc-linux-gnu
Stderr	<core_client_version>6.12.33</core_client_version> <![CDATA[ <message> process exited with code 193 (0xc1, -63) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 06:12:39 (9693): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:13:22 (9705): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 14:24:26 (21748): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 11:18:30 (27188): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 13:45:25 (13748): No heartbeat from core client for 30 sec - exiting 13:46:07 (13748): No heartbeat from core client for 30 sec - exiting 13:46:08 (13748): No heartbeat from core client for 30 sec - exiting 13:46:09 (13748): No heartbeat from core client for 30 sec - exiting 13:46:10 (13748): No heartbeat from core client for 30 sec - exiting 13:46:11 (13748): No heartbeat from core client for 30 sec - exiting 13:46:37 (13748): No heartbeat from core client for 30 sec - exiting 13:46:38 (13748): No heartbeat from core client for 30 sec - exiting 13:46:39 (13748): No heartbeat from core client for 30 sec - exiting 13:46:40 (13748): No heartbeat from core client for 30 sec - exiting 13:46:41 (13748): No heartbeat from core client for 30 sec - exiting 13:49:26 (19713): No heartbeat from core client for 30 sec - exiting 13:49:27 (19713): No heartbeat from core client for 30 sec - exiting 13:49:28 (19713): No heartbeat from core client for 30 sec - exiting 13:49:29 (19713): No heartbeat from core client for 30 sec - exiting 13:49:30 (19713): No heartbeat from core client for 30 sec - exiting 13:49:31 (19713): No heartbeat from core client for 30 sec - exiting 13:49:32 (19713): No heartbeat from core client for 30 sec - exiting 13:49:33 (19713): No heartbeat from core client for 30 sec - exiting 13:49:34 (19713): No heartbeat from core client for 30 sec - exiting 13:49:35 (19713): No heartbeat from core client for 30 sec - exiting 13:49:36 (19713): No heartbeat from core client for 30 sec - exiting 13:49:37 (19713): No heartbeat from core client for 30 sec - exiting 13:49:38 (19713): No heartbeat from core client for 30 sec - exiting 13:49:39 (19713): No heartbeat from core client for 30 sec - exiting 13:49:40 (19713): No heartbeat from core client for 30 sec - exiting 13:49:41 (19713): No heartbeat from core client for 30 sec - exiting 13:49:42 (19713): No heartbeat from core client for 30 sec - exiting 13:49:43 (19713): No heartbeat from core client for 30 sec - exiting 13:49:44 (19713): No heartbeat from core client for 30 sec - exiting 13:49:45 (19713): No heartbeat from core client for 30 sec - exiting 13:49:46 (19713): No heartbeat from core client for 30 sec - exiting 13:49:47 (19713): No heartbeat from core client for 30 sec - exiting 13:49:48 (19713): No heartbeat from core client for 30 sec - exiting 13:49:49 (19713): No heartbeat from core client for 30 sec - exiting 13:49:50 (19713): No heartbeat from core client for 30 sec - exiting 13:49:51 (19713): No heartbeat from core client for 30 sec - exiting 13:49:52 (19713): No heartbeat from core client for 30 sec - exiting 13:49:53 (19713): No heartbeat from core client for 30 sec - exiting 13:49:54 (19713): No heartbeat from core client for 30 sec - exiting 13:49:55 (19713): No heartbeat from core client for 30 sec - exiting 13:49:56 (19713): No heartbeat from core client for 30 sec - exiting 13:49:57 (19713): No heartbeat from core client for 30 sec - exiting 13:49:58 (19713): No heartbeat from core client for 30 sec - exiting 13:49:59 (19713): No heartbeat from core client for 30 sec - exiting 13:50:00 (19713): No heartbeat from core client for 30 sec - exiting 13:50:01 (19713): No heartbeat from core client for 30 sec - exiting 13:50:02 (19713): No heartbeat from core client for 30 sec - exiting 13:50:03 (19713): No heartbeat from core client for 30 sec - exiting 13:50:04 (19713): No heartbeat from core client for 30 sec - exiting 13:50:05 (19713): No heartbeat from core client for 30 sec - exiting 13:50:06 (19713): No heartbeat from core client for 30 sec - exiting 13:50:07 (19713): No heartbeat from core client for 30 sec - exiting 13:50:08 (19713): No heartbeat from core client for 30 sec - exiting 13:50:09 (19713): No heartbeat from core client for 30 sec - exiting 13:50:10 (19713): No heartbeat from core client for 30 sec - exiting 13:50:11 (19713): No heartbeat from core client for 30 sec - exiting 13:50:12 (19713): No heartbeat from core client for 30 sec - exiting 13:50:13 (19713): No heartbeat from core client for 30 sec - exiting 13:50:14 (19713): No heartbeat from core client for 30 sec - exiting 13:50:15 (19713): No heartbeat from core client for 30 sec - exiting 13:50:16 (19713): No heartbeat from core client for 30 sec - exiting 13:50:17 (19713): No heartbeat from core client for 30 sec - exiting 13:50:18 (19713): No heartbeat from core client for 30 sec - exiting 13:50:19 (19713): No heartbeat from core client for 30 sec - exiting 13:50:20 (19713): No heartbeat from core client for 30 sec - exiting 13:50:21 (19713): No heartbeat from core client for 30 sec - exiting 13:50:22 (19713): No heartbeat from core client for 30 sec - exiting 13:50:23 (19713): No heartbeat from core client for 30 sec - exiting 13:50:24 (19713): No heartbeat from core client for 30 sec - exiting 13:50:25 (19713): No heartbeat from core client for 30 sec - exiting 13:50:26 (19713): No heartbeat from core client for 30 sec - exiting 13:50:27 (19713): No heartbeat from core client for 30 sec - exiting 13:50:28 (19713): No heartbeat from core client for 30 sec - exiting 13:50:29 (19713): No heartbeat from core client for 30 sec - exiting 13:50:30 (19713): No heartbeat from core client for 30 sec - exiting 13:50:31 (19713): No heartbeat from core client for 30 sec - exiting 13:50:32 (19713): No heartbeat from core client for 30 sec - exiting 13:50:33 (19713): No heartbeat from core client for 30 sec - exiting 13:50:34 (19713): No heartbeat from core client for 30 sec - exiting 13:50:35 (19713): No heartbeat from core client for 30 sec - exiting 13:50:36 (19713): No heartbeat from core client for 30 sec - exiting 13:50:37 (19713): No heartbeat from core client for 30 sec - exiting 13:50:38 (19713): No heartbeat from core client for 30 sec - exiting 13:50:39 (19713): No heartbeat from core client for 30 sec - exiting 13:50:40 (19713): No heartbeat from core client for 30 sec - exiting 13:50:41 (19713): No heartbeat from core client for 30 sec - exiting 13:50:42 (19713): No heartbeat from core client for 30 sec - exiting 13:50:43 (19713): No heartbeat from core client for 30 sec - exiting 13:50:44 (19713): No heartbeat from core client for 30 sec - exiting 13:50:45 (19713): No heartbeat from core client for 30 sec - exiting 13:50:46 (19713): No heartbeat from core client for 30 sec - exiting 13:50:47 (19713): No heartbeat from core client for 30 sec - exiting 13:50:48 (19713): No heartbeat from core client for 30 sec - exiting 13:50:49 (19713): No heartbeat from core client for 30 sec - exiting 13:50:50 (19713): No heartbeat from core client for 30 sec - exiting 13:50:51 (19713): No heartbeat from core client for 30 sec - exiting 13:50:52 (19713): No heartbeat from core client for 30 sec - exiting 13:50:53 (19713): No heartbeat from core client for 30 sec - exiting 13:50:54 (19713): No heartbeat from core client for 30 sec - exiting 13:50:55 (19713): No heartbeat from core client for 30 sec - exiting 13:50:56 (19713): No heartbeat from core client for 30 sec - exiting 13:50:57 (19713): No heartbeat from core client for 30 sec - exiting 13:50:58 (19713): No heartbeat from core client for 30 sec - exiting 13:50:59 (19713): No heartbeat from core client for 30 sec - exiting 13:51:00 (19713): No heartbeat from core client for 30 sec - exiting 13:51:01 (19713): No heartbeat from core client for 30 sec - exiting 13:51:02 (19713): No heartbeat from core client for 30 sec - exiting 13:51:03 (19713): No heartbeat from core client for 30 sec - exiting 13:51:04 (19713): No heartbeat from core client for 30 sec - exiting 13:51:05 (19713): No heartbeat from core client for 30 sec - exiting 13:51:06 (19713): No heartbeat from core client for 30 sec - exiting 13:51:07 (19713): No heartbeat from core client for 30 sec - exiting 13:51:08 (19713): No heartbeat from core client for 30 sec - exiting 13:51:09 (19713): No heartbeat from core client for 30 sec - exiting 13:51:10 (19713): No heartbeat from core client for 30 sec - exiting 13:51:11 (19713): No heartbeat from core client for 30 sec - exiting 13:51:12 (19713): No heartbeat from core client for 30 sec - exiting 13:51:13 (19713): No heartbeat from core client for 30 sec - exiting 13:51:14 (19713): No heartbeat from core client for 30 sec - exiting 13:51:15 (19713): No heartbeat from core client for 30 sec - exiting 13:51:16 (19713): No heartbeat from core client for 30 sec - exiting 13:51:17 (19713): No heartbeat from core client for 30 sec - exiting 13:51:18 (19713): No heartbeat from core client for 30 sec - exiting 13:51:19 (19713): No heartbeat from core client for 30 sec - exiting 13:51:20 (19713): No heartbeat from core client for 30 sec - exiting 13:51:21 (19713): No heartbeat from core client for 30 sec - exiting 13:51:22 (19713): No heartbeat from core client for 30 sec - exiting 13:51:23 (19713): No heartbeat from core client for 30 sec - exiting 13:51:24 (19713): No heartbeat from core client for 30 sec - exiting 13:51:25 (19713): No heartbeat from core client for 30 sec - exiting 13:51:26 (19713): No heartbeat from core client for 30 sec - exiting 13:51:27 (19713): No heartbeat from core client for 30 sec - exiting 13:51:28 (19713): No heartbeat from core client for 30 sec - exiting 13:51:29 (19713): No heartbeat from core client for 30 sec - exiting 13:51:30 (19713): No heartbeat from core client for 30 sec - exiting 13:51:31 (19713): No heartbeat from core client for 30 sec - exiting 13:51:32 (19713): No heartbeat from core client for 30 sec - exiting 13:51:33 (19713): No heartbeat from core client for 30 sec - exiting 13:51:34 (19713): No heartbeat from core client for 30 sec - exiting 13:51:35 (19713): No heartbeat from core client for 30 sec - exiting 13:51:36 (19713): No heartbeat from core client for 30 sec - exiting 13:51:37 (19713): No heartbeat from core client for 30 sec - exiting 13:51:38 (19713): No heartbeat from core client for 30 sec - exiting 13:51:39 (19713): No heartbeat from core client for 30 sec - exiting 13:51:40 (19713): No heartbeat from core client for 30 sec - exiting 13:51:41 (19713): No heartbeat from core client for 30 sec - exiting 13:51:42 (19713): No heartbeat from core client for 30 sec - exiting 13:51:43 (19713): No heartbeat from core client for 30 sec - exiting 13:51:44 (19713): No heartbeat from core client for 30 sec - exiting 13:51:45 (19713): No heartbeat from core client for 30 sec - exiting 13:51:46 (19713): No heartbeat from core client for 30 sec - exiting 13:51:47 (19713): No heartbeat from core client for 30 sec - exiting 13:51:48 (19713): No heartbeat from core client for 30 sec - exiting 13:51:49 (19713): No heartbeat from core client for 30 sec - exiting 13:51:50 (19713): No heartbeat from core client for 30 sec - exiting 13:51:51 (19713): No heartbeat from core client for 30 sec - exiting 13:51:52 (19713): No heartbeat from core client for 30 sec - exiting 13:51:53 (19713): No heartbeat from core client for 30 sec - exiting 13:51:54 (19713): No heartbeat from core client for 30 sec - exiting 13:51:55 (19713): No heartbeat from core client for 30 sec - exiting 13:51:56 (19713): No heartbeat from core client for 30 sec - exiting 13:51:57 (19713): No heartbeat from core client for 30 sec - exiting 13:51:58 (19713): No heartbeat from core client for 30 sec - exiting 13:51:59 (19713): No heartbeat from core client for 30 sec - exiting 13:52:00 (19713): No heartbeat from core client for 30 sec - exiting 13:52:01 (19713): No heartbeat from core client for 30 sec - exiting 13:52:02 (19713): No heartbeat from core client for 30 sec - exiting 13:52:03 (19713): No heartbeat from core client for 30 sec - exiting 13:52:04 (19713): No heartbeat from core client for 30 sec - exiting 13:52:05 (19713): No heartbeat from core client for 30 sec - exiting 13:52:06 (19713): No heartbeat from core client for 30 sec - exiting 13:52:07 (19713): No heartbeat from core client for 30 sec - exiting 13:52:08 (19713): No heartbeat from core client for 30 sec - exiting 13:52:09 (19713): No heartbeat from core client for 30 sec - exiting 13:52:10 (19713): No heartbeat from core client for 30 sec - exiting 13:52:11 (19713): No heartbeat from core client for 30 sec - exiting 13:52:12 (19713): No heartbeat from core client for 30 sec - exiting 13:52:13 (19713): No heartbeat from core client for 30 sec - exiting 13:52:14 (19713): No heartbeat from core client for 30 sec - exiting 13:52:15 (19713): No heartbeat from core client for 30 sec - exiting 13:52:16 (19713): No heartbeat from core client for 30 sec - exiting 13:52:17 (19713): No heartbeat from core client for 30 sec - exiting 13:52:18 (19713): No heartbeat from core client for 30 sec - exiting 13:52:19 (19713): No heartbeat from core client for 30 sec - exiting 13:52:20 (19713): No heartbeat from core client for 30 sec - exiting 13:52:21 (19713): No heartbeat from core client for 30 sec - exiting 13:52:22 (19713): No heartbeat from core client for 30 sec - exiting 13:52:23 (19713): No heartbeat from core client for 30 sec - exiting 13:52:24 (19713): No heartbeat from core client for 30 sec - exiting 13:52:25 (19713): No heartbeat from core client for 30 sec - exiting 13:52:26 (19713): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... * glibc detected * ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu: double free or corruption (out): 0x09451630 *** ======= Backtrace: ========= /lib32/libc.so.6(+0x6eb72)[0xf7503b72] /lib32/libc.so.6(+0x6f812)[0xf7504812] /lib32/libc.so.6(cfree+0x6d)[0xf75078cd] /usr/lib32/libstdc++.so.6(_ZdlPv+0x1f)[0xf7704baf] /usr/lib32/libstdc++.so.6(_ZdaPv+0x1b)[0xf7704c0b] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8053e8e] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8057bc4] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x804f232] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8050491] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805112c] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805137a] /lib32/libc.so.6(__libc_start_main+0xf3)[0xf74ae0f3] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(__gxx_personality_v0+0x169)[0x804cb51] ======= Memory map: ======== 08048000-080e3000 r-xp 00000000 08:08 719 /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu 080e3000-080e4000 rw-p 0009b000 08:08 719 /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu 080e4000-0813b000 rw-p 00000000 00:00 0 093fc000-09461000 rw-p 00000000 00:00 0 [heap] f6f00000-f6f21000 rw-p 00000000 00:00 0 f6f21000-f7000000 ---p 00000000 00:00 0 f7017000-f7492000 rw-s 00000000 08:08 10389 /var/lib/boinc-client/slots/0/139810 f7492000-f7495000 rw-p 00000000 00:00 0 f7495000-f7608000 r-xp 00000000 08:05 48284 /lib32/libc-2.13.so f7608000-f7609000 ---p 00173000 08:05 48284 /lib32/libc-2.13.so f7609000-f760b000 r--p 00173000 08:05 48284 /lib32/libc-2.13.so f760b000-f760c000 rw-p 00175000 08:05 48284 /lib32/libc-2.13.so f760c000-f760f000 rw-p 00000000 00:00 0 f760f000-f762b000 r-xp 00000000 08:06 18423 /usr/lib32/libgcc_s.so.1 f762b000-f762c000 r--p 0001b000 08:06 18423 /usr/lib32/libgcc_s.so.1 f762c000-f762d000 rw-p 0001c000 08:06 18423 /usr/lib32/libgcc_s.so.1 f762d000-f7655000 r-xp 00000000 08:05 48300 /lib32/libm-2.13.so f7655000-f7656000 r--p 00028000 08:05 48300 /lib32/libm-2.13.so f7656000-f7657000 rw-p 00029000 08:05 48300 /lib32/libm-2.13.so f7657000-f7735000 r-xp 00000000 08:06 12372 /usr/lib32/libstdc++.so.6.0.16 f7735000-f7736000 ---p 000de000 08:06 12372 /usr/lib32/libstdc++.so.6.0.16 f7736000-f773a000 r--p 000de000 08:06 12372 /usr/lib32/libstdc++.so.6.0.16 f773a000-f773b000 rw-p 000e2000 08:06 12372 /usr/lib32/libstdc++.so.6.0.16 f773b000-f7743000 rw-p 00000000 00:00 0 f7743000-f7746000 r-xp 00000000 08:05 48286 /lib32/libdl-2.13.so f7746000-f7747000 r--p 00002000 08:05 48286 /lib32/libdl-2.13.so f7747000-f7748000 rw-p 00003000 08:05 48286 /lib32/libdl-2.13.so f7748000-f775f000 r-xp 00000000 08:05 48298 /lib32/libpthread-2.13.so f775f000-f7760000 r--p 00016000 08:05 48298 /lib32/libpthread-2.13.so f7760000-f7761000 rw-p 00017000 08:05 48298 /lib32/libpthread-2.13.so f7761000-f7763000 rw-p 00000000 00:00 0 f7788000-f7789000 rw-p 00000000 00:00 0 f7789000-f778a000 ---p 00000000 00:00 0 f778a000-f778d000 rw-p 00000000 00:00 0 f778d000-f778f000 rw-s 00000000 08:08 937 /var/lib/boinc-client/slots/0/boinc_mmap_file f778f000-f7791000 rw-p 00000000 00:00 0 f7791000-f7792000 r-xp 00000000 00:00 0 [vdso] f7792000-f77b0000 r-xp 00000000 08:05 28892 /lib/i386-linux-gnu/ld-2.13.so f77b0000-f77b1000 r--p 0001d000 08:05 28892 /lib/i386-linux-gnu/ld-2.13.so f77b1000-f77b2000 rw-p 0001e000 08:05 28892 /lib/i386-linux-gnu/ld-2.13.so ff95d000-ff9cc000 rw-p 00000000 00:00 0 [stack] SIGABRT: abort called Stack trace (19 frames): ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80b80df] [0xf7791400] [0xf7791430] /lib32/libc.so.6(gsignal+0x4f)[0xf74c2c4f] /lib32/libc.so.6(abort+0x175)[0xf74c6175] /lib32/libc.so.6(+0x63e8c)[0xf74f8e8c] /lib32/libc.so.6(+0x6eb72)[0xf7503b72] /lib32/libc.so.6(+0x6f812)[0xf7504812] /lib32/libc.so.6(cfree+0x6d)[0xf75078cd] /usr/lib32/libstdc++.so.6(_ZdlPv+0x1f)[0xf7704baf] /usr/lib32/libstdc++.so.6(_ZdaPv+0x1b)[0xf7704c0b] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8053e8e] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8057bc4] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x804f232] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8050491] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805112c] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805137a] /lib32/libc.so.6(__libc_start_main+0xf3)[0xf74ae0f3] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(__gxx_personality_v0+0x169)[0x804cb51] Exiting... </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
16 Nov 2011 08:49:59	1126170	13590373	hadcm3n_ybut_1900_40_007525409_4	259,200	555,538	2.1433
15 Nov 2011 20:23:14	1126170	13590373	hadcm3n_ybut_1900_40_007525409_4	233,280	499,788	2.1424
15 Nov 2011 20:23:14	1126170	13590373	hadcm3n_ybut_1900_40_007525409_4	207,360	444,122	2.1418
15 Nov 2011 20:23:14	1126170	13590373	hadcm3n_ybut_1900_40_007525409_4	181,440	388,590	2.1417
15 Nov 2011 20:23:14	1126170	13590373	hadcm3n_ybut_1900_40_007525409_4	155,520	332,921	2.1407
15 Nov 2011 20:23:14	1126170	13590373	hadcm3n_ybut_1900_40_007525409_4	129,600	277,378	2.1403
09 Nov 2011 19:32:26	1126170	13590373	hadcm3n_ybut_1900_40_007525409_4	103,680	221,903	2.1403
07 Nov 2011 18:50:06	1126170	13590373	hadcm3n_ybut_1900_40_007525409_4	77,760	166,362	2.1394
06 Nov 2011 13:38:11	1126170	13590373	hadcm3n_ybut_1900_40_007525409_4	51,840	110,858	2.1385
05 Nov 2011 14:42:12	1126170	13590373	hadcm3n_ybut_1900_40_007525409_4	25,920	55,446	2.1391