Task 12928119

Name	hadcm3n_o42o_1940_40_007267289_1
Workunit	7465529
Created	3 Jun 2011, 2:28:34 UTC
Sent	3 Jun 2011, 2:28:45 UTC
Report deadline	2 Sep 2011, 9:55:56 UTC
Received	27 Jun 2011, 1:33:05 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	-177 (0xFFFFFF4F) ERR_RSC_LIMIT_EXCEEDED
Computer ID	1152595
Run time	2 days 7 hours 24 min 48 sec
CPU time	1 days 23 hours 7 min 43 sec
Validate state	Invalid
Credit	1,866.24
Device peak FLOPS	3.53 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 i686-apple-darwin
Stderr	<core_client_version>6.8.23</core_client_version> <![CDATA[ <message> Maximum memory exceeded </message> <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 03:12:54 (37154): No heartbeat from core client for 30 sec - exiting 03:12:56 (37154): No heartbeat from core client for 30 sec - exiting 03:12:57 (37154): No heartbeat from core client for 30 sec - exiting 03:12:58 (37154): No heartbeat from core client for 30 sec - exiting 03:12:59 (37154): No heartbeat from core client for 30 sec - exiting 03:13:00 (37154): No heartbeat from core client for 30 sec - exiting 03:13:01 (37154): No heartbeat from core client for 30 sec - exiting 03:13:02 (37154): No heartbeat from core client for 30 sec - exiting 03:13:03 (37154): No heartbeat from core client for 30 sec - exiting 03:13:04 (37154): No heartbeat from core client for 30 sec - exiting 03:13:05 (37154): No heartbeat from core client for 30 sec - exiting 03:13:06 (37154): No heartbeat from core client for 30 sec - exiting 03:13:07 (37154): No heartbeat from core client for 30 sec - exiting 03:13:08 (37154): No heartbeat from core client for 30 sec - exiting 03:13:09 (37154): No heartbeat from core client for 30 sec - exiting 03:13:10 (37154): No heartbeat from core client for 30 sec - exiting 03:13:11 (37154): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 10:40:50 (37273): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... 10:40:58 (37273): No heartbeat from core client for 30 sec - exiting SIGSEGV: segmentation violation Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 05:46:11 (62880): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:49:22 (75206): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:49:23 (75206): No heartbeat from core client for 30 sec - exiting 05:49:24 (75206): No heartbeat from core client for 30 sec - exiting 05:49:25 (75206): No heartbeat from core client for 30 sec - exiting 05:49:27 (75206): No heartbeat from core client for 30 sec - exiting 05:49:28 (75206): No heartbeat from core client for 30 sec - exiting 05:49:29 (75206): No heartbeat from core client for 30 sec - exiting 05:49:30 (75206): No heartbeat from core client for 30 sec - exiting 05:49:31 (75206): No heartbeat from core client for 30 sec - exiting 05:49:32 (75206): No heartbeat from core client for 30 sec - exiting 05:49:33 (75206): No heartbeat from core client for 30 sec - exiting 05:49:34 (75206): No heartbeat from core client for 30 sec - exiting 05:49:35 (75206): No heartbeat from core client for 30 sec - exiting 05:49:36 (75206): No heartbeat from core client for 30 sec - exiting 05:49:37 (75206): No heartbeat from core client for 30 sec - exiting 05:49:38 (75206): No heartbeat from core client for 30 sec - exiting 05:49:39 (75206): No heartbeat from core client for 30 sec - exiting 05:49:40 (75206): No heartbeat from core client for 30 sec - exiting 05:49:41 (75206): No heartbeat from core client for 30 sec - exiting 05:49:42 (75206): No heartbeat from core client for 30 sec - exiting 05:49:43 (75206): No heartbeat from core client for 30 sec - exiting 05:49:44 (75206): No heartbeat from core client for 30 sec - exiting 05:49:45 (75206): No heartbeat from core client for 30 sec - exiting 05:49:46 (75206): No heartbeat from core client for 30 sec - exiting 05:49:47 (75206): No heartbeat from core client for 30 sec - exiting 05:49:48 (75206): No heartbeat from core client for 30 sec - exiting 06:01:30 (75258): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:01:31 (75258): No heartbeat from core client for 30 sec - exiting 06:01:32 (75258): No heartbeat from core client for 30 sec - exiting 06:01:33 (75258): No heartbeat from core client for 30 sec - exiting 06:07:17 (75335): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:07:20 (75335): No heartbeat from core client for 30 sec - exiting 06:07:21 (75335): No heartbeat from core client for 30 sec - exiting 06:07:22 (75335): No heartbeat from core client for 30 sec - exiting 06:07:23 (75335): No heartbeat from core client for 30 sec - exiting 06:07:24 (75335): No heartbeat from core client for 30 sec - exiting 06:07:25 (75335): No heartbeat from core client for 30 sec - exiting 06:07:26 (75335): No heartbeat from core client for 30 sec - exiting 06:07:27 (75335): No heartbeat from core client for 30 sec - exiting 06:07:28 (75335): No heartbeat from core client for 30 sec - exiting 06:07:29 (75335): No heartbeat from core client for 30 sec - exiting 06:07:30 (75335): No heartbeat from core client for 30 sec - exiting 06:07:31 (75335): No heartbeat from core client for 30 sec - exiting 06:07:32 (75335): No heartbeat from core client for 30 sec - exiting 06:07:33 (75335): No heartbeat from core client for 30 sec - exiting 06:07:34 (75335): No heartbeat from core client for 30 sec - exiting 06:07:35 (75335): No heartbeat from core client for 30 sec - exiting 06:07:36 (75335): No heartbeat from core client for 30 sec - exiting 06:07:37 (75335): No heartbeat from core client for 30 sec - exiting 06:07:38 (75335): No heartbeat from core client for 30 sec - exiting 06:07:39 (75335): No heartbeat from core client for 30 sec - exiting 06:07:40 (75335): No heartbeat from core client for 30 sec - exiting 06:07:41 (75335): No heartbeat from core client for 30 sec - exiting 06:07:42 (75335): No heartbeat from core client for 30 sec - exiting 06:07:43 (75335): No heartbeat from core client for 30 sec - exiting 06:07:44 (75335): No heartbeat from core client for 30 sec - exiting 06:07:45 (75335): No heartbeat from core client for 30 sec - exiting 06:07:46 (75335): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 18:02:18 (254): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 13:11:11 (9256): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 05:55:20 (20050): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:55:22 (20050): No heartbeat from core client for 30 sec - exiting 05:55:23 (20050): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 08:17:33 (33646): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... 09:41:36 (35487): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:41:37 (35487): No heartbeat from core client for 30 sec - exiting 09:41:38 (35487): No heartbeat from core client for 30 sec - exiting 09:41:39 (35487): No heartbeat from core client for 30 sec - exiting 09:41:40 (35487): No heartbeat from core client for 30 sec - exiting 09:41:42 (35487): No heartbeat from core client for 30 sec - exiting 09:41:43 (35487): No heartbeat from core client for 30 sec - exiting 09:41:44 (35487): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 14:36:50 (35999): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... 19:07:04 (9819): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:07:06 (9819): No heartbeat from core client for 30 sec - exiting 19:07:07 (9819): No heartbeat from core client for 30 sec - exiting 19:07:08 (9819): No heartbeat from core client for 30 sec - exiting 19:07:09 (9819): No heartbeat from core client for 30 sec - exiting 19:07:10 (9819): No heartbeat from core client for 30 sec - exiting 19:07:11 (9819): No heartbeat from core client for 30 sec - exiting 19:07:12 (9819): No heartbeat from core client for 30 sec - exiting 19:07:13 (9819): No heartbeat from core client for 30 sec - exiting 19:07:14 (9819): No heartbeat from core client for 30 sec - exiting 19:07:15 (9819): No heartbeat from core client for 30 sec - exiting 19:07:16 (9819): No heartbeat from core client for 30 sec - exiting 19:07:17 (9819): No heartbeat from core client for 30 sec - exiting 19:07:18 (9819): No heartbeat from core client for 30 sec - exiting 19:07:19 (9819): No heartbeat from core client for 30 sec - exiting 19:07:20 (9819): No heartbeat from core client for 30 sec - exiting 19:07:21 (9819): No heartbeat from core client for 30 sec - exiting 19:07:22 (9819): No heartbeat from core client for 30 sec - exiting 19:07:23 (9819): No heartbeat from core client for 30 sec - exiting 19:07:24 (9819): No heartbeat from core client for 30 sec - exiting 19:07:25 (9819): No heartbeat from core client for 30 sec - exiting 19:07:26 (9819): No heartbeat from core client for 30 sec - exiting 19:07:27 (9819): No heartbeat from core client for 30 sec - exiting 19:07:28 (9819): No heartbeat from core client for 30 sec - exiting 19:07:29 (9819): No heartbeat from core client for 30 sec - exiting 19:07:30 (9819): No heartbeat from core client for 30 sec - exiting 19:07:31 (9819): No heartbeat from core client for 30 sec - exiting 19:07:32 (9819): No heartbeat from core client for 30 sec - exiting 19:07:33 (9819): No heartbeat from core client for 30 sec - exiting 19:07:34 (9819): No heartbeat from core client for 30 sec - exiting 19:07:35 (9819): No heartbeat from core client for 30 sec - exiting 19:07:36 (9819): No heartbeat from core client for 30 sec - exiting 19:07:37 (9819): No heartbeat from core client for 30 sec - exiting 19:07:38 (9819): No heartbeat from core client for 30 sec - exiting 19:07:39 (9819): No heartbeat from core client for 30 sec - exiting 19:07:40 (9819): No heartbeat from core client for 30 sec - exiting 19:07:41 (9819): No heartbeat from core client for 30 sec - exiting 19:07:42 (9819): No heartbeat from core client for 30 sec - exiting 19:07:43 (9819): No heartbeat from core client for 30 sec - exiting 19:07:44 (9819): No heartbeat from core client for 30 sec - exiting 19:07:45 (9819): No heartbeat from core client for 30 sec - exiting 19:07:46 (9819): No heartbeat from core client for 30 sec - exiting 19:07:47 (9819): No heartbeat from core client for 30 sec - exiting 19:07:48 (9819): No heartbeat from core client for 30 sec - exiting 19:07:49 (9819): No heartbeat from core client for 30 sec - exiting 19:07:50 (9819): No heartbeat from core client for 30 sec - exiting 19:07:51 (9819): No heartbeat from core client for 30 sec - exiting 19:07:53 (9819): No heartbeat from core client for 30 sec - exiting 19:07:54 (9819): No heartbeat from core client for 30 sec - exiting 19:07:55 (9819): No heartbeat from core client for 30 sec - exiting 19:07:56 (9819): No heartbeat from core client for 30 sec - exiting 19:07:57 (9819): No heartbeat from core client for 30 sec - exiting 19:07:58 (9819): No heartbeat from core client for 30 sec - exiting 19:07:59 (9819): No heartbeat from core client for 30 sec - exiting 19:08:00 (9819): No heartbeat from core client for 30 sec - exiting 19:08:01 (9819): No heartbeat from core client for 30 sec - exiting 19:08:02 (9819): No heartbeat from core client for 30 sec - exiting 19:08:03 (9819): No heartbeat from core client for 30 sec - exiting 19:08:04 (9819): No heartbeat from core client for 30 sec - exiting 19:08:05 (9819): No heartbeat from core client for 30 sec - exiting 19:08:06 (9819): No heartbeat from core client for 30 sec - exiting 19:08:07 (9819): No heartbeat from core client for 30 sec - exiting 19:08:08 (9819): No heartbeat from core client for 30 sec - exiting 19:08:09 (9819): No heartbeat from core client for 30 sec - exiting 19:08:10 (9819): No heartbeat from core client for 30 sec - exiting 19:08:11 (9819): No heartbeat from core client for 30 sec - exiting 19:08:12 (9819): No heartbeat from core client for 30 sec - exiting 19:08:13 (9819): No heartbeat from core client for 30 sec - exiting 19:08:14 (9819): No heartbeat from core client for 30 sec - exiting 19:08:15 (9819): No heartbeat from core client for 30 sec - exiting 19:08:47 (9819): No heartbeat from core client for 30 sec - exiting 19:08:48 (9819): No heartbeat from core client for 30 sec - exiting 19:08:49 (9819): No heartbeat from core client for 30 sec - exiting 19:08:50 (9819): No heartbeat from core client for 30 sec - exiting 19:08:51 (9819): No heartbeat from core client for 30 sec - exiting 19:08:52 (9819): No heartbeat from core client for 30 sec - exiting 19:08:53 (9819): No heartbeat from core client for 30 sec - exiting 19:08:54 (9819): No heartbeat from core client for 30 sec - exiting 19:08:55 (9819): No heartbeat from core client for 30 sec - exiting 19:08:56 (9819): No heartbeat from core client for 30 sec - exiting 19:08:57 (9819): No heartbeat from core client for 30 sec - exiting 19:09:28 (9819): No heartbeat from core client for 30 sec - exiting 19:09:29 (9819): No heartbeat from core client for 30 sec - exiting 19:09:30 (9819): No heartbeat from core client for 30 sec - exiting 19:09:31 (9819): No heartbeat from core client for 30 sec - exiting 19:09:32 (9819): No heartbeat from core client for 30 sec - exiting 19:09:33 (9819): No heartbeat from core client for 30 sec - exiting 19:09:34 (9819): No heartbeat from core client for 30 sec - exiting 19:09:35 (9819): No heartbeat from core client for 30 sec - exiting 19:09:36 (9819): No heartbeat from core client for 30 sec - exiting 19:09:37 (9819): No heartbeat from core client for 30 sec - exiting 19:09:38 (9819): No heartbeat from core client for 30 sec - exiting 19:09:39 (9819): No heartbeat from core client for 30 sec - exiting 19:09:40 (9819): No heartbeat from core client for 30 sec - exiting 19:09:41 (9819): No heartbeat from core client for 30 sec - exiting 19:09:42 (9819): No heartbeat from core client for 30 sec - exiting 19:09:43 (9819): No heartbeat from core client for 30 sec - exiting 19:09:44 (9819): No heartbeat from core client for 30 sec - exiting 19:09:45 (9819): No heartbeat from core client for 30 sec - exiting 19:09:46 (9819): No heartbeat from core client for 30 sec - exiting 19:09:47 (9819): No heartbeat from core client for 30 sec - exiting 19:09:48 (9819): No heartbeat from core client for 30 sec - exiting 19:09:49 (9819): No heartbeat from core client for 30 sec - exiting 19:09:50 (9819): No heartbeat from core client for 30 sec - exiting 19:09:51 (9819): No heartbeat from core client for 30 sec - exiting 19:09:52 (9819): No heartbeat from core client for 30 sec - exiting 19:09:53 (9819): No heartbeat from core client for 30 sec - exiting 19:09:55 (9819): No heartbeat from core client for 30 sec - exiting 19:09:56 (9819): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Abort request from BOINC... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
26 Jun 2011 23:26:10	1152595	12928119	hadcm3n_o42o_1940_40_007267289_1	155,520	163,529	1.0515
24 Jun 2011 14:24:16	1152595	12928119	hadcm3n_o42o_1940_40_007267289_1	129,600	128,323	0.9901
19 Jun 2011 22:33:26	1152595	12928119	hadcm3n_o42o_1940_40_007267289_1	103,680	98,208	0.9472
16 Jun 2011 12:36:45	1152595	12928119	hadcm3n_o42o_1940_40_007267289_1	77,760	73,590	0.9464
14 Jun 2011 12:02:45	1152595	12928119	hadcm3n_o42o_1940_40_007267289_1	51,840	49,421	0.9533
14 Jun 2011 04:10:05	1152595	12928119	hadcm3n_o42o_1940_40_007267289_1	25,920	25,114	0.9689