Task 12831800

Name	hadcm3n_p6g0_1900_40_007225936_1
Workunit	7424176
Created	26 Apr 2011, 15:36:12 UTC
Sent	27 Apr 2011, 11:34:29 UTC
Report deadline	27 Jul 2011, 19:01:40 UTC
Received	24 May 2011, 14:59:06 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	193 (0x000000C1) EXIT_SIGNAL
Computer ID	1143614
Run time	21 days 15 hours 35 min 8 sec
CPU time	16 days 16 hours 40 min 58 sec
Validate state	Invalid
Credit	9,642.24
Device peak FLOPS	3.18 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 i686-apple-darwin
Stderr	<core_client_version>6.10.58</core_client_version> <![CDATA[ <message> process exited with code 193 (0xc1, -63) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 07:48:54 (34647): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:48:55 (34647): No heartbeat from core client for 30 sec - exiting 07:48:56 (34647): No heartbeat from core client for 30 sec - exiting 07:48:57 (34647): No heartbeat from core client for 30 sec - exiting 07:48:58 (34647): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 08:30:49 (2526): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 03:17:41 (39092): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:17:43 (39092): No heartbeat from core client for 30 sec - exiting 03:17:44 (39092): No heartbeat from core client for 30 sec - exiting 03:17:45 (39092): No heartbeat from core client for 30 sec - exiting 03:17:46 (39092): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... 08:14:53 (50911): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... hadcm3n_6.07_i686-apple-darwin(18608,0xa0577540) malloc: * error for object 0x802e004: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(18608,0xa0577540) malloc: * error for object 0x3023a04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(18608,0xa0577540) malloc: * error for object 0x201f604: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(18608,0xa0577540) malloc: * error for object 0x3820a04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(18608,0xa0577540) malloc: * error for object 0x3820a00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(18608,0xa0577540) malloc: * error for object 0xd808e04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(18608,0xa0577540) malloc: * error for object 0xd809c04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(18608,0xa0577540) malloc: * error for object 0xd809c00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(18608,0xa0577540) malloc: * error for object 0xd809c04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(18608,0xa0577540) malloc: * error for object 0xd809c00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(18608,0xa0577540) malloc: * error for object 0xd809c04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(18608,0xa0577540) malloc: * error for object 0xd809c00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(18608,0xa0577540) malloc: * error for object 0xd809c04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(18608,0xa0577540) malloc: * error for object 0xd809c00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(18608,0xa0577540) malloc: * error for object 0xd809c04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(18608,0xa0577540) malloc: * error for object 0xd809c00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 05:06:21 (64341): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 03:39:25 (34491): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:39:31 (34491): No heartbeat from core client for 30 sec - exiting 03:39:32 (34491): No heartbeat from core client for 30 sec - exiting 03:39:33 (34491): No heartbeat from core client for 30 sec - exiting 03:39:34 (34491): No heartbeat from core client for 30 sec - exiting 03:39:35 (34491): No heartbeat from core client for 30 sec - exiting 03:39:36 (34491): No heartbeat from core client for 30 sec - exiting 03:39:37 (34491): No heartbeat from core client for 30 sec - exiting 03:39:38 (34491): No heartbeat from core client for 30 sec - exiting 03:39:39 (34491): No heartbeat from core client for 30 sec - exiting 03:39:40 (34491): No heartbeat from core client for 30 sec - exiting 03:39:41 (34491): No heartbeat from core client for 30 sec - exiting 03:39:42 (34491): No heartbeat from core client for 30 sec - exiting 03:39:43 (34491): No heartbeat from core client for 30 sec - exiting 03:39:52 (34491): No heartbeat from core client for 30 sec - exiting 03:44:08 (43119): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:44:13 (43119): No heartbeat from core client for 30 sec - exiting 03:44:14 (43119): No heartbeat from core client for 30 sec - exiting 03:44:15 (43119): No heartbeat from core client for 30 sec - exiting 03:44:16 (43119): No heartbeat from core client for 30 sec - exiting 03:44:17 (43119): No heartbeat from core client for 30 sec - exiting 03:44:18 (43119): No heartbeat from core client for 30 sec - exiting 03:44:19 (43119): No heartbeat from core client for 30 sec - exiting 03:44:20 (43119): No heartbeat from core client for 30 sec - exiting 03:44:21 (43119): No heartbeat from core client for 30 sec - exiting 03:44:22 (43119): No heartbeat from core client for 30 sec - exiting 03:44:23 (43119): No heartbeat from core client for 30 sec - exiting 03:44:24 (43119): No heartbeat from core client for 30 sec - exiting 03:44:25 (43119): No heartbeat from core client for 30 sec - exiting 03:44:26 (43119): No heartbeat from core client for 30 sec - exiting 03:44:27 (43119): No heartbeat from core client for 30 sec - exiting 03:46:18 (43275): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:46:21 (43275): No heartbeat from core client for 30 sec - exiting 03:46:22 (43275): No heartbeat from core client for 30 sec - exiting 03:46:23 (43275): No heartbeat from core client for 30 sec - exiting 03:46:24 (43275): No heartbeat from core client for 30 sec - exiting 03:46:25 (43275): No heartbeat from core client for 30 sec - exiting 03:46:26 (43275): No heartbeat from core client for 30 sec - exiting 03:46:27 (43275): No heartbeat from core client for 30 sec - exiting 03:46:28 (43275): No heartbeat from core client for 30 sec - exiting 03:46:29 (43275): No heartbeat from core client for 30 sec - exiting 03:46:30 (43275): No heartbeat from core client for 30 sec - exiting 03:46:31 (43275): No heartbeat from core client for 30 sec - exiting 03:46:32 (43275): No heartbeat from core client for 30 sec - exiting 03:46:33 (43275): No heartbeat from core client for 30 sec - exiting 03:46:34 (43275): No heartbeat from core client for 30 sec - exiting 04:19:22 (43402): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:19:23 (43402): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 11:43:52 (52319): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:43:58 (52319): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Signal 3 received, exiting... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
24 May 2011 04:52:08	1143614	12831800	hadcm3n_p6g0_1900_40_007225936_1	803,520	1,410,562	1.7555
23 May 2011 06:01:07	1143614	12831800	hadcm3n_p6g0_1900_40_007225936_1	777,600	1,371,213	1.7634
22 May 2011 17:43:46	1143614	12831800	hadcm3n_p6g0_1900_40_007225936_1	751,680	1,338,502	1.7807
22 May 2011 05:26:25	1143614	12831800	hadcm3n_p6g0_1900_40_007225936_1	725,760	1,305,559	1.7989
21 May 2011 14:06:32	1143614	12831800	hadcm3n_p6g0_1900_40_007225936_1	699,840	1,269,241	1.8136
20 May 2011 23:08:30	1143614	12831800	hadcm3n_p6g0_1900_40_007225936_1	673,920	1,232,825	1.8293
20 May 2011 08:18:38	1143614	12831800	hadcm3n_p6g0_1900_40_007225936_1	648,000	1,196,794	1.8469
19 May 2011 17:57:44	1143614	12831800	hadcm3n_p6g0_1900_40_007225936_1	622,080	1,161,197	1.8666
19 May 2011 04:55:24	1143614	12831800	hadcm3n_p6g0_1900_40_007225936_1	596,160	1,125,823	1.8885
18 May 2011 13:57:39	1143614	12831800	hadcm3n_p6g0_1900_40_007225936_1	570,240	1,085,728	1.9040
17 May 2011 21:36:33	1143614	12831800	hadcm3n_p6g0_1900_40_007225936_1	544,320	1,040,189	1.9110
17 May 2011 00:35:48	1143614	12831800	hadcm3n_p6g0_1900_40_007225936_1	518,400	993,804	1.9171
16 May 2011 06:15:41	1143614	12831800	hadcm3n_p6g0_1900_40_007225936_1	492,480	947,436	1.9238
15 May 2011 13:04:47	1143614	12831800	hadcm3n_p6g0_1900_40_007225936_1	466,560	901,519	1.9323
14 May 2011 21:50:12	1143614	12831800	hadcm3n_p6g0_1900_40_007225936_1	440,640	857,403	1.9458
14 May 2011 04:26:28	1143614	12831800	hadcm3n_p6g0_1900_40_007225936_1	414,720	816,447	1.9687
13 May 2011 10:50:47	1143614	12831800	hadcm3n_p6g0_1900_40_007225936_1	388,800	774,565	1.9922
12 May 2011 17:18:03	1143614	12831800	hadcm3n_p6g0_1900_40_007225936_1	362,880	732,725	2.0192
11 May 2011 19:15:08	1143614	12831800	hadcm3n_p6g0_1900_40_007225936_1	336,960	687,624	2.0407
09 May 2011 21:02:57	1143614	12831800	hadcm3n_p6g0_1900_40_007225936_1	311,040	640,598	2.0595