Task 13397584

Name	hadcm3n_o4wg_1940_40_007443665_2
Workunit	7641168
Created	19 Sep 2011, 0:28:31 UTC
Sent	19 Sep 2011, 2:23:03 UTC
Report deadline	19 Dec 2011, 9:50:14 UTC
Received	20 Nov 2011, 2:04:55 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	193 (0x000000C1) EXIT_SIGNAL
Computer ID	1170443
Run time	15 days 21 hours 4 min 54 sec
CPU time	12 days 20 hours 41 min 29 sec
Validate state	Invalid
Credit	7,776.00
Device peak FLOPS	2.85 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 i686-apple-darwin
Stderr	<core_client_version>6.12.35</core_client_version> <![CDATA[ <message> process exited with code 193 (0xc1, -63) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 11:35:36 (297): Can't acquire lockfile (-154) - waiting 35s 11:35:53 (286): No heartbeat from core client for 30 sec - exiting 11:35:54 (286): No heartbeat from core client for 30 sec - exiting 11:35:55 (286): No heartbeat from core client for 30 sec - exiting 11:35:56 (286): No heartbeat from core client for 30 sec - exiting 11:35:57 (286): No heartbeat from core client for 30 sec - exiting 11:35:58 (286): No heartbeat from core client for 30 sec - exiting 11:35:59 (286): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 12:43:09 (299): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 63 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 64 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 65 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 66 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 67 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 68 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 69 - Return code = 1 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... hadcm3n_6.07_i686-apple-darwin(2309,0xac0ef2c0) malloc: * error for object 0x110d404: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(2309,0xac0ef2c0) malloc: * error for object 0x110d400: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(2309,0xac0ef2c0) malloc: * error for object 0x110d404: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(2309,0xac0ef2c0) malloc: * error for object 0x110d400: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(2309,0xac0ef2c0) malloc: * error for object 0x110d404: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(2309,0xac0ef2c0) malloc: * error for object 0x110d400: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(2309,0xac0ef2c0) malloc: * error for object 0x110d404: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(2309,0xac0ef2c0) malloc: * error for object 0x110d400: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(2309,0xac0ef2c0) malloc: * error for object 0x110d404: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(2309,0xac0ef2c0) malloc: * error for object 0x110d400: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(2309,0xac0ef2c0) malloc: * error for object 0x10ea404: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(2309,0xac0ef2c0) malloc: * error for object 0x10ea400: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Signal 3 received, exiting... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
18 Nov 2011 08:39:09	1170443	13397584	hadcm3n_o4wg_1940_40_007443665_2	648,000	1,095,230	1.6902
17 Nov 2011 04:02:08	1170443	13397584	hadcm3n_o4wg_1940_40_007443665_2	622,080	1,051,362	1.6901
16 Nov 2011 06:08:35	1170443	13397584	hadcm3n_o4wg_1940_40_007443665_2	596,160	1,007,820	1.6905
16 Nov 2011 06:08:35	1170443	13397584	hadcm3n_o4wg_1940_40_007443665_2	570,240	964,224	1.6909
16 Nov 2011 06:08:35	1170443	13397584	hadcm3n_o4wg_1940_40_007443665_2	544,320	920,227	1.6906
02 Nov 2011 08:57:10	1170443	13397584	hadcm3n_o4wg_1940_40_007443665_2	518,400	876,924	1.6916
01 Nov 2011 12:52:18	1170443	13397584	hadcm3n_o4wg_1940_40_007443665_2	492,480	833,999	1.6935
31 Oct 2011 19:17:52	1170443	13397584	hadcm3n_o4wg_1940_40_007443665_2	466,560	789,753	1.6927
31 Oct 2011 18:58:35	1170443	13397584	hadcm3n_o4wg_1940_40_007443665_2	440,640	745,769	1.6925
31 Oct 2011 18:37:41	1170443	13397584	hadcm3n_o4wg_1940_40_007443665_2	414,720	701,774	1.6922
31 Oct 2011 17:35:04	1170443	13397584	hadcm3n_o4wg_1940_40_007443665_2	388,800	657,878	1.6921
31 Oct 2011 16:52:12	1170443	13397584	hadcm3n_o4wg_1940_40_007443665_2	362,880	614,504	1.6934
31 Oct 2011 15:43:28	1170443	13397584	hadcm3n_o4wg_1940_40_007443665_2	336,960	570,711	1.6937
31 Oct 2011 15:10:39	1170443	13397584	hadcm3n_o4wg_1940_40_007443665_2	311,040	526,618	1.6931
31 Oct 2011 15:10:39	1170443	13397584	hadcm3n_o4wg_1940_40_007443665_2	285,120	482,563	1.6925
31 Oct 2011 15:10:39	1170443	13397584	hadcm3n_o4wg_1940_40_007443665_2	259,200	438,406	1.6914
14 Oct 2011 06:52:33	1170443	13397584	hadcm3n_o4wg_1940_40_007443665_2	233,280	394,630	1.6917
13 Oct 2011 05:46:03	1170443	13397584	hadcm3n_o4wg_1940_40_007443665_2	207,360	350,842	1.6919
12 Oct 2011 02:39:36	1170443	13397584	hadcm3n_o4wg_1940_40_007443665_2	181,440	306,904	1.6915
10 Oct 2011 01:57:27	1170443	13397584	hadcm3n_o4wg_1940_40_007443665_2	155,520	263,615	1.6951