Task 15655050

Name	hadcm3n_4jgz_1940_40_008303565_4
Workunit	8454700
Created	9 Mar 2013, 10:22:22 UTC
Sent	9 Mar 2013, 10:22:38 UTC
Report deadline	8 Jun 2013, 17:49:49 UTC
Received	25 Mar 2013, 16:32:53 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	1101528
Run time	10 days 1 hours 24 min 38 sec
CPU time	6 days 13 hours 38 min 13 sec
Validate state	Invalid
Credit	5,287.68
Device peak FLOPS	3.14 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 i686-apple-darwin
Stderr	<core_client_version>7.0.31</core_client_version> <![CDATA[ <message> process exited with code 22 (0x16, -234) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... SIGSEGV: segmentation violation hadcm3n_6.07_i686-apple-darwin(11827,0xa0032540) malloc: * error for object 0x82d404: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(11827,0xa0032540) malloc: * error for object 0x82d400: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(11827,0xa0032540) malloc: * error for object 0x82d404: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(11827,0xa0032540) malloc: * error for object 0x82d400: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(11827,0xa0032540) malloc: * error for object 0x82d404: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(11827,0xa0032540) malloc: * error for object 0x82d400: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(11827,0xa0032540) malloc: * error for object 0x82d404: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(11827,0xa0032540) malloc: * error for object 0x82d400: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(11827,0xa0032540) malloc: * error for object 0x82d404: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(11827,0xa0032540) malloc: * error for object 0x82d400: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(11827,0xa0032540) malloc: * error for object 0x82d404: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(11827,0xa0032540) malloc: * error for object 0x82d400: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 Sorry, too many model crashes! :-( Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
25 Mar 2013 14:35:24	1101528	15655050	hadcm3n_4jgz_1940_40_008303565_4	440,640	779,673	1.7694
25 Mar 2013 01:15:21	1101528	15655050	hadcm3n_4jgz_1940_40_008303565_4	414,720	733,542	1.7688
24 Mar 2013 10:22:34	1101528	15655050	hadcm3n_4jgz_1940_40_008303565_4	388,800	687,751	1.7689
23 Mar 2013 20:21:24	1101528	15655050	hadcm3n_4jgz_1940_40_008303565_4	362,880	641,214	1.7670
23 Mar 2013 06:22:23	1101528	15655050	hadcm3n_4jgz_1940_40_008303565_4	336,960	594,460	1.7642
22 Mar 2013 13:00:19	1101528	15655050	hadcm3n_4jgz_1940_40_008303565_4	311,040	549,336	1.7661
21 Mar 2013 12:15:04	1101528	15655050	hadcm3n_4jgz_1940_40_008303565_4	285,120	503,775	1.7669
20 Mar 2013 08:37:00	1101528	15655050	hadcm3n_4jgz_1940_40_008303565_4	259,200	459,029	1.7709
17 Mar 2013 05:43:21	1101528	15655050	hadcm3n_4jgz_1940_40_008303565_4	233,280	414,008	1.7747
16 Mar 2013 10:38:55	1101528	15655050	hadcm3n_4jgz_1940_40_008303565_4	207,360	367,597	1.7727
15 Mar 2013 14:45:24	1101528	15655050	hadcm3n_4jgz_1940_40_008303565_4	181,440	322,078	1.7751
14 Mar 2013 20:17:58	1101528	15655050	hadcm3n_4jgz_1940_40_008303565_4	155,520	276,872	1.7803
14 Mar 2013 01:02:33	1101528	15655050	hadcm3n_4jgz_1940_40_008303565_4	129,600	231,243	1.7843
13 Mar 2013 06:54:25	1101528	15655050	hadcm3n_4jgz_1940_40_008303565_4	103,680	185,304	1.7873
12 Mar 2013 11:07:11	1101528	15655050	hadcm3n_4jgz_1940_40_008303565_4	77,760	139,775	1.7975
11 Mar 2013 16:50:57	1101528	15655050	hadcm3n_4jgz_1940_40_008303565_4	51,840	93,027	1.7945
11 Mar 2013 00:55:11	1101528	15655050	hadcm3n_4jgz_1940_40_008303565_4	25,920	46,421	1.7909