Task 15454368

Name	hadcm3n_zme1_1880_40_008251467_0
Workunit	8406591
Created	22 Nov 2012, 17:22:37 UTC
Sent	22 Nov 2012, 17:23:42 UTC
Report deadline	22 Feb 2013, 0:50:53 UTC
Received	20 Mar 2013, 9:36:11 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	193 (0x000000C1) EXIT_SIGNAL
Computer ID	987869
Run time	12 days 10 hours 40 min 53 sec
CPU time	11 days 15 hours 7 min 19 sec
Validate state	Invalid
Credit	6,531.84
Device peak FLOPS	2.76 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 i686-apple-darwin
Stderr	<core_client_version>7.0.31</core_client_version> <![CDATA[ <message> process exited with code 193 (0xc1, -63) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... hadcm3n_6.07_i686-apple-darwin(6178,0xa031f540) malloc: * error for object 0x802a04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(6178,0xa031f540) malloc: * error for object 0x802a00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(6178,0xa031f540) malloc: * error for object 0x1814204: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(6178,0xa031f540) malloc: * error for object 0x1814200: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(6178,0xa031f540) malloc: * error for object 0x2009c00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation Crashed executable name: hadcm3n_6.07_i686-apple-darwin built using BOINC library version 6.13.0 Machine type Intel 80486 (32-bit executable) System version: Macintosh OS 10.6.8 build 10K549 Mon Jan 7 15:39:46 2013 Thread 0 Crashed: atos cannot load symbols for the file hadcm3n_6.07_i686-apple-darwin. 0 libSystem.B.dylib 0x92e08b0f small_free_list_remove_ptr + 246 1 libSystem.B.dylib 0x92e055cc szone_free_definite_size + 3457 2 libSystem.B.dylib 0x92e045e8 free + 244 3 hadcm3n_6.07_i686-apple-darwin 0x0000ba58 annual_cycle(std::vector<std::basic_string<char, std::char_traits<char>, std::allocator<char> >, std::allocator<std::basic_string<char, std::char_traits<char>, std::allocator<char> > > > const, char const, int, int) + 3482 4 hadcm3n_6.07_i686-apple-darwin 0x0000d36b decadalMeans(int, char const) + 957 5 hadcm3n_6.07_i686-apple-darwin 0x000067ff doCM3Proc() + 185 6 hadcm3n_6.07_i686-apple-darwin 0x0000791c mainLoop() + 410 7 hadcm3n_6.07_i686-apple-darwin 0x000087c7 worker() + 2989 8 hadcm3n_6.07_i686-apple-darwin 0x00008aa9 main + 491 9 hadcm3n_6.07_i686-apple-darwin 0x00002676 start + 54 Thread 1: hadcm3n_6.07_i686-apple-darwin(360,0xa031f540) malloc: error for object 0x822604: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(360,0xa031f540) malloc: * error for object 0x822600: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(360,0xa031f540) malloc: * error for object 0x3801c04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(360,0xa031f540) malloc: * error for object 0x3801c00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(360,0xa031f540) malloc: * error for object 0x3801c04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(360,0xa031f540) malloc: * error for object 0x3801c00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(360,0xa031f540) malloc: * error for object 0x3801c04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(360,0xa031f540) malloc: * error for object 0x3801c00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(360,0xa031f540) malloc: * error for object 0x3801c04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(360,0xa031f540) malloc: * error for object 0x3801c00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(360,0xa031f540) malloc: * error for object 0x3801c04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(360,0xa031f540) malloc: * error for object 0x3801c00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Signal 3 received, exiting... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
18 Mar 2013 13:50:10	987869	15454368	hadcm3n_zme1_1880_40_008251467_0	544,320	973,729	1.7889
13 Mar 2013 11:10:32	987869	15454368	hadcm3n_zme1_1880_40_008251467_0	518,400	924,757	1.7839
11 Mar 2013 13:09:40	987869	15454368	hadcm3n_zme1_1880_40_008251467_0	492,480	875,420	1.7776
06 Mar 2013 13:30:08	987869	15454368	hadcm3n_zme1_1880_40_008251467_0	466,560	827,161	1.7729
04 Mar 2013 11:39:16	987869	15454368	hadcm3n_zme1_1880_40_008251467_0	440,640	779,010	1.7679
06 Feb 2013 10:08:24	987869	15454368	hadcm3n_zme1_1880_40_008251467_0	414,720	729,963	1.7601
01 Feb 2013 16:21:36	987869	15454368	hadcm3n_zme1_1880_40_008251467_0	388,800	681,099	1.7518
30 Jan 2013 10:18:22	987869	15454368	hadcm3n_zme1_1880_40_008251467_0	362,880	635,433	1.7511
28 Jan 2013 15:30:34	987869	15454368	hadcm3n_zme1_1880_40_008251467_0	336,960	598,997	1.7777
25 Jan 2013 09:10:22	987869	15454368	hadcm3n_zme1_1880_40_008251467_0	311,040	551,764	1.7739
23 Jan 2013 11:58:46	987869	15454368	hadcm3n_zme1_1880_40_008251467_0	285,120	508,638	1.7839
07 Jan 2013 15:41:44	987869	15454368	hadcm3n_zme1_1880_40_008251467_0	259,200	461,365	1.7800
03 Jan 2013 17:01:15	987869	15454368	hadcm3n_zme1_1880_40_008251467_0	233,280	416,255	1.7844
02 Jan 2013 10:15:26	987869	15454368	hadcm3n_zme1_1880_40_008251467_0	207,360	371,885	1.7934
20 Dec 2012 11:17:29	987869	15454368	hadcm3n_zme1_1880_40_008251467_0	181,440	326,389	1.7989
17 Dec 2012 17:16:14	987869	15454368	hadcm3n_zme1_1880_40_008251467_0	155,520	281,217	1.8082
14 Dec 2012 12:35:29	987869	15454368	hadcm3n_zme1_1880_40_008251467_0	129,600	235,193	1.8148
07 Dec 2012 13:27:47	987869	15454368	hadcm3n_zme1_1880_40_008251467_0	103,680	189,687	1.8295
05 Dec 2012 11:19:56	987869	15454368	hadcm3n_zme1_1880_40_008251467_0	77,760	146,493	1.8839
29 Nov 2012 11:18:03	987869	15454368	hadcm3n_zme1_1880_40_008251467_0	51,840	97,491	1.8806