Task 15991976

Name	hadcm3n_804j_1980_40_008458102_0
Workunit	8608958
Created	30 Aug 2013, 20:03:56 UTC
Sent	8 Sep 2013, 22:30:31 UTC
Report deadline	9 Dec 2013, 5:57:42 UTC
Received	19 Sep 2013, 15:53:12 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	193 (0x000000C1) EXIT_SIGNAL
Computer ID	1176682
Run time	8 days 9 hours 17 min 50 sec
CPU time	7 days 12 hours 3 min 43 sec
Validate state	Invalid
Credit	6,220.80
Device peak FLOPS	3.50 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 i686-apple-darwin
Stderr	<core_client_version>7.0.65</core_client_version> <![CDATA[ <message> process exited with code 193 (0xc1, -63) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... hadcm3n_6.07_i686-apple-darwin(11620,0xad0c82c0) malloc: * error for object 0x1b4e804: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation hadcm3n_6.07_i686-apple-darwin(15327,0xad0c82c0) malloc: * error for object 0x1a0ea04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(15327,0xad0c82c0) malloc: * error for object 0x3a1aa04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(15327,0xad0c82c0) malloc: * error for object 0x31f9604: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(15327,0xad0c82c0) malloc: * error for object 0x31f9600: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(15327,0xad0c82c0) malloc: * error for object 0x9e0004: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(15327,0xad0c82c0) malloc: * error for object 0x9e0000: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(15327,0xad0c82c0) malloc: * error for object 0x9e0004: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(15327,0xad0c82c0) malloc: * error for object 0x9e0000: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(15327,0xad0c82c0) malloc: * error for object 0x9e0004: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(15327,0xad0c82c0) malloc: * error for object 0x9e0000: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(15327,0xad0c82c0) malloc: * error for object 0x9e0004: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(15327,0xad0c82c0) malloc: * error for object 0x9e0000: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(15327,0xad0c82c0) malloc: * error for object 0x9e0004: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(15327,0xad0c82c0) malloc: * error for object 0x9e0000: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(15327,0xad0c82c0) malloc: * error for object 0x29d7204: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(15327,0xad0c82c0) malloc: * error for object 0x29e5804: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... hadcm3n_6.07_i686-apple-darwin(61577,0xad0c82c0) malloc: * error for object 0x3204e00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation hadcm3n_6.07_i686-apple-darwin(61577,0xad0c82c0) malloc: * error for object 0x4204e04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(61577,0xad0c82c0) malloc: * error for object 0x4204e00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug Crashed executable name: hadcm3n_6.07_i686-apple-darwin built using BOINC library version 6.13.0 Machine type Intel 80486 (32-bit executable) System version: Macintosh OS 10.7.5 build 11G63 Thu Sep 19 11:15:11 2013 Thread 0 Crashed: Thread 1: atos cannot load symbols for the file hadcm3n_6.07_i686-apple-darwin for architecture i386. Thread 0 crashed with X86 Thread State (32-bit): eax: 0x00000000 ebx: 0x00000000 ecx: 0x00000000 edx: 0x00000000 edi: 0x00000000 esi: 0x00000000 ebp: 0xbff8fad8 esp: 0x00000000 ss: 0x00000000 efl: 0x00000000 eip: 0x0007697e cs: 0x00000000 ds: 0x00000000 es: 0x00000000 fs: 0x00000000 gs: 0x00000000 Binary Images Description: 0x1000 - 0x93fff /Library/Application Support/BOINC Data/slots/9/../../projects/climateprediction.net/hadcm3n_6.07_i686-apple-darwin 0x9062c000 - 0x9065bfff /usr/lib/system/libsystem_info.dylib 0x91333000 - 0x91336fff /usr/lib/system/libmathCommon.A.dylib 0x9183e000 - 0x91846fff /usr/lib/system/liblaunch.dylib 0x91881000 - 0x9189ffff /usr/lib/system/libsystem_kernel.dylib 0x918a0000 - 0x918aefff /usr/lib/system/libdispatch.dylib 0x91ed1000 - 0x91ed5fff /usr/lib/system/libcache.dylib 0x91f29000 - 0x91f2afff /usr/lib/system/libquarantine.dylib 0x9224b000 - 0x92279fff /usr/lib/libSystem.B.dylib 0x92965000 - 0x9296dfff /usr/lib/system/libcopyfile.dylib 0x9317a000 - 0x9317cfff /usr/lib/system/libdyld.dylib 0x93e09000 - 0x93e10fff /usr/lib/system/libsystem_dnssd.dylib 0x947e2000 - 0x947eafff /usr/lib/system/libunwind.dylib 0x9483d000 - 0x94853fff /usr/lib/system/libxpc.dylib 0x9494e000 - 0x94957fff /usr/lib/libc++abi.dylib 0x949a3000 - 0x949a4fff /usr/lib/system/libsystem_sandbox.dylib 0x949a6000 - 0x949a7fff /usr/lib/system/libsystem_blocks.dylib 0x96a5f000 - 0x96a5ffff /usr/lib/system/libdnsinfo.dylib 0x96b79000 - 0x96bdbfff /usr/lib/libstdc++.6.dylib 0x96cdc000 - 0x96cddfff /usr/lib/system/libremovefile.dylib 0x971b0000 - 0x971b1fff /usr/lib/system/libunc.dylib 0x971b2000 - 0x971b6fff /usr/lib/system/libsystem_network.dylib 0x9884d000 - 0x98890fff /usr/lib/system/libcommonCrypto.dylib 0x9905d000 - 0x99064fff /usr/lib/system/libsystem_notify.dylib 0x99dc7000 - 0x99dccfff /usr/lib/system/libmacho.dylib 0x9a6bf000 - 0x9a6bffff /usr/lib/system/libkeymgr.dylib 0x9b510000 - 0x9b513fff /usr/lib/system/libcompiler_rt.dylib 0x9b514000 - 0x9b5dffff /usr/lib/system/libsystem_c.dylib 0x9cdec000 - 0x9cdfafff /usr/lib/libz.1.dylib Exiting... </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
19 Sep 2013 15:55:56	1176682	15991976	hadcm3n_804j_1980_40_008458102_0	518,400	648,220	1.2504
19 Sep 2013 06:16:44	1176682	15991976	hadcm3n_804j_1980_40_008458102_0	492,480	616,711	1.2523
18 Sep 2013 19:48:44	1176682	15991976	hadcm3n_804j_1980_40_008458102_0	466,560	585,231	1.2544
18 Sep 2013 09:33:28	1176682	15991976	hadcm3n_804j_1980_40_008458102_0	440,640	553,817	1.2568
17 Sep 2013 20:54:13	1176682	15991976	hadcm3n_804j_1980_40_008458102_0	414,720	522,165	1.2591
17 Sep 2013 11:21:50	1176682	15991976	hadcm3n_804j_1980_40_008458102_0	388,800	489,818	1.2598
16 Sep 2013 16:34:04	1176682	15991976	hadcm3n_804j_1980_40_008458102_0	362,880	457,403	1.2605
16 Sep 2013 05:05:13	1176682	15991976	hadcm3n_804j_1980_40_008458102_0	336,960	425,065	1.2615
15 Sep 2013 17:06:29	1176682	15991976	hadcm3n_804j_1980_40_008458102_0	311,040	392,535	1.2620
15 Sep 2013 06:58:24	1176682	15991976	hadcm3n_804j_1980_40_008458102_0	285,120	359,948	1.2624
14 Sep 2013 19:45:39	1176682	15991976	hadcm3n_804j_1980_40_008458102_0	259,200	326,769	1.2607
14 Sep 2013 08:17:50	1176682	15991976	hadcm3n_804j_1980_40_008458102_0	233,280	293,055	1.2562
13 Sep 2013 20:38:42	1176682	15991976	hadcm3n_804j_1980_40_008458102_0	207,360	259,450	1.2512
11 Sep 2013 21:50:23	1176682	15991976	hadcm3n_804j_1980_40_008458102_0	181,440	225,785	1.2444
11 Sep 2013 11:21:46	1176682	15991976	hadcm3n_804j_1980_40_008458102_0	155,520	192,042	1.2348
11 Sep 2013 00:58:58	1176682	15991976	hadcm3n_804j_1980_40_008458102_0	129,600	158,452	1.2226
10 Sep 2013 13:35:50	1176682	15991976	hadcm3n_804j_1980_40_008458102_0	103,680	125,396	1.2095
10 Sep 2013 03:57:29	1176682	15991976	hadcm3n_804j_1980_40_008458102_0	77,760	93,720	1.2052
09 Sep 2013 18:23:21	1176682	15991976	hadcm3n_804j_1980_40_008458102_0	51,840	62,195	1.1997
09 Sep 2013 08:53:11	1176682	15991976	hadcm3n_804j_1980_40_008458102_0	25,920	30,875	1.1912