Task 19420896

Name	hadcm3n_sdii_198012_480_375_010415216_0
Workunit	10415216
Created	21 Mar 2016, 16:56:06 UTC
Sent	22 Mar 2016, 13:33:47 UTC
Report deadline	4 Mar 2017, 18:53:47 UTC
Received	31 Mar 2016, 19:16:37 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	193 (0x000000C1) EXIT_SIGNAL
Computer ID	1360088
Run time	6 days 20 hours 21 min 2 sec
CPU time	6 days 17 hours 51 min 41 sec
Validate state	Invalid
Credit	12,441.60
Device peak FLOPS	4.90 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 i686-apple-darwin
Stderr	<core_client_version>7.4.42</core_client_version> <![CDATA[ <message> process exited with code 193 (0xc1, -63) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 63 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 64 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 65 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 66 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 67 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 68 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 69 - Return code = 1 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... hadcm3n_6.07_i686-apple-darwin(96467,0xa3f17000) malloc: * error for object 0x1022004: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(96467,0xa3f17000) malloc: * error for object 0x1022000: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(96467,0xa3f17000) malloc: * error for object 0x830a04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(96467,0xa3f17000) malloc: * error for object 0x282f004: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation hadcm3n_6.07_i686-apple-darwin(96791,0xa3f17000) malloc: * error for object 0x1820604: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation hadcm3n_6.07_i686-apple-darwin(97789,0xa3f17000) malloc: * error for object 0x2824604: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation Crashed executable name: hadcm3n_6.07_i686-apple-darwin built using BOINC library version 6.13.0 Machine type Intel 80486 (32-bit executable) System version: Macintosh OS 10.11.4 build 15E65 Wed Mar 30 17:41:49 2016 SIGSEGV: segmentation violation hadcm3n_6.07_i686-apple-darwin(4894,0xa3f17000) malloc: * error for object 0x2824604: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(4894,0xa3f17000) malloc: * error for object 0x182f204: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(4894,0xa3f17000) malloc: * error for object 0x2824604: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(4894,0xa3f17000) malloc: * error for object 0x840e04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(4894,0xa3f17000) malloc: * error for object 0x2817004: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation Crashed executable name: hadcm3n_6.07_i686-apple-darwin built using BOINC library version 6.13.0 Machine type Intel 80486 (32-bit executable) hadcm3n_6.07_i686-apple-darwin(5392,0xa3f17000) malloc: * error for object 0x2027604: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation hadcm3n_6.07_i686-apple-darwin(7370,0xa3f17000) malloc: * error for object 0x103b204: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(7370,0xa3f17000) malloc: * error for object 0x2027604: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(7370,0xa3f17000) malloc: * error for object 0x3005804: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(7370,0xa3f17000) malloc: * error for object 0x3006604: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation hadcm3n_6.07_i686-apple-darwin(7370,0xa3f17000) malloc: * error for object 0x800e04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(7370,0xa3f17000) malloc: * error for object 0x800e00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug Crashed executable name: hadcm3n_6.07_i686-apple-darwin built using BOINC library version 6.13.0 Machine type Intel 80486 (32-bit executable) System version: Macintosh OS 10.11.4 build 15E65 Thu Mar 31 13:14:02 2016 Thread 0 Crashed: Thread 1: atos cannot load symbols for the file hadcm3n_6.07_i686-apple-darwin for architecture i386. Thread 0 crashed with X86 Thread State (32-bit): eax: 0x00000000 ebx: 0x00000000 ecx: 0x00000000 edx: 0x00000000 edi: 0x00000000 esi: 0x00000000 ebp: 0xbff8fd38 esp: 0x00000000 ss: 0x00000000 efl: 0x00000000 eip: 0x0007697e cs: 0x00000000 ds: 0x00000000 es: 0x00000000 fs: 0x00000000 gs: 0x00000000 Binary Images Description: 0x1000 - 0x93fff /Library/Application Support/BOINC Data/slots/2/../../projects/climateprediction.net/hadcm3n_6.07_i686-apple-darwin 0x127000 - 0x17afff /usr/lib/libstdc++.6.dylib 0x90103000 - 0x9010cfff /usr/lib/system/libcopyfile.dylib 0x903e8000 - 0x903e8fff /usr/lib/system/libkeymgr.dylib 0x906c1000 - 0x906c6fff /usr/lib/system/libcompiler_rt.dylib 0x9100f000 - 0x910a4fff /usr/lib/system/libsystem_c.dylib 0x92bb8000 - 0x92c1ffff /usr/lib/system/libcorecrypto.dylib 0x9330a000 - 0x93315fff /usr/lib/system/libcommonCrypto.dylib 0x93824000 - 0x93824fff /usr/lib/system/libsystem_blocks.dylib 0x93c62000 - 0x93c65fff /usr/lib/system/libdyld.dylib 0x941ea000 - 0x94258fff /usr/lib/system/libsystem_network.dylib 0x94413000 - 0x9441dfff /usr/lib/system/libsystem_notify.dylib 0x959a0000 - 0x959aefff /usr/lib/libz.1.dylib 0x9727f000 - 0x97285fff /usr/lib/system/libsystem_platform.dylib 0x974c3000 - 0x974ccfff /usr/lib/system/libsystem_networkextension.dylib 0x974cd000 - 0x974f0fff /usr/lib/libc++abi.dylib 0x978a6000 - 0x978a8fff /usr/lib/system/libsystem_coreservices.dylib 0x978a9000 - 0x978dcfff /usr/lib/system/libsystem_m.dylib 0x9a3e5000 - 0x9a406fff /usr/lib/system/libsystem_kernel.dylib 0x9a43e000 - 0x9a440fff /usr/lib/system/libsystem_secinit.dylib 0x9aa5c000 - 0x9aa62fff /usr/lib/system/libunwind.dylib 0x9b056000 - 0x9b06ffff /usr/lib/system/libsystem_asl.dylib 0x9bf0b000 - 0x9bf13fff /usr/lib/system/libsystem_pthread.dylib 0x9c1cd000 - 0x9c1cdfff /usr/lib/system/libunc.dylib 0x9c202000 - 0x9c207fff /usr/lib/system/libmacho.dylib 0x9c9fc000 - 0x9ca13fff /usr/lib/system/libsystem_coretls.dylib 0x9ca7f000 - 0x9ca81fff /usr/lib/system/libquarantine.dylib 0x9ca82000 - 0x9caaafff /usr/lib/system/libxpc.dylib 0x9caab000 - 0x9caaffff /usr/lib/system/libcache.dylib 0x9cb88000 - 0x9cb99fff /usr/lib/system/libsystem_trace.dylib 0x9cb9a000 - 0x9cbc4fff /usr/lib/system/libdispatch.dylib 0x9cbc5000 - 0x9cbc5fff /usr/lib/system/liblaunch.dylib 0x9cbc6000 - 0x9cbc9fff /usr/lib/system/libsystem_sandbox.dylib 0x9cbca000 - 0x9cbccfff /usr/lib/system/libsystem_configuration.dylib 0x9ccef000 - 0x9cd19fff /usr/lib/system/libsystem_info.dylib 0x9ced4000 - 0x9cedcfff /usr/lib/system/libsystem_dnssd.dylib 0x9d0f9000 - 0x9d0fafff /usr/lib/libSystem.B.dylib 0x9dde1000 - 0x9ddfafff /usr/lib/system/libsystem_malloc.dylib 0x9ecb3000 - 0x9ecb4fff /usr/lib/system/libremovefile.dylib Exiting... </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
30 Mar 2016 21:10:17	1360088	19420896	hadcm3n_sdii_198012_480_375_010415216_0	1,036,800	582,462	0.5618
30 Mar 2016 11:44:19	1360088	19420896	hadcm3n_sdii_198012_480_375_010415216_0	1,010,880	567,990	0.5619
30 Mar 2016 07:41:21	1360088	19420896	hadcm3n_sdii_198012_480_375_010415216_0	984,960	553,444	0.5619
30 Mar 2016 03:33:49	1360088	19420896	hadcm3n_sdii_198012_480_375_010415216_0	959,040	538,816	0.5618
29 Mar 2016 21:30:06	1360088	19420896	hadcm3n_sdii_198012_480_375_010415216_0	933,120	524,148	0.5617
29 Mar 2016 11:46:15	1360088	19420896	hadcm3n_sdii_198012_480_375_010415216_0	907,200	509,511	0.5616
29 Mar 2016 07:38:47	1360088	19420896	hadcm3n_sdii_198012_480_375_010415216_0	881,280	494,961	0.5616
29 Mar 2016 03:37:10	1360088	19420896	hadcm3n_sdii_198012_480_375_010415216_0	855,360	480,427	0.5617
28 Mar 2016 23:30:15	1360088	19420896	hadcm3n_sdii_198012_480_375_010415216_0	829,440	465,902	0.5617
28 Mar 2016 19:23:22	1360088	19420896	hadcm3n_sdii_198012_480_375_010415216_0	803,520	451,360	0.5617
28 Mar 2016 15:21:25	1360088	19420896	hadcm3n_sdii_198012_480_375_010415216_0	777,600	436,868	0.5618
28 Mar 2016 11:19:21	1360088	19420896	hadcm3n_sdii_198012_480_375_010415216_0	751,680	422,354	0.5619
28 Mar 2016 07:12:39	1360088	19420896	hadcm3n_sdii_198012_480_375_010415216_0	725,760	407,814	0.5619
28 Mar 2016 03:06:44	1360088	19420896	hadcm3n_sdii_198012_480_375_010415216_0	699,840	393,268	0.5619
27 Mar 2016 23:05:50	1360088	19420896	hadcm3n_sdii_198012_480_375_010415216_0	673,920	378,742	0.5620
27 Mar 2016 18:59:47	1360088	19420896	hadcm3n_sdii_198012_480_375_010415216_0	648,000	364,206	0.5620
27 Mar 2016 14:53:00	1360088	19420896	hadcm3n_sdii_198012_480_375_010415216_0	622,080	349,671	0.5621
27 Mar 2016 10:51:41	1360088	19420896	hadcm3n_sdii_198012_480_375_010415216_0	596,160	335,127	0.5621
27 Mar 2016 06:46:10	1360088	19420896	hadcm3n_sdii_198012_480_375_010415216_0	570,240	320,584	0.5622
27 Mar 2016 02:40:47	1360088	19420896	hadcm3n_sdii_198012_480_375_010415216_0	544,320	306,021	0.5622