Task 16587719

Name	hadcm3n_8aek_1980_40_008722903_0
Workunit	8868881
Created	23 Apr 2014, 12:53:44 UTC
Sent	4 May 2014, 4:57:55 UTC
Report deadline	3 Aug 2014, 12:25:06 UTC
Received	12 Jun 2014, 8:53:32 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	193 (0x000000C1) EXIT_SIGNAL
Computer ID	1319163
Run time	7 days 9 hours 20 min 19 sec
CPU time	7 days 3 hours 42 min 23 sec
Validate state	Invalid
Credit	9,331.20
Device peak FLOPS	4.28 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 i686-apple-darwin
Stderr	<core_client_version>7.2.42</core_client_version> <![CDATA[ <message> process exited with code 193 (0xc1, -63) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... hadcm3n_6.07_i686-apple-darwin(428,0xa050b1a8) malloc: * error for object 0x39e4e04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(428,0xa050b1a8) malloc: * error for object 0x29c9e04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(428,0xa050b1a8) malloc: * error for object 0x29c9e00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(428,0xa050b1a8) malloc: * error for object 0x41c5e04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(428,0xa050b1a8) malloc: * error for object 0x41c5e00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation hadcm3n_6.07_i686-apple-darwin(4315,0xa050b1a8) malloc: * error for object 0x1322404: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(4315,0xa050b1a8) malloc: * error for object 0x1322400: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(4315,0xa050b1a8) malloc: * error for object 0x4339a04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(4315,0xa050b1a8) malloc: * error for object 0x4339a00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(4315,0xa050b1a8) malloc: * error for object 0x4334c04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(4315,0xa050b1a8) malloc: * error for object 0x4334c00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(4315,0xa050b1a8) malloc: * error for object 0x4334c04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(4315,0xa050b1a8) malloc: * error for object 0x4334c00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(4315,0xa050b1a8) malloc: * error for object 0x4334c04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(4315,0xa050b1a8) malloc: * error for object 0x4334c00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(4315,0xa050b1a8) malloc: * error for object 0x4334c04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(4315,0xa050b1a8) malloc: * error for object 0x4334c00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... hadcm3n_6.07_i686-apple-darwin(998,0xa050b1a8) malloc: * error for object 0x407dc04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(998,0xa050b1a8) malloc: * error for object 0x407dc00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(998,0xa050b1a8) malloc: * error for object 0x407dc04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(998,0xa050b1a8) malloc: * error for object 0x407dc00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(998,0xa050b1a8) malloc: * error for object 0x3855c04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation Crashed executable name: hadcm3n_6.07_i686-apple-darwin built using BOINC library version 6.13.0 Machine type Intel 80486 (32-bit executable) System version: Macintosh OS 10.9.2 build 13C1021 Thu Jun 12 01:51:51 2014 Thread 0 Crashed: Thread 1: -- Warning: /usr/bin/atos is moving and will be removed from a future OS X release. It is now available in the Xcode developer tools to be invoked via: `xcrun atos` To silence this warning, pass the '-d' command-line flag to this tool. -- atos cannot load symbols for the file hadcm3n_6.07_i686-apple-darwin for architecture i386. Thread 0 crashed with X86 Thread State (32-bit): eax: 0x00000000 ebx: 0x00000000 ecx: 0x00000000 edx: 0x00000000 edi: 0x00000000 esi: 0x00000000 ebp: 0xbff8fac8 esp: 0x00000000 ss: 0x00000000 efl: 0x00000000 eip: 0x0007697e cs: 0x00000000 ds: 0x00000000 es: 0x00000000 fs: 0x00000000 gs: 0x00000000 Binary Images Description: 0x1000 - 0x93fff /Library/Application Support/BOINC Data/slots/7/../../projects/climateprediction.net/hadcm3n_6.07_i686-apple-darwin 0x90d78000 - 0x90e0afff /usr/lib/system/libsystem_c.dylib 0x90ef8000 - 0x90f20fff /usr/lib/system/libsystem_info.dylib 0x90fbe000 - 0x90fc7fff /usr/lib/system/libsystem_notify.dylib 0x916f0000 - 0x91741fff /usr/lib/libstdc++.6.dylib 0x91892000 - 0x918a0fff /usr/lib/libz.1.dylib 0x918f5000 - 0x918fcfff /usr/lib/system/libsystem_pthread.dylib 0x91cb4000 - 0x91cb9fff /usr/lib/system/libcompiler_rt.dylib 0x92517000 - 0x9251cfff /usr/lib/system/libsystem_platform.dylib 0x934c4000 - 0x934c6fff /usr/lib/system/libsystem_configuration.dylib 0x9352e000 - 0x93540fff /usr/lib/system/libsystem_asl.dylib 0x93541000 - 0x93545fff /usr/lib/system/libcache.dylib 0x9358f000 - 0x9358ffff /usr/lib/system/libkeymgr.dylib 0x93b9f000 - 0x93baafff /usr/lib/system/libcommonCrypto.dylib 0x957bf000 - 0x957c5fff /usr/lib/system/libunwind.dylib 0x971ef000 - 0x971f7fff /usr/lib/system/liblaunch.dylib 0x98029000 - 0x9804dfff /usr/lib/libc++abi.dylib 0x98528000 - 0x98529fff /usr/lib/libSystem.B.dylib 0x98aaf000 - 0x98ab0fff /usr/lib/system/libunc.dylib 0x98ab4000 - 0x98b04fff /usr/lib/system/libcorecrypto.dylib 0x98bba000 - 0x98bbefff /usr/lib/system/libmacho.dylib 0x98ddd000 - 0x98df5fff /usr/lib/system/libdispatch.dylib 0x99407000 - 0x9942bfff /usr/lib/system/libxpc.dylib 0x99553000 - 0x9957efff /usr/lib/system/libsystem_network.dylib 0x99590000 - 0x99591fff /usr/lib/system/libsystem_sandbox.dylib 0x9a7fb000 - 0x9a7fcfff /usr/lib/system/libremovefile.dylib 0x9a7fd000 - 0x9a82efff /usr/lib/system/libsystem_m.dylib 0x9aeb3000 - 0x9aecbfff /usr/lib/system/libsystem_malloc.dylib 0x9b767000 - 0x9b76ffff /usr/lib/system/libsystem_dnssd.dylib 0x9bd6f000 - 0x9bd8cfff /usr/lib/system/libsystem_kernel.dylib 0x9bd8d000 - 0x9bd8ffff /usr/lib/system/libquarantine.dylib 0x9bdce000 - 0x9bdd1fff /usr/lib/system/libdyld.dylib 0x9c241000 - 0x9c249fff /usr/lib/system/libcopyfile.dylib 0x9c24a000 - 0x9c24bfff /usr/lib/system/libsystem_blocks.dylib Exiting... </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
12 Jun 2014 08:54:24	1319163	16587719	hadcm3n_8aek_1980_40_008722903_0	777,600	618,141	0.7949
11 Jun 2014 08:16:55	1319163	16587719	hadcm3n_8aek_1980_40_008722903_0	751,680	598,158	0.7958
10 Jun 2014 09:04:29	1319163	16587719	hadcm3n_8aek_1980_40_008722903_0	725,760	577,619	0.7959
10 Jun 2014 09:02:27	1319163	16587719	hadcm3n_8aek_1980_40_008722903_0	699,840	557,563	0.7967
07 Jun 2014 13:24:17	1319163	16587719	hadcm3n_8aek_1980_40_008722903_0	673,920	537,619	0.7977
04 Jun 2014 23:13:24	1319163	16587719	hadcm3n_8aek_1980_40_008722903_0	648,000	517,310	0.7983
04 Jun 2014 06:15:27	1319163	16587719	hadcm3n_8aek_1980_40_008722903_0	622,080	496,272	0.7978
01 Jun 2014 09:33:03	1319163	16587719	hadcm3n_8aek_1980_40_008722903_0	596,160	475,520	0.7976
31 May 2014 05:05:43	1319163	16587719	hadcm3n_8aek_1980_40_008722903_0	570,240	453,578	0.7954
29 May 2014 20:54:29	1319163	16587719	hadcm3n_8aek_1980_40_008722903_0	544,320	433,234	0.7959
29 May 2014 00:19:54	1319163	16587719	hadcm3n_8aek_1980_40_008722903_0	518,400	413,230	0.7971
28 May 2014 05:30:47	1319163	16587719	hadcm3n_8aek_1980_40_008722903_0	492,480	392,151	0.7963
27 May 2014 08:06:01	1319163	16587719	hadcm3n_8aek_1980_40_008722903_0	466,560	371,278	0.7958
25 May 2014 00:04:51	1319163	16587719	hadcm3n_8aek_1980_40_008722903_0	440,640	350,453	0.7953
23 May 2014 07:45:18	1319163	16587719	hadcm3n_8aek_1980_40_008722903_0	414,720	329,241	0.7939
22 May 2014 06:49:41	1319163	16587719	hadcm3n_8aek_1980_40_008722903_0	388,800	308,739	0.7941
21 May 2014 08:31:02	1319163	16587719	hadcm3n_8aek_1980_40_008722903_0	362,880	288,564	0.7952
20 May 2014 21:56:13	1319163	16587719	hadcm3n_8aek_1980_40_008722903_0	336,960	268,657	0.7973
20 May 2014 05:00:59	1319163	16587719	hadcm3n_8aek_1980_40_008722903_0	311,040	246,922	0.7939
18 May 2014 07:46:07	1319163	16587719	hadcm3n_8aek_1980_40_008722903_0	285,120	225,343	0.7903