Task 18237174

Name	hadcm3n_xap8_1940_40_009150162_4
Workunit	9280498
Created	29 Mar 2015, 3:26:13 UTC
Sent	29 Mar 2015, 3:29:31 UTC
Report deadline	28 Jun 2015, 10:56:42 UTC
Received	6 Apr 2015, 22:31:47 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	193 (0x000000C1) EXIT_SIGNAL
Computer ID	1099887
Run time	2 days 16 hours 26 min 17 sec
CPU time	1 days 22 hours 7 min 4 sec
Validate state	Invalid
Credit	3,110.40
Device peak FLOPS	4.54 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 i686-apple-darwin
Stderr	<core_client_version>7.4.36</core_client_version> <![CDATA[ <message> process exited with code 193 (0xc1, -63) </message> <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Signal 1 received, exiting... Called boinc_finish CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... BUFFOUT: Write Failed: No space left on device BUFFOUT: C I/O Error - Return code = 1 Model crashed: WRITDUMP: BAD BUFFOUT OF DATA tmp/pipe_dummy 2048 Suspended CPDN Monitor - Suspend request from BOINC... hadcm3n_6.07_i686-apple-darwin(563,0xa09a91d4) malloc: * error for object 0x2043e04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(563,0xa09a91d4) malloc: * error for object 0x2043e00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(563,0xa09a91d4) malloc: * error for object 0x1038a04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(563,0xa09a91d4) malloc: * error for object 0x302a604: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(563,0xa09a91d4) malloc: * error for object 0x827e04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(563,0xa09a91d4) malloc: * error for object 0x1038a04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(563,0xa09a91d4) malloc: * error for object 0x3822604: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation BUFFOUT: Write Failed: No space left on device BUFFOUT: C I/O Error - Return code = 1 Model crashed: WRITDUMP: BAD BUFFOUT OF DATA tmp/pipe_dummy 2048 Signal 15 received, exiting... Called boinc_finish hadcm3n_6.07_i686-apple-darwin(578,0xa09a91d4) malloc: * error for object 0x382c604: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(578,0xa09a91d4) malloc: * error for object 0x302c204: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(578,0xa09a91d4) malloc: * error for object 0x581f604: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation hadcm3n_6.07_i686-apple-darwin(546,0xa09a91d4) malloc: * error for object 0x830604: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(546,0xa09a91d4) malloc: * error for object 0x2024604: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(546,0xa09a91d4) malloc: * error for object 0x830604: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation Crashed executable name: hadcm3n_6.07_i686-apple-darwin built using BOINC library version 6.13.0 Machine type Intel 80486 (32-bit executable) System version: Macintosh OS 10.10.2 build 14C1514 Mon Apr 6 15:30:05 2015 hadcm3n_6.07_i686-apple-darwin(546,0xa09a91d4) malloc: * error for object 0x1034204: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(546,0xa09a91d4) malloc: * error for object 0x1034200: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug Thread 0 Crashed: Thread 1: atos cannot load symbols for the file hadcm3n_6.07_i686-apple-darwin for architecture i386. Thread 0 crashed with X86 Thread State (32-bit): eax: 0x00000000 ebx: 0x00000000 ecx: 0x00000000 edx: 0x00000000 edi: 0x00000000 esi: 0x00000000 ebp: 0xbff8fc18 esp: 0x00000000 ss: 0x00000000 efl: 0x00000000 eip: 0x0007697e cs: 0x00000000 ds: 0x00000000 es: 0x00000000 fs: 0x00000000 gs: 0x00000000 Binary Images Description: 0x1000 - 0x93fff /Library/Application Support/BOINC Data/slots/11/../../projects/climateprediction.net/hadcm3n_6.07_i686-apple-darwin 0x90a72000 - 0x90a72fff /usr/lib/system/liblaunch.dylib 0x90eca000 - 0x90ee3fff /usr/lib/system/libsystem_malloc.dylib 0x91d84000 - 0x91d8afff /usr/lib/system/libsystem_platform.dylib 0x91dab000 - 0x91dc2fff /usr/lib/system/libsystem_asl.dylib 0x91e79000 - 0x91e98fff /usr/lib/system/libsystem_kernel.dylib 0x93678000 - 0x93689fff /usr/lib/system/libsystem_coretls.dylib 0x938b8000 - 0x938bffff /usr/lib/system/libunwind.dylib 0x93acb000 - 0x93ad3fff /usr/lib/system/libsystem_dnssd.dylib 0x93ad9000 - 0x93adefff /usr/lib/system/libmacho.dylib 0x93b96000 - 0x93b98fff /usr/lib/system/libsystem_coreservices.dylib 0x93dfc000 - 0x93e0afff /usr/lib/libz.1.dylib 0x93f50000 - 0x93fb9fff /usr/lib/system/libcorecrypto.dylib 0x94197000 - 0x94197fff /usr/lib/system/libunc.dylib 0x95465000 - 0x9546afff /usr/lib/system/libcompiler_rt.dylib 0x9563f000 - 0x95666fff /usr/lib/system/libdispatch.dylib 0x9589a000 - 0x9589cfff /usr/lib/system/libsystem_sandbox.dylib 0x95ad6000 - 0x95ad9fff /usr/lib/system/libdyld.dylib 0x95e6b000 - 0x95e73fff /usr/lib/system/libsystem_pthread.dylib 0x96a8d000 - 0x96a8efff /usr/lib/system/libsystem_blocks.dylib 0x96ca9000 - 0x96cb2fff /usr/lib/system/libsystem_notify.dylib 0x96cb3000 - 0x96cb9fff /usr/lib/system/libsystem_trace.dylib 0x96cba000 - 0x96cbafff /usr/lib/system/libkeymgr.dylib 0x96cf4000 - 0x96d27fff /usr/lib/system/libsystem_m.dylib 0x96d6e000 - 0x96d70fff /usr/lib/system/libsystem_secinit.dylib 0x96d71000 - 0x96e06fff /usr/lib/system/libsystem_c.dylib 0x96f8a000 - 0x96fb0fff /usr/lib/libc++abi.dylib 0x9816e000 - 0x98170fff /usr/lib/system/libquarantine.dylib 0x98172000 - 0x98198fff /usr/lib/system/libxpc.dylib 0x9819b000 - 0x9819cfff /usr/lib/libSystem.B.dylib 0x99346000 - 0x9934cfff /usr/lib/system/libsystem_networkextension.dylib 0x9934d000 - 0x99359fff /usr/lib/system/libcommonCrypto.dylib 0x9a092000 - 0x9a0cffff /usr/lib/system/libsystem_network.dylib 0x9a1bc000 - 0x9a1c5fff /usr/lib/system/libcopyfile.dylib 0x9a1c8000 - 0x9a21bfff /usr/lib/libstdc++.6.dylib 0x9a245000 - 0x9a247fff /usr/lib/system/libsystem_configuration.dylib 0x9a8bc000 - 0x9a8e5fff /usr/lib/system/libsystem_info.dylib 0x9ae98000 - 0x9ae9cfff /usr/lib/system/libcache.dylib 0x9bd2c000 - 0x9bd2dfff /usr/lib/system/libremovefile.dylib Exiting... </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
06 Apr 2015 04:55:57	1099887	18237174	hadcm3n_xap8_1940_40_009150162_4	259,200	158,388	0.6111
05 Apr 2015 17:36:09	1099887	18237174	hadcm3n_xap8_1940_40_009150162_4	233,280	200,441	0.8592
05 Apr 2015 09:30:17	1099887	18237174	hadcm3n_xap8_1940_40_009150162_4	207,360	179,088	0.8637
05 Apr 2015 01:08:27	1099887	18237174	hadcm3n_xap8_1940_40_009150162_4	181,440	157,808	0.8698
03 Apr 2015 22:51:28	1099887	18237174	hadcm3n_xap8_1940_40_009150162_4	155,520	136,215	0.8759
03 Apr 2015 13:20:15	1099887	18237174	hadcm3n_xap8_1940_40_009150162_4	129,600	113,981	0.8795
03 Apr 2015 05:19:05	1099887	18237174	hadcm3n_xap8_1940_40_009150162_4	103,680	92,556	0.8927
30 Mar 2015 11:17:27	1099887	18237174	hadcm3n_xap8_1940_40_009150162_4	77,760	69,727	0.8967
30 Mar 2015 04:25:07	1099887	18237174	hadcm3n_xap8_1940_40_009150162_4	51,840	45,486	0.8774
29 Mar 2015 09:58:36	1099887	18237174	hadcm3n_xap8_1940_40_009150162_4	25,920	22,550	0.8700