Task 19132174

Name	hadcm3n_xdmv_198012_480_010221151_0
Workunit	10221151
Created	4 Dec 2015, 15:05:15 UTC
Sent	4 Dec 2015, 16:40:27 UTC
Report deadline	15 Nov 2016, 22:00:27 UTC
Received	4 Jan 2016, 15:15:44 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	193 (0x000000C1) EXIT_SIGNAL
Computer ID	1364549
Run time	20 days 12 hours 22 min 16 sec
CPU time	12 days 23 hours 21 min 21 sec
Validate state	Invalid
Credit	6,220.80
Device peak FLOPS	4.34 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 i686-apple-darwin
Stderr	<core_client_version>7.6.12</core_client_version> <![CDATA[ <message> process exited with code 193 (0xc1, -63) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 63 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 64 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 65 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 66 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 67 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 68 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 69 - Return code = 1 Error: Input file: dataout/xdmvko.pjj6c10 is not a valid UM file. Error converting file to netcdf: dataout/xdmvko.pjj6c10 Error: Input file: dataout/xdmvko.pij6c10 is not a valid UM file. Error converting file to netcdf: dataout/xdmvko.pij6c10 Error: Input file: dataout/xdmvko.pfj6c10 is not a valid UM file. Error converting file to netcdf: dataout/xdmvko.pfj6c10 Error: Input file: dataout/xdmvka.phj6c10 is not a valid UM file. Error converting file to netcdf: dataout/xdmvka.phj6c10 Error: Input file: dataout/xdmvka.pgj6c10 is not a valid UM file. Error converting file to netcdf: dataout/xdmvka.pgj6c10 Error: Input file: dataout/xdmvka.pej6c10 is not a valid UM file. Error converting file to netcdf: dataout/xdmvka.pej6c10 Error: Input file: dataout/xdmvka.pdj6c10 is not a valid UM file. Error converting file to netcdf: dataout/xdmvka.pdj6c10 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... hadcm3n_6.07_i686-apple-darwin(86473,0xa31fb000) malloc: * error for object 0x380a204: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(86473,0xa31fb000) malloc: * error for object 0x380a200: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(86473,0xa31fb000) malloc: * error for object 0x1810e04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(86473,0xa31fb000) malloc: * error for object 0x1000e04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(86473,0xa31fb000) malloc: * error for object 0x1810e04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(86473,0xa31fb000) malloc: * error for object 0x800e04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(86473,0xa31fb000) malloc: * error for object 0x800e00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(86473,0xa31fb000) malloc: * error for object 0x3800e04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation Crashed executable name: hadcm3n_6.07_i686-apple-darwin built using BOINC library version 6.13.0 Machine type Intel x86-64h Haswell (32-bit executable) System version: Macintosh OS 10.11.3 build 15D9c Sun Jan 3 01:44:43 2016 atos cannot load symbols for the file hadcm3n_6.07_i686-apple-darwin for architecture i386. hadcm3n_6.07_i686-apple-darwin(28994,0xa31fb000) malloc: * error for object 0x402e604: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation hadcm3n_6.07_i686-apple-darwin(37108,0xa31fb000) malloc: * error for object 0x202a604: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation hadcm3n_6.07_i686-apple-darwin(48652,0xa31fb000) malloc: * error for object 0x821c04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation Crashed executable name: hadcm3n_6.07_i686-apple-darwin built using BOINC library version 6.13.0 Machine type Intel x86-64h Haswell (32-bit executable) System version: Macintosh OS 10.11.3 build 15D9c Sun Jan 3 10:44:39 2016 hadcm3n_6.07_i686-apple-darwin(16325,0xa31fb000) malloc: * error for object 0x183a604: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation Crashed executable name: hadcm3n_6.07_i686-apple-darwin built using BOINC library version 6.13.0 Machine type Intel x86-64h Haswell (32-bit executable) hadcm3n_6.07_i686-apple-darwin(66302,0xa31fb000) malloc: * error for object 0x82e004: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation Crashed executable name: hadcm3n_6.07_i686-apple-darwin built using BOINC library version 6.13.0 Machine type Intel x86-64h Haswell (32-bit executable) System version: Macintosh OS 10.11.3 build 15D9c Mon Jan 4 06:15:39 2016 Thread 0 Crashed: Thread 1: atos cannot load symbols for the file hadcm3n_6.07_i686-apple-darwin for architecture i386. Thread 0 crashed with X86 Thread State (32-bit): eax: 0x00000000 ebx: 0x00000000 ecx: 0x00000000 edx: 0x00000000 edi: 0x00000000 esi: 0x00000000 ebp: 0xbff8fd68 esp: 0x00000000 ss: 0x00000000 efl: 0x00000000 eip: 0x0007697e cs: 0x00000000 ds: 0x00000000 es: 0x00000000 fs: 0x00000000 gs: 0x00000000 Binary Images Description: 0x1000 - 0x93fff /Library/Application Support/BOINC Data/slots/11/../../projects/climateprediction.net/hadcm3n_6.07_i686-apple-darwin 0x905af000 - 0x905b0fff /usr/lib/system/libremovefile.dylib 0x910a6000 - 0x910bffff /usr/lib/system/libsystem_asl.dylib 0x9194d000 - 0x9194dfff /usr/lib/system/libkeymgr.dylib 0x92302000 - 0x9230afff /usr/lib/system/libsystem_pthread.dylib 0x9239e000 - 0x923b5fff /usr/lib/system/libsystem_coretls.dylib 0x92740000 - 0x92745fff /usr/lib/system/libcompiler_rt.dylib 0x927dc000 - 0x9280ffff /usr/lib/system/libsystem_m.dylib 0x92cc8000 - 0x92ccdfff /usr/lib/system/libmacho.dylib 0x93647000 - 0x93647fff /usr/lib/system/libunc.dylib 0x93a61000 - 0x93a6afff /usr/lib/system/libsystem_networkextension.dylib 0x957af000 - 0x957d7fff /usr/lib/system/libxpc.dylib 0x97cb1000 - 0x97d04fff /usr/lib/libstdc++.6.dylib 0x97de7000 - 0x97de7fff /usr/lib/system/liblaunch.dylib 0x97de8000 - 0x97deafff /usr/lib/system/libsystem_configuration.dylib 0x981d7000 - 0x98201fff /usr/lib/system/libdispatch.dylib 0x9821a000 - 0x9823dfff /usr/lib/libc++abi.dylib 0x9824a000 - 0x982b3fff /usr/lib/system/libsystem_network.dylib 0x982bd000 - 0x982c0fff /usr/lib/system/libdyld.dylib 0x98d60000 - 0x98df5fff /usr/lib/system/libsystem_c.dylib 0x98df6000 - 0x98e16fff /usr/lib/system/libsystem_kernel.dylib 0x998ae000 - 0x998b4fff /usr/lib/system/libunwind.dylib 0x9a079000 - 0x9a092fff /usr/lib/system/libsystem_malloc.dylib 0x9a093000 - 0x9a095fff /usr/lib/system/libquarantine.dylib 0x9a483000 - 0x9a4adfff /usr/lib/system/libsystem_info.dylib 0x9a5f9000 - 0x9a607fff /usr/lib/libz.1.dylib 0x9aa96000 - 0x9aa97fff /usr/lib/libSystem.B.dylib 0x9b51d000 - 0x9b525fff /usr/lib/system/libsystem_dnssd.dylib 0x9b6ba000 - 0x9b6c4fff /usr/lib/system/libsystem_notify.dylib 0x9b76e000 - 0x9b777fff /usr/lib/system/libcopyfile.dylib 0x9cb4d000 - 0x9cb58fff /usr/lib/system/libcommonCrypto.dylib 0x9cc25000 - 0x9cc2bfff /usr/lib/system/libsystem_platform.dylib 0x9cc33000 - 0x9cc35fff /usr/lib/system/libsystem_coreservices.dylib 0x9ddbf000 - 0x9de26fff /usr/lib/system/libcorecrypto.dylib 0x9e2b5000 - 0x9e2c6fff /usr/lib/system/libsystem_trace.dylib 0x9e563000 - 0x9e566fff /usr/lib/system/libsystem_sandbox.dylib 0x9e99e000 - 0x9e9a0fff /usr/lib/system/libsystem_secinit.dylib 0x9e9a1000 - 0x9e9a1fff /usr/lib/system/libsystem_blocks.dylib 0x9ed66000 - 0x9ed6afff /usr/lib/system/libcache.dylib Exiting... </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
03 Jan 2016 09:46:17	1364549	19132174	hadcm3n_xdmv_198012_480_010221151_0	518,400	1,116,784	2.1543
02 Jan 2016 08:42:13	1364549	19132174	hadcm3n_xdmv_198012_480_010221151_0	492,480	1,074,179	2.1812
01 Jan 2016 05:53:21	1364549	19132174	hadcm3n_xdmv_198012_480_010221151_0	466,560	1,011,970	2.1690
31 Dec 2015 01:19:08	1364549	19132174	hadcm3n_xdmv_198012_480_010221151_0	440,640	950,897	2.1580
30 Dec 2015 00:16:48	1364549	19132174	hadcm3n_xdmv_198012_480_010221151_0	414,720	892,996	2.1533
27 Dec 2015 11:31:42	1364549	19132174	hadcm3n_xdmv_198012_480_010221151_0	388,800	828,523	2.1310
25 Dec 2015 13:28:35	1364549	19132174	hadcm3n_xdmv_198012_480_010221151_0	362,880	767,401	2.1148
24 Dec 2015 00:23:28	1364549	19132174	hadcm3n_xdmv_198012_480_010221151_0	336,960	714,216	2.1196
23 Dec 2015 23:23:15	1364549	19132174	hadcm3n_xdmv_198012_480_010221151_0	311,040	699,024	2.2474
23 Dec 2015 23:23:15	1364549	19132174	hadcm3n_xdmv_198012_480_010221151_0	285,120	672,898	2.3601
22 Dec 2015 02:54:45	1364549	19132174	hadcm3n_xdmv_198012_480_010221151_0	259,200	626,116	2.4156
21 Dec 2015 03:44:38	1364549	19132174	hadcm3n_xdmv_198012_480_010221151_0	233,280	580,216	2.4872
19 Dec 2015 23:49:48	1364549	19132174	hadcm3n_xdmv_198012_480_010221151_0	207,360	536,530	2.5874
18 Dec 2015 21:50:21	1364549	19132174	hadcm3n_xdmv_198012_480_010221151_0	181,440	492,515	2.7145
17 Dec 2015 19:12:33	1364549	19132174	hadcm3n_xdmv_198012_480_010221151_0	155,520	446,162	2.8688
15 Dec 2015 19:31:34	1364549	19132174	hadcm3n_xdmv_198012_480_010221151_0	129,600	374,659	2.8909
13 Dec 2015 21:15:00	1364549	19132174	hadcm3n_xdmv_198012_480_010221151_0	103,680	308,175	2.9724
11 Dec 2015 11:51:57	1364549	19132174	hadcm3n_xdmv_198012_480_010221151_0	77,760	221,075	2.8430
08 Dec 2015 20:28:31	1364549	19132174	hadcm3n_xdmv_198012_480_010221151_0	51,840	148,446	2.8635
06 Dec 2015 23:50:16	1364549	19132174	hadcm3n_xdmv_198012_480_010221151_0	25,920	77,725	2.9986