Task 14728449

Name	hadcm3n_ye69_1940_40_007955145_4
Workunit	8110257
Created	21 May 2012, 17:30:56 UTC
Sent	21 May 2012, 17:32:11 UTC
Report deadline	21 Aug 2012, 0:59:22 UTC
Received	5 Jun 2012, 17:40:11 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	4 (0x00000004) Unknown error code
Computer ID	1124592
Run time	14 days 1 hours 44 min 49 sec
CPU time	13 days 11 hours 29 min 16 sec
Validate state	Invalid
Credit	9,331.20
Device peak FLOPS	3.27 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 i686-apple-darwin
Stderr	<core_client_version>6.10.58</core_client_version> <![CDATA[ <message> process got signal 4 </message> <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... hadcm3n_6.07_i686-apple-darwin(27884,0xa014b540) malloc: * error for object 0x819604: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(27884,0xa014b540) malloc: * error for object 0x819600: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(27884,0xa014b540) malloc: * error for object 0x819604: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(27884,0xa014b540) malloc: * error for object 0x819600: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(27884,0xa014b540) malloc: * error for object 0x102a804: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(27884,0xa014b540) malloc: * error for object 0x102a800: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(27884,0xa014b540) malloc: * error for object 0x819604: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(27884,0xa014b540) malloc: * error for object 0x819600: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(27884,0xa014b540) malloc: * error for object 0x1000e04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(27884,0xa014b540) malloc: * error for object 0x1000e00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(27884,0xa014b540) malloc: * error for object 0x800e04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(27884,0xa014b540) malloc: * error for object 0x800e00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 60 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 61 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 62 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 63 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 64 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 65 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 66 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 67 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 68 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 69 - Return code = 1 Error: Input file: dataout/ye69ko.pjh0c10 is not a valid UM file. Error converting file to netcdf: dataout/ye69ko.pjh0c10 Error: Input file: dataout/ye69ko.pih0c10 is not a valid UM file. Error converting file to netcdf: dataout/ye69ko.pih0c10 Error: Input file: dataout/ye69ko.pfh0c10 is not a valid UM file. Error converting file to netcdf: dataout/ye69ko.pfh0c10 Error: Input file: dataout/ye69ko.pch0c10 is not a valid UM file. Error converting file to netcdf: dataout/ye69ko.pch0c10 Error: Input file: dataout/ye69ko.pbh0c10 is not a valid UM file. Error converting file to netcdf: dataout/ye69ko.pbh0c10 Error: Input file: dataout/ye69ko.pah0c10 is not a valid UM file. Error converting file to netcdf: dataout/ye69ko.pah0c10 Error: Input file: dataout/ye69ka.phh0c10 is not a valid UM file. Error converting file to netcdf: dataout/ye69ka.phh0c10 Error: Input file: dataout/ye69ka.pgh0c10 is not a valid UM file. Error converting file to netcdf: dataout/ye69ka.pgh0c10 Error: Input file: dataout/ye69ka.peh0c10 is not a valid UM file. Error converting file to netcdf: dataout/ye69ka.peh0c10 Error: Input file: dataout/ye69ka.pdh0c10 is not a valid UM file. Error converting file to netcdf: dataout/ye69ka.pdh0c10 CPDN Monitor - Quit request from BOINC... </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
05 Jun 2012 07:30:14	1124592	14728449	hadcm3n_ye69_1940_40_007955145_4	777,600	1,142,827	1.4697
04 Jun 2012 16:09:55	1124592	14728449	hadcm3n_ye69_1940_40_007955145_4	751,680	1,104,983	1.4700
04 Jun 2012 02:51:23	1124592	14728449	hadcm3n_ye69_1940_40_007955145_4	725,760	1,067,085	1.4703
03 Jun 2012 15:15:57	1124592	14728449	hadcm3n_ye69_1940_40_007955145_4	699,840	1,026,764	1.4671
03 Jun 2012 03:30:24	1124592	14728449	hadcm3n_ye69_1940_40_007955145_4	673,920	986,413	1.4637
02 Jun 2012 16:02:47	1124592	14728449	hadcm3n_ye69_1940_40_007955145_4	648,000	946,546	1.4607
02 Jun 2012 04:06:59	1124592	14728449	hadcm3n_ye69_1940_40_007955145_4	622,080	905,387	1.4554
01 Jun 2012 16:18:22	1124592	14728449	hadcm3n_ye69_1940_40_007955145_4	596,160	864,715	1.4505
01 Jun 2012 05:32:47	1124592	14728449	hadcm3n_ye69_1940_40_007955145_4	570,240	825,651	1.4479
31 May 2012 18:32:27	1124592	14728449	hadcm3n_ye69_1940_40_007955145_4	544,320	789,881	1.4511
31 May 2012 07:18:17	1124592	14728449	hadcm3n_ye69_1940_40_007955145_4	518,400	752,857	1.4523
30 May 2012 14:12:00	1124592	14728449	hadcm3n_ye69_1940_40_007955145_4	492,480	715,329	1.4525
30 May 2012 03:21:35	1124592	14728449	hadcm3n_ye69_1940_40_007955145_4	466,560	678,339	1.4539
29 May 2012 15:49:23	1124592	14728449	hadcm3n_ye69_1940_40_007955145_4	440,640	640,858	1.4544
29 May 2012 04:54:40	1124592	14728449	hadcm3n_ye69_1940_40_007955145_4	414,720	603,503	1.4552
28 May 2012 17:59:20	1124592	14728449	hadcm3n_ye69_1940_40_007955145_4	388,800	565,041	1.4533
28 May 2012 06:25:35	1124592	14728449	hadcm3n_ye69_1940_40_007955145_4	362,880	527,661	1.4541
27 May 2012 19:27:41	1124592	14728449	hadcm3n_ye69_1940_40_007955145_4	336,960	490,668	1.4562
27 May 2012 08:15:32	1124592	14728449	hadcm3n_ye69_1940_40_007955145_4	311,040	453,489	1.4580
26 May 2012 21:43:21	1124592	14728449	hadcm3n_ye69_1940_40_007955145_4	285,120	416,084	1.4593