Task 13391078

Name	hadcm3n_t3no_1940_40_007447633_4
Workunit	7645136
Created	16 Sep 2011, 4:33:19 UTC
Sent	16 Sep 2011, 4:42:50 UTC
Report deadline	16 Dec 2011, 12:10:01 UTC
Received	20 Dec 2011, 4:01:00 UTC
Server state	Over
Outcome	Success
Client state	Done
Exit status	0 (0x00000000)
Computer ID	1169939
Run time	17 days 23 hours 3 min 34 sec
CPU time	17 days 5 hours 20 min 14 sec
Validate state	Valid
Credit	12,441.60
Device peak FLOPS	3.05 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 i686-apple-darwin
Stderr	<core_client_version>6.12.35</core_client_version> <![CDATA[ <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Signal 15 received, exiting... Called boinc_finish Signal 15 received, exiting... Called boinc_finish Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=320, selfPID=320, iMonCtr=1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 63 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 64 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 65 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 66 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 67 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 68 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 69 - Return code = 1 Error: Input file: dataout/t3noko.pje3c10 is not a valid UM file. Error converting file to netcdf: dataout/t3noko.pje3c10 Error: Input file: dataout/t3noko.pie3c10 is not a valid UM file. Error converting file to netcdf: dataout/t3noko.pie3c10 Error: Input file: dataout/t3noko.pfe3c10 is not a valid UM file. Error converting file to netcdf: dataout/t3noko.pfe3c10 Error: Input file: dataout/t3noka.phe3c10 is not a valid UM file. Error converting file to netcdf: dataout/t3noka.phe3c10 Error: Input file: dataout/t3noka.pge3c10 is not a valid UM file. Error converting file to netcdf: dataout/t3noka.pge3c10 Error: Input file: dataout/t3noka.pee3c10 is not a valid UM file. Error converting file to netcdf: dataout/t3noka.pee3c10 Error: Input file: dataout/t3noka.pde3c10 is not a valid UM file. Error converting file to netcdf: dataout/t3noka.pde3c10 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... hadcm3n_6.07_i686-apple-darwin(316,0xac64a2c0) malloc: * error for object 0x88d9e04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(316,0xac64a2c0) malloc: * error for object 0x88d9e00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(316,0xac64a2c0) malloc: * error for object 0x20a2804: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(316,0xac64a2c0) malloc: * error for object 0x20a2800: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(316,0xac64a2c0) malloc: * error for object 0x20a2804: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(316,0xac64a2c0) malloc: * error for object 0x20a2800: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(316,0xac64a2c0) malloc: * error for object 0x20a2800: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation Crashed executable name: hadcm3n_6.07_i686-apple-darwin built using BOINC library version 6.13.0 Machine type Intel 80486 (32-bit executable) 22:57:00 (316): No heartbeat from core client for 30 sec - exiting 22:57:01 (316): No heartbeat from core client for 30 sec - exiting 22:57:02 (316): No heartbeat from core client for 30 sec - exiting 22:57:03 (316): No heartbeat from core client for 30 sec - exiting 22:57:04 (316): No heartbeat from core client for 30 sec - exiting 22:57:05 (316): No heartbeat from core client for 30 sec - exiting 22:57:06 (316): No heartbeat from core client for 30 sec - exiting 22:57:07 (316): No heartbeat from core client for 30 sec - exiting 22:57:08 (316): No heartbeat from core client for 30 sec - exiting 22:57:09 (316): No heartbeat from core client for 30 sec - exiting 22:57:10 (316): No heartbeat from core client for 30 sec - exiting 22:57:11 (316): No heartbeat from core client for 30 sec - exiting 22:57:12 (316): No heartbeat from core client for 30 sec - exiting 22:57:13 (316): No heartbeat from core client for 30 sec - exiting 22:57:14 (316): No heartbeat from core client for 30 sec - exiting 22:57:15 (316): No heartbeat from core client for 30 sec - exiting 22:57:16 (316): No heartbeat from core client for 30 sec - exiting 22:57:17 (316): No heartbeat from core client for 30 sec - exiting 22:57:18 (316): No heartbeat from core client for 30 sec - exiting 22:57:19 (316): No heartbeat from core client for 30 sec - exiting 22:57:20 (316): No heartbeat from core client for 30 sec - exiting 22:57:21 (316): No heartbeat from core client for 30 sec - exiting 22:57:22 (316): No heartbeat from core client for 30 sec - exiting 22:57:23 (316): No heartbeat from core client for 30 sec - exiting 22:57:24 (316): No heartbeat from core client for 30 sec - exiting 22:57:25 (316): No heartbeat from core client for 30 sec - exiting 22:57:26 (316): No heartbeat from core client for 30 sec - exiting 22:57:27 (316): No heartbeat from core client for 30 sec - exiting 22:57:28 (316): No heartbeat from core client for 30 sec - exiting 22:57:29 (316): No heartbeat from core client for 30 sec - exiting 22:57:30 (316): No heartbeat from core client for 30 sec - exiting 22:57:31 (316): No heartbeat from core client for 30 sec - exiting 22:57:32 (316): No heartbeat from core client for 30 sec - exiting 22:57:33 (316): No heartbeat from core client for 30 sec - exiting 22:57:34 (316): No heartbeat from core client for 30 sec - exiting 22:57:35 (316): No heartbeat from core client for 30 sec - exiting 22:57:36 (316): No heartbeat from core client for 30 sec - exiting 22:57:37 (316): No heartbeat from core client for 30 sec - exiting 22:57:38 (316): No heartbeat from core client for 30 sec - exiting 22:57:39 (316): No heartbeat from core client for 30 sec - exiting 22:57:40 (316): No heartbeat from core client for 30 sec - exiting 22:57:41 (316): No heartbeat from core client for 30 sec - exiting 22:57:42 (316): No heartbeat from core client for 30 sec - exiting 22:57:43 (316): No heartbeat from core client for 30 sec - exiting 22:57:44 (316): No heartbeat from core client for 30 sec - exiting 22:57:45 (316): No heartbeat from core client for 30 sec - exiting 22:57:46 (316): No heartbeat from core client for 30 sec - exiting 22:57:47 (316): No heartbeat from core client for 30 sec - exiting 22:57:48 (316): No heartbeat from core client for 30 sec - exiting 22:57:50 (316): No heartbeat from core client for 30 sec - exiting 22:57:51 (316): No heartbeat from core client for 30 sec - exiting 22:57:52 (316): No heartbeat from core client for 30 sec - exiting 22:57:53 (316): No heartbeat from core client for 30 sec - exiting 22:57:54 (316): No heartbeat from core client for 30 sec - exiting 22:57:55 (316): No heartbeat from core client for 30 sec - exiting 22:57:56 (316): No heartbeat from core client for 30 sec - exiting 22:57:57 (316): No heartbeat from core client for 30 sec - exiting 22:57:58 (316): No heartbeat from core client for 30 sec - exiting 22:57:59 (316): No heartbeat from core client for 30 sec - exiting 22:58:00 (316): No heartbeat from core client for 30 sec - exiting 22:58:01 (316): No heartbeat from core client for 30 sec - exiting Signal 15 received, exiting... Called boinc_finish Signal 15 received, exiting... Called boinc_finish hadcm3n_6.07_i686-apple-darwin(351,0xac64a2c0) malloc: * error for object 0x13ea804: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(351,0xac64a2c0) malloc: * error for object 0x13ea800: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(351,0xac64a2c0) malloc: * error for object 0x1bca604: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(351,0xac64a2c0) malloc: * error for object 0x1bca600: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(351,0xac64a2c0) malloc: * error for object 0x1bca604: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(351,0xac64a2c0) malloc: * error for object 0x1bca600: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(351,0xac64a2c0) malloc: * error for object 0x1bca604: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(351,0xac64a2c0) malloc: * error for object 0x1bca600: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(351,0xac64a2c0) malloc: * error for object 0x1bca604: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(351,0xac64a2c0) malloc: * error for object 0x1bca600: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(351,0xac64a2c0) malloc: * error for object 0x1bca604: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(351,0xac64a2c0) malloc: * error for object 0x1bca600: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Signal 15 received, exiting... Called boinc_finish Signal 15 received, exiting... Called boinc_finish CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
20 Dec 2011 03:01:30	1169939	13391078	hadcm3n_t3no_1940_40_007447633_4	1,036,800	1,487,414	1.4346
19 Dec 2011 16:44:32	1169939	13391078	hadcm3n_t3no_1940_40_007447633_4	1,010,880	1,450,006	1.4344
18 Dec 2011 19:07:14	1169939	13391078	hadcm3n_t3no_1940_40_007447633_4	984,960	1,413,534	1.4351
18 Dec 2011 06:37:09	1169939	13391078	hadcm3n_t3no_1940_40_007447633_4	959,040	1,375,589	1.4343
17 Dec 2011 20:54:42	1169939	13391078	hadcm3n_t3no_1940_40_007447633_4	933,120	1,335,589	1.4313
17 Dec 2011 09:39:07	1169939	13391078	hadcm3n_t3no_1940_40_007447633_4	907,200	1,297,269	1.4300
16 Dec 2011 19:23:27	1169939	13391078	hadcm3n_t3no_1940_40_007447633_4	881,280	1,258,529	1.4281
16 Dec 2011 11:57:33	1169939	13391078	hadcm3n_t3no_1940_40_007447633_4	855,360	1,220,654	1.4271
30 Nov 2011 09:31:48	1169939	13391078	hadcm3n_t3no_1940_40_007447633_4	829,440	1,181,275	1.4242
29 Nov 2011 20:37:30	1169939	13391078	hadcm3n_t3no_1940_40_007447633_4	803,520	1,142,341	1.4217
29 Nov 2011 08:51:23	1169939	13391078	hadcm3n_t3no_1940_40_007447633_4	777,600	1,103,532	1.4192
28 Nov 2011 22:17:26	1169939	13391078	hadcm3n_t3no_1940_40_007447633_4	751,680	1,067,175	1.4197
27 Nov 2011 09:10:49	1169939	13391078	hadcm3n_t3no_1940_40_007447633_4	725,760	1,032,664	1.4229
26 Nov 2011 23:17:52	1169939	13391078	hadcm3n_t3no_1940_40_007447633_4	699,840	998,347	1.4265
26 Nov 2011 13:40:47	1169939	13391078	hadcm3n_t3no_1940_40_007447633_4	673,920	964,082	1.4306
24 Nov 2011 14:58:17	1169939	13391078	hadcm3n_t3no_1940_40_007447633_4	648,000	931,614	1.4377
24 Nov 2011 05:05:37	1169939	13391078	hadcm3n_t3no_1940_40_007447633_4	622,080	897,248	1.4423
20 Nov 2011 21:45:34	1169939	13391078	hadcm3n_t3no_1940_40_007447633_4	596,160	863,827	1.4490
20 Nov 2011 02:11:24	1169939	13391078	hadcm3n_t3no_1940_40_007447633_4	570,240	828,561	1.4530
19 Nov 2011 11:09:20	1169939	13391078	hadcm3n_t3no_1940_40_007447633_4	544,320	792,775	1.4565