Task 15921260

Name	hadcm3n_n7ll_1920_40_008324872_4
Workunit	8476007
Created	14 Aug 2013, 23:17:31 UTC
Sent	14 Aug 2013, 23:21:06 UTC
Report deadline	14 Nov 2013, 6:48:17 UTC
Received	30 Nov 2013, 8:33:17 UTC
Server state	Over
Outcome	Success
Client state	Done
Exit status	0 (0x00000000)
Computer ID	1246955
Run time	31 days 19 hours 47 min 10 sec
CPU time	26 days 2 hours 25 min 46 sec
Validate state	Valid
Credit	12,441.60
Device peak FLOPS	1.86 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 i686-apple-darwin
Stderr	<core_client_version>7.2.33</core_client_version> <![CDATA[ <stderr_txt> CPDN Monitor - Quit request from BOINC... 09:40:38 (707): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 17:59:24 (343): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:59:25 (343): No heartbeat from core client for 30 sec - exiting 17:59:26 (343): No heartbeat from core client for 30 sec - exiting 17:59:27 (343): No heartbeat from core client for 30 sec - exiting 18:05:40 (4231): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:05:41 (4231): No heartbeat from core client for 30 sec - exiting 18:05:42 (4231): No heartbeat from core client for 30 sec - exiting 18:05:43 (4231): No heartbeat from core client for 30 sec - exiting 18:05:45 (4231): No heartbeat from core client for 30 sec - exiting 18:05:46 (4231): No heartbeat from core client for 30 sec - exiting 18:05:47 (4231): No heartbeat from core client for 30 sec - exiting 18:05:48 (4231): No heartbeat from core client for 30 sec - exiting 18:05:49 (4231): No heartbeat from core client for 30 sec - exiting 18:05:51 (4231): No heartbeat from core client for 30 sec - exiting 18:05:52 (4231): No heartbeat from core client for 30 sec - exiting 18:05:53 (4231): No heartbeat from core client for 30 sec - exiting 18:12:03 (4316): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:22:00 (4357): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:22:02 (4357): No heartbeat from core client for 30 sec - exiting 18:22:03 (4357): No heartbeat from core client for 30 sec - exiting 18:22:04 (4357): No heartbeat from core client for 30 sec - exiting 18:22:06 (4357): No heartbeat from core client for 30 sec - exiting 18:32:00 (4422): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:32:02 (4422): No heartbeat from core client for 30 sec - exiting 18:32:03 (4422): No heartbeat from core client for 30 sec - exiting 18:32:04 (4422): No heartbeat from core client for 30 sec - exiting 18:32:06 (4422): No heartbeat from core client for 30 sec - exiting 18:37:02 (4494): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 20:57:09 (345): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 16:13:29 (353): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:13:31 (353): No heartbeat from core client for 30 sec - exiting 16:13:32 (353): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... 20:21:43 (580): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... hadcm3n_6.07_i686-apple-darwin(333,0xacf942c0) malloc: * error for object 0x938e04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(333,0xacf942c0) malloc: * error for object 0x938e00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(333,0xacf942c0) malloc: * error for object 0x91d804: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(333,0xacf942c0) malloc: * error for object 0x113ea04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(333,0xacf942c0) malloc: * error for object 0x91d804: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(333,0xacf942c0) malloc: * error for object 0x938e04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(333,0xacf942c0) malloc: * error for object 0x938e00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(333,0xacf942c0) malloc: * error for object 0x938e04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(333,0xacf942c0) malloc: * error for object 0x938e00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(333,0xacf942c0) malloc: * error for object 0x113ea04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(333,0xacf942c0) malloc: * error for object 0x111f200: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation Signal 15 received, exiting... Signal 15 received, exiting... Called boinc_finish Called boinc_finish hadcm3n_6.07_i686-apple-darwin(347,0xacf942c0) malloc: * error for object 0x13cec04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(347,0xacf942c0) malloc: * error for object 0xbcb204: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(347,0xacf942c0) malloc: * error for object 0x13cec04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(347,0xacf942c0) malloc: * error for object 0x13bc804: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(347,0xacf942c0) malloc: * error for object 0x13bc800: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(347,0xacf942c0) malloc: * error for object 0x13bc804: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(347,0xacf942c0) malloc: * error for object 0x13bc800: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(347,0xacf942c0) malloc: * error for object 0x13bc804: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(347,0xacf942c0) malloc: * error for object 0x13bc800: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(347,0xacf942c0) malloc: * error for object 0x13bc804: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(347,0xacf942c0) malloc: * error for object 0x13bc800: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(347,0xacf942c0) malloc: * error for object 0x13bc804: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(347,0xacf942c0) malloc: * error for object 0x13bc800: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(347,0xacf942c0) malloc: * error for object 0x13bc804: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(347,0xacf942c0) malloc: * error for object 0x13bc800: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 13:15:35 (426): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 13:10:32 (2263): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 13:10:50 (467): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 65 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 68 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 69 - Return code = 1 Error: Input file: dataout/n7llko.pje5c10 is not a valid UM file. Error converting file to netcdf: dataout/n7llko.pje5c10 Error: Input file: dataout/n7llko.pie5c10 is not a valid UM file. Error converting file to netcdf: dataout/n7llko.pie5c10 Error: Input file: dataout/n7llko.pfe5c10 is not a valid UM file. Error converting file to netcdf: dataout/n7llko.pfe5c10 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 13:29:37 (385): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 20:49:05 (375): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
30 Nov 2013 07:34:47	1246955	15921260	hadcm3n_n7ll_1920_40_008324872_4	1,036,800	2,254,314	2.1743
29 Nov 2013 12:04:45	1246955	15921260	hadcm3n_n7ll_1920_40_008324872_4	1,010,880	2,198,207	2.1745
28 Nov 2013 17:34:46	1246955	15921260	hadcm3n_n7ll_1920_40_008324872_4	984,960	2,143,657	2.1764
27 Nov 2013 16:22:35	1246955	15921260	hadcm3n_n7ll_1920_40_008324872_4	959,040	2,088,102	2.1773
26 Nov 2013 02:03:36	1246955	15921260	hadcm3n_n7ll_1920_40_008324872_4	933,120	2,032,679	2.1784
24 Nov 2013 08:46:40	1246955	15921260	hadcm3n_n7ll_1920_40_008324872_4	907,200	1,976,021	2.1782
23 Nov 2013 14:39:24	1246955	15921260	hadcm3n_n7ll_1920_40_008324872_4	881,280	1,921,105	2.1799
22 Nov 2013 00:02:52	1246955	15921260	hadcm3n_n7ll_1920_40_008324872_4	855,360	1,865,634	2.1811
21 Nov 2013 01:56:45	1246955	15921260	hadcm3n_n7ll_1920_40_008324872_4	829,440	1,803,951	2.1749
18 Nov 2013 20:31:24	1246955	15921260	hadcm3n_n7ll_1920_40_008324872_4	803,520	1,748,321	2.1758
17 Nov 2013 21:06:59	1246955	15921260	hadcm3n_n7ll_1920_40_008324872_4	777,600	1,692,577	2.1767
16 Nov 2013 09:45:37	1246955	15921260	hadcm3n_n7ll_1920_40_008324872_4	751,680	1,636,982	2.1778
14 Nov 2013 00:56:11	1246955	15921260	hadcm3n_n7ll_1920_40_008324872_4	725,760	1,582,152	2.1800
12 Nov 2013 10:02:11	1246955	15921260	hadcm3n_n7ll_1920_40_008324872_4	699,840	1,526,929	2.1818
11 Nov 2013 13:23:03	1246955	15921260	hadcm3n_n7ll_1920_40_008324872_4	673,920	1,472,485	2.1850
10 Nov 2013 04:36:56	1246955	15921260	hadcm3n_n7ll_1920_40_008324872_4	648,000	1,415,592	2.1846
08 Nov 2013 04:11:01	1246955	15921260	hadcm3n_n7ll_1920_40_008324872_4	622,080	1,360,340	2.1868
05 Nov 2013 23:24:26	1246955	15921260	hadcm3n_n7ll_1920_40_008324872_4	596,160	1,305,990	2.1907
04 Nov 2013 19:33:08	1246955	15921260	hadcm3n_n7ll_1920_40_008324872_4	570,240	1,249,979	2.1920
03 Nov 2013 17:27:41	1246955	15921260	hadcm3n_n7ll_1920_40_008324872_4	544,320	1,194,464	2.1944