Task 15862667

Name	hadcm3n_zhuh_1920_40_008316691_4
Workunit	8467826
Created	25 Jun 2013, 4:14:59 UTC
Sent	25 Jun 2013, 4:39:04 UTC
Report deadline	24 Sep 2013, 12:06:15 UTC
Received	20 Aug 2013, 14:30:48 UTC
Server state	Over
Outcome	Success
Client state	Done
Exit status	0 (0x00000000)
Computer ID	1231328
Run time	30 days 21 hours 50 min 48 sec
CPU time	19 days 8 hours 58 min 55 sec
Validate state	Valid
Credit	12,441.60
Device peak FLOPS	3.03 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 i686-apple-darwin
Stderr	<core_client_version>7.0.65</core_client_version> <![CDATA[ <stderr_txt> CPDN Monitor - Quit request from BOINC... 19:58:54 (23512): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:35:56 (24327): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Atmos Hold Restart file rename failed on atmos_restart.hold CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 04:30:35 (44750): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:30:37 (44750): No heartbeat from core client for 30 sec - exiting 04:30:38 (44750): No heartbeat from core client for 30 sec - exiting 04:30:39 (44750): No heartbeat from core client for 30 sec - exiting 04:30:40 (44750): No heartbeat from core client for 30 sec - exiting 04:30:41 (44750): No heartbeat from core client for 30 sec - exiting 04:30:42 (44750): No heartbeat from core client for 30 sec - exiting 04:30:43 (44750): No heartbeat from core client for 30 sec - exiting 04:30:44 (44750): No heartbeat from core client for 30 sec - exiting 04:30:45 (44750): No heartbeat from core client for 30 sec - exiting 04:30:46 (44750): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... 19:12:19 (54789): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:16:03 (55293): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:16:06 (55293): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 23:27:31 (85823): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 18:03:10 (96549): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:03:14 (96549): No heartbeat from core client for 30 sec - exiting 18:03:15 (96549): No heartbeat from core client for 30 sec - exiting 01:39:24 (96582): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:39:26 (96582): No heartbeat from core client for 30 sec - exiting 01:39:27 (96582): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 03:32:54 (25268): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:23:35 (29323): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:23:39 (29323): No heartbeat from core client for 30 sec - exiting 06:23:40 (29323): No heartbeat from core client for 30 sec - exiting 06:23:41 (29323): No heartbeat from core client for 30 sec - exiting 06:23:42 (29323): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 22:22:56 (45365): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:29:58 (47150): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:11:58 (47217): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:12:02 (47217): No heartbeat from core client for 30 sec - exiting 01:12:03 (47217): No heartbeat from core client for 30 sec - exiting 01:12:04 (47217): No heartbeat from core client for 30 sec - exiting 01:12:05 (47217): No heartbeat from core client for 30 sec - exiting 02:18:18 (48307): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:18:30 (48307): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... 00:05:21 (55653): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:51:10 (58131): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:35:30 (58868): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:35:32 (58868): No heartbeat from core client for 30 sec - exiting 02:35:33 (58868): No heartbeat from core client for 30 sec - exiting 02:35:34 (58868): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 00:05:14 (1592): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 21:23:53 (23098): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:37:42 (24453): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... hadcm3n_6.07_i686-apple-darwin(24565,0xa06ad540) malloc: * error for object 0x2042c04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(24565,0xa06ad540) malloc: * error for object 0x2042c00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(24565,0xa06ad540) malloc: * error for object 0x2823e04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(24565,0xa06ad540) malloc: * error for object 0x2823e00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(24565,0xa06ad540) malloc: * error for object 0x483fc04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(24565,0xa06ad540) malloc: * error for object 0x483fc00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(24565,0xa06ad540) malloc: * error for object 0x846a04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(24565,0xa06ad540) malloc: * error for object 0x2823e04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation 05:49:02 (24565): No heartbeat from core client for 30 sec - exiting hadcm3n_6.07_i686-apple-darwin(33387,0xa06ad540) malloc: * error for object 0x820e04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(33387,0xa06ad540) malloc: * error for object 0x201c604: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(33387,0xa06ad540) malloc: * error for object 0x820e04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(33387,0xa06ad540) malloc: * error for object 0x806604: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(33387,0xa06ad540) malloc: * error for object 0x806600: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(33387,0xa06ad540) malloc: * error for object 0x806604: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(33387,0xa06ad540) malloc: * error for object 0x806600: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(33387,0xa06ad540) malloc: * error for object 0x806604: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(33387,0xa06ad540) malloc: * error for object 0x806600: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(33387,0xa06ad540) malloc: * error for object 0x806604: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(33387,0xa06ad540) malloc: * error for object 0x806600: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(33387,0xa06ad540) malloc: * error for object 0x806604: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(33387,0xa06ad540) malloc: * error for object 0x806600: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(33387,0xa06ad540) malloc: * error for object 0x2000e04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(33387,0xa06ad540) malloc: * error for object 0x2000e00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 05:06:08 (56585): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:06:18 (56585): No heartbeat from core client for 30 sec - exiting 05:06:19 (56585): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 22:02:25 (25755): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:55:58 (27390): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:56:01 (27390): No heartbeat from core client for 30 sec - exiting 22:56:02 (27390): No heartbeat from core client for 30 sec - exiting 22:56:03 (27390): No heartbeat from core client for 30 sec - exiting 22:56:04 (27390): No heartbeat from core client for 30 sec - exiting 22:56:05 (27390): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 22:24:29 (36559): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 03:06:07 (57391): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 03:04:29 (77331): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:04:34 (77331): No heartbeat from core client for 30 sec - exiting 03:04:35 (77331): No heartbeat from core client for 30 sec - exiting 03:04:36 (77331): No heartbeat from core client for 30 sec - exiting 03:04:37 (77331): No heartbeat from core client for 30 sec - exiting 03:04:38 (77331): No heartbeat from core client for 30 sec - exiting 03:04:39 (77331): No heartbeat from core client for 30 sec - exiting 03:04:40 (77331): No heartbeat from core client for 30 sec - exiting 03:04:41 (77331): No heartbeat from core client for 30 sec - exiting 03:04:42 (77331): No heartbeat from core client for 30 sec - exiting 03:04:43 (77331): No heartbeat from core client for 30 sec - exiting 03:04:44 (77331): No heartbeat from core client for 30 sec - exiting 03:04:45 (77331): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... 19:22:28 (87107): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:17:15 (87673): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:17:17 (87673): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... 21:17:23 (97256): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 18:29:57 (7085): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:30:00 (7085): No heartbeat from core client for 30 sec - exiting 21:09:22 (7305): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:00:15 (8369): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:00:16 (8369): No heartbeat from core client for 30 sec - exiting 22:00:17 (8369): No heartbeat from core client for 30 sec - exiting 22:33:22 (8721): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:55:44 (8949): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:30:46 (9499): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 19:12:32 (27513): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 18:02:41 (38167): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:55:28 (38210): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:55:29 (38210): No heartbeat from core client for 30 sec - exiting 23:55:30 (38210): No heartbeat from core client for 30 sec - exiting 23:55:31 (38210): No heartbeat from core client for 30 sec - exiting 23:55:32 (38210): No heartbeat from core client for 30 sec - exiting 03:19:01 (40555): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 06:01:27 (6000): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 20:45:46 (16893): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:45:51 (16893): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... 18:30:59 (27293): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:31:01 (27293): No heartbeat from core client for 30 sec - exiting 21:47:27 (27500): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 06:19:34 (38945): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:19:39 (38945): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 03:36:30 (70537): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:36:32 (70537): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 07:50:05 (484): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
20 Aug 2013 07:22:51	1231328	15862667	hadcm3n_zhuh_1920_40_008316691_4	1,036,800	1,673,245	1.6139
18 Aug 2013 13:05:42	1231328	15862667	hadcm3n_zhuh_1920_40_008316691_4	1,010,880	1,625,803	1.6083
17 Aug 2013 03:33:43	1231328	15862667	hadcm3n_zhuh_1920_40_008316691_4	984,960	1,576,815	1.6009
15 Aug 2013 08:20:31	1231328	15862667	hadcm3n_zhuh_1920_40_008316691_4	959,040	1,528,170	1.5934
14 Aug 2013 16:18:46	1231328	15862667	hadcm3n_zhuh_1920_40_008316691_4	933,120	1,492,643	1.5996
14 Aug 2013 16:18:46	1231328	15862667	hadcm3n_zhuh_1920_40_008316691_4	907,200	1,463,241	1.6129
14 Aug 2013 16:18:46	1231328	15862667	hadcm3n_zhuh_1920_40_008316691_4	881,280	1,430,723	1.6235
14 Aug 2013 16:18:46	1231328	15862667	hadcm3n_zhuh_1920_40_008316691_4	855,360	1,398,073	1.6345
14 Aug 2013 16:18:46	1231328	15862667	hadcm3n_zhuh_1920_40_008316691_4	829,440	1,365,618	1.6464
14 Aug 2013 16:18:46	1231328	15862667	hadcm3n_zhuh_1920_40_008316691_4	803,520	1,332,940	1.6589
14 Aug 2013 16:18:46	1231328	15862667	hadcm3n_zhuh_1920_40_008316691_4	777,600	1,300,236	1.6721
14 Aug 2013 16:18:46	1231328	15862667	hadcm3n_zhuh_1920_40_008316691_4	751,680	1,267,619	1.6864
14 Aug 2013 16:18:46	1231328	15862667	hadcm3n_zhuh_1920_40_008316691_4	725,760	1,235,112	1.7018
14 Aug 2013 16:18:46	1231328	15862667	hadcm3n_zhuh_1920_40_008316691_4	699,840	1,202,518	1.7183
14 Aug 2013 16:18:46	1231328	15862667	hadcm3n_zhuh_1920_40_008316691_4	673,920	1,169,891	1.7359
14 Aug 2013 16:18:46	1231328	15862667	hadcm3n_zhuh_1920_40_008316691_4	648,000	1,136,498	1.7539
14 Aug 2013 16:18:46	1231328	15862667	hadcm3n_zhuh_1920_40_008316691_4	622,080	1,103,499	1.7739
14 Aug 2013 16:18:45	1231328	15862667	hadcm3n_zhuh_1920_40_008316691_4	596,160	1,066,306	1.7886
14 Aug 2013 16:18:45	1231328	15862667	hadcm3n_zhuh_1920_40_008316691_4	570,240	1,023,732	1.7953
29 Jul 2013 13:22:57	1231328	15862667	hadcm3n_zhuh_1920_40_008316691_4	544,320	980,364	1.8011