Task 13666241

Name	hadcm3n_u26r_1980_40_007545429_1
Workunit	7742661
Created	28 Nov 2011, 20:27:05 UTC
Sent	28 Nov 2011, 20:27:15 UTC
Report deadline	28 Feb 2012, 3:54:26 UTC
Received	28 Feb 2012, 10:54:40 UTC
Server state	Over
Outcome	Success
Client state	Done
Exit status	0 (0x00000000)
Computer ID	1102859
Run time	18 days 3 hours 3 min 10 sec
CPU time	13 days 1 hours 48 min 1 sec
Validate state	Valid
Credit	12,441.60
Device peak FLOPS	2.99 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 i686-apple-darwin
Stderr	<core_client_version>6.10.58</core_client_version> <![CDATA[ <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 18:48:58 (209): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:51:25 (3432): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 16:39:07 (6614): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:39:08 (6614): No heartbeat from core client for 30 sec - exiting 16:39:09 (6614): No heartbeat from core client for 30 sec - exiting 16:39:10 (6614): No heartbeat from core client for 30 sec - exiting 16:39:11 (6614): No heartbeat from core client for 30 sec - exiting 16:39:12 (6614): No heartbeat from core client for 30 sec - exiting 16:39:13 (6614): No heartbeat from core client for 30 sec - exiting 16:39:14 (6614): No heartbeat from core client for 30 sec - exiting 16:39:15 (6614): No heartbeat from core client for 30 sec - exiting 17:40:46 (14071): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:42:17 (14842): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:42:18 (14842): No heartbeat from core client for 30 sec - exiting 18:42:19 (14842): No heartbeat from core client for 30 sec - exiting 18:42:20 (14842): No heartbeat from core client for 30 sec - exiting 18:42:21 (14842): No heartbeat from core client for 30 sec - exiting 21:45:48 (15629): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:05:21 (17748): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:05:23 (17748): No heartbeat from core client for 30 sec - exiting 22:05:24 (17748): No heartbeat from core client for 30 sec - exiting 22:05:25 (17748): No heartbeat from core client for 30 sec - exiting 22:05:26 (17748): No heartbeat from core client for 30 sec - exiting 22:05:27 (17748): No heartbeat from core client for 30 sec - exiting 22:05:28 (17748): No heartbeat from core client for 30 sec - exiting 22:05:29 (17748): No heartbeat from core client for 30 sec - exiting 22:05:30 (17748): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 22:08:28 (18953): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:08:29 (18953): No heartbeat from core client for 30 sec - exiting 22:08:30 (18953): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 08:45:01 (5748): No heartbeat from core client for 30 sec - exiting 08:45:02 (5748): No heartbeat from core client for 30 sec - exiting 08:45:03 (5748): No heartbeat from core client for 30 sec - exiting 08:45:04 (5748): No heartbeat from core client for 30 sec - exiting 08:45:05 (5748): No heartbeat from core client for 30 sec - exiting 08:45:36 (5748): No heartbeat from core client for 30 sec - exiting 08:45:37 (5748): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 15:06:12 (11140): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:06:13 (11140): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... 15:18:01 (11362): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:43:33 (11456): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:43:36 (11456): No heartbeat from core client for 30 sec - exiting 15:59:37 (11829): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:59:38 (11829): No heartbeat from core client for 30 sec - exiting 15:59:39 (11829): No heartbeat from core client for 30 sec - exiting 15:59:40 (11829): No heartbeat from core client for 30 sec - exiting 15:59:41 (11829): No heartbeat from core client for 30 sec - exiting 15:59:42 (11829): No heartbeat from core client for 30 sec - exiting 16:45:02 (12045): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:45:03 (12045): No heartbeat from core client for 30 sec - exiting 16:45:04 (12045): No heartbeat from core client for 30 sec - exiting 16:45:05 (12045): No heartbeat from core client for 30 sec - exiting 16:45:06 (12045): No heartbeat from core client for 30 sec - exiting 16:45:07 (12045): No heartbeat from core client for 30 sec - exiting 16:45:08 (12045): No heartbeat from core client for 30 sec - exiting 16:45:09 (12045): No heartbeat from core client for 30 sec - exiting 16:45:10 (12045): No heartbeat from core client for 30 sec - exiting 16:45:11 (12045): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Signal 3 received, exiting... Called boinc_finish 08:16:40 (19175): Can't acquire lockfile (-154) - waiting 35s 11:37:50 (19175): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:43:23 (22720): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Signal 3 received, exiting... Called boinc_finish 20:37:57 (33426): No heartbeat from core client for 30 sec - exiting 20:37:58 (33426): No heartbeat from core client for 30 sec - exiting 20:37:59 (33426): No heartbeat from core client for 30 sec - exiting 20:38:00 (33426): No heartbeat from core client for 30 sec - exiting 20:38:01 (33426): No heartbeat from core client for 30 sec - exiting 20:38:02 (33426): No heartbeat from core client for 30 sec - exiting 20:38:03 (33426): No heartbeat from core client for 30 sec - exiting 20:38:04 (33426): No heartbeat from core client for 30 sec - exiting 20:38:05 (33426): No heartbeat from core client for 30 sec - exiting 20:38:07 (33426): No heartbeat from core client for 30 sec - exiting 20:38:08 (33426): No heartbeat from core client for 30 sec - exiting 20:38:09 (33426): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Signal 3 received, exiting... Called boinc_finish CPDN Monitor - Quit request from BOINC... 13:22:26 (1120): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:22:27 (1120): No heartbeat from core client for 30 sec - exiting 13:22:28 (1120): No heartbeat from core client for 30 sec - exiting 13:22:29 (1120): No heartbeat from core client for 30 sec - exiting 13:22:30 (1120): No heartbeat from core client for 30 sec - exiting 13:22:31 (1120): No heartbeat from core client for 30 sec - exiting 13:22:32 (1120): No heartbeat from core client for 30 sec - exiting 13:22:33 (1120): No heartbeat from core client for 30 sec - exiting 13:22:34 (1120): No heartbeat from core client for 30 sec - exiting 13:22:35 (1120): No heartbeat from core client for 30 sec - exiting 13:25:32 (1236): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:25:33 (1236): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Signal 3 received, exiting... Called boinc_finish CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 15:08:19 (10827): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:15:33 (16408): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:16:56 (19123): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:00:03 (20070): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 08:10:43 (34269): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 12:52:09 (311): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:52:10 (311): No heartbeat from core client for 30 sec - exiting 12:52:11 (311): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... Signal 3 received, exiting... Called boinc_finish CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 07:32:04 (19828): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:32:05 (19828): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 19:03:56 (28697): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:52:18 (28928): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Signal 3 received, exiting... Called boinc_finish CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... hadcm3n_6.07_i686-apple-darwin(230,0xa0382540) malloc: * error for object 0x4001c04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(230,0xa0382540) malloc: * error for object 0x4001c00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(230,0xa0382540) malloc: * error for object 0x802804: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(230,0xa0382540) malloc: * error for object 0x802800: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(230,0xa0382540) malloc: * error for object 0x802804: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(230,0xa0382540) malloc: * error for object 0x802800: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(230,0xa0382540) malloc: * error for object 0x802804: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(230,0xa0382540) malloc: * error for object 0x802800: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(230,0xa0382540) malloc: * error for object 0x802804: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(230,0xa0382540) malloc: * error for object 0x802800: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(230,0xa0382540) malloc: * error for object 0x802804: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(230,0xa0382540) malloc: * error for object 0x802800: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug 19:14:01 (255): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:45:28 (9450): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 08:34:09 (14220): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:19:28 (14274): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:09:32 (17566): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 16:34:59 (213): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:35:13 (213): No heartbeat from core client for 30 sec - exiting 16:35:14 (213): No heartbeat from core client for 30 sec - exiting 16:35:15 (213): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 19:47:30 (432): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:47:31 (432): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 07:52:24 (236): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:52:25 (236): No heartbeat from core client for 30 sec - exiting 07:52:26 (236): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Signal 3 received, exiting... Called boinc_finish CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 13:19:16 (21907): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 19:26:41 (40021): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 16:56:57 (41400): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:59:00 (49572): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 13:59:58 (11377): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
28 Feb 2012 09:57:48	1102859	13666241	hadcm3n_u26r_1980_40_007545429_1	1,036,800	1,129,223	1.0891
25 Feb 2012 22:05:27	1102859	13666241	hadcm3n_u26r_1980_40_007545429_1	1,010,880	1,099,907	1.0881
25 Feb 2012 08:35:19	1102859	13666241	hadcm3n_u26r_1980_40_007545429_1	984,960	1,070,434	1.0868
24 Feb 2012 09:03:53	1102859	13666241	hadcm3n_u26r_1980_40_007545429_1	959,040	1,038,722	1.0831
23 Feb 2012 06:57:55	1102859	13666241	hadcm3n_u26r_1980_40_007545429_1	933,120	1,006,690	1.0788
22 Feb 2012 12:22:19	1102859	13666241	hadcm3n_u26r_1980_40_007545429_1	907,200	975,063	1.0748
20 Feb 2012 20:19:41	1102859	13666241	hadcm3n_u26r_1980_40_007545429_1	881,280	944,875	1.0722
14 Feb 2012 19:03:24	1102859	13666241	hadcm3n_u26r_1980_40_007545429_1	855,360	915,612	1.0704
12 Feb 2012 09:09:06	1102859	13666241	hadcm3n_u26r_1980_40_007545429_1	829,440	887,797	1.0704
09 Feb 2012 14:32:09	1102859	13666241	hadcm3n_u26r_1980_40_007545429_1	803,520	860,261	1.0706
08 Feb 2012 18:42:02	1102859	13666241	hadcm3n_u26r_1980_40_007545429_1	777,600	832,774	1.0710
07 Feb 2012 12:20:07	1102859	13666241	hadcm3n_u26r_1980_40_007545429_1	751,680	805,344	1.0714
06 Feb 2012 12:05:06	1102859	13666241	hadcm3n_u26r_1980_40_007545429_1	725,760	777,884	1.0718
05 Feb 2012 17:49:29	1102859	13666241	hadcm3n_u26r_1980_40_007545429_1	699,840	750,447	1.0723
04 Feb 2012 17:56:02	1102859	13666241	hadcm3n_u26r_1980_40_007545429_1	673,920	722,738	1.0724
04 Feb 2012 07:09:22	1102859	13666241	hadcm3n_u26r_1980_40_007545429_1	648,000	694,630	1.0720
01 Feb 2012 20:02:13	1102859	13666241	hadcm3n_u26r_1980_40_007545429_1	622,080	666,567	1.0715
29 Jan 2012 15:14:33	1102859	13666241	hadcm3n_u26r_1980_40_007545429_1	596,160	640,034	1.0736
29 Jan 2012 07:21:48	1102859	13666241	hadcm3n_u26r_1980_40_007545429_1	570,240	613,659	1.0761
28 Jan 2012 12:41:48	1102859	13666241	hadcm3n_u26r_1980_40_007545429_1	544,320	587,252	1.0789