Task 13347830

Name	hadcm3n_t20x_1940_40_007443010_0
Workunit	7640513
Created	8 Sep 2011, 22:44:53 UTC
Sent	8 Sep 2011, 22:52:04 UTC
Report deadline	9 Dec 2011, 6:19:15 UTC
Received	27 Oct 2011, 17:17:17 UTC
Server state	Over
Outcome	Success
Client state	Done
Exit status	0 (0x00000000)
Computer ID	864106
Run time	19 days 14 hours 41 min 42 sec
CPU time	16 days 11 hours 14 min 58 sec
Validate state	Valid
Credit	12,441.60
Device peak FLOPS	3.46 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 i686-apple-darwin
Stderr	<core_client_version>6.10.17</core_client_version> <![CDATA[ <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 06:28:16 (48795): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:28:17 (48795): No heartbeat from core client for 30 sec - exiting 06:28:18 (48795): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 02:59:22 (83834): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 18:16:46 (31281): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 23:34:17 (12079): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 00:31:23 (49877): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:31:25 (49877): No heartbeat from core client for 30 sec - exiting 00:31:26 (49877): No heartbeat from core client for 30 sec - exiting 00:31:27 (49877): No heartbeat from core client for 30 sec - exiting 00:31:28 (49877): No heartbeat from core client for 30 sec - exiting 00:31:29 (49877): No heartbeat from core client for 30 sec - exiting 00:31:30 (49877): No heartbeat from core client for 30 sec - exiting 00:31:31 (49877): No heartbeat from core client for 30 sec - exiting 00:31:32 (49877): No heartbeat from core client for 30 sec - exiting 00:31:33 (49877): No heartbeat from core client for 30 sec - exiting 00:31:34 (49877): No heartbeat from core client for 30 sec - exiting 00:31:35 (49877): No heartbeat from core client for 30 sec - exiting 00:31:36 (49877): No heartbeat from core client for 30 sec - exiting 00:31:37 (49877): No heartbeat from core client for 30 sec - exiting 00:31:38 (49877): No heartbeat from core client for 30 sec - exiting 00:31:39 (49877): No heartbeat from core client for 30 sec - exiting 00:31:40 (49877): No heartbeat from core client for 30 sec - exiting 00:31:41 (49877): No heartbeat from core client for 30 sec - exiting 00:31:42 (49877): No heartbeat from core client for 30 sec - exiting 00:31:43 (49877): No heartbeat from core client for 30 sec - exiting 00:31:44 (49877): No heartbeat from core client for 30 sec - exiting 00:31:45 (49877): No heartbeat from core client for 30 sec - exiting 00:31:46 (49877): No heartbeat from core client for 30 sec - exiting 00:31:47 (49877): No heartbeat from core client for 30 sec - exiting 00:31:48 (49877): No heartbeat from core client for 30 sec - exiting 00:31:49 (49877): No heartbeat from core client for 30 sec - exiting 00:31:50 (49877): No heartbeat from core client for 30 sec - exiting 00:31:51 (49877): No heartbeat from core client for 30 sec - exiting 00:31:52 (49877): No heartbeat from core client for 30 sec - exiting 00:31:53 (49877): No heartbeat from core client for 30 sec - exiting 00:31:54 (49877): No heartbeat from core client for 30 sec - exiting 00:31:55 (49877): No heartbeat from core client for 30 sec - exiting 00:31:56 (49877): No heartbeat from core client for 30 sec - exiting 00:31:57 (49877): No heartbeat from core client for 30 sec - exiting 00:31:58 (49877): No heartbeat from core client for 30 sec - exiting 00:31:59 (49877): No heartbeat from core client for 30 sec - exiting 00:32:00 (49877): No heartbeat from core client for 30 sec - exiting 00:32:01 (49877): No heartbeat from core client for 30 sec - exiting 00:32:02 (49877): No heartbeat from core client for 30 sec - exiting 00:32:03 (49877): No heartbeat from core client for 30 sec - exiting 00:32:04 (49877): No heartbeat from core client for 30 sec - exiting 00:32:05 (49877): No heartbeat from core client for 30 sec - exiting 00:32:06 (49877): No heartbeat from core client for 30 sec - exiting 00:32:07 (49877): No heartbeat from core client for 30 sec - exiting 00:32:08 (49877): No heartbeat from core client for 30 sec - exiting 00:32:09 (49877): No heartbeat from core client for 30 sec - exiting 12:11:33 (36203): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 05:53:08 (92801): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 17:47:02 (98541): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 19:14:53 (38179): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... hadcm3n_6.07_i686-apple-darwin(41405,0xa0056540) malloc: * error for object 0x2836c04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(41405,0xa0056540) malloc: * error for object 0x2836c00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=41416, selfPID=41416, iMonCtr=1 hadcm3n_6.07_i686-apple-darwin(49836,0xa0056540) malloc: * error for object 0x2000e04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(49836,0xa0056540) malloc: * error for object 0x2001c04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(49836,0xa0056540) malloc: * error for object 0x2001c00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(49836,0xa0056540) malloc: * error for object 0x2001c04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(49836,0xa0056540) malloc: * error for object 0x2001c00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(49836,0xa0056540) malloc: * error for object 0x2001c04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(49836,0xa0056540) malloc: * error for object 0x2001c00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(49836,0xa0056540) malloc: * error for object 0x2001c04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(49836,0xa0056540) malloc: * error for object 0x2001c00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(49836,0xa0056540) malloc: * error for object 0x2001c04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(49836,0xa0056540) malloc: * error for object 0x2001c00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(49836,0xa0056540) malloc: * error for object 0x281b604: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug CPDN Monitor - Quit request from BOINC... 23:07:09 (52293): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:38:47 (57384): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 17:23:51 (71487): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
31 Oct 2011 17:02:17	864106	13347830	hadcm3n_t20x_1940_40_007443010_0	1,036,800	1,422,363	1.3719
31 Oct 2011 16:33:35	864106	13347830	hadcm3n_t20x_1940_40_007443010_0	1,010,880	1,387,289	1.3724
31 Oct 2011 15:17:41	864106	13347830	hadcm3n_t20x_1940_40_007443010_0	984,960	1,352,184	1.3728
31 Oct 2011 15:13:56	864106	13347830	hadcm3n_t20x_1940_40_007443010_0	959,040	1,317,357	1.3736
31 Oct 2011 15:13:56	864106	13347830	hadcm3n_t20x_1940_40_007443010_0	933,120	1,282,697	1.3746
31 Oct 2011 15:13:56	864106	13347830	hadcm3n_t20x_1940_40_007443010_0	907,200	1,247,788	1.3754
31 Oct 2011 15:13:56	864106	13347830	hadcm3n_t20x_1940_40_007443010_0	881,280	1,213,115	1.3765
31 Oct 2011 15:13:56	864106	13347830	hadcm3n_t20x_1940_40_007443010_0	855,360	1,177,712	1.3769
31 Oct 2011 15:13:56	864106	13347830	hadcm3n_t20x_1940_40_007443010_0	829,440	1,142,493	1.3774
31 Oct 2011 15:13:56	864106	13347830	hadcm3n_t20x_1940_40_007443010_0	803,520	1,107,220	1.3780
31 Oct 2011 15:13:56	864106	13347830	hadcm3n_t20x_1940_40_007443010_0	777,600	1,071,848	1.3784
18 Oct 2011 15:53:21	864106	13347830	hadcm3n_t20x_1940_40_007443010_0	751,680	1,036,557	1.3790
17 Oct 2011 20:42:48	864106	13347830	hadcm3n_t20x_1940_40_007443010_0	725,760	1,001,204	1.3795
17 Oct 2011 00:13:14	864106	13347830	hadcm3n_t20x_1940_40_007443010_0	699,840	965,882	1.3801
16 Oct 2011 09:02:14	864106	13347830	hadcm3n_t20x_1940_40_007443010_0	673,920	930,346	1.3805
15 Oct 2011 18:28:24	864106	13347830	hadcm3n_t20x_1940_40_007443010_0	648,000	895,078	1.3813
14 Oct 2011 23:59:51	864106	13347830	hadcm3n_t20x_1940_40_007443010_0	622,080	859,454	1.3816
14 Oct 2011 08:23:46	864106	13347830	hadcm3n_t20x_1940_40_007443010_0	596,160	823,564	1.3814
13 Oct 2011 08:54:52	864106	13347830	hadcm3n_t20x_1940_40_007443010_0	570,240	787,771	1.3815
12 Oct 2011 07:18:56	864106	13347830	hadcm3n_t20x_1940_40_007443010_0	544,320	751,926	1.3814