Task 13100062

Name	hadcm3n_ybrc_1900_40_007348098_0
Workunit	7545528
Created	6 Jul 2011, 13:48:30 UTC
Sent	18 Jul 2011, 13:32:09 UTC
Report deadline	17 Oct 2011, 20:59:20 UTC
Received	13 Mar 2012, 12:31:53 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	1087112
Run time	16 days 9 hours 3 min 28 sec
CPU time	14 days 0 hours 37 min 48 sec
Validate state	Invalid
Credit	11,508.48
Device peak FLOPS	3.28 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 i686-apple-darwin
Stderr	<core_client_version>6.10.58</core_client_version> <![CDATA[ <message> process exited with code 22 (0x16, -234) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 07:29:12 (265): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 11:14:11 (344): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 07:12:55 (252): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:12:56 (252): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 06:48:42 (251): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 09:34:03 (299): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:34:04 (299): No heartbeat from core client for 30 sec - exiting 09:34:05 (299): No heartbeat from core client for 30 sec - exiting 09:34:06 (299): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 14:47:52 (6684): No heartbeat from core client for 30 sec - exiting 14:47:53 (6684): No heartbeat from core client for 30 sec - exiting 14:47:54 (6684): No heartbeat from core client for 30 sec - exiting 14:47:55 (6684): No heartbeat from core client for 30 sec - exiting 14:47:56 (6684): No heartbeat from core client for 30 sec - exiting 14:47:57 (6684): No heartbeat from core client for 30 sec - exiting 14:47:58 (6684): No heartbeat from core client for 30 sec - exiting 14:47:59 (6684): No heartbeat from core client for 30 sec - exiting 14:48:00 (6684): No heartbeat from core client for 30 sec - exiting 14:48:01 (6684): No heartbeat from core client for 30 sec - exiting 14:48:02 (6684): No heartbeat from core client for 30 sec - exiting 14:48:03 (6684): No heartbeat from core client for 30 sec - exiting 14:48:04 (6684): No heartbeat from core client for 30 sec - exiting 14:48:05 (6684): No heartbeat from core client for 30 sec - exiting 14:48:06 (6684): No heartbeat from core client for 30 sec - exiting 14:48:07 (6684): No heartbeat from core client for 30 sec - exiting 14:48:08 (6684): No heartbeat from core client for 30 sec - exiting 14:48:09 (6684): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 09:28:21 (289): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 07:14:20 (352): No heartbeat from core client for 30 sec - exiting 07:14:21 (352): No heartbeat from core client for 30 sec - exiting 07:14:22 (352): No heartbeat from core client for 30 sec - exiting 07:14:23 (352): No heartbeat from core client for 30 sec - exiting 07:14:24 (352): No heartbeat from core client for 30 sec - exiting 07:14:25 (352): No heartbeat from core client for 30 sec - exiting 07:14:26 (352): No heartbeat from core client for 30 sec - exiting 07:14:27 (352): No heartbeat from core client for 30 sec - exiting 07:14:28 (352): No heartbeat from core client for 30 sec - exiting 07:14:29 (352): No heartbeat from core client for 30 sec - exiting 07:14:30 (352): No heartbeat from core client for 30 sec - exiting 07:14:31 (352): No heartbeat from core client for 30 sec - exiting 07:14:32 (352): No heartbeat from core client for 30 sec - exiting 07:14:33 (352): No heartbeat from core client for 30 sec - exiting 07:14:34 (352): No heartbeat from core client for 30 sec - exiting 07:14:35 (352): No heartbeat from core client for 30 sec - exiting 07:14:36 (352): No heartbeat from core client for 30 sec - exiting 07:14:37 (352): No heartbeat from core client for 30 sec - exiting 07:14:38 (352): No heartbeat from core client for 30 sec - exiting 07:14:39 (352): No heartbeat from core client for 30 sec - exiting 07:14:40 (352): No heartbeat from core client for 30 sec - exiting 07:14:41 (352): No heartbeat from core client for 30 sec - exiting 07:14:42 (352): No heartbeat from core client for 30 sec - exiting 07:14:43 (352): No heartbeat from core client for 30 sec - exiting 07:14:44 (352): No heartbeat from core client for 30 sec - exiting 07:14:45 (352): No heartbeat from core client for 30 sec - exiting 07:14:46 (352): No heartbeat from core client for 30 sec - exiting 07:14:47 (352): No heartbeat from core client for 30 sec - exiting 07:14:48 (352): No heartbeat from core client for 30 sec - exiting 07:14:49 (352): No heartbeat from core client for 30 sec - exiting 07:14:50 (352): No heartbeat from core client for 30 sec - exiting 07:14:51 (352): No heartbeat from core client for 30 sec - exiting 07:14:52 (352): No heartbeat from core client for 30 sec - exiting 07:14:53 (352): No heartbeat from core client for 30 sec - exiting 07:14:54 (352): No heartbeat from core client for 30 sec - exiting 07:14:55 (352): No heartbeat from core client for 30 sec - exiting 07:14:56 (352): No heartbeat from core client for 30 sec - exiting 07:14:57 (352): No heartbeat from core client for 30 sec - exiting 07:14:58 (352): No heartbeat from core client for 30 sec - exiting 07:14:59 (352): No heartbeat from core client for 30 sec - exiting 07:15:00 (352): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 07:23:45 (257): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:23:46 (257): No heartbeat from core client for 30 sec - exiting 07:23:47 (257): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 09:25:16 (1350): No heartbeat from core client for 30 sec - exiting 09:25:17 (1350): No heartbeat from core client for 30 sec - exiting 09:25:18 (1350): No heartbeat from core client for 30 sec - exiting 09:25:19 (1350): No heartbeat from core client for 30 sec - exiting 09:25:20 (1350): No heartbeat from core client for 30 sec - exiting 09:25:21 (1350): No heartbeat from core client for 30 sec - exiting 09:25:22 (1350): No heartbeat from core client for 30 sec - exiting 09:25:23 (1350): No heartbeat from core client for 30 sec - exiting 09:25:24 (1350): No heartbeat from core client for 30 sec - exiting 09:25:25 (1350): No heartbeat from core client for 30 sec - exiting 09:25:26 (1350): No heartbeat from core client for 30 sec - exiting 09:25:27 (1350): No heartbeat from core client for 30 sec - exiting 09:25:28 (1350): No heartbeat from core client for 30 sec - exiting 09:25:29 (1350): No heartbeat from core client for 30 sec - exiting 09:25:30 (1350): No heartbeat from core client for 30 sec - exiting 09:25:31 (1350): No heartbeat from core client for 30 sec - exiting 09:25:32 (1350): No heartbeat from core client for 30 sec - exiting 09:25:33 (1350): No heartbeat from core client for 30 sec - exiting 09:25:34 (1350): No heartbeat from core client for 30 sec - exiting 09:25:35 (1350): No heartbeat from core client for 30 sec - exiting 09:25:36 (1350): No heartbeat from core client for 30 sec - exiting 09:25:37 (1350): No heartbeat from core client for 30 sec - exiting 09:25:38 (1350): No heartbeat from core client for 30 sec - exiting 09:25:39 (1350): No heartbeat from core client for 30 sec - exiting 09:25:40 (1350): No heartbeat from core client for 30 sec - exiting 09:25:41 (1350): No heartbeat from core client for 30 sec - exiting 09:25:42 (1350): No heartbeat from core client for 30 sec - exiting 09:25:43 (1350): No heartbeat from core client for 30 sec - exiting 09:25:44 (1350): No heartbeat from core client for 30 sec - exiting 09:25:45 (1350): No heartbeat from core client for 30 sec - exiting 09:25:46 (1350): No heartbeat from core client for 30 sec - exiting 09:25:47 (1350): No heartbeat from core client for 30 sec - exiting 09:25:48 (1350): No heartbeat from core client for 30 sec - exiting 09:25:49 (1350): No heartbeat from core client for 30 sec - exiting 09:25:50 (1350): No heartbeat from core client for 30 sec - exiting 09:25:51 (1350): No heartbeat from core client for 30 sec - exiting 09:25:52 (1350): No heartbeat from core client for 30 sec - exiting 09:25:53 (1350): No heartbeat from core client for 30 sec - exiting 09:25:54 (1350): No heartbeat from core client for 30 sec - exiting 09:25:55 (1350): No heartbeat from core client for 30 sec - exiting 09:25:56 (1350): No heartbeat from core client for 30 sec - exiting 09:25:57 (1350): No heartbeat from core client for 30 sec - exiting 09:25:58 (1350): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 14:08:32 (26338): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 06:48:45 (327): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 06:57:37 (301): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... hadcm3n_6.07_i686-apple-darwin(4647,0xa057f540) malloc: * error for object 0x103d600: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4649, selfPID=4649, iMonCtr=1 hadcm3n_6.07_i686-apple-darwin(17200,0xa057f540) malloc: * error for object 0x102de04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(17200,0xa057f540) malloc: * error for object 0x102de00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(17200,0xa057f540) malloc: * error for object 0x102de04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(17200,0xa057f540) malloc: * error for object 0x102de00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(17200,0xa057f540) malloc: * error for object 0x102de04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(17200,0xa057f540) malloc: * error for object 0x102de00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(17200,0xa057f540) malloc: * error for object 0x102de04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(17200,0xa057f540) malloc: * error for object 0x102de00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(17200,0xa057f540) malloc: * error for object 0x102de04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(17200,0xa057f540) malloc: * error for object 0x102de00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(17200,0xa057f540) malloc: * error for object 0x102de04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation hadcm3n_6.07_i686-apple-darwin(17712,0xa057f540) malloc: * error for object 0x83de04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation hadcm3n_6.07_i686-apple-darwin(627,0xa057f540) malloc: * error for object 0x81de04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(627,0xa057f540) malloc: * error for object 0x81de00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(627,0xa057f540) malloc: * error for object 0x81de04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(627,0xa057f540) malloc: * error for object 0x81de00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(627,0xa057f540) malloc: * error for object 0x81de04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(627,0xa057f540) malloc: * error for object 0x81de00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(627,0xa057f540) malloc: * error for object 0x81de04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(627,0xa057f540) malloc: * error for object 0x81de00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(627,0xa057f540) malloc: * error for object 0x81de04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(627,0xa057f540) malloc: * error for object 0x81de00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(627,0xa057f540) malloc: * error for object 0x81de04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(627,0xa057f540) malloc: * error for object 0x81de00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 07:12:30 (322): No heartbeat from core client for 30 sec - exiting 07:12:31 (322): No heartbeat from core client for 30 sec - exiting 07:12:32 (322): No heartbeat from core client for 30 sec - exiting 07:12:33 (322): No heartbeat from core client for 30 sec - exiting 07:12:34 (322): No heartbeat from core client for 30 sec - exiting 07:12:35 (322): No heartbeat from core client for 30 sec - exiting 07:12:36 (322): No heartbeat from core client for 30 sec - exiting 07:12:37 (322): No heartbeat from core client for 30 sec - exiting 07:12:38 (322): No heartbeat from core client for 30 sec - exiting 07:12:39 (322): No heartbeat from core client for 30 sec - exiting 07:12:40 (322): No heartbeat from core client for 30 sec - exiting 07:12:41 (322): No heartbeat from core client for 30 sec - exiting 07:12:42 (322): No heartbeat from core client for 30 sec - exiting 07:12:43 (322): No heartbeat from core client for 30 sec - exiting 07:12:44 (322): No heartbeat from core client for 30 sec - exiting 07:12:45 (322): No heartbeat from core client for 30 sec - exiting 07:12:46 (322): No heartbeat from core client for 30 sec - exiting 07:12:47 (322): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... hadcm3n_6.07_i686-apple-darwin(341,0xa0542540) malloc: * error for object 0x1022004: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(341,0xa0542540) malloc: * error for object 0x1022000: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(341,0xa0542540) malloc: * error for object 0x1022004: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(341,0xa0542540) malloc: * error for object 0x1022000: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(341,0xa0542540) malloc: * error for object 0x1022004: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(341,0xa0542540) malloc: * error for object 0x1022000: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(341,0xa0542540) malloc: * error for object 0x1022004: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(341,0xa0542540) malloc: * error for object 0x1022000: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(341,0xa0542540) malloc: * error for object 0x1022004: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(341,0xa0542540) malloc: * error for object 0x1022000: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(341,0xa0542540) malloc: * error for object 0x1022004: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(341,0xa0542540) malloc: * error for object 0x1022000: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 07:30:00 (327): No heartbeat from core client for 30 sec - exiting 07:30:01 (327): No heartbeat from core client for 30 sec - exiting 07:30:02 (327): No heartbeat from core client for 30 sec - exiting 07:30:03 (327): No heartbeat from core client for 30 sec - exiting 07:30:04 (327): No heartbeat from core client for 30 sec - exiting 07:30:05 (327): No heartbeat from core client for 30 sec - exiting 07:30:06 (327): No heartbeat from core client for 30 sec - exiting 07:30:07 (327): No heartbeat from core client for 30 sec - exiting 07:30:08 (327): No heartbeat from core client for 30 sec - exiting 07:30:09 (327): No heartbeat from core client for 30 sec - exiting 07:30:10 (327): No heartbeat from core client for 30 sec - exiting 07:30:11 (327): No heartbeat from core client for 30 sec - exiting 07:30:12 (327): No heartbeat from core client for 30 sec - exiting 07:30:13 (327): No heartbeat from core client for 30 sec - exiting 07:30:14 (327): No heartbeat from core client for 30 sec - exiting 07:30:15 (327): No heartbeat from core client for 30 sec - exiting 07:30:16 (327): No heartbeat from core client for 30 sec - exiting 07:30:17 (327): No heartbeat from core client for 30 sec - exiting 07:30:18 (327): No heartbeat from core client for 30 sec - exiting 07:30:19 (327): No heartbeat from core client for 30 sec - exiting 07:30:20 (327): No heartbeat from core client for 30 sec - exiting 07:30:21 (327): No heartbeat from core client for 30 sec - exiting 07:30:22 (327): No heartbeat from core client for 30 sec - exiting 07:30:23 (327): No heartbeat from core client for 30 sec - exiting 07:30:24 (327): No heartbeat from core client for 30 sec - exiting 07:30:25 (327): No heartbeat from core client for 30 sec - exiting 07:30:26 (327): No heartbeat from core client for 30 sec - exiting 07:30:27 (327): No heartbeat from core client for 30 sec - exiting 07:30:28 (327): No heartbeat from core client for 30 sec - exiting 07:30:29 (327): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 10:33:18 (413): No heartbeat from core client for 30 sec - exiting 10:33:19 (413): No heartbeat from core client for 30 sec - exiting 10:33:20 (413): No heartbeat from core client for 30 sec - exiting 10:33:21 (413): No heartbeat from core client for 30 sec - exiting 10:33:22 (413): No heartbeat from core client for 30 sec - exiting 10:33:23 (413): No heartbeat from core client for 30 sec - exiting 10:33:24 (413): No heartbeat from core client for 30 sec - exiting 10:33:25 (413): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 15:02:19 (370): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 11:02:05 (2869): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 12:16:16 (358): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... OPEN: File Creation Failed: No space left on device OPEN: Unable to Open File dataout/ybrcka.dad84l0 for Read/Write Model crashed: DUMPCTL : Fail to open output dump - may already exist Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
08 Mar 2012 14:33:35	1087112	13100062	hadcm3n_ybrc_1900_40_007348098_0	959,040	1,199,986	1.2512
07 Mar 2012 10:15:12	1087112	13100062	hadcm3n_ybrc_1900_40_007348098_0	933,120	1,166,608	1.2502
02 Mar 2012 09:57:51	1087112	13100062	hadcm3n_ybrc_1900_40_007348098_0	907,200	1,133,978	1.2500
23 Feb 2012 10:16:38	1087112	13100062	hadcm3n_ybrc_1900_40_007348098_0	881,280	1,102,513	1.2510
21 Feb 2012 07:56:18	1087112	13100062	hadcm3n_ybrc_1900_40_007348098_0	855,360	1,070,402	1.2514
15 Feb 2012 14:03:20	1087112	13100062	hadcm3n_ybrc_1900_40_007348098_0	829,440	1,038,157	1.2516
09 Feb 2012 11:49:06	1087112	13100062	hadcm3n_ybrc_1900_40_007348098_0	803,520	1,006,098	1.2521
07 Feb 2012 10:43:14	1087112	13100062	hadcm3n_ybrc_1900_40_007348098_0	777,600	973,928	1.2525
02 Feb 2012 10:43:59	1087112	13100062	hadcm3n_ybrc_1900_40_007348098_0	751,680	941,842	1.2530
31 Jan 2012 09:07:38	1087112	13100062	hadcm3n_ybrc_1900_40_007348098_0	725,760	908,526	1.2518
30 Jan 2012 07:16:26	1087112	13100062	hadcm3n_ybrc_1900_40_007348098_0	699,840	876,068	1.2518
24 Jan 2012 09:54:35	1087112	13100062	hadcm3n_ybrc_1900_40_007348098_0	673,920	843,746	1.2520
19 Jan 2012 09:36:42	1087112	13100062	hadcm3n_ybrc_1900_40_007348098_0	648,000	811,261	1.2519
22 Dec 2011 09:03:32	1087112	13100062	hadcm3n_ybrc_1900_40_007348098_0	622,080	778,750	1.2518
13 Dec 2011 12:32:32	1087112	13100062	hadcm3n_ybrc_1900_40_007348098_0	596,160	745,367	1.2503
08 Dec 2011 11:03:48	1087112	13100062	hadcm3n_ybrc_1900_40_007348098_0	570,240	711,969	1.2485
06 Dec 2011 10:10:24	1087112	13100062	hadcm3n_ybrc_1900_40_007348098_0	544,320	679,317	1.2480
01 Dec 2011 08:10:37	1087112	13100062	hadcm3n_ybrc_1900_40_007348098_0	518,400	646,653	1.2474
18 Nov 2011 09:09:17	1087112	13100062	hadcm3n_ybrc_1900_40_007348098_0	492,480	614,311	1.2474
18 Nov 2011 09:09:17	1087112	13100062	hadcm3n_ybrc_1900_40_007348098_0	466,560	581,790	1.2470