Task 15609522

Name	hadcm3n_47wx_1940_40_008309782_3
Workunit	8460917
Created	15 Feb 2013, 18:54:08 UTC
Sent	15 Feb 2013, 18:54:23 UTC
Report deadline	18 May 2013, 2:21:34 UTC
Received	2 May 2013, 11:17:17 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	939545
Run time	18 days 18 hours 15 min 36 sec
CPU time	13 days 18 hours 3 min 4 sec
Validate state	Invalid
Credit	8,087.04
Device peak FLOPS	2.38 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 i686-apple-darwin
Stderr	<core_client_version>7.0.31</core_client_version> <![CDATA[ <message> process exited with code 22 (0x16, -234) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 18:15:50 (7974): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... hadcm3n_6.07_i686-apple-darwin(44766,0xad0502c0) malloc: * error for object 0x910c04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(44766,0xad0502c0) malloc: * error for object 0x910c00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(44766,0xad0502c0) malloc: * error for object 0x910c04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(44766,0xad0502c0) malloc: * error for object 0x910c00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(44766,0xad0502c0) malloc: * error for object 0x10f2c04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(44766,0xad0502c0) malloc: * error for object 0x8f5604: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(44766,0xad0502c0) malloc: * error for object 0x910c04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(44766,0xad0502c0) malloc: * error for object 0x910c00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(44766,0xad0502c0) malloc: * error for object 0x10f2c04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(44766,0xad0502c0) malloc: * error for object 0x110e204: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(44766,0xad0502c0) malloc: * error for object 0x110e200: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(44766,0xad0502c0) malloc: * error for object 0x910c04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(44766,0xad0502c0) malloc: * error for object 0x910c00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(44766,0xad0502c0) malloc: * error for object 0x10f2c04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(44766,0xad0502c0) malloc: * error for object 0x110e204: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(44766,0xad0502c0) malloc: * error for object 0x110e200: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(44766,0xad0502c0) malloc: * error for object 0x8f5604: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(44766,0xad0502c0) malloc: * error for object 0x910c04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(44766,0xad0502c0) malloc: * error for object 0x910c00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(44766,0xad0502c0) malloc: * error for object 0x110e204: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(44766,0xad0502c0) malloc: * error for object 0x110e200: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(44766,0xad0502c0) malloc: * error for object 0x8f5604: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(44766,0xad0502c0) malloc: * error for object 0x910c04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(44766,0xad0502c0) malloc: * error for object 0x910c00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(44766,0xad0502c0) malloc: * error for object 0x10f2c04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(44766,0xad0502c0) malloc: * error for object 0x8eae04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(44766,0xad0502c0) malloc: * error for object 0x8eae00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(44766,0xad0502c0) malloc: * error for object 0x10bb204: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(44766,0xad0502c0) malloc: * error for object 0x10bb200: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(44766,0xad0502c0) malloc: * error for object 0x10bb200: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation Crashed executable name: hadcm3n_6.07_i686-apple-darwin built using BOINC library version 6.13.0 Machine type Intel 80486 (32-bit executable) hadcm3n_6.07_i686-apple-darwin(48539,0xad0502c0) malloc: * error for object 0x1306a04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(48539,0xad0502c0) malloc: * error for object 0xaf6e04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(48539,0xad0502c0) malloc: * error for object 0x1306a04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(48539,0xad0502c0) malloc: * error for object 0x12dc604: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(48539,0xad0502c0) malloc: * error for object 0x12dc600: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(48539,0xad0502c0) malloc: * error for object 0xae9e04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(48539,0xad0502c0) malloc: * error for object 0xae9e00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(48539,0xad0502c0) malloc: * error for object 0xac4404: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(48539,0xad0502c0) malloc: * error for object 0xac4400: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(48539,0xad0502c0) malloc: * error for object 0xac4404: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(48539,0xad0502c0) malloc: * error for object 0xac4400: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(48539,0xad0502c0) malloc: * error for object 0xac4404: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(48539,0xad0502c0) malloc: * error for object 0xac4400: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(48539,0xad0502c0) malloc: * error for object 0xac4404: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(48539,0xad0502c0) malloc: * error for object 0xac4400: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 12:19:27 (4336): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 11:07:29 (11571): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 09:43:23 (799): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 21:42:38 (29692): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:45:01 (29742): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:48:44 (29773): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:52:39 (29796): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:56:26 (29818): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:00:17 (29841): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:04:10 (29864): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 19:18:03 (32922): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 15:15:53 (12160): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 17:07:44 (12782): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... hadcm3n_6.07_i686-apple-darwin(1191,0xacb782c0) malloc: * error for object 0x124a804: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(1191,0xacb782c0) malloc: * error for object 0x1265e04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(1191,0xacb782c0) malloc: * error for object 0x1265e00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(1191,0xacb782c0) malloc: * error for object 0x1265e04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(1191,0xacb782c0) malloc: * error for object 0x1265e00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(1191,0xacb782c0) malloc: * error for object 0x1265e04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(1191,0xacb782c0) malloc: * error for object 0x1265e00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(1191,0xacb782c0) malloc: * error for object 0xa89604: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(1191,0xacb782c0) malloc: * error for object 0x124a804: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(1191,0xacb782c0) malloc: * error for object 0x1265e04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(1191,0xacb782c0) malloc: * error for object 0x1265e00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(1191,0xacb782c0) malloc: * error for object 0xa89604: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 07:38:25 (3367): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 17:17:29 (20754): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 17:27:16 (11782): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:37:13 (11806): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:42:49 (11877): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 21:06:55 (12470): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 13:40:02 (14784): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 63 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 64 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 65 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 66 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 67 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 68 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 69 - Return code = 1 CPDN Monitor - Quit request from BOINC... BUFFIN: Read Failed: Inappropriate ioctl for device BUFFIN: C I/O Error feof - Unit 63 - Return code = 1 BUFFIN: Read Failed: Inappropriate ioctl for device BUFFIN: C I/O Error feof - Unit 64 - Return code = 1 BUFFIN: Read Failed: Inappropriate ioctl for device BUFFIN: C I/O Error feof - Unit 65 - Return code = 1 BUFFIN: Read Failed: Inappropriate ioctl for device BUFFIN: C I/O Error feof - Unit 66 - Return code = 1 BUFFIN: Read Failed: Inappropriate ioctl for device BUFFIN: C I/O Error feof - Unit 67 - Return code = 1 BUFFIN: Read Failed: Inappropriate ioctl for device BUFFIN: C I/O Error feof - Unit 68 - Return code = 1 BUFFIN: Read Failed: Inappropriate ioctl for device BUFFIN: C I/O Error feof - Unit 69 - Return code = 1 CPDN Monitor - Quit request from BOINC... BUFFIN: Read Failed: Inappropriate ioctl for device BUFFIN: C I/O Error feof - Unit 63 - Return code = 1 BUFFIN: Read Failed: Inappropriate ioctl for device BUFFIN: C I/O Error feof - Unit 64 - Return code = 1 BUFFIN: Read Failed: Inappropriate ioctl for device BUFFIN: C I/O Error feof - Unit 65 - Return code = 1 BUFFIN: Read Failed: Inappropriate ioctl for device BUFFIN: C I/O Error feof - Unit 66 - Return code = 1 BUFFIN: Read Failed: Inappropriate ioctl for device BUFFIN: C I/O Error feof - Unit 67 - Return code = 1 BUFFIN: Read Failed: Inappropriate ioctl for device BUFFIN: C I/O Error feof - Unit 68 - Return code = 1 BUFFIN: Read Failed: Inappropriate ioctl for device BUFFIN: C I/O Error feof - Unit 69 - Return code = 1 14:13:31 (1779): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... SIGABRT: abort called Crashed executable name: hadcm3n_um_6.07_i686-apple-darwin built using BOINC library version 6.13.0 Machine type Intel 80486 (32-bit executable) System version: Macintosh OS 10.7.5 build 11G63 Wed May 1 13:16:51 2013 Thread 0 Crashed: Thread 1: Thread 0 crashed with X86 Thread State (32-bit): eax: 0x00000000 ebx: 0x00000000 ecx: 0x00000000 edx: 0x00000000 edi: 0x00000000 esi: 0x00000000 ebp: 0xbfffccb8 esp: 0x00000000 ss: 0x00000000 efl: 0x00000000 eip: 0x00447dc2 cs: 0x00000000 ds: 0x00000000 es: 0x00000000 fs: 0x00000000 gs: 0x00000000 Binary Images Description: 0x1000 - 0x4cbfff /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_um_6.07_i686-apple-darwin 0x90f17000 - 0x90f1cfff /usr/lib/system/libmacho.dylib 0x90f1d000 - 0x90f1efff /usr/lib/system/libremovefile.dylib 0x915ce000 - 0x915fdfff /usr/lib/system/libsystem_info.dylib 0x91963000 - 0x91981fff /usr/lib/system/libsystem_kernel.dylib 0x91f92000 - 0x91f92fff /usr/lib/system/libdnsinfo.dylib 0x92171000 - 0x9219ffff /usr/lib/libSystem.B.dylib 0x922a6000 - 0x922b4fff /usr/lib/system/libdispatch.dylib 0x92643000 - 0x92643fff /usr/lib/system/libkeymgr.dylib 0x9269a000 - 0x926a2fff /usr/lib/system/liblaunch.dylib 0x93097000 - 0x930adfff /usr/lib/system/libxpc.dylib 0x930d1000 - 0x930d2fff /usr/lib/system/libsystem_blocks.dylib 0x9391a000 - 0x9395dfff /usr/lib/system/libcommonCrypto.dylib 0x93a02000 - 0x93a06fff /usr/lib/system/libcache.dylib 0x94040000 - 0x94043fff /usr/lib/system/libcompiler_rt.dylib 0x94ce7000 - 0x94ce8fff /usr/lib/system/libsystem_sandbox.dylib 0x95377000 - 0x9537afff /usr/lib/system/libmathCommon.A.dylib 0x956f1000 - 0x956f9fff /usr/lib/system/libcopyfile.dylib 0x956fa000 - 0x957c5fff /usr/lib/system/libsystem_c.dylib 0x95ef9000 - 0x95efafff /usr/lib/system/libunc.dylib 0x962b7000 - 0x962bffff /usr/lib/system/libunwind.dylib 0x97735000 - 0x97736fff /usr/lib/system/libquarantine.dylib 0x97c58000 - 0x97c5ffff /usr/lib/system/libsystem_notify.dylib 0x99197000 - 0x9919bfff /usr/lib/system/libsystem_network.dylib 0x9a541000 - 0x9a548fff /usr/lib/system/libsystem_dnssd.dylib 0x9b814000 - 0x9b822fff /usr/lib/libz.1.dylib 0x9c5e1000 - 0x9c5e3fff /usr/lib/system/libdyld.dylib Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=334, iMonCtr=1 Model crash detected, will try to restart... SIGABRT: abort called Crashed executable name: hadcm3n_um_6.07_i686-apple-darwin built using BOINC library version 6.13.0 Machine type Intel 80486 (32-bit executable) System version: Macintosh OS 10.7.5 build 11G63 Wed May 1 13:16:54 2013 Thread 0 Crashed: Thread 1: Thread 0 crashed with X86 Thread State (32-bit): eax: 0x00000000 ebx: 0x00000000 ecx: 0x00000000 edx: 0x00000000 edi: 0x00000000 esi: 0x00000000 ebp: 0xbfffccb8 esp: 0x00000000 ss: 0x00000000 efl: 0x00000000 eip: 0x00447dc2 cs: 0x00000000 ds: 0x00000000 es: 0x00000000 fs: 0x00000000 gs: 0x00000000 Binary Images Description: 0x1000 - 0x4cbfff /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_um_6.07_i686-apple-darwin 0x90f17000 - 0x90f1cfff /usr/lib/system/libmacho.dylib 0x90f1d000 - 0x90f1efff /usr/lib/system/libremovefile.dylib 0x915ce000 - 0x915fdfff /usr/lib/system/libsystem_info.dylib 0x91963000 - 0x91981fff /usr/lib/system/libsystem_kernel.dylib 0x91f92000 - 0x91f92fff /usr/lib/system/libdnsinfo.dylib 0x92171000 - 0x9219ffff /usr/lib/libSystem.B.dylib 0x922a6000 - 0x922b4fff /usr/lib/system/libdispatch.dylib 0x92643000 - 0x92643fff /usr/lib/system/libkeymgr.dylib 0x9269a000 - 0x926a2fff /usr/lib/system/liblaunch.dylib 0x93097000 - 0x930adfff /usr/lib/system/libxpc.dylib 0x930d1000 - 0x930d2fff /usr/lib/system/libsystem_blocks.dylib 0x9391a000 - 0x9395dfff /usr/lib/system/libcommonCrypto.dylib 0x93a02000 - 0x93a06fff /usr/lib/system/libcache.dylib 0x94040000 - 0x94043fff /usr/lib/system/libcompiler_rt.dylib 0x94ce7000 - 0x94ce8fff /usr/lib/system/libsystem_sandbox.dylib 0x95377000 - 0x9537afff /usr/lib/system/libmathCommon.A.dylib 0x956f1000 - 0x956f9fff /usr/lib/system/libcopyfile.dylib 0x956fa000 - 0x957c5fff /usr/lib/system/libsystem_c.dylib 0x95ef9000 - 0x95efafff /usr/lib/system/libunc.dylib 0x962b7000 - 0x962bffff /usr/lib/system/libunwind.dylib 0x97735000 - 0x97736fff /usr/lib/system/libquarantine.dylib 0x97c58000 - 0x97c5ffff /usr/lib/system/libsystem_notify.dylib 0x99197000 - 0x9919bfff /usr/lib/system/libsystem_network.dylib 0x9a541000 - 0x9a548fff /usr/lib/system/libsystem_dnssd.dylib 0x9b814000 - 0x9b822fff /usr/lib/libz.1.dylib 0x9c5e1000 - 0x9c5e3fff /usr/lib/system/libdyld.dylib Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=334, iMonCtr=1 Model crash detected, will try to restart... SIGABRT: abort called Crashed executable name: hadcm3n_um_6.07_i686-apple-darwin built using BOINC library version 6.13.0 Machine type Intel 80486 (32-bit executable) System version: Macintosh OS 10.7.5 build 11G63 Wed May 1 13:16:58 2013 Thread 0 Crashed: Thread 1: Thread 0 crashed with X86 Thread State (32-bit): eax: 0x00000000 ebx: 0x00000000 ecx: 0x00000000 edx: 0x00000000 edi: 0x00000000 esi: 0x00000000 ebp: 0xbfffccb8 esp: 0x00000000 ss: 0x00000000 efl: 0x00000000 eip: 0x00447dc2 cs: 0x00000000 ds: 0x00000000 es: 0x00000000 fs: 0x00000000 gs: 0x00000000 Binary Images Description: 0x1000 - 0x4cbfff /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_um_6.07_i686-apple-darwin 0x90f17000 - 0x90f1cfff /usr/lib/system/libmacho.dylib 0x90f1d000 - 0x90f1efff /usr/lib/system/libremovefile.dylib 0x915ce000 - 0x915fdfff /usr/lib/system/libsystem_info.dylib 0x91963000 - 0x91981fff /usr/lib/system/libsystem_kernel.dylib 0x91f92000 - 0x91f92fff /usr/lib/system/libdnsinfo.dylib 0x92171000 - 0x9219ffff /usr/lib/libSystem.B.dylib 0x922a6000 - 0x922b4fff /usr/lib/system/libdispatch.dylib 0x92643000 - 0x92643fff /usr/lib/system/libkeymgr.dylib 0x9269a000 - 0x926a2fff /usr/lib/system/liblaunch.dylib 0x93097000 - 0x930adfff /usr/lib/system/libxpc.dylib 0x930d1000 - 0x930d2fff /usr/lib/system/libsystem_blocks.dylib 0x9391a000 - 0x9395dfff /usr/lib/system/libcommonCrypto.dylib 0x93a02000 - 0x93a06fff /usr/lib/system/libcache.dylib 0x94040000 - 0x94043fff /usr/lib/system/libcompiler_rt.dylib 0x94ce7000 - 0x94ce8fff /usr/lib/system/libsystem_sandbox.dylib 0x95377000 - 0x9537afff /usr/lib/system/libmathCommon.A.dylib 0x956f1000 - 0x956f9fff /usr/lib/system/libcopyfile.dylib 0x956fa000 - 0x957c5fff /usr/lib/system/libsystem_c.dylib 0x95ef9000 - 0x95efafff /usr/lib/system/libunc.dylib 0x962b7000 - 0x962bffff /usr/lib/system/libunwind.dylib 0x97735000 - 0x97736fff /usr/lib/system/libquarantine.dylib 0x97c58000 - 0x97c5ffff /usr/lib/system/libsystem_notify.dylib 0x99197000 - 0x9919bfff /usr/lib/system/libsystem_network.dylib 0x9a541000 - 0x9a548fff /usr/lib/system/libsystem_dnssd.dylib 0x9b814000 - 0x9b822fff /usr/lib/libz.1.dylib 0x9c5e1000 - 0x9c5e3fff /usr/lib/system/libdyld.dylib Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=334, iMonCtr=1 Model crash detected, will try to restart... SIGABRT: abort called Crashed executable name: hadcm3n_um_6.07_i686-apple-darwin built using BOINC library version 6.13.0 Machine type Intel 80486 (32-bit executable) System version: Macintosh OS 10.7.5 build 11G63 Wed May 1 13:17:02 2013 Thread 0 Crashed: Thread 1: Thread 0 crashed with X86 Thread State (32-bit): eax: 0x00000000 ebx: 0x00000000 ecx: 0x00000000 edx: 0x00000000 edi: 0x00000000 esi: 0x00000000 ebp: 0xbfffccb8 esp: 0x00000000 ss: 0x00000000 efl: 0x00000000 eip: 0x00447dc2 cs: 0x00000000 ds: 0x00000000 es: 0x00000000 fs: 0x00000000 gs: 0x00000000 Binary Images Description: 0x1000 - 0x4cbfff /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_um_6.07_i686-apple-darwin 0x90f17000 - 0x90f1cfff /usr/lib/system/libmacho.dylib 0x90f1d000 - 0x90f1efff /usr/lib/system/libremovefile.dylib 0x915ce000 - 0x915fdfff /usr/lib/system/libsystem_info.dylib 0x91963000 - 0x91981fff /usr/lib/system/libsystem_kernel.dylib 0x91f92000 - 0x91f92fff /usr/lib/system/libdnsinfo.dylib 0x92171000 - 0x9219ffff /usr/lib/libSystem.B.dylib 0x922a6000 - 0x922b4fff /usr/lib/system/libdispatch.dylib 0x92643000 - 0x92643fff /usr/lib/system/libkeymgr.dylib 0x9269a000 - 0x926a2fff /usr/lib/system/liblaunch.dylib 0x93097000 - 0x930adfff /usr/lib/system/libxpc.dylib 0x930d1000 - 0x930d2fff /usr/lib/system/libsystem_blocks.dylib 0x9391a000 - 0x9395dfff /usr/lib/system/libcommonCrypto.dylib 0x93a02000 - 0x93a06fff /usr/lib/system/libcache.dylib 0x94040000 - 0x94043fff /usr/lib/system/libcompiler_rt.dylib 0x94ce7000 - 0x94ce8fff /usr/lib/system/libsystem_sandbox.dylib 0x95377000 - 0x9537afff /usr/lib/system/libmathCommon.A.dylib 0x956f1000 - 0x956f9fff /usr/lib/system/libcopyfile.dylib 0x956fa000 - 0x957c5fff /usr/lib/system/libsystem_c.dylib 0x95ef9000 - 0x95efafff /usr/lib/system/libunc.dylib 0x962b7000 - 0x962bffff /usr/lib/system/libunwind.dylib 0x97735000 - 0x97736fff /usr/lib/system/libquarantine.dylib 0x97c58000 - 0x97c5ffff /usr/lib/system/libsystem_notify.dylib 0x99197000 - 0x9919bfff /usr/lib/system/libsystem_network.dylib 0x9a541000 - 0x9a548fff /usr/lib/system/libsystem_dnssd.dylib 0x9b814000 - 0x9b822fff /usr/lib/libz.1.dylib 0x9c5e1000 - 0x9c5e3fff /usr/lib/system/libdyld.dylib Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=334, iMonCtr=1 Model crash detected, will try to restart... SIGABRT: abort called Crashed executable name: hadcm3n_um_6.07_i686-apple-darwin built using BOINC library version 6.13.0 Machine type Intel 80486 (32-bit executable) System version: Macintosh OS 10.7.5 build 11G63 Wed May 1 13:17:05 2013 Thread 0 Crashed: Thread 1: Thread 0 crashed with X86 Thread State (32-bit): eax: 0x00000000 ebx: 0x00000000 ecx: 0x00000000 edx: 0x00000000 edi: 0x00000000 esi: 0x00000000 ebp: 0xbfffccb8 esp: 0x00000000 ss: 0x00000000 efl: 0x00000000 eip: 0x00447dc2 cs: 0x00000000 ds: 0x00000000 es: 0x00000000 fs: 0x00000000 gs: 0x00000000 Binary Images Description: 0x1000 - 0x4cbfff /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_um_6.07_i686-apple-darwin 0x90f17000 - 0x90f1cfff /usr/lib/system/libmacho.dylib 0x90f1d000 - 0x90f1efff /usr/lib/system/libremovefile.dylib 0x915ce000 - 0x915fdfff /usr/lib/system/libsystem_info.dylib 0x91963000 - 0x91981fff /usr/lib/system/libsystem_kernel.dylib 0x91f92000 - 0x91f92fff /usr/lib/system/libdnsinfo.dylib 0x92171000 - 0x9219ffff /usr/lib/libSystem.B.dylib 0x922a6000 - 0x922b4fff /usr/lib/system/libdispatch.dylib 0x92643000 - 0x92643fff /usr/lib/system/libkeymgr.dylib 0x9269a000 - 0x926a2fff /usr/lib/system/liblaunch.dylib 0x93097000 - 0x930adfff /usr/lib/system/libxpc.dylib 0x930d1000 - 0x930d2fff /usr/lib/system/libsystem_blocks.dylib 0x9391a000 - 0x9395dfff /usr/lib/system/libcommonCrypto.dylib 0x93a02000 - 0x93a06fff /usr/lib/system/libcache.dylib 0x94040000 - 0x94043fff /usr/lib/system/libcompiler_rt.dylib 0x94ce7000 - 0x94ce8fff /usr/lib/system/libsystem_sandbox.dylib 0x95377000 - 0x9537afff /usr/lib/system/libmathCommon.A.dylib 0x956f1000 - 0x956f9fff /usr/lib/system/libcopyfile.dylib 0x956fa000 - 0x957c5fff /usr/lib/system/libsystem_c.dylib 0x95ef9000 - 0x95efafff /usr/lib/system/libunc.dylib 0x962b7000 - 0x962bffff /usr/lib/system/libunwind.dylib 0x97735000 - 0x97736fff /usr/lib/system/libquarantine.dylib 0x97c58000 - 0x97c5ffff /usr/lib/system/libsystem_notify.dylib 0x99197000 - 0x9919bfff /usr/lib/system/libsystem_network.dylib 0x9a541000 - 0x9a548fff /usr/lib/system/libsystem_dnssd.dylib 0x9b814000 - 0x9b822fff /usr/lib/libz.1.dylib 0x9c5e1000 - 0x9c5e3fff /usr/lib/system/libdyld.dylib Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=334, iMonCtr=1 Model crash detected, will try to restart... SIGABRT: abort called Crashed executable name: hadcm3n_um_6.07_i686-apple-darwin built using BOINC library version 6.13.0 Machine type Intel 80486 (32-bit executable) System version: Macintosh OS 10.7.5 build 11G63 Wed May 1 13:17:08 2013 Thread 0 Crashed: Thread 1: Thread 0 crashed with X86 Thread State (32-bit): eax: 0x00000000 ebx: 0x00000000 ecx: 0x00000000 edx: 0x00000000 edi: 0x00000000 esi: 0x00000000 ebp: 0xbfffccb8 esp: 0x00000000 ss: 0x00000000 efl: 0x00000000 eip: 0x00447dc2 cs: 0x00000000 ds: 0x00000000 es: 0x00000000 fs: 0x00000000 gs: 0x00000000 Binary Images Description: 0x1000 - 0x4cbfff /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_um_6.07_i686-apple-darwin 0x90f17000 - 0x90f1cfff /usr/lib/system/libmacho.dylib 0x90f1d000 - 0x90f1efff /usr/lib/system/libremovefile.dylib 0x915ce000 - 0x915fdfff /usr/lib/system/libsystem_info.dylib 0x91963000 - 0x91981fff /usr/lib/system/libsystem_kernel.dylib 0x91f92000 - 0x91f92fff /usr/lib/system/libdnsinfo.dylib 0x92171000 - 0x9219ffff /usr/lib/libSystem.B.dylib 0x922a6000 - 0x922b4fff /usr/lib/system/libdispatch.dylib 0x92643000 - 0x92643fff /usr/lib/system/libkeymgr.dylib 0x9269a000 - 0x926a2fff /usr/lib/system/liblaunch.dylib 0x93097000 - 0x930adfff /usr/lib/system/libxpc.dylib 0x930d1000 - 0x930d2fff /usr/lib/system/libsystem_blocks.dylib 0x9391a000 - 0x9395dfff /usr/lib/system/libcommonCrypto.dylib 0x93a02000 - 0x93a06fff /usr/lib/system/libcache.dylib 0x94040000 - 0x94043fff /usr/lib/system/libcompiler_rt.dylib 0x94ce7000 - 0x94ce8fff /usr/lib/system/libsystem_sandbox.dylib 0x95377000 - 0x9537afff /usr/lib/system/libmathCommon.A.dylib 0x956f1000 - 0x956f9fff /usr/lib/system/libcopyfile.dylib 0x956fa000 - 0x957c5fff /usr/lib/system/libsystem_c.dylib 0x95ef9000 - 0x95efafff /usr/lib/system/libunc.dylib 0x962b7000 - 0x962bffff /usr/lib/system/libunwind.dylib 0x97735000 - 0x97736fff /usr/lib/system/libquarantine.dylib 0x97c58000 - 0x97c5ffff /usr/lib/system/libsystem_notify.dylib 0x99197000 - 0x9919bfff /usr/lib/system/libsystem_network.dylib 0x9a541000 - 0x9a548fff /usr/lib/system/libsystem_dnssd.dylib 0x9b814000 - 0x9b822fff /usr/lib/libz.1.dylib 0x9c5e1000 - 0x9c5e3fff /usr/lib/system/libdyld.dylib Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=334, iMonCtr=1 Model crash detected, will try to restart... Sorry, too many model crashes! :-( Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
29 Apr 2013 09:27:56	939545	15609522	hadcm3n_47wx_1940_40_008309782_3	673,920	1,179,035	1.7495
25 Apr 2013 04:40:45	939545	15609522	hadcm3n_47wx_1940_40_008309782_3	648,000	1,133,633	1.7494
24 Apr 2013 13:06:32	939545	15609522	hadcm3n_47wx_1940_40_008309782_3	622,080	1,088,112	1.7492
22 Apr 2013 13:10:24	939545	15609522	hadcm3n_47wx_1940_40_008309782_3	596,160	1,042,684	1.7490
18 Apr 2013 17:07:14	939545	15609522	hadcm3n_47wx_1940_40_008309782_3	570,240	997,139	1.7486
17 Apr 2013 22:05:22	939545	15609522	hadcm3n_47wx_1940_40_008309782_3	544,320	952,178	1.7493
16 Apr 2013 12:56:04	939545	15609522	hadcm3n_47wx_1940_40_008309782_3	518,400	906,506	1.7487
14 Apr 2013 22:01:42	939545	15609522	hadcm3n_47wx_1940_40_008309782_3	492,480	859,940	1.7461
12 Apr 2013 17:22:25	939545	15609522	hadcm3n_47wx_1940_40_008309782_3	466,560	813,635	1.7439
05 Apr 2013 21:17:05	939545	15609522	hadcm3n_47wx_1940_40_008309782_3	440,640	768,049	1.7430
02 Apr 2013 14:30:34	939545	15609522	hadcm3n_47wx_1940_40_008309782_3	414,720	722,883	1.7431
29 Mar 2013 15:10:36	939545	15609522	hadcm3n_47wx_1940_40_008309782_3	388,800	677,014	1.7413
28 Mar 2013 02:41:39	939545	15609522	hadcm3n_47wx_1940_40_008309782_3	362,880	631,449	1.7401
26 Mar 2013 20:49:16	939545	15609522	hadcm3n_47wx_1940_40_008309782_3	336,960	586,312	1.7400
22 Mar 2013 14:40:20	939545	15609522	hadcm3n_47wx_1940_40_008309782_3	311,040	540,534	1.7378
17 Mar 2013 13:45:16	939545	15609522	hadcm3n_47wx_1940_40_008309782_3	285,120	495,050	1.7363
13 Mar 2013 21:46:05	939545	15609522	hadcm3n_47wx_1940_40_008309782_3	259,200	450,230	1.7370
11 Mar 2013 20:21:30	939545	15609522	hadcm3n_47wx_1940_40_008309782_3	233,280	404,775	1.7351
08 Mar 2013 02:14:27	939545	15609522	hadcm3n_47wx_1940_40_008309782_3	207,360	359,465	1.7335
06 Mar 2013 00:23:51	939545	15609522	hadcm3n_47wx_1940_40_008309782_3	181,440	314,589	1.7338