Task 13123625

Name	hadcm3n_ykuj_1900_40_007359877_0
Workunit	7557307
Created	6 Jul 2011, 15:09:05 UTC
Sent	7 Jul 2011, 21:43:19 UTC
Report deadline	7 Oct 2011, 5:10:30 UTC
Received	9 Aug 2011, 6:34:17 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	942621
Run time	8 days 1 hours 44 min 16 sec
CPU time	4 days 23 hours 59 min 17 sec
Validate state	Invalid
Credit	3,110.40
Device peak FLOPS	3.45 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 i686-apple-darwin
Stderr	<core_client_version>6.6.36</core_client_version> <![CDATA[ <message> process exited with code 22 (0x16, -234) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 16:28:56 (23590): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... BUFFOUT: Write Failed: No space left on device BUFFOUT: C I/O Error - Return code = 1 Model crashed: WRITDUMP: BAD BUFFOUT OF DATA tmp/pipe_dummy 2048 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 10:42:44 (47070): No heartbeat from core client for 30 sec - exiting 10:42:46 (47070): No heartbeat from core client for 30 sec - exiting 10:42:47 (47070): No heartbeat from core client for 30 sec - exiting 10:42:48 (47070): No heartbeat from core client for 30 sec - exiting 10:42:49 (47070): No heartbeat from core client for 30 sec - exiting 10:42:50 (47070): No heartbeat from core client for 30 sec - exiting 10:42:51 (47070): No heartbeat from core client for 30 sec - exiting 10:42:52 (47070): No heartbeat from core client for 30 sec - exiting 10:42:53 (47070): No heartbeat from core client for 30 sec - exiting 10:42:54 (47070): No heartbeat from core client for 30 sec - exiting 10:42:55 (47070): No heartbeat from core client for 30 sec - exiting 10:42:56 (47070): No heartbeat from core client for 30 sec - exiting 10:42:57 (47070): No heartbeat from core client for 30 sec - exiting 10:42:58 (47070): No heartbeat from core client for 30 sec - exiting 10:42:59 (47070): No heartbeat from core client for 30 sec - exiting 10:43:00 (47070): No heartbeat from core client for 30 sec - exiting 10:43:01 (47070): No heartbeat from core client for 30 sec - exiting 10:43:02 (47070): No heartbeat from core client for 30 sec - exiting 10:43:03 (47070): No heartbeat from core client for 30 sec - exiting 10:43:04 (47070): No heartbeat from core client for 30 sec - exiting 10:43:05 (47070): No heartbeat from core client for 30 sec - exiting 10:43:06 (47070): No heartbeat from core client for 30 sec - exiting 10:43:07 (47070): No heartbeat from core client for 30 sec - exiting 10:43:08 (47070): No heartbeat from core client for 30 sec - exiting 10:43:09 (47070): No heartbeat from core client for 30 sec - exiting 10:43:10 (47070): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 12:45:36 (49264): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:45:37 (49264): No heartbeat from core client for 30 sec - exiting 12:45:38 (49264): No heartbeat from core client for 30 sec - exiting 12:45:39 (49264): No heartbeat from core client for 30 sec - exiting 12:45:40 (49264): No heartbeat from core client for 30 sec - exiting 12:45:41 (49264): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... 16:57:49 (50936): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:23:41 (54470): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... BUFFOUT: Write Failed: No space left on device BUFFOUT: C I/O Error - Return code = 1 Model crashed: WRITDUMP: BAD BUFFOUT OF DATA tmp/pipe_dummy 2048 BUFFOUT: Write Failed: No space left on device BUFFOUT: C I/O Error - Return code = 1 Model crashed: WRITDUMP: BAD BUFFOUT OF DATA tmp/pipe_dummy 2048 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 08:44:12 (73580): No heartbeat from core client for 30 sec - exiting 08:44:13 (73580): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 22:05:35 (88922): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 00:19:29 (91539): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:21:25 (91557): No heartbeat from core client for 30 sec - exiting 00:21:27 (91557): No heartbeat from core client for 30 sec - exiting 00:21:28 (91557): No heartbeat from core client for 30 sec - exiting 00:21:29 (91557): No heartbeat from core client for 30 sec - exiting 00:21:30 (91557): No heartbeat from core client for 30 sec - exiting 00:21:31 (91557): No heartbeat from core client for 30 sec - exiting 00:21:32 (91557): No heartbeat from core client for 30 sec - exiting 00:21:33 (91557): No heartbeat from core client for 30 sec - exiting 00:21:34 (91557): No heartbeat from core client for 30 sec - exiting 00:21:35 (91557): No heartbeat from core client for 30 sec - exiting 00:21:36 (91557): No heartbeat from core client for 30 sec - exiting 00:21:37 (91557): No heartbeat from core client for 30 sec - exiting 00:21:38 (91557): No heartbeat from core client for 30 sec - exiting 00:21:39 (91557): No heartbeat from core client for 30 sec - exiting 00:21:40 (91557): No heartbeat from core client for 30 sec - exiting 00:21:41 (91557): No heartbeat from core client for 30 sec - exiting 00:21:42 (91557): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:24:35 (91586): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:26:16 (91634): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:26:17 (91634): No heartbeat from core client for 30 sec - exiting 00:26:18 (91634): No heartbeat from core client for 30 sec - exiting 00:26:19 (91634): No heartbeat from core client for 30 sec - exiting 00:27:42 (91670): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:28:44 (91703): No heartbeat from core client for 30 sec - exiting 00:28:46 (91703): No heartbeat from core client for 30 sec - exiting 00:28:47 (91703): No heartbeat from core client for 30 sec - exiting 00:28:48 (91703): No heartbeat from core client for 30 sec - exiting 00:28:49 (91703): No heartbeat from core client for 30 sec - exiting 00:28:50 (91703): No heartbeat from core client for 30 sec - exiting 00:28:51 (91703): No heartbeat from core client for 30 sec - exiting 00:28:52 (91703): No heartbeat from core client for 30 sec - exiting 00:28:53 (91703): No heartbeat from core client for 30 sec - exiting 00:28:54 (91703): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:30:51 (91718): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:30:53 (91718): No heartbeat from core client for 30 sec - exiting 00:32:52 (91768): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 10:34:36 (734): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 10:40:52 (872): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 19:01:57 (11001): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 00:42:50 (17800): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 09:17:51 (28107): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 09:41:16 (28771): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 10:30:57 (29977): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 16:32:18 (37351): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 16:58:21 (37930): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:40:40 (37949): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 22:17:47 (44415): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 05:00:26 (46387): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 07:03:07 (52442): No heartbeat from core client for 30 sec - exiting 07:03:09 (52442): No heartbeat from core client for 30 sec - exiting 07:03:10 (52442): No heartbeat from core client for 30 sec - exiting 07:03:11 (52442): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:10:09 (52459): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:31:41 (52567): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 08:06:39 (53339): No heartbeat from core client for 30 sec - exiting 08:06:42 (53339): No heartbeat from core client for 30 sec - exiting 08:06:43 (53339): No heartbeat from core client for 30 sec - exiting 08:06:44 (53339): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 18:28:43 (61924): No heartbeat from core client for 30 sec - exiting 18:28:44 (61924): No heartbeat from core client for 30 sec - exiting 18:28:45 (61924): No heartbeat from core client for 30 sec - exiting 18:28:46 (61924): No heartbeat from core client for 30 sec - exiting 18:28:47 (61924): No heartbeat from core client for 30 sec - exiting 18:28:48 (61924): No heartbeat from core client for 30 sec - exiting 18:28:49 (61924): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:34:45 (61935): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:34:46 (61935): No heartbeat from core client for 30 sec - exiting 21:34:47 (61935): No heartbeat from core client for 30 sec - exiting 21:34:48 (61935): No heartbeat from core client for 30 sec - exiting 22:36:02 (64456): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:36:03 (64456): No heartbeat from core client for 30 sec - exiting 22:36:04 (64456): No heartbeat from core client for 30 sec - exiting 22:36:05 (64456): No heartbeat from core client for 30 sec - exiting 22:36:06 (64456): No heartbeat from core client for 30 sec - exiting 22:36:07 (64456): No heartbeat from core client for 30 sec - exiting 22:36:08 (64456): No heartbeat from core client for 30 sec - exiting 22:36:09 (64456): No heartbeat from core client for 30 sec - exiting 22:36:10 (64456): No heartbeat from core client for 30 sec - exiting 22:36:11 (64456): No heartbeat from core client for 30 sec - exiting 22:36:12 (64456): No heartbeat from core client for 30 sec - exiting 22:39:11 (65286): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 06:38:45 (35157): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:38:46 (35157): No heartbeat from core client for 30 sec - exiting 06:38:47 (35157): No heartbeat from core client for 30 sec - exiting 06:38:48 (35157): No heartbeat from core client for 30 sec - exiting 06:38:49 (35157): No heartbeat from core client for 30 sec - exiting 06:38:50 (35157): No heartbeat from core client for 30 sec - exiting 06:38:51 (35157): No heartbeat from core client for 30 sec - exiting 06:38:52 (35157): No heartbeat from core client for 30 sec - exiting 06:38:53 (35157): No heartbeat from core client for 30 sec - exiting 06:38:54 (35157): No heartbeat from core client for 30 sec - exiting 06:38:55 (35157): No heartbeat from core client for 30 sec - exiting 06:38:56 (35157): No heartbeat from core client for 30 sec - exiting 06:38:57 (35157): No heartbeat from core client for 30 sec - exiting 06:38:58 (35157): No heartbeat from core client for 30 sec - exiting 06:38:59 (35157): No heartbeat from core client for 30 sec - exiting 06:39:00 (35157): No heartbeat from core client for 30 sec - exiting 06:39:01 (35157): No heartbeat from core client for 30 sec - exiting 06:39:02 (35157): No heartbeat from core client for 30 sec - exiting 06:39:03 (35157): No heartbeat from core client for 30 sec - exiting 06:39:04 (35157): No heartbeat from core client for 30 sec - exiting 06:39:05 (35157): No heartbeat from core client for 30 sec - exiting 06:39:06 (35157): No heartbeat from core client for 30 sec - exiting 06:39:07 (35157): No heartbeat from core client for 30 sec - exiting 06:39:08 (35157): No heartbeat from core client for 30 sec - exiting 06:39:09 (35157): No heartbeat from core client for 30 sec - exiting 06:39:10 (35157): No heartbeat from core client for 30 sec - exiting 06:39:12 (35157): No heartbeat from core client for 30 sec - exiting 06:39:13 (35157): No heartbeat from core client for 30 sec - exiting 06:39:14 (35157): No heartbeat from core client for 30 sec - exiting 06:39:15 (35157): No heartbeat from core client for 30 sec - exiting 06:39:16 (35157): No heartbeat from core client for 30 sec - exiting 06:39:17 (35157): No heartbeat from core client for 30 sec - exiting 06:39:18 (35157): No heartbeat from core client for 30 sec - exiting 06:39:19 (35157): No heartbeat from core client for 30 sec - exiting 06:39:20 (35157): No heartbeat from core client for 30 sec - exiting 06:39:21 (35157): No heartbeat from core client for 30 sec - exiting 06:39:22 (35157): No heartbeat from core client for 30 sec - exiting 06:39:23 (35157): No heartbeat from core client for 30 sec - exiting 06:39:24 (35157): No heartbeat from core client for 30 sec - exiting 06:39:25 (35157): No heartbeat from core client for 30 sec - exiting 06:39:26 (35157): No heartbeat from core client for 30 sec - exiting 06:39:27 (35157): No heartbeat from core client for 30 sec - exiting 06:39:28 (35157): No heartbeat from core client for 30 sec - exiting 06:39:29 (35157): No heartbeat from core client for 30 sec - exiting 06:39:30 (35157): No heartbeat from core client for 30 sec - exiting 06:39:31 (35157): No heartbeat from core client for 30 sec - exiting 06:39:32 (35157): No heartbeat from core client for 30 sec - exiting 06:39:33 (35157): No heartbeat from core client for 30 sec - exiting 06:39:34 (35157): No heartbeat from core client for 30 sec - exiting 06:39:35 (35157): No heartbeat from core client for 30 sec - exiting 06:39:36 (35157): No heartbeat from core client for 30 sec - exiting 06:39:37 (35157): No heartbeat from core client for 30 sec - exiting 06:39:38 (35157): No heartbeat from core client for 30 sec - exiting 06:39:39 (35157): No heartbeat from core client for 30 sec - exiting 06:39:40 (35157): No heartbeat from core client for 30 sec - exiting 06:39:41 (35157): No heartbeat from core client for 30 sec - exiting 06:39:42 (35157): No heartbeat from core client for 30 sec - exiting 06:39:43 (35157): No heartbeat from core client for 30 sec - exiting 06:39:44 (35157): No heartbeat from core client for 30 sec - exiting 06:39:45 (35157): No heartbeat from core client for 30 sec - exiting 06:39:46 (35157): No heartbeat from core client for 30 sec - exiting 06:39:47 (35157): No heartbeat from core client for 30 sec - exiting 06:39:48 (35157): No heartbeat from core client for 30 sec - exiting 06:39:49 (35157): No heartbeat from core client for 30 sec - exiting 06:39:50 (35157): No heartbeat from core client for 30 sec - exiting 06:39:51 (35157): No heartbeat from core client for 30 sec - exiting 06:39:52 (35157): No heartbeat from core client for 30 sec - exiting 06:39:53 (35157): No heartbeat from core client for 30 sec - exiting 06:39:54 (35157): No heartbeat from core client for 30 sec - exiting 06:39:55 (35157): No heartbeat from core client for 30 sec - exiting 06:39:56 (35157): No heartbeat from core client for 30 sec - exiting 06:39:57 (35157): No heartbeat from core client for 30 sec - exiting 06:39:58 (35157): No heartbeat from core client for 30 sec - exiting 06:39:59 (35157): No heartbeat from core client for 30 sec - exiting 06:40:00 (35157): No heartbeat from core client for 30 sec - exiting 06:40:01 (35157): No heartbeat from core client for 30 sec - exiting 06:40:02 (35157): No heartbeat from core client for 30 sec - exiting 06:40:03 (35157): No heartbeat from core client for 30 sec - exiting 06:40:04 (35157): No heartbeat from core client for 30 sec - exiting 06:40:05 (35157): No heartbeat from core client for 30 sec - exiting 06:40:06 (35157): No heartbeat from core client for 30 sec - exiting 06:40:07 (35157): No heartbeat from core client for 30 sec - exiting 06:40:08 (35157): No heartbeat from core client for 30 sec - exiting 06:40:09 (35157): No heartbeat from core client for 30 sec - exiting 06:40:10 (35157): No heartbeat from core client for 30 sec - exiting 06:40:11 (35157): No heartbeat from core client for 30 sec - exiting 06:40:12 (35157): No heartbeat from core client for 30 sec - exiting 06:40:13 (35157): No heartbeat from core client for 30 sec - exiting 06:40:14 (35157): No heartbeat from core client for 30 sec - exiting 06:40:15 (35157): No heartbeat from core client for 30 sec - exiting 06:40:16 (35157): No heartbeat from core client for 30 sec - exiting 06:40:17 (35157): No heartbeat from core client for 30 sec - exiting 06:40:18 (35157): No heartbeat from core client for 30 sec - exiting 06:40:19 (35157): No heartbeat from core client for 30 sec - exiting 06:40:20 (35157): No heartbeat from core client for 30 sec - exiting 06:40:21 (35157): No heartbeat from core client for 30 sec - exiting 06:40:22 (35157): No heartbeat from core client for 30 sec - exiting 06:40:23 (35157): No heartbeat from core client for 30 sec - exiting 06:40:24 (35157): No heartbeat from core client for 30 sec - exiting 06:40:25 (35157): No heartbeat from core client for 30 sec - exiting 06:40:26 (35157): No heartbeat from core client for 30 sec - exiting 06:40:27 (35157): No heartbeat from core client for 30 sec - exiting 06:40:28 (35157): No heartbeat from core client for 30 sec - exiting 06:40:29 (35157): No heartbeat from core client for 30 sec - exiting 06:40:31 (35157): No heartbeat from core client for 30 sec - exiting 06:40:32 (35157): No heartbeat from core client for 30 sec - exiting 06:40:33 (35157): No heartbeat from core client for 30 sec - exiting 06:40:34 (35157): No heartbeat from core client for 30 sec - exiting 06:40:35 (35157): No heartbeat from core client for 30 sec - exiting 06:40:36 (35157): No heartbeat from core client for 30 sec - exiting 06:40:37 (35157): No heartbeat from core client for 30 sec - exiting 06:40:38 (35157): No heartbeat from core client for 30 sec - exiting 06:40:39 (35157): No heartbeat from core client for 30 sec - exiting 06:40:40 (35157): No heartbeat from core client for 30 sec - exiting 06:40:41 (35157): No heartbeat from core client for 30 sec - exiting 06:40:42 (35157): No heartbeat from core client for 30 sec - exiting 06:40:43 (35157): No heartbeat from core client for 30 sec - exiting 06:40:44 (35157): No heartbeat from core client for 30 sec - exiting 06:40:45 (35157): No heartbeat from core client for 30 sec - exiting 06:40:46 (35157): No heartbeat from core client for 30 sec - exiting 06:40:47 (35157): No heartbeat from core client for 30 sec - exiting 06:40:48 (35157): No heartbeat from core client for 30 sec - exiting 06:40:49 (35157): No heartbeat from core client for 30 sec - exiting 06:40:50 (35157): No heartbeat from core client for 30 sec - exiting 06:40:51 (35157): No heartbeat from core client for 30 sec - exiting 06:40:52 (35157): No heartbeat from core client for 30 sec - exiting 06:40:53 (35157): No heartbeat from core client for 30 sec - exiting 06:40:54 (35157): No heartbeat from core client for 30 sec - exiting 06:40:55 (35157): No heartbeat from core client for 30 sec - exiting 06:40:56 (35157): No heartbeat from core client for 30 sec - exiting 06:40:57 (35157): No heartbeat from core client for 30 sec - exiting 06:40:58 (35157): No heartbeat from core client for 30 sec - exiting 06:40:59 (35157): No heartbeat from core client for 30 sec - exiting 06:41:00 (35157): No heartbeat from core client for 30 sec - exiting 06:41:01 (35157): No heartbeat from core client for 30 sec - exiting 06:41:02 (35157): No heartbeat from core client for 30 sec - exiting 06:41:03 (35157): No heartbeat from core client for 30 sec - exiting 06:41:04 (35157): No heartbeat from core client for 30 sec - exiting 06:41:05 (35157): No heartbeat from core client for 30 sec - exiting 06:41:06 (35157): No heartbeat from core client for 30 sec - exiting 06:41:07 (35157): No heartbeat from core client for 30 sec - exiting 06:41:08 (35157): No heartbeat from core client for 30 sec - exiting 06:41:09 (35157): No heartbeat from core client for 30 sec - exiting 06:41:10 (35157): No heartbeat from core client for 30 sec - exiting 06:41:11 (35157): No heartbeat from core client for 30 sec - exiting 06:41:12 (35157): No heartbeat from core client for 30 sec - exiting 06:41:13 (35157): No heartbeat from core client for 30 sec - exiting 06:41:14 (35157): No heartbeat from core client for 30 sec - exiting 06:41:15 (35157): No heartbeat from core client for 30 sec - exiting 06:41:16 (35157): No heartbeat from core client for 30 sec - exiting 06:41:17 (35157): No heartbeat from core client for 30 sec - exiting 06:41:18 (35157): No heartbeat from core client for 30 sec - exiting 06:41:19 (35157): No heartbeat from core client for 30 sec - exiting 06:41:20 (35157): No heartbeat from core client for 30 sec - exiting 06:41:21 (35157): No heartbeat from core client for 30 sec - exiting 06:41:22 (35157): No heartbeat from core client for 30 sec - exiting 06:41:23 (35157): No heartbeat from core client for 30 sec - exiting 06:41:24 (35157): No heartbeat from core client for 30 sec - exiting 06:41:25 (35157): No heartbeat from core client for 30 sec - exiting 06:41:26 (35157): No heartbeat from core client for 30 sec - exiting 06:41:27 (35157): No heartbeat from core client for 30 sec - exiting 06:41:28 (35157): No heartbeat from core client for 30 sec - exiting 06:41:29 (35157): No heartbeat from core client for 30 sec - exiting 06:41:30 (35157): No heartbeat from core client for 30 sec - exiting 06:41:31 (35157): No heartbeat from core client for 30 sec - exiting 06:41:32 (35157): No heartbeat from core client for 30 sec - exiting 06:41:33 (35157): No heartbeat from core client for 30 sec - exiting 06:41:34 (35157): No heartbeat from core client for 30 sec - exiting 06:41:35 (35157): No heartbeat from core client for 30 sec - exiting 06:41:36 (35157): No heartbeat from core client for 30 sec - exiting 06:41:38 (35157): No heartbeat from core client for 30 sec - exiting 06:41:39 (35157): No heartbeat from core client for 30 sec - exiting 06:41:40 (35157): No heartbeat from core client for 30 sec - exiting 06:41:41 (35157): No heartbeat from core client for 30 sec - exiting 06:41:42 (35157): No heartbeat from core client for 30 sec - exiting 06:41:43 (35157): No heartbeat from core client for 30 sec - exiting 06:41:44 (35157): No heartbeat from core client for 30 sec - exiting 06:41:45 (35157): No heartbeat from core client for 30 sec - exiting 06:41:46 (35157): No heartbeat from core client for 30 sec - exiting 06:41:47 (35157): No heartbeat from core client for 30 sec - exiting 06:41:48 (35157): No heartbeat from core client for 30 sec - exiting 06:41:49 (35157): No heartbeat from core client for 30 sec - exiting 06:41:50 (35157): No heartbeat from core client for 30 sec - exiting 06:41:51 (35157): No heartbeat from core client for 30 sec - exiting 06:41:52 (35157): No heartbeat from core client for 30 sec - exiting 06:41:53 (35157): No heartbeat from core client for 30 sec - exiting 06:41:54 (35157): No heartbeat from core client for 30 sec - exiting 06:41:55 (35157): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 21:37:21 (53804): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:39:55 (54358): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 02:39:41 (55344): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:39:42 (55344): No heartbeat from core client for 30 sec - exiting 02:39:43 (55344): No heartbeat from core client for 30 sec - exiting 02:39:44 (55344): No heartbeat from core client for 30 sec - exiting 02:39:45 (55344): No heartbeat from core client for 30 sec - exiting 02:39:46 (55344): No heartbeat from core client for 30 sec - exiting 02:39:47 (55344): No heartbeat from core client for 30 sec - exiting 02:39:48 (55344): No heartbeat from core client for 30 sec - exiting 02:39:49 (55344): No heartbeat from core client for 30 sec - exiting 02:39:50 (55344): No heartbeat from core client for 30 sec - exiting 02:39:51 (55344): No heartbeat from core client for 30 sec - exiting 02:39:52 (55344): No heartbeat from core client for 30 sec - exiting 02:39:53 (55344): No heartbeat from core client for 30 sec - exiting 02:39:54 (55344): No heartbeat from core client for 30 sec - exiting 02:39:55 (55344): No heartbeat from core client for 30 sec - exiting 02:39:56 (55344): No heartbeat from core client for 30 sec - exiting 02:39:57 (55344): No heartbeat from core client for 30 sec - exiting 02:39:58 (55344): No heartbeat from core client for 30 sec - exiting 02:39:59 (55344): No heartbeat from core client for 30 sec - exiting 02:40:00 (55344): No heartbeat from core client for 30 sec - exiting 02:40:01 (55344): No heartbeat from core client for 30 sec - exiting 02:40:02 (55344): No heartbeat from core client for 30 sec - exiting 02:40:03 (55344): No heartbeat from core client for 30 sec - exiting 02:40:04 (55344): No heartbeat from core client for 30 sec - exiting 02:40:05 (55344): No heartbeat from core client for 30 sec - exiting 02:40:06 (55344): No heartbeat from core client for 30 sec - exiting 02:40:07 (55344): No heartbeat from core client for 30 sec - exiting 02:40:08 (55344): No heartbeat from core client for 30 sec - exiting 02:40:09 (55344): No heartbeat from core client for 30 sec - exiting 02:40:10 (55344): No heartbeat from core client for 30 sec - exiting 02:40:11 (55344): No heartbeat from core client for 30 sec - exiting 02:40:12 (55344): No heartbeat from core client for 30 sec - exiting 02:40:13 (55344): No heartbeat from core client for 30 sec - exiting 02:40:14 (55344): No heartbeat from core client for 30 sec - exiting 02:40:15 (55344): No heartbeat from core client for 30 sec - exiting 02:40:16 (55344): No heartbeat from core client for 30 sec - exiting 02:40:17 (55344): No heartbeat from core client for 30 sec - exiting 02:40:18 (55344): No heartbeat from core client for 30 sec - exiting 02:40:19 (55344): No heartbeat from core client for 30 sec - exiting 02:40:20 (55344): No heartbeat from core client for 30 sec - exiting 02:40:21 (55344): No heartbeat from core client for 30 sec - exiting 02:40:22 (55344): No heartbeat from core client for 30 sec - exiting 02:40:23 (55344): No heartbeat from core client for 30 sec - exiting 02:40:24 (55344): No heartbeat from core client for 30 sec - exiting 02:40:25 (55344): No heartbeat from core client for 30 sec - exiting 02:40:26 (55344): No heartbeat from core client for 30 sec - exiting 02:40:27 (55344): No heartbeat from core client for 30 sec - exiting 02:40:28 (55344): No heartbeat from core client for 30 sec - exiting 02:40:29 (55344): No heartbeat from core client for 30 sec - exiting 02:40:30 (55344): No heartbeat from core client for 30 sec - exiting 02:40:31 (55344): No heartbeat from core client for 30 sec - exiting 02:40:32 (55344): No heartbeat from core client for 30 sec - exiting 02:40:33 (55344): No heartbeat from core client for 30 sec - exiting 02:45:28 (58507): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:45:29 (58507): No heartbeat from core client for 30 sec - exiting 02:45:30 (58507): No heartbeat from core client for 30 sec - exiting 02:57:00 (58599): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:07:45 (58786): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:15:59 (58951): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:24:58 (59085): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:39:07 (59272): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:56:04 (59485): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Model crashed: TEMPHIST: Failed in OPEN of history file tmp/pipe_dummy 2048 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 02:46:54 (7549): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:46:55 (7549): No heartbeat from core client for 30 sec - exiting 02:46:56 (7549): No heartbeat from core client for 30 sec - exiting 02:46:57 (7549): No heartbeat from core client for 30 sec - exiting 02:46:58 (7549): No heartbeat from core client for 30 sec - exiting 02:46:59 (7549): No heartbeat from core client for 30 sec - exiting 02:47:00 (7549): No heartbeat from core client for 30 sec - exiting 02:47:01 (7549): No heartbeat from core client for 30 sec - exiting 02:47:02 (7549): No heartbeat from core client for 30 sec - exiting 02:47:03 (7549): No heartbeat from core client for 30 sec - exiting 02:47:04 (7549): No heartbeat from core client for 30 sec - exiting 02:47:05 (7549): No heartbeat from core client for 30 sec - exiting 02:47:06 (7549): No heartbeat from core client for 30 sec - exiting 02:47:07 (7549): No heartbeat from core client for 30 sec - exiting 02:47:08 (7549): No heartbeat from core client for 30 sec - exiting 02:47:09 (7549): No heartbeat from core client for 30 sec - exiting 02:47:10 (7549): No heartbeat from core client for 30 sec - exiting 02:47:11 (7549): No heartbeat from core client for 30 sec - exiting 02:47:12 (7549): No heartbeat from core client for 30 sec - exiting SIGABRT: abort called Crashed executable name: hadcm3n_um_6.07_i686-apple-darwin built using BOINC library version 6.13.0 Machine type Intel 80486 (32-bit executable) System version: Macintosh OS 10.6.8 build 10K549 Tue Aug 9 02:50:23 2011 Thread 0 Crashed: 0 libSystem.B.dylib 0x90a0bc5a ___kill + 10 1 libSystem.B.dylib 0x90a9e5a5 _raise + 26 2 libSystem.B.dylib 0x90ab46e4 _abort + 93 3 hadcm3n_um_6.07_i686-apple-darwin 0x00336cff _um_setup + 127 4 hadcm3n_um_6.07_i686-apple-darwin 0x00389b71 _um_shell + 3953 5 hadcm3n_um_6.07_i686-apple-darwin 0x000048e1 _main + 1153 6 hadcm3n_um_6.07_i686-apple-darwin 0x000027fb __start + 209 7 hadcm3n_um_6.07_i686-apple-darwin 0x00002729 start + 41 Thread 1: 0 libSystem.B.dylib 0x909aac0e _mach_wait_until + 10 1 libSystem.B.dylib 0x90a32429 _nanosleep + 345 2 libSystem.B.dylib 0x90a322ca _usleep + 61 3 hadcm3n_um_6.07_i686-apple-darwin 0x00442ec0 __Z11boinc_sleepd + 188 4 hadcm3n_um_6.07_i686-apple-darwin 0x0043865e __Z12timer_threadPv + 78 5 libSystem.B.dylib 0x909d8259 __pthread_start + 345 6 libSystem.B.dylib 0x909d80de _thread_start + 34 Thread 0 crashed with X86 Thread State (32-bit): eax: 0x00000000 ebx: 0x00000000 ecx: 0x00000000 edx: 0x00000000 edi: 0x00000000 esi: 0x00000000 ebp: 0xbfffc9c8 esp: 0x00000000 ss: 0x00000000 efl: 0x00000000 eip: 0x00447dc2 cs: 0x00000000 ds: 0x00000000 es: 0x00000000 fs: 0x00000000 gs: 0x00000000 Binary Images Description: 0x1000 - 0x4cbfff /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_um_6.07_i686-apple-darwin 0x909aa000 - 0x90b51fff /usr/lib/libSystem.B.dylib 0x92adb000 - 0x92adefff /usr/lib/system/libmathCommon.A.dylib 0x9a940000 - 0x9a94efff /usr/lib/libz.1.dylib Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=12810, iMonCtr=1 Model crash detected, will try to restart... SIGABRT: abort called Crashed executable name: hadcm3n_um_6.07_i686-apple-darwin built using BOINC library version 6.13.0 Machine type Intel 80486 (32-bit executable) System version: Macintosh OS 10.6.8 build 10K549 Tue Aug 9 02:50:26 2011 Thread 0 Crashed: 0 libSystem.B.dylib 0x90a0bc5a ___kill + 10 1 libSystem.B.dylib 0x90a9e5a5 _raise + 26 2 libSystem.B.dylib 0x90ab46e4 _abort + 93 3 hadcm3n_um_6.07_i686-apple-darwin 0x00336cff _um_setup + 127 4 hadcm3n_um_6.07_i686-apple-darwin 0x00389b71 _um_shell + 3953 5 hadcm3n_um_6.07_i686-apple-darwin 0x000048e1 _main + 1153 6 hadcm3n_um_6.07_i686-apple-darwin 0x000027fb __start + 209 7 hadcm3n_um_6.07_i686-apple-darwin 0x00002729 start + 41 Thread 1: 0 libSystem.B.dylib 0x909aac0e _mach_wait_until + 10 1 libSystem.B.dylib 0x90a32429 _nanosleep + 345 2 libSystem.B.dylib 0x90a322ca _usleep + 61 3 hadcm3n_um_6.07_i686-apple-darwin 0x00442ec0 __Z11boinc_sleepd + 188 4 hadcm3n_um_6.07_i686-apple-darwin 0x0043865e __Z12timer_threadPv + 78 5 libSystem.B.dylib 0x909d8259 __pthread_start + 345 6 libSystem.B.dylib 0x909d80de _thread_start + 34 Thread 0 crashed with X86 Thread State (32-bit): eax: 0x00000000 ebx: 0x00000000 ecx: 0x00000000 edx: 0x00000000 edi: 0x00000000 esi: 0x00000000 ebp: 0xbfffc9c8 esp: 0x00000000 ss: 0x00000000 efl: 0x00000000 eip: 0x00447dc2 cs: 0x00000000 ds: 0x00000000 es: 0x00000000 fs: 0x00000000 gs: 0x00000000 Binary Images Description: 0x1000 - 0x4cbfff /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_um_6.07_i686-apple-darwin 0x909aa000 - 0x90b51fff /usr/lib/libSystem.B.dylib 0x92adb000 - 0x92adefff /usr/lib/system/libmathCommon.A.dylib 0x9a940000 - 0x9a94efff /usr/lib/libz.1.dylib Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=12810, iMonCtr=1 Model crash detected, will try to restart... SIGABRT: abort called Crashed executable name: hadcm3n_um_6.07_i686-apple-darwin built using BOINC library version 6.13.0 Machine type Intel 80486 (32-bit executable) System version: Macintosh OS 10.6.8 build 10K549 Tue Aug 9 02:50:29 2011 Thread 0 Crashed: CPDN Monitor - Quit request from BOINC... SIGABRT: abort called Crashed executable name: hadcm3n_um_6.07_i686-apple-darwin built using BOINC library version 6.13.0 Machine type Intel 80486 (32-bit executable) System version: Macintosh OS 10.6.8 build 10K549 Tue Aug 9 06:12:17 2011 Thread 0 Crashed: 0 libSystem.B.dylib 0x90a0bc5a ___kill + 10 1 libSystem.B.dylib 0x90a9e5a5 _raise + 26 2 libSystem.B.dylib 0x90ab46e4 _abort + 93 3 hadcm3n_um_6.07_i686-apple-darwin 0x00336cff _um_setup + 127 4 hadcm3n_um_6.07_i686-apple-darwin 0x00389b71 _um_shell + 3953 5 hadcm3n_um_6.07_i686-apple-darwin 0x000048e1 _main + 1153 6 hadcm3n_um_6.07_i686-apple-darwin 0x000027fb __start + 209 7 hadcm3n_um_6.07_i686-apple-darwin 0x00002729 start + 41 Thread 1: 0 libSystem.B.dylib 0x909aac0e _mach_wait_until + 10 1 libSystem.B.dylib 0x90a32429 _nanosleep + 345 2 libSystem.B.dylib 0x90a322ca _usleep + 61 3 hadcm3n_um_6.07_i686-apple-darwin 0x00442ec0 __Z11boinc_sleepd + 188 4 hadcm3n_um_6.07_i686-apple-darwin 0x0043865e __Z12timer_threadPv + 78 5 libSystem.B.dylib 0x909d8259 __pthread_start + 345 6 libSystem.B.dylib 0x909d80de _thread_start + 34 Thread 0 crashed with X86 Thread State (32-bit): eax: 0x00000000 ebx: 0x00000000 ecx: 0x00000000 edx: 0x00000000 edi: 0x00000000 esi: 0x00000000 ebp: 0xbfffc9c8 esp: 0x00000000 ss: 0x00000000 efl: 0x00000000 eip: 0x00447dc2 cs: 0x00000000 ds: 0x00000000 es: 0x00000000 fs: 0x00000000 gs: 0x00000000 Binary Images Description: 0x1000 - 0x4cbfff /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_um_6.07_i686-apple-darwin 0x909aa000 - 0x90b51fff /usr/lib/libSystem.B.dylib 0x92adb000 - 0x92adefff /usr/lib/system/libmathCommon.A.dylib 0x9a940000 - 0x9a94efff /usr/lib/libz.1.dylib Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=20080, iMonCtr=1 Model crash detected, will try to restart... SIGABRT: abort called Crashed executable name: hadcm3n_um_6.07_i686-apple-darwin built using BOINC library version 6.13.0 Machine type Intel 80486 (32-bit executable) System version: Macintosh OS 10.6.8 build 10K549 Tue Aug 9 06:12:20 2011 Thread 0 Crashed: 0 libSystem.B.dylib 0x90a0bc5a ___kill + 10 1 libSystem.B.dylib 0x90a9e5a5 _raise + 26 2 libSystem.B.dylib 0x90ab46e4 _abort + 93 3 hadcm3n_um_6.07_i686-apple-darwin 0x00336cff _um_setup + 127 4 hadcm3n_um_6.07_i686-apple-darwin 0x00389b71 _um_shell + 3953 5 hadcm3n_um_6.07_i686-apple-darwin 0x000048e1 _main + 1153 6 hadcm3n_um_6.07_i686-apple-darwin 0x000027fb __start + 209 7 hadcm3n_um_6.07_i686-apple-darwin 0x00002729 start + 41 Thread 1: 0 libSystem.B.dylib 0x909aac0e _mach_wait_until + 10 1 libSystem.B.dylib 0x90a32429 _nanosleep + 345 2 libSystem.B.dylib 0x90a322ca _usleep + 61 3 hadcm3n_um_6.07_i686-apple-darwin 0x00442ec0 __Z11boinc_sleepd + 188 4 hadcm3n_um_6.07_i686-apple-darwin 0x0043865e __Z12timer_threadPv + 78 5 libSystem.B.dylib 0x909d8259 __pthread_start + 345 6 libSystem.B.dylib 0x909d80de _thread_start + 34 Thread 0 crashed with X86 Thread State (32-bit): eax: 0x00000000 ebx: 0x00000000 ecx: 0x00000000 edx: 0x00000000 edi: 0x00000000 esi: 0x00000000 ebp: 0xbfffc9c8 esp: 0x00000000 ss: 0x00000000 efl: 0x00000000 eip: 0x00447dc2 cs: 0x00000000 ds: 0x00000000 es: 0x00000000 fs: 0x00000000 gs: 0x00000000 Binary Images Description: 0x1000 - 0x4cbfff /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_um_6.07_i686-apple-darwin 0x909aa000 - 0x90b51fff /usr/lib/libSystem.B.dylib 0x92adb000 - 0x92adefff /usr/lib/system/libmathCommon.A.dylib 0x9a940000 - 0x9a94efff /usr/lib/libz.1.dylib Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=20080, iMonCtr=1 Model crash detected, will try to restart... SIGABRT: abort called Crashed executable name: hadcm3n_um_6.07_i686-apple-darwin built using BOINC library version 6.13.0 Machine type Intel 80486 (32-bit executable) System version: Macintosh OS 10.6.8 build 10K549 Tue Aug 9 06:12:23 2011 Thread 0 Crashed: 0 libSystem.B.dylib 0x90a0bc5a ___kill + 10 1 libSystem.B.dylib 0x90a9e5a5 _raise + 26 2 libSystem.B.dylib 0x90ab46e4 _abort + 93 3 hadcm3n_um_6.07_i686-apple-darwin 0x00336cff _um_setup + 127 4 hadcm3n_um_6.07_i686-apple-darwin 0x00389b71 _um_shell + 3953 5 hadcm3n_um_6.07_i686-apple-darwin 0x000048e1 _main + 1153 6 hadcm3n_um_6.07_i686-apple-darwin 0x000027fb __start + 209 7 hadcm3n_um_6.07_i686-apple-darwin 0x00002729 start + 41 Thread 1: 0 libSystem.B.dylib 0x909aac0e _mach_wait_until + 10 1 libSystem.B.dylib 0x90a32429 _nanosleep + 345 2 libSystem.B.dylib 0x90a322ca _usleep + 61 3 hadcm3n_um_6.07_i686-apple-darwin 0x00442ec0 __Z11boinc_sleepd + 188 4 hadcm3n_um_6.07_i686-apple-darwin 0x0043865e __Z12timer_threadPv + 78 5 libSystem.B.dylib 0x909d8259 __pthread_start + 345 6 libSystem.B.dylib 0x909d80de _thread_start + 34 Thread 0 crashed with X86 Thread State (32-bit): eax: 0x00000000 ebx: 0x00000000 ecx: 0x00000000 edx: 0x00000000 edi: 0x00000000 esi: 0x00000000 ebp: 0xbfffc9c8 esp: 0x00000000 ss: 0x00000000 efl: 0x00000000 eip: 0x00447dc2 cs: 0x00000000 ds: 0x00000000 es: 0x00000000 fs: 0x00000000 gs: 0x00000000 Binary Images Description: 0x1000 - 0x4cbfff /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_um_6.07_i686-apple-darwin 0x909aa000 - 0x90b51fff /usr/lib/libSystem.B.dylib 0x92adb000 - 0x92adefff /usr/lib/system/libmathCommon.A.dylib 0x9a940000 - 0x9a94efff /usr/lib/libz.1.dylib Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=20080, iMonCtr=1 Model crash detected, will try to restart... SIGABRT: abort called Crashed executable name: hadcm3n_um_6.07_i686-apple-darwin built using BOINC library version 6.13.0 Machine type Intel 80486 (32-bit executable) System version: Macintosh OS 10.6.8 build 10K549 Tue Aug 9 06:12:25 2011 Thread 0 Crashed: 0 libSystem.B.dylib 0x90a0bc5a ___kill + 10 1 libSystem.B.dylib 0x90a9e5a5 _raise + 26 2 libSystem.B.dylib 0x90ab46e4 _abort + 93 3 hadcm3n_um_6.07_i686-apple-darwin 0x00336cff _um_setup + 127 4 hadcm3n_um_6.07_i686-apple-darwin 0x00389b71 _um_shell + 3953 5 hadcm3n_um_6.07_i686-apple-darwin 0x000048e1 _main + 1153 6 hadcm3n_um_6.07_i686-apple-darwin 0x000027fb __start + 209 7 hadcm3n_um_6.07_i686-apple-darwin 0x00002729 start + 41 Thread 1: 0 libSystem.B.dylib 0x909aac0e _mach_wait_until + 10 1 libSystem.B.dylib 0x90a32429 _nanosleep + 345 2 libSystem.B.dylib 0x90a322ca _usleep + 61 3 hadcm3n_um_6.07_i686-apple-darwin 0x00442ec0 __Z11boinc_sleepd + 188 4 hadcm3n_um_6.07_i686-apple-darwin 0x0043865e __Z12timer_threadPv + 78 5 libSystem.B.dylib 0x909d8259 __pthread_start + 345 6 libSystem.B.dylib 0x909d80de _thread_start + 34 Thread 0 crashed with X86 Thread State (32-bit): eax: 0x00000000 ebx: 0x00000000 ecx: 0x00000000 edx: 0x00000000 edi: 0x00000000 esi: 0x00000000 ebp: 0xbfffc9c8 esp: 0x00000000 ss: 0x00000000 efl: 0x00000000 eip: 0x00447dc2 cs: 0x00000000 ds: 0x00000000 es: 0x00000000 fs: 0x00000000 gs: 0x00000000 Binary Images Description: 0x1000 - 0x4cbfff /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_um_6.07_i686-apple-darwin 0x909aa000 - 0x90b51fff /usr/lib/libSystem.B.dylib 0x92adb000 - 0x92adefff /usr/lib/system/libmathCommon.A.dylib 0x9a940000 - 0x9a94efff /usr/lib/libz.1.dylib Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=20080, iMonCtr=1 Model crash detected, will try to restart... Sorry, too many model crashes! :-( Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
25 Jul 2011 18:45:27	942621	13123625	hadcm3n_ykuj_1900_40_007359877_0	259,200	396,610	1.5301
25 Jul 2011 17:52:59	942621	13123625	hadcm3n_ykuj_1900_40_007359877_0	233,280	358,801	1.5381
25 Jul 2011 16:44:13	942621	13123625	hadcm3n_ykuj_1900_40_007359877_0	207,360	315,872	1.5233
25 Jul 2011 13:28:55	942621	13123625	hadcm3n_ykuj_1900_40_007359877_0	181,440	277,306	1.5284
25 Jul 2011 13:28:55	942621	13123625	hadcm3n_ykuj_1900_40_007359877_0	155,520	236,795	1.5226
25 Jul 2011 13:28:55	942621	13123625	hadcm3n_ykuj_1900_40_007359877_0	129,600	195,866	1.5113
25 Jul 2011 13:28:55	942621	13123625	hadcm3n_ykuj_1900_40_007359877_0	103,680	155,617	1.5009
25 Jul 2011 13:28:55	942621	13123625	hadcm3n_ykuj_1900_40_007359877_0	77,760	115,647	1.4872
10 Jul 2011 15:54:33	942621	13123625	hadcm3n_ykuj_1900_40_007359877_0	51,840	80,929	1.5611
09 Jul 2011 03:57:49	942621	13123625	hadcm3n_ykuj_1900_40_007359877_0	25,920	40,488	1.5620