Name | hadcm3n_39o3_1940_40_008265469_1 |
Workunit | 8420593 |
Created | 31 Dec 2012, 20:47:59 UTC |
Sent | 31 Dec 2012, 20:48:06 UTC |
Report deadline | 2 Apr 2013, 4:15:17 UTC |
Received | 9 Jun 2013, 19:26:00 UTC |
Server state | Over |
Outcome | Computation error |
Client state | Compute error |
Exit status | 22 (0x00000016) Unknown error code |
Computer ID | 1243235 |
Run time | 23 days 8 hours 31 min 11 sec |
CPU time | 7 days 14 hours 57 min 59 sec |
Validate state | Invalid |
Credit | 5,598.72 |
Device peak FLOPS | 3.18 GFLOPS |
Application version | UK Met Office Coupled Model Full Resolution Ocean v6.07 i686-apple-darwin |
Stderr | <core_client_version>7.0.31</core_client_version> <![CDATA[ <message> process exited with code 22 (0x16, -234) </message> <stderr_txt> eat from core client for 30 sec - exiting 05:39:31 (55868): No heartbeat from core client for 30 sec - exiting 05:40:02 (55868): No heartbeat from core client for 30 sec - exiting 05:40:03 (55868): No heartbeat from core client for 30 sec - exiting 05:40:04 (55868): No heartbeat from core client for 30 sec - exiting 05:40:05 (55868): No heartbeat from core client for 30 sec - exiting 05:40:06 (55868): No heartbeat from core client for 30 sec - exiting 05:40:07 (55868): No heartbeat from core client for 30 sec - exiting 05:40:08 (55868): No heartbeat from core client for 30 sec - exiting 05:40:09 (55868): No heartbeat from core client for 30 sec - exiting 05:40:10 (55868): No heartbeat from core client for 30 sec - exiting 05:40:11 (55868): No heartbeat from core client for 30 sec - exiting 05:40:12 (55868): No heartbeat from core client for 30 sec - exiting 05:40:13 (55868): No heartbeat from core client for 30 sec - exiting 05:40:14 (55868): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... BUFFOUT: Write Failed: No space left on device BUFFOUT: C I/O Error - Return code = 1 Model crashed: WRITDUMP: BAD BUFFOUT OF DATA tmp/pipe_dummy 2048 CPDN Monitor - Quit request from BOINC... 09:12:05 (60712): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:12:10 (60712): No heartbeat from core client for 30 sec - exiting 09:22:11 (61122): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:22:40 (61122): No heartbeat from core client for 30 sec - exiting 09:22:41 (61122): No heartbeat from core client for 30 sec - exiting 09:22:42 (61122): No heartbeat from core client for 30 sec - exiting 09:22:43 (61122): No heartbeat from core client for 30 sec - exiting 09:22:44 (61122): No heartbeat from core client for 30 sec - exiting 09:22:45 (61122): No heartbeat from core client for 30 sec - exiting 09:22:46 (61122): No heartbeat from core client for 30 sec - exiting 09:22:47 (61122): No heartbeat from core client for 30 sec - exiting 09:22:48 (61122): No heartbeat from core client for 30 sec - exiting 09:22:49 (61122): No heartbeat from core client for 30 sec - exiting 09:22:50 (61122): No heartbeat from core client for 30 sec - exiting 09:22:51 (61122): No heartbeat from core client for 30 sec - exiting 09:22:52 (61122): No heartbeat from core client for 30 sec - exiting 09:22:53 (61122): No heartbeat from core client for 30 sec - exiting 09:22:54 (61122): No heartbeat from core client for 30 sec - exiting 09:22:55 (61122): No heartbeat from core client for 30 sec - exiting 09:22:56 (61122): No heartbeat from core client for 30 sec - exiting 09:22:57 (61122): No heartbeat from core client for 30 sec - exiting 09:22:58 (61122): No heartbeat from core client for 30 sec - exiting 09:22:59 (61122): No heartbeat from core client for 30 sec - exiting 09:23:00 (61122): No heartbeat from core client for 30 sec - exiting 09:23:22 (61122): No heartbeat from core client for 30 sec - exiting 09:23:23 (61122): No heartbeat from core client for 30 sec - exiting 09:23:24 (61122): No heartbeat from core client for 30 sec - exiting 09:23:25 (61122): No heartbeat from core client for 30 sec - exiting 09:23:26 (61122): No heartbeat from core client for 30 sec - exiting 09:23:27 (61122): No heartbeat from core client for 30 sec - exiting 09:23:28 (61122): No heartbeat from core client for 30 sec - exiting 09:23:29 (61122): No heartbeat from core client for 30 sec - exiting 09:23:30 (61122): No heartbeat from core client for 30 sec - exiting 09:23:31 (61122): No heartbeat from core client for 30 sec - exiting 09:23:32 (61122): No heartbeat from core client for 30 sec - exiting 09:23:33 (61122): No heartbeat from core client for 30 sec - exiting 09:23:34 (61122): No heartbeat from core client for 30 sec - exiting 09:23:35 (61122): No heartbeat from core client for 30 sec - exiting 09:23:36 (61122): No heartbeat from core client for 30 sec - exiting 09:23:37 (61122): No heartbeat from core client for 30 sec - exiting 09:23:38 (61122): No heartbeat from core client for 30 sec - exiting 09:23:39 (61122): No heartbeat from core client for 30 sec - exiting 09:23:40 (61122): No heartbeat from core client for 30 sec - exiting 09:34:50 (61331): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:42:08 (61598): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:42:20 (61598): No heartbeat from core client for 30 sec - exiting 09:42:21 (61598): No heartbeat from core client for 30 sec - exiting 09:42:22 (61598): No heartbeat from core client for 30 sec - exiting 09:42:23 (61598): No heartbeat from core client for 30 sec - exiting 09:42:24 (61598): No heartbeat from core client for 30 sec - exiting 09:42:25 (61598): No heartbeat from core client for 30 sec - exiting 09:42:26 (61598): No heartbeat from core client for 30 sec - exiting 09:42:27 (61598): No heartbeat from core client for 30 sec - exiting 09:42:28 (61598): No heartbeat from core client for 30 sec - exiting 09:42:29 (61598): No heartbeat from core client for 30 sec - exiting 09:42:30 (61598): No heartbeat from core client for 30 sec - exiting 09:42:31 (61598): No heartbeat from core client for 30 sec - exiting 09:45:03 (61732): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:45:05 (61732): No heartbeat from core client for 30 sec - exiting 10:10:55 (61836): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:18:44 (62490): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Atmos Hold Restart file rename failed on atmos_restart.hold 10:27:16 (62676): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:27:17 (62676): No heartbeat from core client for 30 sec - exiting 10:27:18 (62676): No heartbeat from core client for 30 sec - exiting 10:27:19 (62676): No heartbeat from core client for 30 sec - exiting 10:27:20 (62676): No heartbeat from core client for 30 sec - exiting 10:27:21 (62676): No heartbeat from core client for 30 sec - exiting 10:27:22 (62676): No heartbeat from core client for 30 sec - exiting 10:27:23 (62676): No heartbeat from core client for 30 sec - exiting 10:27:24 (62676): No heartbeat from core client for 30 sec - exiting 10:27:25 (62676): No heartbeat from core client for 30 sec - exiting 10:27:26 (62676): No heartbeat from core client for 30 sec - exiting 10:27:27 (62676): No heartbeat from core client for 30 sec - exiting 10:27:28 (62676): No heartbeat from core client for 30 sec - exiting 10:27:29 (62676): No heartbeat from core client for 30 sec - exiting 10:27:30 (62676): No heartbeat from core client for 30 sec - exiting 10:27:31 (62676): No heartbeat from core client for 30 sec - exiting 10:27:32 (62676): No heartbeat from core client for 30 sec - exiting 10:27:33 (62676): No heartbeat from core client for 30 sec - exiting 10:27:34 (62676): No heartbeat from core client for 30 sec - exiting 10:27:35 (62676): No heartbeat from core client for 30 sec - exiting 10:27:36 (62676): No heartbeat from core client for 30 sec - exiting 10:27:37 (62676): No heartbeat from core client for 30 sec - exiting 10:27:38 (62676): No heartbeat from core client for 30 sec - exiting 10:27:39 (62676): No heartbeat from core client for 30 sec - exiting 10:27:40 (62676): No heartbeat from core client for 30 sec - exiting 10:27:41 (62676): No heartbeat from core client for 30 sec - exiting 10:27:42 (62676): No heartbeat from core client for 30 sec - exiting 10:27:43 (62676): No heartbeat from core client for 30 sec - exiting 10:30:31 (62842): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:37:17 (62956): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:37:28 (62956): No heartbeat from core client for 30 sec - exiting 10:37:29 (62956): No heartbeat from core client for 30 sec - exiting 10:37:30 (62956): No heartbeat from core client for 30 sec - exiting 10:37:31 (62956): No heartbeat from core client for 30 sec - exiting 10:37:32 (62956): No heartbeat from core client for 30 sec - exiting 10:37:33 (62956): No heartbeat from core client for 30 sec - exiting 10:37:34 (62956): No heartbeat from core client for 30 sec - exiting 10:37:35 (62956): No heartbeat from core client for 30 sec - exiting 10:37:36 (62956): No heartbeat from core client for 30 sec - exiting 10:37:37 (62956): No heartbeat from core client for 30 sec - exiting 10:37:38 (62956): No heartbeat from core client for 30 sec - exiting 10:37:39 (62956): No heartbeat from core client for 30 sec - exiting 10:37:40 (62956): No heartbeat from core client for 30 sec - exiting 10:37:41 (62956): No heartbeat from core client for 30 sec - exiting 10:37:42 (62956): No heartbeat from core client for 30 sec - exiting 10:37:43 (62956): No heartbeat from core client for 30 sec - exiting 10:37:44 (62956): No heartbeat from core client for 30 sec - exiting 10:37:46 (62956): No heartbeat from core client for 30 sec - exiting 10:37:47 (62956): No heartbeat from core client for 30 sec - exiting 11:02:20 (63106): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:02:29 (63106): No heartbeat from core client for 30 sec - exiting 11:02:30 (63106): No heartbeat from core client for 30 sec - exiting 11:02:31 (63106): No heartbeat from core client for 30 sec - exiting 11:02:32 (63106): No heartbeat from core client for 30 sec - exiting 11:02:33 (63106): No heartbeat from core client for 30 sec - exiting 11:02:34 (63106): No heartbeat from core client for 30 sec - exiting 11:02:35 (63106): No heartbeat from core client for 30 sec - exiting 11:02:36 (63106): No heartbeat from core client for 30 sec - exiting 11:02:37 (63106): No heartbeat from core client for 30 sec - exiting 11:05:09 (63591): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:05:10 (63591): No heartbeat from core client for 30 sec - exiting 11:05:11 (63591): No heartbeat from core client for 30 sec - exiting 11:05:12 (63591): No heartbeat from core client for 30 sec - exiting 11:05:13 (63591): No heartbeat from core client for 30 sec - exiting 11:05:14 (63591): No heartbeat from core client for 30 sec - exiting 11:05:15 (63591): No heartbeat from core client for 30 sec - exiting 11:05:16 (63591): No heartbeat from core client for 30 sec - exiting 11:05:17 (63591): No heartbeat from core client for 30 sec - exiting 11:05:18 (63591): No heartbeat from core client for 30 sec - exiting 11:05:19 (63591): No heartbeat from core client for 30 sec - exiting 11:05:20 (63591): No heartbeat from core client for 30 sec - exiting 11:05:21 (63591): No heartbeat from core client for 30 sec - exiting 11:05:22 (63591): No heartbeat from core client for 30 sec - exiting 11:05:23 (63591): No heartbeat from core client for 30 sec - exiting 11:05:24 (63591): No heartbeat from core client for 30 sec - exiting 11:11:40 (63713): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:25:02 (63940): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:25:08 (63940): No heartbeat from core client for 30 sec - exiting 11:25:09 (63940): No heartbeat from core client for 30 sec - exiting 11:25:10 (63940): No heartbeat from core client for 30 sec - exiting 11:25:11 (63940): No heartbeat from core client for 30 sec - exiting 11:25:12 (63940): No heartbeat from core client for 30 sec - exiting 11:25:13 (63940): No heartbeat from core client for 30 sec - exiting 11:25:14 (63940): No heartbeat from core client for 30 sec - exiting 11:25:15 (63940): No heartbeat from core client for 30 sec - exiting 11:25:16 (63940): No heartbeat from core client for 30 sec - exiting 11:25:17 (63940): No heartbeat from core client for 30 sec - exiting 11:25:18 (63940): No heartbeat from core client for 30 sec - exiting 11:25:19 (63940): No heartbeat from core client for 30 sec - exiting 11:25:20 (63940): No heartbeat from core client for 30 sec - exiting 11:25:21 (63940): No heartbeat from core client for 30 sec - exiting 11:25:22 (63940): No heartbeat from core client for 30 sec - exiting 11:25:23 (63940): No heartbeat from core client for 30 sec - exiting 12:37:47 (64222): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:38:02 (64222): No heartbeat from core client for 30 sec - exiting 13:09:26 (65875): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:09:44 (65875): No heartbeat from core client for 30 sec - exiting 13:09:45 (65875): No heartbeat from core client for 30 sec - exiting 13:09:46 (65875): No heartbeat from core client for 30 sec - exiting 13:09:47 (65875): No heartbeat from core client for 30 sec - exiting 13:09:48 (65875): No heartbeat from core client for 30 sec - exiting 13:09:49 (65875): No heartbeat from core client for 30 sec - exiting 13:09:50 (65875): No heartbeat from core client for 30 sec - exiting 13:09:51 (65875): No heartbeat from core client for 30 sec - exiting 13:09:52 (65875): No heartbeat from core client for 30 sec - exiting 13:09:53 (65875): No heartbeat from core client for 30 sec - exiting 13:09:54 (65875): No heartbeat from core client for 30 sec - exiting 13:09:55 (65875): No heartbeat from core client for 30 sec - exiting 13:09:56 (65875): No heartbeat from core client for 30 sec - exiting 13:09:57 (65875): No heartbeat from core client for 30 sec - exiting 13:09:58 (65875): No heartbeat from core client for 30 sec - exiting 13:09:59 (65875): No heartbeat from core client for 30 sec - exiting 13:10:00 (65875): No heartbeat from core client for 30 sec - exiting 13:10:01 (65875): No heartbeat from core client for 30 sec - exiting 13:10:02 (65875): No heartbeat from core client for 30 sec - exiting 13:10:03 (65875): No heartbeat from core client for 30 sec - exiting 13:10:04 (65875): No heartbeat from core client for 30 sec - exiting 13:10:05 (65875): No heartbeat from core client for 30 sec - exiting 13:10:06 (65875): No heartbeat from core client for 30 sec - exiting 13:10:07 (65875): No heartbeat from core client for 30 sec - exiting 13:10:08 (65875): No heartbeat from core client for 30 sec - exiting 13:10:09 (65875): No heartbeat from core client for 30 sec - exiting 13:12:56 (66623): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:12:57 (66623): No heartbeat from core client for 30 sec - exiting 13:12:58 (66623): No heartbeat from core client for 30 sec - exiting 13:12:59 (66623): No heartbeat from core client for 30 sec - exiting 13:13:00 (66623): No heartbeat from core client for 30 sec - exiting 13:13:01 (66623): No heartbeat from core client for 30 sec - exiting 13:13:02 (66623): No heartbeat from core client for 30 sec - exiting 13:13:03 (66623): No heartbeat from core client for 30 sec - exiting 13:13:04 (66623): No heartbeat from core client for 30 sec - exiting 13:13:05 (66623): No heartbeat from core client for 30 sec - exiting 13:13:06 (66623): No heartbeat from core client for 30 sec - exiting 13:13:07 (66623): No heartbeat from core client for 30 sec - exiting 13:18:14 (66736): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:18:27 (66736): No heartbeat from core client for 30 sec - exiting 13:18:28 (66736): No heartbeat from core client for 30 sec - exiting 13:31:20 (66882): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:03:27 (67154): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:38:51 (67800): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:42:46 (68464): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:42:47 (68464): No heartbeat from core client for 30 sec - exiting 14:42:48 (68464): No heartbeat from core client for 30 sec - exiting 14:42:49 (68464): No heartbeat from core client for 30 sec - exiting 14:42:50 (68464): No heartbeat from core client for 30 sec - exiting 14:42:51 (68464): No heartbeat from core client for 30 sec - exiting 14:42:52 (68464): No heartbeat from core client for 30 sec - exiting 14:42:53 (68464): No heartbeat from core client for 30 sec - exiting 14:42:54 (68464): No heartbeat from core client for 30 sec - exiting 14:42:55 (68464): No heartbeat from core client for 30 sec - exiting 14:42:56 (68464): No heartbeat from core client for 30 sec - exiting 14:42:57 (68464): No heartbeat from core client for 30 sec - exiting 14:58:52 (68616): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:59:07 (68616): No heartbeat from core client for 30 sec - exiting 14:59:08 (68616): No heartbeat from core client for 30 sec - exiting 14:59:09 (68616): No heartbeat from core client for 30 sec - exiting 14:59:10 (68616): No heartbeat from core client for 30 sec - exiting 14:59:11 (68616): No heartbeat from core client for 30 sec - exiting 14:59:12 (68616): No heartbeat from core client for 30 sec - exiting 14:59:13 (68616): No heartbeat from core client for 30 sec - exiting 14:59:14 (68616): No heartbeat from core client for 30 sec - exiting 15:02:03 (68950): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:02:04 (68950): No heartbeat from core client for 30 sec - exiting 15:02:05 (68950): No heartbeat from core client for 30 sec - exiting 15:02:06 (68950): No heartbeat from core client for 30 sec - exiting 15:08:11 (69090): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:08:12 (69090): No heartbeat from core client for 30 sec - exiting 15:23:55 (69244): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:24:05 (69244): No heartbeat from core client for 30 sec - exiting 15:24:06 (69244): No heartbeat from core client for 30 sec - exiting 15:24:07 (69244): No heartbeat from core client for 30 sec - exiting 15:24:08 (69244): No heartbeat from core client for 30 sec - exiting 15:24:09 (69244): No heartbeat from core client for 30 sec - exiting 15:24:10 (69244): No heartbeat from core client for 30 sec - exiting 15:24:11 (69244): No heartbeat from core client for 30 sec - exiting 15:24:12 (69244): No heartbeat from core client for 30 sec - exiting 15:24:13 (69244): No heartbeat from core client for 30 sec - exiting 15:24:14 (69244): No heartbeat from core client for 30 sec - exiting 15:24:15 (69244): No heartbeat from core client for 30 sec - exiting 15:24:16 (69244): No heartbeat from core client for 30 sec - exiting 15:24:17 (69244): No heartbeat from core client for 30 sec - exiting 15:24:18 (69244): No heartbeat from core client for 30 sec - exiting 15:24:19 (69244): No heartbeat from core client for 30 sec - exiting 15:24:20 (69244): No heartbeat from core client for 30 sec - exiting 15:24:21 (69244): No heartbeat from core client for 30 sec - exiting 15:43:58 (69608): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:24:18 (69993): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:24:27 (69993): No heartbeat from core client for 30 sec - exiting 22:14:33 (73369): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:39:36 (77715): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:39:37 (77715): No heartbeat from core client for 30 sec - exiting 22:39:38 (77715): No heartbeat from core client for 30 sec - exiting 22:39:39 (77715): No heartbeat from core client for 30 sec - exiting 22:39:40 (77715): No heartbeat from core client for 30 sec - exiting 22:39:41 (77715): No heartbeat from core client for 30 sec - exiting 00:19:50 (78224): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:19:52 (78224): No heartbeat from core client for 30 sec - exiting 00:19:53 (78224): No heartbeat from core client for 30 sec - exiting 00:19:54 (78224): No heartbeat from core client for 30 sec - exiting 00:19:55 (78224): No heartbeat from core client for 30 sec - exiting 00:19:56 (78224): No heartbeat from core client for 30 sec - exiting 00:19:57 (78224): No heartbeat from core client for 30 sec - exiting 00:19:58 (78224): No heartbeat from core client for 30 sec - exiting 00:19:59 (78224): No heartbeat from core client for 30 sec - exiting 00:20:00 (78224): No heartbeat from core client for 30 sec - exiting 00:20:01 (78224): No heartbeat from core client for 30 sec - exiting 00:20:02 (78224): No heartbeat from core client for 30 sec - exiting 00:20:03 (78224): No heartbeat from core client for 30 sec - exiting 00:20:04 (78224): No heartbeat from core client for 30 sec - exiting 00:20:05 (78224): No heartbeat from core client for 30 sec - exiting 00:20:06 (78224): No heartbeat from core client for 30 sec - exiting 00:20:07 (78224): No heartbeat from core client for 30 sec - exiting 00:20:08 (78224): No heartbeat from core client for 30 sec - exiting 00:22:59 (80201): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:23:00 (80201): No heartbeat from core client for 30 sec - exiting 00:23:01 (80201): No heartbeat from core client for 30 sec - exiting 00:23:02 (80201): No heartbeat from core client for 30 sec - exiting 00:23:03 (80201): No heartbeat from core client for 30 sec - exiting 00:23:04 (80201): No heartbeat from core client for 30 sec - exiting 00:23:05 (80201): No heartbeat from core client for 30 sec - exiting 02:35:03 (80844): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:35:08 (80844): No heartbeat from core client for 30 sec - exiting 02:35:09 (80844): No heartbeat from core client for 30 sec - exiting 02:35:10 (80844): No heartbeat from core client for 30 sec - exiting 05:40:19 (83332): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:55:27 (88203): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:10:31 (89605): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:10:34 (89605): No heartbeat from core client for 30 sec - exiting 07:10:35 (89605): No heartbeat from core client for 30 sec - exiting 07:10:36 (89605): No heartbeat from core client for 30 sec - exiting 07:10:37 (89605): No heartbeat from core client for 30 sec - exiting 07:10:38 (89605): No heartbeat from core client for 30 sec - exiting 07:10:39 (89605): No heartbeat from core client for 30 sec - exiting 07:10:40 (89605): No heartbeat from core client for 30 sec - exiting 07:10:41 (89605): No heartbeat from core client for 30 sec - exiting 07:41:22 (89956): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:18:59 (90544): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:40:49 (92391): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:44:38 (92808): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:44:39 (92808): No heartbeat from core client for 30 sec - exiting 10:44:40 (92808): No heartbeat from core client for 30 sec - exiting 10:44:41 (92808): No heartbeat from core client for 30 sec - exiting 10:44:42 (92808): No heartbeat from core client for 30 sec - exiting 10:44:43 (92808): No heartbeat from core client for 30 sec - exiting 10:44:44 (92808): No heartbeat from core client for 30 sec - exiting 10:44:45 (92808): No heartbeat from core client for 30 sec - exiting 18:31:24 (94058): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:56:34 (2933): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... hadcm3n_6.07_i686-apple-darwin(27050,0xac6de2c0) malloc: *** error for object 0xc1d7404: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(27050,0xac6de2c0) malloc: *** error for object 0xc1d7400: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(27050,0xac6de2c0) malloc: *** error for object 0x61d8804: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(27050,0xac6de2c0) malloc: *** error for object 0x61d8800: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(27050,0xac6de2c0) malloc: *** error for object 0x61d8804: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(27050,0xac6de2c0) malloc: *** error for object 0x61d8800: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(27050,0xac6de2c0) malloc: *** error for object 0x61d8804: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(27050,0xac6de2c0) malloc: *** error for object 0x61d8800: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(27050,0xac6de2c0) malloc: *** error for object 0x61d8804: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(27050,0xac6de2c0) malloc: *** error for object 0x61d8800: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 14:04:32 (68773): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 15:04:03 (86887): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 15:24:05 (87511): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:24:07 (87511): No heartbeat from core client for 30 sec - exiting 15:24:08 (87511): No heartbeat from core client for 30 sec - exiting 15:24:09 (87511): No heartbeat from core client for 30 sec - exiting 15:24:10 (87511): No heartbeat from core client for 30 sec - exiting 15:24:11 (87511): No heartbeat from core client for 30 sec - exiting 15:24:12 (87511): No heartbeat from core client for 30 sec - exiting 15:24:13 (87511): No heartbeat from core client for 30 sec - exiting 15:24:14 (87511): No heartbeat from core client for 30 sec - exiting 15:24:15 (87511): No heartbeat from core client for 30 sec - exiting 15:24:16 (87511): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 18:10:05 (87911): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:20:05 (91601): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 00:41:15 (95512): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:56:30 (502): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:07:16 (2286): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 09:18:12 (9188): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:18:15 (9188): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 03:15:24 (47790): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:15:26 (47790): No heartbeat from core client for 30 sec - exiting 03:15:27 (47790): No heartbeat from core client for 30 sec - exiting 03:15:28 (47790): No heartbeat from core client for 30 sec - exiting 03:15:29 (47790): No heartbeat from core client for 30 sec - exiting 03:15:30 (47790): No heartbeat from core client for 30 sec - exiting 03:15:31 (47790): No heartbeat from core client for 30 sec - exiting 03:15:32 (47790): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 09:18:56 (51443): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:19:00 (51443): No heartbeat from core client for 30 sec - exiting 09:19:01 (51443): No heartbeat from core client for 30 sec - exiting 09:19:02 (51443): No heartbeat from core client for 30 sec - exiting 09:19:03 (51443): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 11:49:18 (54500): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:02:41 (54836): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:09:25 (56179): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:14:27 (56341): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:20:18 (56446): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:52:11 (58796): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 04:13:00 (60471): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 00:25:58 (38107): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:26:00 (38107): No heartbeat from core client for 30 sec - exiting 00:56:02 (41727): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:01:02 (42302): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:41:30 (42407): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:41:31 (42407): No heartbeat from core client for 30 sec - exiting 04:41:32 (42407): No heartbeat from core client for 30 sec - exiting 04:41:33 (42407): No heartbeat from core client for 30 sec - exiting 04:41:34 (42407): No heartbeat from core client for 30 sec - exiting 05:46:23 (46425): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 09:47:43 (49507): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:23:01 (52228): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:28:02 (52849): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:08:08 (52953): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:08:13 (52953): No heartbeat from core client for 30 sec - exiting 12:03:11 (53695): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 19:14:48 (48476): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 20:14:15 (49337): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:14:19 (49337): No heartbeat from core client for 30 sec - exiting 20:14:20 (49337): No heartbeat from core client for 30 sec - exiting 20:14:21 (49337): No heartbeat from core client for 30 sec - exiting 20:14:22 (49337): No heartbeat from core client for 30 sec - exiting 20:14:23 (49337): No heartbeat from core client for 30 sec - exiting 20:14:24 (49337): No heartbeat from core client for 30 sec - exiting 20:14:25 (49337): No heartbeat from core client for 30 sec - exiting 20:14:26 (49337): No heartbeat from core client for 30 sec - exiting 20:29:18 (49768): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 21:24:34 (50790): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:24:36 (50790): No heartbeat from core client for 30 sec - exiting 21:24:37 (50790): No heartbeat from core client for 30 sec - exiting 22:19:41 (51669): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:24:46 (52674): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:24:53 (52674): No heartbeat from core client for 30 sec - exiting 23:24:54 (52674): No heartbeat from core client for 30 sec - exiting 23:24:55 (52674): No heartbeat from core client for 30 sec - exiting 23:24:56 (52674): No heartbeat from core client for 30 sec - exiting 23:24:57 (52674): No heartbeat from core client for 30 sec - exiting 23:39:47 (53876): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:15:24 (54140): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:15:30 (54140): No heartbeat from core client for 30 sec - exiting 05:15:31 (54140): No heartbeat from core client for 30 sec - exiting 05:15:32 (54140): No heartbeat from core client for 30 sec - exiting 05:15:33 (54140): No heartbeat from core client for 30 sec - exiting 05:15:34 (54140): No heartbeat from core client for 30 sec - exiting 05:15:35 (54140): No heartbeat from core client for 30 sec - exiting 08:35:57 (60376): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:26:02 (64002): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:06:05 (64931): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:31:08 (65653): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:46:09 (66143): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:46:14 (66143): No heartbeat from core client for 30 sec - exiting 10:46:15 (66143): No heartbeat from core client for 30 sec - exiting 13:36:28 (66432): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:36:33 (66432): No heartbeat from core client for 30 sec - exiting 13:36:34 (66432): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 14:41:36 (69526): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:31:50 (70743): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:06:53 (73910): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:06:57 (73910): No heartbeat from core client for 30 sec - exiting 18:31:59 (74560): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:32:01 (74560): No heartbeat from core client for 30 sec - exiting 18:32:02 (74560): No heartbeat from core client for 30 sec - exiting Atmos Hold Restart file rename failed on atmos_restart.hold 20:02:12 (75030): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:02:15 (75030): No heartbeat from core client for 30 sec - exiting 20:17:10 (76664): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:17:20 (76945): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:17:32 (76945): No heartbeat from core client for 30 sec - exiting 21:17:33 (76945): No heartbeat from core client for 30 sec - exiting 21:17:34 (76945): No heartbeat from core client for 30 sec - exiting 21:17:35 (76945): No heartbeat from core client for 30 sec - exiting 21:17:36 (76945): No heartbeat from core client for 30 sec - exiting 21:17:37 (76945): No heartbeat from core client for 30 sec - exiting 21:17:38 (76945): No heartbeat from core client for 30 sec - exiting 22:02:25 (78032): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:02:28 (78032): No heartbeat from core client for 30 sec - exiting 22:27:28 (78854): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:22:48 (79329): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:22:56 (79329): No heartbeat from core client for 30 sec - exiting 00:22:57 (79329): No heartbeat from core client for 30 sec - exiting 02:25:21 (81441): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Atmos Hold Restart file rename failed on atmos_restart.hold 02:28:06 (83745): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:28:07 (83745): No heartbeat from core client for 30 sec - exiting 02:28:08 (83745): No heartbeat from core client for 30 sec - exiting 02:28:09 (83745): No heartbeat from core client for 30 sec - exiting 02:28:10 (83745): No heartbeat from core client for 30 sec - exiting 02:28:11 (83745): No heartbeat from core client for 30 sec - exiting 02:28:12 (83745): No heartbeat from core client for 30 sec - exiting 02:28:13 (83745): No heartbeat from core client for 30 sec - exiting 02:28:14 (83745): No heartbeat from core client for 30 sec - exiting 02:28:15 (83745): No heartbeat from core client for 30 sec - exiting Atmos Hold Restart file rename failed on atmos_restart.hold 02:31:20 (83803): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:31:38 (83803): No heartbeat from core client for 30 sec - exiting Atmos Hold Restart file rename failed on atmos_restart.hold 03:03:28 (83861): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:43:52 (84431): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:24:22 (86374): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:29:23 (89260): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 08:39:31 (89355): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:54:40 (90638): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:00:19 (92003): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:00:22 (92003): No heartbeat from core client for 30 sec - exiting 11:00:23 (92003): No heartbeat from core client for 30 sec - exiting 11:00:24 (92003): No heartbeat from core client for 30 sec - exiting 11:00:25 (92003): No heartbeat from core client for 30 sec - exiting 11:00:26 (92003): No heartbeat from core client for 30 sec - exiting 11:00:27 (92003): No heartbeat from core client for 30 sec - exiting 11:00:28 (92003): No heartbeat from core client for 30 sec - exiting 11:00:29 (92003): No heartbeat from core client for 30 sec - exiting 11:00:30 (92003): No heartbeat from core client for 30 sec - exiting 12:55:18 (93201): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:00:30 (95360): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:05:26 (95465): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Atmos Hold Restart file rename failed on atmos_restart.hold 15:25:38 (95555): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:25:49 (95555): No heartbeat from core client for 30 sec - exiting 15:25:50 (95555): No heartbeat from core client for 30 sec - exiting 17:56:08 (98102): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:56:15 (98102): No heartbeat from core client for 30 sec - exiting 17:56:16 (98102): No heartbeat from core client for 30 sec - exiting 17:56:21 (98102): No heartbeat from core client for 30 sec - exiting 22:16:43 (938): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:06:54 (5636): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:06:58 (5636): No heartbeat from core client for 30 sec - exiting Atmos Hold Restart file rename failed on atmos_restart.hold 00:46:58 (7649): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:32:03 (8397): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:32:09 (8397): No heartbeat from core client for 30 sec - exiting 01:32:10 (8397): No heartbeat from core client for 30 sec - exiting Atmos Hold Restart file rename failed on atmos_restart.hold 01:42:05 (9212): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 02:20:58 (9404): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:34:05 (10132): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:34:06 (10132): No heartbeat from core client for 30 sec - exiting 02:34:07 (10132): No heartbeat from core client for 30 sec - exiting 02:34:08 (10132): No heartbeat from core client for 30 sec - exiting 02:34:09 (10132): No heartbeat from core client for 30 sec - exiting 02:34:10 (10132): No heartbeat from core client for 30 sec - exiting 02:34:11 (10132): No heartbeat from core client for 30 sec - exiting 02:34:12 (10132): No heartbeat from core client for 30 sec - exiting 02:42:12 (10391): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:42:22 (10391): No heartbeat from core client for 30 sec - exiting 02:42:23 (10391): No heartbeat from core client for 30 sec - exiting 02:42:24 (10391): No heartbeat from core client for 30 sec - exiting 02:42:25 (10391): No heartbeat from core client for 30 sec - exiting 02:42:26 (10391): No heartbeat from core client for 30 sec - exiting 02:42:27 (10391): No heartbeat from core client for 30 sec - exiting 02:42:29 (10391): No heartbeat from core client for 30 sec - exiting 02:42:30 (10391): No heartbeat from core client for 30 sec - exiting 03:27:17 (10549): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:37:35 (11434): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:37:42 (11434): No heartbeat from core client for 30 sec - exiting 04:37:43 (11434): No heartbeat from core client for 30 sec - exiting 04:37:44 (11434): No heartbeat from core client for 30 sec - exiting 04:37:45 (11434): No heartbeat from core client for 30 sec - exiting 04:37:46 (11434): No heartbeat from core client for 30 sec - exiting 08:23:04 (12713): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:31:08 (16767): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:31:16 (16767): No heartbeat from core client for 30 sec - exiting 09:08:09 (16911): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:08:12 (16911): No heartbeat from core client for 30 sec - exiting 09:28:10 (17577): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:28:14 (17577): No heartbeat from core client for 30 sec - exiting 09:28:15 (17577): No heartbeat from core client for 30 sec - exiting 09:28:16 (17577): No heartbeat from core client for 30 sec - exiting 09:28:17 (17577): No heartbeat from core client for 30 sec - exiting 09:28:18 (17577): No heartbeat from core client for 30 sec - exiting 09:28:19 (17577): No heartbeat from core client for 30 sec - exiting 09:28:20 (17577): No heartbeat from core client for 30 sec - exiting 09:28:21 (17577): No heartbeat from core client for 30 sec - exiting 09:48:20 (17950): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:48:29 (17950): No heartbeat from core client for 30 sec - exiting 09:48:30 (17950): No heartbeat from core client for 30 sec - exiting 09:48:31 (17950): No heartbeat from core client for 30 sec - exiting 09:48:32 (17950): No heartbeat from core client for 30 sec - exiting 09:48:33 (17950): No heartbeat from core client for 30 sec - exiting 09:48:34 (17950): No heartbeat from core client for 30 sec - exiting 09:48:35 (17950): No heartbeat from core client for 30 sec - exiting 09:48:36 (17950): No heartbeat from core client for 30 sec - exiting 09:48:37 (17950): No heartbeat from core client for 30 sec - exiting 09:48:38 (17950): No heartbeat from core client for 30 sec - exiting 09:48:39 (17950): No heartbeat from core client for 30 sec - exiting 11:08:45 (18326): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:08:49 (18326): No heartbeat from core client for 30 sec - exiting 11:08:50 (18326): No heartbeat from core client for 30 sec - exiting 11:08:52 (18326): No heartbeat from core client for 30 sec - exiting 11:08:53 (18326): No heartbeat from core client for 30 sec - exiting 11:08:54 (18326): No heartbeat from core client for 30 sec - exiting Atmos Hold Restart file rename failed on atmos_restart.hold 12:03:57 (19766): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:23:24 (20848): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... SIGABRT: abort called Crashed executable name: hadcm3n_um_6.07_i686-apple-darwin built using BOINC library version 6.13.0 Machine type Intel 80486 (32-bit executable) System version: Macintosh OS 10.7.5 build 11G63 Sun Jun 9 12:23:38 2013 Thread 0 Crashed: Thread 1: Thread 0 crashed with X86 Thread State (32-bit): eax: 0x00000000 ebx: 0x00000000 ecx: 0x00000000 edx: 0x00000000 edi: 0x00000000 esi: 0x00000000 ebp: 0xbfffccc8 esp: 0x00000000 ss: 0x00000000 efl: 0x00000000 eip: 0x00447dc2 cs: 0x00000000 ds: 0x00000000 es: 0x00000000 fs: 0x00000000 gs: 0x00000000 Binary Images Description: 0x1000 - 0x4cbfff /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_um_6.07_i686-apple-darwin 0x904b7000 - 0x904b7fff /usr/lib/system/libdnsinfo.dylib 0x907f2000 - 0x90800fff /usr/lib/libz.1.dylib 0x90d01000 - 0x90d09fff /usr/lib/system/libcopyfile.dylib 0x912b8000 - 0x912e7fff /usr/lib/system/libsystem_info.dylib 0x92cf3000 - 0x92cf7fff /usr/lib/system/libsystem_network.dylib 0x93ad5000 - 0x93ad7fff /usr/lib/system/libdyld.dylib 0x94ae6000 - 0x94afcfff /usr/lib/system/libxpc.dylib 0x95062000 - 0x950a5fff /usr/lib/system/libcommonCrypto.dylib 0x950a6000 - 0x950c4fff /usr/lib/system/libsystem_kernel.dylib 0x95261000 - 0x95265fff /usr/lib/system/libcache.dylib 0x9595d000 - 0x9595efff /usr/lib/system/libsystem_blocks.dylib 0x95ca6000 - 0x95caefff /usr/lib/system/libunwind.dylib 0x95caf000 - 0x95cb6fff /usr/lib/system/libsystem_notify.dylib 0x95cb7000 - 0x95cbcfff /usr/lib/system/libmacho.dylib 0x95cd7000 - 0x95cd8fff /usr/lib/system/libquarantine.dylib 0x95df9000 - 0x95e00fff /usr/lib/system/libsystem_dnssd.dylib 0x95e07000 - 0x95e0afff /usr/lib/system/libcompiler_rt.dylib 0x95fc2000 - 0x95fc3fff /usr/lib/system/libremovefile.dylib 0x96398000 - 0x963c6fff /usr/lib/libSystem.B.dylib 0x964a8000 - 0x96573fff /usr/lib/system/libsystem_c.dylib 0x96d18000 - 0x96d26fff /usr/lib/system/libdispatch.dylib 0x97237000 - 0x9723afff /usr/lib/system/libmathCommon.A.dylib 0x97262000 - 0x97262fff /usr/lib/system/libkeymgr.dylib 0x97296000 - 0x9729efff /usr/lib/system/liblaunch.dylib 0x972a0000 - 0x972a1fff /usr/lib/system/libunc.dylib 0x9bd0a000 - 0x9bd0bfff /usr/lib/system/libsystem_sandbox.dylib Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=21211, iMonCtr=1 Model crash detected, will try to restart... SIGABRT: abort called Crashed executable name: hadcm3n_um_6.07_i686-apple-darwin built using BOINC library version 6.13.0 Machine type Intel 80486 (32-bit executable) System version: Macintosh OS 10.7.5 build 11G63 Sun Jun 9 12:23:43 2013 Thread 0 Crashed: Thread 1: Thread 0 crashed with X86 Thread State (32-bit): eax: 0x00000000 ebx: 0x00000000 ecx: 0x00000000 edx: 0x00000000 edi: 0x00000000 esi: 0x00000000 ebp: 0xbfffccc8 esp: 0x00000000 ss: 0x00000000 efl: 0x00000000 eip: 0x00447dc2 cs: 0x00000000 ds: 0x00000000 es: 0x00000000 fs: 0x00000000 gs: 0x00000000 Binary Images Description: 0x1000 - 0x4cbfff /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_um_6.07_i686-apple-darwin 0x904b7000 - 0x904b7fff /usr/lib/system/libdnsinfo.dylib 0x907f2000 - 0x90800fff /usr/lib/libz.1.dylib 0x90d01000 - 0x90d09fff /usr/lib/system/libcopyfile.dylib 0x912b8000 - 0x912e7fff /usr/lib/system/libsystem_info.dylib 0x92cf3000 - 0x92cf7fff /usr/lib/system/libsystem_network.dylib 0x93ad5000 - 0x93ad7fff /usr/lib/system/libdyld.dylib 0x94ae6000 - 0x94afcfff /usr/lib/system/libxpc.dylib 0x95062000 - 0x950a5fff /usr/lib/system/libcommonCrypto.dylib 0x950a6000 - 0x950c4fff /usr/lib/system/libsystem_kernel.dylib 0x95261000 - 0x95265fff /usr/lib/system/libcache.dylib 0x9595d000 - 0x9595efff /usr/lib/system/libsystem_blocks.dylib 0x95ca6000 - 0x95caefff /usr/lib/system/libunwind.dylib 0x95caf000 - 0x95cb6fff /usr/lib/system/libsystem_notify.dylib 0x95cb7000 - 0x95cbcfff /usr/lib/system/libmacho.dylib 0x95cd7000 - 0x95cd8fff /usr/lib/system/libquarantine.dylib 0x95df9000 - 0x95e00fff /usr/lib/system/libsystem_dnssd.dylib 0x95e07000 - 0x95e0afff /usr/lib/system/libcompiler_rt.dylib 0x95fc2000 - 0x95fc3fff /usr/lib/system/libremovefile.dylib 0x96398000 - 0x963c6fff /usr/lib/libSystem.B.dylib 0x964a8000 - 0x96573fff /usr/lib/system/libsystem_c.dylib 0x96d18000 - 0x96d26fff /usr/lib/system/libdispatch.dylib 0x97237000 - 0x9723afff /usr/lib/system/libmathCommon.A.dylib 0x97262000 - 0x97262fff /usr/lib/system/libkeymgr.dylib 0x97296000 - 0x9729efff /usr/lib/system/liblaunch.dylib 0x972a0000 - 0x972a1fff /usr/lib/system/libunc.dylib 0x9bd0a000 - 0x9bd0bfff /usr/lib/system/libsystem_sandbox.dylib Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=21211, iMonCtr=1 Model crash detected, will try to restart... SIGABRT: abort called Crashed executable name: hadcm3n_um_6.07_i686-apple-darwin built using BOINC library version 6.13.0 Machine type Intel 80486 (32-bit executable) System version: Macintosh OS 10.7.5 build 11G63 Sun Jun 9 12:23:46 2013 Thread 0 Crashed: Thread 1: Thread 0 crashed with X86 Thread State (32-bit): eax: 0x00000000 ebx: 0x00000000 ecx: 0x00000000 edx: 0x00000000 edi: 0x00000000 esi: 0x00000000 ebp: 0xbfffccc8 esp: 0x00000000 ss: 0x00000000 efl: 0x00000000 eip: 0x00447dc2 cs: 0x00000000 ds: 0x00000000 es: 0x00000000 fs: 0x00000000 gs: 0x00000000 Binary Images Description: 0x1000 - 0x4cbfff /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_um_6.07_i686-apple-darwin 0x904b7000 - 0x904b7fff /usr/lib/system/libdnsinfo.dylib 0x907f2000 - 0x90800fff /usr/lib/libz.1.dylib 0x90d01000 - 0x90d09fff /usr/lib/system/libcopyfile.dylib 0x912b8000 - 0x912e7fff /usr/lib/system/libsystem_info.dylib 0x92cf3000 - 0x92cf7fff /usr/lib/system/libsystem_network.dylib 0x93ad5000 - 0x93ad7fff /usr/lib/system/libdyld.dylib 0x94ae6000 - 0x94afcfff /usr/lib/system/libxpc.dylib 0x95062000 - 0x950a5fff /usr/lib/system/libcommonCrypto.dylib 0x950a6000 - 0x950c4fff /usr/lib/system/libsystem_kernel.dylib 0x95261000 - 0x95265fff /usr/lib/system/libcache.dylib 0x9595d000 - 0x9595efff /usr/lib/system/libsystem_blocks.dylib 0x95ca6000 - 0x95caefff /usr/lib/system/libunwind.dylib 0x95caf000 - 0x95cb6fff /usr/lib/system/libsystem_notify.dylib 0x95cb7000 - 0x95cbcfff /usr/lib/system/libmacho.dylib 0x95cd7000 - 0x95cd8fff /usr/lib/system/libquarantine.dylib 0x95df9000 - 0x95e00fff /usr/lib/system/libsystem_dnssd.dylib 0x95e07000 - 0x95e0afff /usr/lib/system/libcompiler_rt.dylib 0x95fc2000 - 0x95fc3fff /usr/lib/system/libremovefile.dylib 0x96398000 - 0x963c6fff /usr/lib/libSystem.B.dylib 0x964a8000 - 0x96573fff /usr/lib/system/libsystem_c.dylib 0x96d18000 - 0x96d26fff /usr/lib/system/libdispatch.dylib 0x97237000 - 0x9723afff /usr/lib/system/libmathCommon.A.dylib 0x97262000 - 0x97262fff /usr/lib/system/libkeymgr.dylib 0x97296000 - 0x9729efff /usr/lib/system/liblaunch.dylib 0x972a0000 - 0x972a1fff /usr/lib/system/libunc.dylib 0x9bd0a000 - 0x9bd0bfff /usr/lib/system/libsystem_sandbox.dylib Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=21211, iMonCtr=1 Model crash detected, will try to restart... SIGABRT: abort called Crashed executable name: hadcm3n_um_6.07_i686-apple-darwin built using BOINC library version 6.13.0 Machine type Intel 80486 (32-bit executable) System version: Macintosh OS 10.7.5 build 11G63 Sun Jun 9 12:23:48 2013 Thread 0 Crashed: Thread 1: Thread 0 crashed with X86 Thread State (32-bit): eax: 0x00000000 ebx: 0x00000000 ecx: 0x00000000 edx: 0x00000000 edi: 0x00000000 esi: 0x00000000 ebp: 0xbfffccc8 esp: 0x00000000 ss: 0x00000000 efl: 0x00000000 eip: 0x00447dc2 cs: 0x00000000 ds: 0x00000000 es: 0x00000000 fs: 0x00000000 gs: 0x00000000 Binary Images Description: 0x1000 - 0x4cbfff /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_um_6.07_i686-apple-darwin 0x904b7000 - 0x904b7fff /usr/lib/system/libdnsinfo.dylib 0x907f2000 - 0x90800fff /usr/lib/libz.1.dylib 0x90d01000 - 0x90d09fff /usr/lib/system/libcopyfile.dylib 0x912b8000 - 0x912e7fff /usr/lib/system/libsystem_info.dylib 0x92cf3000 - 0x92cf7fff /usr/lib/system/libsystem_network.dylib 0x93ad5000 - 0x93ad7fff /usr/lib/system/libdyld.dylib 0x94ae6000 - 0x94afcfff /usr/lib/system/libxpc.dylib 0x95062000 - 0x950a5fff /usr/lib/system/libcommonCrypto.dylib 0x950a6000 - 0x950c4fff /usr/lib/system/libsystem_kernel.dylib 0x95261000 - 0x95265fff /usr/lib/system/libcache.dylib 0x9595d000 - 0x9595efff /usr/lib/system/libsystem_blocks.dylib 0x95ca6000 - 0x95caefff /usr/lib/system/libunwind.dylib 0x95caf000 - 0x95cb6fff /usr/lib/system/libsystem_notify.dylib 0x95cb7000 - 0x95cbcfff /usr/lib/system/libmacho.dylib 0x95cd7000 - 0x95cd8fff /usr/lib/system/libquarantine.dylib 0x95df9000 - 0x95e00fff /usr/lib/system/libsystem_dnssd.dylib 0x95e07000 - 0x95e0afff /usr/lib/system/libcompiler_rt.dylib 0x95fc2000 - 0x95fc3fff /usr/lib/system/libremovefile.dylib 0x96398000 - 0x963c6fff /usr/lib/libSystem.B.dylib 0x964a8000 - 0x96573fff /usr/lib/system/libsystem_c.dylib 0x96d18000 - 0x96d26fff /usr/lib/system/libdispatch.dylib 0x97237000 - 0x9723afff /usr/lib/system/libmathCommon.A.dylib 0x97262000 - 0x97262fff /usr/lib/system/libkeymgr.dylib 0x97296000 - 0x9729efff /usr/lib/system/liblaunch.dylib 0x972a0000 - 0x972a1fff /usr/lib/system/libunc.dylib 0x9bd0a000 - 0x9bd0bfff /usr/lib/system/libsystem_sandbox.dylib Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=21211, iMonCtr=1 Model crash detected, will try to restart... SIGABRT: abort called Crashed executable name: hadcm3n_um_6.07_i686-apple-darwin built using BOINC library version 6.13.0 Machine type Intel 80486 (32-bit executable) System version: Macintosh OS 10.7.5 build 11G63 Sun Jun 9 12:23:51 2013 Thread 0 Crashed: Thread 1: Thread 0 crashed with X86 Thread State (32-bit): eax: 0x00000000 ebx: 0x00000000 ecx: 0x00000000 edx: 0x00000000 edi: 0x00000000 esi: 0x00000000 ebp: 0xbfffccc8 esp: 0x00000000 ss: 0x00000000 efl: 0x00000000 eip: 0x00447dc2 cs: 0x00000000 ds: 0x00000000 es: 0x00000000 fs: 0x00000000 gs: 0x00000000 Binary Images Description: 0x1000 - 0x4cbfff /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_um_6.07_i686-apple-darwin 0x904b7000 - 0x904b7fff /usr/lib/system/libdnsinfo.dylib 0x907f2000 - 0x90800fff /usr/lib/libz.1.dylib 0x90d01000 - 0x90d09fff /usr/lib/system/libcopyfile.dylib 0x912b8000 - 0x912e7fff /usr/lib/system/libsystem_info.dylib 0x92cf3000 - 0x92cf7fff /usr/lib/system/libsystem_network.dylib 0x93ad5000 - 0x93ad7fff /usr/lib/system/libdyld.dylib 0x94ae6000 - 0x94afcfff /usr/lib/system/libxpc.dylib 0x95062000 - 0x950a5fff /usr/lib/system/libcommonCrypto.dylib 0x950a6000 - 0x950c4fff /usr/lib/system/libsystem_kernel.dylib 0x95261000 - 0x95265fff /usr/lib/system/libcache.dylib 0x9595d000 - 0x9595efff /usr/lib/system/libsystem_blocks.dylib 0x95ca6000 - 0x95caefff /usr/lib/system/libunwind.dylib 0x95caf000 - 0x95cb6fff /usr/lib/system/libsystem_notify.dylib 0x95cb7000 - 0x95cbcfff /usr/lib/system/libmacho.dylib 0x95cd7000 - 0x95cd8fff /usr/lib/system/libquarantine.dylib 0x95df9000 - 0x95e00fff /usr/lib/system/libsystem_dnssd.dylib 0x95e07000 - 0x95e0afff /usr/lib/system/libcompiler_rt.dylib 0x95fc2000 - 0x95fc3fff /usr/lib/system/libremovefile.dylib 0x96398000 - 0x963c6fff /usr/lib/libSystem.B.dylib 0x964a8000 - 0x96573fff /usr/lib/system/libsystem_c.dylib 0x96d18000 - 0x96d26fff /usr/lib/system/libdispatch.dylib 0x97237000 - 0x9723afff /usr/lib/system/libmathCommon.A.dylib 0x97262000 - 0x97262fff /usr/lib/system/libkeymgr.dylib 0x97296000 - 0x9729efff /usr/lib/system/liblaunch.dylib 0x972a0000 - 0x972a1fff /usr/lib/system/libunc.dylib 0x9bd0a000 - 0x9bd0bfff /usr/lib/system/libsystem_sandbox.dylib Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=21211, iMonCtr=1 Model crash detected, will try to restart... SIGABRT: abort called Crashed executable name: hadcm3n_um_6.07_i686-apple-darwin built using BOINC library version 6.13.0 Machine type Intel 80486 (32-bit executable) System version: Macintosh OS 10.7.5 build 11G63 Sun Jun 9 12:23:53 2013 Thread 0 Crashed: Thread 1: Thread 0 crashed with X86 Thread State (32-bit): eax: 0x00000000 ebx: 0x00000000 ecx: 0x00000000 edx: 0x00000000 edi: 0x00000000 esi: 0x00000000 ebp: 0xbfffccc8 esp: 0x00000000 ss: 0x00000000 efl: 0x00000000 eip: 0x00447dc2 cs: 0x00000000 ds: 0x00000000 es: 0x00000000 fs: 0x00000000 gs: 0x00000000 Binary Images Description: 0x1000 - 0x4cbfff /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_um_6.07_i686-apple-darwin 0x904b7000 - 0x904b7fff /usr/lib/system/libdnsinfo.dylib 0x907f2000 - 0x90800fff /usr/lib/libz.1.dylib 0x90d01000 - 0x90d09fff /usr/lib/system/libcopyfile.dylib 0x912b8000 - 0x912e7fff /usr/lib/system/libsystem_info.dylib 0x92cf3000 - 0x92cf7fff /usr/lib/system/libsystem_network.dylib 0x93ad5000 - 0x93ad7fff /usr/lib/system/libdyld.dylib 0x94ae6000 - 0x94afcfff /usr/lib/system/libxpc.dylib 0x95062000 - 0x950a5fff /usr/lib/system/libcommonCrypto.dylib 0x950a6000 - 0x950c4fff /usr/lib/system/libsystem_kernel.dylib 0x95261000 - 0x95265fff /usr/lib/system/libcache.dylib 0x9595d000 - 0x9595efff /usr/lib/system/libsystem_blocks.dylib 0x95ca6000 - 0x95caefff /usr/lib/system/libunwind.dylib 0x95caf000 - 0x95cb6fff /usr/lib/system/libsystem_notify.dylib 0x95cb7000 - 0x95cbcfff /usr/lib/system/libmacho.dylib 0x95cd7000 - 0x95cd8fff /usr/lib/system/libquarantine.dylib 0x95df9000 - 0x95e00fff /usr/lib/system/libsystem_dnssd.dylib 0x95e07000 - 0x95e0afff /usr/lib/system/libcompiler_rt.dylib 0x95fc2000 - 0x95fc3fff /usr/lib/system/libremovefile.dylib 0x96398000 - 0x963c6fff /usr/lib/libSystem.B.dylib 0x964a8000 - 0x96573fff /usr/lib/system/libsystem_c.dylib 0x96d18000 - 0x96d26fff /usr/lib/system/libdispatch.dylib 0x97237000 - 0x9723afff /usr/lib/system/libmathCommon.A.dylib 0x97262000 - 0x97262fff /usr/lib/system/libkeymgr.dylib 0x97296000 - 0x9729efff /usr/lib/system/liblaunch.dylib 0x972a0000 - 0x972a1fff /usr/lib/system/libunc.dylib 0x9bd0a000 - 0x9bd0bfff /usr/lib/system/libsystem_sandbox.dylib Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=21211, iMonCtr=1 Model crash detected, will try to restart... Sorry, too many model crashes! :-( Called boinc_finish </stderr_txt> ]]> |
Latest Trickles Received | ||||||
---|---|---|---|---|---|---|
Time Sent (UTC) | Host ID | Result ID | Result Name | Timestep | CPU Time (sec) | Average (sec/TS) |
09 Jun 2013 04:28:02 | 1243235 | 15518979 | hadcm3n_39o3_1940_40_008265469_1 | 466,560 | 639,337 | 1.3703 |
08 Jun 2013 08:48:41 | 1243235 | 15518979 | hadcm3n_39o3_1940_40_008265469_1 | 440,640 | 613,464 | 1.3922 |
07 Jun 2013 13:37:33 | 1243235 | 15518979 | hadcm3n_39o3_1940_40_008265469_1 | 414,720 | 587,764 | 1.4173 |
03 Jun 2013 11:20:39 | 1243235 | 15518979 | hadcm3n_39o3_1940_40_008265469_1 | 388,800 | 562,107 | 1.4457 |
02 Jun 2013 20:37:40 | 1243235 | 15518979 | hadcm3n_39o3_1940_40_008265469_1 | 362,880 | 537,054 | 1.4800 |
02 Jun 2013 07:33:19 | 1243235 | 15518979 | hadcm3n_39o3_1940_40_008265469_1 | 336,960 | 508,992 | 1.5105 |
30 May 2013 15:28:17 | 1243235 | 15518979 | hadcm3n_39o3_1940_40_008265469_1 | 311,040 | 475,839 | 1.5298 |
29 May 2013 13:24:31 | 1243235 | 15518979 | hadcm3n_39o3_1940_40_008265469_1 | 285,120 | 443,145 | 1.5542 |
16 Apr 2013 18:59:16 | 1243235 | 15518979 | hadcm3n_39o3_1940_40_008265469_1 | 259,200 | 409,209 | 1.5787 |
08 Apr 2013 06:06:06 | 1243235 | 15518979 | hadcm3n_39o3_1940_40_008265469_1 | 233,280 | 372,949 | 1.5987 |
07 Apr 2013 05:41:53 | 1243235 | 15518979 | hadcm3n_39o3_1940_40_008265469_1 | 207,360 | 331,723 | 1.5997 |
04 Apr 2013 02:33:19 | 1243235 | 15518979 | hadcm3n_39o3_1940_40_008265469_1 | 181,440 | 285,980 | 1.5762 |
01 Apr 2013 08:04:13 | 1243235 | 15518979 | hadcm3n_39o3_1940_40_008265469_1 | 155,520 | 232,728 | 1.4965 |
29 Mar 2013 14:55:33 | 1243235 | 15518979 | hadcm3n_39o3_1940_40_008265469_1 | 129,600 | 179,498 | 1.3850 |
22 Mar 2013 23:58:55 | 1243235 | 15518979 | hadcm3n_39o3_1940_40_008265469_1 | 103,680 | 141,540 | 1.3652 |
22 Mar 2013 16:55:51 | 1243235 | 15518979 | hadcm3n_39o3_1940_40_008265469_1 | 77,760 | 113,700 | 1.4622 |
22 Mar 2013 16:55:51 | 1243235 | 15518979 | hadcm3n_39o3_1940_40_008265469_1 | 51,840 | 86,381 | 1.6663 |
03 Jan 2013 11:06:27 | 1243235 | 15518979 | hadcm3n_39o3_1940_40_008265469_1 | 25,920 | 46,702 | 1.8018 |
©2024 cpdn.org