climateprediction.net home page
Task 15487587

Task 15487587

Name hadcm3n_3kg1_1940_40_008259810_0
Workunit 8414934
Created 20 Dec 2012, 15:56:24 UTC
Sent 20 Dec 2012, 15:57:34 UTC
Report deadline 21 Mar 2013, 23:24:45 UTC
Received 4 Feb 2013, 12:31:36 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 22 (0x00000016) Unknown error code
Computer ID 1148818
Run time 32 days 3 hours 18 min 44 sec
CPU time 23 days 16 hours 17 min 37 sec
Validate state Invalid
Credit 10,575.36
Device peak FLOPS 2.28 GFLOPS
Application version UK Met Office Coupled Model Full Resolution Ocean v6.07
i686-pc-linux-gnu
Stderr
<core_client_version>6.10.17</core_client_version>
<![CDATA[
<message>
process exited with code 22 (0x16, -234)
</message>
<stderr_txt>
2:09 (28831): No heartbeat from core client for 30 sec - exiting
22:22:10 (28831): No heartbeat from core client for 30 sec - exiting
22:22:11 (28831): No heartbeat from core client for 30 sec - exiting
22:22:12 (28831): No heartbeat from core client for 30 sec - exiting
22:22:13 (28831): No heartbeat from core client for 30 sec - exiting
22:22:14 (28831): No heartbeat from core client for 30 sec - exiting
22:22:15 (28831): No heartbeat from core client for 30 sec - exiting
22:22:16 (28831): No heartbeat from core client for 30 sec - exiting
22:22:17 (28831): No heartbeat from core client for 30 sec - exiting
22:22:18 (28831): No heartbeat from core client for 30 sec - exiting
22:22:19 (28831): No heartbeat from core client for 30 sec - exiting
22:22:20 (28831): No heartbeat from core client for 30 sec - exiting
22:22:21 (28831): No heartbeat from core client for 30 sec - exiting
22:22:22 (28831): No heartbeat from core client for 30 sec - exiting
22:22:23 (28831): No heartbeat from core client for 30 sec - exiting
22:22:24 (28831): No heartbeat from core client for 30 sec - exiting
22:22:25 (28831): No heartbeat from core client for 30 sec - exiting
22:22:26 (28831): No heartbeat from core client for 30 sec - exiting
22:22:27 (28831): No heartbeat from core client for 30 sec - exiting
22:22:28 (28831): No heartbeat from core client for 30 sec - exiting
22:22:29 (28831): No heartbeat from core client for 30 sec - exiting
22:22:30 (28831): No heartbeat from core client for 30 sec - exiting
22:22:31 (28831): No heartbeat from core client for 30 sec - exiting
22:22:32 (28831): No heartbeat from core client for 30 sec - exiting
22:22:33 (28831): No heartbeat from core client for 30 sec - exiting
22:22:34 (28831): No heartbeat from core client for 30 sec - exiting
22:22:35 (28831): No heartbeat from core client for 30 sec - exiting
22:22:36 (28831): No heartbeat from core client for 30 sec - exiting
22:22:37 (28831): No heartbeat from core client for 30 sec - exiting
22:22:38 (28831): No heartbeat from core client for 30 sec - exiting
22:22:39 (28831): No heartbeat from core client for 30 sec - exiting
22:22:40 (28831): No heartbeat from core client for 30 sec - exiting
22:22:41 (28831): No heartbeat from core client for 30 sec - exiting
22:22:42 (28831): No heartbeat from core client for 30 sec - exiting
22:22:43 (28831): No heartbeat from core client for 30 sec - exiting
22:22:44 (28831): No heartbeat from core client for 30 sec - exiting
22:22:45 (28831): No heartbeat from core client for 30 sec - exiting
22:22:46 (28831): No heartbeat from core client for 30 sec - exiting
22:22:47 (28831): No heartbeat from core client for 30 sec - exiting
22:22:48 (28831): No heartbeat from core client for 30 sec - exiting
22:22:49 (28831): No heartbeat from core client for 30 sec - exiting
22:22:50 (28831): No heartbeat from core client for 30 sec - exiting
22:22:51 (28831): No heartbeat from core client for 30 sec - exiting
22:22:52 (28831): No heartbeat from core client for 30 sec - exiting
22:22:53 (28831): No heartbeat from core client for 30 sec - exiting
22:22:54 (28831): No heartbeat from core client for 30 sec - exiting
22:22:55 (28831): No heartbeat from core client for 30 sec - exiting
22:22:56 (28831): No heartbeat from core client for 30 sec - exiting
22:22:57 (28831): No heartbeat from core client for 30 sec - exiting
22:22:58 (28831): No heartbeat from core client for 30 sec - exiting
22:22:59 (28831): No heartbeat from core client for 30 sec - exiting
22:23:00 (28831): No heartbeat from core client for 30 sec - exiting
22:23:01 (28831): No heartbeat from core client for 30 sec - exiting
22:23:02 (28831): No heartbeat from core client for 30 sec - exiting
22:23:03 (28831): No heartbeat from core client for 30 sec - exiting
22:23:04 (28831): No heartbeat from core client for 30 sec - exiting
22:23:05 (28831): No heartbeat from core client for 30 sec - exiting
22:23:06 (28831): No heartbeat from core client for 30 sec - exiting
22:23:07 (28831): No heartbeat from core client for 30 sec - exiting
22:23:08 (28831): No heartbeat from core client for 30 sec - exiting
22:23:09 (28831): No heartbeat from core client for 30 sec - exiting
22:23:10 (28831): No heartbeat from core client for 30 sec - exiting
22:23:11 (28831): No heartbeat from core client for 30 sec - exiting
22:23:12 (28831): No heartbeat from core client for 30 sec - exiting
22:23:13 (28831): No heartbeat from core client for 30 sec - exiting
22:23:14 (28831): No heartbeat from core client for 30 sec - exiting
22:23:15 (28831): No heartbeat from core client for 30 sec - exiting
22:23:16 (28831): No heartbeat from core client for 30 sec - exiting
22:23:18 (28831): No heartbeat from core client for 30 sec - exiting
22:23:19 (28831): No heartbeat from core client for 30 sec - exiting
22:23:20 (28831): No heartbeat from core client for 30 sec - exiting
22:23:21 (28831): No heartbeat from core client for 30 sec - exiting
22:23:22 (28831): No heartbeat from core client for 30 sec - exiting
22:23:23 (28831): No heartbeat from core client for 30 sec - exiting
22:23:24 (28831): No heartbeat from core client for 30 sec - exiting
22:23:25 (28831): No heartbeat from core client for 30 sec - exiting
22:23:26 (28831): No heartbeat from core client for 30 sec - exiting
22:23:27 (28831): No heartbeat from core client for 30 sec - exiting
22:23:28 (28831): No heartbeat from core client for 30 sec - exiting
22:23:29 (28831): No heartbeat from core client for 30 sec - exiting
22:23:30 (28831): No heartbeat from core client for 30 sec - exiting
22:23:31 (28831): No heartbeat from core client for 30 sec - exiting
22:23:32 (28831): No heartbeat from core client for 30 sec - exiting
22:23:33 (28831): No heartbeat from core client for 30 sec - exiting
22:23:34 (28831): No heartbeat from core client for 30 sec - exiting
22:23:35 (28831): No heartbeat from core client for 30 sec - exiting
22:23:36 (28831): No heartbeat from core client for 30 sec - exiting
22:23:37 (28831): No heartbeat from core client for 30 sec - exiting
22:23:38 (28831): No heartbeat from core client for 30 sec - exiting
22:23:39 (28831): No heartbeat from core client for 30 sec - exiting
22:23:40 (28831): No heartbeat from core client for 30 sec - exiting
22:23:41 (28831): No heartbeat from core client for 30 sec - exiting
22:23:42 (28831): No heartbeat from core client for 30 sec - exiting
22:23:43 (28831): No heartbeat from core client for 30 sec - exiting
22:23:44 (28831): No heartbeat from core client for 30 sec - exiting
22:23:45 (28831): No heartbeat from core client for 30 sec - exiting
22:23:46 (28831): No heartbeat from core client for 30 sec - exiting
22:23:47 (28831): No heartbeat from core client for 30 sec - exiting
22:23:48 (28831): No heartbeat from core client for 30 sec - exiting
22:23:49 (28831): No heartbeat from core client for 30 sec - exiting
22:23:50 (28831): No heartbeat from core client for 30 sec - exiting
22:23:51 (28831): No heartbeat from core client for 30 sec - exiting
22:23:52 (28831): No heartbeat from core client for 30 sec - exiting
22:23:54 (28831): No heartbeat from core client for 30 sec - exiting
22:23:55 (28831): No heartbeat from core client for 30 sec - exiting
22:23:56 (28831): No heartbeat from core client for 30 sec - exiting
22:23:57 (28831): No heartbeat from core client for 30 sec - exiting
22:23:58 (28831): No heartbeat from core client for 30 sec - exiting
22:23:59 (28831): No heartbeat from core client for 30 sec - exiting
22:24:00 (28831): No heartbeat from core client for 30 sec - exiting
22:24:01 (28831): No heartbeat from core client for 30 sec - exiting
22:24:02 (28831): No heartbeat from core client for 30 sec - exiting
22:24:03 (28831): No heartbeat from core client for 30 sec - exiting
22:24:04 (28831): No heartbeat from core client for 30 sec - exiting
22:24:05 (28831): No heartbeat from core client for 30 sec - exiting
22:24:06 (28831): No heartbeat from core client for 30 sec - exiting
22:24:07 (28831): No heartbeat from core client for 30 sec - exiting
22:24:08 (28831): No heartbeat from core client for 30 sec - exiting
22:24:09 (28831): No heartbeat from core client for 30 sec - exiting
22:24:10 (28831): No heartbeat from core client for 30 sec - exiting
22:24:11 (28831): No heartbeat from core client for 30 sec - exiting
22:24:12 (28831): No heartbeat from core client for 30 sec - exiting
22:24:13 (28831): No heartbeat from core client for 30 sec - exiting
22:24:14 (28831): No heartbeat from core client for 30 sec - exiting
22:24:15 (28831): No heartbeat from core client for 30 sec - exiting
22:24:16 (28831): No heartbeat from core client for 30 sec - exiting
22:24:17 (28831): No heartbeat from core client for 30 sec - exiting
22:24:18 (28831): No heartbeat from core client for 30 sec - exiting
22:24:19 (28831): No heartbeat from core client for 30 sec - exiting
22:24:20 (28831): No heartbeat from core client for 30 sec - exiting
22:24:21 (28831): No heartbeat from core client for 30 sec - exiting
22:24:22 (28831): No heartbeat from core client for 30 sec - exiting
22:24:23 (28831): No heartbeat from core client for 30 sec - exiting
22:24:24 (28831): No heartbeat from core client for 30 sec - exiting
22:24:25 (28831): No heartbeat from core client for 30 sec - exiting
22:24:26 (28831): No heartbeat from core client for 30 sec - exiting
22:24:27 (28831): No heartbeat from core client for 30 sec - exiting
22:24:28 (28831): No heartbeat from core client for 30 sec - exiting
22:24:29 (28831): No heartbeat from core client for 30 sec - exiting
22:24:30 (28831): No heartbeat from core client for 30 sec - exiting
22:24:31 (28831): No heartbeat from core client for 30 sec - exiting
22:24:32 (28831): No heartbeat from core client for 30 sec - exiting
22:24:33 (28831): No heartbeat from core client for 30 sec - exiting
22:24:34 (28831): No heartbeat from core client for 30 sec - exiting
22:24:35 (28831): No heartbeat from core client for 30 sec - exiting
22:24:36 (28831): No heartbeat from core client for 30 sec - exiting
22:24:37 (28831): No heartbeat from core client for 30 sec - exiting
22:24:38 (28831): No heartbeat from core client for 30 sec - exiting
22:24:39 (28831): No heartbeat from core client for 30 sec - exiting
22:24:40 (28831): No heartbeat from core client for 30 sec - exiting
22:24:41 (28831): No heartbeat from core client for 30 sec - exiting
22:24:42 (28831): No heartbeat from core client for 30 sec - exiting
22:24:43 (28831): No heartbeat from core client for 30 sec - exiting
22:24:44 (28831): No heartbeat from core client for 30 sec - exiting
22:24:45 (28831): No heartbeat from core client for 30 sec - exiting
22:24:46 (28831): No heartbeat from core client for 30 sec - exiting
22:24:47 (28831): No heartbeat from core client for 30 sec - exiting
22:24:48 (28831): No heartbeat from core client for 30 sec - exiting
22:24:49 (28831): No heartbeat from core client for 30 sec - exiting
22:24:50 (28831): No heartbeat from core client for 30 sec - exiting
22:24:51 (28831): No heartbeat from core client for 30 sec - exiting
22:24:52 (28831): No heartbeat from core client for 30 sec - exiting
22:24:53 (28831): No heartbeat from core client for 30 sec - exiting
22:24:54 (28831): No heartbeat from core client for 30 sec - exiting
22:24:55 (28831): No heartbeat from core client for 30 sec - exiting
22:24:56 (28831): No heartbeat from core client for 30 sec - exiting
22:24:57 (28831): No heartbeat from core client for 30 sec - exiting
22:24:58 (28831): No heartbeat from core client for 30 sec - exiting
22:24:59 (28831): No heartbeat from core client for 30 sec - exiting
22:25:00 (28831): No heartbeat from core client for 30 sec - exiting
22:25:01 (28831): No heartbeat from core client for 30 sec - exiting
22:25:02 (28831): No heartbeat from core client for 30 sec - exiting
22:25:03 (28831): No heartbeat from core client for 30 sec - exiting
22:25:04 (28831): No heartbeat from core client for 30 sec - exiting
22:25:05 (28831): No heartbeat from core client for 30 sec - exiting
22:25:06 (28831): No heartbeat from core client for 30 sec - exiting
22:25:07 (28831): No heartbeat from core client for 30 sec - exiting
22:25:08 (28831): No heartbeat from core client for 30 sec - exiting
22:25:09 (28831): No heartbeat from core client for 30 sec - exiting
22:25:10 (28831): No heartbeat from core client for 30 sec - exiting
22:25:11 (28831): No heartbeat from core client for 30 sec - exiting
22:25:12 (28831): No heartbeat from core client for 30 sec - exiting
22:25:13 (28831): No heartbeat from core client for 30 sec - exiting
22:25:14 (28831): No heartbeat from core client for 30 sec - exiting
22:25:15 (28831): No heartbeat from core client for 30 sec - exiting
22:25:16 (28831): No heartbeat from core client for 30 sec - exiting
22:25:17 (28831): No heartbeat from core client for 30 sec - exiting
22:25:18 (28831): No heartbeat from core client for 30 sec - exiting
22:25:19 (28831): No heartbeat from core client for 30 sec - exiting
22:25:20 (28831): No heartbeat from core client for 30 sec - exiting
22:25:21 (28831): No heartbeat from core client for 30 sec - exiting
22:25:22 (28831): No heartbeat from core client for 30 sec - exiting
22:25:23 (28831): No heartbeat from core client for 30 sec - exiting
22:25:24 (28831): No heartbeat from core client for 30 sec - exiting
22:25:25 (28831): No heartbeat from core client for 30 sec - exiting
22:25:26 (28831): No heartbeat from core client for 30 sec - exiting
22:25:27 (28831): No heartbeat from core client for 30 sec - exiting
22:25:28 (28831): No heartbeat from core client for 30 sec - exiting
22:25:29 (28831): No heartbeat from core client for 30 sec - exiting
22:25:30 (28831): No heartbeat from core client for 30 sec - exiting
22:25:31 (28831): No heartbeat from core client for 30 sec - exiting
22:25:32 (28831): No heartbeat from core client for 30 sec - exiting
22:25:33 (28831): No heartbeat from core client for 30 sec - exiting
22:25:34 (28831): No heartbeat from core client for 30 sec - exiting
22:25:35 (28831): No heartbeat from core client for 30 sec - exiting
22:25:36 (28831): No heartbeat from core client for 30 sec - exiting
22:25:37 (28831): No heartbeat from core client for 30 sec - exiting
22:25:38 (28831): No heartbeat from core client for 30 sec - exiting
22:25:39 (28831): No heartbeat from core client for 30 sec - exiting
22:25:40 (28831): No heartbeat from core client for 30 sec - exiting
22:25:41 (28831): No heartbeat from core client for 30 sec - exiting
22:25:42 (28831): No heartbeat from core client for 30 sec - exiting
22:25:43 (28831): No heartbeat from core client for 30 sec - exiting
22:25:45 (28831): No heartbeat from core client for 30 sec - exiting
22:25:46 (28831): No heartbeat from core client for 30 sec - exiting
22:25:47 (28831): No heartbeat from core client for 30 sec - exiting
22:25:48 (28831): No heartbeat from core client for 30 sec - exiting
22:25:49 (28831): No heartbeat from core client for 30 sec - exiting
22:25:50 (28831): No heartbeat from core client for 30 sec - exiting
22:25:51 (28831): No heartbeat from core client for 30 sec - exiting
22:25:52 (28831): No heartbeat from core client for 30 sec - exiting
22:25:53 (28831): No heartbeat from core client for 30 sec - exiting
22:25:54 (28831): No heartbeat from core client for 30 sec - exiting
22:25:55 (28831): No heartbeat from core client for 30 sec - exiting
22:25:56 (28831): No heartbeat from core client for 30 sec - exiting
22:25:57 (28831): No heartbeat from core client for 30 sec - exiting
22:25:58 (28831): No heartbeat from core client for 30 sec - exiting
22:25:59 (28831): No heartbeat from core client for 30 sec - exiting
22:26:00 (28831): No heartbeat from core client for 30 sec - exiting
22:26:01 (28831): No heartbeat from core client for 30 sec - exiting
22:26:02 (28831): No heartbeat from core client for 30 sec - exiting
22:26:03 (28831): No heartbeat from core client for 30 sec - exiting
22:26:04 (28831): No heartbeat from core client for 30 sec - exiting
22:26:05 (28831): No heartbeat from core client for 30 sec - exiting
22:26:06 (28831): No heartbeat from core client for 30 sec - exiting
22:26:07 (28831): No heartbeat from core client for 30 sec - exiting
22:26:08 (28831): No heartbeat from core client for 30 sec - exiting
22:26:09 (28831): No heartbeat from core client for 30 sec - exiting
22:26:10 (28831): No heartbeat from core client for 30 sec - exiting
22:26:11 (28831): No heartbeat from core client for 30 sec - exiting
22:26:12 (28831): No heartbeat from core client for 30 sec - exiting
22:26:13 (28831): No heartbeat from core client for 30 sec - exiting
22:26:14 (28831): No heartbeat from core client for 30 sec - exiting
22:26:15 (28831): No heartbeat from core client for 30 sec - exiting
22:26:16 (28831): No heartbeat from core client for 30 sec - exiting
22:26:17 (28831): No heartbeat from core client for 30 sec - exiting
22:26:18 (28831): No heartbeat from core client for 30 sec - exiting
22:26:19 (28831): No heartbeat from core client for 30 sec - exiting
22:26:20 (28831): No heartbeat from core client for 30 sec - exiting
22:26:21 (28831): No heartbeat from core client for 30 sec - exiting
22:26:22 (28831): No heartbeat from core client for 30 sec - exiting
22:26:23 (28831): No heartbeat from core client for 30 sec - exiting
22:26:24 (28831): No heartbeat from core client for 30 sec - exiting
22:26:25 (28831): No heartbeat from core client for 30 sec - exiting
22:26:26 (28831): No heartbeat from core client for 30 sec - exiting
22:26:27 (28831): No heartbeat from core client for 30 sec - exiting
22:26:28 (28831): No heartbeat from core client for 30 sec - exiting
22:26:29 (28831): No heartbeat from core client for 30 sec - exiting
22:26:30 (28831): No heartbeat from core client for 30 sec - exiting
22:26:31 (28831): No heartbeat from core client for 30 sec - exiting
22:26:32 (28831): No heartbeat from core client for 30 sec - exiting
22:26:33 (28831): No heartbeat from core client for 30 sec - exiting
22:26:34 (28831): No heartbeat from core client for 30 sec - exiting
22:26:35 (28831): No heartbeat from core client for 30 sec - exiting
22:26:36 (28831): No heartbeat from core client for 30 sec - exiting
22:26:37 (28831): No heartbeat from core client for 30 sec - exiting
22:26:38 (28831): No heartbeat from core client for 30 sec - exiting
22:26:39 (28831): No heartbeat from core client for 30 sec - exiting
22:26:40 (28831): No heartbeat from core client for 30 sec - exiting
22:26:41 (28831): No heartbeat from core client for 30 sec - exiting
22:26:42 (28831): No heartbeat from core client for 30 sec - exiting
22:26:43 (28831): No heartbeat from core client for 30 sec - exiting
22:26:44 (28831): No heartbeat from core client for 30 sec - exiting
22:26:45 (28831): No heartbeat from core client for 30 sec - exiting
22:26:46 (28831): No heartbeat from core client for 30 sec - exiting
22:26:47 (28831): No heartbeat from core client for 30 sec - exiting
22:26:48 (28831): No heartbeat from core client for 30 sec - exiting
22:26:49 (28831): No heartbeat from core client for 30 sec - exiting
22:26:50 (28831): No heartbeat from core client for 30 sec - exiting
22:26:51 (28831): No heartbeat from core client for 30 sec - exiting
22:26:52 (28831): No heartbeat from core client for 30 sec - exiting
22:26:53 (28831): No heartbeat from core client for 30 sec - exiting
22:26:54 (28831): No heartbeat from core client for 30 sec - exiting
22:26:55 (28831): No heartbeat from core client for 30 sec - exiting
22:26:56 (28831): No heartbeat from core client for 30 sec - exiting
22:26:57 (28831): No heartbeat from core client for 30 sec - exiting
22:26:58 (28831): No heartbeat from core client for 30 sec - exiting
22:26:59 (28831): No heartbeat from core client for 30 sec - exiting
22:27:00 (28831): No heartbeat from core client for 30 sec - exiting
22:27:01 (28831): No heartbeat from core client for 30 sec - exiting
22:27:02 (28831): No heartbeat from core client for 30 sec - exiting
22:27:03 (28831): No heartbeat from core client for 30 sec - exiting
22:27:04 (28831): No heartbeat from core client for 30 sec - exiting
22:27:05 (28831): No heartbeat from core client for 30 sec - exiting
22:27:06 (28831): No heartbeat from core client for 30 sec - exiting
22:27:07 (28831): No heartbeat from core client for 30 sec - exiting
22:27:08 (28831): No heartbeat from core client for 30 sec - exiting
22:27:09 (28831): No heartbeat from core client for 30 sec - exiting
22:27:10 (28831): No heartbeat from core client for 30 sec - exiting
22:27:11 (28831): No heartbeat from core client for 30 sec - exiting
22:27:12 (28831): No heartbeat from core client for 30 sec - exiting
22:27:13 (28831): No heartbeat from core client for 30 sec - exiting
22:27:14 (28831): No heartbeat from core client for 30 sec - exiting
22:27:15 (28831): No heartbeat from core client for 30 sec - exiting
22:27:16 (28831): No heartbeat from core client for 30 sec - exiting
22:27:17 (28831): No heartbeat from core client for 30 sec - exiting
22:27:18 (28831): No heartbeat from core client for 30 sec - exiting
22:27:19 (28831): No heartbeat from core client for 30 sec - exiting
22:27:20 (28831): No heartbeat from core client for 30 sec - exiting
22:27:21 (28831): No heartbeat from core client for 30 sec - exiting
22:27:22 (28831): No heartbeat from core client for 30 sec - exiting
22:27:23 (28831): No heartbeat from core client for 30 sec - exiting
22:27:24 (28831): No heartbeat from core client for 30 sec - exiting
22:27:26 (28831): No heartbeat from core client for 30 sec - exiting
22:27:27 (28831): No heartbeat from core client for 30 sec - exiting
22:27:28 (28831): No heartbeat from core client for 30 sec - exiting
22:27:29 (28831): No heartbeat from core client for 30 sec - exiting
22:27:30 (28831): No heartbeat from core client for 30 sec - exiting
22:27:31 (28831): No heartbeat from core client for 30 sec - exiting
22:27:32 (28831): No heartbeat from core client for 30 sec - exiting
22:27:33 (28831): No heartbeat from core client for 30 sec - exiting
22:27:34 (28831): No heartbeat from core client for 30 sec - exiting
22:27:35 (28831): No heartbeat from core client for 30 sec - exiting
22:27:36 (28831): No heartbeat from core client for 30 sec - exiting
22:27:37 (28831): No heartbeat from core client for 30 sec - exiting
22:27:38 (28831): No heartbeat from core client for 30 sec - exiting
22:27:39 (28831): No heartbeat from core client for 30 sec - exiting
22:27:40 (28831): No heartbeat from core client for 30 sec - exiting
22:27:41 (28831): No heartbeat from core client for 30 sec - exiting
22:27:42 (28831): No heartbeat from core client for 30 sec - exiting
22:27:43 (28831): No heartbeat from core client for 30 sec - exiting
22:27:44 (28831): No heartbeat from core client for 30 sec - exiting
22:27:45 (28831): No heartbeat from core client for 30 sec - exiting
22:27:46 (28831): No heartbeat from core client for 30 sec - exiting
22:27:47 (28831): No heartbeat from core client for 30 sec - exiting
22:27:48 (28831): No heartbeat from core client for 30 sec - exiting
22:27:49 (28831): No heartbeat from core client for 30 sec - exiting
22:27:50 (28831): No heartbeat from core client for 30 sec - exiting
22:27:51 (28831): No heartbeat from core client for 30 sec - exiting
22:27:52 (28831): No heartbeat from core client for 30 sec - exiting
22:27:53 (28831): No heartbeat from core client for 30 sec - exiting
22:27:54 (28831): No heartbeat from core client for 30 sec - exiting
22:27:55 (28831): No heartbeat from core client for 30 sec - exiting
22:27:56 (28831): No heartbeat from core client for 30 sec - exiting
22:27:57 (28831): No heartbeat from core client for 30 sec - exiting
22:27:58 (28831): No heartbeat from core client for 30 sec - exiting
22:27:59 (28831): No heartbeat from core client for 30 sec - exiting
22:28:00 (28831): No heartbeat from core client for 30 sec - exiting
22:28:01 (28831): No heartbeat from core client for 30 sec - exiting
22:28:02 (28831): No heartbeat from core client for 30 sec - exiting
22:28:03 (28831): No heartbeat from core client for 30 sec - exiting
22:28:04 (28831): No heartbeat from core client for 30 sec - exiting
22:28:05 (28831): No heartbeat from core client for 30 sec - exiting
22:28:06 (28831): No heartbeat from core client for 30 sec - exiting
22:28:07 (28831): No heartbeat from core client for 30 sec - exiting
22:28:08 (28831): No heartbeat from core client for 30 sec - exiting
22:28:09 (28831): No heartbeat from core client for 30 sec - exiting
22:28:10 (28831): No heartbeat from core client for 30 sec - exiting
22:28:11 (28831): No heartbeat from core client for 30 sec - exiting
22:28:12 (28831): No heartbeat from core client for 30 sec - exiting
22:28:13 (28831): No heartbeat from core client for 30 sec - exiting
22:28:14 (28831): No heartbeat from core client for 30 sec - exiting
22:28:15 (28831): No heartbeat from core client for 30 sec - exiting
22:28:16 (28831): No heartbeat from core client for 30 sec - exiting
22:28:17 (28831): No heartbeat from core client for 30 sec - exiting
22:28:18 (28831): No heartbeat from core client for 30 sec - exiting
22:28:19 (28831): No heartbeat from core client for 30 sec - exiting
22:28:20 (28831): No heartbeat from core client for 30 sec - exiting
22:28:21 (28831): No heartbeat from core client for 30 sec - exiting
22:28:22 (28831): No heartbeat from core client for 30 sec - exiting
22:28:23 (28831): No heartbeat from core client for 30 sec - exiting
22:28:24 (28831): No heartbeat from core client for 30 sec - exiting
22:28:25 (28831): No heartbeat from core client for 30 sec - exiting
22:28:26 (28831): No heartbeat from core client for 30 sec - exiting
22:28:27 (28831): No heartbeat from core client for 30 sec - exiting
22:28:28 (28831): No heartbeat from core client for 30 sec - exiting
22:28:29 (28831): No heartbeat from core client for 30 sec - exiting
22:28:30 (28831): No heartbeat from core client for 30 sec - exiting
22:28:31 (28831): No heartbeat from core client for 30 sec - exiting
22:28:32 (28831): No heartbeat from core client for 30 sec - exiting
22:28:33 (28831): No heartbeat from core client for 30 sec - exiting
22:28:34 (28831): No heartbeat from core client for 30 sec - exiting
22:28:35 (28831): No heartbeat from core client for 30 sec - exiting
22:28:36 (28831): No heartbeat from core client for 30 sec - exiting
22:28:37 (28831): No heartbeat from core client for 30 sec - exiting
22:28:38 (28831): No heartbeat from core client for 30 sec - exiting
22:28:39 (28831): No heartbeat from core client for 30 sec - exiting
22:28:40 (28831): No heartbeat from core client for 30 sec - exiting
22:28:41 (28831): No heartbeat from core client for 30 sec - exiting
22:28:42 (28831): No heartbeat from core client for 30 sec - exiting
22:28:43 (28831): No heartbeat from core client for 30 sec - exiting
22:28:44 (28831): No heartbeat from core client for 30 sec - exiting
22:28:45 (28831): No heartbeat from core client for 30 sec - exiting
22:28:47 (28831): No heartbeat from core client for 30 sec - exiting
22:28:48 (28831): No heartbeat from core client for 30 sec - exiting
22:28:49 (28831): No heartbeat from core client for 30 sec - exiting
22:28:50 (28831): No heartbeat from core client for 30 sec - exiting
22:28:51 (28831): No heartbeat from core client for 30 sec - exiting
22:28:52 (28831): No heartbeat from core client for 30 sec - exiting
22:28:53 (28831): No heartbeat from core client for 30 sec - exiting
22:28:54 (28831): No heartbeat from core client for 30 sec - exiting
22:28:55 (28831): No heartbeat from core client for 30 sec - exiting
22:28:56 (28831): No heartbeat from core client for 30 sec - exiting
22:28:57 (28831): No heartbeat from core client for 30 sec - exiting
22:28:58 (28831): No heartbeat from core client for 30 sec - exiting
22:28:59 (28831): No heartbeat from core client for 30 sec - exiting
22:29:00 (28831): No heartbeat from core client for 30 sec - exiting
22:29:01 (28831): No heartbeat from core client for 30 sec - exiting
22:29:02 (28831): No heartbeat from core client for 30 sec - exiting
22:29:03 (28831): No heartbeat from core client for 30 sec - exiting
22:29:04 (28831): No heartbeat from core client for 30 sec - exiting
22:29:05 (28831): No heartbeat from core client for 30 sec - exiting
22:29:06 (28831): No heartbeat from core client for 30 sec - exiting
22:29:07 (28831): No heartbeat from core client for 30 sec - exiting
22:29:08 (28831): No heartbeat from core client for 30 sec - exiting
22:29:09 (28831): No heartbeat from core client for 30 sec - exiting
22:29:10 (28831): No heartbeat from core client for 30 sec - exiting
22:29:12 (28831): No heartbeat from core client for 30 sec - exiting
22:29:13 (28831): No heartbeat from core client for 30 sec - exiting
22:29:14 (28831): No heartbeat from core client for 30 sec - exiting
22:29:15 (28831): No heartbeat from core client for 30 sec - exiting
22:29:16 (28831): No heartbeat from core client for 30 sec - exiting
22:29:17 (28831): No heartbeat from core client for 30 sec - exiting
22:29:18 (28831): No heartbeat from core client for 30 sec - exiting
22:29:19 (28831): No heartbeat from core client for 30 sec - exiting
22:29:20 (28831): No heartbeat from core client for 30 sec - exiting
22:29:21 (28831): No heartbeat from core client for 30 sec - exiting
22:29:22 (28831): No heartbeat from core client for 30 sec - exiting
22:29:23 (28831): No heartbeat from core client for 30 sec - exiting
22:29:24 (28831): No heartbeat from core client for 30 sec - exiting
22:29:25 (28831): No heartbeat from core client for 30 sec - exiting
22:29:26 (28831): No heartbeat from core client for 30 sec - exiting
22:29:27 (28831): No heartbeat from core client for 30 sec - exiting
22:29:28 (28831): No heartbeat from core client for 30 sec - exiting
22:29:29 (28831): No heartbeat from core client for 30 sec - exiting
22:29:30 (28831): No heartbeat from core client for 30 sec - exiting
22:29:31 (28831): No heartbeat from core client for 30 sec - exiting
22:29:32 (28831): No heartbeat from core client for 30 sec - exiting
22:29:33 (28831): No heartbeat from core client for 30 sec - exiting
22:29:34 (28831): No heartbeat from core client for 30 sec - exiting
22:29:35 (28831): No heartbeat from core client for 30 sec - exiting
22:29:36 (28831): No heartbeat from core client for 30 sec - exiting
22:29:37 (28831): No heartbeat from core client for 30 sec - exiting
22:29:38 (28831): No heartbeat from core client for 30 sec - exiting
22:29:39 (28831): No heartbeat from core client for 30 sec - exiting
22:29:40 (28831): No heartbeat from core client for 30 sec - exiting
22:29:41 (28831): No heartbeat from core client for 30 sec - exiting
22:29:42 (28831): No heartbeat from core client for 30 sec - exiting
22:29:43 (28831): No heartbeat from core client for 30 sec - exiting
22:29:44 (28831): No heartbeat from core client for 30 sec - exiting
22:29:45 (28831): No heartbeat from core client for 30 sec - exiting
22:29:46 (28831): No heartbeat from core client for 30 sec - exiting
22:29:47 (28831): No heartbeat from core client for 30 sec - exiting
22:29:48 (28831): No heartbeat from core client for 30 sec - exiting
22:29:49 (28831): No heartbeat from core client for 30 sec - exiting
22:29:50 (28831): No heartbeat from core client for 30 sec - exiting
22:29:51 (28831): No heartbeat from core client for 30 sec - exiting
22:29:52 (28831): No heartbeat from core client for 30 sec - exiting
22:29:53 (28831): No heartbeat from core client for 30 sec - exiting
22:29:54 (28831): No heartbeat from core client for 30 sec - exiting
22:29:55 (28831): No heartbeat from core client for 30 sec - exiting
22:29:56 (28831): No heartbeat from core client for 30 sec - exiting
22:29:57 (28831): No heartbeat from core client for 30 sec - exiting
22:29:58 (28831): No heartbeat from core client for 30 sec - exiting
22:29:59 (28831): No heartbeat from core client for 30 sec - exiting
22:30:00 (28831): No heartbeat from core client for 30 sec - exiting
22:30:01 (28831): No heartbeat from core client for 30 sec - exiting
22:30:02 (28831): No heartbeat from core client for 30 sec - exiting
22:30:03 (28831): No heartbeat from core client for 30 sec - exiting
22:30:04 (28831): No heartbeat from core client for 30 sec - exiting
22:30:05 (28831): No heartbeat from core client for 30 sec - exiting
22:30:06 (28831): No heartbeat from core client for 30 sec - exiting
22:30:07 (28831): No heartbeat from core client for 30 sec - exiting
22:30:08 (28831): No heartbeat from core client for 30 sec - exiting
22:30:09 (28831): No heartbeat from core client for 30 sec - exiting
22:30:10 (28831): No heartbeat from core client for 30 sec - exiting
22:30:11 (28831): No heartbeat from core client for 30 sec - exiting
22:30:12 (28831): No heartbeat from core client for 30 sec - exiting
22:30:13 (28831): No heartbeat from core client for 30 sec - exiting
22:30:14 (28831): No heartbeat from core client for 30 sec - exiting
22:30:15 (28831): No heartbeat from core client for 30 sec - exiting
22:30:16 (28831): No heartbeat from core client for 30 sec - exiting
22:30:17 (28831): No heartbeat from core client for 30 sec - exiting
22:30:18 (28831): No heartbeat from core client for 30 sec - exiting
22:30:19 (28831): No heartbeat from core client for 30 sec - exiting
22:30:20 (28831): No heartbeat from core client for 30 sec - exiting
22:30:21 (28831): No heartbeat from core client for 30 sec - exiting
22:30:22 (28831): No heartbeat from core client for 30 sec - exiting
22:30:23 (28831): No heartbeat from core client for 30 sec - exiting
22:30:24 (28831): No heartbeat from core client for 30 sec - exiting
22:30:25 (28831): No heartbeat from core client for 30 sec - exiting
22:30:26 (28831): No heartbeat from core client for 30 sec - exiting
22:30:27 (28831): No heartbeat from core client for 30 sec - exiting
22:30:28 (28831): No heartbeat from core client for 30 sec - exiting
22:30:29 (28831): No heartbeat from core client for 30 sec - exiting
22:30:30 (28831): No heartbeat from core client for 30 sec - exiting
22:30:31 (28831): No heartbeat from core client for 30 sec - exiting
22:30:32 (28831): No heartbeat from core client for 30 sec - exiting
22:30:33 (28831): No heartbeat from core client for 30 sec - exiting
22:30:34 (28831): No heartbeat from core client for 30 sec - exiting
22:30:35 (28831): No heartbeat from core client for 30 sec - exiting
22:30:36 (28831): No heartbeat from core client for 30 sec - exiting
22:30:37 (28831): No heartbeat from core client for 30 sec - exiting
22:30:38 (28831): No heartbeat from core client for 30 sec - exiting
22:30:39 (28831): No heartbeat from core client for 30 sec - exiting
22:30:40 (28831): No heartbeat from core client for 30 sec - exiting
22:30:41 (28831): No heartbeat from core client for 30 sec - exiting
22:30:42 (28831): No heartbeat from core client for 30 sec - exiting
22:30:43 (28831): No heartbeat from core client for 30 sec - exiting
22:30:44 (28831): No heartbeat from core client for 30 sec - exiting
22:30:45 (28831): No heartbeat from core client for 30 sec - exiting
22:30:46 (28831): No heartbeat from core client for 30 sec - exiting
22:30:47 (28831): No heartbeat from core client for 30 sec - exiting
22:30:48 (28831): No heartbeat from core client for 30 sec - exiting
22:30:49 (28831): No heartbeat from core client for 30 sec - exiting
22:30:50 (28831): No heartbeat from core client for 30 sec - exiting
22:30:51 (28831): No heartbeat from core client for 30 sec - exiting
22:30:52 (28831): No heartbeat from core client for 30 sec - exiting
22:30:53 (28831): No heartbeat from core client for 30 sec - exiting
22:30:54 (28831): No heartbeat from core client for 30 sec - exiting
22:30:55 (28831): No heartbeat from core client for 30 sec - exiting
22:30:56 (28831): No heartbeat from core client for 30 sec - exiting
22:30:57 (28831): No heartbeat from core client for 30 sec - exiting
22:30:58 (28831): No heartbeat from core client for 30 sec - exiting
22:30:59 (28831): No heartbeat from core client for 30 sec - exiting
22:31:00 (28831): No heartbeat from core client for 30 sec - exiting
22:31:01 (28831): No heartbeat from core client for 30 sec - exiting
22:31:02 (28831): No heartbeat from core client for 30 sec - exiting
22:31:03 (28831): No heartbeat from core client for 30 sec - exiting
22:31:04 (28831): No heartbeat from core client for 30 sec - exiting
22:31:05 (28831): No heartbeat from core client for 30 sec - exiting
22:31:06 (28831): No heartbeat from core client for 30 sec - exiting
22:31:07 (28831): No heartbeat from core client for 30 sec - exiting
22:31:08 (28831): No heartbeat from core client for 30 sec - exiting
22:31:09 (28831): No heartbeat from core client for 30 sec - exiting
22:31:10 (28831): No heartbeat from core client for 30 sec - exiting
22:31:11 (28831): No heartbeat from core client for 30 sec - exiting
22:31:12 (28831): No heartbeat from core client for 30 sec - exiting
22:31:13 (28831): No heartbeat from core client for 30 sec - exiting
22:31:14 (28831): No heartbeat from core client for 30 sec - exiting
22:31:15 (28831): No heartbeat from core client for 30 sec - exiting
22:31:16 (28831): No heartbeat from core client for 30 sec - exiting
22:31:17 (28831): No heartbeat from core client for 30 sec - exiting
22:31:18 (28831): No heartbeat from core client for 30 sec - exiting
22:31:19 (28831): No heartbeat from core client for 30 sec - exiting
22:31:20 (28831): No heartbeat from core client for 30 sec - exiting
22:31:21 (28831): No heartbeat from core client for 30 sec - exiting
22:31:22 (28831): No heartbeat from core client for 30 sec - exiting
22:31:23 (28831): No heartbeat from core client for 30 sec - exiting
22:31:24 (28831): No heartbeat from core client for 30 sec - exiting
22:31:25 (28831): No heartbeat from core client for 30 sec - exiting
22:31:26 (28831): No heartbeat from core client for 30 sec - exiting
22:31:27 (28831): No heartbeat from core client for 30 sec - exiting
22:31:30 (28831): No heartbeat from core client for 30 sec - exiting
22:31:31 (28831): No heartbeat from core client for 30 sec - exiting
22:31:32 (28831): No heartbeat from core client for 30 sec - exiting
22:31:33 (28831): No heartbeat from core client for 30 sec - exiting
22:31:34 (28831): No heartbeat from core client for 30 sec - exiting
22:31:35 (28831): No heartbeat from core client for 30 sec - exiting
22:31:36 (28831): No heartbeat from core client for 30 sec - exiting
22:31:37 (28831): No heartbeat from core client for 30 sec - exiting
22:31:38 (28831): No heartbeat from core client for 30 sec - exiting
22:31:39 (28831): No heartbeat from core client for 30 sec - exiting
22:31:40 (28831): No heartbeat from core client for 30 sec - exiting
22:31:41 (28831): No heartbeat from core client for 30 sec - exiting
22:31:42 (28831): No heartbeat from core client for 30 sec - exiting
22:31:43 (28831): No heartbeat from core client for 30 sec - exiting
22:31:44 (28831): No heartbeat from core client for 30 sec - exiting
22:31:45 (28831): No heartbeat from core client for 30 sec - exiting
22:31:46 (28831): No heartbeat from core client for 30 sec - exiting
22:31:47 (28831): No heartbeat from core client for 30 sec - exiting
22:31:48 (28831): No heartbeat from core client for 30 sec - exiting
22:31:49 (28831): No heartbeat from core client for 30 sec - exiting
22:31:50 (28831): No heartbeat from core client for 30 sec - exiting
22:31:51 (28831): No heartbeat from core client for 30 sec - exiting
22:31:52 (28831): No heartbeat from core client for 30 sec - exiting
22:31:53 (28831): No heartbeat from core client for 30 sec - exiting
22:31:54 (28831): No heartbeat from core client for 30 sec - exiting
22:31:55 (28831): No heartbeat from core client for 30 sec - exiting
22:31:56 (28831): No heartbeat from core client for 30 sec - exiting
22:31:57 (28831): No heartbeat from core client for 30 sec - exiting
22:31:58 (28831): No heartbeat from core client for 30 sec - exiting
22:31:59 (28831): No heartbeat from core client for 30 sec - exiting
22:32:00 (28831): No heartbeat from core client for 30 sec - exiting
22:32:01 (28831): No heartbeat from core client for 30 sec - exiting
22:32:02 (28831): No heartbeat from core client for 30 sec - exiting
22:32:03 (28831): No heartbeat from core client for 30 sec - exiting
22:32:04 (28831): No heartbeat from core client for 30 sec - exiting
22:32:05 (28831): No heartbeat from core client for 30 sec - exiting
22:32:06 (28831): No heartbeat from core client for 30 sec - exiting
22:32:07 (28831): No heartbeat from core client for 30 sec - exiting
22:32:08 (28831): No heartbeat from core client for 30 sec - exiting
22:32:09 (28831): No heartbeat from core client for 30 sec - exiting
22:32:10 (28831): No heartbeat from core client for 30 sec - exiting
22:32:11 (28831): No heartbeat from core client for 30 sec - exiting
22:32:12 (28831): No heartbeat from core client for 30 sec - exiting
22:32:13 (28831): No heartbeat from core client for 30 sec - exiting
22:32:14 (28831): No heartbeat from core client for 30 sec - exiting
22:32:15 (28831): No heartbeat from core client for 30 sec - exiting
22:32:16 (28831): No heartbeat from core client for 30 sec - exiting
22:32:17 (28831): No heartbeat from core client for 30 sec - exiting
22:32:18 (28831): No heartbeat from core client for 30 sec - exiting
22:32:19 (28831): No heartbeat from core client for 30 sec - exiting
22:32:20 (28831): No heartbeat from core client for 30 sec - exiting
22:32:21 (28831): No heartbeat from core client for 30 sec - exiting
22:32:22 (28831): No heartbeat from core client for 30 sec - exiting
22:32:23 (28831): No heartbeat from core client for 30 sec - exiting
22:32:24 (28831): No heartbeat from core client for 30 sec - exiting
22:32:25 (28831): No heartbeat from core client for 30 sec - exiting
22:32:26 (28831): No heartbeat from core client for 30 sec - exiting
22:32:27 (28831): No heartbeat from core client for 30 sec - exiting
22:32:28 (28831): No heartbeat from core client for 30 sec - exiting
22:32:29 (28831): No heartbeat from core client for 30 sec - exiting
22:32:30 (28831): No heartbeat from core client for 30 sec - exiting
22:32:31 (28831): No heartbeat from core client for 30 sec - exiting
22:32:32 (28831): No heartbeat from core client for 30 sec - exiting
22:32:33 (28831): No heartbeat from core client for 30 sec - exiting
22:32:34 (28831): No heartbeat from core client for 30 sec - exiting
22:32:35 (28831): No heartbeat from core client for 30 sec - exiting
22:32:36 (28831): No heartbeat from core client for 30 sec - exiting
22:32:37 (28831): No heartbeat from core client for 30 sec - exiting
22:32:38 (28831): No heartbeat from core client for 30 sec - exiting
22:32:39 (28831): No heartbeat from core client for 30 sec - exiting
22:32:40 (28831): No heartbeat from core client for 30 sec - exiting
22:32:41 (28831): No heartbeat from core client for 30 sec - exiting
22:32:42 (28831): No heartbeat from core client for 30 sec - exiting
22:32:43 (28831): No heartbeat from core client for 30 sec - exiting
22:32:44 (28831): No heartbeat from core client for 30 sec - exiting
22:32:45 (28831): No heartbeat from core client for 30 sec - exiting
22:32:46 (28831): No heartbeat from core client for 30 sec - exiting
22:32:47 (28831): No heartbeat from core client for 30 sec - exiting
22:32:48 (28831): No heartbeat from core client for 30 sec - exiting
22:32:49 (28831): No heartbeat from core client for 30 sec - exiting
22:32:50 (28831): No heartbeat from core client for 30 sec - exiting
22:32:51 (28831): No heartbeat from core client for 30 sec - exiting
22:32:52 (28831): No heartbeat from core client for 30 sec - exiting
22:32:53 (28831): No heartbeat from core client for 30 sec - exiting
22:32:54 (28831): No heartbeat from core client for 30 sec - exiting
22:32:55 (28831): No heartbeat from core client for 30 sec - exiting
22:32:56 (28831): No heartbeat from core client for 30 sec - exiting
22:32:57 (28831): No heartbeat from core client for 30 sec - exiting
22:32:58 (28831): No heartbeat from core client for 30 sec - exiting
22:32:59 (28831): No heartbeat from core client for 30 sec - exiting
22:33:00 (28831): No heartbeat from core client for 30 sec - exiting
22:33:01 (28831): No heartbeat from core client for 30 sec - exiting
22:33:02 (28831): No heartbeat from core client for 30 sec - exiting
22:33:03 (28831): No heartbeat from core client for 30 sec - exiting
22:33:04 (28831): No heartbeat from core client for 30 sec - exiting
22:33:05 (28831): No heartbeat from core client for 30 sec - exiting
22:33:06 (28831): No heartbeat from core client for 30 sec - exiting
22:33:07 (28831): No heartbeat from core client for 30 sec - exiting
22:33:08 (28831): No heartbeat from core client for 30 sec - exiting
22:33:09 (28831): No heartbeat from core client for 30 sec - exiting
22:33:10 (28831): No heartbeat from core client for 30 sec - exiting
22:33:11 (28831): No heartbeat from core client for 30 sec - exiting
22:33:12 (28831): No heartbeat from core client for 30 sec - exiting
22:33:13 (28831): No heartbeat from core client for 30 sec - exiting
22:33:15 (28831): No heartbeat from core client for 30 sec - exiting
22:33:16 (28831): No heartbeat from core client for 30 sec - exiting
22:33:17 (28831): No heartbeat from core client for 30 sec - exiting
22:33:18 (28831): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...

BUFFOUT: Write Failed: No space left on device
BUFFOUT: C I/O Error - Return code = 1

Model crashed: WRITHEAD: I/O error                                                                                                                                                                                                                                             tmp/pipe_dummy                                                                  2048    

BUFFOUT: Write Failed: No space left on device
BUFFOUT: C I/O Error - Return code = 1

Model crashed: WRITDUMP: BAD BUFFOUT OF DATA                                                                                                                                                                                                                                   tmp/pipe_dummy                                                                  2048    

BUFFOUT: Write Failed: No space left on device
BUFFOUT: C I/O Error - Return code = 1

Model crashed: WRITDUMP: BAD BUFFOUT OF DATA                                                                                                                                                                                                                                   tmp/pipe_dummy                                                                  2048    

BUFFOUT: Write Failed: No space left on device
BUFFOUT: C I/O Error - Return code = 1

Model crashed: WRITDUMP: BAD BUFFOUT OF DATA                                                                                                                                                                                                                                   tmp/pipe_dummy                                                                  2048    

BUFFOUT: Write Failed: No space left on device
BUFFOUT: C I/O Error - Return code = 1

Model crashed: WRITDUMP: BAD BUFFOUT OF DATA                                                                                                                                                                                                                                   tmp/pipe_dummy                                                                  2048    

BUFFOUT: Write Failed: No space left on device
BUFFOUT: C I/O Error - Return code = 1

Model crashed: WRITDUMP: BAD BUFFOUT OF DATA                                                                                                                                                                                                                                   tmp/pipe_dummy                                                                  2048    

BUFFOUT: Write Failed: No space left on device
BUFFOUT: C I/O Error - Return code = 1

Model crashed: WRITHEAD: I/O error                                                                                                                                                                                                                                             tmp/pipe_dummy                                                                  2048    

BUFFOUT: Write Failed: No space left on device
BUFFOUT: C I/O Error - Return code = 1

Model crashed: WRITHEAD: I/O error                                                                                                                                                                                                                                             tmp/pipe_dummy                                                                  2048    
forrtl: No space left on device
forrtl: severe (38): error during write, unit 6, file /data/boinc-client/projects/climateprediction.net/hadcm3n_3kg1_1940_40_008259810/dataout/stdout_um.txt
Image              PC        Routine            Line        Source             
hadcm3n_um_6.07_i  0848EB7D  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0848D975  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0845F3CF  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0841F90D  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0841F257  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  084554BF  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  083721F7  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0837FE35  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0822B1DE  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0818A767  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0818D749  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  08391957  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0838F8B7  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0839BDF8  Unknown               Unknown  Unknown
libc.so.6          F75EABD6  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0804CB11  Unknown               Unknown  Unknown
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=19721, iMonCtr=1
Model crash detected, will try to restart...

BUFFOUT: Write Failed: No space left on device
BUFFOUT: C I/O Error - Return code = 1

Model crashed: WRITDUMP: BAD BUFFOUT OF DATA                                                                                                                                                                                                                                   tmp/pipe_dummy                                                                  2048    

BUFFOUT: Write Failed: No space left on device
BUFFOUT: C I/O Error - Return code = 1

Model crashed: WRITDUMP: BAD BUFFOUT OF DATA                                                                                                                                                                                                                                   tmp/pipe_dummy                                                                  2048    

BUFFOUT: Write Failed: No space left on device
BUFFOUT: C I/O Error - Return code = 1

Model crashed: WRITDUMP: BAD BUFFOUT OF DATA                                                                                                                                                                                                                                   tmp/pipe_dummy                                                                  2048    

BUFFOUT: Write Failed: No space left on device
BUFFOUT: C I/O Error - Return code = 1

Model crashed: WRITDUMP: BAD BUFFOUT OF DATA                                                                                                                                                                                                                                   tmp/pipe_dummy                                                                  2048    
forrtl: No space left on device
forrtl: severe (38): error during write, unit 6, file /data/boinc-client/projects/climateprediction.net/hadcm3n_3kg1_1940_40_008259810/dataout/stdout_um.txt
Image              PC        Routine            Line        Source             
hadcm3n_um_6.07_i  0848EB7D  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0848D975  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0845F3CF  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0841F90D  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0841F257  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  08450E2C  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0844E937  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0822D68F  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0818A767  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0818D749  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  08391957  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0838F8B7  Unknown      CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...

BUFFOUT: Write Failed: No space left on device
BUFFOUT: C I/O Error - Return code = 1

Model crashed: WRITDUMP: BAD BUFFOUT OF DATA                                                                                                                                                                                                                                   tmp/pipe_dummy                                                                  2048    

BUFFOUT: Write Failed: No space left on device
BUFFOUT: C I/O Error - Return code = 1

Model crashed: WRITDUMP: BAD BUFFOUT OF DATA                                                                                                                                                                                                                                   tmp/pipe_dummy                                                                  2048    

BUFFOUT: Write Failed: No space left on device
BUFFOUT: C I/O Error - Return code = 1

Model crashed: WRITDUMP: BAD BUFFOUT OF DATA                                                                                                                                                                                                                                   tmp/pipe_dummy                                                                  2048    
forrtl: No space left on device
forrtl: severe (38): error during write, unit 6, file /data/boinc-client/projects/climateprediction.net/hadcm3n_3kg1_1940_40_008259810/dataout/stdout_um.txt
Image              PC        Routine            Line        Source             
hadcm3n_um_6.07_i  0848EB7D  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0848D975  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0845F3CF  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0841F90D  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0841F257  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  084554BF  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  083721F7  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0837FE35  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0822B1DE  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0818A767  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0818D749  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  08391957  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0838F8B7  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0839BDF8  Unknown               Unknown  Unknown
libc.so.6          F752DBD6  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0804CB11  Unknown               Unknown  Unknown
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=15863, iMonCtr=1
Model crash detected, will try to restart...

BUFFOUT: Write Failed: No space left on device
BUFFOUT: C I/O Error - Return code = 1

Model crashed: WRITDUMP: BAD BUFFOUT OF DATA                                                                                                                                                                                                                                   tmp/pipe_dummy                                                                  2048    
forrtl: No space left on device
forrtl: severe (38): error during write, unit 6, file /data/boinc-client/projects/climateprediction.net/hadcm3n_3kg1_1940_40_008259810/dataout/stdout_um.txt
Image              PC        Routine            Line        Source             
hadcm3n_um_6.07_i  0848EB7D  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0848D975  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0845F3CF  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0841F90D  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0841F257  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  084554BF  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  083721F7  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0837FE35  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0822B1DE  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0818A767  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0818D749  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  08391957  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0838F8B7  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0839BDF8  Unknown               Unknown  Unknown
libc.so.6          F7616BD6  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0804CB11  Unknown               Unknown  Unknown
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=15863, iMonCtr=1
Model crash detected, will try to restart...

BUFFOUT: Write Failed: No space left on device
BUFFOUT: C I/O Error - Return code = 1

Model crashed: WRITDUMP: BAD BUFFOUT OF DATA                                                                                                                                                                                                                                   tmp/pipe_dummy                                                                  2048    

BUFFOUT: Write Failed: No space left on device
BUFFOUT: C I/O Error - Return code = 1

Model crashed: WRITDUMP: BAD BUFFOUT OF DATA                                                                                                                                                                                                                                   tmp/pipe_dummy                                                                  2048    

BUFFOUT: Write Failed: No space left on device
BUFFOUT: C I/O Error - Return code = 1

Model crashed: WRITHEAD: I/O error                                                                                                                                                                                                                                             tmp/pipe_dummy                                                                  2048    

BUFFOUT: Write Failed: No space left on device
BUFFOUT: C I/O Error - Return code = 1

Model crashed: WRITDUMP: BAD BUFFOUT OF DATA                                                                                                                                                                                                                                   tmp/pipe_dummy                                                                  2048    

BUFFOUT: Write Failed: No space left on device
BUFFOUT: C I/O Error - Return code = 1

Model crashed: WRITDUMP: BAD BUFFOUT OF DATA                                                                                                                                                                                                                                   tmp/pipe_dummy                                                                  2048    
forrtl: No space left on device
forrtl: severe (38): error during write, unit 6, file /data/boinc-client/projects/climateprediction.net/hadcm3n_3kg1_1940_40_008259810/dataout/stdout_um.txt
Image              PC        Routine            Line        Source             
hadcm3n_um_6.07_i  0848EB7D  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0848D975  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0845F3CF  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0841F90D  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0841F257  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  08450E2C  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0844E937  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0822D68F  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0818A767  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0818D749  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  08391957  Unknown               Unknown  Unknown
hadcm3n_um_Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=15863, iMonCtr=1
Model crash detected, will try to restart...

BUFFOUT: Write Failed: No space left on device
BUFFOUT: C I/O Error - Return code = 1

Model crashed: WRITDUMP: BAD BUFFOUT OF DATA                                                                                                                                                                                                                                   tmp/pipe_dummy                                                                  2048    

BUFFOUT: Write Failed: No space left on device
BUFFOUT: C I/O Error - Return code = 1

Model crashed: WRITDUMP: BAD BUFFOUT OF DATA                                                                                                                                                                                                                                   tmp/pipe_dummy                                                                  2048    

BUFFOUT: Write Failed: No space left on device
BUFFOUT: C I/O Error - Return code = 1
forrtl: No space left on device
forrtl: severe (38): error during write, unit 6, file /data/boinc-client/projects/climateprediction.net/hadcm3n_3kg1_1940_40_008259810/dataout/stdout_um.txt
Image              PC        Routine            Line        Source             
hadcm3n_um_6.07_i  0848EB7D  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0848D975  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0845F3CF  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0841F90D  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0841F257  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  08450E2C  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0844E937  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0812041A  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  083907B0  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0838F8B7  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0839BDF8  Unknown               Unknown  Unknown
libc.so.6          F75F2BD6  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0804CB11  Unknown               Unknown  Unknown
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=15863, iMonCtr=1
Model crash detected, will try to restart...
Sorry, too many model crashes! :-(
Called boinc_finish

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
03 Feb 2013 21:19:07 1148818 15487587 hadcm3n_3kg1_1940_40_008259810_0 881,280 2,147,901 2.4373
02 Feb 2013 23:40:25 1148818 15487587 hadcm3n_3kg1_1940_40_008259810_0 855,360 2,077,020 2.4282
02 Feb 2013 01:18:54 1148818 15487587 hadcm3n_3kg1_1940_40_008259810_0 829,440 2,004,512 2.4167
31 Jan 2013 18:31:39 1148818 15487587 hadcm3n_3kg1_1940_40_008259810_0 803,520 1,968,875 2.4503
30 Jan 2013 03:57:32 1148818 15487587 hadcm3n_3kg1_1940_40_008259810_0 777,600 1,895,186 2.4372
29 Jan 2013 03:53:46 1148818 15487587 hadcm3n_3kg1_1940_40_008259810_0 751,680 1,817,176 2.4175
28 Jan 2013 00:33:09 1148818 15487587 hadcm3n_3kg1_1940_40_008259810_0 725,760 1,743,325 2.4021
27 Jan 2013 02:59:53 1148818 15487587 hadcm3n_3kg1_1940_40_008259810_0 699,840 1,674,811 2.3931
26 Jan 2013 03:59:10 1148818 15487587 hadcm3n_3kg1_1940_40_008259810_0 673,920 1,604,225 2.3804
25 Jan 2013 06:19:53 1148818 15487587 hadcm3n_3kg1_1940_40_008259810_0 648,000 1,535,241 2.3692
24 Jan 2013 08:36:05 1148818 15487587 hadcm3n_3kg1_1940_40_008259810_0 622,080 1,465,168 2.3553
23 Jan 2013 10:08:28 1148818 15487587 hadcm3n_3kg1_1940_40_008259810_0 596,160 1,394,973 2.3399
22 Jan 2013 14:10:28 1148818 15487587 hadcm3n_3kg1_1940_40_008259810_0 570,240 1,329,007 2.3306
21 Jan 2013 17:36:20 1148818 15487587 hadcm3n_3kg1_1940_40_008259810_0 544,320 1,261,852 2.3182
20 Jan 2013 20:52:38 1148818 15487587 hadcm3n_3kg1_1940_40_008259810_0 518,400 1,191,704 2.2988
19 Jan 2013 21:57:14 1148818 15487587 hadcm3n_3kg1_1940_40_008259810_0 492,480 1,122,401 2.2791
19 Jan 2013 00:13:19 1148818 15487587 hadcm3n_3kg1_1940_40_008259810_0 466,560 1,053,529 2.2581
18 Jan 2013 03:03:29 1148818 15487587 hadcm3n_3kg1_1940_40_008259810_0 440,640 985,610 2.2368
17 Jan 2013 05:13:51 1148818 15487587 hadcm3n_3kg1_1940_40_008259810_0 414,720 915,713 2.2080
16 Jan 2013 05:36:50 1148818 15487587 hadcm3n_3kg1_1940_40_008259810_0 388,800 1,063,819 2.7362


©2024 climateprediction.net