Task 13330703

Name	hadcm3n_t4ca_1940_40_007436068_2
Workunit	7633571
Created	3 Sep 2011, 7:10:54 UTC
Sent	3 Sep 2011, 7:11:04 UTC
Report deadline	3 Dec 2011, 14:38:15 UTC
Received	5 Oct 2011, 1:16:34 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	966603
Run time	12 days 8 hours 41 min 16 sec
CPU time	10 days 17 hours 15 min 46 sec
Validate state	Invalid
Credit	5,598.72
Device peak FLOPS	2.80 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 i686-pc-linux-gnu
Stderr	<core_client_version>6.12.33</core_client_version> <![CDATA[ <message> process exited with code 22 (0x16, -234) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 63 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 64 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 65 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 66 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 67 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 68 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 69 - Return code = 1 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 20:00:12 (13841): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:00:13 (13841): No heartbeat from core client for 30 sec - exiting 20:00:14 (13841): No heartbeat from core client for 30 sec - exiting 20:00:15 (13841): No heartbeat from core client for 30 sec - exiting 20:00:16 (13841): No heartbeat from core client for 30 sec - exiting 20:00:17 (13841): No heartbeat from core client for 30 sec - exiting 20:00:19 (13841): No heartbeat from core client for 30 sec - exiting 20:00:20 (13841): No heartbeat from core client for 30 sec - exiting 21:01:24 (14247): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:01:25 (14247): No heartbeat from core client for 30 sec - exiting 21:01:26 (14247): No heartbeat from core client for 30 sec - exiting 21:01:27 (14247): No heartbeat from core client for 30 sec - exiting 21:01:28 (14247): No heartbeat from core client for 30 sec - exiting 21:01:29 (14247): No heartbeat from core client for 30 sec - exiting 21:01:30 (14247): No heartbeat from core client for 30 sec - exiting 21:01:31 (14247): No heartbeat from core client for 30 sec - exiting 21:01:32 (14247): No heartbeat from core client for 30 sec - exiting 21:01:33 (14247): No heartbeat from core client for 30 sec - exiting 21:04:19 (14584): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:04:20 (14584): No heartbeat from core client for 30 sec - exiting 21:04:21 (14584): No heartbeat from core client for 30 sec - exiting 21:04:22 (14584): No heartbeat from core client for 30 sec - exiting 21:04:23 (14584): No heartbeat from core client for 30 sec - exiting 21:04:26 (14584): No heartbeat from core client for 30 sec - exiting 21:04:27 (14584): No heartbeat from core client for 30 sec - exiting 21:04:28 (14584): No heartbeat from core client for 30 sec - exiting 21:04:29 (14584): No heartbeat from core client for 30 sec - exiting 21:04:30 (14584): No heartbeat from core client for 30 sec - exiting 21:04:32 (14584): No heartbeat from core client for 30 sec - exiting 21:04:33 (14584): No heartbeat from core client for 30 sec - exiting 21:04:34 (14584): No heartbeat from core client for 30 sec - exiting 21:04:35 (14584): No heartbeat from core client for 30 sec - exiting 21:04:36 (14584): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 23:56:10 (16440): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 05:15:07 (25129): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:15:08 (25129): No heartbeat from core client for 30 sec - exiting 05:15:09 (25129): No heartbeat from core client for 30 sec - exiting 05:17:58 (25359): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:17:59 (25359): No heartbeat from core client for 30 sec - exiting 05:18:00 (25359): No heartbeat from core client for 30 sec - exiting 05:18:01 (25359): No heartbeat from core client for 30 sec - exiting 05:18:02 (25359): No heartbeat from core client for 30 sec - exiting 05:18:04 (25359): No heartbeat from core client for 30 sec - exiting 05:18:05 (25359): No heartbeat from core client for 30 sec - exiting 05:36:55 (25385): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:36:56 (25385): No heartbeat from core client for 30 sec - exiting 05:54:33 (25644): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:54:34 (25644): No heartbeat from core client for 30 sec - exiting 05:54:35 (25644): No heartbeat from core client for 30 sec - exiting 05:54:36 (25644): No heartbeat from core client for 30 sec - exiting 05:54:38 (25644): No heartbeat from core client for 30 sec - exiting 05:54:39 (25644): No heartbeat from core client for 30 sec - exiting 05:54:40 (25644): No heartbeat from core client for 30 sec - exiting 05:54:41 (25644): No heartbeat from core client for 30 sec - exiting 05:54:42 (25644): No heartbeat from core client for 30 sec - exiting 05:54:43 (25644): No heartbeat from core client for 30 sec - exiting 05:54:44 (25644): No heartbeat from core client for 30 sec - exiting 05:54:45 (25644): No heartbeat from core client for 30 sec - exiting 05:54:46 (25644): No heartbeat from core client for 30 sec - exiting 05:54:47 (25644): No heartbeat from core client for 30 sec - exiting 06:09:27 (25932): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:09:28 (25932): No heartbeat from core client for 30 sec - exiting 06:39:38 (26147): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:37:41 (26801): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:37:42 (26801): No heartbeat from core client for 30 sec - exiting 07:37:43 (26801): No heartbeat from core client for 30 sec - exiting 07:37:44 (26801): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 19:38:49 (6199): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:33:46 (6250): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 01:58:50 (11572): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:58:52 (11572): No heartbeat from core client for 30 sec - exiting 01:58:53 (11572): No heartbeat from core client for 30 sec - exiting 01:58:54 (11572): No heartbeat from core client for 30 sec - exiting 02:49:54 (12151): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 06:46:18 (4140): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:47:40 (10023): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:49:17 (10055): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:51:16 (10082): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:52:49 (10127): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:52:50 (10127): No heartbeat from core client for 30 sec - exiting 06:59:31 (10154): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:59:32 (10154): No heartbeat from core client for 30 sec - exiting 06:59:33 (10154): No heartbeat from core client for 30 sec - exiting 06:59:34 (10154): No heartbeat from core client for 30 sec - exiting 06:59:35 (10154): No heartbeat from core client for 30 sec - exiting 06:59:36 (10154): No heartbeat from core client for 30 sec - exiting 06:59:37 (10154): No heartbeat from core client for 30 sec - exiting 06:59:38 (10154): No heartbeat from core client for 30 sec - exiting 06:59:39 (10154): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 18:37:43 (18751): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 20:32:23 (19790): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 06:55:03 (25988): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:55:04 (25988): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... 08:40:44 (26773): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 14:24:32 (31003): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:21:29 (31222): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 16:38:31 (603): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 18:21:53 (1809): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 19:48:05 (3399): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 21:23:21 (4508): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:28:48 (5081): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:27:43 (5987): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 05:24:10 (8915): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:24:11 (8915): No heartbeat from core client for 30 sec - exiting 05:24:12 (8915): No heartbeat from core client for 30 sec - exiting 05:24:13 (8915): No heartbeat from core client for 30 sec - exiting 05:24:14 (8915): No heartbeat from core client for 30 sec - exiting 05:24:15 (8915): No heartbeat from core client for 30 sec - exiting 05:24:16 (8915): No heartbeat from core client for 30 sec - exiting 05:24:17 (8915): No heartbeat from core client for 30 sec - exiting 05:24:18 (8915): No heartbeat from core client for 30 sec - exiting 05:24:20 (8915): No heartbeat from core client for 30 sec - exiting 05:24:21 (8915): No heartbeat from core client for 30 sec - exiting 05:24:22 (8915): No heartbeat from core client for 30 sec - exiting 05:24:23 (8915): No heartbeat from core client for 30 sec - exiting 05:24:24 (8915): No heartbeat from core client for 30 sec - exiting 05:24:25 (8915): No heartbeat from core client for 30 sec - exiting 05:24:26 (8915): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 09:31:19 (11557): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:27:57 (11845): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 04:15:35 (21336): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 06:31:45 (25937): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:31:46 (25937): No heartbeat from core client for 30 sec - exiting 06:31:47 (25937): No heartbeat from core client for 30 sec - exiting 06:31:48 (25937): No heartbeat from core client for 30 sec - exiting 06:31:49 (25937): No heartbeat from core client for 30 sec - exiting 06:31:50 (25937): No heartbeat from core client for 30 sec - exiting 06:51:02 (26616): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:54:03 (26779): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:12:35 (26893): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:12:36 (26893): No heartbeat from core client for 30 sec - exiting 07:12:37 (26893): No heartbeat from core client for 30 sec - exiting 07:12:38 (26893): No heartbeat from core client for 30 sec - exiting 07:34:49 (27137): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 01:42:58 (24051): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:42:59 (24051): No heartbeat from core client for 30 sec - exiting 01:43:00 (24051): No heartbeat from core client for 30 sec - exiting 01:43:01 (24051): No heartbeat from core client for 30 sec - exiting 01:43:02 (24051): No heartbeat from core client for 30 sec - exiting 01:43:03 (24051): No heartbeat from core client for 30 sec - exiting 01:43:05 (24051): No heartbeat from core client for 30 sec - exiting 01:43:06 (24051): No heartbeat from core client for 30 sec - exiting 01:43:07 (24051): No heartbeat from core client for 30 sec - exiting 01:43:08 (24051): No heartbeat from core client for 30 sec - exiting 01:43:09 (24051): No heartbeat from core client for 30 sec - exiting 01:43:10 (24051): No heartbeat from core client for 30 sec - exiting 01:43:11 (24051): No heartbeat from core client for 30 sec - exiting 01:43:12 (24051): No heartbeat from core client for 30 sec - exiting 01:43:13 (24051): No heartbeat from core client for 30 sec - exiting 01:43:14 (24051): No heartbeat from core client for 30 sec - exiting 01:43:15 (24051): No heartbeat from core client for 30 sec - exiting 01:43:16 (24051): No heartbeat from core client for 30 sec - exiting 01:43:17 (24051): No heartbeat from core client for 30 sec - exiting 01:43:18 (24051): No heartbeat from core client for 30 sec - exiting 01:43:19 (24051): No heartbeat from core client for 30 sec - exiting 01:43:20 (24051): No heartbeat from core client for 30 sec - exiting 01:43:21 (24051): No heartbeat from core client for 30 sec - exiting 01:43:22 (24051): No heartbeat from core client for 30 sec - exiting 01:43:23 (24051): No heartbeat from core client for 30 sec - exiting 01:43:24 (24051): No heartbeat from core client for 30 sec - exiting 01:43:26 (24051): No heartbeat from core client for 30 sec - exiting 01:43:27 (24051): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... SIGABRT: abort called Stack trace (10 frames): /virtual/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x840da8f] [0xf77a9400] [0xf77a9430] /lib32/libc.so.6(gsignal+0x51)[0xf7616bb1] /lib32/libc.so.6(abort+0x182)[0xf7619fd2] /virtual/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x83400c3] /virtual/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x838f395] /virtual/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x839bdf8] /lib32/libc.so.6(__libc_start_main+0xe6)[0xf7602e46] /virtual/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x804cb11] Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=14892, iMonCtr=1 Model crash detected, will try to restart... SIGABRT: abort called Stack trace (10 frames): /virtual/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x840da8f] [0xf774a400] [0xf774a430] /lib32/libc.so.6(gsignal+0x51)[0xf75b7bb1] /lib32/libc.so.6(abort+0x182)[0xf75bafd2] /virtual/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x83400c3] /virtual/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x838f395] /virtual/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x839bdf8] /lib32/libc.so.6(__libc_start_main+0xe6)[0xf75a3e46] /virtual/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x804cb11] Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=14892, iMonCtr=1 Model crash detected, will try to restart... SIGABRT: abort called Stack trace (10 frames): /virtual/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x840da8f] [0xf778e400] [0xf778e430] /lib32/libc.so.6(gsignal+0x51)[0xf75fbbb1] /lib32/libc.so.6(abort+0x182)[0xf75fefd2] /virtual/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x83400c3] /virtual/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x838f395] /virtual/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x839bdf8] /lib32/libc.so.6(__libc_start_main+0xe6)[0xf75e7e46] /virtual/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x804cb11] Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=14892, iMonCtr=1 Model crash detected, will try to restart... SIGABRT: abort called Stack trace (10 frames): /virtual/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x840da8f] [0xf775e400] [0xf775e430] /lib32/libc.so.6(gsignal+0x51)[0xf75cbbb1] /lib32/libc.so.6(abort+0x182)[0xf75cefd2] /virtual/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x83400c3] /virtual/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x838f395] /virtual/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x839bdf8] /lib32/libc.so.6(__libc_start_main+0xe6)[0xf75b7e46] /virtual/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x804cb11] Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=14892, iMonCtr=1 Model crash detected, will try to restart... SIGABRT: abort called Stack trace (10 frames): /virtual/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x840da8f] [0xf772d400] [0xf772d430] /lib32/libc.so.6(gsignal+0x51)[0xf759abb1] /lib32/libc.so.6(abort+0x182)[0xf759dfd2] /virtual/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x83400c3] /virtual/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x838f395] /virtual/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x839bdf8] /lib32/libc.so.6(__libc_start_main+0xe6)[0xf7586e46] /virtual/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x804cb11] Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=14892, iMonCtr=1 Model crash detected, will try to restart... SIGABRT: abort called Stack trace (10 frames): /virtual/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x840da8f] [0xf76e8400] [0xf76e8430] /lib32/libc.so.6(gsignal+0x51)[0xf7555bb1] /lib32/libc.so.6(abort+0x182)[0xf7558fd2] /virtual/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x83400c3] /virtual/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x838f395] /virtual/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x839bdf8] /lib32/libc.so.6(__libc_start_main+0xe6)[0xf7541e46] /virtual/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x804cb11] Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=14892, iMonCtr=1 Model crash detected, will try to restart... Sorry, too many model crashes! :-( Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
04 Oct 2011 08:00:53	966603	13330703	hadcm3n_t4ca_1940_40_007436068_2	466,560	919,609	1.9710
02 Oct 2011 18:02:39	966603	13330703	hadcm3n_t4ca_1940_40_007436068_2	440,640	863,578	1.9598
01 Oct 2011 17:19:00	966603	13330703	hadcm3n_t4ca_1940_40_007436068_2	414,720	805,919	1.9433
30 Sep 2011 05:33:13	966603	13330703	hadcm3n_t4ca_1940_40_007436068_2	388,800	751,929	1.9340
27 Sep 2011 23:32:35	966603	13330703	hadcm3n_t4ca_1940_40_007436068_2	362,880	700,145	1.9294
24 Sep 2011 23:02:57	966603	13330703	hadcm3n_t4ca_1940_40_007436068_2	336,960	649,287	1.9269
21 Sep 2011 11:53:34	966603	13330703	hadcm3n_t4ca_1940_40_007436068_2	311,040	600,000	1.9290
20 Sep 2011 05:25:33	966603	13330703	hadcm3n_t4ca_1940_40_007436068_2	285,120	548,623	1.9242
19 Sep 2011 00:42:39	966603	13330703	hadcm3n_t4ca_1940_40_007436068_2	259,200	496,262	1.9146
18 Sep 2011 05:17:57	966603	13330703	hadcm3n_t4ca_1940_40_007436068_2	233,280	445,665	1.9104
17 Sep 2011 10:21:02	966603	13330703	hadcm3n_t4ca_1940_40_007436068_2	207,360	396,543	1.9123
16 Sep 2011 06:59:00	966603	13330703	hadcm3n_t4ca_1940_40_007436068_2	181,440	347,171	1.9134
15 Sep 2011 06:21:47	966603	13330703	hadcm3n_t4ca_1940_40_007436068_2	155,520	297,076	1.9102
14 Sep 2011 05:58:05	966603	13330703	hadcm3n_t4ca_1940_40_007436068_2	129,600	246,974	1.9057
12 Sep 2011 23:56:22	966603	13330703	hadcm3n_t4ca_1940_40_007436068_2	103,680	198,116	1.9108
11 Sep 2011 22:01:20	966603	13330703	hadcm3n_t4ca_1940_40_007436068_2	77,760	147,880	1.9017
10 Sep 2011 19:41:08	966603	13330703	hadcm3n_t4ca_1940_40_007436068_2	51,840	97,592	1.8826
10 Sep 2011 02:00:58	966603	13330703	hadcm3n_t4ca_1940_40_007436068_2	25,920	49,541	1.9113