climateprediction.net home page
Task 13016827

Task 13016827

Name hadcm3n_t4bu_1940_40_007312659_1
Workunit 7510089
Created 28 Jun 2011, 4:17:37 UTC
Sent 28 Jun 2011, 4:21:18 UTC
Report deadline 27 Sep 2011, 11:48:29 UTC
Received 15 Jul 2011, 15:22:48 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 22 (0x00000016) Unknown error code
Computer ID 1006135
Run time 12 days 7 hours 1 min 50 sec
CPU time 10 days 5 hours 21 min 37 sec
Validate state Invalid
Credit 5,287.68
Device peak FLOPS 2.68 GFLOPS
Application version UK Met Office Coupled Model Full Resolution Ocean v6.07
i686-apple-darwin
Stderr
<core_client_version>6.6.36</core_client_version>
<![CDATA[
<message>
process exited with code 22 (0x16, -234)
</message>
<stderr_txt>
t for 30 sec - exiting
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
23:41:47 (25576): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
02:11:44 (25598): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
02:11:47 (25598): No heartbeat from core client for 30 sec - exiting
02:11:48 (25598): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
02:19:33 (49799): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
02:21:30 (51455): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
01:11:27 (66865): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
02:18:34 (67593): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
05:13:55 (71159): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
05:37:23 (72733): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
05:37:25 (72733): No heartbeat from core client for 30 sec - exiting
05:37:26 (72733): No heartbeat from core client for 30 sec - exiting
05:37:27 (72733): No heartbeat from core client for 30 sec - exiting
05:37:28 (72733): No heartbeat from core client for 30 sec - exiting
06:33:11 (72905): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
06:33:12 (72905): No heartbeat from core client for 30 sec - exiting
06:33:13 (72905): No heartbeat from core client for 30 sec - exiting
06:33:14 (72905): No heartbeat from core client for 30 sec - exiting
06:33:15 (72905): No heartbeat from core client for 30 sec - exiting
06:33:16 (72905): No heartbeat from core client for 30 sec - exiting
06:33:17 (72905): No heartbeat from core client for 30 sec - exiting
06:34:39 (74568): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
10:00:48 (78138): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
10:00:51 (78138): No heartbeat from core client for 30 sec - exiting
10:00:52 (78138): No heartbeat from core client for 30 sec - exiting
10:00:53 (78138): No heartbeat from core client for 30 sec - exiting
10:01:38 (78626): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
12:35:21 (79434): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
13:36:28 (81006): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
13:36:31 (81006): No heartbeat from core client for 30 sec - exiting
13:36:32 (81006): No heartbeat from core client for 30 sec - exiting
13:36:33 (81006): No heartbeat from core client for 30 sec - exiting
13:36:34 (81006): No heartbeat from core client for 30 sec - exiting
13:36:35 (81006): No heartbeat from core client for 30 sec - exiting
13:36:36 (81006): No heartbeat from core client for 30 sec - exiting
13:36:37 (81006): No heartbeat from core client for 30 sec - exiting
13:36:38 (81006): No heartbeat from core client for 30 sec - exiting
13:36:39 (81006): No heartbeat from core client for 30 sec - exiting
13:36:40 (81006): No heartbeat from core client for 30 sec - exiting
13:36:41 (81006): No heartbeat from core client for 30 sec - exiting
13:36:42 (81006): No heartbeat from core client for 30 sec - exiting
13:36:43 (81006): No heartbeat from core client for 30 sec - exiting
13:36:44 (81006): No heartbeat from core client for 30 sec - exiting
13:36:45 (81006): No heartbeat from core client for 30 sec - exiting
13:36:46 (81006): No heartbeat from core client for 30 sec - exiting
13:36:47 (81006): No heartbeat from core client for 30 sec - exiting
13:36:48 (81006): No heartbeat from core client for 30 sec - exiting
13:36:49 (81006): No heartbeat from core client for 30 sec - exiting
13:36:50 (81006): No heartbeat from core client for 30 sec - exiting
13:36:51 (81006): No heartbeat from core client for 30 sec - exiting
13:36:52 (81006): No heartbeat from core client for 30 sec - exiting
13:36:53 (81006): No heartbeat from core client for 30 sec - exiting
13:37:35 (81428): No heartbeat from core client for 30 sec - exiting
13:37:36 (81428): No heartbeat from core client for 30 sec - exiting
13:37:37 (81428): No heartbeat from core client for 30 sec - exiting
13:37:38 (81428): No heartbeat from core client for 30 sec - exiting
13:37:39 (81428): No heartbeat from core client for 30 sec - exiting
13:37:40 (81428): No heartbeat from core client for 30 sec - exiting
13:37:41 (81428): No heartbeat from core client for 30 sec - exiting
13:37:42 (81428): No heartbeat from core client for 30 sec - exiting
13:37:43 (81428): No heartbeat from core client for 30 sec - exiting
13:37:44 (81428): No heartbeat from core client for 30 sec - exiting
13:37:45 (81428): No heartbeat from core client for 30 sec - exiting
13:37:46 (81428): No heartbeat from core client for 30 sec - exiting
13:37:47 (81428): No heartbeat from core client for 30 sec - exiting
13:37:48 (81428): No heartbeat from core client for 30 sec - exiting
13:37:49 (81428): No heartbeat from core client for 30 sec - exiting
13:37:50 (81428): No heartbeat from core client for 30 sec - exiting
13:37:51 (81428): No heartbeat from core client for 30 sec - exiting
13:37:52 (81428): No heartbeat from core client for 30 sec - exiting
13:37:53 (81428): No heartbeat from core client for 30 sec - exiting
13:37:54 (81428): No heartbeat from core client for 30 sec - exiting
13:37:55 (81428): No heartbeat from core client for 30 sec - exiting
13:37:56 (81428): No heartbeat from core client for 30 sec - exiting
13:37:57 (81428): No heartbeat from core client for 30 sec - exiting
13:37:58 (81428): No heartbeat from core client for 30 sec - exiting
13:37:59 (81428): No heartbeat from core client for 30 sec - exiting
13:38:00 (81428): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
13:52:26 (81438): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
13:52:28 (81438): No heartbeat from core client for 30 sec - exiting
13:52:29 (81438): No heartbeat from core client for 30 sec - exiting
13:52:30 (81438): No heartbeat from core client for 30 sec - exiting
13:52:31 (81438): No heartbeat from core client for 30 sec - exiting
13:52:32 (81438): No heartbeat from core client for 30 sec - exiting
13:52:33 (81438): No heartbeat from core client for 30 sec - exiting
14:01:20 (81563): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
15:12:38 (82118): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
15:25:42 (82140): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
15:55:24 (83497): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
15:57:02 (83720): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
15:57:03 (83720): No heartbeat from core client for 30 sec - exiting
16:06:49 (83745): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
16:07:29 (83745): No heartbeat from core client for 30 sec - exiting
16:07:30 (83745): No heartbeat from core client for 30 sec - exiting
16:07:31 (83745): No heartbeat from core client for 30 sec - exiting
16:07:32 (83745): No heartbeat from core client for 30 sec - exiting
16:16:51 (83832): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
16:16:54 (83832): No heartbeat from core client for 30 sec - exiting
16:16:55 (83832): No heartbeat from core client for 30 sec - exiting
16:16:56 (83832): No heartbeat from core client for 30 sec - exiting
16:16:57 (83832): No heartbeat from core client for 30 sec - exiting
16:16:58 (83832): No heartbeat from core client for 30 sec - exiting
16:16:59 (83832): No heartbeat from core client for 30 sec - exiting
16:17:00 (83832): No heartbeat from core client for 30 sec - exiting
16:26:51 (83911): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
16:36:53 (83992): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
16:46:53 (84073): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
16:50:36 (84155): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
16:51:44 (84155): No heartbeat from core client for 30 sec - exiting
16:51:45 (84155): No heartbeat from core client for 30 sec - exiting
16:51:46 (84155): No heartbeat from core client for 30 sec - exiting
16:51:47 (84155): No heartbeat from core client for 30 sec - exiting
16:51:48 (84155): No heartbeat from core client for 30 sec - exiting
16:51:49 (84155): No heartbeat from core client for 30 sec - exiting
16:51:50 (84155): No heartbeat from core client for 30 sec - exiting
16:51:51 (84155): No heartbeat from core client for 30 sec - exiting
16:51:52 (84155): No heartbeat from core client for 30 sec - exiting
16:51:53 (84155): No heartbeat from core client for 30 sec - exiting
16:51:54 (84155): No heartbeat from core client for 30 sec - exiting
16:51:55 (84155): No heartbeat from core client for 30 sec - exiting
16:51:56 (84155): No heartbeat from core client for 30 sec - exiting
16:51:57 (84155): No heartbeat from core client for 30 sec - exiting
16:51:58 (84155): No heartbeat from core client for 30 sec - exiting
16:51:59 (84155): No heartbeat from core client for 30 sec - exiting
16:52:00 (84155): No heartbeat from core client for 30 sec - exiting
16:52:01 (84155): No heartbeat from core client for 30 sec - exiting
16:52:02 (84155): No heartbeat from core client for 30 sec - exiting
16:52:03 (84155): No heartbeat from core client for 30 sec - exiting
16:52:04 (84155): No heartbeat from core client for 30 sec - exiting
16:52:05 (84155): No heartbeat from core client for 30 sec - exiting
16:52:06 (84155): No heartbeat from core client for 30 sec - exiting
16:52:07 (84155): No heartbeat from core client for 30 sec - exiting
16:52:08 (84155): No heartbeat from core client for 30 sec - exiting
16:52:09 (84155): No heartbeat from core client for 30 sec - exiting
16:52:10 (84155): No heartbeat from core client for 30 sec - exiting
16:52:11 (84155): No heartbeat from core client for 30 sec - exiting
16:52:12 (84155): No heartbeat from core client for 30 sec - exiting
16:52:13 (84155): No heartbeat from core client for 30 sec - exiting
16:52:14 (84155): No heartbeat from core client for 30 sec - exiting
16:52:15 (84155): No heartbeat from core client for 30 sec - exiting
16:52:16 (84155): No heartbeat from core client for 30 sec - exiting
16:52:17 (84155): No heartbeat from core client for 30 sec - exiting
16:52:18 (84155): No heartbeat from core client for 30 sec - exiting
16:52:19 (84155): No heartbeat from core client for 30 sec - exiting
16:52:20 (84155): No heartbeat from core client for 30 sec - exiting
16:52:21 (84155): No heartbeat from core client for 30 sec - exiting
16:52:22 (84155): No heartbeat from core client for 30 sec - exiting
16:52:23 (84155): No heartbeat from core client for 30 sec - exiting
16:52:24 (84155): No heartbeat from core client for 30 sec - exiting
16:52:25 (84155): No heartbeat from core client for 30 sec - exiting
16:52:26 (84155): No heartbeat from core client for 30 sec - exiting
16:52:27 (84155): No heartbeat from core client for 30 sec - exiting
16:52:28 (84155): No heartbeat from core client for 30 sec - exiting
16:52:29 (84155): No heartbeat from core client for 30 sec - exiting
16:52:30 (84155): No heartbeat from core client for 30 sec - exiting
17:03:05 (84204): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
17:03:08 (84204): No heartbeat from core client for 30 sec - exiting
17:03:09 (84204): No heartbeat from core client for 30 sec - exiting
17:03:10 (84204): No heartbeat from core client for 30 sec - exiting
17:03:11 (84204): No heartbeat from core client for 30 sec - exiting
17:13:06 (84291): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
17:13:09 (84291): No heartbeat from core client for 30 sec - exiting
17:13:10 (84291): No heartbeat from core client for 30 sec - exiting
17:13:11 (84291): No heartbeat from core client for 30 sec - exiting
17:13:12 (84291): No heartbeat from core client for 30 sec - exiting
17:13:13 (84291): No heartbeat from core client for 30 sec - exiting
17:13:14 (84291): No heartbeat from core client for 30 sec - exiting
17:13:15 (84291): No heartbeat from core client for 30 sec - exiting
17:14:43 (84370): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
17:23:06 (84384): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
17:23:10 (84384): No heartbeat from core client for 30 sec - exiting
17:23:11 (84384): No heartbeat from core client for 30 sec - exiting
17:23:12 (84384): No heartbeat from core client for 30 sec - exiting
17:33:08 (84467): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
00:04:50 (89975): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
09:07:17 (93586): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
09:07:20 (93586): No heartbeat from core client for 30 sec - exiting
09:07:21 (93586): No heartbeat from core client for 30 sec - exiting
09:07:22 (93586): No heartbeat from core client for 30 sec - exiting
09:07:23 (93586): No heartbeat from core client for 30 sec - exiting
09:07:24 (93586): No heartbeat from core client for 30 sec - exiting
09:07:25 (93586): No heartbeat from core client for 30 sec - exiting
09:07:26 (93586): No heartbeat from core client for 30 sec - exiting
09:07:27 (93586): No heartbeat from core client for 30 sec - exiting
09:07:28 (93586): No heartbeat from core client for 30 sec - exiting
09:07:29 (93586): No heartbeat from core client for 30 sec - exiting
09:07:30 (93586): No heartbeat from core client for 30 sec - exiting
09:07:31 (93586): No heartbeat from core client for 30 sec - exiting
09:07:32 (93586): No heartbeat from core client for 30 sec - exiting
09:07:33 (93586): No heartbeat from core client for 30 sec - exiting
09:07:34 (93586): No heartbeat from core client for 30 sec - exiting
09:07:35 (93586): No heartbeat from core client for 30 sec - exiting
09:07:36 (93586): No heartbeat from core client for 30 sec - exiting
09:07:37 (93586): No heartbeat from core client for 30 sec - exiting
09:07:38 (93586): No heartbeat from core client for 30 sec - exiting
09:07:39 (93586): No heartbeat from core client for 30 sec - exiting
09:07:40 (93586): No heartbeat from core client for 30 sec - exiting
09:45:12 (96619): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
09:45:15 (96619): No heartbeat from core client for 30 sec - exiting
09:45:16 (96619): No heartbeat from core client for 30 sec - exiting
09:45:17 (96619): No heartbeat from core client for 30 sec - exiting
09:45:18 (96619): No heartbeat from core client for 30 sec - exiting
09:45:19 (96619): No heartbeat from core client for 30 sec - exiting
09:45:20 (96619): No heartbeat from core client for 30 sec - exiting
09:45:21 (96619): No heartbeat from core client for 30 sec - exiting
09:45:22 (96619): No heartbeat from core client for 30 sec - exiting
09:45:23 (96619): No heartbeat from core client for 30 sec - exiting
09:45:24 (96619): No heartbeat from core client for 30 sec - exiting
09:45:25 (96619): No heartbeat from core client for 30 sec - exiting
09:45:26 (96619): No heartbeat from core client for 30 sec - exiting
09:45:27 (96619): No heartbeat from core client for 30 sec - exiting
09:45:28 (96619): No heartbeat from core client for 30 sec - exiting
09:45:29 (96619): No heartbeat from core client for 30 sec - exiting
09:45:30 (96619): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - Quit request from BOINC...
10:27:47 (98448): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
10:36:08 (98506): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
11:34:17 (98571): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
11:34:18 (98571): No heartbeat from core client for 30 sec - exiting
11:34:19 (98571): No heartbeat from core client for 30 sec - exiting
11:34:20 (98571): No heartbeat from core client for 30 sec - exiting

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 63 - Return code = 1

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 64 - Return code = 1

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 65 - Return code = 1

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 66 - Return code = 1

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 67 - Return code = 1

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 68 - Return code = 1

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 69 - Return code = 1
Error: Input file: dataout/t4buko.pje6c10 is not a valid UM file.
Error converting file to netcdf: dataout/t4buko.pje6c10
Error: Input file: dataout/t4buko.pie6c10 is not a valid UM file.
Error converting file to netcdf: dataout/t4buko.pie6c10
Error: Input file: dataout/t4buko.pfe6c10 is not a valid UM file.
Error converting file to netcdf: dataout/t4buko.pfe6c10
Error: Input file: dataout/t4buka.phe6c10 is not a valid UM file.
Error converting file to netcdf: dataout/t4buka.phe6c10
Error: Input file: dataout/t4buka.pge6c10 is not a valid UM file.
Error converting file to netcdf: dataout/t4buka.pge6c10
Error: Input file: dataout/t4buka.pee6c10 is not a valid UM file.
Error converting file to netcdf: dataout/t4buka.pee6c10
Error: Input file: dataout/t4buka.pde6c10 is not a valid UM file.
Error converting file to netcdf: dataout/t4buka.pde6c10
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
14:11:57 (184): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
14:12:02 (184): No heartbeat from core client for 30 sec - exiting
14:12:03 (184): No heartbeat from core client for 30 sec - exiting
14:42:38 (356): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
16:49:11 (5231): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
16:31:50 (26128): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
16:31:53 (26128): No heartbeat from core client for 30 sec - exiting
16:31:54 (26128): No heartbeat from core client for 30 sec - exiting
16:31:55 (26128): No heartbeat from core client for 30 sec - exiting
16:31:56 (26128): No heartbeat from core client for 30 sec - exiting
16:31:57 (26128): No heartbeat from core client for 30 sec - exiting
16:31:58 (26128): No heartbeat from core client for 30 sec - exiting
16:31:59 (26128): No heartbeat from core client for 30 sec - exiting
16:32:00 (26128): No heartbeat from core client for 30 sec - exiting
16:40:16 (34777): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
16:40:18 (34777): No heartbeat from core client for 30 sec - exiting
16:40:19 (34777): No heartbeat from core client for 30 sec - exiting
16:40:20 (34777): No heartbeat from core client for 30 sec - exiting
16:40:21 (34777): No heartbeat from core client for 30 sec - exiting
16:40:22 (34777): No heartbeat from core client for 30 sec - exiting
16:49:42 (34830): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
16:49:44 (34830): No heartbeat from core client for 30 sec - exiting
16:49:45 (34830): No heartbeat from core client for 30 sec - exiting
16:49:46 (34830): No heartbeat from core client for 30 sec - exiting
16:49:47 (34830): No heartbeat from core client for 30 sec - exiting
16:59:40 (34921): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
16:59:46 (34921): No heartbeat from core client for 30 sec - exiting
16:59:47 (34921): No heartbeat from core client for 30 sec - exiting
16:59:48 (34921): No heartbeat from core client for 30 sec - exiting
16:59:49 (34921): No heartbeat from core client for 30 sec - exiting
16:59:50 (34921): No heartbeat from core client for 30 sec - exiting
16:59:51 (34921): No heartbeat from core client for 30 sec - exiting
16:59:52 (34921): No heartbeat from core client for 30 sec - exiting
16:59:53 (34921): No heartbeat from core client for 30 sec - exiting
16:59:54 (34921): No heartbeat from core client for 30 sec - exiting
16:59:55 (34921): No heartbeat from core client for 30 sec - exiting
16:59:56 (34921): No heartbeat from core client for 30 sec - exiting
16:59:57 (34921): No heartbeat from core client for 30 sec - exiting
16:59:58 (34921): No heartbeat from core client for 30 sec - exiting
16:59:59 (34921): No heartbeat from core client for 30 sec - exiting
17:09:28 (34985): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
17:09:31 (34985): No heartbeat from core client for 30 sec - exiting
17:09:32 (34985): No heartbeat from core client for 30 sec - exiting
17:09:33 (34985): No heartbeat from core client for 30 sec - exiting
17:09:34 (34985): No heartbeat from core client for 30 sec - exiting
17:09:35 (34985): No heartbeat from core client for 30 sec - exiting
17:09:36 (34985): No heartbeat from core client for 30 sec - exiting
17:09:37 (34985): No heartbeat from core client for 30 sec - exiting
17:09:38 (34985): No heartbeat from core client for 30 sec - exiting
17:09:39 (34985): No heartbeat from core client for 30 sec - exiting
17:09:40 (34985): No heartbeat from core client for 30 sec - exiting
17:16:13 (35079): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
17:16:14 (35079): No heartbeat from core client for 30 sec - exiting
17:16:15 (35079): No heartbeat from core client for 30 sec - exiting
17:26:49 (35132): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
17:26:53 (35132): No heartbeat from core client for 30 sec - exiting
17:26:54 (35132): No heartbeat from core client for 30 sec - exiting
17:26:55 (35132): No heartbeat from core client for 30 sec - exiting
17:26:56 (35132): No heartbeat from core client for 30 sec - exiting
17:26:57 (35132): No heartbeat from core client for 30 sec - exiting
17:34:50 (35249): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
17:34:51 (35249): No heartbeat from core client for 30 sec - exiting
17:34:52 (35249): No heartbeat from core client for 30 sec - exiting
17:34:53 (35249): No heartbeat from core client for 30 sec - exiting
17:34:54 (35249): No heartbeat from core client for 30 sec - exiting
17:41:53 (35297): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
17:58:06 (35374): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
17:58:09 (35374): No heartbeat from core client for 30 sec - exiting
17:58:10 (35374): No heartbeat from core client for 30 sec - exiting
17:58:11 (35374): No heartbeat from core client for 30 sec - exiting
17:58:12 (35374): No heartbeat from core client for 30 sec - exiting
17:58:13 (35374): No heartbeat from core client for 30 sec - exiting
17:58:14 (35374): No heartbeat from core client for 30 sec - exiting
17:58:15 (35374): No heartbeat from core client for 30 sec - exiting
17:58:16 (35374): No heartbeat from core client for 30 sec - exiting
17:58:17 (35374): No heartbeat from core client for 30 sec - exiting
17:58:18 (35374): No heartbeat from core client for 30 sec - exiting
17:58:19 (35374): No heartbeat from core client for 30 sec - exiting
17:58:20 (35374): No heartbeat from core client for 30 sec - exiting
17:58:21 (35374): No heartbeat from core client for 30 sec - exiting
17:58:22 (35374): No heartbeat from core client for 30 sec - exiting
17:58:23 (35374): No heartbeat from core client for 30 sec - exiting
17:58:24 (35374): No heartbeat from core client for 30 sec - exiting
17:58:25 (35374): No heartbeat from core client for 30 sec - exiting
17:58:26 (35374): No heartbeat from core client for 30 sec - exiting
17:58:27 (35374): No heartbeat from core client for 30 sec - exiting
17:58:28 (35374): No heartbeat from core client for 30 sec - exiting
17:58:29 (35374): No heartbeat from core client for 30 sec - exiting
17:58:30 (35374): No heartbeat from core client for 30 sec - exiting
17:58:31 (35374): No heartbeat from core client for 30 sec - exiting
17:58:32 (35374): No heartbeat from core client for 30 sec - exiting
17:58:33 (35374): No heartbeat from core client for 30 sec - exiting
17:58:34 (35374): No heartbeat from core client for 30 sec - exiting
17:58:35 (35374): No heartbeat from core client for 30 sec - exiting
17:58:36 (35374): No heartbeat from core client for 30 sec - exiting
17:58:37 (35374): No heartbeat from core client for 30 sec - exiting
17:58:38 (35374): No heartbeat from core client for 30 sec - exiting
17:58:39 (35374): No heartbeat from core client for 30 sec - exiting
17:58:40 (35374): No heartbeat from core client for 30 sec - exiting
18:06:54 (35474): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
18:21:56 (35564): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
18:31:57 (35674): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
18:32:02 (35674): No heartbeat from core client for 30 sec - exiting
18:32:03 (35674): No heartbeat from core client for 30 sec - exiting
18:39:24 (35770): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
18:39:30 (35770): No heartbeat from core client for 30 sec - exiting
18:39:31 (35770): No heartbeat from core client for 30 sec - exiting
18:39:32 (35770): No heartbeat from core client for 30 sec - exiting
18:39:33 (35770): No heartbeat from core client for 30 sec - exiting
18:39:34 (35770): No heartbeat from core client for 30 sec - exiting
18:39:35 (35770): No heartbeat from core client for 30 sec - exiting
18:39:36 (35770): No heartbeat from core client for 30 sec - exiting
18:39:37 (35770): No heartbeat from core client for 30 sec - exiting
18:39:38 (35770): No heartbeat from core client for 30 sec - exiting
18:39:52 (35770): No heartbeat from core client for 30 sec - exiting
SIGSEGV: segmentation violation
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
12:59:06 (50171): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
hadcm3n_6.07_i686-apple-darwin(75198,0xa0b1f540) malloc: *** error for object 0x102c604: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(75198,0xa0b1f540) malloc: *** error for object 0x1047c04: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(75198,0xa0b1f540) malloc: *** error for object 0x1047c00: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(75198,0xa0b1f540) malloc: *** error for object 0x601dc04: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(75198,0xa0b1f540) malloc: *** error for object 0x601dc00: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(75198,0xa0b1f540) malloc: *** error for object 0x81b604: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(75198,0xa0b1f540) malloc: *** error for object 0x81b600: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(75198,0xa0b1f540) malloc: *** error for object 0x81b604: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(75198,0xa0b1f540) malloc: *** error for object 0x81b600: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(75198,0xa0b1f540) malloc: *** error for object 0x6003404: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(75198,0xa0b1f540) malloc: *** error for object 0x6004204: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(75198,0xa0b1f540) malloc: *** error for object 0x6004200: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(75198,0xa0b1f540) malloc: *** error for object 0x6004204: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(75198,0xa0b1f540) malloc: *** error for object 0x6004200: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(75198,0xa0b1f540) malloc: *** error for object 0x6004204: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
SIGSEGV: segmentation violation
Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=75208, selfPID=75208, iMonCtr=1
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
22:27:11 (24074): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
22:36:47 (24112): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
22:39:38 (24181): No heartbeat from core client for 30 sec - exiting
22:39:39 (24181): No heartbeat from core client for 30 sec - exiting
22:39:40 (24181): No heartbeat from core client for 30 sec - exiting
22:39:41 (24181): No heartbeat from core client for 30 sec - exiting
22:39:42 (24181): No heartbeat from core client for 30 sec - exiting
22:39:43 (24181): No heartbeat from core client for 30 sec - exiting
22:39:44 (24181): No heartbeat from core client for 30 sec - exiting
22:39:45 (24181): No heartbeat from core client for 30 sec - exiting
22:39:46 (24181): No heartbeat from core client for 30 sec - exiting
22:39:47 (24181): No heartbeat from core client for 30 sec - exiting
22:39:48 (24181): No heartbeat from core client for 30 sec - exiting
22:39:49 (24181): No heartbeat from core client for 30 sec - exiting
22:39:50 (24181): No heartbeat from core client for 30 sec - exiting
22:39:51 (24181): No heartbeat from core client for 30 sec - exiting
22:39:52 (24181): No heartbeat from core client for 30 sec - exiting
22:39:53 (24181): No heartbeat from core client for 30 sec - exiting
22:39:54 (24181): No heartbeat from core client for 30 sec - exiting
22:39:55 (24181): No heartbeat from core client for 30 sec - exiting
22:39:56 (24181): No heartbeat from core client for 30 sec - exiting
22:39:57 (24181): No heartbeat from core client for 30 sec - exiting
22:39:58 (24181): No heartbeat from core client for 30 sec - exiting
22:39:59 (24181): No heartbeat from core client for 30 sec - exiting
22:40:00 (24181): No heartbeat from core client for 30 sec - exiting
22:40:01 (24181): No heartbeat from core client for 30 sec - exiting
22:40:02 (24181): No heartbeat from core client for 30 sec - exiting
22:40:03 (24181): No heartbeat from core client for 30 sec - exiting
22:40:04 (24181): No heartbeat from core client for 30 sec - exiting
22:40:05 (24181): No heartbeat from core client for 30 sec - exiting
22:40:06 (24181): No heartbeat from core client for 30 sec - exiting
22:40:07 (24181): No heartbeat from core client for 30 sec - exiting
22:40:08 (24181): No heartbeat from core client for 30 sec - exiting
22:40:09 (24181): No heartbeat from core client for 30 sec - exiting
22:40:10 (24181): No heartbeat from core client for 30 sec - exiting
22:40:11 (24181): No heartbeat from core client for 30 sec - exiting
22:40:12 (24181): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
22:41:12 (24206): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
23:05:35 (24218): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
23:08:06 (24399): No heartbeat from core client for 30 sec - exiting
23:08:07 (24399): No heartbeat from core client for 30 sec - exiting
23:08:08 (24399): No heartbeat from core client for 30 sec - exiting
23:08:09 (24399): No heartbeat from core client for 30 sec - exiting
23:08:10 (24399): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
23:09:13 (24423): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
23:11:13 (24434): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
23:12:25 (24472): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
23:24:15 (24482): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
23:26:44 (24582): No heartbeat from core client for 30 sec - exiting
23:26:45 (24582): No heartbeat from core client for 30 sec - exiting
23:26:46 (24582): No heartbeat from core client for 30 sec - exiting
23:26:47 (24582): No heartbeat from core client for 30 sec - exiting
23:26:48 (24582): No heartbeat from core client for 30 sec - exiting
23:26:49 (24582): No heartbeat from core client for 30 sec - exiting
23:26:50 (24582): No heartbeat from core client for 30 sec - exiting
23:26:51 (24582): No heartbeat from core client for 30 sec - exiting
23:26:52 (24582): No heartbeat from core client for 30 sec - exiting
23:26:53 (24582): No heartbeat from core client for 30 sec - exiting
23:26:54 (24582): No heartbeat from core client for 30 sec - exiting
23:26:55 (24582): No heartbeat from core client for 30 sec - exiting
23:26:56 (24582): No heartbeat from core client for 30 sec - exiting
23:26:57 (24582): No heartbeat from core client for 30 sec - exiting
23:26:58 (24582): No heartbeat from core client for 30 sec - exiting
23:26:59 (24582): No heartbeat from core client for 30 sec - exiting
23:27:00 (24582): No heartbeat from core client for 30 sec - exiting
23:27:01 (24582): No heartbeat from core client for 30 sec - exiting
23:27:02 (24582): No heartbeat from core client for 30 sec - exiting
23:27:03 (24582): No heartbeat from core client for 30 sec - exiting
23:27:04 (24582): No heartbeat from core client for 30 sec - exiting
23:27:05 (24582): No heartbeat from core client for 30 sec - exiting
23:27:06 (24582): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
23:28:08 (24597): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
23:30:46 (24633): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
23:31:54 (24648): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
23:33:05 (24678): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
23:34:10 (24694): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
23:35:04 (24730): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
23:40:40 (24745): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
23:47:41 (24804): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
23:47:43 (24804): No heartbeat from core client for 30 sec - exiting
23:47:44 (24804): No heartbeat from core client for 30 sec - exiting
23:47:45 (24804): No heartbeat from core client for 30 sec - exiting
23:52:41 (24858): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
00:32:54 (24911): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
00:32:57 (24911): No heartbeat from core client for 30 sec - exiting
00:32:58 (24911): No heartbeat from core client for 30 sec - exiting
00:34:04 (25199): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
00:52:57 (25210): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
00:54:08 (25372): No heartbeat from core client for 30 sec - exiting
00:54:09 (25372): No heartbeat from core client for 30 sec - exiting
00:54:10 (25372): No heartbeat from core client for 30 sec - exiting
00:54:11 (25372): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
00:57:57 (25387): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
00:59:04 (25431): No heartbeat from core client for 30 sec - exiting
00:59:05 (25431): No heartbeat from core client for 30 sec - exiting
00:59:06 (25431): No heartbeat from core client for 30 sec - exiting
00:59:07 (25431): No heartbeat from core client for 30 sec - exiting
00:59:08 (25431): No heartbeat from core client for 30 sec - exiting
00:59:09 (25431): No heartbeat from core client for 30 sec - exiting
00:59:10 (25431): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
01:02:59 (25460): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
01:03:04 (25460): No heartbeat from core client for 30 sec - exiting
01:07:59 (25494): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
01:12:59 (25549): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
04:41:24 (29581): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
04:41:27 (29581): No heartbeat from core client for 30 sec - exiting
04:41:28 (29581): No heartbeat from core client for 30 sec - exiting
04:41:29 (29581): No heartbeat from core client for 30 sec - exiting
04:41:30 (29581): No heartbeat from core client for 30 sec - exiting
04:41:31 (29581): No heartbeat from core client for 30 sec - exiting
04:41:32 (29581): No heartbeat from core client for 30 sec - exiting
04:41:33 (29581): No heartbeat from core client for 30 sec - exiting
04:41:34 (29581): No heartbeat from core client for 30 sec - exiting
04:41:35 (29581): No heartbeat from core client for 30 sec - exiting
04:42:17 (29894): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
04:50:45 (29914): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
04:50:50 (29914): No heartbeat from core client for 30 sec - exiting
04:50:51 (29914): No heartbeat from core client for 30 sec - exiting
04:50:52 (29914): No heartbeat from core client for 30 sec - exiting
04:50:53 (29914): No heartbeat from core client for 30 sec - exiting
04:50:54 (29914): No heartbeat from core client for 30 sec - exiting
04:59:13 (29991): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
05:00:03 (30060): No heartbeat from core client for 30 sec - exiting
05:00:04 (30060): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
05:26:25 (30067): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
05:26:28 (30067): No heartbeat from core client for 30 sec - exiting
05:26:29 (30067): No heartbeat from core client for 30 sec - exiting
05:26:30 (30067): No heartbeat from core client for 30 sec - exiting
05:26:31 (30067): No heartbeat from core client for 30 sec - exiting
05:46:41 (30272): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
05:46:45 (30272): No heartbeat from core client for 30 sec - exiting
05:46:46 (30272): No heartbeat from core client for 30 sec - exiting
05:46:47 (30272): No heartbeat from core client for 30 sec - exiting
05:46:48 (30272): No heartbeat from core client for 30 sec - exiting
05:46:49 (30272): No heartbeat from core client for 30 sec - exiting
05:46:50 (30272): No heartbeat from core client for 30 sec - exiting
05:46:51 (30272): No heartbeat from core client for 30 sec - exiting
05:46:52 (30272): No heartbeat from core client for 30 sec - exiting
05:46:53 (30272): No heartbeat from core client for 30 sec - exiting
05:46:54 (30272): No heartbeat from core client for 30 sec - exiting
05:46:55 (30272): No heartbeat from core client for 30 sec - exiting
05:46:56 (30272): No heartbeat from core client for 30 sec - exiting
05:46:57 (30272): No heartbeat from core client for 30 sec - exiting
05:46:58 (30272): No heartbeat from core client for 30 sec - exiting
05:46:59 (30272): No heartbeat from core client for 30 sec - exiting
05:47:00 (30272): No heartbeat from core client for 30 sec - exiting
05:47:01 (30272): No heartbeat from core client for 30 sec - exiting
05:47:02 (30272): No heartbeat from core client for 30 sec - exiting
05:47:03 (30272): No heartbeat from core client for 30 sec - exiting
05:47:04 (30272): No heartbeat from core client for 30 sec - exiting
05:47:05 (30272): No heartbeat from core client for 30 sec - exiting
05:47:06 (30272): No heartbeat from core client for 30 sec - exiting
05:47:07 (30272): No heartbeat from core client for 30 sec - exiting
05:47:08 (30272): No heartbeat from core client for 30 sec - exiting
05:47:09 (30272): No heartbeat from core client for 30 sec - exiting
05:47:10 (30272): No heartbeat from core client for 30 sec - exiting
05:47:11 (30272): No heartbeat from core client for 30 sec - exiting
05:47:12 (30272): No heartbeat from core client for 30 sec - exiting
05:47:13 (30272): No heartbeat from core client for 30 sec - exiting
05:47:14 (30272): No heartbeat from core client for 30 sec - exiting
05:47:15 (30272): No heartbeat from core client for 30 sec - exiting
05:47:16 (30272): No heartbeat from core client for 30 sec - exiting
05:47:17 (30272): No heartbeat from core client for 30 sec - exiting
05:47:18 (30272): No heartbeat from core client for 30 sec - exiting
05:47:19 (30272): No heartbeat from core client for 30 sec - exiting
05:47:20 (30272): No heartbeat from core client for 30 sec - exiting
05:47:21 (30272): No heartbeat from core client for 30 sec - exiting
05:47:22 (30272): No heartbeat from core client for 30 sec - exiting
05:47:23 (30272): No heartbeat from core client for 30 sec - exiting
05:47:24 (30272): No heartbeat from core client for 30 sec - exiting
05:47:25 (30272): No heartbeat from core client for 30 sec - exiting
05:47:26 (30272): No heartbeat from core client for 30 sec - exiting
05:47:27 (30272): No heartbeat from core client for 30 sec - exiting
05:47:28 (30272): No heartbeat from core client for 30 sec - exiting
05:47:29 (30272): No heartbeat from core client for 30 sec - exiting
05:47:30 (30272): No heartbeat from core client for 30 sec - exiting
05:47:31 (30272): No heartbeat from core client for 30 sec - exiting
05:47:32 (30272): No heartbeat from core client for 30 sec - exiting
05:47:33 (30272): No heartbeat from core client for 30 sec - exiting
05:47:34 (30272): No heartbeat from core client for 30 sec - exiting
05:47:35 (30272): No heartbeat from core client for 30 sec - exiting
05:47:36 (30272): No heartbeat from core client for 30 sec - exiting
05:47:37 (30272): No heartbeat from core client for 30 sec - exiting
05:47:38 (30272): No heartbeat from core client for 30 sec - exiting
05:47:39 (30272): No heartbeat from core client for 30 sec - exiting
05:47:40 (30272): No heartbeat from core client for 30 sec - exiting
05:47:41 (30272): No heartbeat from core client for 30 sec - exiting
05:47:42 (30272): No heartbeat from core client for 30 sec - exiting
05:47:43 (30272): No heartbeat from core client for 30 sec - exiting
05:47:44 (30272): No heartbeat from core client for 30 sec - exiting
05:57:20 (30414): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
05:57:25 (30414): No heartbeat from core client for 30 sec - exiting
05:57:26 (30414): No heartbeat from core client for 30 sec - exiting
05:57:27 (30414): No heartbeat from core client for 30 sec - exiting
05:57:28 (30414): No heartbeat from core client for 30 sec - exiting
05:57:29 (30414): No heartbeat from core client for 30 sec - exiting
05:57:30 (30414): No heartbeat from core client for 30 sec - exiting
06:09:52 (31755): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
06:18:59 (31833): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
06:19:05 (31833): No heartbeat from core client for 30 sec - exiting
06:19:06 (31833): No heartbeat from core client for 30 sec - exiting
06:19:07 (31833): No heartbeat from core client for 30 sec - exiting
06:19:08 (31833): No heartbeat from core client for 30 sec - exiting
06:19:09 (31833): No heartbeat from core client for 30 sec - exiting
06:29:16 (31930): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
06:29:19 (31930): No heartbeat from core client for 30 sec - exiting
06:29:20 (31930): No heartbeat from core client for 30 sec - exiting
06:29:21 (31930): No heartbeat from core client for 30 sec - exiting
06:29:22 (31930): No heartbeat from core client for 30 sec - exiting
06:29:23 (31930): No heartbeat from core client for 30 sec - exiting
06:29:24 (31930): No heartbeat from core client for 30 sec - exiting
06:29:25 (31930): No heartbeat from core client for 30 sec - exiting
06:29:26 (31930): No heartbeat from core client for 30 sec - exiting
06:29:27 (31930): No heartbeat from core client for 30 sec - exiting
06:29:28 (31930): No heartbeat from core client for 30 sec - exiting
06:29:29 (31930): No heartbeat from core client for 30 sec - exiting
06:48:17 (32003): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
06:59:33 (32152): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
SIGABRT: abort called

Crashed executable name: hadcm3n_um_6.07_i686-apple-darwin
built using BOINC library version 6.13.0
Machine type Intel 80486 (32-bit executable)
System version: Macintosh OS 10.6.8 build 10K540
Wed Jul 13 07:00:06 2011

Thread 0 Crashed:
0   libSystem.B.dylib                   0x98d74c5a ___kill + 10
1   libSystem.B.dylib                   0x98e075a5 _raise + 26
2   libSystem.B.dylib                   0x98e1d6e4 _abort + 93
3   hadcm3n_um_6.07_i686-apple-darwin   0x00336cff _um_setup + 127
4   hadcm3n_um_6.07_i686-apple-darwin   0x00389b71 _um_shell + 3953
5   hadcm3n_um_6.07_i686-apple-darwin   0x000048e1 _main + 1153
6   hadcm3n_um_6.07_i686-apple-darwin   0x000027fb __start + 209
7   hadcm3n_um_6.07_i686-apple-darwin   0x00002729 start + 41

Thread 1:
0   libSystem.B.dylib                   0x98d13c0e _mach_wait_until + 10
1   libSystem.B.dylib                   0x98d9b429 _nanosleep + 345
2   libSystem.B.dylib                   0x98d9b2ca _usleep + 61
3   hadcm3n_um_6.07_i686-apple-darwin   0x00442ec0 __Z11boinc_sleepd + 188
4   hadcm3n_um_6.07_i686-apple-darwin   0x0043865e __Z12timer_threadPv + 78
5   libSystem.B.dylib                   0x98d41259 __pthread_start + 345
6   libSystem.B.dylib                   0x98d410de _thread_start + 34

Thread 0 crashed with X86 Thread State (32-bit):
  eax: 0x00000000 ebx: 0x00000000 ecx: 0x00000000 edx: 0x00000000
  edi: 0x00000000 esi: 0x00000000 ebp: 0xbfffc9f8 esp: 0x00000000
   ss: 0x00000000 efl: 0x00000000 eip: 0x00447dc2  cs: 0x00000000
   ds: 0x00000000  es: 0x00000000  fs: 0x00000000  gs: 0x00000000

Binary Images Description:
    0x1000 -   0x4cbfff /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_um_6.07_i686-apple-darwin
0x95976000 - 0x95984fff /usr/lib/libz.1.dylib
0x98d13000 - 0x98ebafff /usr/lib/libSystem.B.dylib
0x98efc000 - 0x98efffff /usr/lib/system/libmathCommon.A.dylib


Exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=32219, iMonCtr=1
Model crash detected, will try to restart...
SIGABRT: abort called

Crashed executable name: hadcm3n_um_6.07_i686-apple-darwin
built using BOINC library version 6.13.0
Machine type Intel 80486 (32-bit executable)
System version: Macintosh OS 10.6.8 build 10K540
Wed Jul 13 07:00:09 2011

Thread 0 Crashed:
0   libSystem.B.dylib                   0x98d74c5a ___kill + 10
1   libSystem.B.dylib                   0x98e075a5 _raise + 26
2   libSystem.B.dylib                   0x98e1d6e4 _abort + 93
3   hadcm3n_um_6.07_i686-apple-darwin   0x00336cff _um_setup + 127
4   hadcm3n_um_6.07_i686-apple-darwin   0x00389b71 _um_shell + 3953
5   hadcm3n_um_6.07_i686-apple-darwin   0x000048e1 _main + 1153
6   hadcm3n_um_6.07_i686-apple-darwin   0x000027fb __start + 209
7   hadcm3n_um_6.07_i686-apple-darwin   0x00002729 start + 41

Thread 1:
0   libSystem.B.dylib                   0x98d13c0e _mach_wait_until + 10
1   libSystem.B.dylib                   0x98d9b429 _nanosleep + 345
2   libSystem.B.dylib                   0x98d9b2ca _usleep + 61
3   hadcm3n_um_6.07_i686-apple-darwin   0x00442ec0 __Z11boinc_sleepd + 188
4   hadcm3n_um_6.07_i686-apple-darwin   0x0043865e __Z12timer_threadPv + 78
5   libSystem.B.dylib                   0x98d41259 __pthread_start + 345
6   libSystem.B.dylib                   0x98d410de _thread_start + 34

Thread 0 crashed with X86 Thread State (32-bit):
  eax: 0x00000000 ebx: 0x00000000 ecx: 0x00000000 edx: 0x00000000
  edi: 0x00000000 esi: 0x00000000 ebp: 0xbfffc9f8 esp: 0x00000000
   ss: 0x00000000 efl: 0x00000000 eip: 0x00447dc2  cs: 0x00000000
   ds: 0x00000000  es: 0x00000000  fs: 0x00000000  gs: 0x00000000

Binary Images Description:
    0x1000 -   0x4cbfff /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_um_6.07_i686-apple-darwin
0x95976000 - 0x95984fff /usr/lib/libz.1.dylib
0x98d13000 - 0x98ebafff /usr/lib/libSystem.B.dylib
0x98efc000 - 0x98efffff /usr/lib/system/libmathCommon.A.dylib


Exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=32219, iMonCtr=1
Model crash detected, will try to restart...
SIGABRT: abort called

Crashed executable name: hadcm3n_um_6.07_i686-apple-darwin
built using BOINC library version 6.13.0
Machine type Intel 80486 (32-bit executable)
System version: Macintosh OS 10.6.8 build 10K540
Wed Jul 13 07:00:12 2011

Thread 0 Crashed:
0   libSystem.B.dylib                   0x98d74c5a ___kill + 10
1   libSystem.B.dylib                   0x98e075a5 _raise + 26
2   libSystem.B.dylib                   0x98e1d6e4 _abort + 93
3   hadcm3n_um_6.07_i686-apple-darwin   0x00336cff _um_setup + 127
4   hadcm3n_um_6.07_i686-apple-darwin   0x00389b71 _um_shell + 3953
5   hadcm3n_um_6.07_i686-apple-darwin   0x000048e1 _main + 1153
6   hadcm3n_um_6.07_i686-apple-darwin   0x000027fb __start + 209
7   hadcm3n_um_6.07_i686-apple-darwin   0x00002729 start + 41

Thread 1:
0   libSystem.B.dylib                   0x98d13c0e _mach_wait_until + 10
1   libSystem.B.dylib                   0x98d9b429 _nanosleep + 345
2   libSystem.B.dylib                   0x98d9b2ca _usleep + 61
3   hadcm3n_um_6.07_i686-apple-darwin   0x00442ec0 __Z11boinc_sleepd + 188
4   hadcm3n_um_6.07_i686-apple-darwin   0x0043865e __Z12timer_threadPv + 78
5   libSystem.B.dylib                   0x98d41259 __pthread_start + 345
6   libSystem.B.dylib                   0x98d410de _thread_start + 34

Thread 0 crashed with X86 Thread State (32-bit):
  eax: 0x00000000 ebx: 0x00000000 ecx: 0x00000000 edx: 0x00000000
  edi: 0x00000000 esi: 0x00000000 ebp: 0xbfffc9f8 esp: 0x00000000
   ss: 0x00000000 efl: 0x00000000 eip: 0x00447dc2  cs: 0x00000000
   ds: 0x00000000  es: 0x00000000  fs: 0x00000000  gs: 0x00000000

Binary Images Description:
    0x1000 -   0x4cbfff /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_um_6.07_i686-apple-darwin
0x95976000 - 0x95984fff /usr/lib/libz.1.dylib
0x98d13000 - 0x98ebafff /usr/lib/libSystem.B.dylib
0x98efc000 - 0x98efffff /usr/lib/system/libmathCommon.A.dylib


Exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=32219, iMonCtr=1
Model crash detected, will try to restart...
SIGABRT: abort called

Crashed executable name: hadcm3n_um_6.07_i686-apple-darwin
built using BOINC library version 6.13.0
Machine type Intel 80486 (32-bit executable)
System version: Macintosh OS 10.6.8 build 10K540
Wed Jul 13 07:00:15 2011

Thread 0 Crashed:
0   libSystem.B.dylib                   0x98d74c5a ___kill + 10
1   libSystem.B.dylib                   0x98e075a5 _raise + 26
2   libSystem.B.dylib                   0x98e1d6e4 _abort + 93
3   hadcm3n_um_6.07_i686-apple-darwin   0x00336cff _um_setup + 127
4   hadcm3n_um_6.07_i686-apple-darwin   0x00389b71 _um_shell + 3953
5   hadcm3n_um_6.07_i686-apple-darwin   0x000048e1 _main + 1153
6   hadcm3n_um_6.07_i686-apple-darwin   0x000027fb __start + 209
7   hadcm3n_um_6.07_i686-apple-darwin   0x00002729 start + 41

Thread 1:
0   libSystem.B.dylib                   0x98d13c0e _mach_wait_until + 10
1   libSystem.B.dylib                   0x98d9b429 _nanosleep + 345
2   libSystem.B.dylib                   0x98d9b2ca _usleep + 61
3   hadcm3n_um_6.07_i686-apple-darwin   0x00442ec0 __Z11boinc_sleepd + 188
4   hadcm3n_um_6.07_i686-apple-darwin   0x0043865e __Z12timer_threadPv + 78
5   libSystem.B.dylib                   0x98d41259 __pthread_start + 345
6   libSystem.B.dylib                   0x98d410de _thread_start + 34

Thread 0 crashed with X86 Thread State (32-bit):
  eax: 0x00000000 ebx: 0x00000000 ecx: 0x00000000 edx: 0x00000000
  edi: 0x00000000 esi: 0x00000000 ebp: 0xbfffc9f8 esp: 0x00000000
   ss: 0x00000000 efl: 0x00000000 eip: 0x00447dc2  cs: 0x00000000
   ds: 0x00000000  es: 0x00000000  fs: 0x00000000  gs: 0x00000000

Binary Images Description:
    0x1000 -   0x4cbfff /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_um_6.07_i686-apple-darwin
0x95976000 - 0x95984fff /usr/lib/libz.1.dylib
0x98d13000 - 0x98ebafff /usr/lib/libSystem.B.dylib
0x98efc000 - 0x98efffff /usr/lib/system/libmathCommon.A.dylib


Exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=32219, iMonCtr=1
Model crash detected, will try to restart...
SIGABRT: abort called

Crashed executable name: hadcm3n_um_6.07_i686-apple-darwin
built using BOINC library version 6.13.0
Machine type Intel 80486 (32-bit executable)
System version: Macintosh OS 10.6.8 build 10K540
Wed Jul 13 07:00:18 2011

Thread 0 Crashed:
0   libSystem.B.dylib                   0x98d74c5a ___kill + 10
1   libSystem.B.dylib                   0x98e075a5 _raise + 26
2   libSystem.B.dylib                   0x98e1d6e4 _abort + 93
3   hadcm3n_um_6.07_i686-apple-darwin   0x00336cff _um_setup + 127
4   hadcm3n_um_6.07_i686-apple-darwin   0x00389b71 _um_shell + 3953
5   hadcm3n_um_6.07_i686-apple-darwin   0x000048e1 _main + 1153
6   hadcm3n_um_6.07_i686-apple-darwin   0x000027fb __start + 209
7   hadcm3n_um_6.07_i686-apple-darwin   0x00002729 start + 41

Thread 1:
0   libSystem.B.dylib                   0x98d13c0e _mach_wait_until + 10
1   libSystem.B.dylib                   0x98d9b429 _nanosleep + 345
2   libSystem.B.dylib                   0x98d9b2ca _usleep + 61
3   hadcm3n_um_6.07_i686-apple-darwin   0x00442ec0 __Z11boinc_sleepd + 188
4   hadcm3n_um_6.07_i686-apple-darwin   0x0043865e __Z12timer_threadPv + 78
5   libSystem.B.dylib                   0x98d41259 __pthread_start + 345
6   libSystem.B.dylib                   0x98d410de _thread_start + 34

Thread 0 crashed with X86 Thread State (32-bit):
  eax: 0x00000000 ebx: 0x00000000 ecx: 0x00000000 edx: 0x00000000
  edi: 0x00000000 esi: 0x00000000 ebp: 0xbfffc9f8 esp: 0x00000000
   ss: 0x00000000 efl: 0x00000000 eip: 0x00447dc2  cs: 0x00000000
   ds: 0x00000000  es: 0x00000000  fs: 0x00000000  gs: 0x00000000

Binary Images Description:
    0x1000 -   0x4cbfff /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_um_6.07_i686-apple-darwin
0x95976000 - 0x95984fff /usr/lib/libz.1.dylib
0x98d13000 - 0x98ebafff /usr/lib/libSystem.B.dylib
0x98efc000 - 0x98efffff /usr/lib/system/libmathCommon.A.dylib


Exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=32219, iMonCtr=1
Model crash detected, will try to restart...
SIGABRT: abort called

Crashed executable name: hadcm3n_um_6.07_i686-apple-darwin
built using BOINC library version 6.13.0
Machine type Intel 80486 (32-bit executable)
System version: Macintosh OS 10.6.8 build 10K540
Wed Jul 13 07:00:22 2011

Thread 0 Crashed:
09:09:54 (32219): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
SIGABRT: abort called

Crashed executable name: hadcm3n_um_6.07_i686-apple-darwin
built using BOINC library version 6.13.0
Machine type Intel 80486 (32-bit executable)
System version: Macintosh OS 10.6.8 build 10K540
Wed Jul 13 09:10:28 2011

Thread 0 Crashed:
0   libSystem.B.dylib                   0x98d74c5a ___kill + 10
1   libSystem.B.dylib                   0x98e075a5 _raise + 26
2   libSystem.B.dylib                   0x98e1d6e4 _abort + 93
3   hadcm3n_um_6.07_i686-apple-darwin   0x00336cff _um_setup + 127
4   hadcm3n_um_6.07_i686-apple-darwin   0x00389b71 _um_shell + 3953
5   hadcm3n_um_6.07_i686-apple-darwin   0x000048e1 _main + 1153
6   hadcm3n_um_6.07_i686-apple-darwin   0x000027fb __start + 209
7   hadcm3n_um_6.07_i686-apple-darwin   0x00002729 start + 41

Thread 1:
0   libSystem.B.dylib                   0x98d13c0e _mach_wait_until + 10
1   libSystem.B.dylib                   0x98d9b429 _nanosleep + 345
2   libSystem.B.dylib                   0x98d9b2ca _usleep + 61
3   hadcm3n_um_6.07_i686-apple-darwin   0x00442ec0 __Z11boinc_sleepd + 188
4   hadcm3n_um_6.07_i686-apple-darwin   0x0043865e __Z12timer_threadPv + 78
5   libSystem.B.dylib                   0x98d41259 __pthread_start + 345
6   libSystem.B.dylib                   0x98d410de _thread_start + 34

Thread 0 crashed with X86 Thread State (32-bit):
  eax: 0x00000000 ebx: 0x00000000 ecx: 0x00000000 edx: 0x00000000
  edi: 0x00000000 esi: 0x00000000 ebp: 0xbfffc9f8 esp: 0x00000000
   ss: 0x00000000 efl: 0x00000000 eip: 0x00447dc2  cs: 0x00000000
   ds: 0x00000000  es: 0x00000000  fs: 0x00000000  gs: 0x00000000

Binary Images Description:
    0x1000 -   0x4cbfff /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_um_6.07_i686-apple-darwin
0x95976000 - 0x95984fff /usr/lib/libz.1.dylib
0x98d13000 - 0x98ebafff /usr/lib/libSystem.B.dylib
0x98efc000 - 0x98efffff /usr/lib/system/libmathCommon.A.dylib


Exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=35716, iMonCtr=1
Model crash detected, will try to restart...
Sorry, too many model crashes! :-(
Called boinc_finish

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
25 Jul 2011 13:33:29 1006135 13016827 hadcm3n_t4bu_1940_40_007312659_1 440,640 877,675 1.9918
25 Jul 2011 13:33:29 1006135 13016827 hadcm3n_t4bu_1940_40_007312659_1 414,720 825,825 1.9913
25 Jul 2011 13:33:29 1006135 13016827 hadcm3n_t4bu_1940_40_007312659_1 388,800 774,105 1.9910
10 Jul 2011 08:56:44 1006135 13016827 hadcm3n_t4bu_1940_40_007312659_1 362,880 722,215 1.9902
09 Jul 2011 15:52:44 1006135 13016827 hadcm3n_t4bu_1940_40_007312659_1 336,960 670,022 1.9884
08 Jul 2011 20:54:42 1006135 13016827 hadcm3n_t4bu_1940_40_007312659_1 311,040 618,593 1.9888
08 Jul 2011 05:42:31 1006135 13016827 hadcm3n_t4bu_1940_40_007312659_1 285,120 567,384 1.9900
07 Jul 2011 15:43:27 1006135 13016827 hadcm3n_t4bu_1940_40_007312659_1 259,200 515,848 1.9902
07 Jul 2011 15:42:56 1006135 13016827 hadcm3n_t4bu_1940_40_007312659_1 233,280 464,275 1.9902
07 Jul 2011 15:42:56 1006135 13016827 hadcm3n_t4bu_1940_40_007312659_1 207,360 413,075 1.9921
05 Jul 2011 12:35:29 1006135 13016827 hadcm3n_t4bu_1940_40_007312659_1 181,440 362,787 1.9995
04 Jul 2011 15:38:12 1006135 13016827 hadcm3n_t4bu_1940_40_007312659_1 155,520 311,649 2.0039
03 Jul 2011 10:30:36 1006135 13016827 hadcm3n_t4bu_1940_40_007312659_1 129,600 261,212 2.0155
01 Jul 2011 21:58:48 1006135 13016827 hadcm3n_t4bu_1940_40_007312659_1 103,680 209,303 2.0187
30 Jun 2011 20:28:02 1006135 13016827 hadcm3n_t4bu_1940_40_007312659_1 77,760 157,005 2.0191
30 Jun 2011 00:21:19 1006135 13016827 hadcm3n_t4bu_1940_40_007312659_1 51,840 104,713 2.0199
28 Jun 2011 21:32:28 1006135 13016827 hadcm3n_t4bu_1940_40_007312659_1 25,920 52,817 2.0377


©2024 climateprediction.net