climateprediction.net home page
Task 13363348

Task 13363348

Name hadcm3n_t69j_1940_40_007449321_1
Workunit 7646824
Created 9 Sep 2011, 23:49:59 UTC
Sent 9 Sep 2011, 23:59:40 UTC
Report deadline 10 Dec 2011, 7:26:51 UTC
Received 15 Oct 2011, 1:17:59 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 193 (0x000000C1) EXIT_SIGNAL
Computer ID 1029940
Run time 9 days 23 hours 15 min 23 sec
CPU time 9 days 10 hours 45 min 49 sec
Validate state Invalid
Credit 6,220.80
Device peak FLOPS 2.57 GFLOPS
Application version UK Met Office Coupled Model Full Resolution Ocean v6.07
i686-apple-darwin
Stderr
<core_client_version>6.10.17</core_client_version>
<![CDATA[
<message>
process exited with code 193 (0xc1, -63)
</message>
<stderr_txt>
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
16:48:19 (254): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
19:21:31 (9111): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
19:21:32 (9111): No heartbeat from core client for 30 sec - exiting
19:21:33 (9111): No heartbeat from core client for 30 sec - exiting
19:21:34 (9111): No heartbeat from core client for 30 sec - exiting
19:21:35 (9111): No heartbeat from core client for 30 sec - exiting
19:21:36 (9111): No heartbeat from core client for 30 sec - exiting
19:21:37 (9111): No heartbeat from core client for 30 sec - exiting
19:21:38 (9111): No heartbeat from core client for 30 sec - exiting
19:21:39 (9111): No heartbeat from core client for 30 sec - exiting
19:21:40 (9111): No heartbeat from core client for 30 sec - exiting
19:21:41 (9111): No heartbeat from core client for 30 sec - exiting
19:21:42 (9111): No heartbeat from core client for 30 sec - exiting
19:21:43 (9111): No heartbeat from core client for 30 sec - exiting
19:21:44 (9111): No heartbeat from core client for 30 sec - exiting
19:21:45 (9111): No heartbeat from core client for 30 sec - exiting
19:21:46 (9111): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - Quit request from BOINC...
09:36:16 (226): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
09:36:17 (226): No heartbeat from core client for 30 sec - exiting
09:36:18 (226): No heartbeat from core client for 30 sec - exiting
09:36:19 (226): No heartbeat from core client for 30 sec - exiting
09:36:20 (226): No heartbeat from core client for 30 sec - exiting
09:36:21 (226): No heartbeat from core client for 30 sec - exiting
09:36:22 (226): No heartbeat from core client for 30 sec - exiting
09:36:23 (226): No heartbeat from core client for 30 sec - exiting
09:36:24 (226): No heartbeat from core client for 30 sec - exiting
09:36:25 (226): No heartbeat from core client for 30 sec - exiting
09:36:26 (226): No heartbeat from core client for 30 sec - exiting
09:36:27 (226): No heartbeat from core client for 30 sec - exiting
09:36:28 (226): No heartbeat from core client for 30 sec - exiting
09:36:29 (226): No heartbeat from core client for 30 sec - exiting
09:36:30 (226): No heartbeat from core client for 30 sec - exiting
09:36:31 (226): No heartbeat from core client for 30 sec - exiting
09:36:32 (226): No heartbeat from core client for 30 sec - exiting
09:38:14 (1453): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
09:50:46 (1485): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
09:50:47 (1485): No heartbeat from core client for 30 sec - exiting
09:50:48 (1485): No heartbeat from core client for 30 sec - exiting
09:50:49 (1485): No heartbeat from core client for 30 sec - exiting
09:50:50 (1485): No heartbeat from core client for 30 sec - exiting
09:50:51 (1485): No heartbeat from core client for 30 sec - exiting
09:50:52 (1485): No heartbeat from core client for 30 sec - exiting
09:50:53 (1485): No heartbeat from core client for 30 sec - exiting
09:50:54 (1485): No heartbeat from core client for 30 sec - exiting
09:50:55 (1485): No heartbeat from core client for 30 sec - exiting
09:50:56 (1485): No heartbeat from core client for 30 sec - exiting
09:50:57 (1485): No heartbeat from core client for 30 sec - exiting
09:50:58 (1485): No heartbeat from core client for 30 sec - exiting
09:50:59 (1485): No heartbeat from core client for 30 sec - exiting
09:51:00 (1485): No heartbeat from core client for 30 sec - exiting
09:51:01 (1485): No heartbeat from core client for 30 sec - exiting
09:51:02 (1485): No heartbeat from core client for 30 sec - exiting
09:51:03 (1485): No heartbeat from core client for 30 sec - exiting
09:52:43 (1720): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
09:54:02 (1743): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
09:55:19 (1774): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
09:56:17 (1792): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
09:56:18 (1792): No heartbeat from core client for 30 sec - exiting
09:56:19 (1792): No heartbeat from core client for 30 sec - exiting
09:56:20 (1792): No heartbeat from core client for 30 sec - exiting
09:56:21 (1792): No heartbeat from core client for 30 sec - exiting
09:56:22 (1792): No heartbeat from core client for 30 sec - exiting
09:56:23 (1792): No heartbeat from core client for 30 sec - exiting
09:56:24 (1792): No heartbeat from core client for 30 sec - exiting
09:56:25 (1792): No heartbeat from core client for 30 sec - exiting
09:56:26 (1792): No heartbeat from core client for 30 sec - exiting
09:56:27 (1792): No heartbeat from core client for 30 sec - exiting
09:56:28 (1792): No heartbeat from core client for 30 sec - exiting
09:56:29 (1792): No heartbeat from core client for 30 sec - exiting
09:56:30 (1792): No heartbeat from core client for 30 sec - exiting
09:56:31 (1792): No heartbeat from core client for 30 sec - exiting
09:56:32 (1792): No heartbeat from core client for 30 sec - exiting
09:57:28 (1805): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
09:58:49 (1823): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
10:00:55 (1854): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
10:00:56 (1854): No heartbeat from core client for 30 sec - exiting
10:00:57 (1854): No heartbeat from core client for 30 sec - exiting
10:00:58 (1854): No heartbeat from core client for 30 sec - exiting
10:00:59 (1854): No heartbeat from core client for 30 sec - exiting
10:01:00 (1854): No heartbeat from core client for 30 sec - exiting
10:01:01 (1854): No heartbeat from core client for 30 sec - exiting
10:01:02 (1854): No heartbeat from core client for 30 sec - exiting
10:01:03 (1854): No heartbeat from core client for 30 sec - exiting
10:01:04 (1854): No heartbeat from core client for 30 sec - exiting
10:01:05 (1854): No heartbeat from core client for 30 sec - exiting
10:01:06 (1854): No heartbeat from core client for 30 sec - exiting
10:01:07 (1854): No heartbeat from core client for 30 sec - exiting
10:01:08 (1854): No heartbeat from core client for 30 sec - exiting
10:01:09 (1854): No heartbeat from core client for 30 sec - exiting
10:01:10 (1854): No heartbeat from core client for 30 sec - exiting
10:01:11 (1854): No heartbeat from core client for 30 sec - exiting
10:01:12 (1854): No heartbeat from core client for 30 sec - exiting
10:01:13 (1854): No heartbeat from core client for 30 sec - exiting
10:01:14 (1854): No heartbeat from core client for 30 sec - exiting
10:02:45 (1890): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
10:02:46 (1890): No heartbeat from core client for 30 sec - exiting
10:02:47 (1890): No heartbeat from core client for 30 sec - exiting
10:02:48 (1890): No heartbeat from core client for 30 sec - exiting
10:02:49 (1890): No heartbeat from core client for 30 sec - exiting
10:02:50 (1890): No heartbeat from core client for 30 sec - exiting
10:02:52 (1890): No heartbeat from core client for 30 sec - exiting
10:02:53 (1890): No heartbeat from core client for 30 sec - exiting
10:02:54 (1890): No heartbeat from core client for 30 sec - exiting
10:02:55 (1890): No heartbeat from core client for 30 sec - exiting
10:02:56 (1890): No heartbeat from core client for 30 sec - exiting
10:02:57 (1890): No heartbeat from core client for 30 sec - exiting
10:02:58 (1890): No heartbeat from core client for 30 sec - exiting
10:02:59 (1890): No heartbeat from core client for 30 sec - exiting
10:03:00 (1890): No heartbeat from core client for 30 sec - exiting
10:03:01 (1890): No heartbeat from core client for 30 sec - exiting
10:03:02 (1890): No heartbeat from core client for 30 sec - exiting
10:03:03 (1890): No heartbeat from core client for 30 sec - exiting
10:03:04 (1890): No heartbeat from core client for 30 sec - exiting
10:03:05 (1890): No heartbeat from core client for 30 sec - exiting
10:03:06 (1890): No heartbeat from core client for 30 sec - exiting
10:04:37 (1918): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
10:04:38 (1918): No heartbeat from core client for 30 sec - exiting
10:04:40 (1918): No heartbeat from core client for 30 sec - exiting
10:04:41 (1918): No heartbeat from core client for 30 sec - exiting
10:04:42 (1918): No heartbeat from core client for 30 sec - exiting
10:04:43 (1918): No heartbeat from core client for 30 sec - exiting
10:04:44 (1918): No heartbeat from core client for 30 sec - exiting
10:04:45 (1918): No heartbeat from core client for 30 sec - exiting
10:04:46 (1918): No heartbeat from core client for 30 sec - exiting
10:04:47 (1918): No heartbeat from core client for 30 sec - exiting
10:04:48 (1918): No heartbeat from core client for 30 sec - exiting
10:04:49 (1918): No heartbeat from core client for 30 sec - exiting
10:04:50 (1918): No heartbeat from core client for 30 sec - exiting
10:04:51 (1918): No heartbeat from core client for 30 sec - exiting
10:04:52 (1918): No heartbeat from core client for 30 sec - exiting
10:04:53 (1918): No heartbeat from core client for 30 sec - exiting
10:04:54 (1918): No heartbeat from core client for 30 sec - exiting
10:04:55 (1918): No heartbeat from core client for 30 sec - exiting
10:04:56 (1918): No heartbeat from core client for 30 sec - exiting
10:04:57 (1918): No heartbeat from core client for 30 sec - exiting
10:04:58 (1918): No heartbeat from core client for 30 sec - exiting
10:04:59 (1918): No heartbeat from core client for 30 sec - exiting
10:05:49 (1946): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
10:07:00 (1972): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
10:08:24 (1995): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
10:10:19 (2010): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
10:10:20 (2010): No heartbeat from core client for 30 sec - exiting
10:10:21 (2010): No heartbeat from core client for 30 sec - exiting
10:10:22 (2010): No heartbeat from core client for 30 sec - exiting
10:10:23 (2010): No heartbeat from core client for 30 sec - exiting
10:10:24 (2010): No heartbeat from core client for 30 sec - exiting
10:10:25 (2010): No heartbeat from core client for 30 sec - exiting
10:12:50 (2064): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
10:12:51 (2064): No heartbeat from core client for 30 sec - exiting
10:12:52 (2064): No heartbeat from core client for 30 sec - exiting
10:12:53 (2064): No heartbeat from core client for 30 sec - exiting
10:12:54 (2064): No heartbeat from core client for 30 sec - exiting
10:12:55 (2064): No heartbeat from core client for 30 sec - exiting
10:12:56 (2064): No heartbeat from core client for 30 sec - exiting
10:12:57 (2064): No heartbeat from core client for 30 sec - exiting
10:12:58 (2064): No heartbeat from core client for 30 sec - exiting
10:12:59 (2064): No heartbeat from core client for 30 sec - exiting
10:13:00 (2064): No heartbeat from core client for 30 sec - exiting
10:13:01 (2064): No heartbeat from core client for 30 sec - exiting
10:13:02 (2064): No heartbeat from core client for 30 sec - exiting
10:13:03 (2064): No heartbeat from core client for 30 sec - exiting
10:13:04 (2064): No heartbeat from core client for 30 sec - exiting
10:13:05 (2064): No heartbeat from core client for 30 sec - exiting
10:13:06 (2064): No heartbeat from core client for 30 sec - exiting
10:13:07 (2064): No heartbeat from core client for 30 sec - exiting
10:13:08 (2064): No heartbeat from core client for 30 sec - exiting
10:13:09 (2064): No heartbeat from core client for 30 sec - exiting
10:13:10 (2064): No heartbeat from core client for 30 sec - exiting
10:13:11 (2064): No heartbeat from core client for 30 sec - exiting
10:13:12 (2064): No heartbeat from core client for 30 sec - exiting
10:13:47 (2094): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
10:13:48 (2094): No heartbeat from core client for 30 sec - exiting
10:13:49 (2094): No heartbeat from core client for 30 sec - exiting
10:13:50 (2094): No heartbeat from core client for 30 sec - exiting
10:13:51 (2094): No heartbeat from core client for 30 sec - exiting
10:13:52 (2094): No heartbeat from core client for 30 sec - exiting
10:13:53 (2094): No heartbeat from core client for 30 sec - exiting
10:13:54 (2094): No heartbeat from core client for 30 sec - exiting
10:13:55 (2094): No heartbeat from core client for 30 sec - exiting
10:13:56 (2094): No heartbeat from core client for 30 sec - exiting
10:13:57 (2094): No heartbeat from core client for 30 sec - exiting
10:13:58 (2094): No heartbeat from core client for 30 sec - exiting
10:13:59 (2094): No heartbeat from core client for 30 sec - exiting
10:14:00 (2094): No heartbeat from core client for 30 sec - exiting
10:14:01 (2094): No heartbeat from core client for 30 sec - exiting
10:14:02 (2094): No heartbeat from core client for 30 sec - exiting
10:15:08 (2107): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
10:16:38 (2126): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
10:18:04 (2157): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
10:19:09 (2179): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
10:20:31 (2196): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
10:21:42 (2212): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
10:23:53 (2252): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
10:25:01 (2268): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
10:26:31 (2287): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
10:27:37 (2304): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
10:28:57 (2332): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
10:31:51 (2363): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
10:31:52 (2363): No heartbeat from core client for 30 sec - exiting
10:31:53 (2363): No heartbeat from core client for 30 sec - exiting
10:31:54 (2363): No heartbeat from core client for 30 sec - exiting
10:31:55 (2363): No heartbeat from core client for 30 sec - exiting
10:31:56 (2363): No heartbeat from core client for 30 sec - exiting
10:31:57 (2363): No heartbeat from core client for 30 sec - exiting
10:31:58 (2363): No heartbeat from core client for 30 sec - exiting
10:31:59 (2363): No heartbeat from core client for 30 sec - exiting
10:32:00 (2363): No heartbeat from core client for 30 sec - exiting
10:32:01 (2363): No heartbeat from core client for 30 sec - exiting
10:32:02 (2363): No heartbeat from core client for 30 sec - exiting
10:32:03 (2363): No heartbeat from core client for 30 sec - exiting
10:32:04 (2363): No heartbeat from core client for 30 sec - exiting
10:32:05 (2363): No heartbeat from core client for 30 sec - exiting
10:32:06 (2363): No heartbeat from core client for 30 sec - exiting
10:32:07 (2363): No heartbeat from core client for 30 sec - exiting
10:32:08 (2363): No heartbeat from core client for 30 sec - exiting
10:32:09 (2363): No heartbeat from core client for 30 sec - exiting
10:32:10 (2363): No heartbeat from core client for 30 sec - exiting
10:32:11 (2363): No heartbeat from core client for 30 sec - exiting
10:32:12 (2363): No heartbeat from core client for 30 sec - exiting
10:32:13 (2363): No heartbeat from core client for 30 sec - exiting
10:33:11 (2395): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
10:34:15 (2430): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
10:34:16 (2430): No heartbeat from core client for 30 sec - exiting
10:34:17 (2430): No heartbeat from core client for 30 sec - exiting
10:34:18 (2430): No heartbeat from core client for 30 sec - exiting
10:34:19 (2430): No heartbeat from core client for 30 sec - exiting
10:34:20 (2430): No heartbeat from core client for 30 sec - exiting
10:34:21 (2430): No heartbeat from core client for 30 sec - exiting
10:34:22 (2430): No heartbeat from core client for 30 sec - exiting
10:34:23 (2430): No heartbeat from core client for 30 sec - exiting
10:34:24 (2430): No heartbeat from core client for 30 sec - exiting
10:34:25 (2430): No heartbeat from core client for 30 sec - exiting
10:34:26 (2430): No heartbeat from core client for 30 sec - exiting
10:34:27 (2430): No heartbeat from core client for 30 sec - exiting
10:34:28 (2430): No heartbeat from core client for 30 sec - exiting
10:34:29 (2430): No heartbeat from core client for 30 sec - exiting
10:34:30 (2430): No heartbeat from core client for 30 sec - exiting
10:34:31 (2430): No heartbeat from core client for 30 sec - exiting
10:35:27 (2443): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
10:37:57 (2469): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
10:40:28 (2494): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
10:40:29 (2494): No heartbeat from core client for 30 sec - exiting
10:40:30 (2494): No heartbeat from core client for 30 sec - exiting
10:40:31 (2494): No heartbeat from core client for 30 sec - exiting
10:40:32 (2494): No heartbeat from core client for 30 sec - exiting
10:40:33 (2494): No heartbeat from core client for 30 sec - exiting
10:40:34 (2494): No heartbeat from core client for 30 sec - exiting
10:40:35 (2494): No heartbeat from core client for 30 sec - exiting
10:40:36 (2494): No heartbeat from core client for 30 sec - exiting
10:40:37 (2494): No heartbeat from core client for 30 sec - exiting
10:40:38 (2494): No heartbeat from core client for 30 sec - exiting
10:40:39 (2494): No heartbeat from core client for 30 sec - exiting
10:40:40 (2494): No heartbeat from core client for 30 sec - exiting
10:40:41 (2494): No heartbeat from core client for 30 sec - exiting
10:40:42 (2494): No heartbeat from core client for 30 sec - exiting
10:40:43 (2494): No heartbeat from core client for 30 sec - exiting
10:40:44 (2494): No heartbeat from core client for 30 sec - exiting
10:40:45 (2494): No heartbeat from core client for 30 sec - exiting
10:41:40 (2564): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
10:43:22 (2581): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
10:44:34 (2607): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
10:46:49 (2646): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
10:46:50 (2646): No heartbeat from core client for 30 sec - exiting
10:46:51 (2646): No heartbeat from core client for 30 sec - exiting
10:46:52 (2646): No heartbeat from core client for 30 sec - exiting
10:46:53 (2646): No heartbeat from core client for 30 sec - exiting
10:46:54 (2646): No heartbeat from core client for 30 sec - exiting
10:46:55 (2646): No heartbeat from core client for 30 sec - exiting
10:46:56 (2646): No heartbeat from core client for 30 sec - exiting
10:46:57 (2646): No heartbeat from core client for 30 sec - exiting
10:46:58 (2646): No heartbeat from core client for 30 sec - exiting
10:46:59 (2646): No heartbeat from core client for 30 sec - exiting
10:47:00 (2646): No heartbeat from core client for 30 sec - exiting
10:47:01 (2646): No heartbeat from core client for 30 sec - exiting
10:47:02 (2646): No heartbeat from core client for 30 sec - exiting
10:47:03 (2646): No heartbeat from core client for 30 sec - exiting
10:48:19 (2660): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
10:49:48 (2690): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
16:49:47 (2708): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
16:49:49 (2708): No heartbeat from core client for 30 sec - exiting
16:49:50 (2708): No heartbeat from core client for 30 sec - exiting
16:49:51 (2708): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
15:11:22 (5793): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
15:14:05 (5812): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
15:14:06 (5812): No heartbeat from core client for 30 sec - exiting
15:14:07 (5812): No heartbeat from core client for 30 sec - exiting
15:14:08 (5812): No heartbeat from core client for 30 sec - exiting
15:14:09 (5812): No heartbeat from core client for 30 sec - exiting
15:14:10 (5812): No heartbeat from core client for 30 sec - exiting
15:14:11 (5812): No heartbeat from core client for 30 sec - exiting
15:14:12 (5812): No heartbeat from core client for 30 sec - exiting
15:14:13 (5812): No heartbeat from core client for 30 sec - exiting
15:14:14 (5812): No heartbeat from core client for 30 sec - exiting
15:14:15 (5812): No heartbeat from core client for 30 sec - exiting
15:14:16 (5812): No heartbeat from core client for 30 sec - exiting
15:14:17 (5812): No heartbeat from core client for 30 sec - exiting
15:14:18 (5812): No heartbeat from core client for 30 sec - exiting
15:14:19 (5812): No heartbeat from core client for 30 sec - exiting
15:14:20 (5812): No heartbeat from core client for 30 sec - exiting
15:14:21 (5812): No heartbeat from core client for 30 sec - exiting
15:15:28 (5865): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
21:22:34 (12797): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
22:10:07 (12827): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
22:10:08 (12827): No heartbeat from core client for 30 sec - exiting
22:10:09 (12827): No heartbeat from core client for 30 sec - exiting
22:10:10 (12827): No heartbeat from core client for 30 sec - exiting
22:10:11 (12827): No heartbeat from core client for 30 sec - exiting
22:10:12 (12827): No heartbeat from core client for 30 sec - exiting
22:10:13 (12827): No heartbeat from core client for 30 sec - exiting
22:10:14 (12827): No heartbeat from core client for 30 sec - exiting
22:10:15 (12827): No heartbeat from core client for 30 sec - exiting
22:10:16 (12827): No heartbeat from core client for 30 sec - exiting
22:10:17 (12827): No heartbeat from core client for 30 sec - exiting
22:10:18 (12827): No heartbeat from core client for 30 sec - exiting
22:10:19 (12827): No heartbeat from core client for 30 sec - exiting
22:10:20 (12827): No heartbeat from core client for 30 sec - exiting
22:10:21 (12827): No heartbeat from core client for 30 sec - exiting
22:10:22 (12827): No heartbeat from core client for 30 sec - exiting
22:10:23 (12827): No heartbeat from core client for 30 sec - exiting
22:10:24 (12827): No heartbeat from core client for 30 sec - exiting
22:10:25 (12827): No heartbeat from core client for 30 sec - exiting
22:10:26 (12827): No heartbeat from core client for 30 sec - exiting
22:10:27 (12827): No heartbeat from core client for 30 sec - exiting
22:10:28 (12827): No heartbeat from core client for 30 sec - exiting
22:10:29 (12827): No heartbeat from core client for 30 sec - exiting
22:10:30 (12827): No heartbeat from core client for 30 sec - exiting
22:10:31 (12827): No heartbeat from core client for 30 sec - exiting
22:10:32 (12827): No heartbeat from core client for 30 sec - exiting
22:11:25 (13722): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
07:16:37 (231): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
07:16:38 (231): No heartbeat from core client for 30 sec - exiting
07:16:39 (231): No heartbeat from core client for 30 sec - exiting
07:16:40 (231): No heartbeat from core client for 30 sec - exiting
07:16:41 (231): No heartbeat from core client for 30 sec - exiting
07:16:42 (231): No heartbeat from core client for 30 sec - exiting
07:16:43 (231): No heartbeat from core client for 30 sec - exiting
07:16:44 (231): No heartbeat from core client for 30 sec - exiting
07:16:45 (231): No heartbeat from core client for 30 sec - exiting
07:16:46 (231): No heartbeat from core client for 30 sec - exiting
07:16:47 (231): No heartbeat from core client for 30 sec - exiting
07:16:48 (231): No heartbeat from core client for 30 sec - exiting
07:16:49 (231): No heartbeat from core client for 30 sec - exiting
07:16:50 (231): No heartbeat from core client for 30 sec - exiting
07:16:51 (231): No heartbeat from core client for 30 sec - exiting
07:16:52 (231): No heartbeat from core client for 30 sec - exiting
07:16:53 (231): No heartbeat from core client for 30 sec - exiting
07:16:54 (231): No heartbeat from core client for 30 sec - exiting
07:16:55 (231): No heartbeat from core client for 30 sec - exiting
07:16:56 (231): No heartbeat from core client for 30 sec - exiting
07:16:57 (231): No heartbeat from core client for 30 sec - exiting
07:19:30 (1005): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
07:20:42 (1056): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
07:22:35 (1074): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
07:22:36 (1074): No heartbeat from core client for 30 sec - exiting
07:22:37 (1074): No heartbeat from core client for 30 sec - exiting
07:22:38 (1074): No heartbeat from core client for 30 sec - exiting
07:22:39 (1074): No heartbeat from core client for 30 sec - exiting
07:22:40 (1074): No heartbeat from core client for 30 sec - exiting
07:22:41 (1074): No heartbeat from core client for 30 sec - exiting
07:22:42 (1074): No heartbeat from core client for 30 sec - exiting
07:22:43 (1074): No heartbeat from core client for 30 sec - exiting
07:22:44 (1074): No heartbeat from core client for 30 sec - exiting
07:22:45 (1074): No heartbeat from core client for 30 sec - exiting
07:22:46 (1074): No heartbeat from core client for 30 sec - exiting
07:22:47 (1074): No heartbeat from core client for 30 sec - exiting
07:22:48 (1074): No heartbeat from core client for 30 sec - exiting
07:22:49 (1074): No heartbeat from core client for 30 sec - exiting
07:22:50 (1074): No heartbeat from core client for 30 sec - exiting
07:22:51 (1074): No heartbeat from core client for 30 sec - exiting
07:22:52 (1074): No heartbeat from core client for 30 sec - exiting
07:22:53 (1074): No heartbeat from core client for 30 sec - exiting
07:22:54 (1074): No heartbeat from core client for 30 sec - exiting
07:22:55 (1074): No heartbeat from core client for 30 sec - exiting
07:22:56 (1074): No heartbeat from core client for 30 sec - exiting
07:22:57 (1074): No heartbeat from core client for 30 sec - exiting
10:12:37 (1101): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
10:12:38 (1101): No heartbeat from core client for 30 sec - exiting
10:12:39 (1101): No heartbeat from core client for 30 sec - exiting
10:12:40 (1101): No heartbeat from core client for 30 sec - exiting
10:12:41 (1101): No heartbeat from core client for 30 sec - exiting
10:12:42 (1101): No heartbeat from core client for 30 sec - exiting
10:12:43 (1101): No heartbeat from core client for 30 sec - exiting
10:12:44 (1101): No heartbeat from core client for 30 sec - exiting
10:12:45 (1101): No heartbeat from core client for 30 sec - exiting
10:12:46 (1101): No heartbeat from core client for 30 sec - exiting
10:12:47 (1101): No heartbeat from core client for 30 sec - exiting
10:12:48 (1101): No heartbeat from core client for 30 sec - exiting
10:12:49 (1101): No heartbeat from core client for 30 sec - exiting
10:12:50 (1101): No heartbeat from core client for 30 sec - exiting
10:12:51 (1101): No heartbeat from core client for 30 sec - exiting
10:12:52 (1101): No heartbeat from core client for 30 sec - exiting
10:12:53 (1101): No heartbeat from core client for 30 sec - exiting
10:12:54 (1101): No heartbeat from core client for 30 sec - exiting
10:12:55 (1101): No heartbeat from core client for 30 sec - exiting
10:12:56 (1101): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
12:48:05 (226): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
12:48:06 (226): No heartbeat from core client for 30 sec - exiting
12:48:07 (226): No heartbeat from core client for 30 sec - exiting
12:48:08 (226): No heartbeat from core client for 30 sec - exiting
12:48:09 (226): No heartbeat from core client for 30 sec - exiting
12:48:10 (226): No heartbeat from core client for 30 sec - exiting
12:48:11 (226): No heartbeat from core client for 30 sec - exiting
12:48:12 (226): No heartbeat from core client for 30 sec - exiting
12:48:13 (226): No heartbeat from core client for 30 sec - exiting
12:48:14 (226): No heartbeat from core client for 30 sec - exiting
12:48:15 (226): No heartbeat from core client for 30 sec - exiting
12:48:16 (226): No heartbeat from core client for 30 sec - exiting
12:48:17 (226): No heartbeat from core client for 30 sec - exiting
12:48:18 (226): No heartbeat from core client for 30 sec - exiting
12:48:19 (226): No heartbeat from core client for 30 sec - exiting
12:48:20 (226): No heartbeat from core client for 30 sec - exiting
12:48:21 (226): No heartbeat from core client for 30 sec - exiting
12:48:22 (226): No heartbeat from core client for 30 sec - exiting
12:48:23 (226): No heartbeat from core client for 30 sec - exiting
12:48:24 (226): No heartbeat from core client for 30 sec - exiting
12:48:25 (226): No heartbeat from core client for 30 sec - exiting
12:48:26 (226): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - Quit request from BOINC...
08:27:27 (250): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 63 - Return code = 1

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 64 - Return code = 1

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 65 - Return code = 1

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 66 - Return code = 1

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 67 - Return code = 1

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 68 - Return code = 1

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 69 - Return code = 1
Error: Input file: dataout/t69jko.pjf5c10 is not a valid UM file.
Error converting file to netcdf: dataout/t69jko.pjf5c10
Error: Input file: dataout/t69jko.pif5c10 is not a valid UM file.
Error converting file to netcdf: dataout/t69jko.pif5c10
Error: Input file: dataout/t69jko.pff5c10 is not a valid UM file.
Error converting file to netcdf: dataout/t69jko.pff5c10
Error: Input file: dataout/t69jka.phf5c10 is not a valid UM file.
Error converting file to netcdf: dataout/t69jka.phf5c10
Error: Input file: dataout/t69jka.pgf5c10 is not a valid UM file.
Error converting file to netcdf: dataout/t69jka.pgf5c10
Error: Input file: dataout/t69jka.pef5c10 is not a valid UM file.
Error converting file to netcdf: dataout/t69jka.pef5c10
Error: Input file: dataout/t69jka.pdf5c10 is not a valid UM file.
Error converting file to netcdf: dataout/t69jka.pdf5c10
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
08:29:57 (55911): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
08:29:58 (55911): No heartbeat from core client for 30 sec - exiting
08:29:59 (55911): No heartbeat from core client for 30 sec - exiting
08:30:00 (55911): No heartbeat from core client for 30 sec - exiting
08:30:01 (55911): No heartbeat from core client for 30 sec - exiting
08:30:02 (55911): No heartbeat from core client for 30 sec - exiting
08:30:03 (55911): No heartbeat from core client for 30 sec - exiting
08:30:04 (55911): No heartbeat from core client for 30 sec - exiting
08:30:05 (55911): No heartbeat from core client for 30 sec - exiting
08:30:06 (55911): No heartbeat from core client for 30 sec - exiting
08:30:07 (55911): No heartbeat from core client for 30 sec - exiting
08:30:08 (55911): No heartbeat from core client for 30 sec - exiting
08:30:09 (55911): No heartbeat from core client for 30 sec - exiting
08:30:10 (55911): No heartbeat from core client for 30 sec - exiting
08:30:11 (55911): No heartbeat from core client for 30 sec - exiting
08:30:12 (55911): No heartbeat from core client for 30 sec - exiting
08:30:13 (55911): No heartbeat from core client for 30 sec - exiting
08:30:14 (55911): No heartbeat from core client for 30 sec - exiting
08:30:15 (55911): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - Quit request from BOINC...
12:00:13 (59665): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
12:00:14 (59665): No heartbeat from core client for 30 sec - exiting
12:00:15 (59665): No heartbeat from core client for 30 sec - exiting
12:00:16 (59665): No heartbeat from core client for 30 sec - exiting
12:00:17 (59665): No heartbeat from core client for 30 sec - exiting
12:00:18 (59665): No heartbeat from core client for 30 sec - exiting
12:00:19 (59665): No heartbeat from core client for 30 sec - exiting
12:00:20 (59665): No heartbeat from core client for 30 sec - exiting
12:00:21 (59665): No heartbeat from core client for 30 sec - exiting
12:00:22 (59665): No heartbeat from core client for 30 sec - exiting
12:00:23 (59665): No heartbeat from core client for 30 sec - exiting
12:00:25 (59665): No heartbeat from core client for 30 sec - exiting
12:00:26 (59665): No heartbeat from core client for 30 sec - exiting
12:00:27 (59665): No heartbeat from core client for 30 sec - exiting
12:00:28 (59665): No heartbeat from core client for 30 sec - exiting
12:00:29 (59665): No heartbeat from core client for 30 sec - exiting
12:00:30 (59665): No heartbeat from core client for 30 sec - exiting
12:00:31 (59665): No heartbeat from core client for 30 sec - exiting
12:00:32 (59665): No heartbeat from core client for 30 sec - exiting
12:00:33 (59665): No heartbeat from core client for 30 sec - exiting
12:00:34 (59665): No heartbeat from core client for 30 sec - exiting
12:00:35 (59665): No heartbeat from core client for 30 sec - exiting
12:00:36 (59665): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
15:51:52 (9839): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
15:51:53 (9839): No heartbeat from core client for 30 sec - exiting
15:51:54 (9839): No heartbeat from core client for 30 sec - exiting
15:51:55 (9839): No heartbeat from core client for 30 sec - exiting
15:51:56 (9839): No heartbeat from core client for 30 sec - exiting
15:51:57 (9839): No heartbeat from core client for 30 sec - exiting
15:51:58 (9839): No heartbeat from core client for 30 sec - exiting
15:51:59 (9839): No heartbeat from core client for 30 sec - exiting
15:52:00 (9839): No heartbeat from core client for 30 sec - exiting
15:52:01 (9839): No heartbeat from core client for 30 sec - exiting
15:52:02 (9839): No heartbeat from core client for 30 sec - exiting
15:52:03 (9839): No heartbeat from core client for 30 sec - exiting
15:52:04 (9839): No heartbeat from core client for 30 sec - exiting
15:52:05 (9839): No heartbeat from core client for 30 sec - exiting
15:52:06 (9839): No heartbeat from core client for 30 sec - exiting
15:52:07 (9839): No heartbeat from core client for 30 sec - exiting
15:52:08 (9839): No heartbeat from core client for 30 sec - exiting
16:47:19 (10729): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
21:57:38 (20507): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
21:59:06 (21308): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
21:59:46 (21349): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
16:48:49 (5228): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
16:47:45 (12723): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
SIGSEGV: segmentation violation

Crashed executable name: hadcm3n_6.07_i686-apple-darwin
built using BOINC library version 6.13.0
Machine type Intel 80486 (32-bit executable)
System version: Macintosh OS 10.5.8 build 9L30
Fri Oct 14 15:16:50 2011

BOINC backtrace under OS 10.5.x only shows exported (global) symbols
and may not show the final location which caused a crash.  For a better
backtrace, either run under OS 10.4.x or run under OS 10.6.x or later.

0   hadcm3n_6.07_i686-apple-darwin      0x00074953 version + 61229
1   hadcm3n_6.07_i686-apple-darwin      0x0006a936 version + 20240
2   libSystem.B.dylib                   0x93a621cb _sigtramp + 43
3   ???                                 0xffffffff 0x0 + 4294967295
4   hadcm3n_6.07_i686-apple-darwin      0x00020602 ncx_getn_float_float + 34
5   hadcm3n_6.07_i686-apple-darwin      0x00027264 fill_NC_var + 17204
6   hadcm3n_6.07_i686-apple-darwin      0x000294e3 fill_NC_var + 26035
7   hadcm3n_6.07_i686-apple-darwin      0x0002f733 nc_get_var_float + 355
8   hadcm3n_6.07_i686-apple-darwin      0x0000b927 _Z12annual_cyclePKSt6vectorISsSaISsEEPKcii + 3177
9   hadcm3n_6.07_i686-apple-darwin      0x0000d36b _Z12decadalMeansiPKc + 957
10  hadcm3n_6.07_i686-apple-darwin      0x000067ff _Z9doCM3Procv + 185
11  hadcm3n_6.07_i686-apple-darwin      0x0000791c _Z8mainLoopv + 410
12  hadcm3n_6.07_i686-apple-darwin      0x000087c7 _Z6workerv + 2989
13  hadcm3n_6.07_i686-apple-darwin      0x00008aa9 main + 491
14  hadcm3n_6.07_i686-apple-darwin      0x00002676 start + 54
15  ???                                 0x0000000b 0x0 + 11

Thread 0 crashed with X86 Thread State (32-bit):
  eax: 0xffffffe1 ebx: 0x93a2a7c2 ecx: 0xbff9028c edx: 0x939f6166
  edi: 0x00000000 esi: 0x00000000 ebp: 0xbff902c8 esp: 0xbff9028c
   ss: 0x0000001f efl: 0x00000206 eip: 0x939f6166  cs: 0x00000007
   ds: 0x0000001f  es: 0x0000001f  fs: 0x00000000  gs: 0x00000037

Binary Images Description:
    0x1000 -    0x93fff /Library/Application Support/BOINC Data/slots/3/../../projects/climateprediction.net/hadcm3n_6.07_i686-apple-darwin
0x9248b000 - 0x9248ffff /usr/lib/system/libmathCommon.A.dylib
0x939f5000 - 0x93b5cfff /usr/lib/libSystem.B.dylib
0x944b4000 - 0x94511fff /usr/lib/libstdc++.6.dylib
0x97a3b000 - 0x97a49fff /usr/lib/libz.1.dylib
0x97b99000 - 0x97ba0fff /usr/lib/libgcc_s.1.dylib


Exiting...

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
15 Oct 2011 01:20:55 1029940 13363348 hadcm3n_t69j_1940_40_007449321_1 518,400 816,346 1.5747
14 Oct 2011 02:28:40 1029940 13363348 hadcm3n_t69j_1940_40_007449321_1 492,480 776,788 1.5773
12 Oct 2011 07:18:54 1029940 13363348 hadcm3n_t69j_1940_40_007449321_1 466,560 736,529 1.5786
10 Oct 2011 23:48:01 1029940 13363348 hadcm3n_t69j_1940_40_007449321_1 440,640 694,060 1.5751
06 Oct 2011 07:42:11 1029940 13363348 hadcm3n_t69j_1940_40_007449321_1 414,720 652,737 1.5739
04 Oct 2011 21:18:14 1029940 13363348 hadcm3n_t69j_1940_40_007449321_1 388,800 608,883 1.5661
02 Oct 2011 01:55:21 1029940 13363348 hadcm3n_t69j_1940_40_007449321_1 362,880 565,930 1.5596
30 Sep 2011 03:46:16 1029940 13363348 hadcm3n_t69j_1940_40_007449321_1 336,960 523,778 1.5544
26 Sep 2011 23:47:06 1029940 13363348 hadcm3n_t69j_1940_40_007449321_1 311,040 480,847 1.5459
24 Sep 2011 00:05:44 1029940 13363348 hadcm3n_t69j_1940_40_007449321_1 285,120 440,063 1.5434
21 Sep 2011 19:58:22 1029940 13363348 hadcm3n_t69j_1940_40_007449321_1 259,200 398,085 1.5358
20 Sep 2011 09:03:40 1029940 13363348 hadcm3n_t69j_1940_40_007449321_1 233,280 356,019 1.5261
18 Sep 2011 01:15:41 1029940 13363348 hadcm3n_t69j_1940_40_007449321_1 207,360 315,767 1.5228
17 Sep 2011 02:17:02 1029940 13363348 hadcm3n_t69j_1940_40_007449321_1 181,440 276,449 1.5236
16 Sep 2011 03:23:19 1029940 13363348 hadcm3n_t69j_1940_40_007449321_1 155,520 237,273 1.5257
14 Sep 2011 23:44:09 1029940 13363348 hadcm3n_t69j_1940_40_007449321_1 129,600 197,990 1.5277
14 Sep 2011 02:15:03 1029940 13363348 hadcm3n_t69j_1940_40_007449321_1 103,680 158,842 1.5320
13 Sep 2011 04:40:06 1029940 13363348 hadcm3n_t69j_1940_40_007449321_1 77,760 119,478 1.5365
11 Sep 2011 22:31:38 1029940 13363348 hadcm3n_t69j_1940_40_007449321_1 51,840 79,789 1.5391
11 Sep 2011 11:14:37 1029940 13363348 hadcm3n_t69j_1940_40_007449321_1 25,920 40,376 1.5577


©2024 cpdn.org