climateprediction.net home page
Task 15189128

Task 15189128

Name hadam3p_saf_1alh_1964_1_006931965_1
Workunit 7135281
Created 26 Aug 2012, 12:27:57 UTC
Sent 26 Aug 2012, 12:28:01 UTC
Report deadline 8 Aug 2013, 17:48:01 UTC
Received 14 Sep 2012, 18:07:36 UTC
Server state Over
Outcome Success
Client state Done
Exit status 0 (0x00000000)
Computer ID 1164908
Run time 3 days 23 hours 5 min
CPU time 3 days 20 hours 3 min 33 sec
Validate state Initial
Credit 2,244.09
Device peak FLOPS 2.88 GFLOPS
Application version UK Met Office HadAM3P-HadRM3P Southern Africa v6.09
windows_intelx86
Stderr
<core_client_version>7.0.28</core_client_version>
<![CDATA[
<stderr_txt>
11:37:21 (6844): No heartbeat from core client for 30 sec - exiting
11:37:22 (6844): No heartbeat from core client for 30 sec - exiting
11:37:23 (6844): No heartbeat from core client for 30 sec - exiting
11:37:24 (6844): No heartbeat from core client for 30 sec - exiting
11:37:25 (6844): No heartbeat from core client for 30 sec - exiting
11:37:26 (6844): No heartbeat from core client for 30 sec - exiting
11:37:27 (6844): No heartbeat from core client for 30 sec - exiting
11:37:28 (6844): No heartbeat from core client for 30 sec - exiting
11:37:29 (6844): No heartbeat from core client for 30 sec - exiting
11:37:30 (6844): No heartbeat from core client for 30 sec - exiting
11:37:31 (6844): No heartbeat from core client for 30 sec - exiting
11:37:32 (6844): No heartbeat from core client for 30 sec - exiting
11:37:33 (6844): No heartbeat from core client for 30 sec - exiting
11:37:34 (6844): No heartbeat from core client for 30 sec - exiting
11:37:35 (6844): No heartbeat from core client for 30 sec - exiting
11:37:36 (6844): No heartbeat from core client for 30 sec - exiting
11:37:37 (6844): No heartbeat from core client for 30 sec - exiting
11:37:38 (6844): No heartbeat from core client for 30 sec - exiting
11:37:39 (6844): No heartbeat from core client for 30 sec - exiting
11:37:40 (6844): No heartbeat from core client for 30 sec - exiting
11:37:41 (6844): No heartbeat from core client for 30 sec - exiting
11:37:42 (6844): No heartbeat from core client for 30 sec - exiting
11:37:43 (6844): No heartbeat from core client for 30 sec - exiting
11:37:44 (6844): No heartbeat from core client for 30 sec - exiting
11:37:45 (6844): No heartbeat from core client for 30 sec - exiting
11:37:46 (6844): No heartbeat from core client for 30 sec - exiting
11:37:47 (6844): No heartbeat from core client for 30 sec - exiting
11:37:48 (6844): No heartbeat from core client for 30 sec - exiting
11:37:49 (6844): No heartbeat from core client for 30 sec - exiting
11:37:50 (6844): No heartbeat from core client for 30 sec - exiting
11:37:51 (6844): No heartbeat from core client for 30 sec - exiting
11:37:52 (6844): No heartbeat from core client for 30 sec - exiting
11:37:53 (6844): No heartbeat from core client for 30 sec - exiting
11:37:54 (6844): No heartbeat from core client for 30 sec - exiting
11:37:55 (6844): No heartbeat from core client for 30 sec - exiting
11:37:56 (6844): No heartbeat from core client for 30 sec - exiting
11:37:57 (6844): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
11:23:32 (2492): No heartbeat from core client for 30 sec - exiting
11:23:34 (2492): No heartbeat from core client for 30 sec - exiting
11:23:35 (2492): No heartbeat from core client for 30 sec - exiting
11:23:36 (2492): No heartbeat from core client for 30 sec - exiting
11:23:37 (2492): No heartbeat from core client for 30 sec - exiting
11:23:38 (2492): No heartbeat from core client for 30 sec - exiting
11:23:39 (2492): No heartbeat from core client for 30 sec - exiting
11:23:40 (2492): No heartbeat from core client for 30 sec - exiting
11:23:41 (2492): No heartbeat from core client for 30 sec - exiting
11:23:42 (2492): No heartbeat from core client for 30 sec - exiting
11:23:43 (2492): No heartbeat from core client for 30 sec - exiting
11:23:44 (2492): No heartbeat from core client for 30 sec - exiting
11:23:45 (2492): No heartbeat from core client for 30 sec - exiting
11:23:46 (2492): No heartbeat from core client for 30 sec - exiting
11:23:47 (2492): No heartbeat from core client for 30 sec - exiting
11:23:48 (2492): No heartbeat from core client for 30 sec - exiting
11:23:49 (2492): No heartbeat from core client for 30 sec - exiting
11:23:50 (2492): No heartbeat from core client for 30 sec - exiting
11:23:51 (2492): No heartbeat from core client for 30 sec - exiting
11:23:52 (2492): No heartbeat from core client for 30 sec - exiting
11:23:53 (2492): No heartbeat from core client for 30 sec - exiting
11:23:54 (2492): No heartbeat from core client for 30 sec - exiting
11:23:55 (2492): No heartbeat from core client for 30 sec - exiting
11:23:56 (2492): No heartbeat from core client for 30 sec - exiting
11:23:57 (2492): No heartbeat from core client for 30 sec - exiting
11:23:58 (2492): No heartbeat from core client for 30 sec - exiting
11:23:59 (2492): No heartbeat from core client for 30 sec - exiting
11:24:00 (2492): No heartbeat from core client for 30 sec - exiting
11:24:01 (2492): No heartbeat from core client for 30 sec - exiting
11:24:02 (2492): No heartbeat from core client for 30 sec - exiting
11:24:03 (2492): No heartbeat from core client for 30 sec - exiting
11:24:04 (2492): No heartbeat from core client for 30 sec - exiting
11:24:05 (2492): No heartbeat from core client for 30 sec - exiting
11:24:06 (2492): No heartbeat from core client for 30 sec - exiting
11:24:07 (2492): No heartbeat from core client for 30 sec - exiting
11:24:08 (2492): No heartbeat from core client for 30 sec - exiting
11:24:09 (2492): No heartbeat from core client for 30 sec - exiting
11:24:10 (2492): No heartbeat from core client for 30 sec - exiting
11:24:11 (2492): No heartbeat from core client for 30 sec - exiting
11:24:12 (2492): No heartbeat from core client for 30 sec - exiting
11:24:13 (2492): No heartbeat from core client for 30 sec - exiting
11:24:14 (2492): No heartbeat from core client for 30 sec - exiting
11:24:15 (2492): No heartbeat from core client for 30 sec - exiting
11:24:16 (2492): No heartbeat from core client for 30 sec - exiting
11:24:17 (2492): No heartbeat from core client for 30 sec - exiting
11:24:18 (2492): No heartbeat from core client for 30 sec - exiting
11:24:19 (2492): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3172, iMonCtr=2
Model crash detected, will try to restart...
12:52:25 (4748): No heartbeat from core client for 30 sec - exiting
12:52:26 (4748): No heartbeat from core client for 30 sec - exiting
12:52:27 (4748): No heartbeat from core client for 30 sec - exiting
12:52:28 (4748): No heartbeat from core client for 30 sec - exiting
12:52:29 (4748): No heartbeat from core client for 30 sec - exiting
12:52:30 (4748): No heartbeat from core client for 30 sec - exiting
12:52:31 (4748): No heartbeat from core client for 30 sec - exiting
12:52:32 (4748): No heartbeat from core client for 30 sec - exiting
12:52:33 (4748): No heartbeat from core client for 30 sec - exiting
12:52:34 (4748): No heartbeat from core client for 30 sec - exiting
12:52:35 (4748): No heartbeat from core client for 30 sec - exiting
12:52:36 (4748): No heartbeat from core client for 30 sec - exiting
12:52:37 (4748): No heartbeat from core client for 30 sec - exiting
12:52:38 (4748): No heartbeat from core client for 30 sec - exiting
12:52:39 (4748): No heartbeat from core client for 30 sec - exiting
12:52:40 (4748): No heartbeat from core client for 30 sec - exiting
12:52:41 (4748): No heartbeat from core client for 30 sec - exiting
12:52:42 (4748): No heartbeat from core client for 30 sec - exiting
12:52:43 (4748): No heartbeat from core client for 30 sec - exiting
12:52:44 (4748): No heartbeat from core client for 30 sec - exiting
12:52:45 (4748): No heartbeat from core client for 30 sec - exiting
12:52:46 (4748): No heartbeat from core client for 30 sec - exiting
12:52:47 (4748): No heartbeat from core client for 30 sec - exiting
12:52:48 (4748): No heartbeat from core client for 30 sec - exiting
12:52:49 (4748): No heartbeat from core client for 30 sec - exiting
12:52:50 (4748): No heartbeat from core client for 30 sec - exiting
12:52:51 (4748): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
17:53:24 (5000): No heartbeat from core client for 30 sec - exiting
17:53:26 (5000): No heartbeat from core client for 30 sec - exiting
17:53:27 (5000): No heartbeat from core client for 30 sec - exiting
17:53:28 (5000): No heartbeat from core client for 30 sec - exiting
17:53:29 (5000): No heartbeat from core client for 30 sec - exiting
17:53:30 (5000): No heartbeat from core client for 30 sec - exiting
17:53:31 (5000): No heartbeat from core client for 30 sec - exiting
17:53:32 (5000): No heartbeat from core client for 30 sec - exiting
17:53:33 (5000): No heartbeat from core client for 30 sec - exiting
17:53:34 (5000): No heartbeat from core client for 30 sec - exiting
17:53:35 (5000): No heartbeat from core client for 30 sec - exiting
17:53:36 (5000): No heartbeat from core client for 30 sec - exiting
17:53:37 (5000): No heartbeat from core client for 30 sec - exiting
17:53:38 (5000): No heartbeat from core client for 30 sec - exiting
17:53:39 (5000): No heartbeat from core client for 30 sec - exiting
17:53:40 (5000): No heartbeat from core client for 30 sec - exiting
17:53:41 (5000): No heartbeat from core client for 30 sec - exiting
17:53:42 (5000): No heartbeat from core client for 30 sec - exiting
17:53:43 (5000): No heartbeat from core client for 30 sec - exiting
17:53:44 (5000): No heartbeat from core client for 30 sec - exiting
17:53:45 (5000): No heartbeat from core client for 30 sec - exiting
17:53:46 (5000): No heartbeat from core client for 30 sec - exiting
17:53:47 (5000): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7432, iMonCtr=2
10:36:29 (5736): No heartbeat from core client for 30 sec - exiting
10:36:30 (5736): No heartbeat from core client for 30 sec - exiting
10:36:31 (5736): No heartbeat from core client for 30 sec - exiting
10:36:32 (5736): No heartbeat from core client for 30 sec - exiting
10:36:33 (5736): No heartbeat from core client for 30 sec - exiting
10:36:34 (5736): No heartbeat from core client for 30 sec - exiting
10:36:35 (5736): No heartbeat from core client for 30 sec - exiting
10:36:36 (5736): No heartbeat from core client for 30 sec - exiting
10:36:37 (5736): No heartbeat from core client for 30 sec - exiting
10:36:38 (5736): No heartbeat from core client for 30 sec - exiting
10:36:39 (5736): No heartbeat from core client for 30 sec - exiting
10:36:40 (5736): No heartbeat from core client for 30 sec - exiting
10:36:41 (5736): No heartbeat from core client for 30 sec - exiting
10:36:42 (5736): No heartbeat from core client for 30 sec - exiting
10:36:43 (5736): No heartbeat from core client for 30 sec - exiting
10:36:44 (5736): No heartbeat from core client for 30 sec - exiting
10:36:45 (5736): No heartbeat from core client for 30 sec - exiting
10:36:46 (5736): No heartbeat from core client for 30 sec - exiting
10:36:47 (5736): No heartbeat from core client for 30 sec - exiting
10:36:48 (5736): No heartbeat from core client for 30 sec - exiting
10:36:49 (5736): No heartbeat from core client for 30 sec - exiting
10:36:50 (5736): No heartbeat from core client for 30 sec - exiting
10:36:51 (5736): No heartbeat from core client for 30 sec - exiting
10:36:52 (5736): No heartbeat from core client for 30 sec - exiting
10:36:53 (5736): No heartbeat from core client for 30 sec - exiting
10:36:54 (5736): No heartbeat from core client for 30 sec - exiting
10:36:55 (5736): No heartbeat from core client for 30 sec - exiting
10:36:56 (5736): No heartbeat from core client for 30 sec - exiting
10:36:57 (5736): No heartbeat from core client for 30 sec - exiting
10:36:58 (5736): No heartbeat from core client for 30 sec - exiting
10:36:59 (5736): No heartbeat from core client for 30 sec - exiting
10:37:00 (5736): No heartbeat from core client for 30 sec - exiting
10:37:01 (5736): No heartbeat from core client for 30 sec - exiting
10:37:02 (5736): No heartbeat from core client for 30 sec - exiting
10:37:03 (5736): No heartbeat from core client for 30 sec - exiting
10:37:04 (5736): No heartbeat from core client for 30 sec - exiting
10:37:05 (5736): No heartbeat from core client for 30 sec - exiting
10:37:06 (5736): No heartbeat from core client for 30 sec - exiting
10:37:07 (5736): No heartbeat from core client for 30 sec - exiting
10:37:08 (5736): No heartbeat from core client for 30 sec - exiting
10:37:09 (5736): No heartbeat from core client for 30 sec - exiting
10:37:10 (5736): No heartbeat from core client for 30 sec - exiting
10:37:11 (5736): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
11:13:29 (4740): No heartbeat from core client for 30 sec - exiting
11:13:30 (4740): No heartbeat from core client for 30 sec - exiting
11:13:31 (4740): No heartbeat from core client for 30 sec - exiting
11:13:32 (4740): No heartbeat from core client for 30 sec - exiting
11:13:33 (4740): No heartbeat from core client for 30 sec - exiting
11:13:34 (4740): No heartbeat from core client for 30 sec - exiting
11:13:35 (4740): No heartbeat from core client for 30 sec - exiting
11:13:36 (4740): No heartbeat from core client for 30 sec - exiting
11:13:37 (4740): No heartbeat from core client for 30 sec - exiting
11:13:38 (4740): No heartbeat from core client for 30 sec - exiting
11:13:39 (4740): No heartbeat from core client for 30 sec - exiting
11:13:40 (4740): No heartbeat from core client for 30 sec - exiting
11:13:41 (4740): No heartbeat from core client for 30 sec - exiting
11:13:42 (4740): No heartbeat from core client for 30 sec - exiting
11:13:43 (4740): No heartbeat from core client for 30 sec - exiting
11:13:44 (4740): No heartbeat from core client for 30 sec - exiting
11:13:45 (4740): No heartbeat from core client for 30 sec - exiting
11:13:46 (4740): No heartbeat from core client for 30 sec - exiting
11:13:47 (4740): No heartbeat from core client for 30 sec - exiting
11:13:48 (4740): No heartbeat from core client for 30 sec - exiting
11:13:49 (4740): No heartbeat from core client for 30 sec - exiting
11:13:50 (4740): No heartbeat from core client for 30 sec - exiting
11:13:51 (4740): No heartbeat from core client for 30 sec - exiting
11:13:52 (4740): No heartbeat from core client for 30 sec - exiting
11:13:53 (4740): No heartbeat from core client for 30 sec - exiting
11:13:54 (4740): No heartbeat from core client for 30 sec - exiting
11:13:55 (4740): No heartbeat from core client for 30 sec - exiting
11:13:56 (4740): No heartbeat from core client for 30 sec - exiting
11:13:57 (4740): No heartbeat from core client for 30 sec - exiting
11:13:58 (4740): No heartbeat from core client for 30 sec - exiting
11:13:59 (4740): No heartbeat from core client for 30 sec - exiting
11:14:00 (4740): No heartbeat from core client for 30 sec - exiting
11:14:01 (4740): No heartbeat from core client for 30 sec - exiting
11:14:02 (4740): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1260, selfPID=4448, iMonCtr=1
Model11:18:39 (5604): No heartbeat from core client for 30 sec - exiting
11:18:40 (5604): No heartbeat from core client for 30 sec - exiting
11:18:41 (5604): No heartbeat from core client for 30 sec - exiting
11:18:42 (5604): No heartbeat from core client for 30 sec - exiting
11:18:43 (5604): No heartbeat from core client for 30 sec - exiting
11:18:44 (5604): No heartbeat from core client for 30 sec - exiting
11:18:45 (5604): No heartbeat from core client for 30 sec - exiting
11:18:46 (5604): No heartbeat from core client for 30 sec - exiting
11:18:47 (5604): No heartbeat from core client for 30 sec - exiting
11:18:48 (5604): No heartbeat from core client for 30 sec - exiting
11:18:49 (5604): No heartbeat from core client for 30 sec - exiting
11:18:50 (5604): No heartbeat from core client for 30 sec - exiting
11:18:51 (5604): No heartbeat from core client for 30 sec - exiting
11:18:52 (5604): No heartbeat from core client for 30 sec - exiting
11:18:53 (5604): No heartbeat from core client for 30 sec - exiting
11:18:54 (5604): No heartbeat from core client for 30 sec - exiting
11:18:55 (5604): No heartbeat from core client for 30 sec - exiting
11:18:56 (5604): No heartbeat from core client for 30 sec - exiting
11:18:57 (5604): No heartbeat from core client for 30 sec - exiting
11:18:58 (5604): No heartbeat from core client for 30 sec - exiting
11:18:59 (5604): No heartbeat from core client for 30 sec - exiting
11:19:00 (5604): No heartbeat from core client for 30 sec - exiting
11:19:01 (5604): No heartbeat from core client for 30 sec - exiting
11:19:02 (5604): No heartbeat from core client for 30 sec - exiting
11:19:03 (5604): No heartbeat from core client for 30 sec - exiting
11:19:04 (5604): No heartbeat from core client for 30 sec - exiting
11:19:05 (5604): No heartbeat from core client for 30 sec - exiting
11:19:06 (5604): No heartbeat from core client for 30 sec - exiting
11:19:07 (5604): No heartbeat from core client for 30 sec - exiting
11:19:08 (5604): No heartbeat from core client for 30 sec - exiting
11:19:09 (5604): No heartbeat from core client for 30 sec - exiting
11:19:10 (5604): No heartbeat from core client for 30 sec - exiting
11:19:11 (5604): No heartbeat from core client for 30 sec - exiting
11:19:12 (5604): No heartbeat from core client for 30 sec - exiting
11:19:13 (5604): No heartbeat from core client for 30 sec - exiting
11:19:14 (5604): No heartbeat from core client for 30 sec - exiting
11:19:15 (5604): No heartbeat from core client for 30 sec - exiting
11:19:16 (5604): No heartbeat from core client for 30 sec - exiting
11:19:17 (5604): No heartbeat from core client for 30 sec - exiting
11:19:18 (5604): No heartbeat from core client for 30 sec - exiting
11:19:19 (5604): No heartbeat from core client for 30 sec - exiting
11:19:20 (5604): No heartbeat from core client for 30 sec - exiting
11:19:21 (5604): No heartbeat from core client for 30 sec - exiting
11:19:22 (5604): No heartbeat from core client for 30 sec - exiting
11:19:23 (5604): No heartbeat from core client for 30 sec - exiting
11:19:24 (5604): No heartbeat from core client for 30 sec - exiting
11:19:25 (5604): No heartbeat from core client for 30 sec - exiting
11:19:26 (5604): No heartbeat from core client for 30 sec - exiting
11:19:27 (5604): No heartbeat from core client for 30 sec - exiting
11:19:28 (5604): No heartbeat from core client for 30 sec - exiting
11:19:29 (5604): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
11:19:29 (6484): No heartbeat from core client for 30 sec - exiting
11:19:30 (6484): No heartbeat from core client for 30 sec - exiting
11:19:31 (6484): No heartbeat from core client for 30 sec - exiting
11:19:32 (6484): No heartbeat from core client for 30 sec - exiting
11:19:33 (6484): No heartbeat from core client for 30 sec - exiting
11:19:34 (6484): No heartbeat from core client for 30 sec - exiting
11:19:35 (6484): No heartbeat from core client for 30 sec - exiting
11:19:36 (6484): No heartbeat from core client for 30 sec - exiting
11:19:37 (6484): No heartbeat from core client for 30 sec - exiting
11:19:38 (6484): No heartbeat from core client for 30 sec - exiting
11:19:39 (6484): No heartbeat from core client for 30 sec - exiting
11:19:40 (6484): No heartbeat from core client for 30 sec - exiting
11:19:41 (6484): No heartbeat from core client for 30 sec - exiting
11:19:42 (6484): No heartbeat from core client for 30 sec - exiting
11:19:43 (6484): No heartbeat from core client for 30 sec - exiting
11:19:44 (6484): No heartbeat from core client for 30 sec - exiting
11:19:45 (6484): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
12:12:55 (6124): No heartbeat from core client for 30 sec - exiting
12:12:56 (6124): No heartbeat from core client for 30 sec - exiting
12:12:57 (6124): No heartbeat from core client for 30 sec - exiting
12:12:58 (6124): No heartbeat from core client for 30 sec - exiting
12:12:59 (6124): No heartbeat from core client for 30 sec - exiting
12:13:00 (6124): No heartbeat from core client for 30 sec - exiting
12:13:01 (6124): No heartbeat from core client for 30 sec - exiting
12:13:02 (6124): No heartbeat from core client for 30 sec - exiting
12:13:03 (6124): No heartbeat from core client for 30 sec - exiting
12:13:04 (6124): No heartbeat from core client for 30 sec - exiting
12:13:05 (6124): No heartbeat from core client for 30 sec - exiting
12:13:06 (6124): No heartbeat from core client for 30 sec - exiting
12:13:07 (6124): No heartbeat from core client for 30 sec - exiting
12:13:08 (6124): No heartbeat from core client for 30 sec - exiting
12:13:09 (6124): No heartbeat from core client for 30 sec - exiting
12:13:10 (6124): No heartbeat from core client for 30 sec - exiting
12:13:11 (6124): No heartbeat from core client for 30 sec - exiting
12:13:12 (6124): No heartbeat from core client for 30 sec - exiting
12:13:13 (6124): No heartbeat from core client for 30 sec - exiting
12:13:14 (6124): No heartbeat from core client for 30 sec - exiting
12:13:15 (6124): No heartbeat from core client for 30 sec - exiting
12:13:16 (6124): No heartbeat from core client for 30 sec - exiting
12:13:17 (6124): No heartbeat from core client for 30 sec - exiting
12:13:18 (6124): No heartbeat from core client for 30 sec - exiting
12:13:19 (6124): No heartbeat from core client for 30 sec - exiting
12:13:20 (6124): No heartbeat from core client for 30 sec - exiting
12:13:21 (6124): No heartbeat from core client for 30 sec - exiting
12:13:22 (6124): No heartbeat from core client for 30 sec - exiting
12:13:23 (6124): No heartbeat from core client for 30 sec - exiting
12:13:24 (6124): No heartbeat from core client for 30 sec - exiting
12:13:25 (6124): No heartbeat from core client for 30 sec - exiting
12:13:26 (6124): No heartbeat from core client for 30 sec - exiting
12:13:27 (6124): No heartbeat from core client for 30 sec - exiting
12:13:28 (6124): No heartbeat from core client for 30 sec - exiting
12:13:29 (6124): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Error converting file to netcdf: D:\BOINC_Data/projects/climateprediction.net/hadam3p_saf_1alh_1964_1_006931965/dataout\1alhga.pdg5jul
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=7580, selfPID=7540, iMonCtr=1
Model crash detected, will14:56:04 (7132): No heartbeat from core client for 30 sec - exiting
14:56:05 (7132): No heartbeat from core client for 30 sec - exiting
14:56:06 (7132): No heartbeat from core client for 30 sec - exiting
14:56:07 (7132): No heartbeat from core client for 30 sec - exiting
14:56:08 (7132): No heartbeat from core client for 30 sec - exiting
14:56:09 (7132): No heartbeat from core client for 30 sec - exiting
14:56:10 (7132): No heartbeat from core client for 30 sec - exiting
14:56:11 (7132): No heartbeat from core client for 30 sec - exiting
14:56:12 (7132): No heartbeat from core client for 30 sec - exiting
14:56:13 (7132): No heartbeat from core client for 30 sec - exiting
14:56:14 (7132): No heartbeat from core client for 30 sec - exiting
14:56:15 (7132): No heartbeat from core client for 30 sec - exiting
14:56:16 (7132): No heartbeat from core client for 30 sec - exiting
14:56:17 (7132): No heartbeat from core client for 30 sec - exiting
14:56:18 (7132): No heartbeat from core client for 30 sec - exiting
14:56:19 (7132): No heartbeat from core client for 30 sec - exiting
14:56:20 (7132): No heartbeat from core client for 30 sec - exiting
14:56:21 (7132): No heartbeat from core client for 30 sec - exiting
14:56:22 (7132): No heartbeat from core client for 30 sec - exiting
14:56:23 (7132): No heartbeat from core client for 30 sec - exiting
14:56:24 (7132): No heartbeat from core client for 30 sec - exiting
14:56:25 (7132): No heartbeat from core client for 30 sec - exiting
14:56:26 (7132): No heartbeat from core client for 30 sec - exiting
14:56:27 (7132): No heartbeat from core client for 30 sec - exiting
14:56:28 (7132): No heartbeat from core client for 30 sec - exiting
14:56:29 (7132): No heartbeat from core client for 30 sec - exiting
14:56:30 (7132): No heartbeat from core client for 30 sec - exiting
14:56:31 (7132): No heartbeat from core client for 30 sec - exiting
14:56:32 (7132): No heartbeat from core client for 30 sec - exiting
14:56:33 (7132): No heartbeat from core client for 30 sec - exiting
14:56:34 (7132): No heartbeat from core client for 30 sec - exiting
14:56:35 (7132): No heartbeat from core client for 30 sec - exiting
14:56:36 (7132): No heartbeat from core client for 30 sec - exiting
14:56:37 (7132): No heartbeat from core client for 30 sec - exiting
14:56:38 (7132): No heartbeat from core client for 30 sec - exiting
14:56:39 (7132): No heartbeat from core client for 30 sec - exiting
14:56:40 (7132): No heartbeat from core client for 30 sec - exiting
14:56:41 (7132): No heartbeat from core client for 30 sec - exiting
14:56:42 (7132): No heartbeat from core client for 30 sec - exiting
14:56:43 (7132): No heartbeat from core client for 30 sec - exiting
14:56:44 (7132): No heartbeat from core client for 30 sec - exiting
14:56:45 (7132): No heartbeat from core client for 30 sec - exiting
14:56:46 (7132): No heartbeat from core client for 30 sec - exiting
14:56:47 (7132): No heartbeat from core client for 30 sec - exiting
14:56:48 (7132): No heartbeat from core client for 30 sec - exiting
14:56:49 (7132): No heartbeat from core client for 30 sec - exiting
14:56:50 (7132): No heartbeat from core client for 30 sec - exiting
14:56:51 (7132): No heartbeat from core client for 30 sec - exiting
14:56:52 (7132): No heartbeat from core client for 30 sec - exiting
14:56:53 (7132): No heartbeat from core client for 30 sec - exiting
14:56:54 (7132): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2972, selfPID=2588, iMonCtr=1
Model crash detected, will try to restart...
14:20:45 (6084): No heartbeat from core client for 30 sec - exiting
14:20:46 (6084): No heartbeat from core client for 30 sec - exiting
14:20:47 (6084): No heartbeat from core client for 30 sec - exiting
14:20:48 (6084): No heartbeat from core client for 30 sec - exiting
14:20:49 (6084): No heartbeat from core client for 30 sec - exiting
14:20:50 (6084): No heartbeat from core client for 30 sec - exiting
14:20:51 (6084): No heartbeat from core client for 30 sec - exiting
14:20:52 (6084): No heartbeat from core client for 30 sec - exiting
14:20:53 (6084): No heartbeat from core client for 30 sec - exiting
14:20:54 (6084): No heartbeat from core client for 30 sec - exiting
14:20:55 (6084): No heartbeat from core client for 30 sec - exiting
14:20:56 (6084): No heartbeat from core client for 30 sec - exiting
14:20:57 (6084): No heartbeat from core client for 30 sec - exiting
14:20:58 (6084): No heartbeat from core client for 30 sec - exiting
14:20:59 (6084): No heartbeat from core client for 30 sec - exiting
14:21:00 (6084): No heartbeat from core client for 30 sec - exiting
14:21:01 (6084): No heartbeat from core client for 30 sec - exiting
14:21:02 (6084): No heartbeat from core client for 30 sec - exiting
14:21:03 (6084): No heartbeat from core client for 30 sec - exiting
14:21:04 (6084): No heartbeat from core client for 30 sec - exiting
14:21:05 (6084): No heartbeat from core client for 30 sec - exiting
14:21:06 (6084): No heartbeat from core client for 30 sec - exiting
14:21:07 (6084): No heartbeat from core client for 30 sec - exiting
14:21:08 (6084): No heartbeat from core client for 30 sec - exiting
14:21:09 (6084): No heartbeat from core client for 30 sec - exiting
14:21:10 (6084): No heartbeat from core client for 30 sec - exiting
14:21:11 (6084): No heartbeat from core client for 30 sec - exiting
14:21:12 (6084): No heartbeat from core client for 30 sec - exiting
14:21:13 (6084): No heartbeat from core client for 30 sec - exiting
14:21:14 (6084): No heartbeat from core client for 30 sec - exiting
14:21:15 (6084): No heartbeat from core client for 30 sec - exiting
14:21:16 (6084): No heartbeat from core client for 30 sec - exiting
14:21:17 (6084): No heartbeat from core client for 30 sec - exiting
14:21:18 (6084): No heartbeat from core client for 30 sec - exiting
14:21:19 (6084): No heartbeat from core client for 30 sec - exiting
14:21:20 (6084): No heartbeat from core client for 30 sec - exiting
14:21:21 (6084): No heartbeat from core client for 30 sec - exiting
14:21:22 (6084): No heartbeat from core client for 30 sec - exiting
14:21:23 (6084): No heartbeat from core client for 30 sec - exiting
14:21:24 (6084): No heartbeat from core client for 30 sec - exiting
14:21:25 (6084): No heartbeat from core client for 30 sec - exiting
14:21:26 (6084): No heartbeat from core client for 30 sec - exiting
14:21:27 (6084): No heartbeat from core client for 30 sec - exiting
14:21:28 (6084): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
18:18:55 (5604): No heartbeat from core client for 30 sec - exiting
18:18:56 (5604): No heartbeat from core client for 30 sec - exiting
18:18:57 (5604): No heartbeat from core client for 30 sec - exiting
18:18:58 (5604): No heartbeat from core client for 30 sec - exiting
18:18:59 (5604): No heartbeat from core client for 30 sec - exiting
18:19:00 (5604): No heartbeat from core client for 30 sec - exiting
18:19:01 (5604): No heartbeat from core client for 30 sec - exiting
18:19:02 (5604): No heartbeat from core client for 30 sec - exiting
18:19:03 (5604): No heartbeat from core client for 30 sec - exiting
18:19:04 (5604): No heartbeat from core client for 30 sec - exiting
18:19:05 (5604): No heartbeat from core client for 30 sec - exiting
18:19:06 (5604): No heartbeat from core client for 30 sec - exiting
18:19:07 (5604): No heartbeat from core client for 30 sec - exiting
18:19:08 (5604): No heartbeat from core client for 30 sec - exiting
18:19:09 (5604): No heartbeat from core client for 30 sec - exiting
18:19:10 (5604): No heartbeat from core client for 30 sec - exiting
18:19:11 (5604): No heartbeat from core client for 30 sec - exiting
18:19:12 (5604): No heartbeat from core client for 30 sec - exiting
18:19:13 (5604): No heartbeat from core client for 30 sec - exiting
18:19:14 (5604): No heartbeat from core client for 30 sec - exiting
18:19:15 (5604): No heartbeat from core client for 30 sec - exiting
18:19:16 (5604): No heartbeat from core client for 30 sec - exiting
18:19:17 (5604): No heartbeat from core client for 30 sec - exiting
18:19:18 (5604): No heartbeat from core client for 30 sec - exiting
18:19:19 (5604): No heartbeat from core client for 30 sec - exiting
18:19:20 (5604): No heartbeat from core client for 30 sec - exiting
18:19:21 (5604): No heartbeat from core client for 30 sec - exiting
18:19:22 (5604): No heartbeat from core client for 30 sec - exiting
18:19:23 (5604): No heartbeat from core client for 30 sec - exiting
18:19:24 (5604): No heartbeat from core client for 30 sec - exiting
18:19:25 (5604): No heartbeat from core client for 30 sec - exiting
18:19:26 (5604): No heartbeat from core client for 30 sec - exiting
18:19:27 (5604): No heartbeat from core client for 30 sec - exiting
18:19:28 (5604): No heartbeat from core client for 30 sec - exiting
18:19:29 (5604): No heartbeat from core client for 30 sec - exiting
18:19:30 (5604): No heartbeat from core client for 30 sec - exiting
18:19:31 (5604): No heartbeat from core client for 30 sec - exiting
18:19:32 (5604): No heartbeat from core client for 30 sec - exiting
18:19:33 (5604): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
11:43:15 (5792): No heartbeat from core client for 30 sec - exiting
11:43:16 (5792): No heartbeat from core client for 30 sec - exiting
11:43:17 (5792): No heartbeat from core client for 30 sec - exiting
11:43:18 (5792): No heartbeat from core client for 30 sec - exiting
11:43:19 (5792): No heartbeat from core client for 30 sec - exiting
11:43:20 (5792): No heartbeat from core client for 30 sec - exiting
11:43:21 (5792): No heartbeat from core client for 30 sec - exiting
11:43:22 (5792): No heartbeat from core client for 30 sec - exiting
11:43:23 (5792): No heartbeat from core client for 30 sec - exiting
11:43:24 (5792): No heartbeat from core client for 30 sec - exiting
11:43:25 (5792): No heartbeat from core client for 30 sec - exiting
11:43:26 (5792): No heartbeat from core client for 30 sec - exiting
11:43:27 (5792): No heartbeat from core client for 30 sec - exiting
11:43:28 (5792): No heartbeat from core client for 30 sec - exiting
11:43:29 (5792): No heartbeat from core client for 30 sec - exiting
11:43:30 (5792): No heartbeat from core client for 30 sec - exiting
11:43:31 (5792): No heartbeat from core client for 30 sec - exiting
11:43:32 (5792): No heartbeat from core client for 30 sec - exiting
11:43:33 (5792): No heartbeat from core client for 30 sec - exiting
11:43:34 (5792): No heartbeat from core client for 30 sec - exiting
11:43:35 (5792): No heartbeat from core client for 30 sec - exiting
11:43:36 (5792): No heartbeat from core client for 30 sec - exiting
11:43:37 (5792): No heartbeat from core client for 30 sec - exiting
11:43:38 (5792): No heartbeat from core client for 30 sec - exiting
11:43:39 (5792): No heartbeat from core client for 30 sec - exiting
11:43:40 (5792): No heartbeat from core client for 30 sec - exiting
11:43:41 (5792): No heartbeat from core client for 30 sec - exiting
11:43:42 (5792): No heartbeat from core client for 30 sec - exiting
11:43:43 (5792): No heartbeat from core client for 30 sec - exiting
11:43:44 (5792): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
14:23:29 (4928): No heartbeat from core client for 30 sec - exiting
14:23:30 (4928): No heartbeat from core client for 30 sec - exiting
14:23:31 (4928): No heartbeat from core client for 30 sec - exiting
14:23:32 (4928): No heartbeat from core client for 30 sec - exiting
14:23:33 (4928): No heartbeat from core client for 30 sec - exiting
14:23:34 (4928): No heartbeat from core client for 30 sec - exiting
14:23:35 (4928): No heartbeat from core client for 30 sec - exiting
14:23:36 (4928): No heartbeat from core client for 30 sec - exiting
14:23:37 (4928): No heartbeat from core client for 30 sec - exiting
14:23:38 (4928): No heartbeat from core client for 30 sec - exiting
14:23:39 (4928): No heartbeat from core client for 30 sec - exiting
14:23:40 (4928): No heartbeat from core client for 30 sec - exiting
14:23:41 (4928): No heartbeat from core client for 30 sec - exiting
14:23:42 (4928): No heartbeat from core client for 30 sec - exiting
14:23:43 (4928): No heartbeat from core client for 30 sec - exiting
14:23:44 (4928): No heartbeat from core client for 30 sec - exiting
14:23:45 (4928): No heartbeat from core client for 30 sec - exiting
14:23:46 (4928): No heartbeat from core client for 30 sec - exiting
14:23:47 (4928): No heartbeat from core client for 30 sec - exiting
14:23:48 (4928): No heartbeat from core client for 30 sec - exiting
14:23:49 (4928): No heartbeat from core client for 30 sec - exiting
14:23:50 (4928): No heartbeat from core client for 30 sec - exiting
14:23:51 (4928): No heartbeat from core client for 30 sec - exiting
14:23:52 (4928): No heartbeat from core client for 30 sec - exiting
14:23:53 (4928): No heartbeat from core client for 30 sec - exiting
14:23:54 (4928): No heartbeat from core client for 30 sec - exiting
14:23:55 (4928): No heartbeat from core client for 30 sec - exiting
14:23:56 (4928): No heartbeat from core client for 30 sec - exiting
14:23:57 (4928): No heartbeat from core client for 30 sec - exiting
14:23:58 (4928): No heartbeat from core client for 30 sec - exiting
14:23:59 (4928): No heartbeat from core client for 30 sec - exiting
14:24:00 (4928): No heartbeat from core client for 30 sec - exiting
14:24:01 (4928): No heartbeat from core client for 30 sec - exiting
14:24:02 (4928): No heartbeat from core client for 30 sec - exiting
14:24:03 (4928): No heartbeat from core client for 30 sec - exiting
14:24:04 (4928): No heartbeat from core client for 30 sec - exiting
14:24:05 (4928): No heartbeat from core client for 30 sec - exiting
14:24:06 (4928): No heartbeat from core client for 30 sec - exiting
14:24:07 (4928): No heartbeat from core client for 30 sec - exiting
14:24:08 (4928): No heartbeat from core client for 30 sec - exiting
14:24:09 (4928): No heartbeat from core client for 30 sec - exiting
14:24:10 (4928): No heartbeat from core client for 30 sec - exiting
14:24:11 (4928): No heartbeat from core client for 30 sec - exiting
14:24:12 (4928): No heartbeat from core client for 30 sec - exiting
14:24:13 (4928): No heartbeat from core client for 30 sec - exiting
14:24:14 (4928): No heartbeat from core client for 30 sec - exiting
14:24:15 (4928): No heartbeat from core client for 30 sec - exiting
14:24:16 (4928): No heartbeat from core client for 30 sec - exiting
14:24:17 (4928): No heartbeat from core client for 30 sec - exiting
14:24:18 (4928): No heartbeat from core client for 30 sec - exiting
14:24:19 (4928): No heartbeat from core client for 30 sec - exiting
14:24:20 (4928): No heartbeat from core client for 30 sec - exiting
14:24:21 (4928): No heartbeat from core client for 30 sec - exiting
14:24:22 (4928): No heartbeat from core client for 30 sec - exiting
14:24:23 (4928): No heartbeat from core client for 30 sec - exiting
14:24:24 (4928): No heartbeat from core client for 30 sec - exiting
14:24:25 (4928): No heartbeat from core client for 30 sec - exiting
14:24:26 (4928): No heartbeat from core client for 30 sec - exiting
14:24:27 (4928): No heartbeat from core client for 30 sec - exiting
14:24:28 (4928): No heartbeat from core client for 30 sec - exiting
14:24:29 (4928): No heartbeat from core client for 30 sec - exiting
14:24:30 (4928): No heartbeat from core client for 30 sec - exiting
14:24:31 (4928): No heartbeat from core client for 30 sec - exiting
14:24:32 (4928): No heartbeat from core client for 30 sec - exiting
14:24:33 (4928): No heartbeat from core client for 30 sec - exiting
14:24:34 (4928): No heartbeat from core client for 30 sec - exiting
14:24:35 (4928): No heartbeat from core client for 30 sec - exiting
14:24:36 (4928): No heartbeat from core client for 30 sec - exiting
14:24:37 (4928): No heartbeat from core client for 30 sec - exiting
14:24:38 (4928): No heartbeat from core client for 30 sec - exiting
14:24:39 (4928): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
14:27:35 (2856): No heartbeat from core client for 30 sec - exiting
14:27:37 (2856): No heartbeat from core client for 30 sec - exiting
14:27:38 (2856): No heartbeat from core client for 30 sec - exiting
14:27:39 (2856): No heartbeat from core client for 30 sec - exiting
14:27:40 (2856): No heartbeat from core client for 30 sec - exiting
14:27:41 (2856): No heartbeat from core client for 30 sec - exiting
14:27:42 (2856): No heartbeat from core client for 30 sec - exiting
14:27:43 (2856): No heartbeat from core client for 30 sec - exiting
14:27:44 (2856): No heartbeat from core client for 30 sec - exiting
14:27:45 (2856): No heartbeat from core client for 30 sec - exiting
14:27:46 (2856): No heartbeat from core client for 30 sec - exiting
14:27:47 (2856): No heartbeat from core client for 30 sec - exiting
14:27:48 (2856): No heartbeat from core client for 30 sec - exiting
14:27:49 (2856): No heartbeat from core client for 30 sec - exiting
14:27:50 (2856): No heartbeat from core client for 30 sec - exiting
14:27:51 (2856): No heartbeat from core client for 30 sec - exiting
14:27:52 (2856): No heartbeat from core client for 30 sec - exiting
14:27:53 (2856): No heartbeat from core client for 30 sec - exiting
14:27:54 (2856): No heartbeat from core client for 30 sec - exiting
14:27:55 (2856): No heartbeat from core client for 30 sec - exiting
14:27:56 (2856): No heartbeat from core client for 30 sec - exiting
14:27:57 (2856): No heartbeat from core client for 30 sec - exiting
14:27:58 (2856): No heartbeat from core client for 30 sec - exiting
14:27:59 (2856): No heartbeat from core client for 30 sec - exiting
14:28:00 (2856): No heartbeat from core client for 30 sec - exiting
14:28:01 (2856): No heartbeat from core client for 30 sec - exiting
14:28:02 (2856): No heartbeat from core client for 30 sec - exiting
14:28:03 (2856): No heartbeat from core client for 30 sec - exiting
14:28:04 (2856): No heartbeat from core client for 30 sec - exiting
14:28:05 (2856): No heartbeat from core client for 30 sec - exiting
14:28:06 (2856): No heartbeat from core client for 30 sec - exiting
14:28:07 (2856): No heartbeat from core client for 30 sec - exiting
14:28:08 (2856): No heartbeat from core client for 30 sec - exiting
14:28:09 (2856): No heartbeat from core client for 30 sec - exiting
14:28:10 (2856): No heartbeat from core client for 30 sec - exiting
14:28:11 (2856): No heartbeat from core client for 30 sec - exiting
14:28:12 (2856): No heartbeat from core client for 30 sec - exiting
14:28:13 (2856): No heartbeat from core client for 30 sec - exiting
14:28:14 (2856): No heartbeat from core client for 30 sec - exiting
14:28:15 (2856): No heartbeat from core client for 30 sec - exiting
14:28:16 (2856): No heartbeat from core client for 30 sec - exiting
14:28:17 (2856): No heartbeat from core client for 30 sec - exiting
14:28:18 (2856): No heartbeat from core client for 30 sec - exiting
14:28:19 (2856): No heartbeat from core client for 30 sec - exiting
14:28:20 (2856): No heartbeat from core client for 30 sec - exiting
14:28:21 (2856): No heartbeat from core client for 30 sec - exiting
14:28:22 (2856): No heartbeat from core client for 30 sec - exiting
14:28:23 (2856): No heartbeat from core client for 30 sec - exiting
14:28:24 (2856): No heartbeat from core client for 30 sec - exiting
14:28:25 (2856): No heartbeat from core client for 30 sec - exiting
14:28:26 (2856): No heartbeat from core client for 30 sec - exiting
14:28:27 (2856): No heartbeat from core client for 30 sec - exiting
14:28:28 (2856): No heartbeat from core client for 30 sec - exiting
14:28:29 (2856): No heartbeat from core client for 30 sec - exiting
14:28:30 (2856): No heartbeat from core client for 30 sec - exiting
14:28:31 (2856): No heartbeat from core client for 30 sec - exiting
14:28:32 (2856): No heartbeat from core client for 30 sec - exiting
14:28:33 (2856): No heartbeat from core client for 30 sec - exiting
14:28:34 (2856): No heartbeat from core client for 30 sec - exiting
14:28:35 (2856): No heartbeat from core client for 30 sec - exiting
14:28:36 (2856): No heartbeat from core client for 30 sec - exiting
14:28:37 (2856): No heartbeat from core client for 30 sec - exiting
14:28:38 (2856): No heartbeat from core client for 30 sec - exiting
14:28:39 (2856): No heartbeat from core client for 30 sec - exiting
14:28:40 (2856): No heartbeat from core client for 30 sec - exiting
14:28:41 (2856): No heartbeat from core client for 30 sec - exiting
14:28:42 (2856): No heartbeat from core client for 30 sec - exiting
14:28:43 (2856): No heartbeat from core client for 30 sec - exiting
14:28:44 (2856): No heartbeat from core client for 30 sec - exiting
14:28:45 (2856): No heartbeat from core client for 30 sec - exiting
14:28:46 (2856): No heartbeat from core client for 30 sec - exiting
14:28:47 (2856): No heartbeat from core client for 30 sec - exiting
14:28:48 (2856): No heartbeat from core client for 30 sec - exiting
14:28:49 (2856): No heartbeat from core client for 30 sec - exiting
14:28:50 (2856): No heartbeat from core client for 30 sec - exiting
14:28:51 (2856): No heartbeat from core client for 30 sec - exiting
14:28:52 (2856): No heartbeat from core client for 30 sec - exiting
14:28:53 (2856): No heartbeat from core client for 30 sec - exiting
14:28:54 (2856): No heartbeat from core client for 30 sec - exiting
14:28:55 (2856): No heartbeat from core client for 30 sec - exiting
14:28:56 (2856): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Leaving CPDN_Main::Monitor...
Called boinc_finish

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
14 Sep 2012 18:14:38 1164908 15189128 hadam3p_saf_1alh_1964_1_006931965_1 138,336 330,899 2.3920
09 Sep 2012 14:26:19 1164908 15189128 hadam3p_saf_1alh_1964_1_006931965_1 126,816 302,983 2.3892
08 Sep 2012 16:34:07 1164908 15189128 hadam3p_saf_1alh_1964_1_006931965_1 115,296 275,538 2.3898
07 Sep 2012 19:41:43 1164908 15189128 hadam3p_saf_1alh_1964_1_006931965_1 103,776 247,975 2.3895
02 Sep 2012 18:39:41 1164908 15189128 hadam3p_saf_1alh_1964_1_006931965_1 92,256 220,705 2.3923
01 Sep 2012 19:46:22 1164908 15189128 hadam3p_saf_1alh_1964_1_006931965_1 80,736 194,088 2.4040
01 Sep 2012 12:26:08 1164908 15189128 hadam3p_saf_1alh_1964_1_006931965_1 69,216 167,439 2.4191
31 Aug 2012 15:41:52 1164908 15189128 hadam3p_saf_1alh_1964_1_006931965_1 57,696 140,277 2.4313
30 Aug 2012 16:18:28 1164908 15189128 hadam3p_saf_1alh_1964_1_006931965_1 46,176 112,554 2.4375
29 Aug 2012 10:15:43 1164908 15189128 hadam3p_saf_1alh_1964_1_006931965_1 34,656 84,780 2.4463
27 Aug 2012 19:00:10 1164908 15189128 hadam3p_saf_1alh_1964_1_006931965_1 23,136 56,582 2.4456
27 Aug 2012 11:16:58 1164908 15189128 hadam3p_saf_1alh_1964_1_006931965_1 11,616 28,648 2.4663


©2024 climateprediction.net