climateprediction.net home page
Task 13134867

Task 13134867

Name hadcm3n_yile_1900_40_007356956_2
Workunit 7554386
Created 9 Jul 2011, 7:40:03 UTC
Sent 9 Jul 2011, 7:41:20 UTC
Report deadline 8 Oct 2011, 15:08:31 UTC
Received 2 Oct 2011, 8:51:03 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 193 (0x000000C1) EXIT_SIGNAL
Computer ID 1012620
Run time 18 days 9 hours 15 min 57 sec
CPU time 13 days 18 hours 12 min 16 sec
Validate state Invalid
Credit 6,220.80
Device peak FLOPS 2.27 GFLOPS
Application version UK Met Office Coupled Model Full Resolution Ocean v6.07
windows_intelx86
Stderr 
<core_client_version>6.12.34</core_client_version>
<![CDATA[
<message>
 - exit code 193 (0xc1)
</message>
<stderr_txt>
Suspended CPDN Monitor - Suspend request from BOINC...
20:16:19 (4576): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3604, iMonCtr=1
Model crash detected, will try to restart...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=732, iMonCtr=1
Model crash detected, will try to restart...
12:03:56 (184): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
12:03:57 (184): No heartbeat from core client for 30 sec - exiting
12:03:59 (184): No heartbeat from core client for 30 sec - exiting
12:04:00 (184): No heartbeat from core client for 30 sec - exiting
12:04:01 (184): No heartbeat from core client for 30 sec - exiting
12:04:02 (184): No heartbeat from core client for 30 sec - exiting
12:04:03 (184): No heartbeat from core client for 30 sec - exiting
12:04:04 (184): No heartbeat from core client for 30 sec - exiting
12:04:05 (184): No heartbeat from core client for 30 sec - exiting
12:04:06 (184): No heartbeat from core client for 30 sec - exiting
12:04:07 (184): No heartbeat from core client for 30 sec - exiting
Ocean Restart file copy failed on yileko.daa3310
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4524, iMonCtr=1
Model crash detected, will try to restart...
CController:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3832, iMonCtr=1
Model crash detected, will try to restart...
Suspended CPDN Monitor - Suspend request from BOINC...
Atmos Hold Restart file rename failed on atmos_restart.hold
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5124, iMonCtr=1
Model crash detected, will try to restart...
Suspended CPDN Monitor - Suspend request from BOINC...
11:24:53 (3408): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4588, iMonCtr=1
Model crash detected, will try to restart...
17:05:03 (2816): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
17:05:05 (2816): No heartbeat from core client for 30 sec - exiting
17:05:06 (2816): No heartbeat from core client for 30 sec - exiting
17:05:07 (2816): No heartbeat from core client for 30 sec - exiting
17:05:08 (2816): No heartbeat from core client for 30 sec - exiting
17:05:09 (2816): No heartbeat from core client for 30 sec - exiting
17:05:10 (2816): No heartbeat from core client for 30 sec - exiting
17:05:11 (2816): No heartbeat from core client for 30 sec - exiting
17:05:12 (2816): No heartbeat from core client for 30 sec - exiting
17:05:13 (2816): No heartbeat from core client for 30 sec - exiting
17:05:14 (2816): No heartbeat from core client for 30 sec - exiting
17:05:15 (2816): No heartbeat from core client for 30 sec - exiting
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3472, iMonCtr=1
Model crash detected, will try to restart...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5344, iMonCtr=1
Model crash detected, will try to restart...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4208, iMonCtr=1
Model crash detected, will try to restart...
Suspended CPDN Monitor - Suspend request from BOINC...
BUFFOUT: C I/O Error - Return code = 32

Model crashed: WRITHEAD: I/O error                                                                                                                                                                                                                                             tmp/pipe_dummy                                                                  2048    
BUFFOUT: C I/O Error - Return code = 32

Model crashed: WRITDUMP: BAD BUFFOUT OF DATA                                                     Suspended CPDN Monitor - Suspend request from BOINC...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3412, iMonCtr=1
Model crash detected, will try to restart...
Suspended CPDN Monitor - Suspend request from BOINC...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5128, iMonCtr=1
Model crash detected, will try to restart...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4280, iMonCtr=1
Model crash detected, will try to restart...
Ocean Restart file copy failed on yileko.dab06i0
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4032, iMonCtr=1
Model crash detected, will try to restart...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5580, iMonCtr=1
Model crash detected, will try to restart...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5104, iMonCtr=1
Model crash detected, will try to restart...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5636, iMonCtr=1
Model crash detected, will try to restart...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5732, iMonCtr=1
Model crash detected, will try to restart...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5728, iMonCtr=1
Model crash detected, will try to restart...
Suspended CPDN Monitor - Suspend request from BOINC...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3212, iMonCtr=1
Model crash detected, will try to restart...
11:26:45 (5356): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
13:29:46 (4448): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
15:31:20 (6672): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
15:31:21 (6672): No heartbeat from core client for 30 sec - exiting
10:55:20 (5072): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Atmos Hold Restart file rename failed on atmos_restart.hold
12:56:57 (5704): No heartbeat from core client for 30 sec - exiting
12:56:58 (5704): No heartbeat from core client for 30 sec - exiting
12:56:59 (5704): No heartbeat from core client for 30 sec - exiting
12:57:00 (5704): No heartbeat from core client for 30 sec - exiting
12:57:01 (5704): No heartbeat from core client for 30 sec - exiting
12:57:02 (5704): No heartbeat from core client for 30 sec - exiting
12:57:03 (5704): No heartbeat from core client for 30 sec - exiting
12:57:04 (5704): No heartbeat from core client for 30 sec - exiting
12:57:06 (5704): No heartbeat from core client for 30 sec - exiting
12:57:07 (5704): No heartbeat from core client for 30 sec - exiting
12:57:08 (5704): No heartbeat from core client for 30 sec - exiting
12:57:09 (5704): No heartbeat from core client for 30 sec - exiting
12:57:10 (5704): No heartbeat from core client for 30 sec - exiting
12:57:11 (5704): No heartbeat from core client for 30 sec - exiting
12:57:12 (5704): No heartbeat from core client for 30 sec - exiting
12:57:13 (5704): No heartbeat from core client for 30 sec - exiting
12:57:14 (5704): No heartbeat from core client for 30 sec - exiting
12:57:15 (5704): No heartbeat from core client for 30 sec - exiting
12:57:16 (5704): No heartbeat from core client for 30 sec - exiting
12:57:17 (5704): No heartbeat from core client for 30 sec - exiting
12:57:18 (5704): No heartbeat from core client for 30 sec - exiting
12:57:19 (5704): No heartbeat from core client for 30 sec - exiting
12:57:20 (5704): No heartbeat from core client for 30 sec - exiting
12:57:21 (5704): No heartbeat from core client for 30 sec - exiting
12:57:22 (5704): No heartbeat from core client for 30 sec - exiting
12:57:23 (5704): No heartbeat from core client for 30 sec - exiting
12:57:24 (5704): No heartbeat from core client for 30 sec - exiting
12:57:25 (5704): No heartbeat from core client for 30 sec - exiting
12:57:26 (5704): No heartbeat from core client for 30 sec - exiting
12:57:28 (5704): No heartbeat from core client for 30 sec - exiting
12:57:29 (5704): No heartbeat from core client for 30 sec - exiting
12:57:30 (5704): No heartbeat from core client for 30 sec - exiting
12:57:31 (5704): No heartbeat from core client for 30 sec - exiting
12:57:32 (5704): No heartbeat from core client for 30 sec - exiting
12:57:33 (5704): No heartbeat from core client for 30 sec - exiting
12:57:34 (5704): No heartbeat from core client for 30 sec - exiting
12:57:35 (5704): No heartbeat from core client for 30 sec - exiting
12:57:36 (5704): No heartbeat from core client for 30 sec - exiting
12:57:37 (5704): No heartbeat from core client for 30 sec - exiting
12:57:38 (5704): No heartbeat from core client for 30 sec - exiting
12:57:40 (5704): No heartbeat from core client for 30 sec - exiting
12:57:41 (5704): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
08:00:44 (4832): No heartbeat from core client for 30 sec - exiting
08:00:46 (4832): No heartbeat from core client for 30 sec - exiting
08:00:47 (4832): No heartbeat from core client for 30 sec - exiting
08:00:48 (4832): No heartbeat from core client for 30 sec - exiting
08:00:49 (4832): No heartbeat from core client for 30 sec - exiting
08:00:50 (4832): No heartbeat from core client for 30 sec - exiting
08:00:51 (4832): No heartbeat from core client for 30 sec - exiting
08:00:52 (4832): No heartbeat from core client for 30 sec - exiting
08:00:53 (4832): No heartbeat from core client for 30 sec - exiting
08:00:54 (4832): No heartbeat from core client for 30 sec - exiting
08:00:55 (4832): No heartbeat from core client for 30 sec - exiting
08:00:56 (4832): No heartbeat from core client for 30 sec - exiting
08:00:57 (4832): No heartbeat from core client for 30 sec - exiting
08:00:58 (4832): No heartbeat from core client for 30 sec - exiting
08:00:59 (4832): No heartbeat from core client for 30 sec - exiting
08:01:00 (4832): No heartbeat from core client for 30 sec - exiting
08:01:01 (4832): No heartbeat from core client for 30 sec - exiting
08:01:03 (4832): No heartbeat from core client for 30 sec - exiting
08:01:04 (4832): No heartbeat from core client for 30 sec - exiting
08:01:05 (4832): No heartbeat from core client for 30 sec - exiting
08:01:06 (4832): No heartbeat from core client for 30 sec - exiting
08:01:07 (4832): No heartbeat from core client for 30 sec - exiting
08:01:09 (4832): No heartbeat from core client for 30 sec - exiting
08:01:10 (4832): No heartbeat from core client for 30 sec - exiting
08:01:11 (4832): No heartbeat from core client for 30 sec - exiting
08:01:12 (4832): No heartbeat from core client for 30 sec - exiting
08:01:13 (4832): No heartbeat from core client for 30 sec - exiting
08:01:14 (4832): No heartbeat from core client for 30 sec - exiting
08:01:15 (4832): No heartbeat from core client for 30 sec - exiting
08:01:16 (4832): No heartbeat from core client for 30 sec - exiting
08:01:17 (4832): No heartbeat from core client for 30 sec - exiting
08:01:18 (4832): No heartbeat from core client for 30 sec - exiting
08:01:19 (4832): No heartbeat from core client for 30 sec - exiting
08:01:20 (4832): No heartbeat from core client for 30 sec - exiting
08:01:21 (4832): No heartbeat from core client for 30 sec - exiting
08:01:22 (4832): No heartbeat from core client for 30 sec - exiting
08:01:23 (4832): No heartbeat from core client for 30 sec - exiting
08:01:24 (4832): No heartbeat from core client for 30 sec - exiting
08:01:25 (4832): No heartbeat from core client for 30 sec - exiting
08:01:26 (4832): No heartbeat from core client for 30 sec - exiting
08:01:27 (4832): No heartbeat from core client for 30 sec - exiting
08:01:29 (4832): No heartbeat from core client for 30 sec - exiting
08:01:30 (4832): No heartbeat from core client for 30 sec - exiting
08:01:31 (4832): No heartbeat from core client for 30 sec - exiting
08:01:32 (4832): No heartbeat from core client for 30 sec - exiting
08:01:33 (4832): No heartbeat from core client for 30 sec - exiting
08:01:34 (4832): No heartbeat from core client for 30 sec - exiting
08:01:35 (4832): No heartbeat from core client for 30 sec - exiting
08:01:36 (4832): No heartbeat from core client for 30 sec - exiting
08:01:37 (4832): No heartbeat from core client for 30 sec - exiting
08:01:38 (4832): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
20:32:06 (3212): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
20:32:08 (3212): No heartbeat from core client for 30 sec - exiting
08:13:27 (5656): No heartbeat from core client for 30 sec - exiting
08:13:28 (5656): No heartbeat from core client for 30 sec - exiting
08:13:29 (5656): No heartbeat from core client for 30 sec - exiting
08:13:30 (5656): No heartbeat from core client for 30 sec - exiting
08:13:32 (5656): No heartbeat from core client for 30 sec - exiting
08:13:33 (5656): No heartbeat from core client for 30 sec - exiting
08:13:34 (5656): No heartbeat from core client for 30 sec - exiting
08:13:35 (5656): No heartbeat from core client for 30 sec - exiting
08:13:36 (5656): No heartbeat from core client for 30 sec - exiting
08:13:37 (5656): No heartbeat from core client for 30 sec - exiting
08:13:38 (5656): No heartbeat from core client for 30 sec - exiting
08:13:39 (5656): No heartbeat from core client for 30 sec - exiting
08:13:40 (5656): No heartbeat from core client for 30 sec - exiting
08:13:41 (5656): No heartbeat from core client for 30 sec - exiting
08:13:43 (5656): No heartbeat from core client for 30 sec - exiting
08:13:44 (5656): No heartbeat from core client for 30 sec - exiting
08:13:45 (5656): No heartbeat from core client for 30 sec - exiting
08:13:46 (5656): No heartbeat from core client for 30 sec - exiting
08:13:47 (5656): No heartbeat from core client for 30 sec - exiting
08:13:48 (5656): No heartbeat from core client for 30 sec - exiting
08:13:49 (5656): No heartbeat from core client for 30 sec - exiting
08:13:50 (5656): No heartbeat from core client for 30 sec - exiting
08:13:51 (5656): No heartbeat from core client for 30 sec - exiting
08:13:52 (5656): No heartbeat from core client for 30 sec - exiting
08:13:53 (5656): No heartbeat from core client for 30 sec - exiting
08:13:54 (5656): No heartbeat from core client for 30 sec - exiting
08:13:55 (5656): No heartbeat from core client for 30 sec - exiting
08:13:56 (5656): No heartbeat from core client for 30 sec - exiting
08:13:57 (5656): No heartbeat from core client for 30 sec - exiting
08:13:58 (5656): No heartbeat from core client for 30 sec - exiting
08:14:00 (5656): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4764, iMonCtr=1
Model crash detected, will try to restart...
09:04:45 (6140): No heartbeat from core client for 30 sec - exiting
09:04:46 (6140): No heartbeat from core client for 30 sec - exiting
09:04:47 (6140): No heartbeat from core client for 30 sec - exiting
09:04:48 (6140): No heartbeat from core client for 30 sec - exiting
09:04:49 (6140): No heartbeat from core client for 30 sec - exiting
09:04:50 (6140): No heartbeat from core client for 30 sec - exiting
09:04:52 (6140): No heartbeat from core client for 30 sec - exiting
09:04:53 (6140): No heartbeat from core client for 30 sec - exiting
09:04:54 (6140): No heartbeat from core client for 30 sec - exiting
09:04:55 (6140): No heartbeat from core client for 30 sec - exiting
09:04:56 (6140): No heartbeat from core client for 30 sec - exiting
09:04:57 (6140): No heartbeat from core client for 30 sec - exiting
09:04:58 (6140): No heartbeat from core client for 30 sec - exiting
09:04:59 (6140): No heartbeat from core client for 30 sec - exiting
09:05:00 (6140): No heartbeat from core client for 30 sec - exiting
09:05:01 (6140): No heartbeat from core client for 30 sec - exiting
09:05:02 (6140): No heartbeat from core client for 30 sec - exiting
09:05:04 (6140): No heartbeat from core client for 30 sec - exiting
09:05:05 (6140): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
09:05:06 (6140): No heartbeat from core client for 30 sec - exiting
09:05:07 (6140): No heartbeat from core client for 30 sec - exiting
09:05:08 (6140): No heartbeat from core client for 30 sec - exiting
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5376, iMonCtr=1
Model crash detected, will try to restart...
13:45:04 (5248): No heartbeat from core client for 30 sec - exiting
13:45:05 (5248): No heartbeat from core client for 30 sec - exiting
13:45:06 (5248): No heartbeat from core client for 30 sec - exiting
13:45:07 (5248): No heartbeat from core client for 30 sec - exiting
13:45:08 (5248): No heartbeat from core client for 30 sec - exiting
13:45:09 (5248): No heartbeat from core client for 30 sec - exiting
13:45:10 (5248): No heartbeat from core client for 30 sec - exiting
13:45:11 (5248): No heartbeat from core client for 30 sec - exiting
13:45:12 (5248): No heartbeat from core client for 30 sec - exiting
13:45:13 (5248): No heartbeat from core client for 30 sec - exiting
13:45:14 (5248): No heartbeat from core client for 30 sec - exiting
13:45:15 (5248): No heartbeat from core client for 30 sec - exiting
13:45:16 (5248): No heartbeat from core client for 30 sec - exiting
13:45:17 (5248): No heartbeat from core client for 30 sec - exiting
13:45:18 (5248): No heartbeat from core client for 30 sec - exiting
13:45:19 (5248): No heartbeat from core client for 30 sec - exiting
13:45:20 (5248): No heartbeat from core client for 30 sec - exiting
13:45:21 (5248): No heartbeat from core client for 30 sec - exiting
13:45:22 (5248): No heartbeat from core client for 30 sec - exiting
13:45:23 (5248): No heartbeat from core client for 30 sec - exiting
13:45:24 (5248): No heartbeat from core client for 30 sec - exiting
13:45:25 (5248): No heartbeat from core client for 30 sec - exiting
13:45:26 (5248): No heartbeat from core client for 30 sec - exiting
13:45:27 (5248): No heartbeat from core client for 30 sec - exiting
13:45:28 (5248): No heartbeat from core client for 30 sec - exiting
13:45:29 (5248): No heartbeat from core client for 30 sec - exiting
13:45:30 (5248): No heartbeat from core client for 30 sec - exiting
13:45:31 (5248): No heartbeat from core client for 30 sec - exiting
13:45:32 (5248): No heartbeat from core client for 30 sec - exiting
13:45:33 (5248): No heartbeat from core client for 30 sec - exiting
13:45:34 (5248): No heartbeat from core client for 30 sec - exiting
13:45:35 (5248): No heartbeat from core client for 30 sec - exiting
13:45:36 (5248): No heartbeat from core client for 30 sec - exiting
13:45:37 (5248): No heartbeat from core client for 30 sec - exiting
13:45:38 (5248): No heartbeat from core client for 30 sec - exiting
13:45:39 (5248): No heartbeat from core client for 30 sec - exiting
13:45:40 (5248): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
13:45:43 (5248): No heartbeat from core client for 30 sec - exiting
13:45:45 (5248): No heartbeat from core client for 30 sec - exiting
13:45:47 (5248): No heartbeat from core client for 30 sec - exiting
13:45:49 (5248): No heartbeat from core client for 30 sec - exiting
13:45:50 (5248): No heartbeat from core client for 30 sec - exiting
13:45:51 (5248): No heartbeat from core client for 30 sec - exiting
13:45:53 (5248): No heartbeat from core client for 30 sec - exiting
17:04:23 (4056): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
07:51:24 (5700): No heartbeat from core client for 30 sec - exiting
07:51:25 (5700): No heartbeat from core client for 30 sec - exiting
07:51:26 (5700): No heartbeat from core client for 30 sec - exiting
07:51:27 (5700): No heartbeat from core client for 30 sec - exiting
07:51:28 (5700): No heartbeat from core client for 30 sec - exiting
07:51:29 (5700): No heartbeat from core client for 30 sec - exiting
07:51:30 (5700): No heartbeat from core client for 30 sec - exiting
07:51:31 (5700): No heartbeat from core client for 30 sec - exiting
07:51:32 (5700): No heartbeat from core client for 30 sec - exiting
07:51:33 (5700): No heartbeat from core client for 30 sec - exiting
07:51:34 (5700): No heartbeat from core client for 30 sec - exiting
07:51:35 (5700): No heartbeat from core client for 30 sec - exiting
07:51:36 (5700): No heartbeat from core client for 30 sec - exiting
07:51:38 (5700): No heartbeat from core client for 30 sec - exiting
07:51:39 (5700): No heartbeat from core client for 30 sec - exiting
07:51:40 (5700): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
07:51:41 (5700): No heartbeat from core client for 30 sec - exiting
10:25:01 (5996): No heartbeat from core client for 30 sec - exiting
10:25:02 (5996): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5196, iMonCtr=1
Model crash detected, will try to restart...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...


Unhandled Exception Detected...

- Unhandled Exception Record -
Reason: Access Violation (0xc0000005) at address 0x77946E0F read attempt to address 0x409B894F

Engaging BOINC Windows Runtime Debugger...

Cannot serialize file C:\ProgramData\BOINC/projects/climateprediction.net/hadcm3n_yile_1900_40_007356956/dataout/shmem_restart.day
Signal 11 received, exiting...
Called boinc_finish

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
02 Oct 2011 08:50:44 1012620 13134867 hadcm3n_yile_1900_40_007356956_2 518,400 1,188,733 2.2931
01 Oct 2011 07:01:59 1012620 13134867 hadcm3n_yile_1900_40_007356956_2 492,480 1,133,749 2.3021
27 Sep 2011 08:07:42 1012620 13134867 hadcm3n_yile_1900_40_007356956_2 466,560 1,077,884 2.3103
25 Sep 2011 08:25:24 1012620 13134867 hadcm3n_yile_1900_40_007356956_2 440,640 1,022,295 2.3200
21 Sep 2011 17:27:50 1012620 13134867 hadcm3n_yile_1900_40_007356956_2 414,720 965,410 2.3279
19 Sep 2011 06:56:36 1012620 13134867 hadcm3n_yile_1900_40_007356956_2 388,800 910,195 2.3410
16 Sep 2011 11:58:49 1012620 13134867 hadcm3n_yile_1900_40_007356956_2 362,880 850,345 2.3433
11 Sep 2011 13:57:59 1012620 13134867 hadcm3n_yile_1900_40_007356956_2 336,960 784,818 2.3291
06 Sep 2011 15:36:08 1012620 13134867 hadcm3n_yile_1900_40_007356956_2 311,040 720,682 2.3170
03 Sep 2011 11:34:14 1012620 13134867 hadcm3n_yile_1900_40_007356956_2 285,120 655,423 2.2988
01 Sep 2011 12:14:50 1012620 13134867 hadcm3n_yile_1900_40_007356956_2 259,200 592,260 2.2850
26 Aug 2011 07:11:55 1012620 13134867 hadcm3n_yile_1900_40_007356956_2 233,280 526,361 2.2563
24 Aug 2011 16:33:12 1012620 13134867 hadcm3n_yile_1900_40_007356956_2 207,360 509,629 2.4577
23 Aug 2011 07:23:46 1012620 13134867 hadcm3n_yile_1900_40_007356956_2 181,440 443,604 2.4449
20 Aug 2011 07:31:40 1012620 13134867 hadcm3n_yile_1900_40_007356956_2 155,520 379,701 2.4415
13 Aug 2011 07:37:36 1012620 13134867 hadcm3n_yile_1900_40_007356956_2 129,600 316,042 2.4386
04 Aug 2011 17:41:53 1012620 13134867 hadcm3n_yile_1900_40_007356956_2 103,680 252,960 2.4398
03 Aug 2011 10:16:36 1012620 13134867 hadcm3n_yile_1900_40_007356956_2 77,760 192,197 2.4717
02 Aug 2011 14:53:56 1012620 13134867 hadcm3n_yile_1900_40_007356956_2 51,840 127,737 2.4641
25 Jul 2011 18:50:48 1012620 13134867 hadcm3n_yile_1900_40_007356956_2 25,920 64,443 2.4862


©2024 climateprediction.net