climateprediction.net home page
Task 13667936

Task 13667936

Name hadcm3n_t2vo_1940_40_007545960_1
Workunit 7743192
Created 29 Nov 2011, 1:00:02 UTC
Sent 1 Dec 2011, 19:32:41 UTC
Report deadline 2 Mar 2012, 2:59:52 UTC
Received 26 Dec 2011, 20:50:03 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 22 (0x00000016) Unknown error code
Computer ID 1182746
Run time 8 days 7 hours 12 min 46 sec
CPU time 7 days 19 hours 25 min 5 sec
Validate state Invalid
Credit 6,220.80
Device peak FLOPS 3.08 GFLOPS
Application version UK Met Office Coupled Model Full Resolution Ocean v6.07
i686-apple-darwin
Stderr
<core_client_version>6.12.27</core_client_version>
<![CDATA[
<message>
process exited with code 22 (0x16, -234)
</message>
<stderr_txt>
Suspended CPDN Monitor - Suspend request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;CPDN Monitor - Quit request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;CPDN Monitor - Quit request from BOINC...&#10;CPDN Monitor - Quit request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;CPDN Monitor - Quit request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;CPDN Monitor - Quit request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;CPDN Monitor - Quit request from BOINC...&#10;CPDN Monitor - Quit request from BOINC...&#10;CPDN Monitor - Quit request from BOINC...&#10;CPDN Monitor - Quit request from BOINC...&#10;CPDN Monitor - Quit request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;CPDN Monitor - Quit request from BOINC...&#10;CPDN Monitor - Quit request from BOINC...&#10;CPDN Monitor - Quit request from BOINC...&#10;CPDN Monitor - Quit request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;Suspended CPDN Monitor - Quit request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;CPDN Monitor - Quit request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;CPDN Monitor - Quit request from BOINC...&#10;CPDN Monitor - Quit request from BOINC...&#10;CPDN Monitor - Quit request from BOINC...&#10;CPDN Monitor - Quit request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;CPDN Monitor - Quit request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;CPDN Monitor - Quit request from BOINC...&#10;CPDN Monitor - Quit request from BOINC...&#10;CPDN Monitor - Quit request from BOINC...&#10;CPDN Monitor - Quit request from BOINC...&#10;CPDN Monitor - Quit request from BOINC...&#10;CPDN Monitor - Quit request from BOINC...&#10;&#10;BUFFIN: Read Failed: No such file or directory&#10;BUFFIN: C I/O Error feof - Unit 63 - Return code = 1&#10;&#10;BUFFIN: Read Failed: No such file or directory&#10;BUFFIN: C I/O Error feof - Unit 64 - Return code = 1&#10;&#10;BUFFIN: Read Failed: No such file or directory&#10;BUFFIN: C I/O Error feof - Unit 65 - Return code = 1&#10;&#10;BUFFIN: Read Failed: No such file or directory&#10;BUFFIN: C I/O Error feof - Unit 66 - Return code = 1&#10;&#10;BUFFIN: Read Failed: No such file or directory&#10;BUFFIN: C I/O Error feof - Unit 67 - Return code = 1&#10;&#10;BUFFIN: Read Failed: No such file or directory&#10;BUFFIN: C I/O Error feof - Unit 68 - Return code = 1&#10;&#10;BUFFIN: Read Failed: No such file or directory&#10;BUFFIN: C I/O Error feof - Unit 69 - Return code = 1&#10;Error: Input file: dataout/t2voko.pje4c10 is not a valid UM file.&#10;Error converting file to netcdf: dataout/t2voko.pje4c10&#10;Error: Input file: dataout/t2voko.pie4c10 is not a valid UM file.&#10;Error converting file to netcdf: dataout/t2voko.pie4c10&#10;Error: Input file: dataout/t2voko.pfe4c10 is not a valid UM file.&#10;Error converting file to netcdf: dataout/t2voko.pfe4c10&#10;Error: Input file: dataout/t2voka.phe4c10 is not a valid UM file.&#10;Error converting file to netcdf: dataout/t2voka.phe4c10&#10;Error: Input file: dataout/t2voka.pge4c10 is not a valid UM file.&#10;Error converting file to netcdf: dataout/t2voka.pge4c10&#10;Error: Input file: dataout/t2voka.pee4c10 is not a valid UM file.&#10;Error converting file to netcdf: dataout/t2voka.pee4c10&#10;Error: Input file: dataout/t2voka.pde4c10 is not a valid UM file.&#10;Error converting file to netcdf: dataout/t2voka.pde4c10&#10;CPDN Monitor - Quit request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;CPDN Monitor - Quit request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;CPDN Monitor - Quit request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;CPDN Monitor - Quit request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;CPDN Monitor - Quit request from BOINC...&#10;CPDN Monitor - Quit request from BOINC...&#10;CPDN Monitor - Quit request from BOINC...&#10;CPDN Monitor - Quit request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;CPDN Monitor - Quit request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;CPDN Monitor - Quit request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;CPDN Monitor - Quit request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;CPDN Monitor - Quit request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;CPDN Monitor - Quit request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;CPDN Monitor - Quit request from BOINC...&#10;CPDN Monitor - Quit request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;Signal 15 received, exiting...&#10;Called boinc_finish&#10;Signal 15 received, exiting...&#10;Called boinc_finish&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;CPDN Monitor - Quit request from BOINC...&#10;CPDN Monitor - Quit request from BOINC...&#10;CPDN Monitor - Quit request from BOINC...&#10;&#10;BUFFIN: Read Failed: No such file or directory&#10;BUFFIN: C I/O Error feof - Unit 63 - Return code = 1&#10;&#10;BUFFIN: Read Failed: No such file or directory&#10;BUFFIN: C I/O Error feof - Unit 64 - Return code = 1&#10;&#10;BUFFIN: Read Failed: No such file or directory&#10;BUFFIN: C I/O Error feof - Unit 65 - Return code = 1&#10;&#10;BUFFIN: Read Failed: No such file or directory&#10;BUFFIN: C I/O Error feof - Unit 66 - Return code = 1&#10;&#10;BUFFIN: Read Failed: No such file or directory&#10;BUFFIN: C I/O Error feof - Unit 67 - Return code = 1&#10;&#10;BUFFIN: Read Failed: No such file or directory&#10;BUFFIN: C I/O Error feof - Unit 68 - Return code = 1&#10;&#10;BUFFIN: Read Failed: No such file or directory&#10;BUFFIN: C I/O Error feof - Unit 69 - Return code = 1&#10;CPDN Monitor - Quit request from BOINC...&#10;CPDN Monitor - Quit request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;CPDN Monitor - Quit request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;CPDN Monitor - Quit request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;CPDN Monitor - Quit request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;CPDN Monitor - Quit request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;CPDN Monitor - Quit request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;CPDN Monitor - Quit request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;CPDN Monitor - Quit request from BOINC...&#10;CPDN Monitor - Quit request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;CPDN Monitor - Quit request from BOINC...&#10;CPDN Monitor - Quit request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;CPDN Monitor - Quit request from BOINC...&#10;CPDN Monitor - Quit request from BOINC...&#10;CPDN Monitor - Quit request from BOINC...&#10;CPDN Monitor - Quit request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;CPDN Monitor - Quit request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;CPDN Monitor - Quit request from BOINC...&#10;CPDN Monitor - Quit request from BOINC...&#10;CPDN Monitor - Quit request from BOINC...&#10;CPDN Monitor - Quit request from BOINC...&#10;CPDN Monitor - Quit request from BOINC...&#10;CPDN Monitor - Quit request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;CPDN Monitor - Quit request from BOINC...&#10;CPDN Monitor - Quit request from BOINC...&#10;CPDN Monitor - Quit request from BOINC...&#10;CPDN Monitor - Quit request from BOINC...&#10;CPDN Monitor - Quit request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;CPDN Monitor - Quit request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;CPDN Monitor - Quit request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;CPDN Monitor - Quit request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;CPDN Monitor - Quit request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;CPDN Monitor - Quit request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;CPDN Monitor - Quit request from BOINC...&#10;CPDN Monitor - Quit request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;CPDN Monitor - Quit request from BOINC...&#10;CPDN Monitor - Quit request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;CPDN Monitor - Quit request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;CPDN Monitor - Quit request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;CPDN Monitor - Quit request from BOINC...&#10;&#10;BUFFIN: Read Failed: No such file or directory&#10;BUFFIN: C I/O Error feof - Unit 63 - Return code = 1&#10;&#10;BUFFIN: Read Failed: No such file or directory&#10;BUFFIN: C I/O Error feof - Unit 64 - Return code = 1&#10;&#10;BUFFIN: Read Failed: No such file or directory&#10;BUFFIN: C I/O Error feof - Unit 65 - Return code = 1&#10;&#10;BUFFIN: Read Failed: No such file or directory&#10;BUFFIN: C I/O Error feof - Unit 66 - Return code = 1&#10;&#10;BUFFIN: Read Failed: No such file or directory&#10;BUFFIN: C I/O Error feof - Unit 67 - Return code = 1&#10;&#10;BUFFIN: Read Failed: No such file or directory&#10;BUFFIN: C I/O Error feof - Unit 68 - Return code = 1&#10;&#10;BUFFIN: Read Failed: No such file or directory&#10;BUFFIN: C I/O Error feof - Unit 69 - Return code = 1&#10;CPDN Monitor - Quit request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;CPDN Monitor - Quit request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;CPDN Monitor - Quit request from BOINC...&#10;CPDN Monitor - Quit request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;CPDN Monitor - Quit request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;CPDN Monitor - Quit request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;CPDN Monitor - Quit request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;CPDN Monitor - Quit request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;CPDN Monitor - Quit request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;CPDN Monitor - Quit request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;CPDN Monitor - Quit request from BOINC...&#10;CPDN Monitor - Quit request from BOINC...&#10;CPDN Monitor - Quit request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;CPDN Monitor - Quit request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;CPDN Monitor - Quit request from BOINC...&#10;CPDN Monitor - Quit request from BOINC...&#10;CPDN Monitor - Quit request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;CPDN Monitor - Quit request from BOINC...&#10;CPDN Monitor - Quit request from BOINC...&#10;CPDN Monitor - Quit request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;CPDN Monitor - Quit request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;CPDN Monitor - Quit request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;CPDN Monitor - Quit request from BOINC...&#10;CPDN Monitor - Quit request from BOINC...&#10;CPDN Monitor - Quit request from BOINC...&#10;CPDN Monitor - Quit request from BOINC...&#10;CPDN Monitor - Quit request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;CPDN Monitor - Quit request from BOINC...&#10;CPDN Monitor - Quit request from BOINC...&#10;CPDN Monitor - Quit request from BOINC...&#10;CPDN Monitor - Quit request from BOINC...&#10;CPDN Monitor - Quit request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;CPDN Monitor - Quit request from BOINC...&#10;CPDN Monitor - Quit request from BOINC...&#10;CPDN Monitor - Quit request from BOINC...&#10;CPDN Monitor - Quit request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;CPDN Monitor - Quit request from BOINC...&#10;CPDN Monitor - Quit request from BOINC...&#10;CPDN Monitor - Quit request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;CPDN Monitor - Quit request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;CPDN Monitor - Quit request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;CPDN Monitor - Quit request from BOINC...&#10;CPDN Monitor - Quit request from BOINC...&#10;CPDN Monitor - Quit request from BOINC...&#10;CPDN Monitor - Quit request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;CPDN Monitor - Quit request from BOINC...&#10;CPDN Monitor - Quit request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;CPDN Monitor - Quit request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;CPDN Monitor - Quit request from BOINC...&#10;CPDN Monitor - Quit request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;CPDN Monitor - Quit request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;CPDN Monitor - Quit request from BOINC...&#10;&#10;BUFFIN: Read Failed: No such file or directory&#10;BUFFIN: C I/O Error feof - Unit 63 - Return code = 1&#10;&#10;BUFFIN: Read Failed: No such file or directory&#10;BUFFIN: C I/O Error feof - Unit 64 - Return code = 1&#10;&#10;BUFFIN: Read Failed: No such file or directory&#10;BUFFIN: C I/O Error feof - Unit 65 - Return code = 1&#10;&#10;BUFFIN: Read Failed: No such file or directory&#10;BUFFIN: C I/O Error feof - Unit 66 - Return code = 1&#10;&#10;BUFFIN: Read Failed: No such file or directory&#10;BUFFIN: C I/O Error feof - Unit 67 - Return code = 1&#10;&#10;BUFFIN: Read Failed: No such file or directory&#10;BUFFIN: C I/O Error feof - Unit 68 - Return code = 1&#10;&#10;BUFFIN: Read Failed: No such file or directory&#10;BUFFIN: C I/O Error feof - Unit 69 - Return code = 1&#10;CPDN Monitor - Quit request from BOINC...&#10;CPDN Monitor - Quit request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;CPDN Monitor - Quit request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;CPDN Monitor - Quit request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;CPDN Monitor - Quit request from BOINC...&#10;CPDN Monitor - Quit request from BOINC...&#10;Suspended CPDN Monitor - Suspend request from BOINC...&#10;hadcm3n_6.07_i686-apple-darwin(44831,0xac9272c0) malloc: *** error for object 0x12ba000: incorrect checksum for freed object - object was probably modified after being freed.&#10;*** set a breakpoint in malloc_error_break to debug&#10;SIGSEGV: segmentation violation&#10;Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=44832, selfPID=44832, iMonCtr=1&#10;hadcm3n_6.07_i686-apple-darwin(49532,0xac9272c0) malloc: *** error for object 0x9c2c04: incorrect checksum for freed object - object was probably modified after being freed.&#10;*** set a breakpoint in malloc_error_break to debug&#10;hadcm3n_6.07_i686-apple-darwin(49532,0xac9272c0) malloc: *** error for object 0x9c2c00: incorrect checksum for freed object - object was probably modified after being freed.&#10;*** set a breakpoint in malloc_error_break to debug&#10;SIGSEGV: segmentation violation&#10;Signal 15 received, exiting...&#10;Called boinc_finish&#10;Signal 15 received, exiting...&#10;Called boinc_finish&#10;hadcm3n_6.07_i686-apple-darwin(65019,0xac9272c0) malloc: *** error for object 0x8cf204: incorrect checksum for freed object - object was probably modified after being freed.&#10;*** set a breakpoint in malloc_error_break to debug&#10;hadcm3n_6.07_i686-apple-darwin(65019,0xac9272c0) malloc: *** error for object 0x8cf200: incorrect checksum for freed object - object was probably modified after being freed.&#10;*** set a breakpoint in malloc_error_break to debug&#10;hadcm3n_6.07_i686-apple-darwin(65019,0xac9272c0) malloc: *** error for object 0x18f0604: incorrect checksum for freed object - object was probably modified after being freed.&#10;*** set a breakpoint in malloc_error_break to debug&#10;hadcm3n_6.07_i686-apple-darwin(65019,0xac9272c0) malloc: *** error for object 0x18f0600: incorrect checksum for freed object - object was probably modified after being freed.&#10;*** set a breakpoint in malloc_error_break to debug&#10;hadcm3n_6.07_i686-apple-darwin(65019,0xac9272c0) malloc: *** error for object 0x18f0604: incorrect checksum for freed object - object was probably modified after being freed.&#10;*** set a breakpoint in malloc_error_break to debug&#10;hadcm3n_6.07_i686-apple-darwin(65019,0xac9272c0) malloc: *** error for object 0x18f0600: incorrect checksum for freed object - object was probably modified after being freed.&#10;*** set a breakpoint in malloc_error_break to debug&#10;hadcm3n_6.07_i686-apple-darwin(65019,0xac9272c0) malloc: *** error for object 0x18f0604: incorrect checksum for freed object - object was probably modified after being freed.&#10;*** set a breakpoint in malloc_error_break to debug&#10;hadcm3n_6.07_i686-apple-darwin(65019,0xac9272c0) malloc: *** error for object 0x18f0600: incorrect checksum for freed object - object was probably modified after being freed.&#10;*** set a breakpoint in malloc_error_break to debug&#10;hadcm3n_6.07_i686-apple-darwin(65019,0xac9272c0) malloc: *** error for object 0x18f0604: incorrect checksum for freed object - object was probably modified after being freed.&#10;*** set a breakpoint in malloc_error_break to debug&#10;hadcm3n_6.07_i686-apple-darwin(65019,0xac9272c0) malloc: *** error for object 0x18f0600: incorrect checksum for freed object - object was probably modified after being freed.&#10;*** set a breakpoint in malloc_error_break to debug&#10;hadcm3n_6.07_i686-apple-darwin(65019,0xac9272c0) malloc: *** error for object 0x18f0604: incorrect checksum for freed object - object was probably modified after being freed.&#10;*** set a breakpoint in malloc_error_break to debug&#10;hadcm3n_6.07_i686-apple-darwin(65019,0xac9272c0) malloc: *** error for object 0x18f0600: incorrect checksum for freed object - object was probably modified after being freed.&#10;*** set a breakpoint in malloc_error_break to debug&#10;cpdnmonitor: cannot open input file /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_t2vo_1940_40_007545960/dataout/atmos_restart.day after 11 attempts&#10;cpdnmonitor: cannot open input file /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_t2vo_1940_40_007545960/dataout/ocean_restart.day after 11 attempts&#10;&#10;Model crashed: READ_FLH: I/O error                                                                                                                                                                                                                                             tmp/pipe_dummy                                                                  2048    &#10;cpdnmonitor: cannot open input file /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_t2vo_1940_40_007545960/dataout/atmos_restart.day after 11 attempts&#10;cpdnmonitor: cannot open input file /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_t2vo_1940_40_007545960/dataout/ocean_restart.day after 11 attempts&#10;&#10;Model crashed: READ_FLH: I/O error                                                                                                                                                                                                                                             tmp/pipe_dummy                                                                  2048    &#10;cpdnmonitor: cannot open input file /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_t2vo_1940_40_007545960/dataout/atmos_restart.day after 11 attempts&#10;cpdnmonitor: cannot open input file /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_t2vo_1940_40_007545960/dataout/ocean_restart.day after 11 attempts&#10;&#10;Model crashed: READ_FLH: I/O error                                                                                                                                                                                                                                             tmp/pipe_dummy                                                                  2048    &#10;cpdnmonitor: cannot open input file /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_t2vo_1940_40_007545960/dataout/atmos_restart.day after 11 attempts&#10;cpdnmonitor: cannot open input file /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_t2vo_1940_40_007545960/dataout/ocean_restart.day after 11 attempts&#10;&#10;Model crashed: READ_FLH: I/O error                                                                                                                                                                                                                                             tmp/pipe_dummy                                                                  2048    &#10;cpdnmonitor: cannot open input file /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_t2vo_1940_40_007545960/dataout/atmos_restart.day after 11 attempts&#10;cpdnmonitor: cannot open input file /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_t2vo_1940_40_007545960/dataout/ocean_restart.day after 11 attempts&#10;&#10;Model crashed: READ_FLH: I/O error                                                                                                                                                                                                                                             tmp/pipe_dummy                                                                  2048    &#10;cpdnmonitor: cannot open input file /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_t2vo_1940_40_007545960/dataout/atmos_restart.day after 11 attempts&#10;cpdnmonitor: cannot open input file /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_t2vo_1940_40_007545960/dataout/ocean_restart.day after 11 attempts&#10;&#10;Model crashed: READ_FLH: I/O error                                                                                                                                                                                                                                             tmp/pipe_dummy                                                                  2048    &#10;Sorry, too many model crashes! :-(&#10;Called boinc_finish&#10;
</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
21 Dec 2011 01:00:53 1182746 13667936 hadcm3n_t2vo_1940_40_007545960_1 518,400 674,736 1.3016
20 Dec 2011 05:52:09 1182746 13667936 hadcm3n_t2vo_1940_40_007545960_1 492,480 640,978 1.3015
19 Dec 2011 04:06:38 1182746 13667936 hadcm3n_t2vo_1940_40_007545960_1 466,560 607,278 1.3016
18 Dec 2011 03:26:31 1182746 13667936 hadcm3n_t2vo_1940_40_007545960_1 440,640 573,523 1.3016
17 Dec 2011 14:45:14 1182746 13667936 hadcm3n_t2vo_1940_40_007545960_1 414,720 539,777 1.3015
16 Dec 2011 23:11:16 1182746 13667936 hadcm3n_t2vo_1940_40_007545960_1 388,800 506,124 1.3018
16 Dec 2011 04:40:29 1182746 13667936 hadcm3n_t2vo_1940_40_007545960_1 362,880 472,312 1.3016
15 Dec 2011 09:49:49 1182746 13667936 hadcm3n_t2vo_1940_40_007545960_1 336,960 438,708 1.3020
13 Dec 2011 02:23:46 1182746 13667936 hadcm3n_t2vo_1940_40_007545960_1 311,040 404,971 1.3020
11 Dec 2011 22:25:26 1182746 13667936 hadcm3n_t2vo_1940_40_007545960_1 285,120 371,152 1.3017
11 Dec 2011 06:01:06 1182746 13667936 hadcm3n_t2vo_1940_40_007545960_1 259,200 337,639 1.3026
09 Dec 2011 18:30:37 1182746 13667936 hadcm3n_t2vo_1940_40_007545960_1 233,280 303,788 1.3022
09 Dec 2011 01:45:57 1182746 13667936 hadcm3n_t2vo_1940_40_007545960_1 207,360 270,113 1.3026
08 Dec 2011 03:46:37 1182746 13667936 hadcm3n_t2vo_1940_40_007545960_1 181,440 236,177 1.3017
05 Dec 2011 18:04:22 1182746 13667936 hadcm3n_t2vo_1940_40_007545960_1 129,600 168,816 1.3026
04 Dec 2011 16:01:44 1182746 13667936 hadcm3n_t2vo_1940_40_007545960_1 103,680 134,975 1.3018
03 Dec 2011 20:31:28 1182746 13667936 hadcm3n_t2vo_1940_40_007545960_1 77,760 100,923 1.2979
03 Dec 2011 06:05:39 1182746 13667936 hadcm3n_t2vo_1940_40_007545960_1 51,840 67,217 1.2966
02 Dec 2011 05:56:05 1182746 13667936 hadcm3n_t2vo_1940_40_007545960_1 25,920 33,520 1.2932


©2024 climateprediction.net