Task 13605585

Name	hadcm3n_o4u0_1980_40_007538082_1
Workunit	7735314
Created	5 Nov 2011, 18:56:46 UTC
Sent	7 Nov 2011, 11:05:35 UTC
Report deadline	6 Feb 2012, 18:32:46 UTC
Received	12 Dec 2011, 9:11:19 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	361754
Run time	25 days 17 hours 50 min 34 sec
CPU time	19 days 13 hours 14 min 35 sec
Validate state	Invalid
Credit	5,287.68
Device peak FLOPS	1.42 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 i686-pc-linux-gnu
Stderr	<core_client_version>6.10.58</core_client_version> <![CDATA[ <message> process exited with code 22 (0x16, -234) </message> <stderr_txt> Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=9656, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=9656, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=9656, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 07:33:31 (11764): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=13031, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=13031, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=13031, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=13031, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=13031, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=14001, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=14001, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=14001, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=14001, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=14001, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=14001, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=14001, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Unable to load library hadcm3n_se_6.07_i686-pc-linux-gnu.so dlopen error: /usr/lib/libstdc++.so.6: version `GLIBCXX_3.4.9' not found (required by /home/adi/boinc/projects/climateprediction.net/hadcm3n_se_6.07_i686-pc-linux-gnu.so) CPDN Monitor - Quit request from BOINC... Unable to load library hadcm3n_se_6.07_i686-pc-linux-gnu.so dlopen error: /usr/lib/libstdc++.so.6: version `GLIBCXX_3.4.9' not found (required by /home/adi/boinc/projects/climateprediction.net/hadcm3n_se_6.07_i686-pc-linux-gnu.so) CPDN Monitor - Quit request from BOINC... Unable to load library hadcm3n_se_6.07_i686-pc-linux-gnu.so dlopen error: /usr/lib/libstdc++.so.6: version `GLIBCXX_3.4.9' not found (required by /home/adi/boinc/projects/climateprediction.net/hadcm3n_se_6.07_i686-pc-linux-gnu.so) Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Unable to load library hadcm3n_se_6.07_i686-pc-linux-gnu.so dlopen error: /usr/lib/libstdc++.so.6: version `GLIBCXX_3.4.9' not found (required by /home/adi/boinc/projects/climateprediction.net/hadcm3n_se_6.07_i686-pc-linux-gnu.so) CPDN Monitor - Quit request from BOINC... Unable to load library hadcm3n_se_6.07_i686-pc-linux-gnu.so dlopen error: /usr/lib/libstdc++.so.6: version `GLIBCXX_3.4.9' not found (required by /home/adi/boinc/projects/climateprediction.net/hadcm3n_se_6.07_i686-pc-linux-gnu.so) CPDN Monitor - Quit request from BOINC... Unable to load library hadcm3n_se_6.07_i686-pc-linux-gnu.so dlopen error: /usr/lib/libstdc++.so.6: version `GLIBCXX_3.4.9' not found (required by /home/adi/boinc/projects/climateprediction.net/hadcm3n_se_6.07_i686-pc-linux-gnu.so) Suspended CPDN Monitor - Suspend request from BOINC... Unable to load library hadcm3n_se_6.07_i686-pc-linux-gnu.so dlopen error: /usr/lib/libstdc++.so.6: version `GLIBCXX_3.4.9' not found (required by /home/adi/boinc/projects/climateprediction.net/hadcm3n_se_6.07_i686-pc-linux-gnu.so) Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Unable to load library hadcm3n_se_6.07_i686-pc-linux-gnu.so dlopen error: /usr/lib/libstdc++.so.6: version `GLIBCXX_3.4.9' not found (required by /home/adi/boinc/projects/climateprediction.net/hadcm3n_se_6.07_i686-pc-linux-gnu.so) Unable to load library hadcm3n_se_6.07_i686-pc-linux-gnu.so dlopen error: /usr/lib/libstdc++.so.6: version `GLIBCXX_3.4.9' not found (required by /home/adi/boinc/projects/climateprediction.net/hadcm3n_se_6.07_i686-pc-linux-gnu.so) Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Unable to load library hadcm3n_se_6.07_i686-pc-linux-gnu.so dlopen error: /usr/lib/libstdc++.so.6: version `GLIBCXX_3.4.9' not found (required by /home/adi/boinc/projects/climateprediction.net/hadcm3n_se_6.07_i686-pc-linux-gnu.so) Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Unable to load library hadcm3n_se_6.07_i686-pc-linux-gnu.so dlopen error: /usr/lib/libstdc++.so.6: version `GLIBCXX_3.4.9' not found (required by /home/adi/boinc/projects/climateprediction.net/hadcm3n_se_6.07_i686-pc-linux-gnu.so) Unable to load library hadcm3n_se_6.07_i686-pc-linux-gnu.so dlopen error: /usr/lib/libstdc++.so.6: version `GLIBCXX_3.4.9' not found (required by /home/adi/boinc/projects/climateprediction.net/hadcm3n_se_6.07_i686-pc-linux-gnu.so) Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Unable to load library hadcm3n_se_6.07_i686-pc-linux-gnu.so dlopen error: /usr/lib/libstdc++.so.6: version `GLIBCXX_3.4.9' not found (required by /home/adi/boinc/projects/climateprediction.net/hadcm3n_se_6.07_i686-pc-linux-gnu.so) Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Unable to load library hadcm3n_se_6.07_i686-pc-linux-gnu.so dlopen error: /usr/lib/libstdc++.so.6: version `GLIBCXX_3.4.9' not found (required by /home/adi/boinc/projects/climateprediction.net/hadcm3n_se_6.07_i686-pc-linux-gnu.so) Unable to load library hadcm3n_se_6.07_i686-pc-linux-gnu.so dlopen error: /usr/lib/libstdc++.so.6: version `GLIBCXX_3.4.9' not found (required by /home/adi/boinc/projects/climateprediction.net/hadcm3n_se_6.07_i686-pc-linux-gnu.so) CPDN Monitor - Quit request from BOINC... Unable to load library hadcm3n_se_6.07_i686-pc-linux-gnu.so dlopen error: /usr/lib/libstdc++.so.6: version `GLIBCXX_3.4.9' not found (required by /home/adi/boinc/projects/climateprediction.net/hadcm3n_se_6.07_i686-pc-linux-gnu.so) Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Unable to load library hadcm3n_se_6.07_i686-pc-linux-gnu.so dlopen error: /usr/lib/libstdc++.so.6: version `GLIBCXX_3.4.9' not found (required by /home/adi/boinc/projects/climateprediction.net/hadcm3n_se_6.07_i686-pc-linux-gnu.so) Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Unable to load library hadcm3n_se_6.07_i686-pc-linux-gnu.so dlopen error: /usr/lib/libstdc++.so.6: version `GLIBCXX_3.4.9' not found (required by /home/adi/boinc/projects/climateprediction.net/hadcm3n_se_6.07_i686-pc-linux-gnu.so) Unable to load library hadcm3n_se_6.07_i686-pc-linux-gnu.so dlopen error: /usr/lib/libstdc++.so.6: version `GLIBCXX_3.4.9' not found (required by /home/adi/boinc/projects/climateprediction.net/hadcm3n_se_6.07_i686-pc-linux-gnu.so) CPDN Monitor - Quit request from BOINC... Unable to load library hadcm3n_se_6.07_i686-pc-linux-gnu.so dlopen error: /usr/lib/libstdc++.so.6: version `GLIBCXX_3.4.9' not found (required by /home/adi/boinc/projects/climateprediction.net/hadcm3n_se_6.07_i686-pc-linux-gnu.so) Unable to load library hadcm3n_se_6.07_i686-pc-linux-gnu.so dlopen error: /usr/lib/libstdc++.so.6: version `GLIBCXX_3.4.9' not found (required by /home/adi/boinc/projects/climateprediction.net/hadcm3n_se_6.07_i686-pc-linux-gnu.so) CPDN Monitor - Quit request from BOINC... Unable to load library hadcm3n_se_6.07_i686-pc-linux-gnu.so dlopen error: /usr/lib/libstdc++.so.6: version `GLIBCXX_3.4.9' not found (required by /home/adi/boinc/projects/climateprediction.net/hadcm3n_se_6.07_i686-pc-linux-gnu.so) Suspended CPDN Monitor - Suspend request from BOINC... Unable to load library hadcm3n_se_6.07_i686-pc-linux-gnu.so dlopen error: /usr/lib/libstdc++.so.6: version `GLIBCXX_3.4.9' not found (required by /home/adi/boinc/projects/climateprediction.net/hadcm3n_se_6.07_i686-pc-linux-gnu.so) CPDN Monitor - Quit request from BOINC... Unable to load library hadcm3n_se_6.07_i686-pc-linux-gnu.so dlopen error: /usr/lib/libstdc++.so.6: version `GLIBCXX_3.4.9' not found (required by /home/adi/boinc/projects/climateprediction.net/hadcm3n_se_6.07_i686-pc-linux-gnu.so) Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Unable to load library hadcm3n_se_6.07_i686-pc-linux-gnu.so dlopen error: /usr/lib/libstdc++.so.6: version `GLIBCXX_3.4.9' not found (required by /home/adi/boinc/projects/climateprediction.net/hadcm3n_se_6.07_i686-pc-linux-gnu.so) CPDN Monitor - Quit request from BOINC... Unable to load library hadcm3n_se_6.07_i686-pc-linux-gnu.so dlopen error: /usr/lib/libstdc++.so.6: version `GLIBCXX_3.4.9' not found (required by /home/adi/boinc/projects/climateprediction.net/hadcm3n_se_6.07_i686-pc-linux-gnu.so) Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Unable to load library hadcm3n_se_6.07_i686-pc-linux-gnu.so dlopen error: /usr/lib/libstdc++.so.6: version `GLIBCXX_3.4.9' not found (required by /home/adi/boinc/projects/climateprediction.net/hadcm3n_se_6.07_i686-pc-linux-gnu.so) Unable to load library hadcm3n_se_6.07_i686-pc-linux-gnu.so dlopen error: /usr/lib/libstdc++.so.6: version `GLIBCXX_3.4.9' not found (required by /home/adi/boinc/projects/climateprediction.net/hadcm3n_se_6.07_i686-pc-linux-gnu.so) CPDN Monitor - Quit request from BOINC... Unable to load library hadcm3n_se_6.07_i686-pc-linux-gnu.so dlopen error: /usr/lib/libstdc++.so.6: version `GLIBCXX_3.4.9' not found (required by /home/adi/boinc/projects/climateprediction.net/hadcm3n_se_6.07_i686-pc-linux-gnu.so) Unable to load library hadcm3n_se_6.07_i686-pc-linux-gnu.so dlopen error: /usr/lib/libstdc++.so.6: version `GLIBCXX_3.4.9' not found (required by /home/adi/boinc/projects/climateprediction.net/hadcm3n_se_6.07_i686-pc-linux-gnu.so) CPDN Monitor - Quit request from BOINC... Unable to load library hadcm3n_se_6.07_i686-pc-linux-gnu.so dlopen error: /usr/lib/libstdc++.so.6: version `GLIBCXX_3.4.9' not found (required by /home/adi/boinc/projects/climateprediction.net/hadcm3n_se_6.07_i686-pc-linux-gnu.so) Unable to load library hadcm3n_se_6.07_i686-pc-linux-gnu.so dlopen error: /usr/lib/libstdc++.so.6: version `GLIBCXX_3.4.9' not found (required by /home/adi/boinc/projects/climateprediction.net/hadcm3n_se_6.07_i686-pc-linux-gnu.so) CPDN Monitor - Quit request from BOINC... Unable to load library hadcm3n_se_6.07_i686-pc-linux-gnu.so dlopen error: /usr/lib/libstdc++.so.6: version `GLIBCXX_3.4.9' not found (required by /home/adi/boinc/projects/climateprediction.net/hadcm3n_se_6.07_i686-pc-linux-gnu.so) Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Unable to load library hadcm3n_se_6.07_i686-pc-linux-gnu.so dlopen error: /usr/lib/libstdc++.so.6: version `GLIBCXX_3.4.9' not found (required by /home/adi/boinc/projects/climateprediction.net/hadcm3n_se_6.07_i686-pc-linux-gnu.so) Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Unable to load library hadcm3n_se_6.07_i686-pc-linux-gnu.so dlopen error: /usr/lib/libstdc++.so.6: version `GLIBCXX_3.4.9' not found (required by /home/adi/boinc/projects/climateprediction.net/hadcm3n_se_6.07_i686-pc-linux-gnu.so) CPDN Monitor - Quit request from BOINC... Unable to load library hadcm3n_se_6.07_i686-pc-linux-gnu.so dlopen error: /usr/lib/libstdc++.so.6: version `GLIBCXX_3.4.9' not found (required by /home/adi/boinc/projects/climateprediction.net/hadcm3n_se_6.07_i686-pc-linux-gnu.so) Unable to load library hadcm3n_se_6.07_i686-pc-linux-gnu.so dlopen error: /usr/lib/libstdc++.so.6: version `GLIBCXX_3.4.9' not found (required by /home/adi/boinc/projects/climateprediction.net/hadcm3n_se_6.07_i686-pc-linux-gnu.so) Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Unable to load library hadcm3n_se_6.07_i686-pc-linux-gnu.so dlopen error: /usr/lib/libstdc++.so.6: version `GLIBCXX_3.4.9' not found (required by /home/adi/boinc/projects/climateprediction.net/hadcm3n_se_6.07_i686-pc-linux-gnu.so) Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Unable to load library hadcm3n_se_6.07_i686-pc-linux-gnu.so dlopen error: /usr/lib/libstdc++.so.6: version `GLIBCXX_3.4.9' not found (required by /home/adi/boinc/projects/climateprediction.net/hadcm3n_se_6.07_i686-pc-linux-gnu.so) Suspended CPDN Monitor - Suspend request from BOINC... 02:15:17 (12717): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... Unable to load library hadcm3n_se_6.07_i686-pc-linux-gnu.so dlopen error: /usr/lib/libstdc++.so.6: version `GLIBCXX_3.4.9' not found (required by /home/adi/boinc/projects/climateprediction.net/hadcm3n_se_6.07_i686-pc-linux-gnu.so) CPDN Monitor - Quit request from BOINC... Unable to load library hadcm3n_se_6.07_i686-pc-linux-gnu.so dlopen error: /usr/lib/libstdc++.so.6: version `GLIBCXX_3.4.9' not found (required by /home/adi/boinc/projects/climateprediction.net/hadcm3n_se_6.07_i686-pc-linux-gnu.so) Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Unable to load library hadcm3n_se_6.07_i686-pc-linux-gnu.so dlopen error: /usr/lib/libstdc++.so.6: version `GLIBCXX_3.4.9' not found (required by /home/adi/boinc/projects/climateprediction.net/hadcm3n_se_6.07_i686-pc-linux-gnu.so) Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Unable to load library hadcm3n_se_6.07_i686-pc-linux-gnu.so dlopen error: /usr/lib/libstdc++.so.6: version `GLIBCXX_3.4.9' not found (required by /home/adi/boinc/projects/climateprediction.net/hadcm3n_se_6.07_i686-pc-linux-gnu.so) Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Unable to load library hadcm3n_se_6.07_i686-pc-linux-gnu.so dlopen error: /usr/lib/libstdc++.so.6: version `GLIBCXX_3.4.9' not found (required by /home/adi/boinc/projects/climateprediction.net/hadcm3n_se_6.07_i686-pc-linux-gnu.so) Unable to load library hadcm3n_se_6.07_i686-pc-linux-gnu.so dlopen error: /usr/lib/libstdc++.so.6: version `GLIBCXX_3.4.9' not found (required by /home/adi/boinc/projects/climateprediction.net/hadcm3n_se_6.07_i686-pc-linux-gnu.so) CPDN Monitor - Quit request from BOINC... Unable to load library hadcm3n_se_6.07_i686-pc-linux-gnu.so dlopen error: /usr/lib/libstdc++.so.6: version `GLIBCXX_3.4.9' not found (required by /home/adi/boinc/projects/climateprediction.net/hadcm3n_se_6.07_i686-pc-linux-gnu.so) CPDN Monitor - Quit request from BOINC... Unable to load library hadcm3n_se_6.07_i686-pc-linux-gnu.so dlopen error: /usr/lib/libstdc++.so.6: version `GLIBCXX_3.4.9' not found (required by /home/adi/boinc/projects/climateprediction.net/hadcm3n_se_6.07_i686-pc-linux-gnu.so) Unable to load library hadcm3n_se_6.07_i686-pc-linux-gnu.so dlopen error: /usr/lib/libstdc++.so.6: version `GLIBCXX_3.4.9' not found (required by /home/adi/boinc/projects/climateprediction.net/hadcm3n_se_6.07_i686-pc-linux-gnu.so) CPDN Monitor - Quit request from BOINC... Unable to load library hadcm3n_se_6.07_i686-pc-linux-gnu.so dlopen error: /usr/lib/libstdc++.so.6: version `GLIBCXX_3.4.9' not found (required by /home/adi/boinc/projects/climateprediction.net/hadcm3n_se_6.07_i686-pc-linux-gnu.so) Suspended CPDN Monitor - Suspend request from BOINC... Unable to load library hadcm3n_se_6.07_i686-pc-linux-gnu.so dlopen error: /usr/lib/libstdc++.so.6: version `GLIBCXX_3.4.9' not found (required by /home/adi/boinc/projects/climateprediction.net/hadcm3n_se_6.07_i686-pc-linux-gnu.so) Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3777, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3777, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3777, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3777, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3777, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3777, iMonCtr=1 Model crash detected, will try to restart... Sorry, too many model crashes! :-( Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
11 Dec 2011 02:45:22	361754	13605585	hadcm3n_o4u0_1980_40_007538082_1	440,640	1,612,363	3.6591
09 Dec 2011 08:47:39	361754	13605585	hadcm3n_o4u0_1980_40_007538082_1	414,720	1,514,118	3.6509
03 Dec 2011 07:35:59	361754	13605585	hadcm3n_o4u0_1980_40_007538082_1	388,800	1,412,799	3.6337
30 Nov 2011 14:03:04	361754	13605585	hadcm3n_o4u0_1980_40_007538082_1	362,880	1,308,901	3.6070
26 Nov 2011 16:36:26	361754	13605585	hadcm3n_o4u0_1980_40_007538082_1	336,960	1,199,924	3.5610
25 Nov 2011 12:57:03	361754	13605585	hadcm3n_o4u0_1980_40_007538082_1	311,040	1,106,558	3.5576
24 Nov 2011 07:06:08	361754	13605585	hadcm3n_o4u0_1980_40_007538082_1	285,120	1,009,598	3.5410
22 Nov 2011 22:34:52	361754	13605585	hadcm3n_o4u0_1980_40_007538082_1	259,200	917,925	3.5414
21 Nov 2011 17:05:43	361754	13605585	hadcm3n_o4u0_1980_40_007538082_1	233,280	824,650	3.5350
20 Nov 2011 13:08:48	361754	13605585	hadcm3n_o4u0_1980_40_007538082_1	207,360	732,051	3.5303
19 Nov 2011 03:52:25	361754	13605585	hadcm3n_o4u0_1980_40_007538082_1	181,440	635,900	3.5047
17 Nov 2011 16:05:17	361754	13605585	hadcm3n_o4u0_1980_40_007538082_1	155,520	543,643	3.4956
15 Nov 2011 18:26:01	361754	13605585	hadcm3n_o4u0_1980_40_007538082_1	129,600	452,589	3.4922
15 Nov 2011 18:26:01	361754	13605585	hadcm3n_o4u0_1980_40_007538082_1	103,680	412,117	3.9749
15 Nov 2011 18:26:01	361754	13605585	hadcm3n_o4u0_1980_40_007538082_1	77,760	324,264	4.1701
15 Nov 2011 18:26:01	361754	13605585	hadcm3n_o4u0_1980_40_007538082_1	51,840	266,550	5.1418
09 Nov 2011 05:52:31	361754	13605585	hadcm3n_o4u0_1980_40_007538082_1	25,920	87,094	3.3601