Task 16008417

Name	hadcm3n_o25c_1980_40_008385940_2
Workunit	8536799
Created	8 Sep 2013, 16:46:08 UTC
Sent	8 Sep 2013, 17:06:02 UTC
Report deadline	9 Dec 2013, 0:33:13 UTC
Received	30 Nov 2013, 19:52:29 UTC
Server state	Over
Outcome	Computation error
Client state	Aborted by user
Exit status	203 (0x000000CB) EXIT_ABORTED_VIA_GUI
Computer ID	1269167
Run time	7 days 18 hours 8 min 43 sec
CPU time	7 days 2 hours 5 min 1 sec
Validate state	Invalid
Credit	9,953.28
Device peak FLOPS	4.19 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 i686-pc-linux-gnu
Stderr	<core_client_version>7.2.33</core_client_version> <![CDATA[ <message> aborted by user </message> <stderr_txt> restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... hadcm3n_6.07_i686-pc-linux-gnu: malloc.c:2365: sysmalloc: Assertion `(old_top == (((mbinptr) (((char ) &((av)->bins[((1) - 1) 2])) - __builtin_offsetof (struct malloc_chunk, fd)))) && old_size == 0) \|\| ((unsigned long) (old_size) >= (unsigned long)((((__builtin_offsetof (struct malloc_chunk, fd_nextsize))+((2 * (sizeof(size_t))) - 1)) & ~((2 * (sizeof(size_t))) - 1))) && ((old_top)->size & 0x1) && ((unsigned long)old_end & pagemask) == 0)' failed. SIGABRT: abort called Signal 1 received, exiting... Called boinc_finish Signal 15 received, exiting... Called boinc_finish hadcm3n_6.07_i686-pc-linux-gnu: malloc.c:2365: sysmalloc: Assertion `(old_top == (((mbinptr) (((char ) &((av)->bins[((1) - 1) 2])) - __builtin_offsetof (struct malloc_chunk, fd)))) && old_size == 0) \|\| ((unsigned long) (old_size) >= (unsigned long)((((__builtin_offsetof (struct malloc_chunk, fd_nextsize))+((2 * (sizeof(size_t))) - 1)) & ~((2 * (sizeof(size_t))) - 1))) && ((old_top)->size & 0x1) && ((unsigned long)old_end & pagemask) == 0)' failed. SIGABRT: abort called hadcm3n_6.07_i686-pc-linux-gnu: malloc.c:2365: sysmalloc: Assertion `(old_top == (((mbinptr) (((char ) &((av)->bins[((1) - 1) 2])) - __builtin_offsetof (struct malloc_chunk, fd)))) && old_size == 0) \|\| ((unsigned long) (old_size) >= (unsigned long)((((__builtin_offsetof (struct malloc_chunk, fd_nextsize))+((2 * (sizeof(size_t))) - 1)) & ~((2 * (sizeof(size_t))) - 1))) && ((old_top)->size & 0x1) && ((unsigned long)old_end & pagemask) == 0)' failed. SIGABRT: abort called hadcm3n_6.07_i686-pc-linux-gnu: malloc.c:2365: sysmalloc: Assertion `(old_top == (((mbinptr) (((char ) &((av)->bins[((1) - 1) 2])) - __builtin_offsetof (struct malloc_chunk, fd)))) && old_size == 0) \|\| ((unsigned long) (old_size) >= (unsigned long)((((__builtin_offsetof (struct malloc_chunk, fd_nextsize))+((2 * (sizeof(size_t))) - 1)) & ~((2 * (sizeof(size_t))) - 1))) && ((old_top)->size & 0x1) && ((unsigned long)old_end & pagemask) == 0)' failed. SIGABRT: abort called hadcm3n_6.07_i686-pc-linux-gnu: malloc.c:2365: sysmalloc: Assertion `(old_top == (((mbinptr) (((char ) &((av)->bins[((1) - 1) 2])) - __builtin_offsetof (struct malloc_chunk, fd)))) && old_size == 0) \|\| ((unsigned long) (old_size) >= (unsigned long)((((__builtin_offsetof (struct malloc_chunk, fd_nextsize))+((2 * (sizeof(size_t))) - 1)) & ~((2 * (sizeof(size_t))) - 1))) && ((old_top)->size & 0x1) && ((unsigned long)old_end & pagemask) == 0)' failed. SIGABRT: abort called hadcm3n_6.07_i686-pc-linux-gnu: malloc.c:2365: sysmalloc: Assertion `(old_top == (((mbinptr) (((char ) &((av)->bins[((1) - 1) 2])) - __builtin_offsetof (struct malloc_chunk, fd)))) && old_size == 0) \|\| ((unsigned long) (old_size) >= (unsigned long)((((__builtin_offsetof (struct malloc_chunk, fd_nextsize))+((2 * (sizeof(size_t))) - 1)) & ~((2 * (sizeof(size_t))) - 1))) && ((old_top)->size & 0x1) && ((unsigned long)old_end & pagemask) == 0)' failed. SIGABRT: abort called Signal 1 received, exiting... Called boinc_finish hadcm3n_6.07_i686-pc-linux-gnu: malloc.c:2365: sysmalloc: Assertion `(old_top == (((mbinptr) (((char ) &((av)->bins[((1) - 1) 2])) - __builtin_offsetof (struct malloc_chunk, fd)))) && old_size == 0) \|\| ((unsigned long) (old_size) >= (unsigned long)((((__builtin_offsetof (struct malloc_chunk, fd_nextsize))+((2 * (sizeof(size_t))) - 1)) & ~((2 * (sizeof(size_t))) - 1))) && ((old_top)->size & 0x1) && ((unsigned long)old_end & pagemask) == 0)' failed. SIGABRT: abort called hadcm3n_6.07_i686-pc-linux-gnu: malloc.c:2365: sysmalloc: Assertion `(old_top == (((mbinptr) (((char ) &((av)->bins[((1) - 1) 2])) - __builtin_offsetof (struct malloc_chunk, fd)))) && old_size == 0) \|\| ((unsigned long) (old_size) >= (unsigned long)((((__builtin_offsetof (struct malloc_chunk, fd_nextsize))+((2 * (sizeof(size_t))) - 1)) & ~((2 * (sizeof(size_t))) - 1))) && ((old_top)->size & 0x1) && ((unsigned long)old_end & pagemask) == 0)' failed. SIGABRT: abort called Signal 1 received, exiting... Called boinc_finish Signal 15 received, exiting... Called boinc_finish hadcm3n_6.07_i686-pc-linux-gnu: malloc.c:2365: sysmalloc: Assertion `(old_top == (((mbinptr) (((char ) &((av)->bins[((1) - 1) 2])) - __builtin_offsetof (struct malloc_chunk, fd)))) && old_size == 0) \|\| ((unsigned long) (old_size) >= (unsigned long)((((__builtin_offsetof (struct malloc_chunk, fd_nextsize))+((2 * (sizeof(size_t))) - 1)) & ~((2 * (sizeof(size_t))) - 1))) && ((old_top)->size & 0x1) && ((unsigned long)old_end & pagemask) == 0)' failed. SIGABRT: abort called Signal 1 received, exiting... Called boinc_finish Signal 15 received, exiting... Called boinc_finish hadcm3n_6.07_i686-pc-linux-gnu: malloc.c:2365: sysmalloc: Assertion `(old_top == (((mbinptr) (((char ) &((av)->bins[((1) - 1) 2])) - __builtin_offsetof (struct malloc_chunk, fd)))) && old_size == 0) \|\| ((unsigned long) (old_size) >= (unsigned long)((((__builtin_offsetof (struct malloc_chunk, fd_nextsize))+((2 * (sizeof(size_t))) - 1)) & ~((2 * (sizeof(size_t))) - 1))) && ((old_top)->size & 0x1) && ((unsigned long)old_end & pagemask) == 0)' failed. SIGABRT: abort called Signal 1 received, exiting... Called boinc_finish Signal 15 received, exiting... Called boinc_finish hadcm3n_6.07_i686-pc-linux-gnu: malloc.c:2365: sysmalloc: Assertion `(old_top == (((mbinptr) (((char ) &((av)->bins[((1) - 1) 2])) - __builtin_offsetof (struct malloc_chunk, fd)))) && old_size == 0) \|\| ((unsigned long) (old_size) >= (unsigned long)((((__builtin_offsetof (struct malloc_chunk, fd_nextsize))+((2 * (sizeof(size_t))) - 1)) & ~((2 * (sizeof(size_t))) - 1))) && ((old_top)->size & 0x1) && ((unsigned long)old_end & pagemask) == 0)' failed. SIGABRT: abort called Signal 1 received, exiting... Called boinc_finish hadcm3n_6.07_i686-pc-linux-gnu: malloc.c:2365: sysmalloc: Assertion `(old_top == (((mbinptr) (((char ) &((av)->bins[((1) - 1) 2])) - __builtin_offsetof (struct malloc_chunk, fd)))) && old_size == 0) \|\| ((unsigned long) (old_size) >= (unsigned long)((((__builtin_offsetof (struct malloc_chunk, fd_nextsize))+((2 * (sizeof(size_t))) - 1)) & ~((2 * (sizeof(size_t))) - 1))) && ((old_top)->size & 0x1) && ((unsigned long)old_end & pagemask) == 0)' failed. SIGABRT: abort called 19:23:57 (16018): No heartbeat from core client for 30 sec - exiting 19:23:58 (16018): No heartbeat from core client for 30 sec - exiting 19:23:59 (16018): No heartbeat from core client for 30 sec - exiting 19:24:00 (16018): No heartbeat from core client for 30 sec - exiting 19:24:01 (16018): No heartbeat from core client for 30 sec - exiting 19:24:02 (16018): No heartbeat from core client for 30 sec - exiting 19:24:03 (16018): No heartbeat from core client for 30 sec - exiting 19:24:04 (16018): No heartbeat from core client for 30 sec - exiting 19:24:05 (16018): No heartbeat from core client for 30 sec - exiting 19:24:06 (16018): No heartbeat from core client for 30 sec - exiting 19:24:07 (16018): No heartbeat from core client for 30 sec - exiting 19:24:08 (16018): No heartbeat from core client for 30 sec - exiting 19:24:09 (16018): No heartbeat from core client for 30 sec - exiting 19:24:10 (16018): No heartbeat from core client for 30 sec - exiting 19:24:11 (16018): No heartbeat from core client for 30 sec - exiting 19:24:12 (16018): No heartbeat from core client for 30 sec - exiting 19:24:13 (16018): No heartbeat from core client for 30 sec - exiting 19:24:14 (16018): No heartbeat from core client for 30 sec - exiting 19:24:15 (16018): No heartbeat from core client for 30 sec - exiting 19:24:16 (16018): No heartbeat from core client for 30 sec - exiting 19:24:17 (16018): No heartbeat from core client for 30 sec - exiting 19:24:18 (16018): No heartbeat from core client for 30 sec - exiting 19:24:19 (16018): No heartbeat from core client for 30 sec - exiting 19:24:20 (16018): No heartbeat from core client for 30 sec - exiting 19:24:21 (16018): No heartbeat from core client for 30 sec - exiting 19:24:22 (16018): No heartbeat from core client for 30 sec - exiting 19:24:23 (16018): No heartbeat from core client for 30 sec - exiting 19:24:24 (16018): No heartbeat from core client for 30 sec - exiting 19:24:25 (16018): No heartbeat from core client for 30 sec - exiting 19:24:26 (16018): No heartbeat from core client for 30 sec - exiting 19:24:27 (16018): No heartbeat from core client for 30 sec - exiting 19:24:28 (16018): No heartbeat from core client for 30 sec - exiting 19:24:29 (16018): No heartbeat from core client for 30 sec - exiting 19:24:30 (16018): No heartbeat from core client for 30 sec - exiting 19:24:31 (16018): No heartbeat from core client for 30 sec - exiting 19:24:32 (16018): No heartbeat from core client for 30 sec - exiting 19:24:33 (16018): No heartbeat from core client for 30 sec - exiting 19:24:34 (16018): No heartbeat from core client for 30 sec - exiting 19:24:35 (16018): No heartbeat from core client for 30 sec - exiting 19:24:36 (16018): No heartbeat from core client for 30 sec - exiting 19:24:37 (16018): No heartbeat from core client for 30 sec - exiting 19:24:38 (16018): No heartbeat from core client for 30 sec - exiting 19:24:39 (16018): No heartbeat from core client for 30 sec - exiting 19:24:40 (16018): No heartbeat from core client for 30 sec - exiting 19:24:41 (16018): No heartbeat from core client for 30 sec - exiting 19:24:42 (16018): No heartbeat from core client for 30 sec - exiting 19:24:43 (16018): No heartbeat from core client for 30 sec - exiting 19:24:44 (16018): No heartbeat from core client for 30 sec - exiting 19:24:45 (16018): No heartbeat from core client for 30 sec - exiting 19:24:46 (16018): No heartbeat from core client for 30 sec - exiting 19:24:47 (16018): No heartbeat from core client for 30 sec - exiting 19:24:48 (16018): No heartbeat from core client for 30 sec - exiting 19:24:49 (16018): No heartbeat from core client for 30 sec - exiting 19:24:50 (16018): No heartbeat from core client for 30 sec - exiting 19:24:51 (16018): No heartbeat from core client for 30 sec - exiting 19:24:52 (16018): No heartbeat from core client for 30 sec - exiting 19:24:53 (16018): No heartbeat from core client for 30 sec - exiting 19:24:54 (16018): No heartbeat from core client for 30 sec - exiting 19:24:55 (16018): No heartbeat from core client for 30 sec - exiting 19:24:56 (16018): No heartbeat from core client for 30 sec - exiting 19:24:57 (16018): No heartbeat from core client for 30 sec - exiting 19:24:58 (16018): No heartbeat from core client for 30 sec - exiting 19:24:59 (16018): No heartbeat from core client for 30 sec - exiting 19:25:00 (16018): No heartbeat from core client for 30 sec - exiting 19:25:01 (16018): No heartbeat from core client for 30 sec - exiting 19:25:02 (16018): No heartbeat from core client for 30 sec - exiting 19:25:03 (16018): No heartbeat from core client for 30 sec - exiting 19:25:04 (16018): No heartbeat from core client for 30 sec - exiting 19:25:05 (16018): No heartbeat from core client for 30 sec - exiting 19:25:06 (16018): No heartbeat from core client for 30 sec - exiting 19:25:07 (16018): No heartbeat from core client for 30 sec - exiting 19:25:08 (16018): No heartbeat from core client for 30 sec - exiting 19:25:09 (16018): No heartbeat from core client for 30 sec - exiting 19:25:10 (16018): No heartbeat from core client for 30 sec - exiting 19:25:11 (16018): No heartbeat from core client for 30 sec - exiting 19:25:12 (16018): No heartbeat from core client for 30 sec - exiting 19:25:13 (16018): No heartbeat from core client for 30 sec - exiting 19:25:14 (16018): No heartbeat from core client for 30 sec - exiting 19:25:15 (16018): No heartbeat from core client for 30 sec - exiting 19:25:16 (16018): No heartbeat from core client for 30 sec - exiting 19:25:17 (16018): No heartbeat from core client for 30 sec - exiting 19:25:19 (16018): No heartbeat from core client for 30 sec - exiting 19:25:20 (16018): No heartbeat from core client for 30 sec - exiting 19:25:21 (16018): No heartbeat from core client for 30 sec - exiting 19:25:22 (16018): No heartbeat from core client for 30 sec - exiting 19:25:23 (16018): No heartbeat from core client for 30 sec - exiting 19:25:24 (16018): No heartbeat from core client for 30 sec - exiting 19:25:25 (16018): No heartbeat from core client for 30 sec - exiting 19:25:26 (16018): No heartbeat from core client for 30 sec - exiting 19:25:27 (16018): No heartbeat from core client for 30 sec - exiting 19:25:28 (16018): No heartbeat from core client for 30 sec - exiting 19:25:29 (16018): No heartbeat from core client for 30 sec - exiting 19:25:30 (16018): No heartbeat from core client for 30 sec - exiting 19:25:31 (16018): No heartbeat from core client for 30 sec - exiting 19:25:32 (16018): No heartbeat from core client for 30 sec - exiting 19:25:33 (16018): No heartbeat from core client for 30 sec - exiting 19:25:34 (16018): No heartbeat from core client for 30 sec - exiting 19:25:35 (16018): No heartbeat from core client for 30 sec - exiting 19:25:36 (16018): No heartbeat from core client for 30 sec - exiting 19:25:37 (16018): No heartbeat from core client for 30 sec - exiting 19:25:38 (16018): No heartbeat from core client for 30 sec - exiting 19:25:39 (16018): No heartbeat from core client for 30 sec - exiting 19:25:40 (16018): No heartbeat from core client for 30 sec - exiting 19:25:41 (16018): No heartbeat from core client for 30 sec - exiting 19:25:42 (16018): No heartbeat from core client for 30 sec - exiting 19:25:43 (16018): No heartbeat from core client for 30 sec - exiting 19:25:44 (16018): No heartbeat from core client for 30 sec - exiting 19:25:45 (16018): No heartbeat from core client for 30 sec - exiting 19:25:46 (16018): No heartbeat from core client for 30 sec - exiting 19:25:47 (16018): No heartbeat from core client for 30 sec - exiting 19:25:48 (16018): No heartbeat from core client for 30 sec - exiting 19:25:49 (16018): No heartbeat from core client for 30 sec - exiting 19:25:50 (16018): No heartbeat from core client for 30 sec - exiting 19:25:51 (16018): No heartbeat from core client for 30 sec - exiting 19:25:52 (16018): No heartbeat from core client for 30 sec - exiting 19:25:53 (16018): No heartbeat from core client for 30 sec - exiting 19:25:54 (16018): No heartbeat from core client for 30 sec - exiting 19:25:55 (16018): No heartbeat from core client for 30 sec - exiting 19:25:56 (16018): No heartbeat from core client for 30 sec - exiting 19:25:57 (16018): No heartbeat from core client for 30 sec - exiting 19:25:58 (16018): No heartbeat from core client for 30 sec - exiting 19:25:59 (16018): No heartbeat from core client for 30 sec - exiting 19:26:00 (16018): No heartbeat from core client for 30 sec - exiting 19:26:01 (16018): No heartbeat from core client for 30 sec - exiting 19:26:02 (16018): No heartbeat from core client for 30 sec - exiting 19:26:03 (16018): No heartbeat from core client for 30 sec - exiting 19:26:04 (16018): No heartbeat from core client for 30 sec - exiting 19:26:05 (16018): No heartbeat from core client for 30 sec - exiting 19:26:06 (16018): No heartbeat from core client for 30 sec - exiting 19:26:07 (16018): No heartbeat from core client for 30 sec - exiting 19:26:08 (16018): No heartbeat from core client for 30 sec - exiting 19:26:09 (16018): No heartbeat from core client for 30 sec - exiting 19:26:10 (16018): No heartbeat from core client for 30 sec - exiting 19:26:11 (16018): No heartbeat from core client for 30 sec - exiting 19:26:12 (16018): No heartbeat from core client for 30 sec - exiting 19:26:13 (16018): No heartbeat from core client for 30 sec - exiting 19:26:14 (16018): No heartbeat from core client for 30 sec - exiting 19:26:15 (16018): No heartbeat from core client for 30 sec - exiting 19:26:16 (16018): No heartbeat from core client for 30 sec - exiting 19:26:17 (16018): No heartbeat from core client for 30 sec - exiting 19:26:18 (16018): No heartbeat from core client for 30 sec - exiting 19:26:19 (16018): No heartbeat from core client for 30 sec - exiting 19:26:20 (16018): No heartbeat from core client for 30 sec - exiting 19:26:21 (16018): No heartbeat from core client for 30 sec - exiting 19:26:22 (16018): No heartbeat from core client for 30 sec - exiting 19:26:23 (16018): No heartbeat from core client for 30 sec - exiting 19:26:24 (16018): No heartbeat from core client for 30 sec - exiting 19:26:25 (16018): No heartbeat from core client for 30 sec - exiting 19:26:26 (16018): No heartbeat from core client for 30 sec - exiting 19:26:27 (16018): No heartbeat from core client for 30 sec - exiting 19:26:28 (16018): No heartbeat from core client for 30 sec - exiting 19:26:29 (16018): No heartbeat from core client for 30 sec - exiting 19:26:30 (16018): No heartbeat from core client for 30 sec - exiting 19:26:31 (16018): No heartbeat from core client for 30 sec - exiting 19:26:32 (16018): No heartbeat from core client for 30 sec - exiting 19:26:33 (16018): No heartbeat from core client for 30 sec - exiting 19:26:34 (16018): No heartbeat from core client for 30 sec - exiting 19:26:35 (16018): No heartbeat from core client for 30 sec - exiting 19:26:36 (16018): No heartbeat from core client for 30 sec - exiting 19:26:37 (16018): No heartbeat from core client for 30 sec - exiting 19:26:38 (16018): No heartbeat from core client for 30 sec - exiting 19:26:39 (16018): No heartbeat from core client for 30 sec - exiting 19:26:40 (16018): No heartbeat from core client for 30 sec - exiting 19:26:41 (16018): No heartbeat from core client for 30 sec - exiting 19:26:42 (16018): No heartbeat from core client for 30 sec - exiting 19:26:43 (16018): No heartbeat from core client for 30 sec - exiting 19:26:44 (16018): No heartbeat from core client for 30 sec - exiting 19:26:45 (16018): No heartbeat from core client for 30 sec - exiting 19:26:46 (16018): No heartbeat from core client for 30 sec - exiting 19:26:47 (16018): No heartbeat from core client for 30 sec - exiting 19:26:48 (16018): No heartbeat from core client for 30 sec - exiting 19:26:49 (16018): No heartbeat from core client for 30 sec - exiting 19:26:50 (16018): No heartbeat from core client for 30 sec - exiting 19:26:51 (16018): No heartbeat from core client for 30 sec - exiting 19:26:52 (16018): No heartbeat from core client for 30 sec - exiting 19:26:53 (16018): No heartbeat from core client for 30 sec - exiting 19:26:54 (16018): No heartbeat from core client for 30 sec - exiting 19:26:55 (16018): No heartbeat from core client for 30 sec - exiting 19:26:56 (16018): No heartbeat from core client for 30 sec - exiting 19:26:57 (16018): No heartbeat from core client for 30 sec - exiting 19:26:58 (16018): No heartbeat from core client for 30 sec - exiting 19:26:59 (16018): No heartbeat from core client for 30 sec - exiting 19:27:00 (16018): No heartbeat from core client for 30 sec - exiting 19:27:01 (16018): No heartbeat from core client for 30 sec - exiting 19:27:02 (16018): No heartbeat from core client for 30 sec - exiting 19:27:03 (16018): No heartbeat from core client for 30 sec - exiting 19:27:04 (16018): No heartbeat from core client for 30 sec - exiting 19:27:05 (16018): No heartbeat from core client for 30 sec - exiting 19:27:06 (16018): No heartbeat from core client for 30 sec - exiting 19:27:07 (16018): No heartbeat from core client for 30 sec - exiting 19:27:08 (16018): No heartbeat from core client for 30 sec - exiting 19:27:09 (16018): No heartbeat from core client for 30 sec - exiting 19:27:10 (16018): No heartbeat from core client for 30 sec - exiting 19:27:11 (16018): No heartbeat from core client for 30 sec - exiting 19:27:12 (16018): No heartbeat from core client for 30 sec - exiting 19:27:13 (16018): No heartbeat from core client for 30 sec - exiting 19:27:14 (16018): No heartbeat from core client for 30 sec - exiting 19:27:15 (16018): No heartbeat from core client for 30 sec - exiting 19:27:16 (16018): No heartbeat from core client for 30 sec - exiting 19:27:17 (16018): No heartbeat from core client for 30 sec - exiting 19:27:18 (16018): No heartbeat from core client for 30 sec - exiting 19:27:19 (16018): No heartbeat from core client for 30 sec - exiting 19:27:20 (16018): No heartbeat from core client for 30 sec - exiting 19:27:21 (16018): No heartbeat from core client for 30 sec - exiting 19:27:22 (16018): No heartbeat from core client for 30 sec - exiting 19:27:23 (16018): No heartbeat from core client for 30 sec - exiting 19:27:24 (16018): No heartbeat from core client for 30 sec - exiting 19:27:25 (16018): No heartbeat from core client for 30 sec - exiting 19:27:26 (16018): No heartbeat from core client for 30 sec - exiting 19:27:27 (16018): No heartbeat from core client for 30 sec - exiting 19:27:28 (16018): No heartbeat from core client for 30 sec - exiting 19:27:29 (16018): No heartbeat from core client for 30 sec - exiting 19:27:30 (16018): No heartbeat from core client for 30 sec - exiting 19:27:31 (16018): No heartbeat from core client for 30 sec - exiting 19:27:32 (16018): No heartbeat from core client for 30 sec - exiting 19:27:33 (16018): No heartbeat from core client for 30 sec - exiting 19:27:34 (16018): No heartbeat from core client for 30 sec - exiting 19:27:35 (16018): No heartbeat from core client for 30 sec - exiting 19:27:36 (16018): No heartbeat from core client for 30 sec - exiting 19:27:37 (16018): No heartbeat from core client for 30 sec - exiting 19:27:38 (16018): No heartbeat from core client for 30 sec - exiting 19:27:39 (16018): No heartbeat from core client for 30 sec - exiting 19:27:40 (16018): No heartbeat from core client for 30 sec - exiting 19:27:41 (16018): No heartbeat from core client for 30 sec - exiting 19:27:42 (16018): No heartbeat from core client for 30 sec - exiting 19:27:43 (16018): No heartbeat from core client for 30 sec - exiting 19:27:44 (16018): No heartbeat from core client for 30 sec - exiting 19:27:45 (16018): No heartbeat from core client for 30 sec - exiting 19:27:46 (16018): No heartbeat from core client for 30 sec - exiting 19:27:47 (16018): No heartbeat from core client for 30 sec - exiting 19:27:48 (16018): No heartbeat from core client for 30 sec - exiting 19:27:49 (16018): No heartbeat from core client for 30 sec - exiting 19:27:50 (16018): No heartbeat from core client for 30 sec - exiting 19:27:51 (16018): No heartbeat from core client for 30 sec - exiting 19:27:52 (16018): No heartbeat from core client for 30 sec - exiting 19:27:53 (16018): No heartbeat from core client for 30 sec - exiting 19:27:54 (16018): No heartbeat from core client for 30 sec - exiting 19:27:55 (16018): No heartbeat from core client for 30 sec - exiting 19:27:56 (16018): No heartbeat from core client for 30 sec - exiting 19:27:57 (16018): No heartbeat from core client for 30 sec - exiting 19:27:58 (16018): No heartbeat from core client for 30 sec - exiting 19:27:59 (16018): No heartbeat from core client for 30 sec - exiting 19:28:00 (16018): No heartbeat from core client for 30 sec - exiting 19:28:01 (16018): No heartbeat from core client for 30 sec - exiting 19:28:02 (16018): No heartbeat from core client for 30 sec - exiting 19:28:03 (16018): No heartbeat from core client for 30 sec - exiting 19:28:04 (16018): No heartbeat from core client for 30 sec - exiting 19:28:05 (16018): No heartbeat from core client for 30 sec - exiting 19:28:06 (16018): No heartbeat from core client for 30 sec - exiting 19:28:07 (16018): No heartbeat from core client for 30 sec - exiting 19:28:08 (16018): No heartbeat from core client for 30 sec - exiting 19:28:09 (16018): No heartbeat from core client for 30 sec - exiting 19:28:10 (16018): No heartbeat from core client for 30 sec - exiting 19:28:11 (16018): No heartbeat from core client for 30 sec - exiting 19:28:12 (16018): No heartbeat from core client for 30 sec - exiting 19:28:13 (16018): No heartbeat from core client for 30 sec - exiting 19:28:14 (16018): No heartbeat from core client for 30 sec - exiting 19:28:15 (16018): No heartbeat from core client for 30 sec - exiting 19:28:16 (16018): No heartbeat from core client for 30 sec - exiting 19:28:17 (16018): No heartbeat from core client for 30 sec - exiting 19:28:18 (16018): No heartbeat from core client for 30 sec - exiting 19:28:19 (16018): No heartbeat from core client for 30 sec - exiting Signal 1 received, exiting... Called boinc_finish Signal 1 received, exiting... Called boinc_finish hadcm3n_6.07_i686-pc-linux-gnu: malloc.c:2365: sysmalloc: Assertion `(old_top == (((mbinptr) (((char ) &((av)->bins[((1) - 1) 2])) - __builtin_offsetof (struct malloc_chunk, fd)))) && old_size == 0) \|\| ((unsigned long) (old_size) >= (unsigned long)((((__builtin_offsetof (struct malloc_chunk, fd_nextsize))+((2 * (sizeof(size_t))) - 1)) & ~((2 * (sizeof(size_t))) - 1))) && ((old_top)->size & 0x1) && ((unsigned long)old_end & pagemask) == 0)' failed. SIGABRT: abort called </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
07 Nov 2013 21:59:10	1269167	16008417	hadcm3n_o25c_1980_40_008385940_2	829,440	612,301	0.7382
06 Nov 2013 08:32:29	1269167	16008417	hadcm3n_o25c_1980_40_008385940_2	777,600	568,517	0.7311
06 Nov 2013 03:00:43	1269167	16008417	hadcm3n_o25c_1980_40_008385940_2	751,680	549,743	0.7314
05 Nov 2013 21:08:44	1269167	16008417	hadcm3n_o25c_1980_40_008385940_2	725,760	530,858	0.7315
05 Nov 2013 17:06:34	1269167	16008417	hadcm3n_o25c_1980_40_008385940_2	699,840	511,665	0.7311
05 Nov 2013 09:23:15	1269167	16008417	hadcm3n_o25c_1980_40_008385940_2	673,920	492,790	0.7312
05 Nov 2013 03:46:39	1269167	16008417	hadcm3n_o25c_1980_40_008385940_2	648,000	473,992	0.7315
04 Nov 2013 22:14:01	1269167	16008417	hadcm3n_o25c_1980_40_008385940_2	622,080	455,217	0.7318
20 Oct 2013 20:03:43	1269167	16008417	hadcm3n_o25c_1980_40_008385940_2	596,160	436,371	0.7320
20 Oct 2013 14:32:51	1269167	16008417	hadcm3n_o25c_1980_40_008385940_2	570,240	417,534	0.7322
19 Oct 2013 06:49:51	1269167	16008417	hadcm3n_o25c_1980_40_008385940_2	544,320	398,776	0.7326
19 Oct 2013 01:17:43	1269167	16008417	hadcm3n_o25c_1980_40_008385940_2	518,400	380,055	0.7331
18 Oct 2013 19:45:25	1269167	16008417	hadcm3n_o25c_1980_40_008385940_2	492,480	361,313	0.7337
18 Oct 2013 14:13:02	1269167	16008417	hadcm3n_o25c_1980_40_008385940_2	466,560	342,544	0.7342
18 Oct 2013 08:35:18	1269167	16008417	hadcm3n_o25c_1980_40_008385940_2	440,640	323,835	0.7349
18 Oct 2013 03:08:24	1269167	16008417	hadcm3n_o25c_1980_40_008385940_2	414,720	305,179	0.7359
17 Oct 2013 07:57:58	1269167	16008417	hadcm3n_o25c_1980_40_008385940_2	388,800	286,423	0.7367
17 Oct 2013 02:25:19	1269167	16008417	hadcm3n_o25c_1980_40_008385940_2	362,880	267,732	0.7378
16 Oct 2013 20:42:23	1269167	16008417	hadcm3n_o25c_1980_40_008385940_2	336,960	248,861	0.7385
15 Oct 2013 13:34:16	1269167	16008417	hadcm3n_o25c_1980_40_008385940_2	311,040	230,095	0.7398