Task 16590488

Name	hadcm3n_8ci0_1980_40_008725619_0
Workunit	8871597
Created	23 Apr 2014, 13:30:35 UTC
Sent	30 Apr 2014, 12:55:16 UTC
Report deadline	30 Jul 2014, 20:22:27 UTC
Received	5 Jun 2014, 2:08:21 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	193 (0x000000C1) EXIT_SIGNAL
Computer ID	1222530
Run time	19 days 0 hours 33 min 18 sec
CPU time	18 days 7 hours 22 min 48 sec
Validate state	Invalid
Credit	9,331.20
Device peak FLOPS	2.39 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 i686-apple-darwin
Stderr	<core_client_version>7.2.42</core_client_version> <![CDATA[ <message> process exited with code 193 (0xc1, -63) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... hadcm3n_6.07_i686-apple-darwin(23342,0xac74b2c0) malloc: * error for object 0x53a8004: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(23342,0xac74b2c0) malloc: * error for object 0x53a8000: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(23342,0xac74b2c0) malloc: * error for object 0x13b2a04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(23342,0xac74b2c0) malloc: * error for object 0x13b2a00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(23342,0xac74b2c0) malloc: * error for object 0x13b2a00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation Crashed executable name: hadcm3n_6.07_i686-apple-darwin built using BOINC library version 6.13.0 Machine type Intel 80486 (32-bit executable) System version: Macintosh OS 10.7.5 build 11G63b Thu Jun 5 03:07:42 2014 hadcm3n_6.07_i686-apple-darwin(23342,0xac74b2c0) malloc: * error for object 0x5ba9a04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(23342,0xac74b2c0) malloc: * error for object 0x5baa204: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(23342,0xac74b2c0) malloc: * error for object 0x5baa604: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(23342,0xac74b2c0) malloc: * error for object 0x5baaa04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(23342,0xac74b2c0) malloc: * error for object 0x5bab004: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(23342,0xac74b2c0) malloc: * error for object 0x5bab404: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(23342,0xac74b2c0) malloc: * error for object 0x5bab804: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(23342,0xac74b2c0) malloc: * error for object 0x5babc04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(23342,0xac74b2c0) malloc: * error for object 0x5bac004: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(23342,0xac74b2c0) malloc: * error for object 0x5bac604: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(23342,0xac74b2c0) malloc: * error for object 0x5baca04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(23342,0xac74b2c0) malloc: * error for object 0x5bace04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(23342,0xac74b2c0) malloc: * error for object 0x5bad204: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(23342,0xac74b2c0) malloc: * error for object 0x5bad804: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(23342,0xac74b2c0) malloc: * error for object 0x5badc04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(23342,0xac74b2c0) malloc: * error for object 0x5bae004: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(23342,0xac74b2c0) malloc: * error for object 0x5bae404: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(23342,0xac74b2c0) malloc: * error for object 0x5bae804: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(23342,0xac74b2c0) malloc: * error for object 0x5baee04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(23342,0xac74b2c0) malloc: * error for object 0x5baf204: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(23342,0xac74b2c0) malloc: * error for object 0x5baf604: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(23342,0xac74b2c0) malloc: * error for object 0x5bafa04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(23342,0xac74b2c0) malloc: * error for object 0x5bafe04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(23342,0xac74b2c0) malloc: * error for object 0x5bb0204: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(23342,0xac74b2c0) malloc: * error for object 0x5bb0604: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(23342,0xac74b2c0) malloc: * error for object 0x5bb0a04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(23342,0xac74b2c0) malloc: * error for object 0x5bb0e04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(23342,0xac74b2c0) malloc: * error for object 0x5bb1404: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(23342,0xac74b2c0) malloc: * error for object 0x5bb1a04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(23342,0xac74b2c0) malloc: * error for object 0x5bb2404: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(23342,0xac74b2c0) malloc: * error for object 0x5bb2400: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug Thread 0 Crashed: Thread 1: atos cannot load symbols for the file hadcm3n_6.07_i686-apple-darwin for architecture i386. Thread 0 crashed with X86 Thread State (32-bit): eax: 0x00000000 ebx: 0x00000000 ecx: 0x00000000 edx: 0x00000000 edi: 0x00000000 esi: 0x00000000 ebp: 0xbff8fac8 esp: 0x00000000 ss: 0x00000000 efl: 0x00000000 eip: 0x0007697e cs: 0x00000000 ds: 0x00000000 es: 0x00000000 fs: 0x00000000 gs: 0x00000000 Binary Images Description: 0x1000 - 0x93fff /Library/Application Support/BOINC Data/slots/16/../../projects/climateprediction.net/hadcm3n_6.07_i686-apple-darwin 0x9000e000 - 0x90013fff /usr/lib/system/libmacho.dylib 0x9106c000 - 0x9106dfff /usr/lib/system/libunc.dylib 0x91373000 - 0x91374fff /usr/lib/system/libremovefile.dylib 0x914d7000 - 0x914d8fff /usr/lib/system/libsystem_blocks.dylib 0x914d9000 - 0x91507fff /usr/lib/libSystem.B.dylib 0x92652000 - 0x92656fff /usr/lib/system/libcache.dylib 0x93780000 - 0x9379efff /usr/lib/system/libsystem_kernel.dylib 0x939cb000 - 0x939fafff /usr/lib/system/libsystem_info.dylib 0x94a88000 - 0x94a8bfff /usr/lib/system/libmathCommon.A.dylib 0x94c17000 - 0x94c1ffff /usr/lib/system/libcopyfile.dylib 0x94c20000 - 0x94c21fff /usr/lib/system/libsystem_sandbox.dylib 0x950ac000 - 0x950adfff /usr/lib/system/libquarantine.dylib 0x954c2000 - 0x954c9fff /usr/lib/system/libsystem_dnssd.dylib 0x9598b000 - 0x95a56fff /usr/lib/system/libsystem_c.dylib 0x95ab4000 - 0x95abcfff /usr/lib/system/libunwind.dylib 0x95b1e000 - 0x95b22fff /usr/lib/system/libsystem_network.dylib 0x95b23000 - 0x95b2afff /usr/lib/system/libsystem_notify.dylib 0x95b4e000 - 0x95b51fff /usr/lib/system/libcompiler_rt.dylib 0x97210000 - 0x97253fff /usr/lib/system/libcommonCrypto.dylib 0x972f8000 - 0x97300fff /usr/lib/system/liblaunch.dylib 0x981a5000 - 0x981bbfff /usr/lib/system/libxpc.dylib 0x99163000 - 0x99171fff /usr/lib/libz.1.dylib 0x991f5000 - 0x99257fff /usr/lib/libstdc++.6.dylib 0x994c8000 - 0x994cafff /usr/lib/system/libdyld.dylib 0x9a696000 - 0x9a69ffff /usr/lib/libc++abi.dylib 0x9c00e000 - 0x9c00efff /usr/lib/system/libdnsinfo.dylib 0x9c12b000 - 0x9c139fff /usr/lib/system/libdispatch.dylib 0x9cdfb000 - 0x9cdfbfff /usr/lib/system/libkeymgr.dylib Exiting... </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
05 Jun 2014 01:08:41	1222530	16590488	hadcm3n_8ci0_1980_40_008725619_0	777,600	1,581,764	2.0342
04 Jun 2014 04:10:05	1222530	16590488	hadcm3n_8ci0_1980_40_008725619_0	751,680	1,528,350	2.0332
30 May 2014 15:50:28	1222530	16590488	hadcm3n_8ci0_1980_40_008725619_0	725,760	1,475,839	2.0335
27 May 2014 21:59:17	1222530	16590488	hadcm3n_8ci0_1980_40_008725619_0	699,840	1,422,943	2.0332
26 May 2014 23:34:21	1222530	16590488	hadcm3n_8ci0_1980_40_008725619_0	673,920	1,371,097	2.0345
26 May 2014 00:11:26	1222530	16590488	hadcm3n_8ci0_1980_40_008725619_0	648,000	1,318,579	2.0348
25 May 2014 08:51:35	1222530	16590488	hadcm3n_8ci0_1980_40_008725619_0	622,080	1,265,658	2.0346
24 May 2014 17:32:59	1222530	16590488	hadcm3n_8ci0_1980_40_008725619_0	596,160	1,212,592	2.0340
24 May 2014 02:15:11	1222530	16590488	hadcm3n_8ci0_1980_40_008725619_0	570,240	1,159,560	2.0335
23 May 2014 02:14:14	1222530	16590488	hadcm3n_8ci0_1980_40_008725619_0	544,320	1,106,166	2.0322
22 May 2014 03:44:06	1222530	16590488	hadcm3n_8ci0_1980_40_008725619_0	518,400	1,053,272	2.0318
21 May 2014 10:21:25	1222530	16590488	hadcm3n_8ci0_1980_40_008725619_0	492,480	1,001,158	2.0329
20 May 2014 15:22:08	1222530	16590488	hadcm3n_8ci0_1980_40_008725619_0	466,560	948,627	2.0332
19 May 2014 15:30:01	1222530	16590488	hadcm3n_8ci0_1980_40_008725619_0	440,640	895,143	2.0315
15 May 2014 20:16:50	1222530	16590488	hadcm3n_8ci0_1980_40_008725619_0	414,720	843,973	2.0350
14 May 2014 23:51:33	1222530	16590488	hadcm3n_8ci0_1980_40_008725619_0	388,800	791,244	2.0351
14 May 2014 02:05:22	1222530	16590488	hadcm3n_8ci0_1980_40_008725619_0	362,880	738,812	2.0360
13 May 2014 03:40:35	1222530	16590488	hadcm3n_8ci0_1980_40_008725619_0	336,960	686,326	2.0368
12 May 2014 06:10:47	1222530	16590488	hadcm3n_8ci0_1980_40_008725619_0	311,040	634,030	2.0384
11 May 2014 15:14:33	1222530	16590488	hadcm3n_8ci0_1980_40_008725619_0	285,120	581,908	2.0409