Task 22183701

Name	hadcm3s_18tx_200012_168_926_012127883_1
Workunit	12127883
Created	5 Jan 2022, 2:31:35 UTC
Sent	5 Jan 2022, 3:04:19 UTC
Report deadline	18 Dec 2022, 8:24:19 UTC
Received	30 Jan 2022, 2:06:25 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	1503934
Run time	20 days 23 hours 30 min 2 sec
CPU time	16 days 9 hours 21 min 29 sec
Validate state	Invalid
Credit	3,421.44
Device peak FLOPS	3.74 GFLOPS
Application version	UK Met Office HadCM3 short v8.36 i686-apple-darwin
Peak working set size	153.07 MB
Peak swap size	1,134.77 MB
Peak disk usage	56.09 MB
Stderr	<core_client_version>7.16.11</core_client_version> <![CDATA[ <message> process exited with code 22 (0x16, -234)</message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 19:10:25 (18233): BOINC client no longer exists - exiting 19:10:25 (18233): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:57:39 (11016): BOINC client no longer exists - exiting 21:57:39 (11016): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 15:14:12 (76384): BOINC client no longer exists - exiting 15:14:12 (76384): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 11:42:29 (98841): BOINC client no longer exists - exiting 11:42:29 (98841): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 16:15:44 (3772): BOINC client no longer exists - exiting 16:15:44 (3772): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:30:53 (98608): BOINC client no longer exists - exiting 16:30:53 (98608): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... OPEN: File Creation Failed: Operation timed out OPEN: Unable to Open File dataout/18txko.dal1cs0 for Read/Write Model crashed: DUMPCTL : Fail to open output dump - may already exist tmp/pipe_dummy OPEN: File Open Failed: Operation timed out OPEN: Unable to Open File datain/ancil/ozone_cmip6hist_2000_2014_n48 for Reading Model crashed: INANCLA: Error opening file tmp/pipe_dummy Model crashed: jobs/climate.cpdc forrtl: severe (121): Cannot access current working directory for unit 8, file "Unknown" Image PC Routine Line Source hadcm3s_um_8.36_i 004C4867 Unknown Unknown Unknown hadcm3s_um_8.36_i 004D7DA4 Unknown Unknown Unknown hadcm3s_um_8.36_i 0049AFBF Unknown Unknown Unknown hadcm3s_um_8.36_i 004A8D78 Unknown Unknown Unknown hadcm3s_um_8.36_i 000018FD Unknown Unknown Unknown hadcm3s_um_8.36_i 00001828 Unknown Unknown Unknown Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=94576, iMonCtr=1 Model crash detected, will try to restart... SIGABRT: abort called built using BOINC library version 7.7.0 Machine type Intel 80486 (32-bit executable) Sun Jan 30 01:38:23 2022 0 hadcm3s_um_8.36_i686-apple-darwin 0x00572b85 PrintBacktrace + 1009 1 hadcm3s_um_8.36_i686-apple-darwin 0x00566300 boinc_catch_signal + 241 2 libsystem_platform.dylib 0xa17f6e5b _sigtramp + 43 3 ??? 0xffffffff 0x0 + 4294967295 4 libsystem_c.dylib 0xa167ca34 abort + 141 5 hadcm3s_um_8.36_i686-apple-darwin 0x001b3aa0 inactr + 4928 6 hadcm3s_um_8.36_i686-apple-darwin 0x003c446c stash_proc + 3068 7 hadcm3s_um_8.36_i686-apple-darwin 0x0049b36e um_shell + 3806 8 hadcm3s_um_8.36_i686-apple-darwin 0x004a8d78 main + 1120 9 hadcm3s_um_8.36_i686-apple-darwin 0x000018fd _start + 212 10 hadcm3s_um_8.36_i686-apple-darwin 0x00001828 start + 40 Thread 0 crashed with X86 Thread State (32-bit): eax: 0xffffffe1 ebx: 0x00000003 ecx: 0xbff91c4c edx: 0xa171491e edi: 0xbff91cb8 esi: 0x00000000 ebp: 0xbff91c88 esp: 0xbff91c4c ss: 0x00000023 efl: 0x00000296 eip: 0xa171491e cs: 0x0000000b ds: 0x00000023 es: 0x00000023 fs: 0x00000000 gs: 0x0000000f Binary Images Description: 0x1000 - 0x5eafff /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3s_um_8.36_i686-apple-darwin 0xa0016000 - 0xa0017fff /usr/lib/libSystem.B.dylib 0xa01ad000 - 0xa0203fff /usr/lib/libc++.1.dylib 0xa0204000 - 0xa0227fff /usr/lib/libc++abi.dylib 0xa0d10000 - 0xa10d4fff /usr/lib/libobjc.A.dylib 0xa1375000 - 0xa13c5fff /usr/lib/libstdc++.6.dylib 0xa1534000 - 0xa1538fff /usr/lib/system/libcache.dylib 0xa1539000 - 0xa1543fff /usr/lib/system/libcommonCrypto.dylib 0xa1544000 - 0xa1549fff /usr/lib/system/libcompiler_rt.dylib 0xa154a000 - 0xa1552fff /usr/lib/system/libcopyfile.dylib 0xa1553000 - 0xa15b9fff /usr/lib/system/libcorecrypto.dylib 0xa15ba000 - 0xa15e7fff /usr/lib/system/libdispatch.dylib 0xa15e8000 - 0xa15edfff /usr/lib/system/libdyld.dylib 0xa15ee000 - 0xa15eefff /usr/lib/system/libkeymgr.dylib 0xa15fc000 - 0xa15fcfff /usr/lib/system/liblaunch.dylib 0xa15fd000 - 0xa1603fff /usr/lib/system/libmacho.dylib 0xa1604000 - 0xa1606fff /usr/lib/system/libquarantine.dylib 0xa1607000 - 0xa1608fff /usr/lib/system/libremovefile.dylib 0xa1609000 - 0xa1620fff /usr/lib/system/libsystem_asl.dylib 0xa1621000 - 0xa1621fff /usr/lib/system/libsystem_blocks.dylib 0xa1622000 - 0xa16b0fff /usr/lib/system/libsystem_c.dylib 0xa16b1000 - 0xa16b4fff /usr/lib/system/libsystem_configuration.dylib 0xa16b5000 - 0xa16b8fff /usr/lib/system/libsystem_coreservices.dylib 0xa16b9000 - 0xa16d1fff /usr/lib/system/libsystem_coretls.dylib 0xa16d2000 - 0xa16d8fff /usr/lib/system/libsystem_dnssd.dylib 0xa16d9000 - 0xa1700fff /usr/lib/system/libsystem_info.dylib 0xa1701000 - 0xa1722fff /usr/lib/system/libsystem_kernel.dylib 0xa1723000 - 0xa176ffff /usr/lib/system/libsystem_m.dylib 0xa1770000 - 0xa178afff /usr/lib/system/libsystem_malloc.dylib 0xa178b000 - 0xa17e1fff /usr/lib/system/libsystem_network.dylib 0xa17e2000 - 0xa17ebfff /usr/lib/system/libsystem_networkextension.dylib 0xa17ec000 - 0xa17f4fff /usr/lib/system/libsystem_notify.dylib 0xa17f5000 - 0xa17fbfff /usr/lib/system/libsystem_platform.dylib 0xa17fc000 - 0xa1805fff /usr/lib/system/libsystem_pthread.dylib 0xa1806000 - 0xa1809fff /usr/lib/system/libsystem_sandbox.dylib 0xa180a000 - 0xa180cfff /usr/lib/system/libsystem_secinit.dylib 0xa180d000 - 0xa1814fff /usr/lib/system/libsystem_symptoms.dylib 0xa1815000 - 0xa1827fff /usr/lib/system/libsystem_trace.dylib 0xa1828000 - 0xa182efff /usr/lib/system/libunwind.dylib 0xa182f000 - 0xa1855fff /usr/lib/system/libxpc.dylib Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=94576, iMonCtr=1 Model crash detected, will try to restart... SIGABRT: abort called built using BOINC library version 7.7.0 Machine type Intel 80486 (32-bit executable) Sun Jan 30 01:38:26 2022 0 hadcm3s_um_8.36_i686-apple-darwin 0x00572b85 PrintBacktrace + 1009 1 hadcm3s_um_8.36_i686-apple-darwin 0x00566300 boinc_catch_signal + 241 2 libsystem_platform.dylib 0xa17f6e5b _sigtramp + 43 3 ??? 0xffffffff 0x0 + 4294967295 4 libsystem_c.dylib 0xa167ca34 abort + 141 5 hadcm3s_um_8.36_i686-apple-darwin 0x001b3aa0 inactr + 4928 6 hadcm3s_um_8.36_i686-apple-darwin 0x003c446c stash_proc + 3068 7 hadcm3s_um_8.36_i686-apple-darwin 0x0049b36e um_shell + 3806 8 hadcm3s_um_8.36_i686-apple-darwin 0x004a8d78 main + 1120 9 hadcm3s_um_8.36_i686-apple-darwin 0x000018fd _start + 212 10 hadcm3s_um_8.36_i686-apple-darwin 0x00001828 start + 40 Thread 0 crashed with X86 Thread State (32-bit): eax: 0xffffffe1 ebx: 0x00000003 ecx: 0xbff91c4c edx: 0xa171491e edi: 0xbff91cb8 esi: 0x00000000 ebp: 0xbff91c88 esp: 0xbff91c4c ss: 0x00000023 efl: 0x00000296 eip: 0xa171491e cs: 0x0000000b ds: 0x00000023 es: 0x00000023 fs: 0x00000000 gs: 0x0000000f Binary Images Description: 0x1000 - 0x5eafff /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3s_um_8.36_i686-apple-darwin 0xa0016000 - 0xa0017fff /usr/lib/libSystem.B.dylib 0xa01ad000 - 0xa0203fff /usr/lib/libc++.1.dylib 0xa0204000 - 0xa0227fff /usr/lib/libc++abi.dylib 0xa0d10000 - 0xa10d4fff /usr/lib/libobjc.A.dylib 0xa1375000 - 0xa13c5fff /usr/lib/libstdc++.6.dylib 0xa1534000 - 0xa1538fff /usr/lib/system/libcache.dylib 0xa1539000 - 0xa1543fff /usr/lib/system/libcommonCrypto.dylib 0xa1544000 - 0xa1549fff /usr/lib/system/libcompiler_rt.dylib 0xa154a000 - 0xa1552fff /usr/lib/system/libcopyfile.dylib 0xa1553000 - 0xa15b9fff /usr/lib/system/libcorecrypto.dylib 0xa15ba000 - 0xa15e7fff /usr/lib/system/libdispatch.dylib 0xa15e8000 - 0xa15edfff /usr/lib/system/libdyld.dylib 0xa15ee000 - 0xa15eefff /usr/lib/system/libkeymgr.dylib 0xa15fc000 - 0xa15fcfff /usr/lib/system/liblaunch.dylib 0xa15fd000 - 0xa1603fff /usr/lib/system/libmacho.dylib 0xa1604000 - 0xa1606fff /usr/lib/system/libquarantine.dylib 0xa1607000 - 0xa1608fff /usr/lib/system/libremovefile.dylib 0xa1609000 - 0xa1620fff /usr/lib/system/libsystem_asl.dylib 0xa1621000 - 0xa1621fff /usr/lib/system/libsystem_blocks.dylib 0xa1622000 - 0xa16b0fff /usr/lib/system/libsystem_c.dylib 0xa16b1000 - 0xa16b4fff /usr/lib/system/libsystem_configuration.dylib 0xa16b5000 - 0xa16b8fff /usr/lib/system/libsystem_coreservices.dylib 0xa16b9000 - 0xa16d1fff /usr/lib/system/libsystem_coretls.dylib 0xa16d2000 - 0xa16d8fff /usr/lib/system/libsystem_dnssd.dylib 0xa16d9000 - 0xa1700fff /usr/lib/system/libsystem_info.dylib 0xa1701000 - 0xa1722fff /usr/lib/system/libsystem_kernel.dylib 0xa1723000 - 0xa176ffff /usr/lib/system/libsystem_m.dylib 0xa1770000 - 0xa178afff /usr/lib/system/libsystem_malloc.dylib 0xa178b000 - 0xa17e1fff /usr/lib/system/libsystem_network.dylib 0xa17e2000 - 0xa17ebfff /usr/lib/system/libsystem_networkextension.dylib 0xa17ec000 - 0xa17f4fff /usr/lib/system/libsystem_notify.dylib 0xa17f5000 - 0xa17fbfff /usr/lib/system/libsystem_platform.dylib 0xa17fc000 - 0xa1805fff /usr/lib/system/libsystem_pthread.dylib 0xa1806000 - 0xa1809fff /usr/lib/system/libsystem_sandbox.dylib 0xa180a000 - 0xa180cfff /usr/lib/system/libsystem_secinit.dylib 0xa180d000 - 0xa1814fff /usr/lib/system/libsystem_symptoms.dylib 0xa1815000 - 0xa1827fff /usr/lib/system/libsystem_trace.dylib 0xa1828000 - 0xa182efff /usr/lib/system/libunwind.dylib 0xa182f000 - 0xa1855fff /usr/lib/system/libxpc.dylib Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=94576, iMonCtr=1 Model crash detected, will try to restart... Sorry, too many model crashes! :-( 17:38:28 (94576): called boinc_finish(22) </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
29 Jan 2022 23:07:39	1503934	22183701	hadcm3s_18tx_200012_168_926_012127883_1	285,120	1,642,813	5.7618
27 Jan 2022 22:06:56	1503934	22183701	hadcm3s_18tx_200012_168_926_012127883_1	259,200	1,483,264	5.7225
25 Jan 2022 18:01:39	1503934	22183701	hadcm3s_18tx_200012_168_926_012127883_1	233,280	1,323,639	5.6740
23 Jan 2022 12:18:07	1503934	22183701	hadcm3s_18tx_200012_168_926_012127883_1	207,360	1,164,679	5.6167
20 Jan 2022 14:42:47	1503934	22183701	hadcm3s_18tx_200012_168_926_012127883_1	181,440	1,008,550	5.5586
18 Jan 2022 13:01:51	1503934	22183701	hadcm3s_18tx_200012_168_926_012127883_1	155,520	861,404	5.5389
16 Jan 2022 06:10:56	1503934	22183701	hadcm3s_18tx_200012_168_926_012127883_1	129,600	702,790	5.4228
14 Jan 2022 05:48:05	1503934	22183701	hadcm3s_18tx_200012_168_926_012127883_1	103,680	562,142	5.4219
12 Jan 2022 01:27:41	1503934	22183701	hadcm3s_18tx_200012_168_926_012127883_1	77,760	417,478	5.3688
10 Jan 2022 01:40:12	1503934	22183701	hadcm3s_18tx_200012_168_926_012127883_1	51,840	275,223	5.3091
07 Jan 2022 22:06:10	1503934	22183701	hadcm3s_18tx_200012_168_926_012127883_1	25,920	137,092	5.2890