climateprediction.net home page
Task 22053320

Task 22053320

Name hadam4h_1010_209105_5_902_012077395_2
Workunit 12077395
Created 12 Apr 2021, 13:41:58 UTC
Sent 14 Apr 2021, 5:10:48 UTC
Report deadline 27 Mar 2022, 10:30:48 UTC
Received 17 Jul 2021, 13:46:30 UTC
Server state Over
Outcome Success
Client state Done
Exit status 0 (0x00000000)
Computer ID 1513349
Run time 13 days 3 hours 55 min 1 sec
CPU time 12 days 17 hours 14 min 45 sec
Validate state Valid
Credit 33,854.34
Device peak FLOPS 6.01 GFLOPS
Application version UK Met Office HadAM4 at N216 resolution v8.52
i686-pc-linux-gnu
Peak working set size 1,377.27 MB
Peak swap size 1,398.80 MB
Peak disk usage 162.08 MB
Stderr
<core_client_version>7.16.6</core_client_version>
<![CDATA[
<stderr_txt>
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
19:28:57 (19991): called boinc_finish(193)
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
19:28:57 (19991): called boinc_finish(193)
Suspended CPDN Monitor - Suspend request from BOINC...
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
SIGSEGV: segmentation violation
Stack trace (22 frames):
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu(boinc_catch_signal+0x67)[0x80d4cf7]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7f3b580]
/lib/i386-linux-gnu/libc.so.6(getenv+0xa2)[0xf7a3a552]
/lib/i386-linux-gnu/libc.so.6(+0xbbd2d)[0xf7abed2d]
/lib/i386-linux-gnu/libc.so.6(+0xbc0ee)[0xf7abf0ee]
/lib/i386-linux-gnu/libc.so.6(localtime_r+0x1b)[0xf7abd03b]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d01b2]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d0900]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d09f1]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7f3b580]
linux-gate.so.1(__kernel_vsyscall+0x9)[0xf7f3b569]
/lib/i386-linux-gnu/libc.so.6(+0xc6693)[0xf7ac9693]
/lib/i386-linux-gnu/libc.so.6(clock_nanosleep+0x52)[0xf7ac9892]
/lib/i386-linux-gnu/libc.so.6(nanosleep+0x24)[0xf7ad0314]
/lib/i386-linux-gnu/libc.so.6(usleep+0x45)[0xf7b04475]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80e78a5]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x804fca4]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80503d7]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051b13]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051d8b]
/lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf5)[0xf7a21ee5]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x804cd21]

Exiting...
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
SIGSEGV: segmentation violation
Stack trace (21 frames):
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu(boinc_catch_signal+0x67)[0x80d4cf7]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7ee5580]
/lib/i386-linux-gnu/libc.so.6(getenv+0xa2)[0xf79e3552]
/lib/i386-linux-gnu/libc.so.6(+0xbbd2d)[0xf7a67d2d]
/lib/i386-linux-gnu/libc.so.6(+0xbc0ee)[0xf7a680ee]
/lib/i386-linux-gnu/libc.so.6(localtime_r+0x1b)[0xf7a6603b]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d01b2]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d0900]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d09f1]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7ee5580]
linux-gate.so.1(__kernel_vsyscall+0x9)[0xf7ee5569]
/lib/i386-linux-gnu/libc.so.6(+0xc6693)[0xf7a72693]
/lib/i386-linux-gnu/libc.so.6(clock_nanosleep+0x52)[0xf7a72892]
/lib/i386-linux-gnu/libc.so.6(nanosleep+0x24)[0xf7a79314]
/lib/i386-linux-gnu/libc.so.6(usleep+0x45)[0xf7aad475]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80e78a5]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80503e8]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051b13]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051d8b]
/lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf5)[0xf79caee5]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x804cd21]

Exiting...
Suspended CPDN Monitor - Suspend request from BOINC...
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
22:11:09 (3450): called boinc_finish(193)
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
SIGSEGV: segmentation violation
Stack trace (22 frames):
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu(boinc_catch_signal+0x67)[0x80d4cf7]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7f1b580]
/lib/i386-linux-gnu/libc.so.6(getenv+0xa2)[0xf7a1a552]
/lib/i386-linux-gnu/libc.so.6(+0xbbd2d)[0xf7a9ed2d]
/lib/i386-linux-gnu/libc.so.6(+0xbc0ee)[0xf7a9f0ee]
/lib/i386-linux-gnu/libc.so.6(localtime_r+0x1b)[0xf7a9d03b]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d01b2]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d0900]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d09f1]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7f1b580]
linux-gate.so.1(__kernel_vsyscall+0x9)[0xf7f1b569]
/lib/i386-linux-gnu/libc.so.6(+0xc6693)[0xf7aa9693]
/lib/i386-linux-gnu/libc.so.6(clock_nanosleep+0x52)[0xf7aa9892]
/lib/i386-linux-gnu/libc.so.6(nanosleep+0x24)[0xf7ab0314]
/lib/i386-linux-gnu/libc.so.6(usleep+0x45)[0xf7ae4475]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80e78a5]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x804fca4]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80503d7]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051b13]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051d8b]
/lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf5)[0xf7a01ee5]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x804cd21]

Exiting...
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
SIGSEGV: segmentation violation
Stack trace (21 frames):
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu(boinc_catch_signal+0x67)[0x80d4cf7]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7f4d580]
/lib/i386-linux-gnu/libc.so.6(getenv+0xa2)[0xf7a4b552]
/lib/i386-linux-gnu/libc.so.6(+0xbbd2d)[0xf7acfd2d]
/lib/i386-linux-gnu/libc.so.6(+0xbc0ee)[0xf7ad00ee]
/lib/i386-linux-gnu/libc.so.6(localtime_r+0x1b)[0xf7ace03b]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d01b2]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d0900]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d09f1]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7f4d580]
linux-gate.so.1(__kernel_vsyscall+0x9)[0xf7f4d569]
/lib/i386-linux-gnu/libc.so.6(+0xc6693)[0xf7ada693]
/lib/i386-linux-gnu/libc.so.6(clock_nanosleep+0x52)[0xf7ada892]
/lib/i386-linux-gnu/libc.so.6(nanosleep+0x24)[0xf7ae1314]
/lib/i386-linux-gnu/libc.so.6(usleep+0x45)[0xf7b15475]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80e78a5]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80503e8]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051b13]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051d8b]
/lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf5)[0xf7a32ee5]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x804cd21]

Exiting...
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
22:28:03 (3319): called boinc_finish(193)
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
SIGSEGV: segmentation violation
Stack trace (21 frames):
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu(boinc_catch_signal+0x67)[0x80d4cf7]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7f34580]
/lib/i386-linux-gnu/libc.so.6(getenv+0xa2)[0xf7a33552]
/lib/i386-linux-gnu/libc.so.6(+0xbbd2d)[0xf7ab7d2d]
/lib/i386-linux-gnu/libc.so.6(+0xbc0ee)[0xf7ab80ee]
/lib/i386-linux-gnu/libc.so.6(localtime_r+0x1b)[0xf7ab603b]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d01b2]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d0900]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d09f1]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7f34580]
linux-gate.so.1(__kernel_vsyscall+0x9)[0xf7f34569]
/lib/i386-linux-gnu/libc.so.6(+0xc6693)[0xf7ac2693]
/lib/i386-linux-gnu/libc.so.6(clock_nanosleep+0x52)[0xf7ac2892]
/lib/i386-linux-gnu/libc.so.6(nanosleep+0x24)[0xf7ac9314]
/lib/i386-linux-gnu/libc.so.6(usleep+0x45)[0xf7afd475]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80e78a5]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80503e8]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051b13]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051d8b]
/lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf5)[0xf7a1aee5]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x804cd21]

Exiting...
Signal 15 received: Software termination signal from kill 
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
SIGSEGV: segmentation violation
Stack trace (21 frames):
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu(boinc_catch_signal+0x67)[0x80d4cf7]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7ee4580]
/lib/i386-linux-gnu/libc.so.6(getenv+0xa2)[0xf79e2552]
/lib/i386-linux-gnu/libc.so.6(+0xbbd2d)[0xf7a66d2d]
/lib/i386-linux-gnu/libc.so.6(+0xbc0ee)[0xf7a670ee]
/lib/i386-linux-gnu/libc.so.6(localtime_r+0x1b)[0xf7a6503b]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d01b2]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d0900]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d09f1]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7ee4580]
linux-gate.so.1(__kernel_vsyscall+0x9)[0xf7ee4569]
/lib/i386-linux-gnu/libc.so.6(+0xc6693)[0xf7a71693]
/lib/i386-linux-gnu/libc.so.6(clock_nanosleep+0x52)[0xf7a71892]
/lib/i386-linux-gnu/libc.so.6(nanosleep+0x24)[0xf7a78314]
/lib/i386-linux-gnu/libc.so.6(usleep+0x45)[0xf7aac475]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80e78a5]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80503e8]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051b13]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051d8b]
/lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf5)[0xf79c9ee5]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x804cd21]

Exiting...
Signal 15 received: Software termination signal from kill 
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
SIGSEGV: segmentation violation
Stack trace (21 frames):
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu(boinc_catch_signal+0x67)[0x80d4cf7]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7f50580]
/lib/i386-linux-gnu/libc.so.6(getenv+0xa2)[0xf7a4f552]
/lib/i386-linux-gnu/libc.so.6(+0xbbd2d)[0xf7ad3d2d]
/lib/i386-linux-gnu/libc.so.6(+0xbc0ee)[0xf7ad40ee]
/lib/i386-linux-gnu/libc.so.6(localtime_r+0x1b)[0xf7ad203b]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d01b2]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d0900]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d09f1]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7f50580]
linux-gate.so.1(__kernel_vsyscall+0x9)[0xf7f50569]
/lib/i386-linux-gnu/libc.so.6(+0xc6693)[0xf7ade693]
/lib/i386-linux-gnu/libc.so.6(clock_nanosleep+0x52)[0xf7ade892]
/lib/i386-linux-gnu/libc.so.6(nanosleep+0x24)[0xf7ae5314]
/lib/i386-linux-gnu/libc.so.6(usleep+0x45)[0xf7b19475]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80e78a5]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80503e8]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051b13]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051d8b]
/lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf5)[0xf7a36ee5]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x804cd21]

Exiting...
Suspended CPDN Monitor - Suspend request from BOINC...
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
22:39:29 (2599): called boinc_finish(193)
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
SIGSEGV: segmentation violation
Stack trace (22 frames):
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu(boinc_catch_signal+0x67)[0x80d4cf7]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7f51580]
/lib/i386-linux-gnu/libc.so.6(getenv+0xa2)[0xf7a4f552]
/lib/i386-linux-gnu/libc.so.6(+0xbbd2d)[0xf7ad3d2d]
/lib/i386-linux-gnu/libc.so.6(+0xbc0ee)[0xf7ad40ee]
/lib/i386-linux-gnu/libc.so.6(localtime_r+0x1b)[0xf7ad203b]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d01b2]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d0900]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d09f1]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7f51580]
linux-gate.so.1(__kernel_vsyscall+0x9)[0xf7f51569]
/lib/i386-linux-gnu/libc.so.6(+0xc6693)[0xf7ade693]
/lib/i386-linux-gnu/libc.so.6(clock_nanosleep+0x52)[0xf7ade892]
/lib/i386-linux-gnu/libc.so.6(nanosleep+0x24)[0xf7ae5314]
/lib/i386-linux-gnu/libc.so.6(usleep+0x45)[0xf7b19475]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80e78a5]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x804fca4]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80503d7]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051b13]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051d8b]
/lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf5)[0xf7a36ee5]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x804cd21]

Exiting...
Suspended CPDN Monitor - Suspend request from BOINC...
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
19:53:36 (2980): called boinc_finish(193)
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
SIGSEGV: segmentation violation
Stack trace (24 frames):
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu(boinc_catch_signal+0x67)[0x80d4cf7]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7f75580]
/lib/i386-linux-gnu/libc.so.6(getenv+0xa2)[0xf7a74552]
/lib/i386-linux-gnu/libc.so.6(+0xbbd2d)[0xf7af8d2d]
/lib/i386-linux-gnu/libc.so.6(+0xbc0ee)[0xf7af90ee]
/lib/i386-linux-gnu/libc.so.6(localtime_r+0x1b)[0xf7af703b]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d01b2]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d0900]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d09f1]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7f75580]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d0580]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7f75580]
linux-gate.so.1(__kernel_vsyscall+0x9)[0xf7f75569]
/lib/i386-linux-gnu/libc.so.6(+0xc6693)[0xf7b03693]
/lib/i386-linux-gnu/libc.so.6(clock_nanosleep+0x52)[0xf7b03892]
/lib/i386-linux-gnu/libc.so.6(nanosleep+0x24)[0xf7b0a314]
/lib/i386-linux-gnu/libc.so.6(usleep+0x45)[0xf7b3e475]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80e78a5]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x804fca4]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80503d7]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051b13]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051d8b]
/lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf5)[0xf7a5bee5]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x804cd21]

Exiting...
Suspended CPDN Monitor - Suspend request from BOINC...
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
SIGSEGV: segmentation violation
Stack trace (22 frames):
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu(boinc_catch_signal+0x67)[0x80d4cf7]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7fa3580]
/lib/i386-linux-gnu/libc.so.6(getenv+0xa2)[0xf7aa2552]
/lib/i386-linux-gnu/libc.so.6(+0xbbd2d)[0xf7b26d2d]
/lib/i386-linux-gnu/libc.so.6(+0xbc0ee)[0xf7b270ee]
/lib/i386-linux-gnu/libc.so.6(localtime_r+0x1b)[0xf7b2503b]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d01b2]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d0900]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d09f1]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7fa3580]
linux-gate.so.1(__kernel_vsyscall+0x9)[0xf7fa3569]
/lib/i386-linux-gnu/libc.so.6(+0xc6693)[0xf7b31693]
/lib/i386-linux-gnu/libc.so.6(clock_nanosleep+0x52)[0xf7b31892]
/lib/i386-linux-gnu/libc.so.6(nanosleep+0x24)[0xf7b38314]
/lib/i386-linux-gnu/libc.so.6(usleep+0x45)[0xf7b6c475]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80e78a5]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x804fca4]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80503d7]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051b13]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051d8b]
/lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf5)[0xf7a89ee5]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x804cd21]

Exiting...
Suspended CPDN Monitor - Suspend request from BOINC...
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
SIGSEGV: segmentation violation
Stack trace (22 frames):
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu(boinc_catch_signal+0x67)[0x80d4cf7]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7f11580]
/lib/i386-linux-gnu/libc.so.6(getenv+0xa2)[0xf7a0f552]
/lib/i386-linux-gnu/libc.so.6(+0xbbd2d)[0xf7a93d2d]
/lib/i386-linux-gnu/libc.so.6(+0xbc0ee)[0xf7a940ee]
/lib/i386-linux-gnu/libc.so.6(localtime_r+0x1b)[0xf7a9203b]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d01b2]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d0900]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d09f1]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7f11580]
linux-gate.so.1(__kernel_vsyscall+0x9)[0xf7f11569]
/lib/i386-linux-gnu/libc.so.6(+0xc6693)[0xf7a9e693]
/lib/i386-linux-gnu/libc.so.6(clock_nanosleep+0x52)[0xf7a9e892]
/lib/i386-linux-gnu/libc.so.6(nanosleep+0x24)[0xf7aa5314]
/lib/i386-linux-gnu/libc.so.6(usleep+0x45)[0xf7ad9475]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80e78a5]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x804fca4]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80503d7]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051b13]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051d8b]
/lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf5)[0xf79f6ee5]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x804cd21]

Exiting...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Signal 15 received: Software termination signal from kill 
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
SIGSEGV: segmentation violation
Stack trace (22 frames):
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu(boinc_catch_signal+0x67)[0x80d4cf7]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7fbe580]
/lib/i386-linux-gnu/libc.so.6(getenv+0xa2)[0xf7abc552]
/lib/i386-linux-gnu/libc.so.6(+0xbbd2d)[0xf7b40d2d]
/lib/i386-linux-gnu/libc.so.6(+0xbc0ee)[0xf7b410ee]
/lib/i386-linux-gnu/libc.so.6(localtime_r+0x1b)[0xf7b3f03b]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d01b2]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d0900]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d09f1]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7fbe580]
linux-gate.so.1(__kernel_vsyscall+0x9)[0xf7fbe569]
/lib/i386-linux-gnu/libc.so.6(+0xc6693)[0xf7b4b693]
/lib/i386-linux-gnu/libc.so.6(clock_nanosleep+0x52)[0xf7b4b892]
/lib/i386-linux-gnu/libc.so.6(nanosleep+0x24)[0xf7b52314]
/lib/i386-linux-gnu/libc.so.6(usleep+0x45)[0xf7b86475]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80e78a5]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x804fca4]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80503d7]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051b13]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051d8b]
/lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf5)[0xf7aa3ee5]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x804cd21]

Exiting...
Suspended CPDN Monitor - Suspend request from BOINC...
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
15:57:22 (3222): called boinc_finish(193)
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
15:57:22 (3222): called boinc_finish(193)
Suspended CPDN Monitor - Suspend request from BOINC...
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
SIGSEGV: segmentation violation
Stack trace (22 frames):
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu(boinc_catch_signal+0x67)[0x80d4cf7]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7f0d580]
/lib/i386-linux-gnu/libc.so.6(getenv+0xa2)[0xf7a0a552]
/lib/i386-linux-gnu/libc.so.6(+0xbbd2d)[0xf7a8ed2d]
/lib/i386-linux-gnu/libc.so.6(+0xbc0ee)[0xf7a8f0ee]
/lib/i386-linux-gnu/libc.so.6(localtime_r+0x1b)[0xf7a8d03b]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d01b2]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d0900]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d09f1]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7f0d580]
linux-gate.so.1(__kernel_vsyscall+0x9)[0xf7f0d569]
/lib/i386-linux-gnu/libc.so.6(+0xc6693)[0xf7a99693]
/lib/i386-linux-gnu/libc.so.6(clock_nanosleep+0x52)[0xf7a99892]
/lib/i386-linux-gnu/libc.so.6(nanosleep+0x24)[0xf7aa0314]
/lib/i386-linux-gnu/libc.so.6(usleep+0x45)[0xf7ad4475]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80e78a5]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x804fca4]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80503d7]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051b13]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051d8b]
/lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf5)[0xf79f1ee5]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x804cd21]

Exiting...
Suspended CPDN Monitor - Suspend request from BOINC...
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
18:47:56 (2481): called boinc_finish(193)
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
SIGSEGV: segmentation violation
Stack trace (22 frames):
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu(boinc_catch_signal+0x67)[0x80d4cf7]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7ed2580]
/lib/i386-linux-gnu/libc.so.6(getenv+0xa2)[0xf79cf552]
/lib/i386-linux-gnu/libc.so.6(+0xbbd2d)[0xf7a53d2d]
/lib/i386-linux-gnu/libc.so.6(+0xbc0ee)[0xf7a540ee]
/lib/i386-linux-gnu/libc.so.6(localtime_r+0x1b)[0xf7a5203b]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d01b2]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d0900]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d09f1]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7ed2580]
linux-gate.so.1(__kernel_vsyscall+0x9)[0xf7ed2569]
/lib/i386-linux-gnu/libc.so.6(+0xc6693)[0xf7a5e693]
/lib/i386-linux-gnu/libc.so.6(clock_nanosleep+0x52)[0xf7a5e892]
/lib/i386-linux-gnu/libc.so.6(nanosleep+0x24)[0xf7a65314]
/lib/i386-linux-gnu/libc.so.6(usleep+0x45)[0xf7a99475]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80e78a5]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x804fca4]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80503d7]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051b13]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051d8b]
/lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf5)[0xf79b6ee5]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x804cd21]

Exiting...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
19:14:14 (3850): called boinc_finish(193)
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
SIGSEGV: segmentation violation
Stack trace (22 frames):
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu(boinc_catch_signal+0x67)[0x80d4cf7]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7f56580]
/lib/i386-linux-gnu/libc.so.6(getenv+0xa2)[0xf7a52552]
/lib/i386-linux-gnu/libc.so.6(+0xbbd2d)[0xf7ad6d2d]
/lib/i386-linux-gnu/libc.so.6(+0xbc0ee)[0xf7ad70ee]
/lib/i386-linux-gnu/libc.so.6(localtime_r+0x1b)[0xf7ad503b]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d01b2]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d0900]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d09f1]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7f56580]
linux-gate.so.1(__kernel_vsyscall+0x9)[0xf7f56569]
/lib/i386-linux-gnu/libc.so.6(+0xc6693)[0xf7ae1693]
/lib/i386-linux-gnu/libc.so.6(clock_nanosleep+0x52)[0xf7ae1892]
/lib/i386-linux-gnu/libc.so.6(nanosleep+0x24)[0xf7ae8314]
/lib/i386-linux-gnu/libc.so.6(usleep+0x45)[0xf7b1c475]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80e78a5]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x804fca4]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80503d7]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051b13]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051d8b]
/lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf5)[0xf7a39ee5]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x804cd21]

Exiting...
Suspended CPDN Monitor - Suspend request from BOINC...
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
20:17:20 (2855): called boinc_finish(193)
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
SIGSEGV: segmentation violation
Stack trace (22 frames):
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu(boinc_catch_signal+0x67)[0x80d4cf7]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7f71580]
/lib/i386-linux-gnu/libc.so.6(getenv+0xa2)[0xf7a6d552]
/lib/i386-linux-gnu/libc.so.6(+0xbbd2d)[0xf7af1d2d]
/lib/i386-linux-gnu/libc.so.6(+0xbc0ee)[0xf7af20ee]
/lib/i386-linux-gnu/libc.so.6(localtime_r+0x1b)[0xf7af003b]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d01b2]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d0900]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d09f1]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7f71580]
linux-gate.so.1(__kernel_vsyscall+0x9)[0xf7f71569]
/lib/i386-linux-gnu/libc.so.6(+0xc6693)[0xf7afc693]
/lib/i386-linux-gnu/libc.so.6(clock_nanosleep+0x52)[0xf7afc892]
/lib/i386-linux-gnu/libc.so.6(nanosleep+0x24)[0xf7b03314]
/lib/i386-linux-gnu/libc.so.6(usleep+0x45)[0xf7b37475]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80e78a5]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x804fca4]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80503d7]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051b13]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051d8b]
/lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf5)[0xf7a54ee5]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x804cd21]

Exiting...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
23:39:39 (20199): called boinc_finish(193)
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
23:39:40 (20199): called boinc_finish(193)
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
SIGSEGV: segmentation violation
Stack trace (23 frames):
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu(boinc_catch_signal+0x67)[0x80d4cf7]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7f13580]
/lib/i386-linux-gnu/libc.so.6(getenv+0xa2)[0xf7a0f552]
/lib/i386-linux-gnu/libc.so.6(+0xbbd2d)[0xf7a93d2d]
/lib/i386-linux-gnu/libc.so.6(+0xbc0ee)[0xf7a940ee]
/lib/i386-linux-gnu/libc.so.6(localtime_r+0x1b)[0xf7a9203b]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d01b2]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d0900]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d09f1]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7f13580]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d0580]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7f13580]
linux-gate.so.1(__kernel_vsyscall+0x9)[0xf7f13569]
/lib/i386-linux-gnu/libc.so.6(+0xc6693)[0xf7a9e693]
/lib/i386-linux-gnu/libc.so.6(clock_nanosleep+0x52)[0xf7a9e892]
/lib/i386-linux-gnu/libc.so.6(nanosleep+0x24)[0xf7aa5314]
/lib/i386-linux-gnu/libc.so.6(usleep+0x45)[0xf7ad9475]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80e78a5]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80503e8]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051b13]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051d8b]
/lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf5)[0xf79f6ee5]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x804cd21]

Exiting...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
19:51:21 (4230): called boinc_finish(193)
Suspended CPDN Monitor - Suspend request from BOINC...
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
SIGSEGV: segmentation violation
Stack trace (22 frames):
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu(boinc_catch_signal+0x67)[0x80d4cf7]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7fc7580]
/lib/i386-linux-gnu/libc.so.6(getenv+0xa2)[0xf7ac3552]
/lib/i386-linux-gnu/libc.so.6(+0xbbd2d)[0xf7b47d2d]
/lib/i386-linux-gnu/libc.so.6(+0xbc0ee)[0xf7b480ee]
/lib/i386-linux-gnu/libc.so.6(localtime_r+0x1b)[0xf7b4603b]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d01b2]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d0900]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d09f1]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7fc7580]
linux-gate.so.1(__kernel_vsyscall+0x9)[0xf7fc7569]
/lib/i386-linux-gnu/libc.so.6(+0xc6693)[0xf7b52693]
/lib/i386-linux-gnu/libc.so.6(clock_nanosleep+0x52)[0xf7b52892]
/lib/i386-linux-gnu/libc.so.6(nanosleep+0x24)[0xf7b59314]
/lib/i386-linux-gnu/libc.so.6(usleep+0x45)[0xf7b8d475]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80e78a5]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x804fca4]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80503d7]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051b13]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051d8b]
/lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf5)[0xf7aaaee5]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x804cd21]

Exiting...
11:52:51 (3111): called boinc_finish(0)

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
17 Jul 2021 12:46:36 1513349 22053320 hadam4h_1010_209105_5_902_012077395_2 43,403 1,096,867 25.2717
12 Jul 2021 20:39:08 1513349 22053320 hadam4h_1010_209105_5_902_012077395_2 34,763 885,024 25.4588
09 Jul 2021 09:32:32 1513349 22053320 hadam4h_1010_209105_5_902_012077395_2 26,123 659,774 25.2564
02 Jul 2021 06:43:45 1513349 22053320 hadam4h_1010_209105_5_902_012077395_2 17,483 448,965 25.6801
22 May 2021 22:00:44 1513349 22053320 hadam4h_1010_209105_5_902_012077395_2 8,843 230,688 26.0871


©2024 climateprediction.net