climateprediction.net home page
Task 22197734

Task 22197734

Name hadam4_a049_200010_13_928_012132923_0
Workunit 12132923
Created 5 Apr 2022, 9:57:54 UTC
Sent 6 Apr 2022, 12:53:09 UTC
Report deadline 19 Mar 2023, 18:13:09 UTC
Received 17 May 2022, 9:37:36 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 22 (0x00000016) Unknown error code
Computer ID 1531397
Run time 26 days 10 hours 58 min 35 sec
CPU time 25 days 18 hours 40 min 6 sec
Validate state Invalid
Credit 20,793.11
Device peak FLOPS 2.91 GFLOPS
Application version UK Met Office HadAM4 at N144 resolution v8.09
i686-pc-linux-gnu
Peak working set size 633.68 MB
Peak swap size 667.92 MB
Peak disk usage 60.92 MB
Stderr
<core_client_version>7.9.3</core_client_version>
<![CDATA[
<message>
process exited with code 22 (0x16, -234)</message>
<stderr_txt>
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
SIGSEGV: segmentation violation
Stack trace (19 frames):
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu(boinc_catch_signal+0x67)[0x80d4cf7]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xb7fcdd14]
/lib/i386-linux-gnu/libc.so.6(getenv+0x99)[0xb7b2dc39]
/lib/i386-linux-gnu/libc.so.6(+0xaf528)[0xb7bad528]
/lib/i386-linux-gnu/libc.so.6(+0xaf905)[0xb7bad905]
/lib/i386-linux-gnu/libc.so.6(localtime_r+0x12)[0xb7babe62]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x80d01b2]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x80d0900]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x80d09f1]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xb7fcdd14]
linux-gate.so.1(__kernel_vsyscall+0x9)[0xb7fcdd09]
/lib/i386-linux-gnu/libc.so.6(nanosleep+0x4b)[0xb7bbd29b]
/lib/i386-linux-gnu/libc.so.6(usleep+0x41)[0xb7befaa1]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x80e78a5]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x80503e8]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x8051b13]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x8051d8b]
/lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf1)[0xb7b16fa1]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x804cd21]

Exiting...
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
17:28:37 (2805): called boinc_finish(193)
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
SIGSEGV: segmentation violation
Stack trace (19 frames):
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu(boinc_catch_signal+0x67)[0x80d4cf7]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xb7ed9d14]
/lib/i386-linux-gnu/libc.so.6(getenv+0x99)[0xb7a39c39]
/lib/i386-linux-gnu/libc.so.6(+0xaf528)[0xb7ab9528]
/lib/i386-linux-gnu/libc.so.6(+0xaf905)[0xb7ab9905]
/lib/i386-linux-gnu/libc.so.6(localtime_r+0x12)[0xb7ab7e62]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x80d01b2]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x80d0900]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x80d09f1]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xb7ed9d14]
linux-gate.so.1(__kernel_vsyscall+0x9)[0xb7ed9d09]
/lib/i386-linux-gnu/libc.so.6(nanosleep+0x4b)[0xb7ac929b]
/lib/i386-linux-gnu/libc.so.6(usleep+0x41)[0xb7afbaa1]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x80e78a5]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x80503e8]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x8051b13]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x8051d8b]
/lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf1)[0xb7a22fa1]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x804cd21]

Exiting...
Suspended CPDN Monitor - Suspend request from BOINC...
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
14:45:05 (1082): called boinc_finish(193)
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
SIGSEGV: segmentation violation
Stack trace (19 frames):
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu(boinc_catch_signal+0x67)[0x80d4cf7]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xb7f62d14]
/lib/i386-linux-gnu/libc.so.6(getenv+0x99)[0xb7ac2c39]
/lib/i386-linux-gnu/libc.so.6(+0xaf528)[0xb7b42528]
/lib/i386-linux-gnu/libc.so.6(+0xaf905)[0xb7b42905]
/lib/i386-linux-gnu/libc.so.6(localtime_r+0x12)[0xb7b40e62]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x80d01b2]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x80d0900]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x80d09f1]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xb7f62d14]
linux-gate.so.1(__kernel_vsyscall+0x9)[0xb7f62d09]
/lib/i386-linux-gnu/libc.so.6(nanosleep+0x4b)[0xb7b5229b]
/lib/i386-linux-gnu/libc.so.6(usleep+0x41)[0xb7b84aa1]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x80e78a5]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x80503e8]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x8051b13]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x8051d8b]
/lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf1)[0xb7aabfa1]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x804cd21]

Exiting...
Signal 15 received: Software termination signal from kill 
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
SIGSEGV: segmentation violation
Stack trace (19 frames):
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu(boinc_catch_signal+0x67)[0x80d4cf7]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xb7fbbd14]
/lib/i386-linux-gnu/libc.so.6(getenv+0x99)[0xb7b1bc39]
/lib/i386-linux-gnu/libc.so.6(+0xaf528)[0xb7b9b528]
/lib/i386-linux-gnu/libc.so.6(+0xaf905)[0xb7b9b905]
/lib/i386-linux-gnu/libc.so.6(localtime_r+0x12)[0xb7b99e62]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x80d01b2]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x80d0900]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x80d09f1]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xb7fbbd14]
linux-gate.so.1(__kernel_vsyscall+0x9)[0xb7fbbd09]
/lib/i386-linux-gnu/libc.so.6(nanosleep+0x4b)[0xb7bab29b]
/lib/i386-linux-gnu/libc.so.6(usleep+0x41)[0xb7bddaa1]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x80e78a5]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x80503e8]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x8051b13]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x8051d8b]
/lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf1)[0xb7b04fa1]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x804cd21]

Exiting...
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
SIGSEGV: segmentation violation
Stack trace (19 frames):
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu(boinc_catch_signal+0x67)[0x80d4cf7]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xb7facd14]
/lib/i386-linux-gnu/libc.so.6(getenv+0x99)[0xb7b0cc39]
/lib/i386-linux-gnu/libc.so.6(+0xaf528)[0xb7b8c528]
/lib/i386-linux-gnu/libc.so.6(+0xaf905)[0xb7b8c905]
/lib/i386-linux-gnu/libc.so.6(localtime_r+0x12)[0xb7b8ae62]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x80d01b2]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x80d0900]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x80d09f1]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xb7facd14]
linux-gate.so.1(__kernel_vsyscall+0x9)[0xb7facd09]
/lib/i386-linux-gnu/libc.so.6(nanosleep+0x4b)[0xb7b9c29b]
/lib/i386-linux-gnu/libc.so.6(usleep+0x41)[0xb7bceaa1]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x80e78a5]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x80503e8]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x8051b13]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x8051d8b]
/lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf1)[0xb7af5fa1]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x804cd21]

Exiting...
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
SIGSEGV: segmentation violation
Stack trace (19 frames):
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu(boinc_catch_signal+0x67)[0x80d4cf7]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xb7fcbd14]
/lib/i386-linux-gnu/libc.so.6(getenv+0x99)[0xb7b2bc39]
/lib/i386-linux-gnu/libc.so.6(+0xaf528)[0xb7bab528]
/lib/i386-linux-gnu/libc.so.6(+0xaf905)[0xb7bab905]
/lib/i386-linux-gnu/libc.so.6(localtime_r+0x12)[0xb7ba9e62]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x80d01b2]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x80d0900]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x80d09f1]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xb7fcbd14]
linux-gate.so.1(__kernel_vsyscall+0x9)[0xb7fcbd09]
/lib/i386-linux-gnu/libc.so.6(nanosleep+0x4b)[0xb7bbb29b]
/lib/i386-linux-gnu/libc.so.6(usleep+0x41)[0xb7bedaa1]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x80e78a5]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x80503e8]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x8051b13]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x8051d8b]
/lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf1)[0xb7b14fa1]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x804cd21]

Exiting...
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
SIGSEGV: segmentation violation
Stack trace (19 frames):
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu(boinc_catch_signal+0x67)[0x80d4cf7]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xb7f93d14]
/lib/i386-linux-gnu/libc.so.6(getenv+0x99)[0xb7af3c39]
/lib/i386-linux-gnu/libc.so.6(+0xaf528)[0xb7b73528]
/lib/i386-linux-gnu/libc.so.6(+0xaf905)[0xb7b73905]
/lib/i386-linux-gnu/libc.so.6(localtime_r+0x12)[0xb7b71e62]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x80d01b2]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x80d0900]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x80d09f1]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xb7f93d14]
linux-gate.so.1(__kernel_vsyscall+0x9)[0xb7f93d09]
/lib/i386-linux-gnu/libc.so.6(nanosleep+0x4b)[0xb7b8329b]
/lib/i386-linux-gnu/libc.so.6(usleep+0x41)[0xb7bb5aa1]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x80e78a5]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x80503e8]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x8051b13]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x8051d8b]
/lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf1)[0xb7adcfa1]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x804cd21]

Exiting...
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
SIGSEGV: segmentation violation
Stack trace (19 frames):
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu(boinc_catch_signal+0x67)[0x80d4cf7]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xb7eebd14]
/lib/i386-linux-gnu/libc.so.6(getenv+0x99)[0xb7a4bc39]
/lib/i386-linux-gnu/libc.so.6(+0xaf528)[0xb7acb528]
/lib/i386-linux-gnu/libc.so.6(+0xaf905)[0xb7acb905]
/lib/i386-linux-gnu/libc.so.6(localtime_r+0x12)[0xb7ac9e62]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x80d01b2]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x80d0900]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x80d09f1]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xb7eebd14]
linux-gate.so.1(__kernel_vsyscall+0x9)[0xb7eebd09]
/lib/i386-linux-gnu/libc.so.6(nanosleep+0x4b)[0xb7adb29b]
/lib/i386-linux-gnu/libc.so.6(usleep+0x41)[0xb7b0daa1]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x80e78a5]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x80503e8]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x8051b13]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x8051d8b]
/lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf1)[0xb7a34fa1]
../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x804cd21]

Exiting...

BUFFOUT: Write Failed: No space left on device
BUFFOUT: C I/O Error - Return code = 1

Model crashed: WRITDUMP: BAD BUFFOUT OF DATA                                                                                                                                                                                                                                   tmp/xnnuj.pipe_dummy                                                            
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1308, iMonCtr=1
Model crash detected, will try to restart...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1308, iMonCtr=1
Model crash detected, will try to restart...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1308, iMonCtr=1
Model crash detected, will try to restart...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1308, iMonCtr=1
Model crash detected, will try to restart...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1308, iMonCtr=1
Model crash detected, will try to restart...
Sorry, too many model crashes! :-(
12:36:17 (1308): called boinc_finish(22)

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
18 May 2022 22:41:51 1531397 22197734 hadam4_a049_200010_13_928_012132923_0 56,261 2,368,250 42.0940
18 May 2022 00:24:43 1531397 22197734 hadam4_a049_200010_13_928_012132923_0 51,941 2,288,147 44.0528
16 May 2022 07:32:10 1529210 22197734 hadam4_a049_200010_13_928_012132923_0 47,621 2,195,898 46.1120
04 May 2022 02:58:34 1529210 22197734 hadam4_a049_200010_13_928_012132923_0 43,301 2,023,624 46.7339
01 May 2022 17:19:25 1529210 22197734 hadam4_a049_200010_13_928_012132923_0 38,981 1,821,266 46.7219
29 Apr 2022 08:56:40 1529210 22197734 hadam4_a049_200010_13_928_012132923_0 34,661 1,620,049 46.7398
26 Apr 2022 22:49:58 1529210 22197734 hadam4_a049_200010_13_928_012132923_0 30,341 1,417,225 46.7099
24 Apr 2022 13:59:12 1529210 22197734 hadam4_a049_200010_13_928_012132923_0 26,021 1,214,411 46.6704
22 Apr 2022 05:22:21 1529210 22197734 hadam4_a049_200010_13_928_012132923_0 21,701 1,012,260 46.6458
19 Apr 2022 19:00:57 1529210 22197734 hadam4_a049_200010_13_928_012132923_0 17,381 811,965 46.7157
17 Apr 2022 09:59:09 1529210 22197734 hadam4_a049_200010_13_928_012132923_0 13,061 611,981 46.8556
15 Apr 2022 01:43:54 1529210 22197734 hadam4_a049_200010_13_928_012132923_0 8,741 411,565 47.0844
12 Apr 2022 16:11:36 1529210 22197734 hadam4_a049_200010_13_928_012132923_0 4,421 208,692 47.2047


©2024 climateprediction.net