climateprediction.net home page
Task 22026660

Task 22026660

Name hadcm3s_qw27_190012_240_837_011900073_1
Workunit 11900073
Created 28 Feb 2021, 12:02:40 UTC
Sent 16 Mar 2021, 16:44:03 UTC
Report deadline 26 Feb 2022, 22:04:03 UTC
Received 19 Mar 2021, 18:51:50 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 22 (0x00000016) Unknown error code
Computer ID 1512816
Run time 2 days 21 hours 2 min 58 sec
CPU time 1 days 18 hours 50 min 7 sec
Validate state Invalid
Credit 3,110.40
Device peak FLOPS 6.17 GFLOPS
Application version UK Met Office HadCM3 short v8.36
i686-pc-linux-gnu
Peak working set size 177.73 MB
Peak swap size 215.00 MB
Peak disk usage 98.91 MB
Stderr
<core_client_version>7.16.16</core_client_version>
<![CDATA[
<message>
process exited with code 22 (0x16, -234)</message>
<stderr_txt>
MainError:	11:56:33 PM	No files match the supplied pattern.
MainError:	11:56:33 PM	No files match the supplied pattern.
MainError:	06:45:01 AM	No files match the supplied pattern.
MainError:	06:45:01 AM	No files match the supplied pattern.
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
10:13:36 (97919): called boinc_finish(193)
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
10:13:36 (97919): called boinc_finish(193)
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
SIGSEGV: segmentation violation
Stack trace (21 frames):
../../projects/climateprediction.net/hadcm3s_8.36_i686-pc-linux-gnu(boinc_catch_signal+0x67)[0x80bc177]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7f4b570]
/lib/i386-linux-gnu/libc.so.6(getenv+0x9a)[0xf7a58e0a]
/lib/i386-linux-gnu/libc.so.6(+0xb9f7d)[0xf7adbf7d]
/lib/i386-linux-gnu/libc.so.6(+0xba32a)[0xf7adc32a]
/lib/i386-linux-gnu/libc.so.6(localtime_r+0x17)[0xf7ada277]
../../projects/climateprediction.net/hadcm3s_8.36_i686-pc-linux-gnu[0x80b7632]
../../projects/climateprediction.net/hadcm3s_8.36_i686-pc-linux-gnu[0x80b7d80]
../../projects/climateprediction.net/hadcm3s_8.36_i686-pc-linux-gnu[0x80b7e71]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7f4b570]
linux-gate.so.1(__kernel_vsyscall+0x9)[0xf7f4b559]
/lib/i386-linux-gnu/libc.so.6(+0xc43ed)[0xf7ae63ed]
/lib/i386-linux-gnu/libc.so.6(clock_nanosleep+0x4e)[0xf7ae64be]
/lib/i386-linux-gnu/libc.so.6(nanosleep+0x20)[0xf7aeca20]
/lib/i386-linux-gnu/libc.so.6(usleep+0x41)[0xf7b1f051]
../../projects/climateprediction.net/hadcm3s_8.36_i686-pc-linux-gnu[0x80cead5]
../../projects/climateprediction.net/hadcm3s_8.36_i686-pc-linux-gnu[0x804fe8b]
../../projects/climateprediction.net/hadcm3s_8.36_i686-pc-linux-gnu[0x80515bd]
../../projects/climateprediction.net/hadcm3s_8.36_i686-pc-linux-gnu[0x80517bd]
/lib/i386-linux-gnu/libc.so.6(__libc_start_main+0x106)[0xf7a40e46]
../../projects/climateprediction.net/hadcm3s_8.36_i686-pc-linux-gnu[0x804c7a1]

Exiting...
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
SIGSEGV: segmentation violation
Stack trace (21 frames):
../../projects/climateprediction.net/hadcm3s_8.36_i686-pc-linux-gnu(boinc_catch_signal+0x67)[0x80bc177]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7fc7570]
/lib/i386-linux-gnu/libc.so.6(getenv+0x9a)[0xf7ad4e0a]
/lib/i386-linux-gnu/libc.so.6(+0xb9f7d)[0xf7b57f7d]
/lib/i386-linux-gnu/libc.so.6(+0xba32a)[0xf7b5832a]
/lib/i386-linux-gnu/libc.so.6(localtime_r+0x17)[0xf7b56277]
../../projects/climateprediction.net/hadcm3s_8.36_i686-pc-linux-gnu[0x80b7632]
../../projects/climateprediction.net/hadcm3s_8.36_i686-pc-linux-gnu[0x80b7d80]
../../projects/climateprediction.net/hadcm3s_8.36_i686-pc-linux-gnu[0x80b7e71]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7fc7570]
linux-gate.so.1(__kernel_vsyscall+0x9)[0xf7fc7559]
/lib/i386-linux-gnu/libc.so.6(+0xc43ed)[0xf7b623ed]
/lib/i386-linux-gnu/libc.so.6(clock_nanosleep+0x4e)[0xf7b624be]
/lib/i386-linux-gnu/libc.so.6(nanosleep+0x20)[0xf7b68a20]
/lib/i386-linux-gnu/libc.so.6(usleep+0x41)[0xf7b9b051]
../../projects/climateprediction.net/hadcm3s_8.36_i686-pc-linux-gnu[0x80cead5]
../../projects/climateprediction.net/hadcm3s_8.36_i686-pc-linux-gnu[0x804fe8b]
../../projects/climateprediction.net/hadcm3s_8.36_i686-pc-linux-gnu[0x80515bd]
../../projects/climateprediction.net/hadcm3s_8.36_i686-pc-linux-gnu[0x80517bd]
/lib/i386-linux-gnu/libc.so.6(__libc_start_main+0x106)[0xf7abce46]
../../projects/climateprediction.net/hadcm3s_8.36_i686-pc-linux-gnu[0x804c7a1]

Exiting...
MainError:	01:57:45 PM	No files match the supplied pattern.
MainError:	01:57:45 PM	No files match the supplied pattern.
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
18:19:38 (1627): called boinc_finish(193)
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
18:19:38 (1627): called boinc_finish(193)
SIGSEGV: segmentation violation
Stack trace (17 frames):
/var/lib/boinc-client/projects/climateprediction.net/hadcm3s_um_8.36_i686-pc-linux-gnu(boinc_catch_signal+0x67)[0x84ff4f7]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7f73570]
/var/lib/boinc-client/projects/climateprediction.net/hadcm3s_um_8.36_i686-pc-linux-gnu[0x8426581]
/var/lib/boinc-client/projects/climateprediction.net/hadcm3s_um_8.36_i686-pc-linux-gnu[0x83d3f82]
/var/lib/boinc-client/projects/climateprediction.net/hadcm3s_um_8.36_i686-pc-linux-gnu[0x842bfb5]
/var/lib/boinc-client/projects/climateprediction.net/hadcm3s_um_8.36_i686-pc-linux-gnu[0x84228e0]
/var/lib/boinc-client/projects/climateprediction.net/hadcm3s_um_8.36_i686-pc-linux-gnu[0x82a52fa]
/var/lib/boinc-client/projects/climateprediction.net/hadcm3s_um_8.36_i686-pc-linux-gnu[0x836d928]
/var/lib/boinc-client/projects/climateprediction.net/hadcm3s_um_8.36_i686-pc-linux-gnu[0x819c242]
/var/lib/boinc-client/projects/climateprediction.net/hadcm3s_um_8.36_i686-pc-linux-gnu[0x8265f1e]
/var/lib/boinc-client/projects/climateprediction.net/hadcm3s_um_8.36_i686-pc-linux-gnu[0x832032d]
/var/lib/boinc-client/projects/climateprediction.net/hadcm3s_um_8.36_i686-pc-linux-gnu[0x80880c9]
/var/lib/boinc-client/projects/climateprediction.net/hadcm3s_um_8.36_i686-pc-linux-gnu[0x8479d6e]
/var/lib/boinc-client/projects/climateprediction.net/hadcm3s_um_8.36_i686-pc-linux-gnu[0x8494feb]
/var/lib/boinc-client/projects/climateprediction.net/hadcm3s_um_8.36_i686-pc-linux-gnu[0x848be04]
/var/lib/boinc-client/projects/climateprediction.net/hadcm3s_um_8.36_i686-pc-linux-gnu[0x8496bad]
/lib/i386-linux-gnu/libc.so.6(__libc_start_main+0x106)[0xf7c52e46]

Exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1505, iMonCtr=1
Model crash detected, will try to restart...
MainError:	12:17:27 AM	No files match the supplied pattern.
MainError:	12:17:27 AM	No files match the supplied pattern.
MainError:	06:47:46 AM	No files match the supplied pattern.
MainError:	06:47:46 AM	No files match the supplied pattern.
MainError:	01:29:23 PM	No files match the supplied pattern.
MainError:	01:29:23 PM	No files match the supplied pattern.
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
19:36:27 (1885): called boinc_finish(193)
MainError:	08:05:32 PM	No files match the supplied pattern.
MainError:	08:05:32 PM	No files match the supplied pattern.
MainError:	02:25:18 AM	No files match the supplied pattern.
MainError:	02:25:18 AM	No files match the supplied pattern.
MainError:	08:57:28 AM	No files match the supplied pattern.
MainError:	08:57:28 AM	No files match the supplied pattern.
MainError:	03:43:11 PM	No files match the supplied pattern.
MainError:	03:43:11 PM	No files match the supplied pattern.
Suspended CPDN Monitor - Suspend request from BOINC...

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  
Sorry, too many model crashes! :-(
17:51:01 (1533): called boinc_finish(22)

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
19 Mar 2021 16:46:16 1512816 22026660 hadcm3s_qw27_190012_240_837_011900073_1 259,200 223,448 0.8621
19 Mar 2021 09:58:36 1512816 22026660 hadcm3s_qw27_190012_240_837_011900073_1 233,280 200,384 0.8590
19 Mar 2021 03:26:33 1512816 22026660 hadcm3s_qw27_190012_240_837_011900073_1 207,360 177,747 0.8572
18 Mar 2021 21:09:39 1512816 22026660 hadcm3s_qw27_190012_240_837_011900073_1 181,440 155,638 0.8578
18 Mar 2021 14:31:38 1512816 22026660 hadcm3s_qw27_190012_240_837_011900073_1 155,520 133,233 0.8567
18 Mar 2021 07:52:50 1512816 22026660 hadcm3s_qw27_190012_240_837_011900073_1 129,600 110,322 0.8513
18 Mar 2021 00:18:05 1512816 22026660 hadcm3s_qw27_190012_240_837_011900073_1 103,680 87,836 0.8472
17 Mar 2021 14:03:07 1512816 22026660 hadcm3s_qw27_190012_240_837_011900073_1 77,760 72,172 0.9281
17 Mar 2021 07:46:28 1512816 22026660 hadcm3s_qw27_190012_240_837_011900073_1 51,840 48,146 0.9287
17 Mar 2021 00:58:51 1512816 22026660 hadcm3s_qw27_190012_240_837_011900073_1 25,920 24,603 0.9492


©2024 cpdn.org