climateprediction.net home page
Task 21759009

Task 21759009

Name hadcm3s_n630_206012_240_837_011897314_1
Workunit 11897314
Created 8 Oct 2019, 10:17:59 UTC
Sent 8 Oct 2019, 10:18:29 UTC
Report deadline 19 Sep 2020, 15:38:29 UTC
Received 14 Nov 2019, 21:09:04 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 22 (0x00000016) Unknown error code
Computer ID 1460222
Run time 34 days 19 hours 39 min 3 sec
CPU time 33 days 3 hours 1 min 5 sec
Validate state Invalid
Credit 3,110.40
Device peak FLOPS 0.84 GFLOPS
Application version UK Met Office HadCM3 short v8.36
i686-pc-linux-gnu
Peak working set size 166.33 MB
Peak swap size 215.19 MB
Peak disk usage 99.79 MB
Stderr
<core_client_version>7.9.3</core_client_version>
<![CDATA[
<message>
process exited with code 22 (0x16, -234)</message>
<stderr_txt>
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
14:12:41 (10706): called boinc_finish(193)
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
SIGSEGV: segmentation violation
Stack trace (21 frames):
../../projects/climateprediction.net/hadcm3s_8.36_i686-pc-linux-gnu(boinc_catch_signal+0x67)[0x80bc177]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xb7f9bd14]
/lib/i386-linux-gnu/libc.so.6(getenv+0x99)[0xb7b09a69]
/lib/i386-linux-gnu/libc.so.6(+0xaf468)[0xb7b89468]
/lib/i386-linux-gnu/libc.so.6(+0xaf835)[0xb7b89835]
/lib/i386-linux-gnu/libc.so.6(localtime_r+0x12)[0xb7b87db2]
../../projects/climateprediction.net/hadcm3s_8.36_i686-pc-linux-gnu[0x80b7632]
../../projects/climateprediction.net/hadcm3s_8.36_i686-pc-linux-gnu[0x80b7d80]
../../projects/climateprediction.net/hadcm3s_8.36_i686-pc-linux-gnu[0x80b7e71]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xb7f9bd14]
../../projects/climateprediction.net/hadcm3s_8.36_i686-pc-linux-gnu[0x80b7a00]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xb7f9bd14]
linux-gate.so.1(__kernel_vsyscall+0x9)[0xb7f9bd09]
/lib/i386-linux-gnu/libc.so.6(nanosleep+0x4b)[0xb7b991cb]
/lib/i386-linux-gnu/libc.so.6(usleep+0x41)[0xb7bcbbe1]
../../projects/climateprediction.net/hadcm3s_8.36_i686-pc-linux-gnu[0x80cead5]
../../projects/climateprediction.net/hadcm3s_8.36_i686-pc-linux-gnu[0x804fe8b]
../../projects/climateprediction.net/hadcm3s_8.36_i686-pc-linux-gnu[0x80515bd]
../../projects/climateprediction.net/hadcm3s_8.36_i686-pc-linux-gnu[0x80517bd]
/lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf1)[0xb7af2e81]
../../projects/climateprediction.net/hadcm3s_8.36_i686-pc-linux-gnu[0x804c7a1]

Exiting...
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
SIGSEGV: segmentation violation
Stack trace (19 frames):
../../projects/climateprediction.net/hadcm3s_8.36_i686-pc-linux-gnu(boinc_catch_signal+0x67)[0x80bc177]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xb7f1dd14]
/lib/i386-linux-gnu/libc.so.6(getenv+0x99)[0xb7a8ba69]
/lib/i386-linux-gnu/libc.so.6(+0xaf468)[0xb7b0b468]
/lib/i386-linux-gnu/libc.so.6(+0xaf835)[0xb7b0b835]
/lib/i386-linux-gnu/libc.so.6(localtime_r+0x12)[0xb7b09db2]
../../projects/climateprediction.net/hadcm3s_8.36_i686-pc-linux-gnu[0x80b7632]
../../projects/climateprediction.net/hadcm3s_8.36_i686-pc-linux-gnu[0x80b7d80]
../../projects/climateprediction.net/hadcm3s_8.36_i686-pc-linux-gnu[0x80b7e71]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xb7f1dd14]
linux-gate.so.1(__kernel_vsyscall+0x9)[0xb7f1dd09]
/lib/i386-linux-gnu/libc.so.6(nanosleep+0x4b)[0xb7b1b1cb]
/lib/i386-linux-gnu/libc.so.6(usleep+0x41)[0xb7b4dbe1]
../../projects/climateprediction.net/hadcm3s_8.36_i686-pc-linux-gnu[0x80cead5]
../../projects/climateprediction.net/hadcm3s_8.36_i686-pc-linux-gnu[0x804fe8b]
../../projects/climateprediction.net/hadcm3s_8.36_i686-pc-linux-gnu[0x80515bd]
../../projects/climateprediction.net/hadcm3s_8.36_i686-pc-linux-gnu[0x80517bd]
/lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf1)[0xb7a74e81]
../../projects/climateprediction.net/hadcm3s_8.36_i686-pc-linux-gnu[0x804c7a1]

Exiting...
Suspended CPDN Monitor - Suspend request from BOINC...
MainError:	07:11:11 PM	No files match the supplied pattern.
MainError:	07:11:11 PM	No files match the supplied pattern.
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
MainError:	10:52:48 PM	No files match the supplied pattern.
MainError:	10:52:48 PM	No files match the supplied pattern.
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
MainError:	03:11:42 AM	No files match the supplied pattern.
MainError:	03:11:42 AM	No files match the supplied pattern.
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
MainError:	10:32:01 AM	No files match the supplied pattern.
MainError:	10:32:01 AM	No files match the supplied pattern.
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
16:07:41 (900): called boinc_finish(193)
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
MainError:	01:22:41 AM	No files match the supplied pattern.
MainError:	01:22:41 AM	No files match the supplied pattern.
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
MainError:	09:26:09 AM	No files match the supplied pattern.
MainError:	09:26:09 AM	No files match the supplied pattern.
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
MainError:	06:09:40 PM	No files match the supplied pattern.
MainError:	06:09:40 PM	No files match the supplied pattern.
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
MainError:	02:18:55 AM	No files match the supplied pattern.
MainError:	02:18:55 AM	No files match the supplied pattern.
Suspended CPDN Monitor - Suspend request from BOINC...
MainError:	04:19:03 AM	No files match the supplied pattern.
MainError:	04:19:03 AM	No files match the supplied pattern.
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
15:30:05 (1517): called boinc_finish(193)
Suspended CPDN Monitor - Suspend request from BOINC...
MainError:	07:24:45 PM	No files match the supplied pattern.
MainError:	07:24:45 PM	No files match the supplied pattern.

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  
Sorry, too many model crashes! :-(
14:08:36 (698): called boinc_finish(22)

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
14 Nov 2019 19:29:30 1460222 21759009 hadcm3s_n630_206012_240_837_011897314_1 259,200 2,862,348 11.0430
11 Nov 2019 04:20:07 1460222 21759009 hadcm3s_n630_206012_240_837_011897314_1 233,280 2,602,157 11.1547
08 Nov 2019 02:22:06 1460222 21759009 hadcm3s_n630_206012_240_837_011897314_1 207,360 2,345,813 11.3128
04 Nov 2019 18:14:22 1460222 21759009 hadcm3s_n630_206012_240_837_011897314_1 181,440 2,086,277 11.4984
01 Nov 2019 09:28:31 1460222 21759009 hadcm3s_n630_206012_240_837_011897314_1 155,520 1,827,260 11.7494
30 Oct 2019 10:56:30 1460222 21759009 hadcm3s_n630_206012_240_837_011897314_1 129,600 1,569,831 12.1129
25 Oct 2019 10:36:54 1460222 21759009 hadcm3s_n630_206012_240_837_011897314_1 103,680 1,299,295 12.5318
21 Oct 2019 03:15:06 1460222 21759009 hadcm3s_n630_206012_240_837_011897314_1 77,760 968,516 12.4552
16 Oct 2019 22:57:39 1460222 21759009 hadcm3s_n630_206012_240_837_011897314_1 51,840 637,783 12.3029
12 Oct 2019 19:13:12 1460222 21759009 hadcm3s_n630_206012_240_837_011897314_1 25,920 306,152 11.8114


©2024 climateprediction.net