Task 21366148

Name	hadcm3s_st233_190012_120_771_011667104_0
Workunit	11667104
Created	5 Nov 2018, 22:13:13 UTC
Sent	6 Nov 2018, 6:15:59 UTC
Report deadline	19 Oct 2019, 11:35:59 UTC
Received	12 Nov 2018, 12:35:53 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	1460081
Run time	1 days 20 hours 54 min 42 sec
CPU time	1 days 4 hours 26 min 4 sec
Validate state	Invalid
Credit	3,111.26
Device peak FLOPS	4.02 GFLOPS
Application version	UK Met Office HadCM3 short v8.34 i686-pc-linux-gnu
Peak working set size	166.63 MB
Peak swap size	214.35 MB
Peak disk usage	4.51 MB
Stderr	<core_client_version>7.6.31</core_client_version> <![CDATA[ <message> process exited with code 22 (0x16, -234) </message> <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Signal 15 received: Software termination signal from kill Signal 15 received: Abnormal termination triggered by abort call Signal 15 received, exiting... 01:09:47 (19124): called boinc_finish(193) In boinc_exit called with status 193 Calloing set_signal_exit_code with status 193 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Signal 15 received: Software termination signal from kill Signal 15 received: Abnormal termination triggered by abort call Signal 15 received, exiting... SIGSEGV: segmentation violation Stack trace (21 frames): ../../projects/climateprediction.net/hadcm3s_8.34_i686-pc-linux-gnu(boinc_catch_signal+0x67)[0x80bcc77] [0xf7f18000] /lib/i386-linux-gnu/libc.so.6(getenv+0x9a)[0xf7b5b18a] /lib/i386-linux-gnu/libc.so.6(+0xa232b)[0xf7bcf32b] /lib/i386-linux-gnu/libc.so.6(+0xa269a)[0xf7bcf69a] /lib/i386-linux-gnu/libc.so.6(localtime_r+0x1e)[0xf7bcdd2e] ../../projects/climateprediction.net/hadcm3s_8.34_i686-pc-linux-gnu[0x80b8132] ../../projects/climateprediction.net/hadcm3s_8.34_i686-pc-linux-gnu[0x80b88c0] ../../projects/climateprediction.net/hadcm3s_8.34_i686-pc-linux-gnu[0x80b89b1] [0xf7f18000] ../../projects/climateprediction.net/hadcm3s_8.34_i686-pc-linux-gnu[0x80b8540] [0xf7f18000] [0xf7f17fe9] /lib/i386-linux-gnu/libc.so.6(nanosleep+0x4a)[0xf7bdd3ca] /lib/i386-linux-gnu/libc.so.6(usleep+0x35)[0xf7c0d2c5] ../../projects/climateprediction.net/hadcm3s_8.34_i686-pc-linux-gnu[0x80cf745] ../../projects/climateprediction.net/hadcm3s_8.34_i686-pc-linux-gnu[0x804fe8c] ../../projects/climateprediction.net/hadcm3s_8.34_i686-pc-linux-gnu[0x80515db] ../../projects/climateprediction.net/hadcm3s_8.34_i686-pc-linux-gnu[0x80517db] /lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf7)[0xf7b45637] ../../projects/climateprediction.net/hadcm3s_8.34_i686-pc-linux-gnu[0x804c771] Exiting... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Signal 15 received: Software termination signal from kill Signal 15 received: Abnormal termination triggered by abort call Signal 15 received, exiting... 23:00:02 (5131): called boinc_finish(193) In boinc_exit called with status 193 Calloing set_signal_exit_code with status 193 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Signal 15 received: Software termination signal from kill Signal 15 received: Abnormal termination triggered by abort call Signal 15 received, exiting... SIGSEGV: segmentation violation Stack trace (21 frames): ../../projects/climateprediction.net/hadcm3s_8.34_i686-pc-linux-gnu(boinc_catch_signal+0x67)[0x80bcc77] [0xf7f4d000] /lib/i386-linux-gnu/libc.so.6(getenv+0x9a)[0xf7b9018a] /lib/i386-linux-gnu/libc.so.6(+0xa232b)[0xf7c0432b] /lib/i386-linux-gnu/libc.so.6(+0xa269a)[0xf7c0469a] /lib/i386-linux-gnu/libc.so.6(localtime_r+0x1e)[0xf7c02d2e] ../../projects/climateprediction.net/hadcm3s_8.34_i686-pc-linux-gnu[0x80b8132] ../../projects/climateprediction.net/hadcm3s_8.34_i686-pc-linux-gnu[0x80b88c0] ../../projects/climateprediction.net/hadcm3s_8.34_i686-pc-linux-gnu[0x80b89b1] [0xf7f4d000] ../../projects/climateprediction.net/hadcm3s_8.34_i686-pc-linux-gnu[0x80b8540] [0xf7f4d000] [0xf7f4cfe9] /lib/i386-linux-gnu/libc.so.6(nanosleep+0x4a)[0xf7c123ca] /lib/i386-linux-gnu/libc.so.6(usleep+0x35)[0xf7c422c5] ../../projects/climateprediction.net/hadcm3s_8.34_i686-pc-linux-gnu[0x80cf745] ../../projects/climateprediction.net/hadcm3s_8.34_i686-pc-linux-gnu[0x804fe8c] ../../projects/climateprediction.net/hadcm3s_8.34_i686-pc-linux-gnu[0x80515db] ../../projects/climateprediction.net/hadcm3s_8.34_i686-pc-linux-gnu[0x80517db] /lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf7)[0xf7b7a637] ../../projects/climateprediction.net/hadcm3s_8.34_i686-pc-linux-gnu[0x804c771] Exiting... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Signal 15 received: Software termination signal from kill Signal 15 received: Abnormal termination triggered by abort call Signal 15 received, exiting... SIGSEGV: segmentation violation Stack trace (19 frames): ../../projects/climateprediction.net/hadcm3s_8.34_i686-pc-linux-gnu(boinc_catch_signal+0x67)[0x80bcc77] [0xf7edb000] /lib/i386-linux-gnu/libc.so.6(getenv+0x9a)[0xf7b1e18a] /lib/i386-linux-gnu/libc.so.6(+0xa232b)[0xf7b9232b] /lib/i386-linux-gnu/libc.so.6(+0xa269a)[0xf7b9269a] /lib/i386-linux-gnu/libc.so.6(localtime_r+0x1e)[0xf7b90d2e] ../../projects/climateprediction.net/hadcm3s_8.34_i686-pc-linux-gnu[0x80b8132] ../../projects/climateprediction.net/hadcm3s_8.34_i686-pc-linux-gnu[0x80b88c0] ../../projects/climateprediction.net/hadcm3s_8.34_i686-pc-linux-gnu[0x80b89b1] [0xf7edb000] [0xf7edafe9] /lib/i386-linux-gnu/libc.so.6(nanosleep+0x4a)[0xf7ba03ca] /lib/i386-linux-gnu/libc.so.6(usleep+0x35)[0xf7bd02c5] ../../projects/climateprediction.net/hadcm3s_8.34_i686-pc-linux-gnu[0x80cf745] ../../projects/climateprediction.net/hadcm3s_8.34_i686-pc-linux-gnu[0x804fe8c] ../../projects/climateprediction.net/hadcm3s_8.34_i686-pc-linux-gnu[0x80515db] ../../projects/climateprediction.net/hadcm3s_8.34_i686-pc-linux-gnu[0x80517db] /lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf7)[0xf7b08637] ../../projects/climateprediction.net/hadcm3s_8.34_i686-pc-linux-gnu[0x804c771] Exiting... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Signal 15 received: Software termination signal from kill Signal 15 received: Abnormal termination triggered by abort call Signal 15 received, exiting... SIGSEGV: segmentation violation Stack trace (19 frames): ../../projects/climateprediction.net/hadcm3s_8.34_i686-pc-linux-gnu(boinc_catch_signal+0x67)[0x80bcc77] [0xf7f3c000] /lib/i386-linux-gnu/libc.so.6(getenv+0x9a)[0xf7b7f18a] /lib/i386-linux-gnu/libc.so.6(+0xa232b)[0xf7bf332b] /lib/i386-linux-gnu/libc.so.6(+0xa269a)[0xf7bf369a] /lib/i386-linux-gnu/libc.so.6(localtime_r+0x1e)[0xf7bf1d2e] ../../projects/climateprediction.net/hadcm3s_8.34_i686-pc-linux-gnu[0x80b8132] ../../projects/climateprediction.net/hadcm3s_8.34_i686-pc-linux-gnu[0x80b88c0] ../../projects/climateprediction.net/hadcm3s_8.34_i686-pc-linux-gnu[0x80b89b1] [0xf7f3c000] [0xf7f3bfe9] /lib/i386-linux-gnu/libc.so.6(nanosleep+0x4a)[0xf7c013ca] /lib/i386-linux-gnu/libc.so.6(usleep+0x35)[0xf7c312c5] ../../projects/climateprediction.net/hadcm3s_8.34_i686-pc-linux-gnu[0x80cf745] ../../projects/climateprediction.net/hadcm3s_8.34_i686-pc-linux-gnu[0x804fe8c] ../../projects/climateprediction.net/hadcm3s_8.34_i686-pc-linux-gnu[0x80515db] ../../projects/climateprediction.net/hadcm3s_8.34_i686-pc-linux-gnu[0x80517db] /lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf7)[0xf7b69637] ../../projects/climateprediction.net/hadcm3s_8.34_i686-pc-linux-gnu[0x804c771] Exiting... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy Sorry, too many model crashes! :-( Calling boinc_finish...11:17:30 (2549): called boinc_finish(22) In boinc_exit called with status 22 Calloing set_signal_exit_code with status 22 </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
06 Nov 2018 18:19:11	1460081	21366148	hadcm3s_st233_190012_120_771_011667104_0	259,272	32,284	0.1245