Task 21975020

Name	hadam4h_d0ah_206711_5_886_012040640_3
Workunit	12040640
Created	28 Nov 2020, 18:34:19 UTC
Sent	28 Nov 2020, 20:51:23 UTC
Report deadline	11 Nov 2021, 2:11:23 UTC
Received	15 Jan 2021, 0:47:44 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	1518166
Run time	43 days 2 hours 3 min 31 sec
CPU time	41 days 11 hours 38 min 34 sec
Validate state	Invalid
Credit	27,115.14
Device peak FLOPS	5.80 GFLOPS
Application version	UK Met Office HadAM4 at N216 resolution v8.52 i686-pc-linux-gnu
Peak working set size	1,375.37 MB
Peak swap size	1,407.44 MB
Peak disk usage	206.54 MB
Stderr	<core_client_version>7.16.6</core_client_version> <![CDATA[ <message> process exited with code 22 (0x16, -234)</message> <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Signal 1 received, exiting... Signal 15 received: Software termination signal from kill Signal 15 received: Abnormal termination triggered by abort call Signal 15 received, exiting... SIGSEGV: segmentation violation Stack trace (19 frames): ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu(boinc_catch_signal+0x67)[0x80d4cf7] linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7f63170] /lib/libc.so.6(getenv+0x99)[0xf7a86479] /lib/libc.so.6(+0xb5188)[0xf7b07188] /lib/libc.so.6(+0xb556d)[0xf7b0756d] /lib/libc.so.6(localtime_r+0x1e)[0xf7b05abe] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d01b2] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d0900] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d09f1] linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7f63170] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x804d118] linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7f63170] linux-gate.so.1(__kernel_vsyscall+0x9)[0xf7f63159] /lib/libc.so.6(nanosleep+0x53)[0xf7b16723] /lib/libc.so.6(usleep+0x41)[0xf7b48b11] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80e78a5] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d2114] /lib/libpthread.so.0(+0x733d)[0xf7f2433d] /lib/libc.so.6(clone+0x66)[0xf7b50216] Exiting... CPDN Monitor - Quit request from BOINC... Signal 15 received: Software termination signal from kill Signal 15 received: Abnormal termination triggered by abort call Signal 15 received, exiting... SIGSEGV: segmentation violation Stack trace (26 frames): ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu(boinc_catch_signal+0x67)[0x80d4cf7] linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7edb170] /lib/libc.so.6(getenv+0x99)[0xf79fe479] /lib/libc.so.6(+0xb5188)[0xf7a7f188] /lib/libc.so.6(+0xb556d)[0xf7a7f56d] /lib/libc.so.6(localtime_r+0x1e)[0xf7a7dabe] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d01b2] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d0900] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d09f1] linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7edb170] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d0580] linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7edb170] linux-gate.so.1(__kernel_vsyscall+0x7)[0xf7edb157] /lib/libpthread.so.0(waitpid+0x5b)[0xf7ea7c8b] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x804f550] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x804d158] linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7edb170] linux-gate.so.1(__kernel_vsyscall+0x9)[0xf7edb159] /lib/libc.so.6(nanosleep+0x53)[0xf7a8e723] /lib/libc.so.6(usleep+0x41)[0xf7ac0b11] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80e78a5] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80503e8] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051b13] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051d8b] /lib/libc.so.6(__libc_start_main+0xf3)[0xf79e5e63] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x804cd21] Exiting... Signal 1 received, exiting... SIGSEGV: segmentation violation Stack trace (23 frames): ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu(boinc_catch_signal+0x67)[0x80d4cf7] linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7f2c170] /lib/libc.so.6(getenv+0x99)[0xf7a4f479] /lib/libc.so.6(+0xb5188)[0xf7ad0188] /lib/libc.so.6(+0xb556d)[0xf7ad056d] /lib/libc.so.6(localtime_r+0x1e)[0xf7aceabe] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d01b2] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d0900] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d09f1] linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7f2c170] linux-gate.so.1(__kernel_vsyscall+0x9)[0xf7f2c159] /lib/libc.so.6(__munmap+0x16)[0xf7b147a6] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80e2954] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x804f7ba] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x804d160] linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7f2c170] linux-gate.so.1(__kernel_vsyscall+0x9)[0xf7f2c159] /lib/libc.so.6(nanosleep+0x53)[0xf7adf723] /lib/libc.so.6(usleep+0x41)[0xf7b11b11] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80e78a5] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d2114] /lib/libpthread.so.0(+0x733d)[0xf7eed33d] /lib/libc.so.6(clone+0x66)[0xf7b19216] Exiting... CPDN Monitor - Quit request from BOINC... Model crashed: READDUMP: BAD BUFFIN OF DATA tmp/xnnuj.pipe_dummy Model crashed: READDUMP: BAD BUFFIN OF DATA tmp/xnnuj.pipe_dummy Model crashed: READDUMP: BAD BUFFIN OF DATA tmp/xnnuj.pipe_dummy Model crashed: READDUMP: BAD BUFFIN OF DATA tmp/xnnuj.pipe_dummy Model crashed: READDUMP: BAD BUFFIN OF DATA tmp/xnnuj.pipe_dummy Model crashed: READDUMP: BAD BUFFIN OF DATA tmp/xnnuj.pipe_dummy Sorry, too many model crashes! :-( 01:51:53 (6581): called boinc_finish(22) </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
10 Jan 2021 23:02:53	1510957	21975020	hadam4h_d0ah_206711_5_886_012040640_3	34,763	3,231,440	92.9563
01 Jan 2021 23:00:49	1510957	21975020	hadam4h_d0ah_206711_5_886_012040640_3	26,123	2,471,004	94.5911
22 Dec 2020 23:03:53	1510957	21975020	hadam4h_d0ah_206711_5_886_012040640_3	17,483	1,639,674	93.7868
12 Dec 2020 23:04:06	1510957	21975020	hadam4h_d0ah_206711_5_886_012040640_3	8,843	801,371	90.6221