Task 21841204

Name	hadam4_a0iw_209210_6_856_011962395_0
Workunit	11962395
Created	9 Dec 2019, 1:44:25 UTC
Sent	18 Dec 2019, 14:22:00 UTC
Report deadline	29 Nov 2020, 19:42:00 UTC
Received	31 Dec 2019, 15:13:52 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	1495246
Run time	4 days 8 hours 18 min 22 sec
CPU time	4 days 2 hours 8 min 19 sec
Validate state	Invalid
Credit	4,827.12
Device peak FLOPS	4.13 GFLOPS
Application version	UK Met Office HadAM4 at N144 resolution v8.09 i686-pc-linux-gnu
Peak working set size	627.89 MB
Peak swap size	650.50 MB
Peak disk usage	5.79 MB
Stderr	<core_client_version>7.9.3</core_client_version> <![CDATA[ <message> process exited with code 22 (0x16, -234)</message> <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Signal 15 received: Software termination signal from kill Signal 15 received: Abnormal termination triggered by abort call Signal 15 received, exiting... 00:07:28 (5504): called boinc_finish(193) Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Signal 2 received: Interrupt Signal 2 received: Illegal instruction - invalid function image Signal 2 received: Floating point exception Signal 2 received: Segment violation Signal 2 received: Software termination signal from kill Signal 2 received: Abnormal termination triggered by abort call Signal 2 received, exiting... 11:46:36 (4583): called boinc_finish(193) Signal 2 received: Interrupt Signal 2 received: Illegal instruction - invalid function image Signal 2 received: Floating point exception Signal 2 received: Segment violation Signal 2 received: Software termination signal from kill Signal 2 received: Abnormal termination triggered by abort call Signal 2 received, exiting... SIGSEGV: segmentation violation Stack trace (19 frames): ../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu(boinc_catch_signal+0x67)[0x80d4cf7] linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7f3f090] /lib/i386-linux-gnu/libc.so.6(getenv+0x99)[0xf7aa4a69] /lib/i386-linux-gnu/libc.so.6(+0xaf468)[0xf7b24468] /lib/i386-linux-gnu/libc.so.6(+0xaf835)[0xf7b24835] /lib/i386-linux-gnu/libc.so.6(localtime_r+0x12)[0xf7b22db2] ../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x80d01b2] ../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x80d0900] ../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x80d09f1] linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7f3f090] linux-gate.so.1(__kernel_vsyscall+0x9)[0xf7f3f079] /lib/i386-linux-gnu/libc.so.6(nanosleep+0x4b)[0xf7b341cb] /lib/i386-linux-gnu/libc.so.6(usleep+0x41)[0xf7b66be1] ../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x80e78a5] ../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x80503e8] ../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x8051b13] ../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x8051d8b] /lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf1)[0xf7a8de81] ../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x804cd21] Exiting... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 22:22:47 (3065): BOINC client no longer exists - exiting 22:22:47 (3065): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Signal 2 received: Interrupt Signal 2 received: Illegal instruction - invalid function image Signal 2 received: Floating point exception Signal 2 received: Segment violation Signal 2 received: Software termination signal from kill Signal 2 received: Abnormal termination triggered by abort call Signal 2 received, exiting... 03:03:54 (11197): called boinc_finish(193) Signal 2 received: Interrupt Signal 2 received: Illegal instruction - invalid function image Signal 2 received: Floating point exception Signal 2 received: Segment violation Signal 2 received: Software termination signal from kill Signal 2 received: Abnormal termination triggered by abort call Signal 2 received, exiting... SIGSEGV: segmentation violation Stack trace (19 frames): ../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu(boinc_catch_signal+0x67)[0x80d4cf7] linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7f43090] /lib/i386-linux-gnu/libc.so.6(getenv+0x99)[0xf7aa8a69] /lib/i386-linux-gnu/libc.so.6(+0xaf468)[0xf7b28468] /lib/i386-linux-gnu/libc.so.6(+0xaf835)[0xf7b28835] /lib/i386-linux-gnu/libc.so.6(localtime_r+0x12)[0xf7b26db2] ../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x80d01b2] ../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x80d0900] ../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x80d09f1] linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7f43090] linux-gate.so.1(__kernel_vsyscall+0x9)[0xf7f43079] /lib/i386-linux-gnu/libc.so.6(nanosleep+0x4b)[0xf7b381cb] /lib/i386-linux-gnu/libc.so.6(usleep+0x41)[0xf7b6abe1] ../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x80e78a5] ../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x80503e8] ../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x8051b13] ../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x8051d8b] /lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf1)[0xf7a91e81] ../../projects/climateprediction.net/hadam4_8.09_i686-pc-linux-gnu[0x804cd21] Exiting... OPEN: File Open Failed: Permission denied OPEN: Unable to Open File dataout/a0iwga.pat3jan for Read/Write Model crashed: PPCTL : Error opening preassigned PPfile tmp/xnnuj.pipe_dummy OPEN: File Open Failed: Permission denied OPEN: Unable to Open File dataout/a0iwga.pat3jan for Read/Write Model crashed: PPCTL : Error opening preassigned PPfile tmp/xnnuj.pipe_dummy OPEN: File Open Failed: Permission denied OPEN: Unable to Open File dataout/a0iwga.pat3jan for Read/Write Model crashed: PPCTL : Error opening preassigned PPfile tmp/xnnuj.pipe_dummy OPEN: File Open Failed: Permission denied OPEN: Unable to Open File dataout/a0iwga.pat3jan for Read/Write Model crashed: PPCTL : Error opening preassigned PPfile tmp/xnnuj.pipe_dummy OPEN: File Open Failed: Permission denied OPEN: Unable to Open File dataout/a0iwga.pat3jan for Read/Write Model crashed: PPCTL : Error opening preassigned PPfile tmp/xnnuj.pipe_dummy Sorry, too many model crashes! :-( 16:09:24 (4642): called boinc_finish(22) </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
29 Dec 2019 20:39:45	1495246	21841204	hadam4_a0iw_209210_6_856_011962395_0	13,061	320,589	24.5455
23 Dec 2019 01:16:29	1495246	21841204	hadam4_a0iw_209210_6_856_011962395_0	8,741	215,363	24.6383
19 Dec 2019 21:59:57	1495246	21841204	hadam4_a0iw_209210_6_856_011962395_0	4,421	109,395	24.7444