Task 17794298

Name	hadam3pm2_k2ab_1959_10_009464190_0
Workunit	9546424
Created	15 Jan 2015, 15:33:06 UTC
Sent	30 Jan 2015, 19:48:22 UTC
Report deadline	13 Jan 2016, 1:08:22 UTC
Received	18 Feb 2015, 6:57:45 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	1223602
Run time	3 days 17 hours 25 min 34 sec
CPU time	3 days 16 hours 59 min 31 sec
Validate state	Invalid
Credit	5,157.88
Device peak FLOPS	3.95 GFLOPS
Application version	UK Met Office HadAM3P (global only) with MOSES II landsurface scheme v7.03 i686-pc-linux-gnu
Stderr	<core_client_version>7.1.0</core_client_version> <![CDATA[ <message> process exited with code 22 (0x16, -234) </message> <stderr_txt> Signal 2 received, exiting... 18:14:52 (17383): called boinc_finish Signal 2 received, exiting... 18:14:52 (17363): called boinc_finish Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... SIGSEGV: segmentation violation Stack trace (13 frames): /usr/local/ondrejch/BOINC/projects/climateprediction.net/hadam3pm2_um_7.03_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x83bccdf] [0xf0f1ebc0] /usr/local/ondrejch/BOINC/projects/climateprediction.net/hadam3pm2_um_7.03_i686-pc-linux-gnu[0x8165b39] /usr/local/ondrejch/BOINC/projects/climateprediction.net/hadam3pm2_um_7.03_i686-pc-linux-gnu[0x816b8f8] /usr/local/ondrejch/BOINC/projects/climateprediction.net/hadam3pm2_um_7.03_i686-pc-linux-gnu[0x8162a76] /usr/local/ondrejch/BOINC/projects/climateprediction.net/hadam3pm2_um_7.03_i686-pc-linux-gnu[0x816d014] /usr/local/ondrejch/BOINC/projects/climateprediction.net/hadam3pm2_um_7.03_i686-pc-linux-gnu[0x8161751] /usr/local/ondrejch/BOINC/projects/climateprediction.net/hadam3pm2_um_7.03_i686-pc-linux-gnu[0x8085677] /usr/local/ondrejch/BOINC/projects/climateprediction.net/hadam3pm2_um_7.03_i686-pc-linux-gnu[0x8094c0a] /usr/local/ondrejch/BOINC/projects/climateprediction.net/hadam3pm2_um_7.03_i686-pc-linux-gnu[0x831e514] /usr/local/ondrejch/BOINC/projects/climateprediction.net/hadam3pm2_um_7.03_i686-pc-linux-gnu[0x83205f9] /usr/local/ondrejch/BOINC/projects/climateprediction.net/hadam3pm2_um_7.03_i686-pc-linux-gnu[0x834c82d] /usr/lib/libc.so.6(__libc_start_main+0xde)[0xf0cf7e7e] Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=895, iMonCtr=1 Model crash detected, will try to restart... SIGSEGV: segmentation violation Stack trace (13 frames): /usr/local/ondrejch/BOINC/projects/climateprediction.net/hadam3pm2_um_7.03_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x83bccdf] [0xf0fd4bc0] /usr/local/ondrejch/BOINC/projects/climateprediction.net/hadam3pm2_um_7.03_i686-pc-linux-gnu[0x8165b39] /usr/local/ondrejch/BOINC/projects/climateprediction.net/hadam3pm2_um_7.03_i686-pc-linux-gnu[0x816b8f8] /usr/local/ondrejch/BOINC/projects/climateprediction.net/hadam3pm2_um_7.03_i686-pc-linux-gnu[0x8162a76] /usr/local/ondrejch/BOINC/projects/climateprediction.net/hadam3pm2_um_7.03_i686-pc-linux-gnu[0x816d014] /usr/local/ondrejch/BOINC/projects/climateprediction.net/hadam3pm2_um_7.03_i686-pc-linux-gnu[0x8161751] /usr/local/ondrejch/BOINC/projects/climateprediction.net/hadam3pm2_um_7.03_i686-pc-linux-gnu[0x8085677] /usr/local/ondrejch/BOINC/projects/climateprediction.net/hadam3pm2_um_7.03_i686-pc-linux-gnu[0x8094c0a] /usr/local/ondrejch/BOINC/projects/climateprediction.net/hadam3pm2_um_7.03_i686-pc-linux-gnu[0x831e514] /usr/local/ondrejch/BOINC/projects/climateprediction.net/hadam3pm2_um_7.03_i686-pc-linux-gnu[0x83205f9] /usr/local/ondrejch/BOINC/projects/climateprediction.net/hadam3pm2_um_7.03_i686-pc-linux-gnu[0x834c82d] /usr/lib/libc.so.6(__libc_start_main+0xde)[0xf0dade7e] Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=895, iMonCtr=1 Model crash detected, will try to restart... SIGSEGV: segmentation violation Stack trace (13 frames): /usr/local/ondrejch/BOINC/projects/climateprediction.net/hadam3pm2_um_7.03_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x83bccdf] [0xf0f0dbc0] /usr/local/ondrejch/BOINC/projects/climateprediction.net/hadam3pm2_um_7.03_i686-pc-linux-gnu[0x8165b39] /usr/local/ondrejch/BOINC/projects/climateprediction.net/hadam3pm2_um_7.03_i686-pc-linux-gnu[0x816b8f8] /usr/local/ondrejch/BOINC/projects/climateprediction.net/hadam3pm2_um_7.03_i686-pc-linux-gnu[0x8162a76] /usr/local/ondrejch/BOINC/projects/climateprediction.net/hadam3pm2_um_7.03_i686-pc-linux-gnu[0x816d014] /usr/local/ondrejch/BOINC/projects/climateprediction.net/hadam3pm2_um_7.03_i686-pc-linux-gnu[0x8161751] /usr/local/ondrejch/BOINC/projects/climateprediction.net/hadam3pm2_um_7.03_i686-pc-linux-gnu[0x8085677] /usr/local/ondrejch/BOINC/projects/climateprediction.net/hadam3pm2_um_7.03_i686-pc-linux-gnu[0x8094c0a] /usr/local/ondrejch/BOINC/projects/climateprediction.net/hadam3pm2_um_7.03_i686-pc-linux-gnu[0x831e514] /usr/local/ondrejch/BOINC/projects/climateprediction.net/hadam3pm2_um_7.03_i686-pc-linux-gnu[0x83205f9] /usr/local/ondrejch/BOINC/projects/climateprediction.net/hadam3pm2_um_7.03_i686-pc-linux-gnu[0x834c82d] /usr/lib/libc.so.6(__libc_start_main+0xde)[0xf0ce6e7e] Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=895, iMonCtr=1 Model crash detected, will try to restart... SIGSEGV: segmentation violation Stack trace (13 frames): /usr/local/ondrejch/BOINC/projects/climateprediction.net/hadam3pm2_um_7.03_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x83bccdf] [0xf0f45bc0] /usr/local/ondrejch/BOINC/projects/climateprediction.net/hadam3pm2_um_7.03_i686-pc-linux-gnu[0x8165b39] /usr/local/ondrejch/BOINC/projects/climateprediction.net/hadam3pm2_um_7.03_i686-pc-linux-gnu[0x816b8f8] /usr/local/ondrejch/BOINC/projects/climateprediction.net/hadam3pm2_um_7.03_i686-pc-linux-gnu[0x8162a76] /usr/local/ondrejch/BOINC/projects/climateprediction.net/hadam3pm2_um_7.03_i686-pc-linux-gnu[0x816d014] /usr/local/ondrejch/BOINC/projects/climateprediction.net/hadam3pm2_um_7.03_i686-pc-linux-gnu[0x8161751] /usr/local/ondrejch/BOINC/projects/climateprediction.net/hadam3pm2_um_7.03_i686-pc-linux-gnu[0x8085677] /usr/local/ondrejch/BOINC/projects/climateprediction.net/hadam3pm2_um_7.03_i686-pc-linux-gnu[0x8094c0a] /usr/local/ondrejch/BOINC/projects/climateprediction.net/hadam3pm2_um_7.03_i686-pc-linux-gnu[0x831e514] /usr/local/ondrejch/BOINC/projects/climateprediction.net/hadam3pm2_um_7.03_i686-pc-linux-gnu[0x83205f9] /usr/local/ondrejch/BOINC/projects/climateprediction.net/hadam3pm2_um_7.03_i686-pc-linux-gnu[0x834c82d] /usr/lib/libc.so.6(__libc_start_main+0xde)[0xf0d1ee7e] Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=895, iMonCtr=1 Model crash detected, will try to restart... SIGSEGV: segmentation violation Stack trace (13 frames): /usr/local/ondrejch/BOINC/projects/climateprediction.net/hadam3pm2_um_7.03_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x83bccdf] [0xf0fd4bc0] /usr/local/ondrejch/BOINC/projects/climateprediction.net/hadam3pm2_um_7.03_i686-pc-linux-gnu[0x8165b39] /usr/local/ondrejch/BOINC/projects/climateprediction.net/hadam3pm2_um_7.03_i686-pc-linux-gnu[0x816b8f8] /usr/local/ondrejch/BOINC/projects/climateprediction.net/hadam3pm2_um_7.03_i686-pc-linux-gnu[0x8162a76] /usr/local/ondrejch/BOINC/projects/climateprediction.net/hadam3pm2_um_7.03_i686-pc-linux-gnu[0x816d014] /usr/local/ondrejch/BOINC/projects/climateprediction.net/hadam3pm2_um_7.03_i686-pc-linux-gnu[0x8161751] /usr/local/ondrejch/BOINC/projects/climateprediction.net/hadam3pm2_um_7.03_i686-pc-linux-gnu[0x8085677] /usr/local/ondrejch/BOINC/projects/climateprediction.net/hadam3pm2_um_7.03_i686-pc-linux-gnu[0x8094c0a] /usr/local/ondrejch/BOINC/projects/climateprediction.net/hadam3pm2_um_7.03_i686-pc-linux-gnu[0x831e514] /usr/local/ondrejch/BOINC/projects/climateprediction.net/hadam3pm2_um_7.03_i686-pc-linux-gnu[0x83205f9] /usr/local/ondrejch/BOINC/projects/climateprediction.net/hadam3pm2_um_7.03_i686-pc-linux-gnu[0x834c82d] /usr/lib/libc.so.6(__libc_start_main+0xde)[0xf0dade7e] Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=895, iMonCtr=1 Model crash detected, will try to restart... SIGSEGV: segmentation violation Stack trace (13 frames): /usr/local/ondrejch/BOINC/projects/climateprediction.net/hadam3pm2_um_7.03_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x83bccdf] [0xf0f16bc0] /usr/local/ondrejch/BOINC/projects/climateprediction.net/hadam3pm2_um_7.03_i686-pc-linux-gnu[0x8165b39] /usr/local/ondrejch/BOINC/projects/climateprediction.net/hadam3pm2_um_7.03_i686-pc-linux-gnu[0x816b8f8] /usr/local/ondrejch/BOINC/projects/climateprediction.net/hadam3pm2_um_7.03_i686-pc-linux-gnu[0x8162a76] /usr/local/ondrejch/BOINC/projects/climateprediction.net/hadam3pm2_um_7.03_i686-pc-linux-gnu[0x816d014] /usr/local/ondrejch/BOINC/projects/climateprediction.net/hadam3pm2_um_7.03_i686-pc-linux-gnu[0x8161751] /usr/local/ondrejch/BOINC/projects/climateprediction.net/hadam3pm2_um_7.03_i686-pc-linux-gnu[0x8085677] /usr/local/ondrejch/BOINC/projects/climateprediction.net/hadam3pm2_um_7.03_i686-pc-linux-gnu[0x8094c0a] /usr/local/ondrejch/BOINC/projects/climateprediction.net/hadam3pm2_um_7.03_i686-pc-linux-gnu[0x831e514] /usr/local/ondrejch/BOINC/projects/climateprediction.net/hadam3pm2_um_7.03_i686-pc-linux-gnu[0x83205f9] /usr/local/ondrejch/BOINC/projects/climateprediction.net/hadam3pm2_um_7.03_i686-pc-linux-gnu[0x834c82d] /usr/lib/libc.so.6(__libc_start_main+0xde)[0xf0cefe7e] Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=895, iMonCtr=1 Model crash detected, will try to restart... Sorry, too many model crashes! :-( 17:13:19 (895): called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
10 Feb 2015 02:18:58	1223602	17794298	hadam3pm2_k2ab_1959_10_009464190_0	178,628	319,982	1.7913
10 Feb 2015 01:17:50	1223602	17794298	hadam3pm2_k2ab_1959_10_009464190_0	175,748	316,528	1.8010
08 Feb 2015 19:36:32	1223602	17794298	hadam3pm2_k2ab_1959_10_009464190_0	146,948	272,708	1.8558
08 Feb 2015 17:36:01	1223602	17794298	hadam3pm2_k2ab_1959_10_009464190_0	144,068	266,856	1.8523
08 Feb 2015 15:30:34	1223602	17794298	hadam3pm2_k2ab_1959_10_009464190_0	141,188	261,105	1.8493
07 Feb 2015 19:44:20	1223602	17794298	hadam3pm2_k2ab_1959_10_009464190_0	109,508	202,682	1.8508
07 Feb 2015 17:43:53	1223602	17794298	hadam3pm2_k2ab_1959_10_009464190_0	106,628	196,933	1.8469
07 Feb 2015 00:09:14	1223602	17794298	hadam3pm2_k2ab_1959_10_009464190_0	77,828	143,282	1.8410
06 Feb 2015 23:09:01	1223602	17794298	hadam3pm2_k2ab_1959_10_009464190_0	74,948	137,798	1.8386
06 Feb 2015 21:03:26	1223602	17794298	hadam3pm2_k2ab_1959_10_009464190_0	72,068	132,483	1.8383
04 Feb 2015 07:34:55	1223602	17794298	hadam3pm2_k2ab_1959_10_009464190_0	51,908	95,360	1.8371
04 Feb 2015 05:34:15	1223602	17794298	hadam3pm2_k2ab_1959_10_009464190_0	49,028	89,960	1.8349
04 Feb 2015 04:33:49	1223602	17794298	hadam3pm2_k2ab_1959_10_009464190_0	46,148	84,848	1.8386
04 Feb 2015 02:42:37	1223602	17794298	hadam3pm2_k2ab_1959_10_009464190_0	43,268	79,612	1.8400
04 Feb 2015 01:31:02	1223602	17794298	hadam3pm2_k2ab_1959_10_009464190_0	40,388	74,333	1.8405
04 Feb 2015 00:30:40	1223602	17794298	hadam3pm2_k2ab_1959_10_009464190_0	37,508	69,078	1.8417
03 Feb 2015 06:59:50	1223602	17794298	hadam3pm2_k2ab_1959_10_009464190_0	14,468	26,095	1.8036
03 Feb 2015 05:59:32	1223602	17794298	hadam3pm2_k2ab_1959_10_009464190_0	11,588	20,792	1.7943
03 Feb 2015 03:48:22	1223602	17794298	hadam3pm2_k2ab_1959_10_009464190_0	8,708	15,466	1.7761
03 Feb 2015 02:47:30	1223602	17794298	hadam3pm2_k2ab_1959_10_009464190_0	5,828	10,310	1.7690