Task 12483067

Name	famous_wllw_999_200_007105627_0
Workunit	7308799
Created	15 Jan 2011, 16:16:22 UTC
Sent	15 Jan 2011, 22:19:39 UTC
Report deadline	17 Apr 2011, 5:46:50 UTC
Received	10 Feb 2011, 17:46:46 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	989329
Run time	8 days 6 hours 44 min 6 sec
CPU time	6 days 15 hours 19 min
Validate state	Invalid
Credit	1,822.10
Device peak FLOPS	1.05 GFLOPS
Application version	UK Met Office FAMOUS v6.11 i686-pc-linux-gnu
Stderr	<core_client_version>6.10.17</core_client_version> <![CDATA[ <message> process exited with code 22 (0x16, -234) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... Signal 15 received, exiting... (1655): called boinc_finish CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 60 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 61 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 68 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 69 - Return code = 1 CPDN Monitor - Quit request from BOINC... BUFFIN: Read Failed: Inappropriate ioctl for device BUFFIN: C I/O Error feof - Unit 60 - Return code = 1 BUFFIN: Read Failed: Invalid argument BUFFIN: C I/O Error feof - Unit 61 - Return code = 1 BUFFIN: Read Failed: Invalid argument BUFFIN: C I/O Error feof - Unit 68 - Return code = 1 BUFFIN: Read Failed: Invalid argument BUFFIN: C I/O Error feof - Unit 69 - Return code = 1 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Signal 15 received, exiting... (1381): called boinc_finish CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Signal 15 received, exiting... (1338): called boinc_finish CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Signal 15 received, exiting... (1236): called boinc_finish Signal 15 received, exiting... (1730): called boinc_finish Signal 15 received, exiting... (1326): called boinc_finish SIGSEGV: segmentation violation Stack trace (7 frames): ../../projects/climateprediction.net/famous_6.11_i686-pc-linux-gnu(boinc_catch_signal+0x58)[0x809e59c] [0xbd1400] ../../projects/climateprediction.net/famous_6.11_i686-pc-linux-gnu[0x804f906] ../../projects/climateprediction.net/famous_6.11_i686-pc-linux-gnu[0x805085a] ../../projects/climateprediction.net/famous_6.11_i686-pc-linux-gnu[0x8050ad6] /lib/tls/i686/cmov/libc.so.6(__libc_start_main+0xe6)[0x126bd6] ../../projects/climateprediction.net/famous_6.11_i686-pc-linux-gnu(__gxx_personality_v0+0xe1)[0x804c449] Exiting... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Signal 15 received, exiting... (1256): called boinc_finish CPDN Monitor - Quit request from BOINC... Signal 15 received, exiting... (1297): called boinc_finish CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Signal 15 received, exiting... (1352): called boinc_finish CPDN Monitor - Quit request from BOINC... Signal 15 received, exiting... (1291): called boinc_finish CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Signal 15 received, exiting... (1310): called boinc_finish SIGSEGV: segmentation violation Stack trace (7 frames): ../../projects/climateprediction.net/famous_6.11_i686-pc-linux-gnu(boinc_catch_signal+0x58)[0x809e59c] [0x520400] ../../projects/climateprediction.net/famous_6.11_i686-pc-linux-gnu[0x804f906] ../../projects/climateprediction.net/famous_6.11_i686-pc-linux-gnu[0x805085a] ../../projects/climateprediction.net/famous_6.11_i686-pc-linux-gnu[0x8050ad6] /lib/tls/i686/cmov/libc.so.6(__libc_start_main+0xe6)[0x18cbd6] ../../projects/climateprediction.net/famous_6.11_i686-pc-linux-gnu(__gxx_personality_v0+0xe1)[0x804c449] Exiting... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Signal 15 received, exiting... (1300): called boinc_finish Signal 15 received, exiting... (1252): called boinc_finish SIGSEGV: segmentation violation Stack trace (7 frames): ../../projects/climateprediction.net/famous_6.11_i686-pc-linux-gnu(boinc_catch_signal+0x58)[0x809e59c] [0x326400] ../../projects/climateprediction.net/famous_6.11_i686-pc-linux-gnu[0x804f906] ../../projects/climateprediction.net/famous_6.11_i686-pc-linux-gnu[0x805085a] ../../projects/climateprediction.net/famous_6.11_i686-pc-linux-gnu[0x8050ad6] /lib/tls/i686/cmov/libc.so.6(__libc_start_main+0xe6)[0xe60bd6] ../../projects/climateprediction.net/famous_6.11_i686-pc-linux-gnu(__gxx_personality_v0+0xe1)[0x804c449] Exiting... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Signal 15 received, exiting... (1226): called boinc_finish Signal 15 received, exiting... (1322): called boinc_finish SIGSEGV: segmentation violation Stack trace (7 frames): ../../projects/climateprediction.net/famous_6.11_i686-pc-linux-gnu(boinc_catch_signal+0x58)[0x809e59c] [0x7fc400] ../../projects/climateprediction.net/famous_6.11_i686-pc-linux-gnu[0x804f906] ../../projects/climateprediction.net/famous_6.11_i686-pc-linux-gnu[0x805085a] ../../projects/climateprediction.net/famous_6.11_i686-pc-linux-gnu[0x8050ad6] /lib/tls/i686/cmov/libc.so.6(__libc_start_main+0xe6)[0xb61bd6] ../../projects/climateprediction.net/famous_6.11_i686-pc-linux-gnu(__gxx_personality_v0+0xe1)[0x804c449] Exiting... Signal 15 received, exiting... (1342): called boinc_finish SIGSEGV: segmentation violation Stack trace (7 frames): ../../projects/climateprediction.net/famous_6.11_i686-pc-linux-gnu(boinc_catch_signal+0x58)[0x809e59c] [0x7ec400] ../../projects/climateprediction.net/famous_6.11_i686-pc-linux-gnu[0x804f906] ../../projects/climateprediction.net/famous_6.11_i686-pc-linux-gnu[0x805085a] ../../projects/climateprediction.net/famous_6.11_i686-pc-linux-gnu[0x8050ad6] /lib/tls/i686/cmov/libc.so.6(__libc_start_main+0xe6)[0x337bd6] ../../projects/climateprediction.net/famous_6.11_i686-pc-linux-gnu(__gxx_personality_v0+0xe1)[0x804c449] Exiting... Signal 15 received, exiting... (1291): called boinc_finish SIGSEGV: segmentation violation Stack trace (7 frames): ../../projects/climateprediction.net/famous_6.11_i686-pc-linux-gnu(boinc_catch_signal+0x58)[0x809e59c] [0x12c400] ../../projects/climateprediction.net/famous_6.11_i686-pc-linux-gnu[0x804f906] ../../projects/climateprediction.net/famous_6.11_i686-pc-linux-gnu[0x805085a] ../../projects/climateprediction.net/famous_6.11_i686-pc-linux-gnu[0x8050ad6] /lib/tls/i686/cmov/libc.so.6(__libc_start_main+0xe6)[0x143bd6] ../../projects/climateprediction.net/famous_6.11_i686-pc-linux-gnu(__gxx_personality_v0+0xe1)[0x804c449] Exiting... Signal 15 received, exiting... (1397): called boinc_finish Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy Sorry, too many model crashes! :-( (1233): called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
10 Feb 2011 14:05:50	989329	12483067	famous_wllw_999_200_007105627_0	552,266	567,333	1.0273
10 Feb 2011 11:21:58	989329	12483067	famous_wllw_999_200_007105627_0	542,906	557,688	1.0272
10 Feb 2011 08:36:56	989329	12483067	famous_wllw_999_200_007105627_0	533,546	548,029	1.0271
09 Feb 2011 23:00:03	989329	12483067	famous_wllw_999_200_007105627_0	524,186	538,345	1.0270
08 Feb 2011 23:11:44	989329	12483067	famous_wllw_999_200_007105627_0	514,826	528,784	1.0271
08 Feb 2011 20:33:10	989329	12483067	famous_wllw_999_200_007105627_0	505,466	519,255	1.0273
08 Feb 2011 05:21:23	989329	12483067	famous_wllw_999_200_007105627_0	496,106	509,768	1.0275
08 Feb 2011 02:33:35	989329	12483067	famous_wllw_999_200_007105627_0	486,746	500,306	1.0279
06 Feb 2011 20:49:19	989329	12483067	famous_wllw_999_200_007105627_0	477,386	490,847	1.0282
05 Feb 2011 18:57:25	989329	12483067	famous_wllw_999_200_007105627_0	468,026	481,383	1.0285
05 Feb 2011 18:49:15	989329	12483067	famous_wllw_999_200_007105627_0	458,666	471,894	1.0288
05 Feb 2011 18:49:15	989329	12483067	famous_wllw_999_200_007105627_0	449,306	462,400	1.0291
04 Feb 2011 21:52:54	989329	12483067	famous_wllw_999_200_007105627_0	439,946	452,888	1.0294
04 Feb 2011 02:44:45	989329	12483067	famous_wllw_999_200_007105627_0	430,586	443,408	1.0298
04 Feb 2011 00:04:02	989329	12483067	famous_wllw_999_200_007105627_0	421,226	433,963	1.0302
03 Feb 2011 18:51:37	989329	12483067	famous_wllw_999_200_007105627_0	411,866	424,475	1.0306
03 Feb 2011 15:20:29	989329	12483067	famous_wllw_999_200_007105627_0	402,506	415,007	1.0311
03 Feb 2011 13:53:35	989329	12483067	famous_wllw_999_200_007105627_0	393,146	405,545	1.0315
03 Feb 2011 13:53:35	989329	12483067	famous_wllw_999_200_007105627_0	383,786	396,068	1.0320
03 Feb 2011 13:53:35	989329	12483067	famous_wllw_999_200_007105627_0	374,426	386,595	1.0325