Task 11621629

Name	famous_s31u_599_200_006668933_1
Workunit	6872187
Created	29 Jul 2010, 10:14:45 UTC
Sent	29 Jul 2010, 15:17:47 UTC
Report deadline	28 Oct 2010, 22:44:58 UTC
Received	27 Aug 2010, 9:40:19 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	1018267
Run time	4 days 19 hours 18 min 41 sec
CPU time	4 days 1 hours 4 min 28 sec
Validate state	Invalid
Credit	2,439.74
Device peak FLOPS	1.71 GFLOPS
Application version	UK Met Office FAMOUS v6.11 i686-pc-linux-gnu
Stderr	<core_client_version>6.10.45</core_client_version> <![CDATA[ <message> process exited with code 22 (0x16, -234) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 60 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 61 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 68 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 69 - Return code = 1 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... (1752): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 60 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 61 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 68 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 69 - Return code = 1 BUFFOUT: Write Failed: No space left on device BUFFOUT: C I/O Error - Return code = 1 Model crashed: WRITDUMP: BAD BUFFOUT OF DATA Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1776, iMonCtr=1 Model crash detected, will try to restart... forrtl: No space left on device forrtl: severe (38): error during write, unit 6, file /var/lib/boinc/projects/climateprediction.net/famous_s31u_599_200_006668933/dataout/stdout_um.txt Image PC Routine Line Source famous_um_6.11_i6 0840BA88 Unknown Unknown Unknown famous_um_6.11_i6 0840A221 Unknown Unknown Unknown famous_um_6.11_i6 083ED787 Unknown Unknown Unknown famous_um_6.11_i6 083BA000 Unknown Unknown Unknown famous_um_6.11_i6 083DF6B0 Unknown Unknown Unknown famous_um_6.11_i6 080F5531 Unknown Unknown Unknown famous_um_6.11_i6 0816C400 Unknown Unknown Unknown famous_um_6.11_i6 081756AB Unknown Unknown Unknown famous_um_6.11_i6 08325C74 Unknown Unknown Unknown famous_um_6.11_i6 08330BDF Unknown Unknown Unknown famous_um_6.11_i6 083415D2 Unknown Unknown Unknown libc.so.6 002DACC6 Unknown Unknown Unknown famous_um_6.11_i6 0804C041 Unknown Unknown Unknown Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1776, iMonCtr=1 Model crash detected, will try to restart... forrtl: No space left on device forrtl: severe (38): error during write, unit 6, file /var/lib/boinc/projects/climateprediction.net/famous_s31u_599_200_006668933/dataout/stdout_um.txt Image PC Routine Line Source famous_um_6.11_i6 0840BA88 Unknown Unknown Unknown famous_um_6.11_i6 0840A221 Unknown Unknown Unknown famous_um_6.11_i6 083ED787 Unknown Unknown Unknown famous_um_6.11_i6 083BA000 Unknown Unknown Unknown famous_um_6.11_i6 083DF6B0 Unknown Unknown Unknown famous_um_6.11_i6 083DDD57 Unknown Unknown Unknown famous_um_6.11_i6 080F5508 Unknown Unknown Unknown famous_um_6.11_i6 0816C400 Unknown Unknown Unknown famous_um_6.11_i6 081756AB Unknown Unknown Unknown famous_um_6.11_i6 08325C74 Unknown Unknown Unknown famous_um_6.11_i6 08330BDF Unknown Unknown Unknown famous_um_6.11_i6 083415D2 Unknown Unknown Unknown libc.so.6 002DACC6 Unknown Unknown Unknown famous_um_6.11_i6 0804C041 Unknown Unknown Unknown Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1776, iMonCtr=1 Model crash detected, will try to restart... Sorry, too many model crashes! :-( (1776): called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
25 Aug 2010 15:49:01	1018267	11621629	famous_s31u_599_200_006668933_1	739,466	347,840	0.4704
25 Aug 2010 12:15:42	1018267	11621629	famous_s31u_599_200_006668933_1	730,106	343,508	0.4705
25 Aug 2010 09:18:33	1018267	11621629	famous_s31u_599_200_006668933_1	720,746	339,186	0.4706
25 Aug 2010 07:42:33	1018267	11621629	famous_s31u_599_200_006668933_1	711,386	334,409	0.4701
24 Aug 2010 15:19:07	1018267	11621629	famous_s31u_599_200_006668933_1	702,026	329,848	0.4699
24 Aug 2010 13:54:10	1018267	11621629	famous_s31u_599_200_006668933_1	692,666	325,373	0.4697
24 Aug 2010 10:14:32	1018267	11621629	famous_s31u_599_200_006668933_1	683,306	320,899	0.4696
23 Aug 2010 16:38:00	1018267	11621629	famous_s31u_599_200_006668933_1	673,946	316,591	0.4698
23 Aug 2010 15:17:27	1018267	11621629	famous_s31u_599_200_006668933_1	664,586	312,294	0.4699
23 Aug 2010 13:58:17	1018267	11621629	famous_s31u_599_200_006668933_1	655,226	307,995	0.4701
23 Aug 2010 11:46:03	1018267	11621629	famous_s31u_599_200_006668933_1	645,866	303,692	0.4702
23 Aug 2010 08:49:46	1018267	11621629	famous_s31u_599_200_006668933_1	636,506	299,390	0.4704
20 Aug 2010 15:23:55	1018267	11621629	famous_s31u_599_200_006668933_1	627,146	294,933	0.4703
20 Aug 2010 13:52:10	1018267	11621629	famous_s31u_599_200_006668933_1	617,786	290,647	0.4705
20 Aug 2010 09:19:00	1018267	11621629	famous_s31u_599_200_006668933_1	608,426	286,359	0.4707
19 Aug 2010 15:50:55	1018267	11621629	famous_s31u_599_200_006668933_1	599,066	282,084	0.4709
19 Aug 2010 14:03:59	1018267	11621629	famous_s31u_599_200_006668933_1	589,706	277,759	0.4710
19 Aug 2010 12:39:03	1018267	11621629	famous_s31u_599_200_006668933_1	580,346	273,322	0.4710
19 Aug 2010 09:49:00	1018267	11621629	famous_s31u_599_200_006668933_1	570,986	269,006	0.4711
18 Aug 2010 15:39:00	1018267	11621629	famous_s31u_599_200_006668933_1	561,626	264,681	0.4713