Task 11612413

Name	famous_u2z0_1899_200_006636695_5
Workunit	6840067
Created	21 Jul 2010, 5:58:21 UTC
Sent	21 Jul 2010, 6:26:06 UTC
Report deadline	20 Oct 2010, 13:53:17 UTC
Received	11 Aug 2010, 0:42:44 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	1067483
Run time	6 days 18 hours 50 min 33 sec
CPU time	5 days 2 hours 38 min 48 sec
Validate state	Invalid
Credit	1,852.98
Device peak FLOPS	1.11 GFLOPS
Application version	UK Met Office FAMOUS v6.11 i686-pc-linux-gnu
Stderr	<core_client_version>6.10.17</core_client_version> <![CDATA[ <message> process exited with code 22 (0x16, -234) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... (3687): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (3687): No heartbeat from core client for 30 sec - exiting (3687): No heartbeat from core client for 30 sec - exiting (3687): No heartbeat from core client for 30 sec - exiting (3687): No heartbeat from core client for 30 sec - exiting (3687): No heartbeat from core client for 30 sec - exiting (3687): No heartbeat from core client for 30 sec - exiting (3687): No heartbeat from core client for 30 sec - exiting (3687): No heartbeat from core client for 30 sec - exiting (3687): No heartbeat from core client for 30 sec - exiting (3687): No heartbeat from core client for 30 sec - exiting (3687): No heartbeat from core client for 30 sec - exiting (3687): No heartbeat from core client for 30 sec - exiting (3687): No heartbeat from core client for 30 sec - exiting (3687): No heartbeat from core client for 30 sec - exiting (3687): No heartbeat from core client for 30 sec - exiting (3687): No heartbeat from core client for 30 sec - exiting (3687): No heartbeat from core client for 30 sec - exiting (3687): No heartbeat from core client for 30 sec - exiting (3687): No heartbeat from core client for 30 sec - exiting (3687): No heartbeat from core client for 30 sec - exiting (3687): No heartbeat from core client for 30 sec - exiting (3687): No heartbeat from core client for 30 sec - exiting (3687): No heartbeat from core client for 30 sec - exiting (3687): No heartbeat from core client for 30 sec - exiting (3687): No heartbeat from core client for 30 sec - exiting (3687): No heartbeat from core client for 30 sec - exiting (3687): No heartbeat from core client for 30 sec - exiting (3687): No heartbeat from core client for 30 sec - exiting (3687): No heartbeat from core client for 30 sec - exiting (3687): No heartbeat from core client for 30 sec - exiting (3687): No heartbeat from core client for 30 sec - exiting (3687): No heartbeat from core client for 30 sec - exiting (3687): No heartbeat from core client for 30 sec - exiting (3687): No heartbeat from core client for 30 sec - exiting (7963): No heartbeat from core client for 30 sec - exiting (7963): No heartbeat from core client for 30 sec - exiting (7963): No heartbeat from core client for 30 sec - exiting (7963): No heartbeat from core client for 30 sec - exiting (7963): No heartbeat from core client for 30 sec - exiting (7963): No heartbeat from core client for 30 sec - exiting (7963): No heartbeat from core client for 30 sec - exiting (7963): No heartbeat from core client for 30 sec - exiting (7963): No heartbeat from core client for 30 sec - exiting (7963): No heartbeat from core client for 30 sec - exiting (7963): No heartbeat from core client for 30 sec - exiting (7963): No heartbeat from core client for 30 sec - exiting (7963): No heartbeat from core client for 30 sec - exiting (7963): No heartbeat from core client for 30 sec - exiting (7963): No heartbeat from core client for 30 sec - exiting (7963): No heartbeat from core client for 30 sec - exiting (7963): No heartbeat from core client for 30 sec - exiting (7963): No heartbeat from core client for 30 sec - exiting (7963): No heartbeat from core client for 30 sec - exiting (7963): No heartbeat from core client for 30 sec - exiting (7963): No heartbeat from core client for 30 sec - exiting (7963): No heartbeat from core client for 30 sec - exiting (7963): No heartbeat from core client for 30 sec - exiting (7963): No heartbeat from core client for 30 sec - exiting (7963): No heartbeat from core client for 30 sec - exiting (7963): No heartbeat from core client for 30 sec - exiting (7963): No heartbeat from core client for 30 sec - exiting (7963): No heartbeat from core client for 30 sec - exiting (7963): No heartbeat from core client for 30 sec - exiting (7963): No heartbeat from core client for 30 sec - exiting (7963): No heartbeat from core client for 30 sec - exiting (7963): No heartbeat from core client for 30 sec - exiting (7963): No heartbeat from core client for 30 sec - exiting (7963): No heartbeat from core client for 30 sec - exiting (7963): No heartbeat from core client for 30 sec - exiting (7963): No heartbeat from core client for 30 sec - exiting (7963): No heartbeat from core client for 30 sec - exiting (7963): No heartbeat from core client for 30 sec - exiting (7963): No heartbeat from core client for 30 sec - exiting (7963): No heartbeat from core client for 30 sec - exiting (7963): No heartbeat from core client for 30 sec - exiting (7963): No heartbeat from core client for 30 sec - exiting (7963): No heartbeat from core client for 30 sec - exiting (7963): No heartbeat from core client for 30 sec - exiting (7963): No heartbeat from core client for 30 sec - exiting (7963): No heartbeat from core client for 30 sec - exiting (7963): No heartbeat from core client for 30 sec - exiting (7963): No heartbeat from core client for 30 sec - exiting (7963): No heartbeat from core client for 30 sec - exiting (7963): No heartbeat from core client for 30 sec - exiting (7963): No heartbeat from core client for 30 sec - exiting (7963): No heartbeat from core client for 30 sec - exiting (7963): No heartbeat from core client for 30 sec - exiting (7963): No heartbeat from core client for 30 sec - exiting (7963): No heartbeat from core client for 30 sec - exiting (7963): No heartbeat from core client for 30 sec - exiting (7963): No heartbeat from core client for 30 sec - exiting (7963): No heartbeat from core client for 30 sec - exiting (7963): No heartbeat from core client for 30 sec - exiting (7963): No heartbeat from core client for 30 sec - exiting (7963): No heartbeat from core client for 30 sec - exiting (7963): No heartbeat from core client for 30 sec - exiting (7963): No heartbeat from core client for 30 sec - exiting (7963): No heartbeat from core client for 30 sec - exiting (7963): No heartbeat from core client for 30 sec - exiting (7963): No heartbeat from core client for 30 sec - exiting (7963): No heartbeat from core client for 30 sec - exiting (7963): No heartbeat from core client for 30 sec - exiting (7963): No heartbeat from core client for 30 sec - exiting (7963): No heartbeat from core client for 30 sec - exiting (7963): No heartbeat from core client for 30 sec - exiting (7963): No heartbeat from core client for 30 sec - exiting (7963): No heartbeat from core client for 30 sec - exiting (7963): No heartbeat from core client for 30 sec - exiting (7963): No heartbeat from core client for 30 sec - exiting (7963): No heartbeat from core client for 30 sec - exiting (7963): No heartbeat from core client for 30 sec - exiting (7963): No heartbeat from core client for 30 sec - exiting (7963): No heartbeat from core client for 30 sec - exiting (7963): No heartbeat from core client for 30 sec - exiting (7963): No heartbeat from core client for 30 sec - exiting (7963): No heartbeat from core client for 30 sec - exiting (7963): No heartbeat from core client for 30 sec - exiting (7963): No heartbeat from core client for 30 sec - exiting (7963): No heartbeat from core client for 30 sec - exiting (7963): No heartbeat from core client for 30 sec - exiting (7963): No heartbeat from core client for 30 sec - exiting (7963): No heartbeat from core client for 30 sec - exiting (7963): No heartbeat from core client for 30 sec - exiting (7963): No heartbeat from core client for 30 sec - exiting (7963): No heartbeat from core client for 30 sec - exiting (7963): No heartbeat from core client for 30 sec - exiting (7963): No heartbeat from core client for 30 sec - exiting (7963): No heartbeat from core client for 30 sec - exiting (7963): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (8187): No heartbeat from core client for 30 sec - exiting (8187): No heartbeat from core client for 30 sec - exiting (8187): No heartbeat from core client for 30 sec - exiting (8187): No heartbeat from core client for 30 sec - exiting (8187): No heartbeat from core client for 30 sec - exiting (8187): No heartbeat from core client for 30 sec - exiting (8187): No heartbeat from core client for 30 sec - exiting (8187): No heartbeat from core client for 30 sec - exiting (8187): No heartbeat from core client for 30 sec - exiting (8187): No heartbeat from core client for 30 sec - exiting (8187): No heartbeat from core client for 30 sec - exiting (8187): No heartbeat from core client for 30 sec - exiting (8187): No heartbeat from core client for 30 sec - exiting (8187): No heartbeat from core client for 30 sec - exiting (8187): No heartbeat from core client for 30 sec - exiting (8187): No heartbeat from core client for 30 sec - exiting (8187): No heartbeat from core client for 30 sec - exiting (8187): No heartbeat from core client for 30 sec - exiting (8187): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (8516): No heartbeat from core client for 30 sec - exiting (8516): No heartbeat from core client for 30 sec - exiting (8516): No heartbeat from core client for 30 sec - exiting (8516): No heartbeat from core client for 30 sec - exiting (8516): No heartbeat from core client for 30 sec - exiting (8516): No heartbeat from core client for 30 sec - exiting (8516): No heartbeat from core client for 30 sec - exiting (8516): No heartbeat from core client for 30 sec - exiting (8516): No heartbeat from core client for 30 sec - exiting (8516): No heartbeat from core client for 30 sec - exiting (8516): No heartbeat from core client for 30 sec - exiting (8516): No heartbeat from core client for 30 sec - exiting (8516): No heartbeat from core client for 30 sec - exiting (8516): No heartbeat from core client for 30 sec - exiting (8516): No heartbeat from core client for 30 sec - exiting (8516): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (8656): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... (6033): No heartbeat from core client for 30 sec - exiting (6033): No heartbeat from core client for 30 sec - exiting (6033): No heartbeat from core client for 30 sec - exiting (6033): No heartbeat from core client for 30 sec - exiting (6033): No heartbeat from core client for 30 sec - exiting (6033): No heartbeat from core client for 30 sec - exiting (6033): No heartbeat from core client for 30 sec - exiting (6033): No heartbeat from core client for 30 sec - exiting (6033): No heartbeat from core client for 30 sec - exiting (6033): No heartbeat from core client for 30 sec - exiting (6033): No heartbeat from core client for 30 sec - exiting (6033): No heartbeat from core client for 30 sec - exiting (6033): No heartbeat from core client for 30 sec - exiting (6033): No heartbeat from core client for 30 sec - exiting (6033): No heartbeat from core client for 30 sec - exiting (6033): No heartbeat from core client for 30 sec - exiting (6033): No heartbeat from core client for 30 sec - exiting (6033): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (6033): No heartbeat from core client for 30 sec - exiting (6033): No heartbeat from core client for 30 sec - exiting (6033): No heartbeat from core client for 30 sec - exiting (6033): No heartbeat from core client for 30 sec - exiting (6033): No heartbeat from core client for 30 sec - exiting (6033): No heartbeat from core client for 30 sec - exiting (6033): No heartbeat from core client for 30 sec - exiting (6033): No heartbeat from core client for 30 sec - exiting (6033): No heartbeat from core client for 30 sec - exiting (6033): No heartbeat from core client for 30 sec - exiting (6033): No heartbeat from core client for 30 sec - exiting (6033): No heartbeat from core client for 30 sec - exiting (6033): No heartbeat from core client for 30 sec - exiting (6033): No heartbeat from core client for 30 sec - exiting (6033): No heartbeat from core client for 30 sec - exiting (6033): No heartbeat from core client for 30 sec - exiting (6033): No heartbeat from core client for 30 sec - exiting (6033): No heartbeat from core client for 30 sec - exiting (6033): No heartbeat from core client for 30 sec - exiting (6033): No heartbeat from core client for 30 sec - exiting (6033): No heartbeat from core client for 30 sec - exiting (6033): No heartbeat from core client for 30 sec - exiting (6033): No heartbeat from core client for 30 sec - exiting (6033): No heartbeat from core client for 30 sec - exiting (6033): No heartbeat from core client for 30 sec - exiting (6033): No heartbeat from core client for 30 sec - exiting (6033): No heartbeat from core client for 30 sec - exiting (6033): No heartbeat from core client for 30 sec - exiting (6033): No heartbeat from core client for 30 sec - exiting (6033): No heartbeat from core client for 30 sec - exiting (6033): No heartbeat from core client for 30 sec - exiting (6033): No heartbeat from core client for 30 sec - exiting (6033): No heartbeat from core client for 30 sec - exiting no start tag in app init data (8084): Can't parse init data file - running in standalone mode no start tag in app init data (8084): Can't parse init data file - running in standalone mode Could not change to project directory (8084): called boinc_finish CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... (10416): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... no start tag in app init data (13968): Can't parse init data file - running in standalone mode no start tag in app init data (13968): Can't parse init data file - running in standalone mode Could not change to project directory (13968): called boinc_finish CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 60 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 61 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 68 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 69 - Return code = 1 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 60 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 61 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 68 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 69 - Return code = 1 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 60 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 61 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 68 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 69 - Return code = 1 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... forrtl: No space left on device forrtl: severe (38): error during write, unit 6, file /var/lib/boinc-client/projects/climateprediction.net/famous_u2z0_1899_200_006636695/dataout/stdout_um.txt Image PC Routine Line Source famous_um_6.11_i6 0840BA88 Unknown Unknown Unknown famous_um_6.11_i6 0840A221 Unknown Unknown Unknown famous_um_6.11_i6 083ED787 Unknown Unknown Unknown famous_um_6.11_i6 083BA000 Unknown Unknown Unknown famous_um_6.11_i6 083E03A1 Unknown Unknown Unknown famous_um_6.11_i6 08266191 Unknown Unknown Unknown famous_um_6.11_i6 082EFC2C Unknown Unknown Unknown famous_um_6.11_i6 08328714 Unknown Unknown Unknown famous_um_6.11_i6 08330BDF Unknown Unknown Unknown famous_um_6.11_i6 083415D2 Unknown Unknown Unknown libc.so.6 00126BD6 Unknown Unknown Unknown famous_um_6.11_i6 0804C041 Unknown Unknown Unknown Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=24428, iMonCtr=1 Model crash detected, will try to restart... no start tag in app init data (29591): Can't parse init data file - running in standalone mode forrtl: No space left on device forrtl: severe (38): error during write, unit 6, file /var/lib/boinc-client/projects/climateprediction.net/famous_u2z0_1899_200_006636695/dataout/stdout_um.txt Image PC Routine Line Source famous_um_6.11_i6 0840BA88 Unknown Unknown Unknown famous_um_6.11_i6 0840A221 Unknown Unknown Unknown famous_um_6.11_i6 083ED787 Unknown Unknown Unknown famous_um_6.11_i6 083BA000 Unknown Unknown Unknown famous_um_6.11_i6 083E043D Unknown Unknown Unknown famous_um_6.11_i6 08267F53 Unknown Unknown Unknown famous_um_6.11_i6 082EFC2C Unknown Unknown Unknown famous_um_6.11_i6 08328714 Unknown Unknown Unknown famous_um_6.11_i6 08330BDF Unknown Unknown Unknown famous_um_6.11_i6 083415D2 Unknown Unknown Unknown libc.so.6 00A1EBD6 Unknown Unknown Unknown famous_um_6.11_i6 0804C041 Unknown Unknown Unknown Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=24428, iMonCtr=1 Model crash detected, will try to restart... no start tag in app init data (24428): Can't parse init data file (24428): called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
05 Aug 2010 19:48:25	1067483	11612413	famous_u2z0_1899_200_006636695_5	561,626	440,765	0.7848
05 Aug 2010 15:49:30	1067483	11612413	famous_u2z0_1899_200_006636695_5	552,266	433,719	0.7853
05 Aug 2010 13:17:15	1067483	11612413	famous_u2z0_1899_200_006636695_5	542,906	426,722	0.7860
05 Aug 2010 10:15:35	1067483	11612413	famous_u2z0_1899_200_006636695_5	533,546	419,632	0.7865
05 Aug 2010 06:51:02	1067483	11612413	famous_u2z0_1899_200_006636695_5	524,186	412,188	0.7863
05 Aug 2010 04:52:38	1067483	11612413	famous_u2z0_1899_200_006636695_5	514,826	405,396	0.7874
05 Aug 2010 04:51:58	1067483	11612413	famous_u2z0_1899_200_006636695_5	505,466	398,569	0.7885
05 Aug 2010 00:42:41	1067483	11612413	famous_u2z0_1899_200_006636695_5	496,106	391,526	0.7892
04 Aug 2010 22:32:51	1067483	11612413	famous_u2z0_1899_200_006636695_5	486,746	384,166	0.7893
03 Aug 2010 16:23:26	1067483	11612413	famous_u2z0_1899_200_006636695_5	477,386	376,836	0.7894
03 Aug 2010 12:40:14	1067483	11612413	famous_u2z0_1899_200_006636695_5	468,026	369,636	0.7898
03 Aug 2010 08:26:06	1067483	11612413	famous_u2z0_1899_200_006636695_5	458,666	362,581	0.7905
03 Aug 2010 05:29:57	1067483	11612413	famous_u2z0_1899_200_006636695_5	449,306	355,872	0.7920
03 Aug 2010 03:19:56	1067483	11612413	famous_u2z0_1899_200_006636695_5	439,946	349,394	0.7942
02 Aug 2010 14:16:02	1067483	11612413	famous_u2z0_1899_200_006636695_5	430,586	342,843	0.7962
02 Aug 2010 10:04:43	1067483	11612413	famous_u2z0_1899_200_006636695_5	421,226	335,864	0.7973
02 Aug 2010 05:55:36	1067483	11612413	famous_u2z0_1899_200_006636695_5	411,866	328,848	0.7984
02 Aug 2010 03:20:35	1067483	11612413	famous_u2z0_1899_200_006636695_5	402,506	321,616	0.7990
01 Aug 2010 22:24:40	1067483	11612413	famous_u2z0_1899_200_006636695_5	393,146	314,179	0.7991
01 Aug 2010 16:36:29	1067483	11612413	famous_u2z0_1899_200_006636695_5	383,786	306,776	0.7993