Task 11624018

Name	famous_s3f4_599_200_006669411_0
Workunit	6872665
Created	29 Jul 2010, 10:23:54 UTC
Sent	30 Jul 2010, 3:19:54 UTC
Report deadline	29 Oct 2010, 10:47:05 UTC
Received	21 Sep 2010, 17:46:38 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	775148
Run time	14 days 16 hours 37 min 1 sec
CPU time	13 days 16 hours 26 min 57 sec
Validate state	Invalid
Credit	5,589.66
Device peak FLOPS	1.72 GFLOPS
Application version	UK Met Office FAMOUS v6.11 i686-pc-linux-gnu
Stderr	<core_client_version>6.10.17</core_client_version> <![CDATA[ <message> process exited with code 22 (0x16, -234) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 60 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 61 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 68 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 69 - Return code = 1 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 60 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 61 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 68 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 69 - Return code = 1 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 60 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 61 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 68 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 69 - Return code = 1 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 60 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 61 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 68 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 69 - Return code = 1 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... (22427): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (22427): No heartbeat from core client for 30 sec - exiting (27618): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (27618): No heartbeat from core client for 30 sec - exiting (27838): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (27838): No heartbeat from core client for 30 sec - exiting (28794): No heartbeat from core client for 30 sec - exiting (28794): No heartbeat from core client for 30 sec - exiting (28794): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (28794): No heartbeat from core client for 30 sec - exiting (28794): No heartbeat from core client for 30 sec - exiting (29050): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=29130, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=29130, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy Sorry, too many model crashes! :-( (12476): called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
20 Sep 2010 16:22:12	775148	11624018	famous_s3f4_599_200_006669411_0	1,694,186	1,177,305	0.6949
20 Sep 2010 14:36:40	775148	11624018	famous_s3f4_599_200_006669411_0	1,684,826	1,170,861	0.6949
19 Sep 2010 21:38:57	775148	11624018	famous_s3f4_599_200_006669411_0	1,675,466	1,164,400	0.6950
19 Sep 2010 19:45:39	775148	11624018	famous_s3f4_599_200_006669411_0	1,666,106	1,157,899	0.6950
19 Sep 2010 17:47:50	775148	11624018	famous_s3f4_599_200_006669411_0	1,656,746	1,151,378	0.6950
19 Sep 2010 15:53:08	775148	11624018	famous_s3f4_599_200_006669411_0	1,647,386	1,144,869	0.6950
18 Sep 2010 22:55:31	775148	11624018	famous_s3f4_599_200_006669411_0	1,638,026	1,138,372	0.6950
18 Sep 2010 21:04:39	775148	11624018	famous_s3f4_599_200_006669411_0	1,628,666	1,131,884	0.6950
18 Sep 2010 19:13:16	775148	11624018	famous_s3f4_599_200_006669411_0	1,619,306	1,125,387	0.6950
18 Sep 2010 17:17:59	775148	11624018	famous_s3f4_599_200_006669411_0	1,609,946	1,118,878	0.6950
18 Sep 2010 15:21:39	775148	11624018	famous_s3f4_599_200_006669411_0	1,600,586	1,112,379	0.6950
17 Sep 2010 22:24:58	775148	11624018	famous_s3f4_599_200_006669411_0	1,591,226	1,105,883	0.6950
17 Sep 2010 20:33:50	775148	11624018	famous_s3f4_599_200_006669411_0	1,581,866	1,099,384	0.6950
17 Sep 2010 18:41:58	775148	11624018	famous_s3f4_599_200_006669411_0	1,572,506	1,092,875	0.6950
17 Sep 2010 16:46:01	775148	11624018	famous_s3f4_599_200_006669411_0	1,563,146	1,086,360	0.6950
17 Sep 2010 14:53:02	775148	11624018	famous_s3f4_599_200_006669411_0	1,553,786	1,079,849	0.6950
16 Sep 2010 21:54:13	775148	11624018	famous_s3f4_599_200_006669411_0	1,544,426	1,073,339	0.6950
16 Sep 2010 19:57:59	775148	11624018	famous_s3f4_599_200_006669411_0	1,535,066	1,066,827	0.6950
16 Sep 2010 18:04:42	775148	11624018	famous_s3f4_599_200_006669411_0	1,525,706	1,060,308	0.6950
16 Sep 2010 16:10:57	775148	11624018	famous_s3f4_599_200_006669411_0	1,516,346	1,053,781	0.6949