Task 11690870

Name	famous_v0ce_1599_200_006686220_1
Workunit	6889473
Created	26 Aug 2010, 15:39:43 UTC
Sent	29 Aug 2010, 15:00:55 UTC
Report deadline	28 Nov 2010, 22:28:06 UTC
Received	16 Sep 2010, 11:55:25 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	1006326
Run time	3 days 2 hours 30 min 24 sec
CPU time	3 days 1 hours 24 min 34 sec
Validate state	Invalid
Credit	1,914.75
Device peak FLOPS	2.35 GFLOPS
Application version	UK Met Office FAMOUS v6.11 windows_intelx86
Stderr	<core_client_version>6.10.58</core_client_version> <![CDATA[ <message> The device does not recognize the command. (0x16) - exit code 22 (0x16) </message> <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 14:11:40 (5580): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 60 - Return code = 16 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 61 - Return code = 16 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 CPDN Monitor - Quit request from BOINC... BUFFIN: Read Failed: Result too large BUFFIN: C I/O Error feof - Unit 60 - Return code = 16 BUFFIN: Read Failed: Result too large BUFFIN: C I/O Error feof - Unit 61 - Return code = 16 BUFFIN: Read Failed: Result too large BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: Read Failed: Result too large BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 CPDN Monitor - Quit request from BOINC... BUFFIN: Read Failed: Result too large BUFFIN: C I/O Error feof - Unit 60 - Return code = 16 BUFFIN: Read Failed: Result too large BUFFIN: C I/O Error feof - Unit 61 - Return code = 16 BUFFIN: Read Failed: Result too large BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: Read Failed: Result too large BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 CPDN Monitor - Quit request from BOINC... BUFFIN: Read Failed: Result too large BUFFIN: C I/O Error feof - Unit 60 - Return code = 16 BUFFIN: Read Failed: Result too large BUFFIN: C I/O Error feof - Unit 61 - Return code = 16 BUFFIN: Read Failed: Result too large BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: Read Failed: Result too large BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=8632, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7144, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... 17:07:16 (5484): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7120, iMonCtr=1 Model crash detected, will try to restart... 05:08:32 (3280): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:08:36 (3280): No heartbeat from core client for 30 sec - exiting 05:08:37 (3280): No heartbeat from core client for 30 sec - exiting 05:10:05 (5092): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy Sorry, too many model crashes! :-( 07:47:30 (5052): called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
16 Sep 2010 12:04:17	1006326	11690870	famous_v0ce_1599_200_006686220_1	580,346	261,198	0.4501
15 Sep 2010 22:08:07	1006326	11690870	famous_v0ce_1599_200_006686220_1	570,986	257,089	0.4503
15 Sep 2010 20:59:11	1006326	11690870	famous_v0ce_1599_200_006686220_1	561,626	252,933	0.4504
15 Sep 2010 19:50:15	1006326	11690870	famous_v0ce_1599_200_006686220_1	552,266	248,744	0.4504
15 Sep 2010 18:39:14	1006326	11690870	famous_v0ce_1599_200_006686220_1	542,906	244,603	0.4505
15 Sep 2010 17:31:44	1006326	11690870	famous_v0ce_1599_200_006686220_1	533,546	240,434	0.4506
15 Sep 2010 16:21:10	1006326	11690870	famous_v0ce_1599_200_006686220_1	524,186	236,297	0.4508
15 Sep 2010 15:10:56	1006326	11690870	famous_v0ce_1599_200_006686220_1	514,826	232,117	0.4509
15 Sep 2010 15:04:37	1006326	11690870	famous_v0ce_1599_200_006686220_1	505,466	227,961	0.4510
15 Sep 2010 12:54:51	1006326	11690870	famous_v0ce_1599_200_006686220_1	496,106	223,828	0.4512
15 Sep 2010 11:46:14	1006326	11690870	famous_v0ce_1599_200_006686220_1	486,746	219,702	0.4514
12 Sep 2010 22:02:19	1006326	11690870	famous_v0ce_1599_200_006686220_1	477,386	215,529	0.4515
09 Sep 2010 07:55:44	1006326	11690870	famous_v0ce_1599_200_006686220_1	468,026	211,262	0.4514
09 Sep 2010 06:46:04	1006326	11690870	famous_v0ce_1599_200_006686220_1	458,666	207,135	0.4516
09 Sep 2010 05:32:18	1006326	11690870	famous_v0ce_1599_200_006686220_1	449,306	202,919	0.4516
09 Sep 2010 04:23:16	1006326	11690870	famous_v0ce_1599_200_006686220_1	439,946	198,727	0.4517
09 Sep 2010 03:09:45	1006326	11690870	famous_v0ce_1599_200_006686220_1	430,586	194,553	0.4518
09 Sep 2010 02:00:54	1006326	11690870	famous_v0ce_1599_200_006686220_1	421,226	190,339	0.4519
09 Sep 2010 00:43:41	1006326	11690870	famous_v0ce_1599_200_006686220_1	411,866	186,095	0.4518
08 Sep 2010 23:47:18	1006326	11690870	famous_v0ce_1599_200_006686220_1	402,506	181,874	0.4519