Task 11805108

Name	famous_vhz9_1599_200_006709067_4
Workunit	6912320
Created	26 Aug 2010, 17:02:15 UTC
Sent	11 Nov 2010, 11:31:24 UTC
Report deadline	10 Feb 2011, 18:58:35 UTC
Received	14 Dec 2010, 9:41:52 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	1112786
Run time	4 days 9 hours 7 min 43 sec
CPU time	4 days 2 hours 47 min 31 sec
Validate state	Invalid
Credit	2,655.91
Device peak FLOPS	2.90 GFLOPS
Application version	UK Met Office FAMOUS v6.11 windows_intelx86
Stderr	<core_client_version>6.10.58</core_client_version> <![CDATA[ <message> The device does not recognize the command. (0x16) - exit code 22 (0x16) </message> <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 60 - Return code = 16 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 61 - Return code = 16 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... BUFFOUT: Write Failed: Invalid argument BUFFOUT: C I/O Error - Return code = 32 Model crashed: WRITDUMP: BAD BUFFOUT OF DATA tmp/pipe_dummy 21:48:34 (6248): No heartbeat from core client for 30 sec - exiting 21:48:35 (6248): No heartbeat from core client for 30 sec - exiting 21:48:36 (6248): No heartbeat from core client for 30 sec - exiting 21:48:37 (6248): No heartbeat from core client for 30 sec - exiting 21:48:38 (6248): No heartbeat from core client for 30 sec - exiting 21:48:39 (6248): No heartbeat from core client for 30 sec - exiting 21:48:40 (6248): No heartbeat from core client for 30 sec - exiting 21:48:41 (6248): No heartbeat from core client for 30 sec - exiting 21:48:42 (6248): No heartbeat from core client for 30 sec - exiting 21:48:43 (6248): No heartbeat from core client for 30 sec - exiting 21:48:44 (6248): No heartbeat from core client for 30 sec - exiting 21:48:45 (6248): No heartbeat from core client for 30 sec - exiting 21:48:46 (6248): No heartbeat from core client for 30 sec - exiting 21:48:47 (6248): No heartbeat from core client for 30 sec - exiting 21:48:48 (6248): No heartbeat from core client for 30 sec - exiting 21:48:49 (6248): No heartbeat from core client for 30 sec - exiting 21:48:50 (6248): No heartbeat from core client for 30 sec - exiting 21:48:51 (6248): No heartbeat from core client for 30 sec - exiting 21:48:52 (6248): No heartbeat from core client for 30 sec - exiting 21:48:53 (6248): No heartbeat from core client for 30 sec - exiting 21:48:54 (6248): No heartbeat from core client for 30 sec - exiting 21:48:55 (6248): No heartbeat from core client for 30 sec - exiting 21:48:56 (6248): No heartbeat from core client for 30 sec - exiting 21:48:57 (6248): No heartbeat from core client for 30 sec - exiting 21:48:58 (6248): No heartbeat from core client for 30 sec - exiting 21:48:59 (6248): No heartbeat from core client for 30 sec - exiting 21:49:00 (6248): No heartbeat from core client for 30 sec - exiting 21:49:01 (6248): No heartbeat from core client for 30 sec - exiting 21:49:02 (6248): No heartbeat from core client for 30 sec - exiting 21:49:03 (6248): No heartbeat from core client for 30 sec - exiting 21:49:04 (6248): No heartbeat from core client for 30 sec - exiting 21:49:05 (6248): No heartbeat from core client for 30 sec - exiting 21:49:06 (6248): No heartbeat from core client for 30 sec - exiting 21:49:07 (6248): No heartbeat from core client for 30 sec - exiting 21:49:08 (6248): No heartbeat from core client for 30 sec - exiting 21:49:09 (6248): No heartbeat from core client for 30 sec - exiting 21:49:10 (6248): No heartbeat from core client for 30 sec - exiting 21:49:11 (6248): No heartbeat from core client for 30 sec - exiting 21:49:12 (6248): No heartbeat from core client for 30 sec - exiting 21:49:13 (6248): No heartbeat from core client for 30 sec - exiting 21:49:14 (6248): No heartbeat from core client for 30 sec - exiting 21:49:15 (6248): No heartbeat from core client for 30 sec - exiting 21:49:16 (6248): No heartbeat from core client for 30 sec - exiting 21:49:17 (6248): No heartbeat from core client for 30 sec - exiting 21:49:18 (6248): No heartbeat from core client for 30 sec - exiting 21:49:19 (6248): No heartbeat from core client for 30 sec - exiting 21:49:20 (6248): No heartbeat from core client for 30 sec - exiting 21:49:21 (6248): No heartbeat from core client for 30 sec - exiting 21:49:22 (6248): No heartbeat from core client for 30 sec - exiting 21:49:23 (6248): No heartbeat from core client for 30 sec - exiting 21:49:24 (6248): No heartbeat from core client for 30 sec - exiting 21:49:25 (6248): No heartbeat from core client for 30 sec - exiting 21:49:26 (6248): No heartbeat from core client for 30 sec - exiting 21:49:27 (6248): No heartbeat from core client for 30 sec - exiting 21:49:28 (6248): No heartbeat from core client for 30 sec - exiting 21:49:29 (6248): No heartbeat from core client for 30 sec - exiting 21:49:30 (6248): No heartbeat from core client for 30 sec - exiting 21:49:31 (6248): No heartbeat from core client for 30 sec - exiting 21:49:32 (6248): No heartbeat from core client for 30 sec - exiting 21:49:33 (6248): No heartbeat from core client for 30 sec - exiting 21:49:34 (6248): No heartbeat from core client for 30 sec - exiting 21:49:35 (6248): No heartbeat from core client for 30 sec - exiting 21:49:36 (6248): No heartbeat from core client for 30 sec - exiting 21:49:37 (6248): No heartbeat from core client for 30 sec - exiting 21:49:38 (6248): No heartbeat from core client for 30 sec - exiting 21:49:39 (6248): No heartbeat from core client for 30 sec - exiting 21:49:40 (6248): No heartbeat from core client for 30 sec - exiting 21:49:41 (6248): No heartbeat from core client for 30 sec - exiting 21:49:42 (6248): No heartbeat from core client for 30 sec - exiting 21:49:43 (6248): No heartbeat from core client for 30 sec - exiting 21:49:44 (6248): No heartbeat from core client for 30 sec - exiting 21:49:45 (6248): No heartbeat from core client for 30 sec - exiting 21:49:46 (6248): No heartbeat from core client for 30 sec - exiting 21:49:47 (6248): No heartbeat from core client for 30 sec - exiting 21:49:48 (6248): No heartbeat from core client for 30 sec - exiting 21:49:49 (6248): No heartbeat from core client for 30 sec - exiting 21:49:50 (6248): No heartbeat from core client for 30 sec - exiting 21:49:51 (6248): No heartbeat from core client for 30 sec - exiting 21:49:52 (6248): No heartbeat from core client for 30 sec - exiting 21:49:53 (6248): No heartbeat from core client for 30 sec - exiting 21:49:54 (6248): No heartbeat from core client for 30 sec - exiting 21:49:55 (6248): No heartbeat from core client for 30 sec - exiting 21:49:56 (6248): No heartbeat from core client for 30 sec - exiting 21:49:57 (6248): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6816, iMonCtr=1 Model crash detected, will try to restart... 23:27:08 (5564): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 60 - Return code = 16 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 61 - Return code = 16 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 02:07:59 (1284): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:08:01 (1284): No heartbeat from core client for 30 sec - exiting 02:09:09 (5564): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... BUFFOUT: Write Failed: Invalid argument BUFFOUT: C I/O Error - Return code = 32 Model crashed: WRITDUMP: BAD BUFFOUT OF DATA tmp/pipe_dummy Signal 11 received, exiting... 02:44:52 (4856): called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1284, iMonCtr=1 Model crash detected, will try to restart... Signal 11 received, exiting... 02:44:58 (1332): called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1284, iMonCtr=1 Model crash detected, will try to restart... Signal 11 received, exiting... 02:45:04 (2736): called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1284, iMonCtr=1 Model crash detected, will try to restart... Signal 11 received, exiting... 02:45:08 (3300): called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1284, iMonCtr=1 Model crash detected, will try to restart... Signal 11 received, exiting... 02:45:13 (1012): called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1284, iMonCtr=1 Model crash detected, will try to restart... Sorry, too many model crashes! :-( 02:45:19 (1284): called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
14 Dec 2010 09:47:18	1112786	11805108	famous_vhz9_1599_200_006709067_4	804,986	354,176	0.4400
14 Dec 2010 00:56:43	1112786	11805108	famous_vhz9_1599_200_006709067_4	795,626	349,800	0.4397
13 Dec 2010 23:32:03	1112786	11805108	famous_vhz9_1599_200_006709067_4	786,266	345,278	0.4391
13 Dec 2010 22:10:16	1112786	11805108	famous_vhz9_1599_200_006709067_4	776,906	340,858	0.4387
13 Dec 2010 20:50:57	1112786	11805108	famous_vhz9_1599_200_006709067_4	767,546	336,318	0.4382
13 Dec 2010 19:24:58	1112786	11805108	famous_vhz9_1599_200_006709067_4	758,186	331,850	0.4377
13 Dec 2010 18:27:37	1112786	11805108	famous_vhz9_1599_200_006709067_4	748,826	327,441	0.4373
13 Dec 2010 16:42:22	1112786	11805108	famous_vhz9_1599_200_006709067_4	739,466	323,164	0.4370
13 Dec 2010 15:13:50	1112786	11805108	famous_vhz9_1599_200_006709067_4	730,106	318,649	0.4364
13 Dec 2010 13:47:54	1112786	11805108	famous_vhz9_1599_200_006709067_4	720,746	314,251	0.4360
13 Dec 2010 12:22:19	1112786	11805108	famous_vhz9_1599_200_006709067_4	711,386	309,795	0.4355
13 Dec 2010 11:50:46	1112786	11805108	famous_vhz9_1599_200_006709067_4	702,026	305,455	0.4351
13 Dec 2010 11:50:46	1112786	11805108	famous_vhz9_1599_200_006709067_4	692,666	300,897	0.4344
13 Dec 2010 11:50:46	1112786	11805108	famous_vhz9_1599_200_006709067_4	683,306	296,444	0.4338
13 Dec 2010 11:50:46	1112786	11805108	famous_vhz9_1599_200_006709067_4	673,946	291,982	0.4332
13 Dec 2010 11:50:46	1112786	11805108	famous_vhz9_1599_200_006709067_4	664,586	287,573	0.4327
12 Dec 2010 23:56:40	1112786	11805108	famous_vhz9_1599_200_006709067_4	655,226	283,267	0.4323
12 Dec 2010 22:41:11	1112786	11805108	famous_vhz9_1599_200_006709067_4	645,866	279,181	0.4323
12 Dec 2010 21:37:39	1112786	11805108	famous_vhz9_1599_200_006709067_4	636,506	275,305	0.4325
12 Dec 2010 20:29:30	1112786	11805108	famous_vhz9_1599_200_006709067_4	627,146	271,383	0.4327