Task 12359242

Name	famous_vbsx_1799_200_006701063_5
Workunit	6904316
Created	3 Dec 2010, 16:01:47 UTC
Sent	3 Dec 2010, 16:04:45 UTC
Report deadline	4 Mar 2011, 23:31:56 UTC
Received	5 Dec 2010, 16:47:11 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	1108612
Run time	1 days 22 hours 58 min 47 sec
CPU time	1 days 16 hours 41 min 32 sec
Validate state	Invalid
Credit	1,173.59
Device peak FLOPS	2.60 GFLOPS
Application version	UK Met Office FAMOUS v6.11 windows_intelx86
Stderr	<core_client_version>6.10.58</core_client_version> <![CDATA[ <message> The device does not recognize the command. (0x16) - exit code 22 (0x16) </message> <stderr_txt> 17:08:20 (1576): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:08:21 (1576): No heartbeat from core client for 30 sec - exiting 17:08:22 (1576): No heartbeat from core client for 30 sec - exiting 17:08:23 (1576): No heartbeat from core client for 30 sec - exiting 17:08:24 (1576): No heartbeat from core client for 30 sec - exiting 17:08:25 (1576): No heartbeat from core client for 30 sec - exiting 17:08:26 (1576): No heartbeat from core client for 30 sec - exiting 17:08:27 (1576): No heartbeat from core client for 30 sec - exiting 17:08:28 (1576): No heartbeat from core client for 30 sec - exiting 17:08:29 (1576): No heartbeat from core client for 30 sec - exiting 17:08:30 (1576): No heartbeat from core client for 30 sec - exiting 17:09:37 (3216): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:09:38 (3216): No heartbeat from core client for 30 sec - exiting 17:09:39 (3216): No heartbeat from core client for 30 sec - exiting 17:09:40 (3216): No heartbeat from core client for 30 sec - exiting 17:09:41 (3216): No heartbeat from core client for 30 sec - exiting 17:09:42 (3216): No heartbeat from core client for 30 sec - exiting 17:09:43 (3216): No heartbeat from core client for 30 sec - exiting 17:09:44 (3216): No heartbeat from core client for 30 sec - exiting 17:09:45 (3216): No heartbeat from core client for 30 sec - exiting 17:09:46 (3216): No heartbeat from core client for 30 sec - exiting 17:09:47 (3216): No heartbeat from core client for 30 sec - exiting 00:18:05 (3592): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:30:30 (1480): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 60 - Return code = 16 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 61 - Return code = 16 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 05:03:31 (3084): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:03:32 (3084): No heartbeat from core client for 30 sec - exiting 05:03:33 (3084): No heartbeat from core client for 30 sec - exiting 05:03:34 (3084): No heartbeat from core client for 30 sec - exiting 05:03:35 (3084): No heartbeat from core client for 30 sec - exiting 05:03:36 (3084): No heartbeat from core client for 30 sec - exiting 05:03:37 (3084): No heartbeat from core client for 30 sec - exiting 05:03:38 (3084): No heartbeat from core client for 30 sec - exiting 05:03:39 (3084): No heartbeat from core client for 30 sec - exiting 05:03:40 (3084): No heartbeat from core client for 30 sec - exiting 05:03:41 (3084): No heartbeat from core client for 30 sec - exiting 06:47:50 (2520): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:47:51 (2520): No heartbeat from core client for 30 sec - exiting 06:47:52 (2520): No heartbeat from core client for 30 sec - exiting 06:47:53 (2520): No heartbeat from core client for 30 sec - exiting 06:47:54 (2520): No heartbeat from core client for 30 sec - exiting 06:47:55 (2520): No heartbeat from core client for 30 sec - exiting 06:47:56 (2520): No heartbeat from core client for 30 sec - exiting 06:47:57 (2520): No heartbeat from core client for 30 sec - exiting 06:47:58 (2520): No heartbeat from core client for 30 sec - exiting 06:47:59 (2520): No heartbeat from core client for 30 sec - exiting 06:48:00 (2520): No heartbeat from core client for 30 sec - exiting 07:41:47 (3760): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:41:48 (3760): No heartbeat from core client for 30 sec - exiting 07:41:49 (3760): No heartbeat from core client for 30 sec - exiting 07:41:50 (3760): No heartbeat from core client for 30 sec - exiting 07:41:51 (3760): No heartbeat from core client for 30 sec - exiting 07:41:52 (3760): No heartbeat from core client for 30 sec - exiting 07:41:53 (3760): No heartbeat from core client for 30 sec - exiting 07:41:54 (3760): No heartbeat from core client for 30 sec - exiting 07:41:55 (3760): No heartbeat from core client for 30 sec - exiting 07:41:57 (3760): No heartbeat from core client for 30 sec - exiting 07:41:58 (3760): No heartbeat from core client for 30 sec - exiting 07:49:12 (3660): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:44:20 (3564): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:19:59 (3080): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:20:00 (3080): No heartbeat from core client for 30 sec - exiting 14:12:27 (3984): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:12:28 (3984): No heartbeat from core client for 30 sec - exiting 14:12:29 (3984): No heartbeat from core client for 30 sec - exiting 14:12:30 (3984): No heartbeat from core client for 30 sec - exiting 14:12:31 (3984): No heartbeat from core client for 30 sec - exiting BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 60 - Return code = 16 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 61 - Return code = 16 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 14:15:07 (2616): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... BUFFIN: Read Failed: Result too large BUFFIN: C I/O Error feof - Unit 60 - Return code = 16 BUFFIN: Read Failed: Result too large BUFFIN: C I/O Error feof - Unit 61 - Return code = 16 BUFFIN: Read Failed: Result too large BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: Read Failed: Result too large BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 16:54:41 (588): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:54:42 (588): No heartbeat from core client for 30 sec - exiting 16:54:43 (588): No heartbeat from core client for 30 sec - exiting 16:54:44 (588): No heartbeat from core client for 30 sec - exiting 16:54:45 (588): No heartbeat from core client for 30 sec - exiting 16:54:46 (588): No heartbeat from core client for 30 sec - exiting 16:54:47 (588): No heartbeat from core client for 30 sec - exiting 16:54:48 (588): No heartbeat from core client for 30 sec - exiting 16:54:49 (588): No heartbeat from core client for 30 sec - exiting 16:54:50 (588): No heartbeat from core client for 30 sec - exiting 16:54:51 (588): No heartbeat from core client for 30 sec - exiting 21:29:07 (3900): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:30:55 (3004): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:09:34 (3916): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:09:35 (3916): No heartbeat from core client for 30 sec - exiting 00:09:36 (3916): No heartbeat from core client for 30 sec - exiting 00:09:37 (3916): No heartbeat from core client for 30 sec - exiting 00:09:38 (3916): No heartbeat from core client for 30 sec - exiting 00:09:39 (3916): No heartbeat from core client for 30 sec - exiting 00:09:40 (3916): No heartbeat from core client for 30 sec - exiting 00:09:41 (3916): No heartbeat from core client for 30 sec - exiting 00:09:42 (3916): No heartbeat from core client for 30 sec - exiting 00:09:43 (3916): No heartbeat from core client for 30 sec - exiting 00:09:44 (3916): No heartbeat from core client for 30 sec - exiting forrtl: severe (47): write to READONLY file, unit 6, file C:\WINDOWS\system32\wbem\projects\climateprediction.net\famous_vbsx_1799_200_006701063\dataout\stdout_um.txt Image PC Routine Line Source famous_um_6.11_wi 008846D2 Unknown Unknown Unknown famous_um_6.11_wi 0088196C Unknown Unknown Unknown famous_um_6.11_wi 0080BD3E Unknown Unknown Unknown famous_um_6.11_wi 0080B95B Unknown Unknown Unknown famous_um_6.11_wi 007F028D Unknown Unknown Unknown famous_um_6.11_wi 007BA86B Unknown Unknown Unknown famous_um_6.11_wi 007BA0FF Unknown Unknown Unknown famous_um_6.11_wi 007BA0A0 Unknown Unknown Unknown famous_um_6.11_wi 00776C15 Unknown Unknown Unknown famous_um_6.11_wi 007CA0F6 Unknown Unknown Unknown kernel32.dll 7D4E7D42 Unknown Unknown Unknown Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1904, iMonCtr=1 Model crash detected, will try to restart... BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 60 - Return code = 16 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 61 - Return code = 16 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 08:26:41 (1904): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:29:08 (3076): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:34:15 (3780): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:29:13 (332): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:21:00 (728): No heartbeat from core client for 30 sec - exiting 11:21:01 (728): No heartbeat from core client for 30 sec - exiting 11:21:02 (728): No heartbeat from core client for 30 sec - exiting 11:21:03 (728): No heartbeat from core client for 30 sec - exiting 11:21:04 (728): No heartbeat from core client for 30 sec - exiting 11:21:05 (728): No heartbeat from core client for 30 sec - exiting 11:21:06 (728): No heartbeat from core client for 30 sec - exiting 11:21:07 (728): No heartbeat from core client for 30 sec - exiting 11:21:08 (728): No heartbeat from core client for 30 sec - exiting 11:21:09 (728): No heartbeat from core client for 30 sec - exiting 11:21:10 (728): No heartbeat from core client for 30 sec - exiting 11:21:11 (728): No heartbeat from core client for 30 sec - exiting 11:21:12 (728): No heartbeat from core client for 30 sec - exiting 11:21:13 (728): No heartbeat from core client for 30 sec - exiting 11:21:14 (728): No heartbeat from core client for 30 sec - exiting 11:21:15 (728): No heartbeat from core client for 30 sec - exiting 11:21:16 (728): No heartbeat from core client for 30 sec - exiting 11:21:17 (728): No heartbeat from core client for 30 sec - exiting 11:21:18 (728): No heartbeat from core client for 30 sec - exiting 11:21:19 (728): No heartbeat from core client for 30 sec - exiting 11:21:20 (728): No heartbeat from core client for 30 sec - exiting 11:21:21 (728): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... 12:16:10 (2352): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:16:11 (2352): No heartbeat from core client for 30 sec - exiting 13:51:13 (4080): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:52:58 (1080): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:53:35 (4060): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:57:51 (2852): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:57:52 (2852): No heartbeat from core client for 30 sec - exiting 13:57:53 (2852): No heartbeat from core client for 30 sec - exiting 13:57:54 (2852): No heartbeat from core client for 30 sec - exiting 13:57:55 (2852): No heartbeat from core client for 30 sec - exiting 13:57:56 (2852): No heartbeat from core client for 30 sec - exiting 13:57:57 (2852): No heartbeat from core client for 30 sec - exiting 13:57:58 (2852): No heartbeat from core client for 30 sec - exiting 13:57:59 (2852): No heartbeat from core client for 30 sec - exiting 13:58:00 (2852): No heartbeat from core client for 30 sec - exiting 13:58:01 (2852): No heartbeat from core client for 30 sec - exiting 15:48:08 (2352): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:34:27 (3844): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:34:28 (3844): No heartbeat from core client for 30 sec - exiting 17:34:29 (3844): No heartbeat from core client for 30 sec - exiting 17:34:30 (3844): No heartbeat from core client for 30 sec - exiting 17:34:31 (3844): No heartbeat from core client for 30 sec - exiting 17:34:32 (3844): No heartbeat from core client for 30 sec - exiting 17:34:33 (3844): No heartbeat from core client for 30 sec - exiting 17:34:34 (3844): No heartbeat from core client for 30 sec - exiting 17:34:35 (3844): No heartbeat from core client for 30 sec - exiting 17:34:36 (3844): No heartbeat from core client for 30 sec - exiting 17:34:37 (3844): No heartbeat from core client for 30 sec - exiting 17:45:16 (3556): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:45:17 (3556): No heartbeat from core client for 30 sec - exiting 17:45:18 (3556): No heartbeat from core client for 30 sec - exiting 17:45:19 (3556): No heartbeat from core client for 30 sec - exiting 17:45:20 (3556): No heartbeat from core client for 30 sec - exiting 17:45:21 (3556): No heartbeat from core client for 30 sec - exiting 17:45:22 (3556): No heartbeat from core client for 30 sec - exiting 17:45:23 (3556): No heartbeat from core client for 30 sec - exiting 17:45:24 (3556): No heartbeat from core client for 30 sec - exiting 17:45:25 (3556): No heartbeat from core client for 30 sec - exiting 17:45:26 (3556): No heartbeat from core client for 30 sec - exiting cpdnmonitor: cannot open input file C:\WINDOWS\system32\wbem/projects/climateprediction.net/famous_vbsx_1799_200_006701063/dataout/atmos_restart.day after 11 attempts Model crashed: DRLANDF1 : Error in FILE_OPEN. tmp/pipe_dummy cpdnmonitor: cannot open input file C:\WINDOWS\system32\wbem/projects/climateprediction.net/famous_vbsx_1799_200_006701063/dataout/atmos_restart.day after 11 attempts Model crashed: DRLANDF1 : Error in FILE_OPEN. tmp/pipe_dummy cpdnmonitor: cannot open input file C:\WINDOWS\system32\wbem/projects/climateprediction.net/famous_vbsx_1799_200_006701063/dataout/atmos_restart.day after 11 attempts Model crashed: DRLANDF1 : Error in FILE_OPEN. tmp/pipe_dummy cpdnmonitor: cannot open input file C:\WINDOWS\system32\wbem/projects/climateprediction.net/famous_vbsx_1799_200_006701063/dataout/atmos_restart.day after 11 attempts Model crashed: DRLANDF1 : Error in FILE_OPEN. tmp/pipe_dummy cpdnmonitor: cannot open input file C:\WINDOWS\system32\wbem/projects/climateprediction.net/famous_vbsx_1799_200_006701063/dataout/atmos_restart.day after 11 attempts Model crashed: DRLANDF1 : Error in FILE_OPEN. tmp/pipe_dummy cpdnmonitor: cannot open input file C:\WINDOWS\system32\wbem/projects/climateprediction.net/famous_vbsx_1799_200_006701063/dataout/atmos_restart.day after 11 attempts Model crashed: DRLANDF1 : Error in FILE_OPEN. tmp/pipe_dummy Sorry, too many model crashes! :-( 17:46:09 (2624): called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
05 Dec 2010 15:32:33	1108612	12359242	famous_vbsx_1799_200_006701063_5	355,706	142,947	0.4019
05 Dec 2010 14:13:19	1108612	12359242	famous_vbsx_1799_200_006701063_5	346,346	139,097	0.4016
05 Dec 2010 12:53:51	1108612	12359242	famous_vbsx_1799_200_006701063_5	336,986	135,333	0.4016
05 Dec 2010 11:41:12	1108612	12359242	famous_vbsx_1799_200_006701063_5	327,626	131,553	0.4015
05 Dec 2010 10:25:30	1108612	12359242	famous_vbsx_1799_200_006701063_5	318,266	127,944	0.4020
05 Dec 2010 09:02:34	1108612	12359242	famous_vbsx_1799_200_006701063_5	308,906	123,985	0.4014
05 Dec 2010 08:33:38	1108612	12359242	famous_vbsx_1799_200_006701063_5	299,546	120,374	0.4019
05 Dec 2010 08:33:38	1108612	12359242	famous_vbsx_1799_200_006701063_5	290,186	116,642	0.4020
05 Dec 2010 08:33:38	1108612	12359242	famous_vbsx_1799_200_006701063_5	280,826	112,892	0.4020
05 Dec 2010 08:33:38	1108612	12359242	famous_vbsx_1799_200_006701063_5	271,466	109,130	0.4020
05 Dec 2010 08:33:38	1108612	12359242	famous_vbsx_1799_200_006701063_5	262,106	105,364	0.4020
05 Dec 2010 08:33:38	1108612	12359242	famous_vbsx_1799_200_006701063_5	252,746	101,614	0.4020
05 Dec 2010 00:24:31	1108612	12359242	famous_vbsx_1799_200_006701063_5	243,386	97,862	0.4021
04 Dec 2010 23:11:37	1108612	12359242	famous_vbsx_1799_200_006701063_5	234,026	94,111	0.4021
04 Dec 2010 21:58:43	1108612	12359242	famous_vbsx_1799_200_006701063_5	224,666	90,339	0.4021
04 Dec 2010 20:45:51	1108612	12359242	famous_vbsx_1799_200_006701063_5	215,306	86,574	0.4021
04 Dec 2010 19:27:18	1108612	12359242	famous_vbsx_1799_200_006701063_5	205,946	82,799	0.4020
04 Dec 2010 18:12:47	1108612	12359242	famous_vbsx_1799_200_006701063_5	196,586	79,003	0.4019
04 Dec 2010 17:03:58	1108612	12359242	famous_vbsx_1799_200_006701063_5	187,226	75,220	0.4018
04 Dec 2010 15:45:59	1108612	12359242	famous_vbsx_1799_200_006701063_5	177,866	71,504	0.4020