Task 12492434

Name	famous_wns2_799_200_007117929_0
Workunit	7316289
Created	16 Jan 2011, 15:30:08 UTC
Sent	18 Jan 2011, 21:14:05 UTC
Report deadline	20 Apr 2011, 4:41:16 UTC
Received	22 Jan 2011, 20:36:20 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	1077167
Run time	2 days 0 hours 21 min 50 sec
CPU time	1 days 21 hours 22 min 35 sec
Validate state	Invalid
Credit	1,111.83
Device peak FLOPS	2.77 GFLOPS
Application version	UK Met Office FAMOUS v6.11 windows_intelx86
Stderr	<core_client_version>6.10.56</core_client_version> <![CDATA[ <message> The device does not recognize the command. (0x16) - exit code 22 (0x16) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 12:29:00 (6564): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:36:07 (7752): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 18:27:49 (6380): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:28:39 (8416): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:38:56 (8544): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:41:00 (2788): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 00:12:14 (8104): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:20:01 (8372): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:27:47 (6900): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:28:28 (3116): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:11:15 (8704): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:16:59 (5492): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:59:02 (8036): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:23:45 (9140): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:57:22 (8048): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 05:13:37 (8820): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:13:38 (8820): No heartbeat from core client for 30 sec - exiting 05:13:39 (8820): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... 07:07:07 (9144): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 08:52:58 (8104): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 12:30:47 (4336): No heartbeat from core client for 30 sec - exiting 12:30:52 (4336): No heartbeat from core client for 30 sec - exiting 12:30:53 (4336): No heartbeat from core client for 30 sec - exiting 12:30:54 (4336): No heartbeat from core client for 30 sec - exiting 12:30:55 (4336): No heartbeat from core client for 30 sec - exiting 12:30:56 (4336): No heartbeat from core client for 30 sec - exiting 12:30:57 (4336): No heartbeat from core client for 30 sec - exiting 12:30:58 (4336): No heartbeat from core client for 30 sec - exiting 12:30:59 (4336): No heartbeat from core client for 30 sec - exiting 12:31:00 (4336): No heartbeat from core client for 30 sec - exiting 12:31:01 (4336): No heartbeat from core client for 30 sec - exiting 12:31:02 (4336): No heartbeat from core client for 30 sec - exiting 12:31:03 (4336): No heartbeat from core client for 30 sec - exiting 12:31:04 (4336): No heartbeat from core client for 30 sec - exiting 12:31:05 (4336): No heartbeat from core client for 30 sec - exiting 12:31:06 (4336): No heartbeat from core client for 30 sec - exiting 12:31:07 (4336): No heartbeat from core client for 30 sec - exiting 12:31:08 (4336): No heartbeat from core client for 30 sec - exiting 12:31:09 (4336): No heartbeat from core client for 30 sec - exiting 12:31:15 (4336): No heartbeat from core client for 30 sec - exiting 12:31:16 (4336): No heartbeat from core client for 30 sec - exiting 12:31:17 (4336): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:39:25 (3436): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 12:55:39 (5076): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:25:41 (3840): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:34:47 (5016): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:36:07 (3868): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:36:08 (3868): No heartbeat from core client for 30 sec - exiting 14:36:09 (3868): No heartbeat from core client for 30 sec - exiting 14:36:10 (3868): No heartbeat from core client for 30 sec - exiting 15:20:21 (3140): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 17:34:55 (3052): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 22:51:01 (5588): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 02:58:25 (5232): No heartbeat from core client for 30 sec - exiting 02:59:02 (5232): No heartbeat from core client for 30 sec - exiting 02:59:03 (5232): No heartbeat from core client for 30 sec - exiting 02:59:04 (5232): No heartbeat from core client for 30 sec - exiting 02:59:05 (5232): No heartbeat from core client for 30 sec - exiting 02:59:06 (5232): No heartbeat from core client for 30 sec - exiting 02:59:07 (5232): No heartbeat from core client for 30 sec - exiting 02:59:08 (5232): No heartbeat from core client for 30 sec - exiting 02:59:09 (5232): No heartbeat from core client for 30 sec - exiting 02:59:10 (5232): No heartbeat from core client for 30 sec - exiting 02:59:11 (5232): No heartbeat from core client for 30 sec - exiting 02:59:12 (5232): No heartbeat from core client for 30 sec - exiting 02:59:13 (5232): No heartbeat from core client for 30 sec - exiting 02:59:14 (5232): No heartbeat from core client for 30 sec - exiting 02:59:15 (5232): No heartbeat from core client for 30 sec - exiting 02:59:16 (5232): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... 03:17:39 (904): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:12:16 (5180): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:13:32 (5220): No heartbeat from core client for 30 sec - exiting 05:13:33 (5220): No heartbeat from core client for 30 sec - exiting 05:13:34 (5220): No heartbeat from core client for 30 sec - exiting 05:13:35 (5220): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:16:54 (2508): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:12:08 (3384): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:12:16 (3384): No heartbeat from core client for 30 sec - exiting 06:12:17 (3384): No heartbeat from core client for 30 sec - exiting 06:12:18 (3384): No heartbeat from core client for 30 sec - exiting 06:12:19 (3384): No heartbeat from core client for 30 sec - exiting 06:12:20 (3384): No heartbeat from core client for 30 sec - exiting 06:12:21 (3384): No heartbeat from core client for 30 sec - exiting 06:12:22 (3384): No heartbeat from core client for 30 sec - exiting 07:02:49 (3832): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:03:56 (5464): No heartbeat from core client for 30 sec - exiting 07:03:57 (5464): No heartbeat from core client for 30 sec - exiting 07:03:58 (5464): No heartbeat from core client for 30 sec - exiting 07:03:59 (5464): No heartbeat from core client for 30 sec - exiting 07:04:00 (5464): No heartbeat from core client for 30 sec - exiting 07:04:01 (5464): No heartbeat from core client for 30 sec - exiting 07:04:02 (5464): No heartbeat from core client for 30 sec - exiting 07:04:03 (5464): No heartbeat from core client for 30 sec - exiting 07:04:04 (5464): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:12:41 (5584): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:13:20 (3680): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:43:04 (4688): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 15:30:24 (904): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... cpdnmonitor: cannot open input file D:\ProgramData\BOINC/projects/climateprediction.net/famous_wns2_799_200_007117929/dataout/ocean_restart.day after 11 attempts Model crashed: READ_FLH: I/O error tmp/pipe_dummy cpdnmonitor: cannot open input file D:\ProgramData\BOINC/projects/climateprediction.net/famous_wns2_799_200_007117929/dataout/ocean_restart.day after 11 attempts Model crashed: READ_FLH: I/O error tmp/pipe_dummy cpdnmonitor: cannot open input file D:\ProgramData\BOINC/projects/climateprediction.net/famous_wns2_799_200_007117929/dataout/ocean_restart.day after 11 attempts Model crashed: READ_FLH: I/O error tmp/pipe_dummy cpdnmonitor: cannot open input file D:\ProgramData\BOINC/projects/climateprediction.net/famous_wns2_799_200_007117929/dataout/ocean_restart.day after 11 attempts Model crashed: READ_FLH: I/O error tmp/pipe_dummy cpdnmonitor: cannot open input file D:\ProgramData\BOINC/projects/climateprediction.net/famous_wns2_799_200_007117929/dataout/ocean_restart.day after 11 attempts Model crashed: READ_FLH: I/O error tmp/pipe_dummy cpdnmonitor: cannot open input file D:\ProgramData\BOINC/projects/climateprediction.net/famous_wns2_799_200_007117929/dataout/ocean_restart.day after 11 attempts Model crashed: READ_FLH: I/O error tmp/pipe_dummy Sorry, too many model crashes! :-( 15:30:58 (4080): called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
22 Jan 2011 19:35:53	1077167	12492434	famous_wns2_799_200_007117929_0	336,986	161,013	0.4778
22 Jan 2011 12:12:08	1077167	12492434	famous_wns2_799_200_007117929_0	327,626	156,865	0.4788
22 Jan 2011 10:54:49	1077167	12492434	famous_wns2_799_200_007117929_0	318,266	153,039	0.4809
22 Jan 2011 09:11:56	1077167	12492434	famous_wns2_799_200_007117929_0	308,906	148,253	0.4799
22 Jan 2011 08:04:59	1077167	12492434	famous_wns2_799_200_007117929_0	299,546	144,483	0.4823
22 Jan 2011 06:37:19	1077167	12492434	famous_wns2_799_200_007117929_0	290,186	139,465	0.4806
22 Jan 2011 05:20:35	1077167	12492434	famous_wns2_799_200_007117929_0	280,826	135,322	0.4819
22 Jan 2011 03:38:29	1077167	12492434	famous_wns2_799_200_007117929_0	271,466	131,111	0.4830
22 Jan 2011 02:21:39	1077167	12492434	famous_wns2_799_200_007117929_0	262,106	126,625	0.4831
22 Jan 2011 01:09:41	1077167	12492434	famous_wns2_799_200_007117929_0	252,746	122,439	0.4844
21 Jan 2011 22:59:59	1077167	12492434	famous_wns2_799_200_007117929_0	243,386	118,027	0.4849
21 Jan 2011 21:04:28	1077167	12492434	famous_wns2_799_200_007117929_0	234,026	113,357	0.4844
21 Jan 2011 19:58:14	1077167	12492434	famous_wns2_799_200_007117929_0	224,666	109,690	0.4882
21 Jan 2011 18:47:52	1077167	12492434	famous_wns2_799_200_007117929_0	215,306	105,348	0.4893
21 Jan 2011 15:10:30	1077167	12492434	famous_wns2_799_200_007117929_0	205,946	100,558	0.4883
21 Jan 2011 12:47:51	1077167	12492434	famous_wns2_799_200_007117929_0	196,586	96,028	0.4885
21 Jan 2011 12:29:51	1077167	12492434	famous_wns2_799_200_007117929_0	187,226	91,700	0.4898
21 Jan 2011 12:29:51	1077167	12492434	famous_wns2_799_200_007117929_0	177,866	87,111	0.4898
21 Jan 2011 12:29:51	1077167	12492434	famous_wns2_799_200_007117929_0	168,506	82,299	0.4884
21 Jan 2011 12:29:51	1077167	12492434	famous_wns2_799_200_007117929_0	159,146	77,610	0.4877