Task 12911303

Name	famous_xgr2_1999_200_007083541_2
Workunit	7286841
Created	28 May 2011, 10:00:13 UTC
Sent	28 May 2011, 10:00:17 UTC
Report deadline	27 Aug 2011, 17:27:28 UTC
Received	24 Jun 2011, 11:15:00 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	1116859
Run time	8 days 8 hours 48 min 34 sec
CPU time	8 days 5 hours 54 min 47 sec
Validate state	Invalid
Credit	3,026.49
Device peak FLOPS	1.68 GFLOPS
Application version	UK Met Office FAMOUS v6.11 windows_intelx86
Stderr	<core_client_version>6.10.58</core_client_version> <![CDATA[ <message> The device does not recognize the command. (0x16) - exit code 22 (0x16) </message> <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 19:15:29 (2868): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:15:30 (2868): No heartbeat from core client for 30 sec - exiting 19:15:31 (2868): No heartbeat from core client for 30 sec - exiting 19:15:32 (2868): No heartbeat from core client for 30 sec - exiting 19:15:34 (2868): No heartbeat from core client for 30 sec - exiting 19:15:35 (2868): No heartbeat from core client for 30 sec - exiting 19:15:36 (2868): No heartbeat from core client for 30 sec - exiting 19:15:37 (2868): No heartbeat from core client for 30 sec - exiting 19:15:38 (2868): No heartbeat from core client for 30 sec - exiting 19:15:39 (2868): No heartbeat from core client for 30 sec - exiting 19:15:40 (2868): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 22:00:57 (4476): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:00:58 (4476): No heartbeat from core client for 30 sec - exiting 22:00:59 (4476): No heartbeat from core client for 30 sec - exiting 22:01:00 (4476): No heartbeat from core client for 30 sec - exiting 22:01:01 (4476): No heartbeat from core client for 30 sec - exiting 22:01:02 (4476): No heartbeat from core client for 30 sec - exiting 22:01:03 (4476): No heartbeat from core client for 30 sec - exiting 22:01:05 (4476): No heartbeat from core client for 30 sec - exiting 22:01:06 (4476): No heartbeat from core client for 30 sec - exiting 22:01:07 (4476): No heartbeat from core client for 30 sec - exiting 22:01:08 (4476): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Signal 11 received, exiting... 12:05:16 (4288): called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2948, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Signal 11 received, exiting... 12:05:45 (4272): called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2948, iMonCtr=1 Model crash detected, will try to restart... Signal 11 received, exiting... 12:05:50 (5020): called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2948, iMonCtr=1 Model crash detected, will try to restart... Signal 11 received, exiting... 12:05:55 (5812): called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2948, iMonCtr=1 Model crash detected, will try to restart... Signal 11 received, exiting... 12:05:59 (4476): called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2948, iMonCtr=1 Model crash detected, will try to restart... Signal 11 received, exiting... 12:06:04 (5896): called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2948, iMonCtr=1 Model crash detected, will try to restart... Sorry, too many model crashes! :-( 12:06:08 (2948): called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
24 Jun 2011 10:17:31	1116859	12911303	famous_xgr2_1999_200_007083541_2	917,306	707,422	0.7712
23 Jun 2011 22:14:42	1116859	12911303	famous_xgr2_1999_200_007083541_2	907,946	701,768	0.7729
23 Jun 2011 20:13:01	1116859	12911303	famous_xgr2_1999_200_007083541_2	898,586	695,998	0.7745
23 Jun 2011 18:36:08	1116859	12911303	famous_xgr2_1999_200_007083541_2	889,226	690,103	0.7761
23 Jun 2011 17:18:05	1116859	12911303	famous_xgr2_1999_200_007083541_2	879,866	684,247	0.7777
23 Jun 2011 15:50:23	1116859	12911303	famous_xgr2_1999_200_007083541_2	870,506	678,412	0.7793
23 Jun 2011 13:48:16	1116859	12911303	famous_xgr2_1999_200_007083541_2	861,146	672,758	0.7812
23 Jun 2011 12:47:22	1116859	12911303	famous_xgr2_1999_200_007083541_2	851,786	667,091	0.7832
23 Jun 2011 10:45:43	1116859	12911303	famous_xgr2_1999_200_007083541_2	842,426	661,426	0.7851
23 Jun 2011 09:44:26	1116859	12911303	famous_xgr2_1999_200_007083541_2	833,066	655,773	0.7872
22 Jun 2011 21:58:04	1116859	12911303	famous_xgr2_1999_200_007083541_2	823,706	650,109	0.7892
22 Jun 2011 20:42:29	1116859	12911303	famous_xgr2_1999_200_007083541_2	814,346	644,414	0.7913
22 Jun 2011 19:41:55	1116859	12911303	famous_xgr2_1999_200_007083541_2	804,986	638,769	0.7935
22 Jun 2011 17:36:16	1116859	12911303	famous_xgr2_1999_200_007083541_2	795,626	633,138	0.7958
22 Jun 2011 17:19:25	1116859	12911303	famous_xgr2_1999_200_007083541_2	786,266	627,503	0.7981
22 Jun 2011 14:37:42	1116859	12911303	famous_xgr2_1999_200_007083541_2	776,906	621,875	0.8005
21 Jun 2011 17:20:57	1116859	12911303	famous_xgr2_1999_200_007083541_2	767,546	616,424	0.8031
21 Jun 2011 15:29:09	1116859	12911303	famous_xgr2_1999_200_007083541_2	758,186	610,728	0.8055
21 Jun 2011 13:31:02	1116859	12911303	famous_xgr2_1999_200_007083541_2	748,826	605,072	0.8080
20 Jun 2011 21:02:29	1116859	12911303	famous_xgr2_1999_200_007083541_2	739,466	599,369	0.8105