Task 13088871

Name	famous_x8h1_1099_200_007072812_2
Workunit	7276112
Created	5 Jul 2011, 22:30:54 UTC
Sent	5 Jul 2011, 22:30:59 UTC
Report deadline	5 Oct 2011, 5:58:10 UTC
Received	8 Jul 2011, 1:44:11 UTC
Server state	Over
Outcome	Computation error
Client state	Done
Exit status	22 (0x00000016) Unknown error code
Computer ID	840014
Run time
CPU time	23 hours 3 min 33 sec
Validate state	Invalid
Credit	216.26
Device peak FLOPS	1.63 GFLOPS
Application version	UK Met Office FAMOUS v6.11 windows_intelx86
Stderr	<core_client_version>5.10.30</core_client_version> <![CDATA[ <message> The device does not recognize the command. (0x16) - exit code 22 (0x16) </message> <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 05:24:01 (2428): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:24:03 (2428): No heartbeat from core client for 30 sec - exiting 05:28:16 (3904): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:28:19 (3904): No heartbeat from core client for 30 sec - exiting 05:28:20 (3904): No heartbeat from core client for 30 sec - exiting 05:28:21 (3904): No heartbeat from core client for 30 sec - exiting 05:28:22 (3904): No heartbeat from core client for 30 sec - exiting 05:28:23 (3904): No heartbeat from core client for 30 sec - exiting 05:28:24 (3904): No heartbeat from core client for 30 sec - exiting 05:28:25 (3904): No heartbeat from core client for 30 sec - exiting 06:27:17 (1984): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 07:36:29 (1660): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:36:32 (1660): No heartbeat from core client for 30 sec - exiting 07:36:33 (1660): No heartbeat from core client for 30 sec - exiting 08:00:11 (3828): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:08:11 (176): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:08:13 (176): No heartbeat from core client for 30 sec - exiting 08:08:14 (176): No heartbeat from core client for 30 sec - exiting 08:11:52 (3880): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:11:54 (3880): No heartbeat from core client for 30 sec - exiting Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 08:34:23 (2396): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:34:26 (2396): No heartbeat from core client for 30 sec - exiting 08:34:27 (2396): No heartbeat from core client for 30 sec - exiting 08:34:28 (2396): No heartbeat from core client for 30 sec - exiting 08:40:29 (676): No heartbeat from core client for 30 sec - exiting 08:40:30 (676): No heartbeat from core client for 30 sec - exiting 08:40:31 (676): No heartbeat from core client for 30 sec - exiting 08:40:32 (676): No heartbeat from core client for 30 sec - exiting 08:40:33 (676): No heartbeat from core client for 30 sec - exiting 08:40:34 (676): No heartbeat from core client for 30 sec - exiting 08:40:35 (676): No heartbeat from core client for 30 sec - exiting 08:40:36 (676): No heartbeat from core client for 30 sec - exiting 08:40:37 (676): No heartbeat from core client for 30 sec - exiting 08:40:38 (676): No heartbeat from core client for 30 sec - exiting 08:40:39 (676): No heartbeat from core client for 30 sec - exiting 08:40:40 (676): No heartbeat from core client for 30 sec - exiting 08:40:41 (676): No heartbeat from core client for 30 sec - exiting 08:40:42 (676): No heartbeat from core client for 30 sec - exiting 08:40:43 (676): No heartbeat from core client for 30 sec - exiting 08:40:44 (676): No heartbeat from core client for 30 sec - exiting 08:40:45 (676): No heartbeat from core client for 30 sec - exiting 08:40:46 (676): No heartbeat from core client for 30 sec - exiting 08:40:47 (676): No heartbeat from core client for 30 sec - exiting 08:40:48 (676): No heartbeat from core client for 30 sec - exiting 08:40:49 (676): No heartbeat from core client for 30 sec - exiting 08:40:50 (676): No heartbeat from core client for 30 sec - exiting 08:40:51 (676): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:40:52 (676): No heartbeat from core client for 30 sec - exiting 08:40:53 (676): No heartbeat from core client for 30 sec - exiting 08:40:54 (676): No heartbeat from core client for 30 sec - exiting 08:40:55 (676): No heartbeat from core client for 30 sec - exiting 08:40:56 (676): No heartbeat from core client for 30 sec - exiting 08:40:57 (676): No heartbeat from core client for 30 sec - exiting 08:44:02 (632): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:44:05 (632): No heartbeat from core client for 30 sec - exiting 08:44:06 (632): No heartbeat from core client for 30 sec - exiting 08:44:07 (632): No heartbeat from core client for 30 sec - exiting 08:44:08 (632): No heartbeat from core client for 30 sec - exiting 08:44:09 (632): No heartbeat from core client for 30 sec - exiting 08:44:10 (632): No heartbeat from core client for 30 sec - exiting 08:44:11 (632): No heartbeat from core client for 30 sec - exiting 08:44:12 (632): No heartbeat from core client for 30 sec - exiting 08:44:13 (632): No heartbeat from core client for 30 sec - exiting 08:44:14 (632): No heartbeat from core client for 30 sec - exiting 08:44:15 (632): No heartbeat from core client for 30 sec - exiting 08:44:16 (632): No heartbeat from core client for 30 sec - exiting Model crashed: P_TH_ADJ : NEGATIVE PRESSURE VALUE CREATED. tmp/pipe_dummy Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 16:12:34 (1084): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 17:32:55 (3172): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Signal 11 received, exiting... 18:07:50 (892): called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2980, iMonCtr=1 Model crash detected, will try to restart... Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy Sorry, too many model crashes! :-( 22:37:25 (2980): called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
08 Jul 2011 01:46:16	840014	13088871	famous_x8h1_1099_200_007072812_2	65,546	76,882	1.1729
08 Jul 2011 01:46:16	840014	13088871	famous_x8h1_1099_200_007072812_2	56,186	66,326	1.1805
08 Jul 2011 01:46:16	840014	13088871	famous_x8h1_1099_200_007072812_2	46,826	55,547	1.1862
08 Jul 2011 01:46:16	840014	13088871	famous_x8h1_1099_200_007072812_2	37,466	44,312	1.1827
08 Jul 2011 01:46:16	840014	13088871	famous_x8h1_1099_200_007072812_2	28,106	33,095	1.1775
08 Jul 2011 01:46:16	840014	13088871	famous_x8h1_1099_200_007072812_2	18,746	22,075	1.1776
08 Jul 2011 01:46:16	840014	13088871	famous_x8h1_1099_200_007072812_2	9,386	11,118	1.1845