Task 11415582

Name	famous_u0l3_1599_200_006633610_4
Workunit	6836982
Created	1 Jun 2010, 15:34:54 UTC
Sent	4 Jun 2010, 11:28:17 UTC
Report deadline	3 Sep 2010, 18:55:28 UTC
Received	23 Jun 2010, 18:48:47 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	849017
Run time	5 days 17 hours 40 min 31 sec
CPU time	5 days 4 hours 27 min 30 sec
Validate state	Invalid
Credit	3,180.89
Device peak FLOPS	2.50 GFLOPS
Application version	UK Met Office FAMOUS v6.10 windows_intelx86
Stderr	<core_client_version>6.10.56</core_client_version> <![CDATA[ <message> The device does not recognize the command. (0x16) - exit code 22 (0x16) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 07:11:50 (7704): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 60 - Return code = 16 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 61 - Return code = 16 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 60 - Return code = 16 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 61 - Return code = 16 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 CPDN Monitor - Quit request from BOINC... BUFFIN: Read Failed: Result too large BUFFIN: C I/O Error feof - Unit 60 - Return code = 16 BUFFIN: Read Failed: Result too large BUFFIN: C I/O Error feof - Unit 61 - Return code = 16 BUFFIN: Read Failed: Result too large BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: Read Failed: Result too large BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 CPDN Monitor - Quit request from BOINC... BUFFIN: Read Failed: Result too large BUFFIN: C I/O Error feof - Unit 60 - Return code = 16 BUFFIN: Read Failed: Result too large BUFFIN: C I/O Error feof - Unit 61 - Return code = 16 BUFFIN: Read Failed: Result too large BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: Read Failed: Result too large BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 60 - Return code = 16 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 61 - Return code = 16 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... forrtl: The requested operation cannot be performed on a file with a user-mapped section open. forrtl: severe (38): error during write, unit 6, file C:\Documents and Settings\All Users\Application Data\BOINC\projects\climateprediction.net\famous_u0l3_1599_200_006633610\dataout\stdout_um.txt Image PC Routine Line Source famous_um_6.10_wi 008846D2 Unknown Unknown Unknown famous_um_6.10_wi 0088196C Unknown Unknown Unknown famous_um_6.10_wi 0080BD3E Unknown Unknown Unknown famous_um_6.10_wi 0080B95B Unknown Unknown Unknown famous_um_6.10_wi 007F0945 Unknown Unknown Unknown famous_um_6.10_wi 007F00F5 Unknown Unknown Unknown famous_um_6.10_wi 007BA86B Unknown Unknown Unknown famous_um_6.10_wi 007BA0FF Unknown Unknown Unknown famous_um_6.10_wi 007BA0A0 Unknown Unknown Unknown famous_um_6.10_wi 00776C15 Unknown Unknown Unknown famous_um_6.10_wi 007CA0F6 Unknown Unknown Unknown kernel32.dll 7C817077 Unknown Unknown Unknown Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=9256, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 07:31:51 (7560): No heartbeat from core client for 30 sec - exiting 07:32:20 (7560): No heartbeat from core client for 30 sec - exiting 07:32:21 (7560): No heartbeat from core client for 30 sec - exiting 07:32:23 (7560): No heartbeat from core client for 30 sec - exiting 07:32:24 (7560): No heartbeat from core client for 30 sec - exiting 07:32:25 (7560): No heartbeat from core client for 30 sec - exiting 07:32:26 (7560): No heartbeat from core client for 30 sec - exiting 07:32:27 (7560): No heartbeat from core client for 30 sec - exiting 07:32:28 (7560): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... forrtl: The requested operation cannot be performed on a file with a user-mapped section open. forrtl: severe (38): error during write, unit 6, file C:\Documents and Settings\All Users\Application Data\BOINC\projects\climateprediction.net\famous_u0l3_1599_200_006633610\dataout\stdout_um.txt Image PC Routine Line Source famous_um_6.10_wi 008846D2 Unknown Unknown Unknown famous_um_6.10_wi 0088196C Unknown Unknown Unknown famous_um_6.10_wi 0080BD3E Unknown Unknown Unknown famous_um_6.10_wi 0080B95B Unknown Unknown Unknown famous_um_6.10_wi 007F0945 Unknown Unknown Unknown famous_um_6.10_wi 007F00F5 Unknown Unknown Unknown famous_um_6.10_wi 007BA86B Unknown Unknown Unknown famous_um_6.10_wi 007BA0FF Unknown Unknown Unknown famous_um_6.10_wi 007BA0A0 Unknown Unknown Unknown famous_um_6.10_wi 00776C15 Unknown Unknown Unknown famous_um_6.10_wi 007CA0F6 Unknown Unknown Unknown kernel32.dll 7C817077 Unknown Unknown Unknown Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=8788, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 22:00:41 (9240): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 13:41:18 (9276): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy Sorry, too many model crashes! :-( 14:47:36 (3984): called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
23 Jun 2010 17:55:02	849017	11415582	famous_u0l3_1599_200_006633610_4	964,106	444,930	0.4615
23 Jun 2010 12:38:30	849017	11415582	famous_u0l3_1599_200_006633610_4	954,746	440,947	0.4618
23 Jun 2010 10:33:51	849017	11415582	famous_u0l3_1599_200_006633610_4	945,386	436,739	0.4620
23 Jun 2010 09:25:17	849017	11415582	famous_u0l3_1599_200_006633610_4	936,026	432,799	0.4624
23 Jun 2010 08:15:25	849017	11415582	famous_u0l3_1599_200_006633610_4	926,666	428,740	0.4627
23 Jun 2010 05:04:38	849017	11415582	famous_u0l3_1599_200_006633610_4	917,306	424,820	0.4631
23 Jun 2010 03:51:19	849017	11415582	famous_u0l3_1599_200_006633610_4	907,946	420,852	0.4635
22 Jun 2010 23:01:08	849017	11415582	famous_u0l3_1599_200_006633610_4	898,586	415,521	0.4624
22 Jun 2010 11:47:15	849017	11415582	famous_u0l3_1599_200_006633610_4	889,226	410,708	0.4619
21 Jun 2010 12:41:03	849017	11415582	famous_u0l3_1599_200_006633610_4	879,866	406,495	0.4620
21 Jun 2010 09:14:40	849017	11415582	famous_u0l3_1599_200_006633610_4	870,506	402,565	0.4624
21 Jun 2010 08:02:58	849017	11415582	famous_u0l3_1599_200_006633610_4	861,146	398,514	0.4628
21 Jun 2010 06:54:54	849017	11415582	famous_u0l3_1599_200_006633610_4	851,786	394,526	0.4632
21 Jun 2010 05:43:25	849017	11415582	famous_u0l3_1599_200_006633610_4	842,426	390,434	0.4635
21 Jun 2010 03:07:32	849017	11415582	famous_u0l3_1599_200_006633610_4	833,066	386,497	0.4639
21 Jun 2010 00:41:53	849017	11415582	famous_u0l3_1599_200_006633610_4	823,706	382,461	0.4643
20 Jun 2010 21:20:59	849017	11415582	famous_u0l3_1599_200_006633610_4	814,346	378,437	0.4647
20 Jun 2010 19:47:55	849017	11415582	famous_u0l3_1599_200_006633610_4	804,986	374,332	0.4650
20 Jun 2010 17:35:14	849017	11415582	famous_u0l3_1599_200_006633610_4	795,626	370,249	0.4654
20 Jun 2010 14:18:59	849017	11415582	famous_u0l3_1599_200_006633610_4	786,266	366,067	0.4656