climateprediction.net home page
Task 11837509

Task 11837509

Name famous_vmy1_1999_200_006715503_3
Workunit 6918756
Created 26 Aug 2010, 17:54:49 UTC
Sent 30 Sep 2010, 6:55:38 UTC
Report deadline 30 Dec 2010, 14:22:49 UTC
Received 31 Oct 2010, 3:27:14 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 22 (0x00000016) Unknown error code
Computer ID 1037359
Run time 3 days 18 hours 14 min 22 sec
CPU time 3 days 17 hours 46 min 18 sec
Validate state Invalid
Credit 3,705.88
Device peak FLOPS 3.09 GFLOPS
Application version UK Met Office FAMOUS v6.11
windows_intelx86
Stderr 
<core_client_version>6.10.18</core_client_version>
<![CDATA[
<message>
The device does not recognize the command. (0x16) - exit code 22 (0x16)
</message>
<stderr_txt>
Suspended CPDN Monitor - Suspend request from BOINC...
13:22:14 (5960): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
20:47:18 (1972): No heartbeat from core client for 30 sec - exiting
Suspended CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
23:56:25 (920): No heartbeat from core client for 30 sec - exiting
Suspended CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
21:31:14 (5364): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
21:31:15 (5364): No heartbeat from core client for 30 sec - exiting
cpdnmonitor: cannot open input file C:\COMM\SETI@home\Boinc\projects/projects/climateprediction.net/famous_vmy1_1999_200_006715503/dataout/ocean_restart.day after 11 attempts

Model crashed: READ_FLH: I/O error                                                                                                                                                                                                                                             tmp/pipe_dummy                                                                  
cpdnmonitor: cannot open input file C:\COMM\SETI@home\Boinc\projects/projects/climateprediction.net/famous_vmy1_1999_200_006715503/dataout/ocean_restart.day after 11 attempts

Model crashed: READ_FLH: I/O error                                                                                                                                                                                                                                             tmp/pipe_dummy                                                                  
cpdnmonitor: cannot open input file C:\COMM\SETI@home\Boinc\projects/projects/climateprediction.net/famous_vmy1_1999_200_006715503/dataout/ocean_restart.day after 11 attempts

Model crashed: READ_FLH: I/O error                                                                                                                                                                                                                                             tmp/pipe_dummy                                                                  
cpdnmonitor: cannot open input file C:\COMM\SETI@home\Boinc\projects/projects/climateprediction.net/famous_vmy1_1999_200_006715503/dataout/ocean_restart.day after 11 attempts

Model crashed: READ_FLH: I/O error                                                                                                                                                                                                                                             tmp/pipe_dummy                                                                  
cpdnmonitor: cannot open input file C:\COMM\SETI@home\Boinc\projects/projects/climateprediction.net/famous_vmy1_1999_200_006715503/dataout/ocean_restart.day after 11 attempts

Model crashed: READ_FLH: I/O error                                                                                                                                                                                                                                             tmp/pipe_dummy                                                                  
cpdnmonitor: cannot open input file C:\COMM\SETI@home\Boinc\projects/projects/climateprediction.net/famous_vmy1_1999_200_006715503/dataout/ocean_restart.day after 11 attempts

Model crashed: READ_FLH: I/O error                                                                                                                                                                                                                                             tmp/pipe_dummy                                                                  
Sorry, too many model crashes! :-(
cpdnmonitor: cannot open input file C:\COMM\SETI@home\Boinc\projects/projects/climateprediction.net/famous_vmy1_1999_200_006715503/dataout/atmos_restart.day after 11 attempts
cpdnmonitor: cannot open input file C:\COMM\SETI@home\Boinc\projects/projects/climateprediction.net/famous_vmy1_1999_200_006715503/dataout/ocean_restart.day after 11 attempts
forrtl: severe (24): end-of-file during read, unit 5, file C:\COMM\SETI@home\Boinc\projects\projects\climateprediction.net\famous_vmy1_1999_200_006715503\jobs\climate.cpdc, line 1, position 0
Image              PC        Routine            Line        Source             
famous_um_6.11_wi  008846D2  Unknown               Unknown  Unknown

Stack trace terminated abnormally.
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=9848, iMonCtr=1
Model crash detected, will try to restart...
cpdnmonitor: cannot open input file C:\COMM\SETI@home\Boinc\projects/projects/climateprediction.net/famous_vmy1_1999_200_006715503/dataout/atmos_restart.day after 11 attempts
cpdnmonitor: cannot open input file C:\COMM\SETI@home\Boinc\projects/projects/climateprediction.net/famous_vmy1_1999_200_006715503/dataout/ocean_restart.day after 11 attempts
forrtl: severe (24): end-of-file during read, unit 5, file C:\COMM\SETI@home\Boinc\projects\projects\climateprediction.net\famous_vmy1_1999_200_006715503\jobs\climate.cpdc, line 1, position 0
Image              PC        Routine            Line        Source             
famous_um_6.11_wi  008846D2  Unknown               Unknown  Unknown

Stack trace terminated abnormally.
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=9848, iMonCtr=1
Model crash detected, will try to restart...
cpdnmonitor: cannot open input file C:\COMM\SETI@home\Boinc\projects/projects/climateprediction.net/famous_vmy1_1999_200_006715503/dataout/atmos_restart.day after 11 attempts
cpdnmonitor: cannot open input file C:\COMM\SETI@home\Boinc\projects/projects/climateprediction.net/famous_vmy1_1999_200_006715503/dataout/ocean_restart.day after 11 attempts
forrtl: severe (24): end-of-file during read, unit 5, file C:\COMM\SETI@home\Boinc\projects\projects\climateprediction.net\famous_vmy1_1999_200_006715503\jobs\climate.cpdc, line 1, position 0
Image              PC        Routine            Line        Source             
famous_um_6.11_wi  008846D2  Unknown               Unknown  Unknown

Stack trace terminated abnormally.
cpdnmonitor: cannot open input file C:\COMM\SETI@home\Boinc\projects/projects/climateprediction.net/famous_vmy1_1999_200_006715503/dataout/atmos_restart.day after 11 attempts
cpdnmonitor: cannot open input file C:\COMM\SETI@home\Boinc\projects/projects/climateprediction.net/famous_vmy1_1999_200_006715503/dataout/ocean_restart.day after 11 attempts
forrtl: severe (24): end-of-file during read, unit 5, file C:\COMM\SETI@home\Boinc\projects\projects\climateprediction.net\famous_vmy1_1999_200_006715503\jobs\climate.cpdc, line 1, position 0
Image              PC        Routine            Line        Source             
famous_um_6.11_wi  008846D2  Unknown               Unknown  Unknown

Stack trace terminated abnormally.
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5228, iMonCtr=1
Model crash detected, will try to restart...
cpdnmonitor: cannot open input file C:\COMM\SETI@home\Boinc\projects/projects/climateprediction.net/famous_vmy1_1999_200_006715503/dataout/atmos_restart.day after 11 attempts
cpdnmonitor: cannot open input file C:\COMM\SETI@home\Boinc\projects/projects/climateprediction.net/famous_vmy1_1999_200_006715503/dataout/ocean_restart.day after 11 attempts
forrtl: severe (24): end-of-file during read, unit 5, file C:\COMM\SETI@home\Boinc\projects\projects\climateprediction.net\famous_vmy1_1999_200_006715503\jobs\climate.cpdc, line 1, position 0
Image              PC        Routine            Line        Source             
famous_um_6.11_wi  008846D2  Unknown               Unknown  Unknown

Stack trace terminated abnormally.
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5228, iMonCtr=1
Model crash detected, will try to restart...
cpdnmonitor: cannot open input file C:\COMM\SETI@home\Boinc\projects/projects/climateprediction.net/famous_vmy1_1999_200_006715503/dataout/atmos_restart.day after 11 attempts
cpdnmonitor: cannot open input file C:\COMM\SETI@home\Boinc\projects/projects/climateprediction.net/famous_vmy1_1999_200_006715503/dataout/ocean_restart.day after 11 attempts
forrtl: severe (24): end-of-file during read, unit 5, file C:\COMM\SETI@home\Boinc\projects\projects\climateprediction.net\famous_vmy1_1999_200_006715503\jobs\climate.cpdc, line 1, position 0
Image              PC        Routine            Line        Source             
famous_um_6.11_wi  008846D2  Unknown               Unknown  Unknown

Stack trace terminated abnormally.
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5228, iMonCtr=1
Model crash detected, will try to restart...
cpdnmonitor: cannot open input file C:\COMM\SETI@home\Boinc\projects/projects/climateprediction.net/famous_vmy1_1999_200_006715503/dataout/atmos_restart.day after 11 attempts
cpdnmonitor: cannot open input file C:\COMM\SETI@home\Boinc\projects/projects/climateprediction.net/famous_vmy1_1999_200_006715503/dataout/ocean_restart.day after 11 attempts
forrtl: severe (24): end-of-file during read, unit 5, file C:\COMM\SETI@home\Boinc\projects\projects\climateprediction.net\famous_vmy1_1999_200_006715503\jobs\climate.cpdc, line 1, position 0
Image              PC        Routine            Line        Source             
famous_um_6.11_wi  008846D2  Unknown               Unknown  Unknown

Stack trace terminated abnormally.
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5228, iMonCtr=1
Model crash detected, will try to restart...
Sorry, too many model crashes! :-(
21:39:13 (5228): called boinc_finish

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
31 Oct 2010 03:29:49 1037359 11837509 famous_vmy1_1999_200_006715503_3 1,123,226 320,874 0.2857
31 Oct 2010 03:29:49 1037359 11837509 famous_vmy1_1999_200_006715503_3 1,113,866 318,188 0.2857
31 Oct 2010 03:29:49 1037359 11837509 famous_vmy1_1999_200_006715503_3 1,104,506 315,527 0.2857
31 Oct 2010 03:29:49 1037359 11837509 famous_vmy1_1999_200_006715503_3 1,095,146 312,900 0.2857
30 Oct 2010 07:08:14 1037359 11837509 famous_vmy1_1999_200_006715503_3 1,085,786 310,287 0.2858
30 Oct 2010 06:06:43 1037359 11837509 famous_vmy1_1999_200_006715503_3 1,076,426 307,652 0.2858
30 Oct 2010 05:25:48 1037359 11837509 famous_vmy1_1999_200_006715503_3 1,067,066 305,108 0.2859
30 Oct 2010 04:44:38 1037359 11837509 famous_vmy1_1999_200_006715503_3 1,057,706 302,540 0.2860
30 Oct 2010 03:59:11 1037359 11837509 famous_vmy1_1999_200_006715503_3 1,048,346 299,973 0.2861
30 Oct 2010 03:14:18 1037359 11837509 famous_vmy1_1999_200_006715503_3 1,038,986 297,409 0.2862
30 Oct 2010 02:56:11 1037359 11837509 famous_vmy1_1999_200_006715503_3 1,029,626 294,813 0.2863
29 Oct 2010 07:15:53 1037359 11837509 famous_vmy1_1999_200_006715503_3 1,020,266 292,210 0.2864
29 Oct 2010 06:19:48 1037359 11837509 famous_vmy1_1999_200_006715503_3 1,010,906 289,098 0.2860
29 Oct 2010 05:31:15 1037359 11837509 famous_vmy1_1999_200_006715503_3 1,001,546 286,004 0.2856
29 Oct 2010 04:44:42 1037359 11837509 famous_vmy1_1999_200_006715503_3 992,186 282,899 0.2851
29 Oct 2010 03:47:15 1037359 11837509 famous_vmy1_1999_200_006715503_3 982,826 279,795 0.2847
29 Oct 2010 03:06:26 1037359 11837509 famous_vmy1_1999_200_006715503_3 973,466 276,613 0.2842
29 Oct 2010 03:06:26 1037359 11837509 famous_vmy1_1999_200_006715503_3 964,106 273,955 0.2842
28 Oct 2010 05:33:02 1037359 11837509 famous_vmy1_1999_200_006715503_3 954,746 271,387 0.2843
28 Oct 2010 04:52:04 1037359 11837509 famous_vmy1_1999_200_006715503_3 945,386 268,827 0.2844


©2024 climateprediction.net