Name | hadcm3n_o2ta_2020_40_007857240_3 |
Workunit | 8012352 |
Created | 5 Apr 2012, 0:08:50 UTC |
Sent | 5 Apr 2012, 0:12:57 UTC |
Report deadline | 5 Jul 2012, 7:40:08 UTC |
Received | 11 Oct 2012, 19:13:00 UTC |
Server state | Over |
Outcome | Computation error |
Client state | Compute error |
Exit status | 22 (0x00000016) Unknown error code |
Computer ID | 1183901 |
Run time | 26 days 3 hours 20 min 57 sec |
CPU time | 24 days 17 hours 10 min 26 sec |
Validate state | Invalid |
Credit | 12,130.56 |
Device peak FLOPS | 2.64 GFLOPS |
Application version | UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86 |
Stderr | <core_client_version>7.0.28</core_client_version> <![CDATA[ <message> The device does not recognize the command. (0x16) - exit code 22 (0x16) </message> <stderr_txt> equest from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2568, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6148, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 16:51:05 (6296): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4828, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4716, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 10:18:59 (5836): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:19:05 (5836): No heartbeat from core client for 30 sec - exiting 10:19:06 (5836): No heartbeat from core client for 30 sec - exiting 10:19:07 (5836): No heartbeat from core client for 30 sec - exiting 10:19:08 (5836): No heartbeat from core client for 30 sec - exiting 10:19:09 (5836): No heartbeat from core client for 30 sec - exiting 08:31:10 (408): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:31:13 (408): No heartbeat from core client for 30 sec - exiting 08:31:14 (408): No heartbeat from core client for 30 sec - exiting 08:31:15 (408): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6592, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4344, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4544, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=10252, iMonCtr=1 Model crash detected, will try to restart... Sorry, too many model crashes! :-( cpdnmonitor: cannot open input file C:\ProgramData\BOINC/projects/climateprediction.net/hadcm3n_o2ta_2020_40_007857240/dataout/atmos_restart.day after 11 attempts CPDN Monitor - Quit request from BOINC... cpdnmonitor: cannot open input file C:\ProgramData\BOINC/projects/climateprediction.net/hadcm3n_o2ta_2020_40_007857240/dataout/atmos_restart.day after 11 attempts CPDN Monitor - Quit request from BOINC... cpdnmonitor: cannot open input file C:\ProgramData\BOINC/projects/climateprediction.net/hadcm3n_o2ta_2020_40_007857240/dataout/atmos_restart.day after 11 attempts Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... cpdnmonitor: cannot open input file C:\ProgramData\BOINC/projects/climateprediction.net/hadcm3n_o2ta_2020_40_007857240/dataout/atmos_restart.day after 11 attempts CPDN Monitor - Quit request from BOINC... cpdnmonitor: cannot open input file C:\ProgramData\BOINC/projects/climateprediction.net/hadcm3n_o2ta_2020_40_007857240/dataout/atmos_restart.day after 11 attempts CPDN Monitor - Quit request from BOINC... cpdnmonitor: cannot open input file C:\ProgramData\BOINC/projects/climateprediction.net/hadcm3n_o2ta_2020_40_007857240/dataout/atmos_restart.day after 11 attempts CPDN Monitor - Quit request from BOINC... cpdnmonitor: cannot open input file C:\ProgramData\BOINC/projects/climateprediction.net/hadcm3n_o2ta_2020_40_007857240/dataout/atmos_restart.day after 11 attempts CPDN Monitor - Quit request from BOINC... cpdnmonitor: cannot open input file C:\ProgramData\BOINC/projects/climateprediction.net/hadcm3n_o2ta_2020_40_007857240/dataout/atmos_restart.day after 11 attempts CPDN Monitor - Quit request from BOINC... cpdnmonitor: cannot open input file C:\ProgramData\BOINC/projects/climateprediction.net/hadcm3n_o2ta_2020_40_007857240/dataout/atmos_restart.day after 11 attempts CPDN Monitor - Quit request from BOINC... cpdnmonitor: cannot open input file C:\ProgramData\BOINC/projects/climateprediction.net/hadcm3n_o2ta_2020_40_007857240/dataout/atmos_restart.day after 11 attempts CPDN Monitor - Quit request from BOINC... cpdnmonitor: cannot open input file C:\ProgramData\BOINC/projects/climateprediction.net/hadcm3n_o2ta_2020_40_007857240/dataout/atmos_restart.day after 11 attempts CPDN Monitor - Quit request from BOINC... cpdnmonitor: cannot open input file C:\ProgramData\BOINC/projects/climateprediction.net/hadcm3n_o2ta_2020_40_007857240/dataout/atmos_restart.day after 11 attempts CPDN Monitor - Quit request from BOINC... cpdnmonitor: cannot open input file C:\ProgramData\BOINC/projects/climateprediction.net/hadcm3n_o2ta_2020_40_007857240/dataout/atmos_restart.day after 11 attempts CPDN Monitor - Quit request from BOINC... cpdnmonitor: cannot open input file C:\ProgramData\BOINC/projects/climateprediction.net/hadcm3n_o2ta_2020_40_007857240/dataout/atmos_restart.day after 11 attempts CPDN Monitor - Quit request from BOINC... cpdnmonitor: cannot open input file C:\ProgramData\BOINC/projects/climateprediction.net/hadcm3n_o2ta_2020_40_007857240/dataout/atmos_restart.day after 11 attempts CPDN Monitor - Quit request from BOINC... cpdnmonitor: cannot open input file C:\ProgramData\BOINC/projects/climateprediction.net/hadcm3n_o2ta_2020_40_007857240/dataout/atmos_restart.day after 11 attempts CPDN Monitor - Quit request from BOINC... cpdnmonitor: cannot open input file C:\ProgramData\BOINC/projects/climateprediction.net/hadcm3n_o2ta_2020_40_007857240/dataout/atmos_restart.day after 11 attempts CPDN Monitor - Quit request from BOINC... cpdnmonitor: cannot open input file C:\ProgramData\BOINC/projects/climateprediction.net/hadcm3n_o2ta_2020_40_007857240/dataout/atmos_restart.day after 11 attempts CPDN Monitor - Quit request from BOINC... cpdnmonitor: cannot open input file C:\ProgramData\BOINC/projects/climateprediction.net/hadcm3n_o2ta_2020_40_007857240/dataout/atmos_restart.day after 11 attempts CPDN Monitor - Quit request from BOINC... cpdnmonitor: cannot open input file C:\ProgramData\BOINC/projects/climateprediction.net/hadcm3n_o2ta_2020_40_007857240/dataout/atmos_restart.day after 11 attempts CPDN Monitor - Quit request from BOINC... cpdnmonitor: cannot open input file C:\ProgramData\BOINC/projects/climateprediction.net/hadcm3n_o2ta_2020_40_007857240/dataout/atmos_restart.day after 11 attempts CPDN Monitor - Quit request from BOINC... cpdnmonitor: cannot open input file C:\ProgramData\BOINC/projects/climateprediction.net/hadcm3n_o2ta_2020_40_007857240/dataout/atmos_restart.day after 11 attempts CPDN Monitor - Quit request from BOINC... cpdnmonitor: cannot open input file C:\ProgramData\BOINC/projects/climateprediction.net/hadcm3n_o2ta_2020_40_007857240/dataout/atmos_restart.day after 11 attempts CPDN Monitor - Quit request from BOINC... cpdnmonitor: cannot open input file C:\ProgramData\BOINC/projects/climateprediction.net/hadcm3n_o2ta_2020_40_007857240/dataout/atmos_restart.day after 11 attempts CPDN Monitor - Quit request from BOINC... cpdnmonitor: cannot open input file C:\ProgramData\BOINC/projects/climateprediction.net/hadcm3n_o2ta_2020_40_007857240/dataout/atmos_restart.day after 11 attempts CPDN Monitor - Quit request from BOINC... cpdnmonitor: cannot open input file C:\ProgramData\BOINC/projects/climateprediction.net/hadcm3n_o2ta_2020_40_007857240/dataout/atmos_restart.day after 11 attempts Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... cpdnmonitor: cannot open input file C:\ProgramData\BOINC/projects/climateprediction.net/hadcm3n_o2ta_2020_40_007857240/dataout/atmos_restart.day after 11 attempts CPDN Monitor - Quit request from BOINC... cpdnmonitor: cannot open input file C:\ProgramData\BOINC/projects/climateprediction.net/hadcm3n_o2ta_2020_40_007857240/dataout/atmos_restart.day after 11 attempts Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... cpdnmonitor: cannot open input file C:\ProgramData\BOINC/projects/climateprediction.net/hadcm3n_o2ta_2020_40_007857240/dataout/atmos_restart.day after 11 attempts CPDN Monitor - Quit request from BOINC... cpdnmonitor: cannot open input file C:\ProgramData\BOINC/projects/climateprediction.net/hadcm3n_o2ta_2020_40_007857240/dataout/atmos_restart.day after 11 attempts CPDN Monitor - Quit request from BOINC... cpdnmonitor: cannot open input file C:\ProgramData\BOINC/projects/climateprediction.net/hadcm3n_o2ta_2020_40_007857240/dataout/atmos_restart.day after 11 attempts CPDN Monitor - Quit request from BOINC... cpdnmonitor: cannot open input file C:\ProgramData\BOINC/projects/climateprediction.net/hadcm3n_o2ta_2020_40_007857240/dataout/atmos_restart.day after 11 attempts CPDN Monitor - Quit request from BOINC... cpdnmonitor: cannot open input file C:\ProgramData\BOINC/projects/climateprediction.net/hadcm3n_o2ta_2020_40_007857240/dataout/atmos_restart.day after 11 attempts CPDN Monitor - Quit request from BOINC... cpdnmonitor: cannot open input file C:\ProgramData\BOINC/projects/climateprediction.net/hadcm3n_o2ta_2020_40_007857240/dataout/atmos_restart.day after 11 attempts CPDN Monitor - Quit request from BOINC... cpdnmonitor: cannot open input file C:\ProgramData\BOINC/projects/climateprediction.net/hadcm3n_o2ta_2020_40_007857240/dataout/atmos_restart.day after 11 attempts CPDN Monitor - Quit request from BOINC... cpdnmonitor: cannot open input file C:\ProgramData\BOINC/projects/climateprediction.net/hadcm3n_o2ta_2020_40_007857240/dataout/atmos_restart.day after 11 attempts 16:09:46 (424): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... cpdnmonitor: cannot open input file C:\ProgramData\BOINC/projects/climateprediction.net/hadcm3n_o2ta_2020_40_007857240/dataout/atmos_restart.day after 11 attempts cpdnmonitor: cannot open input file C:\ProgramData\BOINC/projects/climateprediction.net/hadcm3n_o2ta_2020_40_007857240/dataout/atmos_restart.day after 11 attempts Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... cpdnmonitor: cannot open input file C:\ProgramData\BOINC/projects/climateprediction.net/hadcm3n_o2ta_2020_40_007857240/dataout/atmos_restart.day after 11 attempts CPDN Monitor - Quit request from BOINC... cpdnmonitor: cannot open input file C:\ProgramData\BOINC/projects/climateprediction.net/hadcm3n_o2ta_2020_40_007857240/dataout/atmos_restart.day after 11 attempts cpdnmonitor: cannot open input file C:\ProgramData\BOINC/projects/climateprediction.net/hadcm3n_o2ta_2020_40_007857240/dataout/atmos_restart.day after 11 attempts CPDN Monitor - Quit request from BOINC... cpdnmonitor: cannot open input file C:\ProgramData\BOINC/projects/climateprediction.net/hadcm3n_o2ta_2020_40_007857240/dataout/atmos_restart.day after 11 attempts 16:34:31 (1500): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:34:53 (1500): No heartbeat from core client for 30 sec - exiting 16:34:54 (1500): No heartbeat from core client for 30 sec - exiting 16:34:55 (1500): No heartbeat from core client for 30 sec - exiting cpdnmonitor: cannot open input file C:\ProgramData\BOINC/projects/climateprediction.net/hadcm3n_o2ta_2020_40_007857240/dataout/atmos_restart.day after 11 attempts cpdnmonitor: cannot open input file C:\ProgramData\BOINC/projects/climateprediction.net/hadcm3n_o2ta_2020_40_007857240/dataout/atmos_restart.day after 11 attempts 16:25:42 (2540): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:25:43 (2540): No heartbeat from core client for 30 sec - exiting cpdnmonitor: cannot open input file C:\ProgramData\BOINC/projects/climateprediction.net/hadcm3n_o2ta_2020_40_007857240/dataout/atmos_restart.day after 11 attempts CPDN Monitor - Quit request from BOINC... cpdnmonitor: cannot open input file C:\ProgramData\BOINC/projects/climateprediction.net/hadcm3n_o2ta_2020_40_007857240/dataout/atmos_restart.day after 11 attempts CPDN Monitor - Quit request from BOINC... cpdnmonitor: cannot open input file C:\ProgramData\BOINC/projects/climateprediction.net/hadcm3n_o2ta_2020_40_007857240/dataout/atmos_restart.day after 11 attempts CPDN Monitor - Quit request from BOINC... cpdnmonitor: cannot open input file C:\ProgramData\BOINC/projects/climateprediction.net/hadcm3n_o2ta_2020_40_007857240/dataout/atmos_restart.day after 11 attempts CPDN Monitor - Quit request from BOINC... cpdnmonitor: cannot open input file C:\ProgramData\BOINC/projects/climateprediction.net/hadcm3n_o2ta_2020_40_007857240/dataout/atmos_restart.day after 11 attempts CPDN Monitor - Quit request from BOINC... cpdnmonitor: cannot open input file C:\ProgramData\BOINC/projects/climateprediction.net/hadcm3n_o2ta_2020_40_007857240/dataout/atmos_restart.day after 11 attempts Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5204, iMonCtr=1 Model crash detected, will try to restart... cpdnmonitor: cannot open input file C:\ProgramData\BOINC/projects/climateprediction.net/hadcm3n_o2ta_2020_40_007857240/dataout/atmos_restart.day after 11 attempts Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5204, iMonCtr=1 Model crash detected, will try to restart... cpdnmonitor: cannot open input file C:\ProgramData\BOINC/projects/climateprediction.net/hadcm3n_o2ta_2020_40_007857240/dataout/atmos_restart.day after 11 attempts Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5204, iMonCtr=1 Model crash detected, will try to restart... cpdnmonitor: cannot open input file C:\ProgramData\BOINC/projects/climateprediction.net/hadcm3n_o2ta_2020_40_007857240/dataout/atmos_restart.day after 11 attempts Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5204, iMonCtr=1 Model crash detected, will try to restart... cpdnmonitor: cannot open input file C:\ProgramData\BOINC/projects/climateprediction.net/hadcm3n_o2ta_2020_40_007857240/dataout/atmos_restart.day after 11 attempts Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5204, iMonCtr=1 Model crash detected, will try to restart... cpdnmonitor: cannot open input file C:\ProgramData\BOINC/projects/climateprediction.net/hadcm3n_o2ta_2020_40_007857240/dataout/atmos_restart.day after 11 attempts Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5204, iMonCtr=1 Model crash detected, will try to restart... Sorry, too many model crashes! :-( Called boinc_finish CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5968, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5716, iMonCtr=1 Model crash detected, will try to restart... 22:26:57 (6024): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:26:59 (6024): No heartbeat from core client for 30 sec - exiting 22:27:00 (6024): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=8360, iMonCtr=1 Model crash detected, will try to restart... 11:40:17 (3576): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:40:20 (3576): No heartbeat from core client for 30 sec - exiting 11:40:21 (3576): No heartbeat from core client for 30 sec - exiting 11:40:23 (3576): No heartbeat from core client for 30 sec - exiting 11:40:24 (3576): No heartbeat from core client for 30 sec - exiting 11:47:36 (6012): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:47:38 (6012): No heartbeat from core client for 30 sec - exiting 11:47:39 (6012): No heartbeat from core client for 30 sec - exiting 11:47:40 (6012): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... 21:14:22 (5356): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:22:29 (4724): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:22:36 (4724): No heartbeat from core client for 30 sec - exiting 21:22:37 (4724): No heartbeat from core client for 30 sec - exiting 21:22:38 (4724): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... 23:20:45 (3552): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:20:48 (3552): No heartbeat from core client for 30 sec - exiting 23:20:49 (3552): No heartbeat from core client for 30 sec - exiting 23:20:50 (3552): No heartbeat from core client for 30 sec - exiting 23:20:52 (3552): No heartbeat from core client for 30 sec - exiting 23:27:26 (2940): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:27:40 (2940): No heartbeat from core client for 30 sec - exiting 23:27:41 (2940): No heartbeat from core client for 30 sec - exiting 23:27:42 (2940): No heartbeat from core client for 30 sec - exiting 23:27:43 (2940): No heartbeat from core client for 30 sec - exiting 23:27:44 (2940): No heartbeat from core client for 30 sec - exiting 23:27:45 (2940): No heartbeat from core client for 30 sec - exiting 23:27:46 (2940): No heartbeat from core client for 30 sec - exiting 23:34:39 (3460): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:34:49 (3460): No heartbeat from core client for 30 sec - exiting 23:34:57 (3460): No heartbeat from core client for 30 sec - exiting 23:34:59 (3460): No heartbeat from core client for 30 sec - exiting 23:35:00 (3460): No heartbeat from core client for 30 sec - exiting 23:35:01 (3460): No heartbeat from core client for 30 sec - exiting 23:35:03 (3460): No heartbeat from core client for 30 sec - exiting 23:35:04 (3460): No heartbeat from core client for 30 sec - exiting 23:42:04 (5408): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:42:10 (5408): No heartbeat from core client for 30 sec - exiting 23:42:11 (5408): No heartbeat from core client for 30 sec - exiting 23:42:12 (5408): No heartbeat from core client for 30 sec - exiting 23:42:13 (5408): No heartbeat from core client for 30 sec - exiting 23:42:14 (5408): No heartbeat from core client for 30 sec - exiting 23:48:54 (5040): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:48:59 (5040): No heartbeat from core client for 30 sec - exiting 23:49:00 (5040): No heartbeat from core client for 30 sec - exiting 23:49:01 (5040): No heartbeat from core client for 30 sec - exiting 23:49:03 (5040): No heartbeat from core client for 30 sec - exiting 23:49:06 (5040): No heartbeat from core client for 30 sec - exiting 23:49:08 (5040): No heartbeat from core client for 30 sec - exiting 23:56:15 (5556): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:56:30 (5556): No heartbeat from core client for 30 sec - exiting 23:56:34 (5556): No heartbeat from core client for 30 sec - exiting 23:56:35 (5556): No heartbeat from core client for 30 sec - exiting 23:56:37 (5556): No heartbeat from core client for 30 sec - exiting 23:56:38 (5556): No heartbeat from core client for 30 sec - exiting 23:56:39 (5556): No heartbeat from core client for 30 sec - exiting 23:56:40 (5556): No heartbeat from core client for 30 sec - exiting 23:56:41 (5556): No heartbeat from core client for 30 sec - exiting 23:56:43 (5556): No heartbeat from core client for 30 sec - exiting 23:56:44 (5556): No heartbeat from core client for 30 sec - exiting 23:56:45 (5556): No heartbeat from core client for 30 sec - exiting 23:56:46 (5556): No heartbeat from core client for 30 sec - exiting 23:56:47 (5556): No heartbeat from core client for 30 sec - exiting 00:03:29 (2136): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:03:39 (2136): No heartbeat from core client for 30 sec - exiting 00:03:41 (2136): No heartbeat from core client for 30 sec - exiting 00:03:42 (2136): No heartbeat from core client for 30 sec - exiting 00:03:43 (2136): No heartbeat from core client for 30 sec - exiting 00:03:44 (2136): No heartbeat from core client for 30 sec - exiting 00:03:45 (2136): No heartbeat from core client for 30 sec - exiting 00:03:46 (2136): No heartbeat from core client for 30 sec - exiting 00:10:46 (3644): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:11:06 (3644): No heartbeat from core client for 30 sec - exiting 00:11:20 (3644): No heartbeat from core client for 30 sec - exiting 00:11:22 (3644): No heartbeat from core client for 30 sec - exiting 00:11:23 (3644): No heartbeat from core client for 30 sec - exiting 00:11:25 (3644): No heartbeat from core client for 30 sec - exiting 00:11:26 (3644): No heartbeat from core client for 30 sec - exiting 00:11:27 (3644): No heartbeat from core client for 30 sec - exiting 00:18:23 (4992): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:18:34 (4992): No heartbeat from core client for 30 sec - exiting 00:18:35 (4992): No heartbeat from core client for 30 sec - exiting 00:18:36 (4992): No heartbeat from core client for 30 sec - exiting 00:25:09 (2760): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:25:22 (2760): No heartbeat from core client for 30 sec - exiting 00:25:23 (2760): No heartbeat from core client for 30 sec - exiting 00:25:24 (2760): No heartbeat from core client for 30 sec - exiting 00:25:25 (2760): No heartbeat from core client for 30 sec - exiting 00:25:27 (2760): No heartbeat from core client for 30 sec - exiting 00:25:28 (2760): No heartbeat from core client for 30 sec - exiting 00:25:29 (2760): No heartbeat from core client for 30 sec - exiting 00:32:24 (3736): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:32:35 (3736): No heartbeat from core client for 30 sec - exiting 00:32:36 (3736): No heartbeat from core client for 30 sec - exiting 00:32:37 (3736): No heartbeat from core client for 30 sec - exiting 00:32:38 (3736): No heartbeat from core client for 30 sec - exiting 00:40:08 (6044): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:40:21 (6044): No heartbeat from core client for 30 sec - exiting 00:40:22 (6044): No heartbeat from core client for 30 sec - exiting 00:40:23 (6044): No heartbeat from core client for 30 sec - exiting 00:40:25 (6044): No heartbeat from core client for 30 sec - exiting 00:40:27 (6044): No heartbeat from core client for 30 sec - exiting 00:40:36 (6044): No heartbeat from core client for 30 sec - exiting 00:40:41 (6044): No heartbeat from core client for 30 sec - exiting 00:47:15 (3660): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:47:23 (3660): No heartbeat from core client for 30 sec - exiting 00:47:24 (3660): No heartbeat from core client for 30 sec - exiting 00:47:25 (3660): No heartbeat from core client for 30 sec - exiting 00:54:23 (3688): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:54:28 (3688): No heartbeat from core client for 30 sec - exiting 00:54:29 (3688): No heartbeat from core client for 30 sec - exiting 00:54:31 (3688): No heartbeat from core client for 30 sec - exiting 00:54:32 (3688): No heartbeat from core client for 30 sec - exiting 00:54:33 (3688): No heartbeat from core client for 30 sec - exiting 01:00:41 (300): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:01:10 (300): No heartbeat from core client for 30 sec - exiting 01:01:14 (300): No heartbeat from core client for 30 sec - exiting 01:01:15 (300): No heartbeat from core client for 30 sec - exiting 01:01:16 (300): No heartbeat from core client for 30 sec - exiting 01:01:17 (300): No heartbeat from core client for 30 sec - exiting 01:01:18 (300): No heartbeat from core client for 30 sec - exiting 01:01:19 (300): No heartbeat from core client for 30 sec - exiting 01:01:21 (300): No heartbeat from core client for 30 sec - exiting 01:01:22 (300): No heartbeat from core client for 30 sec - exiting 01:01:23 (300): No heartbeat from core client for 30 sec - exiting 01:01:24 (300): No heartbeat from core client for 30 sec - exiting 01:01:25 (300): No heartbeat from core client for 30 sec - exiting 01:01:27 (300): No heartbeat from core client for 30 sec - exiting 01:01:28 (300): No heartbeat from core client for 30 sec - exiting 01:01:29 (300): No heartbeat from core client for 30 sec - exiting 01:01:30 (300): No heartbeat from core client for 30 sec - exiting 01:01:31 (300): No heartbeat from core client for 30 sec - exiting 01:08:51 (3936): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:08:57 (3936): No heartbeat from core client for 30 sec - exiting 01:08:58 (3936): No heartbeat from core client for 30 sec - exiting 01:09:01 (3936): No heartbeat from core client for 30 sec - exiting 01:09:02 (3936): No heartbeat from core client for 30 sec - exiting 01:09:03 (3936): No heartbeat from core client for 30 sec - exiting 01:09:04 (3936): No heartbeat from core client for 30 sec - exiting 01:09:05 (3936): No heartbeat from core client for 30 sec - exiting 01:09:07 (3936): No heartbeat from core client for 30 sec - exiting 01:09:08 (3936): No heartbeat from core client for 30 sec - exiting 01:09:10 (3936): No heartbeat from core client for 30 sec - exiting 01:09:11 (3936): No heartbeat from core client for 30 sec - exiting 01:09:12 (3936): No heartbeat from core client for 30 sec - exiting 01:09:13 (3936): No heartbeat from core client for 30 sec - exiting 01:09:15 (3936): No heartbeat from core client for 30 sec - exiting 01:16:33 (4796): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:16:35 (4796): No heartbeat from core client for 30 sec - exiting 01:16:36 (4796): No heartbeat from core client for 30 sec - exiting 01:16:37 (4796): No heartbeat from core client for 30 sec - exiting 01:16:38 (4796): No heartbeat from core client for 30 sec - exiting Atmos Hold Restart file rename failed on atmos_restart.hold 01:22:36 (5000): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:22:48 (5000): No heartbeat from core client for 30 sec - exiting 01:22:59 (5000): No heartbeat from core client for 30 sec - exiting 01:29:58 (2240): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:30:05 (2240): No heartbeat from core client for 30 sec - exiting 01:30:07 (2240): No heartbeat from core client for 30 sec - exiting 01:30:08 (2240): No heartbeat from core client for 30 sec - exiting 01:30:09 (2240): No heartbeat from core client for 30 sec - exiting 01:30:10 (2240): No heartbeat from core client for 30 sec - exiting 01:30:11 (2240): No heartbeat from core client for 30 sec - exiting 01:30:12 (2240): No heartbeat from core client for 30 sec - exiting 01:30:14 (2240): No heartbeat from core client for 30 sec - exiting 01:30:15 (2240): No heartbeat from core client for 30 sec - exiting 01:30:16 (2240): No heartbeat from core client for 30 sec - exiting 01:30:17 (2240): No heartbeat from core client for 30 sec - exiting 01:30:18 (2240): No heartbeat from core client for 30 sec - exiting 01:37:11 (3504): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:37:25 (3504): No heartbeat from core client for 30 sec - exiting 01:44:07 (5568): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:44:18 (5568): No heartbeat from core client for 30 sec - exiting 01:44:19 (5568): No heartbeat from core client for 30 sec - exiting 01:44:20 (5568): No heartbeat from core client for 30 sec - exiting 01:44:21 (5568): No heartbeat from core client for 30 sec - exiting 01:44:23 (5568): No heartbeat from core client for 30 sec - exiting 01:44:24 (5568): No heartbeat from core client for 30 sec - exiting 01:44:25 (5568): No heartbeat from core client for 30 sec - exiting 01:44:27 (5568): No heartbeat from core client for 30 sec - exiting 01:44:28 (5568): No heartbeat from core client for 30 sec - exiting 01:44:29 (5568): No heartbeat from core client for 30 sec - exiting 01:44:30 (5568): No heartbeat from core client for 30 sec - exiting 01:51:05 (840): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:51:15 (840): No heartbeat from core client for 30 sec - exiting 01:51:16 (840): No heartbeat from core client for 30 sec - exiting 01:51:17 (840): No heartbeat from core client for 30 sec - exiting 01:51:18 (840): No heartbeat from core client for 30 sec - exiting 01:51:19 (840): No heartbeat from core client for 30 sec - exiting 01:51:20 (840): No heartbeat from core client for 30 sec - exiting 01:51:21 (840): No heartbeat from core client for 30 sec - exiting 01:51:23 (840): No heartbeat from core client for 30 sec - exiting 01:58:07 (5980): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:58:25 (5980): No heartbeat from core client for 30 sec - exiting 01:58:26 (5980): No heartbeat from core client for 30 sec - exiting 01:58:27 (5980): No heartbeat from core client for 30 sec - exiting 01:58:28 (5980): No heartbeat from core client for 30 sec - exiting 01:58:30 (5980): No heartbeat from core client for 30 sec - exiting 01:58:31 (5980): No heartbeat from core client for 30 sec - exiting 01:58:32 (5980): No heartbeat from core client for 30 sec - exiting 01:58:33 (5980): No heartbeat from core client for 30 sec - exiting 01:58:35 (5980): No heartbeat from core client for 30 sec - exiting 01:58:36 (5980): No heartbeat from core client for 30 sec - exiting 01:58:37 (5980): No heartbeat from core client for 30 sec - exiting 01:58:38 (5980): No heartbeat from core client for 30 sec - exiting 02:05:30 (3868): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:05:44 (3868): No heartbeat from core client for 30 sec - exiting 02:05:47 (3868): No heartbeat from core client for 30 sec - exiting 02:05:56 (3868): No heartbeat from core client for 30 sec - exiting 02:05:57 (3868): No heartbeat from core client for 30 sec - exiting 02:05:58 (3868): No heartbeat from core client for 30 sec - exiting 02:05:59 (3868): No heartbeat from core client for 30 sec - exiting 02:06:00 (3868): No heartbeat from core client for 30 sec - exiting 02:06:01 (3868): No heartbeat from core client for 30 sec - exiting 02:12:48 (4052): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:12:56 (4052): No heartbeat from core client for 30 sec - exiting 02:12:57 (4052): No heartbeat from core client for 30 sec - exiting 02:12:58 (4052): No heartbeat from core client for 30 sec - exiting 02:12:59 (4052): No heartbeat from core client for 30 sec - exiting 02:13:00 (4052): No heartbeat from core client for 30 sec - exiting 02:13:01 (4052): No heartbeat from core client for 30 sec - exiting 02:13:02 (4052): No heartbeat from core client for 30 sec - exiting 02:19:27 (3952): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:19:43 (3952): No heartbeat from core client for 30 sec - exiting 02:19:50 (3952): No heartbeat from core client for 30 sec - exiting 02:19:51 (3952): No heartbeat from core client for 30 sec - exiting 02:26:49 (4456): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:34:14 (3664): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:34:18 (3664): No heartbeat from core client for 30 sec - exiting 02:34:19 (3664): No heartbeat from core client for 30 sec - exiting 02:34:21 (3664): No heartbeat from core client for 30 sec - exiting 02:34:22 (3664): No heartbeat from core client for 30 sec - exiting 02:40:40 (4932): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:40:44 (4932): No heartbeat from core client for 30 sec - exiting 02:40:45 (4932): No heartbeat from core client for 30 sec - exiting 02:40:46 (4932): No heartbeat from core client for 30 sec - exiting 02:40:48 (4932): No heartbeat from core client for 30 sec - exiting 02:40:49 (4932): No heartbeat from core client for 30 sec - exiting 02:48:26 (4796): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:54:52 (4776): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:54:57 (4776): No heartbeat from core client for 30 sec - exiting 02:54:58 (4776): No heartbeat from core client for 30 sec - exiting 02:54:59 (4776): No heartbeat from core client for 30 sec - exiting 02:55:00 (4776): No heartbeat from core client for 30 sec - exiting 03:01:28 (5012): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:01:42 (5012): No heartbeat from core client for 30 sec - exiting 03:01:44 (5012): No heartbeat from core client for 30 sec - exiting 03:01:45 (5012): No heartbeat from core client for 30 sec - exiting 03:01:47 (5012): No heartbeat from core client for 30 sec - exiting 03:01:51 (5012): No heartbeat from core client for 30 sec - exiting 03:01:52 (5012): No heartbeat from core client for 30 sec - exiting 03:09:07 (3508): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:09:16 (3508): No heartbeat from core client for 30 sec - exiting 03:09:17 (3508): No heartbeat from core client for 30 sec - exiting 03:09:18 (3508): No heartbeat from core client for 30 sec - exiting 03:09:19 (3508): No heartbeat from core client for 30 sec - exiting 03:09:20 (3508): No heartbeat from core client for 30 sec - exiting 03:09:21 (3508): No heartbeat from core client for 30 sec - exiting 03:09:22 (3508): No heartbeat from core client for 30 sec - exiting 03:09:23 (3508): No heartbeat from core client for 30 sec - exiting 03:09:24 (3508): No heartbeat from core client for 30 sec - exiting 03:09:26 (3508): No heartbeat from core client for 30 sec - exiting 03:09:27 (3508): No heartbeat from core client for 30 sec - exiting 03:09:29 (3508): No heartbeat from core client for 30 sec - exiting 03:16:19 (4864): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:16:31 (4864): No heartbeat from core client for 30 sec - exiting 03:16:32 (4864): No heartbeat from core client for 30 sec - exiting 03:16:33 (4864): No heartbeat from core client for 30 sec - exiting 03:16:34 (4864): No heartbeat from core client for 30 sec - exiting 03:16:36 (4864): No heartbeat from core client for 30 sec - exiting 03:16:37 (4864): No heartbeat from core client for 30 sec - exiting 03:16:38 (4864): No heartbeat from core client for 30 sec - exiting 03:16:39 (4864): No heartbeat from core client for 30 sec - exiting 03:16:40 (4864): No heartbeat from core client for 30 sec - exiting 03:16:41 (4864): No heartbeat from core client for 30 sec - exiting 03:16:42 (4864): No heartbeat from core client for 30 sec - exiting 03:23:56 (3816): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:24:01 (3816): No heartbeat from core client for 30 sec - exiting 03:24:02 (3816): No heartbeat from core client for 30 sec - exiting 03:24:03 (3816): No heartbeat from core client for 30 sec - exiting 03:24:05 (3816): No heartbeat from core client for 30 sec - exiting 03:24:06 (3816): No heartbeat from core client for 30 sec - exiting 03:24:07 (3816): No heartbeat from core client for 30 sec - exiting 03:24:08 (3816): No heartbeat from core client for 30 sec - exiting 03:24:09 (3816): No heartbeat from core client for 30 sec - exiting 03:24:10 (3816): No heartbeat from core client for 30 sec - exiting 03:24:11 (3816): No heartbeat from core client for 30 sec - exiting 03:24:12 (3816): No heartbeat from core client for 30 sec - exiting 03:24:14 (3816): No heartbeat from core client for 30 sec - exiting 03:30:39 (6412): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:30:45 (6412): No heartbeat from core client for 30 sec - exiting 03:30:46 (6412): No heartbeat from core client for 30 sec - exiting 03:30:47 (6412): No heartbeat from core client for 30 sec - exiting 03:30:48 (6412): No heartbeat from core client for 30 sec - exiting 03:30:49 (6412): No heartbeat from core client for 30 sec - exiting 03:30:50 (6412): No heartbeat from core client for 30 sec - exiting 03:30:51 (6412): No heartbeat from core client for 30 sec - exiting 03:37:39 (3008): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:37:48 (3008): No heartbeat from core client for 30 sec - exiting 03:37:49 (3008): No heartbeat from core client for 30 sec - exiting 03:37:50 (3008): No heartbeat from core client for 30 sec - exiting 03:37:52 (3008): No heartbeat from core client for 30 sec - exiting 03:37:53 (3008): No heartbeat from core client for 30 sec - exiting 03:37:54 (3008): No heartbeat from core client for 30 sec - exiting 03:37:55 (3008): No heartbeat from core client for 30 sec - exiting 03:44:17 (6916): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:44:21 (6916): No heartbeat from core client for 30 sec - exiting 03:44:22 (6916): No heartbeat from core client for 30 sec - exiting 03:44:24 (6916): No heartbeat from core client for 30 sec - exiting 03:44:25 (6916): No heartbeat from core client for 30 sec - exiting 03:51:39 (6536): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:51:55 (6536): No heartbeat from core client for 30 sec - exiting 03:51:56 (6536): No heartbeat from core client for 30 sec - exiting 03:51:57 (6536): No heartbeat from core client for 30 sec - exiting 03:51:58 (6536): No heartbeat from core client for 30 sec - exiting 03:51:59 (6536): No heartbeat from core client for 30 sec - exiting 03:52:01 (6536): No heartbeat from core client for 30 sec - exiting 03:52:02 (6536): No heartbeat from core client for 30 sec - exiting 03:59:43 (5632): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:59:47 (5632): No heartbeat from core client for 30 sec - exiting 03:59:48 (5632): No heartbeat from core client for 30 sec - exiting 03:59:50 (5632): No heartbeat from core client for 30 sec - exiting 03:59:53 (5632): No heartbeat from core client for 30 sec - exiting 04:07:14 (3696): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:07:37 (3696): No heartbeat from core client for 30 sec - exiting 04:07:39 (3696): No heartbeat from core client for 30 sec - exiting 04:07:40 (3696): No heartbeat from core client for 30 sec - exiting 04:07:41 (3696): No heartbeat from core client for 30 sec - exiting 04:07:43 (3696): No heartbeat from core client for 30 sec - exiting 04:07:44 (3696): No heartbeat from core client for 30 sec - exiting 04:07:45 (3696): No heartbeat from core client for 30 sec - exiting 04:07:47 (3696): No heartbeat from core client for 30 sec - exiting 04:07:48 (3696): No heartbeat from core client for 30 sec - exiting 04:07:49 (3696): No heartbeat from core client for 30 sec - exiting 04:07:50 (3696): No heartbeat from core client for 30 sec - exiting 04:07:51 (3696): No heartbeat from core client for 30 sec - exiting 04:07:52 (3696): No heartbeat from core client for 30 sec - exiting 04:07:53 (3696): No heartbeat from core client for 30 sec - exiting 04:07:54 (3696): No heartbeat from core client for 30 sec - exiting 04:14:35 (444): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:14:50 (444): No heartbeat from core client for 30 sec - exiting 04:14:52 (444): No heartbeat from core client for 30 sec - exiting 04:14:53 (444): No heartbeat from core client for 30 sec - exiting 04:14:54 (444): No heartbeat from core client for 30 sec - exiting 04:14:55 (444): No heartbeat from core client for 30 sec - exiting 04:14:56 (444): No heartbeat from core client for 30 sec - exiting 04:14:57 (444): No heartbeat from core client for 30 sec - exiting 04:14:58 (444): No heartbeat from core client for 30 sec - exiting 04:21:39 (4764): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:22:02 (4764): No heartbeat from core client for 30 sec - exiting 04:22:04 (4764): No heartbeat from core client for 30 sec - exiting 04:22:05 (4764): No heartbeat from core client for 30 sec - exiting 04:22:06 (4764): No heartbeat from core client for 30 sec - exiting 04:22:08 (4764): No heartbeat from core client for 30 sec - exiting 04:28:50 (6376): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:29:03 (6376): No heartbeat from core client for 30 sec - exiting 04:29:06 (6376): No heartbeat from core client for 30 sec - exiting 04:29:07 (6376): No heartbeat from core client for 30 sec - exiting 04:29:08 (6376): No heartbeat from core client for 30 sec - exiting 04:29:09 (6376): No heartbeat from core client for 30 sec - exiting 04:29:10 (6376): No heartbeat from core client for 30 sec - exiting 04:29:12 (6376): No heartbeat from core client for 30 sec - exiting 04:29:13 (6376): No heartbeat from core client for 30 sec - exiting 04:29:14 (6376): No heartbeat from core client for 30 sec - exiting 04:29:15 (6376): No heartbeat from core client for 30 sec - exiting 04:29:16 (6376): No heartbeat from core client for 30 sec - exiting 04:29:17 (6376): No heartbeat from core client for 30 sec - exiting 04:36:32 (4900): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:36:44 (4900): No heartbeat from core client for 30 sec - exiting 04:36:45 (4900): No heartbeat from core client for 30 sec - exiting 04:36:46 (4900): No heartbeat from core client for 30 sec - exiting 04:36:47 (4900): No heartbeat from core client for 30 sec - exiting 04:36:49 (4900): No heartbeat from core client for 30 sec - exiting 04:36:50 (4900): No heartbeat from core client for 30 sec - exiting 04:36:51 (4900): No heartbeat from core client for 30 sec - exiting 04:36:58 (4900): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 11:42:57 (7648): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:43:10 (7648): No heartbeat from core client for 30 sec - exiting 11:43:12 (7648): No heartbeat from core client for 30 sec - exiting 11:43:13 (7648): No heartbeat from core client for 30 sec - exiting 11:43:14 (7648): No heartbeat from core client for 30 sec - exiting 11:43:15 (7648): No heartbeat from core client for 30 sec - exiting 11:43:16 (7648): No heartbeat from core client for 30 sec - exiting 11:43:17 (7648): No heartbeat from core client for 30 sec - exiting 11:43:18 (7648): No heartbeat from core client for 30 sec - exiting 11:43:19 (7648): No heartbeat from core client for 30 sec - exiting 11:43:20 (7648): No heartbeat from core client for 30 sec - exiting 11:43:21 (7648): No heartbeat from core client for 30 sec - exiting 11:43:22 (7648): No heartbeat from core client for 30 sec - exiting 11:43:23 (7648): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... 18:30:47 (5428): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:30:52 (5428): No heartbeat from core client for 30 sec - exiting 18:30:53 (5428): No heartbeat from core client for 30 sec - exiting 18:30:54 (5428): No heartbeat from core client for 30 sec - exiting 18:30:55 (5428): No heartbeat from core client for 30 sec - exiting 18:30:56 (5428): No heartbeat from core client for 30 sec - exiting 18:38:10 (5184): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:38:18 (5184): No heartbeat from core client for 30 sec - exiting 18:38:20 (5184): No heartbeat from core client for 30 sec - exiting 18:38:28 (5184): No heartbeat from core client for 30 sec - exiting 18:38:29 (5184): No heartbeat from core client for 30 sec - exiting 18:38:31 (5184): No heartbeat from core client for 30 sec - exiting 18:38:32 (5184): No heartbeat from core client for 30 sec - exiting 18:45:37 (5816): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:45:47 (5816): No heartbeat from core client for 30 sec - exiting 18:45:48 (5816): No heartbeat from core client for 30 sec - exiting 18:45:49 (5816): No heartbeat from core client for 30 sec - exiting 18:45:51 (5816): No heartbeat from core client for 30 sec - exiting 18:45:52 (5816): No heartbeat from core client for 30 sec - exiting 18:45:53 (5816): No heartbeat from core client for 30 sec - exiting 18:45:54 (5816): No heartbeat from core client for 30 sec - exiting 18:45:55 (5816): No heartbeat from core client for 30 sec - exiting 18:45:56 (5816): No heartbeat from core client for 30 sec - exiting 18:54:25 (4272): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:54:27 (4272): No heartbeat from core client for 30 sec - exiting 18:54:29 (4272): No heartbeat from core client for 30 sec - exiting 19:00:44 (5408): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:00:51 (5408): No heartbeat from core client for 30 sec - exiting 19:00:52 (5408): No heartbeat from core client for 30 sec - exiting 19:00:53 (5408): No heartbeat from core client for 30 sec - exiting 19:00:54 (5408): No heartbeat from core client for 30 sec - exiting 19:00:56 (5408): No heartbeat from core client for 30 sec - exiting 19:00:58 (5408): No heartbeat from core client for 30 sec - exiting 19:01:00 (5408): No heartbeat from core client for 30 sec - exiting 19:01:01 (5408): No heartbeat from core client for 30 sec - exiting 19:01:02 (5408): No heartbeat from core client for 30 sec - exiting 19:01:03 (5408): No heartbeat from core client for 30 sec - exiting 19:01:05 (5408): No heartbeat from core client for 30 sec - exiting 19:01:07 (5408): No heartbeat from core client for 30 sec - exiting 19:08:05 (2112): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:08:13 (2112): No heartbeat from core client for 30 sec - exiting 19:08:14 (2112): No heartbeat from core client for 30 sec - exiting 19:08:15 (2112): No heartbeat from core client for 30 sec - exiting 19:08:17 (2112): No heartbeat from core client for 30 sec - exiting 19:08:18 (2112): No heartbeat from core client for 30 sec - exiting Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 Sorry, too many model crashes! :-( Called boinc_finish </stderr_txt> ]]> |
Latest Trickles Received | ||||||
---|---|---|---|---|---|---|
Time Sent (UTC) | Host ID | Result ID | Result Name | Timestep | CPU Time (sec) | Average (sec/TS) |
22 May 2012 00:52:44 | 1183901 | 14361172 | hadcm3n_o2ta_2020_40_007857240_3 | 1,010,880 | 1,919,095 | 1.8984 |
21 May 2012 10:46:15 | 1183901 | 14361172 | hadcm3n_o2ta_2020_40_007857240_3 | 984,960 | 1,870,209 | 1.8988 |
20 May 2012 20:56:53 | 1183901 | 14361172 | hadcm3n_o2ta_2020_40_007857240_3 | 959,040 | 1,821,579 | 1.8994 |
20 May 2012 00:56:02 | 1183901 | 14361172 | hadcm3n_o2ta_2020_40_007857240_3 | 933,120 | 1,773,425 | 1.9005 |
19 May 2012 11:07:23 | 1183901 | 14361172 | hadcm3n_o2ta_2020_40_007857240_3 | 907,200 | 1,725,191 | 1.9017 |
18 May 2012 11:48:35 | 1183901 | 14361172 | hadcm3n_o2ta_2020_40_007857240_3 | 881,280 | 1,677,269 | 1.9032 |
16 May 2012 22:04:20 | 1183901 | 14361172 | hadcm3n_o2ta_2020_40_007857240_3 | 855,360 | 1,630,769 | 1.9065 |
16 May 2012 06:39:52 | 1183901 | 14361172 | hadcm3n_o2ta_2020_40_007857240_3 | 829,440 | 1,580,191 | 1.9051 |
15 May 2012 15:20:52 | 1183901 | 14361172 | hadcm3n_o2ta_2020_40_007857240_3 | 803,520 | 1,529,278 | 1.9032 |
15 May 2012 01:04:15 | 1183901 | 14361172 | hadcm3n_o2ta_2020_40_007857240_3 | 777,600 | 1,477,800 | 1.9005 |
11 May 2012 08:21:20 | 1183901 | 14361172 | hadcm3n_o2ta_2020_40_007857240_3 | 751,680 | 1,427,110 | 1.8986 |
10 May 2012 18:19:18 | 1183901 | 14361172 | hadcm3n_o2ta_2020_40_007857240_3 | 725,760 | 1,376,426 | 1.8965 |
09 May 2012 03:54:05 | 1183901 | 14361172 | hadcm3n_o2ta_2020_40_007857240_3 | 699,840 | 1,326,097 | 1.8949 |
08 May 2012 13:08:41 | 1183901 | 14361172 | hadcm3n_o2ta_2020_40_007857240_3 | 673,920 | 1,276,909 | 1.8947 |
07 May 2012 22:23:56 | 1183901 | 14361172 | hadcm3n_o2ta_2020_40_007857240_3 | 648,000 | 1,227,838 | 1.8948 |
07 May 2012 06:08:58 | 1183901 | 14361172 | hadcm3n_o2ta_2020_40_007857240_3 | 622,080 | 1,177,711 | 1.8932 |
06 May 2012 15:26:43 | 1183901 | 14361172 | hadcm3n_o2ta_2020_40_007857240_3 | 596,160 | 1,127,827 | 1.8918 |
06 May 2012 00:23:05 | 1183901 | 14361172 | hadcm3n_o2ta_2020_40_007857240_3 | 570,240 | 1,077,043 | 1.8888 |
05 May 2012 10:20:44 | 1183901 | 14361172 | hadcm3n_o2ta_2020_40_007857240_3 | 544,320 | 1,027,187 | 1.8871 |
04 May 2012 18:20:54 | 1183901 | 14361172 | hadcm3n_o2ta_2020_40_007857240_3 | 518,400 | 978,404 | 1.8874 |
©2024 climateprediction.net