Name | hadcm3n_o5cf_1940_40_008411073_1 |
Workunit | 8561929 |
Created | 25 Nov 2013, 22:21:37 UTC |
Sent | 26 Nov 2013, 0:29:06 UTC |
Report deadline | 25 Feb 2014, 7:56:17 UTC |
Received | 5 Jan 2014, 18:59:24 UTC |
Server state | Over |
Outcome | Computation error |
Client state | Compute error |
Exit status | 22 (0x00000016) Unknown error code |
Computer ID | 1268519 |
Run time | 30 days 22 hours 29 min 26 sec |
CPU time | 25 days 16 hours 3 min 34 sec |
Validate state | Invalid |
Credit | 8,709.12 |
Device peak FLOPS | 1.58 GFLOPS |
Application version | UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86 |
Stderr | <core_client_version>7.2.33</core_client_version> <![CDATA[ <message> The device does not recognize the command. (0x16) - exit code 22 (0x16) </message> <stderr_txt> l crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 20:29:36 (3388): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 19:05:15 (2296): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:05:16 (2296): No heartbeat from core client for 30 sec - exiting 19:05:17 (2296): No heartbeat from core client for 30 sec - exiting 19:05:18 (2296): No heartbeat from core client for 30 sec - exiting 19:05:19 (2296): No heartbeat from core client for 30 sec - exiting 19:05:20 (2296): No heartbeat from core client for 30 sec - exiting 19:05:21 (2296): No heartbeat from core client for 30 sec - exiting 19:05:22 (2296): No heartbeat from core client for 30 sec - exiting 19:05:23 (2296): No heartbeat from core client for 30 sec - exiting 19:05:24 (2296): No heartbeat from core client for 30 sec - exiting 19:05:25 (2296): No heartbeat from core client for 30 sec - exiting 19:08:47 (3172): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:08:48 (3172): No heartbeat from core client for 30 sec - exiting 19:08:49 (3172): No heartbeat from core client for 30 sec - exiting 19:08:50 (3172): No heartbeat from core client for 30 sec - exiting 19:08:51 (3172): No heartbeat from core client for 30 sec - exiting 19:08:52 (3172): No heartbeat from core client for 30 sec - exiting 19:08:53 (3172): No heartbeat from core client for 30 sec - exiting 19:08:54 (3172): No heartbeat from core client for 30 sec - exiting 19:08:55 (3172): No heartbeat from core client for 30 sec - exiting 19:08:56 (3172): No heartbeat from core client for 30 sec - exiting 19:08:57 (3172): No heartbeat from core client for 30 sec - exiting 19:12:51 (3060): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:12:52 (3060): No heartbeat from core client for 30 sec - exiting 19:12:53 (3060): No heartbeat from core client for 30 sec - exiting 19:12:54 (3060): No heartbeat from core client for 30 sec - exiting 19:12:55 (3060): No heartbeat from core client for 30 sec - exiting 19:12:56 (3060): No heartbeat from core client for 30 sec - exiting 19:12:57 (3060): No heartbeat from core client for 30 sec - exiting 19:12:58 (3060): No heartbeat from core client for 30 sec - exiting 19:12:59 (3060): No heartbeat from core client for 30 sec - exiting 19:13:00 (3060): No heartbeat from core client for 30 sec - exiting 19:13:01 (3060): No heartbeat from core client for 30 sec - exiting 19:17:32 (3600): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:17:33 (3600): No heartbeat from core client for 30 sec - exiting 19:17:34 (3600): No heartbeat from core client for 30 sec - exiting 19:17:35 (3600): No heartbeat from core client for 30 sec - exiting 19:17:36 (3600): No heartbeat from core client for 30 sec - exiting 19:17:37 (3600): No heartbeat from core client for 30 sec - exiting 19:17:38 (3600): No heartbeat from core client for 30 sec - exiting 19:17:40 (3600): No heartbeat from core client for 30 sec - exiting 19:17:41 (3600): No heartbeat from core client for 30 sec - exiting 19:17:42 (3600): No heartbeat from core client for 30 sec - exiting 22:11:11 (1228): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:15:29 (3980): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:15:30 (3980): No heartbeat from core client for 30 sec - exiting 22:15:31 (3980): No heartbeat from core client for 30 sec - exiting 22:15:32 (3980): No heartbeat from core client for 30 sec - exiting 22:15:33 (3980): No heartbeat from core client for 30 sec - exiting 22:15:34 (3980): No heartbeat from core client for 30 sec - exiting 22:15:35 (3980): No heartbeat from core client for 30 sec - exiting 22:15:36 (3980): No heartbeat from core client for 30 sec - exiting 22:15:37 (3980): No heartbeat from core client for 30 sec - exiting 22:15:38 (3980): No heartbeat from core client for 30 sec - exiting 22:15:39 (3980): No heartbeat from core client for 30 sec - exiting 22:20:11 (700): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:20:12 (700): No heartbeat from core client for 30 sec - exiting 22:20:13 (700): No heartbeat from core client for 30 sec - exiting 22:20:14 (700): No heartbeat from core client for 30 sec - exiting 22:20:15 (700): No heartbeat from core client for 30 sec - exiting 22:20:16 (700): No heartbeat from core client for 30 sec - exiting 22:20:17 (700): No heartbeat from core client for 30 sec - exiting 22:20:18 (700): No heartbeat from core client for 30 sec - exiting 22:20:19 (700): No heartbeat from core client for 30 sec - exiting 22:20:20 (700): No heartbeat from core client for 30 sec - exiting 22:20:21 (700): No heartbeat from core client for 30 sec - exiting 22:25:00 (4064): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:25:01 (4064): No heartbeat from core client for 30 sec - exiting 22:25:02 (4064): No heartbeat from core client for 30 sec - exiting 22:25:03 (4064): No heartbeat from core client for 30 sec - exiting 22:25:04 (4064): No heartbeat from core client for 30 sec - exiting 22:25:05 (4064): No heartbeat from core client for 30 sec - exiting 22:25:06 (4064): No heartbeat from core client for 30 sec - exiting 22:25:07 (4064): No heartbeat from core client for 30 sec - exiting 22:25:08 (4064): No heartbeat from core client for 30 sec - exiting 22:25:09 (4064): No heartbeat from core client for 30 sec - exiting 22:25:10 (4064): No heartbeat from core client for 30 sec - exiting 22:29:52 (5076): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:29:53 (5076): No heartbeat from core client for 30 sec - exiting 22:29:54 (5076): No heartbeat from core client for 30 sec - exiting 22:29:56 (5076): No heartbeat from core client for 30 sec - exiting 22:29:57 (5076): No heartbeat from core client for 30 sec - exiting 22:29:58 (5076): No heartbeat from core client for 30 sec - exiting 22:29:59 (5076): No heartbeat from core client for 30 sec - exiting 22:30:00 (5076): No heartbeat from core client for 30 sec - exiting 22:30:01 (5076): No heartbeat from core client for 30 sec - exiting 22:30:02 (5076): No heartbeat from core client for 30 sec - exiting 22:33:56 (3880): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:33:57 (3880): No heartbeat from core client for 30 sec - exiting 22:33:58 (3880): No heartbeat from core client for 30 sec - exiting 22:33:59 (3880): No heartbeat from core client for 30 sec - exiting 22:34:00 (3880): No heartbeat from core client for 30 sec - exiting 22:34:01 (3880): No heartbeat from core client for 30 sec - exiting 22:34:02 (3880): No heartbeat from core client for 30 sec - exiting 22:34:03 (3880): No heartbeat from core client for 30 sec - exiting 22:34:04 (3880): No heartbeat from core client for 30 sec - exiting 22:34:05 (3880): No heartbeat from core client for 30 sec - exiting 22:34:06 (3880): No heartbeat from core client for 30 sec - exiting 22:38:34 (4492): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:38:36 (4492): No heartbeat from core client for 30 sec - exiting 22:42:10 (1880): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:42:11 (1880): No heartbeat from core client for 30 sec - exiting 22:42:12 (1880): No heartbeat from core client for 30 sec - exiting 22:42:13 (1880): No heartbeat from core client for 30 sec - exiting 22:42:14 (1880): No heartbeat from core client for 30 sec - exiting 22:42:15 (1880): No heartbeat from core client for 30 sec - exiting 22:42:16 (1880): No heartbeat from core client for 30 sec - exiting 22:42:17 (1880): No heartbeat from core client for 30 sec - exiting 22:42:18 (1880): No heartbeat from core client for 30 sec - exiting 22:42:19 (1880): No heartbeat from core client for 30 sec - exiting 22:42:20 (1880): No heartbeat from core client for 30 sec - exiting 22:48:08 (4372): No heartbeat from core client for 30 sec - exiting 22:48:39 (4372): No heartbeat from core client for 30 sec - exiting 22:48:40 (4372): No heartbeat from core client for 30 sec - exiting 22:48:41 (4372): No heartbeat from core client for 30 sec - exiting 22:48:42 (4372): No heartbeat from core client for 30 sec - exiting 22:48:43 (4372): No heartbeat from core client for 30 sec - exiting 22:48:44 (4372): No heartbeat from core client for 30 sec - exiting 22:48:45 (4372): No heartbeat from core client for 30 sec - exiting 22:48:46 (4372): No heartbeat from core client for 30 sec - exiting 22:48:47 (4372): No heartbeat from core client for 30 sec - exiting 22:48:48 (4372): No heartbeat from core client for 30 sec - exiting 22:48:49 (4372): No heartbeat from core client for 30 sec - exiting 22:48:50 (4372): No heartbeat from core client for 30 sec - exiting 22:48:51 (4372): No heartbeat from core client for 30 sec - exiting 22:48:52 (4372): No heartbeat from core client for 30 sec - exiting 22:48:53 (4372): No heartbeat from core client for 30 sec - exiting 22:48:54 (4372): No heartbeat from core client for 30 sec - exiting 22:48:55 (4372): No heartbeat from core client for 30 sec - exiting 22:48:56 (4372): No heartbeat from core client for 30 sec - exiting 22:48:57 (4372): No heartbeat from core client for 30 sec - exiting 22:48:58 (4372): No heartbeat from core client for 30 sec - exiting 22:48:59 (4372): No heartbeat from core client for 30 sec - exiting 22:49:00 (4372): No heartbeat from core client for 30 sec - exiting 22:49:01 (4372): No heartbeat from core client for 30 sec - exiting 22:49:02 (4372): No heartbeat from core client for 30 sec - exiting 22:49:03 (4372): No heartbeat from core client for 30 sec - exiting 22:49:05 (4372): No heartbeat from core client for 30 sec - exiting 22:49:06 (4372): No heartbeat from core client for 30 sec - exiting 22:49:07 (4372): No heartbeat from core client for 30 sec - exiting 22:49:08 (4372): No heartbeat from core client for 30 sec - exiting 22:49:09 (4372): No heartbeat from core client for 30 sec - exiting 22:49:10 (4372): No heartbeat from core client for 30 sec - exiting 22:49:11 (4372): No heartbeat from core client for 30 sec - exiting 22:49:12 (4372): No heartbeat from core client for 30 sec - exiting 22:49:13 (4372): No heartbeat from core client for 30 sec - exiting 22:49:14 (4372): No heartbeat from core client for 30 sec - exiting 22:49:15 (4372): No heartbeat from core client for 30 sec - exiting 22:49:16 (4372): No heartbeat from core client for 30 sec - exiting 22:49:18 (4372): No heartbeat from core client for 30 sec - exiting 22:49:19 (4372): No heartbeat from core client for 30 sec - exiting 22:49:20 (4372): No heartbeat from core client for 30 sec - exiting 22:49:21 (4372): No heartbeat from core client for 30 sec - exiting 22:49:22 (4372): No heartbeat from core client for 30 sec - exiting 22:49:23 (4372): No heartbeat from core client for 30 sec - exiting 22:49:24 (4372): No heartbeat from core client for 30 sec - exiting 22:49:25 (4372): No heartbeat from core client for 30 sec - exiting 22:49:26 (4372): No heartbeat from core client for 30 sec - exiting 22:49:27 (4372): No heartbeat from core client for 30 sec - exiting 22:49:28 (4372): No heartbeat from core client for 30 sec - exiting 22:49:29 (4372): No heartbeat from core client for 30 sec - exiting 22:49:30 (4372): No heartbeat from core client for 30 sec - exiting 22:49:31 (4372): No heartbeat from core client for 30 sec - exiting 22:49:32 (4372): No heartbeat from core client for 30 sec - exiting 22:49:33 (4372): No heartbeat from core client for 30 sec - exiting 22:49:34 (4372): No heartbeat from core client for 30 sec - exiting 22:49:35 (4372): No heartbeat from core client for 30 sec - exiting 22:49:36 (4372): No heartbeat from core client for 30 sec - exiting 22:49:37 (4372): No heartbeat from core client for 30 sec - exiting 22:49:38 (4372): No heartbeat from core client for 30 sec - exiting 22:49:39 (4372): No heartbeat from core client for 30 sec - exiting 22:49:40 (4372): No heartbeat from core client for 30 sec - exiting 22:49:41 (4372): No heartbeat from core client for 30 sec - exiting 22:49:42 (4372): No heartbeat from core client for 30 sec - exiting 22:49:43 (4372): No heartbeat from core client for 30 sec - exiting 22:49:44 (4372): No heartbeat from core client for 30 sec - exiting 22:49:45 (4372): No heartbeat from core client for 30 sec - exiting 22:49:46 (4372): No heartbeat from core client for 30 sec - exiting 22:49:47 (4372): No heartbeat from core client for 30 sec - exiting 22:49:48 (4372): No heartbeat from core client for 30 sec - exiting 22:49:49 (4372): No heartbeat from core client for 30 sec - exiting 22:49:50 (4372): No heartbeat from core client for 30 sec - exiting 22:49:51 (4372): No heartbeat from core client for 30 sec - exiting 22:49:52 (4372): No heartbeat from core client for 30 sec - exiting 22:49:53 (4372): No heartbeat from core client for 30 sec - exiting 22:49:54 (4372): No heartbeat from core client for 30 sec - exiting 22:49:55 (4372): No heartbeat from core client for 30 sec - exiting 22:49:56 (4372): No heartbeat from core client for 30 sec - exiting 22:49:57 (4372): No heartbeat from core client for 30 sec - exiting 22:49:58 (4372): No heartbeat from core client for 30 sec - exiting 22:49:59 (4372): No heartbeat from core client for 30 sec - exiting 22:50:00 (4372): No heartbeat from core client for 30 sec - exiting 22:50:01 (4372): No heartbeat from core client for 30 sec - exiting 22:50:02 (4372): No heartbeat from core client for 30 sec - exiting 22:50:03 (4372): No heartbeat from core client for 30 sec - exiting 22:50:04 (4372): No heartbeat from core client for 30 sec - exiting 22:50:05 (4372): No heartbeat from core client for 30 sec - exiting 22:50:06 (4372): No heartbeat from core client for 30 sec - exiting 22:50:07 (4372): No heartbeat from core client for 30 sec - exiting 22:50:08 (4372): No heartbeat from core client for 30 sec - exiting 22:50:09 (4372): No heartbeat from core client for 30 sec - exiting 22:50:10 (4372): No heartbeat from core client for 30 sec - exiting 22:50:11 (4372): No heartbeat from core client for 30 sec - exiting 22:50:12 (4372): No heartbeat from core client for 30 sec - exiting 22:50:13 (4372): No heartbeat from core client for 30 sec - exiting 22:50:15 (4372): No heartbeat from core client for 30 sec - exiting 22:50:16 (4372): No heartbeat from core client for 30 sec - exiting 22:50:17 (4372): No heartbeat from core client for 30 sec - exiting 22:50:18 (4372): No heartbeat from core client for 30 sec - exiting 22:50:19 (4372): No heartbeat from core client for 30 sec - exiting 22:50:20 (4372): No heartbeat from core client for 30 sec - exiting 22:50:21 (4372): No heartbeat from core client for 30 sec - exiting 22:50:22 (4372): No heartbeat from core client for 30 sec - exiting 22:50:23 (4372): No heartbeat from core client for 30 sec - exiting 22:50:24 (4372): No heartbeat from core client for 30 sec - exiting 22:50:25 (4372): No heartbeat from core client for 30 sec - exiting 22:50:26 (4372): No heartbeat from core client for 30 sec - exiting 22:50:27 (4372): No heartbeat from core client for 30 sec - exiting 22:50:28 (4372): No heartbeat from core client for 30 sec - exiting 22:50:29 (4372): No heartbeat from core client for 30 sec - exiting 22:50:30 (4372): No heartbeat from core client for 30 sec - exiting 22:50:31 (4372): No heartbeat from core client for 30 sec - exiting 22:50:32 (4372): No heartbeat from core client for 30 sec - exiting 22:50:33 (4372): No heartbeat from core client for 30 sec - exiting 22:50:34 (4372): No heartbeat from core client for 30 sec - exiting 22:50:35 (4372): No heartbeat from core client for 30 sec - exiting 22:50:36 (4372): No heartbeat from core client for 30 sec - exiting 22:50:37 (4372): No heartbeat from core client for 30 sec - exiting 22:50:38 (4372): No heartbeat from core client for 30 sec - exiting 22:50:39 (4372): No heartbeat from core client for 30 sec - exiting 22:50:40 (4372): No heartbeat from core client for 30 sec - exiting 22:50:41 (4372): No heartbeat from core client for 30 sec - exiting 22:50:42 (4372): No heartbeat from core client for 30 sec - exiting 22:50:43 (4372): No heartbeat from core client for 30 sec - exiting 22:50:44 (4372): No heartbeat from core client for 30 sec - exiting 22:50:45 (4372): No heartbeat from core client for 30 sec - exiting 22:50:46 (4372): No heartbeat from core client for 30 sec - exiting 22:50:47 (4372): No heartbeat from core client for 30 sec - exiting 22:50:48 (4372): No heartbeat from core client for 30 sec - exiting 22:50:49 (4372): No heartbeat from core client for 30 sec - exiting 22:50:50 (4372): No heartbeat from core client for 30 sec - exiting 22:50:51 (4372): No heartbeat from core client for 30 sec - exiting 22:50:52 (4372): No heartbeat from core client for 30 sec - exiting 22:50:53 (4372): No heartbeat from core client for 30 sec - exiting 22:50:54 (4372): No heartbeat from core client for 30 sec - exiting 22:50:55 (4372): No heartbeat from core client for 30 sec - exiting 22:50:56 (4372): No heartbeat from core client for 30 sec - exiting 22:50:57 (4372): No heartbeat from core client for 30 sec - exiting 22:51:03 (4372): No heartbeat from core client for 30 sec - exiting 22:51:49 (4372): No heartbeat from core client for 30 sec - exiting 22:51:50 (4372): No heartbeat from core client for 30 sec - exiting 22:51:51 (4372): No heartbeat from core client for 30 sec - exiting 22:51:52 (4372): No heartbeat from core client for 30 sec - exiting 22:51:53 (4372): No heartbeat from core client for 30 sec - exiting 22:51:54 (4372): No heartbeat from core client for 30 sec - exiting 22:51:55 (4372): No heartbeat from core client for 30 sec - exiting 22:51:56 (4372): No heartbeat from core client for 30 sec - exiting 22:51:57 (4372): No heartbeat from core client for 30 sec - exiting 22:51:58 (4372): No heartbeat from core client for 30 sec - exiting 22:51:59 (4372): No heartbeat from core client for 30 sec - exiting 22:52:00 (4372): No heartbeat from core client for 30 sec - exiting 22:52:01 (4372): No heartbeat from core client for 30 sec - exiting 22:52:02 (4372): No heartbeat from core client for 30 sec - exiting 22:52:03 (4372): No heartbeat from core client for 30 sec - exiting 22:52:04 (4372): No heartbeat from core client for 30 sec - exiting 22:52:05 (4372): No heartbeat from core client for 30 sec - exiting 22:52:06 (4372): No heartbeat from core client for 30 sec - exiting 22:52:07 (4372): No heartbeat from core client for 30 sec - exiting 22:52:50 (4372): No heartbeat from core client for 30 sec - exiting 22:52:51 (4372): No heartbeat from core client for 30 sec - exiting 22:52:53 (4372): No heartbeat from core client for 30 sec - exiting 22:52:54 (4372): No heartbeat from core client for 30 sec - exiting 22:52:56 (4372): No heartbeat from core client for 30 sec - exiting 22:52:57 (4372): No heartbeat from core client for 30 sec - exiting 22:52:59 (4372): No heartbeat from core client for 30 sec - exiting 22:53:00 (4372): No heartbeat from core client for 30 sec - exiting 22:53:01 (4372): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:03:18 (4492): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:03:19 (4492): No heartbeat from core client for 30 sec - exiting 23:03:21 (4492): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 23:01:37 (3204): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:01:38 (3204): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from09:42:35 (3472): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:12:01 (3852): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 09:55:34 (1496): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:55:35 (1496): No heartbeat from core client for 30 sec - exiting 09:55:36 (1496): No heartbeat from core client for 30 sec - exiting 09:55:37 (1496): No heartbeat from core client for 30 sec - exiting 09:55:38 (1496): No heartbeat from core client for 30 sec - exiting 09:55:40 (1496): No heartbeat from core client for 30 sec - exiting 09:55:41 (1496): No heartbeat from core client for 30 sec - exiting 09:55:42 (1496): No heartbeat from core client for 30 sec - exiting 09:55:43 (1496): No heartbeat from core client for 30 sec - exiting 09:55:44 (1496): No heartbeat from core client for 30 sec - exiting 09:01:11 (864): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:01:12 (864): No heartbeat from core client for 30 sec - exiting 09:01:13 (864): No heartbeat from core client for 30 sec - exiting 09:01:14 (864): No heartbeat from core client for 30 sec - exiting 09:01:15 (864): No heartbeat from core client for 30 sec - exiting 09:01:16 (864): No heartbeat from core client for 30 sec - exiting 09:01:17 (864): No heartbeat from core client for 30 sec - exiting 09:01:18 (864): No heartbeat from core client for 30 sec - exiting 20:16:13 (4916): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:16:15 (4916): No heartbeat from core client for 30 sec - exiting 20:16:16 (4916): No heartbeat from core client for 30 sec - exiting 20:16:17 (4916): No heartbeat from core client for 30 sec - exiting 22:26:37 (4100): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:26:38 (4100): No heartbeat from core client for 30 sec - exiting 22:26:39 (4100): No heartbeat from core client for 30 sec - exiting 22:26:40 (4100): No heartbeat from core client for 30 sec - exiting 04:05:54 (5080): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:05:55 (5080): No heartbeat from core client for 30 sec - exiting 04:05:56 (5080): No heartbeat from core client for 30 sec - exiting 04:05:58 (5080): No heartbeat from core client for 30 sec - exiting 04:05:59 (5080): No heartbeat from core client for 30 sec - exiting 04:06:01 (5080): No heartbeat from core client for 30 sec - exiting 04:06:03 (5080): No heartbeat from core client for 30 sec - exiting 04:06:05 (5080):Atmos Hold Restart file rename failed on atmos_restart.hold 06:01:06 (5804): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:01:07 (5804): No heartbeat from core client for 30 sec - exiting 07:17:40 (4576): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:27:34 (5316): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:25:49 (5460): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:37:11 (4536): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:17:53 (2628): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:17:54 (2628): No heartbeat from core client for 30 sec - exiting 03:56:45 (5516): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:56:46 (5516): No heartbeat from core client for 30 sec - exiting 03:56:47 (5516): No heartbeat from core client for 30 sec - exiting 03:56:48 (5516): No heartbeat from core client for 30 sec - exiting 03:56:49 (5516): No heartbeat from core client for 30 sec - exiting 04:37:57 (5396): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:48:54 (4852): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:48:55 (4852): No heartbeat from core client for 30 sec - exiting 04:48:56 (4852): No heartbeat from core client for 30 sec - exiting 04:48:57 (4852): No heartbeat from core client for 30 sec - exiting 04:48:58 (4852): No heartbeat from core client for 30 sec - exiting 04:48:59 (4852): No heartbeat from core client for 30 sec - exiting 04:54:48 (3596): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:54:49 (3596): No heartbeat from core client for 30 sec - exiting 04:54:50 (3596): No heartbeat from core client for 30 sec - exiting 04:54:51 (3596): No heartbeat from core client for 30 sec - exiting 04:54:52 (3596): No heartbeat from core client for 30 sec - exiting 04:54:53 (3596): No heartbeat from core client for 30 sec - exiting 09:39:45 (4476): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:39:46 (4476): No heartbeat from core client for 30 sec - exiting 09:39:47 (4476): No heartbeat from core client for 30 sec - exiting 09:39:48 (4476): No heartbeat from core client for 30 sec - exiting 09:39:49 (4476): No heartbeat from core client for 30 sec - exiting 09:39:50 (4476): No heartbeat from core client for 30 sec - exiting 09:39:51 (4476): No heartbeat from core client for 30 sec - exiting 10:48:55 (5624): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:48:56 (5624): No heartbeat from core client for 30 sec - exiting 10:48:57 (5624): No heartbeat from core client for 30 sec - exiting 10:48:58 (5624): No heartbeat from core client for 30 sec - exiting 12:07:14 (348): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:21:28 (2452): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:26:50 (3700): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:26:51 (3700): No heartbeat from core client for 30 sec - exiting 12:26:52 (3700): No heartbeat from core client for 30 sec - exiting 12:26:53 (3700): No heartbeat from core client for 30 sec - exiting 12:26:54 (3700): No heartbeat from core client for 30 sec - exiting 12:26:55 (3700): No heartbeat from core client for 30 sec - exiting 12:26:56 (3700): No heartbeat from core client for 30 sec - exiting 14:01:45 (4784): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:07:39 (176): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:07:40 (176): No heartbeat from core client for 30 sec - exiting 14:07:41 (176): No heartbeat from core client for 30 sec - exiting 18:59:20 (5992): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:52:37 (5840): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:52:38 (5840): No heartbeat from core client for 30 sec - exiting 00:31:32 (4956): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:33:29 (3940): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:33:30 (3940): No heartbeat from core client for 30 sec - exiting 00:33:31 (3940): No heartbeat from core client for 30 sec - exiting 00:33:32 (3940): No heartbeat from core client for 30 sec - exiting 00:33:33 (3940): No heartbeat from core client for 30 sec - exiting 00:33:34 (3940): No heartbeat from core client for 30 sec - exiting 00:33:35 (3940): No heartbeat from core client for 30 sec - exiting 00:33:36 (3940): No heartbeat from core client for 30 sec - exiting 00:33:37 (3940): No heartbeat from core client for 30 sec - exiting 00:33:38 (3940): No heartbeat from core client for 30 sec - exiting 00:33:39 (3940): No heartbeat from core client for 30 sec - exiting 00:37:43 (6096): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:42:25 (4764): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:42:27 (4764): No heartbeat from core client for 30 sec - exiting 00:42:28 (4764): No heartbeat from core client for 30 sec - exiting 00:42:29 (4764): No heartbeat from core client for 30 sec - exiting 00:42:30 (4764): No heartbeat from core client for 30 sec - exiting 00:42:31 (4764): No heartbeat from core client for 30 sec - exiting 00:42:32 (4764): No heartbeat from core client for 30 sec - exiting 00:43:38 (5616): No heartbeat from core client for 30 sec - exiting 00:43:39 (5616): No heartbeat from core client for 30 sec - exiting 00:43:40 (5616): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:47:24 (4040): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:47:25 (4040): No heartbeat from core client for 30 sec - exiting 00:47:26 (4040): No heartbeat from core client for 30 sec - exiting 00:48:51 (4388): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:48:52 (4388): No heartbeat from core client for 30 sec - exiting 00:48:53 (4388): No heartbeat from core client for 30 sec - exiting 00:48:54 (4388): No heartbeat from core client for 30 sec - exiting 00:48:55 (4388): No heartbeat from core client for 30 sec - exiting 00:53:55 (4144): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:53:56 (4144): No heartbeat from core client for 30 sec - exiting 01:14:36 (4936): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Atmos Hold Restart file rename failed on atmos_restart.hold 01:19:12 (3852): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Atmos Hold Restart file rename failed on atmos_restart.hold 05:34:25 (1020): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:34:27 (1020): No heartbeat from core client for 30 sec - exiting 06:13:56 (4020): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:25:24 (5440): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=412, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=412, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=412, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=412, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=412, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3072, iMonCtr=1 Model crash detected, will try to restart... Sorry, too many model crashes! :-( Called boinc_finish </stderr_txt> ]]> |
Latest Trickles Received | ||||||
---|---|---|---|---|---|---|
Time Sent (UTC) | Host ID | Result ID | Result Name | Timestep | CPU Time (sec) | Average (sec/TS) |
05 Jan 2014 18:39:17 | 1268519 | 16084306 | hadcm3n_o5cf_1940_40_008411073_1 | 725,760 | 2,175,603 | 2.9977 |
03 Jan 2014 14:12:14 | 1268519 | 16084306 | hadcm3n_o5cf_1940_40_008411073_1 | 699,840 | 2,098,506 | 2.9986 |
02 Jan 2014 03:49:15 | 1268519 | 16084306 | hadcm3n_o5cf_1940_40_008411073_1 | 673,920 | 2,023,422 | 3.0025 |
31 Dec 2013 15:21:43 | 1268519 | 16084306 | hadcm3n_o5cf_1940_40_008411073_1 | 648,000 | 1,945,663 | 3.0026 |
30 Dec 2013 12:22:50 | 1268519 | 16084306 | hadcm3n_o5cf_1940_40_008411073_1 | 622,080 | 1,863,768 | 2.9960 |
28 Dec 2013 22:25:23 | 1268519 | 16084306 | hadcm3n_o5cf_1940_40_008411073_1 | 596,160 | 1,784,245 | 2.9929 |
27 Dec 2013 14:12:31 | 1268519 | 16084306 | hadcm3n_o5cf_1940_40_008411073_1 | 570,240 | 1,703,435 | 2.9872 |
26 Dec 2013 14:00:13 | 1268519 | 16084306 | hadcm3n_o5cf_1940_40_008411073_1 | 544,320 | 1,624,472 | 2.9844 |
26 Dec 2013 03:22:32 | 1268519 | 16084306 | hadcm3n_o5cf_1940_40_008411073_1 | 518,400 | 1,546,880 | 2.9840 |
24 Dec 2013 18:31:34 | 1268519 | 16084306 | hadcm3n_o5cf_1940_40_008411073_1 | 492,480 | 1,469,187 | 2.9832 |
23 Dec 2013 11:46:55 | 1268519 | 16084306 | hadcm3n_o5cf_1940_40_008411073_1 | 466,560 | 1,391,566 | 2.9826 |
22 Dec 2013 13:30:44 | 1268519 | 16084306 | hadcm3n_o5cf_1940_40_008411073_1 | 440,640 | 1,310,943 | 2.9751 |
21 Dec 2013 14:21:38 | 1268519 | 16084306 | hadcm3n_o5cf_1940_40_008411073_1 | 414,720 | 1,231,910 | 2.9705 |
19 Dec 2013 21:50:45 | 1268519 | 16084306 | hadcm3n_o5cf_1940_40_008411073_1 | 388,800 | 1,154,190 | 2.9686 |
18 Dec 2013 13:33:31 | 1268519 | 16084306 | hadcm3n_o5cf_1940_40_008411073_1 | 362,880 | 1,077,439 | 2.9691 |
17 Dec 2013 15:53:59 | 1268519 | 16084306 | hadcm3n_o5cf_1940_40_008411073_1 | 336,960 | 999,836 | 2.9672 |
17 Dec 2013 15:53:59 | 1268519 | 16084306 | hadcm3n_o5cf_1940_40_008411073_1 | 311,040 | 923,495 | 2.9691 |
15 Dec 2013 12:57:26 | 1268519 | 16084306 | hadcm3n_o5cf_1940_40_008411073_1 | 285,120 | 847,030 | 2.9708 |
15 Dec 2013 12:57:26 | 1268519 | 16084306 | hadcm3n_o5cf_1940_40_008411073_1 | 259,200 | 770,600 | 2.9730 |
13 Dec 2013 13:44:38 | 1268519 | 16084306 | hadcm3n_o5cf_1940_40_008411073_1 | 233,280 | 694,007 | 2.9750 |
©2024 cpdn.org