Task 15682383

Name	hadcm3n_o0ia_2140_40_008269240_1
Workunit	8424364
Created	25 Mar 2013, 6:10:12 UTC
Sent	25 Mar 2013, 6:10:40 UTC
Report deadline	24 Jun 2013, 13:37:51 UTC
Received	10 Apr 2013, 16:50:07 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	1358917
Run time	11 days 22 hours 0 min 14 sec
CPU time	10 days 9 hours 48 min 37 sec
Validate state	Invalid
Credit	9,331.20
Device peak FLOPS	3.37 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>7.0.28</core_client_version> <![CDATA[ <message> The device does not recognize the command. (0x16) - exit code 22 (0x16) </message> <stderr_txt> ocess is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... 20:22:07 (4840): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:22:08 (4840): No heartbeat from core client for 30 sec - exiting 20:22:09 (4840): No heartbeat from core client for 30 sec - exiting 20:22:10 (4840): No heartbeat from core client for 30 sec - exiting 20:22:11 (4840): No heartbeat from core client for 30 sec - exiting 20:22:12 (4840): No heartbeat from core client for 30 sec - exiting 20:22:13 (4840): No heartbeat from core client for 30 sec - exiting 20:22:14 (4840): No heartbeat from core client for 30 sec - exiting 20:22:15 (4840): No heartbeat from core client for 30 sec - exiting 20:22:16 (4840): No heartbeat from core client for 30 sec - exiting 20:22:17 (4840): No heartbeat from core client for 30 sec - exiting forrtl: Access is denied. 22:12:33 (4776): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:13:45 (4196): No heartbeat from core client for 30 sec - exiting 22:13:46 (4196): No heartbeat from core client for 30 sec - exiting 22:13:47 (4196): No heartbeat from core client for 30 sec - exiting 22:13:48 (4196): No heartbeat from core client for 30 sec - exiting 22:13:49 (4196): No heartbeat from core client for 30 sec - exiting 22:13:50 (4196): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:14:45 (3992): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:14:46 (3992): No heartbeat from core client for 30 sec - exiting 22:14:47 (3992): No heartbeat from core client for 30 sec - exiting 22:14:48 (3992): No heartbeat from core client for 30 sec - exiting 22:14:50 (3992): No heartbeat from core client for 30 sec - exiting 22:14:51 (3992): No heartbeat from core client for 30 sec - exiting 22:14:52 (3992): No heartbeat from core client for 30 sec - exiting 22:14:53 (3992): No heartbeat from core client for 30 sec - exiting 22:14:54 (3992): No heartbeat from core client for 30 sec - exiting 22:14:55 (3992): No heartbeat from core client for 30 sec - exiting 22:14:56 (3992): No heartbeat from core client for 30 sec - exiting 23:07:48 (3356): No heartbeat from core client for 30 sec - exiting 23:07:49 (3356): No heartbeat from core client for 30 sec - exiting 23:08:23 (3356): No heartbeat from core client for 30 sec - exiting 23:08:24 (3356): No heartbeat from core client for 30 sec - exiting 23:08:25 (3356): No heartbeat from core client for 30 sec - exiting 23:08:26 (3356): No heartbeat from core client for 30 sec - exiting 23:08:27 (3356): No heartbeat from core client for 30 sec - exiting 23:08:28 (3356): No heartbeat from core client for 30 sec - exiting 23:08:29 (3356): No heartbeat from core client for 30 sec - exiting 23:08:30 (3356): No heartbeat from core client for 30 sec - exiting 23:08:31 (3356): No heartbeat from core client for 30 sec - exiting 23:08:32 (3356): No heartbeat from core client for 30 sec - exiting 23:08:33 (3356): No heartbeat from core client for 30 sec - exiting 23:08:34 (3356): No heartbeat from core client for 30 sec - exiting 23:08:35 (3356): No heartbeat from core client for 30 sec - exiting 23:08:36 (3356): No heartbeat from core client for 30 sec - exiting 23:08:37 (3356): No heartbeat from core client for 30 sec - exiting 23:08:38 (3356): No heartbeat from core client for 30 sec - exiting 23:08:39 (3356): No heartbeat from core client for 30 sec - exiting 23:08:40 (3356): No heartbeat from core client for 30 sec - exiting 23:08:41 (3356): No heartbeat from core client for 30 sec - exiting 23:08:42 (3356): No heartbeat from core client for 30 sec - exiting 23:08:43 (3356): No heartbeat from core client for 30 sec - exiting 23:08:44 (3356): No heartbeat from core client for 30 sec - exiting 23:08:45 (3356): No heartbeat from core client for 30 sec - exiting 23:08:46 (3356): No heartbeat from core client for 30 sec - exiting 23:08:47 (3356): No heartbeat from core client for 30 sec - exiting 23:08:48 (3356): No heartbeat from core client for 30 sec - exiting 23:08:49 (3356): No heartbeat from core client for 30 sec - exiting 23:08:50 (3356): No heartbeat from core client for 30 sec - exiting 23:08:51 (3356): No heartbeat from core client for 30 sec - exiting 23:08:52 (3356): No heartbeat from core client for 30 sec - exiting 23:08:53 (3356): No heartbeat from core client for 30 sec - exiting 23:08:54 (3356): No heartbeat from core client for 30 sec - exiting 23:08:55 (3356): No heartbeat from core client for 30 sec - exiting 23:08:56 (3356): No heartbeat from core client for 30 sec - exiting 23:08:57 (3356): No heartbeat from core client for 30 sec - exiting 23:08:58 (3356): No heartbeat from core client for 30 sec - exiting 23:08:59 (3356): No heartbeat from core client for 30 sec - exiting 23:09:00 (3356): No heartbeat from core client for 30 sec - exiting 23:09:01 (3356): No heartbeat from core client for 30 sec - exiting 23:09:02 (3356): No heartbeat from core client for 30 sec - exiting 23:09:03 (3356): No heartbeat from core client for 30 sec - exiting 23:09:04 (3356): No heartbeat from core client for 30 sec - exiting 23:09:05 (3356): No heartbeat from core client for 30 sec - exiting 23:09:06 (3356): No heartbeat from core client for 30 sec - exiting 23:09:07 (3356): No heartbeat from core client for 30 sec - exiting 23:09:08 (3356): No heartbeat from core client for 30 sec - exiting 23:09:09 (3356): No heartbeat from core client for 30 sec - exiting 23:09:10 (3356): No heartbeat from core client for 30 sec - exiting 23:09:11 (3356): No heartbeat from core client for 30 sec - exiting 23:09:12 (3356): No heartbeat from core client for 30 sec - exiting 23:09:13 (3356): No heartbeat from core client for 30 sec - exiting 23:09:14 (3356): No heartbeat from core client for 30 sec - exiting 23:09:15 (3356): No heartbeat from core client for 30 sec - exiting 23:09:16 (3356): No heartbeat from core client for 30 sec - exiting 23:09:17 (3356): No heartbeat from core client for 30 sec - exiting 23:09:18 (3356): No heartbeat from core client for 30 sec - exiting 23:09:19 (3356): No heartbeat from core client for 30 sec - exiting 23:09:20 (3356): No heartbeat from core client for 30 sec - exiting 23:09:21 (3356): No heartbeat from core client for 30 sec - exiting 23:09:22 (3356): No heartbeat from core client for 30 sec - exiting 23:09:23 (3356): No heartbeat from core client for 30 sec - exiting 23:09:24 (3356): No heartbeat from core client for 30 sec - exiting 23:09:25 (3356): No heartbeat from core client for 30 sec - exiting 23:09:26 (3356): No heartbeat from core client for 30 sec - exiting 23:09:28 (3356): No heartbeat from core client for 30 sec - exiting 23:09:29 (3356): No heartbeat from core client for 30 sec - exiting 23:09:30 (3356): No heartbeat from core client for 30 sec - exiting 23:09:31 (3356): No heartbeat from core client for 30 sec - exiting 23:09:32 (3356): No heartbeat from core client for 30 sec - exiting 23:09:33 (3356): No heartbeat from core client for 30 sec - exiting 23:09:34 (3356): No heartbeat from core client for 30 sec - exiting 23:09:35 (3356): No heartbeat from core client for 30 sec - exiting 23:09:36 (3356): No heartbeat from core client for 30 sec - exiting 23:09:37 (3356): No heartbeat from core client for 30 sec - exiting 23:09:38 (3356): No heartbeat from core client for 30 sec - exiting 23:09:39 (3356): No heartbeat from core client for 30 sec - exiting 23:09:40 (3356): No heartbeat from core client for 30 sec - exiting 23:09:41 (3356): No heartbeat from core client for 30 sec - exiting 23:09:42 (3356): No heartbeat from core client for 30 sec - exiting 23:09:43 (3356): No heartbeat from core client for 30 sec - exiting 23:09:44 (3356): No heartbeat from core client for 30 sec - exiting 23:09:45 (3356): No heartbeat from core client for 30 sec - exiting 23:09:46 (3356): No heartbeat from core client for 30 sec - exiting 23:09:47 (3356): No heartbeat from core client for 30 sec - exiting 23:09:48 (3356): No heartbeat from core client for 30 sec - exiting 23:09:49 (3356): No heartbeat from core client for 30 sec - exiting 23:09:50 (3356): No heartbeat from core client for 30 sec - exiting 23:09:51 (3356): No heartbeat from core client for 30 sec - exiting 23:09:52 (3356): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:09:53 (3356): No heartbeat from core client for 30 sec - exiting 23:09:54 (3356): No heartbeat from core client for 30 sec - exiting 23:09:55 (3356): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... 23:46:58 (3248): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:46:59 (3248): No heartbeat from core client for 30 sec - exiting 23:47:00 (3248): No heartbeat from core client for 30 sec - exiting 23:47:01 (3248): No heartbeat from core client for 30 sec - exiting 23:47:02 (3248): No heartbeat from core client for 30 sec - exiting 23:47:03 (3248): No heartbeat from core client for 30 sec - exiting 23:47:04 (3248): No heartbeat from core client for 30 sec - exiting 23:47:05 (3248): No heartbeat from core client for 30 sec - exiting 23:47:06 (3248): No heartbeat from core client for 30 sec - exiting 23:47:07 (3248): No heartbeat from core client for 30 sec - exiting 23:47:08 (3248): No heartbeat from core client for 30 sec - exiting 05:25:51 (288): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:52:13 (752): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:53:04 (3248): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:57:17 (1424): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:57:18 (1424): No heartbeat from core client for 30 sec - exiting 06:57:19 (1424): No heartbeat from core client for 30 sec - exiting 06:57:20 (1424): No heartbeat from core client for 30 sec - exiting 06:57:21 (1424): No heartbeat from core client for 30 sec - exiting 06:57:22 (1424): No heartbeat from core client for 30 sec - exiting 06:57:23 (1424): No heartbeat from core client for 30 sec - exiting 06:57:24 (1424): No heartbeat from core client for 30 sec - exiting 06:57:25 (1424): No heartbeat from core client for 30 sec - exiting 06:57:26 (1424): No heartbeat from core client for 30 sec - exiting 06:57:27 (1424): No heartbeat from core client for 30 sec - exiting 06:59:52 (2968): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 17:49:18 (5660): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 01:20:08 (3004): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 11:45:24 (5232): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 14:46:34 (4616): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:47:52 (3080): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:48:40 (4644): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:48:41 (4644): No heartbeat from core client for 30 sec - exiting 14:48:42 (4644): No heartbeat from core client for 30 sec - exiting 14:49:46 (4464): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:49:47 (4464): No heartbeat from core client for 30 sec - exiting 14:49:48 (4464): No heartbeat from core client for 30 sec - exiting 14:49:49 (4464): No heartbeat from core client for 30 sec - exiting 14:49:50 (4464): No heartbeat from core client for 30 sec - exiting 14:49:51 (4464): No heartbeat from core client for 30 sec - exiting 14:49:52 (4464): No heartbeat from core client for 30 sec - exiting 14:49:53 (4464): No heartbeat from core client for 30 sec - exiting 14:49:54 (4464): No heartbeat from core client for 30 sec - exiting 14:49:55 (4464): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... 17:54:28 (5760): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:54:29 (5760): No heartbeat from core client for 30 sec - exiting 17:54:30 (5760): No heartbeat from core client for 30 sec - exiting 17:54:31 (5760): No heartbeat from core client for 30 sec - exiting 17:54:32 (5760): No heartbeat from core client for 30 sec - exiting 17:56:44 (4984): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:56:45 (4984): No heartbeat from core client for 30 sec - exiting 17:56:46 (4984): No heartbeat from core client for 30 sec - exiting 17:56:47 (4984): No heartbeat from core client for 30 sec - exiting 17:56:48 (4984): No heartbeat from core client for 30 sec - exiting 17:56:49 (4984): No heartbeat from core client for 30 sec - exiting 17:56:50 (4984): No heartbeat from core client for 30 sec - exiting 17:56:51 (4984): No heartbeat from core client for 30 sec - exiting 17:56:52 (4984): No heartbeat from core client for 30 sec - exiting 17:56:53 (4984): No heartbeat from core client for 30 sec - exiting 17:56:54 (4984): No heartbeat from core client for 30 sec - exiting forrtl: Access is denied. 17:58:49 (5952): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:00:56 (5872): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:00:57 (5872): No heartbeat from core client for 30 sec - exiting 18:00:58 (5872): No heartbeat from core client for 30 sec - exiting 18:00:59 (5872): No heartbeat from core client for 30 sec - exiting 18:01:00 (5872): No heartbeat from core client for 30 sec - exiting 18:01:01 (5872): No heartbeat from core client for 30 sec - exiting 18:01:02 (5872): No heartbeat from core client for 30 sec - exiting 18:01:03 (5872): No heartbeat from core client for 30 sec - exiting 18:01:04 (5872): No heartbeat from core client for 30 sec - exiting 18:01:05 (5872): No heartbeat from core client for 30 sec - exiting 18:01:06 (5872): No heartbeat from core client for 30 sec - exiting 18:03:02 (696): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:03:03 (696): No heartbeat from core client for 30 sec - exiting 18:03:04 (696): No heartbeat from core client for 30 sec - exiting 18:03:05 (696): No heartbeat from core client for 30 sec - exiting 18:03:06 (696): No heartbeat from core client for 30 sec - exiting 18:03:07 (696): No heartbeat from core client for 30 sec - exiting 18:03:08 (696): No heartbeat from core client for 30 sec - exiting 18:03:09 (696): No heartbeat from core client for 30 sec - exiting 18:03:10 (696): No heartbeat from core client for 30 sec - exiting 18:03:11 (696): No heartbeat from core client for 30 sec - exiting 18:03:12 (696): No heartbeat from core client for 30 sec - exiting 18:05:32 (4588): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:05:33 (4588): No heartbeat from core client for 30 sec - exiting 18:05:34 (4588): No heartbeat from core client for 30 sec - exiting 18:05:35 (4588): No heartbeat from core client for 30 sec - exiting 18:05:36 (4588): No heartbeat from core client for 30 sec - exiting 18:05:37 (4588): No heartbeat from core client for 30 sec - exiting 18:05:38 (4588): No heartbeat from core client for 30 sec - exiting 18:05:39 (4588): No heartbeat from core client for 30 sec - exiting 18:05:40 (4588): No heartbeat from core client for 30 sec - exiting 18:05:41 (4588): No heartbeat from core client for 30 sec - exiting 18:05:42 (4588): No heartbeat from core client for 30 sec - exiting 18:07:42 (1996): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:10:09 (5824): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:10:10 (5824): No heartbeat from core client for 30 sec - exiting 18:10:11 (5824): No heartbeat from core client for 30 sec - exiting 18:10:12 (5824): No heartbeat from core client for 30 sec - exiting 18:10:13 (5824): No heartbeat from core client for 30 sec - exiting 18:10:14 (5824): No heartbeat from core client for 30 sec - exiting 18:10:15 (5824): No heartbeat from core client for 30 sec - exiting 18:10:16 (5824): No heartbeat from core client for 30 sec - exiting 18:10:17 (5824): No heartbeat from core client for 30 sec - exiting 18:10:18 (5824): No heartbeat from core client for 30 sec - exiting 18:10:19 (5824): No heartbeat from core client for 30 sec - exiting 18:12:21 (5692): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:12:22 (5692): No heartbeat from core client for 30 sec - exiting 18:12:23 (5692): No heartbeat from core client for 30 sec - exiting 18:12:24 (5692): No heartbeat from core client for 30 sec - exiting 18:12:25 (5692): No heartbeat from core client for 30 sec - exiting 18:12:26 (5692): No heartbeat from core client for 30 sec - exiting 18:12:27 (5692): No heartbeat from core client for 30 sec - exiting 18:12:28 (5692): No heartbeat from core client for 30 sec - exiting 18:12:29 (5692): No heartbeat from core client for 30 sec - exiting 18:12:30 (5692): No heartbeat from core client for 30 sec - exiting 18:12:31 (5692): No heartbeat from core client for 30 sec - exiting 18:14:27 (4780): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:14:28 (4780): No heartbeat from core client for 30 sec - exiting 18:14:29 (4780): No heartbeat from core client for 30 sec - exiting 18:14:30 (4780): No heartbeat from core client for 30 sec - exiting 18:14:31 (4780): No heartbeat from core client for 30 sec - exiting 18:14:32 (4780): No heartbeat from core client for 30 sec - exiting 18:14:33 (4780): No heartbeat from core client for 30 sec - exiting 18:14:34 (4780): No heartbeat from core client for 30 sec - exiting 18:14:35 (4780): No heartbeat from core client for 30 sec - exiting 18:14:36 (4780): No heartbeat from core client for 30 sec - exiting 18:14:37 (4780): No heartbeat from core client for 30 sec - exiting 18:16:28 (3176): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:16:29 (3176): No heartbeat from core client for 30 sec - exiting 18:16:30 (3176): No heartbeat from core client for 30 sec - exiting 18:16:31 (3176): No heartbeat from core client for 30 sec - exiting 18:16:32 (3176): No heartbeat from core client for 30 sec - exiting 18:16:33 (3176): No heartbeat from core client for 30 sec - exiting 18:16:34 (3176): No heartbeat from core client for 30 sec - exiting 18:16:35 (3176): No heartbeat from core client for 30 sec - exiting 18:16:36 (3176): No heartbeat from core client for 30 sec - exiting 18:16:37 (3176): No heartbeat from core client for 30 sec - exiting 18:16:38 (3176): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... 19:30:59 (532): No heartbeat from core client for 30 sec - exiting 19:31:00 (532): No heartbeat from core client for 30 sec - exiting 19:31:01 (532): No heartbeat from core client for 30 sec - exiting 19:31:02 (532): No heartbeat from core client for 30 sec - exiting 19:31:03 (532): No heartbeat from core client for 30 sec - exiting 19:31:04 (532): No heartbeat from core client for 30 sec - exiting 19:31:05 (532): No heartbeat from core client for 30 sec - exiting 19:31:06 (532): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... MainError: 03:43:20 AM No files match the supplied pattern. MainError: 03:43:20 AM No files match the supplied pattern. CPDN Monitor - Quit request from BOINC... MainError: 03:50:40 PM No files match the supplied pattern. MainError: 03:50:40 PM No files match the supplied pattern. CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... MainError: 11:29:15 AM No files match the supplied pattern. MainError: 11:29:15 AM No files match the supplied pattern. CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... MainError: 06:01:16 AM No files match the supplied pattern. MainError: 06:01:16 AM No files match the supplied pattern. CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... MainError: 08:49:36 AM No files match the supplied pattern. MainError: 08:49:36 AM No files match the supplied pattern. CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... MainError: 10:03:59 PM No files match the supplied pattern. MainError: 10:03:59 PM No files match the supplied pattern. 05:03:58 (5848): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:04:00 (5848): No heartbeat from core client for 30 sec - exiting 05:04:01 (5848): No heartbeat from core client for 30 sec - exiting 05:04:02 (5848): No heartbeat from core client for 30 sec - exiting 05:04:03 (5848): No heartbeat from core client for 30 sec - exiting 05:07:38 (5592): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:07:39 (5592): No heartbeat from core client for 30 sec - exiting 05:07:40 (5592): No heartbeat from core client for 30 sec - exiting 05:07:41 (5592): No heartbeat from core client for 30 sec - exiting 05:09:14 (4416): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:09:15 (4416): No heartbeat from core client for 30 sec - exiting 05:09:16 (4416): No heartbeat from core client for 30 sec - exiting 05:09:17 (4416): No heartbeat from core client for 30 sec - exiting 05:09:18 (4416): No heartbeat from core client for 30 sec - exiting 05:09:19 (4416): No heartbeat from core client for 30 sec - exiting 05:09:20 (4416): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 11:45:16 (852): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:45:52 (1804): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... MainError: 10:27:48 AM No files match the supplied pattern. MainError: 10:27:48 AM No files match the supplied pattern. CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... MainError: 08:18:38 PM No files match the supplied pattern. MainError: 08:18:38 PM No files match the supplied pattern. CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... MainError: 08:26:07 AM No files match the supplied pattern. MainError: 08:26:07 AM No files match the supplied pattern. CPDN Monitor - Quit request from BOINC... 20:12:23 (628): No heartbeat from core client for 30 sec - exiting 20:12:24 (628): No heartbeat from core client for 30 sec - exiting 20:12:25 (628): No heartbeat from core client for 30 sec - exiting 20:12:26 (628): No heartbeat from core client for 30 sec - exiting 20:12:27 (628): No heartbeat from core client for 30 sec - exiting 20:12:28 (628): No heartbeat from core client for 30 sec - exiting 20:12:29 (628): No heartbeat from core client for 30 sec - exiting 20:12:30 (628): No heartbeat from core client for 30 sec - exiting 20:12:31 (628): No heartbeat from core client for 30 sec - exiting 20:12:32 (628): No heartbeat from core client for 30 sec - exiting 20:12:33 (628): No heartbeat from core client for 30 sec - exiting 20:12:34 (628): No heartbeat from core client for 30 sec - exiting 20:12:35 (628): No heartbeat from core client for 30 sec - exiting 20:12:36 (628): No heartbeat from core client for 30 sec - exiting 20:12:37 (628): No heartbeat from core client for 30 sec - exiting 20:12:38 (628): No heartbeat from core client for 30 sec - exiting 20:12:39 (628): No heartbeat from core client for 30 sec - exiting 20:12:40 (628): No heartbeat from core client for 30 sec - exiting 20:12:41 (628): No heartbeat from core client for 30 sec - exiting 20:12:42 (628): No heartbeat from core client for 30 sec - exiting 20:12:43 (628): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:12:44 (628): No heartbeat from core client for 30 sec - exiting MainError: 06:15:47 PM No files match the supplied pattern. MainError: 06:15:47 PM No files match the supplied pattern. CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Error converting file to netcdf: dataout/o0iaka.ph11c10 Error converting file to netcdf: dataout/o0iaka.pg11c10 Error converting file to netcdf: dataout/o0iaka.pe11c10 MainError: 11:30:21 AM No files match the supplied pattern. MainError: 11:30:21 AM No files match the supplied pattern. BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 Model crashed: STWORK : I/O error - PP fixed length header tmp/pipe_dummy 2048 BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 BUFFIN: C I/O Error feof - Unit 66 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 Model crashed: STWORK : I/O error - PP fixed length header tmp/pipe_dummy 2048 BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 BUFFIN: C I/O Error feof - Unit 66 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 Model crashed: STWORK : I/O error - PP fixed length header tmp/pipe_dummy 2048 BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 BUFFIN: C I/O Error feof - Unit 66 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 Model crashed: STWORK : I/O error - PP fixed length header tmp/pipe_dummy 2048 BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 BUFFIN: C I/O Error feof - Unit 66 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 Model crashed: STWORK : I/O error - PP fixed length header tmp/pipe_dummy 2048 BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 BUFFIN: C I/O Error feof - Unit 66 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 Model crashed: STWORK : I/O error - PP fixed length header tmp/pipe_dummy 2048 Sorry, too many model crashes! :-( Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
10 Apr 2013 11:34:09	1241595	15682383	hadcm3n_o0ia_2140_40_008269240_1	777,600	906,570	1.1659
09 Apr 2013 18:32:29	1241595	15682383	hadcm3n_o0ia_2140_40_008269240_1	751,680	876,144	1.1656
09 Apr 2013 08:29:52	1241595	15682383	hadcm3n_o0ia_2140_40_008269240_1	725,760	845,522	1.1650
08 Apr 2013 20:19:01	1241595	15682383	hadcm3n_o0ia_2140_40_008269240_1	699,840	814,794	1.1643
08 Apr 2013 10:32:45	1241595	15682383	hadcm3n_o0ia_2140_40_008269240_1	673,920	784,682	1.1644
07 Apr 2013 22:08:00	1241595	15682383	hadcm3n_o0ia_2140_40_008269240_1	648,000	754,284	1.1640
07 Apr 2013 08:52:55	1241595	15682383	hadcm3n_o0ia_2140_40_008269240_1	622,080	723,702	1.1634
06 Apr 2013 06:02:33	1241595	15682383	hadcm3n_o0ia_2140_40_008269240_1	596,160	693,069	1.1626
05 Apr 2013 11:30:55	1241595	15682383	hadcm3n_o0ia_2140_40_008269240_1	570,240	662,483	1.1618
04 Apr 2013 15:55:47	1241595	15682383	hadcm3n_o0ia_2140_40_008269240_1	544,320	632,132	1.1613
04 Apr 2013 03:43:45	1241595	15682383	hadcm3n_o0ia_2140_40_008269240_1	518,400	601,428	1.1602
03 Apr 2013 02:33:06	1241595	15682383	hadcm3n_o0ia_2140_40_008269240_1	492,480	570,347	1.1581
02 Apr 2013 16:41:20	1241595	15682383	hadcm3n_o0ia_2140_40_008269240_1	466,560	539,634	1.1566
02 Apr 2013 02:51:24	1241595	15682383	hadcm3n_o0ia_2140_40_008269240_1	440,640	509,386	1.1560
01 Apr 2013 16:11:03	1241595	15682383	hadcm3n_o0ia_2140_40_008269240_1	414,720	479,240	1.1556
01 Apr 2013 05:08:08	1241595	15682383	hadcm3n_o0ia_2140_40_008269240_1	388,800	448,538	1.1536
31 Mar 2013 16:36:08	1241595	15682383	hadcm3n_o0ia_2140_40_008269240_1	362,880	418,297	1.1527
31 Mar 2013 03:47:50	1241595	15682383	hadcm3n_o0ia_2140_40_008269240_1	336,960	387,831	1.1510
30 Mar 2013 12:40:37	1241595	15682383	hadcm3n_o0ia_2140_40_008269240_1	311,040	357,311	1.1488
30 Mar 2013 01:52:08	1241595	15682383	hadcm3n_o0ia_2140_40_008269240_1	285,120	326,530	1.1452