Task 13571083

Name	hadcm3n_yk1b_1900_40_007524127_2
Workunit	7721602
Created	31 Oct 2011, 3:03:37 UTC
Sent	31 Oct 2011, 3:09:25 UTC
Report deadline	30 Jan 2012, 10:36:36 UTC
Received	2 Nov 2011, 13:06:18 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	1176150
Run time	23 hours 0 min 31 sec
CPU time	23 hours 0 min 31 sec
Validate state	Invalid
Credit	311.04
Device peak FLOPS	2.47 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>6.12.34</core_client_version> <![CDATA[ <message> The device does not recognize the command. (0x16) - exit code 22 (0x16) </message> <stderr_txt> al = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... 11:05:08 (3768): No heartbeat from core client for 30 sec - exiting 11:05:09 (3768): No heartbeat from core client for 30 sec - exiting 11:05:10 (3768): No heartbeat from core client for 30 sec - exiting 11:05:11 (3768): No heartbeat from core client for 30 sec - exiting 11:06:09 (3768): No heartbeat from core client for 30 sec - exiting 11:06:10 (3768): No heartbeat from core client for 30 sec - exiting 11:06:11 (3768): No heartbeat from core client for 30 sec - exiting 11:06:13 (3768): No heartbeat from core client for 30 sec - exiting 11:06:14 (3768): No heartbeat from core client for 30 sec - exiting 11:06:15 (3768): No heartbeat from core client for 30 sec - exiting 11:06:16 (3768): No heartbeat from core client for 30 sec - exiting 11:06:17 (3768): No heartbeat from core client for 30 sec - exiting 11:06:18 (3768): No heartbeat from core client for 30 sec - exiting 11:06:19 (3768): No heartbeat from core client for 30 sec - exiting 11:06:20 (3768): No heartbeat from core client for 30 sec - exiting 11:06:21 (3768): No heartbeat from core client for 30 sec - exiting 11:06:22 (3768): No heartbeat from core client for 30 sec - exiting 11:06:24 (3768): No heartbeat from core client for 30 sec - exiting 11:06:25 (3768): No heartbeat from core client for 30 sec - exiting 11:06:26 (3768): No heartbeat from core client for 30 sec - exiting 11:06:27 (3768): No heartbeat from core client for 30 sec - exiting 11:06:28 (3768): No heartbeat from core client for 30 sec - exiting 11:06:29 (3768): No heartbeat from core client for 30 sec - exiting 11:06:30 (3768): No heartbeat from core client for 30 sec - exiting 11:06:31 (3768): No heartbeat from core client for 30 sec - exiting 11:06:32 (3768): No heartbeat from core client for 30 sec - exiting 11:06:33 (3768): No heartbeat from core client for 30 sec - exiting 11:06:34 (3768): No heartbeat from core client for 30 sec - exiting 11:06:36 (3768): No heartbeat from core client for 30 sec - exiting 11:06:37 (3768): No heartbeat from core client for 30 sec - exiting 11:06:38 (3768): No heartbeat from core client for 30 sec - exiting 11:06:39 (3768): No heartbeat from core client for 30 sec - exiting 11:06:40 (3768): No heartbeat from core client for 30 sec - exiting 11:06:41 (3768): No heartbeat from core client for 30 sec - exiting 11:06:42 (3768): No heartbeat from core client for 30 sec - exiting 11:06:43 (3768): No heartbeat from core client for 30 sec - exiting 11:06:44 (3768): No heartbeat from core client for 30 sec - exiting 11:06:45 (3768): No heartbeat from core client for 30 sec - exiting 11:06:46 (3768): No heartbeat from core client for 30 sec - exiting 11:06:48 (3768): No heartbeat from core client for 30 sec - exiting 11:06:49 (3768): No heartbeat from core client for 30 sec - exiting 11:06:50 (3768): No heartbeat from core client for 30 sec - exiting 11:06:51 (3768): No heartbeat from core client for 30 sec - exiting 11:06:52 (3768): No heartbeat from core client for 30 sec - exiting 11:06:53 (3768): No heartbeat from core client for 30 sec - exiting 11:06:54 (3768): No heartbeat from core client for 30 sec - exiting 11:06:55 (3768): No heartbeat from core client for 30 sec - exiting 11:06:56 (3768): No heartbeat from core client for 30 sec - exiting 11:06:57 (3768): No heartbeat from core client for 30 sec - exiting 11:06:59 (3768): No heartbeat from core client for 30 sec - exiting 11:07:00 (3768): No heartbeat from core client for 30 sec - exiting 11:07:01 (3768): No heartbeat from core client for 30 sec - exiting 11:07:03 (3768): No heartbeat from core client for 30 sec - exiting 11:07:04 (3768): No heartbeat from core client for 30 sec - exiting 11:07:05 (3768): No heartbeat from core client for 30 sec - exiting 11:07:06 (3768): No heartbeat from core client for 30 sec - exiting 11:07:07 (3768): No heartbeat from core client for 30 sec - exiting 11:07:08 (3768): No heartbeat from core client for 30 sec - exiting 11:07:09 (3768): No heartbeat from core client for 30 sec - exiting 11:07:10 (3768): No heartbeat from core client for 30 sec - exiting 11:07:11 (3768): No heartbeat from core client for 30 sec - exiting 11:07:12 (3768): No heartbeat from core client for 30 sec - exiting 11:07:13 (3768): No heartbeat from core client for 30 sec - exiting 11:07:15 (3768): No heartbeat from core client for 30 sec - exiting 11:07:16 (3768): No heartbeat from core client for 30 sec - exiting 11:07:17 (3768): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:08:58 (2856): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:11:30 (2788): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:16:34 (1148): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:18:41 (2580): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:19:43 (2788): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:21:01 (1600): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:23:32 (1112): No heartbeat from core client for 30 sec - exiting 11:23:33 (1112): No heartbeat from core client for 30 sec - exiting 11:23:34 (1112): No heartbeat from core client for 30 sec - exiting 11:23:35 (1112): No heartbeat from core client for 30 sec - exiting 11:23:36 (1112): No heartbeat from core client for 30 sec - exiting 11:23:37 (1112): No heartbeat from core client for 30 sec - exiting 11:23:38 (1112): No heartbeat from core client for 30 sec - exiting 11:23:39 (1112): No heartbeat from core client for 30 sec - exiting 11:23:41 (1112): No heartbeat from core client for 30 sec - exiting 11:23:42 (1112): No heartbeat from core client for 30 sec - exiting 11:23:43 (1112): No heartbeat from core client for 30 sec - exiting 11:23:44 (1112): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:25:07 (1164): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:25:48 (3216): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:26:33 (1628): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:28:21 (2180): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:30:37 (1540): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:31:33 (1252): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:34:42 (4076): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:37:17 (2708): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:41:14 (2868): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:45:46 (3136): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:48:43 (3108): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:54:11 (2304): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:56:05 (1484): No heartbeat from core client for 30 sec - exiting 11:56:06 (1484): No heartbeat from core client for 30 sec - exiting 11:56:07 (1484): No heartbeat from core client for 30 sec - exiting 11:56:08 (1484): No heartbeat from core client for 30 sec - exiting 11:56:09 (1484): No heartbeat from core client for 30 sec - exiting 11:56:10 (1484): No heartbeat from core client for 30 sec - exiting 11:56:11 (1484): No heartbeat from core client for 30 sec - exiting 11:56:12 (1484): No heartbeat from core client for 30 sec - exiting 11:56:13 (1484): No heartbeat from core client for 30 sec - exiting 11:56:15 (1484): No heartbeat from core client for 30 sec - exiting 11:56:16 (1484): No heartbeat from core client for 30 sec - exiting 11:56:17 (1484): No heartbeat from core client for 30 sec - exiting 11:56:18 (1484): No heartbeat from core client for 30 sec - exiting 11:56:19 (1484): No heartbeat from core client for 30 sec - exiting 11:56:20 (1484): No heartbeat from core client for 30 sec - exiting 11:56:21 (1484): No heartbeat from core client for 30 sec - exiting 11:56:22 (1484): No heartbeat from core client for 30 sec - exiting 11:56:23 (1484): No heartbeat from core client for 30 sec - exiting 11:56:24 (1484): No heartbeat from core client for 30 sec - exiting 11:56:25 (1484): No heartbeat from core client for 30 sec - exiting 11:56:27 (1484): No heartbeat from core client for 30 sec - exiting 11:56:28 (1484): No heartbeat from core client for 30 sec - exiting 11:56:29 (1484): No heartbeat from core client for 30 sec - exiting 11:56:30 (1484): No heartbeat from core client for 30 sec - exiting 11:56:31 (1484): No heartbeat from core client for 30 sec - exiting 11:56:32 (1484): No heartbeat from core client for 30 sec - exiting 11:56:33 (1484): No heartbeat from core client for 30 sec - exiting 11:56:34 (1484): No heartbeat from core client for 30 sec - exiting 11:56:35 (1484): No heartbeat from core client for 30 sec - exiting 11:56:36 (1484): No heartbeat from core client for 30 sec - exiting 11:56:38 (1484): No heartbeat from core client for 30 sec - exiting 11:56:39 (1484): No heartbeat from core client for 30 sec - exiting 11:56:40 (1484): No heartbeat from core client for 30 sec - exiting 11:56:41 (1484): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:56:42 (1484): No heartbeat from core client for 30 sec - exiting 11:56:43 (1484): No heartbeat from core client for 30 sec - exiting 12:02:34 (2560): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:05:42 (2256): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:11:41 (3144): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:13:13 (2940): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:17:23 (2936): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:22:00 (544): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:22:38 (3896): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 13:18:12 (60): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:21:54 (1300): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 13:33:33 (2592): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:34:16 (368): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:37:40 (3952): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CNo Process Handle Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2940, selfPID=2940, iMonCtr=1 20:20:57 (3760): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:22:13 (60): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 03:27:49 (2016): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:33:29 (2940): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:33:30 (2940): No heartbeat from core client for 30 sec - exiting 03:33:31 (2940): No heartbeat from core client for 30 sec - exiting 03:33:32 (2940): No heartbeat from core client for 30 sec - exiting 03:33:33 (2940): No heartbeat from core client for 30 sec - exiting 03:33:34 (2940): No heartbeat from core client for 30 sec - exiting 03:33:36 (2940): No heartbeat from core client for 30 sec - exiting 03:35:04 (2980): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:43:30 (1324): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:43:31 (1324): No heartbeat from core client for 30 sec - exiting 03:44:21 (2004): No heartbeat from core client for 30 sec - exiting 03:44:22 (2004): No heartbeat from core client for 30 sec - exiting 03:44:23 (2004): No heartbeat from core client for 30 sec - exiting 03:44:24 (2004): No heartbeat from core client for 30 sec - exiting 03:44:25 (2004): No heartbeat from core client for 30 sec - exiting 03:44:26 (2004): No heartbeat from core client for 30 sec - exiting 03:44:27 (2004): No heartbeat from core client for 30 sec - exiting 03:44:28 (2004): No heartbeat from core client for 30 sec - exiting 03:44:29 (2004): No heartbeat from core client for 30 sec - exiting 03:44:30 (2004): No heartbeat from core client for 30 sec - exiting 03:44:32 (2004): No heartbeat from core client for 30 sec - exiting 03:44:33 (2004): No heartbeat from core client for 30 sec - exiting 03:44:34 (2004): No heartbeat from core client for 30 sec - exiting 03:44:35 (2004): No heartbeat from core client for 30 sec - exiting 03:44:36 (2004): No heartbeat from core client for 30 sec - exiting 03:44:37 (2004): No heartbeat from core client for 30 sec - exiting 03:44:38 (2004): No heartbeat from core client for 30 sec - exiting 03:44:39 (2004): No heartbeat from core client for 30 sec - exiting 03:44:40 (2004): No heartbeat from core client for 30 sec - exiting 03:44:41 (2004): No heartbeat from core client for 30 sec - exiting 03:44:43 (2004): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:44:44 (2004): No heartbeat from core client for 30 sec - exiting 03:48:48 (2628): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:53:49 (1028): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:56:40 (1452): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:59:03 (1392): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:01:13 (3584): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:03:24 (3988): No heartbeat from core client for 30 sec - exiting 04:03:25 (3988): No heartbeat from core client for 30 sec - exiting 04:03:26 (3988): No heartbeat from core client for 30 sec - exiting 04:03:27 (3988): No heartbeat from core client for 30 sec - exiting 04:03:29 (3988): No heartbeat from core client for 30 sec - exiting 04:03:30 (3988): No heartbeat from core client for 30 sec - exiting 04:03:31 (3988): No heartbeat from core client for 30 sec - exiting 04:03:32 (3988): No heartbeat from core client for 30 sec - exiting 04:03:33 (3988): No heartbeat from core client for 30 sec - exiting 04:03:34 (3988): No heartbeat from core client for 30 sec - exiting 04:03:35 (3988): No heartbeat from core client for 30 sec - exiting 04:03:36 (3988): No heartbeat from core client for 30 sec - exiting 04:03:37 (3988): No heartbeat from core client for 30 sec - exiting 04:03:38 (3988): No heartbeat from core client for 30 sec - exiting 04:03:40 (3988): No heartbeat from core client for 30 sec - exiting 04:03:41 (3988): No heartbeat from core client for 30 sec - exiting 04:03:42 (3988): No heartbeat from core client for 30 sec - exiting 04:03:43 (3988): No heartbeat from core client for 30 sec - exiting 04:03:44 (3988): No heartbeat from core client for 30 sec - exiting 04:03:45 (3988): No heartbeat from core client for 30 sec - exiting 04:03:46 (3988): No heartbeat from core client for 30 sec - exiting 04:03:47 (3988): No heartbeat from core client for 30 sec - exiting 04:03:48 (3988): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:08:05 (3408): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:11:53 (3912): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:16:21 (2512): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:18:19 (120): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 04:28:24 (3552): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:29:38 (3660): No heartbeat from core client for 30 sec - exiting 04:29:39 (3660): No heartbeat from core client for 30 sec - exiting 04:29:40 (3660): No heartbeat from core client for 30 sec - exiting 04:29:41 (3660): No heartbeat from core client for 30 sec - exiting 04:29:42 (3660): No heartbeat from core client for 30 sec - exiting 04:29:43 (3660): No heartbeat from core client for 30 sec - exiting 04:29:45 (3660): No heartbeat from core client for 30 sec - exiting 04:29:46 (3660): No heartbeat from core client for 30 sec - exiting 04:29:47 (3660): No heartbeat from core client for 30 sec - exiting 04:29:48 (3660): No heartbeat from core client for 30 sec - exiting 04:29:49 (3660): No heartbeat from core client for 30 sec - exiting 04:29:50 (3660): No heartbeat from core client for 30 sec - exiting 04:29:51 (3660): No heartbeat from core client for 30 sec - exiting 04:29:52 (3660): No heartbeat from core client for 30 sec - exiting 04:29:53 (3660): No heartbeat from core client for 30 sec - exiting 04:29:54 (3660): No heartbeat from core client for 30 sec - exiting 04:29:55 (3660): No heartbeat from core client for 30 sec - exiting 04:29:57 (3660): No heartbeat from core client for 30 sec - exiting 04:29:58 (3660): No heartbeat from core client for 30 sec - exiting 04:29:59 (3660): No heartbeat from core client for 30 sec - exiting 04:30:00 (3660): No heartbeat from core client for 30 sec - exiting 04:30:01 (3660): No heartbeat from core client for 30 sec - exiting 04:30:02 (3660): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:32:22 (1164): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:32:58 (220): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:34:58 (3524): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:35:57 (2520): No heartbeat from core client for 30 sec - exiting 04:36:34 (2520): No heartbeat from core client for 30 sec - exiting 04:36:35 (2520): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:43:33 (72): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:45:11 (60): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:46:41 (2664): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:49:31 (1232): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 04:57:16 (3812): Can't acquire lockfile (32) - waiting 35s Atmos Hold Restart file rename failed on atmos_restart.hold 05:00:03 (3812): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:03:50 (2412): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:03:51 (2412): No heartbeat from core client for 30 sec - exiting 05:05:13 (604): No heartbeat from core client for 30 sec - exiting 05:05:14 (604): No heartbeat from core client for 30 sec - exiting 05:05:15 (604): No heartbeat from core client for 30 sec - exiting 05:05:16 (604): No heartbeat from core client for 30 sec - exiting 05:05:17 (604): No heartbeat from core client for 30 sec - exiting 05:05:18 (604): No heartbeat from core client for 30 sec - exiting 05:05:19 (604): No heartbeat from core client for 30 sec - exiting 05:05:20 (604): No heartbeat from core client for 30 sec - exiting 05:05:21 (604): No heartbeat from core client for 30 sec - exiting 05:05:22 (604): No heartbeat from core client for 30 sec - exiting 05:05:23 (604): No heartbeat from core client for 30 sec - exiting 05:05:25 (604): No heartbeat from core client for 30 sec - exiting 05:05:26 (604): No heartbeat from core client for 30 sec - exiting 05:05:27 (604): No heartbeat from core client for 30 sec - exiting 05:05:28 (604): No heartbeat from core client for 30 sec - exiting 05:05:29 (604): No heartbeat from core client for 30 sec - exiting 05:05:30 (604): No heartbeat from core client for 30 sec - exiting 05:05:31 (604): No heartbeat from core client for 30 sec - exiting 05:05:32 (604): No heartbeat from core client for 30 sec - exiting 05:05:33 (604): No heartbeat from core client for 30 sec - exiting 05:05:34 (604): No heartbeat from core client for 30 sec - exiting 05:05:36 (604): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:05:37 (604): No heartbeat from core client for 30 sec - exiting 05:05:38 (604): No heartbeat from core client for 30 sec - exiting 05:05:39 (604): No heartbeat from core client for 30 sec - exiting Atmos Hold Restart file rename failed on atmos_restart.hold 05:09:59 (2420): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:11:15 (52): No heartbeat from core client for 30 sec - exiting 05:11:16 (52): No heartbeat from core client for 30 sec - exiting 05:11:18 (52): No heartbeat from core client for 30 sec - exiting 05:11:19 (52): No heartbeat from core client for 30 sec - exiting 05:11:20 (52): No heartbeat from core client for 30 sec - exiting 05:11:21 (52): No heartbeat from core client for 30 sec - exiting 05:11:22 (52): No heartbeat from core client for 30 sec - exiting 05:11:56 (52): No heartbeat from core client for 30 sec - exiting 05:11:57 (52): No heartbeat from core client for 30 sec - exiting 05:11:58 (52): No heartbeat from core client for 30 sec - exiting 05:11:59 (52): No heartbeat from core client for 30 sec - exiting 05:12:00 (52): No heartbeat from core client for 30 sec - exiting 05:12:01 (52): No heartbeat from core client for 30 sec - exiting 05:12:02 (52): No heartbeat from core client for 30 sec - exiting 05:12:04 (52): No heartbeat from core client for 30 sec - exiting 05:12:05 (52): No heartbeat from core client for 30 sec - exiting 05:12:06 (52): No heartbeat from core client for 30 sec - exiting 05:12:07 (52): No heartbeat from core client for 30 sec - exiting 05:12:08 (52): No heartbeat from core client for 30 sec - exiting 05:12:09 (52): No heartbeat from core client for 30 sec - exiting 05:12:10 (52): No heartbeat from core client for 30 sec - exiting 05:12:11 (52): No heartbeat from core client for 30 sec - exiting 05:12:12 (52): No heartbeat from core client for 30 sec - exiting 05:12:13 (52): No heartbeat from core client for 30 sec - exiting 05:12:15 (52): No heartbeat from core client for 30 sec - exiting 05:12:16 (52): No heartbeat from core client for 30 sec - exiting 05:12:17 (52): No heartbeat from core client for 30 sec - exiting 05:12:18 (52): No heartbeat from core client for 30 sec - exiting 05:12:19 (52): No heartbeat from core client for 30 sec - exiting 05:12:20 (52): No heartbeat from core client for 30 sec - exiting 05:12:21 (52): No heartbeat from core client for 30 sec - exiting 05:12:22 (52): No heartbeat from core client for 30 sec - exiting 05:12:23 (52): No heartbeat from core client for 30 sec - exiting 05:12:24 (52): No heartbeat from core client for 30 sec - exiting 05:12:25 (52): No heartbeat from core client for 30 sec - exiting 05:12:27 (52): No heartbeat from core client for 30 sec - exiting 05:12:28 (52): No heartbeat from core client for 30 sec - exiting 05:12:29 (52): No heartbeat from core client for 30 sec - exiting 05:12:30 (52): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:13:57 (3220): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:14:50 (3692): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:15:55 (2560): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:16:39 (3324): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:17:23 (2220): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:17:24 (2220): No heartbeat from core client for 30 sec - exiting 05:17:25 (2220): No heartbeat from core client for 30 sec - exiting 05:17:26 (2220): No heartbeat from core client for 30 sec - exiting 05:17:27 (2220): No heartbeat from core client for 30 sec - exiting 05:18:13 (3228): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:18:50 (2620): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:19:49 (3208): No heartbeat from core client for 30 sec - exiting 05:19:50 (3208): No heartbeat from core client for 30 sec - exiting 05:19:51 (3208): No heartbeat from core client for 30 sec - exiting 05:19:53 (3208): No heartbeat from core client for 30 sec - exiting 05:19:54 (3208): No heartbeat from core client for 30 sec - exiting 05:19:55 (3208): No heartbeat from core client for 30 sec - exiting 05:19:56 (3208): No heartbeat from core client for 30 sec - exiting 05:19:57 (3208): No heartbeat from core client for 30 sec - exiting 05:19:58 (3208): No heartbeat from core client for 30 sec - exiting 05:19:59 (3208): No heartbeat from core client for 30 sec - exiting 05:20:00 (3208): No heartbeat from core client for 30 sec - exiting 05:20:01 (3208): No heartbeat from core client for 30 sec - exiting 05:20:02 (3208): No heartbeat from core client for 30 sec - exiting 05:20:03 (3208): No heartbeat from core client for 30 sec - exiting 05:20:05 (3208): No heartbeat from core client for 30 sec - exiting 05:20:06 (3208): No heartbeat from core client for 30 sec - exiting 05:20:07 (3208): No heartbeat from core client for 30 sec - exiting 05:20:08 (3208): No heartbeat from core client for 30 sec - exiting 05:20:09 (3208): No heartbeat from core client for 30 sec - exiting 05:20:10 (3208): No heartbeat from core client for 30 sec - exiting 05:20:11 (3208): No heartbeat from core client for 30 sec - exiting 05:20:45 (3208): No heartbeat from core client for 30 sec - exiting 05:20:46 (3208): No heartbeat from core client for 30 sec - exiting 05:20:47 (3208): No heartbeat from core client for 30 sec - exiting 05:20:48 (3208): No heartbeat from core client for 30 sec - exiting 05:20:49 (3208): No heartbeat from core client for 30 sec - exiting 05:20:50 (3208): No heartbeat from core client for 30 sec - exiting 05:20:52 (3208): No heartbeat from core client for 30 sec - exiting 05:20:53 (3208): No heartbeat from core client for 30 sec - exiting 05:20:54 (3208): No heartbeat from core client for 30 sec - exiting 05:20:55 (3208): No heartbeat from core client for 30 sec - exiting 05:20:56 (3208): No heartbeat from core client for 30 sec - exiting 05:20:57 (3208): No heartbeat from core client for 30 sec - exiting 05:20:58 (3208): No heartbeat from core client for 30 sec - exiting 05:21:32 (3208): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:21:41 (3208): No heartbeat from core client for 30 sec - exiting 05:22:17 (2524): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:23:32 (636): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... A5:24:17 (2840): No heartbeat from core client for 30 sec - exiting tmos Hold Restart file rename failed on atmos_restart.hold Model crashed: U_MODEL: Illegal combination of submodels tmp/pipe_dummy 2048 CPDN Monitor - No 'heartbeat' from BOINC... Atmos Hold Restart file rename failed on atmos_restart.hold Model crashed: U_MODEL: Illegal combination of submodels tmp/pipe_dummy 2048 05:26:47 (2852): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Atmos Hold Restart file rename failed on atmos_restart.hold Model crashed: U_MODEL: Illegal combination of submodels tmp/pipe_dummy 2048 05:27:24 (3844): No heartbeat from core client for 30 sec - exiting 05:27:25 (3844): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Atmos Hold Restart file rename failed on atmos_restart.hold Model crashed: U_MODEL: Illegal combination of submodels tmp/pipe_dummy 2048 Atmos Hold Restart file rename failed on atmos_restart.hold Model crashed: U_MODEL: Illegal combination of submodels tmp/pipe_dummy 2048 05:33:07 (1424): No heartbeat from core client for 30 sec - exiting 05:33:09 (1424): No heartbeat from core client for 30 sec - exiting 05:33:10 (1424): No heartbeat from core client for 30 sec - exiting 05:33:11 (1424): No heartbeat from core client for 30 sec - exiting 05:33:12 (1424): No heartbeat from core client for 30 sec - exiting 05:33:13 (1424): No heartbeat from core client for 30 sec - exiting 05:33:14 (1424): No heartbeat from core client for 30 sec - exiting 05:33:15 (1424): No heartbeat from core client for 30 sec - exiting 05:33:16 (1424): No heartbeat from core client for 30 sec - exiting 05:33:17 (1424): No heartbeat from core client for 30 sec - exiting 05:33:18 (1424): No heartbeat from core client for 30 sec - exiting 05:33:20 (1424): No heartbeat from core client for 30 sec - exiting 05:33:21 (1424): No heartbeat from core client for 30 sec - exiting 05:33:22 (1424): No heartbeat from core client for 30 sec - exiting 05:33:23 (1424): No heartbeat from core client for 30 sec - exiting 05:33:24 (1424): No heartbeat from core client for 30 sec - exiting 05:33:25 (1424): No heartbeat from core client for 30 sec - exiting 05:33:26 (1424): No heartbeat from core client for 30 sec - exiting 05:33:27 (1424): No heartbeat from core client for 30 sec - exiting 05:33:28 (1424): No heartbeat from core client for 30 sec - exiting 05:33:29 (1424): No heartbeat from core client for 30 sec - exiting 05:33:31 (1424): No heartbeat from core client for 30 sec - exiting 05:33:32 (1424): No heartbeat from core client for 30 sec - exiting 05:33:33 (1424): No heartbeat from core client for 30 sec - exiting 05:33:34 (1424): No heartbeat from core client for 30 sec - exiting 05:33:35 (1424): No heartbeat from core client for 30 sec - exiting 05:33:36 (1424): No heartbeat from core client for 30 sec - exiting 05:33:37 (1424): No heartbeat from core client for 30 sec - exiting 05:33:38 (1424): No heartbeat from core client for 30 sec - exiting 05:33:39 (1424): No heartbeat from core client for 30 sec - exiting 05:33:40 (1424): No heartbeat from core client for 30 sec - exiting 05:33:41 (1424): No heartbeat from core client for 30 sec - exiting 05:33:43 (1424): No heartbeat from core client for 30 sec - exiting 05:33:44 (1424): No heartbeat from core client for 30 sec - exiting 05:33:45 (1424): No heartbeat from core client for 30 sec - exiting 05:33:46 (1424): No heartbeat from core client for 30 sec - exiting 05:33:47 (1424): No heartbeat from core client for 30 sec - exiting 05:33:48 (1424): No heartbeat from core client for 30 sec - exiting 05:33:49 (1424): No heartbeat from core client for 30 sec - exiting 05:33:50 (1424): No heartbeat from core client for 30 sec - exiting 05:33:51 (1424): No heartbeat from core client for 30 sec - exiting 05:33:52 (1424): No heartbeat from core client for 30 sec - exiting 05:33:53 (1424): No heartbeat from core client for 30 sec - exiting 05:33:55 (1424): No heartbeat from core client for 30 sec - exiting 05:33:56 (1424): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:39:18 (540): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Atmos Hold Restart file rename failed on atmos_restart.hold Model crashed: U_MODEL: Illegal combination of submodels tmp/pipe_dummy 2048 Atmos Hold Restart file rename failed on atmos_restart.hold Model crashed: U_MODEL: Illegal combination of submodels tmp/pipe_dummy 2048 Sorry, too many model crashes! :-( Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
01 Nov 2011 19:22:06	1176150	13571083	hadcm3n_yk1b_1900_40_007524127_2	25,920	48,229	1.8607