Task 14651280

Name	hadcm3n_o5wq_2020_40_007955454_4
Workunit	8110566
Created	9 May 2012, 18:54:32 UTC
Sent	9 May 2012, 21:33:39 UTC
Report deadline	9 Aug 2012, 5:00:50 UTC
Received	23 May 2012, 19:40:23 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	193 (0x000000C1) EXIT_SIGNAL
Computer ID	1191123
Run time	6 days 4 hours 4 min 13 sec
CPU time	5 days 9 hours 21 min 55 sec
Validate state	Invalid
Credit	6,220.80
Device peak FLOPS	2.89 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>6.12.34</core_client_version> <![CDATA[ <message> - exit code 193 (0xc1) </message> <stderr_txt> 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... 21:10:10 (944): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 21:23:18 (3148): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 04:00:33 (3336): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Ocean Restart file copy failed on o5wqko.dam8170 Suspended CPDN Monitor - Suspend request from BOINC... 05:52:23 (3616): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:53:47 (1600): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:09:29 (3264): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 15:35:13 (3672): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 16:25:49 (4068): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 03:38:03 (4088): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 03:54:02 (1532): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:54:03 (1532): No heartbeat from core client for 30 sec - exiting 03:55:19 (3908): No heartbeat from core client for 30 sec - exiting 03:55:20 (3908): No heartbeat from core client for 30 sec - exiting 03:55:21 (3908): No heartbeat from core client for 30 sec - exiting 03:55:23 (3908): No heartbeat from core client for 30 sec - exiting 03:55:24 (3908): No heartbeat from core client for 30 sec - exiting 03:55:25 (3908): No heartbeat from core client for 30 sec - exiting 03:55:26 (3908): No heartbeat from core client for 30 sec - exiting 03:55:27 (3908): No heartbeat from core client for 30 sec - exiting 03:55:28 (3908): No heartbeat from core client for 30 sec - exiting 03:55:29 (3908): No heartbeat from core client for 30 sec - exiting 03:55:30 (3908): No heartbeat from core client for 30 sec - exiting 03:55:31 (3908): No heartbeat from core client for 30 sec - exiting 03:55:33 (3908): No heartbeat from core client for 30 sec - exiting 03:55:34 (3908): No heartbeat from core client for 30 sec - exiting 03:55:35 (3908): No heartbeat from core client for 30 sec - exiting 03:55:36 (3908): No heartbeat from core client for 30 sec - exiting 03:55:37 (3908): No heartbeat from core client for 30 sec - exiting 03:55:38 (3908): No heartbeat from core client for 30 sec - exiting 03:55:39 (3908): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 06:14:35 (3536): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:14:36 (3536): No heartbeat from core client for 30 sec - exiting 06:14:37 (3536): No heartbeat from core client for 30 sec - exiting 06:15:41 (3704): No heartbeat from core client for 30 sec - exiting 06:15:42 (3704): No heartbeat from core client for 30 sec - exiting 06:15:43 (3704): No heartbeat from core client for 30 sec - exiting 06:15:44 (3704): No heartbeat from core client for 30 sec - exiting 06:15:46 (3704): No heartbeat from core client for 30 sec - exiting 06:15:47 (3704): No heartbeat from core client for 30 sec - exiting 06:15:48 (3704): No heartbeat from core client for 30 sec - exiting 06:15:49 (3704): No heartbeat from core client for 30 sec - exiting 06:15:50 (3704): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:15:51 (3704): No heartbeat from core client for 30 sec - exiting 06:16:50 (3968): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 06:38:42 (1992): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:54:48 (2812): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:55:49 (2248): No heartbeat from core client for 30 sec - exiting 06:55:50 (2248): No heartbeat from core client for 30 sec - exiting 06:55:51 (2248): No heartbeat from core client for 30 sec - exiting 06:55:52 (2248): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 07:38:57 (3076): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:39:32 (472): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 07:55:18 (2212): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:55:20 (2212): No heartbeat from core client for 30 sec - exiting 07:56:59 (2596): No heartbeat from core client for 30 sec - exiting 07:57:00 (2596): No heartbeat from core client for 30 sec - exiting 07:57:01 (2596): No heartbeat from core client for 30 sec - exiting 07:57:02 (2596): No heartbeat from core client for 30 sec - exiting 07:57:03 (2596): No heartbeat from core client for 30 sec - exiting 07:57:04 (2596): No heartbeat from core client for 30 sec - exiting 07:57:05 (2596): No heartbeat from core client for 30 sec - exiting 07:57:07 (2596): No heartbeat from core client for 30 sec - exiting 07:57:08 (2596): No heartbeat from core client for 30 sec - exiting 07:57:09 (2596): No heartbeat from core client for 30 sec - exiting 07:57:10 (2596): No heartbeat from core client for 30 sec - exiting 07:57:11 (2596): No heartbeat from core client for 30 sec - exiting 07:57:12 (2596): No heartbeat from core client for 30 sec - exiting 07:57:13 (2596): No heartbeat from core client for 30 sec - exiting 07:57:14 (2596): No heartbeat from core client for 30 sec - exiting 07:57:16 (2596): No heartbeat from core client for 30 sec - exiting 07:57:17 (2596): No heartbeat from core client for 30 sec - exiting 07:57:18 (2596): No heartbeat from core client for 30 sec - exiting 07:57:19 (2596): No heartbeat from core client for 30 sec - exiting 07:57:20 (2596): No heartbeat from core client for 30 sec - exiting 07:57:21 (2596): No heartbeat from core client for 30 sec - exiting 07:57:22 (2596): No heartbeat from core client for 30 sec - exiting 07:57:24 (2596): No heartbeat from core client for 30 sec - exiting 07:57:25 (2596): No heartbeat from core client for 30 sec - exiting 07:57:26 (2596): No heartbeat from core client for 30 sec - exiting 07:57:27 (2596): No heartbeat from core client for 30 sec - exiting 07:57:28 (2596): No heartbeat from core client for 30 sec - exiting 07:57:29 (2596): No heartbeat from core client for 30 sec - exiting 07:57:30 (2596): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:57:31 (2596): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 08:15:43 (3396): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:32:27 (3144): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:33:22 (3508): No heartbeat from core client for 30 sec - exiting 08:33:23 (3508): No heartbeat from core client for 30 sec - exiting 08:33:24 (3508): No heartbeat from core client for 30 sec - exiting 08:33:25 (3508): No heartbeat from core client for 30 sec - exiting 08:33:26 (3508): No heartbeat from core client for 30 sec - exiting 08:33:27 (3508): No heartbeat from core client for 30 sec - exiting 08:33:28 (3508): No heartbeat from core client for 30 sec - exiting 08:33:30 (3508): No heartbeat from core client for 30 sec - exiting 08:33:31 (3508): No heartbeat from core client for 30 sec - exiting 08:33:32 (3508): No heartbeat from core client for 30 sec - exiting 08:33:33 (3508): No heartbeat from core client for 30 sec - exiting 08:33:34 (3508): No heartbeat from core client for 30 sec - exiting 08:33:35 (3508): No heartbeat from core client for 30 sec - exiting 08:33:36 (3508): No heartbeat from core client for 30 sec - exiting 08:33:38 (3508): No heartbeat from core client for 30 sec - exiting 08:33:39 (3508): No heartbeat from core client for 30 sec - exiting 08:33:40 (3508): No heartbeat from core client for 30 sec - exiting 08:33:41 (3508): No heartbeat from core client for 30 sec - exiting 08:33:42 (3508): No heartbeat from core client for 30 sec - exiting 08:33:43 (3508): No heartbeat from core client for 30 sec - exiting 08:33:44 (3508): No heartbeat from core client for 30 sec - exiting 08:33:45 (3508): No heartbeat from core client for 30 sec - exiting 08:33:47 (3508): No heartbeat from core client for 30 sec - exiting 08:33:48 (3508): No heartbeat from core client for 30 sec - exiting 08:33:49 (3508): No heartbeat from core client for 30 sec - exiting 08:33:50 (3508): No heartbeat from core client for 30 sec - exiting 08:33:51 (3508): No heartbeat from core client for 30 sec - exiting 08:33:52 (3508): No heartbeat from core client for 30 sec - exiting 08:33:53 (3508): No heartbeat from core client for 30 sec - exiting 08:33:54 (3508): No heartbeat from core client for 30 sec - exiting 08:33:56 (3508): No heartbeat from core client for 30 sec - exiting 08:33:57 (3508): No heartbeat from core client for 30 sec - exiting 08:33:58 (3508): No heartbeat from core client for 30 sec - exiting 08:33:59 (3508): No heartbeat from core client for 30 sec - exiting 08:34:00 (3508): No heartbeat from core client for 30 sec - exiting 08:34:01 (3508): No heartbeat from core client for 30 sec - exiting 08:34:02 (3508): No heartbeat from core client for 30 sec - exiting 08:34:03 (3508): No heartbeat from core client for 30 sec - exiting 08:34:05 (3508): No heartbeat from core client for 30 sec - exiting 08:34:06 (3508): No heartbeat from core client for 30 sec - exiting 08:34:07 (3508): No heartbeat from core client for 30 sec - exiting 08:34:08 (3508): No heartbeat from core client for 30 sec - exiting 08:34:09 (3508): No heartbeat from core client for 30 sec - exiting 08:34:10 (3508): No heartbeat from core client for 30 sec - exiting 08:34:11 (3508): No heartbeat from core client for 30 sec - exiting 08:34:12 (3508): No heartbeat from core client for 30 sec - exiting 08:34:14 (3508): No heartbeat from core client for 30 sec - exiting 08:34:15 (3508): No heartbeat from core client for 30 sec - exiting 08:34:16 (3508): No heartbeat from core client for 30 sec - exiting 08:34:17 (3508): No heartbeat from core client for 30 sec - exiting 08:34:18 (3508): No heartbeat from core client for 30 sec - exiting 08:34:19 (3508): No heartbeat from core client for 30 sec - exiting 08:34:20 (3508): No heartbeat from core client for 30 sec - exiting 08:34:21 (3508): No heartbeat from core client for 30 sec - exiting 08:34:23 (3508): No heartbeat from core client for 30 sec - exiting 08:34:24 (3508): No heartbeat from core client for 30 sec - exiting 08:34:25 (3508): No heartbeat from core client for 30 sec - exiting 08:34:26 (3508): No heartbeat from core client for 30 sec - exiting 08:34:27 (3508): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 08:52:28 (2892): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:52:30 (2892): No heartbeat from core client for 30 sec - exiting 08:53:33 (524): No heartbeat from core client for 30 sec - exiting 08:53:34 (524): No heartbeat from core client for 30 sec - exiting 08:53:36 (524): No heartbeat from core client for 30 sec - exiting 08:53:37 (524): No heartbeat from core client for 30 sec - exiting 08:53:38 (524): No heartbeat from core client for 30 sec - exiting 08:53:39 (524): No heartbeat from core client for 30 sec - exiting 08:53:40 (524): No heartbeat from core client for 30 sec - exiting 08:53:41 (524): No heartbeat from core client for 30 sec - exiting 08:53:42 (524): No heartbeat from core client for 30 sec - exiting 08:53:43 (524): No heartbeat from core client for 30 sec - exiting 08:53:45 (524): No heartbeat from core client for 30 sec - exiting 08:53:46 (524): No heartbeat from core client for 30 sec - exiting 08:53:47 (524): No heartbeat from core client for 30 sec - exiting 08:53:48 (524): No heartbeat from core client for 30 sec - exiting 08:53:49 (524): No heartbeat from core client for 30 sec - exiting 08:53:50 (524): No heartbeat from core client for 30 sec - exiting 08:53:51 (524): No heartbeat from core client for 30 sec - exiting 08:53:52 (524): No heartbeat from core client for 30 sec - exiting 08:53:54 (524): No heartbeat from core client for 30 sec - exiting 08:53:55 (524): No heartbeat from core client for 30 sec - exiting 08:53:56 (524): No heartbeat from core client for 30 sec - exiting 08:53:57 (524): No heartbeat from core client for 30 sec - exiting 08:53:58 (524): No heartbeat from core client for 30 sec - exiting 08:53:59 (524): No heartbeat from core client for 30 sec - exiting 08:54:00 (524): No heartbeat from core client for 30 sec - exiting 08:54:01 (524): No heartbeat from core client for 30 sec - exiting 08:54:02 (524): No heartbeat from core client for 30 sec - exiting 08:54:04 (524): No heartbeat from core client for 30 sec - exiting 08:54:05 (524): No heartbeat from core client for 30 sec - exiting 08:54:06 (524): No heartbeat from core client for 30 sec - exiting 08:54:07 (524): No heartbeat from core client for 30 sec - exiting 08:54:08 (524): No heartbeat from core client for 30 sec - exiting 08:54:09 (524): No heartbeat from core client for 30 sec - exiting 08:54:10 (524): No heartbeat from core client for 30 sec - exiting 08:54:11 (524): No heartbeat from core client for 30 sec - exiting 08:54:13 (524): No heartbeat from core client for 30 sec - exiting 08:54:14 (524): No heartbeat from core client for 30 sec - exiting 08:54:15 (524): No heartbeat from core client for 30 sec - exiting 08:54:16 (524): No heartbeat from core client for 30 sec - exiting 08:54:17 (524): No heartbeat from core client for 30 sec - exiting 08:54:18 (524): No heartbeat from core client for 30 sec - exiting 08:54:19 (524): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 09:12:30 (3856): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:12:31 (3856): No heartbeat from core client for 30 sec - exiting 09:13:24 (1484): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 09:32:33 (3132): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:32:34 (3132): No heartbeat from core client for 30 sec - exiting 09:33:24 (884): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 11:31:51 (3656): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:31:52 (3656): No heartbeat from core client for 30 sec - exiting 11:48:04 (1904): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:48:06 (1904): No heartbeat from core client for 30 sec - exiting 11:49:28 (3456): No heartbeat from core client for 30 sec - exiting 11:49:29 (3456): No heartbeat from core client for 30 sec - exiting 11:49:30 (3456): No heartbeat from core client for 30 sec - exiting 11:49:31 (3456): No heartbeat from core client for 30 sec - exiting 11:49:32 (3456): No heartbeat from core client for 30 sec - exiting 11:49:33 (3456): No heartbeat from core client for 30 sec - exiting 11:49:34 (3456): No heartbeat from core client for 30 sec - exiting 11:49:35 (3456): No heartbeat from core client for 30 sec - exiting 11:49:37 (3456): No heartbeat from core client for 30 sec - exiting 11:49:38 (3456): No heartbeat from core client for 30 sec - exiting 11:49:39 (3456): No heartbeat from core client for 30 sec - exiting 11:49:40 (3456): No heartbeat from core client for 30 sec - exiting 11:49:41 (3456): No heartbeat from core client for 30 sec - exiting 11:49:42 (3456): No heartbeat from core client for 30 sec - exiting 11:49:43 (3456): No heartbeat from core client for 30 sec - exiting 11:49:44 (3456): No heartbeat from core client for 30 sec - exiting 11:49:45 (3456): No heartbeat from core client for 30 sec - exiting 11:49:46 (3456): No heartbeat from core client for 30 sec - exiting 11:49:48 (3456): No heartbeat from core client for 30 sec - exiting 11:49:49 (3456): No heartbeat from core client for 30 sec - exiting 11:49:50 (3456): No heartbeat from core client for 30 sec - exiting 11:49:51 (3456): No heartbeat from core client for 30 sec - exiting 11:49:52 (3456): No heartbeat from core client for 30 sec - exiting 11:49:53 (3456): No heartbeat from core client for 30 sec - exiting 11:49:54 (3456): No heartbeat from core client for 30 sec - exiting 11:49:55 (3456): No heartbeat from core client for 30 sec - exiting 11:49:57 (3456): No heartbeat from core client for 30 sec - exiting 11:49:58 (3456): No heartbeat from core client for 30 sec - exiting 11:49:59 (3456): No heartbeat from core client for 30 sec - exiting 11:50:00 (3456): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:50:01 (3456): No heartbeat from core client for 30 sec - exiting 11:50:02 (3456): No heartbeat from core client for 30 sec - exiting 11:50:03 (3456): No heartbeat from core client for 30 sec - exiting 11:50:05 (3456): No heartbeat from core client for 30 sec - exiting 11:50:06 (3456): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 14:03:16 (2556): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:05:01 (2116): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 23:38:53 (2496): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:38:56 (2496): No heartbeat from core client for 30 sec - exiting 23:40:36 (3752): No heartbeat from core client for 30 sec - exiting 23:40:37 (3752): No heartbeat from core client for 30 sec - exiting 23:40:38 (3752): No heartbeat from core client for 30 sec - exiting 23:40:39 (3752): No heartbeat from core client for 30 sec - exiting 23:40:40 (3752): No heartbeat from core client for 30 sec - exiting 23:40:41 (3752): No heartbeat from core client for 30 sec - exiting 23:40:43 (3752): No heartbeat from core client for 30 sec - exiting 23:40:44 (3752): No heartbeat from core client for 30 sec - exiting 23:40:45 (3752): No heartbeat from core client for 30 sec - exiting 23:40:46 (3752): No heartbeat from core client for 30 sec - exiting 23:40:47 (3752): No heartbeat from core client for 30 sec - exiting 23:40:48 (3752): No heartbeat from core client for 30 sec - exiting 23:40:49 (3752): No heartbeat from core client for 30 sec - exiting 23:40:50 (3752): No heartbeat from core client for 30 sec - exiting 23:40:52 (3752): No heartbeat from core client for 30 sec - exiting 23:40:53 (3752): No heartbeat from core client for 30 sec - exiting 23:40:54 (3752): No heartbeat from core client for 30 sec - exiting 23:40:55 (3752): No heartbeat from core client for 30 sec - exiting 23:40:56 (3752): No heartbeat from core client for 30 sec - exiting 23:40:57 (3752): No heartbeat from core client for 30 sec - exiting 23:40:58 (3752): No heartbeat from core client for 30 sec - exiting 23:40:59 (3752): No heartbeat from core client for 30 sec - exiting 23:41:01 (3752): No heartbeat from core client for 30 sec - exiting 23:41:02 (3752): No heartbeat from core client for 30 sec - exiting 23:41:03 (3752): No heartbeat from core client for 30 sec - exiting 23:41:04 (3752): No heartbeat from core client for 30 sec - exiting 23:41:05 (3752): No heartbeat from core client for 30 sec - exiting 23:41:06 (3752): No heartbeat from core client for 30 sec - exiting 23:41:07 (3752): No heartbeat from core client for 30 sec - exiting 23:41:08 (3752): No heartbeat from core client for 30 sec - exiting 23:41:09 (3752): No heartbeat from core client for 30 sec - exiting 23:41:11 (3752): No heartbeat from core client for 30 sec - exiting 23:41:12 (3752): No heartbeat from core client for 30 sec - exiting 23:41:13 (3752): No heartbeat from core client for 30 sec - exiting 23:41:14 (3752): No heartbeat from core client for 30 sec - exiting 23:41:15 (3752): No heartbeat from core client for 30 sec - exiting 23:41:16 (3752): No heartbeat from core client for 30 sec - exiting 23:41:17 (3752): No heartbeat from core client for 30 sec - exiting 23:41:18 (3752): No heartbeat from core client for 30 sec - exiting 23:41:20 (3752): No heartbeat from core client for 30 sec - exiting 23:41:21 (3752): No heartbeat from core client for 30 sec - exiting 23:41:22 (3752): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 23:42:48 (3736): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 00:28:25 (2088): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:38:30 (3996): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:14:17 (1536): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:46:45 (1936): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:15:30 (3420): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:00:19 (804): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 05:12:59 (3664): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:14:00 (3516): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 05:25:12 (1676): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:46:02 (2164): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:47:02 (1924): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 07:09:26 (3564): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:41:16 (452): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:42:33 (3420): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:30:00 (3528): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 10:44:26 (1980): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:44:27 (1980): No heartbeat from core client for 30 sec - exiting 15:44:11 (460): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:14:02 (2088): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:36:41 (1360): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:37:20 (796): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 17:56:22 (1068): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:57:31 (1516): No heartbeat from core client for 30 sec - exiting 17:57:32 (1516): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:57:33 (1516): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 18:13:56 (2136): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:14:56 (3228): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 02:42:47 (2580): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:42:48 (2580): No heartbeat from core client for 30 sec - exiting 02:43:46 (1624): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 05:44:17 (928): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 08:43:50 (2908): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:47:19 (708): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 08:50:50 (220): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 15:10:04 (2728): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 20:25:23 (900): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 00:30:39 (1684): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:33:21 (3684): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 11:43:14 (3456): No heartbeat from core client for 30 sec - exiting 11:43:15 (3456): No heartbeat from core client for 30 sec - exiting 11:43:16 (3456): No heartbeat from core client for 30 sec - exiting 11:43:17 (3456): No heartbeat from core client for 30 sec - exiting 11:43:18 (3456): No heartbeat from core client for 30 sec - exiting 11:43:19 (3456): No heartbeat from core client for 30 sec - exiting 11:43:20 (3456): No heartbeat from core client for 30 sec - exiting 11:43:22 (3456): No heartbeat from core client for 30 sec - exiting 11:43:23 (3456): No heartbeat from core client for 30 sec - exiting 11:43:24 (3456): No heartbeat from core client for 30 sec - exiting 11:43:25 (3456): No heartbeat from core client for 30 sec - exiting 11:43:26 (3456): No heartbeat from core client for 30 sec - exiting 11:43:27 (3456): No heartbeat from core client for 30 sec - exiting 11:43:28 (3456): No heartbeat from core client for 30 sec - exiting 11:43:30 (3456): No heartbeat from core client for 30 sec - exiting 11:43:31 (3456): No heartbeat from core client for 30 sec - exiting 11:43:32 (3456): No heartbeat from core client for 30 sec - exiting 11:43:33 (3456): No heartbeat from core client for 30 sec - exiting 11:43:34 (3456): No heartbeat from core client for 30 sec - exiting 11:43:35 (3456): No heartbeat from core client for 30 sec - exiting 11:43:36 (3456): No heartbeat from core client for 30 sec - exiting 11:43:37 (3456): No heartbeat from core client for 30 sec - exiting 11:43:39 (3456): No heartbeat from core client for 30 sec - exiting 11:43:40 (3456): No heartbeat from core client for 30 sec - exiting 11:43:41 (3456): No heartbeat from core client for 30 sec - exiting 11:43:42 (3456): No heartbeat from core client for 30 sec - exiting 11:43:43 (3456): No heartbeat from core client for 30 sec - exiting 11:43:44 (3456): No heartbeat from core client for 30 sec - exiting 11:43:45 (3456): No heartbeat from core client for 30 sec - exiting 11:43:46 (3456): No heartbeat from core client for 30 sec - exiting 11:43:48 (3456): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:43:49 (3456): No heartbeat from core client for 30 sec - exiting 11:43:50 (3456): No heartbeat from core client for 30 sec - exiting 11:43:51 (3456): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 13:45:54 (3568): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:53:14 (1968): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Signal 11 received, exiting... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
23 May 2012 18:44:05	1191123	14651280	hadcm3n_o5wq_2020_40_007955454_4	518,400	465,695	0.8983
22 May 2012 19:29:27	1191123	14651280	hadcm3n_o5wq_2020_40_007955454_4	492,480	442,163	0.8978
21 May 2012 20:15:24	1191123	14651280	hadcm3n_o5wq_2020_40_007955454_4	466,560	418,939	0.8979
20 May 2012 16:47:30	1191123	14651280	hadcm3n_o5wq_2020_40_007955454_4	440,640	395,459	0.8975
20 May 2012 09:42:42	1191123	14651280	hadcm3n_o5wq_2020_40_007955454_4	414,720	372,370	0.8979
20 May 2012 02:22:45	1191123	14651280	hadcm3n_o5wq_2020_40_007955454_4	388,800	349,263	0.8983
18 May 2012 22:01:28	1191123	14651280	hadcm3n_o5wq_2020_40_007955454_4	362,880	325,906	0.8981
18 May 2012 13:28:08	1191123	14651280	hadcm3n_o5wq_2020_40_007955454_4	336,960	302,798	0.8986
18 May 2012 05:37:32	1191123	14651280	hadcm3n_o5wq_2020_40_007955454_4	311,040	279,587	0.8989
17 May 2012 21:21:24	1191123	14651280	hadcm3n_o5wq_2020_40_007955454_4	285,120	256,037	0.8980
17 May 2012 11:49:02	1191123	14651280	hadcm3n_o5wq_2020_40_007955454_4	259,200	232,555	0.8972
17 May 2012 01:44:52	1191123	14651280	hadcm3n_o5wq_2020_40_007955454_4	233,280	209,270	0.8971
16 May 2012 10:54:50	1191123	14651280	hadcm3n_o5wq_2020_40_007955454_4	207,360	186,504	0.8994
16 May 2012 03:26:12	1191123	14651280	hadcm3n_o5wq_2020_40_007955454_4	181,440	163,254	0.8998
15 May 2012 18:54:33	1191123	14651280	hadcm3n_o5wq_2020_40_007955454_4	155,520	140,193	0.9014
15 May 2012 11:05:47	1191123	14651280	hadcm3n_o5wq_2020_40_007955454_4	129,600	116,675	0.9003
15 May 2012 03:47:16	1191123	14651280	hadcm3n_o5wq_2020_40_007955454_4	103,680	93,481	0.9016
14 May 2012 17:05:43	1191123	14651280	hadcm3n_o5wq_2020_40_007955454_4	77,760	70,051	0.9009
14 May 2012 08:17:02	1191123	14651280	hadcm3n_o5wq_2020_40_007955454_4	51,840	46,752	0.9019
14 May 2012 01:08:39	1191123	14651280	hadcm3n_o5wq_2020_40_007955454_4	25,920	23,326	0.8999