Task 13091605

Name	hadcm3n_y8hw_1900_40_007343870_0
Workunit	7541300
Created	6 Jul 2011, 13:20:54 UTC
Sent	22 Jul 2011, 21:59:09 UTC
Report deadline	22 Oct 2011, 5:26:20 UTC
Received	8 Oct 2011, 15:01:20 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	193 (0x000000C1) EXIT_SIGNAL
Computer ID	997949
Run time	19 days 21 hours 48 min 12 sec
CPU time	17 days 22 hours 19 min 25 sec
Validate state	Invalid
Credit	12,441.60
Device peak FLOPS	3.23 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>6.10.58</core_client_version> <![CDATA[ <message> - exit code 193 (0xc1) </message> <stderr_txt> del crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... 12:55:33 (5420): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:56:10 (4964): No heartbeat from core client for 30 sec - exiting 12:56:11 (4964): No heartbeat from core client for 30 sec - exiting 12:56:12 (4964): No heartbeat from core client for 30 sec - exiting 12:56:13 (4964): No heartbeat from core client for 30 sec - exiting 12:56:14 (4964): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:58:06 (4528): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:58:41 (5272): No heartbeat from core client for 30 sec - exiting 12:58:42 (5272): No heartbeat from core client for 30 sec - exiting 12:58:43 (5272): No heartbeat from core client for 30 sec - exiting 12:58:44 (5272): No heartbeat from core client for 30 sec - exiting 12:58:45 (5272): No heartbeat from core client for 30 sec - exiting 12:58:46 (5272): No heartbeat from core client for 30 sec - exiting 12:58:47 (5272): No heartbeat from core client for 30 sec - exiting 12:58:48 (5272): No heartbeat from core client for 30 sec - exiting 12:58:49 (5272): No heartbeat from core client for 30 sec - exiting 12:58:50 (5272): No heartbeat from core client for 30 sec - exiting 12:58:51 (5272): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 10:24:31 (6120): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:25:28 (5932): No heartbeat from core client for 30 sec - exiting 10:25:29 (5932): No heartbeat from core client for 30 sec - exiting 10:25:30 (5932): No heartbeat from core client for 30 sec - exiting 10:25:31 (5932): No heartbeat from core client for 30 sec - exiting 10:25:32 (5932): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:34:19 (3596): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:35:06 (6052): No heartbeat from core client for 30 sec - exiting 10:35:07 (6052): No heartbeat from core client for 30 sec - exiting 10:35:08 (6052): No heartbeat from core client for 30 sec - exiting 10:35:09 (6052): No heartbeat from core client for 30 sec - exiting 10:35:10 (6052): No heartbeat from core client for 30 sec - exiting 10:35:11 (6052): No heartbeat from core client for 30 sec - exiting 10:35:12 (6052): No heartbeat from core client for 30 sec - exiting 10:35:13 (6052): No heartbeat from core client for 30 sec - exiting 10:35:14 (6052): No heartbeat from core client for 30 sec - exiting 10:35:15 (6052): No heartbeat from core client for 30 sec - exiting 10:35:16 (6052): No heartbeat from core client for 30 sec - exiting 10:35:17 (6052): No heartbeat from core client for 30 sec - exiting 10:35:18 (6052): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 11:11:21 (3408): No heartbeat from core client for 30 sec - exiting 11:11:22 (3408): No heartbeat from core client for 30 sec - exiting 11:11:23 (3408): No heartbeat from core client for 30 sec - exiting 11:11:24 (3408): No heartbeat from core client for 30 sec - exiting 11:11:25 (3408): No heartbeat from core client for 30 sec - exiting 11:11:26 (3408): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:11:27 (3408): No heartbeat from core client for 30 sec - exiting 11:11:28 (3408): No heartbeat from core client for 30 sec - exiting 11:11:29 (3408): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... 11:24:19 (3484): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 11:35:41 (9536): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 14:05:05 (3092): No heartbeat from core client for 30 sec - exiting 14:05:06 (3092): No heartbeat from core client for 30 sec - exiting 14:05:07 (3092): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:22:09 (604): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 11:36:56 (3032): No heartbeat from core client for 30 sec - exiting 11:36:57 (3032): No heartbeat from core client for 30 sec - exiting 11:36:58 (3032): No heartbeat from core client for 30 sec - exiting 11:36:59 (3032): No heartbeat from core client for 30 sec - exiting 11:37:00 (3032): No heartbeat from core client for 30 sec - exiting 11:37:01 (3032): No heartbeat from core client for 30 sec - exiting 11:37:02 (3032): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:37:03 (3032): No heartbeat from core client for 30 sec - exiting 13:32:23 (3868): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:32:25 (3868): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... 17:34:44 (6476): No heartbeat from core client for 30 sec - exiting 17:34:45 (6476): No heartbeat from core client for 30 sec - exiting 17:34:46 (6476): No heartbeat from core client for 30 sec - exiting 17:34:47 (6476): No heartbeat from core client for 30 sec - exiting 17:34:48 (6476): No heartbeat from core client for 30 sec - exiting 17:34:49 (6476): No heartbeat from core client for 30 sec - exiting 17:34:51 (6476): No heartbeat from core client for 30 sec - exiting 17:34:52 (6476): No heartbeat from core client for 30 sec - exiting 17:34:53 (6476): No heartbeat from core client for 30 sec - exiting 17:34:54 (6476): No heartbeat from core client for 30 sec - exiting 17:34:55 (6476): No heartbeat from core client for 30 sec - exiting 17:34:56 (6476): No heartbeat from core client for 30 sec - exiting 17:34:57 (6476): No heartbeat from core client for 30 sec - exiting 17:34:58 (6476): No heartbeat from core client for 30 sec - exiting 17:34:59 (6476): No heartbeat from core client for 30 sec - exiting 17:35:00 (6476): No heartbeat from core client for 30 sec - exiting 17:35:01 (6476): No heartbeat from core client for 30 sec - exiting 17:35:02 (6476): No heartbeat from core client for 30 sec - exiting 17:35:03 (6476): No heartbeat from core client for 30 sec - exiting 17:35:04 (6476): No heartbeat from core client for 30 sec - exiting 17:35:05 (6476): No heartbeat from core client for 30 sec - exiting 17:35:06 (6476): No heartbeat from core client for 30 sec - exiting 17:35:07 (6476): No heartbeat from core client for 30 sec - exiting 17:35:08 (6476): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:35:09 (6476): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... BUFFOUT: C I/O Error - Return code = 32 Model crashed: WRITDUMP: BAD BUFFOUT OF DATA tmp/pipe_dummy 2048 03:45:34 (3256): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:42:41 (340): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:43:57 (4332): No heartbeat from core client for 30 sec - exiting 08:43:58 (4332): No heartbeat from core client for 30 sec - exiting 08:43:59 (4332): No heartbeat from core client for 30 sec - exiting 08:44:00 (4332): No heartbeat from core client for 30 sec - exiting 08:44:01 (4332): No heartbeat from core client for 30 sec - exiting 08:44:09 (4332): No heartbeat from core client for 30 sec - exiting 08:44:11 (4332): No heartbeat from core client for 30 sec - exiting 08:44:12 (4332): No heartbeat from core client for 30 sec - exiting 08:44:13 (4332): No heartbeat from core client for 30 sec - exiting 08:44:14 (4332): No heartbeat from core client for 30 sec - exiting 08:44:15 (4332): No heartbeat from core client for 30 sec - exiting 08:44:16 (4332): No heartbeat from core client for 30 sec - exiting 08:44:17 (4332): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:45:25 (7380): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:46:14 (8984): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:52:13 (8736): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:53:30 (3052): No heartbeat from core client for 30 sec - exiting 08:53:31 (3052): No heartbeat from core client for 30 sec - exiting 08:53:32 (3052): No heartbeat from core client for 30 sec - exiting 08:53:33 (3052): No heartbeat from core client for 30 sec - exiting 08:53:34 (3052): No heartbeat from core client for 30 sec - exiting 08:53:35 (3052): No heartbeat from core client for 30 sec - exiting 08:53:36 (3052): No heartbeat from core client for 30 sec - exiting 08:53:37 (3052): No heartbeat from core client for 30 sec - exiting 08:53:38 (3052): No heartbeat from core client for 30 sec - exiting 08:53:39 (3052): No heartbeat from core client for 30 sec - exiting 08:53:40 (3052): No heartbeat from core client for 30 sec - exiting 08:53:41 (3052): No heartbeat from core client for 30 sec - exiting 08:53:42 (3052): No heartbeat from core client for 30 sec - exiting 08:53:43 (3052): No heartbeat from core client for 30 sec - exiting 08:53:44 (3052): No heartbeat from core client for 30 sec - exiting 08:53:45 (3052): No heartbeat from core client for 30 sec - exiting 08:53:46 (3052): No heartbeat from core client for 30 sec - exiting 08:53:47 (3052): No heartbeat from core client for 30 sec - exiting 08:53:48 (3052): No heartbeat from core client for 30 sec - exiting 08:53:49 (3052): No heartbeat from core client for 30 sec - exiting 08:53:50 (3052): No heartbeat from core client for 30 sec - exiting 08:53:51 (3052): No heartbeat from core client for 30 sec - exiting 08:53:52 (3052): No heartbeat from core client for 30 sec - exiting 08:53:53 (3052): No heartbeat from core client for 30 sec - exiting 08:53:54 (3052): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:53:55 (3052): No heartbeat from core client for 30 sec - exiting 08:56:42 (8920): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:57:15 (5700): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:57:53 (6692): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 09:04:04 (8768): No heartbeat from core client for 30 sec - exiting 09:04:05 (8768): No heartbeat from core client for 30 sec - exiting 09:04:06 (8768): No heartbeat from core client for 30 sec - exiting 09:04:07 (8768): No heartbeat from core client for 30 sec - exiting 09:04:13 (8768): No heartbeat from core client for 30 sec - exiting 09:04:14 (8768): No heartbeat from core client for 30 sec - exiting 09:04:15 (8768): No heartbeat from core client for 30 sec - exiting 09:04:16 (8768): No heartbeat from core client for 30 sec - exiting 09:04:17 (8768): No heartbeat from core client for 30 sec - exiting 09:04:19 (8768): No heartbeat from core client for 30 sec - exiting 09:04:22 (8768): No heartbeat from core client for 30 sec - exiting 09:04:23 (8768): No heartbeat from core client for 30 sec - exiting 09:04:24 (8768): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:04:25 (8768): No heartbeat from core client for 30 sec - exiting 09:04:26 (8768): No heartbeat from core client for 30 sec - exiting 09:04:27 (8768): No heartbeat from core client for 30 sec - exiting 09:04:28 (8768): No heartbeat from core client for 30 sec - exiting 09:04:29 (8768): No heartbeat from core client for 30 sec - exiting 09:07:14 (10040): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:08:13 (9364): No heartbeat from core client for 30 sec - exiting 09:08:14 (9364): No heartbeat from core client for 30 sec - exiting 09:08:15 (9364): No heartbeat from core client for 30 sec - exiting 09:08:16 (9364): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:11:11 (9992): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:11:59 (9664): No heartbeat from core client for 30 sec - exiting 09:12:00 (9664): No heartbeat from core client for 30 sec - exiting 09:12:01 (9664): No heartbeat from core client for 30 sec - exiting 09:12:02 (9664): No heartbeat from core client for 30 sec - exiting 09:12:03 (9664): No heartbeat from core client for 30 sec - exiting 09:12:04 (9664): No heartbeat from core client for 30 sec - exiting 09:12:05 (9664): No heartbeat from core client for 30 sec - exiting 09:12:06 (9664): No heartbeat from core client for 30 sec - exiting 09:12:07 (9664): No heartbeat from core client for 30 sec - exiting 09:12:08 (9664): No heartbeat from core client for 30 sec - exiting 09:12:09 (9664): No heartbeat from core client for 30 sec - exiting 09:12:10 (9664): No heartbeat from core client for 30 sec - exiting 09:12:11 (9664): No heartbeat from core client for 30 sec - exiting 09:12:12 (9664): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:13:22 (8368): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:15:51 (7844): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:16:25 (9872): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:18:20 (9280): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:20:26 (9316): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:24:46 (264): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:25:39 (9712): No heartbeat from core client for 30 sec - exiting 09:25:42 (9712): No heartbeat from core client for 30 sec - exiting 09:25:43 (9712): No heartbeat from core client for 30 sec - exiting 09:25:44 (9712): No heartbeat from core client for 30 sec - exiting 09:25:48 (9712): No heartbeat from core client for 30 sec - exiting 09:25:49 (9712):CPDN Monitor - No 'heartbeat' from BOINC... No heartbeat from core client for 30 sec - exiting 09:30:12 (12180): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:30:56 (11212): No heartbeat from core client for 30 sec - exiting 09:30:57 (11212): No heartbeat from core client for 30 sec - exiting 09:30:58 (11212): No heartbeat from core client for 30 sec - exiting 09:30:59 (11212): No heartbeat from core client for 30 sec - exiting 09:31:00 (11212): No heartbeat from core client for 30 sec - exiting 09:31:01 (11212): No heartbeat from core client for 30 sec - exiting 09:31:02 (11212): No heartbeat from core client for 30 sec - exiting 09:31:03 (11212): No heartbeat from core client for 30 sec - exiting 09:31:04 (11212): No heartbeat from core client for 30 sec - exiting 09:31:05 (11212): No heartbeat from core client for 30 sec - exiting 09:31:08 (11212): No heartbeat from core client for 30 sec - exiting 09:31:10 (11212): No heartbeat from core client for 30 sec - exiting 09:31:11 (11212): No heartbeat from core client for 30 sec - exiting 09:31:12 (11212): No heartbeat from core client for 30 sec - exiting 09:31:13 (11212): No heartbeat from core client for 30 sec - exiting 09:31:14 (11212): No heartbeat from core client for 30 sec - exiting 09:31:15 (11212): No heartbeat from core client for 30 sec - exiting 09:31:16 (11212): No heartbeat from core client for 30 sec - exiting 09:31:17 (11212): No heartbeat from core client for 30 sec - exiting 09:31:18 (11212): No heartbeat from core client for 30 sec - exiting 09:31:19 (11212): No heartbeat from core client for 30 sec - exiting 09:31:20 (11212): No heartbeat from core client for 30 sec - exiting 09:31:21 (11212): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:31:22 (11212): No heartbeat from core client for 30 sec - exiting 09:33:00 (11520): No heartbeat from core client for 30 sec - exiting 09:33:05 (11520): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:33:06 (11520): No heartbeat from core client for 30 sec - exiting 09:33:48 (12000): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:33:51 (12000): No heartbeat from core client for 30 sec - exiting 09:38:55 (8380): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:40:20 (10328): No heartbeat from core client for 30 sec - exiting 09:40:21 (10328): No heartbeat from core client for 30 sec - exiting 09:40:22 (10328): No heartbeat from core client for 30 sec - exiting 09:40:23 (10328): No heartbeat from core client for 30 sec - exiting 09:40:24 (10328): No heartbeat from core client for 30 sec - exiting 09:40:25 (10328): No heartbeat from core client for 30 sec - exiting 09:40:26 (10328): No heartbeat from core client for 30 sec - exiting 09:40:27 (10328): No heartbeat from core client for 30 sec - exiting 09:40:28 (10328): No heartbeat from core client for 30 sec - exiting 09:40:29 (10328): No heartbeat from core client for 30 sec - exiting 09:40:30 (10328): No heartbeat from core client for 30 sec - exiting 09:40:31 (10328): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:40:32 (10328): No heartbeat from core client for 30 sec - exiting 09:40:33 (10328): No heartbeat from core client for 30 sec - exiting 09:42:18 (10764): No heartbeat from core client for 30 sec - exiting 09:42:23 (10764): No heartbeat from core client for 30 sec - exiting 09:42:24 (10764): No heartbeat from core client for 30 sec - exiting 09:42:25 (10764): No heartbeat from core client for 30 sec - exiting 09:42:26 (10764): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:42:27 (10764): No heartbeat from core client for 30 sec - exiting 09:47:11 (10812): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:48:04 (10432): No heartbeat from core client for 30 sec - exiting 09:48:05 (10432): No heartbeat from core client for 30 sec - exiting 09:48:06 (10432):CPDN Monitor - No 'heartbeat' from BOINC... No heartbeat from core client for 30 sec - exiting 09:49:51 (8932): No heartbeat from core client for 30 sec - exiting 09:49:54 (8932): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:49:55 (8932): No heartbeat from core client for 30 sec - exiting 09:52:49 (10772): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:53:48 (11532): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 10:01:41 (11968): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 08:45:01 (4728): No heartbeat from core client for 30 sec - exiting 08:45:02 (4728): No heartbeat from core client for 30 sec - exiting 08:45:03 (4728): No heartbeat from core client for 30 sec - exiting 08:45:04 (4728): No heartbeat from core client for 30 sec - exiting 08:45:05 (4728): No heartbeat from core client for 30 sec - exiting 08:45:06 (4728): No heartbeat from core client for 30 sec - exiting 08:45:07 (4728): No heartbeat from core client for 30 sec - exiting 08:45:08 (4728): No heartbeat from core client for 30 sec - exiting 08:45:10 (4728): No heartbeat from core client for 30 sec - exiting 08:45:11 (4728): No heartbeat from core client for 30 sec - exiting 08:45:12 (4728): No heartbeat from core client for 30 sec - exiting 08:45:13 (4728): No heartbeat from core client for 30 sec - exiting 08:45:14 (4728): No heartbeat from core client for 30 sec - exiting 08:45:15 (4728): No heartbeat from core client for 30 sec - exiting 08:45:16 (4728): No heartbeat from core client for 30 sec - exiting 08:45:17 (4728): No heartbeat from core client for 30 sec - exiting 08:45:18 (4728): No heartbeat from core client for 30 sec - exiting 08:45:19 (4728): No heartbeat from core client for 30 sec - exiting 08:45:21 (4728): No heartbeat from core client for 30 sec - exiting 08:45:22 (4728): No heartbeat from core client for 30 sec - exiting 08:45:23 (4728): No heartbeat from core client for 30 sec - exiting 08:45:24 (4728): No heartbeat from core client for 30 sec - exiting 08:45:25 (4728): No heartbeat from core client for 30 sec - exiting 08:45:26 (4728): No heartbeat from core client for 30 sec - exiting 08:45:27 (4728): No heartbeat from core client for 30 sec - exiting 08:45:28 (4728): No heartbeat from core client for 30 sec - exiting 08:45:29 (4728): No heartbeat from core client for 30 sec - exiting 08:45:30 (4728): No heartbeat from core client for 30 sec - exiting 08:45:31 (4728): No heartbeat from core client for 30 sec - exiting 08:45:33 (4728): No heartbeat from core client for 30 sec - exiting 08:45:34 (4728): No heartbeat from core client for 30 sec - exiting 08:45:35 (4728): No heartbeat from core client for 30 sec - exiting 08:45:36 (4728): No heartbeat from core client for 30 sec - exiting 08:45:37 (4728): No heartbeat from core client for 30 sec - exiting 08:45:38 (4728): No heartbeat from core client for 30 sec - exiting 08:45:39 (4728): No heartbeat from core client for 30 sec - exiting 08:45:40 (4728): No heartbeat from core client for 30 sec - exiting 08:45:41 (4728): No heartbeat from core client for 30 sec - exiting 08:45:42 (4728): No heartbeat from core client for 30 sec - exiting 08:45:43 (4728): No heartbeat from core client for 30 sec - exiting 08:45:45 (4728): No heartbeat from core client for 30 sec - exiting 08:45:46 (4728): No heartbeat from core client for 30 sec - exiting 08:45:47 (4728): No heartbeat from core client for 30 sec - exiting 08:45:48 (4728): No heartbeat from core client for 30 sec - exiting 08:45:49 (4728): No heartbeat from core client for 30 sec - exiting 08:45:50 (4728): No heartbeat from core client for 30 sec - exiting 08:45:51 (4728): No heartbeat from core client for 30 sec - exiting 08:45:52 (4728): No heartbeat from core client for 30 sec - exiting 08:45:53 (4728): No heartbeat from core client for 30 sec - exiting 08:45:54 (4728): No heartbeat from core client for 30 sec - exiting 08:45:56 (4728): No heartbeat from core client for 30 sec - exiting 08:45:57 (4728): No heartbeat from core client for 30 sec - exiting 08:45:58 (4728): No heartbeat from core client for 30 sec - exiting 08:45:59 (4728): No heartbeat from core client for 30 sec - exiting 08:46:00 (4728): No heartbeat from core client for 30 sec - exiting 08:46:01 (4728): No heartbeat from core client for 30 sec - exiting 08:46:02 (4728): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:46:03 (4728): No heartbeat from core client for 30 sec - exiting 08:46:04 (4728): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... 09:10:10 (1880): No heartbeat from core client for 30 sec - exiting 09:10:11 (1880): No heartbeat from core client for 30 sec - exiting 09:10:12 (1880): No heartbeat from core client for 30 sec - exiting 09:10:13 (1880): No heartbeat from core client for 30 sec - exiting 09:10:14 (1880): No heartbeat from core client for 30 sec - exiting 09:10:15 (1880): No heartbeat from core client for 30 sec - exiting 09:10:16 (1880): No heartbeat from core client for 30 sec - exiting 09:10:17 (1880): No heartbeat from core client for 30 sec - exiting 09:10:18 (1880): No heartbeat from core client for 30 sec - exiting 09:10:19 (1880): No heartbeat from core client for 30 sec - exiting 09:10:20 (1880): No heartbeat from core client for 30 sec - exiting 09:10:21 (1880): No heartbeat from core client for 30 sec - exiting 09:10:22 (1880): No heartbeat from core client for 30 sec - exiting 09:10:23 (1880): No heartbeat from core client for 30 sec - exiting 09:10:24 (1880): No heartbeat from core client for 30 sec - exiting 09:10:25 (1880): No heartbeat from core client for 30 sec - exiting 09:10:26 (1880): No heartbeat from core client for 30 sec - exiting 09:10:27 (1880): No heartbeat from core client for 30 sec - exiting 09:10:28 (1880): No heartbeat from core client for 30 sec - exiting 09:10:29 (1880): No heartbeat from core client for 30 sec - exiting 09:10:30 (1880): No heartbeat from core client for 30 sec - exiting 09:10:31 (1880): No heartbeat from core client for 30 sec - exiting 09:10:32 (1880): No heartbeat from core client for 30 sec - exiting 09:10:33 (1880): No heartbeat from core client for 30 sec - exiting 09:10:34 (1880): No heartbeat from core client for 30 sec - exiting 09:10:35 (1880): No heartbeat from core client for 30 sec - exiting 09:10:36 (1880): No heartbeat from core client for 30 sec - exiting 09:10:37 (1880): No heartbeat from core client for 30 sec - exiting 09:10:38 (1880): No heartbeat from core client for 30 sec - exiting 09:10:39 (1880): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:10:40 (1880): No heartbeat from core client for 30 sec - exiting 09:10:41 (1880): No heartbeat from core client for 30 sec - exiting 14:21:46 (2404): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:22:24 (3108): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:53:42 (3548): No heartbeat from core client for 30 sec - exiting 14:53:44 (3548): No heartbeat from core client for 30 sec - exiting 14:53:45 (3548): No heartbeat from core client for 30 sec - exiting 14:53:46 (3548): No heartbeat from core client for 30 sec - exiting 14:53:47 (3548): No heartbeat from core client for 30 sec - exiting 14:53:48 (3548): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:39:15 (5188): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:40:07 (564): No heartbeat from core client for 30 sec - exiting 08:40:15 (564): No heartbeat from core client for 30 sec - exiting 08:40:21 (564): No heartbeat from core client for 30 sec - exiting 08:40:27 (564): No heartbeat from core client for 30 sec - exiting 08:40:28 (564): No heartbeat from core client for 30 sec - exiting 08:40:29 (564): No heartbeat from core client for 30 sec - exiting 08:40:34 (564): No heartbeat from core client for 30 sec - exiting 08:40:37 (564): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:40:38 (564): No heartbeat from core client for 30 sec - exiting 08:45:20 (2064): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:46:24 (4704): No heartbeat from core client for 30 sec - exiting 08:46:26 (4704): No heartbeat from core client for 30 sec - exiting 08:46:27 (4704): No heartbeat from core client for 30 sec - exiting 08:46:41 (4704): No heartbeat from core client for 30 sec - exiting 08:46:43 (4704): No heartbeat from core client for 30 sec - exiting 08:46:45 (4704): No heartbeat from core client for 30 sec - exiting 08:46:46 (4704): No heartbeat from core client for 30 sec - exiting 08:46:47 (4704): No heartbeat from core client for 30 sec - exiting 08:46:48 (4704): No heartbeat from core client for 30 sec - exiting 08:46:49 (4704): No heartbeat from core client for 30 sec - exiting 08:46:51 (4704): No heartbeat from core client for 30 sec - exiting 08:46:53 (4704): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:50:14 (2676): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:50:16 (2676): No heartbeat from core client for 30 sec - exiting 08:51:59 (7664): No heartbeat from core client for 30 sec - exiting 08:52:00 (7664): No heartbeat from core client for 30 sec - exiting 08:52:01 (7664): No heartbeat from core client for 30 sec - exiting 08:52:02 (7664): No heartbeat from core client for 30 sec - exiting 08:52:03 (7664): No heartbeat from core client for 30 sec - exiting 08:52:04 (7664): No heartbeat from core client for 30 sec - exiting 08:52:05 (7664): No heartbeat from core client for 30 sec - exiting 08:52:06 (7664): No heartbeat from core client for 30 sec - exiting 08:52:07 (7664): No heartbeat from core client for 30 sec - exiting 08:52:08 (7664): No heartbeat from core client for 30 sec - exiting 08:52:09 (7664): No heartbeat from core client for 30 sec - exiting 08:52:10 (7664): No heartbeat from core client for 30 sec - exiting 08:52:11 (7664): No heartbeat from core client for 30 sec - exiting 08:52:12 (7664): No heartbeat from core client for 30 sec - exiting 08:52:13 (7664): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:54:55 (7884): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:55:33 (7008): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 10:17:41 (5880): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:17:43 (5880): No heartbeat from core client for 30 sec - exiting 10:18:17 (7848): No heartbeat from core client for 30 sec - exiting 10:18:18 (7848): No heartbeat from core client for 30 sec - exiting 10:18:19 (7848): No heartbeat from core client for 30 sec - exiting 10:18:20 (7848): No heartbeat from core client for 30 sec - exiting 10:18:21 (7848): No heartbeat from core client for 30 sec - exiting 10:18:22 (7848): No heartbeat from core client for 30 sec - exiting 10:18:23 (7848): No heartbeat from core client for 30 sec - exiting 10:18:24 (7848): No heartbeat from core client for 30 sec - exiting 10:18:25 (7848): No heartbeat from core client for 30 sec - exiting 10:18:26 (7848): No heartbeat from core client for 30 sec - exiting 10:18:27 (7848): No heartbeat from core client for 30 sec - exiting 10:18:28 (7848): No heartbeat from core client for 30 sec - exiting 10:18:29 (7848): No heartbeat from core client for 30 sec - exiting 10:18:30 (7848): No heartbeat from core client for 30 sec - exiting 10:18:31 (7848): No heartbeat from core client for 30 sec - exiting 10:18:32 (7848): No heartbeat from core client for 30 sec - exiting 10:18:33 (7848): No heartbeat from core client for 30 sec - exiting 10:18:34 (7848): No heartbeat from core client for 30 sec - exiting 10:18:35 (7848): No heartbeat from core client for 30 sec - exiting 10:18:36 (7848): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:19:39 (6256): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:20:17 (3060): No heartbeat from core client for 30 sec - exiting 11:20:18 (3060): No heartbeat from core client for 30 sec - exiting 11:20:19 (3060): No heartbeat from core client for 30 sec - exiting 11:20:20 (3060): No heartbeat from core client for 30 sec - exiting 11:20:21 (3060): No heartbeat from core client for 30 sec - exiting 11:20:22 (3060): No heartbeat from core client for 30 sec - exiting 11:20:23 (3060): No heartbeat from core client for 30 sec - exiting 11:20:24 (3060): No heartbeat from core client for 30 sec - exiting 11:20:25 (3060): No heartbeat from core client for 30 sec - exiting 11:20:26 (3060): No heartbeat from core client for 30 sec - exiting 11:20:27 (3060): No heartbeat from core client for 30 sec - exiting 11:20:28 (3060): No heartbeat from core client for 30 sec - exiting 11:20:29 (3060): No heartbeat from core client for 30 sec - exiting 11:20:30 (3060): No heartbeat from core client for 30 sec - exiting 11:20:31 (3060): No heartbeat from core client for 30 sec - exiting 11:20:32 (3060): No heartbeat from core client for 30 sec - exiting 11:20:33 (3060): No heartbeat from core client for 30 sec - exiting 11:20:34 (3060): No heartbeat from core client for 30 sec - exiting 11:20:35 (3060): No heartbeat from core client for 30 sec - exiting 11:20:36 (3060): No heartbeat from core client for 30 sec - exiting 11:20:37 (3060): No heartbeat from core client for 30 sec - exiting 11:20:38 (3060): No heartbeat from core client for 30 sec - exiting 11:20:39 (3060): No heartbeat from core client for 30 sec - exiting 11:20:40 (3060): No heartbeat from core client for 30 sec - exiting 11:20:41 (3060): No heartbeat from core client for 30 sec - exiting 11:20:42 (3060): No heartbeat from core client for 30 sec - exiting 11:20:43 (3060): No heartbeat from core client for 30 sec - exiting 11:20:44 (3060): No heartbeat from core client for 30 sec - exiting 11:20:45 (3060): No heartbeat from core client for 30 sec - exiting 11:20:46 (3060): No heartbeat from core client for 30 sec - exiting 11:20:47 (3060): No heartbeat from core client for 30 sec - exiting 11:20:48 (3060): No heartbeat from core client for 30 sec - exiting 11:20:49 (3060): No heartbeat from core client for 30 sec - exiting 11:20:50 (3060): No heartbeat from core client for 30 sec - exiting 11:20:51 (3060): No heartbeat from core client for 30 sec - exiting 11:20:52 (3060): No heartbeat from core client for 30 sec - exiting 11:20:53 (3060): No heartbeat from core client for 30 sec - exiting 11:20:54 (3060): No heartbeat from core client for 30 sec - exiting 11:20:55 (3060): No heartbeat from core client for 30 sec - exiting 11:20:56 (3060): No heartbeat from core client for 30 sec - exiting 11:20:57 (3060): No heartbeat from core client for 30 sec - exiting 11:20:58 (3060): No heartbeat from core client for 30 sec - exiting 11:21:00 (3060): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:58:32 (7644): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:59:25 (8004): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:02:34 (9688): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:03:40 (8372): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Signal 11 received, exiting... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
08 Oct 2011 15:01:09	997949	13091605	hadcm3n_y8hw_1900_40_007343870_0	1,036,800	1,549,158	1.4942
07 Oct 2011 04:25:41	997949	13091605	hadcm3n_y8hw_1900_40_007343870_0	1,010,880	1,508,465	1.4922
06 Oct 2011 16:02:34	997949	13091605	hadcm3n_y8hw_1900_40_007343870_0	984,960	1,467,893	1.4903
06 Oct 2011 01:46:24	997949	13091605	hadcm3n_y8hw_1900_40_007343870_0	959,040	1,426,528	1.4875
05 Oct 2011 15:26:57	997949	13091605	hadcm3n_y8hw_1900_40_007343870_0	933,120	1,388,881	1.4884
04 Oct 2011 09:47:41	997949	13091605	hadcm3n_y8hw_1900_40_007343870_0	907,200	1,352,305	1.4906
03 Oct 2011 17:30:36	997949	13091605	hadcm3n_y8hw_1900_40_007343870_0	881,280	1,325,225	1.5038
03 Oct 2011 06:55:50	997949	13091605	hadcm3n_y8hw_1900_40_007343870_0	855,360	1,290,610	1.5089
02 Oct 2011 19:49:38	997949	13091605	hadcm3n_y8hw_1900_40_007343870_0	829,440	1,256,499	1.5149
02 Oct 2011 09:11:02	997949	13091605	hadcm3n_y8hw_1900_40_007343870_0	803,520	1,222,599	1.5216
01 Oct 2011 22:11:40	997949	13091605	hadcm3n_y8hw_1900_40_007343870_0	777,600	1,188,670	1.5286
01 Oct 2011 10:24:54	997949	13091605	hadcm3n_y8hw_1900_40_007343870_0	751,680	1,154,316	1.5356
30 Sep 2011 23:59:57	997949	13091605	hadcm3n_y8hw_1900_40_007343870_0	725,760	1,121,439	1.5452
30 Sep 2011 13:35:30	997949	13091605	hadcm3n_y8hw_1900_40_007343870_0	699,840	1,088,185	1.5549
29 Sep 2011 20:03:47	997949	13091605	hadcm3n_y8hw_1900_40_007343870_0	673,920	1,050,608	1.5590
29 Sep 2011 08:17:43	997949	13091605	hadcm3n_y8hw_1900_40_007343870_0	648,000	1,010,634	1.5596
28 Sep 2011 20:53:02	997949	13091605	hadcm3n_y8hw_1900_40_007343870_0	622,080	971,869	1.5623
28 Sep 2011 14:04:37	997949	13091605	hadcm3n_y8hw_1900_40_007343870_0	596,160	931,755	1.5629
27 Sep 2011 21:56:13	997949	13091605	hadcm3n_y8hw_1900_40_007343870_0	570,240	892,430	1.5650
27 Sep 2011 10:59:35	997949	13091605	hadcm3n_y8hw_1900_40_007343870_0	544,320	853,487	1.5680