Task 15766236

Name	hadcm3n_49xf_1940_40_008301186_1
Workunit	8452321
Created	8 May 2013, 22:36:12 UTC
Sent	8 May 2013, 22:36:25 UTC
Report deadline	8 Aug 2013, 6:03:36 UTC
Received	21 May 2013, 14:02:55 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	1228011
Run time	2 days 0 hours 5 min 6 sec
CPU time	1 days 16 hours 54 min 52 sec
Validate state	Invalid
Credit	933.12
Device peak FLOPS	2.48 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>6.10.58</core_client_version> <![CDATA[ <message> The device does not recognize the command. (0x16) - exit code 22 (0x16) </message> <stderr_txt> restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 23:52:01 (4992): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 23:59:48 (4936): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 00:01:55 (5260): No heartbeat from core client for 30 sec - exiting 00:01:56 (5260): No heartbeat from core client for 30 sec - exiting 00:01:57 (5260): No heartbeat from core client for 30 sec - exiting 00:01:58 (5260): No heartbeat from core client for 30 sec - exiting 00:01:59 (5260): No heartbeat from core client for 30 sec - exiting 00:02:00 (5260): No heartbeat from core client for 30 sec - exiting 00:02:01 (5260): No heartbeat from core client for 30 sec - exiting 00:02:02 (5260): No heartbeat from core client for 30 sec - exiting 00:02:03 (5260): No heartbeat from core client for 30 sec - exiting 00:02:04 (5260): No heartbeat from core client for 30 sec - exiting 00:02:06 (5260): No heartbeat from core client for 30 sec - exiting 00:02:07 (5260): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 02:00:45 (888): No heartbeat from core client for 30 sec - exiting 02:00:46 (888): No heartbeat from core client for 30 sec - exiting 02:00:47 (888): No heartbeat from core client for 30 sec - exiting 02:00:48 (888): No heartbeat from core client for 30 sec - exiting 02:00:49 (888): No heartbeat from core client for 30 sec - exiting 02:00:50 (888): No heartbeat from core client for 30 sec - exiting 02:00:51 (888): No heartbeat from core client for 30 sec - exiting 02:00:52 (888): No heartbeat from core client for 30 sec - exiting 02:00:53 (888): No heartbeat from core client for 30 sec - exiting 02:00:55 (888): No heartbeat from core client for 30 sec - exiting 02:00:56 (888): No heartbeat from core client for 30 sec - exiting 02:00:57 (888): No heartbeat from core client for 30 sec - exiting 02:00:58 (888): No heartbeat from core client for 30 sec - exiting 02:00:59 (888): No heartbeat from core client for 30 sec - exiting 02:01:00 (888): No heartbeat from core client for 30 sec - exiting 02:01:01 (888): No heartbeat from core client for 30 sec - exiting 02:01:02 (888): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 03:00:38 (3936): No heartbeat from core client for 30 sec - exiting 03:00:39 (3936): No heartbeat from core client for 30 sec - exiting 03:00:40 (3936): No heartbeat from core client for 30 sec - exiting 03:00:41 (3936): No heartbeat from core client for 30 sec - exiting 03:00:42 (3936): No heartbeat from core client for 30 sec - exiting 03:00:43 (3936): No heartbeat from core client for 30 sec - exiting 03:00:44 (3936): No heartbeat from core client for 30 sec - exiting 03:00:45 (3936): No heartbeat from core client for 30 sec - exiting 03:00:46 (3936): No heartbeat from core client for 30 sec - exiting 03:00:47 (3936): No heartbeat from core client for 30 sec - exiting 03:00:48 (3936): No heartbeat from core client for 30 sec - exiting 03:00:49 (3936): No heartbeat from core client for 30 sec - exiting 03:00:50 (3936): No heartbeat from core client for 30 sec - exiting 03:00:51 (3936): No heartbeat from core client for 30 sec - exiting 03:00:52 (3936): No heartbeat from core client for 30 sec - exiting 03:00:53 (3936): No heartbeat from core client for 30 sec - exiting 03:00:54 (3936): No heartbeat from core client for 30 sec - exiting 03:00:55 (3936): No heartbeat from core client for 30 sec - exiting 03:00:57 (3936): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 20:12:19 (2520): No heartbeat from core client for 30 sec - exiting 20:12:20 (2520): No heartbeat from core client for 30 sec - exiting 20:12:21 (2520): No heartbeat from core client for 30 sec - exiting 20:12:22 (2520): No heartbeat from core client for 30 sec - exiting 20:12:23 (2520): No heartbeat from core client for 30 sec - exiting 20:12:24 (2520): No heartbeat from core client for 30 sec - exiting 20:12:25 (2520): No heartbeat from core client for 30 sec - exiting 20:12:26 (2520): No heartbeat from core client for 30 sec - exiting 20:12:27 (2520): No heartbeat from core client for 30 sec - exiting 20:12:28 (2520): No heartbeat from core client for 30 sec - exiting 20:12:29 (2520): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 20:23:42 (3260): No heartbeat from core client for 30 sec - exiting 20:23:43 (3260): No heartbeat from core client for 30 sec - exiting 20:23:44 (3260): No heartbeat from core client for 30 sec - exiting 20:23:45 (3260): No heartbeat from core client for 30 sec - exiting 20:23:46 (3260): No heartbeat from core client for 30 sec - exiting 20:23:47 (3260): No heartbeat from core client for 30 sec - exiting 20:23:48 (3260): No heartbeat from core client for 30 sec - exiting 20:23:49 (3260): No heartbeat from core client for 30 sec - exiting 20:23:50 (3260): No heartbeat from core client for 30 sec - exiting 20:23:51 (3260): No heartbeat from core client for 30 sec - exiting 20:23:52 (3260): No heartbeat from core client for 30 sec - exiting 20:23:53 (3260): No heartbeat from core client for 30 sec - exiting 20:23:54 (3260): No heartbeat from core client for 30 sec - exiting 20:23:55 (3260): No heartbeat from core client for 30 sec - exiting 20:23:56 (3260): No heartbeat from core client for 30 sec - exiting 20:23:57 (3260): No heartbeat from core client for 30 sec - exiting 20:23:58 (3260): No heartbeat from core client for 30 sec - exiting 20:23:59 (3260): No heartbeat from core client for 30 sec - exiting 20:24:00 (3260): No heartbeat from core client for 30 sec - exiting 20:24:01 (3260): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 20:29:12 (3292): No heartbeat from core client for 30 sec - exiting 20:29:13 (3292): No heartbeat from core client for 30 sec - exiting 20:29:14 (3292): No heartbeat from core client for 30 sec - exiting 20:29:15 (3292): No heartbeat from core client for 30 sec - exiting 20:29:16 (3292): No heartbeat from core client for 30 sec - exiting 20:29:17 (3292): No heartbeat from core client for 30 sec - exiting 20:29:18 (3292): No heartbeat from core client for 30 sec - exiting 20:29:19 (3292): No heartbeat from core client for 30 sec - exiting 20:29:20 (3292): No heartbeat from core client for 30 sec - exiting 20:29:21 (3292): No heartbeat from core client for 30 sec - exiting 20:29:22 (3292): No heartbeat from core client for 30 sec - exiting 20:29:23 (3292): No heartbeat from core client for 30 sec - exiting 20:29:24 (3292): No heartbeat from core client for 30 sec - exiting 20:29:25 (3292): No heartbeat from core client for 30 sec - exiting 20:29:26 (3292): No heartbeat from core client for 30 sec - exiting 20:29:27 (3292): No heartbeat from core client for 30 sec - exiting 20:29:28 (3292): No heartbeat from core client for 30 sec - exiting 20:29:29 (3292): No heartbeat from core client for 30 sec - exiting 20:29:30 (3292): No heartbeat from core client for 30 sec - exiting 20:29:31 (3292): No heartbeat from core client for 30 sec - exiting 20:29:32 (3292): No heartbeat from core client for 30 sec - exiting 20:29:34 (3292): No heartbeat from core client for 30 sec - exiting 20:29:35 (3292): No heartbeat from core client for 30 sec - exiting 20:29:36 (3292): No heartbeat from core client for 30 sec - exiting 20:29:37 (3292): No heartbeat from core client for 30 sec - exiting 20:29:38 (3292): No heartbeat from core client for 30 sec - exiting 20:29:39 (3292): No heartbeat from core client for 30 sec - exiting 20:29:40 (3292): No heartbeat from core client for 30 sec - exiting 20:29:41 (3292): No heartbeat from core client for 30 sec - exiting 20:29:42 (3292): No heartbeat from core client for 30 sec - exiting 20:29:43 (3292): No heartbeat from core client for 30 sec - exiting 20:29:44 (3292): No heartbeat from core client for 30 sec - exiting 20:29:45 (3292): No heartbeat from core client for 30 sec - exiting 20:29:46 (3292): No heartbeat from core client for 30 sec - exiting 20:29:47 (3292): No heartbeat from core client for 30 sec - exiting 20:29:48 (3292): No heartbeat from core client for 30 sec - exiting 20:29:49 (3292): No heartbeat from core client for 30 sec - exiting 20:29:50 (3292): No heartbeat from core client for 30 sec - exiting 20:29:51 (3292): No heartbeat from core client for 30 sec - exiting 20:29:52 (3292): No heartbeat from core client for 30 sec - exiting 20:29:53 (3292): No heartbeat from core client for 30 sec - exiting 20:29:54 (3292): No heartbeat from core client for 30 sec - exiting 20:29:55 (3292): No heartbeat from core client for 30 sec - exiting 20:29:56 (3292): No heartbeat from core client for 30 sec - exiting 20:29:57 (3292): No heartbeat from core client for 30 sec - exiting 20:29:58 (3292): No heartbeat from core client for 30 sec - exiting 20:29:59 (3292): No heartbeat from core client for 30 sec - exiting 20:30:00 (3292): No heartbeat from core client for 30 sec - exiting 20:30:01 (3292): No heartbeat from core client for 30 sec - exiting 20:30:02 (3292): No heartbeat from core client for 30 sec - exiting 20:30:03 (3292): No heartbeat from core client for 30 sec - exiting 20:30:04 (3292): No heartbeat from core client for 30 sec - exiting 20:30:05 (3292): No heartbeat from core client for 30 sec - exiting 20:30:06 (3292): No heartbeat from core client for 30 sec - exiting 20:30:07 (3292): No heartbeat from core client for 30 sec - exiting 20:30:08 (3292): No heartbeat from core client for 30 sec - exiting 20:30:09 (3292): No heartbeat from core client for 30 sec - exiting 20:30:10 (3292): No heartbeat from core client for 30 sec - exiting 20:30:11 (3292): No heartbeat from core client for 30 sec - exiting 20:30:12 (3292): No heartbeat from core client for 30 sec - exiting 20:30:13 (3292): No heartbeat from core client for 30 sec - exiting 20:30:14 (3292): No heartbeat from core client for 30 sec - exiting 20:30:15 (3292): No heartbeat from core client for 30 sec - exiting 20:30:16 (3292): No heartbeat from core client for 30 sec - exiting 20:30:17 (3292): No heartbeat from core client for 30 sec - exiting 20:30:18 (3292): No heartbeat from core client for 30 sec - exiting 20:30:19 (3292): No heartbeat from core client for 30 sec - exiting 20:30:20 (3292): No heartbeat from core client for 30 sec - exiting 20:30:21 (3292): No heartbeat from core client for 30 sec - exiting 20:30:22 (3292): No heartbeat from core client for 30 sec - exiting 20:30:23 (3292): No heartbeat from core client for 30 sec - exiting 20:30:24 (3292): No heartbeat from core client for 30 sec - exiting 20:30:25 (3292): No heartbeat from core client for 30 sec - exiting 20:30:26 (3292): No heartbeat from core client for 30 sec - exiting 20:30:27 (3292): No heartbeat from core client for 30 sec - exiting 20:30:28 (3292): No heartbeat from core client for 30 sec - exiting 20:30:29 (3292): No heartbeat from core client for 30 sec - exiting 20:30:30 (3292): No heartbeat from core client for 30 sec - exiting 20:30:32 (3292): No heartbeat from core client for 30 sec - exiting 20:30:33 (3292): No heartbeat from core client for 30 sec - exiting 20:30:34 (3292): No heartbeat from core client for 30 sec - exiting 20:30:35 (3292): No heartbeat from core client for 30 sec - exiting 20:30:36 (3292): No heartbeat from core client for 30 sec - exiting 20:30:37 (3292): No heartbeat from core client for 30 sec - exiting 20:30:38 (3292): No heartbeat from core client for 30 sec - exiting 20:30:39 (3292): No heartbeat from core client for 30 sec - exiting 20:30:40 (3292): No heartbeat from core client for 30 sec - exiting 20:30:41 (3292): No heartbeat from core client for 30 sec - exiting 20:30:42 (3292): No heartbeat from core client for 30 sec - exiting 20:30:43 (3292): No heartbeat from core client for 30 sec - exiting 20:30:44 (3292): No heartbeat from core client for 30 sec - exiting 20:30:45 (3292): No heartbeat from core client for 30 sec - exiting 20:30:46 (3292): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:30:47 (3292): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... 20:44:07 (4088): No heartbeat from core client for 30 sec - exiting 20:44:08 (4088): No heartbeat from core client for 30 sec - exiting 20:44:09 (4088): No heartbeat from core client for 30 sec - exiting 20:44:10 (4088): No heartbeat from core client for 30 sec - exiting 20:44:11 (4088): No heartbeat from core client for 30 sec - exiting 20:44:12 (4088): No heartbeat from core client for 30 sec - exiting 20:44:14 (4088): No heartbeat from core client for 30 sec - exiting 20:44:15 (4088): No heartbeat from core client for 30 sec - exiting 20:44:16 (4088): No heartbeat from core client for 30 sec - exiting 20:44:17 (4088): No heartbeat from core client for 30 sec - exiting 20:44:18 (4088): No heartbeat from core client for 30 sec - exiting 20:44:19 (4088): No heartbeat from core client for 30 sec - exiting 20:44:20 (4088): No heartbeat from core client for 30 sec - exiting 20:44:21 (4088): No heartbeat from core client for 30 sec - exiting 20:44:22 (4088): No heartbeat from core client for 30 sec - exiting 20:44:23 (4088): No heartbeat from core client for 30 sec - exiting 20:44:24 (4088): No heartbeat from core client for 30 sec - exiting 20:44:25 (4088): No heartbeat from core client for 30 sec - exiting 20:44:26 (4088): No heartbeat from core client for 30 sec - exiting 20:44:27 (4088): No heartbeat from core client for 30 sec - exiting 20:44:28 (4088): No heartbeat from core client for 30 sec - exiting 20:44:29 (4088): No heartbeat from core client for 30 sec - exiting 20:44:30 (4088): No heartbeat from core client for 30 sec - exiting 20:44:31 (4088): No heartbeat from core client for 30 sec - exiting 20:44:32 (4088): No heartbeat from core client for 30 sec - exiting 20:44:33 (4088): No heartbeat from core client for 30 sec - exiting 20:44:34 (4088): No heartbeat from core client for 30 sec - exiting 20:44:35 (4088): No heartbeat from core client for 30 sec - exiting 20:44:36 (4088): No heartbeat from core client for 30 sec - exiting 20:44:37 (4088): No heartbeat from core client for 30 sec - exiting 20:44:38 (4088): No heartbeat from core client for 30 sec - exiting 20:44:39 (4088): No heartbeat from core client for 30 sec - exiting 20:44:40 (4088): No heartbeat from core client for 30 sec - exiting 20:44:41 (4088): No heartbeat from core client for 30 sec - exiting 20:44:42 (4088): No heartbeat from core client for 30 sec - exiting 20:44:43 (4088): No heartbeat from core client for 30 sec - exiting 20:44:44 (4088): No heartbeat from core client for 30 sec - exiting 20:44:45 (4088): No heartbeat from core client for 30 sec - exiting 20:44:46 (4088): No heartbeat from core client for 30 sec - exiting 20:44:47 (4088): No heartbeat from core client for 30 sec - exiting 20:44:48 (4088): No heartbeat from core client for 30 sec - exiting 20:44:49 (4088): No heartbeat from core client for 30 sec - exiting 20:44:50 (4088): No heartbeat from core client for 30 sec - exiting 20:44:51 (4088): No heartbeat from core client for 30 sec - exiting 20:44:52 (4088): No heartbeat from core client for 30 sec - exiting 20:44:53 (4088): No heartbeat from core client for 30 sec - exiting 20:44:54 (4088): No heartbeat from core client for 30 sec - exiting 20:44:55 (4088): No heartbeat from core client for 30 sec - exiting 20:44:56 (4088): No heartbeat from core client for 30 sec - exiting 20:44:57 (4088): No heartbeat from core client for 30 sec - exiting 20:44:58 (4088): No heartbeat from core client for 30 sec - exiting 20:44:59 (4088): No heartbeat from core client for 30 sec - exiting 20:45:00 (4088): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 21:14:07 (1564): No heartbeat from core client for 30 sec - exiting 21:14:08 (1564): No heartbeat from core client for 30 sec - exiting 21:14:09 (1564): No heartbeat from core client for 30 sec - exiting 21:14:10 (1564): No heartbeat from core client for 30 sec - exiting 21:14:11 (1564): No heartbeat from core client for 30 sec - exiting 21:14:12 (1564): No heartbeat from core client for 30 sec - exiting 21:14:13 (1564): No heartbeat from core client for 30 sec - exiting 21:14:14 (1564): No heartbeat from core client for 30 sec - exiting 21:14:15 (1564): No heartbeat from core client for 30 sec - exiting 21:14:16 (1564): No heartbeat from core client for 30 sec - exiting 21:14:18 (1564): No heartbeat from core client for 30 sec - exiting 21:14:19 (1564): No heartbeat from core client for 30 sec - exiting 21:14:20 (1564): No heartbeat from core client for 30 sec - exiting 21:14:21 (1564): No heartbeat from core client for 30 sec - exiting 21:14:22 (1564): No heartbeat from core client for 30 sec - exiting 21:14:23 (1564): No heartbeat from core client for 30 sec - exiting 21:14:24 (1564): No heartbeat from core client for 30 sec - exiting 21:14:25 (1564): No heartbeat from core client for 30 sec - exiting 21:14:26 (1564): No heartbeat from core client for 30 sec - exiting 21:14:27 (1564): No heartbeat from core client for 30 sec - exiting 21:14:28 (1564): No heartbeat from core client for 30 sec - exiting 21:14:29 (1564): No heartbeat from core client for 30 sec - exiting 21:14:30 (1564): No heartbeat from core client for 30 sec - exiting 21:14:31 (1564): No heartbeat from core client for 30 sec - exiting 21:14:32 (1564): No heartbeat from core client for 30 sec - exiting 21:14:33 (1564): No heartbeat from core client for 30 sec - exiting 21:14:34 (1564): No heartbeat from core client for 30 sec - exiting 21:14:35 (1564): No heartbeat from core client for 30 sec - exiting 21:14:36 (1564): No heartbeat from core client for 30 sec - exiting 21:14:37 (1564): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:14:38 (1564): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... 21:15:54 (3920): No heartbeat from core client for 30 sec - exiting 21:15:55 (3920): No heartbeat from core client for 30 sec - exiting 21:15:56 (3920): No heartbeat from core client for 30 sec - exiting 21:15:57 (3920): No heartbeat from core client for 30 sec - exiting 21:15:58 (3920): No heartbeat from core client for 30 sec - exiting 21:15:59 (3920): No heartbeat from core client for 30 sec - exiting 21:16:00 (3920): No heartbeat from core client for 30 sec - exiting 21:16:01 (3920): No heartbeat from core client for 30 sec - exiting 21:16:02 (3920): No heartbeat from core client for 30 sec - exiting 21:16:03 (3920): No heartbeat from core client for 30 sec - exiting 21:16:04 (3920): No heartbeat from core client for 30 sec - exiting 21:16:05 (3920): No heartbeat from core client for 30 sec - exiting 21:16:06 (3920): No heartbeat from core client for 30 sec - exiting 21:16:07 (3920): No heartbeat from core client for 30 sec - exiting 21:16:08 (3920): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 11:17:44 (4988): No heartbeat from core client for 30 sec - exiting 11:17:45 (4988): No heartbeat from core client for 30 sec - exiting 11:17:46 (4988): No heartbeat from core client for 30 sec - exiting 11:17:47 (4988): No heartbeat from core client for 30 sec - exiting 11:17:48 (4988): No heartbeat from core client for 30 sec - exiting 11:17:49 (4988): No heartbeat from core client for 30 sec - exiting 11:17:51 (4988): No heartbeat from core client for 30 sec - exiting 11:17:52 (4988): No heartbeat from core client for 30 sec - exiting 11:17:53 (4988): No heartbeat from core client for 30 sec - exiting 11:17:54 (4988): No heartbeat from core client for 30 sec - exiting 11:17:55 (4988): No heartbeat from core client for 30 sec - exiting 11:17:56 (4988): No heartbeat from core client for 30 sec - exiting 11:17:57 (4988): No heartbeat from core client for 30 sec - exiting 11:17:58 (4988): No heartbeat from core client for 30 sec - exiting 11:17:59 (4988): No heartbeat from core client for 30 sec - exiting 11:18:00 (4988): No heartbeat from core client for 30 sec - exiting 11:18:02 (4988): No heartbeat from core client for 30 sec - exiting 11:18:03 (4988): No heartbeat from core client for 30 sec - exiting 11:18:04 (4988): No heartbeat from core client for 30 sec - exiting 11:18:05 (4988): No heartbeat from core client for 30 sec - exiting 11:18:06 (4988): No heartbeat from core client for 30 sec - exiting 11:18:07 (4988): No heartbeat from core client for 30 sec - exiting 11:18:08 (4988): No heartbeat from core client for 30 sec - exiting 11:18:09 (4988): No heartbeat from core client for 30 sec - exiting 11:18:10 (4988): No heartbeat from core client for 30 sec - exiting 11:18:11 (4988): No heartbeat from core client for 30 sec - exiting 11:18:13 (4988): No heartbeat from core client for 30 sec - exiting 11:18:14 (4988): No heartbeat from core client for 30 sec - exiting 11:18:15 (4988): No heartbeat from core client for 30 sec - exiting 11:18:16 (4988): No heartbeat from core client for 30 sec - exiting 11:18:17 (4988): No heartbeat from core client for 30 sec - exiting 11:18:18 (4988): No heartbeat from core client for 30 sec - exiting 11:18:19 (4988): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 11:21:19 (4412): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 11:27:48 (5840): No heartbeat from core client for 30 sec - exiting 11:27:49 (5840): No heartbeat from core client for 30 sec - exiting 11:27:51 (5840): No heartbeat from core client for 30 sec - exiting 11:27:52 (5840): No heartbeat from core client for 30 sec - exiting 11:27:53 (5840): No heartbeat from core client for 30 sec - exiting 11:27:54 (5840): No heartbeat from core client for 30 sec - exiting 11:27:56 (5840): No heartbeat from core client for 30 sec - exiting 11:27:57 (5840): No heartbeat from core client for 30 sec - exiting 11:27:58 (5840): No heartbeat from core client for 30 sec - exiting 11:27:59 (5840): No heartbeat from core client for 30 sec - exiting 11:28:00 (5840): No heartbeat from core client for 30 sec - exiting 11:28:01 (5840): No heartbeat from core client for 30 sec - exiting 11:28:02 (5840): No heartbeat from core client for 30 sec - exiting 11:28:05 (5840): No heartbeat from core client for 30 sec - exiting 11:28:06 (5840): No heartbeat from core client for 30 sec - exiting 11:28:07 (5840): No heartbeat from core client for 30 sec - exiting 11:28:08 (5840): No heartbeat from core client for 30 sec - exiting 11:28:10 (5840): No heartbeat from core client for 30 sec - exiting 11:28:11 (5840): No heartbeat from core client for 30 sec - exiting 11:28:12 (5840): No heartbeat from core client for 30 sec - exiting 11:28:13 (5840): No heartbeat from core client for 30 sec - exiting 11:28:14 (5840): No heartbeat from core client for 30 sec - exiting 11:28:15 (5840): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:28:16 (5840): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... 11:32:12 (5100): No heartbeat from core client for 30 sec - exiting 11:32:13 (5100): No heartbeat from core client for 30 sec - exiting 11:32:14 (5100): No heartbeat from core client for 30 sec - exiting 11:32:15 (5100): No heartbeat from core client for 30 sec - exiting 11:32:16 (5100): No heartbeat from core client for 30 sec - exiting 11:32:17 (5100): No heartbeat from core client for 30 sec - exiting 11:32:18 (5100): No heartbeat from core client for 30 sec - exiting 11:32:19 (5100): No heartbeat from core client for 30 sec - exiting 11:32:20 (5100): No heartbeat from core client for 30 sec - exiting 11:32:21 (5100): No heartbeat from core client for 30 sec - exiting 11:32:22 (5100): No heartbeat from core client for 30 sec - exiting 11:32:23 (5100): No heartbeat from core client for 30 sec - exiting 11:32:24 (5100): No heartbeat from core client for 30 sec - exiting 11:32:25 (5100): No heartbeat from core client for 30 sec - exiting 11:32:26 (5100): No heartbeat from core client for 30 sec - exiting 11:32:27 (5100): No heartbeat from core client for 30 sec - exiting 11:32:28 (5100): No heartbeat from core client for 30 sec - exiting 11:32:29 (5100): No heartbeat from core client for 30 sec - exiting 11:32:30 (5100): No heartbeat from core client for 30 sec - exiting 11:32:31 (5100): No heartbeat from core client for 30 sec - exiting 11:32:32 (5100): No heartbeat from core client for 30 sec - exiting 11:32:33 (5100): No heartbeat from core client for 30 sec - exiting 11:32:34 (5100): No heartbeat from core client for 30 sec - exiting 11:32:35 (5100): No heartbeat from core client for 30 sec - exiting 11:32:36 (5100): No heartbeat from core client for 30 sec - exiting 11:32:37 (5100): No heartbeat from core client for 30 sec - exiting 11:32:38 (5100): No heartbeat from core client for 30 sec - exiting 11:32:39 (5100): No heartbeat from core client for 30 sec - exiting 11:32:40 (5100): No heartbeat from core client for 30 sec - exiting 11:32:41 (5100): No heartbeat from core client for 30 sec - exiting 11:32:42 (5100): No heartbeat from core client for 30 sec - exiting 11:32:43 (5100): No heartbeat from core client for 30 sec - exiting 11:32:44 (5100): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 11:38:34 (2508): No heartbeat from core client for 30 sec - exiting 11:38:35 (2508): No heartbeat from core client for 30 sec - exiting 11:38:36 (2508): No heartbeat from core client for 30 sec - exiting 11:38:37 (2508): No heartbeat from core client for 30 sec - exiting 11:38:38 (2508): No heartbeat from core client for 30 sec - exiting 11:38:39 (2508): No heartbeat from core client for 30 sec - exiting 11:38:40 (2508): No heartbeat from core client for 30 sec - exiting 11:38:41 (2508): No heartbeat from core client for 30 sec - exiting 11:38:42 (2508): No heartbeat from core client for 30 sec - exiting 11:38:43 (2508): No heartbeat from core client for 30 sec - exiting 11:38:44 (2508): No heartbeat from core client for 30 sec - exiting 11:38:45 (2508): No heartbeat from core client for 30 sec - exiting 11:38:46 (2508): No heartbeat from core client for 30 sec - exiting 11:38:47 (2508): No heartbeat from core client for 30 sec - exiting 11:38:48 (2508): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 11:53:37 (2984): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 12:04:18 (3096): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 16:11:09 (5520): No heartbeat from core client for 30 sec - exiting 16:11:10 (5520): No heartbeat from core client for 30 sec - exiting 16:11:11 (5520): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 17:10:37 (2504): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 19:04:23 (7632): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 Sorry, too many model crashes! :-( Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
21 May 2013 01:20:14	1228011	15766236	hadcm3n_49xf_1940_40_008301186_1	77,760	133,287	1.7141
18 May 2013 06:37:50	1228011	15766236	hadcm3n_49xf_1940_40_008301186_1	51,840	90,069	1.7374
13 May 2013 17:08:44	1228011	15766236	hadcm3n_49xf_1940_40_008301186_1	25,920	46,327	1.7873