Task 15484368

Name	hadcm3n_zc0e_1880_40_008250239_3
Workunit	8405363
Created	19 Dec 2012, 20:26:31 UTC
Sent	19 Dec 2012, 20:26:42 UTC
Report deadline	21 Mar 2013, 3:53:53 UTC
Received	29 Dec 2012, 18:52:54 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	-226 (0xFFFFFF1E) ERR_TOO_MANY_EXITS
Computer ID	1244728
Run time	1 days 22 hours 38 min 19 sec
CPU time	1 days 20 hours 4 min 37 sec
Validate state	Invalid
Credit	933.12
Device peak FLOPS	2.03 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>6.8.42</core_client_version> <![CDATA[ <message> too many exit(0)s </message> <stderr_txt> t... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 20:08:44 (7328): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:08:46 (7328): No heartbeat from core client for 30 sec - exiting 20:08:47 (7328): No heartbeat from core client for 30 sec - exiting 20:08:48 (7328): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 20:10:56 (7848): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 20:12:48 (1224): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 20:17:49 (8060): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 20:21:38 (1280): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 20:25:08 (7632): Can't acquire lockfile (32) - waiting 35s 20:25:43 (7632): Can't acquire lockfile (32) - exiting 20:25:43 (7632): Error: The process cannot access the file because it is being used by another process. (0x20) 20:25:45 (6820): Can't acquire lockfile (32) - waiting 35s 20:26:20 (6820): Can't acquire lockfile (32) - exiting 20:26:20 (6820): Error: The process cannot access the file because it is being used by another process. (0x20) 20:26:42 (5956): Can't acquire lockfile (32) - waiting 35s 20:27:17 (5956): Can't acquire lockfile (32) - exiting 20:27:17 (5956): Error: The process cannot access the file because it is being used by another process. (0x20) 20:27:32 (8072): Can't acquire lockfile (32) - waiting 35s 20:28:07 (8072): Can't acquire lockfile (32) - exiting 20:28:07 (8072): Error: The process cannot access the file because it is being used by another process. (0x20) 20:28:08 (6844): Can't acquire lockfile (32) - waiting 35s 20:28:43 (6844): Can't acquire lockfile (32) - exiting 20:28:43 (6844): Error: The process cannot access the file because it is being used by another process. (0x20) 20:28:43 (6284): Can't acquire lockfile (32) - waiting 35s 20:29:18 (6284): Can't acquire lockfile (32) - exiting 20:29:18 (6284): Error: The process cannot access the file because it is being used by another process. (0x20) 20:29:19 (6280): Can't acquire lockfile (32) - waiting 35s 20:29:54 (6280): Can't acquire lockfile (32) - exiting 20:29:54 (6280): Error: The process cannot access the file because it is being used by another process. (0x20) 20:29:55 (4524): Can't acquire lockfile (32) - waiting 35s 20:30:30 (4524): Can't acquire lockfile (32) - exiting 20:30:30 (4524): Error: The process cannot access the file because it is being used by another process. (0x20) 20:30:31 (7052): Can't acquire lockfile (32) - waiting 35s 20:31:06 (7052): Can't acquire lockfile (32) - exiting 20:31:06 (7052): Error: The process cannot access the file because it is being used by another process. (0x20) 20:31:06 (5236): Can't acquire lockfile (32) - waiting 35s 20:31:41 (5236): Can't acquire lockfile (32) - exiting 20:31:41 (5236): Error: The process cannot access the file because it is being used by another process. (0x20) 20:31:42 (3096): Can't acquire lockfile (32) - waiting 35s 20:32:17 (3096): Can't acquire lockfile (32) - exiting 20:32:17 (3096): Error: The process cannot access the file because it is being used by another process. (0x20) 20:32:18 (4952): Can't acquire lockfile (32) - waiting 35s 20:32:53 (4952): Can't acquire lockfile (32) - exiting 20:32:53 (4952): Error: The process cannot access the file because it is being used by another process. (0x20) 20:32:54 (6816): Can't acquire lockfile (32) - waiting 35s 20:33:29 (6816): Can't acquire lockfile (32) - exiting 20:33:29 (6816): Error: The process cannot access the file because it is being used by another process. (0x20) 20:33:30 (6732): Can't acquire lockfile (32) - waiting 35s 20:34:05 (6732): Can't acquire lockfile (32) - exiting 20:34:05 (6732): Error: The process cannot access the file because it is being used by another process. (0x20) 20:34:06 (3520): Can't acquire lockfile (32) - waiting 35s 20:34:41 (3520): Can't acquire lockfile (32) - exiting 20:34:41 (3520): Error: The process cannot access the file because it is being used by another process. (0x20) 20:34:42 (5708): Can't acquire lockfile (32) - waiting 35s 20:35:17 (5708): Can't acquire lockfile (32) - exiting 20:35:17 (5708): Error: The process cannot access the file because it is being used by another process. (0x20) 20:35:18 (6160): Can't acquire lockfile (32) - waiting 35s 20:35:53 (6160): Can't acquire lockfile (32) - exiting 20:35:53 (6160): Error: The process cannot access the file because it is being used by another process. (0x20) 20:35:54 (5548): Can't acquire lockfile (32) - waiting 35s 20:36:29 (5548): Can't acquire lockfile (32) - exiting 20:36:29 (5548): Error: The process cannot access the file because it is being used by another process. (0x20) 20:36:30 (6152): Can't acquire lockfile (32) - waiting 35s 20:37:05 (6152): Can't acquire lockfile (32) - exiting 20:37:05 (6152): Error: The process cannot access the file because it is being used by another process. (0x20) 20:37:06 (7124): Can't acquire lockfile (32) - waiting 35s 20:37:41 (7124): Can't acquire lockfile (32) - exiting 20:37:41 (7124): Error: The process cannot access the file because it is being used by another process. (0x20) 20:37:42 (4992): Can't acquire lockfile (32) - waiting 35s 20:38:17 (4992): Can't acquire lockfile (32) - exiting 20:38:17 (4992): Error: The process cannot access the file because it is being used by another process. (0x20) 20:38:18 (7236): Can't acquire lockfile (32) - waiting 35s 20:38:53 (7236): Can't acquire lockfile (32) - exiting 20:38:53 (7236): Error: The process cannot access the file because it is being used by another process. (0x20) 20:38:54 (6256): Can't acquire lockfile (32) - waiting 35s 20:39:29 (6256): Can't acquire lockfile (32) - exiting 20:39:29 (6256): Error: The process cannot access the file because it is being used by another process. (0x20) 20:39:30 (7536): Can't acquire lockfile (32) - waiting 35s 20:40:05 (7536): Can't acquire lockfile (32) - exiting 20:40:05 (7536): Error: The process cannot access the file because it is being used by another process. (0x20) 20:40:06 (4944): Can't acquire lockfile (32) - waiting 35s 20:40:41 (4944): Can't acquire lockfile (32) - exiting 20:40:41 (4944): Error: The process cannot access the file because it is being used by another process. (0x20) 20:40:42 (7812): Can't acquire lockfile (32) - waiting 35s 20:41:17 (7812): Can't acquire lockfile (32) - exiting 20:41:17 (7812): Error: The process cannot access the file because it is being used by another process. (0x20) 20:41:18 (5756): Can't acquire lockfile (32) - waiting 35s 20:41:53 (5756): Can't acquire lockfile (32) - exiting 20:41:53 (5756): Error: The process cannot access the file because it is being used by another process. (0x20) 20:41:53 (5108): Can't acquire lockfile (32) - waiting 35s 20:42:28 (5108): Can't acquire lockfile (32) - exiting 20:42:28 (5108): Error: The process cannot access the file because it is being used by another process. (0x20) 20:42:29 (8040): Can't acquire lockfile (32) - waiting 35s 20:43:04 (8040): Can't acquire lockfile (32) - exiting 20:43:04 (8040): Error: The process cannot access the file because it is being used by another process. (0x20) 20:43:05 (7336): Can't acquire lockfile (32) - waiting 35s 20:43:40 (7336): Can't acquire lockfile (32) - exiting 20:43:40 (7336): Error: The process cannot access the file because it is being used by another process. (0x20) 20:43:41 (6852): Can't acquire lockfile (32) - waiting 35s 20:44:16 (6852): Can't acquire lockfile (32) - exiting 20:44:16 (6852): Error: The process cannot access the file because it is being used by another process. (0x20) 20:44:17 (5816): Can't acquire lockfile (32) - waiting 35s 20:44:52 (5816): Can't acquire lockfile (32) - exiting 20:44:52 (5816): Error: The process cannot access the file because it is being used by another process. (0x20) 20:44:53 (4656): Can't acquire lockfile (32) - waiting 35s 20:45:28 (4656): Can't acquire lockfile (32) - exiting 20:45:28 (4656): Error: The process cannot access the file because it is being used by another process. (0x20) 20:45:30 (5956): Can't acquire lockfile (32) - waiting 35s 20:46:05 (5956): Can't acquire lockfile (32) - exiting 20:46:05 (5956): Error: The process cannot access the file because it is being used by another process. (0x20) 20:46:05 (6256): Can't acquire lockfile (32) - waiting 35s 20:46:40 (6256): Can't acquire lockfile (32) - exiting 20:46:40 (6256): Error: The process cannot access the file because it is being used by another process. (0x20) 20:46:41 (7540): Can't acquire lockfile (32) - waiting 35s 20:47:16 (7540): Can't acquire lockfile (32) - exiting 20:47:16 (7540): Error: The process cannot access the file because it is being used by another process. (0x20) 20:47:17 (1224): Can't acquire lockfile (32) - waiting 35s 20:47:52 (1224): Can't acquire lockfile (32) - exiting 20:47:52 (1224): Error: The process cannot access the file because it is being used by another process. (0x20) 20:47:53 (8012): Can't acquire lockfile (32) - waiting 35s 20:48:28 (8012): Can't acquire lockfile (32) - exiting 20:48:28 (8012): Error: The process cannot access the file because it is being used by another process. (0x20) 20:48:29 (6092): Can't acquire lockfile (32) - waiting 35s 20:49:04 (6092): Can't acquire lockfile (32) - exiting 20:49:04 (6092): Error: The process cannot access the file because it is being used by another process. (0x20) 20:49:05 (7468): Can't acquire lockfile (32) - waiting 35s 20:49:40 (7468): Can't acquire lockfile (32) - exiting 20:49:40 (7468): Error: The process cannot access the file because it is being used by another process. (0x20) 20:49:40 (1284): Can't acquire lockfile (32) - waiting 35s 20:50:15 (1284): Can't acquire lockfile (32) - exiting 20:50:15 (1284): Error: The process cannot access the file because it is being used by another process. (0x20) 20:50:16 (7900): Can't acquire lockfile (32) - waiting 35s 20:50:51 (7900): Can't acquire lockfile (32) - exiting 20:50:51 (7900): Error: The process cannot access the file because it is being used by another process. (0x20) 20:50:51 (2440): Can't acquire lockfile (32) - waiting 35s 20:51:26 (2440): Can't acquire lockfile (32) - exiting 20:51:26 (2440): Error: The process cannot access the file because it is being used by another process. (0x20) 20:51:27 (7556): Can't acquire lockfile (32) - waiting 35s 20:52:02 (7556): Can't acquire lockfile (32) - exiting 20:52:02 (7556): Error: The process cannot access the file because it is being used by another process. (0x20) 20:52:03 (5816): Can't acquire lockfile (32) - waiting 35s 20:52:38 (5816): Can't acquire lockfile (32) - exiting 20:52:38 (5816): Error: The process cannot access the file because it is being used by another process. (0x20) 20:52:39 (4944): Can't acquire lockfile (32) - waiting 35s 20:53:14 (4944): Can't acquire lockfile (32) - exiting 20:53:14 (4944): Error: The process cannot access the file because it is being used by another process. (0x20) 20:53:15 (6816): Can't acquire lockfile (32) - waiting 35s 20:53:50 (6816): Can't acquire lockfile (32) - exiting 20:53:50 (6816): Error: The process cannot access the file because it is being used by another process. (0x20) 20:53:50 (3344): Can't acquire lockfile (32) - waiting 35s 20:54:25 (3344): Can't acquire lockfile (32) - exiting 20:54:25 (3344): Error: The process cannot access the file because it is being used by another process. (0x20) 20:54:25 (1964): Can't acquire lockfile (32) - waiting 35s 20:55:00 (1964): Can't acquire lockfile (32) - exiting 20:55:00 (1964): Error: The process cannot access the file because it is being used by another process. (0x20) 20:55:01 (5972): Can't acquire lockfile (32) - waiting 35s 20:55:36 (5972): Can't acquire lockfile (32) - exiting 20:55:36 (5972): Error: The process cannot access the file because it is being used by another process. (0x20) 20:55:37 (6340): Can't acquire lockfile (32) - waiting 35s 20:56:12 (6340): Can't acquire lockfile (32) - exiting 20:56:12 (6340): Error: The process cannot access the file because it is being used by another process. (0x20) 20:56:13 (5488): Can't acquire lockfile (32) - waiting 35s 20:56:48 (5488): Can't acquire lockfile (32) - exiting 20:56:48 (5488): Error: The process cannot access the file because it is being used by another process. (0x20) 20:56:49 (7752): Can't acquire lockfile (32) - waiting 35s 20:57:24 (7752): Can't acquire lockfile (32) - exiting 20:57:24 (7752): Error: The process cannot access the file because it is being used by another process. (0x20) 20:57:25 (3236): Can't acquire lockfile (32) - waiting 35s 20:58:00 (3236): Can't acquire lockfile (32) - exiting 20:58:00 (3236): Error: The process cannot access the file because it is being used by another process. (0x20) 20:58:01 (7036): Can't acquire lockfile (32) - waiting 35s 20:58:36 (7036): Can't acquire lockfile (32) - exiting 20:58:36 (7036): Error: The process cannot access the file because it is being used by another process. (0x20) 20:58:37 (4896): Can't acquire lockfile (32) - waiting 35s 20:59:12 (4896): Can't acquire lockfile (32) - exiting 20:59:12 (4896): Error: The process cannot access the file because it is being used by another process. (0x20) 20:59:13 (5632): Can't acquire lockfile (32) - waiting 35s 20:59:48 (5632): Can't acquire lockfile (32) - exiting 20:59:48 (5632): Error: The process cannot access the file because it is being used by another process. (0x20) 20:59:49 (5984): Can't acquire lockfile (32) - waiting 35s 21:00:24 (5984): Can't acquire lockfile (32) - exiting 21:00:24 (5984): Error: The process cannot access the file because it is being used by another process. (0x20) 21:00:25 (6920): Can't acquire lockfile (32) - waiting 35s 21:01:00 (6920): Can't acquire lockfile (32) - exiting 21:01:00 (6920): Error: The process cannot access the file because it is being used by another process. (0x20) 21:01:01 (4824): Can't acquire lockfile (32) - waiting 35s 21:01:36 (4824): Can't acquire lockfile (32) - exiting 21:01:36 (4824): Error: The process cannot access the file because it is being used by another process. (0x20) 21:01:37 (7500): Can't acquire lockfile (32) - waiting 35s 21:02:12 (7500): Can't acquire lockfile (32) - exiting 21:02:12 (7500): Error: The process cannot access the file because it is being used by another process. (0x20) 21:02:13 (8100): Can't acquire lockfile (32) - waiting 35s 21:02:48 (8100): Can't acquire lockfile (32) - exiting 21:02:48 (8100): Error: The process cannot access the file because it is being used by another process. (0x20) 21:02:49 (6920): Can't acquire lockfile (32) - waiting 35s 21:03:24 (6920): Can't acquire lockfile (32) - exiting 21:03:24 (6920): Error: The process cannot access the file because it is being used by another process. (0x20) 21:03:25 (7536): Can't acquire lockfile (32) - waiting 35s 21:04:00 (7536): Can't acquire lockfile (32) - exiting 21:04:00 (7536): Error: The process cannot access the file because it is being used by another process. (0x20) 21:04:01 (4824): Can't acquire lockfile (32) - waiting 35s 21:04:36 (4824): Can't acquire lockfile (32) - exiting 21:04:36 (4824): Error: The process cannot access the file because it is being used by another process. (0x20) 21:04:36 (7936): Can't acquire lockfile (32) - waiting 35s 21:05:11 (7936): Can't acquire lockfile (32) - exiting 21:05:11 (7936): Error: The process cannot access the file because it is being used by another process. (0x20) 21:05:12 (7396): Can't acquire lockfile (32) - waiting 35s 21:05:47 (7396): Can't acquire lockfile (32) - exiting 21:05:47 (7396): Error: The process cannot access the file because it is being used by another process. (0x20) 21:05:48 (7880): Can't acquire lockfile (32) - waiting 35s 21:06:23 (7880): Can't acquire lockfile (32) - exiting 21:06:23 (7880): Error: The process cannot access the file because it is being used by another process. (0x20) 21:06:24 (5972): Can't acquire lockfile (32) - waiting 35s 21:06:59 (5972): Can't acquire lockfile (32) - exiting 21:06:59 (5972): Error: The process cannot access the file because it is being used by another process. (0x20) 21:06:59 (820): Can't acquire lockfile (32) - waiting 35s 21:07:34 (820): Can't acquire lockfile (32) - exiting 21:07:34 (820): Error: The process cannot access the file because it is being used by another process. (0x20) 21:07:35 (7980): Can't acquire lockfile (32) - waiting 35s 21:08:10 (7980): Can't acquire lockfile (32) - exiting 21:08:10 (7980): Error: The process cannot access the file because it is being used by another process. (0x20) 21:08:11 (7892): Can't acquire lockfile (32) - waiting 35s 21:08:46 (7892): Can't acquire lockfile (32) - exiting 21:08:46 (7892): Error: The process cannot access the file because it is being used by another process. (0x20) 21:08:47 (7712): Can't acquire lockfile (32) - waiting 35s 21:09:22 (7712): Can't acquire lockfile (32) - exiting 21:09:22 (7712): Error: The process cannot access the file because it is being used by another process. (0x20) 21:09:23 (7688): Can't acquire lockfile (32) - waiting 35s 21:09:58 (7688): Can't acquire lockfile (32) - exiting 21:09:58 (7688): Error: The process cannot access the file because it is being used by another process. (0x20) 21:09:59 (8188): Can't acquire lockfile (32) - waiting 35s 21:10:34 (8188): Can't acquire lockfile (32) - exiting 21:10:34 (8188): Error: The process cannot access the file because it is being used by another process. (0x20) 21:10:35 (4412): Can't acquire lockfile (32) - waiting 35s 21:11:10 (4412): Can't acquire lockfile (32) - exiting 21:11:10 (4412): Error: The process cannot access the file because it is being used by another process. (0x20) 21:11:11 (5776): Can't acquire lockfile (32) - waiting 35s 21:11:46 (5776): Can't acquire lockfile (32) - exiting 21:11:46 (5776): Error: The process cannot access the file because it is being used by another process. (0x20) 21:11:47 (8012): Can't acquire lockfile (32) - waiting 35s 21:12:22 (8012): Can't acquire lockfile (32) - exiting 21:12:22 (8012): Error: The process cannot access the file because it is being used by another process. (0x20) 21:12:23 (6268): Can't acquire lockfile (32) - waiting 35s 21:12:58 (6268): Can't acquire lockfile (32) - exiting 21:12:58 (6268): Error: The process cannot access the file because it is being used by another process. (0x20) 21:12:58 (3024): Can't acquire lockfile (32) - waiting 35s 21:13:33 (3024): Can't acquire lockfile (32) - exiting 21:13:33 (3024): Error: The process cannot access the file because it is being used by another process. (0x20) 21:13:34 (5324): Can't acquire lockfile (32) - waiting 35s 21:14:09 (5324): Can't acquire lockfile (32) - exiting 21:14:09 (5324): Error: The process cannot access the file because it is being used by another process. (0x20) 21:14:10 (5344): Can't acquire lockfile (32) - waiting 35s 21:14:45 (5344): Can't acquire lockfile (32) - exiting 21:14:45 (5344): Error: The process cannot access the file because it is being used by another process. (0x20) 21:14:45 (7024): Can't acquire lockfile (32) - waiting 35s 21:15:20 (7024): Can't acquire lockfile (32) - exiting 21:15:20 (7024): Error: The process cannot access the file because it is being used by another process. (0x20) 21:15:21 (7500): Can't acquire lockfile (32) - waiting 35s 21:15:56 (7500): Can't acquire lockfile (32) - exiting 21:15:56 (7500): Error: The process cannot access the file because it is being used by another process. (0x20) 21:15:57 (7852): Can't acquire lockfile (32) - waiting 35s 21:16:32 (7852): Can't acquire lockfile (32) - exiting 21:16:32 (7852): Error: The process cannot access the file because it is being used by another process. (0x20) 21:16:33 (7796): Can't acquire lockfile (32) - waiting 35s 21:17:08 (7796): Can't acquire lockfile (32) - exiting 21:17:08 (7796): Error: The process cannot access the file because it is being used by another process. (0x20) 21:17:09 (2424): Can't acquire lockfile (32) - waiting 35s 21:17:44 (2424): Can't acquire lockfile (32) - exiting 21:17:44 (2424): Error: The process cannot access the file because it is being used by another process. (0x20) 21:17:45 (6504): Can't acquire lockfile (32) - waiting 35s 21:18:20 (6504): Can't acquire lockfile (32) - exiting 21:18:20 (6504): Error: The process cannot access the file because it is being used by another process. (0x20) 21:18:21 (4860): Can't acquire lockfile (32) - waiting 35s 21:18:56 (4860): Can't acquire lockfile (32) - exiting 21:18:56 (4860): Error: The process cannot access the file because it is being used by another process. (0x20) 21:18:57 (6388): Can't acquire lockfile (32) - waiting 35s 21:19:32 (6388): Can't acquire lockfile (32) - exiting 21:19:32 (6388): Error: The process cannot access the file because it is being used by another process. (0x20) 21:19:33 (6448): Can't acquire lockfile (32) - waiting 35s 21:20:08 (6448): Can't acquire lockfile (32) - exiting 21:20:08 (6448): Error: The process cannot access the file because it is being used by another process. (0x20) 21:20:09 (7592): Can't acquire lockfile (32) - waiting 35s 21:20:44 (7592): Can't acquire lockfile (32) - exiting 21:20:44 (7592): Error: The process cannot access the file because it is being used by another process. (0x20) 21:20:45 (4656): Can't acquire lockfile (32) - waiting 35s 21:21:20 (4656): Can't acquire lockfile (32) - exiting 21:21:20 (4656): Error: The process cannot access the file because it is being used by another process. (0x20) 21:21:20 (5052): Can't acquire lockfile (32) - waiting 35s 21:21:55 (5052): Can't acquire lockfile (32) - exiting 21:21:55 (5052): Error: The process cannot access the file because it is being used by another process. (0x20) 21:21:56 (8144): Can't acquire lockfile (32) - waiting 35s 21:22:31 (8144): Can't acquire lockfile (32) - exiting 21:22:31 (8144): Error: The process cannot access the file because it is being used by another process. (0x20) </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
29 Dec 2012 17:58:11	1244728	15484368	hadcm3n_zc0e_1880_40_008250239_3	77,760	158,677	2.0406
27 Dec 2012 02:02:57	1244728	15484368	hadcm3n_zc0e_1880_40_008250239_3	51,840	106,889	2.0619
22 Dec 2012 00:27:26	1244728	15484368	hadcm3n_zc0e_1880_40_008250239_3	25,920	53,335	2.0577