Task 11901565

Name	hadsm3dhet2_u6er_006726114_9
Workunit	6929457
Created	17 Sep 2010, 8:09:02 UTC
Sent	20 Sep 2010, 4:38:52 UTC
Report deadline	2 Sep 2011, 9:58:52 UTC
Received	15 Oct 2010, 21:09:34 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	1049910
Run time	10 days 20 hours 36 min 15 sec
CPU time	10 days 14 hours 32 min 56 sec
Validate state	Invalid
Credit	7,046.28
Device peak FLOPS	2.49 GFLOPS
Application version	UK Met Office HadSM3 Slab Model v6.07 windows_intelx86
Stderr	<core_client_version>6.10.58</core_client_version> <![CDATA[ <message> The device does not recognize the command. (0x16) - exit code 22 (0x16) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... No Process Handle CPDN process is not running, exiting, bRetVal = 1, checkPID=2912, selfPID=2912, iMonCtr=1 CPDN Monitor - Quit request from BOINC... No Process Handle CPDN process is not running, exiting, bRetVal = 1, checkPID=4568, selfPID=4568, iMonCtr=1 CPDN Monitor - Quit request from BOINC... No Process Handle CPDN process is not running, exiting, bRetVal = 1, checkPID=6700, selfPID=6700, iMonCtr=1 CPDN Monitor - Quit request from BOINC... No Process Handle CPDN process is not running, exiting, bRetVal = 1, checkPID=4956, selfPID=4956, iMonCtr=1 CPDN Monitor - Quit request from BOINC... No Process Handle CPDN process is not running, exiting, bRetVal = 1, checkPID=5320, selfPID=5320, iMonCtr=1 CPDN Monitor - Quit request from BOINC... CPDN process is not running, exiting, bRetVal = 1, checkPID=1808, selfPID=1808, iMonCtr=1 CPDN Monitor - Quit request from BOINC... No Process Handle CPDN process is not running, exiting, bRetVal = 1, checkPID=6304, selfPID=6304, iMonCtr=1 CPDN Monitor - Quit request from BOINC... No Process Handle CPDN process is not running, exiting, bRetVal = 1, checkPID=5604, selfPID=5604, iMonCtr=1 CPDN Monitor - Quit request from BOINC... No Process Handle CPDN process is not running, exiting, bRetVal = 1, checkPID=4328, selfPID=4328, iMonCtr=1 CPDN Monitor - Quit request from BOINC... No Process Handle CPDN process is not running, exiting, bRetVal = 1, checkPID=3124, selfPID=3124, iMonCtr=1 CPDN Monitor - Quit request from BOINC... No Process Handle CPDN process is not running, exiting, bRetVal = 1, checkPID=6000, selfPID=6000, iMonCtr=1 CPDN Monitor - Quit request from BOINC... No Process Handle CPDN process is not running, exiting, bRetVal = 1, checkPID=2284, selfPID=2284, iMonCtr=1 CPDN Monitor - Quit request from BOINC... No Process Handle CPDN process is not running, exiting, bRetVal = 1, checkPID=5820, selfPID=5820, iMonCtr=1 CPDN Monitor - Quit request from BOINC... No Process Handle CPDN process is not running, exiting, bRetVal = 1, checkPID=2756, selfPID=2756, iMonCtr=1 CPDN Monitor - Quit request from BOINC... No Process Handle CPDN process is not running, exiting, bRetVal = 1, checkPID=3172, selfPID=3172, iMonCtr=1 CPDN Monitor - Quit request from BOINC... No Process Handle CPDN process is not running, exiting, bRetVal = 1, checkPID=5940, selfPID=5940, iMonCtr=1 CPDN Monitor - Quit request from BOINC... CPDN process is not running, exiting, bRetVal = 1, checkPID=5988, selfPID=5988, iMonCtr=1 CPDN Monitor - Quit request from BOINC... No Process Handle CPDN process is not running, exiting, bRetVal = 1, checkPID=6132, selfPID=6132, iMonCtr=1 CPDN Monitor - Quit request from BOINC... CPDN process is not running, exiting, bRetVal = 1, checkPID=5332, selfPID=5332, iMonCtr=1 CPDN Monitor - Quit request from BOINC... No Process Handle CPDN process is not running, exiting, bRetVal = 1, checkPID=564, selfPID=564, iMonCtr=1 CPDN Monitor - Quit request from BOINC... No Process Handle CPDN process is not running, exiting, bRetVal = 1, checkPID=832, selfPID=832, iMonCtr=1 CPDN Monitor - Quit request from BOINC... No Process Handle CPDN process is not running, exiting, bRetVal = 1, checkPID=5224, selfPID=5224, iMonCtr=1 CPDN Monitor - Quit request from BOINC... No Process Handle CPDN process is not running, exiting, bRetVal = 1, checkPID=5216, selfPID=5216, iMonCtr=1 CPDN Monitor - Quit request from BOINC... No Process Handle CPDN process is not running, exiting, bRetVal = 1, checkPID=5348, selfPID=5348, iMonCtr=1 CPDN Monitor - Quit request from BOINC... No Process Handle CPDN process is not running, exiting, bRetVal = 1, checkPID=4552, selfPID=4552, iMonCtr=1 CPDN Monitor - Quit request from BOINC... No Process Handle CPDN process is not running, exiting, bRetVal = 1, checkPID=6660, selfPID=6660, iMonCtr=1 CPDN Monitor - Quit request from BOINC... No Process Handle CPDN process is not running, exiting, bRetVal = 1, checkPID=6456, selfPID=6456, iMonCtr=1 CPDN Monitor - Quit request from BOINC... No Process Handle CPDN process is not running, exiting, bRetVal = 1, checkPID=3632, selfPID=3632, iMonCtr=1 CPDN Monitor - Quit request from BOINC... CPDN process is not running, exiting, bRetVal = 1, checkPID=5112, selfPID=5112, iMonCtr=1 CPDN Monitor - Quit request from BOINC... CPDN process is not running, exiting, bRetVal = 1, checkPID=4208, selfPID=4208, iMonCtr=1 CPDN Monitor - Quit request from BOINC... No Process Handle CPDN process is not running, exiting, bRetVal = 1, checkPID=6588, selfPID=6588, iMonCtr=1 CPDN Monitor - Quit request from BOINC... No Process Handle CPDN process is not running, exiting, bRetVal = 1, checkPID=2760, selfPID=2760, iMonCtr=1 CPDN Monitor - Quit request from BOINC... CPDN process is not running, exiting, bRetVal = 1, checkPID=2936, selfPID=2936, iMonCtr=1 CPDN Monitor - Quit request from BOINC... No Process Handle CPDN process is not running, exiting, bRetVal = 1, checkPID=4292, selfPID=4292, iMonCtr=1 CPDN Monitor - Quit request from BOINC... No Process Handle CPDN process is not running, exiting, bRetVal = 1, checkPID=3864, selfPID=3864, iMonCtr=1 CPDN Monitor - Quit request from BOINC... No Process Handle CPDN process is not running, exiting, bRetVal = 1, checkPID=2772, selfPID=2772, iMonCtr=1 CPDN Monitor - Quit request from BOINC... No Process Handle CPDN process is not running, exiting, bRetVal = 1, checkPID=5820, selfPID=5820, iMonCtr=1 CPDN Monitor - Quit request from BOINC... No Process Handle CPDN process is not running, exiting, bRetVal = 1, checkPID=1908, selfPID=1908, iMonCtr=1 CPDN Monitor - Quit request from BOINC... CPDN process is not running, exiting, bRetVal = 1, checkPID=4876, selfPID=4876, iMonCtr=1 CPDN Monitor - Quit request from BOINC... No Process Handle CPDN process is not running, exiting, bRetVal = 1, checkPID=4988, selfPID=4988, iMonCtr=1 CPDN Monitor - Quit request from BOINC... No Process Handle CPDN process is not running, exiting, bRetVal = 1, checkPID=6132, selfPID=6132, iMonCtr=1 CPDN Monitor - Quit request from BOINC... No Process Handle CPDN process is not running, exiting, bRetVal = 1, checkPID=6128, selfPID=6128, iMonCtr=1 CPDN Monitor - Quit request from BOINC... No Process Handle CPDN process is not running, exiting, bRetVal = 1, checkPID=4980, selfPID=4980, iMonCtr=1 CPDN Monitor - Quit request from BOINC... No Process Handle CPDN process is not running, exiting, bRetVal = 1, checkPID=1584, selfPID=1584, iMonCtr=1 CPDN Monitor - Quit request from BOINC... No Process Handle CPDN process is not running, exiting, bRetVal = 1, checkPID=6232, selfPID=6232, iMonCtr=1 No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... No heartbeat from core client for 30 sec - exiting No heartbeat from core client for 30 sec - exiting No heartbeat from core client for 30 sec - exiting No heartbeat from core client for 30 sec - exiting No heartbeat from core client for 30 sec - exiting No heartbeat from core client for 30 sec - exiting forrtl: Access is denied. CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5696, iMonCtr=1 Model crash detected, will try to restart... forrtl: Access is denied. CPDN Monitor - Quit request from BOINC... No Process Handle CPDN process is not running, exiting, bRetVal = 1, checkPID=5472, selfPID=5472, iMonCtr=1 MainError: 02:58:18 PM No files match the supplied pattern. MainError: 02:58:18 PM No files match the supplied pattern. MainError: 02:58:18 PM No files match the supplied pattern. MainError: 02:58:18 PM No files match the supplied pattern. MainError: 02:58:18 PM No files match the supplied pattern. MainError: 02:58:18 PM No files match the supplied pattern. MainError: 02:58:18 PM No files match the supplied pattern. MainError: 02:58:18 PM No files match the supplied pattern. MainError: 02:58:18 PM No files match the supplied pattern. MainError: 02:58:18 PM No files match the supplied pattern. MainError: 02:58:18 PM No files match the supplied pattern. MainError: 02:58:18 PM No files match the supplied pattern. MainError: 02:58:18 PM No files match the supplied pattern. MainError: 02:58:18 PM No files match the supplied pattern. MainError: 02:58:18 PM No files match the supplied pattern. MainError: 02:58:18 PM No files match the supplied pattern. MainError: 02:58:18 PM No files match the supplied pattern. MainError: 02:58:18 PM No files match the supplied pattern. MainError: 02:58:18 PM No files match the supplied pattern. MainError: 02:58:18 PM No files match the supplied pattern. MainError: 02:58:18 PM No files match the supplied pattern. MainError: 02:58:18 PM No files match the supplied pattern. MainError: 02:58:18 PM No files match the supplied pattern. MainError: 02:58:18 PM No files match the supplied pattern. MainError: 02:58:18 PM No files match the supplied pattern. MainError: 02:58:18 PM No files match the supplied pattern. MainError: 02:58:18 PM No files match the supplied pattern. MainError: 02:58:18 PM No files match the supplied pattern. MainError: 02:58:18 PM No files match the supplied pattern. MainError: 02:58:18 PM No files match the supplied pattern. MainError: 02:58:18 PM No files match the supplied pattern. MainError: 02:58:18 PM No files match the supplied pattern. MainError: 02:58:18 PM No files match the supplied pattern. MainError: 02:58:18 PM No files match the supplied pattern. MainError: 02:58:18 PM No files match the supplied pattern. MainError: 02:58:18 PM No files match the supplied pattern. MainError: 02:58:18 PM No files match the supplied pattern. MainError: 02:58:18 PM No files match the supplied pattern. MainError: 02:58:18 PM No files match the supplied pattern. MainError: 02:58:18 PM No files match the supplied pattern. MainError: 02:58:18 PM No files match the supplied pattern. MainError: 02:58:18 PM No files match the supplied pattern. MainError: 02:58:18 PM No files match the supplied pattern. MainError: 02:58:18 PM No files match the supplied pattern. MainError: 02:58:18 PM No files match the supplied pattern. MainError: 02:58:18 PM No files match the supplied pattern. MainError: 02:58:18 PM No files match the supplied pattern. MainError: 02:58:18 PM No files match the supplied pattern. MainError: 02:58:18 PM No files match the supplied pattern. MainError: 02:58:18 PM No files match the supplied pattern. MainError: 02:58:18 PM No files match the supplied pattern. MainError: 02:58:18 PM No files match the supplied pattern. MainError: 02:58:18 PM No files match the supplied pattern. MainError: 02:58:18 PM No files match the supplied pattern. MainError: 02:58:18 PM No files match the supplied pattern. MainError: 02:58:18 PM No files match the supplied pattern. CPDN Monitor - Quit request from BOINC... No Process Handle CPDN process is not running, exiting, bRetVal = 1, checkPID=5748, selfPID=5748, iMonCtr=1 CPDN Monitor - Quit request from BOINC... No Process Handle CPDN process is not running, exiting, bRetVal = 1, checkPID=2540, selfPID=2540, iMonCtr=1 CPDN Monitor - Quit request from BOINC... No Process Handle CPDN process is not running, exiting, bRetVal = 1, checkPID=5884, selfPID=5884, iMonCtr=1 CPDN Monitor - Quit request from BOINC... No Process Handle CPDN process is not running, exiting, bRetVal = 1, checkPID=2412, selfPID=2412, iMonCtr=1 CPDN Monitor - Quit request from BOINC... No Process Handle CPDN process is not running, exiting, bRetVal = 1, checkPID=6344, selfPID=6344, iMonCtr=1 CPDN Monitor - Quit request from BOINC... No Process Handle CPDN process is not running, exiting, bRetVal = 1, checkPID=360, selfPID=360, iMonCtr=1 No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... No heartbeat from core client for 30 sec - exiting No heartbeat from core client for 30 sec - exiting No heartbeat from core client for 30 sec - exiting No heartbeat from core client for 30 sec - exiting No heartbeat from core client for 30 sec - exiting No heartbeat from core client for 30 sec - exiting No heartbeat from core client for 30 sec - exiting No heartbeat from core client for 30 sec - exiting No heartbeat from core client for 30 sec - exiting No heartbeat from core client for 30 sec - exiting CPDN process is not running, exiting, bRetVal = 1, checkPID=6180, selfPID=6180, iMonCtr=1 CPDN Monitor - Quit request from BOINC... No Process Handle CPDN process is not running, exiting, bRetVal = 1, checkPID=6588, selfPID=6588, iMonCtr=1 CPDN Monitor - Quit request from BOINC... No Process Handle CPDN process is not running, exiting, bRetVal = 1, checkPID=2540, selfPID=2540, iMonCtr=1 CPDN Monitor - Quit request from BOINC... No Process Handle CPDN process is not running, exiting, bRetVal = 1, checkPID=740, selfPID=740, iMonCtr=1 CPDN Monitor - Quit request from BOINC... No Process Handle CPDN process is not running, exiting, bRetVal = 1, checkPID=7020, selfPID=7020, iMonCtr=1 CPDN Monitor - Quit request from BOINC... No Process Handle CPDN process is not running, exiting, bRetVal = 1, checkPID=6856, selfPID=6856, iMonCtr=1 CPDN Monitor - Quit request from BOINC... No Process Handle CPDN process is not running, exiting, bRetVal = 1, checkPID=7116, selfPID=7116, iMonCtr=1 CPDN Monitor - Quit request from BOINC... No Process Handle CPDN process is not running, exiting, bRetVal = 1, checkPID=4748, selfPID=4748, iMonCtr=1 CPDN Monitor - Quit request from BOINC... No Process Handle CPDN process is not running, exiting, bRetVal = 1, checkPID=5976, selfPID=5976, iMonCtr=1 CPDN Monitor - Quit request from BOINC... No Process Handle CPDN process is not running, exiting, bRetVal = 1, checkPID=4000, selfPID=4000, iMonCtr=1 CPDN Monitor - Quit request from BOINC... No Process Handle CPDN process is not running, exiting, bRetVal = 1, checkPID=360, selfPID=360, iMonCtr=1 CPDN Monitor - Quit request from BOINC... No Process Handle CPDN process is not running, exiting, bRetVal = 1, checkPID=6176, selfPID=6176, iMonCtr=1 CPDN Monitor - Quit request from BOINC... No Process Handle CPDN process is not running, exiting, bRetVal = 1, checkPID=4228, selfPID=4228, iMonCtr=1 CPDN Monitor - Quit request from BOINC... No Process Handle CPDN process is not running, exiting, bRetVal = 1, checkPID=2720, selfPID=2720, iMonCtr=1 CPDN Monitor - Quit request from BOINC... No Process Handle CPDN process is not running, exiting, bRetVal = 1, checkPID=6948, selfPID=6948, iMonCtr=1 CPDN Monitor - Quit request from BOINC... No Process Handle CPDN process is not running, exiting, bRetVal = 1, checkPID=6436, selfPID=6436, iMonCtr=1 CPDN Monitor - Quit request from BOINC... No Process Handle CPDN process is not running, exiting, bRetVal = 1, checkPID=3024, selfPID=3024, iMonCtr=1 CPDN Monitor - Quit request from BOINC... No Process Handle CPDN process is not running, exiting, bRetVal = 1, checkPID=5644, selfPID=5644, iMonCtr=1 CPDN Monitor - Quit request from BOINC... No Process Handle CPDN process is not running, exiting, bRetVal = 1, checkPID=164, selfPID=164, iMonCtr=1 CPDN Monitor - Quit request from BOINC... No Process Handle CPDN process is not running, exiting, bRetVal = 1, checkPID=5652, selfPID=5652, iMonCtr=1 CPDN Monitor - Quit request from BOINC... No Process Handle CPDN process is not running, exiting, bRetVal = 1, checkPID=5392, selfPID=5392, iMonCtr=1 CPDN Monitor - Quit request from BOINC... No Process Handle CPDN process is not running, exiting, bRetVal = 1, checkPID=6392, selfPID=6392, iMonCtr=1 CPDN Monitor - Quit request from BOINC... No Process Handle CPDN process is not running, exiting, bRetVal = 1, checkPID=5028, selfPID=5028, iMonCtr=1 CPDN Monitor - Quit request from BOINC... No Process Handle CPDN process is not running, exiting, bRetVal = 1, checkPID=6724, selfPID=6724, iMonCtr=1 CPDN Monitor - Quit request from BOINC... No Process Handle CPDN process is not running, exiting, bRetVal = 1, checkPID=7064, selfPID=7064, iMonCtr=1 CPDN Monitor - Quit request from BOINC... No Process Handle CPDN process is not running, exiting, bRetVal = 1, checkPID=6872, selfPID=6872, iMonCtr=1 CPDN Monitor - Quit request from BOINC... No Process Handle CPDN process is not running, exiting, bRetVal = 1, checkPID=3200, selfPID=3200, iMonCtr=1 CPDN Monitor - Quit request from BOINC... CPDN process is not running, exiting, bRetVal = 1, checkPID=4452, selfPID=4452, iMonCtr=1 CPDN Monitor - Quit request from BOINC... CPDN process is not running, exiting, bRetVal = 1, checkPID=1960, selfPID=1960, iMonCtr=1 CPDN Monitor - Quit request from BOINC... No Process Handle CPDN process is not running, exiting, bRetVal = 1, checkPID=3868, selfPID=3868, iMonCtr=1 CPDN Monitor - Quit request from BOINC... No Process Handle CPDN process is not running, exiting, bRetVal = 1, checkPID=2212, selfPID=2212, iMonCtr=1 CPDN Monitor - Quit request from BOINC... No Process Handle CPDN process is not running, exiting, bRetVal = 1, checkPID=5624, selfPID=5624, iMonCtr=1 CPDN Monitor - Quit request from BOINC... CPDN process is not running, exiting, bRetVal = 1, checkPID=3228, selfPID=3228, iMonCtr=1 CPDN Monitor - Quit request from BOINC... No Process Handle CPDN process is not running, exiting, bRetVal = 1, checkPID=6820, selfPID=6820, iMonCtr=1 CPDN Monitor - Quit request from BOINC... No Process Handle CPDN process is not running, exiting, bRetVal = 1, checkPID=6812, selfPID=6812, iMonCtr=1 CPDN Monitor - Quit request from BOINC... No Process Handle CPDN process is not running, exiting, bRetVal = 1, checkPID=7000, selfPID=7000, iMonCtr=1 CPDN Monitor - Quit request from BOINC... No Process Handle CPDN process is not running, exiting, bRetVal = 1, checkPID=5392, selfPID=5392, iMonCtr=1 CPDN Monitor - Quit request from BOINC... No Process Handle CPDN process is not running, exiting, bRetVal = 1, checkPID=5808, selfPID=5808, iMonCtr=1 MainError: 05:51:48 AM No files match the supplied pattern. MainError: 05:51:48 AM No files match the supplied pattern. MainError: 05:51:48 AM No files match the supplied pattern. MainError: 05:51:48 AM No files match the supplied pattern. MainError: 05:51:48 AM No files match the supplied pattern. MainError: 05:51:48 AM No files match the supplied pattern. MainError: 05:51:48 AM No files match the supplied pattern. MainError: 05:51:48 AM No files match the supplied pattern. MainError: 05:51:48 AM No files match the supplied pattern. MainError: 05:51:48 AM No files match the supplied pattern. MainError: 05:51:48 AM No files match the supplied pattern. MainError: 05:51:48 AM No files match the supplied pattern. MainError: 05:51:48 AM No files match the supplied pattern. MainError: 05:51:48 AM No files match the supplied pattern. MainError: 05:51:48 AM No files match the supplied pattern. MainError: 05:51:48 AM No files match the supplied pattern. MainError: 05:51:48 AM No files match the supplied pattern. MainError: 05:51:48 AM No files match the supplied pattern. MainError: 05:51:48 AM No files match the supplied pattern. MainError: 05:51:48 AM No files match the supplied pattern. MainError: 05:51:48 AM No files match the supplied pattern. MainError: 05:51:48 AM No files match the supplied pattern. MainError: 05:51:48 AM No files match the supplied pattern. MainError: 05:51:48 AM No files match the supplied pattern. MainError: 05:51:48 AM No files match the supplied pattern. MainError: 05:51:48 AM No files match the supplied pattern. MainError: 05:51:48 AM No files match the supplied pattern. MainError: 05:51:48 AM No files match the supplied pattern. MainError: 05:51:48 AM No files match the supplied pattern. MainError: 05:51:48 AM No files match the supplied pattern. MainError: 05:51:48 AM No files match the supplied pattern. MainError: 05:51:48 AM No files match the supplied pattern. MainError: 05:51:48 AM No files match the supplied pattern. MainError: 05:51:48 AM No files match the supplied pattern. MainError: 05:51:48 AM No files match the supplied pattern. MainError: 05:51:48 AM No files match the supplied pattern. MainError: 05:51:48 AM No files match the supplied pattern. MainError: 05:51:48 AM No files match the supplied pattern. MainError: 05:51:48 AM No files match the supplied pattern. MainError: 05:51:48 AM No files match the supplied pattern. MainError: 05:51:48 AM No files match the supplied pattern. MainError: 05:51:48 AM No files match the supplied pattern. MainError: 05:51:48 AM No files match the supplied pattern. MainError: 05:51:48 AM No files match the supplied pattern. MainError: 05:51:48 AM No files match the supplied pattern. MainError: 05:51:48 AM No files match the supplied pattern. MainError: 05:51:48 AM No files match the supplied pattern. MainError: 05:51:48 AM No files match the supplied pattern. MainError: 05:51:48 AM No files match the supplied pattern. MainError: 05:51:48 AM No files match the supplied pattern. MainError: 05:51:48 AM No files match the supplied pattern. MainError: 05:51:48 AM No files match the supplied pattern. MainError: 05:51:48 AM No files match the supplied pattern. MainError: 05:51:48 AM No files match the supplied pattern. MainError: 05:51:48 AM No files match the supplied pattern. MainError: 05:51:48 AM No files match the supplied pattern. CPDN Monitor - Quit request from BOINC... CPDN process is not running, exiting, bRetVal = 1, checkPID=6840, selfPID=6840, iMonCtr=1 CPDN Monitor - Quit request from BOINC... No Process Handle CPDN process is not running, exiting, bRetVal = 1, checkPID=6480, selfPID=6480, iMonCtr=1 CPDN Monitor - Quit request from BOINC... No Process Handle CPDN process is not running, exiting, bRetVal = 1, checkPID=5308, selfPID=5308, iMonCtr=1 CPDN Monitor - Quit request from BOINC... CPDN process is not running, exiting, bRetVal = 1, checkPID=4696, selfPID=4696, iMonCtr=1 CPDN Monitor - Quit request from BOINC... No Process Handle CPDN process is not running, exiting, bRetVal = 1, checkPID=6112, selfPID=6112, iMonCtr=1 CPDN Monitor - Quit request from BOINC... No Process Handle CPDN process is not running, exiting, bRetVal = 1, checkPID=4052, selfPID=4052, iMonCtr=1 CPDN Monitor - Quit request from BOINC... CPDN process is not running, exiting, bRetVal = 1, checkPID=3252, selfPID=3252, iMonCtr=1 CPDN Monitor - Quit request from BOINC... No Process Handle CPDN process is not running, exiting, bRetVal = 1, checkPID=2768, selfPID=2768, iMonCtr=1 CPDN Monitor - Quit request from BOINC... No Process Handle CPDN process is not running, exiting, bRetVal = 1, checkPID=5348, selfPID=5348, iMonCtr=1 CPDN Monitor - Quit request from BOINC... No Process Handle CPDN process is not running, exiting, bRetVal = 1, checkPID=1952, selfPID=1952, iMonCtr=1 CPDN Monitor - Quit request from BOINC... No Process Handle CPDN process is not running, exiting, bRetVal = 1, checkPID=388, selfPID=388, iMonCtr=1 CPDN Monitor - Quit request from BOINC... CPDN process is not running, exiting, bRetVal = 1, checkPID=1416, selfPID=1416, iMonCtr=1 CPDN Monitor - Quit request from BOINC... No Process Handle CPDN process is not running, exiting, bRetVal = 1, checkPID=2260, selfPID=2260, iMonCtr=1 CPDN Monitor - Quit request from BOINC... No Process Handle CPDN process is not running, exiting, bRetVal = 1, checkPID=5996, selfPID=5996, iMonCtr=1 CPDN Monitor - Quit request from BOINC... No Process Handle CPDN process is not running, exiting, bRetVal = 1, checkPID=4488, selfPID=4488, iMonCtr=1 CPDN Monitor - Quit request from BOINC... No Process Handle CPDN process is not running, exiting, bRetVal = 1, checkPID=380, selfPID=380, iMonCtr=1 CPDN Monitor - Quit request from BOINC... No Process Handle CPDN process is not running, exiting, bRetVal = 1, checkPID=4132, selfPID=4132, iMonCtr=1 CPDN Monitor - Quit request from BOINC... No Process Handle CPDN process is not running, exiting, bRetVal = 1, checkPID=3232, selfPID=3232, iMonCtr=1 CPDN Monitor - Quit request from BOINC... No Process Handle CPDN process is not running, exiting, bRetVal = 1, checkPID=7028, selfPID=7028, iMonCtr=1 CPDN Monitor - Quit request from BOINC... No Process Handle CPDN process is not running, exiting, bRetVal = 1, checkPID=6564, selfPID=6564, iMonCtr=1 CPDN Monitor - Quit request from BOINC... forrtl: Access is denied. CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2208, iMonCtr=1 Model crash detected, will try to restart... forrtl: Access is denied. CPDN Monitor - Quit request from BOINC... No Process Handle CPDN process is not running, exiting, bRetVal = 1, checkPID=5164, selfPID=5164, iMonCtr=1 CPDN Monitor - Quit request from BOINC... No Process Handle CPDN process is not running, exiting, bRetVal = 1, checkPID=6952, selfPID=6952, iMonCtr=1 CPDN Monitor - Quit request from BOINC... No Process Handle CPDN process is not running, exiting, bRetVal = 1, checkPID=4604, selfPID=4604, iMonCtr=1 CPDN Monitor - Quit request from BOINC... No Process Handle CPDN process is not running, exiting, bRetVal = 1, checkPID=6700, selfPID=6700, iMonCtr=1 CPDN Monitor - Quit request from BOINC... No Process Handle CPDN process is not running, exiting, bRetVal = 1, checkPID=5088, selfPID=5088, iMonCtr=1 CPDN Monitor - Quit request from BOINC... No Process Handle CPDN process is not running, exiting, bRetVal = 1, checkPID=6632, selfPID=6632, iMonCtr=1 CPDN Monitor - Quit request from BOINC... No Process Handle CPDN process is not running, exiting, bRetVal = 1, checkPID=7088, selfPID=7088, iMonCtr=1 CPDN Monitor - Quit request from BOINC... No Process Handle CPDN process is not running, exiting, bRetVal = 1, checkPID=4632, selfPID=4632, iMonCtr=1 CPDN Monitor - Quit request from BOINC... No Process Handle CPDN process is not running, exiting, bRetVal = 1, checkPID=1208, selfPID=1208, iMonCtr=1 CPDN Monitor - Quit request from BOINC... CPDN process is not running, exiting, bRetVal = 1, checkPID=5144, selfPID=5144, iMonCtr=1 CPDN Monitor - Quit request from BOINC... No Process Handle CPDN process is not running, exiting, bRetVal = 1, checkPID=4752, selfPID=4752, iMonCtr=1 CPDN Monitor - Quit request from BOINC... No Process Handle CPDN process is not running, exiting, bRetVal = 1, checkPID=416, selfPID=416, iMonCtr=1 CPDN Monitor - Quit request from BOINC... No Process Handle CPDN process is not running, exiting, bRetVal = 1, checkPID=2144, selfPID=2144, iMonCtr=1 CPDN Monitor - Quit request from BOINC... No Process Handle CPDN process is not running, exiting, bRetVal = 1, checkPID=3960, selfPID=3960, iMonCtr=1 CPDN Monitor - Quit request from BOINC... No Process Handle CPDN process is not running, exiting, bRetVal = 1, checkPID=420, selfPID=420, iMonCtr=1 CPDN Monitor - Quit request from BOINC... No Process Handle CPDN process is not running, exiting, bRetVal = 1, checkPID=4872, selfPID=4872, iMonCtr=1 No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... No heartbeat from core client for 30 sec - exiting No heartbeat from core client for 30 sec - exiting No heartbeat from core client for 30 sec - exiting forrtl: Access is denied. CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5744, iMonCtr=1 Model crash detected, will try to restart... forrtl: Access is denied. CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5744, iMonCtr=1 Model crash detected, will try to restart... forrtl: Access is denied. CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5744, iMonCtr=1 Model crash detected, will try to restart... forrtl: Access is denied. CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5744, iMonCtr=1 Model crash detected, will try to restart... forrtl: Access is denied. CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5744, iMonCtr=1 Model crash detected, will try to restart... forrtl: Access is denied. CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5744, iMonCtr=1 Model crash detected, will try to restart... Sorry, too many model crashes! :-( called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
15 Oct 2010 16:05:35	1049910	11901565	hadsm3dhet2_u6er_006726114_9	248,446	908,414	1.1845
15 Oct 2010 12:13:01	1049910	11901565	hadsm3dhet2_u6er_006726114_9	237,644	895,758	1.1846
15 Oct 2010 08:35:49	1049910	11901565	hadsm3dhet2_u6er_006726114_9	226,842	883,061	1.1848
15 Oct 2010 02:59:38	1049910	11901565	hadsm3dhet2_u6er_006726114_9	216,040	870,147	1.1846
14 Oct 2010 21:22:27	1049910	11901565	hadsm3dhet2_u6er_006726114_9	205,238	857,090	1.1843
14 Oct 2010 16:01:52	1049910	11901565	hadsm3dhet2_u6er_006726114_9	194,436	844,330	1.1843
14 Oct 2010 11:55:09	1049910	11901565	hadsm3dhet2_u6er_006726114_9	183,634	831,568	1.1844
14 Oct 2010 08:18:23	1049910	11901565	hadsm3dhet2_u6er_006726114_9	172,832	818,862	1.1845
14 Oct 2010 04:34:45	1049910	11901565	hadsm3dhet2_u6er_006726114_9	162,030	806,124	1.1846
14 Oct 2010 02:47:33	1049910	11901565	hadsm3dhet2_u6er_006726114_9	151,228	792,739	1.1837
13 Oct 2010 19:35:33	1049910	11901565	hadsm3dhet2_u6er_006726114_9	140,426	780,022	1.1838
13 Oct 2010 13:49:22	1049910	11901565	hadsm3dhet2_u6er_006726114_9	129,624	767,025	1.1835
13 Oct 2010 09:33:37	1049910	11901565	hadsm3dhet2_u6er_006726114_9	118,822	754,337	1.1836
13 Oct 2010 05:02:30	1049910	11901565	hadsm3dhet2_u6er_006726114_9	108,020	741,624	1.1837
13 Oct 2010 02:57:45	1049910	11901565	hadsm3dhet2_u6er_006726114_9	97,218	728,466	1.1831
12 Oct 2010 20:48:02	1049910	11901565	hadsm3dhet2_u6er_006726114_9	86,416	715,258	1.1824
12 Oct 2010 17:14:20	1049910	11901565	hadsm3dhet2_u6er_006726114_9	75,614	702,427	1.1823
12 Oct 2010 12:58:52	1049910	11901565	hadsm3dhet2_u6er_006726114_9	64,812	689,472	1.1820
12 Oct 2010 07:20:52	1049910	11901565	hadsm3dhet2_u6er_006726114_9	54,010	676,692	1.1820
12 Oct 2010 03:19:25	1049910	11901565	hadsm3dhet2_u6er_006726114_9	43,208	663,506	1.1812