Task 11509591

Name	famous_uel8_799_200_006651751_0
Workunit	6855123
Created	10 Jun 2010, 13:45:30 UTC
Sent	18 Aug 2010, 1:04:34 UTC
Report deadline	17 Nov 2010, 8:31:45 UTC
Received	25 Aug 2010, 13:28:04 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	1077167
Run time	5 days 6 hours 56 min 12 sec
CPU time	5 days 0 hours 55 min 10 sec
Validate state	Invalid
Credit	3,150.01
Device peak FLOPS	2.78 GFLOPS
Application version	UK Met Office FAMOUS v6.11 windows_intelx86
Stderr	<core_client_version>6.10.56</core_client_version> <![CDATA[ <message> The device does not recognize the command. (0x16) - exit code 22 (0x16) </message> <stderr_txt> Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2972, selfPID=2972, iMonCtr=1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 60 - Return code = 16 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 61 - Return code = 16 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 09:18:40 (3620): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:19:44 (1904): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 13:04:52 (5408): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:03:10 (5836): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 18:11:10 (5196): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:07:00 (5200): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 11:23:56 (6316): No heartbeat from core client for 30 sec - exiting 11:23:57 (6316): No heartbeat from core client for 30 sec - exiting 11:23:58 (6316): No heartbeat from core client for 30 sec - exiting 11:23:59 (6316): No heartbeat from core client for 30 sec - exiting 11:24:00 (6316): No heartbeat from core client for 30 sec - exiting 11:24:01 (6316): No heartbeat from core client for 30 sec - exiting 11:24:02 (6316): No heartbeat from core client for 30 sec - exiting 11:24:03 (6316): No heartbeat from core client for 30 sec - exiting 11:24:04 (6316): No heartbeat from core client for 30 sec - exiting 11:24:05 (6316): No heartbeat from core client for 30 sec - exiting 11:24:06 (6316): No heartbeat from core client for 30 sec - exiting 11:24:07 (6316): No heartbeat from core client for 30 sec - exiting 11:24:08 (6316): No heartbeat from core client for 30 sec - exiting 11:24:09 (6316): No heartbeat from core client for 30 sec - exiting 11:24:10 (6316): No heartbeat from core client for 30 sec - exiting 11:24:11 (6316): No heartbeat from core client for 30 sec - exiting 11:24:12 (6316): No heartbeat from core client for 30 sec - exiting 11:24:13 (6316): No heartbeat from core client for 30 sec - exiting 11:24:14 (6316): No heartbeat from core client for 30 sec - exiting 11:24:15 (6316): No heartbeat from core client for 30 sec - exiting 11:24:16 (6316): No heartbeat from core client for 30 sec - exiting 11:24:17 (6316): No heartbeat from core client for 30 sec - exiting 11:24:18 (6316): No heartbeat from core client for 30 sec - exiting 11:24:19 (6316): No heartbeat from core client for 30 sec - exiting 11:24:20 (6316): No heartbeat from core client for 30 sec - exiting 11:24:21 (6316): No heartbeat from core client for 30 sec - exiting 11:24:22 (6316): No heartbeat from core client for 30 sec - exiting 11:24:23 (6316): No heartbeat from core client for 30 sec - exiting 11:24:24 (6316): No heartbeat from core client for 30 sec - exiting 11:24:25 (6316): No heartbeat from core client for 30 sec - exiting 11:24:26 (6316): No heartbeat from core client for 30 sec - exiting 11:24:27 (6316): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... 11:27:04 (5888): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:57:03 (7032): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 12:55:57 (5272): No heartbeat from core client for 30 sec - exiting 12:55:58 (5272): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 60 - Return code = 16 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 61 - Return code = 16 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 13:00:18 (6904): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:01:23 (1348): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 16:01:35 (6260): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:02:42 (2848): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:06:32 (1892): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:27:10 (7000): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 18:28:17 (520): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 02:24:43 (3148): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:24:51 (3148): No heartbeat from core client for 30 sec - exiting 02:24:52 (3148): No heartbeat from core client for 30 sec - exiting 02:24:53 (3148): No heartbeat from core client for 30 sec - exiting 02:24:54 (3148): No heartbeat from core client for 30 sec - exiting 02:24:55 (3148): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... 05:07:17 (6356): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:07:56 (5384): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:27:20 (2388): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:37:00 (4304): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 12:16:42 (6856): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:53:40 (6672): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 17:01:45 (6204): No heartbeat from core client for 30 sec - exiting 17:01:46 (6204): No heartbeat from core client for 30 sec - exiting 17:01:47 (6204): No heartbeat from core client for 30 sec - exiting 17:01:48 (6204): No heartbeat from core client for 30 sec - exiting 17:01:49 (6204): No heartbeat from core client for 30 sec - exiting 17:01:50 (6204): No heartbeat from core client for 30 sec - exiting 17:01:51 (6204): No heartbeat from core client for 30 sec - exiting 17:01:52 (6204): No heartbeat from core client for 30 sec - exiting 17:01:53 (6204): No heartbeat from core client for 30 sec - exiting 17:01:54 (6204): No heartbeat from core client for 30 sec - exiting 17:01:55 (6204): No heartbeat from core client for 30 sec - exiting 17:01:56 (6204): No heartbeat from core client for 30 sec - exiting 17:01:57 (6204): No heartbeat from core client for 30 sec - exiting 17:01:58 (6204): No heartbeat from core client for 30 sec - exiting 17:01:59 (6204): No heartbeat from core client for 30 sec - exiting 17:02:00 (6204): No heartbeat from core client for 30 sec - exiting 17:02:01 (6204): No heartbeat from core client for 30 sec - exiting 17:02:02 (6204): No heartbeat from core client for 30 sec - exiting 17:02:03 (6204): No heartbeat from core client for 30 sec - exiting 17:02:04 (6204): No heartbeat from core client for 30 sec - exiting 17:02:05 (6204): No heartbeat from core client for 30 sec - exiting 17:02:06 (6204): No heartbeat from core client for 30 sec - exiting 17:02:07 (6204): No heartbeat from core client for 30 sec - exiting 17:02:08 (6204): No heartbeat from core client for 30 sec - exiting 17:02:09 (6204): No heartbeat from core client for 30 sec - exiting 17:02:10 (6204): No heartbeat from core client for 30 sec - exiting 17:02:11 (6204): No heartbeat from core client for 30 sec - exiting 17:02:12 (6204): No heartbeat from core client for 30 sec - exiting 17:02:13 (6204): No heartbeat from core client for 30 sec - exiting 17:02:14 (6204): No heartbeat from core client for 30 sec - exiting 17:02:15 (6204): No heartbeat from core client for 30 sec - exiting 17:02:16 (6204): No heartbeat from core client for 30 sec - exiting 17:02:17 (6204): No heartbeat from core client for 30 sec - exiting 17:02:18 (6204): No heartbeat from core client for 30 sec - exiting 17:02:19 (6204): No heartbeat from core client for 30 sec - exiting 17:02:20 (6204): No heartbeat from core client for 30 sec - exiting 17:02:21 (6204): No heartbeat from core client for 30 sec - exiting 17:02:22 (6204): No heartbeat from core client for 30 sec - exiting 17:02:23 (6204): No heartbeat from core client for 30 sec - exiting 17:02:24 (6204): No heartbeat from core client for 30 sec - exiting 17:02:25 (6204): No heartbeat from core client for 30 sec - exiting 17:02:26 (6204): No heartbeat from core client for 30 sec - exiting 17:02:27 (6204): No heartbeat from core client for 30 sec - exiting 17:02:28 (6204): No heartbeat from core client for 30 sec - exiting 17:02:29 (6204): No heartbeat from core client for 30 sec - exiting 17:02:30 (6204): No heartbeat from core client for 30 sec - exiting 17:02:31 (6204): No heartbeat from core client for 30 sec - exiting 17:02:32 (6204): No heartbeat from core client for 30 sec - exiting 17:02:33 (6204): No heartbeat from core client for 30 sec - exiting 17:02:34 (6204): No heartbeat from core client for 30 sec - exiting 17:02:35 (6204): No heartbeat from core client for 30 sec - exiting 17:02:36 (6204): No heartbeat from core client for 30 sec - exiting 17:02:37 (6204): No heartbeat from core client for 30 sec - exiting 17:02:38 (6204): No heartbeat from core client for 30 sec - exiting 17:02:39 (6204): No heartbeat from core client for 30 sec - exiting 17:02:40 (6204): No heartbeat from core client for 30 sec - exiting 17:02:41 (6204): No heartbeat from core client for 30 sec - exiting 17:02:42 (6204): No heartbeat from core client for 30 sec - exiting 17:02:43 (6204): No heartbeat from core client for 30 sec - exiting 17:02:44 (6204): No heartbeat from core client for 30 sec - exiting 17:02:45 (6204): No heartbeat from core client for 30 sec - exiting 17:02:46 (6204): No heartbeat from core client for 30 sec - exiting 17:02:47 (6204): No heartbeat from core client for 30 sec - exiting 17:02:48 (6204): No heartbeat from core client for 30 sec - exiting 17:02:49 (6204): No heartbeat from core client for 30 sec - exiting 17:02:50 (6204): No heartbeat from core client for 30 sec - exiting 17:02:51 (6204): No heartbeat from core client for 30 sec - exiting 17:02:52 (6204): No heartbeat from core client for 30 sec - exiting 17:02:53 (6204): No heartbeat from core client for 30 sec - exiting 17:02:54 (6204): No heartbeat from core client for 30 sec - exiting 17:02:55 (6204): No heartbeat from core client for 30 sec - exiting 17:02:56 (6204): No heartbeat from core client for 30 sec - exiting 17:02:57 (6204): No heartbeat from core client for 30 sec - exiting 17:02:58 (6204): No heartbeat from core client for 30 sec - exiting 17:02:59 (6204): No heartbeat from core client for 30 sec - exiting 17:03:00 (6204): No heartbeat from core client for 30 sec - exiting 17:03:01 (6204): No heartbeat from core client for 30 sec - exiting 17:03:02 (6204): No heartbeat from core client for 30 sec - exiting 17:03:03 (6204): No heartbeat from core client for 30 sec - exiting 17:03:04 (6204): No heartbeat from core client for 30 sec - exiting 17:03:05 (6204): No heartbeat from core client for 30 sec - exiting 17:03:06 (6204): No heartbeat from core client for 30 sec - exiting 17:03:07 (6204): No heartbeat from core client for 30 sec - exiting 17:03:08 (6204): No heartbeat from core client for 30 sec - exiting 17:03:09 (6204): No heartbeat from core client for 30 sec - exiting 17:03:10 (6204): No heartbeat from core client for 30 sec - exiting 17:03:11 (6204): No heartbeat from core client for 30 sec - exiting 17:03:12 (6204): No heartbeat from core client for 30 sec - exiting 17:03:13 (6204): No heartbeat from core client for 30 sec - exiting 17:03:14 (6204): No heartbeat from core client for 30 sec - exiting 17:03:15 (6204): No heartbeat from core client for 30 sec - exiting 17:03:16 (6204): No heartbeat from core client for 30 sec - exiting 17:03:17 (6204): No heartbeat from core client for 30 sec - exiting 17:03:18 (6204): No heartbeat from core client for 30 sec - exiting 17:03:19 (6204): No heartbeat from core client for 30 sec - exiting 17:03:20 (6204): No heartbeat from core client for 30 sec - exiting 17:03:21 (6204): No heartbeat from core client for 30 sec - exiting 17:03:22 (6204): No heartbeat from core client for 30 sec - exiting 17:03:23 (6204): No heartbeat from core client for 30 sec - exiting 17:03:24 (6204): No heartbeat from core client for 30 sec - exiting 17:03:25 (6204): No heartbeat from core client for 30 sec - exiting 17:03:26 (6204): No heartbeat from core client for 30 sec - exiting 17:03:27 (6204): No heartbeat from core client for 30 sec - exiting 17:03:28 (6204): No heartbeat from core client for 30 sec - exiting 17:03:29 (6204): No heartbeat from core client for 30 sec - exiting 17:03:30 (6204): No heartbeat from core client for 30 sec - exiting 17:03:31 (6204): No heartbeat from core client for 30 sec - exiting 17:03:32 (6204): No heartbeat from core client for 30 sec - exiting 17:03:33 (6204): No heartbeat from core client for 30 sec - exiting 17:03:34 (6204): No heartbeat from core client for 30 sec - exiting 17:03:35 (6204): No heartbeat from core client for 30 sec - exiting 17:03:36 (6204): No heartbeat from core client for 30 sec - exiting 17:03:37 (6204): No heartbeat from core client for 30 sec - exiting 17:03:38 (6204): No heartbeat from core client for 30 sec - exiting 17:03:39 (6204): No heartbeat from core client for 30 sec - exiting 17:03:40 (6204): No heartbeat from core client for 30 sec - exiting 17:03:41 (6204): No heartbeat from core client for 30 sec - exiting 17:03:42 (6204): No heartbeat from core client for 30 sec - exiting 17:03:43 (6204): No heartbeat from core client for 30 sec - exiting 17:03:44 (6204): No heartbeat from core client for 30 sec - exiting 17:03:45 (6204): No heartbeat from core client for 30 sec - exiting 17:03:46 (6204): No heartbeat from core client for 30 sec - exiting 17:03:47 (6204): No heartbeat from core client for 30 sec - exiting 17:03:48 (6204): No heartbeat from core client for 30 sec - exiting 17:03:49 (6204): No heartbeat from core client for 30 sec - exiting 17:03:50 (6204): No heartbeat from core client for 30 sec - exiting 17:03:51 (6204): No heartbeat from core client for 30 sec - exiting 17:03:52 (6204): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:05:05 (1420): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 17:13:31 (2272): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:23:04 (6444): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:27:37 (5748): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:39:30 (3232): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 23:16:12 (6112): No heartbeat from core client for 30 sec - exiting 23:16:13 (6112): No heartbeat from core client for 30 sec - exiting 23:16:14 (6112): No heartbeat from core client for 30 sec - exiting 23:16:15 (6112): No heartbeat from core client for 30 sec - exiting 23:16:16 (6112): No heartbeat from core client for 30 sec - exiting 23:16:17 (6112): No heartbeat from core client for 30 sec - exiting 23:16:18 (6112): No heartbeat from core client for 30 sec - exiting 23:16:19 (6112): No heartbeat from core client for 30 sec - exiting 23:16:20 (6112): No heartbeat from core client for 30 sec - exiting 23:16:21 (6112): No heartbeat from core client for 30 sec - exiting 23:16:22 (6112): No heartbeat from core client for 30 sec - exiting 23:16:23 (6112): No heartbeat from core client for 30 sec - exiting 23:16:24 (6112): No heartbeat from core client for 30 sec - exiting 23:16:25 (6112): No heartbeat from core client for 30 sec - exiting 23:16:26 (6112): No heartbeat from core client for 30 sec - exiting 23:16:27 (6112): No heartbeat from core client for 30 sec - exiting 23:16:28 (6112): No heartbeat from core client for 30 sec - exiting 23:16:29 (6112): No heartbeat from core client for 30 sec - exiting 23:16:30 (6112): No heartbeat from core client for 30 sec - exiting 23:16:31 (6112): No heartbeat from core client for 30 sec - exiting 23:16:32 (6112): No heartbeat from core client for 30 sec - exiting 23:16:36 (6112): No heartbeat from core client for 30 sec - exiting 23:16:37 (6112): No heartbeat from core client for 30 sec - exiting 23:16:38 (6112): No heartbeat from core client for 30 sec - exiting 23:16:39 (6112): No heartbeat from core client for 30 sec - exiting 23:16:40 (6112): No heartbeat from core client for 30 sec - exiting 23:16:41 (6112): No heartbeat from core client for 30 sec - exiting 23:16:42 (6112): No heartbeat from core client for 30 sec - exiting Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6128, selfPID=6128, iMonCtr=1 Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... 23:45:54 (4944): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:17:49 (5736): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:28:49 (5144): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:37:19 (5500): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:38:13 (6920): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 05:52:31 (7628): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:52:32 (7628): No heartbeat from core client for 30 sec - exiting 05:52:33 (7628): No heartbeat from core client for 30 sec - exiting 05:57:02 (6916): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:34:15 (6360): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:00:08 (7768): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:45:29 (7852): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 10:31:06 (4404): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 12:23:05 (2980): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 14:25:57 (6596): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 60 - Return code = 16 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 61 - Return code = 16 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 CPDN Monitor - Quit request from BOINC... 16:37:20 (244): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 19:45:07 (5136): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... No Process Handle Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=8044, selfPID=8044, iMonCtr=1 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 05:15:33 (7464): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 60 - Return code = 16 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 61 - Return code = 16 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 12:45:17 (8448): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:57:50 (9024): No heartbeat from core client for 30 sec - exiting 12:57:51 (9024): No heartbeat from core client for 30 sec - exiting 12:57:52 (9024): No heartbeat from core client for 30 sec - exiting 12:57:53 (9024): No heartbeat from core client for 30 sec - exiting 12:57:54 (9024): No heartbeat from core client for 30 sec - exiting 12:57:55 (9024): No heartbeat from core client for 30 sec - exiting 12:57:56 (9024): No heartbeat from core client for 30 sec - exiting 12:57:57 (9024): No heartbeat from core client for 30 sec - exiting 12:57:58 (9024): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... 14:21:46 (7188): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:27:00 (5444): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:18:50 (7780): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 19:01:07 (2848): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 22:13:31 (3408): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 00:15:55 (8684): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:23:12 (9124): No heartbeat from core client for 30 sec - exiting 03:23:13 (9124): No heartbeat from core client for 30 sec - exiting 03:23:14 (9124): No heartbeat from core client for 30 sec - exiting 03:23:15 (9124): No heartbeat from core client for 30 sec - exiting 03:23:16 (9124): No heartbeat from core client for 30 sec - exiting 03:23:17 (9124): No heartbeat from core client for 30 sec - exiting 03:23:18 (9124): No heartbeat from core client for 30 sec - exiting 03:23:19 (9124): No heartbeat from core client for 30 sec - exiting 03:23:20 (9124): No heartbeat from core client for 30 sec - exiting 03:23:21 (9124): No heartbeat from core client for 30 sec - exiting 03:23:22 (9124): No heartbeat from core client for 30 sec - exiting 03:23:23 (9124): No heartbeat from core client for 30 sec - exiting 03:23:24 (9124): No heartbeat from core client for 30 sec - exiting 03:23:25 (9124): No heartbeat from core client for 30 sec - exiting 03:23:26 (9124): No heartbeat from core client for 30 sec - exiting 03:23:27 (9124): No heartbeat from core client for 30 sec - exiting 03:23:28 (9124): No heartbeat from core client for 30 sec - exiting 03:23:29 (9124): No heartbeat from core client for 30 sec - exiting 03:23:30 (9124): No heartbeat from core client for 30 sec - exiting 03:23:31 (9124): No heartbeat from core client for 30 sec - exiting 03:23:32 (9124): No heartbeat from core client for 30 sec - exiting 03:23:33 (9124): No heartbeat from core client for 30 sec - exiting 03:23:34 (9124): No heartbeat from core client for 30 sec - exiting 03:23:35 (9124): No heartbeat from core client for 30 sec - exiting 03:23:36 (9124): No heartbeat from core client for 30 sec - exiting 03:23:37 (9124): No heartbeat from core client for 30 sec - exiting 03:24:08 (9124): No heartbeat from core client for 30 sec - exiting 03:24:09 (9124): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 10:28:25 (7868): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 06:51:22 (9448): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 13:43:54 (10656): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... No Process Handle Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=10820, selfPID=10820, iMonCtr=1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 60 - Return code = 16 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 61 - Return code = 16 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 CPDN Monitor - Quit request from BOINC... BUFFIN: Read Failed: Result too large BUFFIN: C I/O Error feof - Unit 60 - Return code = 16 BUFFIN: Read Failed: Result too large BUFFIN: C I/O Error feof - Unit 61 - Return code = 16 BUFFIN: Read Failed: Result too large BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... cpdnmonitor: cannot open input file D:\ProgramData\BOINC/projects/climateprediction.net/famous_uel8_799_200_006651751/dataout/ocean_restart.day after 11 attempts Model crashed: READ_FLH: I/O error tmp/pipe_dummy cpdnmonitor: cannot open input file D:\ProgramData\BOINC/projects/climateprediction.net/famous_uel8_799_200_006651751/dataout/ocean_restart.day after 11 attempts Model crashed: READ_FLH: I/O error tmp/pipe_dummy cpdnmonitor: cannot open input file D:\ProgramData\BOINC/projects/climateprediction.net/famous_uel8_799_200_006651751/dataout/ocean_restart.day after 11 attempts Model crashed: READ_FLH: I/O error tmp/pipe_dummy cpdnmonitor: cannot open input file D:\ProgramData\BOINC/projects/climateprediction.net/famous_uel8_799_200_006651751/dataout/ocean_restart.day after 11 attempts Model crashed: READ_FLH: I/O error tmp/pipe_dummy cpdnmonitor: cannot open input file D:\ProgramData\BOINC/projects/climateprediction.net/famous_uel8_799_200_006651751/dataout/ocean_restart.day after 11 attempts Model crashed: READ_FLH: I/O error tmp/pipe_dummy cpdnmonitor: cannot open input file D:\ProgramData\BOINC/projects/climateprediction.net/famous_uel8_799_200_006651751/dataout/ocean_restart.day after 11 attempts Model crashed: READ_FLH: I/O error tmp/pipe_dummy Sorry, too many model crashes! :-( 09:26:23 (6596): called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
25 Aug 2010 12:47:55	1077167	11509591	famous_uel8_799_200_006651751_0	954,746	433,815	0.4544
25 Aug 2010 10:48:21	1077167	11509591	famous_uel8_799_200_006651751_0	945,386	429,466	0.4543
25 Aug 2010 09:39:40	1077167	11509591	famous_uel8_799_200_006651751_0	936,026	425,447	0.4545
25 Aug 2010 08:25:11	1077167	11509591	famous_uel8_799_200_006651751_0	926,666	421,195	0.4545
25 Aug 2010 07:04:20	1077167	11509591	famous_uel8_799_200_006651751_0	917,306	416,610	0.4542
25 Aug 2010 05:48:45	1077167	11509591	famous_uel8_799_200_006651751_0	907,946	412,213	0.4540
25 Aug 2010 04:37:04	1077167	11509591	famous_uel8_799_200_006651751_0	898,586	407,888	0.4539
25 Aug 2010 03:20:13	1077167	11509591	famous_uel8_799_200_006651751_0	889,226	403,481	0.4537
25 Aug 2010 01:02:01	1077167	11509591	famous_uel8_799_200_006651751_0	879,866	399,139	0.4536
25 Aug 2010 01:02:01	1077167	11509591	famous_uel8_799_200_006651751_0	870,506	394,793	0.4535
24 Aug 2010 21:51:07	1077167	11509591	famous_uel8_799_200_006651751_0	861,146	390,634	0.4536
24 Aug 2010 20:30:35	1077167	11509591	famous_uel8_799_200_006651751_0	851,786	386,193	0.4534
24 Aug 2010 19:04:34	1077167	11509591	famous_uel8_799_200_006651751_0	842,426	381,927	0.4534
24 Aug 2010 17:31:19	1077167	11509591	famous_uel8_799_200_006651751_0	833,066	377,533	0.4532
24 Aug 2010 16:17:02	1077167	11509591	famous_uel8_799_200_006651751_0	823,706	373,290	0.4532
24 Aug 2010 15:03:08	1077167	11509591	famous_uel8_799_200_006651751_0	814,346	369,041	0.4532
24 Aug 2010 13:48:36	1077167	11509591	famous_uel8_799_200_006651751_0	804,986	364,759	0.4531
24 Aug 2010 12:09:25	1077167	11509591	famous_uel8_799_200_006651751_0	795,626	360,388	0.4530
24 Aug 2010 10:19:56	1077167	11509591	famous_uel8_799_200_006651751_0	786,266	356,168	0.4530
24 Aug 2010 09:05:20	1077167	11509591	famous_uel8_799_200_006651751_0	776,906	351,946	0.4530