Task 11957996

Name	famous_v31u_1999_200_006738957_1
Workunit	6942301
Created	31 Oct 2010, 11:32:16 UTC
Sent	31 Oct 2010, 11:35:06 UTC
Report deadline	30 Jan 2011, 19:02:17 UTC
Received	7 Nov 2010, 4:29:39 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	986959
Run time
CPU time	1 days 3 hours 9 min 22 sec
Validate state	Invalid
Credit	803.01
Device peak FLOPS	2.45 GFLOPS
Application version	UK Met Office FAMOUS v6.11 windows_intelx86
Stderr	<core_client_version>5.8.15</core_client_version> <![CDATA[ <message> The device does not recognize the command. (0x16) - exit code 22 (0x16) </message> <stderr_txt> 01:12:17 (6492): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:12:20 (6492): No heartbeat from core client for 30 sec - exiting 01:12:21 (6492): No heartbeat from core client for 30 sec - exiting 01:12:22 (6492): No heartbeat from core client for 30 sec - exiting 01:12:23 (6492): No heartbeat from core client for 30 sec - exiting 01:12:24 (6492): No heartbeat from core client for 30 sec - exiting 01:12:25 (6492): No heartbeat from core client for 30 sec - exiting 01:12:26 (6492): No heartbeat from core client for 30 sec - exiting 01:12:27 (6492): No heartbeat from core client for 30 sec - exiting 01:12:28 (6492): No heartbeat from core client for 30 sec - exiting 01:12:29 (6492): No heartbeat from core client for 30 sec - exiting 01:15:33 (6312): No heartbeat from core client for 30 sec - exiting 01:15:34 (6312): No heartbeat from core client for 30 sec - exiting 01:15:35 (6312): No heartbeat from core client for 30 sec - exiting 01:15:36 (6312): No heartbeat from core client for 30 sec - exiting 01:15:37 (6312): No heartbeat from core client for 30 sec - exiting 01:15:38 (6312): No heartbeat from core client for 30 sec - exiting 01:15:39 (6312): No heartbeat from core client for 30 sec - exiting 01:15:40 (6312): No heartbeat from core client for 30 sec - exiting 01:15:41 (6312): No heartbeat from core client for 30 sec - exiting 01:15:42 (6312): No heartbeat from core client for 30 sec - exiting 01:15:43 (6312): No heartbeat from core client for 30 sec - exiting 01:15:44 (6312): No heartbeat from core client for 30 sec - exiting 01:15:45 (6312): No heartbeat from core client for 30 sec - exiting 01:15:46 (6312): No heartbeat from core client for 30 sec - exiting 01:15:47 (6312): No heartbeat from core client for 30 sec - exiting 01:15:48 (6312): No heartbeat from core client for 30 sec - exiting 01:15:49 (6312): No heartbeat from core client for 30 sec - exiting 01:15:50 (6312): No heartbeat from core client for 30 sec - exiting 01:15:52 (6312): No heartbeat from core client for 30 sec - exiting 01:15:53 (6312): No heartbeat from core client for 30 sec - exiting 01:15:55 (6312): No heartbeat from core client for 30 sec - exiting 01:15:56 (6312): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:30:35 (6764): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:02:38 (6148): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:24:16 (4944): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:54:24 (4272): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:29:59 (4880): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:31:32 (5680): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:31:35 (5680): No heartbeat from core client for 30 sec - exiting 12:51:10 (7096): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:53:29 (736): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:16:19 (1960): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:28:51 (7804): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 60 - Return code = 16 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 61 - Return code = 16 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 14:31:45 (5712): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:31:47 (5712): No heartbeat from core client for 30 sec - exiting 16:17:19 (4752): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:19:38 (1724): No heartbeat from core client for 30 sec - exiting 17:19:39 (1724): No heartbeat from core client for 30 sec - exiting 17:19:40 (1724): No heartbeat from core client for 30 sec - exiting 17:19:41 (1724): No heartbeat from core client for 30 sec - exiting 17:19:42 (1724): No heartbeat from core client for 30 sec - exiting 17:19:43 (1724): No heartbeat from core client for 30 sec - exiting 17:19:44 (1724): No heartbeat from core client for 30 sec - exiting 17:19:45 (1724): No heartbeat from core client for 30 sec - exiting 17:19:46 (1724): No heartbeat from core client for 30 sec - exiting 17:19:47 (1724): No heartbeat from core client for 30 sec - exiting 17:19:49 (1724): No heartbeat from core client for 30 sec - exiting 17:19:50 (1724): No heartbeat from core client for 30 sec - exiting 17:19:51 (1724): No heartbeat from core client for 30 sec - exiting 17:19:52 (1724): No heartbeat from core client for 30 sec - exiting 17:19:53 (1724): No heartbeat from core client for 30 sec - exiting 17:19:54 (1724): No heartbeat from core client for 30 sec - exiting 17:19:55 (1724): No heartbeat from core client for 30 sec - exiting 17:19:56 (1724): No heartbeat from core client for 30 sec - exiting 17:19:57 (1724): No heartbeat from core client for 30 sec - exiting 17:19:58 (1724): No heartbeat from core client for 30 sec - exiting 17:19:59 (1724): No heartbeat from core client for 30 sec - exiting 17:20:00 (1724): No heartbeat from core client for 30 sec - exiting 17:20:01 (1724): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 60 - Return code = 16 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 61 - Return code = 16 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 18:38:08 (7604): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:01:54 (7736): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 60 - Return code = 16 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 61 - Return code = 16 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 23:24:11 (6436): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:36:49 (3656): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:24:15 (6688): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:56:31 (2912): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:59:40 (4652): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:59:42 (4652): No heartbeat from core client for 30 sec - exiting 06:18:33 (2800): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 60 - Return code = 16 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 61 - Return code = 16 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 07:48:02 (5520): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:17:41 (5464): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:38:34 (5932): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 60 - Return code = 16 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 61 - Return code = 16 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 10:40:35 (8108): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:42:38 (5032): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:45:01 (604): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:49:48 (7284): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:32:33 (2740): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:43:57 (5992): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 01:34:21 (4052): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:39:57 (7696): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 05:49:51 (6960): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:55:36 (2804): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 05:07:12 (12852): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:07:16 (12852): No heartbeat from core client for 30 sec - exiting 05:08:16 (14748): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:14:24 (6712): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:14:25 (6712): No heartbeat from core client for 30 sec - exiting 05:14:26 (6712): No heartbeat from core client for 30 sec - exiting 05:14:28 (6712): No heartbeat from core client for 30 sec - exiting 05:14:29 (6712): No heartbeat from core client for 30 sec - exiting 05:14:30 (6712): No heartbeat from core client for 30 sec - exiting 05:14:31 (6712): No heartbeat from core client for 30 sec - exiting 05:14:32 (6712): No heartbeat from core client for 30 sec - exiting 05:14:33 (6712): No heartbeat from core client for 30 sec - exiting 05:14:35 (6712): No heartbeat from core client for 30 sec - exiting 05:14:36 (6712): No heartbeat from core client for 30 sec - exiting 05:23:11 (7708): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:27:06 (13456): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:27:08 (13456): No heartbeat from core client for 30 sec - exiting 05:27:09 (13456): No heartbeat from core client for 30 sec - exiting 05:27:10 (13456): No heartbeat from core client for 30 sec - exiting 05:43:10 (13224): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:43:13 (13224): No heartbeat from core client for 30 sec - exiting 06:02:07 (28156): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:14:42 (12420): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:16:25 (16612): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:25:38 (27012): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:05:56 (9520): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:06:01 (9520): No heartbeat from core client for 30 sec - exiting 07:06:02 (9520): No heartbeat from core client for 30 sec - exiting 07:06:03 (9520): No heartbeat from core client for 30 sec - exiting 07:06:04 (9520): No heartbeat from core client for 30 sec - exiting 07:06:05 (9520): No heartbeat from core client for 30 sec - exiting 07:06:09 (9520): No heartbeat from core client for 30 sec - exiting 08:37:25 (19336): No heartbeat from core client for 30 sec - exiting 08:37:26 (19336): No heartbeat from core client for 30 sec - exiting 08:37:27 (19336): No heartbeat from core client for 30 sec - exiting 08:37:28 (19336): No heartbeat from core client for 30 sec - exiting 08:37:29 (19336): No heartbeat from core client for 30 sec - exiting 08:37:30 (19336): No heartbeat from core client for 30 sec - exiting 08:37:31 (19336): No heartbeat from core client for 30 sec - exiting 08:37:32 (19336): No heartbeat from core client for 30 sec - exiting 08:38:39 (19336): No heartbeat from core client for 30 sec - exiting 08:38:40 (19336): No heartbeat from core client for 30 sec - exiting 08:38:41 (19336): No heartbeat from core client for 30 sec - exiting 08:38:42 (19336): No heartbeat from core client for 30 sec - exiting 08:38:43 (19336): No heartbeat from core client for 30 sec - exiting 08:38:45 (19336): No heartbeat from core client for 30 sec - exiting 08:38:46 (19336): No heartbeat from core client for 30 sec - exiting 08:38:47 (19336): No heartbeat from core client for 30 sec - exiting 08:38:48 (19336): No heartbeat from core client for 30 sec - exiting 08:38:49 (19336): No heartbeat from core client for 30 sec - exiting 08:38:50 (19336): No heartbeat from core client for 30 sec - exiting 08:38:51 (19336): No heartbeat from core client for 30 sec - exiting 08:38:52 (19336): No heartbeat from core client for 30 sec - exiting 08:38:53 (19336): No heartbeat from core client for 30 sec - exiting 08:38:54 (19336): No heartbeat from core client for 30 sec - exiting 08:38:56 (19336): No heartbeat from core client for 30 sec - exiting 08:38:57 (19336): No heartbeat from core client for 30 sec - exiting 08:38:58 (19336): No heartbeat from core client for 30 sec - exiting 08:38:59 (19336): No heartbeat from core client for 30 sec - exiting 08:39:00 (19336): No heartbeat from core client for 30 sec - exiting 08:39:01 (19336): No heartbeat from core client for 30 sec - exiting 08:39:02 (19336): No heartbeat from core client for 30 sec - exiting 08:39:03 (19336): No heartbeat from core client for 30 sec - exiting 08:39:04 (19336): No heartbeat from core client for 30 sec - exiting 08:39:05 (19336): No heartbeat from core client for 30 sec - exiting 08:39:07 (19336): No heartbeat from core client for 30 sec - exiting 08:39:08 (19336): No heartbeat from core client for 30 sec - exiting 08:39:09 (19336): No heartbeat from core client for 30 sec - exiting 08:39:10 (19336): No heartbeat from core client for 30 sec - exiting 08:39:11 (19336): No heartbeat from core client for 30 sec - exiting 08:39:12 (19336): No heartbeat from core client for 30 sec - exiting 08:43:39 (19336): No heartbeat from core client for 30 sec - exiting 08:43:40 (19336): No heartbeat from core client for 30 sec - exiting 08:43:42 (19336): No heartbeat from core client for 30 sec - exiting 08:43:43 (19336): No heartbeat from core client for 30 sec - exiting 08:43:44 (19336): No heartbeat from core client for 30 sec - exiting 08:43:45 (19336): No heartbeat from core client for 30 sec - exiting 08:43:46 (19336): No heartbeat from core client for 30 sec - exiting 08:43:47 (19336): No heartbeat from core client for 30 sec - exiting 08:43:48 (19336): No heartbeat from core client for 30 sec - exiting 08:43:49 (19336): No heartbeat from core client for 30 sec - exiting 08:43:51 (19336): No heartbeat from core client for 30 sec - exiting 08:43:52 (19336): No heartbeat from core client for 30 sec - exiting 08:43:54 (19336): No heartbeat from core client for 30 sec - exiting 08:43:55 (19336): No heartbeat from core client for 30 sec - exiting 08:43:56 (19336): No heartbeat from core client for 30 sec - exiting 08:43:57 (19336): No heartbeat from core client for 30 sec - exiting 08:43:58 (19336): No heartbeat from core client for 30 sec - exiting 08:43:59 (19336): No heartbeat from core client for 30 sec - exiting 08:44:00 (19336): No heartbeat from core client for 30 sec - exiting 08:44:01 (19336): No heartbeat from core client for 30 sec - exiting 08:44:02 (19336): No heartbeat from core client for 30 sec - exiting 08:44:03 (19336): No heartbeat from core client for 30 sec - exiting 08:44:04 (19336): No heartbeat from core client for 30 sec - exiting 08:44:05 (19336): No heartbeat from core client for 30 sec - exiting 08:44:06 (19336): No heartbeat from core client for 30 sec - exiting 08:44:07 (19336): No heartbeat from core client for 30 sec - exiting 08:44:09 (19336): No heartbeat from core client for 30 sec - exiting 08:44:10 (19336): No heartbeat from core client for 30 sec - exiting 08:44:11 (19336): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:44:12 (19336): No heartbeat from core client for 30 sec - exiting Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... 08:47:35 (17448): No heartbeat from core client for 30 sec - exiting 08:47:36 (17448): No heartbeat from core client for 30 sec - exiting 08:47:37 (17448): No heartbeat from core client for 30 sec - exiting 08:47:38 (17448): No heartbeat from core client for 30 sec - exiting 08:47:39 (17448): No heartbeat from core client for 30 sec - exiting 08:47:40 (17448): No heartbeat from core client for 30 sec - exiting 08:47:41 (17448): No heartbeat from core client for 30 sec - exiting 08:47:43 (17448): No heartbeat from core client for 30 sec - exiting 08:47:44 (17448): No heartbeat from core client for 30 sec - exiting 08:47:45 (17448): No heartbeat from core client for 30 sec - exiting 08:47:47 (17448): No heartbeat from core client for 30 sec - exiting 08:47:48 (17448): No heartbeat from core client for 30 sec - exiting 08:47:49 (17448): No heartbeat from core client for 30 sec - exiting 08:47:51 (17448): No heartbeat from core client for 30 sec - exiting 08:47:53 (17448): No heartbeat from core client for 30 sec - exiting 08:47:54 (17448): No heartbeat from core client for 30 sec - exiting 08:47:55 (17448): No heartbeat from core client for 30 sec - exiting 08:47:56 (17448): No heartbeat from core client for 30 sec - exiting 08:47:58 (17448): No heartbeat from core client for 30 sec - exiting 08:47:59 (17448): No heartbeat from core client for 30 sec - exiting 08:48:00 (17448): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:06:32 (10044): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:06:35 (10044): No heartbeat from core client for 30 sec - exiting 09:06:36 (10044): No heartbeat from core client for 30 sec - exiting 09:06:37 (10044): No heartbeat from core client for 30 sec - exiting cpdnmonitor: cannot open input file C:\Program Files\BOINC/projects/climateprediction.net/famous_v31u_1999_200_006738957/dataout/ocean_restart.day after 11 attempts Model crashed: READ_FLH: I/O error tmp/pipe_dummy cpdnmonitor: cannot open input file C:\Program Files\BOINC/projects/climateprediction.net/famous_v31u_1999_200_006738957/dataout/ocean_restart.day after 11 attempts 09:11:43 (14120): No heartbeat from core client for 30 sec - exiting 09:11:44 (14120): No heartbeat from core client for 30 sec - exiting 09:11:45 (14120): No heartbeat from core client for 30 sec - exiting 09:11:46 (14120): No heartbeat from core client for 30 sec - exiting 09:11:48 (14120): No heartbeat from core client for 30 sec - exiting 09:11:52 (14120): No heartbeat from core client for 30 sec - exiting 09:11:53 (14120): No heartbeat from core client for 30 sec - exiting 09:11:54 (14120): No heartbeat from core client for 30 sec - exiting 09:11:55 (14120): No heartbeat from core client for 30 sec - exiting 09:11:56 (14120): No heartbeat from core client for 30 sec - exiting 09:11:59 (14120): No heartbeat from core client for 30 sec - exiting 09:12:00 (14120): No heartbeat from core client for 30 sec - exiting 09:12:01 (14120): No heartbeat from core client for 30 sec - exiting 09:12:02 (14120): No heartbeat from core client for 30 sec - exiting 09:12:03 (14120): No heartbeat from core client for 30 sec - exiting 09:12:07 (14120): No heartbeat from core client for 30 sec - exiting 09:12:08 (14120): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:12:09 (14120): No heartbeat from core client for 30 sec - exiting 09:12:11 (14120): No heartbeat from core client for 30 sec - exiting cpdnmonitor: cannot open input file C:\Program Files\BOINC/projects/climateprediction.net/famous_v31u_1999_200_006738957/dataout/ocean_restart.day after 11 attempts 09:14:37 (20136): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:14:38 (20136): No heartbeat from core client for 30 sec - exiting cpdnmonitor: cannot open input file C:\Program Files\BOINC/projects/climateprediction.net/famous_v31u_1999_200_006738957/dataout/ocean_restart.day after 11 attempts Model crashed: READ_FLH: I/O error tmp/pipe_dummy cpdnmonitor: cannot open input file C:\Program Files\BOINC/projects/climateprediction.net/famous_v31u_1999_200_006738957/dataout/ocean_restart.day after 11 attempts 09:20:11 (21448): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:20:12 (21448): No heartbeat from core client for 30 sec - exiting cpdnmonitor: cannot open input file C:\Program Files\BOINC/projects/climateprediction.net/famous_v31u_1999_200_006738957/dataout/ocean_restart.day after 11 attempts Model crashed: READ_FLH: I/O error tmp/pipe_dummy cpdnmonitor: cannot open input file C:\Program Files\BOINC/projects/climateprediction.net/famous_v31u_1999_200_006738957/dataout/ocean_restart.day after 11 attempts Model crashed: READ_FLH: I/O error tmp/pipe_dummy cpdnmonitor: cannot open input file C:\Program Files\BOINC/projects/climateprediction.net/famous_v31u_1999_200_006738957/dataout/ocean_restart.day after 11 attempts Model crashed: READ_FLH: I/O error tmp/pipe_dummy cpdnmonitor: cannot open input file C:\Program Files\BOINC/projects/climateprediction.net/famous_v31u_1999_200_006738957/dataout/ocean_restart.day after 11 attempts Model crashed: READ_FLH: I/O error tmp/pipe_dummy Sorry, too many model crashes! :-( 09:34:45 (4200): called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
07 Nov 2010 04:34:03	986959	11957996	famous_v31u_1999_200_006738957_1	243,386	97,610	0.4011
06 Nov 2010 22:08:16	986959	11957996	famous_v31u_1999_200_006738957_1	234,026	93,721	0.4005
06 Nov 2010 21:06:17	986959	11957996	famous_v31u_1999_200_006738957_1	224,666	89,987	0.4005
06 Nov 2010 21:06:17	986959	11957996	famous_v31u_1999_200_006738957_1	215,306	86,317	0.4009
06 Nov 2010 21:06:17	986959	11957996	famous_v31u_1999_200_006738957_1	205,946	82,581	0.4010
06 Nov 2010 21:06:17	986959	11957996	famous_v31u_1999_200_006738957_1	196,586	78,847	0.4011
06 Nov 2010 21:06:17	986959	11957996	famous_v31u_1999_200_006738957_1	187,226	75,200	0.4017
06 Nov 2010 21:06:17	986959	11957996	famous_v31u_1999_200_006738957_1	177,866	71,484	0.4019
06 Nov 2010 21:06:17	986959	11957996	famous_v31u_1999_200_006738957_1	168,506	67,799	0.4024
06 Nov 2010 21:06:17	986959	11957996	famous_v31u_1999_200_006738957_1	159,146	64,166	0.4032
06 Nov 2010 21:06:17	986959	11957996	famous_v31u_1999_200_006738957_1	149,786	60,538	0.4042
06 Nov 2010 21:06:17	986959	11957996	famous_v31u_1999_200_006738957_1	140,426	56,883	0.4051
06 Nov 2010 21:06:17	986959	11957996	famous_v31u_1999_200_006738957_1	131,066	53,196	0.4059
01 Nov 2010 22:22:58	986959	11957996	famous_v31u_1999_200_006738957_1	121,706	49,595	0.4075
01 Nov 2010 18:00:54	986959	11957996	famous_v31u_1999_200_006738957_1	112,346	45,756	0.4073
01 Nov 2010 14:02:46	986959	11957996	famous_v31u_1999_200_006738957_1	102,986	41,846	0.4063
01 Nov 2010 09:23:02	986959	11957996	famous_v31u_1999_200_006738957_1	93,626	37,984	0.4057
01 Nov 2010 05:36:24	986959	11957996	famous_v31u_1999_200_006738957_1	84,266	34,284	0.4069
01 Nov 2010 04:35:51	986959	11957996	famous_v31u_1999_200_006738957_1	74,906	30,377	0.4055
01 Nov 2010 00:24:45	986959	11957996	famous_v31u_1999_200_006738957_1	65,546	26,430	0.4032