Task 11571252

Name	famous_uo3n_999_200_006664078_3
Workunit	6867450
Created	10 Jun 2010, 15:33:50 UTC
Sent	2 Jul 2010, 23:01:34 UTC
Report deadline	2 Oct 2010, 6:28:45 UTC
Received	3 Jul 2010, 23:38:36 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	1134514
Run time	4 hours 35 min 41 sec
CPU time	2 hours 30 min 22 sec
Validate state	Invalid
Credit	61.85
Device peak FLOPS	2.67 GFLOPS
Application version	UK Met Office FAMOUS v6.11 windows_intelx86
Stderr	<core_client_version>6.10.18</core_client_version> <![CDATA[ <message> The device does not recognize the command. (0x16) - exit code 22 (0x16) </message> <stderr_txt> 17:17:49 (3904): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:19:34 (1792): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:20:45 (5080): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:26:06 (3568): No heartbeat from core client for 30 sec - exiting 17:26:07 (3568): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:27:28 (2488): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:29:00 (2636): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:29:01 (2636): No heartbeat from core client for 30 sec - exiting 17:31:45 (4804): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:33:00 (3900): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:36:57 (4108): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:44:41 (2072): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:45:54 (3152): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:46:37 (4364): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:47:46 (2036): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:50:29 (1240): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:53:30 (2472): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:55:13 (3888): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:56:48 (4872): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:58:38 (2116): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:00:57 (3236): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:04:51 (1492): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:04:52 (1492): No heartbeat from core client for 30 sec - exiting 18:04:53 (1492): No heartbeat from core client for 30 sec - exiting 18:04:54 (1492): No heartbeat from core client for 30 sec - exiting 18:04:55 (1492): No heartbeat from core client for 30 sec - exiting 18:04:56 (1492): No heartbeat from core client for 30 sec - exiting 18:04:57 (1492): No heartbeat from core client for 30 sec - exiting 18:04:59 (1492): No heartbeat from core client for 30 sec - exiting 18:05:00 (1492): No heartbeat from core client for 30 sec - exiting 18:05:01 (1492): No heartbeat from core client for 30 sec - exiting 18:05:02 (1492): No heartbeat from core client for 30 sec - exiting 18:05:46 (4156): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:07:33 (4944): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:08:29 (2820): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:13:33 (2704): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:15:19 (680): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:18:32 (1044): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:20:05 (4264): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:23:36 (4396): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:26:30 (4592): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:27:52 (4608): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:35:42 (1960): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:35:43 (1960): No heartbeat from core client for 30 sec - exiting 18:35:44 (1960): No heartbeat from core client for 30 sec - exiting 18:35:45 (1960): No heartbeat from core client for 30 sec - exiting 18:35:46 (1960): No heartbeat from core client for 30 sec - exiting 18:35:47 (1960): No heartbeat from core client for 30 sec - exiting 18:35:48 (1960): No heartbeat from core client for 30 sec - exiting 18:35:50 (1960): No heartbeat from core client for 30 sec - exiting 18:35:51 (1960): No heartbeat from core client for 30 sec - exiting 18:35:52 (1960): No heartbeat from core client for 30 sec - exiting 18:35:53 (1960): No heartbeat from core client for 30 sec - exiting 18:38:25 (3440): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:41:04 (1844): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:41:43 (1252): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:42:51 (3324): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:45:39 (5008): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:47:55 (4436): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:48:53 (1672): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:50:24 (4864): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:50:25 (4864): No heartbeat from core client for 30 sec - exiting 18:50:26 (4864): No heartbeat from core client for 30 sec - exiting 18:50:27 (4864): No heartbeat from core client for 30 sec - exiting 18:50:28 (4864): No heartbeat from core client for 30 sec - exiting 18:50:29 (4864): No heartbeat from core client for 30 sec - exiting 18:50:30 (4864): No heartbeat from core client for 30 sec - exiting 18:50:31 (4864): No heartbeat from core client for 30 sec - exiting 18:50:33 (4864): No heartbeat from core client for 30 sec - exiting 18:50:34 (4864): No heartbeat from core client for 30 sec - exiting 18:50:35 (4864): No heartbeat from core client for 30 sec - exiting 18:52:03 (3572): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:54:21 (5060): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:01:26 (4172): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:02:27 (4148): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:05:17 (4728): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:06:38 (4132): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:08:59 (2468): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:09:49 (1532): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:12:40 (4536): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:12:41 (4536): No heartbeat from core client for 30 sec - exiting 19:12:43 (4536): No heartbeat from core client for 30 sec - exiting 19:12:44 (4536): No heartbeat from core client for 30 sec - exiting 19:12:45 (4536): No heartbeat from core client for 30 sec - exiting 19:12:46 (4536): No heartbeat from core client for 30 sec - exiting 19:12:47 (4536): No heartbeat from core client for 30 sec - exiting 19:12:48 (4536): No heartbeat from core client for 30 sec - exiting 19:12:49 (4536): No heartbeat from core client for 30 sec - exiting 19:12:50 (4536): No heartbeat from core client for 30 sec - exiting 19:12:51 (4536): No heartbeat from core client for 30 sec - exiting 19:15:21 (3156): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:15:22 (3156): No heartbeat from core client for 30 sec - exiting 19:15:23 (3156): No heartbeat from core client for 30 sec - exiting 19:15:24 (3156): No heartbeat from core client for 30 sec - exiting 19:15:25 (3156): No heartbeat from core client for 30 sec - exiting 19:15:26 (3156): No heartbeat from core client for 30 sec - exiting 19:15:27 (3156): No heartbeat from core client for 30 sec - exiting 19:15:28 (3156): No heartbeat from core client for 30 sec - exiting 19:15:29 (3156): No heartbeat from core client for 30 sec - exiting 19:15:30 (3156): No heartbeat from core client for 30 sec - exiting 19:15:32 (3156): No heartbeat from core client for 30 sec - exiting 19:20:12 (4780): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:22:30 (676): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:23:46 (4040): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:26:11 (5112): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:27:53 (4976): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:29:35 (1240): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:30:19 (3708): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:31:25 (3192): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:32:31 (4000): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:33:40 (4208): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:37:09 (4704): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:38:46 (1720): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:41:56 (3112): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:44:10 (1480): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:44:11 (1480): No heartbeat from core client for 30 sec - exiting 19:44:12 (1480): No heartbeat from core client for 30 sec - exiting 19:44:13 (1480): No heartbeat from core client for 30 sec - exiting 19:44:14 (1480): No heartbeat from core client for 30 sec - exiting 19:44:15 (1480): No heartbeat from core client for 30 sec - exiting 19:44:16 (1480): No heartbeat from core client for 30 sec - exiting 19:44:17 (1480): No heartbeat from core client for 30 sec - exiting 19:44:19 (1480): No heartbeat from core client for 30 sec - exiting 19:44:20 (1480): No heartbeat from core client for 30 sec - exiting 19:44:21 (1480): No heartbeat from core client for 30 sec - exiting 19:49:37 (1176): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:52:32 (2588): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:57:49 (4368): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:59:13 (3560): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:01:36 (4352): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:03:51 (3804): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:16:09 (1216): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:16:53 (404): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:24:09 (2080): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:26:26 (5036): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:46:23 (4492): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:37:00 (4460): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:01:43 (3456): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:32:31 (4164): No heartbeat from core client for 30 sec - exiting 22:33:32 (4164): No heartbeat from core client for 30 sec - exiting 22:33:33 (4164): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... 22:57:41 (4660): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:58:56 (2700): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:03:28 (3196): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:06:13 (4732): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:21:41 (4960): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:21:42 (4960): No heartbeat from core client for 30 sec - exiting 23:21:43 (4960): No heartbeat from core client for 30 sec - exiting 23:21:44 (4960): No heartbeat from core client for 30 sec - exiting 23:21:45 (4960): No heartbeat from core client for 30 sec - exiting 23:21:46 (4960): No heartbeat from core client for 30 sec - exiting 23:21:47 (4960): No heartbeat from core client for 30 sec - exiting cpdnmonitor: cannot open input file C:\ProgramData\BOINC/projects/climateprediction.net/famous_uo3n_999_200_006664078/dataout/ocean_restart.day after 11 attempts Model crashed: READ_FLH: I/O error tmp/pipe_dummy cpdnmonitor: cannot open input file C:\ProgramData\BOINC/projects/climateprediction.net/famous_uo3n_999_200_006664078/dataout/ocean_restart.day after 11 attempts Model crashed: READ_FLH: I/O error tmp/pipe_dummy cpdnmonitor: cannot open input file C:\ProgramData\BOINC/projects/climateprediction.net/famous_uo3n_999_200_006664078/dataout/ocean_restart.day after 11 attempts Model crashed: READ_FLH: I/O error tmp/pipe_dummy cpdnmonitor: cannot open input file C:\ProgramData\BOINC/projects/climateprediction.net/famous_uo3n_999_200_006664078/dataout/ocean_restart.day after 11 attempts Model crashed: READ_FLH: I/O error tmp/pipe_dummy cpdnmonitor: cannot open input file C:\ProgramData\BOINC/projects/climateprediction.net/famous_uo3n_999_200_006664078/dataout/ocean_restart.day after 11 attempts Model crashed: READ_FLH: I/O error tmp/pipe_dummy cpdnmonitor: cannot open input file C:\ProgramData\BOINC/projects/climateprediction.net/famous_uo3n_999_200_006664078/dataout/ocean_restart.day after 11 attempts Model crashed: READ_FLH: I/O error tmp/pipe_dummy Sorry, too many model crashes! :-( 23:22:57 (3684): called boinc_finish 23:22:57 (3684): No heartbeat from core client for 30 sec - exiting </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
03 Jul 2010 23:40:57	1048971	11571252	famous_uo3n_999_200_006664078_3	18,746	7,304	0.3896
03 Jul 2010 23:40:57	1048971	11571252	famous_uo3n_999_200_006664078_3	9,386	3,900	0.4155