Task 15596189

Name	hadcm3n_49lh_1940_40_008308867_1
Workunit	8460002
Created	7 Feb 2013, 20:09:01 UTC
Sent	7 Feb 2013, 20:19:49 UTC
Report deadline	10 May 2013, 3:47:00 UTC
Received	12 Feb 2013, 14:57:37 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	1260264
Run time	1 days 6 hours 56 min 10 sec
CPU time	23 hours 52 min 4 sec
Validate state	Invalid
Credit	311.04
Device peak FLOPS	2.56 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>7.0.28</core_client_version> <![CDATA[ <message> The device does not recognize the command. (0x16) - exit code 22 (0x16) </message> <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=192, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=8268, iMonCtr=1 Model crash detected, will try to restart... 20:10:32 (5752): No heartbeat from core client for 30 sec - exiting 20:10:34 (5752): No heartbeat from core client for 30 sec - exiting 20:10:35 (5752): No heartbeat from core client for 30 sec - exiting 20:10:36 (5752): No heartbeat from core client for 30 sec - exiting 20:10:37 (5752): No heartbeat from core client for 30 sec - exiting 20:10:38 (5752): No heartbeat from core client for 30 sec - exiting 20:10:39 (5752): No heartbeat from core client for 30 sec - exiting 20:10:40 (5752): No heartbeat from core client for 30 sec - exiting 20:10:41 (5752): No heartbeat from core client for 30 sec - exiting 20:10:42 (5752): No heartbeat from core client for 30 sec - exiting 20:10:43 (5752): No heartbeat from core client for 30 sec - exiting 20:10:44 (5752): No heartbeat from core client for 30 sec - exiting 20:10:45 (5752): No heartbeat from core client for 30 sec - exiting 20:10:46 (5752): No heartbeat from core client for 30 sec - exiting 20:10:47 (5752): No heartbeat from core client for 30 sec - exiting 20:10:48 (5752): No heartbeat from core client for 30 sec - exiting 20:10:49 (5752): No heartbeat from core client for 30 sec - exiting 20:10:50 (5752): No heartbeat from core client for 30 sec - exiting 20:10:51 (5752): No heartbeat from core client for 30 sec - exiting 20:10:52 (5752): No heartbeat from core client for 30 sec - exiting 20:10:53 (5752): No heartbeat from core client for 30 sec - exiting 20:10:54 (5752): No heartbeat from core client for 30 sec - exiting 20:10:55 (5752): No heartbeat from core client for 30 sec - exiting 20:10:56 (5752): No heartbeat from core client for 30 sec - exiting 20:10:57 (5752): No heartbeat from core client for 30 sec - exiting 20:10:58 (5752): No heartbeat from core client for 30 sec - exiting 20:10:59 (5752): No heartbeat from core client for 30 sec - exiting 20:11:00 (5752): No heartbeat from core client for 30 sec - exiting 20:11:01 (5752): No heartbeat from core client for 30 sec - exiting 20:11:02 (5752): No heartbeat from core client for 30 sec - exiting 20:11:03 (5752): No heartbeat from core client for 30 sec - exiting 20:11:04 (5752): No heartbeat from core client for 30 sec - exiting 20:11:05 (5752): No heartbeat from core client for 30 sec - exiting 20:11:06 (5752): No heartbeat from core client for 30 sec - exiting 20:11:07 (5752): No heartbeat from core client for 30 sec - exiting 20:11:08 (5752): No heartbeat from core client for 30 sec - exiting 20:11:09 (5752): No heartbeat from core client for 30 sec - exiting 20:11:10 (5752): No heartbeat from core client for 30 sec - exiting 20:11:11 (5752): No heartbeat from core client for 30 sec - exiting 20:11:12 (5752): No heartbeat from core client for 30 sec - exiting 20:11:13 (5752): No heartbeat from core client for 30 sec - exiting 20:11:14 (5752): No heartbeat from core client for 30 sec - exiting 20:11:15 (5752): No heartbeat from core client for 30 sec - exiting 20:11:16 (5752): No heartbeat from core client for 30 sec - exiting 20:11:17 (5752): No heartbeat from core client for 30 sec - exiting 20:11:18 (5752): No heartbeat from core client for 30 sec - exiting 20:11:19 (5752): No heartbeat from core client for 30 sec - exiting 20:11:20 (5752): No heartbeat from core client for 30 sec - exiting 20:11:21 (5752): No heartbeat from core client for 30 sec - exiting 20:11:22 (5752): No heartbeat from core client for 30 sec - exiting 20:11:23 (5752): No heartbeat from core client for 30 sec - exiting 20:11:24 (5752): No heartbeat from core client for 30 sec - exiting 20:11:25 (5752): No heartbeat from core client for 30 sec - exiting 20:11:26 (5752): No heartbeat from core client for 30 sec - exiting 20:11:27 (5752): No heartbeat from core client for 30 sec - exiting 20:11:28 (5752): No heartbeat from core client for 30 sec - exiting 20:11:29 (5752): No heartbeat from core client for 30 sec - exiting 20:11:30 (5752): No heartbeat from core client for 30 sec - exiting 20:11:31 (5752): No heartbeat from core client for 30 sec - exiting 20:11:32 (5752): No heartbeat from core client for 30 sec - exiting 20:11:33 (5752): No heartbeat from core client for 30 sec - exiting 20:11:34 (5752): No heartbeat from core client for 30 sec - exiting 20:11:35 (5752): No heartbeat from core client for 30 sec - exiting 20:11:36 (5752): No heartbeat from core client for 30 sec - exiting 20:11:37 (5752): No heartbeat from core client for 30 sec - exiting 20:11:38 (5752): No heartbeat from core client for 30 sec - exiting 20:11:39 (5752): No heartbeat from core client for 30 sec - exiting 20:11:40 (5752): No heartbeat from core client for 30 sec - exiting 20:11:41 (5752): No heartbeat from core client for 30 sec - exiting 20:11:42 (5752): No heartbeat from core client for 30 sec - exiting 20:11:43 (5752): No heartbeat from core client for 30 sec - exiting 20:11:44 (5752): No heartbeat from core client for 30 sec - exiting 20:11:45 (5752): No heartbeat from core client for 30 sec - exiting 20:11:46 (5752): No heartbeat from core client for 30 sec - exiting 20:11:47 (5752): No heartbeat from core client for 30 sec - exiting 20:11:48 (5752): No heartbeat from core client for 30 sec - exiting 20:11:49 (5752): No heartbeat from core client for 30 sec - exiting 20:11:50 (5752): No heartbeat from core client for 30 sec - exiting 20:11:51 (5752): No heartbeat from core client for 30 sec - exiting 20:11:52 (5752): No heartbeat from core client for 30 sec - exiting 20:11:53 (5752): No heartbeat from core client for 30 sec - exiting 20:11:54 (5752): No heartbeat from core client for 30 sec - exiting 20:11:55 (5752): No heartbeat from core client for 30 sec - exiting 20:11:56 (5752): No heartbeat from core client for 30 sec - exiting 20:11:57 (5752): No heartbeat from core client for 30 sec - exiting 20:11:58 (5752): No heartbeat from core client for 30 sec - exiting 20:11:59 (5752): No heartbeat from core client for 30 sec - exiting 20:12:00 (5752): No heartbeat from core client for 30 sec - exiting 20:12:01 (5752): No heartbeat from core client for 30 sec - exiting 20:12:02 (5752): No heartbeat from core client for 30 sec - exiting 20:12:03 (5752): No heartbeat from core client for 30 sec - exiting 20:12:04 (5752): No heartbeat from core client for 30 sec - exiting 20:12:05 (5752): No heartbeat from core client for 30 sec - exiting 20:12:06 (5752): No heartbeat from core client for 30 sec - exiting 20:12:07 (5752): No heartbeat from core client for 30 sec - exiting 20:12:08 (5752): No heartbeat from core client for 30 sec - exiting 20:12:09 (5752): No heartbeat from core client for 30 sec - exiting 20:12:10 (5752): No heartbeat from core client for 30 sec - exiting 20:12:11 (5752): No heartbeat from core client for 30 sec - exiting 20:12:12 (5752): No heartbeat from core client for 30 sec - exiting 20:12:13 (5752): No heartbeat from core client for 30 sec - exiting 20:12:14 (5752): No heartbeat from core client for 30 sec - exiting 20:12:15 (5752): No heartbeat from core client for 30 sec - exiting 20:12:16 (5752): No heartbeat from core client for 30 sec - exiting 20:12:17 (5752): No heartbeat from core client for 30 sec - exiting 20:12:18 (5752): No heartbeat from core client for 30 sec - exiting 20:12:19 (5752): No heartbeat from core client for 30 sec - exiting 20:12:20 (5752): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
10 Feb 2013 07:41:40	1260264	15596189	hadcm3n_49lh_1940_40_008308867_1	25,920	54,365	2.0974