Task 13677555

Name	hadcm3n_o61c_1940_40_007548109_0
Workunit	7745341
Created	30 Nov 2011, 20:18:26 UTC
Sent	30 Nov 2011, 20:23:49 UTC
Report deadline	1 Mar 2012, 3:51:00 UTC
Received	18 Mar 2012, 22:16:35 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	1039191
Run time	49 days 7 hours 12 min 41 sec
CPU time	47 days 10 hours 52 min 39 sec
Validate state	Invalid
Credit	11,819.52
Device peak FLOPS	1.61 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>6.10.18</core_client_version> <![CDATA[ <message> The device does not recognize the command. (0x16) - exit code 22 (0x16) </message> <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... 21:57:38 (4788): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3428, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3428, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3428, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3428, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3428, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3428, iMonCtr=1 Model crash detected, will try to restart... Sorry, too many model crashes! :-( Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
17 Mar 2012 17:24:11	1039191	13677555	hadcm3n_o61c_1940_40_007548109_0	984,960	4,018,996	4.0804
16 Mar 2012 08:44:53	1039191	13677555	hadcm3n_o61c_1940_40_007548109_0	959,040	3,921,091	4.0886
15 Feb 2012 11:04:00	1039191	13677555	hadcm3n_o61c_1940_40_007548109_0	933,120	3,807,085	4.0800
12 Feb 2012 08:38:34	1039191	13677555	hadcm3n_o61c_1940_40_007548109_0	907,200	3,681,496	4.0581
09 Feb 2012 02:29:00	1039191	13677555	hadcm3n_o61c_1940_40_007548109_0	881,280	3,558,056	4.0374
08 Feb 2012 03:52:14	1039191	13677555	hadcm3n_o61c_1940_40_007548109_0	855,360	3,482,871	4.0718
07 Feb 2012 08:25:54	1039191	13677555	hadcm3n_o61c_1940_40_007548109_0	829,440	3,413,240	4.1151
06 Feb 2012 13:01:09	1039191	13677555	hadcm3n_o61c_1940_40_007548109_0	803,520	3,343,539	4.1611
05 Feb 2012 17:39:09	1039191	13677555	hadcm3n_o61c_1940_40_007548109_0	777,600	3,273,799	4.2101
04 Feb 2012 22:08:32	1039191	13677555	hadcm3n_o61c_1940_40_007548109_0	751,680	3,203,991	4.2624
04 Feb 2012 02:55:13	1039191	13677555	hadcm3n_o61c_1940_40_007548109_0	725,760	3,134,421	4.3188
03 Feb 2012 06:04:44	1039191	13677555	hadcm3n_o61c_1940_40_007548109_0	699,840	3,057,637	4.3691
02 Feb 2012 08:11:17	1039191	13677555	hadcm3n_o61c_1940_40_007548109_0	673,920	2,980,716	4.4230
01 Feb 2012 10:31:52	1039191	13677555	hadcm3n_o61c_1940_40_007548109_0	648,000	2,903,706	4.4810
31 Jan 2012 14:16:21	1039191	13677555	hadcm3n_o61c_1940_40_007548109_0	622,080	2,826,619	4.5438
30 Jan 2012 12:22:08	1039191	13677555	hadcm3n_o61c_1940_40_007548109_0	596,160	2,739,353	4.5950
29 Jan 2012 07:06:32	1039191	13677555	hadcm3n_o61c_1940_40_007548109_0	570,240	2,637,644	4.6255
27 Jan 2012 20:15:06	1039191	13677555	hadcm3n_o61c_1940_40_007548109_0	544,320	2,518,035	4.6260
26 Jan 2012 08:52:03	1039191	13677555	hadcm3n_o61c_1940_40_007548109_0	518,400	2,399,993	4.6296
24 Jan 2012 19:19:04	1039191	13677555	hadcm3n_o61c_1940_40_007548109_0	492,480	2,271,292	4.6119