Task 15476152

Name	hadcm3n_zebf_1920_40_008255566_1
Workunit	8410690
Created	14 Dec 2012, 2:36:03 UTC
Sent	14 Dec 2012, 2:41:10 UTC
Report deadline	15 Mar 2013, 10:08:21 UTC
Received	11 Jan 2013, 4:49:26 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	995357
Run time	11 days 19 hours 35 min 22 sec
CPU time	11 days 13 hours 32 min 16 sec
Validate state	Invalid
Credit	9,331.20
Device peak FLOPS	2.88 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>6.10.60</core_client_version> <![CDATA[ <message> The device does not recognize the command. (0x16) - exit code 22 (0x16) </message> <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 14:36:38 (1584): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:44:15 (2568): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 20:49:12 (340): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Signal 11 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1928, iMonCtr=1 Model crash detected, will try to restart... Signal 11 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1928, iMonCtr=1 Model crash detected, will try to restart... Signal 11 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1928, iMonCtr=1 Model crash detected, will try to restart... Signal 11 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1928, iMonCtr=1 Model crash detected, will try to restart... Signal 11 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1928, iMonCtr=1 Model crash detected, will try to restart... Signal 11 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1928, iMonCtr=1 Model crash detected, will try to restart... Sorry, too many model crashes! :-( Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
10 Jan 2013 22:37:25	995357	15476152	hadcm3n_zebf_1920_40_008255566_1	777,600	1,007,687	1.2959
09 Jan 2013 22:26:42	995357	15476152	hadcm3n_zebf_1920_40_008255566_1	751,680	974,444	1.2964
09 Jan 2013 09:30:20	995357	15476152	hadcm3n_zebf_1920_40_008255566_1	725,760	941,428	1.2972
08 Jan 2013 10:02:16	995357	15476152	hadcm3n_zebf_1920_40_008255566_1	699,840	908,930	1.2988
07 Jan 2013 16:16:53	995357	15476152	hadcm3n_zebf_1920_40_008255566_1	673,920	876,068	1.3000
07 Jan 2013 04:40:11	995357	15476152	hadcm3n_zebf_1920_40_008255566_1	648,000	842,374	1.3000
06 Jan 2013 10:26:30	995357	15476152	hadcm3n_zebf_1920_40_008255566_1	622,080	808,595	1.2998
05 Jan 2013 11:46:27	995357	15476152	hadcm3n_zebf_1920_40_008255566_1	596,160	775,650	1.3011
04 Jan 2013 20:30:27	995357	15476152	hadcm3n_zebf_1920_40_008255566_1	570,240	742,058	1.3013
04 Jan 2013 07:19:58	995357	15476152	hadcm3n_zebf_1920_40_008255566_1	544,320	707,733	1.3002
03 Jan 2013 08:55:59	995357	15476152	hadcm3n_zebf_1920_40_008255566_1	518,400	674,192	1.3005
02 Jan 2013 12:40:33	995357	15476152	hadcm3n_zebf_1920_40_008255566_1	492,480	640,641	1.3008
01 Jan 2013 21:06:20	995357	15476152	hadcm3n_zebf_1920_40_008255566_1	466,560	607,302	1.3017
01 Jan 2013 07:26:06	995357	15476152	hadcm3n_zebf_1920_40_008255566_1	440,640	573,188	1.3008
31 Dec 2012 16:11:03	995357	15476152	hadcm3n_zebf_1920_40_008255566_1	414,720	539,666	1.3013
30 Dec 2012 17:36:40	995357	15476152	hadcm3n_zebf_1920_40_008255566_1	388,800	506,192	1.3019
29 Dec 2012 21:30:59	995357	15476152	hadcm3n_zebf_1920_40_008255566_1	362,880	471,461	1.2992
29 Dec 2012 08:50:23	995357	15476152	hadcm3n_zebf_1920_40_008255566_1	336,960	438,175	1.3004
28 Dec 2012 18:01:52	995357	15476152	hadcm3n_zebf_1920_40_008255566_1	311,040	404,501	1.3005
27 Dec 2012 23:42:17	995357	15476152	hadcm3n_zebf_1920_40_008255566_1	285,120	371,972	1.3046