Task 11893500

Name	hadsm3dhet2_u4cl_006725308_4
Workunit	6928651
Created	17 Sep 2010, 8:07:54 UTC
Sent	22 Sep 2010, 18:53:35 UTC
Report deadline	5 Sep 2011, 0:13:35 UTC
Received	11 Jan 2011, 12:56:11 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	1037448
Run time	14 days 17 hours 36 min 24 sec
CPU time	16 days 8 hours 13 min 36 sec
Validate state	Invalid
Credit	4,565.20
Device peak FLOPS	2.26 GFLOPS
Application version	UK Met Office HadSM3 Slab Model v6.07 windows_intelx86
Stderr	<core_client_version>6.10.18</core_client_version> <![CDATA[ <message> The device does not recognize the command. (0x16) - exit code 22 (0x16) </message> <stderr_txt> CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4320, iMonCtr=1 Model crash detected, will try to restart... CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4320, iMonCtr=1 Model crash detected, will try to restart... CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3492, iMonCtr=1 Model crash detected, will try to restart... CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3616, iMonCtr=1 Model crash detected, will try to restart... CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3544, iMonCtr=1 Model crash detected, will try to restart... CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3568, iMonCtr=1 Model crash detected, will try to restart... CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3568, iMonCtr=1 Model crash detected, will try to restart... CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3568, iMonCtr=1 Model crash detected, will try to restart... CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3568, iMonCtr=1 Model crash detected, will try to restart... CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2872, iMonCtr=1 Model crash detected, will try to restart... CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2872, iMonCtr=1 Model crash detected, will try to restart... No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... No heartbeat from core client for 30 sec - exiting CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3916, iMonCtr=1 Model crash detected, will try to restart... CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3916, iMonCtr=1 Model crash detected, will try to restart... CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3916, iMonCtr=1 Model crash detected, will try to restart... CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3916, iMonCtr=1 Model crash detected, will try to restart... CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3916, iMonCtr=1 Model crash detected, will try to restart... CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3916, iMonCtr=1 Model crash detected, will try to restart... CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3740, iMonCtr=1 Model crash detected, will try to restart... CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4000, iMonCtr=1 Model crash detected, will try to restart... CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4000, iMonCtr=1 Model crash detected, will try to restart... CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3188, iMonCtr=1 Model crash detected, will try to restart... CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3812, iMonCtr=1 Model crash detected, will try to restart... CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3608, iMonCtr=1 Model crash detected, will try to restart... CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2932, iMonCtr=1 Model crash detected, will try to restart... CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3076, iMonCtr=1 Model crash detected, will try to restart... CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3524, iMonCtr=1 Model crash detected, will try to restart... MainError: 08:38:59 AM No files match the supplied pattern. MainError: 08:38:59 AM No files match the supplied pattern. MainError: 08:38:59 AM No files match the supplied pattern. MainError: 08:38:59 AM No files match the supplied pattern. MainError: 08:38:59 AM No files match the supplied pattern. MainError: 08:38:59 AM No files match the supplied pattern. MainError: 08:38:59 AM No files match the supplied pattern. MainError: 08:38:59 AM No files match the supplied pattern. MainError: 08:38:59 AM No files match the supplied pattern. MainError: 08:38:59 AM No files match the supplied pattern. MainError: 08:38:59 AM No files match the supplied pattern. MainError: 08:38:59 AM No files match the supplied pattern. MainError: 08:38:59 AM No files match the supplied pattern. MainError: 08:38:59 AM No files match the supplied pattern. MainError: 08:38:59 AM No files match the supplied pattern. MainError: 08:38:59 AM No files match the supplied pattern. MainError: 08:38:59 AM No files match the supplied pattern. MainError: 08:38:59 AM No files match the supplied pattern. MainError: 08:38:59 AM No files match the supplied pattern. MainError: 08:38:59 AM No files match the supplied pattern. MainError: 08:38:59 AM No files match the supplied pattern. MainError: 08:38:59 AM No files match the supplied pattern. MainError: 08:38:59 AM No files match the supplied pattern. MainError: 08:38:59 AM No files match the supplied pattern. MainError: 08:38:59 AM No files match the supplied pattern. MainError: 08:38:59 AM No files match the supplied pattern. MainError: 08:38:59 AM No files match the supplied pattern. MainError: 08:38:59 AM No files match the supplied pattern. MainError: 08:38:59 AM No files match the supplied pattern. MainError: 08:38:59 AM No files match the supplied pattern. MainError: 08:38:59 AM No files match the supplied pattern. MainError: 08:38:59 AM No files match the supplied pattern. MainError: 08:38:59 AM No files match the supplied pattern. MainError: 08:38:59 AM No files match the supplied pattern. MainError: 08:38:59 AM No files match the supplied pattern. MainError: 08:38:59 AM No files match the supplied pattern. MainError: 08:38:59 AM No files match the supplied pattern. MainError: 08:38:59 AM No files match the supplied pattern. MainError: 08:38:59 AM No files match the supplied pattern. MainError: 08:38:59 AM No files match the supplied pattern. MainError: 08:38:59 AM No files match the supplied pattern. MainError: 08:38:59 AM No files match the supplied pattern. MainError: 08:38:59 AM No files match the supplied pattern. MainError: 08:38:59 AM No files match the supplied pattern. MainError: 08:38:59 AM No files match the supplied pattern. MainError: 08:38:59 AM No files match the supplied pattern. MainError: 08:38:59 AM No files match the supplied pattern. MainError: 08:38:59 AM No files match the supplied pattern. MainError: 08:38:59 AM No files match the supplied pattern. MainError: 08:38:59 AM No files match the supplied pattern. MainError: 08:38:59 AM No files match the supplied pattern. MainError: 08:38:59 AM No files match the supplied pattern. MainError: 08:38:59 AM No files match the supplied pattern. MainError: 08:38:59 AM No files match the supplied pattern. MainError: 08:38:59 AM No files match the supplied pattern. MainError: 08:38:59 AM No files match the supplied pattern. CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3512, iMonCtr=1 Model crash detected, will try to restart... CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3532, iMonCtr=1 Model crash detected, will try to restart... CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4052, iMonCtr=1 Model crash detected, will try to restart... CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2288, iMonCtr=1 Model crash detected, will try to restart... CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3364, iMonCtr=1 Model crash detected, will try to restart... CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3416, iMonCtr=1 Model crash detected, will try to restart... CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1336, iMonCtr=1 Model crash detected, will try to restart... CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1336, iMonCtr=1 Model crash detected, will try to restart... No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... No heartbeat from core client for 30 sec - exiting CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4056, iMonCtr=1 Model crash detected, will try to restart... CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1860, iMonCtr=1 Model crash detected, will try to restart... CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3796, iMonCtr=1 Model crash detected, will try to restart... CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3224, iMonCtr=1 Model crash detected, will try to restart... CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3224, iMonCtr=1 Model crash detected, will try to restart... CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3224, iMonCtr=1 Model crash detected, will try to restart... CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1980, iMonCtr=1 Model crash detected, will try to restart... CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1980, iMonCtr=1 Model crash detected, will try to restart... CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1980, iMonCtr=1 Model crash detected, will try to restart... CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4048, iMonCtr=1 Model crash detected, will try to restart... CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4048, iMonCtr=1 Model crash detected, will try to restart... CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4048, iMonCtr=1 Model crash detected, will try to restart... CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4048, iMonCtr=1 Model crash detected, will try to restart... CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2188, iMonCtr=1 Model crash detected, will try to restart... CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3800, iMonCtr=1 Model crash detected, will try to restart... CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4168, iMonCtr=1 Model crash detected, will try to restart... CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3500, iMonCtr=1 Model crash detected, will try to restart... CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3500, iMonCtr=1 Model crash detected, will try to restart... CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3500, iMonCtr=1 Model crash detected, will try to restart... CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3500, iMonCtr=1 Model crash detected, will try to restart... CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3500, iMonCtr=1 Model crash detected, will try to restart... CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3500, iMonCtr=1 Model crash detected, will try to restart... CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3500, iMonCtr=1 Model crash detected, will try to restart... CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3500, iMonCtr=1 Model crash detected, will try to restart... CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3500, iMonCtr=1 Model crash detected, will try to restart... CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3500, iMonCtr=1 Model crash detected, will try to restart... CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3500, iMonCtr=1 Model crash detected, will try to restart... CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3500, iMonCtr=1 Model crash detected, will try to restart... CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4004, iMonCtr=1 Model crash detected, will try to restart... CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2952, iMonCtr=1 Model crash detected, will try to restart... CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4092, iMonCtr=1 Model crash detected, will try to restart... CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4092, iMonCtr=1 Model crash detected, will try to restart... Model crashed: 7R CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4092, iMonCtr=1 Model crash detected, will try to restart... CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4092, iMonCtr=1 Model crash detected, will try to restart... CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4092, iMonCtr=1 Model crash detected, will try to restart... CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4092, iMonCtr=1 Model crash detected, will try to restart... CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4092, iMonCtr=1 Model crash detected, will try to restart... CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4092, iMonCtr=1 Model crash detected, will try to restart... CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4092, iMonCtr=1 Model crash detected, will try to restart... CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4980, iMonCtr=1 Model crash detected, will try to restart... CCPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4316, iMonCtr=1 Model crash detected, will try to restart... CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4140, iMonCtr=1 Model crash detected, will try to restart... CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4140, iMonCtr=1 Model crash detected, will try to restart... CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4140, iMonCtr=1 Model crash detected, will try to restart... Model crashed: (null) Model crashed: (null) Model crashed: (null) Model crashed: (null) Model crashed: (null) Model crashed: (null) Sorry, too many model crashes! :-( called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
05 Dec 2010 22:03:54	1037448	11893500	hadsm3dhet2_u4cl_006725308_4	237,644	955,655	1.9233
04 Dec 2010 09:05:50	1037448	11893500	hadsm3dhet2_u4cl_006725308_4	226,842	942,600	1.9391
03 Dec 2010 21:51:32	1037448	11893500	hadsm3dhet2_u4cl_006725308_4	216,040	929,835	1.9564
03 Dec 2010 09:43:31	1037448	11893500	hadsm3dhet2_u4cl_006725308_4	205,238	919,793	1.9802
01 Dec 2010 19:49:55	1037448	11893500	hadsm3dhet2_u4cl_006725308_4	194,436	906,734	1.9986
30 Nov 2010 17:02:29	1037448	11893500	hadsm3dhet2_u4cl_006725308_4	183,634	894,355	2.0194
30 Nov 2010 12:01:58	1037448	11893500	hadsm3dhet2_u4cl_006725308_4	172,832	881,529	2.0402
29 Nov 2010 21:14:13	1037448	11893500	hadsm3dhet2_u4cl_006725308_4	162,030	869,226	2.0633
29 Nov 2010 16:37:34	1037448	11893500	hadsm3dhet2_u4cl_006725308_4	151,228	856,634	2.0869
28 Nov 2010 17:12:00	1037448	11893500	hadsm3dhet2_u4cl_006725308_4	140,426	843,822	2.1113
25 Nov 2010 21:09:09	1037448	11893500	hadsm3dhet2_u4cl_006725308_4	129,624	834,715	2.1465
25 Nov 2010 15:50:50	1037448	11893500	hadsm3dhet2_u4cl_006725308_4	118,822	821,123	2.1719
25 Nov 2010 13:10:45	1037448	11893500	hadsm3dhet2_u4cl_006725308_4	108,020	808,179	2.2005
23 Nov 2010 23:19:51	1037448	11893500	hadsm3dhet2_u4cl_006725308_4	97,218	794,871	2.2299
23 Nov 2010 13:43:27	1037448	11893500	hadsm3dhet2_u4cl_006725308_4	86,416	782,046	2.2624
23 Nov 2010 07:28:53	1037448	11893500	hadsm3dhet2_u4cl_006725308_4	75,614	768,885	2.2961
22 Nov 2010 21:12:37	1037448	11893500	hadsm3dhet2_u4cl_006725308_4	64,812	755,752	2.3321
22 Nov 2010 13:37:55	1037448	11893500	hadsm3dhet2_u4cl_006725308_4	54,010	742,781	2.3711
22 Nov 2010 09:02:00	1037448	11893500	hadsm3dhet2_u4cl_006725308_4	43,208	730,385	2.4148
21 Nov 2010 13:29:27	1037448	11893500	hadsm3dhet2_u4cl_006725308_4	32,406	720,040	2.4688