Task 13477802

Name	hadcm3n_u0nh_1980_40_007458044_2
Workunit	7655547
Created	14 Oct 2011, 10:39:58 UTC
Sent	14 Oct 2011, 10:40:08 UTC
Report deadline	13 Jan 2012, 18:07:19 UTC
Received	27 Oct 2011, 1:04:57 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	860081
Run time	7 days 17 hours 44 min 14 sec
CPU time	6 days 17 hours 37 min 19 sec
Validate state	Invalid
Credit	4,665.60
Device peak FLOPS	3.25 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>6.10.18</core_client_version> <![CDATA[ <message> The device does not recognize the command. (0x16) - exit code 22 (0x16) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... 15:26:40 (2756): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 21:06:54 (3120): No heartbeat from core client for 30 sec - exiting 21:06:55 (3120): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 07:37:41 (2452): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 06:45:24 (3824): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:45:25 (3824): No heartbeat from core client for 30 sec - exiting 08:10:54 (280): No heartbeat from core client for 30 sec - exiting 08:10:55 (280): No heartbeat from core client for 30 sec - exiting 08:10:56 (280): No heartbeat from core client for 30 sec - exiting 08:10:57 (280): No heartbeat from core client for 30 sec - exiting 08:10:58 (280): No heartbeat from core client for 30 sec - exiting 08:10:59 (280): No heartbeat from core client for 30 sec - exiting 08:11:00 (280): No heartbeat from core client for 30 sec - exiting 08:11:01 (280): No heartbeat from core client for 30 sec - exiting 08:11:02 (280): No heartbeat from core client for 30 sec - exiting 08:11:03 (280): No heartbeat from core client for 30 sec - exiting 08:11:05 (280): No heartbeat from core client for 30 sec - exiting 08:11:06 (280): No heartbeat from core client for 30 sec - exiting 08:11:07 (280): No heartbeat from core client for 30 sec - exiting 08:11:08 (280): No heartbeat from core client for 30 sec - exiting 08:11:09 (280): No heartbeat from core client for 30 sec - exiting 08:11:10 (280): No heartbeat from core client for 30 sec - exiting 08:11:11 (280): No heartbeat from core client for 30 sec - exiting 08:11:12 (280): No heartbeat from core client for 30 sec - exiting 08:11:13 (280): No heartbeat from core client for 30 sec - exiting 08:11:14 (280): No heartbeat from core client for 30 sec - exiting 08:11:15 (280): No heartbeat from core client for 30 sec - exiting 08:11:17 (280): No heartbeat from core client for 30 sec - exiting 08:11:18 (280): No heartbeat from core client for 30 sec - exiting 08:11:19 (280): No heartbeat from core client for 30 sec - exiting 08:11:20 (280): No heartbeat from core client for 30 sec - exiting 08:11:21 (280): No heartbeat from core client for 30 sec - exiting 08:11:22 (280): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 11:59:31 (3544): No heartbeat from core client for 30 sec - exiting 11:59:33 (3544): No heartbeat from core client for 30 sec - exiting 11:59:34 (3544): No heartbeat from core client for 30 sec - exiting 11:59:35 (3544): No heartbeat from core client for 30 sec - exiting 11:59:36 (3544): No heartbeat from core client for 30 sec - exiting 11:59:37 (3544): No heartbeat from core client for 30 sec - exiting 11:59:38 (3544): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:59:39 (3544): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... 15:30:48 (4952): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 09:00:42 (2912): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 14:47:33 (528): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:47:34 (528): No heartbeat from core client for 30 sec - exiting 14:47:35 (528): No heartbeat from core client for 30 sec - exiting 14:49:26 (1984): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:49:27 (1984): No heartbeat from core client for 30 sec - exiting 14:49:28 (1984): No heartbeat from core client for 30 sec - exiting 14:49:30 (1984): No heartbeat from core client for 30 sec - exiting 14:49:31 (1984): No heartbeat from core client for 30 sec - exiting 14:49:32 (1984): No heartbeat from core client for 30 sec - exiting 14:49:33 (1984): No heartbeat from core client for 30 sec - exiting 14:49:34 (1984): No heartbeat from core client for 30 sec - exiting 14:49:35 (1984): No heartbeat from core client for 30 sec - exiting 14:49:36 (1984): No heartbeat from core client for 30 sec - exiting 14:49:37 (1984): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 16:30:19 (4716): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 21:59:21 (5932): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:00:46 (2128): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 16:20:42 (5180): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4348, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4348, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4348, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4348, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4348, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4348, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4568, iMonCtr=1 Model crash detected, will try to restart... Sorry, too many model crashes! :-( Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
31 Oct 2011 15:40:32	860081	13477802	hadcm3n_u0nh_1980_40_007458044_2	388,800	572,373	1.4722
31 Oct 2011 13:16:57	860081	13477802	hadcm3n_u0nh_1980_40_007458044_2	362,880	537,495	1.4812
31 Oct 2011 13:16:57	860081	13477802	hadcm3n_u0nh_1980_40_007458044_2	336,960	502,049	1.4899
31 Oct 2011 13:16:57	860081	13477802	hadcm3n_u0nh_1980_40_007458044_2	311,040	466,214	1.4989
31 Oct 2011 13:16:57	860081	13477802	hadcm3n_u0nh_1980_40_007458044_2	285,120	430,863	1.5112
31 Oct 2011 13:16:56	860081	13477802	hadcm3n_u0nh_1980_40_007458044_2	259,200	395,650	1.5264
31 Oct 2011 13:16:56	860081	13477802	hadcm3n_u0nh_1980_40_007458044_2	233,280	360,159	1.5439
31 Oct 2011 13:16:56	860081	13477802	hadcm3n_u0nh_1980_40_007458044_2	207,360	323,930	1.5622
18 Oct 2011 12:36:58	860081	13477802	hadcm3n_u0nh_1980_40_007458044_2	181,440	282,371	1.5563
17 Oct 2011 22:01:37	860081	13477802	hadcm3n_u0nh_1980_40_007458044_2	155,520	240,342	1.5454
17 Oct 2011 06:13:39	860081	13477802	hadcm3n_u0nh_1980_40_007458044_2	129,600	199,216	1.5372
16 Oct 2011 11:59:26	860081	13477802	hadcm3n_u0nh_1980_40_007458044_2	103,680	152,401	1.4699
15 Oct 2011 21:57:21	860081	13477802	hadcm3n_u0nh_1980_40_007458044_2	77,760	111,738	1.4370
15 Oct 2011 10:23:25	860081	13477802	hadcm3n_u0nh_1980_40_007458044_2	51,840	71,686	1.3828
14 Oct 2011 21:27:32	860081	13477802	hadcm3n_u0nh_1980_40_007458044_2	25,920	35,003	1.3504