Task 16649775

Name	hadcm3n_86ai_1980_40_008514657_1
Workunit	8662169
Created	28 May 2014, 23:31:48 UTC
Sent	28 May 2014, 23:31:59 UTC
Report deadline	28 Aug 2014, 6:59:10 UTC
Received	7 Jun 2014, 6:37:46 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	1185835
Run time	3 days 22 hours 41 min 10 sec
CPU time	3 days 21 hours 44 min 37 sec
Validate state	Invalid
Credit	3,110.40
Device peak FLOPS	1.89 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>7.2.42</core_client_version> <![CDATA[ <message> The device does not recognize the command. (0x16) - exit code 22 (0x16) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 06:34:40 (2224): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 06:40:08 (1724): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 07:14:08 (2856): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 12:50:55 (6024): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 18:22:33 (3776): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 22:43:40 (8100): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:44:17 (6964): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 12:43:54 (3912): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:43:55 (3912): No heartbeat from core client for 30 sec - exiting 12:43:56 (3912): No heartbeat from core client for 30 sec - exiting 12:43:57 (3912): No heartbeat from core client for 30 sec - exiting 12:43:58 (3912): No heartbeat from core client for 30 sec - exiting 12:43:59 (3912): No heartbeat from core client for 30 sec - exiting 12:44:00 (3912): No heartbeat from core client for 30 sec - exiting 12:44:01 (3912): No heartbeat from core client for 30 sec - exiting 12:44:03 (3912): No heartbeat from core client for 30 sec - exiting 12:44:04 (3912): No heartbeat from core client for 30 sec - exiting 12:44:05 (3912): No heartbeat from core client for 30 sec - exiting 12:44:06 (3912): No heartbeat from core client for 30 sec - exiting 12:44:07 (3912): No heartbeat from core client for 30 sec - exiting 12:44:08 (3912): No heartbeat from core client for 30 sec - exiting 12:44:09 (3912): No heartbeat from core client for 30 sec - exiting 12:44:10 (3912): No heartbeat from core client for 30 sec - exiting 12:44:11 (3912): No heartbeat from core client for 30 sec - exiting 12:44:12 (3912): No heartbeat from core client for 30 sec - exiting 12:44:13 (3912): No heartbeat from core client for 30 sec - exiting 12:44:15 (3912): No heartbeat from core client for 30 sec - exiting 12:44:16 (3912): No heartbeat from core client for 30 sec - exiting 12:44:17 (3912): No heartbeat from core client for 30 sec - exiting 12:44:18 (3912): No heartbeat from core client for 30 sec - exiting 12:44:19 (3912): No heartbeat from core client for 30 sec - exiting 12:44:20 (3912): No heartbeat from core client for 30 sec - exiting 12:44:21 (3912): No heartbeat from core client for 30 sec - exiting 12:44:22 (3912): No heartbeat from core client for 30 sec - exiting 12:44:23 (3912): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 06:37:52 (2840): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 07:02:19 (3940): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 18:16:23 (3360): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 22:38:37 (5292): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3080, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3080, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3080, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3080, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5208, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5208, iMonCtr=1 Model crash detected, will try to restart... Sorry, too many model crashes! :-( Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
06 Jun 2014 23:21:13	1185835	16649775	hadcm3n_86ai_1980_40_008514657_1	259,200	321,323	1.2397
05 Jun 2014 15:24:06	1185835	16649775	hadcm3n_86ai_1980_40_008514657_1	233,280	289,153	1.2395
05 Jun 2014 03:23:59	1185835	16649775	hadcm3n_86ai_1980_40_008514657_1	207,360	256,821	1.2385
03 Jun 2014 20:58:52	1185835	16649775	hadcm3n_86ai_1980_40_008514657_1	181,440	225,044	1.2403
02 Jun 2014 20:29:09	1185835	16649775	hadcm3n_86ai_1980_40_008514657_1	155,520	193,017	1.2411
01 Jun 2014 22:54:59	1185835	16649775	hadcm3n_86ai_1980_40_008514657_1	129,600	161,150	1.2434
01 Jun 2014 02:31:38	1185835	16649775	hadcm3n_86ai_1980_40_008514657_1	103,680	128,905	1.2433
31 May 2014 03:55:28	1185835	16649775	hadcm3n_86ai_1980_40_008514657_1	77,760	97,274	1.2510
30 May 2014 06:56:36	1185835	16649775	hadcm3n_86ai_1980_40_008514657_1	51,840	65,106	1.2559
29 May 2014 19:59:18	1185835	16649775	hadcm3n_86ai_1980_40_008514657_1	25,920	32,352	1.2481