Task 16077036

Name	hadcm3n_oexl_1900_40_008474476_2
Workunit	8625315
Created	2 Nov 2013, 13:56:34 UTC
Sent	2 Nov 2013, 13:56:36 UTC
Report deadline	1 Feb 2014, 21:23:47 UTC
Received	16 Nov 2013, 18:36:26 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	1298090
Run time	11 days 17 hours 48 min 58 sec
CPU time	10 days 8 hours 58 min 2 sec
Validate state	Invalid
Credit	5,598.72
Device peak FLOPS	1.90 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>7.0.64</core_client_version> <![CDATA[ <message> The device does not recognize the command. (0x16) - exit code 22 (0x16) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 10:36:37 (5036): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... BUFFIN: C I/O Error ferror - Unit 68 - Return code = 32 Model crashed: STWORK : I/O error - PP fixed length header tmp/pipe_dummy 2048 Signal 11 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2340, iMonCtr=1 Model crash detected, will try to restart... Signal 11 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2340, iMonCtr=1 Model crash detected, will try to restart... Signal 11 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2340, iMonCtr=1 Model crash detected, will try to restart... Signal 11 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2340, iMonCtr=1 Model crash detected, will try to restart... Signal 11 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2340, iMonCtr=1 Model crash detected, will try to restart... Sorry, too many model crashes! :-( Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
16 Nov 2013 13:16:38	1298090	16077036	hadcm3n_oexl_1900_40_008474476_2	466,560	965,968	2.0704
15 Nov 2013 22:12:39	1298090	16077036	hadcm3n_oexl_1900_40_008474476_2	440,640	912,805	2.0715
14 Nov 2013 22:08:30	1298090	16077036	hadcm3n_oexl_1900_40_008474476_2	414,720	858,502	2.0701
14 Nov 2013 06:42:49	1298090	16077036	hadcm3n_oexl_1900_40_008474476_2	388,800	806,020	2.0731
13 Nov 2013 15:38:03	1298090	16077036	hadcm3n_oexl_1900_40_008474476_2	362,880	753,738	2.0771
13 Nov 2013 00:19:23	1298090	16077036	hadcm3n_oexl_1900_40_008474476_2	336,960	701,454	2.0817
12 Nov 2013 09:27:02	1298090	16077036	hadcm3n_oexl_1900_40_008474476_2	311,040	649,142	2.0870
11 Nov 2013 18:23:17	1298090	16077036	hadcm3n_oexl_1900_40_008474476_2	285,120	595,713	2.0893
11 Nov 2013 02:40:16	1298090	16077036	hadcm3n_oexl_1900_40_008474476_2	259,200	542,455	2.0928
10 Nov 2013 10:43:23	1298090	16077036	hadcm3n_oexl_1900_40_008474476_2	233,280	489,695	2.0992
09 Nov 2013 15:02:28	1298090	16077036	hadcm3n_oexl_1900_40_008474476_2	207,360	435,401	2.0997
08 Nov 2013 14:08:47	1298090	16077036	hadcm3n_oexl_1900_40_008474476_2	181,440	381,070	2.1003
07 Nov 2013 21:39:02	1298090	16077036	hadcm3n_oexl_1900_40_008474476_2	155,520	328,865	2.1146
06 Nov 2013 11:13:39	1298090	16077036	hadcm3n_oexl_1900_40_008474476_2	129,600	274,540	2.1184
05 Nov 2013 16:36:13	1298090	16077036	hadcm3n_oexl_1900_40_008474476_2	103,680	215,202	2.0756
04 Nov 2013 22:29:08	1298090	16077036	hadcm3n_oexl_1900_40_008474476_2	77,760	162,027	2.0837
04 Nov 2013 06:58:40	1298090	16077036	hadcm3n_oexl_1900_40_008474476_2	51,840	109,473	2.1117
03 Nov 2013 11:53:44	1298090	16077036	hadcm3n_oexl_1900_40_008474476_2	25,920	54,389	2.0983