Task 19131403

Name	hadcm3n_xboj_198012_480_010220394_0
Workunit	10220394
Created	4 Dec 2015, 14:51:23 UTC
Sent	4 Dec 2015, 17:30:51 UTC
Report deadline	15 Nov 2016, 22:50:51 UTC
Received	18 Dec 2015, 21:03:42 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	1382392
Run time	3 days 0 hours 37 min 7 sec
CPU time	2 days 13 hours 23 min 27 sec
Validate state	Invalid
Credit	5,598.72
Device peak FLOPS	3.97 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>7.6.9</core_client_version> <![CDATA[ <message> The device does not recognize the command. (0x16) - exit code 22 (0x16) </message> <stderr_txt> 18:32:11 (14016): start_timer_thread(): CreateThread() failed, errno 0 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 17:55:04 (6000): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 20:18:29 (2612): start_timer_thread(): CreateThread() failed, errno 0 14:13:48 (10888): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 14:58:18 (15212): start_timer_thread(): CreateThread() failed, errno 0 18:41:32 (12460): start_timer_thread(): CreateThread() failed, errno 0 16:21:08 (10144): start_timer_thread(): CreateThread() failed, errno 0 23:00:48 (12656): start_timer_thread(): CreateThread() failed, errno 0 16:56:55 (21152): start_timer_thread(): CreateThread() failed, errno 0 17:23:48 (13964): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... diagnostics_init_unhandled_exception_monitor(): Creating hExceptionMonitorThread failed, errno 12 WARNING: BOINC Windows Runtime Debugger has been disabled. 20:56:46 (10364): start_timer_thread(): CreateThread() failed, errno 0 Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 diagnostics_init_unhandled_exception_monitor(): Creating hExceptionMonitorThread failed, errno 12 WARNING: BOINC Windows Runtime Debugger has been disabled. 21:01:40 (6080): start_timer_thread(): CreateThread() failed, errno 0 Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 diagnostics_init_unhandled_exception_monitor(): Creating hExceptionMonitorThread failed, errno 12 WARNING: BOINC Windows Runtime Debugger has been disabled. 21:01:56 (12764): start_timer_thread(): CreateThread() failed, errno 0 Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 diagnostics_init_unhandled_exception_monitor(): Creating hExceptionMonitorThread failed, errno 12 WARNING: BOINC Windows Runtime Debugger has been disabled. 21:02:12 (7220): start_timer_thread(): CreateThread() failed, errno 0 Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 diagnostics_init_unhandled_exception_monitor(): Creating hExceptionMonitorThread failed, errno 12 WARNING: BOINC Windows Runtime Debugger has been disabled. 21:02:28 (2972): start_timer_thread(): CreateThread() failed, errno 0 Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 diagnostics_init_unhandled_exception_monitor(): Creating hExceptionMonitorThread failed, errno 12 WARNING: BOINC Windows Runtime Debugger has been disabled. 21:02:44 (19292): start_timer_thread(): CreateThread() failed, errno 0 Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 Sorry, too many model crashes! :-( Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
18 Dec 2015 17:59:49	1382392	19131403	hadcm3n_xboj_198012_480_010220394_0	466,560	225,747	0.4839
16 Dec 2015 22:02:43	1382392	19131403	hadcm3n_xboj_198012_480_010220394_0	440,640	241,294	0.5476
15 Dec 2015 15:40:42	1382392	19131403	hadcm3n_xboj_198012_480_010220394_0	414,720	221,990	0.5353
13 Dec 2015 17:33:54	1382392	19131403	hadcm3n_xboj_198012_480_010220394_0	388,800	233,182	0.5997
11 Dec 2015 23:50:06	1382392	19131403	hadcm3n_xboj_198012_480_010220394_0	362,880	236,184	0.6509
11 Dec 2015 17:03:39	1382392	19131403	hadcm3n_xboj_198012_480_010220394_0	336,960	221,375	0.6570
10 Dec 2015 18:40:14	1382392	19131403	hadcm3n_xboj_198012_480_010220394_0	311,040	202,300	0.6504
10 Dec 2015 15:48:12	1382392	19131403	hadcm3n_xboj_198012_480_010220394_0	285,120	183,525	0.6437
10 Dec 2015 15:48:12	1382392	19131403	hadcm3n_xboj_198012_480_010220394_0	259,200	165,016	0.6366
08 Dec 2015 16:02:25	1382392	19131403	hadcm3n_xboj_198012_480_010220394_0	233,280	146,550	0.6282
07 Dec 2015 17:17:51	1382392	19131403	hadcm3n_xboj_198012_480_010220394_0	207,360	126,429	0.6097
07 Dec 2015 10:10:06	1382392	19131403	hadcm3n_xboj_198012_480_010220394_0	181,440	107,092	0.5902
06 Dec 2015 21:59:50	1382392	19131403	hadcm3n_xboj_198012_480_010220394_0	155,520	87,931	0.5654
06 Dec 2015 13:52:05	1382392	19131403	hadcm3n_xboj_198012_480_010220394_0	129,600	67,844	0.5235
06 Dec 2015 07:33:12	1382392	19131403	hadcm3n_xboj_198012_480_010220394_0	103,680	48,178	0.4647
06 Dec 2015 01:11:53	1382392	19131403	hadcm3n_xboj_198012_480_010220394_0	77,760	28,568	0.3674
05 Dec 2015 17:29:19	1382392	19131403	hadcm3n_xboj_198012_480_010220394_0	51,840	8,677	0.1674
05 Dec 2015 00:14:03	1382392	19131403	hadcm3n_xboj_198012_480_010220394_0	25,920	19,490	0.7519