Task 16073038

Name	hadcm3n_84ev_1980_40_008463675_1
Workunit	8614514
Created	23 Oct 2013, 14:20:47 UTC
Sent	23 Oct 2013, 14:20:59 UTC
Report deadline	22 Jan 2014, 21:48:10 UTC
Received	23 Nov 2013, 13:38:09 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	867819
Run time	25 days 17 hours 7 min 18 sec
CPU time	21 days 21 hours 34 min 10 sec
Validate state	Invalid
Credit	11,508.48
Device peak FLOPS	2.31 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>7.2.28</core_client_version> <![CDATA[ <message> The device does not recognize the command. (0x16) - exit code 22 (0x16) </message> <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Ocean Restart file copy failed on 84evko.dak91g0 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6372, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2208, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 Sorry, too many model crashes! :-( Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
22 Nov 2013 23:04:38	867819	16073038	hadcm3n_84ev_1980_40_008463675_1	959,040	2,119,848	2.2104
22 Nov 2013 05:55:04	867819	16073038	hadcm3n_84ev_1980_40_008463675_1	933,120	2,063,247	2.2111
21 Nov 2013 11:39:41	867819	16073038	hadcm3n_84ev_1980_40_008463675_1	907,200	2,006,064	2.2113
20 Nov 2013 18:49:35	867819	16073038	hadcm3n_84ev_1980_40_008463675_1	881,280	1,948,673	2.2112
20 Nov 2013 02:19:53	867819	16073038	hadcm3n_84ev_1980_40_008463675_1	855,360	1,892,124	2.2121
19 Nov 2013 08:33:43	867819	16073038	hadcm3n_84ev_1980_40_008463675_1	829,440	1,838,017	2.2160
18 Nov 2013 09:09:52	867819	16073038	hadcm3n_84ev_1980_40_008463675_1	803,520	1,783,651	2.2198
17 Nov 2013 16:39:16	867819	16073038	hadcm3n_84ev_1980_40_008463675_1	777,600	1,730,467	2.2254
16 Nov 2013 03:44:11	867819	16073038	hadcm3n_84ev_1980_40_008463675_1	751,680	1,676,219	2.2300
13 Nov 2013 03:35:10	867819	16073038	hadcm3n_84ev_1980_40_008463675_1	725,760	1,617,453	2.2286
12 Nov 2013 09:06:57	867819	16073038	hadcm3n_84ev_1980_40_008463675_1	699,840	1,559,917	2.2290
11 Nov 2013 13:07:56	867819	16073038	hadcm3n_84ev_1980_40_008463675_1	673,920	1,503,770	2.2314
10 Nov 2013 18:27:33	867819	16073038	hadcm3n_84ev_1980_40_008463675_1	648,000	1,444,628	2.2294
09 Nov 2013 20:55:09	867819	16073038	hadcm3n_84ev_1980_40_008463675_1	622,080	1,386,049	2.2281
09 Nov 2013 01:44:37	867819	16073038	hadcm3n_84ev_1980_40_008463675_1	596,160	1,327,296	2.2264
08 Nov 2013 03:20:47	867819	16073038	hadcm3n_84ev_1980_40_008463675_1	570,240	1,269,499	2.2263
07 Nov 2013 08:35:37	867819	16073038	hadcm3n_84ev_1980_40_008463675_1	544,320	1,210,751	2.2243
06 Nov 2013 15:55:07	867819	16073038	hadcm3n_84ev_1980_40_008463675_1	518,400	1,151,909	2.2220
05 Nov 2013 22:04:03	867819	16073038	hadcm3n_84ev_1980_40_008463675_1	492,480	1,092,981	2.2193
05 Nov 2013 04:57:05	867819	16073038	hadcm3n_84ev_1980_40_008463675_1	466,560	1,035,002	2.2184