Task 17761968

Name	hadcm3n_xa51_1940_40_009149435_4
Workunit	9279771
Created	12 Jan 2015, 18:15:35 UTC
Sent	12 Jan 2015, 18:18:01 UTC
Report deadline	14 Apr 2015, 1:45:12 UTC
Received	30 Jan 2015, 11:36:43 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	1255192
Run time	13 days 17 hours 30 min 50 sec
CPU time	8 days 15 hours 34 min 54 sec
Validate state	Invalid
Credit	12,130.56
Device peak FLOPS	3.68 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>7.4.36</core_client_version> <![CDATA[ <message> The device does not recognize the command. (0x16) - exit code 22 (0x16) </message> <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=8384, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=8384, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 Sorry, too many model crashes! :-( Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
30 Jan 2015 09:19:08	1255192	17761968	hadcm3n_xa51_1940_40_009149435_4	1,010,880	1,169,127	1.1565
30 Jan 2015 01:26:21	1255192	17761968	hadcm3n_xa51_1940_40_009149435_4	984,960	1,140,771	1.1582
29 Jan 2015 17:21:57	1255192	17761968	hadcm3n_xa51_1940_40_009149435_4	959,040	1,112,110	1.1596
29 Jan 2015 09:27:58	1255192	17761968	hadcm3n_xa51_1940_40_009149435_4	933,120	1,083,608	1.1613
29 Jan 2015 01:34:05	1255192	17761968	hadcm3n_xa51_1940_40_009149435_4	907,200	1,055,457	1.1634
28 Jan 2015 17:44:49	1255192	17761968	hadcm3n_xa51_1940_40_009149435_4	881,280	1,027,362	1.1658
28 Jan 2015 06:36:34	1255192	17761968	hadcm3n_xa51_1940_40_009149435_4	855,360	998,734	1.1676
27 Jan 2015 12:02:22	1255192	17761968	hadcm3n_xa51_1940_40_009149435_4	829,440	969,863	1.1693
27 Jan 2015 04:17:51	1255192	17761968	hadcm3n_xa51_1940_40_009149435_4	803,520	942,094	1.1725
26 Jan 2015 20:30:25	1255192	17761968	hadcm3n_xa51_1940_40_009149435_4	777,600	914,388	1.1759
26 Jan 2015 13:18:42	1255192	17761968	hadcm3n_xa51_1940_40_009149435_4	751,680	886,676	1.1796
26 Jan 2015 05:25:14	1255192	17761968	hadcm3n_xa51_1940_40_009149435_4	725,760	858,936	1.1835
25 Jan 2015 21:43:20	1255192	17761968	hadcm3n_xa51_1940_40_009149435_4	699,840	831,246	1.1878
25 Jan 2015 13:41:29	1255192	17761968	hadcm3n_xa51_1940_40_009149435_4	673,920	803,468	1.1922
25 Jan 2015 05:48:22	1255192	17761968	hadcm3n_xa51_1940_40_009149435_4	648,000	775,211	1.1963
24 Jan 2015 19:17:07	1255192	17761968	hadcm3n_xa51_1940_40_009149435_4	622,080	747,147	1.2010
24 Jan 2015 10:19:10	1255192	17761968	hadcm3n_xa51_1940_40_009149435_4	596,160	716,355	1.2016
24 Jan 2015 01:27:03	1255192	17761968	hadcm3n_xa51_1940_40_009149435_4	570,240	684,973	1.2012
23 Jan 2015 16:39:45	1255192	17761968	hadcm3n_xa51_1940_40_009149435_4	544,320	653,767	1.2011
23 Jan 2015 07:41:10	1255192	17761968	hadcm3n_xa51_1940_40_009149435_4	518,400	622,477	1.2008