Task 15792594

Name	hadcm3n_n2m3_1920_40_008370768_0
Workunit	8521627
Created	21 May 2013, 15:52:24 UTC
Sent	21 May 2013, 15:52:30 UTC
Report deadline	20 Aug 2013, 23:19:41 UTC
Received	20 Jul 2013, 9:31:20 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	1114073
Run time	22 days 23 hours 37 min 36 sec
CPU time	22 days 12 hours 49 min 30 sec
Validate state	Invalid
Credit	10,264.32
Device peak FLOPS	2.67 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>6.10.58</core_client_version> <![CDATA[ <message> The device does not recognize the command. (0x16) - exit code 22 (0x16) </message> <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4584, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4584, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4584, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4584, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4584, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4584, iMonCtr=1 Model crash detected, will try to restart... Sorry, too many model crashes! :-( Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
23 Jul 2013 19:59:56	1114073	15792594	hadcm3n_n2m3_1920_40_008370768_0	855,360	1,905,239	2.2274
23 Jul 2013 19:24:20	1114073	15792594	hadcm3n_n2m3_1920_40_008370768_0	829,440	1,850,810	2.2314
23 Jul 2013 16:41:15	1114073	15792594	hadcm3n_n2m3_1920_40_008370768_0	803,520	1,796,453	2.2357
23 Jul 2013 16:41:15	1114073	15792594	hadcm3n_n2m3_1920_40_008370768_0	777,600	1,743,138	2.2417
23 Jul 2013 16:41:14	1114073	15792594	hadcm3n_n2m3_1920_40_008370768_0	751,680	1,689,951	2.2482
23 Jul 2013 16:41:14	1114073	15792594	hadcm3n_n2m3_1920_40_008370768_0	725,760	1,636,561	2.2550
23 Jul 2013 16:41:14	1114073	15792594	hadcm3n_n2m3_1920_40_008370768_0	699,840	1,581,641	2.2600
23 Jul 2013 16:41:14	1114073	15792594	hadcm3n_n2m3_1920_40_008370768_0	673,920	1,526,097	2.2645
23 Jul 2013 16:41:14	1114073	15792594	hadcm3n_n2m3_1920_40_008370768_0	648,000	1,469,544	2.2678
23 Jul 2013 16:41:14	1114073	15792594	hadcm3n_n2m3_1920_40_008370768_0	622,080	1,414,819	2.2743
11 Jul 2013 09:26:19	1114073	15792594	hadcm3n_n2m3_1920_40_008370768_0	596,160	1,360,134	2.2815
10 Jul 2013 05:55:15	1114073	15792594	hadcm3n_n2m3_1920_40_008370768_0	570,240	1,306,657	2.2914
09 Jul 2013 09:42:56	1114073	15792594	hadcm3n_n2m3_1920_40_008370768_0	544,320	1,252,717	2.3014
08 Jul 2013 06:46:54	1114073	15792594	hadcm3n_n2m3_1920_40_008370768_0	518,400	1,193,880	2.3030
07 Jul 2013 12:31:46	1114073	15792594	hadcm3n_n2m3_1920_40_008370768_0	492,480	1,129,991	2.2945
06 Jul 2013 17:40:06	1114073	15792594	hadcm3n_n2m3_1920_40_008370768_0	466,560	1,063,388	2.2792
06 Jul 2013 05:33:19	1114073	15792594	hadcm3n_n2m3_1920_40_008370768_0	440,640	996,634	2.2618
06 Jul 2013 04:32:30	1114073	15792594	hadcm3n_n2m3_1920_40_008370768_0	414,720	929,517	2.2413
04 Jul 2013 14:24:39	1114073	15792594	hadcm3n_n2m3_1920_40_008370768_0	388,800	863,292	2.2204
03 Jul 2013 15:08:39	1114073	15792594	hadcm3n_n2m3_1920_40_008370768_0	362,880	808,701	2.2286