Task 16054495

Name	hadcm3n_n2ic_1920_40_008398290_1
Workunit	8549146
Created	3 Oct 2013, 2:05:08 UTC
Sent	3 Oct 2013, 2:15:00 UTC
Report deadline	2 Jan 2014, 9:42:11 UTC
Received	13 Oct 2013, 18:30:03 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	1290496
Run time	6 days 12 hours 50 min 44 sec
CPU time	6 days 9 hours 36 min 27 sec
Validate state	Invalid
Credit	8,398.08
Device peak FLOPS	4.30 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>7.0.64</core_client_version> <![CDATA[ <message> The device does not recognize the command. (0x16) - exit code 22 (0x16) </message> <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4884, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4880, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 03:02:44 (5300): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4772, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4772, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4772, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4748, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4748, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4748, iMonCtr=1 Model crash detected, will try to restart... Sorry, too many model crashes! :-( Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
12 Oct 2013 21:59:37	1290496	16054495	hadcm3n_n2ic_1920_40_008398290_1	699,840	540,228	0.7719
12 Oct 2013 20:03:44	1290496	16054495	hadcm3n_n2ic_1920_40_008398290_1	673,920	524,454	0.7782
12 Oct 2013 20:03:44	1290496	16054495	hadcm3n_n2ic_1920_40_008398290_1	648,000	511,375	0.7892
12 Oct 2013 20:03:44	1290496	16054495	hadcm3n_n2ic_1920_40_008398290_1	622,080	495,805	0.7970
12 Oct 2013 00:00:34	1290496	16054495	hadcm3n_n2ic_1920_40_008398290_1	596,160	474,333	0.7956
11 Oct 2013 20:53:48	1290496	16054495	hadcm3n_n2ic_1920_40_008398290_1	570,240	454,360	0.7968
11 Oct 2013 06:58:38	1290496	16054495	hadcm3n_n2ic_1920_40_008398290_1	544,320	439,753	0.8079
11 Oct 2013 06:58:38	1290496	16054495	hadcm3n_n2ic_1920_40_008398290_1	518,400	426,119	0.8220
10 Oct 2013 18:07:48	1290496	16054495	hadcm3n_n2ic_1920_40_008398290_1	492,480	404,861	0.8221
10 Oct 2013 05:14:14	1290496	16054495	hadcm3n_n2ic_1920_40_008398290_1	466,560	383,523	0.8220
09 Oct 2013 23:00:22	1290496	16054495	hadcm3n_n2ic_1920_40_008398290_1	440,640	361,723	0.8209
09 Oct 2013 16:40:31	1290496	16054495	hadcm3n_n2ic_1920_40_008398290_1	414,720	340,012	0.8199
09 Oct 2013 03:10:22	1290496	16054495	hadcm3n_n2ic_1920_40_008398290_1	388,800	318,197	0.8184
08 Oct 2013 20:57:01	1290496	16054495	hadcm3n_n2ic_1920_40_008398290_1	362,880	296,628	0.8174
08 Oct 2013 15:42:53	1290496	16054495	hadcm3n_n2ic_1920_40_008398290_1	336,960	275,159	0.8166
08 Oct 2013 01:24:30	1290496	16054495	hadcm3n_n2ic_1920_40_008398290_1	311,040	253,754	0.8158
07 Oct 2013 18:34:32	1290496	16054495	hadcm3n_n2ic_1920_40_008398290_1	285,120	231,641	0.8124
07 Oct 2013 04:37:05	1290496	16054495	hadcm3n_n2ic_1920_40_008398290_1	259,200	210,033	0.8103
06 Oct 2013 22:28:11	1290496	16054495	hadcm3n_n2ic_1920_40_008398290_1	233,280	188,307	0.8072
06 Oct 2013 16:37:58	1290496	16054495	hadcm3n_n2ic_1920_40_008398290_1	207,360	167,421	0.8074