Task 13103291

Name	hadcm3n_yd06_1900_40_007349712_0
Workunit	7547142
Created	6 Jul 2011, 14:00:39 UTC
Sent	17 Jul 2011, 11:43:29 UTC
Report deadline	16 Oct 2011, 19:10:40 UTC
Received	16 Oct 2011, 17:48:46 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	1006326
Run time	10 days 8 hours 22 min 20 sec
CPU time	9 days 17 hours 11 min 22 sec
Validate state	Invalid
Credit	4,665.60
Device peak FLOPS	2.34 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>6.10.58</core_client_version> <![CDATA[ <message> The device does not recognize the command. (0x16) - exit code 22 (0x16) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... 10:23:41 (7848): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2496, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1628, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5060, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 12:08:25 (3172): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4800, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6044, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5616, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5344, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 16:20:57 (7508): No heartbeat from core client for 30 sec - exiting 16:20:58 (7508): No heartbeat from core client for 30 sec - exiting 16:20:59 (7508): No heartbeat from core client for 30 sec - exiting 16:21:00 (7508): No heartbeat from core client for 30 sec - exiting 16:21:01 (7508): No heartbeat from core client for 30 sec - exiting 16:21:02 (7508): No heartbeat from core client for 30 sec - exiting 16:21:03 (7508): No heartbeat from core client for 30 sec - exiting 16:21:04 (7508): No heartbeat from core client for 30 sec - exiting 16:21:05 (7508): No heartbeat from core client for 30 sec - exiting 16:21:06 (7508): No heartbeat from core client for 30 sec - exiting 16:21:07 (7508): No heartbeat from core client for 30 sec - exiting 16:21:08 (7508): No heartbeat from core client for 30 sec - exiting 16:21:09 (7508): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4460, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3404, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... 12:42:28 (6732): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Model crashed: INITDUMP: Wrong no of ocean prognostic fields tmp/pipe_dummy 2048 Model crashed: INITDUMP: Wrong no of ocean prognostic fields tmp/pipe_dummy 2048 Model crashed: INITDUMP: Wrong no of ocean prognostic fields tmp/pipe_dummy 2048 Model crashed: INITDUMP: Wrong no of ocean prognostic fields tmp/pipe_dummy 2048 Model crashed: INITDUMP: Wrong no of ocean prognostic fields tmp/pipe_dummy 2048 Model crashed: INITDUMP: Wrong no of ocean prognostic fields tmp/pipe_dummy 2048 Sorry, too many model crashes! :-( Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
13 Oct 2011 16:18:18	1006326	13103291	hadcm3n_yd06_1900_40_007349712_0	388,800	817,174	2.1018
04 Oct 2011 12:30:14	1006326	13103291	hadcm3n_yd06_1900_40_007349712_0	362,880	765,764	2.1102
21 Sep 2011 19:02:30	1006326	13103291	hadcm3n_yd06_1900_40_007349712_0	336,960	707,671	2.1002
18 Sep 2011 12:20:28	1006326	13103291	hadcm3n_yd06_1900_40_007349712_0	311,040	649,492	2.0881
14 Sep 2011 13:41:27	1006326	13103291	hadcm3n_yd06_1900_40_007349712_0	285,120	593,188	2.0805
08 Sep 2011 23:32:43	1006326	13103291	hadcm3n_yd06_1900_40_007349712_0	259,200	539,994	2.0833
07 Sep 2011 16:59:46	1006326	13103291	hadcm3n_yd06_1900_40_007349712_0	233,280	485,916	2.0830
06 Sep 2011 14:09:09	1006326	13103291	hadcm3n_yd06_1900_40_007349712_0	207,360	432,840	2.0874
04 Sep 2011 19:36:42	1006326	13103291	hadcm3n_yd06_1900_40_007349712_0	181,440	378,867	2.0881
25 Aug 2011 20:51:46	1006326	13103291	hadcm3n_yd06_1900_40_007349712_0	155,520	326,057	2.0966
24 Aug 2011 17:41:19	1006326	13103291	hadcm3n_yd06_1900_40_007349712_0	129,600	276,049	2.1300
18 Aug 2011 10:19:50	1006326	13103291	hadcm3n_yd06_1900_40_007349712_0	103,680	225,581	2.1757
11 Aug 2011 13:39:03	1006326	13103291	hadcm3n_yd06_1900_40_007349712_0	77,760	172,007	2.2120
07 Aug 2011 18:21:58	1006326	13103291	hadcm3n_yd06_1900_40_007349712_0	51,840	115,917	2.2361
27 Jul 2011 12:48:32	1006326	13103291	hadcm3n_yd06_1900_40_007349712_0	25,920	59,713	2.3037