Task 12987773

Name	hadcm3n_s1qz_1940_40_007298775_0
Workunit	7496199
Created	20 Jun 2011, 15:10:30 UTC
Sent	20 Jun 2011, 15:10:59 UTC
Report deadline	19 Sep 2011, 22:38:10 UTC
Received	2 Jul 2011, 22:45:21 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	775427
Run time	7 days 14 hours 46 min 12 sec
CPU time	6 days 22 hours 21 min 39 sec
Validate state	Invalid
Credit	2,799.36
Device peak FLOPS	2.11 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>6.12.26</core_client_version> <![CDATA[ <message> The device does not recognize the command. (0x16) - exit code 22 (0x16) </message> <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5300, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4516, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6028, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4144, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2032, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2032, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 21:53:16 (7216): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:53:17 (7216): No heartbeat from core client for 30 sec - exiting Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7892, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 12:08:17 (5512): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:30:10 (6948): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:44:41 (3660): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6288, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5884, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 Sorry, too many model crashes! :-( Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
02 Jul 2011 20:43:13	775427	12987773	hadcm3n_s1qz_1940_40_007298775_0	233,280	609,686	2.6135
01 Jul 2011 23:19:37	775427	12987773	hadcm3n_s1qz_1940_40_007298775_0	207,360	542,892	2.6181
30 Jun 2011 19:32:19	775427	12987773	hadcm3n_s1qz_1940_40_007298775_0	181,440	474,578	2.6156
29 Jun 2011 03:57:04	775427	12987773	hadcm3n_s1qz_1940_40_007298775_0	155,520	406,438	2.6134
26 Jun 2011 21:55:41	775427	12987773	hadcm3n_s1qz_1940_40_007298775_0	129,600	328,658	2.5359
26 Jun 2011 04:15:12	775427	12987773	hadcm3n_s1qz_1940_40_007298775_0	103,680	263,987	2.5462
24 Jun 2011 23:23:32	775427	12987773	hadcm3n_s1qz_1940_40_007298775_0	77,760	198,791	2.5565
23 Jun 2011 18:15:34	775427	12987773	hadcm3n_s1qz_1940_40_007298775_0	51,840	131,134	2.5296
21 Jun 2011 20:20:37	775427	12987773	hadcm3n_s1qz_1940_40_007298775_0	25,920	64,937	2.5053