Task 13338681

Name	hadcm3n_o5vp_1900_40_007440440_3
Workunit	7637943
Created	5 Sep 2011, 20:56:31 UTC
Sent	5 Sep 2011, 21:17:25 UTC
Report deadline	6 Dec 2011, 4:44:36 UTC
Received	22 Sep 2011, 21:36:20 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	1092103
Run time	6 days 0 hours 53 min 2 sec
CPU time	4 days 6 hours 8 min 19 sec
Validate state	Invalid
Credit	4,043.52
Device peak FLOPS	3.06 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>6.10.58</core_client_version> <![CDATA[ <message> The device does not recognize the command. (0x16) - exit code 22 (0x16) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... 19:39:58 (3244): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:43:39 (4848): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:45:16 (3564): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:50:27 (3416): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:54:31 (4256): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:55:36 (2700): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:57:16 (4420): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:18:21 (3896): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:21:38 (1844): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:29:34 (4964): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:32:49 (2392): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:52:36 (4100): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4036, iMonCtr=1 Model crash detected, will try to restart... 17:04:17 (3492): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3836, iMonCtr=1 Model crash detected, will try to restart... Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3536, iMonCtr=1 Model crash detected, will try to restart... Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 Sorry, too many model crashes! :-( Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
22 Sep 2011 11:45:37	1092103	13338681	hadcm3n_o5vp_1900_40_007440440_3	336,960	486,746	1.4445
22 Sep 2011 01:12:51	1092103	13338681	hadcm3n_o5vp_1900_40_007440440_3	311,040	448,915	1.4433
21 Sep 2011 14:41:15	1092103	13338681	hadcm3n_o5vp_1900_40_007440440_3	285,120	410,881	1.4411
21 Sep 2011 04:38:59	1092103	13338681	hadcm3n_o5vp_1900_40_007440440_3	259,200	372,690	1.4378
20 Sep 2011 23:00:03	1092103	13338681	hadcm3n_o5vp_1900_40_007440440_3	233,280	336,150	1.4410
16 Sep 2011 16:35:49	1092103	13338681	hadcm3n_o5vp_1900_40_007440440_3	207,360	301,963	1.4562
09 Sep 2011 01:10:23	1092103	13338681	hadcm3n_o5vp_1900_40_007440440_3	181,440	271,915	1.4986
08 Sep 2011 14:20:13	1092103	13338681	hadcm3n_o5vp_1900_40_007440440_3	155,520	232,970	1.4980
08 Sep 2011 03:36:42	1092103	13338681	hadcm3n_o5vp_1900_40_007440440_3	129,600	194,065	1.4974
07 Sep 2011 16:59:39	1092103	13338681	hadcm3n_o5vp_1900_40_007440440_3	103,680	155,162	1.4965
07 Sep 2011 06:13:24	1092103	13338681	hadcm3n_o5vp_1900_40_007440440_3	77,760	116,184	1.4941
06 Sep 2011 19:28:29	1092103	13338681	hadcm3n_o5vp_1900_40_007440440_3	51,840	77,161	1.4884
06 Sep 2011 08:50:19	1092103	13338681	hadcm3n_o5vp_1900_40_007440440_3	25,920	38,157	1.4721