Task 13337452

Name	hadcm3n_o59p_1900_40_007440305_1
Workunit	7637808
Created	5 Sep 2011, 18:19:42 UTC
Sent	5 Sep 2011, 21:17:25 UTC
Report deadline	6 Dec 2011, 4:44:36 UTC
Received	22 Sep 2011, 21:36:20 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	1092103
Run time	6 days 0 hours 52 min 21 sec
CPU time	4 days 6 hours 3 min 32 sec
Validate state	Invalid
Credit	4,043.52
Device peak FLOPS	3.06 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>6.10.58</core_client_version> <![CDATA[ <message> The device does not recognize the command. (0x16) - exit code 22 (0x16) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... 19:40:08 (3260): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:43:39 (3932): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:45:15 (2760): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:48:12 (4300): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:50:27 (3440): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:54:32 (4272): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:55:36 (3308): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:57:17 (1312): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:18:21 (1172): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:21:39 (2180): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:29:34 (4900): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:32:49 (3176): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:52:34 (4864): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4780, iMonCtr=1 Model crash detected, will try to restart... 17:04:17 (3512): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3860, iMonCtr=1 Model crash detected, will try to restart... Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3568, iMonCtr=1 Model crash detected, will try to restart... Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3568, iMonCtr=1 Model crash detected, will try to restart... Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 Sorry, too many model crashes! :-( Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
22 Sep 2011 12:46:18	1092103	13337452	hadcm3n_o59p_1900_40_007440305_1	336,960	488,286	1.4491
22 Sep 2011 02:13:32	1092103	13337452	hadcm3n_o59p_1900_40_007440305_1	311,040	450,338	1.4478
21 Sep 2011 15:42:09	1092103	13337452	hadcm3n_o59p_1900_40_007440305_1	285,120	412,186	1.4457
21 Sep 2011 04:38:59	1092103	13337452	hadcm3n_o59p_1900_40_007440305_1	259,200	373,944	1.4427
20 Sep 2011 23:00:03	1092103	13337452	hadcm3n_o59p_1900_40_007440305_1	233,280	337,159	1.4453
16 Sep 2011 16:35:49	1092103	13337452	hadcm3n_o59p_1900_40_007440305_1	207,360	302,788	1.4602
16 Sep 2011 16:35:49	1092103	13337452	hadcm3n_o59p_1900_40_007440305_1	181,440	269,050	1.4829
08 Sep 2011 15:21:34	1092103	13337452	hadcm3n_o59p_1900_40_007440305_1	155,520	233,706	1.5027
08 Sep 2011 03:36:42	1092103	13337452	hadcm3n_o59p_1900_40_007440305_1	129,600	194,678	1.5021
07 Sep 2011 16:59:39	1092103	13337452	hadcm3n_o59p_1900_40_007440305_1	103,680	155,685	1.5016
07 Sep 2011 06:13:24	1092103	13337452	hadcm3n_o59p_1900_40_007440305_1	77,760	116,602	1.4995
06 Sep 2011 19:28:29	1092103	13337452	hadcm3n_o59p_1900_40_007440305_1	51,840	77,502	1.4950
06 Sep 2011 08:50:19	1092103	13337452	hadcm3n_o59p_1900_40_007440305_1	25,920	38,416	1.4821