Task 15439059

Name	hadcm3n_zc4t_1920_40_008245168_1
Workunit	8400292
Created	19 Nov 2012, 16:31:36 UTC
Sent	19 Nov 2012, 16:31:38 UTC
Report deadline	18 Feb 2013, 23:58:49 UTC
Received	13 Jan 2013, 17:46:15 UTC
Server state	Over
Outcome	Computation error
Client state	Aborted by user
Exit status	203 (0x000000CB) EXIT_ABORTED_VIA_GUI
Computer ID	1114363
Run time	14 days 19 hours 33 min 24 sec
CPU time	14 days 6 hours 7 min 44 sec
Validate state	Invalid
Credit	6,220.80
Device peak FLOPS	2.45 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>7.0.28</core_client_version> <![CDATA[ <message> aborted by user </message> <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4292, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4292, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4572, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4580, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4524, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4360, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4756, iMonCtr=1 Model crash detected, will try to restart... 17:56:07 (5472): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 07:04:53 (4764): No heartbeat from core client for 30 sec - exiting 07:04:55 (4764): No heartbeat from core client for 30 sec - exiting 07:04:56 (4764): No heartbeat from core client for 30 sec - exiting 07:04:57 (4764): No heartbeat from core client for 30 sec - exiting 07:04:58 (4764): No heartbeat from core client for 30 sec - exiting 07:04:59 (4764): No heartbeat from core client for 30 sec - exiting 07:05:00 (4764): No heartbeat from core client for 30 sec - exiting 07:05:01 (4764): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5576, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5576, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5576, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5576, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5976, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5976, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5976, iMonCtr=1 Model crash detected, will try to restart... Sorry, too many model crashes! :-( Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
12 Jan 2013 18:31:30	1114363	15439059	hadcm3n_zc4t_1920_40_008245168_1	518,400	1,185,137	2.2861
12 Jan 2013 00:07:41	1114363	15439059	hadcm3n_zc4t_1920_40_008245168_1	492,480	1,128,335	2.2911
11 Jan 2013 05:48:48	1114363	15439059	hadcm3n_zc4t_1920_40_008245168_1	466,560	1,068,406	2.2900
10 Jan 2013 13:15:18	1114363	15439059	hadcm3n_zc4t_1920_40_008245168_1	440,640	1,010,997	2.2944
06 Jan 2013 16:27:47	1114363	15439059	hadcm3n_zc4t_1920_40_008245168_1	414,720	949,326	2.2891
05 Jan 2013 22:03:30	1114363	15439059	hadcm3n_zc4t_1920_40_008245168_1	388,800	887,303	2.2822
05 Jan 2013 04:50:00	1114363	15439059	hadcm3n_zc4t_1920_40_008245168_1	362,880	826,442	2.2775
01 Jan 2013 18:13:12	1114363	15439059	hadcm3n_zc4t_1920_40_008245168_1	336,960	767,269	2.2770
20 Dec 2012 08:26:44	1114363	15439059	hadcm3n_zc4t_1920_40_008245168_1	311,040	718,702	2.3106
19 Dec 2012 19:30:51	1114363	15439059	hadcm3n_zc4t_1920_40_008245168_1	285,120	671,657	2.3557
18 Dec 2012 03:05:42	1114363	15439059	hadcm3n_zc4t_1920_40_008245168_1	259,200	614,062	2.3691
16 Dec 2012 13:45:33	1114363	15439059	hadcm3n_zc4t_1920_40_008245168_1	233,280	554,828	2.3784
15 Dec 2012 20:46:19	1114363	15439059	hadcm3n_zc4t_1920_40_008245168_1	207,360	494,441	2.3845
15 Dec 2012 02:32:20	1114363	15439059	hadcm3n_zc4t_1920_40_008245168_1	181,440	430,700	2.3738
14 Dec 2012 18:28:41	1114363	15439059	hadcm3n_zc4t_1920_40_008245168_1	155,520	368,601	2.3701
07 Dec 2012 10:17:14	1114363	15439059	hadcm3n_zc4t_1920_40_008245168_1	129,600	309,460	2.3878
06 Dec 2012 17:30:57	1114363	15439059	hadcm3n_zc4t_1920_40_008245168_1	103,680	250,007	2.4113
06 Dec 2012 00:21:45	1114363	15439059	hadcm3n_zc4t_1920_40_008245168_1	77,760	188,379	2.4226
29 Nov 2012 17:08:55	1114363	15439059	hadcm3n_zc4t_1920_40_008245168_1	51,840	123,046	2.3736
29 Nov 2012 00:00:37	1114363	15439059	hadcm3n_zc4t_1920_40_008245168_1	25,920	61,493	2.3724