Task 13607961

Name	hadcm3n_o28j_1980_40_007539081_0
Workunit	7736313
Created	5 Nov 2011, 23:46:06 UTC
Sent	7 Nov 2011, 3:30:29 UTC
Report deadline	6 Feb 2012, 10:57:40 UTC
Received	28 Jan 2012, 1:30:45 UTC
Server state	Over
Outcome	Computation error
Client state	Aborted by user
Exit status	-197 (0xFFFFFF3B) ERR_ABORTED_VIA_GUI
Computer ID	1102379
Run time	10 days 9 hours 10 min 40 sec
CPU time	9 days 22 hours 54 min 15 sec
Validate state	Invalid
Credit	5,287.68
Device peak FLOPS	2.90 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>6.10.60</core_client_version> <![CDATA[ <message> aborted by user </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3572, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3576, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3464, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3392, iMonCtr=1 Model crash detected, will try to restart... 00:49:31 (3408): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3824, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3304, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3464, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3548, iMonCtr=1 Model crash detected, will try to restart... CController:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3504, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3968, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4836, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4836, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4652, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3348, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3652, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3568, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3300, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3996, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4024, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4268, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4176, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3568, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3688, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4032, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3976, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4236, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3756, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... 16:03:47 (3432): No heartbeat from core client for 30 sec - exiting 16:03:48 (3432): No heartbeat from core client for 30 sec - exiting 16:03:49 (3432): No heartbeat from core client for 30 sec - exiting 16:03:50 (3432): No heartbeat from core client for 30 sec - exiting 16:03:51 (3432): No heartbeat from core client for 30 sec - exiting 16:03:52 (3432): No heartbeat from core client for 30 sec - exiting 16:03:53 (3432): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:03:54 (3432): No heartbeat from core client for 30 sec - exiting Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2648, iMonCtr=1 Model crash detected, will try to restart... 19:11:10 (3480): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:33:42 (4332): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:21:39 (4732): No heartbeat from core client for 30 sec - exiting 23:21:40 (4732): No heartbeat from core client for 30 sec - exiting 23:21:41 (4732): No heartbeat from core client for 30 sec - exiting 23:21:42 (4732): No heartbeat from core client for 30 sec - exiting 23:21:43 (4732): No heartbeat from core client for 30 sec - exiting 23:21:44 (4732): No heartbeat from core client for 30 sec - exiting 23:21:45 (4732): No heartbeat from core client for 30 sec - exiting 23:21:47 (4732): No heartbeat from core client for 30 sec - exiting 23:21:48 (4732): No heartbeat from core client for 30 sec - exiting 23:21:49 (4732): No heartbeat from core client for 30 sec - exiting 23:21:50 (4732): No heartbeat from core client for 30 sec - exiting 23:21:51 (4732): No heartbeat from core client for 30 sec - exiting 23:21:52 (4732): No heartbeat from core client for 30 sec - exiting 23:21:53 (4732): No heartbeat from core client for 30 sec - exiting 23:21:54 (4732): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:47:04 (3696): No heartbeat from core client for 30 sec - exiting 20:47:05 (3696): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4608, iMonCtr=1 Model crash detected, will try to restart... 21:01:38 (4444): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:14:02 (2256): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:35:27 (4760): No heartbeat from core client for 30 sec - exiting 08:35:28 (4760): No heartbeat from core client for 30 sec - exiting 08:35:29 (4760): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:35:31 (4760): No heartbeat from core client for 30 sec - exiting 08:35:32 (4760): No heartbeat from core client for 30 sec - exiting 12:21:42 (2016): No heartbeat from core client for 30 sec - exiting 12:21:43 (2016): No heartbeat from core client for 30 sec - exiting 12:21:44 (2016): No heartbeat from core client for 30 sec - exiting 12:21:45 (2016): No heartbeat from core client for 30 sec - exiting 12:21:46 (2016): No heartbeat from core client for 30 sec - exiting 12:21:47 (2016): No heartbeat from core client for 30 sec - exiting 12:21:48 (2016): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:21:49 (2016): No heartbeat from core client for 30 sec - exiting 12:21:51 (2016): No heartbeat from core client for 30 sec - exiting 12:21:52 (2016): No heartbeat from core client for 30 sec - exiting 18:33:06 (3608): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:12:58 (4844): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:14:34 (4600): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:47:24 (3604): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:47:26 (3808): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3568, iMonCtr=1 Model crash detected, will try to restart... 23:03:16 (3956): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:03:17 (3956): No heartbeat from core client for 30 sec - exiting 23:03:18 (3956): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... 23:07:50 (1852): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4048, iMonCtr=1 Model crash detected, will try to restart... 19:43:22 (3220): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:43:24 (3220): No heartbeat from core client for 30 sec - exiting 20:52:08 (4272): No heartbeat from core client for 30 sec - exiting 20:52:09 (4272): No heartbeat from core client for 30 sec - exiting 20:52:10 (4272): No heartbeat from core client for 30 sec - exiting 20:52:12 (4272): No heartbeat from core client for 30 sec - exiting 20:52:13 (4272): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4892, iMonCtr=1 Model crash detected, will try to restart... 23:29:50 (3436): No heartbeat from core client for 30 sec - exiting 23:29:51 (3436): No heartbeat from core client for 30 sec - exiting 23:29:52 (3436): No heartbeat from core client for 30 sec - exiting 23:29:53 (3436): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2884, iMonCtr=1 Model crash detected, will try to restart... 08:17:27 (3984): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4504, iMonCtr=1 Model crash detected, will try to restart... 15:24:29 (5032): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:29:23 (4260): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5056, iMonCtr=1 Model crash detected, will try to restart... 08:21:00 (4852): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:11:32 (3900): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:03:44 (4220): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:33:45 (5000): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:33:46 (5000): No heartbeat from core client for 30 sec - exiting 08:33:47 (5000): No heartbeat from core client for 30 sec - exiting Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5336, iMonCtr=1 Model crash detected, will try to restart... 14:44:40 (4084): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:44:41 (4084): No heartbeat from core client for 30 sec - exiting 22:20:05 (4328): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:20:06 (4328): No heartbeat from core client for 30 sec - exiting 09:33:02 (3532): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:29:25 (3864): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:00:26 (3432): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:05:36 (3432): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:05:37 (3432): No heartbeat from core client for 30 sec - exiting 09:05:38 (3432): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Abort request from BOINC... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
20 Jan 2012 09:14:55	1102379	13607961	hadcm3n_o28j_1980_40_007539081_0	440,640	836,532	1.8984
15 Jan 2012 03:24:20	1102379	13607961	hadcm3n_o28j_1980_40_007539081_0	414,720	789,204	1.9030
08 Jan 2012 06:59:31	1102379	13607961	hadcm3n_o28j_1980_40_007539081_0	388,800	741,752	1.9078
31 Dec 2011 01:09:25	1102379	13607961	hadcm3n_o28j_1980_40_007539081_0	362,880	692,201	1.9075
24 Dec 2011 04:54:15	1102379	13607961	hadcm3n_o28j_1980_40_007539081_0	336,960	643,248	1.9090
07 Dec 2011 05:24:48	1102379	13607961	hadcm3n_o28j_1980_40_007539081_0	311,040	593,987	1.9097
06 Dec 2011 00:01:50	1102379	13607961	hadcm3n_o28j_1980_40_007539081_0	285,120	544,427	1.9095
02 Dec 2011 03:30:31	1102379	13607961	hadcm3n_o28j_1980_40_007539081_0	259,200	492,470	1.9000
28 Nov 2011 00:53:13	1102379	13607961	hadcm3n_o28j_1980_40_007539081_0	233,280	442,930	1.8987
25 Nov 2011 09:06:03	1102379	13607961	hadcm3n_o28j_1980_40_007539081_0	207,360	394,135	1.9007
23 Nov 2011 09:02:52	1102379	13607961	hadcm3n_o28j_1980_40_007539081_0	181,440	344,668	1.8996
22 Nov 2011 09:08:54	1102379	13607961	hadcm3n_o28j_1980_40_007539081_0	155,520	294,164	1.8915
21 Nov 2011 16:20:32	1102379	13607961	hadcm3n_o28j_1980_40_007539081_0	129,600	244,990	1.8904
20 Nov 2011 16:04:28	1102379	13607961	hadcm3n_o28j_1980_40_007539081_0	103,680	196,448	1.8948
18 Nov 2011 04:53:09	1102379	13607961	hadcm3n_o28j_1980_40_007539081_0	77,760	147,856	1.9014
17 Nov 2011 06:57:49	1102379	13607961	hadcm3n_o28j_1980_40_007539081_0	51,840	98,853	1.9069
16 Nov 2011 07:09:08	1102379	13607961	hadcm3n_o28j_1980_40_007539081_0	25,920	48,476	1.8702