Task 15472533

Name	hadcm3n_zgj7_1920_40_008255260_0
Workunit	8410384
Created	6 Dec 2012, 19:37:09 UTC
Sent	6 Dec 2012, 19:37:30 UTC
Report deadline	8 Mar 2013, 3:04:41 UTC
Received	12 Jan 2013, 11:03:13 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	193 (0x000000C1) EXIT_SIGNAL
Computer ID	1125151
Run time	17 days 17 hours 3 min 32 sec
CPU time	17 days 14 hours 6 min 35 sec
Validate state	Invalid
Credit	9,331.20
Device peak FLOPS	2.97 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>6.12.34</core_client_version> <![CDATA[ <message> - exit code 193 (0xc1) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 03:23:21 (3508): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 22:25:23 (3060): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:29:03 (2316): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:32:18 (4448): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1948, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... 20:12:57 (3848): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:12:58 (3848): No heartbeat from core client for 30 sec - exiting 20:15:03 (3964): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:17:30 (5100): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4740, iMonCtr=1 Model crash detected, will try to restart... 03:23:15 (3848): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:26:54 (412): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:29:04 (4776): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:14:57 (3184): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:14:58 (3184): No heartbeat from core client for 30 sec - exiting 20:14:59 (3184): No heartbeat from core client for 30 sec - exiting 20:15:00 (3184): No heartbeat from core client for 30 sec - exiting 14:16:00 (3692): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:16:01 (3692): No heartbeat from core client for 30 sec - exiting 14:16:02 (3692): No heartbeat from core client for 30 sec - exiting 14:16:03 (3692): No heartbeat from core client for 30 sec - exiting 14:16:04 (3692): No heartbeat from core client for 30 sec - exiting 14:16:05 (3692): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... 10:22:32 (4492): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:22:33 (4492): No heartbeat from core client for 30 sec - exiting 10:22:34 (4492): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 10:25:19 (1768): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:25:21 (1768): No heartbeat from core client for 30 sec - exiting 10:25:22 (1768): No heartbeat from core client for 30 sec - exiting 10:25:23 (1768): No heartbeat from core client for 30 sec - exiting 10:25:24 (1768): No heartbeat from core client for 30 sec - exiting 21:20:11 (4340): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:20:13 (4340): No heartbeat from core client for 30 sec - exiting 21:20:14 (4340): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 21:24:37 (2308): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:24:38 (2308): No heartbeat from core client for 30 sec - exiting 21:27:57 (2032): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:30:02 (4844): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:19:33 (3012): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:19:35 (3012): No heartbeat from core client for 30 sec - exiting 22:19:36 (3012): No heartbeat from core client for 30 sec - exiting 22:23:11 (3080): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:23:12 (3080): No heartbeat from core client for 30 sec - exiting 22:26:04 (4852): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:28:46 (3932): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:28:47 (3932): No heartbeat from core client for 30 sec - exiting 22:28:48 (3932): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... 22:40:52 (2312): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:40:53 (2312): No heartbeat from core client for 30 sec - exiting 22:40:54 (2312): No heartbeat from core client for 30 sec - exiting 22:40:55 (2312): No heartbeat from core client for 30 sec - exiting 22:40:56 (2312): No heartbeat from core client for 30 sec - exiting 22:43:42 (3524): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:44:28 (4024): No heartbeat from core client for 30 sec - exiting 22:44:29 (4024): No heartbeat from core client for 30 sec - exiting 22:44:30 (4024): No heartbeat from core client for 30 sec - exiting 22:44:31 (4024): No heartbeat from core client for 30 sec - exiting 22:44:32 (4024): No heartbeat from core client for 30 sec - exiting 22:44:33 (4024): No heartbeat from core client for 30 sec - exiting 22:44:34 (4024): No heartbeat from core client for 30 sec - exiting 22:44:35 (4024): No heartbeat from core client for 30 sec - exiting 22:44:36 (4024): No heartbeat from core client for 30 sec - exiting 22:44:37 (4024): No heartbeat from core client for 30 sec - exiting 22:44:38 (4024): No heartbeat from core client for 30 sec - exiting 22:44:40 (4024): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:45:25 (4480): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:46:29 (4740): No heartbeat from core client for 30 sec - exiting 22:46:31 (4740): No heartbeat from core client for 30 sec - exiting 22:46:32 (4740): No heartbeat from core client for 30 sec - exiting 22:46:33 (4740): No heartbeat from core client for 30 sec - exiting 22:46:34 (4740): No heartbeat from core client for 30 sec - exiting 22:46:35 (4740): No heartbeat from core client for 30 sec - exiting 22:46:36 (4740): No heartbeat from core client for 30 sec - exiting 22:46:37 (4740): No heartbeat from core client for 30 sec - exiting 22:46:38 (4740): No heartbeat from core client for 30 sec - exiting 22:46:39 (4740): No heartbeat from core client for 30 sec - exiting 22:46:40 (4740): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:28:55 (2780): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:28:58 (2780): No heartbeat from core client for 30 sec - exiting 23:28:59 (2780): No heartbeat from core client for 30 sec - exiting 23:31:18 (2232): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:24:51 (3352): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:24:53 (3352): No heartbeat from core client for 30 sec - exiting 16:24:54 (3352): No heartbeat from core client for 30 sec - exiting 16:24:55 (3352): No heartbeat from core client for 30 sec - exiting 16:24:56 (3352): No heartbeat from core client for 30 sec - exiting 16:26:49 (3348): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:28:38 (4512): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:18:48 (3132): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:18:49 (3132): No heartbeat from core client for 30 sec - exiting 21:18:50 (3132): No heartbeat from core client for 30 sec - exiting 21:18:51 (3132): No heartbeat from core client for 30 sec - exiting 21:18:52 (3132): No heartbeat from core client for 30 sec - exiting 21:20:51 (1460): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:23:26 (1444): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:58:24 (4420): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:58:26 (4420): No heartbeat from core client for 30 sec - exiting 04:58:27 (4420): No heartbeat from core client for 30 sec - exiting 04:58:28 (4420): No heartbeat from core client for 30 sec - exiting 04:58:29 (4420): No heartbeat from core client for 30 sec - exiting 04:58:30 (4420): No heartbeat from core client for 30 sec - exiting 04:58:31 (4420): No heartbeat from core client for 30 sec - exiting 04:58:32 (4420): No heartbeat from core client for 30 sec - exiting 12:25:02 (4940): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:25:04 (4940): No heartbeat from core client for 30 sec - exiting 12:25:05 (4940): No heartbeat from core client for 30 sec - exiting 12:25:06 (4940): No heartbeat from core client for 30 sec - exiting 16:46:18 (1684): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:46:20 (1684): No heartbeat from core client for 30 sec - exiting 16:46:21 (1684): No heartbeat from core client for 30 sec - exiting 16:46:22 (1684): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... 00:37:43 (5040): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:40:16 (960): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:40:18 (960): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... Atmos Hold Restart file rename failed on atmos_restart.hold CPDN Monitor - Quit request from BOINC... 03:08:30 (2256): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:08:32 (2256): No heartbeat from core client for 30 sec - exiting 03:10:19 (4556): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:12:41 (1036): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:22:03 (492): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:22:05 (492): No heartbeat from core client for 30 sec - exiting 03:29:23 (2464): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:29:25 (2464): No heartbeat from core client for 30 sec - exiting 03:29:26 (2464): No heartbeat from core client for 30 sec - exiting 03:29:27 (2464): No heartbeat from core client for 30 sec - exiting 03:31:48 (3420): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:33:31 (4512): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:46:37 (1464): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:46:38 (1464): No heartbeat from core client for 30 sec - exiting 03:52:28 (4044): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:52:29 (4044): No heartbeat from core client for 30 sec - exiting 03:54:39 (3992): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:56:21 (3372): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:58:02 (4124): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:59:39 (160): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:01:34 (2884): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:07:06 (3516): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:07:08 (3516): No heartbeat from core client for 30 sec - exiting 04:09:31 (1180): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:11:56 (4512): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:14:09 (1868): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CSignal 11 received, exiting... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
12 Jan 2013 10:04:35	1125151	15472533	hadcm3n_zgj7_1920_40_008255260_0	777,600	1,519,589	1.9542
06 Jan 2013 13:12:02	1125151	15472533	hadcm3n_zgj7_1920_40_008255260_0	751,680	1,473,269	1.9600
05 Jan 2013 18:33:00	1125151	15472533	hadcm3n_zgj7_1920_40_008255260_0	725,760	1,407,875	1.9399
05 Jan 2013 00:58:59	1125151	15472533	hadcm3n_zgj7_1920_40_008255260_0	699,840	1,341,957	1.9175
04 Jan 2013 04:49:30	1125151	15472533	hadcm3n_zgj7_1920_40_008255260_0	673,920	1,276,506	1.8942
03 Jan 2013 11:06:27	1125151	15472533	hadcm3n_zgj7_1920_40_008255260_0	648,000	1,214,680	1.8745
02 Jan 2013 18:42:51	1125151	15472533	hadcm3n_zgj7_1920_40_008255260_0	622,080	1,155,063	1.8568
01 Jan 2013 05:15:39	1125151	15472533	hadcm3n_zgj7_1920_40_008255260_0	596,160	1,090,912	1.8299
31 Dec 2012 10:33:49	1125151	15472533	hadcm3n_zgj7_1920_40_008255260_0	570,240	1,024,507	1.7966
30 Dec 2012 16:46:14	1125151	15472533	hadcm3n_zgj7_1920_40_008255260_0	544,320	958,909	1.7617
29 Dec 2012 21:56:19	1125151	15472533	hadcm3n_zgj7_1920_40_008255260_0	518,400	892,788	1.7222
29 Dec 2012 03:44:16	1125151	15472533	hadcm3n_zgj7_1920_40_008255260_0	492,480	828,434	1.6822
26 Dec 2012 06:33:30	1125151	15472533	hadcm3n_zgj7_1920_40_008255260_0	466,560	775,938	1.6631
25 Dec 2012 18:26:53	1125151	15472533	hadcm3n_zgj7_1920_40_008255260_0	440,640	731,559	1.6602
25 Dec 2012 06:11:59	1125151	15472533	hadcm3n_zgj7_1920_40_008255260_0	414,720	687,603	1.6580
24 Dec 2012 17:46:45	1125151	15472533	hadcm3n_zgj7_1920_40_008255260_0	388,800	643,410	1.6549
24 Dec 2012 05:17:00	1125151	15472533	hadcm3n_zgj7_1920_40_008255260_0	362,880	598,653	1.6497
23 Dec 2012 16:54:55	1125151	15472533	hadcm3n_zgj7_1920_40_008255260_0	336,960	554,544	1.6457
23 Dec 2012 04:07:08	1125151	15472533	hadcm3n_zgj7_1920_40_008255260_0	311,040	509,398	1.6377
22 Dec 2012 15:40:48	1125151	15472533	hadcm3n_zgj7_1920_40_008255260_0	285,120	463,175	1.6245