Task 16585676

Name	hadcm3n_88ui_1980_40_008720885_0
Workunit	8866863
Created	23 Apr 2014, 12:28:39 UTC
Sent	5 May 2014, 15:02:56 UTC
Report deadline	4 Aug 2014, 22:30:07 UTC
Received	29 May 2014, 16:40:51 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	193 (0x000000C1) EXIT_SIGNAL
Computer ID	1169946
Run time	4 days 9 hours 27 min 29 sec
CPU time	3 days 22 hours 0 min 41 sec
Validate state	Invalid
Credit	3,110.40
Device peak FLOPS	3.25 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>7.2.42</core_client_version> <![CDATA[ <message> (unknown error) - exit code 193 (0xc1) </message> <stderr_txt> 07:26:12 (7140): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:16:26 (7164): No heartbeat from core client for 30 sec - exiting 21:16:27 (7164): No heartbeat from core client for 30 sec - exiting 21:16:28 (7164): No heartbeat from core client for 30 sec - exiting 21:16:29 (7164): No heartbeat from core client for 30 sec - exiting 21:16:30 (7164): No heartbeat from core client for 30 sec - exiting 21:16:31 (7164): No heartbeat from core client for 30 sec - exiting 21:16:32 (7164): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:54:41 (5988): No heartbeat from core client for 30 sec - exiting 08:54:42 (5988): No heartbeat from core client for 30 sec - exiting 08:54:43 (5988): No heartbeat from core client for 30 sec - exiting 08:54:44 (5988): No heartbeat from core client for 30 sec - exiting 08:54:45 (5988): No heartbeat from core client for 30 sec - exiting 08:54:46 (5988): No heartbeat from core client for 30 sec - exiting 08:54:47 (5988): No heartbeat from core client for 30 sec - exiting 08:54:48 (5988): No heartbeat from core client for 30 sec - exiting 08:54:49 (5988): No heartbeat from core client for 30 sec - exiting 08:54:50 (5988): No heartbeat from core client for 30 sec - exiting 08:54:51 (5988): No heartbeat from core client for 30 sec - exiting 08:54:52 (5988): No heartbeat from core client for 30 sec - exiting 08:54:53 (5988): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:25:40 (6936): No heartbeat from core client for 30 sec - exiting 22:25:42 (6936): No heartbeat from core client for 30 sec - exiting 22:25:43 (6936): No heartbeat from core client for 30 sec - exiting 22:25:44 (6936): No heartbeat from core client for 30 sec - exiting 22:25:45 (6936): No heartbeat from core client for 30 sec - exiting 22:25:46 (6936): No heartbeat from core client for 30 sec - exiting 22:25:47 (6936): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:25:48 (6936): No heartbeat from core client for 30 sec - exiting 09:25:13 (6100): No heartbeat from core client for 30 sec - exiting 09:25:15 (6100): No heartbeat from core client for 30 sec - exiting 09:25:16 (6100): No heartbeat from core client for 30 sec - exiting 09:25:17 (6100): No heartbeat from core client for 30 sec - exiting 09:25:18 (6100): No heartbeat from core client for 30 sec - exiting 09:25:19 (6100): No heartbeat from core client for 30 sec - exiting 09:25:20 (6100): No heartbeat from core client for 30 sec - exiting 09:25:21 (6100): No heartbeat from core client for 30 sec - exiting 09:25:22 (6100): No heartbeat from core client for 30 sec - exiting 09:25:23 (6100): No heartbeat from core client for 30 sec - exiting 09:25:24 (6100): No heartbeat from core client for 30 sec - exiting 09:25:25 (6100): No heartbeat from core client for 30 sec - exiting 09:25:26 (6100): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 11:09:16 (6580): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:45:19 (6876): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:15:50 (6512): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:15:51 (6512): No heartbeat from core client for 30 sec - exiting 18:15:52 (6512): No heartbeat from core client for 30 sec - exiting 18:15:53 (6512): No heartbeat from core client for 30 sec - exiting 18:15:54 (6512): No heartbeat from core client for 30 sec - exiting 18:15:55 (6512): No heartbeat from core client for 30 sec - exiting 18:15:56 (6512): No heartbeat from core client for 30 sec - exiting 18:15:57 (6512): No heartbeat from core client for 30 sec - exiting 18:15:58 (6512): No heartbeat from core client for 30 sec - exiting 18:15:59 (6512): No heartbeat from core client for 30 sec - exiting 07:30:22 (4532): No heartbeat from core client for 30 sec - exiting 07:30:23 (4532): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:13:43 (4504): No heartbeat from core client for 30 sec - exiting 07:13:44 (4504): No heartbeat from core client for 30 sec - exiting 07:13:45 (4504): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:32:43 (7048): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:01:57 (2200): No heartbeat from core client for 30 sec - exiting 10:01:58 (2200): No heartbeat from core client for 30 sec - exiting 10:01:59 (2200): No heartbeat from core client for 30 sec - exiting 10:02:00 (2200): No heartbeat from core client for 30 sec - exiting 10:02:01 (2200): No heartbeat from core client for 30 sec - exiting 10:02:02 (2200): No heartbeat from core client for 30 sec - exiting 10:02:03 (2200): No heartbeat from core client for 30 sec - exiting 10:02:04 (2200): No heartbeat from core client for 30 sec - exiting 10:02:05 (2200): No heartbeat from core client for 30 sec - exiting 10:02:06 (2200): No heartbeat from core client for 30 sec - exiting 10:02:07 (2200): No heartbeat from core client for 30 sec - exiting 10:02:08 (2200): No heartbeat from core client for 30 sec - exiting 10:02:09 (2200): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1124, iMonCtr=1 Model crash detected, will try to restart... 21:09:21 (5320): No heartbeat from core client for 30 sec - exiting 21:09:22 (5320): No heartbeat from core client for 30 sec - exiting 21:09:23 (5320): No heartbeat from core client for 30 sec - exiting 21:09:24 (5320): No heartbeat from core client for 30 sec - exiting 21:09:25 (5320): No heartbeat from core client for 30 sec - exiting 21:09:26 (5320): No heartbeat from core client for 30 sec - exiting 21:09:27 (5320): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:13:23 (7052): No heartbeat from core client for 30 sec - exiting 08:13:25 (7052): No heartbeat from core client for 30 sec - exiting 08:13:26 (7052): No heartbeat from core client for 30 sec - exiting 08:13:27 (7052): No heartbeat from core client for 30 sec - exiting 08:13:28 (7052): No heartbeat from core client for 30 sec - exiting 08:13:29 (7052): No heartbeat from core client for 30 sec - exiting 08:13:30 (7052): No heartbeat from core client for 30 sec - exiting 08:13:31 (7052): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:38:23 (4188): No heartbeat from core client for 30 sec - exiting 10:38:25 (4188): No heartbeat from core client for 30 sec - exiting 10:38:26 (4188): No heartbeat from core client for 30 sec - exiting 10:38:27 (4188): No heartbeat from core client for 30 sec - exiting 10:38:28 (4188): No heartbeat from core client for 30 sec - exiting 10:38:29 (4188): No heartbeat from core client for 30 sec - exiting 10:38:30 (4188): No heartbeat from core client for 30 sec - exiting 10:38:31 (4188): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:54:49 (6880): No heartbeat from core client for 30 sec - exiting 22:54:50 (6880): No heartbeat from core client for 30 sec - exiting 22:54:51 (6880): No heartbeat from core client for 30 sec - exiting 22:54:52 (6880): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:27:24 (512): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:32:53 (5020): No heartbeat from core client for 30 sec - exiting 19:32:55 (5020): No heartbeat from core client for 30 sec - exiting 19:32:56 (5020): No heartbeat from core client for 30 sec - exiting 19:32:57 (5020): No heartbeat from core client for 30 sec - exiting 19:32:58 (5020): No heartbeat from core client for 30 sec - exiting 19:32:59 (5020): No heartbeat from core client for 30 sec - exiting 19:33:00 (5020): No heartbeat from core client for 30 sec - exiting 19:33:01 (5020): No heartbeat from core client for 30 sec - exiting 19:33:02 (5020): No heartbeat from core client for 30 sec - exiting 19:33:03 (5020): No heartbeat from core client for 30 sec - exiting 19:33:04 (5020): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:07:30 (6752): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:56:21 (3876): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:46:01 (6036): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:20:20 (2976): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:42:02 (3608): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:15:19 (5948): No heartbeat from core client for 30 sec - exiting 10:15:20 (5948): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7120, iMonCtr=1 Model crash detected, will try to restart... 20:08:56 (5220): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 00:03:09 (3160): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:38:55 (6436): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:05:08 (4936): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:05:40 (6952): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:03:23 (6660): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:44:24 (5820): No heartbeat from core client for 30 sec - exiting 21:44:25 (5820): No heartbeat from core client for 30 sec - exiting 21:44:26 (5820): No heartbeat from core client for 30 sec - exiting 21:44:27 (5820): No heartbeat from core client for 30 sec - exiting 21:44:28 (5820): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:24:35 (5876): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:30:04 (6020): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:05:48 (6820): No heartbeat from core client for 30 sec - exiting 20:05:49 (6820): No heartbeat from core client for 30 sec - exiting 20:05:50 (6820): No heartbeat from core client for 30 sec - exiting 20:05:51 (6820): No heartbeat from core client for 30 sec - exiting 20:05:52 (6820): No heartbeat from core client for 30 sec - exiting 20:05:53 (6820): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3748, iMonCtr=1 Model crash detected, will try to restart... 20:23:08 (6408): No heartbeat from core client for 30 sec - exiting 20:23:09 (6408): No heartbeat from core client for 30 sec - exiting 20:23:10 (6408): No heartbeat from core client for 30 sec - exiting 20:23:11 (6408): No heartbeat from core client for 30 sec - exiting 20:23:12 (6408): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:23:13 (6408): No heartbeat from core client for 30 sec - exiting 21:29:51 (5752): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:22:32 (2644): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:23:25 (3400): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:38:31 (6652): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:49:33 (3460): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:16:35 (4244): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:26:23 (6376): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 11:33:43 (3760): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:11:35 (4860): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:11:11 (5596): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:13:46 (5296): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 22:39:16 (6892): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5880, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5692, iMonCtr=1 Model crash detected, will try to restart... Signal 11 received, exiting... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
29 May 2014 15:41:14	1169946	16585676	hadcm3n_88ui_1980_40_008720885_0	259,200	338,436	1.3057
25 May 2014 19:40:11	1169946	16585676	hadcm3n_88ui_1980_40_008720885_0	233,280	305,925	1.3114
24 May 2014 23:24:43	1169946	16585676	hadcm3n_88ui_1980_40_008720885_0	207,360	272,570	1.3145
22 May 2014 05:14:22	1169946	16585676	hadcm3n_88ui_1980_40_008720885_0	181,440	238,616	1.3151
19 May 2014 05:02:35	1169946	16585676	hadcm3n_88ui_1980_40_008720885_0	155,520	205,548	1.3217
16 May 2014 18:44:00	1169946	16585676	hadcm3n_88ui_1980_40_008720885_0	129,600	171,228	1.3212
15 May 2014 06:28:02	1169946	16585676	hadcm3n_88ui_1980_40_008720885_0	103,680	135,594	1.3078
11 May 2014 00:54:37	1169946	16585676	hadcm3n_88ui_1980_40_008720885_0	77,760	102,879	1.3230
10 May 2014 14:24:03	1169946	16585676	hadcm3n_88ui_1980_40_008720885_0	51,840	68,515	1.3217
08 May 2014 21:08:06	1169946	16585676	hadcm3n_88ui_1980_40_008720885_0	25,920	33,744	1.3019