Task 15778074

Name	hadcm3n_4chm_1940_40_008309061_1
Workunit	8460196
Created	11 May 2013, 18:40:01 UTC
Sent	11 May 2013, 18:43:10 UTC
Report deadline	11 Aug 2013, 2:10:21 UTC
Received	18 Jun 2013, 17:35:44 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	193 (0x000000C1) EXIT_SIGNAL
Computer ID	1097098
Run time	6 days 12 hours 21 min 14 sec
CPU time	6 days 11 hours 34 min 58 sec
Validate state	Invalid
Credit	3,421.44
Device peak FLOPS	2.38 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>7.0.64</core_client_version> <![CDATA[ <message> (unknown error) - exit code 193 (0xc1) </message> <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2988, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5200, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 10:12:49 (5828): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:12:50 (5828): No heartbeat from core client for 30 sec - exiting 10:12:51 (5828): No heartbeat from core client for 30 sec - exiting 10:12:52 (5828): No heartbeat from core client for 30 sec - exiting 10:12:53 (5828): No heartbeat from core client for 30 sec - exiting 10:12:54 (5828): No heartbeat from core client for 30 sec - exiting 10:12:56 (5828): No heartbeat from core client for 30 sec - exiting 10:12:57 (5828): No heartbeat from core client for 30 sec - exiting 10:12:58 (5828): No heartbeat from core client for 30 sec - exiting 10:12:59 (5828): No heartbeat from core client for 30 sec - exiting 10:13:00 (5828): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 19:28:15 (5428): No heartbeat from core client for 30 sec - exiting 19:28:16 (5428): No heartbeat from core client for 30 sec - exiting 19:28:17 (5428): No heartbeat from core client for 30 sec - exiting 19:28:18 (5428): No heartbeat from core client for 30 sec - exiting 19:28:19 (5428): No heartbeat from core client for 30 sec - exiting 19:28:20 (5428): No heartbeat from core client for 30 sec - exiting 19:28:21 (5428): No heartbeat from core client for 30 sec - exiting 19:28:22 (5428): No heartbeat from core client for 30 sec - exiting 19:28:23 (5428): No heartbeat from core client for 30 sec - exiting 19:28:24 (5428): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 20:13:36 (5752): No heartbeat from core client for 30 sec - exiting 20:13:37 (5752): No heartbeat from core client for 30 sec - exiting 20:13:38 (5752): No heartbeat from core client for 30 sec - exiting 20:13:39 (5752): No heartbeat from core client for 30 sec - exiting 20:13:40 (5752): No heartbeat from core client for 30 sec - exiting 20:13:42 (5752): No heartbeat from core client for 30 sec - exiting 20:13:43 (5752): No heartbeat from core client for 30 sec - exiting 20:13:44 (5752): No heartbeat from core client for 30 sec - exiting 20:13:45 (5752): No heartbeat from core client for 30 sec - exiting 20:13:46 (5752): No heartbeat from core client for 30 sec - exiting 20:13:47 (5752): No heartbeat from core client for 30 sec - exiting 20:13:48 (5752): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:13:49 (5752): No heartbeat from core client for 30 sec - exiting 20:13:50 (5752): No heartbeat from core client for 30 sec - exiting 20:13:51 (5752): No heartbeat from core client for 30 sec - exiting 20:13:52 (5752): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 10:12:34 (1336): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:49:53 (4928): No heartbeat from core client for 30 sec - exiting 20:49:54 (4928): No heartbeat from core client for 30 sec - exiting 20:49:55 (4928): No heartbeat from core client for 30 sec - exiting 20:49:56 (4928): No heartbeat from core client for 30 sec - exiting 20:49:58 (4928): No heartbeat from core client for 30 sec - exiting 20:49:59 (4928): No heartbeat from core client for 30 sec - exiting 20:50:00 (4928): No heartbeat from core client for 30 sec - exiting 20:50:01 (4928): No heartbeat from core client for 30 sec - exiting 20:50:02 (4928): No heartbeat from core client for 30 sec - exiting 20:50:03 (4928): No heartbeat from core client for 30 sec - exiting 20:50:04 (4928): No heartbeat from core client for 30 sec - exiting 20:50:05 (4928): No heartbeat from core client for 30 sec - exiting 20:50:06 (4928): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 19:59:52 (6132): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:59:53 (6132): No heartbeat from core client for 30 sec - exiting 19:59:54 (6132): No heartbeat from core client for 30 sec - exiting 19:59:55 (6132): No heartbeat from core client for 30 sec - exiting 19:59:56 (6132): No heartbeat from core client for 30 sec - exiting 19:59:57 (6132): No heartbeat from core client for 30 sec - exiting 19:59:58 (6132): No heartbeat from core client for 30 sec - exiting 20:00:00 (6132): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 17:26:12 (5892): No heartbeat from core client for 30 sec - exiting 17:26:13 (5892): No heartbeat from core client for 30 sec - exiting 17:26:14 (5892): No heartbeat from core client for 30 sec - exiting 17:26:15 (5892): No heartbeat from core client for 30 sec - exiting 17:26:16 (5892): No heartbeat from core client for 30 sec - exiting 17:26:17 (5892): No heartbeat from core client for 30 sec - exiting 17:26:18 (5892): No heartbeat from core client for 30 sec - exiting 17:26:20 (5892): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x775B71A8 read attempt to address 0xFFFFFFF8 Engaging BOINC Windows Runtime Debugger... </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
18 Jun 2013 17:36:49	1097098	15778074	hadcm3n_4chm_1940_40_008309061_1	285,120	560,098	1.9644
17 Jun 2013 14:08:06	1097098	15778074	hadcm3n_4chm_1940_40_008309061_1	259,200	510,757	1.9705
16 Jun 2013 14:58:28	1097098	15778074	hadcm3n_4chm_1940_40_008309061_1	233,280	461,297	1.9774
12 Jun 2013 00:32:07	1097098	15778074	hadcm3n_4chm_1940_40_008309061_1	207,360	410,206	1.9782
09 Jun 2013 03:12:29	1097098	15778074	hadcm3n_4chm_1940_40_008309061_1	181,440	360,750	1.9883
07 Jun 2013 14:27:56	1097098	15778074	hadcm3n_4chm_1940_40_008309061_1	155,520	308,756	1.9853
02 Jun 2013 21:18:23	1097098	15778074	hadcm3n_4chm_1940_40_008309061_1	129,600	257,623	1.9878
28 May 2013 01:56:08	1097098	15778074	hadcm3n_4chm_1940_40_008309061_1	103,680	204,983	1.9771
21 May 2013 01:10:10	1097098	15778074	hadcm3n_4chm_1940_40_008309061_1	77,760	153,166	1.9697
20 May 2013 00:17:55	1097098	15778074	hadcm3n_4chm_1940_40_008309061_1	51,840	102,748	1.9820
15 May 2013 02:13:15	1097098	15778074	hadcm3n_4chm_1940_40_008309061_1	25,920	51,135	1.9728