Task 15456416

Name	hadcm3n_z8p9_1880_40_008252144_0
Workunit	8407268
Created	23 Nov 2012, 11:41:31 UTC
Sent	23 Nov 2012, 11:41:50 UTC
Report deadline	22 Feb 2013, 19:09:01 UTC
Received	1 Dec 2012, 3:50:12 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	193 (0x000000C1) EXIT_SIGNAL
Computer ID	1117213
Run time	3 days 21 hours 50 min 9 sec
CPU time	3 days 21 hours 5 min 23 sec
Validate state	Invalid
Credit	3,110.40
Device peak FLOPS	2.66 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>6.10.58</core_client_version> <![CDATA[ <message> - exit code 193 (0xc1) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... 07:43:31 (4472): No heartbeat from core client for 30 sec - exiting 07:43:32 (4472): No heartbeat from core client for 30 sec - exiting 07:43:33 (4472): No heartbeat from core client for 30 sec - exiting 07:43:34 (4472): No heartbeat from core client for 30 sec - exiting 07:43:35 (4472): No heartbeat from core client for 30 sec - exiting 07:43:36 (4472): No heartbeat from core client for 30 sec - exiting 07:43:37 (4472): No heartbeat from core client for 30 sec - exiting 07:43:38 (4472): No heartbeat from core client for 30 sec - exiting 07:43:39 (4472): No heartbeat from core client for 30 sec - exiting 07:43:40 (4472): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 10:18:37 (4052): No heartbeat from core client for 30 sec - exiting 10:18:38 (4052): No heartbeat from core client for 30 sec - exiting 10:18:39 (4052): No heartbeat from core client for 30 sec - exiting 10:18:40 (4052): No heartbeat from core client for 30 sec - exiting 10:18:41 (4052): No heartbeat from core client for 30 sec - exiting 10:18:42 (4052): No heartbeat from core client for 30 sec - exiting 10:18:43 (4052): No heartbeat from core client for 30 sec - exiting 10:18:44 (4052): No heartbeat from core client for 30 sec - exiting 10:18:45 (4052): No heartbeat from core client for 30 sec - exiting 10:18:46 (4052): No heartbeat from core client for 30 sec - exiting 10:18:47 (4052): No heartbeat from core client for 30 sec - exiting 10:18:48 (4052): No heartbeat from core client for 30 sec - exiting 10:18:49 (4052): No heartbeat from core client for 30 sec - exiting 10:18:50 (4052): No heartbeat from core client for 30 sec - exiting 10:18:51 (4052): No heartbeat from core client for 30 sec - exiting 10:18:52 (4052): No heartbeat from core client for 30 sec - exiting 10:18:53 (4052): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 10:17:14 (4908): No heartbeat from core client for 30 sec - exiting 10:17:15 (4908): No heartbeat from core client for 30 sec - exiting 10:17:16 (4908): No heartbeat from core client for 30 sec - exiting 10:17:17 (4908): No heartbeat from core client for 30 sec - exiting 10:17:18 (4908): No heartbeat from core client for 30 sec - exiting 10:17:19 (4908): No heartbeat from core client for 30 sec - exiting 10:17:20 (4908): No heartbeat from core client for 30 sec - exiting 10:17:21 (4908): No heartbeat from core client for 30 sec - exiting 10:17:22 (4908): No heartbeat from core client for 30 sec - exiting 10:17:23 (4908): No heartbeat from core client for 30 sec - exiting 10:17:24 (4908): No heartbeat from core client for 30 sec - exiting 10:17:25 (4908): No heartbeat from core client for 30 sec - exiting 10:17:26 (4908): No heartbeat from core client for 30 sec - exiting 10:17:27 (4908): No heartbeat from core client for 30 sec - exiting 10:17:28 (4908): No heartbeat from core client for 30 sec - exiting 10:17:29 (4908): No heartbeat from core client for 30 sec - exiting 10:17:30 (4908): No heartbeat from core client for 30 sec - exiting 10:17:31 (4908): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x77812957 read attempt to address 0x408A05E7 Engaging BOINC Windows Runtime Debugger... Cannot serialize file C:\ProgramData\BOINC/projects/climateprediction.net/hadcm3n_z8p9_1880_40_008252144/dataout/shmem_restart.day Signal 11 received, exiting... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
01 Dec 2012 02:49:59	1117213	15456416	hadcm3n_z8p9_1880_40_008252144_0	259,200	335,122	1.2929
30 Nov 2012 17:34:55	1117213	15456416	hadcm3n_z8p9_1880_40_008252144_0	233,280	302,030	1.2947
29 Nov 2012 23:29:40	1117213	15456416	hadcm3n_z8p9_1880_40_008252144_0	207,360	268,465	1.2947
29 Nov 2012 05:56:54	1117213	15456416	hadcm3n_z8p9_1880_40_008252144_0	181,440	234,702	1.2936
28 Nov 2012 20:23:31	1117213	15456416	hadcm3n_z8p9_1880_40_008252144_0	155,520	200,615	1.2900
28 Nov 2012 01:30:06	1117213	15456416	hadcm3n_z8p9_1880_40_008252144_0	129,600	167,158	1.2898
27 Nov 2012 12:44:27	1117213	15456416	hadcm3n_z8p9_1880_40_008252144_0	103,680	133,872	1.2912
27 Nov 2012 00:57:02	1117213	15456416	hadcm3n_z8p9_1880_40_008252144_0	77,760	100,078	1.2870
26 Nov 2012 15:22:18	1117213	15456416	hadcm3n_z8p9_1880_40_008252144_0	51,840	66,323	1.2794
25 Nov 2012 21:52:34	1117213	15456416	hadcm3n_z8p9_1880_40_008252144_0	25,920	33,055	1.2753