Task 13327330

Name	hadcm3n_ylmd_1940_40_007436695_0
Workunit	7634198
Created	1 Sep 2011, 20:56:09 UTC
Sent	1 Sep 2011, 21:12:23 UTC
Report deadline	2 Dec 2011, 4:39:34 UTC
Received	11 Sep 2011, 5:20:43 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	193 (0x000000C1) EXIT_SIGNAL
Computer ID	926417
Run time	6 days 13 hours 42 min 48 sec
CPU time	5 days 6 hours 53 min 18 sec
Validate state	Invalid
Credit	3,110.40
Device peak FLOPS	2.14 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>6.12.33</core_client_version> <![CDATA[ <message> - exit code 193 (0xc1) </message> <stderr_txt> 09:55:14 (1320): No heartbeat from core client for 30 sec - exiting 09:55:15 (1320): No heartbeat from core client for 30 sec - exiting 09:55:16 (1320): No heartbeat from core client for 30 sec - exiting 09:55:17 (1320): No heartbeat from core client for 30 sec - exiting 09:55:18 (1320): No heartbeat from core client for 30 sec - exiting 09:55:19 (1320): No heartbeat from core client for 30 sec - exiting 09:55:20 (1320): No heartbeat from core client for 30 sec - exiting 09:55:21 (1320): No heartbeat from core client for 30 sec - exiting 09:55:22 (1320): No heartbeat from core client for 30 sec - exiting 09:55:23 (1320): No heartbeat from core client for 30 sec - exiting 09:55:24 (1320): No heartbeat from core client for 30 sec - exiting 09:55:25 (1320): No heartbeat from core client for 30 sec - exiting 09:55:26 (1320): No heartbeat from core client for 30 sec - exiting 09:55:27 (1320): No heartbeat from core client for 30 sec - exiting 09:55:28 (1320): No heartbeat from core client for 30 sec - exiting 09:55:29 (1320): No heartbeat from core client for 30 sec - exiting 09:55:30 (1320): No heartbeat from core client for 30 sec - exiting 09:55:31 (1320): No heartbeat from core client for 30 sec - exiting 09:55:32 (1320): No heartbeat from core client for 30 sec - exiting 09:55:33 (1320): No heartbeat from core client for 30 sec - exiting 09:55:34 (1320): No heartbeat from core client for 30 sec - exiting 09:55:35 (1320): No heartbeat from core client for 30 sec - exiting 09:55:36 (1320): No heartbeat from core client for 30 sec - exiting 09:55:37 (1320): No heartbeat from core client for 30 sec - exiting 09:55:38 (1320): No heartbeat from core client for 30 sec - exiting 09:55:39 (1320): No heartbeat from core client for 30 sec - exiting 09:55:40 (1320): No heartbeat from core client for 30 sec - exiting 09:55:41 (1320): No heartbeat from core client for 30 sec - exiting 09:55:42 (1320): No heartbeat from core client for 30 sec - exiting 09:55:43 (1320): No heartbeat from core client for 30 sec - exiting 09:55:44 (1320): No heartbeat from core client for 30 sec - exiting 09:55:45 (1320): No heartbeat from core client for 30 sec - exiting 09:55:46 (1320): No heartbeat from core client for 30 sec - exiting 09:55:47 (1320): No heartbeat from core client for 30 sec - exiting 09:55:48 (1320): No heartbeat from core client for 30 sec - exiting 09:55:49 (1320): No heartbeat from core client for 30 sec - exiting 09:55:50 (1320): No heartbeat from core client for 30 sec - exiting 09:55:51 (1320): No heartbeat from core client for 30 sec - exiting 09:55:52 (1320): No heartbeat from core client for 30 sec - exiting 09:55:53 (1320): No heartbeat from core client for 30 sec - exiting 09:55:54 (1320): No heartbeat from core client for 30 sec - exiting 09:55:55 (1320): No heartbeat from core client for 30 sec - exiting 09:55:56 (1320): No heartbeat from core client for 30 sec - exiting 09:55:57 (1320): No heartbeat from core client for 30 sec - exiting 09:55:58 (1320): No heartbeat from core client for 30 sec - exiting 09:55:59 (1320): No heartbeat from core client for 30 sec - exiting 09:56:00 (1320): No heartbeat from core client for 30 sec - exiting 09:56:01 (1320): No heartbeat from core client for 30 sec - exiting 09:56:02 (1320): No heartbeat from core client for 30 sec - exiting 09:56:03 (1320): No heartbeat from core client for 30 sec - exiting 09:56:04 (1320): No heartbeat from core client for 30 sec - exiting 09:56:05 (1320): No heartbeat from core client for 30 sec - exiting 09:56:06 (1320): No heartbeat from core client for 30 sec - exiting 09:56:07 (1320): No heartbeat from core client for 30 sec - exiting 09:56:08 (1320): No heartbeat from core client for 30 sec - exiting 09:56:09 (1320): No heartbeat from core client for 30 sec - exiting 09:56:10 (1320): No heartbeat from core client for 30 sec - exiting 09:56:11 (1320): No heartbeat from core client for 30 sec - exiting 09:56:12 (1320): No heartbeat from core client for 30 sec - exiting 09:56:13 (1320): No heartbeat from core client for 30 sec - exiting 09:56:14 (1320): No heartbeat from core client for 30 sec - exiting 09:56:15 (1320): No heartbeat from core client for 30 sec - exiting 09:56:16 (1320): No heartbeat from core client for 30 sec - exiting 09:56:17 (1320): No heartbeat from core client for 30 sec - exiting 09:56:18 (1320): No heartbeat from core client for 30 sec - exiting 09:56:19 (1320): No heartbeat from core client for 30 sec - exiting 09:56:20 (1320): No heartbeat from core client for 30 sec - exiting 09:56:21 (1320): No heartbeat from core client for 30 sec - exiting 09:56:22 (1320): No heartbeat from core client for 30 sec - exiting 09:56:23 (1320): No heartbeat from core client for 30 sec - exiting 09:56:24 (1320): No heartbeat from core client for 30 sec - exiting 09:56:25 (1320): No heartbeat from core client for 30 sec - exiting 09:56:26 (1320): No heartbeat from core client for 30 sec - exiting 09:56:27 (1320): No heartbeat from core client for 30 sec - exiting 09:56:28 (1320): No heartbeat from core client for 30 sec - exiting 09:56:29 (1320): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:56:30 (1320): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 05:28:32 (5628): No heartbeat from core client for 30 sec - exiting 05:28:33 (5628): No heartbeat from core client for 30 sec - exiting 05:28:34 (5628): No heartbeat from core client for 30 sec - exiting 05:28:35 (5628): No heartbeat from core client for 30 sec - exiting 05:28:36 (5628): No heartbeat from core client for 30 sec - exiting 05:28:37 (5628): No heartbeat from core client for 30 sec - exiting 05:28:38 (5628): No heartbeat from core client for 30 sec - exiting 05:28:39 (5628): No heartbeat from core client for 30 sec - exiting 05:28:40 (5628): No heartbeat from core client for 30 sec - exiting 05:28:41 (5628): No heartbeat from core client for 30 sec - exiting 05:28:42 (5628): No heartbeat from core client for 30 sec - exiting 05:28:43 (5628): No heartbeat from core client for 30 sec - exiting 05:28:44 (5628): No heartbeat from core client for 30 sec - exiting 05:28:45 (5628): No heartbeat from core client for 30 sec - exiting 05:28:46 (5628): No heartbeat from core client for 30 sec - exiting 05:28:47 (5628): No heartbeat from core client for 30 sec - exiting 05:28:48 (5628): No heartbeat from core client for 30 sec - exiting 05:28:49 (5628): No heartbeat from core client for 30 sec - exiting 05:28:50 (5628): No heartbeat from core client for 30 sec - exiting 05:28:51 (5628): No heartbeat from core client for 30 sec - exiting 05:28:52 (5628): No heartbeat from core client for 30 sec - exiting 05:28:53 (5628): No heartbeat from core client for 30 sec - exiting 05:28:54 (5628): No heartbeat from core client for 30 sec - exiting 05:28:55 (5628): No heartbeat from core client for 30 sec - exiting 05:28:56 (5628): No heartbeat from core client for 30 sec - exiting 05:28:57 (5628): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:30:12 (5876): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 19:22:54 (5044): No heartbeat from core client for 30 sec - exiting 19:22:55 (5044): No heartbeat from core client for 30 sec - exiting 19:22:56 (5044): No heartbeat from core client for 30 sec - exiting 19:22:57 (5044): No heartbeat from core client for 30 sec - exiting 19:22:58 (5044): No heartbeat from core client for 30 sec - exiting 19:22:59 (5044): No heartbeat from core client for 30 sec - exiting 19:23:00 (5044): No heartbeat from core client for 30 sec - exiting 19:23:01 (5044): No heartbeat from core client for 30 sec - exiting 19:23:02 (5044): No heartbeat from core client for 30 sec - exiting 19:23:03 (5044): No heartbeat from core client for 30 sec - exiting 19:23:04 (5044): No heartbeat from core client for 30 sec - exiting 19:23:05 (5044): No heartbeat from core client for 30 sec - exiting 19:23:06 (5044): No heartbeat from core client for 30 sec - exiting 19:23:07 (5044): No heartbeat from core client for 30 sec - exiting 19:23:08 (5044): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 17:09:14 (6000): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x77582AB1 read attempt to address 0x40C17374 Engaging BOINC Windows Runtime Debugger... Cannot serialize file C:\ProgramData\BOINC/projects/climateprediction.net/hadcm3n_ylmd_1940_40_007436695/dataout/shmem_restart.day Signal 11 received, exiting... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
10 Sep 2011 05:20:49	926417	13327330	hadcm3n_ylmd_1940_40_007436695_0	259,200	456,791	1.7623
09 Sep 2011 05:31:45	926417	13327330	hadcm3n_ylmd_1940_40_007436695_0	233,280	409,255	1.7544
08 Sep 2011 03:21:28	926417	13327330	hadcm3n_ylmd_1940_40_007436695_0	207,360	364,693	1.7587
07 Sep 2011 14:39:24	926417	13327330	hadcm3n_ylmd_1940_40_007436695_0	181,440	319,839	1.7628
06 Sep 2011 12:25:44	926417	13327330	hadcm3n_ylmd_1940_40_007436695_0	155,520	274,293	1.7637
05 Sep 2011 18:52:07	926417	13327330	hadcm3n_ylmd_1940_40_007436695_0	129,600	226,810	1.7501
04 Sep 2011 21:35:34	926417	13327330	hadcm3n_ylmd_1940_40_007436695_0	103,680	179,224	1.7286
04 Sep 2011 06:17:04	926417	13327330	hadcm3n_ylmd_1940_40_007436695_0	77,760	132,608	1.7053
03 Sep 2011 16:43:59	926417	13327330	hadcm3n_ylmd_1940_40_007436695_0	51,840	89,904	1.7343
02 Sep 2011 14:59:30	926417	13327330	hadcm3n_ylmd_1940_40_007436695_0	25,920	46,976	1.8123