Task 15838244

Name	hadcm3n_o3gw_2140_40_008270736_4
Workunit	8425860
Created	10 Jun 2013, 22:01:12 UTC
Sent	10 Jun 2013, 22:13:27 UTC
Report deadline	10 Sep 2013, 5:40:38 UTC
Received	26 Jun 2013, 22:30:04 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	193 (0x000000C1) EXIT_SIGNAL
Computer ID	1195906
Run time	4 days 16 hours 33 min 54 sec
CPU time	4 days 12 hours 16 min 6 sec
Validate state	Invalid
Credit	3,110.40
Device peak FLOPS	3.32 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>7.0.28</core_client_version> <![CDATA[ <message> - exit code 193 (0xc1) </message> <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 07:42:42 (3160): No heartbeat from core client for 30 sec - exiting 07:42:44 (3160): No heartbeat from core client for 30 sec - exiting 07:42:45 (3160): No heartbeat from core client for 30 sec - exiting 07:42:46 (3160): No heartbeat from core client for 30 sec - exiting 07:42:47 (3160): No heartbeat from core client for 30 sec - exiting 07:42:48 (3160): No heartbeat from core client for 30 sec - exiting 07:42:49 (3160): No heartbeat from core client for 30 sec - exiting 07:42:51 (3160): No heartbeat from core client for 30 sec - exiting 07:42:52 (3160): No heartbeat from core client for 30 sec - exiting 07:42:53 (3160): No heartbeat from core client for 30 sec - exiting 07:42:54 (3160): No heartbeat from core client for 30 sec - exiting 07:42:55 (3160): No heartbeat from core client for 30 sec - exiting 07:42:56 (3160): No heartbeat from core client for 30 sec - exiting 07:42:57 (3160): No heartbeat from core client for 30 sec - exiting 07:42:58 (3160): No heartbeat from core client for 30 sec - exiting 07:42:59 (3160): No heartbeat from core client for 30 sec - exiting 07:43:00 (3160): No heartbeat from core client for 30 sec - exiting 07:43:01 (3160): No heartbeat from core client for 30 sec - exiting 07:43:02 (3160): No heartbeat from core client for 30 sec - exiting 07:43:03 (3160): No heartbeat from core client for 30 sec - exiting 07:43:04 (3160): No heartbeat from core client for 30 sec - exiting 07:43:05 (3160): No heartbeat from core client for 30 sec - exiting 07:43:06 (3160): No heartbeat from core client for 30 sec - exiting 07:43:08 (3160): No heartbeat from core client for 30 sec - exiting 07:43:09 (3160): No heartbeat from core client for 30 sec - exiting 07:43:10 (3160): No heartbeat from core client for 30 sec - exiting 07:43:11 (3160): No heartbeat from core client for 30 sec - exiting 07:43:12 (3160): No heartbeat from core client for 30 sec - exiting 07:43:13 (3160): No heartbeat from core client for 30 sec - exiting 07:43:14 (3160): No heartbeat from core client for 30 sec - exiting 07:43:15 (3160): No heartbeat from core client for 30 sec - exiting 07:43:16 (3160): No heartbeat from core client for 30 sec - exiting 07:43:17 (3160): No heartbeat from core client for 30 sec - exiting 07:43:18 (3160): No heartbeat from core client for 30 sec - exiting 07:43:19 (3160): No heartbeat from core client for 30 sec - exiting 07:43:20 (3160): No heartbeat from core client for 30 sec - exiting 07:43:21 (3160): No heartbeat from core client for 30 sec - exiting 07:43:22 (3160): No heartbeat from core client for 30 sec - exiting 07:43:23 (3160): No heartbeat from core client for 30 sec - exiting 07:43:24 (3160): No heartbeat from core client for 30 sec - exiting 07:43:25 (3160): No heartbeat from core client for 30 sec - exiting 07:43:26 (3160): No heartbeat from core client for 30 sec - exiting 07:43:27 (3160): No heartbeat from core client for 30 sec - exiting 07:43:29 (3160): No heartbeat from core client for 30 sec - exiting 07:43:30 (3160): No heartbeat from core client for 30 sec - exiting 07:43:31 (3160): No heartbeat from core client for 30 sec - exiting 07:43:32 (3160): No heartbeat from core client for 30 sec - exiting 07:43:33 (3160): No heartbeat from core client for 30 sec - exiting 07:43:34 (3160): No heartbeat from core client for 30 sec - exiting 07:43:35 (3160): No heartbeat from core client for 30 sec - exiting 07:43:36 (3160): No heartbeat from core client for 30 sec - exiting 07:43:37 (3160): No heartbeat from core client for 30 sec - exiting 07:43:38 (3160): No heartbeat from core client for 30 sec - exiting 07:43:39 (3160): No heartbeat from core client for 30 sec - exiting 07:43:40 (3160): No heartbeat from core client for 30 sec - exiting 07:43:42 (3160): No heartbeat from core client for 30 sec - exiting 07:43:43 (3160): No heartbeat from core client for 30 sec - exiting 07:43:44 (3160): No heartbeat from core client for 30 sec - exiting 07:43:45 (3160): No heartbeat from core client for 30 sec - exiting 07:43:46 (3160): No heartbeat from core client for 30 sec - exiting 07:43:47 (3160): No heartbeat from core client for 30 sec - exiting 07:43:48 (3160): No heartbeat from core client for 30 sec - exiting 07:43:49 (3160): No heartbeat from core client for 30 sec - exiting 07:43:50 (3160): No heartbeat from core client for 30 sec - exiting 07:43:51 (3160): No heartbeat from core client for 30 sec - exiting 07:43:52 (3160): No heartbeat from core client for 30 sec - exiting 07:43:54 (3160): No heartbeat from core client for 30 sec - exiting 07:43:55 (3160): No heartbeat from core client for 30 sec - exiting 07:43:56 (3160): No heartbeat from core client for 30 sec - exiting 07:43:58 (3160): No heartbeat from core client for 30 sec - exiting 07:43:59 (3160): No heartbeat from core client for 30 sec - exiting 07:44:00 (3160): No heartbeat from core client for 30 sec - exiting 07:44:01 (3160): No heartbeat from core client for 30 sec - exiting 07:44:02 (3160): No heartbeat from core client for 30 sec - exiting 07:44:03 (3160): No heartbeat from core client for 30 sec - exiting 07:44:04 (3160): No heartbeat from core client for 30 sec - exiting 07:44:05 (3160): No heartbeat from core client for 30 sec - exiting 07:44:06 (3160): No heartbeat from core client for 30 sec - exiting 07:44:07 (3160): No heartbeat from core client for 30 sec - exiting 07:44:09 (3160): No heartbeat from core client for 30 sec - exiting 07:44:10 (3160): No heartbeat from core client for 30 sec - exiting 07:44:11 (3160): No heartbeat from core client for 30 sec - exiting 07:44:12 (3160): No heartbeat from core client for 30 sec - exiting 07:44:13 (3160): No heartbeat from core client for 30 sec - exiting 07:44:14 (3160): No heartbeat from core client for 30 sec - exiting 07:44:15 (3160): No heartbeat from core client for 30 sec - exiting 07:44:16 (3160): No heartbeat from core client for 30 sec - exiting 07:44:17 (3160): No heartbeat from core client for 30 sec - exiting 07:44:18 (3160): No heartbeat from core client for 30 sec - exiting 07:44:19 (3160): No heartbeat from core client for 30 sec - exiting 07:44:20 (3160): No heartbeat from core client for 30 sec - exiting 07:44:21 (3160): No heartbeat from core client for 30 sec - exiting 07:44:22 (3160): No heartbeat from core client for 30 sec - exiting 07:44:24 (3160): No heartbeat from core client for 30 sec - exiting 07:44:25 (3160): No heartbeat from core client for 30 sec - exiting 07:44:26 (3160): No heartbeat from core client for 30 sec - exiting 07:44:27 (3160): No heartbeat from core client for 30 sec - exiting 07:44:28 (3160): No heartbeat from core client for 30 sec - exiting 07:44:29 (3160): No heartbeat from core client for 30 sec - exiting 07:44:30 (3160): No heartbeat from core client for 30 sec - exiting 07:44:31 (3160): No heartbeat from core client for 30 sec - exiting 07:44:32 (3160): No heartbeat from core client for 30 sec - exiting 07:44:33 (3160): No heartbeat from core client for 30 sec - exiting 07:44:34 (3160): No heartbeat from core client for 30 sec - exiting 07:44:35 (3160): No heartbeat from core client for 30 sec - exiting 07:44:36 (3160): No heartbeat from core client for 30 sec - exiting 07:44:37 (3160): No heartbeat from core client for 30 sec - exiting 07:44:38 (3160): No heartbeat from core client for 30 sec - exiting 07:44:39 (3160): No heartbeat from core client for 30 sec - exiting 07:44:40 (3160): No heartbeat from core client for 30 sec - exiting 07:44:41 (3160): No heartbeat from core client for 30 sec - exiting 07:44:42 (3160): No heartbeat from core client for 30 sec - exiting 07:44:43 (3160): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:44:45 (3160): No heartbeat from core client for 30 sec - exiting 07:44:46 (3160): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x76F15EAB read attempt to address 0x40C26756 Engaging BOINC Windows Runtime Debugger... Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=8056, selfPID=8056, iMonCtr=1 Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x76F15EAB read attempt to address 0x40C26756 Engaging BOINC Windows Runtime Debugger... Cannot serialize file C:\ProgramData\BOINC/projects/climateprediction.net/hadcm3n_o3gw_2140_40_008270736/dataout/shmem_restart.day Signal 11 received, exiting... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
26 Jun 2013 12:46:27	1195906	15838244	hadcm3n_o3gw_2140_40_008270736_4	259,200	386,291	1.4903
25 Jun 2013 18:41:52	1195906	15838244	hadcm3n_o3gw_2140_40_008270736_4	233,280	346,018	1.4833
25 Jun 2013 06:20:09	1195906	15838244	hadcm3n_o3gw_2140_40_008270736_4	207,360	302,806	1.4603
20 Jun 2013 10:18:38	1195906	15838244	hadcm3n_o3gw_2140_40_008270736_4	181,440	265,457	1.4631
18 Jun 2013 20:39:33	1195906	15838244	hadcm3n_o3gw_2140_40_008270736_4	155,520	228,828	1.4714
18 Jun 2013 06:17:41	1195906	15838244	hadcm3n_o3gw_2140_40_008270736_4	129,600	194,060	1.4974
14 Jun 2013 18:19:26	1195906	15838244	hadcm3n_o3gw_2140_40_008270736_4	103,680	154,840	1.4934
14 Jun 2013 05:06:00	1195906	15838244	hadcm3n_o3gw_2140_40_008270736_4	77,760	116,162	1.4939
13 Jun 2013 10:49:34	1195906	15838244	hadcm3n_o3gw_2140_40_008270736_4	51,840	76,688	1.4793
12 Jun 2013 17:38:54	1195906	15838244	hadcm3n_o3gw_2140_40_008270736_4	25,920	37,451	1.4449