Task 15874542

Name	hadcm3n_o4e8_2140_40_008269583_4
Workunit	8424707
Created	1 Jul 2013, 0:00:14 UTC
Sent	1 Jul 2013, 0:33:07 UTC
Report deadline	30 Sep 2013, 8:00:18 UTC
Received	24 Jul 2013, 20:51:14 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	-1073741819 (0xC0000005) STATUS_ACCESS_VIOLATION
Computer ID	1259863
Run time	7 days 12 hours 40 min 50 sec
CPU time	5 days 17 hours 47 min 56 sec
Validate state	Invalid
Credit	3,110.40
Device peak FLOPS	2.13 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>7.0.64</core_client_version> <![CDATA[ <message> (unknown error) - exit code -1073741819 (0xc0000005) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 05:47:35 (4328): No heartbeat from core client for 30 sec - exiting 05:47:36 (4328): No heartbeat from core client for 30 sec - exiting 05:47:37 (4328): No heartbeat from core client for 30 sec - exiting 05:47:38 (4328): No heartbeat from core client for 30 sec - exiting 05:47:39 (4328): No heartbeat from core client for 30 sec - exiting 05:47:41 (4328): No heartbeat from core client for 30 sec - exiting 05:47:42 (4328): No heartbeat from core client for 30 sec - exiting 05:47:43 (4328): No heartbeat from core client for 30 sec - exiting 05:47:44 (4328): No heartbeat from core client for 30 sec - exiting 05:47:45 (4328): No heartbeat from core client for 30 sec - exiting 05:47:46 (4328): No heartbeat from core client for 30 sec - exiting 05:47:47 (4328): No heartbeat from core client for 30 sec - exiting 05:47:48 (4328): No heartbeat from core client for 30 sec - exiting 05:47:49 (4328): No heartbeat from core client for 30 sec - exiting 05:47:50 (4328): No heartbeat from core client for 30 sec - exiting 05:47:52 (4328): No heartbeat from core client for 30 sec - exiting 05:47:53 (4328): No heartbeat from core client for 30 sec - exiting 05:47:54 (4328): No heartbeat from core client for 30 sec - exiting 05:47:55 (4328): No heartbeat from core client for 30 sec - exiting 05:47:56 (4328): No heartbeat from core client for 30 sec - exiting 05:47:57 (4328): No heartbeat from core client for 30 sec - exiting 05:47:58 (4328): No heartbeat from core client for 30 sec - exiting 05:47:59 (4328): No heartbeat from core client for 30 sec - exiting 05:48:00 (4328): No heartbeat from core client for 30 sec - exiting 05:48:01 (4328): No heartbeat from core client for 30 sec - exiting 05:48:02 (4328): No heartbeat from core client for 30 sec - exiting 05:48:04 (4328): No heartbeat from core client for 30 sec - exiting 05:48:05 (4328): No heartbeat from core client for 30 sec - exiting 05:48:06 (4328): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 06:31:20 (4460): No heartbeat from core client for 30 sec - exiting 06:31:22 (4460): No heartbeat from core client for 30 sec - exiting 06:31:23 (4460): No heartbeat from core client for 30 sec - exiting 06:31:24 (4460): No heartbeat from core client for 30 sec - exiting 06:31:25 (4460): No heartbeat from core client for 30 sec - exiting 06:31:26 (4460): No heartbeat from core client for 30 sec - exiting 06:31:27 (4460): No heartbeat from core client for 30 sec - exiting 06:31:28 (4460): No heartbeat from core client for 30 sec - exiting 06:31:29 (4460): No heartbeat from core client for 30 sec - exiting 06:31:30 (4460): No heartbeat from core client for 30 sec - exiting 06:31:31 (4460): No heartbeat from core client for 30 sec - exiting 06:31:33 (4460): No heartbeat from core client for 30 sec - exiting 06:31:34 (4460): No heartbeat from core client for 30 sec - exiting 06:31:35 (4460): No heartbeat from core client for 30 sec - exiting 06:31:36 (4460): No heartbeat from core client for 30 sec - exiting 06:31:37 (4460): No heartbeat from core client for 30 sec - exiting 06:31:38 (4460): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:42:39 (4876): No heartbeat from core client for 30 sec - exiting 05:42:40 (4876): No heartbeat from core client for 30 sec - exiting 05:42:41 (4876): No heartbeat from core client for 30 sec - exiting 05:42:42 (4876): No heartbeat from core client for 30 sec - exiting 05:42:43 (4876): No heartbeat from core client for 30 sec - exiting 05:42:44 (4876): No heartbeat from core client for 30 sec - exiting 05:42:45 (4876): No heartbeat from core client for 30 sec - exiting 05:42:47 (4876): No heartbeat from core client for 30 sec - exiting 05:42:48 (4876): No heartbeat from core client for 30 sec - exiting 05:42:49 (4876): No heartbeat from core client for 30 sec - exiting 05:42:50 (4876): No heartbeat from core client for 30 sec - exiting 05:42:51 (4876): No heartbeat from core client for 30 sec - exiting 05:42:52 (4876): No heartbeat from core client for 30 sec - exiting 05:42:53 (4876): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 19:04:28 (1240): No heartbeat from core client for 30 sec - exiting 19:04:29 (1240): No heartbeat from core client for 30 sec - exiting 19:04:30 (1240): No heartbeat from core client for 30 sec - exiting 19:04:31 (1240): No heartbeat from core client for 30 sec - exiting 19:04:32 (1240): No heartbeat from core client for 30 sec - exiting 19:04:33 (1240): No heartbeat from core client for 30 sec - exiting 19:04:34 (1240): No heartbeat from core client for 30 sec - exiting 19:04:35 (1240): No heartbeat from core client for 30 sec - exiting 19:04:36 (1240): No heartbeat from core client for 30 sec - exiting 19:04:38 (1240): No heartbeat from core client for 30 sec - exiting 19:04:39 (1240): No heartbeat from core client for 30 sec - exiting 19:04:40 (1240): No heartbeat from core client for 30 sec - exiting 19:04:41 (1240): No heartbeat from core client for 30 sec - exiting 19:04:42 (1240): No heartbeat from core client for 30 sec - exiting 19:04:43 (1240): No heartbeat from core client for 30 sec - exiting 19:04:44 (1240): No heartbeat from core client for 30 sec - exiting 19:04:45 (1240): No heartbeat from core client for 30 sec - exiting 19:04:46 (1240): No heartbeat from core client for 30 sec - exiting 19:04:47 (1240): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:57:33 (4560): No heartbeat from core client for 30 sec - exiting 05:57:35 (4560): No heartbeat from core client for 30 sec - exiting 05:57:36 (4560): No heartbeat from core client for 30 sec - exiting 05:57:37 (4560): No heartbeat from core client for 30 sec - exiting 05:57:38 (4560): No heartbeat from core client for 30 sec - exiting 05:57:39 (4560): No heartbeat from core client for 30 sec - exiting 05:57:40 (4560): No heartbeat from core client for 30 sec - exiting 05:57:41 (4560): No heartbeat from core client for 30 sec - exiting 05:57:42 (4560): No heartbeat from core client for 30 sec - exiting 05:57:43 (4560): No heartbeat from core client for 30 sec - exiting 05:57:44 (4560): No heartbeat from core client for 30 sec - exiting 05:57:45 (4560): No heartbeat from core client for 30 sec - exiting 05:57:47 (4560): No heartbeat from core client for 30 sec - exiting 05:57:48 (4560): No heartbeat from core client for 30 sec - exiting 05:57:49 (4560): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 18:41:45 (2536): No heartbeat from core client for 30 sec - exiting 18:41:46 (2536): No heartbeat from core client for 30 sec - exiting 18:41:47 (2536): No heartbeat from core client for 30 sec - exiting 18:41:48 (2536): No heartbeat from core client for 30 sec - exiting 18:41:49 (2536): No heartbeat from core client for 30 sec - exiting 18:41:50 (2536): No heartbeat from core client for 30 sec - exiting 18:41:52 (2536): No heartbeat from core client for 30 sec - exiting 18:41:53 (2536): No heartbeat from core client for 30 sec - exiting 18:41:54 (2536): No heartbeat from core client for 30 sec - exiting 18:41:55 (2536): No heartbeat from core client for 30 sec - exiting 18:41:56 (2536): No heartbeat from core client for 30 sec - exiting 18:41:57 (2536): No heartbeat from core client for 30 sec - exiting 18:41:58 (2536): No heartbeat from core client for 30 sec - exiting 18:41:59 (2536): No heartbeat from core client for 30 sec - exiting 18:42:00 (2536): No heartbeat from core client for 30 sec - exiting 18:42:01 (2536): No heartbeat from core client for 30 sec - exiting 18:42:02 (2536): No heartbeat from core client for 30 sec - exiting 18:42:04 (2536): No heartbeat from core client for 30 sec - exiting 18:42:05 (2536): No heartbeat from core client for 30 sec - exiting 18:42:06 (2536): No heartbeat from core client for 30 sec - exiting 18:42:07 (2536): No heartbeat from core client for 30 sec - exiting 18:42:08 (2536): No heartbeat from core client for 30 sec - exiting 18:42:09 (2536): No heartbeat from core client for 30 sec - exiting 18:42:10 (2536): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:05:51 (2152): No heartbeat from core client for 30 sec - exiting 08:05:52 (2152): No heartbeat from core client for 30 sec - exiting 08:05:53 (2152): No heartbeat from core client for 30 sec - exiting 08:05:55 (2152): No heartbeat from core client for 30 sec - exiting 08:05:56 (2152): No heartbeat from core client for 30 sec - exiting 08:05:57 (2152): No heartbeat from core client for 30 sec - exiting 08:05:58 (2152): No heartbeat from core client for 30 sec - exiting 08:05:59 (2152): No heartbeat from core client for 30 sec - exiting 08:06:00 (2152): No heartbeat from core client for 30 sec - exiting 08:06:01 (2152): No heartbeat from core client for 30 sec - exiting 08:06:02 (2152): No heartbeat from core client for 30 sec - exiting 08:06:03 (2152): No heartbeat from core client for 30 sec - exiting 08:06:04 (2152): No heartbeat from core client for 30 sec - exiting 08:06:05 (2152): No heartbeat from core client for 30 sec - exiting 08:06:07 (2152): No heartbeat from core client for 30 sec - exiting 08:06:08 (2152): No heartbeat from core client for 30 sec - exiting 08:06:09 (2152): No heartbeat from core client for 30 sec - exiting 08:06:10 (2152): No heartbeat from core client for 30 sec - exiting 08:06:11 (2152): No heartbeat from core client for 30 sec - exiting 08:06:12 (2152): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 05:53:55 (4948): No heartbeat from core client for 30 sec - exiting 05:53:56 (4948): No heartbeat from core client for 30 sec - exiting 05:53:57 (4948): No heartbeat from core client for 30 sec - exiting 05:53:58 (4948): No heartbeat from core client for 30 sec - exiting 05:53:59 (4948): No heartbeat from core client for 30 sec - exiting 05:54:00 (4948): No heartbeat from core client for 30 sec - exiting 05:54:01 (4948): No heartbeat from core client for 30 sec - exiting 05:54:02 (4948): No heartbeat from core client for 30 sec - exiting 05:54:04 (4948): No heartbeat from core client for 30 sec - exiting 05:54:05 (4948): No heartbeat from core client for 30 sec - exiting 05:54:06 (4948): No heartbeat from core client for 30 sec - exiting 05:54:07 (4948): No heartbeat from core client for 30 sec - exiting 05:54:08 (4948): No heartbeat from core client for 30 sec - exiting 05:54:09 (4948): No heartbeat from core client for 30 sec - exiting 05:54:10 (4948): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 18:26:20 (3528): No heartbeat from core client for 30 sec - exiting 18:26:21 (3528): No heartbeat from core client for 30 sec - exiting 18:26:22 (3528): No heartbeat from core client for 30 sec - exiting 18:26:23 (3528): No heartbeat from core client for 30 sec - exiting 18:26:24 (3528): No heartbeat from core client for 30 sec - exiting 18:26:25 (3528): No heartbeat from core client for 30 sec - exiting 18:26:26 (3528): No heartbeat from core client for 30 sec - exiting 18:26:27 (3528): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 05:49:10 (4904): No heartbeat from core client for 30 sec - exiting 05:49:11 (4904): No heartbeat from core client for 30 sec - exiting 05:49:12 (4904): No heartbeat from core client for 30 sec - exiting 05:49:13 (4904): No heartbeat from core client for 30 sec - exiting 05:49:14 (4904): No heartbeat from core client for 30 sec - exiting 05:49:15 (4904): No heartbeat from core client for 30 sec - exiting 05:49:16 (4904): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 18:48:48 (4528): No heartbeat from core client for 30 sec - exiting 18:48:49 (4528): No heartbeat from core client for 30 sec - exiting 18:48:50 (4528): No heartbeat from core client for 30 sec - exiting 18:48:51 (4528): No heartbeat from core client for 30 sec - exiting 18:48:52 (4528): No heartbeat from core client for 30 sec - exiting 18:48:53 (4528): No heartbeat from core client for 30 sec - exiting 18:48:54 (4528): No heartbeat from core client for 30 sec - exiting 18:48:55 (4528): No heartbeat from core client for 30 sec - exiting 18:48:56 (4528): No heartbeat from core client for 30 sec - exiting 18:48:58 (4528): No heartbeat from core client for 30 sec - exiting 18:48:59 (4528): No heartbeat from core client for 30 sec - exiting 18:49:00 (4528): No heartbeat from core client for 30 sec - exiting 18:49:01 (4528): No heartbeat from core client for 30 sec - exiting 18:49:02 (4528): No heartbeat from core client for 30 sec - exiting 18:49:03 (4528): No heartbeat from core client for 30 sec - exiting 18:49:04 (4528): No heartbeat from core client for 30 sec - exiting 18:49:05 (4528): No heartbeat from core client for 30 sec - exiting 18:49:06 (4528): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 05:47:28 (1220): No heartbeat from core client for 30 sec - exiting 05:47:29 (1220): No heartbeat from core client for 30 sec - exiting 05:47:30 (1220): No heartbeat from core client for 30 sec - exiting 05:47:31 (1220): No heartbeat from core client for 30 sec - exiting 05:47:32 (1220): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:47:33 (1220): No heartbeat from core client for 30 sec - exiting 18:25:12 (2764): No heartbeat from core client for 30 sec - exiting 18:25:13 (2764): No heartbeat from core client for 30 sec - exiting 18:25:14 (2764): No heartbeat from core client for 30 sec - exiting 18:25:15 (2764): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 05:57:21 (456): No heartbeat from core client for 30 sec - exiting 05:57:22 (456): No heartbeat from core client for 30 sec - exiting 05:57:23 (456): No heartbeat from core client for 30 sec - exiting 05:57:24 (456): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 18:47:58 (3200): No heartbeat from core client for 30 sec - exiting 18:47:59 (3200): No heartbeat from core client for 30 sec - exiting 18:48:00 (3200): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3652, iMonCtr=1 Model crash detected, will try to restart... 06:40:25 (5064): No heartbeat from core client for 30 sec - exiting 06:40:26 (5064): No heartbeat from core client for 30 sec - exiting 06:40:27 (5064): No heartbeat from core client for 30 sec - exiting 06:40:29 (5064): No heartbeat from core client for 30 sec - exiting 06:40:30 (5064): No heartbeat from core client for 30 sec - exiting 06:40:31 (5064): No heartbeat from core client for 30 sec - exiting 06:40:32 (5064): No heartbeat from core client for 30 sec - exiting 06:40:33 (5064): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x77D23AB3 read attempt to address 0x00000000 Engaging BOINC Windows Runtime Debugger... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x77C13AB3 read attempt to address 0x00000000 Engaging BOINC Windows Runtime Debugger... </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
24 Jul 2013 12:20:36	1259863	15874542	hadcm3n_o4e8_2140_40_008269583_4	259,200	494,274	1.9069
23 Jul 2013 20:53:54	1259863	15874542	hadcm3n_o4e8_2140_40_008269583_4	233,280	444,337	1.9047
23 Jul 2013 20:12:18	1259863	15874542	hadcm3n_o4e8_2140_40_008269583_4	207,360	394,675	1.9033
23 Jul 2013 15:54:16	1259863	15874542	hadcm3n_o4e8_2140_40_008269583_4	181,440	344,049	1.8962
23 Jul 2013 15:54:16	1259863	15874542	hadcm3n_o4e8_2140_40_008269583_4	155,520	293,989	1.8904
23 Jul 2013 15:54:16	1259863	15874542	hadcm3n_o4e8_2140_40_008269583_4	129,600	244,893	1.8896
08 Jul 2013 12:08:14	1259863	15874542	hadcm3n_o4e8_2140_40_008269583_4	103,680	196,955	1.8996
07 Jul 2013 09:26:07	1259863	15874542	hadcm3n_o4e8_2140_40_008269583_4	77,760	146,624	1.8856
06 Jul 2013 09:48:44	1259863	15874542	hadcm3n_o4e8_2140_40_008269583_4	51,840	97,654	1.8838
04 Jul 2013 14:28:52	1259863	15874542	hadcm3n_o4e8_2140_40_008269583_4	25,920	48,716	1.8795