Task 15837596

Name	hadcm3n_4c5z_1980_40_008326074_1
Workunit	8477209
Created	10 Jun 2013, 12:08:16 UTC
Sent	10 Jun 2013, 14:53:16 UTC
Report deadline	9 Sep 2013, 22:20:27 UTC
Received	23 Aug 2013, 13:15:09 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	-1073741819 (0xC0000005) STATUS_ACCESS_VIOLATION
Computer ID	1274612
Run time	17 days 18 hours 49 min 22 sec
CPU time	17 days 16 hours 58 min 43 sec
Validate state	Invalid
Credit	12,441.60
Device peak FLOPS	2.90 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>7.0.28</core_client_version> <![CDATA[ <message> - exit code -1073741819 (0xc0000005) </message> <stderr_txt> Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3148, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3120, iMonCtr=1 Model crash detected, will try to restart... 23:12:38 (2992): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:12:39 (2992): No heartbeat from core client for 30 sec - exiting 23:12:40 (2992): No heartbeat from core client for 30 sec - exiting 23:12:41 (2992): No heartbeat from core client for 30 sec - exiting 23:12:42 (2992): No heartbeat from core client for 30 sec - exiting 23:12:43 (2992): No heartbeat from core client for 30 sec - exiting 23:12:44 (2992): No heartbeat from core client for 30 sec - exiting 23:12:45 (2992): No heartbeat from core client for 30 sec - exiting 23:12:47 (2992): No heartbeat from core client for 30 sec - exiting 23:12:48 (2992): No heartbeat from core client for 30 sec - exiting 23:12:49 (2992): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4368, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3380, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 00:07:54 (4760): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:48:15 (3620): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3444, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... 23:12:30 (2280): No heartbeat from core client for 30 sec - exiting 23:12:32 (2280): No heartbeat from core client for 30 sec - exiting 23:12:33 (2280): No heartbeat from core client for 30 sec - exiting 23:12:34 (2280): No heartbeat from core client for 30 sec - exiting 23:12:35 (2280): No heartbeat from core client for 30 sec - exiting 23:12:36 (2280): No heartbeat from core client for 30 sec - exiting 23:12:37 (2280): No heartbeat from core client for 30 sec - exiting 23:12:38 (2280): No heartbeat from core client for 30 sec - exiting 23:12:39 (2280): No heartbeat from core client for 30 sec - exiting 23:12:41 (2280): No heartbeat from core client for 30 sec - exiting 23:12:42 (2280): No heartbeat from core client for 30 sec - exiting 23:12:43 (2280): No heartbeat from core client for 30 sec - exiting 23:12:44 (2280): No heartbeat from core client for 30 sec - exiting 23:12:45 (2280): No heartbeat from core client for 30 sec - exiting 23:12:46 (2280): No heartbeat from core client for 30 sec - exiting 23:12:47 (2280): No heartbeat from core client for 30 sec - exiting 23:12:48 (2280): No heartbeat from core client for 30 sec - exiting 23:12:49 (2280): No heartbeat from core client for 30 sec - exiting 23:12:50 (2280): No heartbeat from core client for 30 sec - exiting 23:12:51 (2280): No heartbeat from core client for 30 sec - exiting 23:12:53 (2280): No heartbeat from core client for 30 sec - exiting 23:12:54 (2280): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4056, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2568, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4344, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3264, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3680, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3924, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... 20:19:58 (4268): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x77C33AC3 read attempt to address 0x00000000 Engaging BOINC Windows Runtime Debugger... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x779E3AC3 read attempt to address 0x00000000 Engaging BOINC Windows Runtime Debugger... </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
21 Aug 2013 15:13:14	1274612	15837596	hadcm3n_4c5z_1980_40_008326074_1	1,036,800	1,529,851	1.4756
20 Aug 2013 16:55:37	1274612	15837596	hadcm3n_4c5z_1980_40_008326074_1	1,010,880	1,491,231	1.4752
19 Aug 2013 17:36:41	1274612	15837596	hadcm3n_4c5z_1980_40_008326074_1	984,960	1,453,139	1.4753
18 Aug 2013 17:06:26	1274612	15837596	hadcm3n_4c5z_1980_40_008326074_1	959,040	1,414,488	1.4749
17 Aug 2013 11:15:05	1274612	15837596	hadcm3n_4c5z_1980_40_008326074_1	933,120	1,376,602	1.4753
16 Aug 2013 05:48:49	1274612	15837596	hadcm3n_4c5z_1980_40_008326074_1	907,200	1,338,743	1.4757
15 Aug 2013 02:53:34	1274612	15837596	hadcm3n_4c5z_1980_40_008326074_1	881,280	1,300,056	1.4752
14 Aug 2013 17:03:30	1274612	15837596	hadcm3n_4c5z_1980_40_008326074_1	855,360	1,261,127	1.4744
14 Aug 2013 17:03:30	1274612	15837596	hadcm3n_4c5z_1980_40_008326074_1	829,440	1,222,781	1.4742
14 Aug 2013 17:03:30	1274612	15837596	hadcm3n_4c5z_1980_40_008326074_1	803,520	1,184,474	1.4741
14 Aug 2013 17:03:30	1274612	15837596	hadcm3n_4c5z_1980_40_008326074_1	777,600	1,145,892	1.4736
14 Aug 2013 17:03:30	1274612	15837596	hadcm3n_4c5z_1980_40_008326074_1	751,680	1,107,461	1.4733
14 Aug 2013 17:03:30	1274612	15837596	hadcm3n_4c5z_1980_40_008326074_1	725,760	1,069,085	1.4731
14 Aug 2013 17:03:30	1274612	15837596	hadcm3n_4c5z_1980_40_008326074_1	699,840	1,030,598	1.4726
14 Aug 2013 17:03:29	1274612	15837596	hadcm3n_4c5z_1980_40_008326074_1	673,920	992,300	1.4724
14 Aug 2013 17:03:29	1274612	15837596	hadcm3n_4c5z_1980_40_008326074_1	648,000	953,988	1.4722
14 Aug 2013 17:03:29	1274612	15837596	hadcm3n_4c5z_1980_40_008326074_1	622,080	915,398	1.4715
25 Jul 2013 17:21:53	1274612	15837596	hadcm3n_4c5z_1980_40_008326074_1	596,160	876,811	1.4708
23 Jul 2013 21:49:49	1274612	15837596	hadcm3n_4c5z_1980_40_008326074_1	570,240	838,671	1.4707
23 Jul 2013 20:35:04	1274612	15837596	hadcm3n_4c5z_1980_40_008326074_1	544,320	800,497	1.4706