Task 12824608

Name	hadcm3n_p3o6_1900_40_007222342_1
Workunit	7420582
Created	26 Apr 2011, 15:25:39 UTC
Sent	30 Apr 2011, 19:44:39 UTC
Report deadline	31 Jul 2011, 3:11:50 UTC
Received	8 Sep 2011, 3:54:27 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	193 (0x000000C1) EXIT_SIGNAL
Computer ID	1075715
Run time	24 days 7 hours 44 min 53 sec
CPU time	21 days 15 hours 20 min 49 sec
Validate state	Invalid
Credit	9,331.20
Device peak FLOPS	2.25 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>6.10.18</core_client_version> <![CDATA[ <message> - exit code 193 (0xc1) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 20:16:40 (8892): No heartbeat from core client for 30 sec - exiting 20:16:41 (8892): No heartbeat from core client for 30 sec - exiting 20:16:42 (8892): No heartbeat from core client for 30 sec - exiting 20:16:43 (8892): No heartbeat from core client for 30 sec - exiting 20:16:44 (8892): No heartbeat from core client for 30 sec - exiting 20:16:45 (8892): No heartbeat from core client for 30 sec - exiting 20:16:46 (8892): No heartbeat from core client for 30 sec - exiting 20:16:47 (8892): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 10:57:37 (9212): No heartbeat from core client for 30 sec - exiting 10:57:38 (9212): No heartbeat from core client for 30 sec - exiting 10:57:39 (9212): No heartbeat from core client for 30 sec - exiting 10:57:40 (9212): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 22:38:03 (6724): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 20:23:46 (6156): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 22:38:50 (4856): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 10:27:06 (4880): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 00:36:55 (4680): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 00:56:06 (4408): No heartbeat from core client for 30 sec - exiting 00:56:07 (4408): No heartbeat from core client for 30 sec - exiting 00:56:08 (4408): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 18:06:03 (2560): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 00:06:22 (8048): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4132, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4132, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 19:24:48 (1520): No heartbeat from core client for 30 sec - exiting 19:24:49 (1520): No heartbeat from core client for 30 sec - exiting 19:24:50 (1520): No heartbeat from core client for 30 sec - exiting 19:24:51 (1520): No heartbeat from core client for 30 sec - exiting 19:24:52 (1520): No heartbeat from core client for 30 sec - exiting 19:24:54 (1520): No heartbeat from core client for 30 sec - exiting 19:24:55 (1520): No heartbeat from core client for 30 sec - exiting 19:24:56 (1520): No heartbeat from core client for 30 sec - exiting 19:24:57 (1520): No heartbeat from core client for 30 sec - exiting 19:24:58 (1520): No heartbeat from core client for 30 sec - exiting 19:24:59 (1520): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x77BC3A93 read attempt to address 0x00000000 Engaging BOINC Windows Runtime Debugger... Cannot serialize file C:\ProgramData\BOINC/projects/climateprediction.net/hadcm3n_p3o6_1900_40_007222342/dataout/shmem_restart.day Signal 11 received, exiting... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
08 Sep 2011 02:55:55	1075715	12824608	hadcm3n_p3o6_1900_40_007222342_1	777,600	1,869,774	2.4045
16 Aug 2011 21:02:37	1075715	12824608	hadcm3n_p3o6_1900_40_007222342_1	751,680	1,808,075	2.4054
10 Aug 2011 09:11:49	1075715	12824608	hadcm3n_p3o6_1900_40_007222342_1	725,760	1,743,160	2.4018
08 Aug 2011 21:18:43	1075715	12824608	hadcm3n_p3o6_1900_40_007222342_1	699,840	1,678,233	2.3980
07 Aug 2011 22:50:27	1075715	12824608	hadcm3n_p3o6_1900_40_007222342_1	673,920	1,613,287	2.3939
06 Aug 2011 23:36:54	1075715	12824608	hadcm3n_p3o6_1900_40_007222342_1	648,000	1,536,162	2.3706
26 Jul 2011 09:33:22	1075715	12824608	hadcm3n_p3o6_1900_40_007222342_1	622,080	1,470,585	2.3640
25 Jul 2011 14:58:57	1075715	12824608	hadcm3n_p3o6_1900_40_007222342_1	596,160	1,407,569	2.3611
25 Jul 2011 14:58:57	1075715	12824608	hadcm3n_p3o6_1900_40_007222342_1	570,240	1,341,400	2.3523
25 Jul 2011 14:58:57	1075715	12824608	hadcm3n_p3o6_1900_40_007222342_1	544,320	1,281,866	2.3550
11 Jul 2011 02:51:06	1075715	12824608	hadcm3n_p3o6_1900_40_007222342_1	518,400	1,220,294	2.3540
07 Jul 2011 21:34:43	1075715	12824608	hadcm3n_p3o6_1900_40_007222342_1	492,480	1,158,942	2.3533
28 Jun 2011 02:59:52	1075715	12824608	hadcm3n_p3o6_1900_40_007222342_1	466,560	1,098,711	2.3549
26 Jun 2011 13:11:03	1075715	12824608	hadcm3n_p3o6_1900_40_007222342_1	440,640	1,037,566	2.3547
22 Jun 2011 23:43:45	1075715	12824608	hadcm3n_p3o6_1900_40_007222342_1	414,720	976,463	2.3545
20 Jun 2011 07:04:23	1075715	12824608	hadcm3n_p3o6_1900_40_007222342_1	388,800	916,116	2.3563
16 Jun 2011 20:13:50	1075715	12824608	hadcm3n_p3o6_1900_40_007222342_1	362,880	855,005	2.3562
15 Jun 2011 05:26:44	1075715	12824608	hadcm3n_p3o6_1900_40_007222342_1	336,960	795,091	2.3596
07 Jun 2011 07:28:41	1075715	12824608	hadcm3n_p3o6_1900_40_007222342_1	311,040	734,179	2.3604
05 Jun 2011 22:30:16	1075715	12824608	hadcm3n_p3o6_1900_40_007222342_1	285,120	673,706	2.3629