Task 13118993

Name	hadcm3n_yj27_1900_40_007357561_0
Workunit	7554991
Created	6 Jul 2011, 14:53:50 UTC
Sent	8 Jul 2011, 23:34:49 UTC
Report deadline	8 Oct 2011, 7:02:00 UTC
Received	30 Sep 2011, 23:11:51 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	193 (0x000000C1) EXIT_SIGNAL
Computer ID	1114025
Run time	23 days 21 hours 24 min 25 sec
CPU time	22 days 12 hours 30 min 5 sec
Validate state	Invalid
Credit	12,441.60
Device peak FLOPS	3.12 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>6.10.58</core_client_version> <![CDATA[ <message> - exit code 193 (0xc1) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 21:47:06 (468): No heartbeat from core client for 30 sec - exiting 21:47:08 (468): No heartbeat from core client for 30 sec - exiting 21:47:09 (468): No heartbeat from core client for 30 sec - exiting 21:47:10 (468): No heartbeat from core client for 30 sec - exiting 21:47:11 (468): No heartbeat from core client for 30 sec - exiting 21:47:12 (468): No heartbeat from core client for 30 sec - exiting 21:47:13 (468): No heartbeat from core client for 30 sec - exiting 21:47:15 (468): No heartbeat from core client for 30 sec - exiting 21:47:16 (468): No heartbeat from core client for 30 sec - exiting 21:47:17 (468): No heartbeat from core client for 30 sec - exiting 21:47:18 (468): No heartbeat from core client for 30 sec - exiting 21:47:19 (468): No heartbeat from core client for 30 sec - exiting 21:47:20 (468): No heartbeat from core client for 30 sec - exiting 21:47:21 (468): No heartbeat from core client for 30 sec - exiting 21:47:22 (468): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3960, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3976, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... C21:01:24 (4796): No heartbeat from core client for 30 sec - exiting 21:01:26 (4796): No heartbeat from core client for 30 sec - exiting 21:01:27 (4796): No heartbeat from core client for 30 sec - exiting 21:01:28 (4796): No heartbeat from core client for 30 sec - exiting 21:01:29 (4796): No heartbeat from core client for 30 sec - exiting 21:01:30 (4796): No heartbeat from core client for 30 sec - exiting 21:01:31 (4796): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 18:00:53 (1072): No heartbeat from core client for 30 sec - exiting 18:00:54 (1072): No heartbeat from core client for 30 sec - exiting 18:00:55 (1072): No heartbeat from core client for 30 sec - exiting 18:00:56 (1072): No heartbeat from core client for 30 sec - exiting 18:00:57 (1072): No heartbeat from core client for 30 sec - exiting 18:00:58 (1072): No heartbeat from core client for 30 sec - exiting 18:00:59 (1072): No heartbeat from core client for 30 sec - exiting 18:01:01 (1072): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3244, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4036, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3804, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4568, iMonCtr=1 Model crash detected, will try to restart... 20:47:17 (4956): No heartbeat from core client for 30 sec - exiting 20:47:19 (4956): No heartbeat from core client for 30 sec - exiting 20:47:20 (4956): No heartbeat from core client for 30 sec - exiting 20:47:21 (4956): No heartbeat from core client for 30 sec - exiting 20:47:22 (4956): No heartbeat from core client for 30 sec - exiting 20:47:23 (4956): No heartbeat from core client for 30 sec - exiting 20:47:25 (4956): No heartbeat from core client for 30 sec - exiting 20:47:26 (4956): No heartbeat from core client for 30 sec - exiting 20:47:27 (4956): No heartbeat from core client for 30 sec - exiting 20:47:28 (4956): No heartbeat from core client for 30 sec - exiting 20:47:29 (4956): No heartbeat from core client for 30 sec - exiting 20:47:30 (4956): No heartbeat from core client for 30 sec - exiting 20:47:31 (4956): No heartbeat from core client for 30 sec - exiting 20:47:32 (4956): No heartbeat from core client for 30 sec - exiting 20:47:33 (4956): No heartbeat from core client for 30 sec - exiting 20:47:34 (4956): No heartbeat from core client for 30 sec - exiting 20:47:35 (4956): No heartbeat from core client for 30 sec - exiting 20:47:37 (4956): No heartbeat from core client for 30 sec - exiting 20:47:38 (4956): No heartbeat from core client for 30 sec - exiting 20:47:39 (4956): No heartbeat from core client for 30 sec - exiting 20:47:40 (4956): No heartbeat from core client for 30 sec - exiting 20:47:41 (4956): No heartbeat from core client for 30 sec - exiting 20:47:42 (4956): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x77563A93 read attempt to address 0x40B8AA3C Engaging BOINC Windows Runtime Debugger... Cannot serialize file C:\ProgramData\BOINC/projects/climateprediction.net/hadcm3n_yj27_1900_40_007357561/dataout/shmem_restart.day Signal 11 received, exiting... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
30 Sep 2011 23:09:13	1114025	13118993	hadcm3n_yj27_1900_40_007357561_0	1,036,800	1,945,801	1.8767
26 Sep 2011 17:49:49	1114025	13118993	hadcm3n_yj27_1900_40_007357561_0	1,010,880	1,895,565	1.8752
20 Sep 2011 20:38:05	1114025	13118993	hadcm3n_yj27_1900_40_007357561_0	984,960	1,845,336	1.8735
18 Sep 2011 08:57:00	1114025	13118993	hadcm3n_yj27_1900_40_007357561_0	959,040	1,797,152	1.8739
17 Sep 2011 13:07:34	1114025	13118993	hadcm3n_yj27_1900_40_007357561_0	933,120	1,749,165	1.8745
16 Sep 2011 20:23:08	1114025	13118993	hadcm3n_yj27_1900_40_007357561_0	907,200	1,699,844	1.8737
10 Sep 2011 16:43:37	1114025	13118993	hadcm3n_yj27_1900_40_007357561_0	881,280	1,650,689	1.8731
10 Sep 2011 03:27:35	1114025	13118993	hadcm3n_yj27_1900_40_007357561_0	855,360	1,602,186	1.8731
05 Sep 2011 20:09:17	1114025	13118993	hadcm3n_yj27_1900_40_007357561_0	829,440	1,552,940	1.8723
04 Sep 2011 07:38:25	1114025	13118993	hadcm3n_yj27_1900_40_007357561_0	803,520	1,505,110	1.8731
03 Sep 2011 03:02:33	1114025	13118993	hadcm3n_yj27_1900_40_007357561_0	777,600	1,455,682	1.8720
28 Aug 2011 18:35:09	1114025	13118993	hadcm3n_yj27_1900_40_007357561_0	751,680	1,405,572	1.8699
28 Aug 2011 04:05:42	1114025	13118993	hadcm3n_yj27_1900_40_007357561_0	725,760	1,355,314	1.8674
27 Aug 2011 06:09:19	1114025	13118993	hadcm3n_yj27_1900_40_007357561_0	699,840	1,305,662	1.8657
26 Aug 2011 15:19:29	1114025	13118993	hadcm3n_yj27_1900_40_007357561_0	673,920	1,255,761	1.8634
20 Aug 2011 04:58:45	1114025	13118993	hadcm3n_yj27_1900_40_007357561_0	648,000	1,205,533	1.8604
19 Aug 2011 14:27:42	1114025	13118993	hadcm3n_yj27_1900_40_007357561_0	622,080	1,154,966	1.8566
18 Aug 2011 23:39:36	1114025	13118993	hadcm3n_yj27_1900_40_007357561_0	596,160	1,104,601	1.8529
18 Aug 2011 08:37:34	1114025	13118993	hadcm3n_yj27_1900_40_007357561_0	570,240	1,054,739	1.8496
15 Aug 2011 20:40:38	1114025	13118993	hadcm3n_yj27_1900_40_007357561_0	544,320	1,005,031	1.8464