Task 13025077

Name	hadcm3n_t50i_1940_40_007315953_1
Workunit	7513383
Created	29 Jun 2011, 0:19:01 UTC
Sent	29 Jun 2011, 0:23:53 UTC
Report deadline	28 Sep 2011, 7:51:04 UTC
Received	17 Aug 2011, 9:38:07 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	193 (0x000000C1) EXIT_SIGNAL
Computer ID	1024466
Run time	25 days 17 hours 23 min 49 sec
CPU time	23 days 19 hours 27 min 42 sec
Validate state	Invalid
Credit	9,331.20
Device peak FLOPS	1.92 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>6.6.20</core_client_version> <![CDATA[ <message> - exit code 193 (0xc1) </message> <stderr_txt> Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5600, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2732, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... 21:44:15 (1932): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 04:13:18 (5412): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:13:20 (5412): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=444, iMonCtr=1 Model crash detected, will try to restart... 09:25:07 (1864): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:25:08 (1864): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 13:21:43 (2444): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 22:00:01 (156): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:00:02 (156): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x77358C13 read attempt to address 0xFFFFFFF8 Engaging BOINC Windows Runtime Debugger... Cannot serialize file C:\ProgramData\BOINC/projects/climateprediction.net/hadcm3n_t50i_1940_40_007315953/dataout/shmem_restart.day Signal 11 received, exiting... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
16 Aug 2011 09:40:09	1024466	13025077	hadcm3n_t50i_1940_40_007315953_1	777,600	2,057,243	2.6456
13 Aug 2011 14:18:24	1024466	13025077	hadcm3n_t50i_1940_40_007315953_1	751,680	1,993,140	2.6516
12 Aug 2011 13:49:14	1024466	13025077	hadcm3n_t50i_1940_40_007315953_1	725,760	1,930,973	2.6606
10 Aug 2011 22:04:36	1024466	13025077	hadcm3n_t50i_1940_40_007315953_1	699,840	1,863,789	2.6632
10 Aug 2011 01:37:30	1024466	13025077	hadcm3n_t50i_1940_40_007315953_1	673,920	1,791,327	2.6581
08 Aug 2011 15:58:37	1024466	13025077	hadcm3n_t50i_1940_40_007315953_1	648,000	1,726,140	2.6638
01 Aug 2011 14:16:07	1024466	13025077	hadcm3n_t50i_1940_40_007315953_1	622,080	1,659,998	2.6685
31 Jul 2011 17:49:09	1024466	13025077	hadcm3n_t50i_1940_40_007315953_1	596,160	1,592,508	2.6713
30 Jul 2011 18:11:17	1024466	13025077	hadcm3n_t50i_1940_40_007315953_1	570,240	1,518,789	2.6634
29 Jul 2011 22:03:44	1024466	13025077	hadcm3n_t50i_1940_40_007315953_1	544,320	1,447,837	2.6599
28 Jul 2011 21:00:32	1024466	13025077	hadcm3n_t50i_1940_40_007315953_1	518,400	1,375,815	2.6540
27 Jul 2011 22:26:27	1024466	13025077	hadcm3n_t50i_1940_40_007315953_1	492,480	1,304,631	2.6491
26 Jul 2011 23:36:46	1024466	13025077	hadcm3n_t50i_1940_40_007315953_1	466,560	1,233,493	2.6438
26 Jul 2011 03:07:16	1024466	13025077	hadcm3n_t50i_1940_40_007315953_1	440,640	1,161,048	2.6349
25 Jul 2011 22:49:31	1024466	13025077	hadcm3n_t50i_1940_40_007315953_1	414,720	1,088,475	2.6246
25 Jul 2011 21:56:56	1024466	13025077	hadcm3n_t50i_1940_40_007315953_1	388,800	1,015,377	2.6116
25 Jul 2011 13:08:03	1024466	13025077	hadcm3n_t50i_1940_40_007315953_1	362,880	941,972	2.5958
25 Jul 2011 13:08:03	1024466	13025077	hadcm3n_t50i_1940_40_007315953_1	336,960	879,453	2.6100
25 Jul 2011 13:08:03	1024466	13025077	hadcm3n_t50i_1940_40_007315953_1	311,040	809,499	2.6026
09 Jul 2011 10:00:46	1024466	13025077	hadcm3n_t50i_1940_40_007315953_1	285,120	737,024	2.5850