Task 16053372

Name	hadcm3n_o0va_1940_40_008383209_4
Workunit	8534068
Created	2 Oct 2013, 7:24:35 UTC
Sent	2 Oct 2013, 7:55:41 UTC
Report deadline	1 Jan 2014, 15:22:52 UTC
Received	29 Nov 2013, 6:55:36 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	193 (0x000000C1) EXIT_SIGNAL
Computer ID	1204768
Run time	12 days 20 hours 15 min 33 sec
CPU time	12 days 2 hours 58 min 34 sec
Validate state	Invalid
Credit	9,331.20
Device peak FLOPS	3.02 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>6.10.58</core_client_version> <![CDATA[ <message> - exit code 193 (0xc1) </message> <stderr_txt> Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5896, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 07:30:38 (5420): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 07:58:11 (5668): No heartbeat from core client for 30 sec - exiting 07:58:12 (5668): No heartbeat from core client for 30 sec - exiting 07:58:13 (5668): No heartbeat from core client for 30 sec - exiting 07:58:14 (5668): No heartbeat from core client for 30 sec - exiting 07:58:15 (5668): No heartbeat from core client for 30 sec - exiting 07:58:16 (5668): No heartbeat from core client for 30 sec - exiting 07:58:17 (5668): No heartbeat from core client for 30 sec - exiting 07:58:18 (5668): No heartbeat from core client for 30 sec - exiting 07:58:19 (5668): No heartbeat from core client for 30 sec - exiting 07:58:20 (5668): No heartbeat from core client for 30 sec - exiting 07:58:21 (5668): No heartbeat from core client for 30 sec - exiting 07:58:22 (5668): No heartbeat from core client for 30 sec - exiting 07:58:23 (5668): No heartbeat from core client for 30 sec - exiting 07:58:24 (5668): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CCPDN Monitor - Quit request from BOINC... 07:35:03 (5144): No heartbeat from core client for 30 sec - exiting 07:35:04 (5144): No heartbeat from core client for 30 sec - exiting 07:35:05 (5144): No heartbeat from core client for 30 sec - exiting 07:35:06 (5144): No heartbeat from core client for 30 sec - exiting 07:35:07 (5144): No heartbeat from core client for 30 sec - exiting 07:35:08 (5144): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 15:16:16 (5348): No heartbeat from core client for 30 sec - exiting 15:16:17 (5348): No heartbeat from core client for 30 sec - exiting 15:16:18 (5348): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:05:25 (6028): No heartbeat from core client for 30 sec - exiting 19:05:26 (6028): No heartbeat from core client for 30 sec - exiting 19:05:27 (6028): No heartbeat from core client for 30 sec - exiting 19:05:28 (6028): No heartbeat from core client for 30 sec - exiting 19:05:29 (6028): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5832, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x77E13AC3 read attempt to address 0x40B0CBEC Engaging BOINC Windows Runtime Debugger... Cannot serialize file C:\ProgramData\BOINC/projects/climateprediction.net/hadcm3n_o0va_1940_40_008383209/dataout/shmem_restart.day Signal 11 received, exiting... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
27 Nov 2013 13:44:46	1204768	16053372	hadcm3n_o0va_1940_40_008383209_4	777,600	1,047,510	1.3471
25 Nov 2013 15:43:16	1204768	16053372	hadcm3n_o0va_1940_40_008383209_4	751,680	1,013,151	1.3478
22 Nov 2013 07:45:46	1204768	16053372	hadcm3n_o0va_1940_40_008383209_4	725,760	978,325	1.3480
21 Nov 2013 08:07:42	1204768	16053372	hadcm3n_o0va_1940_40_008383209_4	699,840	943,410	1.3480
19 Nov 2013 13:29:33	1204768	16053372	hadcm3n_o0va_1940_40_008383209_4	673,920	908,814	1.3485
18 Nov 2013 12:03:15	1204768	16053372	hadcm3n_o0va_1940_40_008383209_4	648,000	874,181	1.3490
15 Nov 2013 09:20:52	1204768	16053372	hadcm3n_o0va_1940_40_008383209_4	622,080	839,327	1.3492
13 Nov 2013 14:37:45	1204768	16053372	hadcm3n_o0va_1940_40_008383209_4	596,160	804,891	1.3501
12 Nov 2013 18:02:09	1204768	16053372	hadcm3n_o0va_1940_40_008383209_4	570,240	770,240	1.3507
12 Nov 2013 08:01:41	1204768	16053372	hadcm3n_o0va_1940_40_008383209_4	544,320	735,774	1.3517
11 Nov 2013 08:16:24	1204768	16053372	hadcm3n_o0va_1940_40_008383209_4	518,400	700,878	1.3520
07 Nov 2013 13:26:38	1204768	16053372	hadcm3n_o0va_1940_40_008383209_4	492,480	666,551	1.3535
05 Nov 2013 16:25:56	1204768	16053372	hadcm3n_o0va_1940_40_008383209_4	466,560	631,906	1.3544
04 Nov 2013 11:00:20	1204768	16053372	hadcm3n_o0va_1940_40_008383209_4	440,640	597,405	1.3558
01 Nov 2013 09:32:23	1204768	16053372	hadcm3n_o0va_1940_40_008383209_4	414,720	563,179	1.3580
31 Oct 2013 08:59:12	1204768	16053372	hadcm3n_o0va_1940_40_008383209_4	388,800	528,528	1.3594
30 Oct 2013 06:31:54	1204768	16053372	hadcm3n_o0va_1940_40_008383209_4	362,880	494,285	1.3621
28 Oct 2013 14:10:12	1204768	16053372	hadcm3n_o0va_1940_40_008383209_4	336,960	459,552	1.3638
25 Oct 2013 10:19:14	1204768	16053372	hadcm3n_o0va_1940_40_008383209_4	311,040	424,951	1.3662
24 Oct 2013 07:28:38	1204768	16053372	hadcm3n_o0va_1940_40_008383209_4	285,120	390,265	1.3688