Task 15591686

Name	hadcm3n_4dc3_1940_40_008305560_0
Workunit	8456695
Created	7 Feb 2013, 6:37:17 UTC
Sent	7 Feb 2013, 6:43:46 UTC
Report deadline	9 May 2013, 14:10:57 UTC
Received	11 Mar 2013, 22:03:49 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	193 (0x000000C1) EXIT_SIGNAL
Computer ID	1072042
Run time	9 days 12 hours 13 min 43 sec
CPU time	8 days 19 hours 25 min 29 sec
Validate state	Invalid
Credit	6,220.80
Device peak FLOPS	2.73 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>6.10.56</core_client_version> <![CDATA[ <message> - exit code 193 (0xc1) </message> <stderr_txt> 00:16:26 (3776): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:16:14 (6904): No heartbeat from core client for 30 sec - exiting 05:16:15 (6904): No heartbeat from core client for 30 sec - exiting 05:16:16 (6904): No heartbeat from core client for 30 sec - exiting 05:16:17 (6904): No heartbeat from core client for 30 sec - exiting 05:16:18 (6904): No heartbeat from core client for 30 sec - exiting 05:16:19 (6904): No heartbeat from core client for 30 sec - exiting 05:16:20 (6904): No heartbeat from core client for 30 sec - exiting 05:16:22 (6904): No heartbeat from core client for 30 sec - exiting 05:16:23 (6904): No heartbeat from core client for 30 sec - exiting 05:16:24 (6904): No heartbeat from core client for 30 sec - exiting 05:16:25 (6904): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:56:08 (4680): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:37:24 (3204): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3060, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 19:43:29 (2484): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:08:38 (7644): No heartbeat from core client for 30 sec - exiting 19:08:39 (7644): No heartbeat from core client for 30 sec - exiting 19:08:40 (7644): No heartbeat from core client for 30 sec - exiting 19:08:41 (7644): No heartbeat from core client for 30 sec - exiting 19:08:42 (7644): No heartbeat from core client for 30 sec - exiting 19:08:43 (7644): No heartbeat from core client for 30 sec - exiting 19:08:45 (7644): No heartbeat from core client for 30 sec - exiting 19:08:46 (7644): No heartbeat from core client for 30 sec - exiting 19:08:47 (7644): No heartbeat from core client for 30 sec - exiting 19:08:48 (7644): No heartbeat from core client for 30 sec - exiting 19:08:49 (7644): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 20:56:14 (5084): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 10:24:14 (3504): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6384, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x77B63F99 read attempt to address 0xFFFFFFF8 Engaging BOINC Windows Runtime Debugger... Cannot serialize file C:\ProgramData\BOINC/projects/climateprediction.net/hadcm3n_4dc3_1940_40_008305560/dataout/shmem_restart.day Signal 11 received, exiting... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
11 Mar 2013 21:07:20	1072042	15591686	hadcm3n_4dc3_1940_40_008305560_0	518,400	761,124	1.4682
10 Mar 2013 06:10:51	1072042	15591686	hadcm3n_4dc3_1940_40_008305560_0	492,480	722,909	1.4679
09 Mar 2013 04:31:18	1072042	15591686	hadcm3n_4dc3_1940_40_008305560_0	466,560	685,064	1.4683
08 Mar 2013 05:55:36	1072042	15591686	hadcm3n_4dc3_1940_40_008305560_0	440,640	647,010	1.4683
07 Mar 2013 07:55:25	1072042	15591686	hadcm3n_4dc3_1940_40_008305560_0	414,720	609,119	1.4687
06 Mar 2013 07:25:30	1072042	15591686	hadcm3n_4dc3_1940_40_008305560_0	388,800	571,107	1.4689
05 Mar 2013 18:59:14	1072042	15591686	hadcm3n_4dc3_1940_40_008305560_0	362,880	532,768	1.4682
28 Feb 2013 01:15:43	1072042	15591686	hadcm3n_4dc3_1940_40_008305560_0	336,960	494,825	1.4685
27 Feb 2013 04:00:43	1072042	15591686	hadcm3n_4dc3_1940_40_008305560_0	311,040	456,434	1.4674
26 Feb 2013 01:58:00	1072042	15591686	hadcm3n_4dc3_1940_40_008305560_0	285,120	417,875	1.4656
25 Feb 2013 05:03:28	1072042	15591686	hadcm3n_4dc3_1940_40_008305560_0	259,200	380,185	1.4668
24 Feb 2013 09:35:42	1072042	15591686	hadcm3n_4dc3_1940_40_008305560_0	233,280	341,511	1.4640
23 Feb 2013 21:14:45	1072042	15591686	hadcm3n_4dc3_1940_40_008305560_0	207,360	301,473	1.4539
23 Feb 2013 10:17:26	1072042	15591686	hadcm3n_4dc3_1940_40_008305560_0	181,440	263,204	1.4506
21 Feb 2013 07:29:21	1072042	15591686	hadcm3n_4dc3_1940_40_008305560_0	155,520	224,724	1.4450
20 Feb 2013 08:02:57	1072042	15591686	hadcm3n_4dc3_1940_40_008305560_0	129,600	187,326	1.4454
19 Feb 2013 07:27:59	1072042	15591686	hadcm3n_4dc3_1940_40_008305560_0	103,680	149,690	1.4438
18 Feb 2013 19:48:02	1072042	15591686	hadcm3n_4dc3_1940_40_008305560_0	77,760	112,128	1.4420
17 Feb 2013 02:15:41	1072042	15591686	hadcm3n_4dc3_1940_40_008305560_0	51,840	74,672	1.4404
16 Feb 2013 00:42:13	1072042	15591686	hadcm3n_4dc3_1940_40_008305560_0	25,920	37,442	1.4445