Task 13676578

Name	hadcm3n_o6ew_1980_40_007538002_4
Workunit	7735234
Created	30 Nov 2011, 12:53:55 UTC
Sent	30 Nov 2011, 12:57:39 UTC
Report deadline	29 Feb 2012, 20:24:50 UTC
Received	23 Dec 2011, 16:23:11 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	193 (0x000000C1) EXIT_SIGNAL
Computer ID	1127567
Run time	14 days 20 hours 30 min 24 sec
CPU time	13 days 3 hours 18 min 44 sec
Validate state	Invalid
Credit	6,220.80
Device peak FLOPS	2.71 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>6.12.34</core_client_version> <![CDATA[ <message> - exit code 193 (0xc1) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 10:53:36 (7360): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:53:38 (7360): No heartbeat from core client for 30 sec - exiting 10:53:39 (7360): No heartbeat from core client for 30 sec - exiting 10:53:40 (7360): No heartbeat from core client for 30 sec - exiting 10:53:41 (7360): No heartbeat from core client for 30 sec - exiting 10:53:42 (7360): No heartbeat from core client for 30 sec - exiting 10:53:43 (7360): No heartbeat from core client for 30 sec - exiting 10:53:44 (7360): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... No Process Handle Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4660, selfPID=4660, iMonCtr=1 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 09:56:22 (5644): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 04:56:26 (7080): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 11:40:06 (3572): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:40:08 (3572): No heartbeat from core client for 30 sec - exiting 14:38:19 (2208): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:38:21 (2208): No heartbeat from core client for 30 sec - exiting 14:38:22 (2208): No heartbeat from core client for 30 sec - exiting 14:38:23 (2208): No heartbeat from core client for 30 sec - exiting 14:38:24 (2208): No heartbeat from core client for 30 sec - exiting 14:38:25 (2208): No heartbeat from core client for 30 sec - exiting 14:38:26 (2208): No heartbeat from core client for 30 sec - exiting 14:38:27 (2208): No heartbeat from core client for 30 sec - exiting 14:38:28 (2208): No heartbeat from core client for 30 sec - exiting 14:38:29 (2208): No heartbeat from core client for 30 sec - exiting 14:38:30 (2208): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 21:07:38 (4592): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:10:42 (4336): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:16:47 (1040): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 17:01:31 (5748): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:01:33 (5748): No heartbeat from core client for 30 sec - exiting 17:01:34 (5748): No heartbeat from core client for 30 sec - exiting 17:01:35 (5748): No heartbeat from core client for 30 sec - exiting 17:01:36 (5748): No heartbeat from core client for 30 sec - exiting 17:01:37 (5748): No heartbeat from core client for 30 sec - exiting 17:01:38 (5748): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 07:37:39 (4232): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:37:40 (4232): No heartbeat from core client for 30 sec - exiting 07:37:41 (4232): No heartbeat from core client for 30 sec - exiting 07:37:42 (4232): No heartbeat from core client for 30 sec - exiting 07:37:43 (4232): No heartbeat from core client for 30 sec - exiting 07:37:44 (4232): No heartbeat from core client for 30 sec - exiting 07:37:45 (4232): No heartbeat from core client for 30 sec - exiting 07:37:46 (4232): No heartbeat from core client for 30 sec - exiting 07:37:47 (4232): No heartbeat from core client for 30 sec - exiting 07:37:48 (4232): No heartbeat from core client for 30 sec - exiting 07:37:49 (4232): No heartbeat from core client for 30 sec - exiting 22:49:45 (4484): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:49:47 (4484): No heartbeat from core client for 30 sec - exiting 22:49:48 (4484): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 04:40:07 (6676): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:00:01 (6836): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x773C3F79 read attempt to address 0x3E2325B1 Engaging BOINC Windows Runtime Debugger... No Process Handle Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1304, selfPID=1304, iMonCtr=1 Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x773C7188 read attempt to address 0x3E2325B1 Engaging BOINC Windows Runtime Debugger... Cannot serialize file C:\ProgramData\BOINC/projects/climateprediction.net/hadcm3n_o6ew_1980_40_007538002/dataout/shmem_restart.day Signal 11 received, exiting... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
23 Dec 2011 10:11:36	1127567	13676578	hadcm3n_o6ew_1980_40_007538002_4	518,400	1,117,269	2.1552
22 Dec 2011 16:10:28	1127567	13676578	hadcm3n_o6ew_1980_40_007538002_4	492,480	1,063,682	2.1598
21 Dec 2011 23:45:35	1127567	13676578	hadcm3n_o6ew_1980_40_007538002_4	466,560	1,008,085	2.1607
21 Dec 2011 08:17:48	1127567	13676578	hadcm3n_o6ew_1980_40_007538002_4	440,640	955,105	2.1675
19 Dec 2011 17:09:42	1127567	13676578	hadcm3n_o6ew_1980_40_007538002_4	414,720	901,881	2.1747
16 Dec 2011 22:20:58	1127567	13676578	hadcm3n_o6ew_1980_40_007538002_4	388,800	846,470	2.1771
15 Dec 2011 23:14:01	1127567	13676578	hadcm3n_o6ew_1980_40_007538002_4	362,880	791,182	2.1803
15 Dec 2011 06:43:47	1127567	13676578	hadcm3n_o6ew_1980_40_007538002_4	336,960	735,957	2.1841
14 Dec 2011 11:08:26	1127567	13676578	hadcm3n_o6ew_1980_40_007538002_4	311,040	679,658	2.1851
13 Dec 2011 13:47:50	1127567	13676578	hadcm3n_o6ew_1980_40_007538002_4	285,120	618,331	2.1687
12 Dec 2011 20:55:00	1127567	13676578	hadcm3n_o6ew_1980_40_007538002_4	259,200	564,472	2.1777
12 Dec 2011 05:07:28	1127567	13676578	hadcm3n_o6ew_1980_40_007538002_4	233,280	511,879	2.1943
11 Dec 2011 03:55:38	1127567	13676578	hadcm3n_o6ew_1980_40_007538002_4	207,360	454,925	2.1939
10 Dec 2011 06:20:34	1127567	13676578	hadcm3n_o6ew_1980_40_007538002_4	181,440	393,450	2.1685
09 Dec 2011 05:16:48	1127567	13676578	hadcm3n_o6ew_1980_40_007538002_4	155,520	335,870	2.1597
06 Dec 2011 12:51:03	1127567	13676578	hadcm3n_o6ew_1980_40_007538002_4	129,600	271,497	2.0949
05 Dec 2011 06:10:18	1127567	13676578	hadcm3n_o6ew_1980_40_007538002_4	103,680	216,276	2.0860
04 Dec 2011 01:28:14	1127567	13676578	hadcm3n_o6ew_1980_40_007538002_4	77,760	161,101	2.0718
02 Dec 2011 23:43:53	1127567	13676578	hadcm3n_o6ew_1980_40_007538002_4	51,840	108,222	2.0876
01 Dec 2011 18:36:17	1127567	13676578	hadcm3n_o6ew_1980_40_007538002_4	25,920	57,559	2.2206