Task 13326657

Name	hadcm3n_o55u_1940_40_007436411_0
Workunit	7633914
Created	1 Sep 2011, 19:54:47 UTC
Sent	1 Sep 2011, 20:08:09 UTC
Report deadline	2 Dec 2011, 3:35:20 UTC
Received	15 Oct 2011, 20:14:06 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	193 (0x000000C1) EXIT_SIGNAL
Computer ID	1092368
Run time	25 days 6 hours 26 min 49 sec
CPU time	20 days 23 hours 36 min 19 sec
Validate state	Invalid
Credit	12,441.60
Device peak FLOPS	2.71 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>6.10.58</core_client_version> <![CDATA[ <message> - exit code 193 (0xc1) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4772, selfPID=4772, iMonCtr=1 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... No Process Handle Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=9936, selfPID=9936, iMonCtr=1 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 04:32:13 (7688): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:32:15 (7688): No heartbeat from core client for 30 sec - exiting 04:32:16 (7688): No heartbeat from core client for 30 sec - exiting 04:33:39 (552): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:49:22 (8996): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:50:23 (8600): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:52:00 (9304): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:52:47 (3700): No heartbeat from core client for 30 sec - exiting 05:52:48 (3700): No heartbeat from core client for 30 sec - exiting 05:52:49 (3700): No heartbeat from core client for 30 sec - exiting 05:52:50 (3700): No heartbeat from core client for 30 sec - exiting 05:52:51 (3700): No heartbeat from core client for 30 sec - exiting 05:52:52 (3700): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:44:04 (8092): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:44:06 (8092): No heartbeat from core client for 30 sec - exiting 06:44:07 (8092): No heartbeat from core client for 30 sec - exiting 06:52:45 (9548): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:01:47 (8828): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:13:30 (7224): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 05:46:39 (9652): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:46:41 (9652): No heartbeat from core client for 30 sec - exiting 05:46:42 (9652): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 11:04:38 (8768): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 12:47:25 (6860): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:47:26 (6860): No heartbeat from core client for 30 sec - exiting 12:47:27 (6860): No heartbeat from core client for 30 sec - exiting 12:47:28 (6860): No heartbeat from core client for 30 sec - exiting 12:47:29 (6860): No heartbeat from core client for 30 sec - exiting 12:48:21 (5812): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 03:08:14 (6876): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 21:59:08 (1336): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:59:09 (1336): No heartbeat from core client for 30 sec - exiting 21:59:10 (1336): No heartbeat from core client for 30 sec - exiting 21:59:11 (1336): No heartbeat from core client for 30 sec - exiting 21:59:12 (1336): No heartbeat from core client for 30 sec - exiting 21:59:13 (1336): No heartbeat from core client for 30 sec - exiting 21:59:14 (1336): No heartbeat from core client for 30 sec - exiting 21:59:15 (1336): No heartbeat from core client for 30 sec - exiting 21:59:16 (1336): No heartbeat from core client for 30 sec - exiting 21:59:17 (1336): No heartbeat from core client for 30 sec - exiting 21:59:18 (1336): No heartbeat from core client for 30 sec - exiting 21:59:19 (1336): No heartbeat from core client for 30 sec - exiting 21:59:20 (1336): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 05:34:34 (5628): No heartbeat from core client for 30 sec - exiting 05:34:35 (5628): No heartbeat from core client for 30 sec - exiting 05:34:36 (5628): No heartbeat from core client for 30 sec - exiting 05:34:37 (5628): No heartbeat from core client for 30 sec - exiting 05:34:38 (5628): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:36:58 (1304): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 17:36:36 (2496): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:36:37 (2496): No heartbeat from core client for 30 sec - exiting 17:36:38 (2496): No heartbeat from core client for 30 sec - exiting 17:36:39 (2496): No heartbeat from core client for 30 sec - exiting 17:36:40 (2496): No heartbeat from core client for 30 sec - exiting 17:36:41 (2496): No heartbeat from core client for 30 sec - exiting 17:36:42 (2496): No heartbeat from core client for 30 sec - exiting 17:36:43 (2496): No heartbeat from core client for 30 sec - exiting 17:36:44 (2496): No heartbeat from core client for 30 sec - exiting 17:36:45 (2496): No heartbeat from core client for 30 sec - exiting 17:36:46 (2496): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... 05:08:28 (9788): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:08:30 (9788): No heartbeat from core client for 30 sec - exiting 05:08:31 (9788): No heartbeat from core client for 30 sec - exiting 05:26:33 (10044): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:38:56 (9796): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:38:57 (9796): No heartbeat from core client for 30 sec - exiting 05:48:58 (5156): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:49:44 (8600): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:58:57 (6920): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:59:49 (5740): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:13:59 (3500): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:14:42 (3988): No heartbeat from core client for 30 sec - exiting 06:14:43 (3988): No heartbeat from core client for 30 sec - exiting 06:14:44 (3988): No heartbeat from core client for 30 sec - exiting 06:14:45 (3988): No heartbeat from core client for 30 sec - exiting 06:14:46 (3988): No heartbeat from core client for 30 sec - exiting 06:14:47 (3988): No heartbeat from core client for 30 sec - exiting 06:14:48 (3988): No heartbeat from core client for 30 sec - exiting 06:14:49 (3988): No heartbeat from core client for 30 sec - exiting 06:14:50 (3988): No heartbeat from core client for 30 sec - exiting 06:14:51 (3988): No heartbeat from core client for 30 sec - exiting 06:14:52 (3988): No heartbeat from core client for 30 sec - exiting 06:14:53 (3988): No heartbeat from core client for 30 sec - exiting 06:14:54 (3988): No heartbeat from core client for 30 sec - exiting 06:14:55 (3988): No heartbeat from core client for 30 sec - exiting 06:14:56 (3988): No heartbeat from core client for 30 sec - exiting 06:14:57 (3988): No heartbeat from core client for 30 sec - exiting 06:14:58 (3988): No heartbeat from core client for 30 sec - exiting 06:14:59 (3988): No heartbeat from core client for 30 sec - exiting 06:15:00 (3988): No heartbeat from core client for 30 sec - exiting 06:15:01 (3988): No heartbeat from core client for 30 sec - exiting 06:15:02 (3988): No heartbeat from core client for 30 sec - exiting 06:15:03 (3988): No heartbeat from core client for 30 sec - exiting 06:15:04 (3988): No heartbeat from core client for 30 sec - exiting 06:15:05 (3988): No heartbeat from core client for 30 sec - exiting 06:15:06 (3988): No heartbeat from core client for 30 sec - exiting 06:15:07 (3988): No heartbeat from core client for 30 sec - exiting 06:15:08 (3988): No heartbeat from core client for 30 sec - exiting 06:15:09 (3988): No heartbeat from core client for 30 sec - exiting 06:15:10 (3988): No heartbeat from core client for 30 sec - exiting 06:15:11 (3988): No heartbeat from core client for 30 sec - exiting 06:15:12 (3988): No heartbeat from core client for 30 sec - exiting 06:15:13 (3988): No heartbeat from core client for 30 sec - exiting 06:15:14 (3988): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:24:00 (9312): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:24:55 (9276): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:09:04 (9560): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 09:44:19 (6664): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:44:21 (6664): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 14:12:57 (8660): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Atmos Hold Restart file rename failed on atmos_restart.hold 19:02:37 (7296): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:02:40 (7296): No heartbeat from core client for 30 sec - exiting 19:02:41 (7296): No heartbeat from core client for 30 sec - exiting 19:02:43 (7296): No heartbeat from core client for 30 sec - exiting 19:02:44 (7296): No heartbeat from core client for 30 sec - exiting 19:02:45 (7296): No heartbeat from core client for 30 sec - exiting 19:02:46 (7296): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 04:54:23 (3584): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:08:33 (7384): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 13:57:21 (9948): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:57:24 (9948): No heartbeat from core client for 30 sec - exiting Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x77AB3F79 read attempt to address 0xFFFFFFF8 Engaging BOINC Windows Runtime Debugger... Cannot serialize file C:\ProgramData\BOINC/projects/climateprediction.net/hadcm3n_o55u_1940_40_007436411/dataout/shmem_restart.day Signal 11 received, exiting... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
15 Oct 2011 19:14:09	1092368	13326657	hadcm3n_o55u_1940_40_007436411_0	1,036,800	1,812,968	1.7486
15 Oct 2011 04:03:16	1092368	13326657	hadcm3n_o55u_1940_40_007436411_0	1,010,880	1,765,758	1.7468
14 Oct 2011 11:46:48	1092368	13326657	hadcm3n_o55u_1940_40_007436411_0	984,960	1,718,784	1.7450
13 Oct 2011 16:48:49	1092368	13326657	hadcm3n_o55u_1940_40_007436411_0	959,040	1,670,925	1.7423
12 Oct 2011 13:19:26	1092368	13326657	hadcm3n_o55u_1940_40_007436411_0	933,120	1,627,832	1.7445
12 Oct 2011 00:58:13	1092368	13326657	hadcm3n_o55u_1940_40_007436411_0	907,200	1,584,455	1.7465
11 Oct 2011 12:03:27	1092368	13326657	hadcm3n_o55u_1940_40_007436411_0	881,280	1,539,379	1.7468
10 Oct 2011 23:27:19	1092368	13326657	hadcm3n_o55u_1940_40_007436411_0	855,360	1,493,258	1.7458
10 Oct 2011 09:50:26	1092368	13326657	hadcm3n_o55u_1940_40_007436411_0	829,440	1,447,565	1.7452
09 Oct 2011 21:23:25	1092368	13326657	hadcm3n_o55u_1940_40_007436411_0	803,520	1,402,165	1.7450
09 Oct 2011 07:15:03	1092368	13326657	hadcm3n_o55u_1940_40_007436411_0	777,600	1,355,962	1.7438
08 Oct 2011 16:48:05	1092368	13326657	hadcm3n_o55u_1940_40_007436411_0	751,680	1,309,177	1.7417
07 Oct 2011 23:54:11	1092368	13326657	hadcm3n_o55u_1940_40_007436411_0	725,760	1,262,661	1.7398
07 Oct 2011 06:12:58	1092368	13326657	hadcm3n_o55u_1940_40_007436411_0	699,840	1,216,631	1.7384
06 Oct 2011 16:12:55	1092368	13326657	hadcm3n_o55u_1940_40_007436411_0	673,920	1,171,067	1.7377
06 Oct 2011 01:51:29	1092368	13326657	hadcm3n_o55u_1940_40_007436411_0	648,000	1,126,108	1.7378
05 Oct 2011 10:57:22	1092368	13326657	hadcm3n_o55u_1940_40_007436411_0	622,080	1,081,684	1.7388
04 Oct 2011 19:50:47	1092368	13326657	hadcm3n_o55u_1940_40_007436411_0	596,160	1,037,061	1.7396
04 Oct 2011 04:02:18	1092368	13326657	hadcm3n_o55u_1940_40_007436411_0	570,240	992,162	1.7399
03 Oct 2011 11:25:00	1092368	13326657	hadcm3n_o55u_1940_40_007436411_0	544,320	947,251	1.7402