Task 13380039

Name	hadcm3n_t2lv_1940_40_007454343_0
Workunit	7651846
Created	12 Sep 2011, 17:29:09 UTC
Sent	13 Sep 2011, 2:32:30 UTC
Report deadline	13 Dec 2011, 9:59:41 UTC
Received	28 Sep 2011, 23:00:30 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	193 (0x000000C1) EXIT_SIGNAL
Computer ID	1149473
Run time	8 days 2 hours 17 min 18 sec
CPU time	6 days 2 hours 50 min 5 sec
Validate state	Invalid
Credit	3,110.40
Device peak FLOPS	2.54 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>6.8.13</core_client_version> <![CDATA[ <message> - exit code 193 (0xc1) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 18:20:08 (5028): No heartbeat from core client for 30 sec - exiting 18:20:09 (5028): No heartbeat from core client for 30 sec - exiting 18:20:10 (5028): No heartbeat from core client for 30 sec - exiting 18:20:11 (5028): No heartbeat from core client for 30 sec - exiting 18:20:12 (5028): No heartbeat from core client for 30 sec - exiting 18:20:13 (5028): No heartbeat from core client for 30 sec - exiting 18:20:14 (5028): No heartbeat from core client for 30 sec - exiting 18:20:16 (5028): No heartbeat from core client for 30 sec - exiting 18:20:17 (5028): No heartbeat from core client for 30 sec - exiting 18:20:18 (5028): No heartbeat from core client for 30 sec - exiting 18:20:19 (5028): No heartbeat from core client for 30 sec - exiting 18:20:20 (5028): No heartbeat from core client for 30 sec - exiting 18:20:21 (5028): No heartbeat from core client for 30 sec - exiting 18:20:23 (5028): No heartbeat from core client for 30 sec - exiting 18:20:24 (5028): No heartbeat from core client for 30 sec - exiting 18:20:25 (5028): No heartbeat from core client for 30 sec - exiting 18:20:26 (5028): No heartbeat from core client for 30 sec - exiting 18:20:27 (5028): No heartbeat from core client for 30 sec - exiting 18:20:28 (5028): No heartbeat from core client for 30 sec - exiting 18:20:29 (5028): No heartbeat from core client for 30 sec - exiting 18:20:31 (5028): No heartbeat from core client for 30 sec - exiting 18:20:32 (5028): No heartbeat from core client for 30 sec - exiting 18:20:33 (5028): No heartbeat from core client for 30 sec - exiting 18:20:34 (5028): No heartbeat from core client for 30 sec - exiting 18:20:35 (5028): No heartbeat from core client for 30 sec - exiting 18:20:36 (5028): No heartbeat from core client for 30 sec - exiting 18:20:38 (5028): No heartbeat from core client for 30 sec - exiting 18:20:39 (5028): No heartbeat from core client for 30 sec - exiting 18:20:40 (5028): No heartbeat from core client for 30 sec - exiting 18:20:41 (5028): No heartbeat from core client for 30 sec - exiting 18:20:42 (5028): No heartbeat from core client for 30 sec - exiting 18:20:43 (5028): No heartbeat from core client for 30 sec - exiting 18:20:44 (5028): No heartbeat from core client for 30 sec - exiting 18:20:46 (5028): No heartbeat from core client for 30 sec - exiting 18:20:47 (5028): No heartbeat from core client for 30 sec - exiting 18:20:48 (5028): No heartbeat from core client for 30 sec - exiting 18:20:49 (5028): No heartbeat from core client for 30 sec - exiting 18:20:50 (5028): No heartbeat from core client for 30 sec - exiting 18:20:51 (5028): No heartbeat from core client for 30 sec - exiting 18:20:52 (5028): No heartbeat from core client for 30 sec - exiting 18:20:53 (5028): No heartbeat from core client for 30 sec - exiting 18:20:54 (5028): No heartbeat from core client for 30 sec - exiting 18:20:56 (5028): No heartbeat from core client for 30 sec - exiting 18:20:57 (5028): No heartbeat from core client for 30 sec - exiting 18:20:58 (5028): No heartbeat from core client for 30 sec - exiting 18:20:59 (5028): No heartbeat from core client for 30 sec - exiting 18:21:00 (5028): No heartbeat from core client for 30 sec - exiting 18:21:01 (5028): No heartbeat from core client for 30 sec - exiting 18:21:03 (5028): No heartbeat from core client for 30 sec - exiting 18:21:04 (5028): No heartbeat from core client for 30 sec - exiting 18:21:05 (5028): No heartbeat from core client for 30 sec - exiting 18:21:06 (5028): No heartbeat from core client for 30 sec - exiting 18:21:07 (5028): No heartbeat from core client for 30 sec - exiting 18:21:08 (5028): No heartbeat from core client for 30 sec - exiting 18:21:09 (5028): No heartbeat from core client for 30 sec - exiting 18:21:10 (5028): No heartbeat from core client for 30 sec - exiting 18:21:11 (5028): No heartbeat from core client for 30 sec - exiting 18:21:13 (5028): No heartbeat from core client for 30 sec - exiting 18:21:14 (5028): No heartbeat from core client for 30 sec - exiting 18:21:15 (5028): No heartbeat from core client for 30 sec - exiting 18:21:16 (5028): No heartbeat from core client for 30 sec - exiting 18:21:17 (5028): No heartbeat from core client for 30 sec - exiting 18:21:18 (5028): No heartbeat from core client for 30 sec - exiting 18:21:19 (5028): No heartbeat from core client for 30 sec - exiting 18:21:21 (5028): No heartbeat from core client for 30 sec - exiting 18:21:22 (5028): No heartbeat from core client for 30 sec - exiting 18:21:23 (5028): No heartbeat from core client for 30 sec - exiting 18:21:24 (5028): No heartbeat from core client for 30 sec - exiting 18:21:25 (5028): No heartbeat from core client for 30 sec - exiting 18:21:26 (5028): No heartbeat from core client for 30 sec - exiting 18:21:27 (5028): No heartbeat from core client for 30 sec - exiting 18:21:28 (5028): No heartbeat from core client for 30 sec - exiting 18:21:29 (5028): No heartbeat from core client for 30 sec - exiting 18:21:31 (5028): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... BUFFIN: C I/O Error feof - Unit 63 - Return code = 16 BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 BUFFIN: C I/O Error feof - Unit 65 - Return code = 16 BUFFIN: C I/O Error feof - Unit 66 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 Error converting file to netcdf: dataout/t2lvko.pje4c10 Error converting file to netcdf: dataout/t2lvko.pie4c10 Error converting file to netcdf: dataout/t2lvko.pfe4c10 Error converting file to netcdf: dataout/t2lvka.phe4c10 Error converting file to netcdf: dataout/t2lvka.pge4c10 Error converting file to netcdf: dataout/t2lvka.pee4c10 Error converting file to netcdf: dataout/t2lvka.pde4c10 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x77D33A93 read attempt to address 0x4038CD0D Engaging BOINC Windows Runtime Debugger... Cannot serialize file C:\ProgramData\BOINC/projects/climateprediction.net/hadcm3n_t2lv_1940_40_007454343/dataout/shmem_restart.day Signal 11 received, exiting... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
28 Sep 2011 22:59:50	1149473	13380039	hadcm3n_t2lv_1940_40_007454343_0	259,200	528,603	2.0394
27 Sep 2011 08:43:05	1149473	13380039	hadcm3n_t2lv_1940_40_007454343_0	233,280	475,842	2.0398
25 Sep 2011 16:10:15	1149473	13380039	hadcm3n_t2lv_1940_40_007454343_0	207,360	422,922	2.0396
24 Sep 2011 00:41:07	1149473	13380039	hadcm3n_t2lv_1940_40_007454343_0	181,440	369,157	2.0346
22 Sep 2011 09:08:10	1149473	13380039	hadcm3n_t2lv_1940_40_007454343_0	155,520	315,488	2.0286
20 Sep 2011 15:57:47	1149473	13380039	hadcm3n_t2lv_1940_40_007454343_0	129,600	261,907	2.0209
19 Sep 2011 00:21:49	1149473	13380039	hadcm3n_t2lv_1940_40_007454343_0	103,680	208,103	2.0072
17 Sep 2011 08:35:09	1149473	13380039	hadcm3n_t2lv_1940_40_007454343_0	77,760	154,395	1.9855
15 Sep 2011 13:33:08	1149473	13380039	hadcm3n_t2lv_1940_40_007454343_0	51,840	101,175	1.9517
13 Sep 2011 16:12:41	1149473	13380039	hadcm3n_t2lv_1940_40_007454343_0	25,920	47,240	1.8225