Task 15494099

Name	hadcm3n_3m8d_1940_40_008265015_0
Workunit	8420139
Created	21 Dec 2012, 11:01:37 UTC
Sent	21 Dec 2012, 11:05:58 UTC
Report deadline	22 Mar 2013, 18:33:09 UTC
Received	25 Mar 2013, 17:02:53 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	193 (0x000000C1) EXIT_SIGNAL
Computer ID	1149985
Run time	15 days 7 hours 25 min 21 sec
CPU time	14 days 21 hours 37 min 22 sec
Validate state	Invalid
Credit	9,331.20
Device peak FLOPS	2.36 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>7.0.28</core_client_version> <![CDATA[ <message> - exit code 193 (0xc1) </message> <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3012, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 BUFFIN: C I/O Error feof - Unit 65 - Return code = 16 BUFFIN: C I/O Error feof - Unit 66 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 Error converting file to netcdf: dataout/3m8dko.pje1c10 Error converting file to netcdf: dataout/3m8dko.pie1c10 Error converting file to netcdf: dataout/3m8dko.pfe1c10 Error converting file to netcdf: dataout/3m8dka.phe1c10 Error converting file to netcdf: dataout/3m8dka.pge1c10 Error converting file to netcdf: dataout/3m8dka.pee1c10 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2596, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2996, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2176, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2768, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2500, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x77D73F99 read attempt to address 0x3E28B963 Engaging BOINC Windows Runtime Debugger... Cannot serialize file C:\ProgramData\BOINC/projects/climateprediction.net/hadcm3n_3m8d_1940_40_008265015/dataout/shmem_restart.day Signal 11 received, exiting... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
25 Mar 2013 17:07:18	1149985	15494099	hadcm3n_3m8d_1940_40_008265015_0	777,600	1,287,438	1.6557
21 Mar 2013 18:01:17	1149985	15494099	hadcm3n_3m8d_1940_40_008265015_0	751,680	1,244,793	1.6560
20 Mar 2013 10:07:20	1149985	15494099	hadcm3n_3m8d_1940_40_008265015_0	725,760	1,201,644	1.6557
18 Mar 2013 16:00:35	1149985	15494099	hadcm3n_3m8d_1940_40_008265015_0	699,840	1,159,318	1.6565
14 Mar 2013 18:14:11	1149985	15494099	hadcm3n_3m8d_1940_40_008265015_0	673,920	1,116,263	1.6564
12 Mar 2013 19:07:07	1149985	15494099	hadcm3n_3m8d_1940_40_008265015_0	648,000	1,073,657	1.6569
07 Mar 2013 19:03:07	1149985	15494099	hadcm3n_3m8d_1940_40_008265015_0	622,080	1,030,000	1.6557
06 Mar 2013 11:01:18	1149985	15494099	hadcm3n_3m8d_1940_40_008265015_0	596,160	986,926	1.6555
04 Mar 2013 14:55:25	1149985	15494099	hadcm3n_3m8d_1940_40_008265015_0	570,240	943,739	1.6550
27 Feb 2013 18:02:26	1149985	15494099	hadcm3n_3m8d_1940_40_008265015_0	544,320	900,325	1.6540
26 Feb 2013 10:05:43	1149985	15494099	hadcm3n_3m8d_1940_40_008265015_0	518,400	857,708	1.6545
22 Feb 2013 10:02:14	1149985	15494099	hadcm3n_3m8d_1940_40_008265015_0	492,480	814,246	1.6534
20 Feb 2013 16:00:42	1149985	15494099	hadcm3n_3m8d_1940_40_008265015_0	466,560	771,722	1.6541
18 Feb 2013 16:05:46	1149985	15494099	hadcm3n_3m8d_1940_40_008265015_0	440,640	729,223	1.6549
14 Feb 2013 18:01:25	1149985	15494099	hadcm3n_3m8d_1940_40_008265015_0	414,720	686,580	1.6555
12 Feb 2013 16:01:25	1149985	15494099	hadcm3n_3m8d_1940_40_008265015_0	388,800	643,896	1.6561
08 Feb 2013 17:56:41	1149985	15494099	hadcm3n_3m8d_1940_40_008265015_0	362,880	600,623	1.6552
07 Feb 2013 10:08:24	1149985	15494099	hadcm3n_3m8d_1940_40_008265015_0	336,960	556,806	1.6524
05 Feb 2013 15:55:50	1149985	15494099	hadcm3n_3m8d_1940_40_008265015_0	311,040	514,107	1.6529
01 Feb 2013 18:06:14	1149985	15494099	hadcm3n_3m8d_1940_40_008265015_0	285,120	471,508	1.6537