Task 15800662

Name	hadcm3n_4e9n_1940_40_008302439_3
Workunit	8453574
Created	29 May 2013, 14:05:02 UTC
Sent	29 May 2013, 14:05:17 UTC
Report deadline	28 Aug 2013, 21:32:28 UTC
Received	23 Jul 2013, 10:05:10 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	193 (0x000000C1) EXIT_SIGNAL
Computer ID	1228459
Run time	11 days 18 hours 27 min 53 sec
CPU time	11 days 9 hours 21 min 14 sec
Validate state	Invalid
Credit	9,331.20
Device peak FLOPS	3.35 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>7.0.64</core_client_version> <![CDATA[ <message> (unknown error) - exit code 193 (0xc1) </message> <stderr_txt> Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4260, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7984, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7804, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7632, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=8624, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4712, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x77447373 read attempt to address 0xFFFFFFF8 Engaging BOINC Windows Runtime Debugger... Cannot serialize file E:\BOINC-Data/projects/climateprediction.net/hadcm3n_4e9n_1940_40_008302439/dataout/shmem_restart.day Signal 11 received, exiting... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
23 Jul 2013 22:07:16	1228459	15800662	hadcm3n_4e9n_1940_40_008302439_3	777,600	984,067	1.2655
23 Jul 2013 20:20:44	1228459	15800662	hadcm3n_4e9n_1940_40_008302439_3	751,680	952,120	1.2667
11 Jul 2013 21:10:08	1228459	15800662	hadcm3n_4e9n_1940_40_008302439_3	725,760	918,250	1.2652
07 Jul 2013 17:31:38	1228459	15800662	hadcm3n_4e9n_1940_40_008302439_3	699,840	885,761	1.2657
06 Jul 2013 16:09:29	1228459	15800662	hadcm3n_4e9n_1940_40_008302439_3	673,920	852,855	1.2655
06 Jul 2013 05:21:14	1228459	15800662	hadcm3n_4e9n_1940_40_008302439_3	648,000	821,505	1.2678
04 Jul 2013 14:28:08	1228459	15800662	hadcm3n_4e9n_1940_40_008302439_3	622,080	789,084	1.2685
03 Jul 2013 19:56:27	1228459	15800662	hadcm3n_4e9n_1940_40_008302439_3	596,160	756,298	1.2686
02 Jul 2013 10:45:31	1228459	15800662	hadcm3n_4e9n_1940_40_008302439_3	570,240	724,928	1.2713
25 Jun 2013 19:19:01	1228459	15800662	hadcm3n_4e9n_1940_40_008302439_3	544,320	692,146	1.2716
23 Jun 2013 21:33:47	1228459	15800662	hadcm3n_4e9n_1940_40_008302439_3	518,400	658,254	1.2698
23 Jun 2013 11:17:48	1228459	15800662	hadcm3n_4e9n_1940_40_008302439_3	492,480	624,297	1.2677
22 Jun 2013 19:18:26	1228459	15800662	hadcm3n_4e9n_1940_40_008302439_3	466,560	590,417	1.2655
22 Jun 2013 09:11:35	1228459	15800662	hadcm3n_4e9n_1940_40_008302439_3	440,640	556,498	1.2629
20 Jun 2013 16:42:19	1228459	15800662	hadcm3n_4e9n_1940_40_008302439_3	414,720	522,719	1.2604
19 Jun 2013 07:15:42	1228459	15800662	hadcm3n_4e9n_1940_40_008302439_3	388,800	491,554	1.2643
15 Jun 2013 20:24:21	1228459	15800662	hadcm3n_4e9n_1940_40_008302439_3	362,880	458,948	1.2647
15 Jun 2013 11:05:40	1228459	15800662	hadcm3n_4e9n_1940_40_008302439_3	336,960	425,424	1.2625
14 Jun 2013 16:32:56	1228459	15800662	hadcm3n_4e9n_1940_40_008302439_3	311,040	391,721	1.2594
13 Jun 2013 14:05:56	1228459	15800662	hadcm3n_4e9n_1940_40_008302439_3	285,120	357,826	1.2550