Task 15492663

Name	hadcm3n_39k2_1940_40_008263844_0
Workunit	8418968
Created	21 Dec 2012, 6:44:43 UTC
Sent	21 Dec 2012, 6:48:13 UTC
Report deadline	22 Mar 2013, 14:15:24 UTC
Received	18 Apr 2013, 5:47:38 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	193 (0x000000C1) EXIT_SIGNAL
Computer ID	1160221
Run time	13 days 20 hours 24 min 21 sec
CPU time	13 days 14 hours 36 min 23 sec
Validate state	Invalid
Credit	6,220.80
Device peak FLOPS	1.84 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>6.12.33</core_client_version> <![CDATA[ <message> - exit code 193 (0xc1) </message> <stderr_txt> Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5464, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4640, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3380, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5456, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5144, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5336, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4620, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5136, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5472, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5148, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4748, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1180, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4908, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2176, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5232, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5060, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4844, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5520, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5440, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4884, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5068, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4976, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4728, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4696, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4840, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5136, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5192, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5492, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4988, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5068, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5356, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4984, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4992, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5436, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5132, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4728, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5208, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5628, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5592, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2732, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4704, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5540, iMonCtr=1 Model crash detected, will try to restart... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x77875EAB read attempt to address 0x40C15FF4 Engaging BOINC Windows Runtime Debugger... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x7719A5D5 read attempt to address 0xFFFFFFF8 Engaging BOINC Windows Runtime Debugger... Cannot serialize file C:\Programy\Boinc\Data/projects/climateprediction.net/hadcm3n_39k2_1940_40_008263844/dataout/shmem_restart.day Signal 11 received, exiting... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
17 Apr 2013 11:12:39	1160221	15492663	hadcm3n_39k2_1940_40_008263844_0	518,400	1,175,141	2.2669
15 Apr 2013 06:19:35	1160221	15492663	hadcm3n_39k2_1940_40_008263844_0	492,480	1,114,982	2.2640
10 Apr 2013 11:39:11	1160221	15492663	hadcm3n_39k2_1940_40_008263844_0	466,560	1,055,991	2.2634
08 Apr 2013 06:46:22	1160221	15492663	hadcm3n_39k2_1940_40_008263844_0	440,640	996,789	2.2621
03 Apr 2013 10:16:08	1160221	15492663	hadcm3n_39k2_1940_40_008263844_0	414,720	938,065	2.2619
26 Mar 2013 08:31:03	1160221	15492663	hadcm3n_39k2_1940_40_008263844_0	388,800	880,347	2.2643
21 Mar 2013 19:42:15	1160221	15492663	hadcm3n_39k2_1940_40_008263844_0	362,880	822,022	2.2653
19 Mar 2013 07:48:48	1160221	15492663	hadcm3n_39k2_1940_40_008263844_0	336,960	761,598	2.2602
14 Mar 2013 12:05:43	1160221	15492663	hadcm3n_39k2_1940_40_008263844_0	311,040	703,449	2.2616
12 Mar 2013 07:26:10	1160221	15492663	hadcm3n_39k2_1940_40_008263844_0	285,120	645,759	2.2649
07 Mar 2013 08:00:27	1160221	15492663	hadcm3n_39k2_1940_40_008263844_0	259,200	588,003	2.2685
04 Mar 2013 10:44:02	1160221	15492663	hadcm3n_39k2_1940_40_008263844_0	233,280	529,118	2.2682
20 Feb 2013 09:23:13	1160221	15492663	hadcm3n_39k2_1940_40_008263844_0	207,360	470,858	2.2707
15 Feb 2013 09:42:18	1160221	15492663	hadcm3n_39k2_1940_40_008263844_0	181,440	411,425	2.2676
12 Feb 2013 11:20:12	1160221	15492663	hadcm3n_39k2_1940_40_008263844_0	155,520	353,278	2.2716
29 Jan 2013 07:54:23	1160221	15492663	hadcm3n_39k2_1940_40_008263844_0	129,600	293,482	2.2645
23 Jan 2013 12:03:46	1160221	15492663	hadcm3n_39k2_1940_40_008263844_0	103,680	235,256	2.2691
17 Jan 2013 13:50:55	1160221	15492663	hadcm3n_39k2_1940_40_008263844_0	77,760	175,643	2.2588
14 Jan 2013 10:19:01	1160221	15492663	hadcm3n_39k2_1940_40_008263844_0	51,840	117,081	2.2585
09 Jan 2013 12:55:10	1160221	15492663	hadcm3n_39k2_1940_40_008263844_0	25,920	58,693	2.2644