Task 13361010

Name	hadcm3n_t5iy_1940_40_007448247_0
Workunit	7645750
Created	9 Sep 2011, 20:32:11 UTC
Sent	15 Sep 2011, 13:00:40 UTC
Report deadline	15 Dec 2011, 20:27:51 UTC
Received	28 Oct 2011, 1:03:21 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	193 (0x000000C1) EXIT_SIGNAL
Computer ID	1001784
Run time	20 days 11 hours 27 min 54 sec
CPU time	18 days 9 hours 32 min 42 sec
Validate state	Invalid
Credit	6,220.80
Device peak FLOPS	1.83 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>6.10.58</core_client_version> <![CDATA[ <message> - exit code 193 (0xc1) </message> <stderr_txt> Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2860, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3108, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=644, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1988, iMonCtr=1 Model crash detected, will try to restaController:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2248, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2624, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2564, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3380, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2588, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2052, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3744, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4752, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Signal 11 received, exiting... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
31 Oct 2011 16:48:53	1001784	13361010	hadcm3n_t5iy_1940_40_007448247_0	518,400	1,589,545	3.0663
31 Oct 2011 13:14:02	1001784	13361010	hadcm3n_t5iy_1940_40_007448247_0	492,480	1,513,584	3.0734
31 Oct 2011 13:14:01	1001784	13361010	hadcm3n_t5iy_1940_40_007448247_0	466,560	1,436,417	3.0787
31 Oct 2011 13:14:00	1001784	13361010	hadcm3n_t5iy_1940_40_007448247_0	440,640	1,359,603	3.0855
18 Oct 2011 06:38:21	1001784	13361010	hadcm3n_t5iy_1940_40_007448247_0	414,720	1,282,259	3.0919
16 Oct 2011 12:29:49	1001784	13361010	hadcm3n_t5iy_1940_40_007448247_0	388,800	1,203,044	3.0942
13 Oct 2011 19:10:58	1001784	13361010	hadcm3n_t5iy_1940_40_007448247_0	362,880	1,125,850	3.1025
10 Oct 2011 16:34:05	1001784	13361010	hadcm3n_t5iy_1940_40_007448247_0	336,960	1,046,902	3.1069
08 Oct 2011 16:58:21	1001784	13361010	hadcm3n_t5iy_1940_40_007448247_0	311,040	966,248	3.1065
06 Oct 2011 21:22:44	1001784	13361010	hadcm3n_t5iy_1940_40_007448247_0	285,120	889,049	3.1182
04 Oct 2011 03:36:48	1001784	13361010	hadcm3n_t5iy_1940_40_007448247_0	259,200	812,091	3.1331
03 Oct 2011 03:57:31	1001784	13361010	hadcm3n_t5iy_1940_40_007448247_0	233,280	731,791	3.1370
01 Oct 2011 01:51:59	1001784	13361010	hadcm3n_t5iy_1940_40_007448247_0	207,360	649,350	3.1315
29 Sep 2011 18:06:55	1001784	13361010	hadcm3n_t5iy_1940_40_007448247_0	181,440	569,978	3.1414
28 Sep 2011 02:19:24	1001784	13361010	hadcm3n_t5iy_1940_40_007448247_0	155,520	489,266	3.1460
27 Sep 2011 01:53:27	1001784	13361010	hadcm3n_t5iy_1940_40_007448247_0	129,600	407,058	3.1409
24 Sep 2011 20:20:04	1001784	13361010	hadcm3n_t5iy_1940_40_007448247_0	103,680	321,677	3.1026
22 Sep 2011 18:35:44	1001784	13361010	hadcm3n_t5iy_1940_40_007448247_0	77,760	239,531	3.0804
21 Sep 2011 02:02:25	1001784	13361010	hadcm3n_t5iy_1940_40_007448247_0	51,840	159,882	3.0841
16 Sep 2011 20:33:18	1001784	13361010	hadcm3n_t5iy_1940_40_007448247_0	25,920	79,987	3.0859