Task 12822993

Name	hadcm3n_p31r_1900_40_007221535_0
Workunit	7419775
Created	26 Apr 2011, 15:23:10 UTC
Sent	1 May 2011, 15:52:16 UTC
Report deadline	31 Jul 2011, 23:19:27 UTC
Received	17 Sep 2011, 16:59:52 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	193 (0x000000C1) EXIT_SIGNAL
Computer ID	1126224
Run time	21 days 0 hours 9 min 9 sec
CPU time	18 days 20 hours 42 min 29 sec
Validate state	Invalid
Credit	9,331.20
Device peak FLOPS	2.12 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>6.10.58</core_client_version> <![CDATA[ <message> - exit code 193 (0xc1) </message> <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4088, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=352, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4396, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3268, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 14:36:43 (2816): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... 14:36:44 (2816): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... BUFFIN: C I/O Error feof - Unit 63 - Return code = 16 BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 BUFFIN: C I/O Error feof - Unit 65 - Return code = 16 BUFFIN: C I/O Error feof - Unit 66 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 CSuspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CSuspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4040, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4104, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CSignal 11 received, exiting... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
17 Sep 2011 17:41:56	1126224	12822993	hadcm3n_p31r_1900_40_007221535_0	777,600	1,629,744	2.0959
11 Sep 2011 19:41:01	1126224	12822993	hadcm3n_p31r_1900_40_007221535_0	751,680	1,574,380	2.0945
02 Sep 2011 20:45:16	1126224	12822993	hadcm3n_p31r_1900_40_007221535_0	725,760	1,519,378	2.0935
09 Aug 2011 02:29:08	1126224	12822993	hadcm3n_p31r_1900_40_007221535_0	699,840	1,463,985	2.0919
27 Jun 2011 22:00:22	1126224	12822993	hadcm3n_p31r_1900_40_007221535_0	673,920	1,409,160	2.0910
27 Jun 2011 10:24:29	1126224	12822993	hadcm3n_p31r_1900_40_007221535_0	648,000	1,353,221	2.0883
05 Jun 2011 00:17:20	1126224	12822993	hadcm3n_p31r_1900_40_007221535_0	622,080	1,295,774	2.0830
31 May 2011 17:18:54	1126224	12822993	hadcm3n_p31r_1900_40_007221535_0	596,160	1,242,530	2.0842
30 May 2011 01:16:36	1126224	12822993	hadcm3n_p31r_1900_40_007221535_0	570,240	1,187,716	2.0828
29 May 2011 08:57:49	1126224	12822993	hadcm3n_p31r_1900_40_007221535_0	544,320	1,132,126	2.0799
28 May 2011 07:39:14	1126224	12822993	hadcm3n_p31r_1900_40_007221535_0	518,400	1,077,200	2.0779
26 May 2011 21:15:01	1126224	12822993	hadcm3n_p31r_1900_40_007221535_0	492,480	1,021,175	2.0735
25 May 2011 20:32:00	1126224	12822993	hadcm3n_p31r_1900_40_007221535_0	466,560	967,386	2.0734
24 May 2011 19:16:04	1126224	12822993	hadcm3n_p31r_1900_40_007221535_0	440,640	913,227	2.0725
23 May 2011 17:13:49	1126224	12822993	hadcm3n_p31r_1900_40_007221535_0	414,720	857,699	2.0681
21 May 2011 23:00:25	1126224	12822993	hadcm3n_p31r_1900_40_007221535_0	388,800	802,492	2.0640
20 May 2011 14:59:07	1126224	12822993	hadcm3n_p31r_1900_40_007221535_0	362,880	746,878	2.0582
18 May 2011 22:24:22	1126224	12822993	hadcm3n_p31r_1900_40_007221535_0	336,960	693,373	2.0577
17 May 2011 20:05:26	1126224	12822993	hadcm3n_p31r_1900_40_007221535_0	311,040	638,871	2.0540
15 May 2011 21:51:35	1126224	12822993	hadcm3n_p31r_1900_40_007221535_0	285,120	584,622	2.0504