Task 12850406

Name	hadcm3n_o24i_1900_40_007198085_2
Workunit	7396365
Created	3 May 2011, 10:00:34 UTC
Sent	3 May 2011, 10:16:08 UTC
Report deadline	2 Aug 2011, 17:43:19 UTC
Received	29 Jun 2011, 14:21:14 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	193 (0x000000C1) EXIT_SIGNAL
Computer ID	710818
Run time	20 days 12 hours 4 min 36 sec
CPU time	18 days 10 hours 20 min 47 sec
Validate state	Invalid
Credit	9,331.20
Device peak FLOPS	2.47 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>6.12.26</core_client_version> <![CDATA[ <message> - exit code 193 (0xc1) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... BUFFIN: C I/O Error feof - Unit 63 - Return code = 16 BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 BUFFIN: C I/O Error feof - Unit 65 - Return code = 16 BUFFIN: C I/O Error feof - Unit 66 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 Error converting file to netcdf: dataout/o24iko.pja5c10 Error converting file to netcdf: dataout/o24iko.pia5c10 Error converting file to netcdf: dataout/o24iko.pfa5c10 Error converting file to netcdf: dataout/o24ika.pha5c10 Error converting file to netcdf: dataout/o24ika.pga5c10 Error converting file to netcdf: dataout/o24ika.pea5c10 Error converting file to netcdf: dataout/o24ika.pda5c10 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3768, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2660, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2200, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3020, iMonCtr=1 Model crash detected, will try to restart... Signal 11 received, exiting... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
29 Jun 2011 13:21:15	710818	12850406	hadcm3n_o24i_1900_40_007198085_2	777,600	1,592,444	2.0479
26 Jun 2011 19:44:08	710818	12850406	hadcm3n_o24i_1900_40_007198085_2	751,680	1,535,292	2.0425
25 Jun 2011 10:03:27	710818	12850406	hadcm3n_o24i_1900_40_007198085_2	725,760	1,475,548	2.0331
23 Jun 2011 14:49:16	710818	12850406	hadcm3n_o24i_1900_40_007198085_2	699,840	1,420,203	2.0293
20 Jun 2011 18:08:18	710818	12850406	hadcm3n_o24i_1900_40_007198085_2	673,920	1,364,609	2.0249
19 Jun 2011 22:06:13	710818	12850406	hadcm3n_o24i_1900_40_007198085_2	648,000	1,319,385	2.0361
19 Jun 2011 22:02:09	710818	12850406	hadcm3n_o24i_1900_40_007198085_2	622,080	1,275,654	2.0506
16 Jun 2011 15:47:46	710818	12850406	hadcm3n_o24i_1900_40_007198085_2	596,160	1,237,690	2.0761
15 Jun 2011 07:19:05	710818	12850406	hadcm3n_o24i_1900_40_007198085_2	570,240	1,192,672	2.0915
13 Jun 2011 15:57:05	710818	12850406	hadcm3n_o24i_1900_40_007198085_2	544,320	1,148,511	2.1100
10 Jun 2011 17:36:59	710818	12850406	hadcm3n_o24i_1900_40_007198085_2	518,400	1,093,059	2.1085
09 Jun 2011 06:34:54	710818	12850406	hadcm3n_o24i_1900_40_007198085_2	492,480	1,035,000	2.1016
07 Jun 2011 08:59:31	710818	12850406	hadcm3n_o24i_1900_40_007198085_2	466,560	981,116	2.1029
06 Jun 2011 06:14:03	710818	12850406	hadcm3n_o24i_1900_40_007198085_2	440,640	928,572	2.1073
04 Jun 2011 18:01:31	710818	12850406	hadcm3n_o24i_1900_40_007198085_2	414,720	884,427	2.1326
31 May 2011 22:50:44	710818	12850406	hadcm3n_o24i_1900_40_007198085_2	388,800	839,032	2.1580
29 May 2011 19:44:10	710818	12850406	hadcm3n_o24i_1900_40_007198085_2	362,880	783,890	2.1602
28 May 2011 12:25:42	710818	12850406	hadcm3n_o24i_1900_40_007198085_2	336,960	726,498	2.1560
26 May 2011 12:40:56	710818	12850406	hadcm3n_o24i_1900_40_007198085_2	311,040	668,496	2.1492
24 May 2011 13:35:37	710818	12850406	hadcm3n_o24i_1900_40_007198085_2	285,120	613,296	2.1510