Task 12015774

Name	hadcm3igeo_w1nr_2000_80_06760906_4
Workunit	6964222
Created	12 Nov 2010, 15:31:28 UTC
Sent	14 Nov 2010, 20:33:56 UTC
Report deadline	15 May 2012, 17:17:05 UTC
Received	17 Nov 2010, 0:10:43 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	852663
Run time
CPU time	18 hours 3 min 49 sec
Validate state	Invalid
Credit	326.59
Device peak FLOPS	3.23 GFLOPS
Application version	HadCM3L Coupled Model Experiment Optimised File I/O v6.04 i686-pc-linux-gnu
Stderr	<core_client_version>5.10.45</core_client_version> <![CDATA[ <message> process exited with code 22 (0x16, -234) </message> <stderr_txt> Archive: hadcm3trans_data_6.04_i686-pc-linux-gnu.zip Starting work on result hadcm3igeo_w1nr_2000_80_06760906_4... Starting model in /home/wilkinc/Boinc/BOINC/projects/climateprediction.net... Unzipping global model data file... creating: hadcm3igeo_w1nr_2000_80_06760906/jobs/ inflating: hadcm3igeo_w1nr_2000_80_06760906/jobs/yafbg.ihist inflating: hadcm3igeo_w1nr_2000_80_06760906/jobs/yafbg.PRESM_A inflating: hadcm3igeo_w1nr_2000_80_06760906/jobs/yafbg.PRESM_O extracting: hadcm3igeo_w1nr_2000_80_06760906/jobs/yafbg.PRESM_S extracting: hadcm3igeo_w1nr_2000_80_06760906/jobs/yafbg.PRESM_W inflating: hadcm3igeo_w1nr_2000_80_06760906/jobs/yafbg.stashc creating: hadcm3igeo_w1nr_2000_80_06760906/tmp/ creating: hadcm3igeo_w1nr_2000_80_06760906/datain/ creating: hadcm3igeo_w1nr_2000_80_06760906/datain/ancil/ inflating: hadcm3igeo_w1nr_2000_80_06760906/datain/ancil/basin.index creating: hadcm3igeo_w1nr_2000_80_06760906/datain/ancil/ctldata/ creating: hadcm3igeo_w1nr_2000_80_06760906/datain/ancil/ctldata/stasets/ inflating: hadcm3igeo_w1nr_2000_80_06760906/datain/ancil/ctldata/stasets/X01001218 inflating: hadcm3igeo_w1nr_2000_80_06760906/datain/ancil/ctldata/stasets/X01002207 inflating: hadcm3igeo_w1nr_2000_80_06760906/datain/ancil/ctldata/stasets/X01003236 inflating: hadcm3igeo_w1nr_2000_80_06760906/datain/ancil/ctldata/stasets/X01003237 extracting: hadcm3igeo_w1nr_2000_80_06760906/datain/ancil/ctldata/stasets/X01003254 extracting: hadcm3igeo_w1nr_2000_80_06760906/datain/ancil/ctldata/stasets/X01003255 inflating: hadcm3igeo_w1nr_2000_80_06760906/datain/ancil/ctldata/stasets/X01003274 inflating: hadcm3igeo_w1nr_2000_80_06760906/datain/ancil/ctldata/stasets/X01003275 inflating: hadcm3igeo_w1nr_2000_80_06760906/datain/ancil/ctldata/stasets/X01003276 inflating: hadcm3igeo_w1nr_2000_80_06760906/datain/ancil/ctldata/stasets/X01003277 inflating: hadcm3igeo_w1nr_2000_80_06760906/datain/ancil/ctldata/stasets/X01003278 inflating: hadcm3igeo_w1nr_2000_80_06760906/datain/ancil/ctldata/stasets/X01003279 inflating: hadcm3igeo_w1nr_2000_80_06760906/datain/ancil/ctldata/stasets/X01003280 inflating: hadcm3igeo_w1nr_2000_80_06760906/datain/ancil/ctldata/stasets/X01003281 inflating: hadcm3igeo_w1nr_2000_80_06760906/datain/ancil/ctldata/stasets/X01003286 inflating: hadcm3igeo_w1nr_2000_80_06760906/datain/ancil/ctldata/stasets/X01005207 inflating: hadcm3igeo_w1nr_2000_80_06760906/datain/ancil/ctldata/stasets/X01005208 inflating: hadcm3igeo_w1nr_2000_80_06760906/datain/ancil/ctldata/stasets/X01005222 inflating: hadcm3igeo_w1nr_2000_80_06760906/datain/ancil/ctldata/stasets/X01005223 inflating: hadcm3igeo_w1nr_2000_80_06760906/datain/ancil/ctldata/stasets/X01010206 creating: hadcm3igeo_w1nr_2000_80_06760906/datain/ancil/ctldata/STASHmaster/ inflating: hadcm3igeo_w1nr_2000_80_06760906/datain/ancil/ctldata/STASHmaster/STASHmaster_A inflating: hadcm3igeo_w1nr_2000_80_06760906/datain/ancil/ctldata/STASHmaster/STASHmaster_O inflating: hadcm3igeo_w1nr_2000_80_06760906/datain/ancil/ctldata/STASHmaster/STASHmaster_S inflating: hadcm3igeo_w1nr_2000_80_06760906/datain/ancil/ctldata/STASHmaster/STASHmaster_W inflating: hadcm3igeo_w1nr_2000_80_06760906/datain/ancil/qrclim.hadisst.sss_l94_ni inflating: hadcm3igeo_w1nr_2000_80_06760906/datain/lats creating: hadcm3igeo_w1nr_2000_80_06760906/datain/masks/ inflating: hadcm3igeo_w1nr_2000_80_06760906/datain/masks/cpdn_omsk_arctic_0.nc inflating: hadcm3igeo_w1nr_2000_80_06760906/datain/masks/cpdn_omsk_arctic_300.nc inflating: hadcm3igeo_w1nr_2000_80_06760906/datain/masks/cpdn_omsk_arctic_3000.nc inflating: hadcm3igeo_w1nr_2000_80_06760906/datain/masks/cpdn_omsk_arctic_700.nc inflating: hadcm3igeo_w1nr_2000_80_06760906/datain/masks/cpdn_omsk_global_0.nc inflating: hadcm3igeo_w1nr_2000_80_06760906/datain/masks/cpdn_omsk_global_300.nc inflating: hadcm3igeo_w1nr_2000_80_06760906/datain/masks/cpdn_omsk_global_3000.nc inflating: hadcm3igeo_w1nr_2000_80_06760906/datain/masks/cpdn_omsk_global_700.nc inflating: hadcm3igeo_w1nr_2000_80_06760906/datain/masks/cpdn_omsk_n_atl_0.nc inflating: hadcm3igeo_w1nr_2000_80_06760906/datain/masks/cpdn_omsk_n_atl_300.nc inflating: hadcm3igeo_w1nr_2000_80_06760906/datain/masks/cpdn_omsk_n_atl_3000.nc inflating: hadcm3igeo_w1nr_2000_80_06760906/datain/masks/cpdn_omsk_n_atl_700.nc inflating: hadcm3igeo_w1nr_2000_80_06760906/datain/masks/cpdn_omsk_n_ind_0.nc inflating: hadcm3igeo_w1nr_2000_80_06760906/datain/masks/cpdn_omsk_n_ind_300.nc inflating: hadcm3igeo_w1nr_2000_80_06760906/datain/masks/cpdn_omsk_n_ind_3000.nc inflating: hadcm3igeo_w1nr_2000_80_06760906/datain/masks/cpdn_omsk_n_ind_700.nc inflating: hadcm3igeo_w1nr_2000_80_06760906/datain/masks/cpdn_omsk_n_pac_0.nc inflating: hadcm3igeo_w1nr_2000_80_06760906/datain/masks/cpdn_omsk_n_pac_300.nc inflating: hadcm3igeo_w1nr_2000_80_06760906/datain/masks/cpdn_omsk_n_pac_3000.nc inflating: hadcm3igeo_w1nr_2000_80_06760906/datain/masks/cpdn_omsk_n_pac_700.nc inflating: hadcm3igeo_w1nr_2000_80_06760906/datain/masks/cpdn_omsk_southern_0.nc inflating: hadcm3igeo_w1nr_2000_80_06760906/datain/masks/cpdn_omsk_southern_300.nc inflating: hadcm3igeo_w1nr_2000_80_06760906/datain/masks/cpdn_omsk_southern_3000.nc inflating: hadcm3igeo_w1nr_2000_80_06760906/datain/masks/cpdn_omsk_southern_700.nc inflating: hadcm3igeo_w1nr_2000_80_06760906/datain/masks/cpdn_omsk_s_atl_0.nc inflating: hadcm3igeo_w1nr_2000_80_06760906/datain/masks/cpdn_omsk_s_atl_300.nc inflating: hadcm3igeo_w1nr_2000_80_06760906/datain/masks/cpdn_omsk_s_atl_3000.nc inflating: hadcm3igeo_w1nr_2000_80_06760906/datain/masks/cpdn_omsk_s_atl_700.nc inflating: hadcm3igeo_w1nr_2000_80_06760906/datain/masks/cpdn_omsk_s_ind_0.nc inflating: hadcm3igeo_w1nr_2000_80_06760906/datain/masks/cpdn_omsk_s_ind_300.nc inflating: hadcm3igeo_w1nr_2000_80_06760906/datain/masks/cpdn_omsk_s_ind_3000.nc inflating: hadcm3igeo_w1nr_2000_80_06760906/datain/masks/cpdn_omsk_s_ind_700.nc inflating: hadcm3igeo_w1nr_2000_80_06760906/datain/masks/cpdn_omsk_s_pac_0.nc inflating: hadcm3igeo_w1nr_2000_80_06760906/datain/masks/cpdn_omsk_s_pac_300.nc inflating: hadcm3igeo_w1nr_2000_80_06760906/datain/masks/cpdn_omsk_s_pac_3000.nc inflating: hadcm3igeo_w1nr_2000_80_06760906/datain/masks/cpdn_omsk_s_pac_700.nc inflating: hadcm3igeo_w1nr_2000_80_06760906/datain/masks/ed_omsk_IPO_N.nc inflating: hadcm3igeo_w1nr_2000_80_06760906/datain/masks/ed_omsk_IPO_N_S.nc inflating: hadcm3igeo_w1nr_2000_80_06760906/datain/masks/ed_omsk_IPO_S.nc inflating: hadcm3igeo_w1nr_2000_80_06760906/datain/masks/ed_omsk_NAC_SST.nc inflating: hadcm3igeo_w1nr_2000_80_06760906/datain/masks/ed_omsk_NA_3d_T.nc inflating: hadcm3igeo_w1nr_2000_80_06760906/datain/masks/ed_omsk_NA_SST.nc inflating: hadcm3igeo_w1nr_2000_80_06760906/datain/masks/ed_omsk_Nino34.nc inflating: hadcm3igeo_w1nr_2000_80_06760906/datain/masks/ed_omsk_SA_SST.nc inflating: hadcm3igeo_w1nr_2000_80_06760906/datain/ppcodes creating: hadcm3igeo_w1nr_2000_80_06760906/dataout/ Archive: hadcm3igeo_w1nr_2000_80_06760906.zip Unzipping workunit data file... inflating: hadcm3igeo_w1nr_2000_80_06760906/jobs/yafbg.namelists inflating: hadcm3igeo_w1nr_2000_80_06760906/jobs/ncatts.cpdc Created shared memory region key = 164755 of size 696080 bytes (version 605) Reconstructing ancillary file DMSNH3SO2A1B_19182082N, this may take a minute! Reconstructing ancillary file SULPC_OXIDANTS_19_A2_1990, this may take a minute! Reconstructing ancillary file ozone_hadcm3_1919_2082, this may take a minute! Copying files for startup... Copying climate.cpdc files... Starting model ID hadcm3igeo_w1nr_2000_80_06760906 Phase 1 Getting pthread attributes - retval=0 Setting pthread size (100663296 bytes) - retval=22 Executing program /home/wilkinc/Boinc/BOINC/projects/climateprediction.net/hadcm3trans_um_6.04_i686-pc-linux-gnu 164755 Program launched with process id # 23170 Climate model starting - use graphics to monitor progress. Or visit the website to see the graphs for this run. hadcm3igeo_w1nr_2000_80_06760906 - PH 1 TS 0000001 A - 01/12/2000 00:30 - H:M:S=0000:00:00 AVG= 0.00 DLT= 0.00 scan: hadcm3trans_um_6.04_i686-pc-linux-gnu.zip scan: SULPC_OXIDANTS_19_A2_1990.mod.gz scan: spec3a_sw_3_asol2b_hadcm3.gz scan: init_data.xml scan: DMSNH3SO2A1B_19182082N.mod.gz scan: cpdnout7.zip scan: boinc_lockfile scan: ghg_a1b.gz scan: ozone_hadcm3_1919_2082.gz scan: 0amp_12_2000_ocean.gz scan: ozone_hadcm3_1919_2082.mod.gz scan: 164755 scan: 0amp_12_2000_atmos.gz scan: cpdnout8.zip scan: stderr.txt scan: cpdnout4.zip scan: volcanic_geocontrol.gz scan: NAT_VOLC.gz scan: graphics_app scan: cpdnout5.zip scan: cpdnout2.zip scan: hadcm3igeo_w1nr_2000_80_06760906.zip scan: hadcm3trans_data_6.04_i686-pc-linux-gnu.zip scan: cpdnout6.zip scan: hadcm3trans_se_6.04_i686-pc-linux-gnu.zip scan: DMSNH3SO2A1B_19182082N.gz scan: spec3a_lw_3_asol2c_hadcm3.gz scan: cpdnout3.zip scan: cpdnout1.zip scan: hfpdhdck_0208_nickfluxcorr.anc.gz scan: SULPC_OXIDANTS_19_A2_1990.gz scan: hadcm3trans_6.04_i686-pc-linux-gnu scan: solar_v01.gz scan: 1063_flux_corr.anc.gz hadcm3igeo_w1nr_2000_80_06760906 - PH 1 TS 0000433 A - 07/12/2000 00:30 - H:M:S=0000:13:17 AVG= 1.84 DLT= 1.57 hadcm3igeo_w1nr_2000_80_06760906 - PH 1 TS 0000865 A - 13/12/2000 00:30 - H:M:S=0000:26:35 AVG= 1.84 DLT= 0.91 hadcm3igeo_w1nr_2000_80_06760906 - PH 1 TS 0001297 A - 19/12/2000 00:30 - H:M:S=0000:39:54 AVG= 1.85 DLT= 1.20 hadcm3igeo_w1nr_2000_80_06760906 - PH 1 TS 0001729 A - 25/12/2000 00:30 - H:M:S=0000:53:12 AVG= 1.85 DLT= 0.83 hadcm3igeo_w1nr_2000_80_06760906 - PH 1 TS 0002161 A - 01/01/2001 00:30 - H:M:S=0001:06:27 AVG= 1.85 DLT= 1.21 hadcm3igeo_w1nr_2000_80_06760906 - PH 1 TS 0002593 A - 07/01/2001 00:30 - H:M:S=0001:19:45 AVG= 1.85 DLT= 0.69 hadcm3igeo_w1nr_2000_80_06760906 - PH 1 TS 0003025 A - 13/01/2001 00:30 - H:M:S=0001:33:03 AVG= 1.85 DLT= 1.60 hadcm3igeo_w1nr_2000_80_06760906 - PH 1 TS 0003457 A - 19/01/2001 00:30 - H:M:S=0001:46:20 AVG= 1.85 DLT= 1.17 hadcm3igeo_w1nr_2000_80_06760906 - PH 1 TS 0003889 A - 25/01/2001 00:30 - H:M:S=0001:59:37 AVG= 1.85 DLT= 1.49 hadcm3igeo_w1nr_2000_80_06760906 - PH 1 TS 0004321 A - 01/02/2001 00:30 - H:M:S=0002:12:54 AVG= 1.85 DLT= 1.18 hadcm3igeo_w1nr_2000_80_06760906 - PH 1 TS 0004753 A - 07/02/2001 00:30 - H:M:S=0002:26:13 AVG= 1.85 DLT= 1.23 hadcm3igeo_w1nr_2000_80_06760906 - PH 1 TS 0005185 A - 13/02/2001 00:30 - H:M:S=0002:39:32 AVG= 1.85 DLT= 1.20 hadcm3igeo_w1nr_2000_80_06760906 - PH 1 TS 0005617 A - 19/02/2001 00:30 - H:M:S=0002:52:51 AVG= 1.85 DLT= 1.13 CPDN Monitor - Quit request from BOINC... Detaching shared memory... Archive: hadcm3igeo_w1nr_2000_80_06760906.zip Starting work on result hadcm3igeo_w1nr_2000_80_06760906_4... Starting model in /home/wilkinc/Boinc/BOINC/projects/climateprediction.net... Unzipping workunit data file... inflating: hadcm3igeo_w1nr_2000_80_06760906/jobs/yafbg.namelists inflating: hadcm3igeo_w1nr_2000_80_06760906/jobs/ncatts.cpdc Trying to kill old process # 23162 Trying to kill old process # 23170 Created shared memory region key = 164755 of size 696080 bytes (version 605) Starting model ID hadcm3igeo_w1nr_2000_80_06760906 Phase 1 Program launched with process id # 25836 Climate model starting - use graphics to monitor progress. Or visit the website to see the graphs for this run. Getting pthread attributes - retval=0 Setting pthread size (100663296 bytes) - retval=22 Executing program /home/wilkinc/Boinc/BOINC/projects/climateprediction.net/hadcm3trans_um_6.04_i686-pc-linux-gnu 164755 scan: hadcm3trans_um_6.04_i686-pc-linux-gnu.zip scan: SULPC_OXIDANTS_19_A2_1990.mod.gz scan: spec3a_sw_3_asol2b_hadcm3.gz scan: init_data.xml scan: DMSNH3SO2A1B_19182082N.mod.gz scan: cpdnout7.zip scan: boinc_lockfile scan: ghg_a1b.gz scan: ozone_hadcm3_1919_2082.gz scan: 0amp_12_2000_ocean.gz scan: ozone_hadcm3_1919_2082.mod.gz scan: 164755 scan: 0amp_12_2000_atmos.gz scan: cpdnout8.zip scan: stderr.txt scan: cpdnout4.zip scan: volcanic_geocontrol.gz scan: NAT_VOLC.gz scan: graphics_app scan: cpdnout5.zip scan: cpdnout2.zip scan: hadcm3igeo_w1nr_2000_80_06760906.zip scan: hadcm3trans_data_6.04_i686-pc-linux-gnu.zip scan: cpdnout6.zip scan: hadcm3trans_se_6.04_i686-pc-linux-gnu.zip scan: DMSNH3SO2A1B_19182082N.gz scan: spec3a_lw_3_asol2c_hadcm3.gz scan: cpdnout3.zip scan: cpdnout1.zip scan: hfpdhdck_0208_nickfluxcorr.anc.gz scan: SULPC_OXIDANTS_19_A2_1990.gz scan: hadcm3trans_6.04_i686-pc-linux-gnu scan: solar_v01.gz scan: 1063_flux_corr.anc.gz hadcm3igeo_w1nr_2000_80_06760906 - PH 1 TS 0006049 A - 25/02/2001 00:30 - H:M:S=0003:06:12 AVG= 1.85 DLT= 1.16 Model crashed: Model restart required... Preparing for restart attempt # 1... Starting model ID hadcm3igeo_w1nr_2000_80_06760906 Phase 1 Getting pthread attributes - retval=0 Setting pthread size (100663296 bytes) - retval=22 Executing program /home/wilkinc/Boinc/BOINC/projects/climateprediction.net/hadcm3trans_um_6.04_i686-pc-linux-gnu 164755 Program launched with process id # 25974 Climate model starting - use graphics to monitor progress. Or visit the website to see the graphs for this run. hadcm3igeo_w1nr_2000_80_06760906 - PH 1 TS 0006481 A - 01/03/2001 00:30 - H:M:S=0003:44:29 AVG= 2.08 DLT= 0.59 hadcm3igeo_w1nr_2000_80_06760906 - PH 1 TS 0006913 A - 07/03/2001 00:30 - H:M:S=0003:58:05 AVG= 2.07 DLT= 1.03 hadcm3igeo_w1nr_2000_80_06760906 - PH 1 TS 0007345 A - 13/03/2001 00:30 - H:M:S=0004:11:42 AVG= 2.06 DLT= 1.31 hadcm3igeo_w1nr_2000_80_06760906 - PH 1 TS 0007777 A - 19/03/2001 00:30 - H:M:S=0004:25:22 AVG= 2.05 DLT= 1.10 hadcm3igeo_w1nr_2000_80_06760906 - PH 1 TS 0008209 A - 25/03/2001 00:30 - H:M:S=0004:39:02 AVG= 2.04 DLT= 1.66 hadcm3igeo_w1nr_2000_80_06760906 - PH 1 TS 0008641 A - 01/04/2001 00:30 - H:M:S=0004:52:41 AVG= 2.03 DLT= 1.44 hadcm3igeo_w1nr_2000_80_06760906 - PH 1 TS 0009073 A - 07/04/2001 00:30 - H:M:S=0005:06:19 AVG= 2.03 DLT= 1.57 hadcm3igeo_w1nr_2000_80_06760906 - PH 1 TS 0009505 A - 13/04/2001 00:30 - H:M:S=0005:19:56 AVG= 2.02 DLT= 1.40 hadcm3igeo_w1nr_2000_80_06760906 - PH 1 TS 0009937 A - 19/04/2001 00:30 - H:M:S=0005:33:34 AVG= 2.01 DLT= 0.81 hadcm3igeo_w1nr_2000_80_06760906 - PH 1 TS 0010369 A - 25/04/2001 00:30 - H:M:S=0005:47:13 AVG= 2.01 DLT= 1.70 hadcm3igeo_w1nr_2000_80_06760906 - PH 1 TS 0010801 A - 01/05/2001 00:30 - H:M:S=0006:00:51 AVG= 2.00 DLT= 1.10 hadcm3igeo_w1nr_2000_80_06760906 - PH 1 TS 0011233 A - 07/05/2001 00:30 - H:M:S=0006:14:29 AVG= 2.00 DLT= 1.54 hadcm3igeo_w1nr_2000_80_06760906 - PH 1 TS 0011665 A - 13/05/2001 00:30 - H:M:S=0006:28:11 AVG= 2.00 DLT= 0.82 hadcm3igeo_w1nr_2000_80_06760906 - PH 1 TS 0012097 A - 19/05/2001 00:30 - H:M:S=0006:41:52 AVG= 1.99 DLT= 0.76 hadcm3igeo_w1nr_2000_80_06760906 - PH 1 TS 0012529 A - 25/05/2001 00:30 - H:M:S=0006:55:31 AVG= 1.99 DLT= 1.19 hadcm3igeo_w1nr_2000_80_06760906 - PH 1 TS 0012961 A - 01/06/2001 00:30 - H:M:S=0007:09:10 AVG= 1.99 DLT= 0.97 hadcm3igeo_w1nr_2000_80_06760906 - PH 1 TS 0013393 A - 07/06/2001 00:30 - H:M:S=0007:22:54 AVG= 1.98 DLT= 0.66 hadcm3igeo_w1nr_2000_80_06760906 - PH 1 TS 0013825 A - 13/06/2001 00:30 - H:M:S=0007:36:36 AVG= 1.98 DLT= 0.62 hadcm3igeo_w1nr_2000_80_06760906 - PH 1 TS 0014257 A - 19/06/2001 00:30 - H:M:S=0007:50:18 AVG= 1.98 DLT= 0.59 hadcm3igeo_w1nr_2000_80_06760906 - PH 1 TS 0014689 A - 25/06/2001 00:30 - H:M:S=0008:03:58 AVG= 1.98 DLT= 1.10 hadcm3igeo_w1nr_2000_80_06760906 - PH 1 TS 0015121 A - 01/07/2001 00:30 - H:M:S=0008:17:37 AVG= 1.97 DLT= 0.89 hadcm3igeo_w1nr_2000_80_06760906 - PH 1 TS 0015553 A - 07/07/2001 00:30 - H:M:S=0008:31:19 AVG= 1.97 DLT= 1.57 hadcm3igeo_w1nr_2000_80_06760906 - PH 1 TS 0015985 A - 13/07/2001 00:30 - H:M:S=0008:45:00 AVG= 1.97 DLT= 1.07 hadcm3igeo_w1nr_2000_80_06760906 - PH 1 TS 0016417 A - 19/07/2001 00:30 - H:M:S=0008:58:40 AVG= 1.97 DLT= 0.81 hadcm3igeo_w1nr_2000_80_06760906 - PH 1 TS 0016849 A - 25/07/2001 00:30 - H:M:S=0009:12:22 AVG= 1.97 DLT= 0.86 hadcm3igeo_w1nr_2000_80_06760906 - PH 1 TS 0017281 A - 01/08/2001 00:30 - H:M:S=0009:26:06 AVG= 1.97 DLT= 1.34 hadcm3igeo_w1nr_2000_80_06760906 - PH 1 TS 0017713 A - 07/08/2001 00:30 - H:M:S=0009:39:55 AVG= 1.96 DLT= 1.23 hadcm3igeo_w1nr_2000_80_06760906 - PH 1 TS 0018145 A - 13/08/2001 00:30 - H:M:S=0009:53:41 AVG= 1.96 DLT= 1.24 hadcm3igeo_w1nr_2000_80_06760906 - PH 1 TS 0018577 A - 19/08/2001 00:30 - H:M:S=0010:07:28 AVG= 1.96 DLT= 1.10 hadcm3igeo_w1nr_2000_80_06760906 - PH 1 TS 0019009 A - 25/08/2001 00:30 - H:M:S=0010:21:16 AVG= 1.96 DLT= 1.70 hadcm3igeo_w1nr_2000_80_06760906 - PH 1 TS 0019441 A - 01/09/2001 00:30 - H:M:S=0010:35:05 AVG= 1.96 DLT= 1.40 hadcm3igeo_w1nr_2000_80_06760906 - PH 1 TS 0019873 A - 07/09/2001 00:30 - H:M:S=0010:48:53 AVG= 1.96 DLT= 0.58 hadcm3igeo_w1nr_2000_80_06760906 - PH 1 TS 0020305 A - 13/09/2001 00:30 - H:M:S=0011:02:40 AVG= 1.96 DLT= 1.40 hadcm3igeo_w1nr_2000_80_06760906 - PH 1 TS 0020737 A - 19/09/2001 00:30 - H:M:S=0011:16:29 AVG= 1.96 DLT= 1.57 hadcm3igeo_w1nr_2000_80_06760906 - PH 1 TS 0021169 A - 25/09/2001 00:30 - H:M:S=0011:30:19 AVG= 1.96 DLT= 1.01 hadcm3igeo_w1nr_2000_80_06760906 - PH 1 TS 0021601 A - 01/10/2001 00:30 - H:M:S=0011:44:14 AVG= 1.96 DLT= 0.97 hadcm3igeo_w1nr_2000_80_06760906 - PH 1 TS 0022033 A - 07/10/2001 00:30 - H:M:S=0011:58:00 AVG= 1.96 DLT= 0.68 hadcm3igeo_w1nr_2000_80_06760906 - PH 1 TS 0022465 A - 13/10/2001 00:30 - H:M:S=0012:11:44 AVG= 1.95 DLT= 1.43 hadcm3igeo_w1nr_2000_80_06760906 - PH 1 TS 0022897 A - 19/10/2001 00:30 - H:M:S=0012:25:27 AVG= 1.95 DLT= 1.67 hadcm3igeo_w1nr_2000_80_06760906 - PH 1 TS 0023329 A - 25/10/2001 00:30 - H:M:S=0012:39:10 AVG= 1.95 DLT= 0.76 hadcm3igeo_w1nr_2000_80_06760906 - PH 1 TS 0023761 A - 01/11/2001 00:30 - H:M:S=0012:52:49 AVG= 1.95 DLT= 1.18 hadcm3igeo_w1nr_2000_80_06760906 - PH 1 TS 0024193 A - 07/11/2001 00:30 - H:M:S=0013:06:28 AVG= 1.95 DLT= 1.63 hadcm3igeo_w1nr_2000_80_06760906 - PH 1 TS 0024625 A - 13/11/2001 00:30 - H:M:S=0013:20:07 AVG= 1.95 DLT= 0.68 hadcm3igeo_w1nr_2000_80_06760906 - PH 1 TS 0025057 A - 19/11/2001 00:30 - H:M:S=0013:33:44 AVG= 1.95 DLT= 1.60 hadcm3igeo_w1nr_2000_80_06760906 - PH 1 TS 0025489 A - 25/11/2001 00:30 - H:M:S=0013:47:22 AVG= 1.95 DLT= 0.69 hadcm3igeo_w1nr_2000_80_06760906 - PH 1 TS 0025921 A - 01/12/2001 00:30 - H:M:S=0014:00:59 AVG= 1.95 DLT= 1.60 file dataout/w1nrfo.pjk1c10 is a 32 bit ieee um file file dataout/w1nrfo.pik1c10 is a 32 bit ieee um file file dataout/w1nrfo.pfk1c10 is a 32 bit ieee um file file dataout/w1nrfa.phk1c10 is a 32 bit ieee um file file dataout/w1nrfa.pgk1c10 is a 32 bit ieee um file file dataout/w1nrfa.pek1c10 is a 32 bit ieee um file file dataout/w1nrfa.pdk1c10 is a 32 bit ieee um file Trickling yearly means for 2001 Building file list for 2001 in dataout -- 7 entries adding: hadcm3igeo_w1nr_2000_80_06760906_4_meana_2001_pd.nc (deflated 84%) adding: hadcm3igeo_w1nr_2000_80_06760906_4_meana_2001_pg.nc (deflated 84%) adding: hadcm3igeo_w1nr_2000_80_06760906_4_meano_2001_opt.nc (deflated 83%) adding: hadcm3igeo_w1nr_2000_80_06760906_4_meano_2001_pi.nc (deflated 86%) adding: hadcm3igeo_w1nr_2000_80_06760906_4_meano_2001_pj.nc (deflated 82%) Creating trickle file trickle_hadcm3igeo_w1nr_2000_80_06760906_4_2001.zip for upload... hadcm3igeo_w1nr_2000_80_06760906 - PH 1 TS 0026353 A - 07/12/2001 00:30 - H:M:S=0014:14:36 AVG= 1.95 DLT= 1.62 hadcm3igeo_w1nr_2000_80_06760906 - PH 1 TS 0026785 A - 13/12/2001 00:30 - H:M:S=0014:28:12 AVG= 1.94 DLT= 1.64 hadcm3igeo_w1nr_2000_80_06760906 - PH 1 TS 0027217 A - 19/12/2001 00:30 - H:M:S=0014:41:49 AVG= 1.94 DLT= 0.68 hadcm3igeo_w1nr_2000_80_06760906 - PH 1 TS 0027649 A - 25/12/2001 00:30 - H:M:S=0014:55:22 AVG= 1.94 DLT= 0.80 hadcm3igeo_w1nr_2000_80_06760906 - PH 1 TS 0028081 A - 01/01/2002 00:30 - H:M:S=0015:08:58 AVG= 1.94 DLT= 0.82 hadcm3igeo_w1nr_2000_80_06760906 - PH 1 TS 0028513 A - 07/01/2002 00:30 - H:M:S=0015:22:36 AVG= 1.94 DLT= 1.12 hadcm3igeo_w1nr_2000_80_06760906 - PH 1 TS 0028945 A - 13/01/2002 00:30 - H:M:S=0015:36:12 AVG= 1.94 DLT= 1.03 hadcm3igeo_w1nr_2000_80_06760906 - PH 1 TS 0029377 A - 19/01/2002 00:30 - H:M:S=0015:49:49 AVG= 1.94 DLT= 0.83 CPDN Monitor - Quit request from BOINC... Detaching shared memory... Archive: hadcm3igeo_w1nr_2000_80_06760906.zip Starting work on result hadcm3igeo_w1nr_2000_80_06760906_4... Starting model in /home/wilkinc/Boinc/BOINC/projects/climateprediction.net... Unzipping workunit data file... inflating: hadcm3igeo_w1nr_2000_80_06760906/jobs/yafbg.namelists inflating: hadcm3igeo_w1nr_2000_80_06760906/jobs/ncatts.cpdc Trying to kill old process # 25833 Trying to kill old process # 25974 Created shared memory region key = 164755 of size 696080 bytes (version 605) Starting model ID hadcm3igeo_w1nr_2000_80_06760906 Phase 1 Getting pthread attributes - retval=0 Setting pthread size (100663296 bytes) - retval=22 Executing program /home/wilkinc/Boinc/BOINC/projects/climateprediction.net/hadcm3trans_um_6.04_i686-pc-linux-gnu 164755 Program launched with process id # 30172 Climate model starting - use graphics to monitor progress. Or visit the website to see the graphs for this run. scan: hadcm3trans_um_6.04_i686-pc-linux-gnu.zip scan: SULPC_OXIDANTS_19_A2_1990.mod.gz scan: spec3a_sw_3_asol2b_hadcm3.gz scan: init_data.xml scan: DMSNH3SO2A1B_19182082N.mod.gz scan: cpdnout7.zip scan: boinc_lockfile scan: ghg_a1b.gz scan: ozone_hadcm3_1919_2082.gz scan: 0amp_12_2000_ocean.gz scan: ozone_hadcm3_1919_2082.mod.gz scan: 164755 scan: 0amp_12_2000_atmos.gz scan: cpdnout8.zip scan: stderr.txt scan: cpdnout4.zip scan: volcanic_geocontrol.gz scan: NAT_VOLC.gz scan: graphics_app scan: cpdnout5.zip scan: cpdnout2.zip scan: hadcm3igeo_w1nr_2000_80_06760906.zip scan: hadcm3trans_data_6.04_i686-pc-linux-gnu.zip scan: cpdnout6.zip scan: hadcm3trans_se_6.04_i686-pc-linux-gnu.zip scan: DMSNH3SO2A1B_19182082N.gz scan: spec3a_lw_3_asol2c_hadcm3.gz scan: cpdnout3.zip scan: cpdnout1.zip scan: hfpdhdck_0208_nickfluxcorr.anc.gz scan: SULPC_OXIDANTS_19_A2_1990.gz scan: hadcm3trans_6.04_i686-pc-linux-gnu scan: solar_v01.gz scan: 1063_flux_corr.anc.gz hadcm3igeo_w1nr_2000_80_06760906 - PH 1 TS 0029809 A - 25/01/2002 00:30 - H:M:S=0016:03:08 AVG= 1.94 DLT= 1.30 hadcm3igeo_w1nr_2000_80_06760906 - PH 1 TS 0030241 A - 01/02/2002 00:30 - H:M:S=0016:16:30 AVG= 1.94 DLT= 1.52 hadcm3igeo_w1nr_2000_80_06760906 - PH 1 TS 0030673 A - 07/02/2002 00:30 - H:M:S=0016:29:49 AVG= 1.94 DLT= 1.68 hadcm3igeo_w1nr_2000_80_06760906 - PH 1 TS 0031105 A - 13/02/2002 00:30 - H:M:S=0016:43:06 AVG= 1.93 DLT= 1.51 hadcm3igeo_w1nr_2000_80_06760906 - PH 1 TS 0031537 A - 19/02/2002 00:30 - H:M:S=0016:56:24 AVG= 1.93 DLT= 0.70 hadcm3igeo_w1nr_2000_80_06760906 - PH 1 TS 0031969 A - 25/02/2002 00:30 - H:M:S=0017:09:43 AVG= 1.93 DLT= 0.77 hadcm3igeo_w1nr_2000_80_06760906 - PH 1 TS 0032401 A - 01/03/2002 00:30 - H:M:S=0017:23:03 AVG= 1.93 DLT= 0.79 hadcm3igeo_w1nr_2000_80_06760906 - PH 1 TS 0032833 A - 07/03/2002 00:30 - H:M:S=0017:36:24 AVG= 1.93 DLT= 0.59 Model crashed: Model restart required... Preparing for restart attempt # 1... Starting model ID hadcm3igeo_w1nr_2000_80_06760906 Phase 1 Getting pthread attributes - retval=0 Setting pthread size (100663296 bytes) - retval=22 Executing program /home/wilkinc/Boinc/BOINC/projects/climateprediction.net/hadcm3trans_um_6.04_i686-pc-linux-gnu 164755 Program launched with process id # 30691 Climate model starting - use graphics to monitor progress. Or visit the website to see the graphs for this run. Model crashed: Model restart required... Preparing for restart attempt # 2... Starting model ID hadcm3igeo_w1nr_2000_80_06760906 Phase 1 Getting pthread attributes - retval=0 Setting pthread size (100663296 bytes) - retval=22 Executing program /home/wilkinc/Boinc/BOINC/projects/climateprediction.net/hadcm3trans_um_6.04_i686-pc-linux-gnu 164755 Program launched with process id # 30693 Climate model starting - use graphics to monitor progress. Or visit the website to see the graphs for this run. Model crashed: Model restart required... Preparing for restart attempt # 3... Starting model ID hadcm3igeo_w1nr_2000_80_06760906 Phase 1 Getting pthread attributes - retval=0 Setting pthread size (100663296 bytes) - retval=22 Executing program /home/wilkinc/Boinc/BOINC/projects/climateprediction.net/hadcm3trans_um_6.04_i686-pc-linux-gnu 164755 Program launched with process id # 30695 Climate model starting - use graphics to monitor progress. Or visit the website to see the graphs for this run. Model crashed: Model restart required... Preparing for restart attempt # 4... Starting model ID hadcm3igeo_w1nr_2000_80_06760906 Phase 1 Program launched with process id # 30697 Climate model starting - use graphics to monitor progress. Or visit the website to see the graphs for this run. Getting pthread attributes - retval=0 Setting pthread size (100663296 bytes) - retval=22 Executing program /home/wilkinc/Boinc/BOINC/projects/climateprediction.net/hadcm3trans_um_6.04_i686-pc-linux-gnu 164755 Model crashed: Model restart required... Preparing for restart attempt # 5... Starting model ID hadcm3igeo_w1nr_2000_80_06760906 Phase 1 Getting pthread attributes - retval=0 Setting pthread size (100663296 bytes) - retval=22 Executing program /home/wilkinc/Boinc/BOINC/projects/climateprediction.net/hadcm3trans_um_6.04_i686-pc-linux-gnu 164755 Program launched with process id # 30699 Climate model starting - use graphics to monitor progress. Or visit the website to see the graphs for this run. Model crashed: Sorry, too many model crashes! :-( Model restart required... Sorry, too many model crashes! :-( Cleaning up from the run... called boinc_finish Detaching shared memory... </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
16 Nov 2010 15:33:28	852663	12015774	hadcm3igeo_w1nr_2000_80_06760906_4	25,920	50,731	1.9572