climateprediction.net home page
Task 22511628

Task 22511628

Name wah2_eas25_a1ie_201312_24_1024_012324213_1
Workunit 12324213
Created 10 Sep 2024, 5:33:34 UTC
Sent 10 Sep 2024, 5:43:32 UTC
Report deadline 19 Dec 2024, 5:43:32 UTC
Received 6 Oct 2024, 20:24:00 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 0 (0x00000000)
Computer ID 1518579
Run time 18 days 15 hours 33 min 56 sec
CPU time 18 days 15 hours 33 min 56 sec
Validate state Invalid
Credit 11,618.13
Device peak FLOPS 3.09 GFLOPS
Application version Weather At Home 2 (wah2) (region independent) v8.32
windows_intelx86
Peak working set size 348.41 MB
Peak swap size 313.40 MB
Peak disk usage 200.84 MB
Stderr 
<core_client_version>8.0.4</core_client_version>
<![CDATA[
<stderr_txt>
modelGetExecutables: check control files, strTemp0 & 1 : 
C:\ProgramData\BOINC/projects/climateprediction.net/wah2_eas25_a1ie_201312_24_1024_012324213/jobs/xadae.namelists
C:\ProgramData\BOINC/projects/climateprediction.net/wah2_eas25_a1ie_201312_24_1024_012324213/jobs/xacxf.namelists
modelGetExecutables: unzipping control files : strInput & strTmp 
wah2_eas25_a1ie_201312_24_1024_012324213.zip
wah2_eas25_a1ie_201312_24_1024_012324213/jobs
gstrDump[0] = generic_phase1_spinup_eas25_global_aabaka_f
gstrDump[1] = generic_phase1_spinup_eas25_regional_aabaka_f
global model: command string: "C:\ProgramData\BOINC/projects/climateprediction.net/wah2am3m2_um_8.32_windows_intelx86.exe" wah2_eas25_a1ie_201312_24_1024_012324213 generic_phase1_spinup_eas25_global_aabaka_f ic19611221_14_N96 AERclim_ancil_168months_CMIP6-IPSL-CM6A-LR_SST_2009-01-01_2022-12-30_v2404b AERclim_ancil_168months_CMIP6-IPSL-CM6A-LR_SIC_2009-01-01_2022-12-30_v2404b SO2DMS_N96_cmip6hist-ssp245_2009-2020 oxi.addfa ozone_cmip6hist-ssp245_N96_1979_2031
regional model: command string: "C:\ProgramData\BOINC/projects/climateprediction.net/wah2rm3m2t_um_8.32_windows_intelx86.exe" wah2_eas25_a1ie_201312_24_1024_012324213
 cpdn_check_running: got RM PID of zero; ignoring this call and waiting for PID via shMem. 
 cpdn_check_running: got RM PID of zero; ignoring this call and waiting for PID via shMem. 
executeModelProcess: MonID=11908, GCM_PID=9724, RCM_PID=10256
Queuing intermediate upload for CPDN/BOINC: cpdnout1.zip
Queuing intermediate upload for CPDN/BOINC: cpdnout2.zip
CPDN Monitor - Quit request from BOINC...
Detaching shared memory... Done.
modelGetExecutables: check control files, strTemp0 & 1 : 
C:\ProgramData\BOINC/projects/climateprediction.net/wah2_eas25_a1ie_201312_24_1024_012324213/jobs/xadae.namelists
C:\ProgramData\BOINC/projects/climateprediction.net/wah2_eas25_a1ie_201312_24_1024_012324213/jobs/xacxf.namelists
gstrDump[0] = generic_phase1_spinup_eas25_global_aabaka_f
gstrDump[1] = generic_phase1_spinup_eas25_regional_aabaka_f
global model: command string: "C:\ProgramData\BOINC/projects/climateprediction.net/wah2am3m2_um_8.32_windows_intelx86.exe" wah2_eas25_a1ie_201312_24_1024_012324213 generic_phase1_spinup_eas25_global_aabaka_f ic19611221_14_N96 AERclim_ancil_168months_CMIP6-IPSL-CM6A-LR_SST_2009-01-01_2022-12-30_v2404b AERclim_ancil_168months_CMIP6-IPSL-CM6A-LR_SIC_2009-01-01_2022-12-30_v2404b SO2DMS_N96_cmip6hist-ssp245_2009-2020 oxi.addfa ozone_cmip6hist-ssp245_N96_1979_2031
regional model: command string: "C:\ProgramData\BOINC/projects/climateprediction.net/wah2rm3m2t_um_8.32_windows_intelx86.exe" wah2_eas25_a1ie_201312_24_1024_012324213
 cpdn_check_running: got RM PID of zero; ignoring this call and waiting for PID via shMem. 
 cpdn_check_running: got RM PID of zero; ignoring this call and waiting for PID via shMem. 
executeModelProcess: MonID=2800, GCM_PID=13240, RCM_PID=6012
CPDN Monitor - Quit request from BOINC...
Detaching shared memory... Done.
modelGetExecutables: check control files, strTemp0 & 1 : 
C:\ProgramData\BOINC/projects/climateprediction.net/wah2_eas25_a1ie_201312_24_1024_012324213/jobs/xadae.namelists
C:\ProgramData\BOINC/projects/climateprediction.net/wah2_eas25_a1ie_201312_24_1024_012324213/jobs/xacxf.namelists
gstrDump[0] = generic_phase1_spinup_eas25_global_aabaka_f
gstrDump[1] = generic_phase1_spinup_eas25_regional_aabaka_f
global model: command string: "C:\ProgramData\BOINC/projects/climateprediction.net/wah2am3m2_um_8.32_windows_intelx86.exe" wah2_eas25_a1ie_201312_24_1024_012324213 generic_phase1_spinup_eas25_global_aabaka_f ic19611221_14_N96 AERclim_ancil_168months_CMIP6-IPSL-CM6A-LR_SST_2009-01-01_2022-12-30_v2404b AERclim_ancil_168months_CMIP6-IPSL-CM6A-LR_SIC_2009-01-01_2022-12-30_v2404b SO2DMS_N96_cmip6hist-ssp245_2009-2020 oxi.addfa ozone_cmip6hist-ssp245_N96_1979_2031
regional model: command string: "C:\ProgramData\BOINC/projects/climateprediction.net/wah2rm3m2t_um_8.32_windows_intelx86.exe" wah2_eas25_a1ie_201312_24_1024_012324213
 cpdn_check_running: got RM PID of zero; ignoring this call and waiting for PID via shMem. 
executeModelProcess: MonID=812, GCM_PID=7660, RCM_PID=7268
CPDN Monitor - Quit request from BOINC...
Detaching shared memory... Done.
modelGetExecutables: check control files, strTemp0 & 1 : 
C:\ProgramData\BOINC/projects/climateprediction.net/wah2_eas25_a1ie_201312_24_1024_012324213/jobs/xadae.namelists
C:\ProgramData\BOINC/projects/climateprediction.net/wah2_eas25_a1ie_201312_24_1024_012324213/jobs/xacxf.namelists
gstrDump[0] = generic_phase1_spinup_eas25_global_aabaka_f
gstrDump[1] = generic_phase1_spinup_eas25_regional_aabaka_f
global model: command string: "C:\ProgramData\BOINC/projects/climateprediction.net/wah2am3m2_um_8.32_windows_intelx86.exe" wah2_eas25_a1ie_201312_24_1024_012324213 generic_phase1_spinup_eas25_global_aabaka_f ic19611221_14_N96 AERclim_ancil_168months_CMIP6-IPSL-CM6A-LR_SST_2009-01-01_2022-12-30_v2404b AERclim_ancil_168months_CMIP6-IPSL-CM6A-LR_SIC_2009-01-01_2022-12-30_v2404b SO2DMS_N96_cmip6hist-ssp245_2009-2020 oxi.addfa ozone_cmip6hist-ssp245_N96_1979_2031
regional model: command string: "C:\ProgramData\BOINC/projects/climateprediction.net/wah2rm3m2t_um_8.32_windows_intelx86.exe" wah2_eas25_a1ie_201312_24_1024_012324213
executeModelProcess: MonID=13240, GCM_PID=10536, RCM_PID=12072
Queuing intermediate upload for CPDN/BOINC: cpdnout3.zip
CPDN Monitor - Quit request from BOINC...
Detaching shared memory... Done.
modelGetExecutables: check control files, strTemp0 & 1 : 
C:\ProgramData\BOINC/projects/climateprediction.net/wah2_eas25_a1ie_201312_24_1024_012324213/jobs/xadae.namelists
C:\ProgramData\BOINC/projects/climateprediction.net/wah2_eas25_a1ie_201312_24_1024_012324213/jobs/xacxf.namelists
gstrDump[0] = generic_phase1_spinup_eas25_global_aabaka_f
gstrDump[1] = generic_phase1_spinup_eas25_regional_aabaka_f
global model: command string: "C:\ProgramData\BOINC/projects/climateprediction.net/wah2am3m2_um_8.32_windows_intelx86.exe" wah2_eas25_a1ie_201312_24_1024_012324213 generic_phase1_spinup_eas25_global_aabaka_f ic19611221_14_N96 AERclim_ancil_168months_CMIP6-IPSL-CM6A-LR_SST_2009-01-01_2022-12-30_v2404b AERclim_ancil_168months_CMIP6-IPSL-CM6A-LR_SIC_2009-01-01_2022-12-30_v2404b SO2DMS_N96_cmip6hist-ssp245_2009-2020 oxi.addfa ozone_cmip6hist-ssp245_N96_1979_2031
regional model: command string: "C:\ProgramData\BOINC/projects/climateprediction.net/wah2rm3m2t_um_8.32_windows_intelx86.exe" wah2_eas25_a1ie_201312_24_1024_012324213
 cpdn_check_running: got RM PID of zero; ignoring this call and waiting for PID via shMem. 
 cpdn_check_running: got RM PID of zero; ignoring this call and waiting for PID via shMem. 
executeModelProcess: MonID=3340, GCM_PID=10652, RCM_PID=7124
GCM : BUFFIN: C I/O Error feof - Unit 63 - Return code = 1
GCM : BUFFIN: C I/O Error feof - Unit 63 - Return code = 1

GCM : BUFFIN: C I/O Error feof - Unit 64 - Return code = 1
GCM : BUFFIN: C I/O Error feof - Unit 64 - Return code = 1

15:46:06 (4208): Can't acquire lockfile (32) - waiting 35s
15:46:41 (4208): Can't acquire lockfile (32) - exiting
15:46:41 (4208): Error: The process cannot access the file because it is being used by another process.

 (0x20)
16:54:29 (2852): Can't acquire lockfile (32) - waiting 35s
16:55:16 (2852): Can't acquire lockfile (32) - exiting
16:55:16 (2852): Error: The process cannot access the file because it is being used by another process.

 (0x20)
17:08:52 (10864): Can't acquire lockfile (32) - waiting 35s
17:09:27 (10864): Can't acquire lockfile (32) - exiting
17:09:27 (10864): Error: The process cannot access the file because it is being used by another process.

 (0x20)
modelGetExecutables: check control files, strTemp0 & 1 : 
C:\ProgramData\BOINC/projects/climateprediction.net/wah2_eas25_a1ie_201312_24_1024_012324213/jobs/xadae.namelists
C:\ProgramData\BOINC/projects/climateprediction.net/wah2_eas25_a1ie_201312_24_1024_012324213/jobs/xacxf.namelists
gstrDump[0] = generic_phase1_spinup_eas25_global_aabaka_f
gstrDump[1] = generic_phase1_spinup_eas25_regional_aabaka_f
global model: command string: "C:\ProgramData\BOINC/projects/climateprediction.net/wah2am3m2_um_8.32_windows_intelx86.exe" wah2_eas25_a1ie_201312_24_1024_012324213 generic_phase1_spinup_eas25_global_aabaka_f ic19611221_14_N96 AERclim_ancil_168months_CMIP6-IPSL-CM6A-LR_SST_2009-01-01_2022-12-30_v2404b AERclim_ancil_168months_CMIP6-IPSL-CM6A-LR_SIC_2009-01-01_2022-12-30_v2404b SO2DMS_N96_cmip6hist-ssp245_2009-2020 oxi.addfa ozone_cmip6hist-ssp245_N96_1979_2031
regional model: command string: "C:\ProgramData\BOINC/projects/climateprediction.net/wah2rm3m2t_um_8.32_windows_intelx86.exe" wah2_eas25_a1ie_201312_24_1024_012324213
 cpdn_check_running: got RM PID of zero; ignoring this call and waiting for PID via shMem. 
 cpdn_check_running: got RM PID of zero; ignoring this call and waiting for PID via shMem. 
executeModelProcess: MonID=9552, GCM_PID=9340, RCM_PID=9720
Queuing intermediate upload for CPDN/BOINC: cpdnout4.zip
CPDN Monitor - Quit request from BOINC...
Detaching shared memory... Done.
modelGetExecutables: check control files, strTemp0 & 1 : 
C:\ProgramData\BOINC/projects/climateprediction.net/wah2_eas25_a1ie_201312_24_1024_012324213/jobs/xadae.namelists
C:\ProgramData\BOINC/projects/climateprediction.net/wah2_eas25_a1ie_201312_24_1024_012324213/jobs/xacxf.namelists
gstrDump[0] = generic_phase1_spinup_eas25_global_aabaka_f
gstrDump[1] = generic_phase1_spinup_eas25_regional_aabaka_f
global model: command string: "C:\ProgramData\BOINC/projects/climateprediction.net/wah2am3m2_um_8.32_windows_intelx86.exe" wah2_eas25_a1ie_201312_24_1024_012324213 generic_phase1_spinup_eas25_global_aabaka_f ic19611221_14_N96 AERclim_ancil_168months_CMIP6-IPSL-CM6A-LR_SST_2009-01-01_2022-12-30_v2404b AERclim_ancil_168months_CMIP6-IPSL-CM6A-LR_SIC_2009-01-01_2022-12-30_v2404b SO2DMS_N96_cmip6hist-ssp245_2009-2020 oxi.addfa ozone_cmip6hist-ssp245_N96_1979_2031
regional model: command string: "C:\ProgramData\BOINC/projects/climateprediction.net/wah2rm3m2t_um_8.32_windows_intelx86.exe" wah2_eas25_a1ie_201312_24_1024_012324213
executeModelProcess: MonID=9736, GCM_PID=5348, RCM_PID=8452
Queuing intermediate upload for CPDN/BOINC: cpdnout5.zip
CPDN Monitor - Quit request from BOINC...
Detaching shared memory... Done.
modelGetExecutables: check control files, strTemp0 & 1 : 
C:\ProgramData\BOINC/projects/climateprediction.net/wah2_eas25_a1ie_201312_24_1024_012324213/jobs/xadae.namelists
C:\ProgramData\BOINC/projects/climateprediction.net/wah2_eas25_a1ie_201312_24_1024_012324213/jobs/xacxf.namelists
gstrDump[0] = generic_phase1_spinup_eas25_global_aabaka_f
gstrDump[1] = generic_phase1_spinup_eas25_regional_aabaka_f
global model: command string: "C:\ProgramData\BOINC/projects/climateprediction.net/wah2am3m2_um_8.32_windows_intelx86.exe" wah2_eas25_a1ie_201312_24_1024_012324213 generic_phase1_spinup_eas25_global_aabaka_f ic19611221_14_N96 AERclim_ancil_168months_CMIP6-IPSL-CM6A-LR_SST_2009-01-01_2022-12-30_v2404b AERclim_ancil_168months_CMIP6-IPSL-CM6A-LR_SIC_2009-01-01_2022-12-30_v2404b SO2DMS_N96_cmip6hist-ssp245_2009-2020 oxi.addfa ozone_cmip6hist-ssp245_N96_1979_2031
regional model: command string: "C:\ProgramData\BOINC/projects/climateprediction.net/wah2rm3m2t_um_8.32_windows_intelx86.exe" wah2_eas25_a1ie_201312_24_1024_012324213
 cpdn_check_running: got RM PID of zero; ignoring this call and waiting for PID via shMem. 
 cpdn_check_running: got RM PID of zero; ignoring this call and waiting for PID via shMem. executeModelProcess: MonID=3520, GCM_PID=5036, RCM_PID=13072

09:11:08 (9808): Can't acquire lockfile (32) - waiting 35s
09:11:43 (9808): Can't acquire lockfile (32) - exiting
09:11:43 (9808): Error: The process cannot access the file because it is being used by another process.

 (0x20)
10:20:27 (4948): Can't acquire lockfile (32) - waiting 35s
10:21:02 (4948): Can't acquire lockfile (32) - exiting
10:21:02 (4948): Error: The process cannot access the file because it is being used by another process.

 (0x20)
10:31:52 (12488): Can't acquire lockfile (32) - waiting 35s
10:32:27 (12488): Can't acquire lockfile (32) - exiting
10:32:27 (12488): Error: The process cannot access the file because it is being used by another process.

 (0x20)
10:45:09 (12132): Can't acquire lockfile (32) - waiting 35s
10:45:44 (12132): Can't acquire lockfile (32) - exiting
10:45:44 (12132): Error: The process cannot access the file because it is being used by another process.

 (0x20)
11:56:26 (11404): Can't acquire lockfile (32) - waiting 35s
11:57:01 (11404): Can't acquire lockfile (32) - exiting
11:57:01 (11404): Error: The process cannot access the file because it is being used by another process.

 (0x20)
12:10:05 (8076): Can't acquire lockfile (32) - waiting 35s
12:10:52 (8076): Can't acquire lockfile (32) - exiting
12:10:52 (8076): Error: The process cannot access the file because it is being used by another process.

 (0x20)
12:21:40 (5092): Can't acquire lockfile (32) - waiting 35s
12:22:15 (5092): Can't acquire lockfile (32) - exiting
12:22:15 (5092): Error: The process cannot access the file because it is being used by another process.

 (0x20)
12:36:28 (9060): Can't acquire lockfile (32) - waiting 35s
12:37:03 (9060): Can't acquire lockfile (32) - exiting
12:37:03 (9060): Error: The process cannot access the file because it is being used by another process.

 (0x20)
12:42:57 (2992): Can't acquire lockfile (32) - waiting 35s
12:43:32 (2992): Can't acquire lockfile (32) - exiting
12:43:32 (2992): Error: The process cannot access the file because it is being used by another process.

 (0x20)
Global Worker:: CPDN process is not running, exiting, bRetVal = T, checkPID = 13072, selfPID = 5036, iMonCtr = 2
Controller:: CPDN process is not running, exiting, bRetVal = T, checkPID = 5036, selfPID = 3520, iMonCtr = 1
Model crash detected, will try to restart...
modelGetExecutables: check control files, strTemp0 & 1 : 
C:\ProgramData\BOINC/projects/climateprediction.net/wah2_eas25_a1ie_201312_24_1024_012324213/jobs/xadae.namelists
C:\ProgramData\BOINC/projects/climateprediction.net/wah2_eas25_a1ie_201312_24_1024_012324213/jobs/xacxf.namelists
gstrDump[0] = generic_phase1_spinup_eas25_global_aabaka_f
gstrDump[1] = generic_phase1_spinup_eas25_regional_aabaka_f
global model: command string: "C:\ProgramData\BOINC/projects/climateprediction.net/wah2am3m2_um_8.32_windows_intelx86.exe" wah2_eas25_a1ie_201312_24_1024_012324213 generic_phase1_spinup_eas25_global_aabaka_f ic19611221_14_N96 AERclim_ancil_168months_CMIP6-IPSL-CM6A-LR_SST_2009-01-01_2022-12-30_v2404b AERclim_ancil_168months_CMIP6-IPSL-CM6A-LR_SIC_2009-01-01_2022-12-30_v2404b SO2DMS_N96_cmip6hist-ssp245_2009-2020 oxi.addfa ozone_cmip6hist-ssp245_N96_1979_2031
regional model: command string: "C:\ProgramData\BOINC/projects/climateprediction.net/wah2rm3m2t_um_8.32_windows_intelx86.exe" wah2_eas25_a1ie_201312_24_1024_012324213
 cpdn_check_running: got RM PID of zero; ignoring this call and waiting for PID via shMem. 
 cpdn_check_running: got RM PID of zero; ignoring this call and waiting for PID via shMem. 
executeModelProcess: MonID=11952, GCM_PID=11992, RCM_PID=10272
Queuing intermediate upload for CPDN/BOINC: cpdnout6.zip
CPDN Monitor - Quit request from BOINC...
Detaching shared memory... Done.
modelGetExecutables: check control files, strTemp0 & 1 : 
C:\ProgramData\BOINC/projects/climateprediction.net/wah2_eas25_a1ie_201312_24_1024_012324213/jobs/xadae.namelists
C:\ProgramData\BOINC/projects/climateprediction.net/wah2_eas25_a1ie_201312_24_1024_012324213/jobs/xacxf.namelists
gstrDump[0] = generic_phase1_spinup_eas25_global_aabaka_f
gstrDump[1] = generic_phase1_spinup_eas25_regional_aabaka_f
global model: command string: "C:\ProgramData\BOINC/projects/climateprediction.net/wah2am3m2_um_8.32_windows_intelx86.exe" wah2_eas25_a1ie_201312_24_1024_012324213 generic_phase1_spinup_eas25_global_aabaka_f ic19611221_14_N96 AERclim_ancil_168months_CMIP6-IPSL-CM6A-LR_SST_2009-01-01_2022-12-30_v2404b AERclim_ancil_168months_CMIP6-IPSL-CM6A-LR_SIC_2009-01-01_2022-12-30_v2404b SO2DMS_N96_cmip6hist-ssp245_2009-2020 oxi.addfa ozone_cmip6hist-ssp245_N96_1979_2031
regional model: command string: "C:\ProgramData\BOINC/projects/climateprediction.net/wah2rm3m2t_um_8.32_windows_intelx86.exe" wah2_eas25_a1ie_201312_24_1024_012324213
 cpdn_check_running: got RM PID of zero; ignoring this call and waiting for PID via shMem. 
 cpdn_check_running: got RM PID of zero; ignoring this call and waiting for PID via shMem. 
executeModelProcess: MonID=9340, GCM_PID=14232, RCM_PID=3660
Queuing intermediate upload for CPDN/BOINC: cpdnout7.zip
CPDN Monitor - Quit request from BOINC...
Detaching shared memory... Done.
modelGetExecutables: check control files, strTemp0 & 1 : 
C:\ProgramData\BOINC/projects/climateprediction.net/wah2_eas25_a1ie_201312_24_1024_012324213/jobs/xadae.namelists
C:\ProgramData\BOINC/projects/climateprediction.net/wah2_eas25_a1ie_201312_24_1024_012324213/jobs/xacxf.namelists
gstrDump[0] = generic_phase1_spinup_eas25_global_aabaka_f
gstrDump[1] = generic_phase1_spinup_eas25_regional_aabaka_f
global model: command string: "C:\ProgramData\BOINC/projects/climateprediction.net/wah2am3m2_um_8.32_windows_intelx86.exe" wah2_eas25_a1ie_201312_24_1024_012324213 generic_phase1_spinup_eas25_global_aabaka_f ic19611221_14_N96 AERclim_ancil_168months_CMIP6-IPSL-CM6A-LR_SST_2009-01-01_2022-12-30_v2404b AERclim_ancil_168months_CMIP6-IPSL-CM6A-LR_SIC_2009-01-01_2022-12-30_v2404b SO2DMS_N96_cmip6hist-ssp245_2009-2020 oxi.addfa ozone_cmip6hist-ssp245_N96_1979_2031
regional model: command string: "C:\ProgramData\BOINC/projects/climateprediction.net/wah2rm3m2t_um_8.32_windows_intelx86.exe" wah2_eas25_a1ie_201312_24_1024_012324213
 cpdn_check_running: got RM PID of zero; ignoring this call and waiting for PID via shMem. 
 cpdn_check_running: got RM PID of zero; ignoring this call and waiting for PID via shMem. 
executeModelProcess: MonID=4100, GCM_PID=11864, RCM_PID=9396
Queuing intermediate upload for CPDN/BOINC: cpdnout8.zip
CPDN Monitor - Quit request from BOINC...
Detaching shared memory... Done.
modelGetExecutables: check control files, strTemp0 & 1 : 
C:\ProgramData\BOINC/projects/climateprediction.net/wah2_eas25_a1ie_201312_24_1024_012324213/jobs/xadae.namelists
C:\ProgramData\BOINC/projects/climateprediction.net/wah2_eas25_a1ie_201312_24_1024_012324213/jobs/xacxf.namelists
gstrDump[0] = generic_phase1_spinup_eas25_global_aabaka_f
gstrDump[1] = generic_phase1_spinup_eas25_regional_aabaka_f
global model: command string: "C:\ProgramData\BOINC/projects/climateprediction.net/wah2am3m2_um_8.32_windows_intelx86.exe" wah2_eas25_a1ie_201312_24_1024_012324213 generic_phase1_spinup_eas25_global_aabaka_f ic19611221_14_N96 AERclim_ancil_168months_CMIP6-IPSL-CM6A-LR_SST_2009-01-01_2022-12-30_v2404b AERclim_ancil_168months_CMIP6-IPSL-CM6A-LR_SIC_2009-01-01_2022-12-30_v2404b SO2DMS_N96_cmip6hist-ssp245_2009-2020 oxi.addfa ozone_cmip6hist-ssp245_N96_1979_2031
regional model: command string: "C:\ProgramData\BOINC/projects/climateprediction.net/wah2rm3m2t_um_8.32_windows_intelx86.exe" wah2_eas25_a1ie_201312_24_1024_012324213
 cpdn_check_running: got RM PID of zero; ignoring this call and waiting for PID via shMem. 
 cpdn_check_running: got RM PID of zero; ignoring this call and waiting for PID via shMem. 
executeModelProcess: MonID=5564, GCM_PID=6932, RCM_PID=10320
CPDN Monitor - Quit request from BOINC...
Detaching shared memory... Done.
modelGetExecutables: check control files, strTemp0 & 1 : 
C:\ProgramData\BOINC/projects/climateprediction.net/wah2_eas25_a1ie_201312_24_1024_012324213/jobs/xadae.namelists
C:\ProgramData\BOINC/projects/climateprediction.net/wah2_eas25_a1ie_201312_24_1024_012324213/jobs/xacxf.namelists
gstrDump[0] = generic_phase1_spinup_eas25_global_aabaka_f
gstrDump[1] = generic_phase1_spinup_eas25_regional_aabaka_f
global model: command string: "C:\ProgramData\BOINC/projects/climateprediction.net/wah2am3m2_um_8.32_windows_intelx86.exe" wah2_eas25_a1ie_201312_24_1024_012324213 generic_phase1_spinup_eas25_global_aabaka_f ic19611221_14_N96 AERclim_ancil_168months_CMIP6-IPSL-CM6A-LR_SST_2009-01-01_2022-12-30_v2404b AERclim_ancil_168months_CMIP6-IPSL-CM6A-LR_SIC_2009-01-01_2022-12-30_v2404b SO2DMS_N96_cmip6hist-ssp245_2009-2020 oxi.addfa ozone_cmip6hist-ssp245_N96_1979_2031
regional model: command string: "C:\ProgramData\BOINC/projects/climateprediction.net/wah2rm3m2t_um_8.32_windows_intelx86.exe" wah2_eas25_a1ie_201312_24_1024_012324213
 cpdn_check_running: got RM PID of zero; ignoring this call and waiting for PID via shMem. 
 cpdn_check_running: got RM PID of zero; ignoring this call and waiting for PID via shMem. 
executeModelProcess: MonID=12200, GCM_PID=11572, RCM_PID=11544
CPDN Monitor - Quit request from BOINC...
Detaching shared memory... Done.
modelGetExecutables: check control files, strTemp0 & 1 : 
C:\ProgramData\BOINC/projects/climateprediction.net/wah2_eas25_a1ie_201312_24_1024_012324213/jobs/xadae.namelists
C:\ProgramData\BOINC/projects/climateprediction.net/wah2_eas25_a1ie_201312_24_1024_012324213/jobs/xacxf.namelists
gstrDump[0] = generic_phase1_spinup_eas25_global_aabaka_f
gstrDump[1] = generic_phase1_spinup_eas25_regional_aabaka_f
global model: command string: "C:\ProgramData\BOINC/projects/climateprediction.net/wah2am3m2_um_8.32_windows_intelx86.exe" wah2_eas25_a1ie_201312_24_1024_012324213 generic_phase1_spinup_eas25_global_aabaka_f ic19611221_14_N96 AERclim_ancil_168months_CMIP6-IPSL-CM6A-LR_SST_2009-01-01_2022-12-30_v2404b AERclim_ancil_168months_CMIP6-IPSL-CM6A-LR_SIC_2009-01-01_2022-12-30_v2404b SO2DMS_N96_cmip6hist-ssp245_2009-2020 oxi.addfa ozone_cmip6hist-ssp245_N96_1979_2031
regional model: command string: "C:\ProgramData\BOINC/projects/climateprediction.net/wah2rm3m2t_um_8.32_windows_intelx86.exe" wah2_eas25_a1ie_201312_24_1024_012324213
 cpdn_check_running: got RM PID of zero; ignoring this call and waiting for PID via shMem. 
 cpdn_check_running: got RM PID of zero; ignoring this call and waiting for PID via shMem. 
executeModelProcess: MonID=10292, GCM_PID=11340, RCM_PID=11680
Queuing intermediate upload for CPDN/BOINC: cpdnout9.zip
Queuing intermediate upload for CPDN/BOINC: cpdnout10.zip
Queuing intermediate upload for CPDN/BOINC: cpdnout11.zip
CPDN Monitor - Quit request from BOINC...
Detaching shared memory... Done.
modelGetExecutables: check control files, strTemp0 & 1 : 
C:\ProgramData\BOINC/projects/climateprediction.net/wah2_eas25_a1ie_201312_24_1024_012324213/jobs/xadae.namelists
C:\ProgramData\BOINC/projects/climateprediction.net/wah2_eas25_a1ie_201312_24_1024_012324213/jobs/xacxf.namelists
gstrDump[0] = generic_phase1_spinup_eas25_global_aabaka_f
gstrDump[1] = generic_phase1_spinup_eas25_regional_aabaka_f
global model: command string: "C:\ProgramData\BOINC/projects/climateprediction.net/wah2am3m2_um_8.32_windows_intelx86.exe" wah2_eas25_a1ie_201312_24_1024_012324213 generic_phase1_spinup_eas25_global_aabaka_f ic19611221_14_N96 AERclim_ancil_168months_CMIP6-IPSL-CM6A-LR_SST_2009-01-01_2022-12-30_v2404b AERclim_ancil_168months_CMIP6-IPSL-CM6A-LR_SIC_2009-01-01_2022-12-30_v2404b SO2DMS_N96_cmip6hist-ssp245_2009-2020 oxi.addfa ozone_cmip6hist-ssp245_N96_1979_2031
regional model: command string: "C:\ProgramData\BOINC/projects/climateprediction.net/wah2rm3m2t_um_8.32_windows_intelx86.exe" wah2_eas25_a1ie_201312_24_1024_012324213
 cpdn_check_running: got RM PID of zero; ignoring this call and waiting for PID via shMem. 
 cpdn_check_running: got RM PID of zero; ignoring this call and waiting for PID via shMem. 
executeModelProcess: MonID=3476, GCM_PID=12404, RCM_PID=7656
GCM : BUFFIN: C I/O Error feof - Unit 63 - Return code = 1
GCM : BUFFIN: C I/O Error feof - Unit 63 - Return code = 1

GCM : BUFFIN: C I/O Error feof - Unit 64 - Return code = 1
GCM : BUFFIN: C I/O Error feof - Unit 64 - Return code = 1

CPDN Monitor - Quit request from BOINC...
Detaching shared memory... Done.
modelGetExecutables: check control files, strTemp0 & 1 : 
C:\ProgramData\BOINC/projects/climateprediction.net/wah2_eas25_a1ie_201312_24_1024_012324213/jobs/xadae.namelists
C:\ProgramData\BOINC/projects/climateprediction.net/wah2_eas25_a1ie_201312_24_1024_012324213/jobs/xacxf.namelists
gstrDump[0] = generic_phase1_spinup_eas25_global_aabaka_f
gstrDump[1] = generic_phase1_spinup_eas25_regional_aabaka_f
global model: command string: "C:\ProgramData\BOINC/projects/climateprediction.net/wah2am3m2_um_8.32_windows_intelx86.exe" wah2_eas25_a1ie_201312_24_1024_012324213 generic_phase1_spinup_eas25_global_aabaka_f ic19611221_14_N96 AERclim_ancil_168months_CMIP6-IPSL-CM6A-LR_SST_2009-01-01_2022-12-30_v2404b AERclim_ancil_168months_CMIP6-IPSL-CM6A-LR_SIC_2009-01-01_2022-12-30_v2404b SO2DMS_N96_cmip6hist-ssp245_2009-2020 oxi.addfa ozone_cmip6hist-ssp245_N96_1979_2031
regional model: command string: "C:\ProgramData\BOINC/projects/climateprediction.net/wah2rm3m2t_um_8.32_windows_intelx86.exe" wah2_eas25_a1ie_201312_24_1024_012324213
 cpdn_check_running: got RM PID of zero; ignoring this call and waiting for PID via shMem. 
 cpdn_check_running: got RM PID of zero; ignoring this call and waiting for PID via shMem. 
executeModelProcess: MonID=5764, GCM_PID=236, RCM_PID=11400
GCM : BUFFIN: C I/O Error feof - Unit 63 - Return code = 1
GCM : BUFFIN: C I/O Error feof - Unit 63 - Return code = 1

GCM : BUFFIN: C I/O Error feof - Unit 64 - Return code = 1
GCM : BUFFIN: C I/O Error feof - Unit 64 - Return code = 1

CPDN Monitor - Quit request from BOINC...
Detaching shared memory... Done.
modelGetExecutables: check control files, strTemp0 & 1 : 
C:\ProgramData\BOINC/projects/climateprediction.net/wah2_eas25_a1ie_201312_24_1024_012324213/jobs/xadae.namelists
C:\ProgramData\BOINC/projects/climateprediction.net/wah2_eas25_a1ie_201312_24_1024_012324213/jobs/xacxf.namelists
gstrDump[0] = generic_phase1_spinup_eas25_global_aabaka_f
gstrDump[1] = generic_phase1_spinup_eas25_regional_aabaka_f
global model: command string: "C:\ProgramData\BOINC/projects/climateprediction.net/wah2am3m2_um_8.32_windows_intelx86.exe" wah2_eas25_a1ie_201312_24_1024_012324213 generic_phase1_spinup_eas25_global_aabaka_f ic19611221_14_N96 AERclim_ancil_168months_CMIP6-IPSL-CM6A-LR_SST_2009-01-01_2022-12-30_v2404b AERclim_ancil_168months_CMIP6-IPSL-CM6A-LR_SIC_2009-01-01_2022-12-30_v2404b SO2DMS_N96_cmip6hist-ssp245_2009-2020 oxi.addfa ozone_cmip6hist-ssp245_N96_1979_2031
regional model: command string: "C:\ProgramData\BOINC/projects/climateprediction.net/wah2rm3m2t_um_8.32_windows_intelx86.exe" wah2_eas25_a1ie_201312_24_1024_012324213
 cpdn_check_running: got RM PID of zero; ignoring this call and waiting for PID via shMem. 
executeModelProcess: MonID=7204, GCM_PID=5772, RCM_PID=8412
GCM : BUFFIN: C I/O Error feof - Unit 63 - Return code = 1
GCM : BUFFIN: C I/O Error feof - Unit 63 - Return code = 1

GCM : BUFFIN: C I/O Error feof - Unit 64 - Return code = 1
GCM : BUFFIN: C I/O Error feof - Unit 64 - Return code = 1

CPDN Monitor - Quit request from BOINC...
Detaching shared memory... Done.
modelGetExecutables: check control files, strTemp0 & 1 : 
C:\ProgramData\BOINC/projects/climateprediction.net/wah2_eas25_a1ie_201312_24_1024_012324213/jobs/xadae.namelists
C:\ProgramData\BOINC/projects/climateprediction.net/wah2_eas25_a1ie_201312_24_1024_012324213/jobs/xacxf.namelists
gstrDump[0] = generic_phase1_spinup_eas25_global_aabaka_f
gstrDump[1] = generic_phase1_spinup_eas25_regional_aabaka_f
global model: command string: "C:\ProgramData\BOINC/projects/climateprediction.net/wah2am3m2_um_8.32_windows_intelx86.exe" wah2_eas25_a1ie_201312_24_1024_012324213 generic_phase1_spinup_eas25_global_aabaka_f ic19611221_14_N96 AERclim_ancil_168months_CMIP6-IPSL-CM6A-LR_SST_2009-01-01_2022-12-30_v2404b AERclim_ancil_168months_CMIP6-IPSL-CM6A-LR_SIC_2009-01-01_2022-12-30_v2404b SO2DMS_N96_cmip6hist-ssp245_2009-2020 oxi.addfa ozone_cmip6hist-ssp245_N96_1979_2031
regional model: command string: "C:\ProgramData\BOINC/projects/climateprediction.net/wah2rm3m2t_um_8.32_windows_intelx86.exe" wah2_eas25_a1ie_201312_24_1024_012324213
 cpdn_check_running: got RM PID of zero; ignoring this call and waiting for PID via shMem. 
executeModelProcess: MonID=10320, GCM_PID=5864, RCM_PID=8008
Queuing intermediate upload for CPDN/BOINC: cpdnout_restart.zip
Queuing intermediate upload for CPDN/BOINC: cpdnout12.zip
Queuing intermediate upload for CPDN/BOINC: cpdnout13.zip
Queuing intermediate upload for CPDN/BOINC: cpdnout14.zip
CPDN Monitor - Quit request from BOINC...
Detaching shared memory... Done.
modelGetExecutables: check control files, strTemp0 & 1 : 
C:\ProgramData\BOINC/projects/climateprediction.net/wah2_eas25_a1ie_201312_24_1024_012324213/jobs/xadae.namelists
C:\ProgramData\BOINC/projects/climateprediction.net/wah2_eas25_a1ie_201312_24_1024_012324213/jobs/xacxf.namelists
gstrDump[0] = generic_phase1_spinup_eas25_global_aabaka_f
gstrDump[1] = generic_phase1_spinup_eas25_regional_aabaka_f
global model: command string: "C:\ProgramData\BOINC/projects/climateprediction.net/wah2am3m2_um_8.32_windows_intelx86.exe" wah2_eas25_a1ie_201312_24_1024_012324213 generic_phase1_spinup_eas25_global_aabaka_f ic19611221_14_N96 AERclim_ancil_168months_CMIP6-IPSL-CM6A-LR_SST_2009-01-01_2022-12-30_v2404b AERclim_ancil_168months_CMIP6-IPSL-CM6A-LR_SIC_2009-01-01_2022-12-30_v2404b SO2DMS_N96_cmip6hist-ssp245_2009-2020 oxi.addfa ozone_cmip6hist-ssp245_N96_1979_2031
regional model: command string: "C:\ProgramData\BOINC/projects/climateprediction.net/wah2rm3m2t_um_8.32_windows_intelx86.exe" wah2_eas25_a1ie_201312_24_1024_012324213
 cpdn_check_running: got RM PID of zero; ignoring this call and waiting for PID via shMem. 
 cpdn_check_running: got RM PID of zero; ignoring this call and waiting for PID via shMem. executeModelProcess: MonID=12680, GCM_PID=8392, RCM_PID=10400

CPDN Monitor - Quit request from BOINC...
Detaching shared memory... Done.
modelGetExecutables: check control files, strTemp0 & 1 : 
C:\ProgramData\BOINC/projects/climateprediction.net/wah2_eas25_a1ie_201312_24_1024_012324213/jobs/xadae.namelists
C:\ProgramData\BOINC/projects/climateprediction.net/wah2_eas25_a1ie_201312_24_1024_012324213/jobs/xacxf.namelists
gstrDump[0] = generic_phase1_spinup_eas25_global_aabaka_f
gstrDump[1] = generic_phase1_spinup_eas25_regional_aabaka_f
global model: command string: "C:\ProgramData\BOINC/projects/climateprediction.net/wah2am3m2_um_8.32_windows_intelx86.exe" wah2_eas25_a1ie_201312_24_1024_012324213 generic_phase1_spinup_eas25_global_aabaka_f ic19611221_14_N96 AERclim_ancil_168months_CMIP6-IPSL-CM6A-LR_SST_2009-01-01_2022-12-30_v2404b AERclim_ancil_168months_CMIP6-IPSL-CM6A-LR_SIC_2009-01-01_2022-12-30_v2404b SO2DMS_N96_cmip6hist-ssp245_2009-2020 oxi.addfa ozone_cmip6hist-ssp245_N96_1979_2031
regional model: command string: "C:\ProgramData\BOINC/projects/climateprediction.net/wah2rm3m2t_um_8.32_windows_intelx86.exe" wah2_eas25_a1ie_201312_24_1024_012324213
 cpdn_check_running: got RM PID of zero; ignoring this call and waiting for PID via shMem. 
executeModelProcess: MonID=13260, GCM_PID=10512, RCM_PID=7688
CPDN Monitor - Quit request from BOINC...
Detaching shared memory... Done.
modelGetExecutables: check control files, strTemp0 & 1 : 
C:\ProgramData\BOINC/projects/climateprediction.net/wah2_eas25_a1ie_201312_24_1024_012324213/jobs/xadae.namelists
C:\ProgramData\BOINC/projects/climateprediction.net/wah2_eas25_a1ie_201312_24_1024_012324213/jobs/xacxf.namelists
gstrDump[0] = generic_phase1_spinup_eas25_global_aabaka_f
gstrDump[1] = generic_phase1_spinup_eas25_regional_aabaka_f
global model: command string: "C:\ProgramData\BOINC/projects/climateprediction.net/wah2am3m2_um_8.32_windows_intelx86.exe" wah2_eas25_a1ie_201312_24_1024_012324213 generic_phase1_spinup_eas25_global_aabaka_f ic19611221_14_N96 AERclim_ancil_168months_CMIP6-IPSL-CM6A-LR_SST_2009-01-01_2022-12-30_v2404b AERclim_ancil_168months_CMIP6-IPSL-CM6A-LR_SIC_2009-01-01_2022-12-30_v2404b SO2DMS_N96_cmip6hist-ssp245_2009-2020 oxi.addfa ozone_cmip6hist-ssp245_N96_1979_2031
regional model: command string: "C:\ProgramData\BOINC/projects/climateprediction.net/wah2rm3m2t_um_8.32_windows_intelx86.exe" wah2_eas25_a1ie_201312_24_1024_012324213
 cpdn_check_running: got RM PID of zero; ignoring this call and waiting for PID via shMem. 
 cpdn_check_running: got RM PID of zero; ignoring this call and waiting for PID via shMem. 
executeModelProcess: MonID=13084, GCM_PID=4716, RCM_PID=11552
Global Worker:: CPDN process is not running, exiting, bRetVal = T, checkPID = 11552, selfPID = 4716, iMonCtr = 2
Controller:: CPDN process is not running, exiting, bRetVal = T, checkPID = 4716, selfPID = 13084, iMonCtr = 1
Model crash detected, will try to restart...
Leaving CPDN_Main::Monitor...
monitor:finished called ... tidying up.
monitor:finished: Uploading out files...
Queuing intermediate upload for CPDN/BOINC: cpdnout_out.zip
Detaching shared memory... Done.
monitor:finished: Closed output file : stdout_<>.txt
modelResultFiles : Removing : wah2_eas25_a1ie_201312_24_1024_012324213 in C:\ProgramData\BOINC/projects/climateprediction.net
modelGetExecutables: check control files, strTemp0 & 1 : 
C:\ProgramData\BOINC/projects/climateprediction.net/wah2_eas25_a1ie_201312_24_1024_012324213/jobs/xadae.namelists
C:\ProgramData\BOINC/projects/climateprediction.net/wah2_eas25_a1ie_201312_24_1024_012324213/jobs/xacxf.namelists
cpdnmonitor: cannot open input file C:\ProgramData\BOINC/projects/climateprediction.net/wah2_eas25_a1ie_201312_24_1024_012324213/jobs/xacxf.ihist after 11 attempts
cpdnmonitor: cannot open input file C:\ProgramData\BOINC/projects/climateprediction.net/wah2_eas25_a1ie_201312_24_1024_012324213/dataout/atmos_restart.day after 11 attempts
cpdnmonitor: cannot open input file C:\ProgramData\BOINC/projects/climateprediction.net/wah2_eas25_a1ie_201312_24_1024_012324213/dataout/region_restart.day after 11 attempts
gstrDump[0] = generic_phase1_spinup_eas25_global_aabaka_f
gstrDump[1] = generic_phase1_spinup_eas25_regional_aabaka_f
global model: command string: "C:\ProgramData\BOINC/projects/climateprediction.net/wah2am3m2_um_8.32_windows_intelx86.exe" wah2_eas25_a1ie_201312_24_1024_012324213 generic_phase1_spinup_eas25_global_aabaka_f ic19611221_14_N96 AERclim_ancil_168months_CMIP6-IPSL-CM6A-LR_SST_2009-01-01_2022-12-30_v2404b AERclim_ancil_168months_CMIP6-IPSL-CM6A-LR_SIC_2009-01-01_2022-12-30_v2404b SO2DMS_N96_cmip6hist-ssp245_2009-2020 oxi.addfa ozone_cmip6hist-ssp245_N96_1979_2031

Model crashed:  DRLANDF1 : Error in FILE_OPEN.                                                                                                                                                                                                                                 tmp/xadae.pipe_dummy                                                            
regional model: command string: "C:\ProgramData\BOINC/projects/climateprediction.net/wah2rm3m2t_um_8.32_windows_intelx86.exe" wah2_eas25_a1ie_201312_24_1024_012324213
executeModelProcess: MonID=7028, GCM_PID=11944, RCM_PID=12256
Controller:: CPDN process is not running, exiting, bRetVal = T, checkPID = 12256, selfPID = 7028, iMonCtr = 2
Model crash detected, will try to restart...
Leaving CPDN_Main::Monitor...
monitor:finished called ... tidying up.
monitor:finished: Uploading out files...
Queuing intermediate upload for CPDN/BOINC: cpdnout_out.zip
Detaching shared memory... Done.
monitor:finished: Closed output file : stdout_<>.txt
modelResultFiles : Removing : wah2_eas25_a1ie_201312_24_1024_012324213 in C:\ProgramData\BOINC/projects/climateprediction.net
monitor:finished: handing over to boinc_finish(RetVal=0)
13:22:33 (7028): called boinc_finish(0)

</stderr_txt>
<message>
upload failure: <file_xfer_error>
  <file_name>wah2_eas25_a1ie_201312_24_1024_012324213_1_r21055656_15.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_eas25_a1ie_201312_24_1024_012324213_1_r21055656_16.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_eas25_a1ie_201312_24_1024_012324213_1_r21055656_17.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_eas25_a1ie_201312_24_1024_012324213_1_r21055656_18.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_eas25_a1ie_201312_24_1024_012324213_1_r21055656_19.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_eas25_a1ie_201312_24_1024_012324213_1_r21055656_20.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_eas25_a1ie_201312_24_1024_012324213_1_r21055656_21.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_eas25_a1ie_201312_24_1024_012324213_1_r21055656_22.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_eas25_a1ie_201312_24_1024_012324213_1_r21055656_23.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_eas25_a1ie_201312_24_1024_012324213_1_r21055656_24.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
</message>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
05 Oct 2024 09:31:00 1518579 22511628 wah2_eas25_a1ie_201312_24_1024_012324213_1 161,579 1,502,985 9.3019
03 Oct 2024 23:32:36 1518579 22511628 wah2_eas25_a1ie_201312_24_1024_012324213_1 150,059 1,381,760 9.2081
02 Oct 2024 13:31:47 1518579 22511628 wah2_eas25_a1ie_201312_24_1024_012324213_1 138,539 1,260,556 9.0989
01 Oct 2024 03:05:20 1518579 22511628 wah2_eas25_a1ie_201312_24_1024_012324213_1 127,019 1,140,182 8.9765
01 Oct 2024 01:39:47 1518579 22511628 wah2_eas25_a1ie_201312_24_1024_012324213_1 127,019 1,138,002 8.9593
29 Sep 2024 23:02:29 1518579 22511628 wah2_eas25_a1ie_201312_24_1024_012324213_1 115,499 1,042,932 9.0298
28 Sep 2024 20:19:00 1518579 22511628 wah2_eas25_a1ie_201312_24_1024_012324213_1 103,979 947,021 9.1078
24 Sep 2024 04:25:59 1518579 22511628 wah2_eas25_a1ie_201312_24_1024_012324213_1 92,459 845,215 9.1415
22 Sep 2024 04:15:33 1518579 22511628 wah2_eas25_a1ie_201312_24_1024_012324213_1 80,939 755,635 9.3359
20 Sep 2024 21:37:59 1518579 22511628 wah2_eas25_a1ie_201312_24_1024_012324213_1 69,419 648,614 9.3435
19 Sep 2024 09:09:28 1518579 22511628 wah2_eas25_a1ie_201312_24_1024_012324213_1 57,899 546,241 9.4344
19 Sep 2024 04:25:01 1518579 22511628 wah2_eas25_a1ie_201312_24_1024_012324213_1 46,379 436,239 9.4060
19 Sep 2024 04:25:01 1518579 22511628 wah2_eas25_a1ie_201312_24_1024_012324213_1 34,859 329,976 9.4660
19 Sep 2024 04:25:01 1518579 22511628 wah2_eas25_a1ie_201312_24_1024_012324213_1 34,859 327,374 9.3914
19 Sep 2024 04:25:01 1518579 22511628 wah2_eas25_a1ie_201312_24_1024_012324213_1 23,339 219,435 9.4021
19 Sep 2024 04:25:01 1518579 22511628 wah2_eas25_a1ie_201312_24_1024_012324213_1 11,819 111,109 9.4009


©2024 cpdn.org