climateprediction.net home page
Task 22303756

Task 22303756

Name oifs_43r3_ps_0549_1999050100_123_968_12185193_1
Workunit 12185193
Created 26 Jan 2023, 2:16:09 UTC
Sent 26 Jan 2023, 2:18:59 UTC
Report deadline 27 Mar 2023, 2:18:59 UTC
Received 26 Jan 2023, 15:47:00 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 1 (0x00000001) Unknown error code
Computer ID 1515225
Run time 12 hours 29 min 42 sec
CPU time 12 hours 16 min 29 sec
Validate state Invalid
Credit 6,894.72
Device peak FLOPS 4.56 GFLOPS
Application version OpenIFS 43r3 Perturbed Surface v1.05
x86_64-pc-linux-gnu
Peak working set size 4,405.66 MB
Peak swap size 4,978.07 MB
Peak disk usage 2,566.56 MB
Stderr
<core_client_version>7.9.3</core_client_version>
<![CDATA[
<message>
process exited with code 1 (0x1, -255)</message>
<stderr_txt>
lib/boinc-client/slots/8/ICMUAhq0f+000852
  02:09:53 STEP  853 H= 853:00 +CPU= 25.194
  02:10:19 STEP  854 H= 854:00 +CPU= 25.959
  02:10:58 STEP  855 H= 855:00 +CPU= 39.334
  02:11:24 STEP  856 H= 856:00 +CPU= 26.246
  02:11:49 STEP  857 H= 857:00 +CPU= 25.116
  02:12:30 STEP  858 H= 858:00 +CPU= 40.417
  02:12:55 STEP  859 H= 859:00 +CPU= 25.181
  02:13:21 STEP  860 H= 860:00 +CPU= 25.701
  02:13:59 STEP  861 H= 861:00 +CPU= 37.883
  02:14:25 STEP  862 H= 862:00 +CPU= 26.032
  02:14:51 STEP  863 H= 863:00 +CPU= 25.748
  02:15:44 STEP  864 H= 864:00 +CPU= 46.313
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGhq0f+000864
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHhq0f+000864
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAhq0f+000864
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185193/ICMGGhq0f+000840
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185193/ICMSHhq0f+000840
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185193/ICMUAhq0f+000840
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185193/ICMGGhq0f+000852
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185193/ICMSHhq0f+000852
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185193/ICMUAhq0f+000852
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0549_1999050100_123_968_12185193_1_r210634063_35.zip
Uploading the intermediate file: upload_file_35.zip
  02:16:09 STEP  865 H= 865:00 +CPU= 25.144
  02:16:39 STEP  866 H= 866:00 +CPU= 26.143
  02:17:20 STEP  867 H= 867:00 +CPU= 39.991
  02:17:44 STEP  868 H= 868:00 +CPU= 23.663
  02:18:10 STEP  869 H= 869:00 +CPU= 25.253
  02:18:52 STEP  870 H= 870:00 +CPU= 40.387
  02:19:17 STEP  871 H= 871:00 +CPU= 24.998
  02:19:43 STEP  872 H= 872:00 +CPU= 26.314
  02:20:23 STEP  873 H= 873:00 +CPU= 39.633
  02:20:49 STEP  874 H= 874:00 +CPU= 26.231
  02:21:14 STEP  875 H= 875:00 +CPU= 25.090
  02:21:59 STEP  876 H= 876:00 +CPU= 43.935
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGhq0f+000876
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHhq0f+000876
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAhq0f+000876
  02:22:24 STEP  877 H= 877:00 +CPU= 25.110
  02:22:50 STEP  878 H= 878:00 +CPU= 25.928
  02:23:29 STEP  879 H= 879:00 +CPU= 39.391
  02:23:55 STEP  880 H= 880:00 +CPU= 25.932
  02:24:20 STEP  881 H= 881:00 +CPU= 25.119
  02:25:01 STEP  882 H= 882:00 +CPU= 40.724
  02:25:27 STEP  883 H= 883:00 +CPU= 25.731
  02:25:53 STEP  884 H= 884:00 +CPU= 26.089
  02:26:33 STEP  885 H= 885:00 +CPU= 39.736
  02:27:00 STEP  886 H= 886:00 +CPU= 26.410
  02:27:26 STEP  887 H= 887:00 +CPU= 26.146
  02:28:20 STEP  888 H= 888:00 +CPU= 46.932
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGhq0f+000888
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHhq0f+000888
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAhq0f+000888
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185193/ICMGGhq0f+000864
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185193/ICMSHhq0f+000864
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185193/ICMUAhq0f+000864
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185193/ICMGGhq0f+000876
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185193/ICMSHhq0f+000876
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185193/ICMUAhq0f+000876
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0549_1999050100_123_968_12185193_1_r210634063_36.zip
Uploading the intermediate file: upload_file_36.zip
  02:28:46 STEP  889 H= 889:00 +CPU= 25.303
Uploading trickle at timestep: 3196800
  02:29:12 STEP  890 H= 890:00 +CPU= 25.977
  02:29:51 STEP  891 H= 891:00 +CPU= 39.351
  02:30:17 STEP  892 H= 892:00 +CPU= 25.835
  02:30:42 STEP  893 H= 893:00 +CPU= 25.064
  02:31:24 STEP  894 H= 894:00 +CPU= 40.455
  02:31:49 STEP  895 H= 895:00 +CPU= 25.368
  02:32:15 STEP  896 H= 896:00 +CPU= 25.951
  02:32:56 STEP  897 H= 897:00 +CPU= 40.146
  02:33:22 STEP  898 H= 898:00 +CPU= 26.561
  02:33:48 STEP  899 H= 899:00 +CPU= 25.567
  02:34:32 STEP  900 H= 900:00 +CPU= 43.975
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGhq0f+000900
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHhq0f+000900
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAhq0f+000900
  02:34:58 STEP  901 H= 901:00 +CPU= 25.459
  02:35:24 STEP  902 H= 902:00 +CPU= 25.841
  02:36:03 STEP  903 H= 903:00 +CPU= 39.429
  02:36:29 STEP  904 H= 904:00 +CPU= 25.926
  02:36:55 STEP  905 H= 905:00 +CPU= 25.160
  02:37:37 STEP  906 H= 906:00 +CPU= 40.334
  02:38:02 STEP  907 H= 907:00 +CPU= 25.133
  02:38:28 STEP  908 H= 908:00 +CPU= 25.846
  02:39:09 STEP  909 H= 909:00 +CPU= 39.376
  02:39:35 STEP  910 H= 910:00 +CPU= 25.877
  02:40:00 STEP  911 H= 911:00 +CPU= 25.433
  02:40:54 STEP  912 H= 912:00 +CPU= 46.252
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGhq0f+000912
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHhq0f+000912
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAhq0f+000912
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185193/ICMGGhq0f+000888
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185193/ICMSHhq0f+000888
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185193/ICMUAhq0f+000888
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185193/ICMGGhq0f+000900
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185193/ICMSHhq0f+000900
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185193/ICMUAhq0f+000900
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0549_1999050100_123_968_12185193_1_r210634063_37.zip
Uploading the intermediate file: upload_file_37.zip
  02:41:20 STEP  913 H= 913:00 +CPU= 25.385
  02:41:46 STEP  914 H= 914:00 +CPU= 25.958
  02:42:26 STEP  915 H= 915:00 +CPU= 39.688
  02:42:56 STEP  916 H= 916:00 +CPU= 26.997
  02:43:22 STEP  917 H= 917:00 +CPU= 26.194
  02:44:04 STEP  918 H= 918:00 +CPU= 42.110
  02:44:31 STEP  919 H= 919:00 +CPU= 25.342
  02:44:56 STEP  920 H= 920:00 +CPU= 25.331
  02:45:35 STEP  921 H= 921:00 +CPU= 38.561
  02:46:01 STEP  922 H= 922:00 +CPU= 26.587
  02:46:27 STEP  923 H= 923:00 +CPU= 25.543
  02:47:12 STEP  924 H= 924:00 +CPU= 44.441
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGhq0f+000924
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHhq0f+000924
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAhq0f+000924
  02:47:37 STEP  925 H= 925:00 +CPU= 25.734
  02:48:04 STEP  926 H= 926:00 +CPU= 25.083
  02:48:44 STEP  927 H= 927:00 +CPU= 39.513
  02:49:10 STEP  928 H= 928:00 +CPU= 26.012
  02:49:35 STEP  929 H= 929:00 +CPU= 24.892
  02:50:15 STEP  930 H= 930:00 +CPU= 40.219
  02:50:40 STEP  931 H= 931:00 +CPU= 25.097
  02:51:07 STEP  932 H= 932:00 +CPU= 25.993
  02:51:46 STEP  933 H= 933:00 +CPU= 39.261
  02:52:12 STEP  934 H= 934:00 +CPU= 25.974
  02:52:38 STEP  935 H= 935:00 +CPU= 25.885
  02:53:29 STEP  936 H= 936:00 +CPU= 46.312
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGhq0f+000936
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHhq0f+000936
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAhq0f+000936
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185193/ICMGGhq0f+000912
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185193/ICMSHhq0f+000912
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185193/ICMUAhq0f+000912
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185193/ICMGGhq0f+000924
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185193/ICMSHhq0f+000924
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185193/ICMUAhq0f+000924
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0549_1999050100_123_968_12185193_1_r210634063_38.zip
Uploading the intermediate file: upload_file_38.zip
  02:53:54 STEP  937 H= 937:00 +CPU= 24.829
  02:54:20 STEP  938 H= 938:00 +CPU= 26.191
  02:55:00 STEP  939 H= 939:00 +CPU= 39.534
  02:55:25 STEP  940 H= 940:00 +CPU= 24.856
  02:55:50 STEP  941 H= 941:00 +CPU= 25.560
  02:56:31 STEP  942 H= 942:00 +CPU= 40.725
  02:56:57 STEP  943 H= 943:00 +CPU= 25.305
  02:57:25 STEP  944 H= 944:00 +CPU= 26.229
  02:58:06 STEP  945 H= 945:00 +CPU= 39.994
  02:58:32 STEP  946 H= 946:00 +CPU= 26.387
  02:58:58 STEP  947 H= 947:00 +CPU= 25.490
  02:59:42 STEP  948 H= 948:00 +CPU= 43.582
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGhq0f+000948
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHhq0f+000948
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAhq0f+000948
  03:00:07 STEP  949 H= 949:00 +CPU= 25.095
  03:00:33 STEP  950 H= 950:00 +CPU= 25.877
  03:01:12 STEP  951 H= 951:00 +CPU= 38.934
  03:01:38 STEP  952 H= 952:00 +CPU= 25.921
  03:02:04 STEP  953 H= 953:00 +CPU= 25.078
  03:02:45 STEP  954 H= 954:00 +CPU= 40.056
  03:03:10 STEP  955 H= 955:00 +CPU= 25.049
  03:03:35 STEP  956 H= 956:00 +CPU= 25.755
  03:04:14 STEP  957 H= 957:00 +CPU= 38.880
  03:04:40 STEP  958 H= 958:00 +CPU= 25.902
  03:05:06 STEP  959 H= 959:00 +CPU= 25.662
  03:05:55 STEP  960 H= 960:00 +CPU= 46.000
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGhq0f+000960
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHhq0f+000960
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAhq0f+000960
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185193/ICMGGhq0f+000936
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185193/ICMSHhq0f+000936
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185193/ICMUAhq0f+000936
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185193/ICMGGhq0f+000948
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185193/ICMSHhq0f+000948
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185193/ICMUAhq0f+000948
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0549_1999050100_123_968_12185193_1_r210634063_39.zip
Uploading the intermediate file: upload_file_39.zip
  03:06:20 STEP  961 H= 961:00 +CPU= 24.943
  03:06:47 STEP  962 H= 962:00 +CPU= 25.853
  03:07:26 STEP  963 H= 963:00 +CPU= 39.089
  03:07:51 STEP  964 H= 964:00 +CPU= 24.373
  03:08:16 STEP  965 H= 965:00 +CPU= 25.130
  03:08:56 STEP  966 H= 966:00 +CPU= 40.586
  03:09:24 STEP  967 H= 967:00 +CPU= 25.052
  03:09:50 STEP  968 H= 968:00 +CPU= 26.020
  03:10:30 STEP  969 H= 969:00 +CPU= 39.452
  03:10:56 STEP  970 H= 970:00 +CPU= 26.173
  03:11:21 STEP  971 H= 971:00 +CPU= 24.997
  03:12:05 STEP  972 H= 972:00 +CPU= 43.410
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGhq0f+000972
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHhq0f+000972
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAhq0f+000972
  03:12:30 STEP  973 H= 973:00 +CPU= 24.936
  03:12:57 STEP  974 H= 974:00 +CPU= 25.961
  03:13:37 STEP  975 H= 975:00 +CPU= 39.218
  03:14:03 STEP  976 H= 976:00 +CPU= 25.773
  03:14:27 STEP  977 H= 977:00 +CPU= 24.855
  03:15:08 STEP  978 H= 978:00 +CPU= 40.135
  03:15:34 STEP  979 H= 979:00 +CPU= 25.307
  03:16:00 STEP  980 H= 980:00 +CPU= 25.786
  03:16:39 STEP  981 H= 981:00 +CPU= 39.196
  03:17:05 STEP  982 H= 982:00 +CPU= 26.072
  03:17:31 STEP  983 H= 983:00 +CPU= 25.657
  03:18:22 STEP  984 H= 984:00 +CPU= 45.798
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGhq0f+000984
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHhq0f+000984
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAhq0f+000984
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185193/ICMGGhq0f+000960
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185193/ICMSHhq0f+000960
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185193/ICMUAhq0f+000960
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185193/ICMGGhq0f+000972
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185193/ICMSHhq0f+000972
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185193/ICMUAhq0f+000972
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0549_1999050100_123_968_12185193_1_r210634063_40.zip
Uploading the intermediate file: upload_file_40.zip
  03:18:48 STEP  985 H= 985:00 +CPU= 25.318
  03:19:14 STEP  986 H= 986:00 +CPU= 25.976
  03:19:53 STEP  987 H= 987:00 +CPU= 39.448
  03:20:22 STEP  988 H= 988:00 +CPU= 26.061
  03:20:47 STEP  989 H= 989:00 +CPU= 24.980
  03:21:28 STEP  990 H= 990:00 +CPU= 40.712
  03:21:55 STEP  991 H= 991:00 +CPU= 25.351
  03:22:21 STEP  992 H= 992:00 +CPU= 25.958
  03:23:00 STEP  993 H= 993:00 +CPU= 39.497
  03:23:27 STEP  994 H= 994:00 +CPU= 26.475
  03:23:52 STEP  995 H= 995:00 +CPU= 25.085
  03:24:36 STEP  996 H= 996:00 +CPU= 43.978
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGhq0f+000996
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHhq0f+000996
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAhq0f+000996
  03:25:02 STEP  997 H= 997:00 +CPU= 25.825
  03:25:29 STEP  998 H= 998:00 +CPU= 26.479
  03:26:09 STEP  999 H= 999:00 +CPU= 39.948
  03:26:36 STEP 1000 H=1000:00 +CPU= 26.741
  03:27:01 STEP 1001 H=1001:00 +CPU= 25.529
  03:27:42 STEP 1002 H=1002:00 +CPU= 41.059
  03:28:08 STEP 1003 H=1003:00 +CPU= 25.545
  03:28:34 STEP 1004 H=1004:00 +CPU= 26.055
  03:29:13 STEP 1005 H=1005:00 +CPU= 39.277
  03:29:40 STEP 1006 H=1006:00 +CPU= 26.159
  03:30:06 STEP 1007 H=1007:00 +CPU= 25.937
  03:31:00 STEP 1008 H=1008:00 +CPU= 46.343
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGhq0f+001008
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHhq0f+001008
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAhq0f+001008
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185193/ICMGGhq0f+000984
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185193/ICMSHhq0f+000984
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185193/ICMUAhq0f+000984
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185193/ICMGGhq0f+000996
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185193/ICMSHhq0f+000996
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185193/ICMUAhq0f+000996
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0549_1999050100_123_968_12185193_1_r210634063_41.zip
Uploading the intermediate file: upload_file_41.zip
  03:31:26 STEP 1009 H=1009:00 +CPU= 25.442
  03:31:55 STEP 1010 H=1010:00 +CPU= 26.460
  03:32:34 STEP 1011 H=1011:00 +CPU= 39.174
  03:33:01 STEP 1012 H=1012:00 +CPU= 25.913
  03:33:26 STEP 1013 H=1013:00 +CPU= 25.017
  03:34:06 STEP 1014 H=1014:00 +CPU= 40.193
  03:34:31 STEP 1015 H=1015:00 +CPU= 25.131
  03:34:57 STEP 1016 H=1016:00 +CPU= 26.198
  03:35:37 STEP 1017 H=1017:00 +CPU= 39.292
  03:36:03 STEP 1018 H=1018:00 +CPU= 26.208
  03:36:29 STEP 1019 H=1019:00 +CPU= 25.639
  03:37:13 STEP 1020 H=1020:00 +CPU= 44.489
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGhq0f+001020
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHhq0f+001020
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAhq0f+001020
  03:37:38 STEP 1021 H=1021:00 +CPU= 25.186
  03:38:03 STEP 1022 H=1022:00 +CPU= 24.283
  03:38:40 STEP 1023 H=1023:00 +CPU= 37.580
  03:39:06 STEP 1024 H=1024:00 +CPU= 25.950
  03:39:32 STEP 1025 H=1025:00 +CPU= 25.332
  03:40:11 STEP 1026 H=1026:00 +CPU= 39.801
  03:40:37 STEP 1027 H=1027:00 +CPU= 25.234
  03:41:03 STEP 1028 H=1028:00 +CPU= 26.032
  03:41:42 STEP 1029 H=1029:00 +CPU= 39.289
  03:42:08 STEP 1030 H=1030:00 +CPU= 26.290
  03:42:36 STEP 1031 H=1031:00 +CPU= 27.839
  03:43:30 STEP 1032 H=1032:00 +CPU= 48.497
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGhq0f+001032
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHhq0f+001032
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAhq0f+001032
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185193/ICMGGhq0f+001008
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185193/ICMSHhq0f+001008
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185193/ICMUAhq0f+001008
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185193/ICMGGhq0f+001020
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185193/ICMSHhq0f+001020
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185193/ICMUAhq0f+001020
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0549_1999050100_123_968_12185193_1_r210634063_42.zip
Uploading the intermediate file: upload_file_42.zip
  03:43:57 STEP 1033 H=1033:00 +CPU= 26.734
  03:44:25 STEP 1034 H=1034:00 +CPU= 27.909
  03:45:04 STEP 1035 H=1035:00 +CPU= 38.585
  03:45:32 STEP 1036 H=1036:00 +CPU= 27.662
  03:45:58 STEP 1037 H=1037:00 +CPU= 26.820
  03:46:41 STEP 1038 H=1038:00 +CPU= 42.345
  03:47:06 STEP 1039 H=1039:00 +CPU= 25.343
  03:47:33 STEP 1040 H=1040:00 +CPU= 27.134
  03:48:14 STEP 1041 H=1041:00 +CPU= 40.402
  03:48:41 STEP 1042 H=1042:00 +CPU= 26.814
  03:49:06 STEP 1043 H=1043:00 +CPU= 25.567
  03:49:50 STEP 1044 H=1044:00 +CPU= 43.852
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGhq0f+001044
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHhq0f+001044
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAhq0f+001044
  03:50:16 STEP 1045 H=1045:00 +CPU= 25.594
  03:50:43 STEP 1046 H=1046:00 +CPU= 27.639
  03:51:25 STEP 1047 H=1047:00 +CPU= 41.738
  03:51:53 STEP 1048 H=1048:00 +CPU= 28.041
  03:52:21 STEP 1049 H=1049:00 +CPU= 27.562
  03:53:04 STEP 1050 H=1050:00 +CPU= 43.243
  03:53:32 STEP 1051 H=1051:00 +CPU= 27.452
  03:54:00 STEP 1052 H=1052:00 +CPU= 28.423
  03:54:40 STEP 1053 H=1053:00 +CPU= 40.180
  03:55:07 STEP 1054 H=1054:00 +CPU= 26.692
  03:55:34 STEP 1055 H=1055:00 +CPU= 26.491
  03:56:33 STEP 1056 H=1056:00 +CPU= 49.006
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGhq0f+001056
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHhq0f+001056
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAhq0f+001056
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185193/ICMGGhq0f+001032
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185193/ICMSHhq0f+001032
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185193/ICMUAhq0f+001032
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185193/ICMGGhq0f+001044
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185193/ICMSHhq0f+001044
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185193/ICMUAhq0f+001044
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0549_1999050100_123_968_12185193_1_r210634063_43.zip
Uploading the intermediate file: upload_file_43.zip
  03:56:59 STEP 1057 H=1057:00 +CPU= 25.221
  03:57:25 STEP 1058 H=1058:00 +CPU= 25.992
  03:58:11 STEP 1059 H=1059:00 +CPU= 39.861
  03:58:39 STEP 1060 H=1060:00 +CPU= 26.682
  03:59:04 STEP 1061 H=1061:00 +CPU= 25.414
  03:59:46 STEP 1062 H=1062:00 +CPU= 41.254
  04:00:12 STEP 1063 H=1063:00 +CPU= 25.811
  04:00:38 STEP 1064 H=1064:00 +CPU= 26.815
  04:01:19 STEP 1065 H=1065:00 +CPU= 40.508
  04:01:46 STEP 1066 H=1066:00 +CPU= 27.069
  04:02:12 STEP 1067 H=1067:00 +CPU= 26.043
  04:02:57 STEP 1068 H=1068:00 +CPU= 44.961
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGhq0f+001068
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHhq0f+001068
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAhq0f+001068
  04:03:26 STEP 1069 H=1069:00 +CPU= 25.882
  04:03:53 STEP 1070 H=1070:00 +CPU= 26.375
  04:04:33 STEP 1071 H=1071:00 +CPU= 39.946
  04:04:59 STEP 1072 H=1072:00 +CPU= 26.449
  04:05:24 STEP 1073 H=1073:00 +CPU= 25.400
  04:06:06 STEP 1074 H=1074:00 +CPU= 41.114
  04:06:31 STEP 1075 H=1075:00 +CPU= 25.800
  04:06:58 STEP 1076 H=1076:00 +CPU= 26.573
  04:07:38 STEP 1077 H=1077:00 +CPU= 40.099
  04:08:05 STEP 1078 H=1078:00 +CPU= 26.675
  04:08:31 STEP 1079 H=1079:00 +CPU= 26.370
  04:09:23 STEP 1080 H=1080:00 +CPU= 45.506
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGhq0f+001080
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHhq0f+001080
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAhq0f+001080
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185193/ICMGGhq0f+001056
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185193/ICMSHhq0f+001056
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185193/ICMUAhq0f+001056
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185193/ICMGGhq0f+001068
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185193/ICMSHhq0f+001068
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185193/ICMUAhq0f+001068
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0549_1999050100_123_968_12185193_1_r210634063_44.zip
Uploading the intermediate file: upload_file_44.zip
  04:09:48 STEP 1081 H=1081:00 +CPU= 25.487
  04:10:14 STEP 1082 H=1082:00 +CPU= 25.762
  04:10:53 STEP 1083 H=1083:00 +CPU= 38.843
  04:11:19 STEP 1084 H=1084:00 +CPU= 25.756
  04:11:44 STEP 1085 H=1085:00 +CPU= 24.916
  04:12:24 STEP 1086 H=1086:00 +CPU= 40.362
  04:12:56 STEP 1087 H=1087:00 +CPU= 25.826
  04:13:23 STEP 1088 H=1088:00 +CPU= 26.261
  04:14:07 STEP 1089 H=1089:00 +CPU= 40.042
  04:14:34 STEP 1090 H=1090:00 +CPU= 26.488
  04:14:59 STEP 1091 H=1091:00 +CPU= 25.447
  04:15:44 STEP 1092 H=1092:00 +CPU= 44.279
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGhq0f+001092
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHhq0f+001092
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAhq0f+001092
  04:16:10 STEP 1093 H=1093:00 +CPU= 25.535
  04:16:36 STEP 1094 H=1094:00 +CPU= 26.247
  04:17:16 STEP 1095 H=1095:00 +CPU= 39.763
  04:17:42 STEP 1096 H=1096:00 +CPU= 26.336
  04:18:07 STEP 1097 H=1097:00 +CPU= 25.180
  04:18:48 STEP 1098 H=1098:00 +CPU= 40.526
  04:19:13 STEP 1099 H=1099:00 +CPU= 25.423
  04:19:39 STEP 1100 H=1100:00 +CPU= 26.052
  04:20:19 STEP 1101 H=1101:00 +CPU= 39.580
  04:20:45 STEP 1102 H=1102:00 +CPU= 26.315
  04:21:11 STEP 1103 H=1103:00 +CPU= 25.972
  04:22:02 STEP 1104 H=1104:00 +CPU= 46.235
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGhq0f+001104
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHhq0f+001104
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAhq0f+001104
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185193/ICMGGhq0f+001080
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185193/ICMSHhq0f+001080
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185193/ICMUAhq0f+001080
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185193/ICMGGhq0f+001092
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185193/ICMSHhq0f+001092
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185193/ICMUAhq0f+001092
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0549_1999050100_123_968_12185193_1_r210634063_45.zip
Uploading the intermediate file: upload_file_45.zip
  04:22:27 STEP 1105 H=1105:00 +CPU= 25.368
  04:22:54 STEP 1106 H=1106:00 +CPU= 26.340
  04:23:33 STEP 1107 H=1107:00 +CPU= 39.492
  04:23:59 STEP 1108 H=1108:00 +CPU= 25.826
  04:24:24 STEP 1109 H=1109:00 +CPU= 25.169
  04:25:05 STEP 1110 H=1110:00 +CPU= 40.447
  04:25:31 STEP 1111 H=1111:00 +CPU= 25.357
  04:25:57 STEP 1112 H=1112:00 +CPU= 26.079
  04:26:36 STEP 1113 H=1113:00 +CPU= 39.624
  04:27:03 STEP 1114 H=1114:00 +CPU= 26.327
  04:27:26 STEP 1115 H=1115:00 +CPU= 23.532
  04:28:13 STEP 1116 H=1116:00 +CPU= 43.875
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGhq0f+001116
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHhq0f+001116
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAhq0f+001116
  04:28:41 STEP 1117 H=1117:00 +CPU= 25.481
  04:29:07 STEP 1118 H=1118:00 +CPU= 26.063
  04:29:47 STEP 1119 H=1119:00 +CPU= 39.889
  04:30:14 STEP 1120 H=1120:00 +CPU= 26.150
  04:30:39 STEP 1121 H=1121:00 +CPU= 25.006
  04:31:19 STEP 1122 H=1122:00 +CPU= 40.258
  04:31:44 STEP 1123 H=1123:00 +CPU= 25.074
  04:32:10 STEP 1124 H=1124:00 +CPU= 25.964
  04:32:50 STEP 1125 H=1125:00 +CPU= 39.818
  04:33:17 STEP 1126 H=1126:00 +CPU= 26.383
  04:33:43 STEP 1127 H=1127:00 +CPU= 26.170
  04:34:38 STEP 1128 H=1128:00 +CPU= 46.616
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGhq0f+001128
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHhq0f+001128
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAhq0f+001128
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185193/ICMGGhq0f+001104
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185193/ICMSHhq0f+001104
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185193/ICMUAhq0f+001104
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185193/ICMGGhq0f+001116
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185193/ICMSHhq0f+001116
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185193/ICMUAhq0f+001116
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0549_1999050100_123_968_12185193_1_r210634063_46.zip
Uploading the intermediate file: upload_file_46.zip
Uploading trickle at timestep: 4060800
  04:35:03 STEP 1129 H=1129:00 +CPU= 25.139
  04:35:29 STEP 1130 H=1130:00 +CPU= 25.834
  04:36:08 STEP 1131 H=1131:00 +CPU= 39.134
  04:36:34 STEP 1132 H=1132:00 +CPU= 25.727
  04:36:59 STEP 1133 H=1133:00 +CPU= 25.260
  04:37:42 STEP 1134 H=1134:00 +CPU= 40.326
  04:38:07 STEP 1135 H=1135:00 +CPU= 25.103
  04:38:33 STEP 1136 H=1136:00 +CPU= 25.804
  04:39:12 STEP 1137 H=1137:00 +CPU= 39.372
  04:39:39 STEP 1138 H=1138:00 +CPU= 26.131
  04:40:04 STEP 1139 H=1139:00 +CPU= 25.074
  04:40:49 STEP 1140 H=1140:00 +CPU= 43.949
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGhq0f+001140
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHhq0f+001140
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAhq0f+001140
  04:41:14 STEP 1141 H=1141:00 +CPU= 25.265
  04:41:40 STEP 1142 H=1142:00 +CPU= 25.949
  04:42:19 STEP 1143 H=1143:00 +CPU= 39.312
  04:42:46 STEP 1144 H=1144:00 +CPU= 26.165
  04:43:11 STEP 1145 H=1145:00 +CPU= 24.897
  04:43:51 STEP 1146 H=1146:00 +CPU= 40.070
  04:44:16 STEP 1147 H=1147:00 +CPU= 24.965
  04:44:42 STEP 1148 H=1148:00 +CPU= 25.834
  04:45:21 STEP 1149 H=1149:00 +CPU= 39.094
  04:45:47 STEP 1150 H=1150:00 +CPU= 26.003
  04:46:13 STEP 1151 H=1151:00 +CPU= 25.786
  04:47:04 STEP 1152 H=1152:00 +CPU= 46.045
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGhq0f+001152
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHhq0f+001152
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAhq0f+001152
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185193/ICMGGhq0f+001128
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185193/ICMSHhq0f+001128
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185193/ICMUAhq0f+001128
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185193/ICMGGhq0f+001140
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185193/ICMSHhq0f+001140
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185193/ICMUAhq0f+001140
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0549_1999050100_123_968_12185193_1_r210634063_47.zip
Uploading the intermediate file: upload_file_47.zip
  04:47:29 STEP 1153 H=1153:00 +CPU= 24.984
  04:47:55 STEP 1154 H=1154:00 +CPU= 25.963
  04:48:35 STEP 1155 H=1155:00 +CPU= 39.546
  04:49:00 STEP 1156 H=1156:00 +CPU= 25.788
  04:49:28 STEP 1157 H=1157:00 +CPU= 25.288
  04:50:09 STEP 1158 H=1158:00 +CPU= 40.723
  04:50:34 STEP 1159 H=1159:00 +CPU= 25.401
  04:51:00 STEP 1160 H=1160:00 +CPU= 26.169
  04:51:40 STEP 1161 H=1161:00 +CPU= 39.625
  04:52:06 STEP 1162 H=1162:00 +CPU= 26.349
  04:52:32 STEP 1163 H=1163:00 +CPU= 25.310
  04:53:18 STEP 1164 H=1164:00 +CPU= 43.635
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGhq0f+001164
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHhq0f+001164
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAhq0f+001164
  04:53:46 STEP 1165 H=1165:00 +CPU= 25.682
  04:54:12 STEP 1166 H=1166:00 +CPU= 25.666
  04:54:51 STEP 1167 H=1167:00 +CPU= 39.131
  04:55:17 STEP 1168 H=1168:00 +CPU= 25.989
  04:55:42 STEP 1169 H=1169:00 +CPU= 25.026
  04:56:22 STEP 1170 H=1170:00 +CPU= 40.021
  04:56:47 STEP 1171 H=1171:00 +CPU= 25.165
  04:57:13 STEP 1172 H=1172:00 +CPU= 25.898
  04:57:52 STEP 1173 H=1173:00 +CPU= 38.917
  04:58:18 STEP 1174 H=1174:00 +CPU= 25.938
  04:58:44 STEP 1175 H=1175:00 +CPU= 25.807
  04:59:35 STEP 1176 H=1176:00 +CPU= 45.810
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGhq0f+001176
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHhq0f+001176
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAhq0f+001176
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185193/ICMGGhq0f+001152
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185193/ICMSHhq0f+001152
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185193/ICMUAhq0f+001152
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185193/ICMGGhq0f+001164
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185193/ICMSHhq0f+001164
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185193/ICMUAhq0f+001164
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0549_1999050100_123_968_12185193_1_r210634063_48.zip
Uploading the intermediate file: upload_file_48.zip
  05:00:00 STEP 1177 H=1177:00 +CPU= 25.543
  05:00:26 STEP 1178 H=1178:00 +CPU= 25.886
  05:01:05 STEP 1179 H=1179:00 +CPU= 39.223
  05:01:32 STEP 1180 H=1180:00 +CPU= 25.976
  05:01:57 STEP 1181 H=1181:00 +CPU= 24.782
  05:02:37 STEP 1182 H=1182:00 +CPU= 39.951
  05:03:02 STEP 1183 H=1183:00 +CPU= 25.142
  05:03:28 STEP 1184 H=1184:00 +CPU= 26.219
  05:04:07 STEP 1185 H=1185:00 +CPU= 39.019
  05:04:33 STEP 1186 H=1186:00 +CPU= 25.876
  05:04:58 STEP 1187 H=1187:00 +CPU= 25.354
  05:05:42 STEP 1188 H=1188:00 +CPU= 43.938
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGhq0f+001188
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHhq0f+001188
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAhq0f+001188
  05:06:08 STEP 1189 H=1189:00 +CPU= 25.310
  05:06:34 STEP 1190 H=1190:00 +CPU= 26.044
  05:07:13 STEP 1191 H=1191:00 +CPU= 39.191
  05:07:39 STEP 1192 H=1192:00 +CPU= 26.201
  05:08:05 STEP 1193 H=1193:00 +CPU= 25.236
  05:08:45 STEP 1194 H=1194:00 +CPU= 40.235
  05:09:10 STEP 1195 H=1195:00 +CPU= 25.297
  05:09:34 STEP 1196 H=1196:00 +CPU= 23.397
  05:10:12 STEP 1197 H=1197:00 +CPU= 38.615
  05:10:38 STEP 1198 H=1198:00 +CPU= 25.913
  05:11:04 STEP 1199 H=1199:00 +CPU= 25.962
  05:11:54 STEP 1200 H=1200:00 +CPU= 45.739
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGhq0f+001200
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHhq0f+001200
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAhq0f+001200
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185193/ICMGGhq0f+001176
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185193/ICMSHhq0f+001176
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185193/ICMUAhq0f+001176
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185193/ICMGGhq0f+001188
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185193/ICMSHhq0f+001188
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185193/ICMUAhq0f+001188
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0549_1999050100_123_968_12185193_1_r210634063_49.zip
Uploading the intermediate file: upload_file_49.zip
  05:12:20 STEP 1201 H=1201:00 +CPU= 25.423
  05:12:46 STEP 1202 H=1202:00 +CPU= 26.212
  05:13:29 STEP 1203 H=1203:00 +CPU= 39.745
  05:13:55 STEP 1204 H=1204:00 +CPU= 26.393
  05:14:20 STEP 1205 H=1205:00 +CPU= 25.105
  05:15:00 STEP 1206 H=1206:00 +CPU= 39.862
  05:15:26 STEP 1207 H=1207:00 +CPU= 25.378
  05:15:52 STEP 1208 H=1208:00 +CPU= 26.342
  05:16:30 STEP 1209 H=1209:00 +CPU= 37.899
  05:16:54 STEP 1210 H=1210:00 +CPU= 23.682
  05:17:19 STEP 1211 H=1211:00 +CPU= 25.258
  05:18:03 STEP 1212 H=1212:00 +CPU= 44.112
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGhq0f+001212
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHhq0f+001212
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAhq0f+001212
  05:18:29 STEP 1213 H=1213:00 +CPU= 25.587
  05:18:55 STEP 1214 H=1214:00 +CPU= 26.557
  05:19:35 STEP 1215 H=1215:00 +CPU= 39.864
  05:20:02 STEP 1216 H=1216:00 +CPU= 26.571
  05:20:28 STEP 1217 H=1217:00 +CPU= 25.714
  05:21:09 STEP 1218 H=1218:00 +CPU= 41.142
  05:21:34 STEP 1219 H=1219:00 +CPU= 25.248
  05:22:00 STEP 1220 H=1220:00 +CPU= 26.287
  05:22:40 STEP 1221 H=1221:00 +CPU= 39.693
  05:23:07 STEP 1222 H=1222:00 +CPU= 26.377
  05:23:33 STEP 1223 H=1223:00 +CPU= 26.344
  05:24:23 STEP 1224 H=1224:00 +CPU= 46.824
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGhq0f+001224
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHhq0f+001224
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAhq0f+001224
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185193/ICMGGhq0f+001200
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185193/ICMSHhq0f+001200
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185193/ICMUAhq0f+001200
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185193/ICMGGhq0f+001212
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185193/ICMSHhq0f+001212
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185193/ICMUAhq0f+001212
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0549_1999050100_123_968_12185193_1_r210634063_50.zip
Uploading the intermediate file: upload_file_50.zip
  05:24:49 STEP 1225 H=1225:00 +CPU= 25.414
  05:25:15 STEP 1226 H=1226:00 +CPU= 26.450
  05:25:55 STEP 1227 H=1227:00 +CPU= 39.579
  05:26:22 STEP 1228 H=1228:00 +CPU= 26.646
  05:26:46 STEP 1229 H=1229:00 +CPU= 24.340
  05:27:26 STEP 1230 H=1230:00 +CPU= 39.413
  05:27:51 STEP 1231 H=1231:00 +CPU= 24.887
  05:28:17 STEP 1232 H=1232:00 +CPU= 25.903
  05:28:57 STEP 1233 H=1233:00 +CPU= 39.705
  05:29:23 STEP 1234 H=1234:00 +CPU= 26.608
  05:29:49 STEP 1235 H=1235:00 +CPU= 25.719
  05:30:33 STEP 1236 H=1236:00 +CPU= 44.189
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGhq0f+001236
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHhq0f+001236
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAhq0f+001236
  05:30:59 STEP 1237 H=1237:00 +CPU= 25.740
  05:31:26 STEP 1238 H=1238:00 +CPU= 26.675
  05:32:03 STEP 1239 H=1239:00 +CPU= 36.888
  05:32:26 STEP 1240 H=1240:00 +CPU= 23.122
  05:32:51 STEP 1241 H=1241:00 +CPU= 25.525
  05:33:32 STEP 1242 H=1242:00 +CPU= 40.531
  05:33:57 STEP 1243 H=1243:00 +CPU= 25.378
  05:34:23 STEP 1244 H=1244:00 +CPU= 26.213
  05:35:04 STEP 1245 H=1245:00 +CPU= 40.157
  05:35:29 STEP 1246 H=1246:00 +CPU= 25.763
  05:35:55 STEP 1247 H=1247:00 +CPU= 26.085
  05:36:42 STEP 1248 H=1248:00 +CPU= 42.084
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGhq0f+001248
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHhq0f+001248
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAhq0f+001248
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185193/ICMGGhq0f+001224
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185193/ICMSHhq0f+001224
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185193/ICMUAhq0f+001224
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185193/ICMGGhq0f+001236
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185193/ICMSHhq0f+001236
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185193/ICMUAhq0f+001236
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0549_1999050100_123_968_12185193_1_r210634063_51.zip
Uploading the intermediate file: upload_file_51.zip
  05:37:06 STEP 1249 H=1249:00 +CPU= 24.301
  05:37:33 STEP 1250 H=1250:00 +CPU= 26.245
  05:38:12 STEP 1251 H=1251:00 +CPU= 39.576
  05:38:37 STEP 1252 H=1252:00 +CPU= 24.696
  05:39:00 STEP 1253 H=1253:00 +CPU= 21.744
  05:39:49 STEP 1254 H=1254:00 +CPU= 41.366
  05:40:20 STEP 1255 H=1255:00 +CPU= 26.108
  05:40:48 STEP 1256 H=1256:00 +CPU= 26.712
  05:41:28 STEP 1257 H=1257:00 +CPU= 40.666
  05:41:56 STEP 1258 H=1258:00 +CPU= 27.568
  05:42:23 STEP 1259 H=1259:00 +CPU= 27.050
  05:43:09 STEP 1260 H=1260:00 +CPU= 46.285
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGhq0f+001260
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHhq0f+001260
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAhq0f+001260
  05:43:36 STEP 1261 H=1261:00 +CPU= 26.956
  05:44:04 STEP 1262 H=1262:00 +CPU= 27.961
  05:44:46 STEP 1263 H=1263:00 +CPU= 41.655
  05:45:13 STEP 1264 H=1264:00 +CPU= 27.163
  05:45:39 STEP 1265 H=1265:00 +CPU= 25.318
  05:46:19 STEP 1266 H=1266:00 +CPU= 40.552
  05:46:46 STEP 1267 H=1267:00 +CPU= 26.518
  05:47:09 STEP 1268 H=1268:00 +CPU= 22.827
  05:47:49 STEP 1269 H=1269:00 +CPU= 39.219
  05:48:15 STEP 1270 H=1270:00 +CPU= 26.387
  05:48:42 STEP 1271 H=1271:00 +CPU= 26.516
  05:49:38 STEP 1272 H=1272:00 +CPU= 47.486
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGhq0f+001272
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHhq0f+001272
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAhq0f+001272
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185193/ICMGGhq0f+001248
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185193/ICMSHhq0f+001248
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185193/ICMUAhq0f+001248
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185193/ICMGGhq0f+001260
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185193/ICMSHhq0f+001260
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185193/ICMUAhq0f+001260
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0549_1999050100_123_968_12185193_1_r210634063_52.zip
Uploading the intermediate file: upload_file_52.zip
  05:50:04 STEP 1273 H=1273:00 +CPU= 26.596
  05:50:32 STEP 1274 H=1274:00 +CPU= 27.508
  05:51:13 STEP 1275 H=1275:00 +CPU= 40.493
  05:51:39 STEP 1276 H=1276:00 +CPU= 26.131
  05:52:01 STEP 1277 H=1277:00 +CPU= 22.658
  05:52:42 STEP 1278 H=1278:00 +CPU= 40.319
  05:53:07 STEP 1279 H=1279:00 +CPU= 25.321
  05:53:33 STEP 1280 H=1280:00 +CPU= 26.239
  05:54:13 STEP 1281 H=1281:00 +CPU= 39.424
  05:54:39 STEP 1282 H=1282:00 +CPU= 26.126
  05:55:04 STEP 1283 H=1283:00 +CPU= 25.259
  05:55:48 STEP 1284 H=1284:00 +CPU= 43.883
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGhq0f+001284
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHhq0f+001284
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAhq0f+001284
  05:56:14 STEP 1285 H=1285:00 +CPU= 25.618
  05:56:40 STEP 1286 H=1286:00 +CPU= 26.221
  05:57:19 STEP 1287 H=1287:00 +CPU= 39.165
  05:57:46 STEP 1288 H=1288:00 +CPU= 26.181
 SMILAG TRAJECTORY UNDERGROUND      1 TIMES.
  POINT=           18  MAX ETADOT VERTICAL VEL.=   2.880043482232772E-008
  LON  =    137.812500000000       degrees
  LAT  =   -42.0558239509352       degrees
  05:58:11 STEP 1289 H=1289:00 +CPU= 25.285
  05:58:51 STEP 1290 H=1290:00 +CPU= 40.192
 SMILAG TRAJECTORY UNDERGROUND      1 TIMES.
  POINT=           19  MAX ETADOT VERTICAL VEL.=   4.357564016728397E-008
  LON  =    136.406250000000       degrees
  LAT  =   -43.1773092288349       degrees
  05:59:17 STEP 1291 H=1291:00 +CPU= 25.094
  05:59:42 STEP 1292 H=1292:00 +CPU= 25.816
  06:00:21 STEP 1293 H=1293:00 +CPU= 39.083
  06:00:47 STEP 1294 H=1294:00 +CPU= 25.752
  06:01:13 STEP 1295 H=1295:00 +CPU= 25.722
  06:02:02 STEP 1296 H=1296:00 +CPU= 45.787
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGhq0f+001296
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHhq0f+001296
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAhq0f+001296
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185193/ICMGGhq0f+001272
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185193/ICMSHhq0f+001272
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185193/ICMUAhq0f+001272
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185193/ICMGGhq0f+001284
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185193/ICMSHhq0f+001284
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185193/ICMUAhq0f+001284
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0549_1999050100_123_968_12185193_1_r210634063_53.zip
Uploading the intermediate file: upload_file_53.zip
  06:02:27 STEP 1297 H=1297:00 +CPU= 25.029
  06:02:53 STEP 1298 H=1298:00 +CPU= 25.995
  06:03:32 STEP 1299 H=1299:00 +CPU= 39.078
  06:03:58 STEP 1300 H=1300:00 +CPU= 26.115
  06:04:24 STEP 1301 H=1301:00 +CPU= 25.223
  06:05:04 STEP 1302 H=1302:00 +CPU= 40.374
  06:05:30 STEP 1303 H=1303:00 +CPU= 25.522
  06:05:56 STEP 1304 H=1304:00 +CPU= 26.417
  06:06:35 STEP 1305 H=1305:00 +CPU= 39.136
  06:07:01 STEP 1306 H=1306:00 +CPU= 25.866
  06:07:26 STEP 1307 H=1307:00 +CPU= 25.008
  06:08:09 STEP 1308 H=1308:00 +CPU= 43.177
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGhq0f+001308
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHhq0f+001308
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAhq0f+001308
  06:08:35 STEP 1309 H=1309:00 +CPU= 25.173
  06:09:01 STEP 1310 H=1310:00 +CPU= 25.972
  06:09:39 STEP 1311 H=1311:00 +CPU= 38.681
  06:10:05 STEP 1312 H=1312:00 +CPU= 25.918
  06:10:30 STEP 1313 H=1313:00 +CPU= 24.955
  06:11:17 STEP 1314 H=1314:00 +CPU= 40.582
  06:11:43 STEP 1315 H=1315:00 +CPU= 25.653
  06:12:10 STEP 1316 H=1316:00 +CPU= 26.490
  06:12:49 STEP 1317 H=1317:00 +CPU= 39.680
  06:13:16 STEP 1318 H=1318:00 +CPU= 26.501
  06:13:42 STEP 1319 H=1319:00 +CPU= 26.514
  06:14:35 STEP 1320 H=1320:00 +CPU= 48.164
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGhq0f+001320
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHhq0f+001320
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAhq0f+001320
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185193/ICMGGhq0f+001296
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185193/ICMSHhq0f+001296
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185193/ICMUAhq0f+001296
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185193/ICMGGhq0f+001308
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185193/ICMSHhq0f+001308
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185193/ICMUAhq0f+001308
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0549_1999050100_123_968_12185193_1_r210634063_54.zip
Uploading the intermediate file: upload_file_54.zip
  06:15:01 STEP 1321 H=1321:00 +CPU= 26.442
  06:15:28 STEP 1322 H=1322:00 +CPU= 26.380
  06:16:05 STEP 1323 H=1323:00 +CPU= 36.991
  06:16:29 STEP 1324 H=1324:00 +CPU= 24.364
  06:16:54 STEP 1325 H=1325:00 +CPU= 25.171
  06:17:35 STEP 1326 H=1326:00 +CPU= 40.602
  06:18:10 STEP 1327 H=1327:00 +CPU= 26.426
  06:18:39 STEP 1328 H=1328:00 +CPU= 26.417
  06:19:20 STEP 1329 H=1329:00 +CPU= 39.598
  06:19:46 STEP 1330 H=1330:00 +CPU= 25.950
  06:20:12 STEP 1331 H=1331:00 +CPU= 25.280
  06:20:56 STEP 1332 H=1332:00 +CPU= 43.703
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGhq0f+001332
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHhq0f+001332
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAhq0f+001332
  06:21:21 STEP 1333 H=1333:00 +CPU= 25.314
  06:21:47 STEP 1334 H=1334:00 +CPU= 26.044
  06:22:26 STEP 1335 H=1335:00 +CPU= 39.042
  06:22:53 STEP 1336 H=1336:00 +CPU= 26.013
  06:23:18 STEP 1337 H=1337:00 +CPU= 25.116
  06:23:58 STEP 1338 H=1338:00 +CPU= 40.066
  06:24:23 STEP 1339 H=1339:00 +CPU= 25.097
  06:24:49 STEP 1340 H=1340:00 +CPU= 25.912
  06:25:28 STEP 1341 H=1341:00 +CPU= 39.069
  06:25:54 STEP 1342 H=1342:00 +CPU= 26.134
  06:26:20 STEP 1343 H=1343:00 +CPU= 26.083
  06:27:15 STEP 1344 H=1344:00 +CPU= 46.047
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGhq0f+001344
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHhq0f+001344
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAhq0f+001344
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185193/ICMGGhq0f+001320
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185193/ICMSHhq0f+001320
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185193/ICMUAhq0f+001320
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185193/ICMGGhq0f+001332
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185193/ICMSHhq0f+001332
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185193/ICMUAhq0f+001332
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0549_1999050100_123_968_12185193_1_r210634063_55.zip
Uploading the intermediate file: upload_file_55.zip
  06:27:40 STEP 1345 H=1345:00 +CPU= 25.071
  06:28:06 STEP 1346 H=1346:00 +CPU= 25.830
  06:28:45 STEP 1347 H=1347:00 +CPU= 38.983
  06:29:11 STEP 1348 H=1348:00 +CPU= 25.917
  06:29:36 STEP 1349 H=1349:00 +CPU= 24.866
  06:30:16 STEP 1350 H=1350:00 +CPU= 39.986
  06:30:41 STEP 1351 H=1351:00 +CPU= 25.223
  06:31:07 STEP 1352 H=1352:00 +CPU= 26.093
  06:31:46 STEP 1353 H=1353:00 +CPU= 39.155
  06:32:13 STEP 1354 H=1354:00 +CPU= 26.154
  06:32:38 STEP 1355 H=1355:00 +CPU= 25.282
  06:33:22 STEP 1356 H=1356:00 +CPU= 43.580
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGhq0f+001356
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHhq0f+001356
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAhq0f+001356
  06:33:47 STEP 1357 H=1357:00 +CPU= 25.228
  06:34:13 STEP 1358 H=1358:00 +CPU= 26.116
  06:34:52 STEP 1359 H=1359:00 +CPU= 39.158
  06:35:18 STEP 1360 H=1360:00 +CPU= 26.073
  06:35:43 STEP 1361 H=1361:00 +CPU= 25.162
  06:36:24 STEP 1362 H=1362:00 +CPU= 40.236
  06:36:49 STEP 1363 H=1363:00 +CPU= 25.150
  06:37:15 STEP 1364 H=1364:00 +CPU= 25.954
  06:37:54 STEP 1365 H=1365:00 +CPU= 39.080
  06:38:20 STEP 1366 H=1366:00 +CPU= 25.907
  06:38:45 STEP 1367 H=1367:00 +CPU= 25.844
  06:39:35 STEP 1368 H=1368:00 +CPU= 45.584
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGhq0f+001368
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHhq0f+001368
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAhq0f+001368
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185193/ICMGGhq0f+001344
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185193/ICMSHhq0f+001344
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185193/ICMUAhq0f+001344
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185193/ICMGGhq0f+001356
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185193/ICMSHhq0f+001356
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185193/ICMUAhq0f+001356
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0549_1999050100_123_968_12185193_1_r210634063_56.zip
Uploading the intermediate file: upload_file_56.zip
  06:40:00 STEP 1369 H=1369:00 +CPU= 25.043
Uploading trickle at timestep: 4924800
  06:40:26 STEP 1370 H=1370:00 +CPU= 25.896
  06:41:05 STEP 1371 H=1371:00 +CPU= 39.116
  06:41:31 STEP 1372 H=1372:00 +CPU= 25.865
  06:41:55 STEP 1373 H=1373:00 +CPU= 24.590
  06:42:35 STEP 1374 H=1374:00 +CPU= 39.872
  06:43:00 STEP 1375 H=1375:00 +CPU= 25.159
  06:43:27 STEP 1376 H=1376:00 +CPU= 26.741
  06:44:09 STEP 1377 H=1377:00 +CPU= 41.334
Quit request received from BOINC client, ending the child process
(argv0) ../../projects/climateprediction.net/oifs_43r3_ps_1.05_x86_64-pc-linux-gnu
(argv1) start_date: 1999050100
(argv2) exptid: hq0f
(argv3) unique_member_id: 0549
(argv4) batchid: 968
(argv5) wuid: 12185193
(argv6) fclen: 123
(argv7) app_name: oifs_43r3_ps
(argv8) nthreads: 1
Working directory is: /var/lib/boinc-client/slots/8
Project directory is: /var/lib/boinc-client/projects/climateprediction.net/
app name: oifs_43r3_ps
version: 1.05
Location of temp folder: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185193
..mkdir for temp folder for results failed
Copying: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip to: /var/lib/boinc-client/slots/8/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Unzipping the app zip file: /var/lib/boinc-client/slots/8/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Copying the namelist files from: ../../projects/climateprediction.net/jf_6dbca0164bd41a9555cf6c3d08eb29b1 to: /var/lib/boinc-client/slots/8/oifs_43r3_ps_0549_1999050100_123_968_12185193.zip
Unzipping the namelist zip file: /var/lib/boinc-client/slots/8/oifs_43r3_ps_0549_1999050100_123_968_12185193.zip
ic_ancil_file: ic_ancil_12185193
ifsdata_file: ifsdata_12185193
climate_data_file: clim_data_12185193
horiz_resolution: 159
vert_resolution: 60
grid_type: l_2
upload_interval: 24
utstep: 3600
nfrres: restart dump frequency (steps) 24
Copying IC ancils from: ../../projects/climateprediction.net/jf_5ab6cf010ea0c10c4c6a2c2c2419decd to: /var/lib/boinc-client/slots/8/ic_ancil_12185193.zip
Unzipping the IC ancils zip file: /var/lib/boinc-client/slots/8/ic_ancil_12185193.zip
..mkdir for ifsdata folder failed
Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_5758d9f6a498a43ee6baa2172cb7b038 to: /var/lib/boinc-client/slots/8/ifsdata/ifsdata_12185193.zip
Unzipping the ifsdata_zip file: /var/lib/boinc-client/slots/8/ifsdata/ifsdata_12185193.zip
..mkdir for the climate data folder failed
Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /var/lib/boinc-client/slots/8/159l_2/clim_data_12185193.zip
Unzipping the climate data zip file: /var/lib/boinc-client/slots/8/159l_2/clim_data_12185193.zip
Checking for progress XML file: /var/lib/boinc-client/slots/8/progress_file_12185193.xml
Opened progress file ok : /var/lib/boinc-client/slots/8/progress_file_12185193.xml
-- Model is restarting --
Adjusting last_iter, 1378, to previous model restart step.
Creating progress file: /var/lib/boinc-client/slots/8/progress_file_12185193.xml
last_cpu_time: 43750
upload_file_number: 57
last_iter: 1367
last_upload: 4924800
model_completed: 0
total_length_of_simulation: 10627200
result_base_name: oifs_43r3_ps_0549_1999050100_123_968_12185193_1_r210634063
The child process has been launched with process id: 31729
Executing the command: /var/lib/boinc-client/slots/8/oifs_43r3_model.exe
[EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1
[EC_DRHOOK:ken-Z230-2:1:1:31729:31729] [20230126:064538:1674744338:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2091] fp = 0x3129fe0
[EC_DRHOOK:ken-Z230-2:1:1:31729:31729] [20230126:064538:1674744338:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1
[EC_DRHOOK:ken-Z230-2:1:1:31729:31729] [20230126:064538:1674744338:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0)
[EC_DRHOOK:ken-Z230-2:1:1:31729:31729] [20230126:064538:1674744338:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1
[EC_DRHOOK:ken-Z230-2:1:1:31729:31729] [20230126:064538:1674744338:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000
[EC_DRHOOK:ken-Z230-2:1:1:31729:31729] [20230126:064538:1674744338:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0  (RAND_MAX=2147483647)
[EC_DRHOOK:ken-Z230-2:1:1:31729:31729] [20230126:064538:1674744338:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16
[EC_DRHOOK:ken-Z230-2:1:1:31729:31729] [20230126:064538:1674744338:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0
[EC_DRHOOK:ken-Z230-2:1:1:31729:31729] [20230126:064538:1674744338:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500
[EC_DRHOOK:ken-Z230-2:1:1:31729:31729] [20230126:064538:1674744338:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1
[EC_DRHOOK:ken-Z230-2:1:1:31729:31729] [20230126:064538:1674744338:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1
[EC_DRHOOK:ken-Z230-2:1:1:31729:31729] [20230126:064538:1674744338:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1
[EC_DRHOOK:ken-Z230-2:1:1:31729:31729] [20230126:064538:1674744338:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1
[EC_DRHOOK:ken-Z230-2:1:1:31729:31729] [20230126:064538:1674744338:0.000] [ignore_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef>
[EC_DRHOOK:ken-Z230-2:1:1:31729:31729] [20230126:064538:1674744338:0.000] [restore_default_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef>
[EC_DRHOOK:ken-Z230-2:1:1:31729:31729] [20230126:064538:1674744338:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:ken-Z230-2:1:1:31729:31729] [20230126:064538:1674744338:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x81f820 (old at (nil))
[EC_DRHOOK:ken-Z230-2:1:1:31729:31729] [20230126:064538:1674744338:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:ken-Z230-2:1:1:31729:31729] [20230126:064538:1674744338:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x81f820 (old at (nil))
[EC_DRHOOK:ken-Z230-2:1:1:31729:31729] [20230126:064538:1674744338:0.000] [trapfpe_treatment@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:ken-Z230-2:1:1:31729:31729] [20230126:064538:1674744338:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:ken-Z230-2:1:1:31729:31729] [20230126:064538:1674744338:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:ken-Z230-2:1:1:31729:31729] [20230126:064538:1674744338:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x81f820 (old at (nil))
[EC_DRHOOK:ken-Z230-2:1:1:31729:31729] [20230126:064538:1674744338:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:ken-Z230-2:1:1:31729:31729] [20230126:064538:1674744338:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:ken-Z230-2:1:1:31729:31729] [20230126:064538:1674744338:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:ken-Z230-2:1:1:31729:31729] [20230126:064538:1674744338:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x81f820 (old at (nil))
[EC_DRHOOK:ken-Z230-2:1:1:31729:31729] [20230126:064538:1674744338:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x81f820 (old at (nil))
[EC_DRHOOK:ken-Z230-2:1:1:31729:31729] [20230126:064538:1674744338:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x81f820 (old at (nil))
[EC_DRHOOK:ken-Z230-2:1:1:31729:31729] [20230126:064538:1674744338:0.000] [catch_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
  06:46:38 STEP 1368 H=1368:00 +CPU= 52.211
  06:47:13 STEP 1369 H=1369:00 +CPU= 31.972
  06:47:47 STEP 1370 H=1370:00 +CPU= 33.219
  06:48:31 STEP 1371 H=1371:00 +CPU= 44.050
  06:49:07 STEP 1372 H=1372:00 +CPU= 35.549
  06:49:40 STEP 1373 H=1373:00 +CPU= 32.851
  06:50:33 STEP 1374 H=1374:00 +CPU= 52.919
  06:51:06 STEP 1375 H=1375:00 +CPU= 33.027
  06:51:36 STEP 1376 H=1376:00 +CPU= 30.003
  06:52:07 STEP 1377 H=1377:00 +CPU= 31.786
  06:52:27 STEP 1378 H=1378:00 +CPU= 19.607
  06:52:56 STEP 1379 H=1379:00 +CPU= 28.558
forrtl: severe (41): insufficient virtual memory
Image              PC                Routine            Line        Source             
oifs_43r3_model.e  0000000001D2B9CB  Unknown               Unknown  Unknown
oifs_43r3_model.e  00000000012BCFF6  radintg_                  935  radintg.F90
oifs_43r3_model.e  0000000001270124  raddrv_                   537  raddrv.F90
oifs_43r3_model.e  0000000000BFD839  gp_model_                 482  gp_model.F90
oifs_43r3_model.e  00000000012E9482  gp_model_heap_             74  gp_model_heap.F90
oifs_43r3_model.e  0000000000BBC1CE  scan2m_                   535  scan2m.F90
oifs_43r3_model.e  000000000057A664  stepo_                    327  stepo.F90
oifs_43r3_model.e  000000000055DEEC  cnt4_                    1133  cnt4.F90
oifs_43r3_model.e  00000000005471C9  cnt3_                     267  cnt3.F90
oifs_43r3_model.e  0000000000546412  cnt2_                      88  cnt2.F90
oifs_43r3_model.e  0000000000545E28  cnt1_                      92  cnt1.F90
oifs_43r3_model.e  000000000040708D  cnt0_                     146  cnt0.F90
oifs_43r3_model.e  000000000040220F  MAIN__                     96  master.F90
oifs_43r3_model.e  00000000004021A2  Unknown               Unknown  Unknown
oifs_43r3_model.e  0000000001DCA390  Unknown               Unknown  Unknown
oifs_43r3_model.e  000000000040206E  Unknown               Unknown  Unknown
The child process terminated with status: 0
..Failed, model did not complete successfully

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
09 May 2023 16:42:11 1515225 22303756 oifs_43r3_ps_0549_1999050100_123_968_12185193_1 4,924,800 43,474 0.0088
09 May 2023 16:42:06 1515225 22303756 oifs_43r3_ps_0549_1999050100_123_968_12185193_1 4,060,800 36,083 0.0089
09 May 2023 16:41:59 1515225 22303756 oifs_43r3_ps_0549_1999050100_123_968_12185193_1 3,196,800 28,643 0.0090
09 May 2023 16:41:53 1515225 22303756 oifs_43r3_ps_0549_1999050100_123_968_12185193_1 2,332,800 21,230 0.0091
09 May 2023 16:41:44 1515225 22303756 oifs_43r3_ps_0549_1999050100_123_968_12185193_1 1,468,800 13,847 0.0094


©2024 cpdn.org