climateprediction.net home page
Task 22449582

Task 22449582

Name oifs_43r3_bl_a0y2_2016092300_20_1018_12289553_1
Workunit 12289553
Created 17 Jun 2024, 7:05:28 UTC
Sent 17 Jun 2024, 7:06:28 UTC
Report deadline 16 Aug 2024, 7:06:28 UTC
Received 17 Jun 2024, 19:59:05 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 1 (0x00000001) Unknown error code
Computer ID 1491072
Run time 11 hours 34 min 29 sec
CPU time 11 hours 34 min 29 sec
Validate state Invalid
Credit 0.00
Device peak FLOPS 4.69 GFLOPS
Application version OpenIFS 43r3 Baroclinic Lifecycle v1.13
x86_64-pc-linux-gnu
Peak working set size 5,320.59 MB
Peak swap size 5,981.13 MB
Peak disk usage 1,370.58 MB
Stderr
<core_client_version>7.16.16</core_client_version>
<![CDATA[
<message>
process exited with code 1 (0x1, -255)</message>
<stderr_txt>
579
  15:32:57 STEP  801 H= 200:15 +CPU= 36.189
  15:33:33 STEP  802 H= 200:30 +CPU= 35.805
  15:34:10 STEP  803 H= 200:45 +CPU= 36.775
  15:34:55 STEP  804 H= 201:00 +CPU= 45.225
Moving to projects directory: /var/lib/boinc-client/slots/14/ICMGGh7zg+000804
Moving to projects directory: /var/lib/boinc-client/slots/14/ICMSHh7zg+000804
Moving to projects directory: /var/lib/boinc-client/slots/14/ICMUAh7zg+000804
  15:35:32 STEP  805 H= 201:15 +CPU= 36.612
  15:36:08 STEP  806 H= 201:30 +CPU= 35.955
  15:36:45 STEP  807 H= 201:45 +CPU= 36.175
  15:37:21 STEP  808 H= 202:00 +CPU= 36.117
  15:37:57 STEP  809 H= 202:15 +CPU= 36.166
  15:38:33 STEP  810 H= 202:30 +CPU= 35.972
  15:39:10 STEP  811 H= 202:45 +CPU= 36.215
  15:39:47 STEP  812 H= 203:00 +CPU= 36.836
  15:40:24 STEP  813 H= 203:15 +CPU= 37.107
  15:41:02 STEP  814 H= 203:30 +CPU= 37.285
  15:41:39 STEP  815 H= 203:45 +CPU= 37.023
  15:42:27 STEP  816 H= 204:00 +CPU= 48.408
Moving to projects directory: /var/lib/boinc-client/slots/14/ICMGGh7zg+000816
Moving to projects directory: /var/lib/boinc-client/slots/14/ICMSHh7zg+000816
Moving to projects directory: /var/lib/boinc-client/slots/14/ICMUAh7zg+000816
  15:43:05 STEP  817 H= 204:15 +CPU= 37.212
  15:43:43 STEP  818 H= 204:30 +CPU= 37.591
  15:44:20 STEP  819 H= 204:45 +CPU= 37.455
  15:44:58 STEP  820 H= 205:00 +CPU= 37.792
  15:45:36 STEP  821 H= 205:15 +CPU= 36.544
  15:46:13 STEP  822 H= 205:30 +CPU= 36.645
  15:46:50 STEP  823 H= 205:45 +CPU= 36.870
  15:47:27 STEP  824 H= 206:00 +CPU= 36.297
  15:48:03 STEP  825 H= 206:15 +CPU= 35.857
  15:48:39 STEP  826 H= 206:30 +CPU= 35.998
  15:49:16 STEP  827 H= 206:45 +CPU= 36.321
  15:50:01 STEP  828 H= 207:00 +CPU= 45.263
Moving to projects directory: /var/lib/boinc-client/slots/14/ICMGGh7zg+000828
Moving to projects directory: /var/lib/boinc-client/slots/14/ICMSHh7zg+000828
Moving to projects directory: /var/lib/boinc-client/slots/14/ICMUAh7zg+000828
  15:50:38 STEP  829 H= 207:15 +CPU= 37.218
  15:51:15 STEP  830 H= 207:30 +CPU= 36.845
  15:51:52 STEP  831 H= 207:45 +CPU= 36.200
  15:52:29 STEP  832 H= 208:00 +CPU= 36.670
  15:53:05 STEP  833 H= 208:15 +CPU= 35.829
  15:53:40 STEP  834 H= 208:30 +CPU= 35.510
  15:54:16 STEP  835 H= 208:45 +CPU= 35.783
  15:54:54 STEP  836 H= 209:00 +CPU= 37.043
  15:55:30 STEP  837 H= 209:15 +CPU= 36.547
  15:56:08 STEP  838 H= 209:30 +CPU= 37.254
  15:56:45 STEP  839 H= 209:45 +CPU= 37.271
  15:57:31 STEP  840 H= 210:00 +CPU= 45.494
Moving to projects directory: /var/lib/boinc-client/slots/14/ICMGGh7zg+000840
Moving to projects directory: /var/lib/boinc-client/slots/14/ICMSHh7zg+000840
Moving to projects directory: /var/lib/boinc-client/slots/14/ICMUAh7zg+000840
  15:58:07 STEP  841 H= 210:15 +CPU= 36.089
  15:58:43 STEP  842 H= 210:30 +CPU= 36.084
  15:59:20 STEP  843 H= 210:45 +CPU= 35.944
  15:59:56 STEP  844 H= 211:00 +CPU= 36.595
  16:00:32 STEP  845 H= 211:15 +CPU= 35.598
  16:01:09 STEP  846 H= 211:30 +CPU= 36.431
  16:01:45 STEP  847 H= 211:45 +CPU= 36.150
  16:02:22 STEP  848 H= 212:00 +CPU= 36.717
  16:03:00 STEP  849 H= 212:15 +CPU= 37.281
  16:03:37 STEP  850 H= 212:30 +CPU= 37.089
  16:04:14 STEP  851 H= 212:45 +CPU= 36.878
  16:04:58 STEP  852 H= 213:00 +CPU= 44.143
Moving to projects directory: /var/lib/boinc-client/slots/14/ICMGGh7zg+000852
Moving to projects directory: /var/lib/boinc-client/slots/14/ICMSHh7zg+000852
Moving to projects directory: /var/lib/boinc-client/slots/14/ICMUAh7zg+000852
  16:05:34 STEP  853 H= 213:15 +CPU= 35.697
  16:06:10 STEP  854 H= 213:30 +CPU= 35.978
  16:06:46 STEP  855 H= 213:45 +CPU= 35.986
  16:07:24 STEP  856 H= 214:00 +CPU= 37.448
  16:08:01 STEP  857 H= 214:15 +CPU= 36.651
  16:08:38 STEP  858 H= 214:30 +CPU= 36.888
  16:09:15 STEP  859 H= 214:45 +CPU= 36.944
  16:09:52 STEP  860 H= 215:00 +CPU= 37.017
  16:10:29 STEP  861 H= 215:15 +CPU= 36.117
  16:11:04 STEP  862 H= 215:30 +CPU= 35.498
  16:11:41 STEP  863 H= 215:45 +CPU= 35.920
  16:12:28 STEP  864 H= 216:00 +CPU= 47.556
Moving to projects directory: /var/lib/boinc-client/slots/14/ICMGGh7zg+000864
Moving to projects directory: /var/lib/boinc-client/slots/14/ICMSHh7zg+000864
Moving to projects directory: /var/lib/boinc-client/slots/14/ICMUAh7zg+000864
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12289553/ICMGGh7zg+000768
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12289553/ICMSHh7zg+000768
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12289553/ICMUAh7zg+000768
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12289553/ICMGGh7zg+000780
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12289553/ICMSHh7zg+000780
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12289553/ICMUAh7zg+000780
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12289553/ICMGGh7zg+000792
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12289553/ICMSHh7zg+000792
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12289553/ICMUAh7zg+000792
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12289553/ICMGGh7zg+000804
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12289553/ICMSHh7zg+000804
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12289553/ICMUAh7zg+000804
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12289553/ICMGGh7zg+000816
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12289553/ICMSHh7zg+000816
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12289553/ICMUAh7zg+000816
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12289553/ICMGGh7zg+000828
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12289553/ICMSHh7zg+000828
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12289553/ICMUAh7zg+000828
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12289553/ICMGGh7zg+000840
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12289553/ICMSHh7zg+000840
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12289553/ICMUAh7zg+000840
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12289553/ICMGGh7zg+000852
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12289553/ICMSHh7zg+000852
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12289553/ICMUAh7zg+000852
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a0y2_2016092300_20_1018_12289553_1_r1617484509_8.zip
Uploading the intermediate file: upload_file_8.zip
  16:13:05 STEP  865 H= 216:15 +CPU= 35.500
  16:13:43 STEP  866 H= 216:30 +CPU= 36.829
  16:14:20 STEP  867 H= 216:45 +CPU= 37.010
  16:14:58 STEP  868 H= 217:00 +CPU= 37.612
  16:15:34 STEP  869 H= 217:15 +CPU= 36.514
  16:16:10 STEP  870 H= 217:30 +CPU= 35.516
  16:16:46 STEP  871 H= 217:45 +CPU= 36.133
  16:17:24 STEP  872 H= 218:00 +CPU= 37.186
  16:18:00 STEP  873 H= 218:15 +CPU= 35.991
  16:18:37 STEP  874 H= 218:30 +CPU= 36.549
  16:19:13 STEP  875 H= 218:45 +CPU= 35.891
  16:19:58 STEP  876 H= 219:00 +CPU= 45.231
Moving to projects directory: /var/lib/boinc-client/slots/14/ICMGGh7zg+000876
Moving to projects directory: /var/lib/boinc-client/slots/14/ICMSHh7zg+000876
Moving to projects directory: /var/lib/boinc-client/slots/14/ICMUAh7zg+000876
  16:20:35 STEP  877 H= 219:15 +CPU= 36.862
  16:21:11 STEP  878 H= 219:30 +CPU= 36.055
  16:21:47 STEP  879 H= 219:45 +CPU= 35.409
  16:22:24 STEP  880 H= 220:00 +CPU= 36.873
  16:23:00 STEP  881 H= 220:15 +CPU= 36.124
  16:23:37 STEP  882 H= 220:30 +CPU= 36.031
  16:24:14 STEP  883 H= 220:45 +CPU= 36.940
  16:24:51 STEP  884 H= 221:00 +CPU= 37.498
  16:25:29 STEP  885 H= 221:15 +CPU= 37.157
  16:26:06 STEP  886 H= 221:30 +CPU= 37.060
  16:26:43 STEP  887 H= 221:45 +CPU= 36.645
  16:27:28 STEP  888 H= 222:00 +CPU= 44.869
Moving to projects directory: /var/lib/boinc-client/slots/14/ICMGGh7zg+000888
Moving to projects directory: /var/lib/boinc-client/slots/14/ICMSHh7zg+000888
Moving to projects directory: /var/lib/boinc-client/slots/14/ICMUAh7zg+000888
  16:28:04 STEP  889 H= 222:15 +CPU= 36.380
  16:28:41 STEP  890 H= 222:30 +CPU= 36.436
  16:29:18 STEP  891 H= 222:45 +CPU= 36.607
  16:29:56 STEP  892 H= 223:00 +CPU= 37.638
  16:30:32 STEP  893 H= 223:15 +CPU= 36.290
  16:31:08 STEP  894 H= 223:30 +CPU= 36.067
  16:31:44 STEP  895 H= 223:45 +CPU= 35.782
  16:32:21 STEP  896 H= 224:00 +CPU= 36.432
  16:32:57 STEP  897 H= 224:15 +CPU= 35.994
  16:33:34 STEP  898 H= 224:30 +CPU= 36.187
  16:34:10 STEP  899 H= 224:45 +CPU= 36.151
  16:34:55 STEP  900 H= 225:00 +CPU= 44.720
Moving to projects directory: /var/lib/boinc-client/slots/14/ICMGGh7zg+000900
Moving to projects directory: /var/lib/boinc-client/slots/14/ICMSHh7zg+000900
Moving to projects directory: /var/lib/boinc-client/slots/14/ICMUAh7zg+000900
  16:35:32 STEP  901 H= 225:15 +CPU= 36.811
  16:36:09 STEP  902 H= 225:30 +CPU= 36.861
  16:36:45 STEP  903 H= 225:45 +CPU= 36.295
  16:37:22 STEP  904 H= 226:00 +CPU= 36.558
  16:37:58 STEP  905 H= 226:15 +CPU= 36.055
  16:38:35 STEP  906 H= 226:30 +CPU= 36.391
  16:39:11 STEP  907 H= 226:45 +CPU= 35.421
  16:39:49 STEP  908 H= 227:00 +CPU= 36.749
  16:40:26 STEP  909 H= 227:15 +CPU= 36.495
  16:41:03 STEP  910 H= 227:30 +CPU= 36.990
  16:41:40 STEP  911 H= 227:45 +CPU= 37.151
  16:42:28 STEP  912 H= 228:00 +CPU= 47.636
Moving to projects directory: /var/lib/boinc-client/slots/14/ICMGGh7zg+000912
Moving to projects directory: /var/lib/boinc-client/slots/14/ICMSHh7zg+000912
Moving to projects directory: /var/lib/boinc-client/slots/14/ICMUAh7zg+000912
  16:43:04 STEP  913 H= 228:15 +CPU= 35.989
  16:43:40 STEP  914 H= 228:30 +CPU= 35.656
  16:44:18 STEP  915 H= 228:45 +CPU= 37.285
  16:44:55 STEP  916 H= 229:00 +CPU= 37.543
  16:45:33 STEP  917 H= 229:15 +CPU= 36.954
  16:46:10 STEP  918 H= 229:30 +CPU= 37.206
  16:46:47 STEP  919 H= 229:45 +CPU= 36.507
  16:47:23 STEP  920 H= 230:00 +CPU= 36.666
  16:47:59 STEP  921 H= 230:15 +CPU= 35.329
  16:48:35 STEP  922 H= 230:30 +CPU= 35.520
  16:49:11 STEP  923 H= 230:45 +CPU= 36.079
  16:49:56 STEP  924 H= 231:00 +CPU= 45.151
Moving to projects directory: /var/lib/boinc-client/slots/14/ICMGGh7zg+000924
Moving to projects directory: /var/lib/boinc-client/slots/14/ICMSHh7zg+000924
Moving to projects directory: /var/lib/boinc-client/slots/14/ICMUAh7zg+000924
  16:50:33 STEP  925 H= 231:15 +CPU= 36.270
  16:51:09 STEP  926 H= 231:30 +CPU= 36.288
  16:51:46 STEP  927 H= 231:45 +CPU= 36.121
  16:52:22 STEP  928 H= 232:00 +CPU= 36.566
  16:52:58 STEP  929 H= 232:15 +CPU= 35.786
  16:53:34 STEP  930 H= 232:30 +CPU= 35.591
  16:54:10 STEP  931 H= 232:45 +CPU= 35.621
  16:54:47 STEP  932 H= 233:00 +CPU= 36.869
  16:55:23 STEP  933 H= 233:15 +CPU= 36.060
  16:56:00 STEP  934 H= 233:30 +CPU= 36.324
  16:56:36 STEP  935 H= 233:45 +CPU= 36.373
  16:57:20 STEP  936 H= 234:00 +CPU= 43.999
Moving to projects directory: /var/lib/boinc-client/slots/14/ICMGGh7zg+000936
Moving to projects directory: /var/lib/boinc-client/slots/14/ICMSHh7zg+000936
Moving to projects directory: /var/lib/boinc-client/slots/14/ICMUAh7zg+000936
  16:57:56 STEP  937 H= 234:15 +CPU= 35.793
  16:58:33 STEP  938 H= 234:30 +CPU= 36.283
  16:59:08 STEP  939 H= 234:45 +CPU= 34.966
  16:59:44 STEP  940 H= 235:00 +CPU= 36.067
  17:00:20 STEP  941 H= 235:15 +CPU= 36.068
  17:00:57 STEP  942 H= 235:30 +CPU= 36.364
  17:01:33 STEP  943 H= 235:45 +CPU= 36.082
  17:02:11 STEP  944 H= 236:00 +CPU= 37.099
  17:02:47 STEP  945 H= 236:15 +CPU= 36.459
  17:03:23 STEP  946 H= 236:30 +CPU= 36.004
  17:04:00 STEP  947 H= 236:45 +CPU= 36.171
  17:04:45 STEP  948 H= 237:00 +CPU= 44.547
Moving to projects directory: /var/lib/boinc-client/slots/14/ICMGGh7zg+000948
Moving to projects directory: /var/lib/boinc-client/slots/14/ICMSHh7zg+000948
Moving to projects directory: /var/lib/boinc-client/slots/14/ICMUAh7zg+000948
  17:05:21 STEP  949 H= 237:15 +CPU= 36.195
  17:05:57 STEP  950 H= 237:30 +CPU= 35.498
  17:06:33 STEP  951 H= 237:45 +CPU= 35.836
  17:07:10 STEP  952 H= 238:00 +CPU= 37.025
  17:07:47 STEP  953 H= 238:15 +CPU= 36.996
  17:08:23 STEP  954 H= 238:30 +CPU= 35.957
  17:08:59 STEP  955 H= 238:45 +CPU= 35.949
  17:09:36 STEP  956 H= 239:00 +CPU= 36.023
  17:10:11 STEP  957 H= 239:15 +CPU= 35.617
  17:10:47 STEP  958 H= 239:30 +CPU= 35.747
  17:11:24 STEP  959 H= 239:45 +CPU= 36.307
  17:12:12 STEP  960 H= 240:00 +CPU= 47.675
Moving to projects directory: /var/lib/boinc-client/slots/14/ICMGGh7zg+000960
Moving to projects directory: /var/lib/boinc-client/slots/14/ICMSHh7zg+000960
Moving to projects directory: /var/lib/boinc-client/slots/14/ICMUAh7zg+000960
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12289553/ICMGGh7zg+000864
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12289553/ICMSHh7zg+000864
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12289553/ICMUAh7zg+000864
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12289553/ICMGGh7zg+000876
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12289553/ICMSHh7zg+000876
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12289553/ICMUAh7zg+000876
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12289553/ICMGGh7zg+000888
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12289553/ICMSHh7zg+000888
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12289553/ICMUAh7zg+000888
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12289553/ICMGGh7zg+000900
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12289553/ICMSHh7zg+000900
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12289553/ICMUAh7zg+000900
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12289553/ICMGGh7zg+000912
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12289553/ICMSHh7zg+000912
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12289553/ICMUAh7zg+000912
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12289553/ICMGGh7zg+000924
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12289553/ICMSHh7zg+000924
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12289553/ICMUAh7zg+000924
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12289553/ICMGGh7zg+000936
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12289553/ICMSHh7zg+000936
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12289553/ICMUAh7zg+000936
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12289553/ICMGGh7zg+000948
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12289553/ICMSHh7zg+000948
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12289553/ICMUAh7zg+000948
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a0y2_2016092300_20_1018_12289553_1_r1617484509_9.zip
Uploading the intermediate file: upload_file_9.zip
  17:12:49 STEP  961 H= 240:15 +CPU= 35.894
  17:13:26 STEP  962 H= 240:30 +CPU= 36.549
  17:14:01 STEP  963 H= 240:45 +CPU= 35.650
  17:14:38 STEP  964 H= 241:00 +CPU= 36.112
  17:15:13 STEP  965 H= 241:15 +CPU= 35.399
  17:15:49 STEP  966 H= 241:30 +CPU= 36.018
  17:16:25 STEP  967 H= 241:45 +CPU= 35.666
  17:17:02 STEP  968 H= 242:00 +CPU= 36.332
  17:17:39 STEP  969 H= 242:15 +CPU= 36.739
  17:18:15 STEP  970 H= 242:30 +CPU= 35.761
  17:18:50 STEP  971 H= 242:45 +CPU= 35.314
  17:19:34 STEP  972 H= 243:00 +CPU= 43.584
Moving to projects directory: /var/lib/boinc-client/slots/14/ICMGGh7zg+000972
Moving to projects directory: /var/lib/boinc-client/slots/14/ICMSHh7zg+000972
Moving to projects directory: /var/lib/boinc-client/slots/14/ICMUAh7zg+000972
  17:20:10 STEP  973 H= 243:15 +CPU= 35.624
  17:20:46 STEP  974 H= 243:30 +CPU= 35.659
  17:21:21 STEP  975 H= 243:45 +CPU= 35.456
  17:21:57 STEP  976 H= 244:00 +CPU= 35.983
  17:22:34 STEP  977 H= 244:15 +CPU= 35.912
  17:23:10 STEP  978 H= 244:30 +CPU= 36.284
  17:23:47 STEP  979 H= 244:45 +CPU= 36.319
  17:24:23 STEP  980 H= 245:00 +CPU= 36.284
  17:24:59 STEP  981 H= 245:15 +CPU= 35.738
  17:25:35 STEP  982 H= 245:30 +CPU= 35.376
  17:26:11 STEP  983 H= 245:45 +CPU= 35.820
  17:26:55 STEP  984 H= 246:00 +CPU= 44.283
Moving to projects directory: /var/lib/boinc-client/slots/14/ICMGGh7zg+000984
Moving to projects directory: /var/lib/boinc-client/slots/14/ICMSHh7zg+000984
Moving to projects directory: /var/lib/boinc-client/slots/14/ICMUAh7zg+000984
  17:27:31 STEP  985 H= 246:15 +CPU= 35.617
  17:28:07 STEP  986 H= 246:30 +CPU= 36.008
  17:28:43 STEP  987 H= 246:45 +CPU= 36.112
  17:29:20 STEP  988 H= 247:00 +CPU= 36.801
  17:29:56 STEP  989 H= 247:15 +CPU= 35.605
  17:30:31 STEP  990 H= 247:30 +CPU= 34.942
  17:31:06 STEP  991 H= 247:45 +CPU= 34.916
  17:31:43 STEP  992 H= 248:00 +CPU= 36.327
  17:32:18 STEP  993 H= 248:15 +CPU= 35.446
  17:32:55 STEP  994 H= 248:30 +CPU= 34.623
  17:33:30 STEP  995 H= 248:45 +CPU= 35.300
  17:34:15 STEP  996 H= 249:00 +CPU= 44.522
Moving to projects directory: /var/lib/boinc-client/slots/14/ICMGGh7zg+000996
Moving to projects directory: /var/lib/boinc-client/slots/14/ICMSHh7zg+000996
Moving to projects directory: /var/lib/boinc-client/slots/14/ICMUAh7zg+000996
  17:34:52 STEP  997 H= 249:15 +CPU= 36.552
  17:35:28 STEP  998 H= 249:30 +CPU= 36.375
  17:36:05 STEP  999 H= 249:45 +CPU= 36.058
  17:36:41 STEP 1000 H= 250:00 +CPU= 36.159
  17:37:16 STEP 1001 H= 250:15 +CPU= 35.235
  17:37:52 STEP 1002 H= 250:30 +CPU= 35.247
  17:38:28 STEP 1003 H= 250:45 +CPU= 35.802
  17:39:03 STEP 1004 H= 251:00 +CPU= 35.412
  17:39:39 STEP 1005 H= 251:15 +CPU= 35.681
  17:40:15 STEP 1006 H= 251:30 +CPU= 35.817
  17:40:51 STEP 1007 H= 251:45 +CPU= 35.819
  17:41:39 STEP 1008 H= 252:00 +CPU= 47.379
Moving to projects directory: /var/lib/boinc-client/slots/14/ICMGGh7zg+001008
Moving to projects directory: /var/lib/boinc-client/slots/14/ICMSHh7zg+001008
Moving to projects directory: /var/lib/boinc-client/slots/14/ICMUAh7zg+001008
  17:42:15 STEP 1009 H= 252:15 +CPU= 35.467
  17:42:50 STEP 1010 H= 252:30 +CPU= 35.373
  17:43:26 STEP 1011 H= 252:45 +CPU= 35.724
  17:44:03 STEP 1012 H= 253:00 +CPU= 36.867
  17:44:39 STEP 1013 H= 253:15 +CPU= 35.935
  17:45:15 STEP 1014 H= 253:30 +CPU= 35.887
  17:45:51 STEP 1015 H= 253:45 +CPU= 35.243
  17:46:28 STEP 1016 H= 254:00 +CPU= 37.147
  17:47:05 STEP 1017 H= 254:15 +CPU= 36.359
  17:47:40 STEP 1018 H= 254:30 +CPU= 35.639
  17:48:16 STEP 1019 H= 254:45 +CPU= 35.155
  17:49:00 STEP 1020 H= 255:00 +CPU= 44.060
Moving to projects directory: /var/lib/boinc-client/slots/14/ICMGGh7zg+001020
Moving to projects directory: /var/lib/boinc-client/slots/14/ICMSHh7zg+001020
Moving to projects directory: /var/lib/boinc-client/slots/14/ICMUAh7zg+001020
  17:49:36 STEP 1021 H= 255:15 +CPU= 35.991
  17:50:13 STEP 1022 H= 255:30 +CPU= 36.613
  17:50:49 STEP 1023 H= 255:45 +CPU= 35.913
  17:51:26 STEP 1024 H= 256:00 +CPU= 37.084
  17:52:02 STEP 1025 H= 256:15 +CPU= 35.606
  17:52:38 STEP 1026 H= 256:30 +CPU= 35.474
  17:53:13 STEP 1027 H= 256:45 +CPU= 35.175
  17:53:49 STEP 1028 H= 257:00 +CPU= 35.811
  17:54:25 STEP 1029 H= 257:15 +CPU= 35.425
  17:55:00 STEP 1030 H= 257:30 +CPU= 35.503
  17:55:37 STEP 1031 H= 257:45 +CPU= 36.003
  17:56:21 STEP 1032 H= 258:00 +CPU= 44.366
Moving to projects directory: /var/lib/boinc-client/slots/14/ICMGGh7zg+001032
Moving to projects directory: /var/lib/boinc-client/slots/14/ICMSHh7zg+001032
Moving to projects directory: /var/lib/boinc-client/slots/14/ICMUAh7zg+001032
  17:56:57 STEP 1033 H= 258:15 +CPU= 35.978
  17:57:33 STEP 1034 H= 258:30 +CPU= 35.384
  17:58:08 STEP 1035 H= 258:45 +CPU= 35.131
  17:58:44 STEP 1036 H= 259:00 +CPU= 35.916
  17:59:20 STEP 1037 H= 259:15 +CPU= 35.750
  17:59:56 STEP 1038 H= 259:30 +CPU= 35.555
  18:00:31 STEP 1039 H= 259:45 +CPU= 35.433
  18:01:08 STEP 1040 H= 260:00 +CPU= 36.301
  18:01:44 STEP 1041 H= 260:15 +CPU= 35.789
  18:02:20 STEP 1042 H= 260:30 +CPU= 36.168
  18:02:56 STEP 1043 H= 260:45 +CPU= 35.715
  18:03:41 STEP 1044 H= 261:00 +CPU= 44.462
Moving to projects directory: /var/lib/boinc-client/slots/14/ICMGGh7zg+001044
Moving to projects directory: /var/lib/boinc-client/slots/14/ICMSHh7zg+001044
Moving to projects directory: /var/lib/boinc-client/slots/14/ICMUAh7zg+001044
  18:04:16 STEP 1045 H= 261:15 +CPU= 35.023
  18:04:52 STEP 1046 H= 261:30 +CPU= 35.560
  18:05:27 STEP 1047 H= 261:45 +CPU= 35.133
  18:06:03 STEP 1048 H= 262:00 +CPU= 35.831
  18:06:38 STEP 1049 H= 262:15 +CPU= 34.884
  18:07:14 STEP 1050 H= 262:30 +CPU= 35.311
  18:07:49 STEP 1051 H= 262:45 +CPU= 35.212
  18:08:25 STEP 1052 H= 263:00 +CPU= 36.295
  18:09:02 STEP 1053 H= 263:15 +CPU= 36.071
  18:09:38 STEP 1054 H= 263:30 +CPU= 35.946
  18:10:14 STEP 1055 H= 263:45 +CPU= 35.844
  18:11:00 STEP 1056 H= 264:00 +CPU= 46.202
Moving to projects directory: /var/lib/boinc-client/slots/14/ICMGGh7zg+001056
Moving to projects directory: /var/lib/boinc-client/slots/14/ICMSHh7zg+001056
Moving to projects directory: /var/lib/boinc-client/slots/14/ICMUAh7zg+001056
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12289553/ICMGGh7zg+000960
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12289553/ICMSHh7zg+000960
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12289553/ICMUAh7zg+000960
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12289553/ICMGGh7zg+000972
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12289553/ICMSHh7zg+000972
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12289553/ICMUAh7zg+000972
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12289553/ICMGGh7zg+000984
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12289553/ICMSHh7zg+000984
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12289553/ICMUAh7zg+000984
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12289553/ICMGGh7zg+000996
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12289553/ICMSHh7zg+000996
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12289553/ICMUAh7zg+000996
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12289553/ICMGGh7zg+001008
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12289553/ICMSHh7zg+001008
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12289553/ICMUAh7zg+001008
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12289553/ICMGGh7zg+001020
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12289553/ICMSHh7zg+001020
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12289553/ICMUAh7zg+001020
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12289553/ICMGGh7zg+001032
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12289553/ICMSHh7zg+001032
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12289553/ICMUAh7zg+001032
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12289553/ICMGGh7zg+001044
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12289553/ICMSHh7zg+001044
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12289553/ICMUAh7zg+001044
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a0y2_2016092300_20_1018_12289553_1_r1617484509_10.zip
Uploading the intermediate file: upload_file_10.zip
  18:11:37 STEP 1057 H= 264:15 +CPU= 35.735
  18:12:14 STEP 1058 H= 264:30 +CPU= 35.909
  18:12:50 STEP 1059 H= 264:45 +CPU= 35.932
  18:13:27 STEP 1060 H= 265:00 +CPU= 37.074
  18:14:04 STEP 1061 H= 265:15 +CPU= 36.389
  18:14:41 STEP 1062 H= 265:30 +CPU= 36.844
  18:15:17 STEP 1063 H= 265:45 +CPU= 36.381
  18:15:54 STEP 1064 H= 266:00 +CPU= 36.803
  18:16:30 STEP 1065 H= 266:15 +CPU= 35.180
  18:17:05 STEP 1066 H= 266:30 +CPU= 35.198
  18:17:40 STEP 1067 H= 266:45 +CPU= 35.169
  18:18:25 STEP 1068 H= 267:00 +CPU= 44.464
Moving to projects directory: /var/lib/boinc-client/slots/14/ICMGGh7zg+001068
Moving to projects directory: /var/lib/boinc-client/slots/14/ICMSHh7zg+001068
Moving to projects directory: /var/lib/boinc-client/slots/14/ICMUAh7zg+001068
  18:19:01 STEP 1069 H= 267:15 +CPU= 36.030
  18:19:38 STEP 1070 H= 267:30 +CPU= 36.927
  18:20:15 STEP 1071 H= 267:45 +CPU= 36.045
  18:20:51 STEP 1072 H= 268:00 +CPU= 36.697
  18:21:28 STEP 1073 H= 268:15 +CPU= 36.111
  18:22:03 STEP 1074 H= 268:30 +CPU= 35.490
  18:22:39 STEP 1075 H= 268:45 +CPU= 35.275
  18:23:16 STEP 1076 H= 269:00 +CPU= 36.719
  18:23:52 STEP 1077 H= 269:15 +CPU= 36.165
  18:24:28 STEP 1078 H= 269:30 +CPU= 35.886
  18:25:05 STEP 1079 H= 269:45 +CPU= 36.272
  18:25:50 STEP 1080 H= 270:00 +CPU= 44.695
Moving to projects directory: /var/lib/boinc-client/slots/14/ICMGGh7zg+001080
Moving to projects directory: /var/lib/boinc-client/slots/14/ICMSHh7zg+001080
Moving to projects directory: /var/lib/boinc-client/slots/14/ICMUAh7zg+001080
  18:26:28 STEP 1081 H= 270:15 +CPU= 36.251
  18:27:04 STEP 1082 H= 270:30 +CPU= 36.186
  18:27:40 STEP 1083 H= 270:45 +CPU= 35.588
  18:28:17 STEP 1084 H= 271:00 +CPU= 36.494
  18:28:53 STEP 1085 H= 271:15 +CPU= 35.842
  18:29:28 STEP 1086 H= 271:30 +CPU= 35.389
  18:30:05 STEP 1087 H= 271:45 +CPU= 36.272
  18:30:42 STEP 1088 H= 272:00 +CPU= 37.012
  18:31:18 STEP 1089 H= 272:15 +CPU= 36.109
  18:31:55 STEP 1090 H= 272:30 +CPU= 36.392
  18:32:31 STEP 1091 H= 272:45 +CPU= 36.031
  18:33:15 STEP 1092 H= 273:00 +CPU= 43.931
Moving to projects directory: /var/lib/boinc-client/slots/14/ICMGGh7zg+001092
Moving to projects directory: /var/lib/boinc-client/slots/14/ICMSHh7zg+001092
Moving to projects directory: /var/lib/boinc-client/slots/14/ICMUAh7zg+001092
  18:33:51 STEP 1093 H= 273:15 +CPU= 35.701
  18:34:27 STEP 1094 H= 273:30 +CPU= 35.456
  18:35:03 STEP 1095 H= 273:45 +CPU= 36.019
  18:35:40 STEP 1096 H= 274:00 +CPU= 36.987
  18:36:17 STEP 1097 H= 274:15 +CPU= 36.365
  18:36:53 STEP 1098 H= 274:30 +CPU= 35.999
  18:37:29 STEP 1099 H= 274:45 +CPU= 35.834
  18:38:05 STEP 1100 H= 275:00 +CPU= 36.263
  18:38:41 STEP 1101 H= 275:15 +CPU= 35.332
  18:39:16 STEP 1102 H= 275:30 +CPU= 35.092
  18:39:51 STEP 1103 H= 275:45 +CPU= 34.961
  18:40:39 STEP 1104 H= 276:00 +CPU= 47.566
Moving to projects directory: /var/lib/boinc-client/slots/14/ICMGGh7zg+001104
Moving to projects directory: /var/lib/boinc-client/slots/14/ICMSHh7zg+001104
Moving to projects directory: /var/lib/boinc-client/slots/14/ICMUAh7zg+001104
  18:41:16 STEP 1105 H= 276:15 +CPU= 36.882
  18:41:53 STEP 1106 H= 276:30 +CPU= 36.507
  18:42:29 STEP 1107 H= 276:45 +CPU= 36.056
  18:43:06 STEP 1108 H= 277:00 +CPU= 36.092
  18:43:41 STEP 1109 H= 277:15 +CPU= 34.703
  18:44:16 STEP 1110 H= 277:30 +CPU= 35.170
  18:44:51 STEP 1111 H= 277:45 +CPU= 35.427
  18:45:27 STEP 1112 H= 278:00 +CPU= 35.822
  18:46:03 STEP 1113 H= 278:15 +CPU= 35.307
  18:46:38 STEP 1114 H= 278:30 +CPU= 35.292
  18:47:15 STEP 1115 H= 278:45 +CPU= 36.037
  18:47:59 STEP 1116 H= 279:00 +CPU= 44.474
Moving to projects directory: /var/lib/boinc-client/slots/14/ICMGGh7zg+001116
Moving to projects directory: /var/lib/boinc-client/slots/14/ICMSHh7zg+001116
Moving to projects directory: /var/lib/boinc-client/slots/14/ICMUAh7zg+001116
  18:48:36 STEP 1117 H= 279:15 +CPU= 36.393
  18:49:12 STEP 1118 H= 279:30 +CPU= 36.208
  18:49:47 STEP 1119 H= 279:45 +CPU= 34.981
  18:50:23 STEP 1120 H= 280:00 +CPU= 35.235
  18:50:58 STEP 1121 H= 280:15 +CPU= 35.475
  18:51:34 STEP 1122 H= 280:30 +CPU= 35.394
  18:52:09 STEP 1123 H= 280:45 +CPU= 35.275
  18:52:46 STEP 1124 H= 281:00 +CPU= 35.967
  18:53:21 STEP 1125 H= 281:15 +CPU= 35.548
  18:53:57 STEP 1126 H= 281:30 +CPU= 35.732
  18:54:33 STEP 1127 H= 281:45 +CPU= 35.984
  18:55:19 STEP 1128 H= 282:00 +CPU= 45.072
Moving to projects directory: /var/lib/boinc-client/slots/14/ICMGGh7zg+001128
Moving to projects directory: /var/lib/boinc-client/slots/14/ICMSHh7zg+001128
Moving to projects directory: /var/lib/boinc-client/slots/14/ICMUAh7zg+001128
  18:55:55 STEP 1129 H= 282:15 +CPU= 36.378
  18:56:31 STEP 1130 H= 282:30 +CPU= 35.674
  18:57:06 STEP 1131 H= 282:45 +CPU= 35.271
  18:57:42 STEP 1132 H= 283:00 +CPU= 35.544
  18:58:17 STEP 1133 H= 283:15 +CPU= 35.114
  18:58:53 STEP 1134 H= 283:30 +CPU= 35.162
  18:59:28 STEP 1135 H= 283:45 +CPU= 35.455
  19:00:04 STEP 1136 H= 284:00 +CPU= 35.643
  19:00:39 STEP 1137 H= 284:15 +CPU= 34.940
  19:01:15 STEP 1138 H= 284:30 +CPU= 35.673
  19:01:51 STEP 1139 H= 284:45 +CPU= 36.061
  19:02:36 STEP 1140 H= 285:00 +CPU= 44.346
Moving to projects directory: /var/lib/boinc-client/slots/14/ICMGGh7zg+001140
Moving to projects directory: /var/lib/boinc-client/slots/14/ICMSHh7zg+001140
Moving to projects directory: /var/lib/boinc-client/slots/14/ICMUAh7zg+001140
  19:03:12 STEP 1141 H= 285:15 +CPU= 35.979
  19:03:48 STEP 1142 H= 285:30 +CPU= 35.927
  19:04:24 STEP 1143 H= 285:45 +CPU= 35.606
  19:05:01 STEP 1144 H= 286:00 +CPU= 36.519
  19:05:36 STEP 1145 H= 286:15 +CPU= 35.564
  19:06:12 STEP 1146 H= 286:30 +CPU= 34.961
  19:06:47 STEP 1147 H= 286:45 +CPU= 35.514
  19:07:25 STEP 1148 H= 287:00 +CPU= 37.023
  19:08:01 STEP 1149 H= 287:15 +CPU= 36.684
  19:08:38 STEP 1150 H= 287:30 +CPU= 35.882
  19:09:14 STEP 1151 H= 287:45 +CPU= 36.535
  19:10:02 STEP 1152 H= 288:00 +CPU= 47.274
Moving to projects directory: /var/lib/boinc-client/slots/14/ICMGGh7zg+001152
Moving to projects directory: /var/lib/boinc-client/slots/14/ICMSHh7zg+001152
Moving to projects directory: /var/lib/boinc-client/slots/14/ICMUAh7zg+001152
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12289553/ICMGGh7zg+001056
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12289553/ICMSHh7zg+001056
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12289553/ICMUAh7zg+001056
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12289553/ICMGGh7zg+001068
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12289553/ICMSHh7zg+001068
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12289553/ICMUAh7zg+001068
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12289553/ICMGGh7zg+001080
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12289553/ICMSHh7zg+001080
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12289553/ICMUAh7zg+001080
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12289553/ICMGGh7zg+001092
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12289553/ICMSHh7zg+001092
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12289553/ICMUAh7zg+001092
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12289553/ICMGGh7zg+001104
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12289553/ICMSHh7zg+001104
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12289553/ICMUAh7zg+001104
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12289553/ICMGGh7zg+001116
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12289553/ICMSHh7zg+001116
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12289553/ICMUAh7zg+001116
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12289553/ICMGGh7zg+001128
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12289553/ICMSHh7zg+001128
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12289553/ICMUAh7zg+001128
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12289553/ICMGGh7zg+001140
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12289553/ICMSHh7zg+001140
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12289553/ICMUAh7zg+001140
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a0y2_2016092300_20_1018_12289553_1_r1617484509_11.zip
Uploading the intermediate file: upload_file_11.zip
  19:10:39 STEP 1153 H= 288:15 +CPU= 35.710
  19:11:15 STEP 1154 H= 288:30 +CPU= 35.844
  19:11:52 STEP 1155 H= 288:45 +CPU= 36.810
  19:12:29 STEP 1156 H= 289:00 +CPU= 36.507
  19:13:05 STEP 1157 H= 289:15 +CPU= 35.981
  19:13:41 STEP 1158 H= 289:30 +CPU= 36.324
  19:14:18 STEP 1159 H= 289:45 +CPU= 36.802
  19:14:56 STEP 1160 H= 290:00 +CPU= 36.934
  19:15:32 STEP 1161 H= 290:15 +CPU= 35.814
  19:16:07 STEP 1162 H= 290:30 +CPU= 35.360
  19:16:43 STEP 1163 H= 290:45 +CPU= 35.773
  19:17:28 STEP 1164 H= 291:00 +CPU= 44.931
Moving to projects directory: /var/lib/boinc-client/slots/14/ICMGGh7zg+001164
Moving to projects directory: /var/lib/boinc-client/slots/14/ICMSHh7zg+001164
Moving to projects directory: /var/lib/boinc-client/slots/14/ICMUAh7zg+001164
  19:18:05 STEP 1165 H= 291:15 +CPU= 36.629
  19:18:42 STEP 1166 H= 291:30 +CPU= 36.852
  19:19:20 STEP 1167 H= 291:45 +CPU= 36.593
  19:19:57 STEP 1168 H= 292:00 +CPU= 36.494
  19:20:34 STEP 1169 H= 292:15 +CPU= 36.597
  19:21:10 STEP 1170 H= 292:30 +CPU= 36.027
  19:21:46 STEP 1171 H= 292:45 +CPU= 35.203
  19:22:22 STEP 1172 H= 293:00 +CPU= 36.073
  19:22:58 STEP 1173 H= 293:15 +CPU= 35.931
  19:23:34 STEP 1174 H= 293:30 +CPU= 36.036
  19:24:11 STEP 1175 H= 293:45 +CPU= 36.424
  19:24:56 STEP 1176 H= 294:00 +CPU= 44.300
Moving to projects directory: /var/lib/boinc-client/slots/14/ICMGGh7zg+001176
Moving to projects directory: /var/lib/boinc-client/slots/14/ICMSHh7zg+001176
Moving to projects directory: /var/lib/boinc-client/slots/14/ICMUAh7zg+001176
  19:25:32 STEP 1177 H= 294:15 +CPU= 36.198
  19:26:08 STEP 1178 H= 294:30 +CPU= 35.791
  19:26:44 STEP 1179 H= 294:45 +CPU= 35.974
  19:27:21 STEP 1180 H= 295:00 +CPU= 36.648
  19:27:56 STEP 1181 H= 295:15 +CPU= 35.127
  19:28:32 STEP 1182 H= 295:30 +CPU= 35.659
  19:29:08 STEP 1183 H= 295:45 +CPU= 36.085
  19:29:45 STEP 1184 H= 296:00 +CPU= 36.238
  19:30:21 STEP 1185 H= 296:15 +CPU= 36.447
  19:30:58 STEP 1186 H= 296:30 +CPU= 36.588
  19:31:35 STEP 1187 H= 296:45 +CPU= 36.385
  19:32:18 STEP 1188 H= 297:00 +CPU= 43.534
Moving to projects directory: /var/lib/boinc-client/slots/14/ICMGGh7zg+001188
Moving to projects directory: /var/lib/boinc-client/slots/14/ICMSHh7zg+001188
Moving to projects directory: /var/lib/boinc-client/slots/14/ICMUAh7zg+001188
  19:32:55 STEP 1189 H= 297:15 +CPU= 35.966
  19:33:30 STEP 1190 H= 297:30 +CPU= 35.484
  19:34:05 STEP 1191 H= 297:45 +CPU= 34.796
  19:34:41 STEP 1192 H= 298:00 +CPU= 36.066
  19:35:17 STEP 1193 H= 298:15 +CPU= 35.203
  19:35:53 STEP 1194 H= 298:30 +CPU= 35.653
  19:36:29 STEP 1195 H= 298:45 +CPU= 36.253
  19:37:07 STEP 1196 H= 299:00 +CPU= 37.324
  19:37:43 STEP 1197 H= 299:15 +CPU= 35.944
  19:38:19 STEP 1198 H= 299:30 +CPU= 36.142
  19:38:55 STEP 1199 H= 299:45 +CPU= 36.089
  19:39:43 STEP 1200 H= 300:00 +CPU= 47.127
Moving to projects directory: /var/lib/boinc-client/slots/14/ICMGGh7zg+001200
Moving to projects directory: /var/lib/boinc-client/slots/14/ICMSHh7zg+001200
Moving to projects directory: /var/lib/boinc-client/slots/14/ICMUAh7zg+001200
  19:40:19 STEP 1201 H= 300:15 +CPU= 35.904
  19:40:55 STEP 1202 H= 300:30 +CPU= 36.027
  19:41:31 STEP 1203 H= 300:45 +CPU= 35.966
  19:42:08 STEP 1204 H= 301:00 +CPU= 36.959
  19:42:45 STEP 1205 H= 301:15 +CPU= 36.737
  19:43:22 STEP 1206 H= 301:30 +CPU= 36.208
  19:43:58 STEP 1207 H= 301:45 +CPU= 36.052
  19:44:35 STEP 1208 H= 302:00 +CPU= 36.461
  19:45:10 STEP 1209 H= 302:15 +CPU= 35.322
  19:45:46 STEP 1210 H= 302:30 +CPU= 35.405
  19:46:21 STEP 1211 H= 302:45 +CPU= 35.462
  19:47:05 STEP 1212 H= 303:00 +CPU= 43.723
Moving to projects directory: /var/lib/boinc-client/slots/14/ICMGGh7zg+001212
Moving to projects directory: /var/lib/boinc-client/slots/14/ICMSHh7zg+001212
Moving to projects directory: /var/lib/boinc-client/slots/14/ICMUAh7zg+001212
  19:47:41 STEP 1213 H= 303:15 +CPU= 35.668
  19:48:17 STEP 1214 H= 303:30 +CPU= 35.625
  19:48:53 STEP 1215 H= 303:45 +CPU= 36.238
  19:49:30 STEP 1216 H= 304:00 +CPU= 36.774
  19:50:07 STEP 1217 H= 304:15 +CPU= 36.133
  19:50:43 STEP 1218 H= 304:30 +CPU= 36.139
  19:51:18 STEP 1219 H= 304:45 +CPU= 35.201
  19:51:55 STEP 1220 H= 305:00 +CPU= 36.140
  19:52:30 STEP 1221 H= 305:15 +CPU= 35.065
  19:53:05 STEP 1222 H= 305:30 +CPU= 34.715
  19:53:40 STEP 1223 H= 305:45 +CPU= 35.092
  19:54:25 STEP 1224 H= 306:00 +CPU= 44.743
Moving to projects directory: /var/lib/boinc-client/slots/14/ICMGGh7zg+001224
Moving to projects directory: /var/lib/boinc-client/slots/14/ICMSHh7zg+001224
Moving to projects directory: /var/lib/boinc-client/slots/14/ICMUAh7zg+001224
  19:55:02 STEP 1225 H= 306:15 +CPU= 36.469
  19:55:38 STEP 1226 H= 306:30 +CPU= 36.485
  19:56:15 STEP 1227 H= 306:45 +CPU= 36.067
  19:56:51 STEP 1228 H= 307:00 +CPU= 36.280
  19:57:27 STEP 1229 H= 307:15 +CPU= 35.490
[EC_DRHOOK:Debian17:1:1:924005:924005] [20240617:195750:1718650670:29637.860] [signal_drhook@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1538] Received signal#8 (SIGFPE) :: 3958MB (heap), 5156MB (maxrss), 0MB (maxstack), 0 (paging), nsigs = 1
[EC_DRHOOK:Debian17:1:1:924005:924005] [20240617:195750:1718650670:29637.865] [signal_drhook@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1542] Also activating Harakiri-alarm (SIGALRM=14) to expire after 500s elapsed to prevent hangs, nsigs = 1
[EC_DRHOOK:Debian17:1:1:924005:924005] [20240617:195750:1718650670:29637.865] [signal_drhook@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1544] Harakiri signal handler 'signal_harakiri' for signal#14 (SIGALRM) installed at 0x820890 (old at (nil))
[EC_DRHOOK:Debian17:1:1:924005:924005] [20240617:195750:1718650670:29637.866] [signal_drhook@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1617] Signal#8 was caused by floating-point overflow [memaddr=0x1cc6692], nsigs = 1
[EC_DRHOOK:Debian17:1:1:924005:924005] [20240617:195750:1718650670:29637.866] [signal_drhook@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1686] Starting DrHook backtrace for signal#8, nsigs = 1
[EC_DRHOOK:Debian17:1:1:924005:924005] [20240617:195750:1718650670:29637.866] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3843] 3958 MB (maxheap), 5156 MB (maxrss), 0 MB (maxstack)
[EC_DRHOOK:Debian17:1:1:924005:924005] [20240617:195750:1718650670:29637.898] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] :  MASTER 
[EC_DRHOOK:Debian17:1:1:924005:924005] [20240617:195750:1718650670:29637.898] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] :   CNT0 
[EC_DRHOOK:Debian17:1:1:924005:924005] [20240617:195750:1718650670:29637.898] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] :    CNT1 
[EC_DRHOOK:Debian17:1:1:924005:924005] [20240617:195750:1718650670:29637.898] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] :     CNT2 
[EC_DRHOOK:Debian17:1:1:924005:924005] [20240617:195750:1718650670:29637.898] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] :      CNT3 
[EC_DRHOOK:Debian17:1:1:924005:924005] [20240617:195750:1718650670:29637.898] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] :       CNT4 
[EC_DRHOOK:Debian17:1:1:924005:924005] [20240617:195750:1718650670:29637.898] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] :        STEPO 
[EC_DRHOOK:Debian17:1:1:924005:924005] [20240617:195750:1718650670:29637.898] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] :         SCAN2M 
[EC_DRHOOK:Debian17:1:1:924005:924005] [20240617:195750:1718650670:29637.898] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] :          GP_MODEL_HEAP 
[EC_DRHOOK:Debian17:1:1:924005:924005] [20240617:195750:1718650670:29637.898] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] :           GP_MODEL 
[EC_DRHOOK:Debian17:1:1:924005:924005] [20240617:195750:1718650670:29637.898] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] :            EC_PHYS_DRV 
[EC_DRHOOK:Debian17:1:1:924005:924005] [20240617:195750:1718650670:29637.898] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] :             >OMP-PHYSICS              (1001) 
[EC_DRHOOK:Debian17:1:1:924005:924005] [20240617:195750:1718650670:29637.898] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] :              EC_PHYS 
[EC_DRHOOK:Debian17:1:1:924005:924005] [20240617:195750:1718650670:29637.898] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] :               CALLPAR 
[EC_DRHOOK:Debian17:1:1:924005:924005] [20240617:195750:1718650670:29637.898] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] :                TURBULENCE_LAYER 
[EC_DRHOOK:Debian17:1:1:924005:924005] [20240617:195750:1718650670:29637.898] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] :                 VDFOUTER 
[EC_DRHOOK:Debian17:1:1:924005:924005] [20240617:195750:1718650670:29637.898] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] :                  VDFMAIN 
[EC_DRHOOK:Debian17:1:1:924005:924005] [20240617:195751:1718650671:29638.901] [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:240] Backtrace(s) for program '/var/lib/boinc-client/slots/14/oifs_43r3_model.exe' : sigcontextptr=0x7ffef1aab490
[EC_DRHOOK:Debian17:1:1:924005:924005] [20240617:195751:1718650671:29638.901] [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:277] Backtrace (size = 24) with addr2line-cmd
[EC_DRHOOK:Debian17:1:1:924005:924005] [20240617:195751:1718650671:29638.901] [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:302] /usr/bin/addr2line -fs -e '/var/lib/boinc-client/slots/14/oifs_43r3_model.exe' 0x83a8f3 0x83aef9 0x1dd5490 0x1cc6692 0x121fd8b 0x1207e29 0x11fdcb2 0xfac003 0xf5fa6b 0xf4dbc4 0xbd7131 0x12c5002 0xbacbae 0x688153 0x4cd1dc 0x4b5d85 0x4b4f52 0x49d638 0x406fbd 0x401e7f 0x401e12 0x1dcc34a 0x1dcdbe7 0x401cd5
[EC_DRHOOK:Debian17:1:1:924005:924005] [20240617:195751:1718650671:29638.901] [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [0]: [0x83a8f3] : ??() at ??:0
[EC_DRHOOK:Debian17:1:1:924005:924005] [20240617:195751:1718650671:29638.901] [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [1]: [0x83aef9] : ??() at ??:0
[EC_DRHOOK:Debian17:1:1:924005:924005] [20240617:195751:1718650671:29638.901] [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [2]: [0x1dd5490] : ??() at ??:0
[EC_DRHOOK:Debian17:1:1:924005:924005] [20240617:195751:1718650671:29638.901] [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [3]: [0x1cc6692] : ??() at ??:0
[EC_DRHOOK:Debian17:1:1:924005:924005] [20240617:195751:1718650671:29638.901] [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [4]: [0x121fd8b] : ??() at ??:0
[EC_DRHOOK:Debian17:1:1:924005:924005] [20240617:195751:1718650671:29638.901] [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [5]: [0x1207e29] : ??() at ??:0
[EC_DRHOOK:Debian17:1:1:924005:924005] [20240617:195751:1718650671:29638.901] [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [6]: [0x11fdcb2] : ??() at ??:0
[EC_DRHOOK:Debian17:1:1:924005:924005] [20240617:195751:1718650671:29638.901] [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [7]: [0xfac003] : ??() at ??:0
[EC_DRHOOK:Debian17:1:1:924005:924005] [20240617:195751:1718650671:29638.901] [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [8]: [0xf5fa6b] : ??() at ??:0
[EC_DRHOOK:Debian17:1:1:924005:924005] [20240617:195751:1718650671:29638.901] [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [9]: [0xf4dbc4] : ??() at ??:0
[EC_DRHOOK:Debian17:1:1:924005:924005] [20240617:195751:1718650671:29638.901] [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [10]: [0xbd7131] : ??() at ??:0
[EC_DRHOOK:Debian17:1:1:924005:924005] [20240617:195751:1718650671:29638.901] [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [11]: [0x12c5002] : ??() at ??:0
[EC_DRHOOK:Debian17:1:1:924005:924005] [20240617:195751:1718650671:29638.901] [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [12]: [0xbacbae] : ??() at ??:0
[EC_DRHOOK:Debian17:1:1:924005:924005] [20240617:195751:1718650671:29638.901] [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [13]: [0x688153] : ??() at ??:0
[EC_DRHOOK:Debian17:1:1:924005:924005] [20240617:195751:1718650671:29638.901] [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [14]: [0x4cd1dc] : ??() at ??:0
[EC_DRHOOK:Debian17:1:1:924005:924005] [20240617:195751:1718650671:29638.901] [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [15]: [0x4b5d85] : ??() at ??:0
[EC_DRHOOK:Debian17:1:1:924005:924005] [20240617:195751:1718650671:29638.901] [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [16]: [0x4b4f52] : ??() at ??:0
[EC_DRHOOK:Debian17:1:1:924005:924005] [20240617:195751:1718650671:29638.901] [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [17]: [0x49d638] : ??() at ??:0
[EC_DRHOOK:Debian17:1:1:924005:924005] [20240617:195751:1718650671:29638.901] [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [18]: [0x406fbd] : ??() at ??:0
[EC_DRHOOK:Debian17:1:1:924005:924005] [20240617:195751:1718650671:29638.901] [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [19]: [0x401e7f] : ??() at ??:0
[EC_DRHOOK:Debian17:1:1:924005:924005] [20240617:195751:1718650671:29638.901] [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [20]: [0x401e12] : ??() at ??:0
[EC_DRHOOK:Debian17:1:1:924005:924005] [20240617:195751:1718650671:29638.901] [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [21]: [0x1dcc34a] : ??() at ??:0
[EC_DRHOOK:Debian17:1:1:924005:924005] [20240617:195751:1718650671:29638.901] [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [22]: [0x1dcdbe7] : ??() at ??:0
[EC_DRHOOK:Debian17:1:1:924005:924005] [20240617:195751:1718650671:29638.901] [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [23]: [0x401cd5] : ??() at ??:0
[EC_DRHOOK:Debian17:1:1:924005:924005] [20240617:195751:1718650671:29638.901] [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:370] End of backtrace(s)
 Process            1  thread            1  calling linux_trbk from intel_trbk()
  [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:240] Backtrace(s) for program '/var/lib/boinc-client/slots/14/oifs_43r3_model.exe' : sigcontextptr=0x7ffef1aab3a0
  [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:277] Backtrace (size = 25) with addr2line-cmd
  [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:302] /usr/bin/addr2line -fs -e '/var/lib/boinc-client/slots/14/oifs_43r3_model.exe' 0x83a8f3 0x83aef9 0x822540 0x1dd5490 0x1cc6692 0x121fd8b 0x1207e29 0x11fdcb2 0xfac003 0xf5fa6b 0xf4dbc4 0xbd7131 0x12c5002 0xbacbae 0x688153 0x4cd1dc 0x4b5d85 0x4b4f52 0x49d638 0x406fbd 0x401e7f 0x401e12 0x1dcc34a 0x1dcdbe7 0x401cd5
  [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [0]: [0x83a8f3] : ??() at ??:0
  [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [1]: [0x83aef9] : ??() at ??:0
  [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [2]: [0x822540] : ??() at ??:0
  [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [3]: [0x1dd5490] : ??() at ??:0
  [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [4]: [0x1cc6692] : ??() at ??:0
  [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [5]: [0x121fd8b] : ??() at ??:0
  [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [6]: [0x1207e29] : ??() at ??:0
  [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [7]: [0x11fdcb2] : ??() at ??:0
  [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [8]: [0xfac003] : ??() at ??:0
  [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [9]: [0xf5fa6b] : ??() at ??:0
  [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [10]: [0xf4dbc4] : ??() at ??:0
  [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [11]: [0xbd7131] : ??() at ??:0
  [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [12]: [0x12c5002] : ??() at ??:0
  [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [13]: [0xbacbae] : ??() at ??:0
  [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [14]: [0x688153] : ??() at ??:0
  [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [15]: [0x4cd1dc] : ??() at ??:0
  [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [16]: [0x4b5d85] : ??() at ??:0
  [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [17]: [0x4b4f52] : ??() at ??:0
  [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [18]: [0x49d638] : ??() at ??:0
  [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [19]: [0x406fbd] : ??() at ??:0
  [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [20]: [0x401e7f] : ??() at ??:0
  [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [21]: [0x401e12] : ??() at ??:0
  [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [22]: [0x1dcc34a] : ??() at ??:0
  [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [23]: [0x1dcdbe7] : ??() at ??:0
  [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [24]: [0x401cd5] : ??() at ??:0
  [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:370] End of backtrace(s)
[EC_DRHOOK:Debian17:1:1:924005:924005] [20240617:195751:1718650671:29639.065] [signal_drhook@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1734] DrHook backtrace done for signal#8, nsigs = 1
[EC_DRHOOK:Debian17:1:1:924005:924005] [20240617:195751:1718650671:29639.065] [signal_drhook@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1785] Calling previous signal handler at 0x1cf8da0 for signal#8, nsigs = 1
forrtl: error (72): floating overflow
Image              PC                Routine            Line        Source             
oifs_43r3_model.e  0000000001CF935B  Unknown               Unknown  Unknown
oifs_43r3_model.e  00000000008214C1  Unknown               Unknown  Unknown
oifs_43r3_model.e  0000000001DD5490  Unknown               Unknown  Unknown
oifs_43r3_model.e  0000000001CC6692  Unknown               Unknown  Unknown
oifs_43r3_model.e  000000000121FD8B  vdfmain_                  874  vdfmain.F90
oifs_43r3_model.e  0000000001207E29  vdfouter_                 739  vdfouter.F90
oifs_43r3_model.e  00000000011FDCB2  turbulence_layer_         158  turbulence_layer.F90
oifs_43r3_model.e  0000000000FAC003  callpar_                  869  callpar.F90
oifs_43r3_model.e  0000000000F5FA6B  ec_phys_                  670  ec_phys.F90
oifs_43r3_model.e  0000000000F4DBC4  ec_phys_drv_              599  ec_phys_drv.F90
oifs_43r3_model.e  0000000000BD7131  gp_model_                 613  gp_model.F90
oifs_43r3_model.e  00000000012C5002  gp_model_heap_             74  gp_model_heap.F90
oifs_43r3_model.e  0000000000BACBAE  scan2m_                   535  scan2m.F90
oifs_43r3_model.e  0000000000688153  stepo_                    327  stepo.F90
oifs_43r3_model.e  00000000004CD1DC  cnt4_                    1133  cnt4.F90
oifs_43r3_model.e  00000000004B5D85  cnt3_                     267  cnt3.F90
oifs_43r3_model.e  00000000004B4F52  cnt2_                      88  cnt2.F90
oifs_43r3_model.e  000000000049D638  cnt1_                      92  cnt1.F90
oifs_43r3_model.e  0000000000406FBD  cnt0_                     146  cnt0.F90
oifs_43r3_model.e  0000000000401E7F  MAIN__                     96  master.F90
oifs_43r3_model.e  0000000000401E12  Unknown               Unknown  Unknown
oifs_43r3_model.e  0000000001DCC34A  Unknown               Unknown  Unknown
oifs_43r3_model.e  0000000001DCDBE7  Unknown               Unknown  Unknown
oifs_43r3_model.e  0000000000401CD5  Unknown               Unknown  Unknown
..The child process has been killed with signal: 6
>>> Printing last 70 lines from file: NODE.001_01

         AVE   0.227247419482932E+00 0.000000000000000E+00 0.100000000000000E+01
 GPNORM CLW                  AVERAGE               MINIMUM               MAXIMUM        
         AVE   0.290020554084618E-05 0.000000000000000E+00 0.778104709489695E-02
 GPNORM CIW                  AVERAGE               MINIMUM               MAXIMUM        
         AVE   0.199285138716627E-04 0.000000000000000E+00 0.113899606365287E-01
 GPNORM CC                   AVERAGE               MINIMUM               MAXIMUM        
         AVE   0.226804420384033E+00 0.000000000000000E+00 0.100000000000000E+01
 GPNORM RFL                  AVERAGE               MINIMUM               MAXIMUM        
         AVE   0.135265818772165E-04 0.000000000000000E+00 0.282554328626030E-01
 GPNORM SFL                  AVERAGE               MINIMUM               MAXIMUM        
         AVE   0.881298266205596E-05 0.000000000000000E+00 0.601894254192808E-02
 GPNORM CRFL                 AVERAGE               MINIMUM               MAXIMUM        
         AVE   0.433414907813060E-05 0.000000000000000E+00 0.144018112602994E-01
 GPNORM CSFL                 AVERAGE               MINIMUM               MAXIMUM        
         AVE   0.137906545682391E-05 0.000000000000000E+00 0.989110541807400E-02
 GPNORM PFRC                 AVERAGE               MINIMUM               MAXIMUM        
         AVE   0.158880217413772E+00 0.000000000000000E+00 0.100000000000000E+01
 NSTEP =  1224 STEPO   A00000000
  MAXGPFV : MAX. VALUE =   0.000000000000000E+000
  MAXGPFV : MAX. VALUE =   0.000000000000000E+000
 NSTEP =  1224 SCAN2M_HPOS  P
 IO-STREAM SETUP - IOTYPE =           2  NUMIOPROCS =           1  CPATH =
 ICMGGh7zg+001224 MODE=w
 IO-STREAM CLOSED - ICMGGh7zg+001224
 MPI-TASK:   1 -    322775220 BYTES IN      6 RECORDS TRANSFERRED IN    0.0004 SECONDS806938.1 Mbytes/s, TOTAL TIME=    0.0108( 3.7%)
 NSTEP =  1224 STEPO   0AA000000
 IO-STREAM SETUP - IOTYPE =           2  NUMIOPROCS =           1  CPATH =
 ./ICMSHh7zg+001224 MODE=w
 IO-STREAM CLOSED - ./ICMSHh7zg+001224
 MPI-TASK:   1 -    707399250 BYTES IN    202 RECORDS TRANSFERRED IN    0.0124 SECONDS 57048.3 Mbytes/s, TOTAL TIME=    0.3955( 3.1%)
 IO-STREAM SETUP - IOTYPE =           2  NUMIOPROCS =           1  CPATH =
 ./ICMUAh7zg+001224 MODE=w
 IO-STREAM CLOSED - ./ICMUAh7zg+001224
 MPI-TASK:   1 -   5164403520 BYTES IN    125 RECORDS TRANSFERRED IN    0.0084 SECONDS614809.9 Mbytes/s, TOTAL TIME=    0.2819( 3.0%)
 STEPO_FPOS WAS : B00000F00E
 IO-STREAM SETUP - IOTYPE =           2  NUMIOPROCS =           1  CPATH =
 ./ICMUAh7zg+001224 MODE=a
 IO-STREAM CLOSED - ./ICMUAh7zg+001224
 MPI-TASK:   1 -           10 BYTES IN      2 RECORDS TRANSFERRED IN    0.0002 SECONDS     0.1 Mbytes/s, TOTAL TIME=    0.0050( 4.0%)
 STEPO_FPOS WAS : V00000000Y
 IO-STREAM SETUP - IOTYPE =           2  NUMIOPROCS =           1  CPATH =
 ./ICMUAh7zg+001224 MODE=a
 IO-STREAM CLOSED - ./ICMUAh7zg+001224
 MPI-TASK:   1 -    314195491 BYTES IN      4 RECORDS TRANSFERRED IN    0.0003 SECONDS******** Mbytes/s, TOTAL TIME=    0.0075( 4.0%)
 STEPO_FPOS WAS : T00000000M
 NSTEP =  1224 STEPO   0AAA00AAA
  MAXGPFV : MAX. VALUE =   0.000000000000000E+000
  MAXGPFV : MAX. VALUE =   0.000000000000000E+000
 NSTEP =  1224 SCAN2M_HPOS  P
 IO-STREAM SETUP - IOTYPE =           2  NUMIOPROCS =           1  CPATH =
 ICMGGh7zg+001224 MODE=a
 IO-STREAM CLOSED - ICMGGh7zg+001224
 MPI-TASK:   1 -    322775220 BYTES IN      7 RECORDS TRANSFERRED IN    0.0006 SECONDS537958.7 Mbytes/s, TOTAL TIME=    0.0140( 4.3%)
 19:54:25 STEP 1224 H= 306:00 +CPU= 44.743
ISTEP=    1225 RSOLINC= 1361.4482 RI0= 1365.0000 ZI0= 1361.4482 RIP0= 1361.4482
ISTEP=    1225 ZI0= 1361.4482 ZSEASON= 1.000000000 REA=149597870000.00 RDEASO=149597870000.00
 NSTEP =  1225 STEPO   0AAA00AAA
 19:55:02 STEP 1225 H= 306:15 +CPU= 36.469
 NSTEP =  1226 STEPO   0AAA00AAA
 19:55:38 STEP 1226 H= 306:30 +CPU= 36.485
 NSTEP =  1227 STEPO   0AAA00AAA
 19:56:15 STEP 1227 H= 306:45 +CPU= 36.067
 NSTEP =  1228 STEPO   0AAA00AAA
 19:56:51 STEP 1228 H= 307:00 +CPU= 36.280
 NSTEP =  1229 STEPO   0AAA00AAA
 19:57:27 STEP 1229 H= 307:15 +CPU= 35.490
ISTEP=    1230 RSOLINC= 1361.4482 RI0= 1365.0000 ZI0= 1361.4482 RIP0= 1361.4482
ISTEP=    1230 ZI0= 1361.4482 ZSEASON= 1.000000000 REA=149597870000.00 RDEASO=149597870000.00
 NSTEP =  1230 STEPO   0AAA00AAA
------------------------------------------------
CNT0 not found; string returned was: 'STEPO'
>>> Printing last 8 lines from file: ifs.stat

 19:53:48 0AAA00AAA STEPO     1224     0.724    0.724    0.725    486:40  -3089:** 0.27101419158589E-04       2GB       0MB
 19:54:25 0AAA00AAA STEPO     1225    37.293   37.293   37.506    487:17  -3088:** 0.27101419158589E-04       2GB       0MB
 19:55:02 0AAA00AAA STEPO     1226    36.469   36.469   36.664    487:54  -3087:** 0.27101419158589E-04       2GB       0MB
 19:55:38 0AAA00AAA STEPO     1227    36.485   36.485   36.691    488:30  -3087:** 0.27101419158589E-04       2GB       0MB
 19:56:15 0AAA00AAA STEPO     1228    36.067   36.067   36.224    489:06  -3086:** 0.27101419158589E-04       2GB       0MB
 19:56:51 0AAA00AAA STEPO     1229    36.280   36.280   36.445    489:42  -3086:** 0.27101419158589E-04       2GB       0MB
 19:57:27 0AAA00AAA STEPO     1230    35.490   35.490   35.624    490:18  -3085:** 0.27101419158589E-04       2GB       0MB
------------------------------------------------
>>> Printing last 11 lines from file: rcf

 CSTEP   = "    1200",
 CTIME   = "00121200      ",
 NSTEPLPP        =         201,         202,          49,      228226,      228227, 2*0,        1188, 2*0,
 IPRGPNSRES      =           1,
 IPRGPEWRES      =           1,
 IPRTRWRES       =           1,
 IPRTRVRES       =           1,
 GMASS0  =  0.000000000000000E+000,
 GMASSI  =  0.000000000000000E+000
 /
------------------------------------------------
>>> Printing last 8 lines from file: /var/lib/boinc-client/slots/14/progress_file_12289553.xml

<running_values>
  <last_cpu_time>41665.900000</last_cpu_time>
  <upload_file_number>12</upload_file_number>
  <last_iter>1230</last_iter>
  <last_upload>1036800</last_upload>
  <model_completed>0</model_completed>
</running_values>
------------------------------------------------
..Failed, model did not complete successfully

</stderr_txt>
]]>
No trickles!


©2024 climateprediction.net