<core_client_version>7.16.16</core_client_version>
<![CDATA[
<message>
Disk usage limit exceeded</message>
<stderr_txt>
Debian12:1:1:557783:557783] [20230107:183245:1673116365:0.001] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1
[EC_DRHOOK:Debian12:1:1:557783:557783] [20230107:183245:1673116365:0.001] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0)
[EC_DRHOOK:Debian12:1:1:557783:557783] [20230107:183245:1673116365:0.001] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1
[EC_DRHOOK:Debian12:1:1:557783:557783] [20230107:183245:1673116365:0.001] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000
[EC_DRHOOK:Debian12:1:1:557783:557783] [20230107:183245:1673116365:0.001] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0 (RAND_MAX=2147483647)
[EC_DRHOOK:Debian12:1:1:557783:557783] [20230107:183245:1673116365:0.001] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16
[EC_DRHOOK:Debian12:1:1:557783:557783] [20230107:183245:1673116365:0.001] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0
[EC_DRHOOK:Debian12:1:1:557783:557783] [20230107:183245:1673116365:0.001] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500
[EC_DRHOOK:Debian12:1:1:557783:557783] [20230107:183245:1673116365:0.001] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1
[EC_DRHOOK:Debian12:1:1:557783:557783] [20230107:183245:1673116365:0.001] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1
[EC_DRHOOK:Debian12:1:1:557783:557783] [20230107:183245:1673116365:0.001] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1
[EC_DRHOOK:Debian12:1:1:557783:557783] [20230107:183245:1673116365:0.001] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1
[EC_DRHOOK:Debian12:1:1:557783:557783] [20230107:183245:1673116365:0.001] [ignore_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef>
[EC_DRHOOK:Debian12:1:1:557783:557783] [20230107:183245:1673116365:0.001] [restore_default_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef>
[EC_DRHOOK:Debian12:1:1:557783:557783] [20230107:183245:1673116365:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:Debian12:1:1:557783:557783] [20230107:183245:1673116365:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x81f820 (old at (nil))
[EC_DRHOOK:Debian12:1:1:557783:557783] [20230107:183245:1673116365:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:Debian12:1:1:557783:557783] [20230107:183245:1673116365:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x81f820 (old at (nil))
[EC_DRHOOK:Debian12:1:1:557783:557783] [20230107:183245:1673116365:0.001] [trapfpe_treatment@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:Debian12:1:1:557783:557783] [20230107:183245:1673116365:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:Debian12:1:1:557783:557783] [20230107:183245:1673116365:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:Debian12:1:1:557783:557783] [20230107:183245:1673116365:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x81f820 (old at (nil))
[EC_DRHOOK:Debian12:1:1:557783:557783] [20230107:183245:1673116365:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:Debian12:1:1:557783:557783] [20230107:183245:1673116365:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:Debian12:1:1:557783:557783] [20230107:183245:1673116365:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:Debian12:1:1:557783:557783] [20230107:183245:1673116365:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x81f820 (old at (nil))
[EC_DRHOOK:Debian12:1:1:557783:557783] [20230107:183245:1673116365:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x81f820 (old at (nil))
[EC_DRHOOK:Debian12:1:1:557783:557783] [20230107:183245:1673116365:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x81f820 (old at (nil))
[EC_DRHOOK:Debian12:1:1:557783:557783] [20230107:183245:1673116365:0.001] [catch_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
18:33:55 STEP 1032 H=1032:00 +CPU= 61.514
18:34:33 STEP 1033 H=1033:00 +CPU= 32.715
18:35:08 STEP 1034 H=1034:00 +CPU= 34.486
18:35:58 STEP 1035 H=1035:00 +CPU= 48.557
18:36:36 STEP 1036 H=1036:00 +CPU= 38.000
18:37:11 STEP 1037 H=1037:00 +CPU= 34.227
18:38:04 STEP 1038 H=1038:00 +CPU= 52.133
18:38:39 STEP 1039 H=1039:00 +CPU= 33.564
18:39:19 STEP 1040 H=1040:00 +CPU= 34.875
18:40:13 STEP 1041 H=1041:00 +CPU= 52.105
18:40:52 STEP 1042 H=1042:00 +CPU= 38.822
18:41:32 STEP 1043 H=1043:00 +CPU= 39.309
18:42:47 STEP 1044 H=1044:00 +CPU= 62.085
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMGGhq0f+001044
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMSHhq0f+001044
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMUAhq0f+001044
18:43:23 STEP 1045 H=1045:00 +CPU= 36.067
18:44:02 STEP 1046 H=1046:00 +CPU= 36.454
18:45:04 STEP 1047 H=1047:00 +CPU= 61.559
18:45:44 STEP 1048 H=1048:00 +CPU= 38.629
18:46:17 STEP 1049 H=1049:00 +CPU= 32.452
18:47:07 STEP 1050 H=1050:00 +CPU= 49.679
18:47:42 STEP 1051 H=1051:00 +CPU= 33.920
18:48:16 STEP 1052 H=1052:00 +CPU= 33.750
18:49:16 STEP 1053 H=1053:00 +CPU= 59.620
18:49:55 STEP 1054 H=1054:00 +CPU= 38.372
18:50:30 STEP 1055 H=1055:00 +CPU= 33.533
18:51:33 STEP 1056 H=1056:00 +CPU= 59.428
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMGGhq0f+001056
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMSHhq0f+001056
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMUAhq0f+001056
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193762/ICMGGhq0f+001032
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193762/ICMSHhq0f+001032
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193762/ICMUAhq0f+001032
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193762/ICMGGhq0f+001044
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193762/ICMSHhq0f+001044
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193762/ICMUAhq0f+001044
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0118_2008050100_123_977_12193762_1_r682421661_43.zip
Uploading the intermediate file: upload_file_43.zip
18:52:06 STEP 1057 H=1057:00 +CPU= 32.197
18:52:38 STEP 1058 H=1058:00 +CPU= 32.180
18:53:30 STEP 1059 H=1059:00 +CPU= 51.485
18:54:04 STEP 1060 H=1060:00 +CPU= 32.815
18:54:39 STEP 1061 H=1061:00 +CPU= 32.358
18:55:29 STEP 1062 H=1062:00 +CPU= 50.008
18:55:59 STEP 1063 H=1063:00 +CPU= 29.241
18:56:34 STEP 1064 H=1064:00 +CPU= 30.205
18:57:11 STEP 1065 H=1065:00 +CPU= 37.098
18:57:38 STEP 1066 H=1066:00 +CPU= 26.844
18:58:07 STEP 1067 H=1067:00 +CPU= 28.064
18:59:24 STEP 1068 H=1068:00 +CPU= 43.374
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMGGhq0f+001068
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMSHhq0f+001068
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMUAhq0f+001068
18:59:46 STEP 1069 H=1069:00 +CPU= 22.283
19:00:13 STEP 1070 H=1070:00 +CPU= 25.286
19:00:57 STEP 1071 H=1071:00 +CPU= 38.732
19:01:23 STEP 1072 H=1072:00 +CPU= 25.589
19:01:44 STEP 1073 H=1073:00 +CPU= 21.682
19:02:30 STEP 1074 H=1074:00 +CPU= 45.599
19:03:07 STEP 1075 H=1075:00 +CPU= 23.593
19:03:32 STEP 1076 H=1076:00 +CPU= 23.676
19:04:52 STEP 1077 H=1077:00 +CPU= 39.048
19:05:24 STEP 1078 H=1078:00 +CPU= 21.903
19:05:48 STEP 1079 H=1079:00 +CPU= 22.710
19:07:06 STEP 1080 H=1080:00 +CPU= 38.760
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMGGhq0f+001080
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMSHhq0f+001080
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMUAhq0f+001080
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193762/ICMGGhq0f+001056
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193762/ICMSHhq0f+001056
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193762/ICMUAhq0f+001056
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193762/ICMGGhq0f+001068
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193762/ICMSHhq0f+001068
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193762/ICMUAhq0f+001068
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0118_2008050100_123_977_12193762_1_r682421661_44.zip
Uploading the intermediate file: upload_file_44.zip
19:07:29 STEP 1081 H=1081:00 +CPU= 22.339
19:07:55 STEP 1082 H=1082:00 +CPU= 25.916
19:08:52 STEP 1083 H=1083:00 +CPU= 37.299
19:09:16 STEP 1084 H=1084:00 +CPU= 23.318
19:09:39 STEP 1085 H=1085:00 +CPU= 22.800
19:10:15 STEP 1086 H=1086:00 +CPU= 34.971
19:10:41 STEP 1087 H=1087:00 +CPU= 25.239
19:11:09 STEP 1088 H=1088:00 +CPU= 25.683
19:11:54 STEP 1089 H=1089:00 +CPU= 34.010
19:12:21 STEP 1090 H=1090:00 +CPU= 26.763
19:12:47 STEP 1091 H=1091:00 +CPU= 25.682
19:13:37 STEP 1092 H=1092:00 +CPU= 46.110
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMGGhq0f+001092
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMSHhq0f+001092
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMUAhq0f+001092
19:14:03 STEP 1093 H=1093:00 +CPU= 25.652
19:14:32 STEP 1094 H=1094:00 +CPU= 28.641
19:15:15 STEP 1095 H=1095:00 +CPU= 41.308
19:15:43 STEP 1096 H=1096:00 +CPU= 27.500
19:16:10 STEP 1097 H=1097:00 +CPU= 26.626
19:16:53 STEP 1098 H=1098:00 +CPU= 43.040
19:17:20 STEP 1099 H=1099:00 +CPU= 26.749
19:17:51 STEP 1100 H=1100:00 +CPU= 31.055
19:18:38 STEP 1101 H=1101:00 +CPU= 41.148
19:19:04 STEP 1102 H=1102:00 +CPU= 25.719
19:19:33 STEP 1103 H=1103:00 +CPU= 26.208
19:21:48 STEP 1104 H=1104:00 +CPU= 51.304
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMGGhq0f+001104
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMSHhq0f+001104
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMUAhq0f+001104
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193762/ICMGGhq0f+001080
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193762/ICMSHhq0f+001080
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193762/ICMUAhq0f+001080
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193762/ICMGGhq0f+001092
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193762/ICMSHhq0f+001092
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193762/ICMUAhq0f+001092
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0118_2008050100_123_977_12193762_1_r682421661_45.zip
Uploading the intermediate file: upload_file_45.zip
19:22:11 STEP 1105 H=1105:00 +CPU= 22.220
19:22:39 STEP 1106 H=1106:00 +CPU= 27.979
19:23:29 STEP 1107 H=1107:00 +CPU= 41.307
19:23:54 STEP 1108 H=1108:00 +CPU= 24.961
19:24:59 STEP 1109 H=1109:00 +CPU= 25.013
19:25:43 STEP 1110 H=1110:00 +CPU= 41.637
19:26:47 STEP 1111 H=1111:00 +CPU= 25.053
19:27:10 STEP 1112 H=1112:00 +CPU= 22.282
19:30:38 STEP 1113 H=1113:00 +CPU= 45.428
19:31:11 STEP 1114 H=1114:00 +CPU= 30.511
19:32:57 STEP 1115 H=1115:00 +CPU= 28.971
19:35:21 STEP 1116 H=1116:00 +CPU= 52.431
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMGGhq0f+001116
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMSHhq0f+001116
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMUAhq0f+001116
19:35:54 STEP 1117 H=1117:00 +CPU= 30.166
19:36:26 STEP 1118 H=1118:00 +CPU= 26.700
19:37:13 STEP 1119 H=1119:00 +CPU= 45.998
19:38:06 STEP 1120 H=1120:00 +CPU= 30.594
19:39:50 STEP 1121 H=1121:00 +CPU= 28.810
19:40:41 STEP 1122 H=1122:00 +CPU= 48.336
19:41:12 STEP 1123 H=1123:00 +CPU= 30.251
19:41:44 STEP 1124 H=1124:00 +CPU= 31.363
19:42:33 STEP 1125 H=1125:00 +CPU= 48.463
19:43:03 STEP 1126 H=1126:00 +CPU= 29.875
19:43:35 STEP 1127 H=1127:00 +CPU= 31.406
19:44:46 STEP 1128 H=1128:00 +CPU= 56.108
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMGGhq0f+001128
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMSHhq0f+001128
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMUAhq0f+001128
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193762/ICMGGhq0f+001104
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193762/ICMSHhq0f+001104
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193762/ICMUAhq0f+001104
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193762/ICMGGhq0f+001116
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193762/ICMSHhq0f+001116
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193762/ICMUAhq0f+001116
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0118_2008050100_123_977_12193762_1_r682421661_46.zip
Uploading the intermediate file: upload_file_46.zip
19:45:17 STEP 1129 H=1129:00 +CPU= 29.819
19:45:49 STEP 1130 H=1130:00 +CPU= 31.932
19:47:02 STEP 1131 H=1131:00 +CPU= 45.663
19:47:34 STEP 1132 H=1132:00 +CPU= 31.475
19:48:29 STEP 1133 H=1133:00 +CPU= 30.337
19:49:51 STEP 1134 H=1134:00 +CPU= 48.247
19:50:41 STEP 1135 H=1135:00 +CPU= 31.078
19:51:11 STEP 1136 H=1136:00 +CPU= 27.719
19:52:14 STEP 1137 H=1137:00 +CPU= 46.176
19:52:46 STEP 1138 H=1138:00 +CPU= 30.461
19:54:15 STEP 1139 H=1139:00 +CPU= 26.197
19:55:04 STEP 1140 H=1140:00 +CPU= 46.487
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMGGhq0f+001140
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMSHhq0f+001140
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMUAhq0f+001140
19:55:32 STEP 1141 H=1141:00 +CPU= 28.107
19:56:02 STEP 1142 H=1142:00 +CPU= 29.736
19:58:11 STEP 1143 H=1143:00 +CPU= 46.620
19:59:04 STEP 1144 H=1144:00 +CPU= 31.224
19:59:37 STEP 1145 H=1145:00 +CPU= 31.012
20:00:40 STEP 1146 H=1146:00 +CPU= 47.222
20:02:07 STEP 1147 H=1147:00 +CPU= 29.973
20:03:39 STEP 1148 H=1148:00 +CPU= 31.906
20:07:17 STEP 1149 H=1149:00 +CPU= 41.811
20:08:52 STEP 1150 H=1150:00 +CPU= 28.091
20:09:32 STEP 1151 H=1151:00 +CPU= 27.252
20:12:34 STEP 1152 H=1152:00 +CPU= 51.152
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMGGhq0f+001152
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMSHhq0f+001152
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMUAhq0f+001152
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193762/ICMGGhq0f+001128
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193762/ICMSHhq0f+001128
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193762/ICMUAhq0f+001128
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193762/ICMGGhq0f+001140
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193762/ICMSHhq0f+001140
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193762/ICMUAhq0f+001140
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0118_2008050100_123_977_12193762_1_r682421661_47.zip
Uploading the intermediate file: upload_file_47.zip
20:13:10 STEP 1153 H=1153:00 +CPU= 30.268
20:14:45 STEP 1154 H=1154:00 +CPU= 27.430
20:18:18 STEP 1155 H=1155:00 +CPU= 44.075
20:19:42 STEP 1156 H=1156:00 +CPU= 29.005
20:20:11 STEP 1157 H=1157:00 +CPU= 27.863
20:20:57 STEP 1158 H=1158:00 +CPU= 44.962
20:21:28 STEP 1159 H=1159:00 +CPU= 30.756
20:22:00 STEP 1160 H=1160:00 +CPU= 31.735
20:23:18 STEP 1161 H=1161:00 +CPU= 47.205
20:24:15 STEP 1162 H=1162:00 +CPU= 27.757
20:24:39 STEP 1163 H=1163:00 +CPU= 23.360
20:26:04 STEP 1164 H=1164:00 +CPU= 50.890
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMGGhq0f+001164
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMSHhq0f+001164
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMUAhq0f+001164
20:27:22 STEP 1165 H=1165:00 +CPU= 26.214
20:27:51 STEP 1166 H=1166:00 +CPU= 28.052
20:30:32 STEP 1167 H=1167:00 +CPU= 45.033
20:31:21 STEP 1168 H=1168:00 +CPU= 27.710
20:31:51 STEP 1169 H=1169:00 +CPU= 29.605
20:34:45 STEP 1170 H=1170:00 +CPU= 41.474
20:35:30 STEP 1171 H=1171:00 +CPU= 29.760
20:36:02 STEP 1172 H=1172:00 +CPU= 31.584
20:37:24 STEP 1173 H=1173:00 +CPU= 44.157
20:39:53 STEP 1174 H=1174:00 +CPU= 30.565
20:41:31 STEP 1175 H=1175:00 +CPU= 29.762
20:43:36 STEP 1176 H=1176:00 +CPU= 50.030
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMGGhq0f+001176
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMSHhq0f+001176
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMUAhq0f+001176
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193762/ICMGGhq0f+001152
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193762/ICMSHhq0f+001152
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193762/ICMUAhq0f+001152
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193762/ICMGGhq0f+001164
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193762/ICMSHhq0f+001164
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193762/ICMUAhq0f+001164
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0118_2008050100_123_977_12193762_1_r682421661_48.zip
Uploading the intermediate file: upload_file_48.zip
20:44:15 STEP 1177 H=1177:00 +CPU= 24.833
20:44:39 STEP 1178 H=1178:00 +CPU= 23.507
20:45:20 STEP 1179 H=1179:00 +CPU= 40.000
20:45:50 STEP 1180 H=1180:00 +CPU= 29.874
20:47:39 STEP 1181 H=1181:00 +CPU= 25.498
20:49:23 STEP 1182 H=1182:00 +CPU= 39.415
20:50:35 STEP 1183 H=1183:00 +CPU= 24.630
20:51:04 STEP 1184 H=1184:00 +CPU= 27.543
20:51:48 STEP 1185 H=1185:00 +CPU= 42.825
20:52:17 STEP 1186 H=1186:00 +CPU= 29.113
20:52:48 STEP 1187 H=1187:00 +CPU= 30.596
20:53:44 STEP 1188 H=1188:00 +CPU= 53.260
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMGGhq0f+001188
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMSHhq0f+001188
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMUAhq0f+001188
20:54:36 STEP 1189 H=1189:00 +CPU= 24.916
20:55:05 STEP 1190 H=1190:00 +CPU= 24.097
20:55:40 STEP 1191 H=1191:00 +CPU= 34.194
20:56:07 STEP 1192 H=1192:00 +CPU= 27.254
20:56:48 STEP 1193 H=1193:00 +CPU= 26.229
20:57:31 STEP 1194 H=1194:00 +CPU= 41.324
20:58:50 STEP 1195 H=1195:00 +CPU= 25.732
20:59:22 STEP 1196 H=1196:00 +CPU= 28.748
21:00:17 STEP 1197 H=1197:00 +CPU= 43.443
21:00:43 STEP 1198 H=1198:00 +CPU= 26.366
21:01:15 STEP 1199 H=1199:00 +CPU= 27.011
Quit request received from BOINC client, ending the child process
(argv0) ../../projects/climateprediction.net/oifs_43r3_ps_1.05_x86_64-pc-linux-gnu
(argv1) start_date: 2008050100
(argv2) exptid: hq0f
(argv3) unique_member_id: 0118
(argv4) batchid: 977
(argv5) wuid: 12193762
(argv6) fclen: 123
(argv7) app_name: oifs_43r3_ps
(argv8) nthreads: 1
Working directory is: /var/lib/boinc-client/slots/7
Project directory is: /var/lib/boinc-client/projects/climateprediction.net/
app name: oifs_43r3_ps
version: 1.05
Location of temp folder: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193762
..mkdir for temp folder for results failed
Copying: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip to: /var/lib/boinc-client/slots/7/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Unzipping the app zip file: /var/lib/boinc-client/slots/7/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Copying the namelist files from: ../../projects/climateprediction.net/jf_828956fcb5b30c0d8e2b569d3b8d7bb2 to: /var/lib/boinc-client/slots/7/oifs_43r3_ps_0118_2008050100_123_977_12193762.zip
Unzipping the namelist zip file: /var/lib/boinc-client/slots/7/oifs_43r3_ps_0118_2008050100_123_977_12193762.zip
ic_ancil_file: ic_ancil_12193762
ifsdata_file: ifsdata_12193762
climate_data_file: clim_data_12193762
horiz_resolution: 159
vert_resolution: 60
grid_type: l_2
upload_interval: 24
utstep: 3600
nfrres: restart dump frequency (steps) 24
Copying IC ancils from: ../../projects/climateprediction.net/jf_2ec6c3bf7c079bd314ebf99d06bda01b to: /var/lib/boinc-client/slots/7/ic_ancil_12193762.zip
Unzipping the IC ancils zip file: /var/lib/boinc-client/slots/7/ic_ancil_12193762.zip
..mkdir for ifsdata folder failed
Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_dd20f801c03953b7583e4bb37700f387 to: /var/lib/boinc-client/slots/7/ifsdata/ifsdata_12193762.zip
Unzipping the ifsdata_zip file: /var/lib/boinc-client/slots/7/ifsdata/ifsdata_12193762.zip
..mkdir for the climate data folder failed
Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /var/lib/boinc-client/slots/7/159l_2/clim_data_12193762.zip
Unzipping the climate data zip file: /var/lib/boinc-client/slots/7/159l_2/clim_data_12193762.zip
Checking for progress XML file: /var/lib/boinc-client/slots/7/progress_file_12193762.xml
Opened progress file ok : /var/lib/boinc-client/slots/7/progress_file_12193762.xml
-- Model is restarting --
Adjusting last_iter, 1200, to previous model restart step.
Creating progress file: /var/lib/boinc-client/slots/7/progress_file_12193762.xml
last_cpu_time: 50339
upload_file_number: 49
last_iter: 1199
last_upload: 4233600
model_completed: 0
total_length_of_simulation: 10627200
result_base_name: oifs_43r3_ps_0118_2008050100_123_977_12193762_1_r682421661
The child process has been launched with process id: 558280
Executing the command: /var/lib/boinc-client/slots/7/oifs_43r3_model.exe
[EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1
[EC_DRHOOK:Debian12:1:1:558280:558280] [20230107:210657:1673125617:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2091] fp = 0x3129fe0
[EC_DRHOOK:Debian12:1:1:558280:558280] [20230107:210657:1673125617:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1
[EC_DRHOOK:Debian12:1:1:558280:558280] [20230107:210657:1673125617:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0)
[EC_DRHOOK:Debian12:1:1:558280:558280] [20230107:210657:1673125617:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1
[EC_DRHOOK:Debian12:1:1:558280:558280] [20230107:210657:1673125617:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000
[EC_DRHOOK:Debian12:1:1:558280:558280] [20230107:210657:1673125617:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0 (RAND_MAX=2147483647)
[EC_DRHOOK:Debian12:1:1:558280:558280] [20230107:210657:1673125617:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16
[EC_DRHOOK:Debian12:1:1:558280:558280] [20230107:210657:1673125617:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0
[EC_DRHOOK:Debian12:1:1:558280:558280] [20230107:210657:1673125617:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500
[EC_DRHOOK:Debian12:1:1:558280:558280] [20230107:210657:1673125617:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1
[EC_DRHOOK:Debian12:1:1:558280:558280] [20230107:210657:1673125617:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1
[EC_DRHOOK:Debian12:1:1:558280:558280] [20230107:210657:1673125617:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1
[EC_DRHOOK:Debian12:1:1:558280:558280] [20230107:210657:1673125617:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1
[EC_DRHOOK:Debian12:1:1:558280:558280] [20230107:210657:1673125617:0.000] [ignore_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef>
[EC_DRHOOK:Debian12:1:1:558280:558280] [20230107:210657:1673125617:0.000] [restore_default_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef>
[EC_DRHOOK:Debian12:1:1:558280:558280] [20230107:210657:1673125617:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:Debian12:1:1:558280:558280] [20230107:210657:1673125617:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x81f820 (old at (nil))
[EC_DRHOOK:Debian12:1:1:558280:558280] [20230107:210657:1673125617:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:Debian12:1:1:558280:558280] [20230107:210657:1673125617:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x81f820 (old at (nil))
[EC_DRHOOK:Debian12:1:1:558280:558280] [20230107:210657:1673125617:0.000] [trapfpe_treatment@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:Debian12:1:1:558280:558280] [20230107:210657:1673125617:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:Debian12:1:1:558280:558280] [20230107:210657:1673125617:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:Debian12:1:1:558280:558280] [20230107:210657:1673125617:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x81f820 (old at (nil))
[EC_DRHOOK:Debian12:1:1:558280:558280] [20230107:210657:1673125617:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:Debian12:1:1:558280:558280] [20230107:210657:1673125617:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:Debian12:1:1:558280:558280] [20230107:210657:1673125617:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:Debian12:1:1:558280:558280] [20230107:210657:1673125617:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x81f820 (old at (nil))
[EC_DRHOOK:Debian12:1:1:558280:558280] [20230107:210657:1673125617:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x81f820 (old at (nil))
[EC_DRHOOK:Debian12:1:1:558280:558280] [20230107:210657:1673125617:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x81f820 (old at (nil))
[EC_DRHOOK:Debian12:1:1:558280:558280] [20230107:210657:1673125617:0.001] [catch_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
21:08:50 STEP 1200 H=1200:00 +CPU= 85.273
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMGGhq0f+001200
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMSHhq0f+001200
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMUAhq0f+001200
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193762/ICMGGhq0f+001176
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193762/ICMSHhq0f+001176
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193762/ICMUAhq0f+001176
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193762/ICMGGhq0f+001188
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193762/ICMSHhq0f+001188
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193762/ICMUAhq0f+001188
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0118_2008050100_123_977_12193762_1_r682421661_49.zip
Uploading the intermediate file: upload_file_49.zip
Quit request received from BOINC client, ending the child process
(argv0) ../../projects/climateprediction.net/oifs_43r3_ps_1.05_x86_64-pc-linux-gnu
(argv1) start_date: 2008050100
(argv2) exptid: hq0f
(argv3) unique_member_id: 0118
(argv4) batchid: 977
(argv5) wuid: 12193762
(argv6) fclen: 123
(argv7) app_name: oifs_43r3_ps
(argv8) nthreads: 1
Working directory is: /var/lib/boinc-client/slots/7
Project directory is: /var/lib/boinc-client/projects/climateprediction.net/
app name: oifs_43r3_ps
version: 1.05
Location of temp folder: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193762
..mkdir for temp folder for results failed
Copying: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip to: /var/lib/boinc-client/slots/7/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Unzipping the app zip file: /var/lib/boinc-client/slots/7/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Copying the namelist files from: ../../projects/climateprediction.net/jf_828956fcb5b30c0d8e2b569d3b8d7bb2 to: /var/lib/boinc-client/slots/7/oifs_43r3_ps_0118_2008050100_123_977_12193762.zip
Unzipping the namelist zip file: /var/lib/boinc-client/slots/7/oifs_43r3_ps_0118_2008050100_123_977_12193762.zip
ic_ancil_file: ic_ancil_12193762
ifsdata_file: ifsdata_12193762
climate_data_file: clim_data_12193762
horiz_resolution: 159
vert_resolution: 60
grid_type: l_2
upload_interval: 24
utstep: 3600
nfrres: restart dump frequency (steps) 24
Copying IC ancils from: ../../projects/climateprediction.net/jf_2ec6c3bf7c079bd314ebf99d06bda01b to: /var/lib/boinc-client/slots/7/ic_ancil_12193762.zip
Unzipping the IC ancils zip file: /var/lib/boinc-client/slots/7/ic_ancil_12193762.zip
..mkdir for ifsdata folder failed
Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_dd20f801c03953b7583e4bb37700f387 to: /var/lib/boinc-client/slots/7/ifsdata/ifsdata_12193762.zip
Unzipping the ifsdata_zip file: /var/lib/boinc-client/slots/7/ifsdata/ifsdata_12193762.zip
..mkdir for the climate data folder failed
Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /var/lib/boinc-client/slots/7/159l_2/clim_data_12193762.zip
Unzipping the climate data zip file: /var/lib/boinc-client/slots/7/159l_2/clim_data_12193762.zip
Checking for progress XML file: /var/lib/boinc-client/slots/7/progress_file_12193762.xml
Opened progress file ok : /var/lib/boinc-client/slots/7/progress_file_12193762.xml
-- Model is restarting --
Adjusting last_iter, 1201, to previous model restart step.
Creating progress file: /var/lib/boinc-client/slots/7/progress_file_12193762.xml
last_cpu_time: 50463
upload_file_number: 50
last_iter: 1199
last_upload: 4320000
model_completed: 0
total_length_of_simulation: 10627200
result_base_name: oifs_43r3_ps_0118_2008050100_123_977_12193762_1_r682421661
The child process has been launched with process id: 558375
Executing the command: /var/lib/boinc-client/slots/7/oifs_43r3_model.exe
[EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1
[EC_DRHOOK:Debian12:1:1:558375:558375] [20230107:211850:1673126330:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2091] fp = 0x3129fe0
[EC_DRHOOK:Debian12:1:1:558375:558375] [20230107:211850:1673126330:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1
[EC_DRHOOK:Debian12:1:1:558375:558375] [20230107:211850:1673126330:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0)
[EC_DRHOOK:Debian12:1:1:558375:558375] [20230107:211850:1673126330:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1
[EC_DRHOOK:Debian12:1:1:558375:558375] [20230107:211850:1673126330:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000
[EC_DRHOOK:Debian12:1:1:558375:558375] [20230107:211850:1673126330:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0 (RAND_MAX=2147483647)
[EC_DRHOOK:Debian12:1:1:558375:558375] [20230107:211850:1673126330:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16
[EC_DRHOOK:Debian12:1:1:558375:558375] [20230107:211850:1673126330:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0
[EC_DRHOOK:Debian12:1:1:558375:558375] [20230107:211850:1673126330:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500
[EC_DRHOOK:Debian12:1:1:558375:558375] [20230107:211850:1673126330:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1
[EC_DRHOOK:Debian12:1:1:558375:558375] [20230107:211850:1673126330:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1
[EC_DRHOOK:Debian12:1:1:558375:558375] [20230107:211850:1673126330:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1
[EC_DRHOOK:Debian12:1:1:558375:558375] [20230107:211850:1673126330:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1
[EC_DRHOOK:Debian12:1:1:558375:558375] [20230107:211850:1673126330:0.000] [ignore_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef>
[EC_DRHOOK:Debian12:1:1:558375:558375] [20230107:211850:1673126330:0.000] [restore_default_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef>
[EC_DRHOOK:Debian12:1:1:558375:558375] [20230107:211850:1673126330:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:Debian12:1:1:558375:558375] [20230107:211850:1673126330:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x81f820 (old at (nil))
[EC_DRHOOK:Debian12:1:1:558375:558375] [20230107:211850:1673126330:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:Debian12:1:1:558375:558375] [20230107:211850:1673126330:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x81f820 (old at (nil))
[EC_DRHOOK:Debian12:1:1:558375:558375] [20230107:211850:1673126330:0.000] [trapfpe_treatment@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:Debian12:1:1:558375:558375] [20230107:211850:1673126330:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:Debian12:1:1:558375:558375] [20230107:211850:1673126330:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:Debian12:1:1:558375:558375] [20230107:211850:1673126330:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x81f820 (old at (nil))
[EC_DRHOOK:Debian12:1:1:558375:558375] [20230107:211850:1673126330:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:Debian12:1:1:558375:558375] [20230107:211850:1673126330:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:Debian12:1:1:558375:558375] [20230107:211850:1673126330:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:Debian12:1:1:558375:558375] [20230107:211850:1673126330:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x81f820 (old at (nil))
[EC_DRHOOK:Debian12:1:1:558375:558375] [20230107:211850:1673126330:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x81f820 (old at (nil))
[EC_DRHOOK:Debian12:1:1:558375:558375] [20230107:211850:1673126330:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x81f820 (old at (nil))
[EC_DRHOOK:Debian12:1:1:558375:558375] [20230107:211850:1673126330:0.000] [catch_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
Quit request received from BOINC client, ending the child process
..Failed, model did not complete successfully
(argv0) ../../projects/climateprediction.net/oifs_43r3_ps_1.05_x86_64-pc-linux-gnu
(argv1) start_date: 2008050100
(argv2) exptid: hq0f
(argv3) unique_member_id: 0118
(argv4) batchid: 977
(argv5) wuid: 12193762
(argv6) fclen: 123
(argv7) app_name: oifs_43r3_ps
(argv8) nthreads: 1
Working directory is: /var/lib/boinc-client/slots/7
Project directory is: /var/lib/boinc-client/projects/climateprediction.net/
app name: oifs_43r3_ps
version: 1.05
Location of temp folder: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193762
..mkdir for temp folder for results failed
Copying: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip to: /var/lib/boinc-client/slots/7/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Unzipping the app zip file: /var/lib/boinc-client/slots/7/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Copying the namelist files from: ../../projects/climateprediction.net/jf_828956fcb5b30c0d8e2b569d3b8d7bb2 to: /var/lib/boinc-client/slots/7/oifs_43r3_ps_0118_2008050100_123_977_12193762.zip
Unzipping the namelist zip file: /var/lib/boinc-client/slots/7/oifs_43r3_ps_0118_2008050100_123_977_12193762.zip
ic_ancil_file: ic_ancil_12193762
ifsdata_file: ifsdata_12193762
climate_data_file: clim_data_12193762
horiz_resolution: 159
vert_resolution: 60
grid_type: l_2
upload_interval: 24
utstep: 3600
nfrres: restart dump frequency (steps) 24
Copying IC ancils from: ../../projects/climateprediction.net/jf_2ec6c3bf7c079bd314ebf99d06bda01b to: /var/lib/boinc-client/slots/7/ic_ancil_12193762.zip
Unzipping the IC ancils zip file: /var/lib/boinc-client/slots/7/ic_ancil_12193762.zip
..mkdir for ifsdata folder failed
Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_dd20f801c03953b7583e4bb37700f387 to: /var/lib/boinc-client/slots/7/ifsdata/ifsdata_12193762.zip
Unzipping the ifsdata_zip file: /var/lib/boinc-client/slots/7/ifsdata/ifsdata_12193762.zip
..mkdir for the climate data folder failed
Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /var/lib/boinc-client/slots/7/159l_2/clim_data_12193762.zip
Unzipping the climate data zip file: /var/lib/boinc-client/slots/7/159l_2/clim_data_12193762.zip
Checking for progress XML file: /var/lib/boinc-client/slots/7/progress_file_12193762.xml
Opened progress file ok : /var/lib/boinc-client/slots/7/progress_file_12193762.xml
-- Model is restarting --
Adjusting last_iter, 1200, to previous model restart step.
Creating progress file: /var/lib/boinc-client/slots/7/progress_file_12193762.xml
last_cpu_time: 50539
upload_file_number: 50
last_iter: 1199
last_upload: 4320000
model_completed: 0
total_length_of_simulation: 10627200
result_base_name: oifs_43r3_ps_0118_2008050100_123_977_12193762_1_r682421661
The child process has been launched with process id: 558739
Executing the command: /var/lib/boinc-client/slots/7/oifs_43r3_model.exe
[EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1
[EC_DRHOOK:Debian12:1:1:558739:558739] [20230107:231449:1673133289:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2091] fp = 0x3129fe0
[EC_DRHOOK:Debian12:1:1:558739:558739] [20230107:231449:1673133289:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1
[EC_DRHOOK:Debian12:1:1:558739:558739] [20230107:231449:1673133289:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0)
[EC_DRHOOK:Debian12:1:1:558739:558739] [20230107:231449:1673133289:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1
[EC_DRHOOK:Debian12:1:1:558739:558739] [20230107:231449:1673133289:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000
[EC_DRHOOK:Debian12:1:1:558739:558739] [20230107:231449:1673133289:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0 (RAND_MAX=2147483647)
[EC_DRHOOK:Debian12:1:1:558739:558739] [20230107:231449:1673133289:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16
[EC_DRHOOK:Debian12:1:1:558739:558739] [20230107:231449:1673133289:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0
[EC_DRHOOK:Debian12:1:1:558739:558739] [20230107:231449:1673133289:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500
[EC_DRHOOK:Debian12:1:1:558739:558739] [20230107:231449:1673133289:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1
[EC_DRHOOK:Debian12:1:1:558739:558739] [20230107:231449:1673133289:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1
[EC_DRHOOK:Debian12:1:1:558739:558739] [20230107:231449:1673133289:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1
[EC_DRHOOK:Debian12:1:1:558739:558739] [20230107:231449:1673133289:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1
[EC_DRHOOK:Debian12:1:1:558739:558739] [20230107:231449:1673133289:0.001] [ignore_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef>
[EC_DRHOOK:Debian12:1:1:558739:558739] [20230107:231449:1673133289:0.001] [restore_default_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef>
[EC_DRHOOK:Debian12:1:1:558739:558739] [20230107:231449:1673133289:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:Debian12:1:1:558739:558739] [20230107:231449:1673133289:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x81f820 (old at (nil))
[EC_DRHOOK:Debian12:1:1:558739:558739] [20230107:231449:1673133289:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:Debian12:1:1:558739:558739] [20230107:231449:1673133289:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x81f820 (old at (nil))
[EC_DRHOOK:Debian12:1:1:558739:558739] [20230107:231449:1673133289:0.001] [trapfpe_treatment@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:Debian12:1:1:558739:558739] [20230107:231449:1673133289:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:Debian12:1:1:558739:558739] [20230107:231449:1673133289:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:Debian12:1:1:558739:558739] [20230107:231449:1673133289:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x81f820 (old at (nil))
[EC_DRHOOK:Debian12:1:1:558739:558739] [20230107:231449:1673133289:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:Debian12:1:1:558739:558739] [20230107:231449:1673133289:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:Debian12:1:1:558739:558739] [20230107:231449:1673133289:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:Debian12:1:1:558739:558739] [20230107:231449:1673133289:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x81f820 (old at (nil))
[EC_DRHOOK:Debian12:1:1:558739:558739] [20230107:231449:1673133289:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x81f820 (old at (nil))
[EC_DRHOOK:Debian12:1:1:558739:558739] [20230107:231449:1673133289:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x81f820 (old at (nil))
[EC_DRHOOK:Debian12:1:1:558739:558739] [20230107:231449:1673133289:0.001] [catch_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
08:42:15 STEP 1200 H=1200:00 +CPU= 69.367
08:49:28 STEP 1201 H=1201:00 +CPU= 45.157
08:50:18 STEP 1202 H=1202:00 +CPU= 47.229
08:51:29 STEP 1203 H=1203:00 +CPU= 68.439
08:52:14 STEP 1204 H=1204:00 +CPU= 43.912
08:52:58 STEP 1205 H=1205:00 +CPU= 43.406
08:54:08 STEP 1206 H=1206:00 +CPU= 68.198
08:54:52 STEP 1207 H=1207:00 +CPU= 43.351
08:55:39 STEP 1208 H=1208:00 +CPU= 46.382
08:56:50 STEP 1209 H=1209:00 +CPU= 69.901
Quit request received from BOINC client, ending the child process
(argv0) ../../projects/climateprediction.net/oifs_43r3_ps_1.05_x86_64-pc-linux-gnu
(argv1) start_date: 2008050100
(argv2) exptid: hq0f
(argv3) unique_member_id: 0118
(argv4) batchid: 977
(argv5) wuid: 12193762
(argv6) fclen: 123
(argv7) app_name: oifs_43r3_ps
(argv8) nthreads: 1
Working directory is: /var/lib/boinc-client/slots/7
Project directory is: /var/lib/boinc-client/projects/climateprediction.net/
app name: oifs_43r3_ps
version: 1.05
Location of temp folder: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12193762
..mkdir for temp folder for results failed
Copying: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip to: /var/lib/boinc-client/slots/7/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Unzipping the app zip file: /var/lib/boinc-client/slots/7/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Copying the namelist files from: ../../projects/climateprediction.net/jf_828956fcb5b30c0d8e2b569d3b8d7bb2 to: /var/lib/boinc-client/slots/7/oifs_43r3_ps_0118_2008050100_123_977_12193762.zip
Unzipping the namelist zip file: /var/lib/boinc-client/slots/7/oifs_43r3_ps_0118_2008050100_123_977_12193762.zip
ic_ancil_file: ic_ancil_12193762
ifsdata_file: ifsdata_12193762
climate_data_file: clim_data_12193762
horiz_resolution: 159
vert_resolution: 60
grid_type: l_2
upload_interval: 24
utstep: 3600
nfrres: restart dump frequency (steps) 24
Copying IC ancils from: ../../projects/climateprediction.net/jf_2ec6c3bf7c079bd314ebf99d06bda01b to: /var/lib/boinc-client/slots/7/ic_ancil_12193762.zip
Unzipping the IC ancils zip file: /var/lib/boinc-client/slots/7/ic_ancil_12193762.zip
..mkdir for ifsdata folder failed
Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_dd20f801c03953b7583e4bb37700f387 to: /var/lib/boinc-client/slots/7/ifsdata/ifsdata_12193762.zip
Unzipping the ifsdata_zip file: /var/lib/boinc-client/slots/7/ifsdata/ifsdata_12193762.zip
..mkdir for the climate data folder failed
Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /var/lib/boinc-client/slots/7/159l_2/clim_data_12193762.zip
Unzipping the climate data zip file: /var/lib/boinc-client/slots/7/159l_2/clim_data_12193762.zip
Checking for progress XML file: /var/lib/boinc-client/slots/7/progress_file_12193762.xml
Opened progress file ok : /var/lib/boinc-client/slots/7/progress_file_12193762.xml
-- Model is restarting --
Adjusting last_iter, 1210, to previous model restart step.
Creating progress file: /var/lib/boinc-client/slots/7/progress_file_12193762.xml
last_cpu_time: 51124
upload_file_number: 50
last_iter: 1199
last_upload: 4320000
model_completed: 0
total_length_of_simulation: 10627200
result_base_name: oifs_43r3_ps_0118_2008050100_123_977_12193762_1_r682421661
The child process has been launched with process id: 569835
Executing the command: /var/lib/boinc-client/slots/7/oifs_43r3_model.exe
[EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1
[EC_DRHOOK:Debian12:1:1:569835:569835] [20230109:155002:1673279402:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2091] fp = 0x3129fe0
[EC_DRHOOK:Debian12:1:1:569835:569835] [20230109:155002:1673279402:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1
[EC_DRHOOK:Debian12:1:1:569835:569835] [20230109:155002:1673279402:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0)
[EC_DRHOOK:Debian12:1:1:569835:569835] [20230109:155002:1673279402:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1
[EC_DRHOOK:Debian12:1:1:569835:569835] [20230109:155002:1673279402:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000
[EC_DRHOOK:Debian12:1:1:569835:569835] [20230109:155002:1673279402:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0 (RAND_MAX=2147483647)
[EC_DRHOOK:Debian12:1:1:569835:569835] [20230109:155002:1673279402:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16
[EC_DRHOOK:Debian12:1:1:569835:569835] [20230109:155002:1673279402:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0
[EC_DRHOOK:Debian12:1:1:569835:569835] [20230109:155002:1673279402:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500
[EC_DRHOOK:Debian12:1:1:569835:569835] [20230109:155002:1673279402:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1
[EC_DRHOOK:Debian12:1:1:569835:569835] [20230109:155002:1673279402:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1
[EC_DRHOOK:Debian12:1:1:569835:569835] [20230109:155002:1673279402:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1
[EC_DRHOOK:Debian12:1:1:569835:569835] [20230109:155002:1673279402:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1
[EC_DRHOOK:Debian12:1:1:569835:569835] [20230109:155002:1673279402:0.000] [ignore_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef>
[EC_DRHOOK:Debian12:1:1:569835:569835] [20230109:155002:1673279402:0.000] [restore_default_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef>
[EC_DRHOOK:Debian12:1:1:569835:569835] [20230109:155002:1673279402:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:Debian12:1:1:569835:569835] [20230109:155002:1673279402:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x81f820 (old at (nil))
[EC_DRHOOK:Debian12:1:1:569835:569835] [20230109:155002:1673279402:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:Debian12:1:1:569835:569835] [20230109:155002:1673279402:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x81f820 (old at (nil))
[EC_DRHOOK:Debian12:1:1:569835:569835] [20230109:155002:1673279402:0.000] [trapfpe_treatment@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:Debian12:1:1:569835:569835] [20230109:155002:1673279402:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:Debian12:1:1:569835:569835] [20230109:155002:1673279402:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:Debian12:1:1:569835:569835] [20230109:155002:1673279402:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x81f820 (old at (nil))
[EC_DRHOOK:Debian12:1:1:569835:569835] [20230109:155002:1673279402:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:Debian12:1:1:569835:569835] [20230109:155002:1673279402:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:Debian12:1:1:569835:569835] [20230109:155002:1673279402:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:Debian12:1:1:569835:569835] [20230109:155002:1673279402:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x81f820 (old at (nil))
[EC_DRHOOK:Debian12:1:1:569835:569835] [20230109:155002:1673279402:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x81f820 (old at (nil))
[EC_DRHOOK:Debian12:1:1:569835:569835] [20230109:155002:1673279402:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x81f820 (old at (nil))
[EC_DRHOOK:Debian12:1:1:569835:569835] [20230109:155002:1673279402:0.001] [catch_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
08:29:25 STEP 1200 H=1200:00 +CPU= 73.314
08:44:28 STEP 1201 H=1201:00 +CPU= 46.422
08:45:04 STEP 1202 H=1202:00 +CPU= 35.397
08:46:24 STEP 1203 H=1203:00 +CPU= 56.333
08:47:10 STEP 1204 H=1204:00 +CPU= 45.142
08:47:59 STEP 1205 H=1205:00 +CPU= 48.059
08:49:18 STEP 1206 H=1206:00 +CPU= 64.434
08:50:09 STEP 1207 H=1207:00 +CPU= 49.840
08:50:56 STEP 1208 H=1208:00 +CPU= 46.942
08:52:39 STEP 1209 H=1209:00 +CPU= 73.830
08:53:35 STEP 1210 H=1210:00 +CPU= 55.368
08:54:25 STEP 1211 H=1211:00 +CPU= 48.714
09:02:12 STEP 1212 H=1212:00 +CPU= 68.502
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMGGhq0f+001212
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMSHhq0f+001212
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMUAhq0f+001212
09:02:48 STEP 1213 H=1213:00 +CPU= 35.740
09:03:26 STEP 1214 H=1214:00 +CPU= 37.906
09:04:24 STEP 1215 H=1215:00 +CPU= 55.625
09:04:57 STEP 1216 H=1216:00 +CPU= 33.392
09:05:34 STEP 1217 H=1217:00 +CPU= 36.630
09:06:36 STEP 1218 H=1218:00 +CPU= 55.365
09:07:18 STEP 1219 H=1219:00 +CPU= 40.586
09:07:59 STEP 1220 H=1220:00 +CPU= 40.298
09:08:56 STEP 1221 H=1221:00 +CPU= 56.322
09:09:44 STEP 1222 H=1222:00 +CPU= 36.415
09:10:15 STEP 1223 H=1223:00 +CPU= 30.090
Abort request received from BOINC client, ending the child process
</stderr_txt>
]]>
