Name | oifs_43r3_ps_0244_1986050100_123_955_12171888_0 |
Workunit | 12171888 |
Created | 21 Dec 2022, 8:07:46 UTC |
Sent | 12 Jan 2023, 5:39:54 UTC |
Report deadline | 11 Feb 2023, 5:39:54 UTC |
Received | 12 Jan 2023, 23:53:36 UTC |
Server state | Over |
Outcome | Computation error |
Client state | Compute error |
Exit status | 196 (0x000000C4) EXIT_DISK_LIMIT_EXCEEDED |
Computer ID | 1523867 |
Run time | 11 hours 20 min 13 sec |
CPU time | 11 hours 20 min 13 sec |
Validate state | Invalid |
Credit | 4,838.40 |
Device peak FLOPS | 5.41 GFLOPS |
Application version | OpenIFS 43r3 Perturbed Surface v1.05 x86_64-pc-linux-gnu |
Peak working set size | 4,409.60 MB |
Peak swap size | 4,978.08 MB |
Peak disk usage | 7,682.34 MB |
Stderr | <core_client_version>7.16.6</core_client_version> <![CDATA[ <message> Disk usage limit exceeded</message> <stderr_txt> ignal_drhook' for signal#3 (SIGQUIT) at 0x81f820 (old at 0x1ce8bb0) [EC_DRHOOK:LinuxMint:1:1:132912:132912] [20230112:203645:1673552205:0.002] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x81f820 (old at 0x1ce8bb0) [EC_DRHOOK:LinuxMint:1:1:132912:132912] [20230112:203645:1673552205:0.002] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x81f820 (old at (nil)) [EC_DRHOOK:LinuxMint:1:1:132912:132912] [20230112:203645:1673552205:0.002] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x81f820 (old at (nil)) [EC_DRHOOK:LinuxMint:1:1:132912:132912] [20230112:203645:1673552205:0.002] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x81f820 (old at (nil)) [EC_DRHOOK:LinuxMint:1:1:132912:132912] [20230112:203645:1673552205:0.002] [catch_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef> 20:37:30 STEP 960 H= 960:00 +CPU= 38.359 20:37:51 STEP 961 H= 961:00 +CPU= 21.066 20:38:11 STEP 962 H= 962:00 +CPU= 19.523 20:38:42 STEP 963 H= 963:00 +CPU= 30.151 20:39:04 STEP 964 H= 964:00 +CPU= 21.561 20:39:25 STEP 965 H= 965:00 +CPU= 21.140 20:39:59 STEP 966 H= 966:00 +CPU= 33.433 20:40:18 STEP 967 H= 967:00 +CPU= 18.733 20:40:38 STEP 968 H= 968:00 +CPU= 19.602 20:41:11 STEP 969 H= 969:00 +CPU= 33.281 20:41:34 STEP 970 H= 970:00 +CPU= 22.152 20:41:55 STEP 971 H= 971:00 +CPU= 21.201 20:42:33 STEP 972 H= 972:00 +CPU= 37.189 Moving to projects directory: /var/lib/boinc-client/slots/6/ICMGGhq0f+000972 Moving to projects directory: /var/lib/boinc-client/slots/6/ICMSHhq0f+000972 Moving to projects directory: /var/lib/boinc-client/slots/6/ICMUAhq0f+000972 20:42:54 STEP 973 H= 973:00 +CPU= 21.259 20:43:16 STEP 974 H= 974:00 +CPU= 21.496 20:43:50 STEP 975 H= 975:00 +CPU= 32.988 20:44:12 STEP 976 H= 976:00 +CPU= 22.324 20:44:34 STEP 977 H= 977:00 +CPU= 21.205 20:45:09 STEP 978 H= 978:00 +CPU= 34.417 20:45:30 STEP 979 H= 979:00 +CPU= 21.450 20:45:53 STEP 980 H= 980:00 +CPU= 22.683 20:46:27 STEP 981 H= 981:00 +CPU= 33.217 20:46:49 STEP 982 H= 982:00 +CPU= 21.864 20:47:11 STEP 983 H= 983:00 +CPU= 21.949 20:47:51 STEP 984 H= 984:00 +CPU= 39.115 Moving to projects directory: /var/lib/boinc-client/slots/6/ICMGGhq0f+000984 Moving to projects directory: /var/lib/boinc-client/slots/6/ICMSHhq0f+000984 Moving to projects directory: /var/lib/boinc-client/slots/6/ICMUAhq0f+000984 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171888/ICMGGhq0f+000960 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171888/ICMSHhq0f+000960 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171888/ICMUAhq0f+000960 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171888/ICMGGhq0f+000972 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171888/ICMSHhq0f+000972 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171888/ICMUAhq0f+000972 Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0244_1986050100_123_955_12171888_0_r1417511287_40.zip Uploading the intermediate file: upload_file_40.zip 20:48:13 STEP 985 H= 985:00 +CPU= 21.535 20:48:35 STEP 986 H= 986:00 +CPU= 22.274 20:49:09 STEP 987 H= 987:00 +CPU= 33.646 20:49:32 STEP 988 H= 988:00 +CPU= 21.932 20:49:53 STEP 989 H= 989:00 +CPU= 21.226 20:50:28 STEP 990 H= 990:00 +CPU= 34.609 20:50:50 STEP 991 H= 991:00 +CPU= 21.272 20:51:12 STEP 992 H= 992:00 +CPU= 22.054 20:51:46 STEP 993 H= 993:00 +CPU= 33.366 20:52:08 STEP 994 H= 994:00 +CPU= 22.040 20:52:30 STEP 995 H= 995:00 +CPU= 21.238 20:53:08 STEP 996 H= 996:00 +CPU= 37.412 Moving to projects directory: /var/lib/boinc-client/slots/6/ICMGGhq0f+000996 Moving to projects directory: /var/lib/boinc-client/slots/6/ICMSHhq0f+000996 Moving to projects directory: /var/lib/boinc-client/slots/6/ICMUAhq0f+000996 20:53:30 STEP 997 H= 997:00 +CPU= 21.454 20:53:52 STEP 998 H= 998:00 +CPU= 22.511 20:54:28 STEP 999 H= 999:00 +CPU= 35.053 20:54:48 STEP 1000 H=1000:00 +CPU= 20.010 20:55:07 STEP 1001 H=1001:00 +CPU= 18.884 20:55:39 STEP 1002 H=1002:00 +CPU= 31.599 20:56:01 STEP 1003 H=1003:00 +CPU= 21.688 20:56:24 STEP 1004 H=1004:00 +CPU= 22.304 20:56:58 STEP 1005 H=1005:00 +CPU= 33.573 20:57:20 STEP 1006 H=1006:00 +CPU= 21.627 20:57:42 STEP 1007 H=1007:00 +CPU= 22.311 20:58:21 STEP 1008 H=1008:00 +CPU= 38.416 Moving to projects directory: /var/lib/boinc-client/slots/6/ICMGGhq0f+001008 Moving to projects directory: /var/lib/boinc-client/slots/6/ICMSHhq0f+001008 Moving to projects directory: /var/lib/boinc-client/slots/6/ICMUAhq0f+001008 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171888/ICMGGhq0f+000984 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171888/ICMSHhq0f+000984 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171888/ICMUAhq0f+000984 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171888/ICMGGhq0f+000996 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171888/ICMSHhq0f+000996 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171888/ICMUAhq0f+000996 Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0244_1986050100_123_955_12171888_0_r1417511287_41.zip Uploading the intermediate file: upload_file_41.zip 20:58:42 STEP 1009 H=1009:00 +CPU= 20.666 20:59:04 STEP 1010 H=1010:00 +CPU= 21.283 20:59:38 STEP 1011 H=1011:00 +CPU= 33.540 20:59:58 STEP 1012 H=1012:00 +CPU= 20.200 21:00:18 STEP 1013 H=1013:00 +CPU= 19.070 21:00:53 STEP 1014 H=1014:00 +CPU= 34.645 21:01:13 STEP 1015 H=1015:00 +CPU= 20.691 21:01:36 STEP 1016 H=1016:00 +CPU= 22.085 21:02:09 STEP 1017 H=1017:00 +CPU= 33.217 21:02:32 STEP 1018 H=1018:00 +CPU= 22.009 21:02:53 STEP 1019 H=1019:00 +CPU= 21.364 21:03:30 STEP 1020 H=1020:00 +CPU= 36.830 Moving to projects directory: /var/lib/boinc-client/slots/6/ICMGGhq0f+001020 Moving to projects directory: /var/lib/boinc-client/slots/6/ICMSHhq0f+001020 Moving to projects directory: /var/lib/boinc-client/slots/6/ICMUAhq0f+001020 21:03:51 STEP 1021 H=1021:00 +CPU= 20.731 21:04:13 STEP 1022 H=1022:00 +CPU= 21.472 21:04:47 STEP 1023 H=1023:00 +CPU= 33.363 21:05:09 STEP 1024 H=1024:00 +CPU= 21.784 21:05:30 STEP 1025 H=1025:00 +CPU= 20.871 21:06:04 STEP 1026 H=1026:00 +CPU= 33.983 21:06:26 STEP 1027 H=1027:00 +CPU= 21.131 21:06:48 STEP 1028 H=1028:00 +CPU= 21.947 21:07:21 STEP 1029 H=1029:00 +CPU= 33.230 21:07:44 STEP 1030 H=1030:00 +CPU= 22.176 21:08:05 STEP 1031 H=1031:00 +CPU= 21.168 21:08:44 STEP 1032 H=1032:00 +CPU= 38.670 Moving to projects directory: /var/lib/boinc-client/slots/6/ICMGGhq0f+001032 Moving to projects directory: /var/lib/boinc-client/slots/6/ICMSHhq0f+001032 Moving to projects directory: /var/lib/boinc-client/slots/6/ICMUAhq0f+001032 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171888/ICMGGhq0f+001008 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171888/ICMSHhq0f+001008 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171888/ICMUAhq0f+001008 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171888/ICMGGhq0f+001020 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171888/ICMSHhq0f+001020 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171888/ICMUAhq0f+001020 Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0244_1986050100_123_955_12171888_0_r1417511287_42.zip Uploading the intermediate file: upload_file_42.zip 21:09:06 STEP 1033 H=1033:00 +CPU= 21.113 21:09:28 STEP 1034 H=1034:00 +CPU= 21.821 21:10:02 STEP 1035 H=1035:00 +CPU= 33.921 21:10:24 STEP 1036 H=1036:00 +CPU= 21.344 21:10:45 STEP 1037 H=1037:00 +CPU= 20.516 21:11:19 STEP 1038 H=1038:00 +CPU= 34.120 21:11:41 STEP 1039 H=1039:00 +CPU= 21.275 21:12:03 STEP 1040 H=1040:00 +CPU= 21.681 21:12:36 STEP 1041 H=1041:00 +CPU= 33.327 21:12:58 STEP 1042 H=1042:00 +CPU= 21.596 21:13:20 STEP 1043 H=1043:00 +CPU= 21.030 21:13:57 STEP 1044 H=1044:00 +CPU= 36.807 Moving to projects directory: /var/lib/boinc-client/slots/6/ICMGGhq0f+001044 Moving to projects directory: /var/lib/boinc-client/slots/6/ICMSHhq0f+001044 Moving to projects directory: /var/lib/boinc-client/slots/6/ICMUAhq0f+001044 21:14:18 STEP 1045 H=1045:00 +CPU= 20.673 21:14:40 STEP 1046 H=1046:00 +CPU= 22.113 21:15:13 STEP 1047 H=1047:00 +CPU= 32.563 21:15:34 STEP 1048 H=1048:00 +CPU= 20.674 21:15:55 STEP 1049 H=1049:00 +CPU= 20.919 21:16:29 STEP 1050 H=1050:00 +CPU= 33.441 21:16:50 STEP 1051 H=1051:00 +CPU= 21.326 21:17:12 STEP 1052 H=1052:00 +CPU= 21.820 21:17:46 STEP 1053 H=1053:00 +CPU= 33.635 21:18:08 STEP 1054 H=1054:00 +CPU= 21.140 21:18:30 STEP 1055 H=1055:00 +CPU= 21.488 21:19:09 STEP 1056 H=1056:00 +CPU= 38.949 Moving to projects directory: /var/lib/boinc-client/slots/6/ICMGGhq0f+001056 Moving to projects directory: /var/lib/boinc-client/slots/6/ICMSHhq0f+001056 Moving to projects directory: /var/lib/boinc-client/slots/6/ICMUAhq0f+001056 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171888/ICMGGhq0f+001032 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171888/ICMSHhq0f+001032 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171888/ICMUAhq0f+001032 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171888/ICMGGhq0f+001044 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171888/ICMSHhq0f+001044 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171888/ICMUAhq0f+001044 Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0244_1986050100_123_955_12171888_0_r1417511287_43.zip Uploading the intermediate file: upload_file_43.zip 21:19:30 STEP 1057 H=1057:00 +CPU= 20.619 21:19:52 STEP 1058 H=1058:00 +CPU= 21.873 21:20:26 STEP 1059 H=1059:00 +CPU= 33.651 21:20:48 STEP 1060 H=1060:00 +CPU= 21.542 21:21:09 STEP 1061 H=1061:00 +CPU= 21.002 21:21:43 STEP 1062 H=1062:00 +CPU= 34.007 21:22:05 STEP 1063 H=1063:00 +CPU= 21.290 21:22:27 STEP 1064 H=1064:00 +CPU= 21.775 21:23:01 STEP 1065 H=1065:00 +CPU= 33.685 21:23:23 STEP 1066 H=1066:00 +CPU= 21.430 21:23:44 STEP 1067 H=1067:00 +CPU= 20.847 21:24:21 STEP 1068 H=1068:00 +CPU= 36.930 Moving to projects directory: /var/lib/boinc-client/slots/6/ICMGGhq0f+001068 Moving to projects directory: /var/lib/boinc-client/slots/6/ICMSHhq0f+001068 Moving to projects directory: /var/lib/boinc-client/slots/6/ICMUAhq0f+001068 21:24:43 STEP 1069 H=1069:00 +CPU= 21.743 21:25:05 STEP 1070 H=1070:00 +CPU= 21.919 21:25:39 STEP 1071 H=1071:00 +CPU= 33.291 21:26:01 STEP 1072 H=1072:00 +CPU= 21.720 21:26:22 STEP 1073 H=1073:00 +CPU= 21.094 21:26:56 STEP 1074 H=1074:00 +CPU= 32.905 21:27:16 STEP 1075 H=1075:00 +CPU= 20.761 21:27:38 STEP 1076 H=1076:00 +CPU= 21.719 21:28:11 STEP 1077 H=1077:00 +CPU= 32.294 21:28:33 STEP 1078 H=1078:00 +CPU= 21.629 21:28:55 STEP 1079 H=1079:00 +CPU= 21.645 21:29:34 STEP 1080 H=1080:00 +CPU= 38.782 Moving to projects directory: /var/lib/boinc-client/slots/6/ICMGGhq0f+001080 Moving to projects directory: /var/lib/boinc-client/slots/6/ICMSHhq0f+001080 Moving to projects directory: /var/lib/boinc-client/slots/6/ICMUAhq0f+001080 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171888/ICMGGhq0f+001056 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171888/ICMSHhq0f+001056 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171888/ICMUAhq0f+001056 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171888/ICMGGhq0f+001068 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171888/ICMSHhq0f+001068 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171888/ICMUAhq0f+001068 Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0244_1986050100_123_955_12171888_0_r1417511287_44.zip Uploading the intermediate file: upload_file_44.zip 21:29:55 STEP 1081 H=1081:00 +CPU= 20.944 21:30:17 STEP 1082 H=1082:00 +CPU= 21.289 21:30:51 STEP 1083 H=1083:00 +CPU= 33.555 21:31:12 STEP 1084 H=1084:00 +CPU= 21.191 21:31:33 STEP 1085 H=1085:00 +CPU= 20.808 21:32:06 STEP 1086 H=1086:00 +CPU= 32.814 21:32:28 STEP 1087 H=1087:00 +CPU= 21.486 21:32:49 STEP 1088 H=1088:00 +CPU= 20.911 21:33:22 STEP 1089 H=1089:00 +CPU= 32.839 21:33:44 STEP 1090 H=1090:00 +CPU= 21.230 21:34:05 STEP 1091 H=1091:00 +CPU= 20.873 21:34:42 STEP 1092 H=1092:00 +CPU= 36.687 Moving to projects directory: /var/lib/boinc-client/slots/6/ICMGGhq0f+001092 Moving to projects directory: /var/lib/boinc-client/slots/6/ICMSHhq0f+001092 Moving to projects directory: /var/lib/boinc-client/slots/6/ICMUAhq0f+001092 21:35:03 STEP 1093 H=1093:00 +CPU= 21.120 21:35:26 STEP 1094 H=1094:00 +CPU= 22.112 21:36:00 STEP 1095 H=1095:00 +CPU= 33.467 21:36:22 STEP 1096 H=1096:00 +CPU= 21.697 21:36:43 STEP 1097 H=1097:00 +CPU= 21.439 21:37:18 STEP 1098 H=1098:00 +CPU= 34.099 21:37:39 STEP 1099 H=1099:00 +CPU= 21.124 21:38:01 STEP 1100 H=1100:00 +CPU= 21.349 21:38:34 STEP 1101 H=1101:00 +CPU= 33.047 21:38:56 STEP 1102 H=1102:00 +CPU= 21.290 21:39:17 STEP 1103 H=1103:00 +CPU= 21.282 21:39:57 STEP 1104 H=1104:00 +CPU= 39.416 Moving to projects directory: /var/lib/boinc-client/slots/6/ICMGGhq0f+001104 Moving to projects directory: /var/lib/boinc-client/slots/6/ICMSHhq0f+001104 Moving to projects directory: /var/lib/boinc-client/slots/6/ICMUAhq0f+001104 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171888/ICMGGhq0f+001080 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171888/ICMSHhq0f+001080 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171888/ICMUAhq0f+001080 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171888/ICMGGhq0f+001092 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171888/ICMSHhq0f+001092 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171888/ICMUAhq0f+001092 Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0244_1986050100_123_955_12171888_0_r1417511287_45.zip Uploading the intermediate file: upload_file_45.zip 21:40:18 STEP 1105 H=1105:00 +CPU= 21.030 21:40:40 STEP 1106 H=1106:00 +CPU= 21.636 21:41:14 STEP 1107 H=1107:00 +CPU= 33.452 21:41:36 STEP 1108 H=1108:00 +CPU= 22.224 21:41:58 STEP 1109 H=1109:00 +CPU= 20.862 21:42:32 STEP 1110 H=1110:00 +CPU= 34.252 21:42:54 STEP 1111 H=1111:00 +CPU= 21.669 21:43:16 STEP 1112 H=1112:00 +CPU= 21.887 21:43:50 STEP 1113 H=1113:00 +CPU= 33.044 21:44:12 STEP 1114 H=1114:00 +CPU= 22.102 21:44:34 STEP 1115 H=1115:00 +CPU= 21.640 21:45:11 STEP 1116 H=1116:00 +CPU= 36.827 Moving to projects directory: /var/lib/boinc-client/slots/6/ICMGGhq0f+001116 Moving to projects directory: /var/lib/boinc-client/slots/6/ICMSHhq0f+001116 Moving to projects directory: /var/lib/boinc-client/slots/6/ICMUAhq0f+001116 21:45:33 STEP 1117 H=1117:00 +CPU= 21.679 21:45:56 STEP 1118 H=1118:00 +CPU= 22.410 21:46:29 STEP 1119 H=1119:00 +CPU= 32.547 21:46:51 STEP 1120 H=1120:00 +CPU= 21.887 21:47:11 STEP 1121 H=1121:00 +CPU= 20.407 21:47:46 STEP 1122 H=1122:00 +CPU= 34.580 21:48:08 STEP 1123 H=1123:00 +CPU= 21.307 21:48:29 STEP 1124 H=1124:00 +CPU= 21.171 21:49:04 STEP 1125 H=1125:00 +CPU= 33.696 21:49:26 STEP 1126 H=1126:00 +CPU= 21.741 21:49:47 STEP 1127 H=1127:00 +CPU= 20.894 21:50:25 STEP 1128 H=1128:00 +CPU= 38.303 Moving to projects directory: /var/lib/boinc-client/slots/6/ICMGGhq0f+001128 Moving to projects directory: /var/lib/boinc-client/slots/6/ICMSHhq0f+001128 Moving to projects directory: /var/lib/boinc-client/slots/6/ICMUAhq0f+001128 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171888/ICMGGhq0f+001104 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171888/ICMSHhq0f+001104 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171888/ICMUAhq0f+001104 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171888/ICMGGhq0f+001116 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171888/ICMSHhq0f+001116 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171888/ICMUAhq0f+001116 Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0244_1986050100_123_955_12171888_0_r1417511287_46.zip Uploading the intermediate file: upload_file_46.zip 21:50:47 STEP 1129 H=1129:00 +CPU= 21.224 21:51:09 STEP 1130 H=1130:00 +CPU= 22.286 21:51:43 STEP 1131 H=1131:00 +CPU= 33.098 21:52:05 STEP 1132 H=1132:00 +CPU= 22.153 21:52:26 STEP 1133 H=1133:00 +CPU= 20.871 21:53:01 STEP 1134 H=1134:00 +CPU= 34.415 21:53:23 STEP 1135 H=1135:00 +CPU= 21.488 21:53:48 STEP 1136 H=1136:00 +CPU= 23.006 Suspend request received from the BOINC client, suspending the child process Resuming the child process 21:54:39 STEP 1137 H=1137:00 +CPU= 34.971 21:55:03 STEP 1138 H=1138:00 +CPU= 22.536 21:55:25 STEP 1139 H=1139:00 +CPU= 21.958 21:56:05 STEP 1140 H=1140:00 +CPU= 38.039 Moving to projects directory: /var/lib/boinc-client/slots/6/ICMGGhq0f+001140 Moving to projects directory: /var/lib/boinc-client/slots/6/ICMSHhq0f+001140 Moving to projects directory: /var/lib/boinc-client/slots/6/ICMUAhq0f+001140 21:56:28 STEP 1141 H=1141:00 +CPU= 23.027 21:56:52 STEP 1142 H=1142:00 +CPU= 22.548 Quit request received from BOINC client, ending the child process (argv0) ../../projects/climateprediction.net/oifs_43r3_ps_1.05_x86_64-pc-linux-gnu (argv1) start_date: 1986050100 (argv2) exptid: hq0f (argv3) unique_member_id: 0244 (argv4) batchid: 955 (argv5) wuid: 12171888 (argv6) fclen: 123 (argv7) app_name: oifs_43r3_ps (argv8) nthreads: 1 Working directory is: /var/lib/boinc-client/slots/6 Project directory is: /var/lib/boinc-client/projects/climateprediction.net/ app name: oifs_43r3_ps version: 1.05 Location of temp folder: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171888 ..mkdir for temp folder for results failed Copying: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip to: /var/lib/boinc-client/slots/6/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip Unzipping the app zip file: /var/lib/boinc-client/slots/6/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip Copying the namelist files from: ../../projects/climateprediction.net/jf_69276309a25808d7be70dfec3928b28b to: /var/lib/boinc-client/slots/6/oifs_43r3_ps_0244_1986050100_123_955_12171888.zip Unzipping the namelist zip file: /var/lib/boinc-client/slots/6/oifs_43r3_ps_0244_1986050100_123_955_12171888.zip ic_ancil_file: ic_ancil_12171888 ifsdata_file: ifsdata_12171888 climate_data_file: clim_data_12171888 horiz_resolution: 159 vert_resolution: 60 grid_type: l_2 upload_interval: 24 utstep: 3600 nfrres: restart dump frequency (steps) 24 Copying IC ancils from: ../../projects/climateprediction.net/jf_37ad26ed28d3e1ad957325171ede5257 to: /var/lib/boinc-client/slots/6/ic_ancil_12171888.zip Unzipping the IC ancils zip file: /var/lib/boinc-client/slots/6/ic_ancil_12171888.zip ..mkdir for ifsdata folder failed Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_57ec4d766b2e0c7ca69c30ce196b495c to: /var/lib/boinc-client/slots/6/ifsdata/ifsdata_12171888.zip Unzipping the ifsdata_zip file: /var/lib/boinc-client/slots/6/ifsdata/ifsdata_12171888.zip ..mkdir for the climate data folder failed Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /var/lib/boinc-client/slots/6/159l_2/clim_data_12171888.zip Unzipping the climate data zip file: /var/lib/boinc-client/slots/6/159l_2/clim_data_12171888.zip Checking for progress XML file: /var/lib/boinc-client/slots/6/progress_file_12171888.xml Opened progress file ok : /var/lib/boinc-client/slots/6/progress_file_12171888.xml -- Model is restarting -- Adjusting last_iter, 1143, to previous model restart step. Creating progress file: /var/lib/boinc-client/slots/6/progress_file_12171888.xml last_cpu_time: 34208 upload_file_number: 47 last_iter: 1127 last_upload: 4060800 model_completed: 0 total_length_of_simulation: 10627200 result_base_name: oifs_43r3_ps_0244_1986050100_123_955_12171888_0_r1417511287 The child process has been launched with process id: 134045 Executing the command: /var/lib/boinc-client/slots/6/oifs_43r3_model.exe [EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1 [EC_DRHOOK:LinuxMint:1:1:134045:134045] [20230112:220034:1673557234:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2091] fp = 0x3129fe0 [EC_DRHOOK:LinuxMint:1:1:134045:134045] [20230112:220034:1673557234:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1 [EC_DRHOOK:LinuxMint:1:1:134045:134045] [20230112:220034:1673557234:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0) [EC_DRHOOK:LinuxMint:1:1:134045:134045] [20230112:220034:1673557234:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1 [EC_DRHOOK:LinuxMint:1:1:134045:134045] [20230112:220034:1673557234:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000 [EC_DRHOOK:LinuxMint:1:1:134045:134045] [20230112:220034:1673557234:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0 (RAND_MAX=2147483647) [EC_DRHOOK:LinuxMint:1:1:134045:134045] [20230112:220034:1673557234:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16 [EC_DRHOOK:LinuxMint:1:1:134045:134045] [20230112:220034:1673557234:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0 [EC_DRHOOK:LinuxMint:1:1:134045:134045] [20230112:220034:1673557234:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500 [EC_DRHOOK:LinuxMint:1:1:134045:134045] [20230112:220034:1673557234:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1 [EC_DRHOOK:LinuxMint:1:1:134045:134045] [20230112:220034:1673557234:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1 [EC_DRHOOK:LinuxMint:1:1:134045:134045] [20230112:220034:1673557234:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1 [EC_DRHOOK:LinuxMint:1:1:134045:134045] [20230112:220034:1673557234:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1 [EC_DRHOOK:LinuxMint:1:1:134045:134045] [20230112:220034:1673557234:0.000] [ignore_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef> [EC_DRHOOK:LinuxMint:1:1:134045:134045] [20230112:220034:1673557234:0.000] [restore_default_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef> [EC_DRHOOK:LinuxMint:1:1:134045:134045] [20230112:220034:1673557234:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x81f820 (old at 0x1ce8bb0) [EC_DRHOOK:LinuxMint:1:1:134045:134045] [20230112:220034:1673557234:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x81f820 (old at (nil)) [EC_DRHOOK:LinuxMint:1:1:134045:134045] [20230112:220034:1673557234:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x81f820 (old at 0x1ce8bb0) [EC_DRHOOK:LinuxMint:1:1:134045:134045] [20230112:220034:1673557234:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x81f820 (old at (nil)) [EC_DRHOOK:LinuxMint:1:1:134045:134045] [20230112:220034:1673557234:0.000] [trapfpe_treatment@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1 [EC_DRHOOK:LinuxMint:1:1:134045:134045] [20230112:220034:1673557234:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x81f820 (old at 0x1ce8bb0) [EC_DRHOOK:LinuxMint:1:1:134045:134045] [20230112:220034:1673557234:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x81f820 (old at 0x1ce8bb0) [EC_DRHOOK:LinuxMint:1:1:134045:134045] [20230112:220034:1673557234:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x81f820 (old at (nil)) [EC_DRHOOK:LinuxMint:1:1:134045:134045] [20230112:220034:1673557234:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x81f820 (old at 0x1ce8bb0) [EC_DRHOOK:LinuxMint:1:1:134045:134045] [20230112:220034:1673557234:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x81f820 (old at 0x1ce8bb0) [EC_DRHOOK:LinuxMint:1:1:134045:134045] [20230112:220034:1673557234:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x81f820 (old at 0x1ce8bb0) [EC_DRHOOK:LinuxMint:1:1:134045:134045] [20230112:220034:1673557234:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x81f820 (old at (nil)) [EC_DRHOOK:LinuxMint:1:1:134045:134045] [20230112:220034:1673557234:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x81f820 (old at (nil)) [EC_DRHOOK:LinuxMint:1:1:134045:134045] [20230112:220034:1673557234:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x81f820 (old at (nil)) [EC_DRHOOK:LinuxMint:1:1:134045:134045] [20230112:220034:1673557234:0.000] [catch_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef> 22:01:23 STEP 1128 H=1128:00 +CPU= 42.198 22:01:48 STEP 1129 H=1129:00 +CPU= 23.136 Suspend request received from the BOINC client, suspending the child process Resuming the child process 22:02:33 STEP 1130 H=1130:00 +CPU= 22.595 Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process 22:03:35 STEP 1131 H=1131:00 +CPU= 36.493 22:03:59 STEP 1132 H=1132:00 +CPU= 23.021 22:04:21 STEP 1133 H=1133:00 +CPU= 21.667 22:04:54 STEP 1134 H=1134:00 +CPU= 32.914 22:05:14 STEP 1135 H=1135:00 +CPU= 19.113 22:05:34 STEP 1136 H=1136:00 +CPU= 20.086 22:06:08 STEP 1137 H=1137:00 +CPU= 34.084 22:06:31 STEP 1138 H=1138:00 +CPU= 22.447 22:06:53 STEP 1139 H=1139:00 +CPU= 21.642 22:07:28 STEP 1140 H=1140:00 +CPU= 34.613 Moving to projects directory: /var/lib/boinc-client/slots/6/ICMGGhq0f+001140 Moving to projects directory: /var/lib/boinc-client/slots/6/ICMSHhq0f+001140 Moving to projects directory: /var/lib/boinc-client/slots/6/ICMUAhq0f+001140 22:07:47 STEP 1141 H=1141:00 +CPU= 19.639 22:08:09 STEP 1142 H=1142:00 +CPU= 21.007 22:08:43 STEP 1143 H=1143:00 +CPU= 33.963 22:09:05 STEP 1144 H=1144:00 +CPU= 21.655 22:09:26 STEP 1145 H=1145:00 +CPU= 21.451 22:10:02 STEP 1146 H=1146:00 +CPU= 35.028 22:10:23 STEP 1147 H=1147:00 +CPU= 21.194 22:10:45 STEP 1148 H=1148:00 +CPU= 22.074 22:11:19 STEP 1149 H=1149:00 +CPU= 33.844 22:11:42 STEP 1150 H=1150:00 +CPU= 22.165 22:12:03 STEP 1151 H=1151:00 +CPU= 21.483 22:12:42 STEP 1152 H=1152:00 +CPU= 38.588 Moving to projects directory: /var/lib/boinc-client/slots/6/ICMGGhq0f+001152 Moving to projects directory: /var/lib/boinc-client/slots/6/ICMSHhq0f+001152 Moving to projects directory: /var/lib/boinc-client/slots/6/ICMUAhq0f+001152 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171888/ICMGGhq0f+001128 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171888/ICMSHhq0f+001128 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171888/ICMUAhq0f+001128 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171888/ICMGGhq0f+001140 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171888/ICMSHhq0f+001140 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171888/ICMUAhq0f+001140 Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0244_1986050100_123_955_12171888_0_r1417511287_47.zip Uploading the intermediate file: upload_file_47.zip 22:13:03 STEP 1153 H=1153:00 +CPU= 20.688 22:13:25 STEP 1154 H=1154:00 +CPU= 22.197 22:13:59 STEP 1155 H=1155:00 +CPU= 33.490 22:14:21 STEP 1156 H=1156:00 +CPU= 21.415 22:14:41 STEP 1157 H=1157:00 +CPU= 20.656 22:15:16 STEP 1158 H=1158:00 +CPU= 34.192 22:15:37 STEP 1159 H=1159:00 +CPU= 20.621 22:15:58 STEP 1160 H=1160:00 +CPU= 21.396 22:16:33 STEP 1161 H=1161:00 +CPU= 34.070 22:16:54 STEP 1162 H=1162:00 +CPU= 21.303 22:17:15 STEP 1163 H=1163:00 +CPU= 20.975 22:17:52 STEP 1164 H=1164:00 +CPU= 36.980 Moving to projects directory: /var/lib/boinc-client/slots/6/ICMGGhq0f+001164 Moving to projects directory: /var/lib/boinc-client/slots/6/ICMSHhq0f+001164 Moving to projects directory: /var/lib/boinc-client/slots/6/ICMUAhq0f+001164 22:18:14 STEP 1165 H=1165:00 +CPU= 21.294 22:18:36 STEP 1166 H=1166:00 +CPU= 21.785 22:19:09 STEP 1167 H=1167:00 +CPU= 33.208 22:19:31 STEP 1168 H=1168:00 +CPU= 21.783 22:19:53 STEP 1169 H=1169:00 +CPU= 21.825 22:20:27 STEP 1170 H=1170:00 +CPU= 33.553 22:20:48 STEP 1171 H=1171:00 +CPU= 20.843 22:21:10 STEP 1172 H=1172:00 +CPU= 21.782 22:21:43 STEP 1173 H=1173:00 +CPU= 32.408 22:22:05 STEP 1174 H=1174:00 +CPU= 21.619 22:22:26 STEP 1175 H=1175:00 +CPU= 20.969 22:23:05 STEP 1176 H=1176:00 +CPU= 38.776 Moving to projects directory: /var/lib/boinc-client/slots/6/ICMGGhq0f+001176 Moving to projects directory: /var/lib/boinc-client/slots/6/ICMSHhq0f+001176 Moving to projects directory: /var/lib/boinc-client/slots/6/ICMUAhq0f+001176 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171888/ICMGGhq0f+001152 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171888/ICMSHhq0f+001152 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171888/ICMUAhq0f+001152 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171888/ICMGGhq0f+001164 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171888/ICMSHhq0f+001164 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171888/ICMUAhq0f+001164 Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0244_1986050100_123_955_12171888_0_r1417511287_48.zip Uploading the intermediate file: upload_file_48.zip 22:23:25 STEP 1177 H=1177:00 +CPU= 20.191 22:23:47 STEP 1178 H=1178:00 +CPU= 21.443 22:24:19 STEP 1179 H=1179:00 +CPU= 32.137 22:24:41 STEP 1180 H=1180:00 +CPU= 21.801 22:25:02 STEP 1181 H=1181:00 +CPU= 20.802 22:25:36 STEP 1182 H=1182:00 +CPU= 33.223 22:25:57 STEP 1183 H=1183:00 +CPU= 21.106 22:26:20 STEP 1184 H=1184:00 +CPU= 22.133 22:26:53 STEP 1185 H=1185:00 +CPU= 33.111 22:27:14 STEP 1186 H=1186:00 +CPU= 21.212 22:27:35 STEP 1187 H=1187:00 +CPU= 20.790 22:28:11 STEP 1188 H=1188:00 +CPU= 35.419 Moving to projects directory: /var/lib/boinc-client/slots/6/ICMGGhq0f+001188 Moving to projects directory: /var/lib/boinc-client/slots/6/ICMSHhq0f+001188 Moving to projects directory: /var/lib/boinc-client/slots/6/ICMUAhq0f+001188 22:28:33 STEP 1189 H=1189:00 +CPU= 21.500 22:28:55 STEP 1190 H=1190:00 +CPU= 22.040 22:29:28 STEP 1191 H=1191:00 +CPU= 32.933 22:29:50 STEP 1192 H=1192:00 +CPU= 21.814 22:30:12 STEP 1193 H=1193:00 +CPU= 21.635 22:30:46 STEP 1194 H=1194:00 +CPU= 33.912 22:31:07 STEP 1195 H=1195:00 +CPU= 20.669 22:31:28 STEP 1196 H=1196:00 +CPU= 21.164 22:32:01 STEP 1197 H=1197:00 +CPU= 32.744 22:32:23 STEP 1198 H=1198:00 +CPU= 21.307 22:32:44 STEP 1199 H=1199:00 +CPU= 21.388 22:33:22 STEP 1200 H=1200:00 +CPU= 37.052 Moving to projects directory: /var/lib/boinc-client/slots/6/ICMGGhq0f+001200 Moving to projects directory: /var/lib/boinc-client/slots/6/ICMSHhq0f+001200 Moving to projects directory: /var/lib/boinc-client/slots/6/ICMUAhq0f+001200 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171888/ICMGGhq0f+001176 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171888/ICMSHhq0f+001176 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171888/ICMUAhq0f+001176 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171888/ICMGGhq0f+001188 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171888/ICMSHhq0f+001188 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171888/ICMUAhq0f+001188 Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0244_1986050100_123_955_12171888_0_r1417511287_49.zip Uploading the intermediate file: upload_file_49.zip 22:33:41 STEP 1201 H=1201:00 +CPU= 19.153 22:34:00 STEP 1202 H=1202:00 +CPU= 19.217 22:34:31 STEP 1203 H=1203:00 +CPU= 30.416 22:34:52 STEP 1204 H=1204:00 +CPU= 21.111 22:35:13 STEP 1205 H=1205:00 +CPU= 20.108 22:35:43 STEP 1206 H=1206:00 +CPU= 30.612 22:36:01 STEP 1207 H=1207:00 +CPU= 17.749 22:36:19 STEP 1208 H=1208:00 +CPU= 18.170 22:36:50 STEP 1209 H=1209:00 +CPU= 30.070 22:37:10 STEP 1210 H=1210:00 +CPU= 20.089 22:37:29 STEP 1211 H=1211:00 +CPU= 19.103 22:38:04 STEP 1212 H=1212:00 +CPU= 34.576 Moving to projects directory: /var/lib/boinc-client/slots/6/ICMGGhq0f+001212 Moving to projects directory: /var/lib/boinc-client/slots/6/ICMSHhq0f+001212 Moving to projects directory: /var/lib/boinc-client/slots/6/ICMUAhq0f+001212 22:38:23 STEP 1213 H=1213:00 +CPU= 19.642 22:38:43 STEP 1214 H=1214:00 +CPU= 19.826 22:39:14 STEP 1215 H=1215:00 +CPU= 30.840 22:39:34 STEP 1216 H=1216:00 +CPU= 19.838 22:39:54 STEP 1217 H=1217:00 +CPU= 19.369 22:40:26 STEP 1218 H=1218:00 +CPU= 31.621 22:40:46 STEP 1219 H=1219:00 +CPU= 19.904 22:41:05 STEP 1220 H=1220:00 +CPU= 19.780 22:41:36 STEP 1221 H=1221:00 +CPU= 30.872 22:41:56 STEP 1222 H=1222:00 +CPU= 19.611 22:42:17 STEP 1223 H=1223:00 +CPU= 20.160 22:42:52 STEP 1224 H=1224:00 +CPU= 35.010 Moving to projects directory: /var/lib/boinc-client/slots/6/ICMGGhq0f+001224 Moving to projects directory: /var/lib/boinc-client/slots/6/ICMSHhq0f+001224 Moving to projects directory: /var/lib/boinc-client/slots/6/ICMUAhq0f+001224 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171888/ICMGGhq0f+001200 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171888/ICMSHhq0f+001200 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171888/ICMUAhq0f+001200 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171888/ICMGGhq0f+001212 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171888/ICMSHhq0f+001212 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171888/ICMUAhq0f+001212 Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0244_1986050100_123_955_12171888_0_r1417511287_50.zip Uploading the intermediate file: upload_file_50.zip 22:43:11 STEP 1225 H=1225:00 +CPU= 19.200 22:43:31 STEP 1226 H=1226:00 +CPU= 19.656 22:44:01 STEP 1227 H=1227:00 +CPU= 30.303 22:44:22 STEP 1228 H=1228:00 +CPU= 20.416 22:44:42 STEP 1229 H=1229:00 +CPU= 20.418 22:45:13 STEP 1230 H=1230:00 +CPU= 30.101 22:45:30 STEP 1231 H=1231:00 +CPU= 17.427 22:45:48 STEP 1232 H=1232:00 +CPU= 18.030 22:46:18 STEP 1233 H=1233:00 +CPU= 29.885 22:46:38 STEP 1234 H=1234:00 +CPU= 19.746 22:46:57 STEP 1235 H=1235:00 +CPU= 19.166 22:47:31 STEP 1236 H=1236:00 +CPU= 33.094 Moving to projects directory: /var/lib/boinc-client/slots/6/ICMGGhq0f+001236 Moving to projects directory: /var/lib/boinc-client/slots/6/ICMSHhq0f+001236 Moving to projects directory: /var/lib/boinc-client/slots/6/ICMUAhq0f+001236 22:47:50 STEP 1237 H=1237:00 +CPU= 19.317 22:48:10 STEP 1238 H=1238:00 +CPU= 20.110 22:48:41 STEP 1239 H=1239:00 +CPU= 30.268 22:49:01 STEP 1240 H=1240:00 +CPU= 19.928 22:49:20 STEP 1241 H=1241:00 +CPU= 18.969 22:49:50 STEP 1242 H=1242:00 +CPU= 30.282 22:50:10 STEP 1243 H=1243:00 +CPU= 19.303 22:50:30 STEP 1244 H=1244:00 +CPU= 19.836 22:51:00 STEP 1245 H=1245:00 +CPU= 30.371 22:51:20 STEP 1246 H=1246:00 +CPU= 19.873 22:51:40 STEP 1247 H=1247:00 +CPU= 20.021 22:52:16 STEP 1248 H=1248:00 +CPU= 35.829 Moving to projects directory: /var/lib/boinc-client/slots/6/ICMGGhq0f+001248 Moving to projects directory: /var/lib/boinc-client/slots/6/ICMSHhq0f+001248 Moving to projects directory: /var/lib/boinc-client/slots/6/ICMUAhq0f+001248 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171888/ICMGGhq0f+001224 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171888/ICMSHhq0f+001224 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171888/ICMUAhq0f+001224 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171888/ICMGGhq0f+001236 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171888/ICMSHhq0f+001236 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171888/ICMUAhq0f+001236 Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0244_1986050100_123_955_12171888_0_r1417511287_51.zip Uploading the intermediate file: upload_file_51.zip 22:52:36 STEP 1249 H=1249:00 +CPU= 19.483 22:52:56 STEP 1250 H=1250:00 +CPU= 19.944 22:53:27 STEP 1251 H=1251:00 +CPU= 31.306 22:53:47 STEP 1252 H=1252:00 +CPU= 19.787 22:54:07 STEP 1253 H=1253:00 +CPU= 19.686 22:54:38 STEP 1254 H=1254:00 +CPU= 31.125 22:54:58 STEP 1255 H=1255:00 +CPU= 19.378 22:55:18 STEP 1256 H=1256:00 +CPU= 19.836 22:55:49 STEP 1257 H=1257:00 +CPU= 30.517 22:56:09 STEP 1258 H=1258:00 +CPU= 19.928 22:56:28 STEP 1259 H=1259:00 +CPU= 19.202 22:57:02 STEP 1260 H=1260:00 +CPU= 33.535 Moving to projects directory: /var/lib/boinc-client/slots/6/ICMGGhq0f+001260 Moving to projects directory: /var/lib/boinc-client/slots/6/ICMSHhq0f+001260 Moving to projects directory: /var/lib/boinc-client/slots/6/ICMUAhq0f+001260 22:57:21 STEP 1261 H=1261:00 +CPU= 19.616 22:57:41 STEP 1262 H=1262:00 +CPU= 19.819 22:58:11 STEP 1263 H=1263:00 +CPU= 30.131 22:58:32 STEP 1264 H=1264:00 +CPU= 19.908 22:58:51 STEP 1265 H=1265:00 +CPU= 19.388 22:59:22 STEP 1266 H=1266:00 +CPU= 31.275 22:59:41 STEP 1267 H=1267:00 +CPU= 18.879 23:00:01 STEP 1268 H=1268:00 +CPU= 19.354 23:00:31 STEP 1269 H=1269:00 +CPU= 30.283 23:00:51 STEP 1270 H=1270:00 +CPU= 19.894 23:01:11 STEP 1271 H=1271:00 +CPU= 19.712 23:01:47 STEP 1272 H=1272:00 +CPU= 35.423 Moving to projects directory: /var/lib/boinc-client/slots/6/ICMGGhq0f+001272 Moving to projects directory: /var/lib/boinc-client/slots/6/ICMSHhq0f+001272 Moving to projects directory: /var/lib/boinc-client/slots/6/ICMUAhq0f+001272 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171888/ICMGGhq0f+001248 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171888/ICMSHhq0f+001248 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171888/ICMUAhq0f+001248 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171888/ICMGGhq0f+001260 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171888/ICMSHhq0f+001260 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171888/ICMUAhq0f+001260 Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0244_1986050100_123_955_12171888_0_r1417511287_52.zip Uploading the intermediate file: upload_file_52.zip 23:02:06 STEP 1273 H=1273:00 +CPU= 19.163 23:02:26 STEP 1274 H=1274:00 +CPU= 19.694 23:02:57 STEP 1275 H=1275:00 +CPU= 30.615 23:03:16 STEP 1276 H=1276:00 +CPU= 19.607 23:03:35 STEP 1277 H=1277:00 +CPU= 19.038 23:04:07 STEP 1278 H=1278:00 +CPU= 31.138 23:04:27 STEP 1279 H=1279:00 +CPU= 19.916 23:04:47 STEP 1280 H=1280:00 +CPU= 19.906 23:05:17 STEP 1281 H=1281:00 +CPU= 30.544 23:05:37 STEP 1282 H=1282:00 +CPU= 19.854 23:05:57 STEP 1283 H=1283:00 +CPU= 19.194 23:06:30 STEP 1284 H=1284:00 +CPU= 33.535 Moving to projects directory: /var/lib/boinc-client/slots/6/ICMGGhq0f+001284 Moving to projects directory: /var/lib/boinc-client/slots/6/ICMSHhq0f+001284 Moving to projects directory: /var/lib/boinc-client/slots/6/ICMUAhq0f+001284 23:06:49 STEP 1285 H=1285:00 +CPU= 18.880 23:07:10 STEP 1286 H=1286:00 +CPU= 20.579 23:07:41 STEP 1287 H=1287:00 +CPU= 30.714 23:08:01 STEP 1288 H=1288:00 +CPU= 20.389 23:08:21 STEP 1289 H=1289:00 +CPU= 19.572 23:08:53 STEP 1290 H=1290:00 +CPU= 31.233 23:09:12 STEP 1291 H=1291:00 +CPU= 19.086 23:09:32 STEP 1292 H=1292:00 +CPU= 19.974 23:10:02 STEP 1293 H=1293:00 +CPU= 29.928 23:10:22 STEP 1294 H=1294:00 +CPU= 19.576 23:10:42 STEP 1295 H=1295:00 +CPU= 20.068 23:11:17 STEP 1296 H=1296:00 +CPU= 35.426 Moving to projects directory: /var/lib/boinc-client/slots/6/ICMGGhq0f+001296 Moving to projects directory: /var/lib/boinc-client/slots/6/ICMSHhq0f+001296 Moving to projects directory: /var/lib/boinc-client/slots/6/ICMUAhq0f+001296 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171888/ICMGGhq0f+001272 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171888/ICMSHhq0f+001272 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171888/ICMUAhq0f+001272 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171888/ICMGGhq0f+001284 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171888/ICMSHhq0f+001284 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171888/ICMUAhq0f+001284 Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0244_1986050100_123_955_12171888_0_r1417511287_53.zip Uploading the intermediate file: upload_file_53.zip 23:11:37 STEP 1297 H=1297:00 +CPU= 19.510 23:11:57 STEP 1298 H=1298:00 +CPU= 20.061 23:12:27 STEP 1299 H=1299:00 +CPU= 30.097 23:12:48 STEP 1300 H=1300:00 +CPU= 20.176 23:13:07 STEP 1301 H=1301:00 +CPU= 18.908 23:13:38 STEP 1302 H=1302:00 +CPU= 31.453 23:13:58 STEP 1303 H=1303:00 +CPU= 19.172 23:14:18 STEP 1304 H=1304:00 +CPU= 19.932 23:14:48 STEP 1305 H=1305:00 +CPU= 30.618 23:15:08 STEP 1306 H=1306:00 +CPU= 19.886 23:15:28 STEP 1307 H=1307:00 +CPU= 19.127 23:16:01 STEP 1308 H=1308:00 +CPU= 33.381 Moving to projects directory: /var/lib/boinc-client/slots/6/ICMGGhq0f+001308 Moving to projects directory: /var/lib/boinc-client/slots/6/ICMSHhq0f+001308 Moving to projects directory: /var/lib/boinc-client/slots/6/ICMUAhq0f+001308 23:16:20 STEP 1309 H=1309:00 +CPU= 19.089 23:16:40 STEP 1310 H=1310:00 +CPU= 19.906 23:17:11 STEP 1311 H=1311:00 +CPU= 30.719 23:17:31 STEP 1312 H=1312:00 +CPU= 19.620 23:17:50 STEP 1313 H=1313:00 +CPU= 19.149 23:18:22 STEP 1314 H=1314:00 +CPU= 31.306 23:18:41 STEP 1315 H=1315:00 +CPU= 19.423 23:19:01 STEP 1316 H=1316:00 +CPU= 20.044 23:19:32 STEP 1317 H=1317:00 +CPU= 30.066 23:19:51 STEP 1318 H=1318:00 +CPU= 19.674 23:20:12 STEP 1319 H=1319:00 +CPU= 20.241 23:20:47 STEP 1320 H=1320:00 +CPU= 35.166 Moving to projects directory: /var/lib/boinc-client/slots/6/ICMGGhq0f+001320 Moving to projects directory: /var/lib/boinc-client/slots/6/ICMSHhq0f+001320 Moving to projects directory: /var/lib/boinc-client/slots/6/ICMUAhq0f+001320 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171888/ICMGGhq0f+001296 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171888/ICMSHhq0f+001296 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171888/ICMUAhq0f+001296 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171888/ICMGGhq0f+001308 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171888/ICMSHhq0f+001308 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171888/ICMUAhq0f+001308 Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0244_1986050100_123_955_12171888_0_r1417511287_54.zip Uploading the intermediate file: upload_file_54.zip 23:21:06 STEP 1321 H=1321:00 +CPU= 19.368 23:21:27 STEP 1322 H=1322:00 +CPU= 20.441 23:21:57 STEP 1323 H=1323:00 +CPU= 30.306 23:22:17 STEP 1324 H=1324:00 +CPU= 19.561 23:22:37 STEP 1325 H=1325:00 +CPU= 19.386 23:23:08 STEP 1326 H=1326:00 +CPU= 31.021 23:23:28 STEP 1327 H=1327:00 +CPU= 20.418 23:23:48 STEP 1328 H=1328:00 +CPU= 19.748 23:24:19 STEP 1329 H=1329:00 +CPU= 31.029 23:24:39 STEP 1330 H=1330:00 +CPU= 19.977 23:24:59 STEP 1331 H=1331:00 +CPU= 19.109 23:25:32 STEP 1332 H=1332:00 +CPU= 33.532 Moving to projects directory: /var/lib/boinc-client/slots/6/ICMGGhq0f+001332 Moving to projects directory: /var/lib/boinc-client/slots/6/ICMSHhq0f+001332 Moving to projects directory: /var/lib/boinc-client/slots/6/ICMUAhq0f+001332 23:25:52 STEP 1333 H=1333:00 +CPU= 19.267 23:26:12 STEP 1334 H=1334:00 +CPU= 19.901 23:26:42 STEP 1335 H=1335:00 +CPU= 30.545 23:27:02 STEP 1336 H=1336:00 +CPU= 19.656 23:27:21 STEP 1337 H=1337:00 +CPU= 19.182 23:27:53 STEP 1338 H=1338:00 +CPU= 31.084 23:28:12 STEP 1339 H=1339:00 +CPU= 19.363 23:28:32 STEP 1340 H=1340:00 +CPU= 19.944 23:29:03 STEP 1341 H=1341:00 +CPU= 30.625 23:29:23 STEP 1342 H=1342:00 +CPU= 19.617 23:29:43 STEP 1343 H=1343:00 +CPU= 20.017 23:30:19 STEP 1344 H=1344:00 +CPU= 35.710 Moving to projects directory: /var/lib/boinc-client/slots/6/ICMGGhq0f+001344 Moving to projects directory: /var/lib/boinc-client/slots/6/ICMSHhq0f+001344 Moving to projects directory: /var/lib/boinc-client/slots/6/ICMUAhq0f+001344 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171888/ICMGGhq0f+001320 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171888/ICMSHhq0f+001320 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171888/ICMUAhq0f+001320 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171888/ICMGGhq0f+001332 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171888/ICMSHhq0f+001332 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171888/ICMUAhq0f+001332 Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0244_1986050100_123_955_12171888_0_r1417511287_55.zip Uploading the intermediate file: upload_file_55.zip 23:30:38 STEP 1345 H=1345:00 +CPU= 19.046 23:30:58 STEP 1346 H=1346:00 +CPU= 20.137 23:31:29 STEP 1347 H=1347:00 +CPU= 30.376 23:31:48 STEP 1348 H=1348:00 +CPU= 19.544 23:32:08 STEP 1349 H=1349:00 +CPU= 19.329 23:32:39 STEP 1350 H=1350:00 +CPU= 31.024 23:32:58 STEP 1351 H=1351:00 +CPU= 19.316 23:33:18 STEP 1352 H=1352:00 +CPU= 19.725 23:33:49 STEP 1353 H=1353:00 +CPU= 30.575 23:34:09 STEP 1354 H=1354:00 +CPU= 19.649 23:34:28 STEP 1355 H=1355:00 +CPU= 19.529 23:35:02 STEP 1356 H=1356:00 +CPU= 34.062 Moving to projects directory: /var/lib/boinc-client/slots/6/ICMGGhq0f+001356 Moving to projects directory: /var/lib/boinc-client/slots/6/ICMSHhq0f+001356 Moving to projects directory: /var/lib/boinc-client/slots/6/ICMUAhq0f+001356 23:35:22 STEP 1357 H=1357:00 +CPU= 19.400 23:35:42 STEP 1358 H=1358:00 +CPU= 19.714 23:36:12 STEP 1359 H=1359:00 +CPU= 30.438 23:36:32 STEP 1360 H=1360:00 +CPU= 19.873 23:36:52 STEP 1361 H=1361:00 +CPU= 19.485 23:37:23 STEP 1362 H=1362:00 +CPU= 31.286 23:37:43 STEP 1363 H=1363:00 +CPU= 19.827 23:38:04 STEP 1364 H=1364:00 +CPU= 20.710 Quit request received from BOINC client, ending the child process ..Failed, model did not complete successfully (argv0) ../../projects/climateprediction.net/oifs_43r3_ps_1.05_x86_64-pc-linux-gnu (argv1) start_date: 1986050100 (argv2) exptid: hq0f (argv3) unique_member_id: 0244 (argv4) batchid: 955 (argv5) wuid: 12171888 (argv6) fclen: 123 (argv7) app_name: oifs_43r3_ps (argv8) nthreads: 1 Working directory is: /var/lib/boinc-client/slots/6 Project directory is: /var/lib/boinc-client/projects/climateprediction.net/ app name: oifs_43r3_ps version: 1.05 Location of temp folder: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171888 ..mkdir for temp folder for results failed Copying: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip to: /var/lib/boinc-client/slots/6/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip Unzipping the app zip file: /var/lib/boinc-client/slots/6/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip Copying the namelist files from: ../../projects/climateprediction.net/jf_69276309a25808d7be70dfec3928b28b to: /var/lib/boinc-client/slots/6/oifs_43r3_ps_0244_1986050100_123_955_12171888.zip Unzipping the namelist zip file: /var/lib/boinc-client/slots/6/oifs_43r3_ps_0244_1986050100_123_955_12171888.zip ic_ancil_file: ic_ancil_12171888 ifsdata_file: ifsdata_12171888 climate_data_file: clim_data_12171888 horiz_resolution: 159 vert_resolution: 60 grid_type: l_2 upload_interval: 24 utstep: 3600 nfrres: restart dump frequency (steps) 24 Copying IC ancils from: ../../projects/climateprediction.net/jf_37ad26ed28d3e1ad957325171ede5257 to: /var/lib/boinc-client/slots/6/ic_ancil_12171888.zip Unzipping the IC ancils zip file: /var/lib/boinc-client/slots/6/ic_ancil_12171888.zip ..mkdir for ifsdata folder failed Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_57ec4d766b2e0c7ca69c30ce196b495c to: /var/lib/boinc-client/slots/6/ifsdata/ifsdata_12171888.zip Unzipping the ifsdata_zip file: /var/lib/boinc-client/slots/6/ifsdata/ifsdata_12171888.zip ..mkdir for the climate data folder failed Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /var/lib/boinc-client/slots/6/159l_2/clim_data_12171888.zip Unzipping the climate data zip file: /var/lib/boinc-client/slots/6/159l_2/clim_data_12171888.zip Checking for progress XML file: /var/lib/boinc-client/slots/6/progress_file_12171888.xml Opened progress file ok : /var/lib/boinc-client/slots/6/progress_file_12171888.xml -- Model is restarting -- Adjusting last_iter, 1365, to previous model restart step. Creating progress file: /var/lib/boinc-client/slots/6/progress_file_12171888.xml last_cpu_time: 39987 upload_file_number: 56 last_iter: 1343 last_upload: 4838400 model_completed: 0 total_length_of_simulation: 10627200 result_base_name: oifs_43r3_ps_0244_1986050100_123_955_12171888_0_r1417511287 The child process has been launched with process id: 137162 Executing the command: /var/lib/boinc-client/slots/6/oifs_43r3_model.exe [EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1 [EC_DRHOOK:LinuxMint:1:1:137162:137162] [20230112:233931:1673563171:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2091] fp = 0x3129fe0 [EC_DRHOOK:LinuxMint:1:1:137162:137162] [20230112:233931:1673563171:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1 [EC_DRHOOK:LinuxMint:1:1:137162:137162] [20230112:233931:1673563171:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0) [EC_DRHOOK:LinuxMint:1:1:137162:137162] [20230112:233931:1673563171:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1 [EC_DRHOOK:LinuxMint:1:1:137162:137162] [20230112:233931:1673563171:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000 [EC_DRHOOK:LinuxMint:1:1:137162:137162] [20230112:233931:1673563171:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0 (RAND_MAX=2147483647) [EC_DRHOOK:LinuxMint:1:1:137162:137162] [20230112:233931:1673563171:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16 [EC_DRHOOK:LinuxMint:1:1:137162:137162] [20230112:233931:1673563171:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0 [EC_DRHOOK:LinuxMint:1:1:137162:137162] [20230112:233931:1673563171:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500 [EC_DRHOOK:LinuxMint:1:1:137162:137162] [20230112:233931:1673563171:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1 [EC_DRHOOK:LinuxMint:1:1:137162:137162] [20230112:233931:1673563171:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1 [EC_DRHOOK:LinuxMint:1:1:137162:137162] [20230112:233931:1673563171:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1 [EC_DRHOOK:LinuxMint:1:1:137162:137162] [20230112:233931:1673563171:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1 [EC_DRHOOK:LinuxMint:1:1:137162:137162] [20230112:233931:1673563171:0.000] [ignore_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef> [EC_DRHOOK:LinuxMint:1:1:137162:137162] [20230112:233931:1673563171:0.000] [restore_default_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef> [EC_DRHOOK:LinuxMint:1:1:137162:137162] [20230112:233931:1673563171:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x81f820 (old at 0x1ce8bb0) [EC_DRHOOK:LinuxMint:1:1:137162:137162] [20230112:233931:1673563171:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x81f820 (old at (nil)) [EC_DRHOOK:LinuxMint:1:1:137162:137162] [20230112:233931:1673563171:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x81f820 (old at 0x1ce8bb0) [EC_DRHOOK:LinuxMint:1:1:137162:137162] [20230112:233931:1673563171:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x81f820 (old at (nil)) [EC_DRHOOK:LinuxMint:1:1:137162:137162] [20230112:233931:1673563171:0.000] [trapfpe_treatment@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1 [EC_DRHOOK:LinuxMint:1:1:137162:137162] [20230112:233931:1673563171:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x81f820 (old at 0x1ce8bb0) [EC_DRHOOK:LinuxMint:1:1:137162:137162] [20230112:233931:1673563171:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x81f820 (old at 0x1ce8bb0) [EC_DRHOOK:LinuxMint:1:1:137162:137162] [20230112:233931:1673563171:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x81f820 (old at (nil)) [EC_DRHOOK:LinuxMint:1:1:137162:137162] [20230112:233931:1673563171:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x81f820 (old at 0x1ce8bb0) [EC_DRHOOK:LinuxMint:1:1:137162:137162] [20230112:233931:1673563171:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x81f820 (old at 0x1ce8bb0) [EC_DRHOOK:LinuxMint:1:1:137162:137162] [20230112:233931:1673563171:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x81f820 (old at 0x1ce8bb0) [EC_DRHOOK:LinuxMint:1:1:137162:137162] [20230112:233931:1673563171:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x81f820 (old at (nil)) [EC_DRHOOK:LinuxMint:1:1:137162:137162] [20230112:233931:1673563171:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x81f820 (old at (nil)) [EC_DRHOOK:LinuxMint:1:1:137162:137162] [20230112:233931:1673563171:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x81f820 (old at (nil)) [EC_DRHOOK:LinuxMint:1:1:137162:137162] [20230112:233931:1673563171:0.000] [catch_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef> 23:40:10 STEP 1344 H=1344:00 +CPU= 34.909 23:40:31 STEP 1345 H=1345:00 +CPU= 19.979 23:40:51 STEP 1346 H=1346:00 +CPU= 20.544 23:41:19 STEP 1347 H=1347:00 +CPU= 28.129 23:41:37 STEP 1348 H=1348:00 +CPU= 17.873 23:41:56 STEP 1349 H=1349:00 +CPU= 18.165 23:42:28 STEP 1350 H=1350:00 +CPU= 31.888 23:42:48 STEP 1351 H=1351:00 +CPU= 20.550 23:43:08 STEP 1352 H=1352:00 +CPU= 19.622 23:43:36 STEP 1353 H=1353:00 +CPU= 27.823 23:43:54 STEP 1354 H=1354:00 +CPU= 18.106 23:44:13 STEP 1355 H=1355:00 +CPU= 18.840 23:44:48 STEP 1356 H=1356:00 +CPU= 34.390 Moving to projects directory: /var/lib/boinc-client/slots/6/ICMGGhq0f+001356 Moving to projects directory: /var/lib/boinc-client/slots/6/ICMSHhq0f+001356 Moving to projects directory: /var/lib/boinc-client/slots/6/ICMUAhq0f+001356 23:45:08 STEP 1357 H=1357:00 +CPU= 20.408 23:45:27 STEP 1358 H=1358:00 +CPU= 18.514 23:45:55 STEP 1359 H=1359:00 +CPU= 27.994 23:46:13 STEP 1360 H=1360:00 +CPU= 18.029 23:46:32 STEP 1361 H=1361:00 +CPU= 19.224 23:47:05 STEP 1362 H=1362:00 +CPU= 32.151 23:47:25 STEP 1363 H=1363:00 +CPU= 20.301 23:47:46 STEP 1364 H=1364:00 +CPU= 20.299 23:48:13 STEP 1365 H=1365:00 +CPU= 27.576 23:48:31 STEP 1366 H=1366:00 +CPU= 17.787 23:48:50 STEP 1367 H=1367:00 +CPU= 18.642 23:49:26 STEP 1368 H=1368:00 +CPU= 35.620 Moving to projects directory: /var/lib/boinc-client/slots/6/ICMGGhq0f+001368 Moving to projects directory: /var/lib/boinc-client/slots/6/ICMSHhq0f+001368 Moving to projects directory: /var/lib/boinc-client/slots/6/ICMUAhq0f+001368 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171888/ICMGGhq0f+001344 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171888/ICMSHhq0f+001344 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171888/ICMUAhq0f+001344 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171888/ICMGGhq0f+001356 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171888/ICMSHhq0f+001356 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171888/ICMUAhq0f+001356 Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0244_1986050100_123_955_12171888_0_r1417511287_56.zip Uploading the intermediate file: upload_file_56.zip 23:49:45 STEP 1369 H=1369:00 +CPU= 19.489 23:50:06 STEP 1370 H=1370:00 +CPU= 20.230 23:50:37 STEP 1371 H=1371:00 +CPU= 30.796 23:50:57 STEP 1372 H=1372:00 +CPU= 20.335 23:51:17 STEP 1373 H=1373:00 +CPU= 19.729 23:51:48 STEP 1374 H=1374:00 +CPU= 31.488 23:52:08 STEP 1375 H=1375:00 +CPU= 19.316 23:52:28 STEP 1376 H=1376:00 +CPU= 19.848 23:52:58 STEP 1377 H=1377:00 +CPU= 29.931 23:53:18 STEP 1378 H=1378:00 +CPU= 19.756 Abort request received from BOINC client, ending the child process </stderr_txt> ]]> |
Latest Trickles Received | ||||||
---|---|---|---|---|---|---|
Time Sent (UTC) | Host ID | Result ID | Result Name | Timestep | CPU Time (sec) | Average (sec/TS) |
09 May 2023 16:17:07 | 1523867 | 22256272 | oifs_43r3_ps_0244_1986050100_123_955_12171888_0 | 3,456,000 | 29,416 | 0.0085 |
09 May 2023 16:17:01 | 1523867 | 22256272 | oifs_43r3_ps_0244_1986050100_123_955_12171888_0 | 2,592,000 | 22,943 | 0.0089 |
©2024 cpdn.org