Name | oifs_43r3_bl_a0mi_2016092300_15_991_12207597_1 |
Workunit | 12207597 |
Created | 28 Feb 2023, 3:15:35 UTC |
Sent | 28 Feb 2023, 3:16:39 UTC |
Report deadline | 29 Apr 2023, 3:16:39 UTC |
Received | 1 Mar 2023, 17:41:49 UTC |
Server state | Over |
Outcome | Computation error |
Client state | Compute error |
Exit status | 1 (0x00000001) Unknown error code |
Computer ID | 1536271 |
Run time | 1 hours 32 min 59 sec |
CPU time | 1 hours 31 min 53 sec |
Validate state | Invalid |
Credit | 0.00 |
Device peak FLOPS | 8.56 GFLOPS |
Application version | OpenIFS 43r3 Baroclinic Lifecycle v1.11 x86_64-pc-linux-gnu |
Peak working set size | 5,075.95 MB |
Peak swap size | 5,930.79 MB |
Peak disk usage | 1,382.30 MB |
Stderr | <core_client_version>7.20.5</core_client_version> <![CDATA[ <message> process exited with code 1 (0x1, -255)</message> <stderr_txt> _oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x81f520 (old at 0x401140) [EC_DRHOOK:boinc-climateprediction:1:1:71060:71060] [20230301:082757:1677684477:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x81f520 (old at (nil)) [EC_DRHOOK:boinc-climateprediction:1:1:71060:71060] [20230301:082757:1677684477:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x81f520 (old at 0x401140) [EC_DRHOOK:boinc-climateprediction:1:1:71060:71060] [20230301:082757:1677684477:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x81f520 (old at 0x401140) [EC_DRHOOK:boinc-climateprediction:1:1:71060:71060] [20230301:082757:1677684477:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x81f520 (old at 0x401140) [EC_DRHOOK:boinc-climateprediction:1:1:71060:71060] [20230301:082757:1677684477:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x81f520 (old at (nil)) [EC_DRHOOK:boinc-climateprediction:1:1:71060:71060] [20230301:082757:1677684477:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x81f520 (old at (nil)) [EC_DRHOOK:boinc-climateprediction:1:1:71060:71060] [20230301:082757:1677684477:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x81f520 (old at (nil)) [EC_DRHOOK:boinc-climateprediction:1:1:71060:71060] [20230301:082757:1677684477:0.000] [catch_signals@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef> 08:28:16 STEP 0 H= 0:00 +CPU= 16.551 Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGh7zg+000000 Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHh7zg+000000 Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAh7zg+000000 08:28:30 STEP 1 H= 0:15 +CPU= 14.268 08:28:43 STEP 2 H= 0:30 +CPU= 12.815 08:28:55 STEP 3 H= 0:45 +CPU= 12.236 08:29:08 STEP 4 H= 1:00 +CPU= 12.429 08:29:20 STEP 5 H= 1:15 +CPU= 12.053 08:29:32 STEP 6 H= 1:30 +CPU= 12.579 08:29:46 STEP 7 H= 1:45 +CPU= 13.323 08:29:58 STEP 8 H= 2:00 +CPU= 12.474 08:30:10 STEP 9 H= 2:15 +CPU= 12.136 08:30:22 STEP 10 H= 2:30 +CPU= 11.996 08:30:34 STEP 11 H= 2:45 +CPU= 12.016 08:30:50 STEP 12 H= 3:00 +CPU= 15.367 Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGh7zg+000012 Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHh7zg+000012 Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAh7zg+000012 08:31:02 STEP 13 H= 3:15 +CPU= 11.978 08:31:14 STEP 14 H= 3:30 +CPU= 12.572 08:31:26 STEP 15 H= 3:45 +CPU= 12.031 08:31:39 STEP 16 H= 4:00 +CPU= 12.385 08:31:51 STEP 17 H= 4:15 +CPU= 11.955 08:32:03 STEP 18 H= 4:30 +CPU= 12.054 08:32:15 STEP 19 H= 4:45 +CPU= 12.214 08:32:27 STEP 20 H= 5:00 +CPU= 12.444 08:32:39 STEP 21 H= 5:15 +CPU= 12.082 08:32:51 STEP 22 H= 5:30 +CPU= 12.074 08:33:04 STEP 23 H= 5:45 +CPU= 12.108 08:33:19 STEP 24 H= 6:00 +CPU= 15.539 Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGh7zg+000024 Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHh7zg+000024 Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAh7zg+000024 08:33:31 STEP 25 H= 6:15 +CPU= 12.084 08:33:43 STEP 26 H= 6:30 +CPU= 12.090 08:33:55 STEP 27 H= 6:45 +CPU= 12.153 08:34:08 STEP 28 H= 7:00 +CPU= 12.492 08:34:20 STEP 29 H= 7:15 +CPU= 12.107 08:34:32 STEP 30 H= 7:30 +CPU= 12.132 08:34:44 STEP 31 H= 7:45 +CPU= 12.136 08:34:57 STEP 32 H= 8:00 +CPU= 12.519 08:35:11 STEP 33 H= 8:15 +CPU= 14.027 08:35:23 STEP 34 H= 8:30 +CPU= 12.326 08:35:35 STEP 35 H= 8:45 +CPU= 12.205 08:35:51 STEP 36 H= 9:00 +CPU= 15.671 Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGh7zg+000036 Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHh7zg+000036 Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAh7zg+000036 08:36:03 STEP 37 H= 9:15 +CPU= 12.257 08:36:16 STEP 38 H= 9:30 +CPU= 12.262 08:36:28 STEP 39 H= 9:45 +CPU= 12.327 08:36:41 STEP 40 H= 10:00 +CPU= 12.638 08:36:53 STEP 41 H= 10:15 +CPU= 12.328 08:37:05 STEP 42 H= 10:30 +CPU= 12.383 08:37:18 STEP 43 H= 10:45 +CPU= 12.303 08:37:30 STEP 44 H= 11:00 +CPU= 12.667 08:37:42 STEP 45 H= 11:15 +CPU= 12.264 08:37:55 STEP 46 H= 11:30 +CPU= 12.280 08:38:07 STEP 47 H= 11:45 +CPU= 12.302 08:38:26 STEP 48 H= 12:00 +CPU= 19.291 Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGh7zg+000048 Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHh7zg+000048 Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAh7zg+000048 08:38:39 STEP 49 H= 12:15 +CPU= 12.391 08:38:51 STEP 50 H= 12:30 +CPU= 12.324 08:39:04 STEP 51 H= 12:45 +CPU= 12.448 08:39:16 STEP 52 H= 13:00 +CPU= 12.764 08:39:29 STEP 53 H= 13:15 +CPU= 12.347 08:39:41 STEP 54 H= 13:30 +CPU= 12.344 08:39:53 STEP 55 H= 13:45 +CPU= 12.334 08:40:06 STEP 56 H= 14:00 +CPU= 12.739 08:40:19 STEP 57 H= 14:15 +CPU= 13.345 08:40:33 STEP 58 H= 14:30 +CPU= 13.620 08:40:46 STEP 59 H= 14:45 +CPU= 13.362 08:41:02 STEP 60 H= 15:00 +CPU= 15.735 Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGh7zg+000060 Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHh7zg+000060 Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAh7zg+000060 08:41:15 STEP 61 H= 15:15 +CPU= 12.490 08:41:27 STEP 62 H= 15:30 +CPU= 12.326 08:41:39 STEP 63 H= 15:45 +CPU= 12.406 08:41:52 STEP 64 H= 16:00 +CPU= 12.750 08:42:05 STEP 65 H= 16:15 +CPU= 12.408 08:42:18 STEP 66 H= 16:30 +CPU= 13.002 08:42:31 STEP 67 H= 16:45 +CPU= 13.482 08:42:44 STEP 68 H= 17:00 +CPU= 12.750 08:42:56 STEP 69 H= 17:15 +CPU= 12.302 08:43:09 STEP 70 H= 17:30 +CPU= 12.330 08:43:21 STEP 71 H= 17:45 +CPU= 12.302 08:43:37 STEP 72 H= 18:00 +CPU= 15.754 Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGh7zg+000072 Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHh7zg+000072 Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAh7zg+000072 08:43:49 STEP 73 H= 18:15 +CPU= 12.351 08:44:01 STEP 74 H= 18:30 +CPU= 12.284 08:44:14 STEP 75 H= 18:45 +CPU= 12.271 08:44:26 STEP 76 H= 19:00 +CPU= 12.721 08:44:40 STEP 77 H= 19:15 +CPU= 14.045 08:44:53 STEP 78 H= 19:30 +CPU= 12.563 08:45:05 STEP 79 H= 19:45 +CPU= 12.477 08:45:18 STEP 80 H= 20:00 +CPU= 12.754 08:45:31 STEP 81 H= 20:15 +CPU= 12.430 08:45:43 STEP 82 H= 20:30 +CPU= 12.444 08:45:55 STEP 83 H= 20:45 +CPU= 12.339 08:46:11 STEP 84 H= 21:00 +CPU= 15.751 Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGh7zg+000084 Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHh7zg+000084 Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAh7zg+000084 08:46:24 STEP 85 H= 21:15 +CPU= 12.351 08:46:36 STEP 86 H= 21:30 +CPU= 12.391 08:46:48 STEP 87 H= 21:45 +CPU= 12.387 08:47:01 STEP 88 H= 22:00 +CPU= 12.865 08:47:14 STEP 89 H= 22:15 +CPU= 12.391 08:47:26 STEP 90 H= 22:30 +CPU= 12.268 08:47:38 STEP 91 H= 22:45 +CPU= 12.326 08:47:51 STEP 92 H= 23:00 +CPU= 12.793 08:48:05 STEP 93 H= 23:15 +CPU= 14.124 08:48:18 STEP 94 H= 23:30 +CPU= 12.490 08:48:30 STEP 95 H= 23:45 +CPU= 12.437 08:48:48 STEP 96 H= 24:00 +CPU= 18.300 Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGh7zg+000096 Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHh7zg+000096 Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAh7zg+000096 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207597/ICMGGh7zg+000000 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207597/ICMSHh7zg+000000 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207597/ICMUAh7zg+000000 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207597/ICMGGh7zg+000012 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207597/ICMSHh7zg+000012 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207597/ICMUAh7zg+000012 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207597/ICMGGh7zg+000024 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207597/ICMSHh7zg+000024 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207597/ICMUAh7zg+000024 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207597/ICMGGh7zg+000036 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207597/ICMSHh7zg+000036 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207597/ICMUAh7zg+000036 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207597/ICMGGh7zg+000048 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207597/ICMSHh7zg+000048 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207597/ICMUAh7zg+000048 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207597/ICMGGh7zg+000060 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207597/ICMSHh7zg+000060 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207597/ICMUAh7zg+000060 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207597/ICMGGh7zg+000072 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207597/ICMSHh7zg+000072 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207597/ICMUAh7zg+000072 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207597/ICMGGh7zg+000084 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207597/ICMSHh7zg+000084 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207597/ICMUAh7zg+000084 Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a0mi_2016092300_15_991_12207597_1_r190202_0.zip Uploading the intermediate file: upload_file_0.zip 08:49:01 STEP 97 H= 24:15 +CPU= 12.722 08:49:14 STEP 98 H= 24:30 +CPU= 12.690 08:49:27 STEP 99 H= 24:45 +CPU= 12.755 08:49:40 STEP 100 H= 25:00 +CPU= 13.124 08:49:52 STEP 101 H= 25:15 +CPU= 12.744 08:50:06 STEP 102 H= 25:30 +CPU= 13.338 08:50:19 STEP 103 H= 25:45 +CPU= 13.711 08:50:33 STEP 104 H= 26:00 +CPU= 13.122 08:50:45 STEP 105 H= 26:15 +CPU= 12.726 08:50:58 STEP 106 H= 26:30 +CPU= 12.642 08:51:11 STEP 107 H= 26:45 +CPU= 12.809 08:51:27 STEP 108 H= 27:00 +CPU= 16.030 Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGh7zg+000108 Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHh7zg+000108 Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAh7zg+000108 08:51:39 STEP 109 H= 27:15 +CPU= 12.557 08:51:53 STEP 110 H= 27:30 +CPU= 13.723 08:52:07 STEP 111 H= 27:45 +CPU= 13.463 08:52:20 STEP 112 H= 28:00 +CPU= 13.199 08:52:33 STEP 113 H= 28:15 +CPU= 12.758 08:52:47 STEP 114 H= 28:30 +CPU= 14.036 08:53:00 STEP 115 H= 28:45 +CPU= 13.420 08:53:14 STEP 116 H= 29:00 +CPU= 13.810 08:53:28 STEP 117 H= 29:15 +CPU= 13.893 08:53:40 STEP 118 H= 29:30 +CPU= 12.760 08:53:53 STEP 119 H= 29:45 +CPU= 12.515 08:54:09 STEP 120 H= 30:00 +CPU= 15.998 Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGh7zg+000120 Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHh7zg+000120 Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAh7zg+000120 08:54:22 STEP 121 H= 30:15 +CPU= 12.663 08:54:34 STEP 122 H= 30:30 +CPU= 12.675 08:54:47 STEP 123 H= 30:45 +CPU= 12.694 08:55:00 STEP 124 H= 31:00 +CPU= 13.034 08:55:13 STEP 125 H= 31:15 +CPU= 12.541 08:55:25 STEP 126 H= 31:30 +CPU= 12.461 08:55:38 STEP 127 H= 31:45 +CPU= 12.950 08:55:51 STEP 128 H= 32:00 +CPU= 13.130 08:56:04 STEP 129 H= 32:15 +CPU= 12.627 08:56:16 STEP 130 H= 32:30 +CPU= 12.691 08:56:29 STEP 131 H= 32:45 +CPU= 12.631 08:56:45 STEP 132 H= 33:00 +CPU= 15.966 Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGh7zg+000132 Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHh7zg+000132 Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAh7zg+000132 08:57:00 STEP 133 H= 33:15 +CPU= 14.454 08:57:12 STEP 134 H= 33:30 +CPU= 12.470 08:57:25 STEP 135 H= 33:45 +CPU= 12.467 08:57:37 STEP 136 H= 34:00 +CPU= 12.901 08:57:50 STEP 137 H= 34:15 +CPU= 12.528 08:58:03 STEP 138 H= 34:30 +CPU= 12.549 08:58:17 STEP 139 H= 34:45 +CPU= 14.215 08:58:30 STEP 140 H= 35:00 +CPU= 13.107 08:58:42 STEP 141 H= 35:15 +CPU= 12.612 08:58:55 STEP 142 H= 35:30 +CPU= 12.560 08:59:08 STEP 143 H= 35:45 +CPU= 12.604 08:59:26 STEP 144 H= 36:00 +CPU= 18.455 Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGh7zg+000144 Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHh7zg+000144 Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAh7zg+000144 08:59:39 STEP 145 H= 36:15 +CPU= 12.397 08:59:51 STEP 146 H= 36:30 +CPU= 12.565 09:00:04 STEP 147 H= 36:45 +CPU= 12.545 09:00:17 STEP 148 H= 37:00 +CPU= 12.892 09:00:29 STEP 149 H= 37:15 +CPU= 12.509 09:00:42 STEP 150 H= 37:30 +CPU= 12.621 09:00:54 STEP 151 H= 37:45 +CPU= 12.536 09:01:07 STEP 152 H= 38:00 +CPU= 12.934 09:01:20 STEP 153 H= 38:15 +CPU= 12.531 09:01:32 STEP 154 H= 38:30 +CPU= 12.619 09:01:45 STEP 155 H= 38:45 +CPU= 12.546 09:02:01 STEP 156 H= 39:00 +CPU= 16.071 Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGh7zg+000156 Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHh7zg+000156 Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAh7zg+000156 09:02:13 STEP 157 H= 39:15 +CPU= 12.553 09:02:26 STEP 158 H= 39:30 +CPU= 12.597 09:02:38 STEP 159 H= 39:45 +CPU= 12.428 09:02:51 STEP 160 H= 40:00 +CPU= 12.929 09:03:04 STEP 161 H= 40:15 +CPU= 12.535 09:03:17 STEP 162 H= 40:30 +CPU= 12.594 09:03:29 STEP 163 H= 40:45 +CPU= 12.592 09:03:42 STEP 164 H= 41:00 +CPU= 12.891 09:03:55 STEP 165 H= 41:15 +CPU= 13.082 09:04:09 STEP 166 H= 41:30 +CPU= 13.737 09:04:22 STEP 167 H= 41:45 +CPU= 13.233 09:04:39 STEP 168 H= 42:00 +CPU= 17.190 Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGh7zg+000168 Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHh7zg+000168 Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAh7zg+000168 09:04:52 STEP 169 H= 42:15 +CPU= 12.512 09:05:04 STEP 170 H= 42:30 +CPU= 12.605 09:05:17 STEP 171 H= 42:45 +CPU= 12.590 09:05:31 STEP 172 H= 43:00 +CPU= 14.377 09:05:44 STEP 173 H= 43:15 +CPU= 13.012 09:05:57 STEP 174 H= 43:30 +CPU= 12.557 09:06:10 STEP 175 H= 43:45 +CPU= 12.594 09:06:23 STEP 176 H= 44:00 +CPU= 13.290 09:06:37 STEP 177 H= 44:15 +CPU= 14.028 09:06:50 STEP 178 H= 44:30 +CPU= 12.586 09:07:02 STEP 179 H= 44:45 +CPU= 12.590 09:07:18 STEP 180 H= 45:00 +CPU= 15.989 Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGh7zg+000180 Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHh7zg+000180 Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAh7zg+000180 09:07:31 STEP 181 H= 45:15 +CPU= 12.541 09:07:43 STEP 182 H= 45:30 +CPU= 12.618 09:07:56 STEP 183 H= 45:45 +CPU= 12.643 09:08:09 STEP 184 H= 46:00 +CPU= 13.075 09:08:22 STEP 185 H= 46:15 +CPU= 12.656 09:08:34 STEP 186 H= 46:30 +CPU= 12.665 09:08:47 STEP 187 H= 46:45 +CPU= 12.651 09:09:01 STEP 188 H= 47:00 +CPU= 13.720 09:09:14 STEP 189 H= 47:15 +CPU= 13.733 09:09:27 STEP 190 H= 47:30 +CPU= 12.909 09:09:40 STEP 191 H= 47:45 +CPU= 12.829 09:09:59 STEP 192 H= 48:00 +CPU= 18.473 Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGh7zg+000192 Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHh7zg+000192 Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAh7zg+000192 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207597/ICMGGh7zg+000096 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207597/ICMSHh7zg+000096 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207597/ICMUAh7zg+000096 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207597/ICMGGh7zg+000108 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207597/ICMSHh7zg+000108 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207597/ICMUAh7zg+000108 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207597/ICMGGh7zg+000120 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207597/ICMSHh7zg+000120 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207597/ICMUAh7zg+000120 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207597/ICMGGh7zg+000132 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207597/ICMSHh7zg+000132 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207597/ICMUAh7zg+000132 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207597/ICMGGh7zg+000144 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207597/ICMSHh7zg+000144 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207597/ICMUAh7zg+000144 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207597/ICMGGh7zg+000156 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207597/ICMSHh7zg+000156 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207597/ICMUAh7zg+000156 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207597/ICMGGh7zg+000168 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207597/ICMSHh7zg+000168 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207597/ICMUAh7zg+000168 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207597/ICMGGh7zg+000180 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207597/ICMSHh7zg+000180 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207597/ICMUAh7zg+000180 Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a0mi_2016092300_15_991_12207597_1_r190202_1.zip Uploading the intermediate file: upload_file_1.zip 09:10:12 STEP 193 H= 48:15 +CPU= 12.893 09:10:24 STEP 194 H= 48:30 +CPU= 12.687 09:10:37 STEP 195 H= 48:45 +CPU= 12.816 09:10:50 STEP 196 H= 49:00 +CPU= 13.191 09:11:03 STEP 197 H= 49:15 +CPU= 12.814 09:11:16 STEP 198 H= 49:30 +CPU= 12.682 09:11:29 STEP 199 H= 49:45 +CPU= 12.715 09:11:42 STEP 200 H= 50:00 +CPU= 13.212 09:11:55 STEP 201 H= 50:15 +CPU= 12.769 09:12:07 STEP 202 H= 50:30 +CPU= 12.716 09:12:20 STEP 203 H= 50:45 +CPU= 12.764 09:12:36 STEP 204 H= 51:00 +CPU= 16.230 Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGh7zg+000204 Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHh7zg+000204 Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAh7zg+000204 09:12:49 STEP 205 H= 51:15 +CPU= 12.686 09:13:02 STEP 206 H= 51:30 +CPU= 12.663 09:13:14 STEP 207 H= 51:45 +CPU= 12.684 09:13:27 STEP 208 H= 52:00 +CPU= 13.123 09:13:40 STEP 209 H= 52:15 +CPU= 12.739 09:13:53 STEP 210 H= 52:30 +CPU= 12.567 09:14:06 STEP 211 H= 52:45 +CPU= 12.803 09:14:19 STEP 212 H= 53:00 +CPU= 13.069 09:14:31 STEP 213 H= 53:15 +CPU= 12.703 09:14:44 STEP 214 H= 53:30 +CPU= 12.825 09:14:57 STEP 215 H= 53:45 +CPU= 12.871 09:15:13 STEP 216 H= 54:00 +CPU= 16.078 Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGh7zg+000216 Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHh7zg+000216 Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAh7zg+000216 09:15:26 STEP 217 H= 54:15 +CPU= 12.732 09:15:39 STEP 218 H= 54:30 +CPU= 12.855 09:15:52 STEP 219 H= 54:45 +CPU= 12.825 09:16:05 STEP 220 H= 55:00 +CPU= 13.210 09:16:18 STEP 221 H= 55:15 +CPU= 12.819 09:16:30 STEP 222 H= 55:30 +CPU= 12.787 09:16:43 STEP 223 H= 55:45 +CPU= 12.683 09:16:58 STEP 224 H= 56:00 +CPU= 14.821 09:17:11 STEP 225 H= 56:15 +CPU= 12.710 09:17:23 STEP 226 H= 56:30 +CPU= 12.704 09:17:36 STEP 227 H= 56:45 +CPU= 12.696 09:17:53 STEP 228 H= 57:00 +CPU= 16.899 Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGh7zg+000228 Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHh7zg+000228 Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAh7zg+000228 09:18:07 STEP 229 H= 57:15 +CPU= 14.265 09:18:21 STEP 230 H= 57:30 +CPU= 13.908 09:18:34 STEP 231 H= 57:45 +CPU= 12.614 09:18:47 STEP 232 H= 58:00 +CPU= 12.984 09:19:00 STEP 233 H= 58:15 +CPU= 12.703 09:19:12 STEP 234 H= 58:30 +CPU= 12.675 09:19:25 STEP 235 H= 58:45 +CPU= 12.718 09:19:38 STEP 236 H= 59:00 +CPU= 13.067 09:19:51 STEP 237 H= 59:15 +CPU= 12.737 09:20:04 STEP 238 H= 59:30 +CPU= 12.751 09:20:16 STEP 239 H= 59:45 +CPU= 12.631 09:20:35 STEP 240 H= 60:00 +CPU= 19.255 Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGh7zg+000240 Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHh7zg+000240 Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAh7zg+000240 09:20:49 STEP 241 H= 60:15 +CPU= 13.646 09:21:02 STEP 242 H= 60:30 +CPU= 12.627 09:21:14 STEP 243 H= 60:45 +CPU= 12.555 09:21:28 STEP 244 H= 61:00 +CPU= 13.667 09:21:42 STEP 245 H= 61:15 +CPU= 13.684 09:21:54 STEP 246 H= 61:30 +CPU= 12.566 09:22:07 STEP 247 H= 61:45 +CPU= 12.638 09:22:21 STEP 248 H= 62:00 +CPU= 13.768 09:22:34 STEP 249 H= 62:15 +CPU= 13.721 09:22:47 STEP 250 H= 62:30 +CPU= 12.666 09:23:00 STEP 251 H= 62:45 +CPU= 12.650 09:23:16 STEP 252 H= 63:00 +CPU= 16.092 Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGh7zg+000252 Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHh7zg+000252 Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAh7zg+000252 09:23:28 STEP 253 H= 63:15 +CPU= 12.569 09:23:41 STEP 254 H= 63:30 +CPU= 12.662 09:23:54 STEP 255 H= 63:45 +CPU= 13.241 09:24:08 STEP 256 H= 64:00 +CPU= 14.248 09:24:21 STEP 257 H= 64:15 +CPU= 12.624 09:24:34 STEP 258 H= 64:30 +CPU= 12.537 09:24:47 STEP 259 H= 64:45 +CPU= 12.851 09:25:01 STEP 260 H= 65:00 +CPU= 14.466 09:25:14 STEP 261 H= 65:15 +CPU= 12.626 09:25:26 STEP 262 H= 65:30 +CPU= 12.708 09:25:39 STEP 263 H= 65:45 +CPU= 12.651 09:25:55 STEP 264 H= 66:00 +CPU= 15.879 Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGh7zg+000264 Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHh7zg+000264 Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAh7zg+000264 09:26:07 STEP 265 H= 66:15 +CPU= 12.530 09:26:20 STEP 266 H= 66:30 +CPU= 12.494 09:26:33 STEP 267 H= 66:45 +CPU= 12.737 09:26:47 STEP 268 H= 67:00 +CPU= 14.329 09:26:59 STEP 269 H= 67:15 +CPU= 12.392 09:27:12 STEP 270 H= 67:30 +CPU= 12.399 09:27:24 STEP 271 H= 67:45 +CPU= 12.469 09:27:37 STEP 272 H= 68:00 +CPU= 12.979 09:27:50 STEP 273 H= 68:15 +CPU= 12.715 09:28:03 STEP 274 H= 68:30 +CPU= 12.695 09:28:15 STEP 275 H= 68:45 +CPU= 12.675 09:28:31 STEP 276 H= 69:00 +CPU= 16.145 Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGh7zg+000276 Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHh7zg+000276 Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAh7zg+000276 09:28:44 STEP 277 H= 69:15 +CPU= 12.767 09:28:57 STEP 278 H= 69:30 +CPU= 12.676 09:29:10 STEP 279 H= 69:45 +CPU= 12.680 09:29:22 STEP 280 H= 70:00 +CPU= 12.868 09:29:35 STEP 281 H= 70:15 +CPU= 12.667 09:29:48 STEP 282 H= 70:30 +CPU= 12.577 09:30:00 STEP 283 H= 70:45 +CPU= 12.658 09:30:13 STEP 284 H= 71:00 +CPU= 13.056 09:30:26 STEP 285 H= 71:15 +CPU= 12.596 09:30:39 STEP 286 H= 71:30 +CPU= 12.571 09:30:51 STEP 287 H= 71:45 +CPU= 12.749 09:31:10 STEP 288 H= 72:00 +CPU= 18.477 Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGh7zg+000288 Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHh7zg+000288 Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAh7zg+000288 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207597/ICMGGh7zg+000192 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207597/ICMSHh7zg+000192 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207597/ICMUAh7zg+000192 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207597/ICMGGh7zg+000204 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207597/ICMSHh7zg+000204 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207597/ICMUAh7zg+000204 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207597/ICMGGh7zg+000216 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207597/ICMSHh7zg+000216 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207597/ICMUAh7zg+000216 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207597/ICMGGh7zg+000228 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207597/ICMSHh7zg+000228 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207597/ICMUAh7zg+000228 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207597/ICMGGh7zg+000240 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207597/ICMSHh7zg+000240 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207597/ICMUAh7zg+000240 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207597/ICMGGh7zg+000252 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207597/ICMSHh7zg+000252 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207597/ICMUAh7zg+000252 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207597/ICMGGh7zg+000264 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207597/ICMSHh7zg+000264 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207597/ICMUAh7zg+000264 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207597/ICMGGh7zg+000276 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207597/ICMSHh7zg+000276 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207597/ICMUAh7zg+000276 Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a0mi_2016092300_15_991_12207597_1_r190202_2.zip Uploading the intermediate file: upload_file_2.zip 09:31:23 STEP 289 H= 72:15 +CPU= 13.525 09:31:37 STEP 290 H= 72:30 +CPU= 13.616 09:31:50 STEP 291 H= 72:45 +CPU= 12.611 09:32:03 STEP 292 H= 73:00 +CPU= 13.154 09:32:16 STEP 293 H= 73:15 +CPU= 12.755 09:32:28 STEP 294 H= 73:30 +CPU= 12.514 09:32:41 STEP 295 H= 73:45 +CPU= 12.603 09:32:54 STEP 296 H= 74:00 +CPU= 13.097 09:33:07 STEP 297 H= 74:15 +CPU= 12.762 09:33:19 STEP 298 H= 74:30 +CPU= 12.812 09:33:32 STEP 299 H= 74:45 +CPU= 12.627 09:33:48 STEP 300 H= 75:00 +CPU= 16.031 Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGh7zg+000300 Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHh7zg+000300 Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAh7zg+000300 09:34:01 STEP 301 H= 75:15 +CPU= 12.684 09:34:15 STEP 302 H= 75:30 +CPU= 14.038 09:34:28 STEP 303 H= 75:45 +CPU= 13.160 09:34:41 STEP 304 H= 76:00 +CPU= 13.121 09:34:54 STEP 305 H= 76:15 +CPU= 12.716 09:35:06 STEP 306 H= 76:30 +CPU= 12.726 09:35:19 STEP 307 H= 76:45 +CPU= 12.715 09:35:32 STEP 308 H= 77:00 +CPU= 13.125 09:35:45 STEP 309 H= 77:15 +CPU= 12.533 09:35:57 STEP 310 H= 77:30 +CPU= 12.503 09:36:10 STEP 311 H= 77:45 +CPU= 12.575 09:36:26 STEP 312 H= 78:00 +CPU= 16.268 Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGh7zg+000312 Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHh7zg+000312 Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAh7zg+000312 09:36:39 STEP 313 H= 78:15 +CPU= 12.590 09:36:51 STEP 314 H= 78:30 +CPU= 12.600 09:37:04 STEP 315 H= 78:45 +CPU= 12.636 09:37:17 STEP 316 H= 79:00 +CPU= 13.072 09:37:31 STEP 317 H= 79:15 +CPU= 14.030 09:37:44 STEP 318 H= 79:30 +CPU= 13.025 09:37:57 STEP 319 H= 79:45 +CPU= 12.670 09:38:10 STEP 320 H= 80:00 +CPU= 13.089 09:38:23 STEP 321 H= 80:15 +CPU= 12.670 09:38:35 STEP 322 H= 80:30 +CPU= 12.685 09:38:48 STEP 323 H= 80:45 +CPU= 12.691 09:39:04 STEP 324 H= 81:00 +CPU= 16.099 Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGh7zg+000324 Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHh7zg+000324 Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAh7zg+000324 09:39:17 STEP 325 H= 81:15 +CPU= 13.211 09:39:31 STEP 326 H= 81:30 +CPU= 13.895 09:39:44 STEP 327 H= 81:45 +CPU= 12.738 09:39:57 STEP 328 H= 82:00 +CPU= 12.921 09:40:09 STEP 329 H= 82:15 +CPU= 12.607 09:40:22 STEP 330 H= 82:30 +CPU= 12.424 09:40:34 STEP 331 H= 82:45 +CPU= 12.410 09:40:47 STEP 332 H= 83:00 +CPU= 12.794 09:41:00 STEP 333 H= 83:15 +CPU= 13.308 09:41:14 STEP 334 H= 83:30 +CPU= 13.700 09:41:28 STEP 335 H= 83:45 +CPU= 13.470 09:41:47 STEP 336 H= 84:00 +CPU= 19.320 Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGh7zg+000336 Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHh7zg+000336 Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAh7zg+000336 09:42:01 STEP 337 H= 84:15 +CPU= 14.176 09:42:14 STEP 338 H= 84:30 +CPU= 12.435 09:42:26 STEP 339 H= 84:45 +CPU= 12.375 09:42:39 STEP 340 H= 85:00 +CPU= 12.774 09:42:51 STEP 341 H= 85:15 +CPU= 12.484 09:43:04 STEP 342 H= 85:30 +CPU= 12.593 09:43:16 STEP 343 H= 85:45 +CPU= 12.564 09:43:29 STEP 344 H= 86:00 +CPU= 12.987 09:43:43 STEP 345 H= 86:15 +CPU= 13.259 09:43:56 STEP 346 H= 86:30 +CPU= 13.626 09:44:09 STEP 347 H= 86:45 +CPU= 12.606 09:44:25 STEP 348 H= 87:00 +CPU= 15.998 Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGh7zg+000348 Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHh7zg+000348 Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAh7zg+000348 09:44:37 STEP 349 H= 87:15 +CPU= 12.491 09:44:50 STEP 350 H= 87:30 +CPU= 12.493 09:45:02 STEP 351 H= 87:45 +CPU= 12.528 09:45:16 STEP 352 H= 88:00 +CPU= 13.541 09:45:30 STEP 353 H= 88:15 +CPU= 13.680 09:45:42 STEP 354 H= 88:30 +CPU= 12.540 09:45:55 STEP 355 H= 88:45 +CPU= 12.511 09:46:08 STEP 356 H= 89:00 +CPU= 12.993 09:46:20 STEP 357 H= 89:15 +CPU= 12.531 09:46:33 STEP 358 H= 89:30 +CPU= 12.549 09:46:45 STEP 359 H= 89:45 +CPU= 12.572 09:47:02 STEP 360 H= 90:00 +CPU= 16.246 Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGh7zg+000360 Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHh7zg+000360 Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAh7zg+000360 09:47:14 STEP 361 H= 90:15 +CPU= 12.651 09:47:27 STEP 362 H= 90:30 +CPU= 12.577 09:47:39 STEP 363 H= 90:45 +CPU= 12.577 09:47:53 STEP 364 H= 91:00 +CPU= 13.548 09:48:07 STEP 365 H= 91:15 +CPU= 13.803 09:48:19 STEP 366 H= 91:30 +CPU= 12.550 09:48:32 STEP 367 H= 91:45 +CPU= 12.593 09:48:45 STEP 368 H= 92:00 +CPU= 13.007 09:48:58 STEP 369 H= 92:15 +CPU= 12.576 09:49:10 STEP 370 H= 92:30 +CPU= 12.588 09:49:23 STEP 371 H= 92:45 +CPU= 12.534 09:49:39 STEP 372 H= 93:00 +CPU= 16.402 Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGh7zg+000372 Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHh7zg+000372 Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAh7zg+000372 09:49:53 STEP 373 H= 93:15 +CPU= 14.195 09:50:06 STEP 374 H= 93:30 +CPU= 12.593 09:50:18 STEP 375 H= 93:45 +CPU= 12.451 09:50:31 STEP 376 H= 94:00 +CPU= 12.835 09:50:44 STEP 377 H= 94:15 +CPU= 13.032 09:50:58 STEP 378 H= 94:30 +CPU= 13.739 09:51:11 STEP 379 H= 94:45 +CPU= 12.567 09:51:23 STEP 380 H= 95:00 +CPU= 12.886 09:51:36 STEP 381 H= 95:15 +CPU= 12.564 09:51:49 STEP 382 H= 95:30 +CPU= 12.518 09:52:01 STEP 383 H= 95:45 +CPU= 12.407 09:52:19 STEP 384 H= 96:00 +CPU= 18.192 Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGh7zg+000384 Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHh7zg+000384 Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAh7zg+000384 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207597/ICMGGh7zg+000288 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207597/ICMSHh7zg+000288 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207597/ICMUAh7zg+000288 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207597/ICMGGh7zg+000300 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207597/ICMSHh7zg+000300 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207597/ICMUAh7zg+000300 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207597/ICMGGh7zg+000312 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207597/ICMSHh7zg+000312 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207597/ICMUAh7zg+000312 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207597/ICMGGh7zg+000324 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207597/ICMSHh7zg+000324 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207597/ICMUAh7zg+000324 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207597/ICMGGh7zg+000336 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207597/ICMSHh7zg+000336 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207597/ICMUAh7zg+000336 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207597/ICMGGh7zg+000348 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207597/ICMSHh7zg+000348 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207597/ICMUAh7zg+000348 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207597/ICMGGh7zg+000360 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207597/ICMSHh7zg+000360 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207597/ICMUAh7zg+000360 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207597/ICMGGh7zg+000372 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207597/ICMSHh7zg+000372 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207597/ICMUAh7zg+000372 Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a0mi_2016092300_15_991_12207597_1_r190202_3.zip Uploading the intermediate file: upload_file_3.zip 09:52:32 STEP 385 H= 96:15 +CPU= 12.571 09:52:44 STEP 386 H= 96:30 +CPU= 12.572 09:52:57 STEP 387 H= 96:45 +CPU= 12.629 09:53:11 STEP 388 H= 97:00 +CPU= 14.422 09:53:24 STEP 389 H= 97:15 +CPU= 13.114 09:53:37 STEP 390 H= 97:30 +CPU= 12.464 09:53:50 STEP 391 H= 97:45 +CPU= 12.558 09:54:02 STEP 392 H= 98:00 +CPU= 12.983 09:54:15 STEP 393 H= 98:15 +CPU= 12.653 09:54:28 STEP 394 H= 98:30 +CPU= 12.605 09:54:40 STEP 395 H= 98:45 +CPU= 12.646 09:54:57 STEP 396 H= 99:00 +CPU= 16.137 Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGh7zg+000396 Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHh7zg+000396 Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAh7zg+000396 09:55:10 STEP 397 H= 99:15 +CPU= 13.312 09:55:24 STEP 398 H= 99:30 +CPU= 13.678 09:55:36 STEP 399 H= 99:45 +CPU= 12.558 09:55:49 STEP 400 H= 100:00 +CPU= 12.949 09:56:02 STEP 401 H= 100:15 +CPU= 12.527 09:56:14 STEP 402 H= 100:30 +CPU= 12.497 09:56:27 STEP 403 H= 100:45 +CPU= 12.445 09:56:40 STEP 404 H= 101:00 +CPU= 12.957 09:56:52 STEP 405 H= 101:15 +CPU= 12.545 09:57:05 STEP 406 H= 101:30 +CPU= 12.648 09:57:17 STEP 407 H= 101:45 +CPU= 12.521 09:57:33 STEP 408 H= 102:00 +CPU= 16.028 Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGh7zg+000408 Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHh7zg+000408 Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAh7zg+000408 09:57:46 STEP 409 H= 102:15 +CPU= 12.495 09:57:58 STEP 410 H= 102:30 +CPU= 12.556 09:58:11 STEP 411 H= 102:45 +CPU= 12.521 09:58:24 STEP 412 H= 103:00 +CPU= 12.957 09:58:36 STEP 413 H= 103:15 +CPU= 12.588 09:58:49 STEP 414 H= 103:30 +CPU= 12.579 09:59:02 STEP 415 H= 103:45 +CPU= 12.582 09:59:14 STEP 416 H= 104:00 +CPU= 12.851 09:59:27 STEP 417 H= 104:15 +CPU= 12.428 09:59:39 STEP 418 H= 104:30 +CPU= 12.382 09:59:52 STEP 419 H= 104:45 +CPU= 12.518 [EC_DRHOOK:boinc-climateprediction:1:1:71060:71060] [20230301:095953:1677689993:5515.916] [signal_drhook@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1538] Received signal#8 (SIGFPE) :: 2686MB (heap), 5076MB (maxrss), 0MB (maxstack), 0 (paging), nsigs = 1 [EC_DRHOOK:boinc-climateprediction:1:1:71060:71060] [20230301:095953:1677689993:5515.916] [signal_drhook@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1542] Also activating Harakiri-alarm (SIGALRM=14) to expire after 500s elapsed to prevent hangs, nsigs = 1 [EC_DRHOOK:boinc-climateprediction:1:1:71060:71060] [20230301:095953:1677689993:5515.916] [signal_drhook@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1544] Harakiri signal handler 'signal_harakiri' for signal#14 (SIGALRM) installed at 0x81f0c0 (old at (nil)) [EC_DRHOOK:boinc-climateprediction:1:1:71060:71060] [20230301:095953:1677689993:5515.916] [signal_drhook@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1617] Signal#8 was caused by floating-point overflow [memaddr=0x1cc4a8f], nsigs = 1 [EC_DRHOOK:boinc-climateprediction:1:1:71060:71060] [20230301:095953:1677689993:5515.916] [signal_drhook@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1686] Starting DrHook backtrace for signal#8, nsigs = 1 [EC_DRHOOK:boinc-climateprediction:1:1:71060:71060] [20230301:095953:1677689993:5515.916] [c_drhook_print_@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:3843] 2686 MB (maxheap), 5076 MB (maxrss), 0 MB (maxstack) [EC_DRHOOK:boinc-climateprediction:1:1:71060:71060] [20230301:095953:1677689993:5515.916] [c_drhook_print_@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:3897] : MASTER [EC_DRHOOK:boinc-climateprediction:1:1:71060:71060] [20230301:095953:1677689993:5515.916] [c_drhook_print_@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:3897] : CNT0 [EC_DRHOOK:boinc-climateprediction:1:1:71060:71060] [20230301:095953:1677689993:5515.916] [c_drhook_print_@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:3897] : CNT1 [EC_DRHOOK:boinc-climateprediction:1:1:71060:71060] [20230301:095953:1677689993:5515.916] [c_drhook_print_@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:3897] : CNT2 [EC_DRHOOK:boinc-climateprediction:1:1:71060:71060] [20230301:095953:1677689993:5515.916] [c_drhook_print_@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:3897] : CNT3 [EC_DRHOOK:boinc-climateprediction:1:1:71060:71060] [20230301:095953:1677689993:5515.916] [c_drhook_print_@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:3897] : CNT4 [EC_DRHOOK:boinc-climateprediction:1:1:71060:71060] [20230301:095953:1677689993:5515.916] [c_drhook_print_@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:3897] : DYNFPOS [EC_DRHOOK:boinc-climateprediction:1:1:71060:71060] [20230301:095953:1677689993:5515.916] [c_drhook_print_@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:3897] : STEPO_FPOS [EC_DRHOOK:boinc-climateprediction:1:1:71060:71060] [20230301:095953:1677689993:5515.916] [c_drhook_print_@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:3897] : SCAN2M_VPOS [EC_DRHOOK:boinc-climateprediction:1:1:71060:71060] [20230301:095953:1677689993:5515.916] [c_drhook_print_@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:3897] : >OMP-SCAN2M VPOS (1435) [EC_DRHOOK:boinc-climateprediction:1:1:71060:71060] [20230301:095953:1677689993:5515.916] [c_drhook_print_@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:3897] : VPOS [EC_DRHOOK:boinc-climateprediction:1:1:71060:71060] [20230301:095953:1677689993:5515.916] [c_drhook_print_@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:3897] : POS [EC_DRHOOK:boinc-climateprediction:1:1:71060:71060] [20230301:095953:1677689993:5515.916] [c_drhook_print_@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:3897] : GPRH [EC_DRHOOK:boinc-climateprediction:1:1:71060:71060] [20230301:095954:1677689994:5516.917] [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:240] Backtrace(s) for program '/var/lib/boinc-client/slots/0/oifs_43r3_model.exe' : sigcontextptr=0x7fff6992b850 [EC_DRHOOK:boinc-climateprediction:1:1:71060:71060] [20230301:095954:1677689994:5516.917] [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:277] Backtrace (size = 20) with addr2line-cmd [EC_DRHOOK:boinc-climateprediction:1:1:71060:71060] [20230301:095954:1677689994:5516.917] [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:302] /usr/bin/addr2line -fs -e '/var/lib/boinc-client/slots/0/oifs_43r3_model.exe' 0x838803 0x838e09 0x1d8bb20 0x1cc4a8f 0x144b066 0x599499 0x576413 0x652b1a 0x4a9238 0x4a27a3 0x4a0968 0x49dc29 0x49ce72 0x49cd68 0x4078ad 0x40276f 0x40270d 0x1d8287a 0x1d840d7 0x4025e5 [EC_DRHOOK:boinc-climateprediction:1:1:71060:71060] [20230301:095954:1677689994:5516.917] [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [0]: [0x838803] : LinuxTraceBack() at linuxtrbk.c:264 [EC_DRHOOK:boinc-climateprediction:1:1:71060:71060] [20230301:095954:1677689994:5516.917] [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [1]: [0x838e09] : LinuxTraceBack() at linuxtrbk.c:236 [EC_DRHOOK:boinc-climateprediction:1:1:71060:71060] [20230301:095954:1677689994:5516.917] [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [2]: [0x1d8bb20] : __restore_rt() at libc_sigaction.o:? [EC_DRHOOK:boinc-climateprediction:1:1:71060:71060] [20230301:095954:1677689994:5516.917] [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [3]: [0x1cc4a8f] : __libm_exp_e7() at ??:? [EC_DRHOOK:boinc-climateprediction:1:1:71060:71060] [20230301:095954:1677689994:5516.917] [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [4]: [0x144b066] : gprh_() at ??:? [EC_DRHOOK:boinc-climateprediction:1:1:71060:71060] [20230301:095954:1677689994:5516.917] [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [5]: [0x599499] : pos_() at ??:? [EC_DRHOOK:boinc-climateprediction:1:1:71060:71060] [20230301:095954:1677689994:5516.917] [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [6]: [0x576413] : vpos_() at ??:? [EC_DRHOOK:boinc-climateprediction:1:1:71060:71060] [20230301:095954:1677689994:5516.917] [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [7]: [0x652b1a] : scan2m_vpos_() at ??:? [EC_DRHOOK:boinc-climateprediction:1:1:71060:71060] [20230301:095954:1677689994:5516.917] [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [8]: [0x4a9238] : stepo_fpos_() at ??:? [EC_DRHOOK:boinc-climateprediction:1:1:71060:71060] [20230301:095954:1677689994:5516.917] [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [9]: [0x4a27a3] : dynfpos_() at ??:? [EC_DRHOOK:boinc-climateprediction:1:1:71060:71060] [20230301:095954:1677689994:5516.917] [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [10]: [0x4a0968] : cnt4_() at ??:? [EC_DRHOOK:boinc-climateprediction:1:1:71060:71060] [20230301:095954:1677689994:5516.917] [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [11]: [0x49dc29] : cnt3_() at ??:? [EC_DRHOOK:boinc-climateprediction:1:1:71060:71060] [20230301:095954:1677689994:5516.917] [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [12]: [0x49ce72] : cnt2_() at ??:? [EC_DRHOOK:boinc-climateprediction:1:1:71060:71060] [20230301:095954:1677689994:5516.917] [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [13]: [0x49cd68] : cnt1_() at ??:? [EC_DRHOOK:boinc-climateprediction:1:1:71060:71060] [20230301:095954:1677689994:5516.917] [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [14]: [0x4078ad] : cnt0_() at ??:? [EC_DRHOOK:boinc-climateprediction:1:1:71060:71060] [20230301:095954:1677689994:5516.917] [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [15]: [0x40276f] : MAIN__() at ??:? [EC_DRHOOK:boinc-climateprediction:1:1:71060:71060] [20230301:095954:1677689994:5516.917] [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [16]: [0x40270d] : main() at ??:? [EC_DRHOOK:boinc-climateprediction:1:1:71060:71060] [20230301:095954:1677689994:5516.917] [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [17]: [0x1d8287a] : __libc_start_call_main() at libc-start.o:? [EC_DRHOOK:boinc-climateprediction:1:1:71060:71060] [20230301:095954:1677689994:5516.917] [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [18]: [0x1d840d7] : __libc_start_main_impl() at ??:? [EC_DRHOOK:boinc-climateprediction:1:1:71060:71060] [20230301:095954:1677689994:5516.917] [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [19]: [0x4025e5] : _start() at ??:? [EC_DRHOOK:boinc-climateprediction:1:1:71060:71060] [20230301:095954:1677689994:5516.917] [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:370] End of backtrace(s) Process 1 thread 1 calling linux_trbk from intel_trbk() [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:240] Backtrace(s) for program '/var/lib/boinc-client/slots/0/oifs_43r3_model.exe' : sigcontextptr=0x7fff6992b760 [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:277] Backtrace (size = 21) with addr2line-cmd [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:302] /usr/bin/addr2line -fs -e '/var/lib/boinc-client/slots/0/oifs_43r3_model.exe' 0x838803 0x838e09 0x820d70 0x1d8bb20 0x1cc4a8f 0x144b066 0x599499 0x576413 0x652b1a 0x4a9238 0x4a27a3 0x4a0968 0x49dc29 0x49ce72 0x49cd68 0x4078ad 0x40276f 0x40270d 0x1d8287a 0x1d840d7 0x4025e5 [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [0]: [0x838803] : LinuxTraceBack() at linuxtrbk.c:264 [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [1]: [0x838e09] : LinuxTraceBack() at linuxtrbk.c:236 [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [2]: [0x820d70] : signal_drhook() at drhook.c:1734 [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [3]: [0x1d8bb20] : __restore_rt() at libc_sigaction.o:? [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [4]: [0x1cc4a8f] : __libm_exp_e7() at ??:? [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [5]: [0x144b066] : gprh_() at ??:? [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [6]: [0x599499] : pos_() at ??:? [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [7]: [0x576413] : vpos_() at ??:? [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [8]: [0x652b1a] : scan2m_vpos_() at ??:? [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [9]: [0x4a9238] : stepo_fpos_() at ??:? [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [10]: [0x4a27a3] : dynfpos_() at ??:? [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [11]: [0x4a0968] : cnt4_() at ??:? [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [12]: [0x49dc29] : cnt3_() at ??:? [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [13]: [0x49ce72] : cnt2_() at ??:? [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [14]: [0x49cd68] : cnt1_() at ??:? [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [15]: [0x4078ad] : cnt0_() at ??:? [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [16]: [0x40276f] : MAIN__() at ??:? [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [17]: [0x40270d] : main() at ??:? [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [18]: [0x1d8287a] : __libc_start_call_main() at libc-start.o:? [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [19]: [0x1d840d7] : __libc_start_main_impl() at ??:? [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [20]: [0x4025e5] : _start() at ??:? [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:370] End of backtrace(s) [EC_DRHOOK:boinc-climateprediction:1:1:71060:71060] [20230301:095954:1677689994:5517.000] [signal_drhook@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1734] DrHook backtrace done for signal#8, nsigs = 1 [EC_DRHOOK:boinc-climateprediction:1:1:71060:71060] [20230301:095954:1677689994:5517.000] [signal_drhook@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1785] Calling previous signal handler at 0x401140 for signal#8, nsigs = 1 forrtl: error (72): floating overflow Image PC Routine Line Source oifs_43r3_model.e 000000000081FCF1 Unknown Unknown Unknown oifs_43r3_model.e 0000000001D8BB20 Unknown Unknown Unknown oifs_43r3_model.e 0000000001CC4A8F Unknown Unknown Unknown oifs_43r3_model.e 000000000144B066 gprh_ 128 gprh.F90 oifs_43r3_model.e 0000000000599499 pos_ 1103 pos.F90 oifs_43r3_model.e 0000000000576413 vpos_ 227 vpos.F90 oifs_43r3_model.e 0000000000652B1A scan2m_vpos_ 117 scan2m_vpos.F90 oifs_43r3_model.e 00000000004A9238 stepo_fpos_ 170 stepo_fpos.F90 oifs_43r3_model.e 00000000004A27A3 dynfpos_ 170 dynfpos.F90 oifs_43r3_model.e 00000000004A0968 cnt4_ 947 cnt4.F90 oifs_43r3_model.e 000000000049DC29 cnt3_ 267 cnt3.F90 oifs_43r3_model.e 000000000049CE72 cnt2_ 88 cnt2.F90 oifs_43r3_model.e 000000000049CD68 cnt1_ 92 cnt1.F90 oifs_43r3_model.e 00000000004078AD cnt0_ 146 cnt0.F90 oifs_43r3_model.e 000000000040276F MAIN__ 96 master.F90 oifs_43r3_model.e 000000000040270D Unknown Unknown Unknown oifs_43r3_model.e 0000000001D8287A Unknown Unknown Unknown oifs_43r3_model.e 0000000001D840D7 Unknown Unknown Unknown oifs_43r3_model.e 00000000004025E5 Unknown Unknown Unknown ..The child process has been killed with signal: 6 >>> Printing last 70 lines from file: NODE.001_01 09:57:58 STEP 410 H= 102:30 +CPU= 12.556 NSTEP = 411 STEPO 0AAA00AAA 09:58:11 STEP 411 H= 102:45 +CPU= 12.521 NSTEP = 412 STEPO 0AAA00AAA 09:58:24 STEP 412 H= 103:00 +CPU= 12.957 NSTEP = 413 STEPO 0AAA00AAA 09:58:36 STEP 413 H= 103:15 +CPU= 12.588 NSTEP = 414 STEPO 0AAA00AAA 09:58:49 STEP 414 H= 103:30 +CPU= 12.579 ISTEP= 415 RSOLINC= 1361.4482 RI0= 1365.0000 ZI0= 1361.4482 RIP0= 1361.4482 ISTEP= 415 ZI0= 1361.4482 ZSEASON= 1.000000000 REA=149597870000.00 RDEASO=149597870000.00 NSTEP = 415 STEPO 0AAA00AAA 09:59:02 STEP 415 H= 103:45 +CPU= 12.582 NSTEP = 416 STEPO 0AAA00AAA 09:59:14 STEP 416 H= 104:00 +CPU= 12.851 NSTEP = 417 STEPO 0AAA00AAA 09:59:27 STEP 417 H= 104:15 +CPU= 12.428 NSTEP = 418 STEPO 0AAA00AAA 09:59:39 STEP 418 H= 104:30 +CPU= 12.382 NSTEP = 419 STEPO 0AAA00AAA 09:59:52 STEP 419 H= 104:45 +CPU= 12.518 ISTEP= 420 RSOLINC= 1361.4482 RI0= 1365.0000 ZI0= 1361.4482 RIP0= 1361.4482 ISTEP= 420 ZI0= 1361.4482 ZSEASON= 1.000000000 REA=149597870000.00 RDEASO=149597870000.00 DATE= 2016 9 23 ISTEP= 420: Reset RSOLINC= 1361.4482 RIP0= 1361.4482 SU_GHGCLIM, RCARDI,RCH4,RN2O,RCFC11,RCFC12,RNO2: 6.175516699499999E-004 1.087291259320000E-006 4.989444016862500E-007 3.778881179906250E-009 2.099153872040000E-009 7.940283000000001E-011 suecaec NAERMACC = 1 UPDT RAESHDU = 2000.0 SUECAEC: GLOBAL AVERAGE VOLCANIC SULPHATE FOR (KINDAT,KMINUT) 20160923 630 9.999999999999998E-005 GPNORM HUMIDITY AVERAGE MINIMUM MAXIMUM AVE 0.406786482404158E-02 0.999999999905546E-08 0.449660705348949E-01 GPNORM LIQUID WATER AVERAGE MINIMUM MAXIMUM AVE 0.356790581995138E-05 0.000000000000000E+00 0.527459254126321E-02 GPNORM ICE WATER AVERAGE MINIMUM MAXIMUM AVE 0.199118352186245E-04 0.000000000000000E+00 0.717887291525972E-02 GPNORM SNOW AVERAGE MINIMUM MAXIMUM AVE 0.720320853075818E-04 0.000000000000000E+00 0.199464307371229E-01 GPNORM RAIN AVERAGE MINIMUM MAXIMUM AVE 0.981796406433452E-05 0.000000000000000E+00 0.765286712481677E-02 GPNORM CLOUD FRACTION AVERAGE MINIMUM MAXIMUM AVE 0.242465601709155E+00 0.000000000000000E+00 0.100000000000000E+01 GPNORM CLW AVERAGE MINIMUM MAXIMUM AVE 0.354938044788094E-05 0.000000000000000E+00 0.489133890706251E-02 GPNORM CIW AVERAGE MINIMUM MAXIMUM AVE 0.200231138622369E-04 0.000000000000000E+00 0.745490046029638E-02 GPNORM CC AVERAGE MINIMUM MAXIMUM AVE 0.242336150509833E+00 0.000000000000000E+00 0.100000000000000E+01 GPNORM RFL AVERAGE MINIMUM MAXIMUM AVE 0.328918830243669E-04 0.000000000000000E+00 0.237929081670658E-01 GPNORM SFL AVERAGE MINIMUM MAXIMUM AVE 0.173808127639516E-04 0.000000000000000E+00 0.565437122693610E-02 GPNORM CRFL AVERAGE MINIMUM MAXIMUM AVE 0.512097754501775E-05 0.000000000000000E+00 0.132587984656906E-01 GPNORM CSFL AVERAGE MINIMUM MAXIMUM AVE 0.644670412173547E-06 0.000000000000000E+00 0.843294284081393E-02 GPNORM PFRC AVERAGE MINIMUM MAXIMUM AVE 0.186393724638158E+00 0.000000000000000E+00 0.100000000000000E+01 NSTEP = 420 STEPO A00000000 MAXGPFV : MAX. VALUE = 0.000000000000000E+000 MAXGPFV : MAX. VALUE = 0.000000000000000E+000 NSTEP = 420 SCAN2M_HPOS P IO-STREAM SETUP - IOTYPE = 2 NUMIOPROCS = 1 CPATH = ICMGGh7zg+000420 MODE=w IO-STREAM CLOSED - ICMGGh7zg+000420 MPI-TASK: 1 - 320778954 BYTES IN 6 RECORDS TRANSFERRED IN 0.0003 SECONDS******** Mbytes/s, TOTAL TIME= 0.0049( 6.1%) NSTEP = 420 STEPO 0AA000000 ------------------------------------------------ CNT0 not found; string returned was: 'DYNFPOS' >>> Printing last 8 lines from file: ifs.stat 09:59:02 0AAA00AAA STEPO 416 12.582 12.582 12.592 91:02 91:04 0.36538628473588E-04 2GB 0MB 09:59:14 0AAA00AAA STEPO 417 12.851 12.851 12.854 91:15 91:17 0.36538628473588E-04 2GB 0MB 09:59:27 0AAA00AAA STEPO 418 12.428 12.428 12.431 91:27 91:29 0.36538628473588E-04 2GB 0MB 09:59:39 0AAA00AAA STEPO 419 12.382 12.382 12.385 91:40 91:42 0.36538628473588E-04 2GB 0MB 09:59:52 A00000000 STEPO 420 12.589 12.589 12.590 91:52 91:54 0.36538628473588E-04 2GB 0MB 09:59:52 0AA000000 STEPO 420 0.015 0.015 0.015 91:52 91:54 0.36538628473588E-04 2GB 0MB 09:59:53 FULLPOS-B DYNFPOS 420 0.656 0.656 0.656 91:53 91:55 0.36538628473588E-04 2GB 0MB ------------------------------------------------ >>> Printing last 11 lines from file: rcf CSTEP = " 384", CTIME = "00040000 ", NSTEPLPP = 201, 202, 49, 228226, 228227, 2*0, 372, 2*0, IPRGPNSRES = 1, IPRGPEWRES = 1, IPRTRWRES = 1, IPRTRVRES = 1, GMASS0 = 0.000000000000000E+000, GMASSI = 0.000000000000000E+000 / ------------------------------------------------ >>> Printing last 8 lines from file: /var/lib/boinc-client/slots/0/progress_file_12207597.xml <running_values> <last_cpu_time>5509.000000</last_cpu_time> <upload_file_number>4</upload_file_number> <last_iter>419</last_iter> <last_upload>345600</last_upload> <model_completed>0</model_completed> </running_values> ------------------------------------------------ ..Failed, model did not complete successfully </stderr_txt> ]]> |
No trickles! |
---|
©2024 climateprediction.net