climateprediction.net (CPDN) home page
Task 22442882

Task 22442882

Name oifs_43r3_bl_a0qy_2016092300_20_1018_12289297_0
Workunit 12289297
Created 12 Jun 2024, 21:22:27 UTC
Sent 13 Jun 2024, 10:00:54 UTC
Report deadline 12 Aug 2024, 10:00:54 UTC
Received 14 Jun 2024, 17:45:43 UTC
Server state Over
Outcome Success
Client state Done
Exit status 0 (0x00000000)
Computer ID 1522755
Run time 15 hours 19 min 15 sec
CPU time 15 hours 11 min 53 sec
Validate state Valid
Credit 2,635.55
Device peak FLOPS 7.59 GFLOPS
Application version OpenIFS 43r3 Baroclinic Lifecycle v1.13
x86_64-pc-linux-gnu
Peak working set size 4.90 GB
Peak swap size 5.84 GB
Peak disk usage 1.34 GB
Stderr
<core_client_version>7.18.1</core_client_version>
<![CDATA[
<stderr_txt>
172
  12:33:13 STEP 1275 H= 318:45 +CPU= 28.484
  12:33:42 STEP 1276 H= 319:00 +CPU= 28.386
  12:34:11 STEP 1277 H= 319:15 +CPU= 28.545
  12:34:39 STEP 1278 H= 319:30 +CPU= 27.892
  12:35:06 STEP 1279 H= 319:45 +CPU= 27.533
  12:35:35 STEP 1280 H= 320:00 +CPU= 28.778
  12:36:03 STEP 1281 H= 320:15 +CPU= 27.596
  12:36:32 STEP 1282 H= 320:30 +CPU= 28.845
  12:37:00 STEP 1283 H= 320:45 +CPU= 27.965
  12:37:33 STEP 1284 H= 321:00 +CPU= 33.501
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMGGh7zg+001284
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMSHh7zg+001284
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMUAh7zg+001284
  12:38:00 STEP 1285 H= 321:15 +CPU= 25.938
  12:38:26 STEP 1286 H= 321:30 +CPU= 26.104
  12:38:53 STEP 1287 H= 321:45 +CPU= 26.869
  12:39:21 STEP 1288 H= 322:00 +CPU= 28.118
  12:39:48 STEP 1289 H= 322:15 +CPU= 26.558
  12:40:15 STEP 1290 H= 322:30 +CPU= 26.953
  12:40:42 STEP 1291 H= 322:45 +CPU= 27.158
  12:41:11 STEP 1292 H= 323:00 +CPU= 29.044
  12:41:39 STEP 1293 H= 323:15 +CPU= 28.312
  12:42:08 STEP 1294 H= 323:30 +CPU= 28.200
  12:42:36 STEP 1295 H= 323:45 +CPU= 27.810
  12:43:15 STEP 1296 H= 324:00 +CPU= 38.800
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMGGh7zg+001296
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMSHh7zg+001296
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMUAh7zg+001296
  12:43:42 STEP 1297 H= 324:15 +CPU= 27.261
  12:44:10 STEP 1298 H= 324:30 +CPU= 27.382
  12:44:37 STEP 1299 H= 324:45 +CPU= 27.459
  12:45:05 STEP 1300 H= 325:00 +CPU= 27.478
  12:45:32 STEP 1301 H= 325:15 +CPU= 26.747
  12:45:59 STEP 1302 H= 325:30 +CPU= 27.798
  12:46:29 STEP 1303 H= 325:45 +CPU= 29.427
  12:46:58 STEP 1304 H= 326:00 +CPU= 28.814
  12:47:26 STEP 1305 H= 326:15 +CPU= 27.675
  12:47:53 STEP 1306 H= 326:30 +CPU= 27.636
  12:48:22 STEP 1307 H= 326:45 +CPU= 28.287
  12:48:57 STEP 1308 H= 327:00 +CPU= 34.563
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMGGh7zg+001308
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMSHh7zg+001308
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMUAh7zg+001308
  12:49:26 STEP 1309 H= 327:15 +CPU= 29.538
  12:49:55 STEP 1310 H= 327:30 +CPU= 28.853
  12:50:23 STEP 1311 H= 327:45 +CPU= 27.578
  12:50:52 STEP 1312 H= 328:00 +CPU= 29.304
  12:51:20 STEP 1313 H= 328:15 +CPU= 28.116
  12:51:50 STEP 1314 H= 328:30 +CPU= 29.320
  12:52:19 STEP 1315 H= 328:45 +CPU= 29.016
  12:52:47 STEP 1316 H= 329:00 +CPU= 28.162
  12:53:14 STEP 1317 H= 329:15 +CPU= 26.620
  12:53:41 STEP 1318 H= 329:30 +CPU= 26.685
  12:54:10 STEP 1319 H= 329:45 +CPU= 28.607
  12:54:45 STEP 1320 H= 330:00 +CPU= 35.285
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMGGh7zg+001320
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMSHh7zg+001320
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMUAh7zg+001320
  12:55:14 STEP 1321 H= 330:15 +CPU= 29.255
  12:55:42 STEP 1322 H= 330:30 +CPU= 27.483
  12:56:10 STEP 1323 H= 330:45 +CPU= 27.638
  12:56:39 STEP 1324 H= 331:00 +CPU= 28.621
  12:57:07 STEP 1325 H= 331:15 +CPU= 28.480
  12:57:36 STEP 1326 H= 331:30 +CPU= 28.518
  12:58:04 STEP 1327 H= 331:45 +CPU= 28.553
  12:58:33 STEP 1328 H= 332:00 +CPU= 28.241
  12:59:01 STEP 1329 H= 332:15 +CPU= 27.826
  12:59:29 STEP 1330 H= 332:30 +CPU= 28.167
  12:59:57 STEP 1331 H= 332:45 +CPU= 27.537
  13:00:30 STEP 1332 H= 333:00 +CPU= 33.458
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMGGh7zg+001332
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMSHh7zg+001332
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMUAh7zg+001332
  13:00:58 STEP 1333 H= 333:15 +CPU= 27.304
  13:01:25 STEP 1334 H= 333:30 +CPU= 27.358
  13:01:51 STEP 1335 H= 333:45 +CPU= 26.189
  13:02:20 STEP 1336 H= 334:00 +CPU= 28.815
  13:02:48 STEP 1337 H= 334:15 +CPU= 27.830
  13:03:16 STEP 1338 H= 334:30 +CPU= 27.923
  13:03:43 STEP 1339 H= 334:45 +CPU= 26.678
  13:04:12 STEP 1340 H= 335:00 +CPU= 28.820
  13:04:41 STEP 1341 H= 335:15 +CPU= 28.827
  13:05:09 STEP 1342 H= 335:30 +CPU= 28.564
  13:05:38 STEP 1343 H= 335:45 +CPU= 28.077
  13:06:16 STEP 1344 H= 336:00 +CPU= 38.505
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMGGh7zg+001344
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMSHh7zg+001344
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMUAh7zg+001344
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12289297/ICMGGh7zg+001248
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12289297/ICMSHh7zg+001248
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12289297/ICMUAh7zg+001248
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12289297/ICMGGh7zg+001260
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12289297/ICMSHh7zg+001260
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12289297/ICMUAh7zg+001260
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12289297/ICMGGh7zg+001272
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12289297/ICMSHh7zg+001272
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12289297/ICMUAh7zg+001272
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12289297/ICMGGh7zg+001284
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12289297/ICMSHh7zg+001284
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12289297/ICMUAh7zg+001284
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12289297/ICMGGh7zg+001296
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12289297/ICMSHh7zg+001296
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12289297/ICMUAh7zg+001296
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12289297/ICMGGh7zg+001308
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12289297/ICMSHh7zg+001308
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12289297/ICMUAh7zg+001308
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12289297/ICMGGh7zg+001320
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12289297/ICMSHh7zg+001320
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12289297/ICMUAh7zg+001320
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12289297/ICMGGh7zg+001332
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12289297/ICMSHh7zg+001332
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12289297/ICMUAh7zg+001332
Zipping up the intermediate file: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_a0qy_2016092300_20_1018_12289297_0_r979929682_13.zip
Uploading the intermediate file: upload_file_13.zip
  13:06:44 STEP 1345 H= 336:15 +CPU= 27.184
  13:07:13 STEP 1346 H= 336:30 +CPU= 29.488
  13:07:42 STEP 1347 H= 336:45 +CPU= 28.526
  13:08:12 STEP 1348 H= 337:00 +CPU= 29.611
  13:08:41 STEP 1349 H= 337:15 +CPU= 29.440
  13:09:09 STEP 1350 H= 337:30 +CPU= 27.849
  13:09:37 STEP 1351 H= 337:45 +CPU= 27.932
  13:10:06 STEP 1352 H= 338:00 +CPU= 28.685
  13:10:35 STEP 1353 H= 338:15 +CPU= 28.792
  13:11:05 STEP 1354 H= 338:30 +CPU= 29.580
  13:11:34 STEP 1355 H= 338:45 +CPU= 28.979
  13:12:09 STEP 1356 H= 339:00 +CPU= 34.976
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMGGh7zg+001356
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMSHh7zg+001356
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMUAh7zg+001356
  13:12:37 STEP 1357 H= 339:15 +CPU= 28.024
  13:13:05 STEP 1358 H= 339:30 +CPU= 27.958
  13:13:34 STEP 1359 H= 339:45 +CPU= 28.869
  13:14:03 STEP 1360 H= 340:00 +CPU= 28.515
  13:14:31 STEP 1361 H= 340:15 +CPU= 28.346
  13:14:58 STEP 1362 H= 340:30 +CPU= 26.905
  13:15:26 STEP 1363 H= 340:45 +CPU= 28.072
  13:15:56 STEP 1364 H= 341:00 +CPU= 29.358
  13:16:25 STEP 1365 H= 341:15 +CPU= 28.910
  13:16:55 STEP 1366 H= 341:30 +CPU= 29.628
  13:17:23 STEP 1367 H= 341:45 +CPU= 28.472
  13:17:59 STEP 1368 H= 342:00 +CPU= 35.880
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMGGh7zg+001368
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMSHh7zg+001368
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMUAh7zg+001368
  13:18:27 STEP 1369 H= 342:15 +CPU= 27.174
  13:18:54 STEP 1370 H= 342:30 +CPU= 27.541
  13:19:22 STEP 1371 H= 342:45 +CPU= 27.613
  13:19:50 STEP 1372 H= 343:00 +CPU= 27.700
  13:20:17 STEP 1373 H= 343:15 +CPU= 26.690
  13:20:43 STEP 1374 H= 343:30 +CPU= 25.860
  13:21:10 STEP 1375 H= 343:45 +CPU= 27.019
  13:21:38 STEP 1376 H= 344:00 +CPU= 28.389
  13:22:04 STEP 1377 H= 344:15 +CPU= 26.152
  13:22:30 STEP 1378 H= 344:30 +CPU= 25.664
  13:22:57 STEP 1379 H= 344:45 +CPU= 26.789
  13:23:31 STEP 1380 H= 345:00 +CPU= 34.263
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMGGh7zg+001380
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMSHh7zg+001380
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMUAh7zg+001380
  13:23:59 STEP 1381 H= 345:15 +CPU= 27.572
  13:24:27 STEP 1382 H= 345:30 +CPU= 27.279
  13:24:55 STEP 1383 H= 345:45 +CPU= 28.464
  13:25:24 STEP 1384 H= 346:00 +CPU= 29.035
  13:25:53 STEP 1385 H= 346:15 +CPU= 29.026
  13:26:21 STEP 1386 H= 346:30 +CPU= 27.763
  13:26:50 STEP 1387 H= 346:45 +CPU= 28.520
  13:27:19 STEP 1388 H= 347:00 +CPU= 28.964
  13:27:47 STEP 1389 H= 347:15 +CPU= 28.326
  13:28:15 STEP 1390 H= 347:30 +CPU= 27.214
  13:28:42 STEP 1391 H= 347:45 +CPU= 27.333
  13:29:19 STEP 1392 H= 348:00 +CPU= 36.425
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMGGh7zg+001392
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMSHh7zg+001392
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMUAh7zg+001392
  13:29:46 STEP 1393 H= 348:15 +CPU= 26.746
  13:30:14 STEP 1394 H= 348:30 +CPU= 27.985
  13:30:43 STEP 1395 H= 348:45 +CPU= 28.668
  13:31:11 STEP 1396 H= 349:00 +CPU= 28.495
  13:31:39 STEP 1397 H= 349:15 +CPU= 27.986
  13:32:07 STEP 1398 H= 349:30 +CPU= 27.396
  13:32:36 STEP 1399 H= 349:45 +CPU= 29.073
  13:33:05 STEP 1400 H= 350:00 +CPU= 29.016
  13:33:33 STEP 1401 H= 350:15 +CPU= 28.225
  13:34:02 STEP 1402 H= 350:30 +CPU= 28.024
  13:34:30 STEP 1403 H= 350:45 +CPU= 28.241
  13:35:04 STEP 1404 H= 351:00 +CPU= 34.207
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMGGh7zg+001404
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMSHh7zg+001404
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMUAh7zg+001404
  13:35:33 STEP 1405 H= 351:15 +CPU= 28.336
  13:36:00 STEP 1406 H= 351:30 +CPU= 27.596
  13:36:28 STEP 1407 H= 351:45 +CPU= 27.791
  13:36:57 STEP 1408 H= 352:00 +CPU= 28.765
  13:37:24 STEP 1409 H= 352:15 +CPU= 26.978
  13:37:52 STEP 1410 H= 352:30 +CPU= 27.964
  13:38:22 STEP 1411 H= 352:45 +CPU= 29.444
  13:38:52 STEP 1412 H= 353:00 +CPU= 29.741
  13:39:20 STEP 1413 H= 353:15 +CPU= 28.343
  13:39:48 STEP 1414 H= 353:30 +CPU= 27.622
  13:40:17 STEP 1415 H= 353:45 +CPU= 29.355
  13:40:53 STEP 1416 H= 354:00 +CPU= 35.762
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMGGh7zg+001416
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMSHh7zg+001416
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMUAh7zg+001416
  13:41:22 STEP 1417 H= 354:15 +CPU= 28.407
  13:41:50 STEP 1418 H= 354:30 +CPU= 28.323
  13:42:18 STEP 1419 H= 354:45 +CPU= 27.582
  13:42:47 STEP 1420 H= 355:00 +CPU= 28.996
  13:43:14 STEP 1421 H= 355:15 +CPU= 26.830
  13:43:42 STEP 1422 H= 355:30 +CPU= 27.943
  13:44:11 STEP 1423 H= 355:45 +CPU= 28.546
  13:44:41 STEP 1424 H= 356:00 +CPU= 29.986
  13:45:09 STEP 1425 H= 356:15 +CPU= 27.910
  13:45:38 STEP 1426 H= 356:30 +CPU= 28.800
  13:46:06 STEP 1427 H= 356:45 +CPU= 28.040
  13:46:41 STEP 1428 H= 357:00 +CPU= 34.961
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMGGh7zg+001428
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMSHh7zg+001428
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMUAh7zg+001428
  13:47:09 STEP 1429 H= 357:15 +CPU= 27.454
  13:47:37 STEP 1430 H= 357:30 +CPU= 27.878
  13:48:05 STEP 1431 H= 357:45 +CPU= 28.174
  13:48:33 STEP 1432 H= 358:00 +CPU= 28.085
  13:49:01 STEP 1433 H= 358:15 +CPU= 27.467
  13:49:28 STEP 1434 H= 358:30 +CPU= 27.228
  13:49:54 STEP 1435 H= 358:45 +CPU= 26.216
  13:50:22 STEP 1436 H= 359:00 +CPU= 27.804
  13:50:48 STEP 1437 H= 359:15 +CPU= 25.929
  13:51:14 STEP 1438 H= 359:30 +CPU= 25.831
  13:51:41 STEP 1439 H= 359:45 +CPU= 26.182
  13:52:17 STEP 1440 H= 360:00 +CPU= 36.064
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMGGh7zg+001440
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMSHh7zg+001440
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMUAh7zg+001440
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12289297/ICMGGh7zg+001344
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12289297/ICMSHh7zg+001344
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12289297/ICMUAh7zg+001344
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12289297/ICMGGh7zg+001356
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12289297/ICMSHh7zg+001356
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12289297/ICMUAh7zg+001356
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12289297/ICMGGh7zg+001368
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12289297/ICMSHh7zg+001368
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12289297/ICMUAh7zg+001368
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12289297/ICMGGh7zg+001380
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12289297/ICMSHh7zg+001380
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12289297/ICMUAh7zg+001380
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12289297/ICMGGh7zg+001392
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12289297/ICMSHh7zg+001392
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12289297/ICMUAh7zg+001392
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12289297/ICMGGh7zg+001404
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12289297/ICMSHh7zg+001404
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12289297/ICMUAh7zg+001404
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12289297/ICMGGh7zg+001416
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12289297/ICMSHh7zg+001416
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12289297/ICMUAh7zg+001416
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12289297/ICMGGh7zg+001428
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12289297/ICMSHh7zg+001428
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12289297/ICMUAh7zg+001428
Zipping up the intermediate file: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_a0qy_2016092300_20_1018_12289297_0_r979929682_14.zip
Uploading the intermediate file: upload_file_14.zip
  13:52:43 STEP 1441 H= 360:15 +CPU= 26.411
  13:53:11 STEP 1442 H= 360:30 +CPU= 27.158
  13:53:39 STEP 1443 H= 360:45 +CPU= 28.298
  13:54:07 STEP 1444 H= 361:00 +CPU= 27.818
  13:54:35 STEP 1445 H= 361:15 +CPU= 28.155
  13:55:02 STEP 1446 H= 361:30 +CPU= 26.576
  13:55:29 STEP 1447 H= 361:45 +CPU= 27.560
  13:55:59 STEP 1448 H= 362:00 +CPU= 29.048
  13:56:27 STEP 1449 H= 362:15 +CPU= 28.224
  13:56:55 STEP 1450 H= 362:30 +CPU= 28.164
  13:57:24 STEP 1451 H= 362:45 +CPU= 28.421
  13:57:58 STEP 1452 H= 363:00 +CPU= 34.590
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMGGh7zg+001452
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMSHh7zg+001452
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMUAh7zg+001452
  13:58:26 STEP 1453 H= 363:15 +CPU= 27.884
  13:58:55 STEP 1454 H= 363:30 +CPU= 28.638
  13:59:24 STEP 1455 H= 363:45 +CPU= 28.751
  13:59:53 STEP 1456 H= 364:00 +CPU= 29.034
  14:00:21 STEP 1457 H= 364:15 +CPU= 28.064
  14:00:48 STEP 1458 H= 364:30 +CPU= 26.498
  14:01:16 STEP 1459 H= 364:45 +CPU= 27.851
  14:01:45 STEP 1460 H= 365:00 +CPU= 29.459
  14:02:15 STEP 1461 H= 365:15 +CPU= 28.933
  14:02:43 STEP 1462 H= 365:30 +CPU= 28.403
  14:03:12 STEP 1463 H= 365:45 +CPU= 28.628
  14:03:47 STEP 1464 H= 366:00 +CPU= 35.015
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMGGh7zg+001464
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMSHh7zg+001464
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMUAh7zg+001464
  14:04:16 STEP 1465 H= 366:15 +CPU= 28.617
  14:04:44 STEP 1466 H= 366:30 +CPU= 28.047
  14:05:12 STEP 1467 H= 366:45 +CPU= 28.509
  14:05:41 STEP 1468 H= 367:00 +CPU= 28.827
  14:06:10 STEP 1469 H= 367:15 +CPU= 28.609
  14:06:38 STEP 1470 H= 367:30 +CPU= 27.564
  14:07:06 STEP 1471 H= 367:45 +CPU= 28.557
  14:07:35 STEP 1472 H= 368:00 +CPU= 28.551
  14:08:02 STEP 1473 H= 368:15 +CPU= 27.003
  14:08:29 STEP 1474 H= 368:30 +CPU= 26.466
  14:08:56 STEP 1475 H= 368:45 +CPU= 26.981
  14:09:29 STEP 1476 H= 369:00 +CPU= 33.295
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMGGh7zg+001476
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMSHh7zg+001476
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMUAh7zg+001476
  14:09:57 STEP 1477 H= 369:15 +CPU= 27.782
  14:10:26 STEP 1478 H= 369:30 +CPU= 28.196
  14:10:54 STEP 1479 H= 369:45 +CPU= 28.747
  14:11:23 STEP 1480 H= 370:00 +CPU= 28.534
  14:11:52 STEP 1481 H= 370:15 +CPU= 28.639
  14:12:21 STEP 1482 H= 370:30 +CPU= 29.314
  14:12:50 STEP 1483 H= 370:45 +CPU= 28.343
  14:13:18 STEP 1484 H= 371:00 +CPU= 28.637
  14:13:47 STEP 1485 H= 371:15 +CPU= 28.437
  14:14:15 STEP 1486 H= 371:30 +CPU= 27.784
  14:14:44 STEP 1487 H= 371:45 +CPU= 28.898
  14:15:22 STEP 1488 H= 372:00 +CPU= 38.091
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMGGh7zg+001488
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMSHh7zg+001488
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMUAh7zg+001488
  14:15:52 STEP 1489 H= 372:15 +CPU= 29.385
  14:16:21 STEP 1490 H= 372:30 +CPU= 28.855
  14:16:48 STEP 1491 H= 372:45 +CPU= 27.559
  14:17:15 STEP 1492 H= 373:00 +CPU= 27.035
  14:17:44 STEP 1493 H= 373:15 +CPU= 28.232
  14:18:12 STEP 1494 H= 373:30 +CPU= 28.119
  14:18:40 STEP 1495 H= 373:45 +CPU= 28.074
  14:19:08 STEP 1496 H= 374:00 +CPU= 28.166
  14:19:35 STEP 1497 H= 374:15 +CPU= 26.741
  14:20:03 STEP 1498 H= 374:30 +CPU= 27.212
  14:20:31 STEP 1499 H= 374:45 +CPU= 28.287
  14:21:04 STEP 1500 H= 375:00 +CPU= 32.781
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMGGh7zg+001500
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMSHh7zg+001500
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMUAh7zg+001500
  14:21:32 STEP 1501 H= 375:15 +CPU= 27.932
  14:22:00 STEP 1502 H= 375:30 +CPU= 27.622
  14:22:29 STEP 1503 H= 375:45 +CPU= 29.223
  14:22:58 STEP 1504 H= 376:00 +CPU= 29.353
  14:23:27 STEP 1505 H= 376:15 +CPU= 28.653
  14:23:55 STEP 1506 H= 376:30 +CPU= 27.794
  14:24:22 STEP 1507 H= 376:45 +CPU= 26.931
  14:24:52 STEP 1508 H= 377:00 +CPU= 29.602
  14:25:20 STEP 1509 H= 377:15 +CPU= 27.712
  14:25:48 STEP 1510 H= 377:30 +CPU= 28.250
  14:26:16 STEP 1511 H= 377:45 +CPU= 27.404
  14:26:51 STEP 1512 H= 378:00 +CPU= 35.210
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMGGh7zg+001512
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMSHh7zg+001512
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMUAh7zg+001512
  14:27:18 STEP 1513 H= 378:15 +CPU= 26.934
  14:27:46 STEP 1514 H= 378:30 +CPU= 28.209
  14:28:16 STEP 1515 H= 378:45 +CPU= 29.533
  14:28:45 STEP 1516 H= 379:00 +CPU= 28.442
  14:29:13 STEP 1517 H= 379:15 +CPU= 27.956
  14:29:40 STEP 1518 H= 379:30 +CPU= 27.167
  14:30:07 STEP 1519 H= 379:45 +CPU= 27.189
  14:30:36 STEP 1520 H= 380:00 +CPU= 28.709
  14:31:04 STEP 1521 H= 380:15 +CPU= 28.235
  14:31:33 STEP 1522 H= 380:30 +CPU= 27.990
  14:32:00 STEP 1523 H= 380:45 +CPU= 27.408
  14:32:34 STEP 1524 H= 381:00 +CPU= 34.242
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMGGh7zg+001524
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMSHh7zg+001524
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMUAh7zg+001524
  14:33:03 STEP 1525 H= 381:15 +CPU= 28.619
  14:33:32 STEP 1526 H= 381:30 +CPU= 29.131
  14:34:01 STEP 1527 H= 381:45 +CPU= 28.716
  14:34:29 STEP 1528 H= 382:00 +CPU= 27.661
  14:34:57 STEP 1529 H= 382:15 +CPU= 27.887
  14:35:23 STEP 1530 H= 382:30 +CPU= 26.238
  14:35:50 STEP 1531 H= 382:45 +CPU= 26.916
  14:36:18 STEP 1532 H= 383:00 +CPU= 27.724
  14:36:45 STEP 1533 H= 383:15 +CPU= 26.220
  14:37:11 STEP 1534 H= 383:30 +CPU= 26.348
  14:37:39 STEP 1535 H= 383:45 +CPU= 27.528
  14:38:18 STEP 1536 H= 384:00 +CPU= 39.426
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMGGh7zg+001536
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMSHh7zg+001536
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMUAh7zg+001536
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12289297/ICMGGh7zg+001440
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12289297/ICMSHh7zg+001440
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12289297/ICMUAh7zg+001440
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12289297/ICMGGh7zg+001452
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12289297/ICMSHh7zg+001452
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12289297/ICMUAh7zg+001452
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12289297/ICMGGh7zg+001464
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12289297/ICMSHh7zg+001464
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12289297/ICMUAh7zg+001464
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12289297/ICMGGh7zg+001476
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12289297/ICMSHh7zg+001476
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12289297/ICMUAh7zg+001476
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12289297/ICMGGh7zg+001488
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12289297/ICMSHh7zg+001488
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12289297/ICMUAh7zg+001488
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12289297/ICMGGh7zg+001500
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12289297/ICMSHh7zg+001500
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12289297/ICMUAh7zg+001500
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12289297/ICMGGh7zg+001512
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12289297/ICMSHh7zg+001512
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12289297/ICMUAh7zg+001512
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12289297/ICMGGh7zg+001524
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12289297/ICMSHh7zg+001524
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12289297/ICMUAh7zg+001524
Zipping up the intermediate file: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_a0qy_2016092300_20_1018_12289297_0_r979929682_15.zip
Uploading the intermediate file: upload_file_15.zip
  14:38:48 STEP 1537 H= 384:15 +CPU= 29.937
  14:39:18 STEP 1538 H= 384:30 +CPU= 29.453
  14:39:47 STEP 1539 H= 384:45 +CPU= 28.988
  14:40:15 STEP 1540 H= 385:00 +CPU= 28.268
  14:40:43 STEP 1541 H= 385:15 +CPU= 27.123
  14:41:10 STEP 1542 H= 385:30 +CPU= 27.479
  14:41:38 STEP 1543 H= 385:45 +CPU= 28.119
  14:42:06 STEP 1544 H= 386:00 +CPU= 27.272
  14:42:34 STEP 1545 H= 386:15 +CPU= 28.097
  14:43:03 STEP 1546 H= 386:30 +CPU= 28.647
  14:43:32 STEP 1547 H= 386:45 +CPU= 28.728
  14:44:07 STEP 1548 H= 387:00 +CPU= 35.449
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMGGh7zg+001548
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMSHh7zg+001548
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMUAh7zg+001548
  14:44:36 STEP 1549 H= 387:15 +CPU= 28.694
  14:45:05 STEP 1550 H= 387:30 +CPU= 28.338
  14:45:33 STEP 1551 H= 387:45 +CPU= 28.388
  14:46:02 STEP 1552 H= 388:00 +CPU= 29.023
  14:46:31 STEP 1553 H= 388:15 +CPU= 28.374
  14:47:00 STEP 1554 H= 388:30 +CPU= 29.247
  14:47:28 STEP 1555 H= 388:45 +CPU= 28.059
  14:47:57 STEP 1556 H= 389:00 +CPU= 28.913
  14:48:25 STEP 1557 H= 389:15 +CPU= 27.876
  14:48:52 STEP 1558 H= 389:30 +CPU= 26.578
  14:49:19 STEP 1559 H= 389:45 +CPU= 26.882
  14:49:54 STEP 1560 H= 390:00 +CPU= 34.734
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMGGh7zg+001560
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMSHh7zg+001560
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMUAh7zg+001560
  14:50:21 STEP 1561 H= 390:15 +CPU= 27.088
  14:50:50 STEP 1562 H= 390:30 +CPU= 28.945
  14:51:18 STEP 1563 H= 390:45 +CPU= 27.991
  14:51:45 STEP 1564 H= 391:00 +CPU= 26.668
  14:52:12 STEP 1565 H= 391:15 +CPU= 27.079
  14:52:40 STEP 1566 H= 391:30 +CPU= 28.186
  14:53:09 STEP 1567 H= 391:45 +CPU= 28.651
  14:53:38 STEP 1568 H= 392:00 +CPU= 28.576
  14:54:06 STEP 1569 H= 392:15 +CPU= 28.561
  14:54:35 STEP 1570 H= 392:30 +CPU= 28.532
  14:55:03 STEP 1571 H= 392:45 +CPU= 28.082
  14:55:39 STEP 1572 H= 393:00 +CPU= 35.223
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMGGh7zg+001572
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMSHh7zg+001572
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMUAh7zg+001572
  14:56:08 STEP 1573 H= 393:15 +CPU= 29.062
  14:56:36 STEP 1574 H= 393:30 +CPU= 28.026
  14:57:05 STEP 1575 H= 393:45 +CPU= 28.379
  14:57:34 STEP 1576 H= 394:00 +CPU= 28.872
  14:58:01 STEP 1577 H= 394:15 +CPU= 27.820
  14:58:30 STEP 1578 H= 394:30 +CPU= 28.589
  14:58:59 STEP 1579 H= 394:45 +CPU= 28.525
  14:59:27 STEP 1580 H= 395:00 +CPU= 28.354
  14:59:55 STEP 1581 H= 395:15 +CPU= 27.183
  15:00:21 STEP 1582 H= 395:30 +CPU= 26.792
  15:00:50 STEP 1583 H= 395:45 +CPU= 27.992
  15:01:27 STEP 1584 H= 396:00 +CPU= 37.631
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMGGh7zg+001584
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMSHh7zg+001584
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMUAh7zg+001584
  15:01:56 STEP 1585 H= 396:15 +CPU= 28.817
  15:02:23 STEP 1586 H= 396:30 +CPU= 26.967
  15:02:51 STEP 1587 H= 396:45 +CPU= 27.579
  15:03:20 STEP 1588 H= 397:00 +CPU= 28.839
  15:03:49 STEP 1589 H= 397:15 +CPU= 29.128
  15:04:19 STEP 1590 H= 397:30 +CPU= 29.660
  15:04:47 STEP 1591 H= 397:45 +CPU= 27.496
  15:05:16 STEP 1592 H= 398:00 +CPU= 28.995
  15:05:43 STEP 1593 H= 398:15 +CPU= 27.263
  15:06:10 STEP 1594 H= 398:30 +CPU= 26.996
  15:06:38 STEP 1595 H= 398:45 +CPU= 27.318
  15:07:12 STEP 1596 H= 399:00 +CPU= 33.986
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMGGh7zg+001596
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMSHh7zg+001596
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMUAh7zg+001596
  15:07:39 STEP 1597 H= 399:15 +CPU= 27.582
  15:08:07 STEP 1598 H= 399:30 +CPU= 27.276
  15:08:35 STEP 1599 H= 399:45 +CPU= 28.135
  15:09:06 STEP 1600 H= 400:00 +CPU= 30.348
  15:09:35 STEP 1601 H= 400:15 +CPU= 29.432
  15:10:03 STEP 1602 H= 400:30 +CPU= 28.081
  15:10:30 STEP 1603 H= 400:45 +CPU= 26.667
  15:10:58 STEP 1604 H= 401:00 +CPU= 27.411
  15:11:25 STEP 1605 H= 401:15 +CPU= 26.975
  15:11:53 STEP 1606 H= 401:30 +CPU= 27.892
  15:12:19 STEP 1607 H= 401:45 +CPU= 26.641
  15:12:54 STEP 1608 H= 402:00 +CPU= 34.355
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMGGh7zg+001608
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMSHh7zg+001608
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMUAh7zg+001608
  15:13:22 STEP 1609 H= 402:15 +CPU= 27.691
  15:13:51 STEP 1610 H= 402:30 +CPU= 29.362
  15:14:19 STEP 1611 H= 402:45 +CPU= 27.503
  15:14:47 STEP 1612 H= 403:00 +CPU= 28.022
  15:15:15 STEP 1613 H= 403:15 +CPU= 27.760
  15:15:42 STEP 1614 H= 403:30 +CPU= 27.510
  15:16:10 STEP 1615 H= 403:45 +CPU= 27.130
  15:16:39 STEP 1616 H= 404:00 +CPU= 29.606
  15:17:08 STEP 1617 H= 404:15 +CPU= 28.694
  15:17:36 STEP 1618 H= 404:30 +CPU= 27.767
  15:18:06 STEP 1619 H= 404:45 +CPU= 30.166
  15:18:44 STEP 1620 H= 405:00 +CPU= 37.450
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMGGh7zg+001620
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMSHh7zg+001620
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMUAh7zg+001620
  15:19:14 STEP 1621 H= 405:15 +CPU= 29.372
  15:19:42 STEP 1622 H= 405:30 +CPU= 28.296
  15:20:10 STEP 1623 H= 405:45 +CPU= 27.798
  15:20:39 STEP 1624 H= 406:00 +CPU= 28.598
  15:21:07 STEP 1625 H= 406:15 +CPU= 27.914
  15:21:33 STEP 1626 H= 406:30 +CPU= 26.655
  15:22:02 STEP 1627 H= 406:45 +CPU= 28.251
  15:22:31 STEP 1628 H= 407:00 +CPU= 29.545
  15:23:01 STEP 1629 H= 407:15 +CPU= 29.090
  15:23:29 STEP 1630 H= 407:30 +CPU= 28.661
  15:23:58 STEP 1631 H= 407:45 +CPU= 27.930
  15:24:35 STEP 1632 H= 408:00 +CPU= 37.664
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMGGh7zg+001632
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMSHh7zg+001632
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMUAh7zg+001632
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12289297/ICMGGh7zg+001536
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12289297/ICMSHh7zg+001536
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12289297/ICMUAh7zg+001536
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12289297/ICMGGh7zg+001548
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12289297/ICMSHh7zg+001548
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12289297/ICMUAh7zg+001548
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12289297/ICMGGh7zg+001560
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12289297/ICMSHh7zg+001560
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12289297/ICMUAh7zg+001560
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12289297/ICMGGh7zg+001572
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12289297/ICMSHh7zg+001572
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12289297/ICMUAh7zg+001572
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12289297/ICMGGh7zg+001584
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12289297/ICMSHh7zg+001584
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12289297/ICMUAh7zg+001584
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12289297/ICMGGh7zg+001596
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12289297/ICMSHh7zg+001596
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12289297/ICMUAh7zg+001596
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12289297/ICMGGh7zg+001608
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12289297/ICMSHh7zg+001608
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12289297/ICMUAh7zg+001608
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12289297/ICMGGh7zg+001620
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12289297/ICMSHh7zg+001620
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12289297/ICMUAh7zg+001620
Zipping up the intermediate file: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_a0qy_2016092300_20_1018_12289297_0_r979929682_16.zip
Uploading the intermediate file: upload_file_16.zip
  15:25:04 STEP 1633 H= 408:15 +CPU= 28.793
  15:25:33 STEP 1634 H= 408:30 +CPU= 28.309
  15:26:02 STEP 1635 H= 408:45 +CPU= 29.357
  15:26:32 STEP 1636 H= 409:00 +CPU= 29.298
  15:26:59 STEP 1637 H= 409:15 +CPU= 27.506
  15:27:27 STEP 1638 H= 409:30 +CPU= 27.116
  15:27:54 STEP 1639 H= 409:45 +CPU= 27.722
  15:28:24 STEP 1640 H= 410:00 +CPU= 29.821
  15:28:53 STEP 1641 H= 410:15 +CPU= 28.854
  15:29:21 STEP 1642 H= 410:30 +CPU= 27.846
  15:29:50 STEP 1643 H= 410:45 +CPU= 28.281
  15:30:24 STEP 1644 H= 411:00 +CPU= 34.286
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMGGh7zg+001644
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMSHh7zg+001644
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMUAh7zg+001644
  15:30:51 STEP 1645 H= 411:15 +CPU= 27.144
  15:31:19 STEP 1646 H= 411:30 +CPU= 27.570
  15:31:47 STEP 1647 H= 411:45 +CPU= 28.196
  15:32:15 STEP 1648 H= 412:00 +CPU= 27.996
  15:32:42 STEP 1649 H= 412:15 +CPU= 26.927
  15:33:11 STEP 1650 H= 412:30 +CPU= 28.137
  15:33:40 STEP 1651 H= 412:45 +CPU= 28.958
  15:34:09 STEP 1652 H= 413:00 +CPU= 29.558
  15:34:37 STEP 1653 H= 413:15 +CPU= 27.905
  15:35:06 STEP 1654 H= 413:30 +CPU= 28.659
  15:35:35 STEP 1655 H= 413:45 +CPU= 28.713
  15:36:11 STEP 1656 H= 414:00 +CPU= 35.651
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMGGh7zg+001656
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMSHh7zg+001656
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMUAh7zg+001656
  15:36:38 STEP 1657 H= 414:15 +CPU= 27.580
  15:37:05 STEP 1658 H= 414:30 +CPU= 26.697
  15:37:33 STEP 1659 H= 414:45 +CPU= 27.428
  15:38:00 STEP 1660 H= 415:00 +CPU= 27.281
  15:38:27 STEP 1661 H= 415:15 +CPU= 27.119
  15:38:54 STEP 1662 H= 415:30 +CPU= 26.949
  15:39:22 STEP 1663 H= 415:45 +CPU= 27.896
  15:39:51 STEP 1664 H= 416:00 +CPU= 28.344
  15:40:18 STEP 1665 H= 416:15 +CPU= 27.455
  15:40:48 STEP 1666 H= 416:30 +CPU= 29.122
  15:41:17 STEP 1667 H= 416:45 +CPU= 28.737
  15:41:51 STEP 1668 H= 417:00 +CPU= 34.471
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMGGh7zg+001668
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMSHh7zg+001668
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMUAh7zg+001668
  15:42:20 STEP 1669 H= 417:15 +CPU= 28.451
  15:42:47 STEP 1670 H= 417:30 +CPU= 27.233
  15:43:15 STEP 1671 H= 417:45 +CPU= 27.932
  15:43:44 STEP 1672 H= 418:00 +CPU= 29.037
  15:44:14 STEP 1673 H= 418:15 +CPU= 29.096
  15:44:42 STEP 1674 H= 418:30 +CPU= 28.701
  15:45:11 STEP 1675 H= 418:45 +CPU= 28.761
  15:45:41 STEP 1676 H= 419:00 +CPU= 29.521
  15:46:10 STEP 1677 H= 419:15 +CPU= 29.354
  15:46:39 STEP 1678 H= 419:30 +CPU= 28.688
  15:47:09 STEP 1679 H= 419:45 +CPU= 29.309
  15:47:47 STEP 1680 H= 420:00 +CPU= 38.120
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMGGh7zg+001680
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMSHh7zg+001680
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMUAh7zg+001680
  15:48:15 STEP 1681 H= 420:15 +CPU= 27.898
  15:48:43 STEP 1682 H= 420:30 +CPU= 27.917
  15:49:10 STEP 1683 H= 420:45 +CPU= 27.156
  15:49:38 STEP 1684 H= 421:00 +CPU= 27.731
  15:50:06 STEP 1685 H= 421:15 +CPU= 28.001
  15:50:36 STEP 1686 H= 421:30 +CPU= 29.602
  15:51:05 STEP 1687 H= 421:45 +CPU= 29.024
  15:51:35 STEP 1688 H= 422:00 +CPU= 29.563
  15:52:04 STEP 1689 H= 422:15 +CPU= 28.669
  15:52:31 STEP 1690 H= 422:30 +CPU= 27.780
  15:52:59 STEP 1691 H= 422:45 +CPU= 27.322
  15:53:33 STEP 1692 H= 423:00 +CPU= 33.847
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMGGh7zg+001692
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMSHh7zg+001692
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMUAh7zg+001692
  15:54:01 STEP 1693 H= 423:15 +CPU= 28.182
  15:54:29 STEP 1694 H= 423:30 +CPU= 28.245
  15:54:58 STEP 1695 H= 423:45 +CPU= 28.512
  15:55:28 STEP 1696 H= 424:00 +CPU= 29.494
  15:55:56 STEP 1697 H= 424:15 +CPU= 27.881
  15:56:24 STEP 1698 H= 424:30 +CPU= 28.455
  15:56:53 STEP 1699 H= 424:45 +CPU= 28.491
  15:57:22 STEP 1700 H= 425:00 +CPU= 28.952
  15:57:50 STEP 1701 H= 425:15 +CPU= 28.101
  15:58:19 STEP 1702 H= 425:30 +CPU= 28.478
  15:58:47 STEP 1703 H= 425:45 +CPU= 28.510
  15:59:23 STEP 1704 H= 426:00 +CPU= 35.106
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMGGh7zg+001704
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMSHh7zg+001704
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMUAh7zg+001704
  15:59:51 STEP 1705 H= 426:15 +CPU= 28.520
  16:00:19 STEP 1706 H= 426:30 +CPU= 27.897
  16:00:47 STEP 1707 H= 426:45 +CPU= 27.782
  16:01:17 STEP 1708 H= 427:00 +CPU= 29.373
  16:01:46 STEP 1709 H= 427:15 +CPU= 28.854
  16:02:15 STEP 1710 H= 427:30 +CPU= 29.298
  16:02:44 STEP 1711 H= 427:45 +CPU= 28.235
  16:03:13 STEP 1712 H= 428:00 +CPU= 29.584
  16:03:42 STEP 1713 H= 428:15 +CPU= 29.141
  16:04:12 STEP 1714 H= 428:30 +CPU= 29.193
  16:04:39 STEP 1715 H= 428:45 +CPU= 27.419
  16:05:15 STEP 1716 H= 429:00 +CPU= 35.992
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMGGh7zg+001716
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMSHh7zg+001716
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMUAh7zg+001716
  16:05:44 STEP 1717 H= 429:15 +CPU= 28.422
  16:06:11 STEP 1718 H= 429:30 +CPU= 27.227
  16:06:39 STEP 1719 H= 429:45 +CPU= 27.972
  16:07:08 STEP 1720 H= 430:00 +CPU= 28.612
  16:07:36 STEP 1721 H= 430:15 +CPU= 27.526
  16:08:03 STEP 1722 H= 430:30 +CPU= 27.331
  16:08:31 STEP 1723 H= 430:45 +CPU= 27.919
  16:08:59 STEP 1724 H= 431:00 +CPU= 28.031
  16:09:27 STEP 1725 H= 431:15 +CPU= 27.827
  16:09:56 STEP 1726 H= 431:30 +CPU= 28.088
  16:10:23 STEP 1727 H= 431:45 +CPU= 26.888
  16:11:00 STEP 1728 H= 432:00 +CPU= 36.839
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMGGh7zg+001728
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMSHh7zg+001728
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMUAh7zg+001728
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12289297/ICMGGh7zg+001632
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12289297/ICMSHh7zg+001632
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12289297/ICMUAh7zg+001632
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12289297/ICMGGh7zg+001644
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12289297/ICMSHh7zg+001644
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12289297/ICMUAh7zg+001644
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12289297/ICMGGh7zg+001656
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12289297/ICMSHh7zg+001656
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12289297/ICMUAh7zg+001656
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12289297/ICMGGh7zg+001668
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12289297/ICMSHh7zg+001668
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12289297/ICMUAh7zg+001668
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12289297/ICMGGh7zg+001680
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12289297/ICMSHh7zg+001680
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12289297/ICMUAh7zg+001680
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12289297/ICMGGh7zg+001692
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12289297/ICMSHh7zg+001692
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12289297/ICMUAh7zg+001692
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12289297/ICMGGh7zg+001704
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12289297/ICMSHh7zg+001704
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12289297/ICMUAh7zg+001704
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12289297/ICMGGh7zg+001716
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12289297/ICMSHh7zg+001716
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12289297/ICMUAh7zg+001716
Zipping up the intermediate file: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_a0qy_2016092300_20_1018_12289297_0_r979929682_17.zip
Uploading the intermediate file: upload_file_17.zip
  16:11:27 STEP 1729 H= 432:15 +CPU= 27.667
  16:11:55 STEP 1730 H= 432:30 +CPU= 27.815
  16:12:24 STEP 1731 H= 432:45 +CPU= 28.728
  16:12:54 STEP 1732 H= 433:00 +CPU= 29.676
  16:13:23 STEP 1733 H= 433:15 +CPU= 28.647
  16:13:51 STEP 1734 H= 433:30 +CPU= 28.519
  16:14:19 STEP 1735 H= 433:45 +CPU= 27.524
  16:14:48 STEP 1736 H= 434:00 +CPU= 28.652
  16:15:15 STEP 1737 H= 434:15 +CPU= 27.530
  16:15:43 STEP 1738 H= 434:30 +CPU= 27.568
  16:16:10 STEP 1739 H= 434:45 +CPU= 27.234
  16:16:45 STEP 1740 H= 435:00 +CPU= 34.209
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMGGh7zg+001740
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMSHh7zg+001740
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMUAh7zg+001740
  16:17:12 STEP 1741 H= 435:15 +CPU= 27.492
  16:17:39 STEP 1742 H= 435:30 +CPU= 27.060
  16:18:06 STEP 1743 H= 435:45 +CPU= 26.871
  16:18:35 STEP 1744 H= 436:00 +CPU= 28.161
  16:19:02 STEP 1745 H= 436:15 +CPU= 26.905
  16:19:29 STEP 1746 H= 436:30 +CPU= 27.247
  16:19:58 STEP 1747 H= 436:45 +CPU= 28.939
  16:20:27 STEP 1748 H= 437:00 +CPU= 29.195
  16:20:56 STEP 1749 H= 437:15 +CPU= 28.472
  16:21:24 STEP 1750 H= 437:30 +CPU= 27.588
  16:21:52 STEP 1751 H= 437:45 +CPU= 28.120
  16:22:27 STEP 1752 H= 438:00 +CPU= 35.392
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMGGh7zg+001752
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMSHh7zg+001752
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMUAh7zg+001752
  16:22:56 STEP 1753 H= 438:15 +CPU= 28.370
  16:23:24 STEP 1754 H= 438:30 +CPU= 28.280
  16:23:52 STEP 1755 H= 438:45 +CPU= 28.136
  16:24:21 STEP 1756 H= 439:00 +CPU= 28.764
  16:24:50 STEP 1757 H= 439:15 +CPU= 28.804
  16:25:18 STEP 1758 H= 439:30 +CPU= 27.986
  16:25:47 STEP 1759 H= 439:45 +CPU= 28.262
  16:26:16 STEP 1760 H= 440:00 +CPU= 28.992
  16:26:45 STEP 1761 H= 440:15 +CPU= 28.629
  16:27:13 STEP 1762 H= 440:30 +CPU= 28.253
  16:27:41 STEP 1763 H= 440:45 +CPU= 28.105
  16:28:17 STEP 1764 H= 441:00 +CPU= 35.845
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMGGh7zg+001764
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMSHh7zg+001764
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMUAh7zg+001764
  16:28:46 STEP 1765 H= 441:15 +CPU= 29.084
  16:29:15 STEP 1766 H= 441:30 +CPU= 28.557
  16:29:42 STEP 1767 H= 441:45 +CPU= 26.859
  16:30:10 STEP 1768 H= 442:00 +CPU= 28.340
  16:30:38 STEP 1769 H= 442:15 +CPU= 27.744
  16:31:06 STEP 1770 H= 442:30 +CPU= 28.003
  16:31:34 STEP 1771 H= 442:45 +CPU= 27.550
  16:32:02 STEP 1772 H= 443:00 +CPU= 27.746
  16:32:30 STEP 1773 H= 443:15 +CPU= 27.634
  16:32:58 STEP 1774 H= 443:30 +CPU= 28.182
  16:33:27 STEP 1775 H= 443:45 +CPU= 28.529
  16:34:05 STEP 1776 H= 444:00 +CPU= 37.823
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMGGh7zg+001776
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMSHh7zg+001776
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMUAh7zg+001776
  16:34:32 STEP 1777 H= 444:15 +CPU= 27.589
  16:35:01 STEP 1778 H= 444:30 +CPU= 28.659
  16:35:30 STEP 1779 H= 444:45 +CPU= 28.722
  16:36:00 STEP 1780 H= 445:00 +CPU= 29.448
  16:36:29 STEP 1781 H= 445:15 +CPU= 29.036
  16:36:59 STEP 1782 H= 445:30 +CPU= 29.548
  16:37:28 STEP 1783 H= 445:45 +CPU= 29.662
  16:37:57 STEP 1784 H= 446:00 +CPU= 28.468
  16:38:26 STEP 1785 H= 446:15 +CPU= 29.145
  16:38:55 STEP 1786 H= 446:30 +CPU= 29.124
  16:39:23 STEP 1787 H= 446:45 +CPU= 27.514
  16:39:58 STEP 1788 H= 447:00 +CPU= 34.345
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMGGh7zg+001788
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMSHh7zg+001788
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMUAh7zg+001788
  16:40:25 STEP 1789 H= 447:15 +CPU= 27.296
  16:40:51 STEP 1790 H= 447:30 +CPU= 26.328
  16:41:20 STEP 1791 H= 447:45 +CPU= 28.564
  16:41:49 STEP 1792 H= 448:00 +CPU= 29.109
  16:42:18 STEP 1793 H= 448:15 +CPU= 28.517
  16:42:47 STEP 1794 H= 448:30 +CPU= 28.622
  16:43:15 STEP 1795 H= 448:45 +CPU= 28.466
  16:43:45 STEP 1796 H= 449:00 +CPU= 29.740
  16:44:14 STEP 1797 H= 449:15 +CPU= 29.127
  16:44:43 STEP 1798 H= 449:30 +CPU= 28.747
  16:45:12 STEP 1799 H= 449:45 +CPU= 28.940
  16:45:47 STEP 1800 H= 450:00 +CPU= 34.446
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMGGh7zg+001800
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMSHh7zg+001800
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMUAh7zg+001800
  16:46:16 STEP 1801 H= 450:15 +CPU= 28.541
  16:46:43 STEP 1802 H= 450:30 +CPU= 27.474
  16:47:12 STEP 1803 H= 450:45 +CPU= 28.471
  16:47:41 STEP 1804 H= 451:00 +CPU= 29.084
  16:48:09 STEP 1805 H= 451:15 +CPU= 28.064
  16:48:39 STEP 1806 H= 451:30 +CPU= 29.391
  16:49:07 STEP 1807 H= 451:45 +CPU= 28.160
  16:49:37 STEP 1808 H= 452:00 +CPU= 29.572
  16:50:06 STEP 1809 H= 452:15 +CPU= 29.117
  16:50:33 STEP 1810 H= 452:30 +CPU= 27.027
  16:51:01 STEP 1811 H= 452:45 +CPU= 27.798
  16:51:35 STEP 1812 H= 453:00 +CPU= 33.865
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMGGh7zg+001812
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMSHh7zg+001812
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMUAh7zg+001812
  16:52:04 STEP 1813 H= 453:15 +CPU= 28.853
  16:52:32 STEP 1814 H= 453:30 +CPU= 28.143
  16:53:01 STEP 1815 H= 453:45 +CPU= 29.048
  16:53:31 STEP 1816 H= 454:00 +CPU= 29.483
  16:54:00 STEP 1817 H= 454:15 +CPU= 28.771
  16:54:28 STEP 1818 H= 454:30 +CPU= 27.514
  16:54:56 STEP 1819 H= 454:45 +CPU= 28.505
  16:55:26 STEP 1820 H= 455:00 +CPU= 29.428
  16:55:54 STEP 1821 H= 455:15 +CPU= 28.398
  16:56:23 STEP 1822 H= 455:30 +CPU= 28.149
  16:56:50 STEP 1823 H= 455:45 +CPU= 27.837
  16:57:30 STEP 1824 H= 456:00 +CPU= 39.262
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMGGh7zg+001824
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMSHh7zg+001824
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMUAh7zg+001824
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12289297/ICMGGh7zg+001728
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12289297/ICMSHh7zg+001728
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12289297/ICMUAh7zg+001728
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12289297/ICMGGh7zg+001740
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12289297/ICMSHh7zg+001740
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12289297/ICMUAh7zg+001740
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12289297/ICMGGh7zg+001752
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12289297/ICMSHh7zg+001752
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12289297/ICMUAh7zg+001752
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12289297/ICMGGh7zg+001764
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12289297/ICMSHh7zg+001764
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12289297/ICMUAh7zg+001764
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12289297/ICMGGh7zg+001776
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12289297/ICMSHh7zg+001776
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12289297/ICMUAh7zg+001776
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12289297/ICMGGh7zg+001788
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12289297/ICMSHh7zg+001788
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12289297/ICMUAh7zg+001788
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12289297/ICMGGh7zg+001800
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12289297/ICMSHh7zg+001800
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12289297/ICMUAh7zg+001800
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12289297/ICMGGh7zg+001812
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12289297/ICMSHh7zg+001812
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12289297/ICMUAh7zg+001812
Zipping up the intermediate file: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_a0qy_2016092300_20_1018_12289297_0_r979929682_18.zip
Uploading the intermediate file: upload_file_18.zip
  16:57:59 STEP 1825 H= 456:15 +CPU= 28.634
  16:58:28 STEP 1826 H= 456:30 +CPU= 29.550
  16:58:58 STEP 1827 H= 456:45 +CPU= 29.299
  16:59:27 STEP 1828 H= 457:00 +CPU= 29.230
  16:59:54 STEP 1829 H= 457:15 +CPU= 26.864
  17:00:21 STEP 1830 H= 457:30 +CPU= 26.652
  17:00:47 STEP 1831 H= 457:45 +CPU= 26.520
  17:01:15 STEP 1832 H= 458:00 +CPU= 27.425
  17:01:41 STEP 1833 H= 458:15 +CPU= 26.296
  17:02:08 STEP 1834 H= 458:30 +CPU= 26.727
  17:02:35 STEP 1835 H= 458:45 +CPU= 26.778
  17:03:09 STEP 1836 H= 459:00 +CPU= 33.553
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMGGh7zg+001836
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMSHh7zg+001836
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMUAh7zg+001836
  17:03:38 STEP 1837 H= 459:15 +CPU= 28.764
  17:04:06 STEP 1838 H= 459:30 +CPU= 28.459
  17:04:34 STEP 1839 H= 459:45 +CPU= 27.327
  17:05:03 STEP 1840 H= 460:00 +CPU= 29.376
  17:05:31 STEP 1841 H= 460:15 +CPU= 28.189
  17:06:00 STEP 1842 H= 460:30 +CPU= 27.981
  17:06:29 STEP 1843 H= 460:45 +CPU= 28.968
  17:06:57 STEP 1844 H= 461:00 +CPU= 28.072
  17:07:25 STEP 1845 H= 461:15 +CPU= 27.931
  17:07:52 STEP 1846 H= 461:30 +CPU= 27.130
  17:08:21 STEP 1847 H= 461:45 +CPU= 28.627
  17:08:56 STEP 1848 H= 462:00 +CPU= 35.334
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMGGh7zg+001848
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMSHh7zg+001848
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMUAh7zg+001848
  17:09:25 STEP 1849 H= 462:15 +CPU= 28.541
  17:09:53 STEP 1850 H= 462:30 +CPU= 27.966
  17:10:22 STEP 1851 H= 462:45 +CPU= 29.100
  17:10:52 STEP 1852 H= 463:00 +CPU= 29.449
  17:11:21 STEP 1853 H= 463:15 +CPU= 28.767
  17:11:51 STEP 1854 H= 463:30 +CPU= 30.438
  17:12:21 STEP 1855 H= 463:45 +CPU= 29.304
  17:12:50 STEP 1856 H= 464:00 +CPU= 29.220
  17:13:19 STEP 1857 H= 464:15 +CPU= 28.357
  17:13:48 STEP 1858 H= 464:30 +CPU= 28.933
  17:14:16 STEP 1859 H= 464:45 +CPU= 28.554
  17:14:52 STEP 1860 H= 465:00 +CPU= 35.389
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMGGh7zg+001860
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMSHh7zg+001860
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMUAh7zg+001860
  17:15:22 STEP 1861 H= 465:15 +CPU= 29.753
  17:15:51 STEP 1862 H= 465:30 +CPU= 28.782
  17:16:18 STEP 1863 H= 465:45 +CPU= 27.178
  17:16:47 STEP 1864 H= 466:00 +CPU= 28.749
  17:17:16 STEP 1865 H= 466:15 +CPU= 28.576
  17:17:44 STEP 1866 H= 466:30 +CPU= 28.570
  17:18:13 STEP 1867 H= 466:45 +CPU= 28.553
  17:18:42 STEP 1868 H= 467:00 +CPU= 28.544
  17:19:09 STEP 1869 H= 467:15 +CPU= 27.158
  17:19:35 STEP 1870 H= 467:30 +CPU= 26.472
  17:20:03 STEP 1871 H= 467:45 +CPU= 27.136
  17:20:39 STEP 1872 H= 468:00 +CPU= 36.412
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMGGh7zg+001872
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMSHh7zg+001872
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMUAh7zg+001872
  17:21:07 STEP 1873 H= 468:15 +CPU= 27.842
  17:21:32 STEP 1874 H= 468:30 +CPU= 25.214
  17:22:01 STEP 1875 H= 468:45 +CPU= 28.484
  17:22:29 STEP 1876 H= 469:00 +CPU= 28.167
  17:22:57 STEP 1877 H= 469:15 +CPU= 27.544
  17:23:25 STEP 1878 H= 469:30 +CPU= 27.503
  17:23:53 STEP 1879 H= 469:45 +CPU= 28.522
  17:24:23 STEP 1880 H= 470:00 +CPU= 29.651
  17:24:52 STEP 1881 H= 470:15 +CPU= 28.291
  17:25:20 STEP 1882 H= 470:30 +CPU= 27.971
  17:25:47 STEP 1883 H= 470:45 +CPU= 27.299
  17:26:22 STEP 1884 H= 471:00 +CPU= 34.941
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMGGh7zg+001884
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMSHh7zg+001884
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMUAh7zg+001884
  17:26:49 STEP 1885 H= 471:15 +CPU= 27.178
  17:27:17 STEP 1886 H= 471:30 +CPU= 27.267
  17:27:45 STEP 1887 H= 471:45 +CPU= 28.059
  17:28:15 STEP 1888 H= 472:00 +CPU= 29.505
  17:28:43 STEP 1889 H= 472:15 +CPU= 27.895
  17:29:09 STEP 1890 H= 472:30 +CPU= 26.679
  17:29:37 STEP 1891 H= 472:45 +CPU= 27.495
  17:30:07 STEP 1892 H= 473:00 +CPU= 29.528
  17:30:36 STEP 1893 H= 473:15 +CPU= 29.526
  17:31:04 STEP 1894 H= 473:30 +CPU= 27.811
  17:31:32 STEP 1895 H= 473:45 +CPU= 27.985
  17:32:06 STEP 1896 H= 474:00 +CPU= 33.739
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMGGh7zg+001896
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMSHh7zg+001896
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMUAh7zg+001896
  17:32:35 STEP 1897 H= 474:15 +CPU= 29.039
  17:33:03 STEP 1898 H= 474:30 +CPU= 27.923
  17:33:31 STEP 1899 H= 474:45 +CPU= 27.853
  17:34:00 STEP 1900 H= 475:00 +CPU= 28.223
  17:34:27 STEP 1901 H= 475:15 +CPU= 26.645
  17:34:53 STEP 1902 H= 475:30 +CPU= 26.385
  17:35:20 STEP 1903 H= 475:45 +CPU= 27.126
  17:35:47 STEP 1904 H= 476:00 +CPU= 27.016
  17:36:13 STEP 1905 H= 476:15 +CPU= 25.747
  17:36:40 STEP 1906 H= 476:30 +CPU= 26.292
  17:37:06 STEP 1907 H= 476:45 +CPU= 26.287
  17:37:39 STEP 1908 H= 477:00 +CPU= 32.596
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMGGh7zg+001908
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMSHh7zg+001908
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMUAh7zg+001908
  17:38:06 STEP 1909 H= 477:15 +CPU= 27.184
  17:38:34 STEP 1910 H= 477:30 +CPU= 27.990
  17:39:01 STEP 1911 H= 477:45 +CPU= 27.100
  17:39:30 STEP 1912 H= 478:00 +CPU= 27.925
  17:39:58 STEP 1913 H= 478:15 +CPU= 28.709
  17:40:28 STEP 1914 H= 478:30 +CPU= 29.763
  17:40:57 STEP 1915 H= 478:45 +CPU= 28.574
  17:41:25 STEP 1916 H= 479:00 +CPU= 28.534
  17:41:54 STEP 1917 H= 479:15 +CPU= 28.684
  17:42:23 STEP 1918 H= 479:30 +CPU= 28.900
  17:42:52 STEP 1919 H= 479:45 +CPU= 28.904
  17:43:28 STEP 1920 H= 480:00 +CPU= 35.128
..The child process terminated with status: 0
>>> Printing last 70 lines from file: NODE.001_01

I   VARIABLE   I      Initial value         I        Current value        I
I-------------------------------------------------------------------------I
I  OMEGA (P/S) I     -0.1504540958E-20      I       0.7017182520E-06      I
ICloud fractionI      0.0000000000E+00      I       0.2632737759E-01      I
I  Relat. Hum. I      0.2515303574E+00      I       0.3404139836E+00      I
I  PASS 01     I      0.0000000000E+00      I       0.3807565645E+03      I
DDH------------------------------------------------------------------------
  
  MAXGPFV : MAX. VALUE =   0.000000000000000E+000
  MAXGPFV : MAX. VALUE =   0.000000000000000E+000
 NSTEP =  1920 SCAN2M_HPOS  P
 IO-STREAM SETUP - IOTYPE =           2  NUMIOPROCS =           1  CPATH =
 ICMGGh7zg+001920 MODE=a
 IO-STREAM CLOSED - ICMGGh7zg+001920
 MPI-TASK:   1 -    312705444 BYTES IN      7 RECORDS TRANSFERRED IN    0.0005 SECONDS625410.9 Mbytes/s, TOTAL TIME=    0.0112( 4.5%)
 17:43:28 STEP 1920 H= 480:00 +CPU= 35.128
 END CNT3
 NSTEP =  1920 CNT0   000000000  25.850  25.850  25.964   0.996               0               0               0               0               0
IO-STREAM STATISTICS, TOTAL NO OF REC/BYTES READ            0/           0 WRITTEN        57546/************
 -TASK-OPENED-OPEN-RECS IN -KBYTE IN    -RECS OUT-KBYTE OUT-WALL   -WALL IN-WALL
  OU-TOT IN -TOT OUT
   1   1008    0        0            0    57546 ************    89.7     0.0    89.7     0.0   195.3
===-=== START OF TIMING STATISTICS ===-===
 
STATS FOR ALL TASKS
 NUM ROUTINE                                     CALLS  MEAN(ms)   MAX(ms)   FRAC(%)  UNBAL(%)
   0 CNT0     - COMPLETE EXECUTION                   1 ********* *********    100.00      0.00
   1 CNT4     - FORWARD INTEGRATION                  1 ********* *********     99.99      0.00
   8 SCAN2M - GRID-POINT DYNAMICS                 2082    5130.4    5130.4     19.44      0.00
   9 SPCM     - SPECTRAL COMP.                    1920     959.2     959.2      3.35      0.00
  10 SCAN2M - PHYSICS                             1921   12702.1   12702.1     44.41      0.00
  11 IOPACK   - OUTPUT P.P. RESULTS                161     794.4     794.4      0.23      0.00
  12 SPNORM   - SPECTRAL NORM COMP.                 83      67.9      67.9      0.01      0.00
  14 SUINIF                                          1    4380.6    4380.6      0.01      0.00
  17 GRIDFPOS IN CNT4                              161      32.3      32.3      0.01      0.00
  18 SUSPECG                                         1    2375.5    2375.5      0.00      0.00
  19 SUSPEC                                          1    2380.4    2380.4      0.00      0.00
  24 SUGRIDU                                         1    1634.5    1634.5      0.00      0.00
  25 SPECRT                                          1     259.7     259.7      0.00      0.00
  26 SUGRIDF                                         1     105.9     105.9      0.00      0.00
  27 RESTART FILES - WRITING                        40    3197.4    3197.4      0.23      0.00
  28 RESTART FILES - READING                         1       0.0       0.0      0.00      0.00
  29 SU4FPOS IN CNT4                               161       0.0       0.0      0.00      0.00
  30 DYNFPOS IN CNT4                               161    5862.5    5862.5      1.72      0.00
  31 POSDDH IN STEPO                                 9       5.0       5.0      0.00      0.00
  37 CPGLAG   - SL COMPUTATIONS                   1921    6082.5    6082.5     21.27      0.00
  39 SU0YOMB                                         1     368.7     368.7      0.00      0.00
  51 SCAN2M   - SL COMM. PART 1                   1921      27.5      27.5      0.10      0.00
  54 SPCM     - M TO S/S TO M TRANSP.             1920     473.5     473.5      1.65      0.00
  55 SPCIMPF  - S TO M/M TO S TRANSP.             1920      65.7      65.7      0.23      0.00
  56 SPNORM   - SPECTRAL NORM COMM.                 83       0.3       0.3      0.00      0.00
 102 LTINV_CTL   - INVERSE LEGENDRE TRANSFORM     4165     389.1     389.1      2.95      0.00
 103 LTDIR_CTL   - DIRECT LEGENDRE TRANSFORM      4006     222.9     222.9      1.63      0.00
 106 FTDIR_CTL   - DIRECT FOURIER TRANSFORM       4006      84.9      84.9      0.62      0.00
 107 FTINV_CTL   - INVERSE FOURIER TRANSFORM      4165     112.6     112.6      0.85      0.00
 140 SULEG       - COMP. OF LEGENDRE POL.            1      29.3      29.3      0.00      0.00
 152 LTINV_CTL   - M TO L TRANSPOSITION           4165      60.3      60.3      0.46      0.00
 153 LTDIR_CTL   - L TO M TRANSPOSITION           4006      32.1      32.1      0.23      0.00
 157 FTINV_CTL   - L TO G TRANSPOSITION           4165      85.3      85.3      0.65      0.00
 158 FTDIR_CTL   - G TO L TRANSPOSITION           4006      40.5      40.5      0.30      0.00
 400 GSTATS                                     223224       0.0       0.0      0.00      0.00
 401 GSTATS HOOK                                207696       0.0       0.0      0.00      0.00
TOTAL MEASURED IMBALANCE =       0.0 SECONDS,  0.0 PERCENT
TOTAL WALLCLOCK TIME    54941.4 CPU TIME   54713.4 VECTOR TIME    54713.4


===-=== END   OF TIMING STATISTICS ===-===
FORECAST DAYS PER DAY       31.5
  *** END CNT0 *** 
------------------------------------------------
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMGGh7zg+001920
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMSHh7zg+001920
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMUAh7zg+001920
Adding to the zip: /home/pdw/Mo/1/slots/0/NODE.001_01
Adding to the zip: /home/pdw/Mo/1/slots/0/ifs.stat
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12289297/ICMSHh7zg+001896
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12289297/ICMUAh7zg+001872
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12289297/ICMGGh7zg+001920
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12289297/ICMGGh7zg+001896
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12289297/ICMUAh7zg+001896
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12289297/ICMSHh7zg+001836
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12289297/ICMUAh7zg+001848
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12289297/ICMGGh7zg+001836
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12289297/ICMSHh7zg+001860
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12289297/ICMSHh7zg+001848
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12289297/ICMGGh7zg+001824
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12289297/ICMUAh7zg+001908
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12289297/ICMGGh7zg+001872
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12289297/ICMGGh7zg+001884
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12289297/ICMSHh7zg+001824
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12289297/ICMUAh7zg+001824
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12289297/ICMUAh7zg+001884
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12289297/ICMUAh7zg+001860
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12289297/ICMSHh7zg+001920
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12289297/ICMUAh7zg+001920
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12289297/ICMSHh7zg+001908
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12289297/ICMSHh7zg+001872
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12289297/ICMGGh7zg+001908
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12289297/ICMGGh7zg+001848
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12289297/ICMUAh7zg+001836
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12289297/ICMSHh7zg+001884
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12289297/ICMGGh7zg+001860
Zipping up the final file: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_a0qy_2016092300_20_1018_12289297_0_r979929682_19.zip
Uploading the final file: upload_file_19.zip
Uploading trickle at timestep: 1727100
17:46:57 (123957): called boinc_finish(0)

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
14 Jun 2024 16:45:06 1522755 22442882 oifs_43r3_bl_a0qy_2016092300_20_1018_12289297_0 1,727,100 54,713 0.0317
14 Jun 2024 10:01:10 1522755 22442882 oifs_43r3_bl_a0qy_2016092300_20_1018_12289297_0 864,000 27,162 0.0314


©2024 cpdn.org