climateprediction.net home page
Task 22444832

Task 22444832

Name oifs_43r3_bl_a28q_2016092300_20_1018_12291233_0
Workunit 12291233
Created 13 Jun 2024, 0:14:54 UTC
Sent 13 Jun 2024, 18:14:19 UTC
Report deadline 12 Aug 2024, 18:14:19 UTC
Received 15 Jun 2024, 7:14:20 UTC
Server state Over
Outcome Success
Client state Done
Exit status 0 (0x00000000)
Computer ID 1550946
Run time 18 hours 34 min 50 sec
CPU time 18 hours 25 min 39 sec
Validate state Valid
Credit 2,635.55
Device peak FLOPS 4.54 GFLOPS
Application version OpenIFS 43r3 Baroclinic Lifecycle v1.13
x86_64-pc-linux-gnu
Peak working set size 5,025.81 MB
Peak swap size 5,981.07 MB
Peak disk usage 1,353.82 MB
Stderr
<core_client_version>7.18.1</core_client_version>
<![CDATA[
<stderr_txt>
oifs_43r3_bl_a28q_2016092300_20_1018_12291233_0_r690183884_13.zip
Uploading the intermediate file: upload_file_13.zip
  02:33:54 STEP 1345 H= 336:15 +CPU= 34.036
  02:34:30 STEP 1346 H= 336:30 +CPU= 35.284
  02:35:07 STEP 1347 H= 336:45 +CPU= 36.448
  02:35:43 STEP 1348 H= 337:00 +CPU= 35.935
  02:36:17 STEP 1349 H= 337:15 +CPU= 34.198
  02:36:54 STEP 1350 H= 337:30 +CPU= 36.035
  02:37:29 STEP 1351 H= 337:45 +CPU= 35.069
  02:38:05 STEP 1352 H= 338:00 +CPU= 36.325
  02:38:43 STEP 1353 H= 338:15 +CPU= 37.376
  02:39:19 STEP 1354 H= 338:30 +CPU= 35.609
  02:39:55 STEP 1355 H= 338:45 +CPU= 36.678
  02:40:41 STEP 1356 H= 339:00 +CPU= 45.114
Moving to projects directory: /opt/boinc/instance_homes/boinc_31418/slots/3/ICMGGh7zg+001356
Moving to projects directory: /opt/boinc/instance_homes/boinc_31418/slots/3/ICMSHh7zg+001356
Moving to projects directory: /opt/boinc/instance_homes/boinc_31418/slots/3/ICMUAh7zg+001356
  02:41:18 STEP 1357 H= 339:15 +CPU= 36.719
  02:41:56 STEP 1358 H= 339:30 +CPU= 38.007
  02:42:32 STEP 1359 H= 339:45 +CPU= 35.847
  02:43:10 STEP 1360 H= 340:00 +CPU= 38.290
  02:43:48 STEP 1361 H= 340:15 +CPU= 37.631
  02:44:24 STEP 1362 H= 340:30 +CPU= 35.335
  02:45:00 STEP 1363 H= 340:45 +CPU= 36.029
  02:45:38 STEP 1364 H= 341:00 +CPU= 37.763
  02:46:14 STEP 1365 H= 341:15 +CPU= 36.651
  02:46:51 STEP 1366 H= 341:30 +CPU= 35.933
  02:47:29 STEP 1367 H= 341:45 +CPU= 37.839
  02:48:16 STEP 1368 H= 342:00 +CPU= 47.271
Moving to projects directory: /opt/boinc/instance_homes/boinc_31418/slots/3/ICMGGh7zg+001368
Moving to projects directory: /opt/boinc/instance_homes/boinc_31418/slots/3/ICMSHh7zg+001368
Moving to projects directory: /opt/boinc/instance_homes/boinc_31418/slots/3/ICMUAh7zg+001368
  02:48:53 STEP 1369 H= 342:15 +CPU= 36.252
  02:49:29 STEP 1370 H= 342:30 +CPU= 35.960
  02:50:05 STEP 1371 H= 342:45 +CPU= 36.420
  02:50:43 STEP 1372 H= 343:00 +CPU= 37.653
  02:51:20 STEP 1373 H= 343:15 +CPU= 36.657
  02:51:57 STEP 1374 H= 343:30 +CPU= 37.272
  02:52:35 STEP 1375 H= 343:45 +CPU= 37.377
  02:53:13 STEP 1376 H= 344:00 +CPU= 37.795
  02:53:48 STEP 1377 H= 344:15 +CPU= 35.309
  02:54:24 STEP 1378 H= 344:30 +CPU= 35.747
  02:55:01 STEP 1379 H= 344:45 +CPU= 36.716
  02:55:46 STEP 1380 H= 345:00 +CPU= 45.197
Moving to projects directory: /opt/boinc/instance_homes/boinc_31418/slots/3/ICMGGh7zg+001380
Moving to projects directory: /opt/boinc/instance_homes/boinc_31418/slots/3/ICMSHh7zg+001380
Moving to projects directory: /opt/boinc/instance_homes/boinc_31418/slots/3/ICMUAh7zg+001380
  02:56:23 STEP 1381 H= 345:15 +CPU= 36.784
  02:57:02 STEP 1382 H= 345:30 +CPU= 38.997
  02:57:40 STEP 1383 H= 345:45 +CPU= 37.081
  02:58:20 STEP 1384 H= 346:00 +CPU= 39.706
  02:58:57 STEP 1385 H= 346:15 +CPU= 37.171
  02:59:33 STEP 1386 H= 346:30 +CPU= 36.240
  03:00:12 STEP 1387 H= 346:45 +CPU= 38.448
  03:00:50 STEP 1388 H= 347:00 +CPU= 37.790
  03:01:27 STEP 1389 H= 347:15 +CPU= 36.589
  03:02:04 STEP 1390 H= 347:30 +CPU= 37.068
  03:02:41 STEP 1391 H= 347:45 +CPU= 36.652
  03:03:32 STEP 1392 H= 348:00 +CPU= 51.169
Moving to projects directory: /opt/boinc/instance_homes/boinc_31418/slots/3/ICMGGh7zg+001392
Moving to projects directory: /opt/boinc/instance_homes/boinc_31418/slots/3/ICMSHh7zg+001392
Moving to projects directory: /opt/boinc/instance_homes/boinc_31418/slots/3/ICMUAh7zg+001392
  03:04:08 STEP 1393 H= 348:15 +CPU= 36.109
  03:04:44 STEP 1394 H= 348:30 +CPU= 35.839
  03:05:21 STEP 1395 H= 348:45 +CPU= 36.035
  03:05:58 STEP 1396 H= 349:00 +CPU= 37.218
  03:06:35 STEP 1397 H= 349:15 +CPU= 36.586
  03:07:12 STEP 1398 H= 349:30 +CPU= 36.844
  03:07:48 STEP 1399 H= 349:45 +CPU= 35.613
  03:08:25 STEP 1400 H= 350:00 +CPU= 37.481
  03:09:01 STEP 1401 H= 350:15 +CPU= 36.121
  03:09:38 STEP 1402 H= 350:30 +CPU= 36.819
  03:10:15 STEP 1403 H= 350:45 +CPU= 36.240
  03:11:00 STEP 1404 H= 351:00 +CPU= 45.397
Moving to projects directory: /opt/boinc/instance_homes/boinc_31418/slots/3/ICMGGh7zg+001404
Moving to projects directory: /opt/boinc/instance_homes/boinc_31418/slots/3/ICMSHh7zg+001404
Moving to projects directory: /opt/boinc/instance_homes/boinc_31418/slots/3/ICMUAh7zg+001404
  03:11:36 STEP 1405 H= 351:15 +CPU= 35.835
  03:12:13 STEP 1406 H= 351:30 +CPU= 36.684
  03:12:49 STEP 1407 H= 351:45 +CPU= 35.924
  03:13:27 STEP 1408 H= 352:00 +CPU= 37.829
  03:14:03 STEP 1409 H= 352:15 +CPU= 35.665
  03:14:40 STEP 1410 H= 352:30 +CPU= 37.007
  03:15:17 STEP 1411 H= 352:45 +CPU= 36.574
  03:15:55 STEP 1412 H= 353:00 +CPU= 37.582
  03:16:32 STEP 1413 H= 353:15 +CPU= 37.415
  03:17:08 STEP 1414 H= 353:30 +CPU= 35.883
  03:17:45 STEP 1415 H= 353:45 +CPU= 36.647
  03:18:30 STEP 1416 H= 354:00 +CPU= 44.685
Moving to projects directory: /opt/boinc/instance_homes/boinc_31418/slots/3/ICMGGh7zg+001416
Moving to projects directory: /opt/boinc/instance_homes/boinc_31418/slots/3/ICMSHh7zg+001416
Moving to projects directory: /opt/boinc/instance_homes/boinc_31418/slots/3/ICMUAh7zg+001416
  03:19:06 STEP 1417 H= 354:15 +CPU= 35.921
  03:19:43 STEP 1418 H= 354:30 +CPU= 36.361
  03:20:17 STEP 1419 H= 354:45 +CPU= 34.338
  03:20:54 STEP 1420 H= 355:00 +CPU= 36.234
  03:21:29 STEP 1421 H= 355:15 +CPU= 35.265
  03:22:05 STEP 1422 H= 355:30 +CPU= 35.227
  03:22:40 STEP 1423 H= 355:45 +CPU= 35.118
  03:23:16 STEP 1424 H= 356:00 +CPU= 36.421
  03:23:54 STEP 1425 H= 356:15 +CPU= 36.914
  03:24:30 STEP 1426 H= 356:30 +CPU= 36.335
  03:25:05 STEP 1427 H= 356:45 +CPU= 35.205
  03:25:51 STEP 1428 H= 357:00 +CPU= 44.852
Moving to projects directory: /opt/boinc/instance_homes/boinc_31418/slots/3/ICMGGh7zg+001428
Moving to projects directory: /opt/boinc/instance_homes/boinc_31418/slots/3/ICMSHh7zg+001428
Moving to projects directory: /opt/boinc/instance_homes/boinc_31418/slots/3/ICMUAh7zg+001428
  03:26:25 STEP 1429 H= 357:15 +CPU= 34.756
  03:27:02 STEP 1430 H= 357:30 +CPU= 36.087
  03:27:38 STEP 1431 H= 357:45 +CPU= 35.653
  03:28:13 STEP 1432 H= 358:00 +CPU= 35.152
  03:28:51 STEP 1433 H= 358:15 +CPU= 37.580
  03:29:28 STEP 1434 H= 358:30 +CPU= 37.459
  03:30:08 STEP 1435 H= 358:45 +CPU= 39.379
  03:30:48 STEP 1436 H= 359:00 +CPU= 39.658
  03:31:23 STEP 1437 H= 359:15 +CPU= 35.346
  03:31:59 STEP 1438 H= 359:30 +CPU= 35.610
  03:32:34 STEP 1439 H= 359:45 +CPU= 34.913
  03:33:26 STEP 1440 H= 360:00 +CPU= 51.271
Moving to projects directory: /opt/boinc/instance_homes/boinc_31418/slots/3/ICMGGh7zg+001440
Moving to projects directory: /opt/boinc/instance_homes/boinc_31418/slots/3/ICMSHh7zg+001440
Moving to projects directory: /opt/boinc/instance_homes/boinc_31418/slots/3/ICMUAh7zg+001440
Adding to the zip: /opt/boinc/instance_homes/boinc_31418/projects/climateprediction.net/oifs_43r3_bl_12291233/ICMGGh7zg+001344
Adding to the zip: /opt/boinc/instance_homes/boinc_31418/projects/climateprediction.net/oifs_43r3_bl_12291233/ICMSHh7zg+001344
Adding to the zip: /opt/boinc/instance_homes/boinc_31418/projects/climateprediction.net/oifs_43r3_bl_12291233/ICMUAh7zg+001344
Adding to the zip: /opt/boinc/instance_homes/boinc_31418/projects/climateprediction.net/oifs_43r3_bl_12291233/ICMGGh7zg+001356
Adding to the zip: /opt/boinc/instance_homes/boinc_31418/projects/climateprediction.net/oifs_43r3_bl_12291233/ICMSHh7zg+001356
Adding to the zip: /opt/boinc/instance_homes/boinc_31418/projects/climateprediction.net/oifs_43r3_bl_12291233/ICMUAh7zg+001356
Adding to the zip: /opt/boinc/instance_homes/boinc_31418/projects/climateprediction.net/oifs_43r3_bl_12291233/ICMGGh7zg+001368
Adding to the zip: /opt/boinc/instance_homes/boinc_31418/projects/climateprediction.net/oifs_43r3_bl_12291233/ICMSHh7zg+001368
Adding to the zip: /opt/boinc/instance_homes/boinc_31418/projects/climateprediction.net/oifs_43r3_bl_12291233/ICMUAh7zg+001368
Adding to the zip: /opt/boinc/instance_homes/boinc_31418/projects/climateprediction.net/oifs_43r3_bl_12291233/ICMGGh7zg+001380
Adding to the zip: /opt/boinc/instance_homes/boinc_31418/projects/climateprediction.net/oifs_43r3_bl_12291233/ICMSHh7zg+001380
Adding to the zip: /opt/boinc/instance_homes/boinc_31418/projects/climateprediction.net/oifs_43r3_bl_12291233/ICMUAh7zg+001380
Adding to the zip: /opt/boinc/instance_homes/boinc_31418/projects/climateprediction.net/oifs_43r3_bl_12291233/ICMGGh7zg+001392
Adding to the zip: /opt/boinc/instance_homes/boinc_31418/projects/climateprediction.net/oifs_43r3_bl_12291233/ICMSHh7zg+001392
Adding to the zip: /opt/boinc/instance_homes/boinc_31418/projects/climateprediction.net/oifs_43r3_bl_12291233/ICMUAh7zg+001392
Adding to the zip: /opt/boinc/instance_homes/boinc_31418/projects/climateprediction.net/oifs_43r3_bl_12291233/ICMGGh7zg+001404
Adding to the zip: /opt/boinc/instance_homes/boinc_31418/projects/climateprediction.net/oifs_43r3_bl_12291233/ICMSHh7zg+001404
Adding to the zip: /opt/boinc/instance_homes/boinc_31418/projects/climateprediction.net/oifs_43r3_bl_12291233/ICMUAh7zg+001404
Adding to the zip: /opt/boinc/instance_homes/boinc_31418/projects/climateprediction.net/oifs_43r3_bl_12291233/ICMGGh7zg+001416
Adding to the zip: /opt/boinc/instance_homes/boinc_31418/projects/climateprediction.net/oifs_43r3_bl_12291233/ICMSHh7zg+001416
Adding to the zip: /opt/boinc/instance_homes/boinc_31418/projects/climateprediction.net/oifs_43r3_bl_12291233/ICMUAh7zg+001416
Adding to the zip: /opt/boinc/instance_homes/boinc_31418/projects/climateprediction.net/oifs_43r3_bl_12291233/ICMGGh7zg+001428
Adding to the zip: /opt/boinc/instance_homes/boinc_31418/projects/climateprediction.net/oifs_43r3_bl_12291233/ICMSHh7zg+001428
Adding to the zip: /opt/boinc/instance_homes/boinc_31418/projects/climateprediction.net/oifs_43r3_bl_12291233/ICMUAh7zg+001428
Zipping up the intermediate file: /opt/boinc/instance_homes/boinc_31418/projects/climateprediction.net/oifs_43r3_bl_a28q_2016092300_20_1018_12291233_0_r690183884_14.zip
Uploading the intermediate file: upload_file_14.zip
  03:34:03 STEP 1441 H= 360:15 +CPU= 36.734
  03:34:38 STEP 1442 H= 360:30 +CPU= 34.889
  03:35:14 STEP 1443 H= 360:45 +CPU= 35.956
  03:35:52 STEP 1444 H= 361:00 +CPU= 37.532
  03:36:27 STEP 1445 H= 361:15 +CPU= 35.366
  03:37:03 STEP 1446 H= 361:30 +CPU= 35.900
  03:37:40 STEP 1447 H= 361:45 +CPU= 36.416
  03:38:17 STEP 1448 H= 362:00 +CPU= 36.706
  03:38:53 STEP 1449 H= 362:15 +CPU= 36.363
  03:39:29 STEP 1450 H= 362:30 +CPU= 35.898
  03:40:05 STEP 1451 H= 362:45 +CPU= 35.312
  03:40:50 STEP 1452 H= 363:00 +CPU= 45.035
Moving to projects directory: /opt/boinc/instance_homes/boinc_31418/slots/3/ICMGGh7zg+001452
Moving to projects directory: /opt/boinc/instance_homes/boinc_31418/slots/3/ICMSHh7zg+001452
Moving to projects directory: /opt/boinc/instance_homes/boinc_31418/slots/3/ICMUAh7zg+001452
  03:41:26 STEP 1453 H= 363:15 +CPU= 35.808
  03:42:02 STEP 1454 H= 363:30 +CPU= 35.480
  03:42:37 STEP 1455 H= 363:45 +CPU= 34.750
  03:43:14 STEP 1456 H= 364:00 +CPU= 37.291
  03:43:50 STEP 1457 H= 364:15 +CPU= 35.950
  03:44:27 STEP 1458 H= 364:30 +CPU= 36.696
  03:45:03 STEP 1459 H= 364:45 +CPU= 35.675
  03:45:39 STEP 1460 H= 365:00 +CPU= 36.235
  03:46:14 STEP 1461 H= 365:15 +CPU= 34.497
  03:46:49 STEP 1462 H= 365:30 +CPU= 34.592
  03:47:24 STEP 1463 H= 365:45 +CPU= 35.230
  03:48:09 STEP 1464 H= 366:00 +CPU= 45.032
Moving to projects directory: /opt/boinc/instance_homes/boinc_31418/slots/3/ICMGGh7zg+001464
Moving to projects directory: /opt/boinc/instance_homes/boinc_31418/slots/3/ICMSHh7zg+001464
Moving to projects directory: /opt/boinc/instance_homes/boinc_31418/slots/3/ICMUAh7zg+001464
  03:48:44 STEP 1465 H= 366:15 +CPU= 34.491
  03:49:19 STEP 1466 H= 366:30 +CPU= 35.070
  03:49:55 STEP 1467 H= 366:45 +CPU= 35.544
  03:50:31 STEP 1468 H= 367:00 +CPU= 35.768
  03:51:07 STEP 1469 H= 367:15 +CPU= 35.464
  03:51:42 STEP 1470 H= 367:30 +CPU= 35.555
  03:52:18 STEP 1471 H= 367:45 +CPU= 35.539
  03:52:56 STEP 1472 H= 368:00 +CPU= 37.248
  03:53:30 STEP 1473 H= 368:15 +CPU= 33.785
  03:54:04 STEP 1474 H= 368:30 +CPU= 34.640
  03:54:40 STEP 1475 H= 368:45 +CPU= 35.349
  03:55:23 STEP 1476 H= 369:00 +CPU= 43.349
Moving to projects directory: /opt/boinc/instance_homes/boinc_31418/slots/3/ICMGGh7zg+001476
Moving to projects directory: /opt/boinc/instance_homes/boinc_31418/slots/3/ICMSHh7zg+001476
Moving to projects directory: /opt/boinc/instance_homes/boinc_31418/slots/3/ICMUAh7zg+001476
  03:55:59 STEP 1477 H= 369:15 +CPU= 35.284
  03:56:33 STEP 1478 H= 369:30 +CPU= 33.983
  03:57:08 STEP 1479 H= 369:45 +CPU= 34.427
  03:57:43 STEP 1480 H= 370:00 +CPU= 35.354
  03:58:19 STEP 1481 H= 370:15 +CPU= 35.473
  03:58:54 STEP 1482 H= 370:30 +CPU= 35.545
  03:59:30 STEP 1483 H= 370:45 +CPU= 35.341
  04:00:07 STEP 1484 H= 371:00 +CPU= 37.004
  04:00:43 STEP 1485 H= 371:15 +CPU= 35.547
  04:01:19 STEP 1486 H= 371:30 +CPU= 36.029
  04:01:56 STEP 1487 H= 371:45 +CPU= 36.498
  04:02:47 STEP 1488 H= 372:00 +CPU= 50.678
Moving to projects directory: /opt/boinc/instance_homes/boinc_31418/slots/3/ICMGGh7zg+001488
Moving to projects directory: /opt/boinc/instance_homes/boinc_31418/slots/3/ICMSHh7zg+001488
Moving to projects directory: /opt/boinc/instance_homes/boinc_31418/slots/3/ICMUAh7zg+001488
  04:03:23 STEP 1489 H= 372:15 +CPU= 35.708
  04:03:58 STEP 1490 H= 372:30 +CPU= 35.246
  04:04:34 STEP 1491 H= 372:45 +CPU= 36.264
  04:05:11 STEP 1492 H= 373:00 +CPU= 36.278
  04:05:47 STEP 1493 H= 373:15 +CPU= 35.638
  04:06:22 STEP 1494 H= 373:30 +CPU= 35.244
  04:06:58 STEP 1495 H= 373:45 +CPU= 35.826
  04:07:34 STEP 1496 H= 374:00 +CPU= 35.784
  04:08:10 STEP 1497 H= 374:15 +CPU= 35.302
  04:08:44 STEP 1498 H= 374:30 +CPU= 34.602
  04:09:20 STEP 1499 H= 374:45 +CPU= 34.986
  04:10:04 STEP 1500 H= 375:00 +CPU= 44.053
Moving to projects directory: /opt/boinc/instance_homes/boinc_31418/slots/3/ICMGGh7zg+001500
Moving to projects directory: /opt/boinc/instance_homes/boinc_31418/slots/3/ICMSHh7zg+001500
Moving to projects directory: /opt/boinc/instance_homes/boinc_31418/slots/3/ICMUAh7zg+001500
  04:10:40 STEP 1501 H= 375:15 +CPU= 35.890
  04:11:17 STEP 1502 H= 375:30 +CPU= 36.596
  04:11:53 STEP 1503 H= 375:45 +CPU= 36.420
  04:12:31 STEP 1504 H= 376:00 +CPU= 37.032
  04:13:07 STEP 1505 H= 376:15 +CPU= 35.716
  04:13:42 STEP 1506 H= 376:30 +CPU= 35.240
  04:14:16 STEP 1507 H= 376:45 +CPU= 33.849
  04:14:52 STEP 1508 H= 377:00 +CPU= 36.143
  04:15:27 STEP 1509 H= 377:15 +CPU= 34.759
  04:16:03 STEP 1510 H= 377:30 +CPU= 35.499
  04:16:40 STEP 1511 H= 377:45 +CPU= 37.174
  04:17:28 STEP 1512 H= 378:00 +CPU= 47.443
Moving to projects directory: /opt/boinc/instance_homes/boinc_31418/slots/3/ICMGGh7zg+001512
Moving to projects directory: /opt/boinc/instance_homes/boinc_31418/slots/3/ICMSHh7zg+001512
Moving to projects directory: /opt/boinc/instance_homes/boinc_31418/slots/3/ICMUAh7zg+001512
  04:18:04 STEP 1513 H= 378:15 +CPU= 36.164
  04:18:41 STEP 1514 H= 378:30 +CPU= 36.316
  04:19:19 STEP 1515 H= 378:45 +CPU= 38.045
  04:19:56 STEP 1516 H= 379:00 +CPU= 36.761
  04:20:33 STEP 1517 H= 379:15 +CPU= 37.182
  04:21:12 STEP 1518 H= 379:30 +CPU= 38.104
  04:21:49 STEP 1519 H= 379:45 +CPU= 37.722
  04:22:29 STEP 1520 H= 380:00 +CPU= 38.905
  04:23:06 STEP 1521 H= 380:15 +CPU= 37.404
  04:23:43 STEP 1522 H= 380:30 +CPU= 36.902
  04:24:20 STEP 1523 H= 380:45 +CPU= 36.510
  04:25:05 STEP 1524 H= 381:00 +CPU= 45.478
Moving to projects directory: /opt/boinc/instance_homes/boinc_31418/slots/3/ICMGGh7zg+001524
Moving to projects directory: /opt/boinc/instance_homes/boinc_31418/slots/3/ICMSHh7zg+001524
Moving to projects directory: /opt/boinc/instance_homes/boinc_31418/slots/3/ICMUAh7zg+001524
  04:25:40 STEP 1525 H= 381:15 +CPU= 34.660
  04:26:16 STEP 1526 H= 381:30 +CPU= 35.192
  04:26:52 STEP 1527 H= 381:45 +CPU= 36.068
  04:27:30 STEP 1528 H= 382:00 +CPU= 38.344
  04:28:09 STEP 1529 H= 382:15 +CPU= 38.348
  04:28:47 STEP 1530 H= 382:30 +CPU= 38.306
  04:29:24 STEP 1531 H= 382:45 +CPU= 36.785
  04:30:04 STEP 1532 H= 383:00 +CPU= 39.844
  04:30:43 STEP 1533 H= 383:15 +CPU= 37.926
  04:31:20 STEP 1534 H= 383:30 +CPU= 37.408
  04:31:59 STEP 1535 H= 383:45 +CPU= 38.634
  04:32:52 STEP 1536 H= 384:00 +CPU= 52.765
Moving to projects directory: /opt/boinc/instance_homes/boinc_31418/slots/3/ICMGGh7zg+001536
Moving to projects directory: /opt/boinc/instance_homes/boinc_31418/slots/3/ICMSHh7zg+001536
Moving to projects directory: /opt/boinc/instance_homes/boinc_31418/slots/3/ICMUAh7zg+001536
Adding to the zip: /opt/boinc/instance_homes/boinc_31418/projects/climateprediction.net/oifs_43r3_bl_12291233/ICMGGh7zg+001440
Adding to the zip: /opt/boinc/instance_homes/boinc_31418/projects/climateprediction.net/oifs_43r3_bl_12291233/ICMSHh7zg+001440
Adding to the zip: /opt/boinc/instance_homes/boinc_31418/projects/climateprediction.net/oifs_43r3_bl_12291233/ICMUAh7zg+001440
Adding to the zip: /opt/boinc/instance_homes/boinc_31418/projects/climateprediction.net/oifs_43r3_bl_12291233/ICMGGh7zg+001452
Adding to the zip: /opt/boinc/instance_homes/boinc_31418/projects/climateprediction.net/oifs_43r3_bl_12291233/ICMSHh7zg+001452
Adding to the zip: /opt/boinc/instance_homes/boinc_31418/projects/climateprediction.net/oifs_43r3_bl_12291233/ICMUAh7zg+001452
Adding to the zip: /opt/boinc/instance_homes/boinc_31418/projects/climateprediction.net/oifs_43r3_bl_12291233/ICMGGh7zg+001464
Adding to the zip: /opt/boinc/instance_homes/boinc_31418/projects/climateprediction.net/oifs_43r3_bl_12291233/ICMSHh7zg+001464
Adding to the zip: /opt/boinc/instance_homes/boinc_31418/projects/climateprediction.net/oifs_43r3_bl_12291233/ICMUAh7zg+001464
Adding to the zip: /opt/boinc/instance_homes/boinc_31418/projects/climateprediction.net/oifs_43r3_bl_12291233/ICMGGh7zg+001476
Adding to the zip: /opt/boinc/instance_homes/boinc_31418/projects/climateprediction.net/oifs_43r3_bl_12291233/ICMSHh7zg+001476
Adding to the zip: /opt/boinc/instance_homes/boinc_31418/projects/climateprediction.net/oifs_43r3_bl_12291233/ICMUAh7zg+001476
Adding to the zip: /opt/boinc/instance_homes/boinc_31418/projects/climateprediction.net/oifs_43r3_bl_12291233/ICMGGh7zg+001488
Adding to the zip: /opt/boinc/instance_homes/boinc_31418/projects/climateprediction.net/oifs_43r3_bl_12291233/ICMSHh7zg+001488
Adding to the zip: /opt/boinc/instance_homes/boinc_31418/projects/climateprediction.net/oifs_43r3_bl_12291233/ICMUAh7zg+001488
Adding to the zip: /opt/boinc/instance_homes/boinc_31418/projects/climateprediction.net/oifs_43r3_bl_12291233/ICMGGh7zg+001500
Adding to the zip: /opt/boinc/instance_homes/boinc_31418/projects/climateprediction.net/oifs_43r3_bl_12291233/ICMSHh7zg+001500
Adding to the zip: /opt/boinc/instance_homes/boinc_31418/projects/climateprediction.net/oifs_43r3_bl_12291233/ICMUAh7zg+001500
Adding to the zip: /opt/boinc/instance_homes/boinc_31418/projects/climateprediction.net/oifs_43r3_bl_12291233/ICMGGh7zg+001512
Adding to the zip: /opt/boinc/instance_homes/boinc_31418/projects/climateprediction.net/oifs_43r3_bl_12291233/ICMSHh7zg+001512
Adding to the zip: /opt/boinc/instance_homes/boinc_31418/projects/climateprediction.net/oifs_43r3_bl_12291233/ICMUAh7zg+001512
Adding to the zip: /opt/boinc/instance_homes/boinc_31418/projects/climateprediction.net/oifs_43r3_bl_12291233/ICMGGh7zg+001524
Adding to the zip: /opt/boinc/instance_homes/boinc_31418/projects/climateprediction.net/oifs_43r3_bl_12291233/ICMSHh7zg+001524
Adding to the zip: /opt/boinc/instance_homes/boinc_31418/projects/climateprediction.net/oifs_43r3_bl_12291233/ICMUAh7zg+001524
Zipping up the intermediate file: /opt/boinc/instance_homes/boinc_31418/projects/climateprediction.net/oifs_43r3_bl_a28q_2016092300_20_1018_12291233_0_r690183884_15.zip
Uploading the intermediate file: upload_file_15.zip
  04:33:29 STEP 1537 H= 384:15 +CPU= 37.150
  04:34:07 STEP 1538 H= 384:30 +CPU= 37.192
  04:34:45 STEP 1539 H= 384:45 +CPU= 37.900
  04:35:22 STEP 1540 H= 385:00 +CPU= 37.285
  04:36:00 STEP 1541 H= 385:15 +CPU= 37.308
  04:36:36 STEP 1542 H= 385:30 +CPU= 36.003
  04:37:12 STEP 1543 H= 385:45 +CPU= 36.183
  04:37:51 STEP 1544 H= 386:00 +CPU= 38.498
  04:38:27 STEP 1545 H= 386:15 +CPU= 36.410
  04:39:02 STEP 1546 H= 386:30 +CPU= 34.558
  04:39:39 STEP 1547 H= 386:45 +CPU= 36.360
  04:40:25 STEP 1548 H= 387:00 +CPU= 46.113
Moving to projects directory: /opt/boinc/instance_homes/boinc_31418/slots/3/ICMGGh7zg+001548
Moving to projects directory: /opt/boinc/instance_homes/boinc_31418/slots/3/ICMSHh7zg+001548
Moving to projects directory: /opt/boinc/instance_homes/boinc_31418/slots/3/ICMUAh7zg+001548
  04:41:04 STEP 1549 H= 387:15 +CPU= 38.510
  04:41:41 STEP 1550 H= 387:30 +CPU= 37.588
  04:42:18 STEP 1551 H= 387:45 +CPU= 36.125
  04:42:55 STEP 1552 H= 388:00 +CPU= 36.888
  04:43:31 STEP 1553 H= 388:15 +CPU= 35.854
  04:44:06 STEP 1554 H= 388:30 +CPU= 34.846
  04:44:41 STEP 1555 H= 388:45 +CPU= 34.866
  04:45:19 STEP 1556 H= 389:00 +CPU= 37.530
  04:45:56 STEP 1557 H= 389:15 +CPU= 37.570
  04:46:33 STEP 1558 H= 389:30 +CPU= 36.654
  04:47:09 STEP 1559 H= 389:45 +CPU= 35.876
  04:47:53 STEP 1560 H= 390:00 +CPU= 43.582
Moving to projects directory: /opt/boinc/instance_homes/boinc_31418/slots/3/ICMGGh7zg+001560
Moving to projects directory: /opt/boinc/instance_homes/boinc_31418/slots/3/ICMSHh7zg+001560
Moving to projects directory: /opt/boinc/instance_homes/boinc_31418/slots/3/ICMUAh7zg+001560
  04:48:28 STEP 1561 H= 390:15 +CPU= 35.479
  04:49:05 STEP 1562 H= 390:30 +CPU= 36.701
  04:49:40 STEP 1563 H= 390:45 +CPU= 34.698
  04:50:16 STEP 1564 H= 391:00 +CPU= 35.566
  04:50:51 STEP 1565 H= 391:15 +CPU= 34.408
  04:51:24 STEP 1566 H= 391:30 +CPU= 32.807
  04:51:57 STEP 1567 H= 391:45 +CPU= 33.245
  04:52:32 STEP 1568 H= 392:00 +CPU= 35.168
  04:53:07 STEP 1569 H= 392:15 +CPU= 34.060
  04:53:42 STEP 1570 H= 392:30 +CPU= 34.916
  04:54:17 STEP 1571 H= 392:45 +CPU= 34.509
  04:55:01 STEP 1572 H= 393:00 +CPU= 43.793
Moving to projects directory: /opt/boinc/instance_homes/boinc_31418/slots/3/ICMGGh7zg+001572
Moving to projects directory: /opt/boinc/instance_homes/boinc_31418/slots/3/ICMSHh7zg+001572
Moving to projects directory: /opt/boinc/instance_homes/boinc_31418/slots/3/ICMUAh7zg+001572
  04:55:35 STEP 1573 H= 393:15 +CPU= 33.554
  04:56:10 STEP 1574 H= 393:30 +CPU= 34.583
  04:56:44 STEP 1575 H= 393:45 +CPU= 34.265
  04:57:19 STEP 1576 H= 394:00 +CPU= 34.965
  04:57:54 STEP 1577 H= 394:15 +CPU= 34.320
  04:58:29 STEP 1578 H= 394:30 +CPU= 35.301
  04:59:05 STEP 1579 H= 394:45 +CPU= 35.680
  04:59:43 STEP 1580 H= 395:00 +CPU= 37.235
  05:00:18 STEP 1581 H= 395:15 +CPU= 35.491
  05:00:53 STEP 1582 H= 395:30 +CPU= 34.835
  05:01:29 STEP 1583 H= 395:45 +CPU= 35.071
  05:02:18 STEP 1584 H= 396:00 +CPU= 49.138
Moving to projects directory: /opt/boinc/instance_homes/boinc_31418/slots/3/ICMGGh7zg+001584
Moving to projects directory: /opt/boinc/instance_homes/boinc_31418/slots/3/ICMSHh7zg+001584
Moving to projects directory: /opt/boinc/instance_homes/boinc_31418/slots/3/ICMUAh7zg+001584
  05:02:53 STEP 1585 H= 396:15 +CPU= 34.942
  05:03:29 STEP 1586 H= 396:30 +CPU= 35.752
  05:04:03 STEP 1587 H= 396:45 +CPU= 34.000
  05:04:39 STEP 1588 H= 397:00 +CPU= 35.520
  05:05:15 STEP 1589 H= 397:15 +CPU= 35.222
  05:05:50 STEP 1590 H= 397:30 +CPU= 35.548
  05:06:26 STEP 1591 H= 397:45 +CPU= 35.422
  05:07:03 STEP 1592 H= 398:00 +CPU= 36.343
  05:07:38 STEP 1593 H= 398:15 +CPU= 35.198
  05:08:15 STEP 1594 H= 398:30 +CPU= 36.467
  05:08:50 STEP 1595 H= 398:45 +CPU= 35.251
  05:09:35 STEP 1596 H= 399:00 +CPU= 44.511
Moving to projects directory: /opt/boinc/instance_homes/boinc_31418/slots/3/ICMGGh7zg+001596
Moving to projects directory: /opt/boinc/instance_homes/boinc_31418/slots/3/ICMSHh7zg+001596
Moving to projects directory: /opt/boinc/instance_homes/boinc_31418/slots/3/ICMUAh7zg+001596
  05:10:12 STEP 1597 H= 399:15 +CPU= 36.554
  05:10:47 STEP 1598 H= 399:30 +CPU= 35.220
  05:11:23 STEP 1599 H= 399:45 +CPU= 35.261
  05:12:00 STEP 1600 H= 400:00 +CPU= 37.148
  05:12:37 STEP 1601 H= 400:15 +CPU= 36.570
  05:13:14 STEP 1602 H= 400:30 +CPU= 36.315
  05:13:50 STEP 1603 H= 400:45 +CPU= 36.164
  05:14:25 STEP 1604 H= 401:00 +CPU= 34.907
  05:14:59 STEP 1605 H= 401:15 +CPU= 33.991
  05:15:34 STEP 1606 H= 401:30 +CPU= 34.526
  05:16:09 STEP 1607 H= 401:45 +CPU= 35.266
  05:16:53 STEP 1608 H= 402:00 +CPU= 43.687
Moving to projects directory: /opt/boinc/instance_homes/boinc_31418/slots/3/ICMGGh7zg+001608
Moving to projects directory: /opt/boinc/instance_homes/boinc_31418/slots/3/ICMSHh7zg+001608
Moving to projects directory: /opt/boinc/instance_homes/boinc_31418/slots/3/ICMUAh7zg+001608
  05:17:30 STEP 1609 H= 402:15 +CPU= 36.638
  05:18:05 STEP 1610 H= 402:30 +CPU= 35.106
  05:18:40 STEP 1611 H= 402:45 +CPU= 34.644
  05:19:18 STEP 1612 H= 403:00 +CPU= 37.297
  05:19:54 STEP 1613 H= 403:15 +CPU= 36.652
  05:20:29 STEP 1614 H= 403:30 +CPU= 34.686
  05:21:05 STEP 1615 H= 403:45 +CPU= 35.147
  05:21:41 STEP 1616 H= 404:00 +CPU= 36.080
  05:22:16 STEP 1617 H= 404:15 +CPU= 35.185
  05:22:52 STEP 1618 H= 404:30 +CPU= 35.430
  05:23:28 STEP 1619 H= 404:45 +CPU= 35.897
  05:24:13 STEP 1620 H= 405:00 +CPU= 45.103
Moving to projects directory: /opt/boinc/instance_homes/boinc_31418/slots/3/ICMGGh7zg+001620
Moving to projects directory: /opt/boinc/instance_homes/boinc_31418/slots/3/ICMSHh7zg+001620
Moving to projects directory: /opt/boinc/instance_homes/boinc_31418/slots/3/ICMUAh7zg+001620
  05:24:49 STEP 1621 H= 405:15 +CPU= 35.262
  05:25:24 STEP 1622 H= 405:30 +CPU= 34.437
  05:25:59 STEP 1623 H= 405:45 +CPU= 35.146
  05:26:35 STEP 1624 H= 406:00 +CPU= 36.274
  05:27:11 STEP 1625 H= 406:15 +CPU= 35.521
  05:27:46 STEP 1626 H= 406:30 +CPU= 34.322
  05:28:21 STEP 1627 H= 406:45 +CPU= 35.532
  05:28:58 STEP 1628 H= 407:00 +CPU= 36.700
  05:29:34 STEP 1629 H= 407:15 +CPU= 35.541
  05:30:10 STEP 1630 H= 407:30 +CPU= 36.045
  05:30:46 STEP 1631 H= 407:45 +CPU= 35.902
  05:31:36 STEP 1632 H= 408:00 +CPU= 49.905
Moving to projects directory: /opt/boinc/instance_homes/boinc_31418/slots/3/ICMGGh7zg+001632
Moving to projects directory: /opt/boinc/instance_homes/boinc_31418/slots/3/ICMSHh7zg+001632
Moving to projects directory: /opt/boinc/instance_homes/boinc_31418/slots/3/ICMUAh7zg+001632
Adding to the zip: /opt/boinc/instance_homes/boinc_31418/projects/climateprediction.net/oifs_43r3_bl_12291233/ICMGGh7zg+001536
Adding to the zip: /opt/boinc/instance_homes/boinc_31418/projects/climateprediction.net/oifs_43r3_bl_12291233/ICMSHh7zg+001536
Adding to the zip: /opt/boinc/instance_homes/boinc_31418/projects/climateprediction.net/oifs_43r3_bl_12291233/ICMUAh7zg+001536
Adding to the zip: /opt/boinc/instance_homes/boinc_31418/projects/climateprediction.net/oifs_43r3_bl_12291233/ICMGGh7zg+001548
Adding to the zip: /opt/boinc/instance_homes/boinc_31418/projects/climateprediction.net/oifs_43r3_bl_12291233/ICMSHh7zg+001548
Adding to the zip: /opt/boinc/instance_homes/boinc_31418/projects/climateprediction.net/oifs_43r3_bl_12291233/ICMUAh7zg+001548
Adding to the zip: /opt/boinc/instance_homes/boinc_31418/projects/climateprediction.net/oifs_43r3_bl_12291233/ICMGGh7zg+001560
Adding to the zip: /opt/boinc/instance_homes/boinc_31418/projects/climateprediction.net/oifs_43r3_bl_12291233/ICMSHh7zg+001560
Adding to the zip: /opt/boinc/instance_homes/boinc_31418/projects/climateprediction.net/oifs_43r3_bl_12291233/ICMUAh7zg+001560
Adding to the zip: /opt/boinc/instance_homes/boinc_31418/projects/climateprediction.net/oifs_43r3_bl_12291233/ICMGGh7zg+001572
Adding to the zip: /opt/boinc/instance_homes/boinc_31418/projects/climateprediction.net/oifs_43r3_bl_12291233/ICMSHh7zg+001572
Adding to the zip: /opt/boinc/instance_homes/boinc_31418/projects/climateprediction.net/oifs_43r3_bl_12291233/ICMUAh7zg+001572
Adding to the zip: /opt/boinc/instance_homes/boinc_31418/projects/climateprediction.net/oifs_43r3_bl_12291233/ICMGGh7zg+001584
Adding to the zip: /opt/boinc/instance_homes/boinc_31418/projects/climateprediction.net/oifs_43r3_bl_12291233/ICMSHh7zg+001584
Adding to the zip: /opt/boinc/instance_homes/boinc_31418/projects/climateprediction.net/oifs_43r3_bl_12291233/ICMUAh7zg+001584
Adding to the zip: /opt/boinc/instance_homes/boinc_31418/projects/climateprediction.net/oifs_43r3_bl_12291233/ICMGGh7zg+001596
Adding to the zip: /opt/boinc/instance_homes/boinc_31418/projects/climateprediction.net/oifs_43r3_bl_12291233/ICMSHh7zg+001596
Adding to the zip: /opt/boinc/instance_homes/boinc_31418/projects/climateprediction.net/oifs_43r3_bl_12291233/ICMUAh7zg+001596
Adding to the zip: /opt/boinc/instance_homes/boinc_31418/projects/climateprediction.net/oifs_43r3_bl_12291233/ICMGGh7zg+001608
Adding to the zip: /opt/boinc/instance_homes/boinc_31418/projects/climateprediction.net/oifs_43r3_bl_12291233/ICMSHh7zg+001608
Adding to the zip: /opt/boinc/instance_homes/boinc_31418/projects/climateprediction.net/oifs_43r3_bl_12291233/ICMUAh7zg+001608
Adding to the zip: /opt/boinc/instance_homes/boinc_31418/projects/climateprediction.net/oifs_43r3_bl_12291233/ICMGGh7zg+001620
Adding to the zip: /opt/boinc/instance_homes/boinc_31418/projects/climateprediction.net/oifs_43r3_bl_12291233/ICMSHh7zg+001620
Adding to the zip: /opt/boinc/instance_homes/boinc_31418/projects/climateprediction.net/oifs_43r3_bl_12291233/ICMUAh7zg+001620
Zipping up the intermediate file: /opt/boinc/instance_homes/boinc_31418/projects/climateprediction.net/oifs_43r3_bl_a28q_2016092300_20_1018_12291233_0_r690183884_16.zip
Uploading the intermediate file: upload_file_16.zip
  05:32:13 STEP 1633 H= 408:15 +CPU= 36.191
  05:32:49 STEP 1634 H= 408:30 +CPU= 35.530
  05:33:24 STEP 1635 H= 408:45 +CPU= 35.668
  05:34:01 STEP 1636 H= 409:00 +CPU= 36.658
  05:34:37 STEP 1637 H= 409:15 +CPU= 35.005
  05:35:12 STEP 1638 H= 409:30 +CPU= 35.413
  05:35:48 STEP 1639 H= 409:45 +CPU= 35.337
  05:36:25 STEP 1640 H= 410:00 +CPU= 36.918
  05:36:59 STEP 1641 H= 410:15 +CPU= 34.337
  05:37:35 STEP 1642 H= 410:30 +CPU= 36.176
  05:38:12 STEP 1643 H= 410:45 +CPU= 36.153
  05:38:57 STEP 1644 H= 411:00 +CPU= 45.489
Moving to projects directory: /opt/boinc/instance_homes/boinc_31418/slots/3/ICMGGh7zg+001644
Moving to projects directory: /opt/boinc/instance_homes/boinc_31418/slots/3/ICMSHh7zg+001644
Moving to projects directory: /opt/boinc/instance_homes/boinc_31418/slots/3/ICMUAh7zg+001644
  05:39:31 STEP 1645 H= 411:15 +CPU= 33.435
  05:40:06 STEP 1646 H= 411:30 +CPU= 34.626
  05:40:41 STEP 1647 H= 411:45 +CPU= 34.718
  05:41:16 STEP 1648 H= 412:00 +CPU= 35.460
  05:41:51 STEP 1649 H= 412:15 +CPU= 34.587
  05:42:25 STEP 1650 H= 412:30 +CPU= 33.670
  05:42:59 STEP 1651 H= 412:45 +CPU= 34.190
  05:43:34 STEP 1652 H= 413:00 +CPU= 34.316
  05:44:08 STEP 1653 H= 413:15 +CPU= 33.938
  05:44:42 STEP 1654 H= 413:30 +CPU= 34.073
  05:45:15 STEP 1655 H= 413:45 +CPU= 32.978
  05:45:58 STEP 1656 H= 414:00 +CPU= 42.275
Moving to projects directory: /opt/boinc/instance_homes/boinc_31418/slots/3/ICMGGh7zg+001656
Moving to projects directory: /opt/boinc/instance_homes/boinc_31418/slots/3/ICMSHh7zg+001656
Moving to projects directory: /opt/boinc/instance_homes/boinc_31418/slots/3/ICMUAh7zg+001656
  05:46:33 STEP 1657 H= 414:15 +CPU= 35.552
  05:47:09 STEP 1658 H= 414:30 +CPU= 34.996
  05:47:43 STEP 1659 H= 414:45 +CPU= 33.956
  05:48:18 STEP 1660 H= 415:00 +CPU= 35.191
  05:48:54 STEP 1661 H= 415:15 +CPU= 36.161
  05:49:31 STEP 1662 H= 415:30 +CPU= 36.192
  05:50:07 STEP 1663 H= 415:45 +CPU= 36.215
  05:50:45 STEP 1664 H= 416:00 +CPU= 37.622
  05:51:20 STEP 1665 H= 416:15 +CPU= 34.603
  05:51:55 STEP 1666 H= 416:30 +CPU= 35.090
  05:52:30 STEP 1667 H= 416:45 +CPU= 35.144
  05:53:14 STEP 1668 H= 417:00 +CPU= 44.139
Moving to projects directory: /opt/boinc/instance_homes/boinc_31418/slots/3/ICMGGh7zg+001668
Moving to projects directory: /opt/boinc/instance_homes/boinc_31418/slots/3/ICMSHh7zg+001668
Moving to projects directory: /opt/boinc/instance_homes/boinc_31418/slots/3/ICMUAh7zg+001668
  05:53:50 STEP 1669 H= 417:15 +CPU= 35.332
  05:54:25 STEP 1670 H= 417:30 +CPU= 34.495
  05:54:59 STEP 1671 H= 417:45 +CPU= 34.253
  05:55:33 STEP 1672 H= 418:00 +CPU= 34.097
  05:56:08 STEP 1673 H= 418:15 +CPU= 34.452
  05:56:41 STEP 1674 H= 418:30 +CPU= 33.336
  05:57:15 STEP 1675 H= 418:45 +CPU= 33.733
  05:57:50 STEP 1676 H= 419:00 +CPU= 34.895
  05:58:24 STEP 1677 H= 419:15 +CPU= 33.519
  05:58:58 STEP 1678 H= 419:30 +CPU= 34.287
  05:59:31 STEP 1679 H= 419:45 +CPU= 32.854
  06:00:20 STEP 1680 H= 420:00 +CPU= 48.967
Moving to projects directory: /opt/boinc/instance_homes/boinc_31418/slots/3/ICMGGh7zg+001680
Moving to projects directory: /opt/boinc/instance_homes/boinc_31418/slots/3/ICMSHh7zg+001680
Moving to projects directory: /opt/boinc/instance_homes/boinc_31418/slots/3/ICMUAh7zg+001680
  06:00:54 STEP 1681 H= 420:15 +CPU= 33.420
  06:01:28 STEP 1682 H= 420:30 +CPU= 34.015
  06:02:03 STEP 1683 H= 420:45 +CPU= 34.611
  06:02:38 STEP 1684 H= 421:00 +CPU= 34.988
  06:03:12 STEP 1685 H= 421:15 +CPU= 34.136
  06:03:47 STEP 1686 H= 421:30 +CPU= 34.973
  06:04:22 STEP 1687 H= 421:45 +CPU= 34.015
  06:04:57 STEP 1688 H= 422:00 +CPU= 34.879
  06:05:31 STEP 1689 H= 422:15 +CPU= 33.829
  06:06:05 STEP 1690 H= 422:30 +CPU= 33.842
  06:06:38 STEP 1691 H= 422:45 +CPU= 32.979
  06:07:21 STEP 1692 H= 423:00 +CPU= 43.566
Moving to projects directory: /opt/boinc/instance_homes/boinc_31418/slots/3/ICMGGh7zg+001692
Moving to projects directory: /opt/boinc/instance_homes/boinc_31418/slots/3/ICMSHh7zg+001692
Moving to projects directory: /opt/boinc/instance_homes/boinc_31418/slots/3/ICMUAh7zg+001692
  06:07:55 STEP 1693 H= 423:15 +CPU= 33.418
  06:08:29 STEP 1694 H= 423:30 +CPU= 34.124
  06:09:03 STEP 1695 H= 423:45 +CPU= 33.888
  06:09:38 STEP 1696 H= 424:00 +CPU= 34.044
  06:10:11 STEP 1697 H= 424:15 +CPU= 32.926
  06:10:45 STEP 1698 H= 424:30 +CPU= 34.036
  06:11:19 STEP 1699 H= 424:45 +CPU= 34.220
  06:11:54 STEP 1700 H= 425:00 +CPU= 34.966
  06:12:28 STEP 1701 H= 425:15 +CPU= 33.655
  06:13:01 STEP 1702 H= 425:30 +CPU= 33.051
  06:13:35 STEP 1703 H= 425:45 +CPU= 33.582
  06:14:19 STEP 1704 H= 426:00 +CPU= 43.641
Moving to projects directory: /opt/boinc/instance_homes/boinc_31418/slots/3/ICMGGh7zg+001704
Moving to projects directory: /opt/boinc/instance_homes/boinc_31418/slots/3/ICMSHh7zg+001704
Moving to projects directory: /opt/boinc/instance_homes/boinc_31418/slots/3/ICMUAh7zg+001704
  06:14:52 STEP 1705 H= 426:15 +CPU= 33.040
  06:15:26 STEP 1706 H= 426:30 +CPU= 34.190
  06:16:01 STEP 1707 H= 426:45 +CPU= 34.732
  06:16:37 STEP 1708 H= 427:00 +CPU= 35.262
  06:17:11 STEP 1709 H= 427:15 +CPU= 34.572
  06:17:45 STEP 1710 H= 427:30 +CPU= 33.687
  06:18:21 STEP 1711 H= 427:45 +CPU= 35.161
  06:18:56 STEP 1712 H= 428:00 +CPU= 35.074
  06:19:30 STEP 1713 H= 428:15 +CPU= 34.402
  06:20:04 STEP 1714 H= 428:30 +CPU= 33.456
  06:20:39 STEP 1715 H= 428:45 +CPU= 34.671
  06:21:22 STEP 1716 H= 429:00 +CPU= 43.248
Moving to projects directory: /opt/boinc/instance_homes/boinc_31418/slots/3/ICMGGh7zg+001716
Moving to projects directory: /opt/boinc/instance_homes/boinc_31418/slots/3/ICMSHh7zg+001716
Moving to projects directory: /opt/boinc/instance_homes/boinc_31418/slots/3/ICMUAh7zg+001716
  06:21:57 STEP 1717 H= 429:15 +CPU= 34.104
  06:22:31 STEP 1718 H= 429:30 +CPU= 34.129
  06:23:05 STEP 1719 H= 429:45 +CPU= 34.437
  06:23:42 STEP 1720 H= 430:00 +CPU= 36.752
  06:24:17 STEP 1721 H= 430:15 +CPU= 34.550
  06:24:51 STEP 1722 H= 430:30 +CPU= 33.927
  06:25:26 STEP 1723 H= 430:45 +CPU= 34.590
  06:26:01 STEP 1724 H= 431:00 +CPU= 34.752
  06:26:35 STEP 1725 H= 431:15 +CPU= 34.265
  06:27:09 STEP 1726 H= 431:30 +CPU= 33.867
  06:27:44 STEP 1727 H= 431:45 +CPU= 34.366
  06:28:34 STEP 1728 H= 432:00 +CPU= 49.857
Moving to projects directory: /opt/boinc/instance_homes/boinc_31418/slots/3/ICMGGh7zg+001728
Moving to projects directory: /opt/boinc/instance_homes/boinc_31418/slots/3/ICMSHh7zg+001728
Moving to projects directory: /opt/boinc/instance_homes/boinc_31418/slots/3/ICMUAh7zg+001728
Adding to the zip: /opt/boinc/instance_homes/boinc_31418/projects/climateprediction.net/oifs_43r3_bl_12291233/ICMGGh7zg+001632
Adding to the zip: /opt/boinc/instance_homes/boinc_31418/projects/climateprediction.net/oifs_43r3_bl_12291233/ICMSHh7zg+001632
Adding to the zip: /opt/boinc/instance_homes/boinc_31418/projects/climateprediction.net/oifs_43r3_bl_12291233/ICMUAh7zg+001632
Adding to the zip: /opt/boinc/instance_homes/boinc_31418/projects/climateprediction.net/oifs_43r3_bl_12291233/ICMGGh7zg+001644
Adding to the zip: /opt/boinc/instance_homes/boinc_31418/projects/climateprediction.net/oifs_43r3_bl_12291233/ICMSHh7zg+001644
Adding to the zip: /opt/boinc/instance_homes/boinc_31418/projects/climateprediction.net/oifs_43r3_bl_12291233/ICMUAh7zg+001644
Adding to the zip: /opt/boinc/instance_homes/boinc_31418/projects/climateprediction.net/oifs_43r3_bl_12291233/ICMGGh7zg+001656
Adding to the zip: /opt/boinc/instance_homes/boinc_31418/projects/climateprediction.net/oifs_43r3_bl_12291233/ICMSHh7zg+001656
Adding to the zip: /opt/boinc/instance_homes/boinc_31418/projects/climateprediction.net/oifs_43r3_bl_12291233/ICMUAh7zg+001656
Adding to the zip: /opt/boinc/instance_homes/boinc_31418/projects/climateprediction.net/oifs_43r3_bl_12291233/ICMGGh7zg+001668
Adding to the zip: /opt/boinc/instance_homes/boinc_31418/projects/climateprediction.net/oifs_43r3_bl_12291233/ICMSHh7zg+001668
Adding to the zip: /opt/boinc/instance_homes/boinc_31418/projects/climateprediction.net/oifs_43r3_bl_12291233/ICMUAh7zg+001668
Adding to the zip: /opt/boinc/instance_homes/boinc_31418/projects/climateprediction.net/oifs_43r3_bl_12291233/ICMGGh7zg+001680
Adding to the zip: /opt/boinc/instance_homes/boinc_31418/projects/climateprediction.net/oifs_43r3_bl_12291233/ICMSHh7zg+001680
Adding to the zip: /opt/boinc/instance_homes/boinc_31418/projects/climateprediction.net/oifs_43r3_bl_12291233/ICMUAh7zg+001680
Adding to the zip: /opt/boinc/instance_homes/boinc_31418/projects/climateprediction.net/oifs_43r3_bl_12291233/ICMGGh7zg+001692
Adding to the zip: /opt/boinc/instance_homes/boinc_31418/projects/climateprediction.net/oifs_43r3_bl_12291233/ICMSHh7zg+001692
Adding to the zip: /opt/boinc/instance_homes/boinc_31418/projects/climateprediction.net/oifs_43r3_bl_12291233/ICMUAh7zg+001692
Adding to the zip: /opt/boinc/instance_homes/boinc_31418/projects/climateprediction.net/oifs_43r3_bl_12291233/ICMGGh7zg+001704
Adding to the zip: /opt/boinc/instance_homes/boinc_31418/projects/climateprediction.net/oifs_43r3_bl_12291233/ICMSHh7zg+001704
Adding to the zip: /opt/boinc/instance_homes/boinc_31418/projects/climateprediction.net/oifs_43r3_bl_12291233/ICMUAh7zg+001704
Adding to the zip: /opt/boinc/instance_homes/boinc_31418/projects/climateprediction.net/oifs_43r3_bl_12291233/ICMGGh7zg+001716
Adding to the zip: /opt/boinc/instance_homes/boinc_31418/projects/climateprediction.net/oifs_43r3_bl_12291233/ICMSHh7zg+001716
Adding to the zip: /opt/boinc/instance_homes/boinc_31418/projects/climateprediction.net/oifs_43r3_bl_12291233/ICMUAh7zg+001716
Zipping up the intermediate file: /opt/boinc/instance_homes/boinc_31418/projects/climateprediction.net/oifs_43r3_bl_a28q_2016092300_20_1018_12291233_0_r690183884_17.zip
Uploading the intermediate file: upload_file_17.zip
  06:29:09 STEP 1729 H= 432:15 +CPU= 34.658
  06:29:43 STEP 1730 H= 432:30 +CPU= 33.990
  06:30:17 STEP 1731 H= 432:45 +CPU= 33.800
  06:30:51 STEP 1732 H= 433:00 +CPU= 34.626
  06:31:26 STEP 1733 H= 433:15 +CPU= 33.986
  06:31:59 STEP 1734 H= 433:30 +CPU= 33.530
  06:32:33 STEP 1735 H= 433:45 +CPU= 33.293
  06:33:07 STEP 1736 H= 434:00 +CPU= 34.378
  06:33:41 STEP 1737 H= 434:15 +CPU= 33.878
  06:34:16 STEP 1738 H= 434:30 +CPU= 34.210
  06:34:50 STEP 1739 H= 434:45 +CPU= 33.923
  06:35:31 STEP 1740 H= 435:00 +CPU= 41.395
Moving to projects directory: /opt/boinc/instance_homes/boinc_31418/slots/3/ICMGGh7zg+001740
Moving to projects directory: /opt/boinc/instance_homes/boinc_31418/slots/3/ICMSHh7zg+001740
Moving to projects directory: /opt/boinc/instance_homes/boinc_31418/slots/3/ICMUAh7zg+001740
  06:36:05 STEP 1741 H= 435:15 +CPU= 33.324
  06:36:40 STEP 1742 H= 435:30 +CPU= 34.708
  06:37:13 STEP 1743 H= 435:45 +CPU= 33.686
  06:37:48 STEP 1744 H= 436:00 +CPU= 34.525
  06:38:22 STEP 1745 H= 436:15 +CPU= 33.363
  06:38:54 STEP 1746 H= 436:30 +CPU= 32.288
  06:39:28 STEP 1747 H= 436:45 +CPU= 33.519
  06:40:02 STEP 1748 H= 437:00 +CPU= 34.270
  06:40:35 STEP 1749 H= 437:15 +CPU= 32.709
  06:41:08 STEP 1750 H= 437:30 +CPU= 32.984
  06:41:41 STEP 1751 H= 437:45 +CPU= 33.123
  06:42:24 STEP 1752 H= 438:00 +CPU= 42.613
Moving to projects directory: /opt/boinc/instance_homes/boinc_31418/slots/3/ICMGGh7zg+001752
Moving to projects directory: /opt/boinc/instance_homes/boinc_31418/slots/3/ICMSHh7zg+001752
Moving to projects directory: /opt/boinc/instance_homes/boinc_31418/slots/3/ICMUAh7zg+001752
  06:42:58 STEP 1753 H= 438:15 +CPU= 33.366
  06:43:30 STEP 1754 H= 438:30 +CPU= 32.537
  06:44:05 STEP 1755 H= 438:45 +CPU= 34.193
  06:44:40 STEP 1756 H= 439:00 +CPU= 34.908
  06:45:13 STEP 1757 H= 439:15 +CPU= 32.791
  06:45:46 STEP 1758 H= 439:30 +CPU= 33.254
  06:46:20 STEP 1759 H= 439:45 +CPU= 33.609
  06:46:55 STEP 1760 H= 440:00 +CPU= 34.841
  06:47:28 STEP 1761 H= 440:15 +CPU= 33.259
  06:48:01 STEP 1762 H= 440:30 +CPU= 32.757
  06:48:34 STEP 1763 H= 440:45 +CPU= 32.413
  06:49:16 STEP 1764 H= 441:00 +CPU= 42.197
Moving to projects directory: /opt/boinc/instance_homes/boinc_31418/slots/3/ICMGGh7zg+001764
Moving to projects directory: /opt/boinc/instance_homes/boinc_31418/slots/3/ICMSHh7zg+001764
Moving to projects directory: /opt/boinc/instance_homes/boinc_31418/slots/3/ICMUAh7zg+001764
  06:49:51 STEP 1765 H= 441:15 +CPU= 34.687
  06:50:26 STEP 1766 H= 441:30 +CPU= 34.706
  06:51:01 STEP 1767 H= 441:45 +CPU= 34.735
  06:51:36 STEP 1768 H= 442:00 +CPU= 35.297
  06:52:10 STEP 1769 H= 442:15 +CPU= 34.001
  06:52:44 STEP 1770 H= 442:30 +CPU= 33.992
  06:53:19 STEP 1771 H= 442:45 +CPU= 34.119
  06:53:55 STEP 1772 H= 443:00 +CPU= 36.033
  06:54:29 STEP 1773 H= 443:15 +CPU= 33.636
  06:55:02 STEP 1774 H= 443:30 +CPU= 33.386
  06:55:36 STEP 1775 H= 443:45 +CPU= 33.239
  06:56:24 STEP 1776 H= 444:00 +CPU= 47.804
Moving to projects directory: /opt/boinc/instance_homes/boinc_31418/slots/3/ICMGGh7zg+001776
Moving to projects directory: /opt/boinc/instance_homes/boinc_31418/slots/3/ICMSHh7zg+001776
Moving to projects directory: /opt/boinc/instance_homes/boinc_31418/slots/3/ICMUAh7zg+001776
  06:56:57 STEP 1777 H= 444:15 +CPU= 33.099
  06:57:30 STEP 1778 H= 444:30 +CPU= 32.748
  06:58:03 STEP 1779 H= 444:45 +CPU= 33.430
  06:58:38 STEP 1780 H= 445:00 +CPU= 34.394
  06:59:12 STEP 1781 H= 445:15 +CPU= 34.315
  06:59:47 STEP 1782 H= 445:30 +CPU= 34.578
  07:00:21 STEP 1783 H= 445:45 +CPU= 34.101
  07:00:57 STEP 1784 H= 446:00 +CPU= 35.329
  07:01:31 STEP 1785 H= 446:15 +CPU= 33.588
  07:02:06 STEP 1786 H= 446:30 +CPU= 35.545
  07:02:40 STEP 1787 H= 446:45 +CPU= 33.946
  07:03:23 STEP 1788 H= 447:00 +CPU= 42.679
Moving to projects directory: /opt/boinc/instance_homes/boinc_31418/slots/3/ICMGGh7zg+001788
Moving to projects directory: /opt/boinc/instance_homes/boinc_31418/slots/3/ICMSHh7zg+001788
Moving to projects directory: /opt/boinc/instance_homes/boinc_31418/slots/3/ICMUAh7zg+001788
  07:03:57 STEP 1789 H= 447:15 +CPU= 33.284
  07:04:31 STEP 1790 H= 447:30 +CPU= 33.764
  07:05:05 STEP 1791 H= 447:45 +CPU= 34.073
  07:05:40 STEP 1792 H= 448:00 +CPU= 35.237
  07:06:12 STEP 1793 H= 448:15 +CPU= 32.077
  07:06:46 STEP 1794 H= 448:30 +CPU= 33.468
  07:07:19 STEP 1795 H= 448:45 +CPU= 33.165
  07:07:53 STEP 1796 H= 449:00 +CPU= 33.766
  07:08:26 STEP 1797 H= 449:15 +CPU= 32.696
  07:08:59 STEP 1798 H= 449:30 +CPU= 32.466
  07:09:33 STEP 1799 H= 449:45 +CPU= 34.200
  07:10:16 STEP 1800 H= 450:00 +CPU= 43.240
Moving to projects directory: /opt/boinc/instance_homes/boinc_31418/slots/3/ICMGGh7zg+001800
Moving to projects directory: /opt/boinc/instance_homes/boinc_31418/slots/3/ICMSHh7zg+001800
Moving to projects directory: /opt/boinc/instance_homes/boinc_31418/slots/3/ICMUAh7zg+001800
  07:10:50 STEP 1801 H= 450:15 +CPU= 33.282
  07:11:23 STEP 1802 H= 450:30 +CPU= 33.198
  07:11:58 STEP 1803 H= 450:45 +CPU= 34.095
  07:12:34 STEP 1804 H= 451:00 +CPU= 35.944
  07:13:08 STEP 1805 H= 451:15 +CPU= 34.350
  07:13:42 STEP 1806 H= 451:30 +CPU= 33.888
  07:14:16 STEP 1807 H= 451:45 +CPU= 33.432
  07:14:51 STEP 1808 H= 452:00 +CPU= 34.747
  07:15:24 STEP 1809 H= 452:15 +CPU= 33.145
  07:15:58 STEP 1810 H= 452:30 +CPU= 33.911
  07:16:31 STEP 1811 H= 452:45 +CPU= 33.039
  07:17:14 STEP 1812 H= 453:00 +CPU= 42.245
Moving to projects directory: /opt/boinc/instance_homes/boinc_31418/slots/3/ICMGGh7zg+001812
Moving to projects directory: /opt/boinc/instance_homes/boinc_31418/slots/3/ICMSHh7zg+001812
Moving to projects directory: /opt/boinc/instance_homes/boinc_31418/slots/3/ICMUAh7zg+001812
  07:17:48 STEP 1813 H= 453:15 +CPU= 33.768
  07:18:21 STEP 1814 H= 453:30 +CPU= 32.834
  07:18:54 STEP 1815 H= 453:45 +CPU= 32.841
  07:19:27 STEP 1816 H= 454:00 +CPU= 33.324
  07:20:00 STEP 1817 H= 454:15 +CPU= 32.849
  07:20:34 STEP 1818 H= 454:30 +CPU= 33.314
  07:21:07 STEP 1819 H= 454:45 +CPU= 33.363
  07:21:42 STEP 1820 H= 455:00 +CPU= 34.384
  07:22:15 STEP 1821 H= 455:15 +CPU= 33.636
  07:22:50 STEP 1822 H= 455:30 +CPU= 34.240
  07:23:24 STEP 1823 H= 455:45 +CPU= 34.052
  07:24:13 STEP 1824 H= 456:00 +CPU= 49.136
Moving to projects directory: /opt/boinc/instance_homes/boinc_31418/slots/3/ICMGGh7zg+001824
Moving to projects directory: /opt/boinc/instance_homes/boinc_31418/slots/3/ICMSHh7zg+001824
Moving to projects directory: /opt/boinc/instance_homes/boinc_31418/slots/3/ICMUAh7zg+001824
Adding to the zip: /opt/boinc/instance_homes/boinc_31418/projects/climateprediction.net/oifs_43r3_bl_12291233/ICMGGh7zg+001728
Adding to the zip: /opt/boinc/instance_homes/boinc_31418/projects/climateprediction.net/oifs_43r3_bl_12291233/ICMSHh7zg+001728
Adding to the zip: /opt/boinc/instance_homes/boinc_31418/projects/climateprediction.net/oifs_43r3_bl_12291233/ICMUAh7zg+001728
Adding to the zip: /opt/boinc/instance_homes/boinc_31418/projects/climateprediction.net/oifs_43r3_bl_12291233/ICMGGh7zg+001740
Adding to the zip: /opt/boinc/instance_homes/boinc_31418/projects/climateprediction.net/oifs_43r3_bl_12291233/ICMSHh7zg+001740
Adding to the zip: /opt/boinc/instance_homes/boinc_31418/projects/climateprediction.net/oifs_43r3_bl_12291233/ICMUAh7zg+001740
Adding to the zip: /opt/boinc/instance_homes/boinc_31418/projects/climateprediction.net/oifs_43r3_bl_12291233/ICMGGh7zg+001752
Adding to the zip: /opt/boinc/instance_homes/boinc_31418/projects/climateprediction.net/oifs_43r3_bl_12291233/ICMSHh7zg+001752
Adding to the zip: /opt/boinc/instance_homes/boinc_31418/projects/climateprediction.net/oifs_43r3_bl_12291233/ICMUAh7zg+001752
Adding to the zip: /opt/boinc/instance_homes/boinc_31418/projects/climateprediction.net/oifs_43r3_bl_12291233/ICMGGh7zg+001764
Adding to the zip: /opt/boinc/instance_homes/boinc_31418/projects/climateprediction.net/oifs_43r3_bl_12291233/ICMSHh7zg+001764
Adding to the zip: /opt/boinc/instance_homes/boinc_31418/projects/climateprediction.net/oifs_43r3_bl_12291233/ICMUAh7zg+001764
Adding to the zip: /opt/boinc/instance_homes/boinc_31418/projects/climateprediction.net/oifs_43r3_bl_12291233/ICMGGh7zg+001776
Adding to the zip: /opt/boinc/instance_homes/boinc_31418/projects/climateprediction.net/oifs_43r3_bl_12291233/ICMSHh7zg+001776
Adding to the zip: /opt/boinc/instance_homes/boinc_31418/projects/climateprediction.net/oifs_43r3_bl_12291233/ICMUAh7zg+001776
Adding to the zip: /opt/boinc/instance_homes/boinc_31418/projects/climateprediction.net/oifs_43r3_bl_12291233/ICMGGh7zg+001788
Adding to the zip: /opt/boinc/instance_homes/boinc_31418/projects/climateprediction.net/oifs_43r3_bl_12291233/ICMSHh7zg+001788
Adding to the zip: /opt/boinc/instance_homes/boinc_31418/projects/climateprediction.net/oifs_43r3_bl_12291233/ICMUAh7zg+001788
Adding to the zip: /opt/boinc/instance_homes/boinc_31418/projects/climateprediction.net/oifs_43r3_bl_12291233/ICMGGh7zg+001800
Adding to the zip: /opt/boinc/instance_homes/boinc_31418/projects/climateprediction.net/oifs_43r3_bl_12291233/ICMSHh7zg+001800
Adding to the zip: /opt/boinc/instance_homes/boinc_31418/projects/climateprediction.net/oifs_43r3_bl_12291233/ICMUAh7zg+001800
Adding to the zip: /opt/boinc/instance_homes/boinc_31418/projects/climateprediction.net/oifs_43r3_bl_12291233/ICMGGh7zg+001812
Adding to the zip: /opt/boinc/instance_homes/boinc_31418/projects/climateprediction.net/oifs_43r3_bl_12291233/ICMSHh7zg+001812
Adding to the zip: /opt/boinc/instance_homes/boinc_31418/projects/climateprediction.net/oifs_43r3_bl_12291233/ICMUAh7zg+001812
Zipping up the intermediate file: /opt/boinc/instance_homes/boinc_31418/projects/climateprediction.net/oifs_43r3_bl_a28q_2016092300_20_1018_12291233_0_r690183884_18.zip
Uploading the intermediate file: upload_file_18.zip
  07:24:49 STEP 1825 H= 456:15 +CPU= 34.985
  07:25:23 STEP 1826 H= 456:30 +CPU= 34.765
  07:25:58 STEP 1827 H= 456:45 +CPU= 34.037
  07:26:33 STEP 1828 H= 457:00 +CPU= 35.638
  07:27:08 STEP 1829 H= 457:15 +CPU= 34.408
  07:27:42 STEP 1830 H= 457:30 +CPU= 34.004
  07:28:16 STEP 1831 H= 457:45 +CPU= 34.188
  07:28:52 STEP 1832 H= 458:00 +CPU= 35.235
  07:29:26 STEP 1833 H= 458:15 +CPU= 33.895
  07:29:59 STEP 1834 H= 458:30 +CPU= 33.400
  07:30:33 STEP 1835 H= 458:45 +CPU= 33.827
  07:31:16 STEP 1836 H= 459:00 +CPU= 42.845
Moving to projects directory: /opt/boinc/instance_homes/boinc_31418/slots/3/ICMGGh7zg+001836
Moving to projects directory: /opt/boinc/instance_homes/boinc_31418/slots/3/ICMSHh7zg+001836
Moving to projects directory: /opt/boinc/instance_homes/boinc_31418/slots/3/ICMUAh7zg+001836
  07:31:51 STEP 1837 H= 459:15 +CPU= 34.400
  07:32:25 STEP 1838 H= 459:30 +CPU= 33.636
  07:33:00 STEP 1839 H= 459:45 +CPU= 35.194
  07:33:36 STEP 1840 H= 460:00 +CPU= 35.759
  07:34:11 STEP 1841 H= 460:15 +CPU= 35.217
  07:34:47 STEP 1842 H= 460:30 +CPU= 35.321
  07:35:22 STEP 1843 H= 460:45 +CPU= 34.776
  07:35:58 STEP 1844 H= 461:00 +CPU= 35.937
  07:36:33 STEP 1845 H= 461:15 +CPU= 35.030
  07:37:07 STEP 1846 H= 461:30 +CPU= 33.783
  07:37:41 STEP 1847 H= 461:45 +CPU= 34.398
  07:38:22 STEP 1848 H= 462:00 +CPU= 40.823
Moving to projects directory: /opt/boinc/instance_homes/boinc_31418/slots/3/ICMGGh7zg+001848
Moving to projects directory: /opt/boinc/instance_homes/boinc_31418/slots/3/ICMSHh7zg+001848
Moving to projects directory: /opt/boinc/instance_homes/boinc_31418/slots/3/ICMUAh7zg+001848
  07:38:56 STEP 1849 H= 462:15 +CPU= 33.240
  07:39:29 STEP 1850 H= 462:30 +CPU= 32.630
  07:40:02 STEP 1851 H= 462:45 +CPU= 33.723
  07:40:37 STEP 1852 H= 463:00 +CPU= 34.191
  07:41:12 STEP 1853 H= 463:15 +CPU= 34.754
  07:41:46 STEP 1854 H= 463:30 +CPU= 33.886
  07:42:21 STEP 1855 H= 463:45 +CPU= 35.268
  07:42:56 STEP 1856 H= 464:00 +CPU= 34.847
  07:43:30 STEP 1857 H= 464:15 +CPU= 34.330
  07:44:04 STEP 1858 H= 464:30 +CPU= 33.490
  07:44:38 STEP 1859 H= 464:45 +CPU= 33.454
  07:45:21 STEP 1860 H= 465:00 +CPU= 42.816
Moving to projects directory: /opt/boinc/instance_homes/boinc_31418/slots/3/ICMGGh7zg+001860
Moving to projects directory: /opt/boinc/instance_homes/boinc_31418/slots/3/ICMSHh7zg+001860
Moving to projects directory: /opt/boinc/instance_homes/boinc_31418/slots/3/ICMUAh7zg+001860
  07:45:53 STEP 1861 H= 465:15 +CPU= 31.871
  07:46:26 STEP 1862 H= 465:30 +CPU= 32.964
  07:46:59 STEP 1863 H= 465:45 +CPU= 32.911
  07:47:33 STEP 1864 H= 466:00 +CPU= 34.090
  07:48:06 STEP 1865 H= 466:15 +CPU= 32.572
  07:48:39 STEP 1866 H= 466:30 +CPU= 33.042
  07:49:13 STEP 1867 H= 466:45 +CPU= 33.467
  07:49:46 STEP 1868 H= 467:00 +CPU= 33.397
  07:50:19 STEP 1869 H= 467:15 +CPU= 32.704
  07:50:52 STEP 1870 H= 467:30 +CPU= 32.764
  07:51:24 STEP 1871 H= 467:45 +CPU= 32.450
  07:52:12 STEP 1872 H= 468:00 +CPU= 46.846
Moving to projects directory: /opt/boinc/instance_homes/boinc_31418/slots/3/ICMGGh7zg+001872
Moving to projects directory: /opt/boinc/instance_homes/boinc_31418/slots/3/ICMSHh7zg+001872
Moving to projects directory: /opt/boinc/instance_homes/boinc_31418/slots/3/ICMUAh7zg+001872
  07:52:44 STEP 1873 H= 468:15 +CPU= 32.429
  07:53:16 STEP 1874 H= 468:30 +CPU= 31.780
  07:53:48 STEP 1875 H= 468:45 +CPU= 32.307
  07:54:22 STEP 1876 H= 469:00 +CPU= 33.195
  07:54:55 STEP 1877 H= 469:15 +CPU= 32.856
  07:55:27 STEP 1878 H= 469:30 +CPU= 32.231
  07:55:59 STEP 1879 H= 469:45 +CPU= 32.165
  07:56:34 STEP 1880 H= 470:00 +CPU= 34.366
  07:57:08 STEP 1881 H= 470:15 +CPU= 33.440
  07:57:40 STEP 1882 H= 470:30 +CPU= 32.613
  07:58:13 STEP 1883 H= 470:45 +CPU= 32.983
  07:58:55 STEP 1884 H= 471:00 +CPU= 41.609
Moving to projects directory: /opt/boinc/instance_homes/boinc_31418/slots/3/ICMGGh7zg+001884
Moving to projects directory: /opt/boinc/instance_homes/boinc_31418/slots/3/ICMSHh7zg+001884
Moving to projects directory: /opt/boinc/instance_homes/boinc_31418/slots/3/ICMUAh7zg+001884
  07:59:28 STEP 1885 H= 471:15 +CPU= 32.478
  08:00:00 STEP 1886 H= 471:30 +CPU= 32.269
  08:00:33 STEP 1887 H= 471:45 +CPU= 33.011
  08:01:07 STEP 1888 H= 472:00 +CPU= 33.392
  08:01:40 STEP 1889 H= 472:15 +CPU= 32.795
  08:02:12 STEP 1890 H= 472:30 +CPU= 32.068
  08:02:45 STEP 1891 H= 472:45 +CPU= 33.074
  08:03:19 STEP 1892 H= 473:00 +CPU= 33.351
  08:03:51 STEP 1893 H= 473:15 +CPU= 32.051
  08:04:24 STEP 1894 H= 473:30 +CPU= 32.417
  08:04:56 STEP 1895 H= 473:45 +CPU= 32.782
  08:05:39 STEP 1896 H= 474:00 +CPU= 42.045
Moving to projects directory: /opt/boinc/instance_homes/boinc_31418/slots/3/ICMGGh7zg+001896
Moving to projects directory: /opt/boinc/instance_homes/boinc_31418/slots/3/ICMSHh7zg+001896
Moving to projects directory: /opt/boinc/instance_homes/boinc_31418/slots/3/ICMUAh7zg+001896
  08:06:12 STEP 1897 H= 474:15 +CPU= 33.018
  08:06:45 STEP 1898 H= 474:30 +CPU= 33.573
  08:07:20 STEP 1899 H= 474:45 +CPU= 34.175
  08:07:55 STEP 1900 H= 475:00 +CPU= 34.983
  08:08:31 STEP 1901 H= 475:15 +CPU= 35.953
  08:09:04 STEP 1902 H= 475:30 +CPU= 32.562
  08:09:37 STEP 1903 H= 475:45 +CPU= 33.479
  08:10:12 STEP 1904 H= 476:00 +CPU= 34.197
  08:10:45 STEP 1905 H= 476:15 +CPU= 33.657
  08:11:20 STEP 1906 H= 476:30 +CPU= 34.056
  08:11:52 STEP 1907 H= 476:45 +CPU= 32.645
  08:12:34 STEP 1908 H= 477:00 +CPU= 41.453
Moving to projects directory: /opt/boinc/instance_homes/boinc_31418/slots/3/ICMGGh7zg+001908
Moving to projects directory: /opt/boinc/instance_homes/boinc_31418/slots/3/ICMSHh7zg+001908
Moving to projects directory: /opt/boinc/instance_homes/boinc_31418/slots/3/ICMUAh7zg+001908
  08:13:07 STEP 1909 H= 477:15 +CPU= 32.922
  08:13:40 STEP 1910 H= 477:30 +CPU= 33.119
  08:14:14 STEP 1911 H= 477:45 +CPU= 33.314
  08:14:48 STEP 1912 H= 478:00 +CPU= 34.430
  08:15:22 STEP 1913 H= 478:15 +CPU= 33.051
  08:15:55 STEP 1914 H= 478:30 +CPU= 32.951
  08:16:28 STEP 1915 H= 478:45 +CPU= 33.123
  08:17:03 STEP 1916 H= 479:00 +CPU= 34.429
  08:17:36 STEP 1917 H= 479:15 +CPU= 33.122
  08:18:10 STEP 1918 H= 479:30 +CPU= 33.857
  08:18:44 STEP 1919 H= 479:45 +CPU= 33.678
  08:19:30 STEP 1920 H= 480:00 +CPU= 46.401
..The child process terminated with status: 0
>>> Printing last 70 lines from file: NODE.001_01

I-------------------------------------------------------------------------I
I   VARIABLE   I      Initial value         I        Current value        I
I-------------------------------------------------------------------------I
I  OMEGA (P/S) I     -0.1667048944E-20      I       0.1752293008E-06      I
ICloud fractionI      0.0000000000E+00      I       0.3039094836E-02      I
I  Relat. Hum. I      0.3797375453E+00      I       0.3949495869E+00      I
I  PASS 01     I      0.0000000000E+00      I       0.4707121092E+02      I
DDH------------------------------------------------------------------------
  
  MAXGPFV : MAX. VALUE =   0.000000000000000E+000
  MAXGPFV : MAX. VALUE =   0.000000000000000E+000
 NSTEP =  1920 SCAN2M_HPOS  P
 IO-STREAM SETUP - IOTYPE =           2  NUMIOPROCS =           1  CPATH =
 ICMGGh7zg+001920 MODE=a
 IO-STREAM CLOSED - ICMGGh7zg+001920
 MPI-TASK:   1 -    319609876 BYTES IN      7 RECORDS TRANSFERRED IN    0.0011 SECONDS290554.4 Mbytes/s, TOTAL TIME=    0.0440( 2.5%)
 08:19:30 STEP 1920 H= 480:00 +CPU= 46.401
 END CNT3
 NSTEP =  1920 CNT0   000000000  32.513  32.513  32.646   0.996               0               0               0               0               0
IO-STREAM STATISTICS, TOTAL NO OF REC/BYTES READ            0/           0 WRITTEN        57546/************
 -TASK-OPENED-OPEN-RECS IN -KBYTE IN    -RECS OUT-KBYTE OUT-WALL   -WALL IN-WALL
  OU-TOT IN -TOT OUT
   1   1008    0        0            0    57546 ************   174.4     0.0   174.4     0.0   308.6
===-=== START OF TIMING STATISTICS ===-===
 
STATS FOR ALL TASKS
 NUM ROUTINE                                     CALLS  MEAN(ms)   MAX(ms)   FRAC(%)  UNBAL(%)
   0 CNT0     - COMPLETE EXECUTION                   1 *********       0.0    100.00   -100.00
   1 CNT4     - FORWARD INTEGRATION                  1 *********       0.0    100.01   -100.01
   8 SCAN2M - GRID-POINT DYNAMICS                 2082    6080.1    6080.1      0.00      0.00
   9 SPCM     - SPECTRAL COMP.                    1920     864.7     864.7      0.00      0.00
  10 SCAN2M - PHYSICS                             1921   15507.9   15507.9      0.00      0.00
  11 IOPACK   - OUTPUT P.P. RESULTS                161    1453.7    1453.7      0.00      0.00
  12 SPNORM   - SPECTRAL NORM COMP.                 83      49.3      49.3      0.00      0.00
  14 SUINIF                                          1    6713.2    6713.2      0.00      0.00
  17 GRIDFPOS IN CNT4                              161      36.8      36.8      0.00      0.00
  18 SUSPECG                                         1    3593.5    3593.5      0.00      0.00
  19 SUSPEC                                          1    3607.9    3607.9      0.00      0.00
  24 SUGRIDU                                         1    2607.4    2607.4      0.00      0.00
  25 SPECRT                                          1     290.0     290.0      0.00      0.00
  26 SUGRIDF                                         1     207.8     207.8      0.00      0.00
  27 RESTART FILES - WRITING                        40    5851.1    5851.1      0.00      0.00
  28 RESTART FILES - READING                         1       0.0       0.0      0.00      0.00
  29 SU4FPOS IN CNT4                               161       0.1       0.1      0.00      0.00
  30 DYNFPOS IN CNT4                               161    7944.3    7944.3      0.00      0.00
  31 POSDDH IN STEPO                                 9       1.4       1.4      0.00      0.00
  37 CPGLAG   - SL COMPUTATIONS                   1921 -104377.0       0.0    135.41   -135.41
  39 SU0YOMB                                         1     592.5     592.5      0.00      0.00
  51 SCAN2M   - SL COMM. PART 1                   1921      28.6      28.6      0.00      0.00
  54 SPCM     - M TO S/S TO M TRANSP.             1920     437.3     437.3      0.00      0.00
  55 SPCIMPF  - S TO M/M TO S TRANSP.             1920      67.7      67.7      0.00      0.00
  56 SPNORM   - SPECTRAL NORM COMM.                 83       0.3       0.3      0.00      0.00
 102 LTINV_CTL   - INVERSE LEGENDRE TRANSFORM     4165     542.2     542.2      0.00      0.00
 103 LTDIR_CTL   - DIRECT LEGENDRE TRANSFORM      4006     311.4     311.4      0.00      0.00
 106 FTDIR_CTL   - DIRECT FOURIER TRANSFORM       4006     144.6     144.6      0.00      0.00
 107 FTINV_CTL   - INVERSE FOURIER TRANSFORM      4165     165.2     165.2      0.00      0.00
 140 SULEG       - COMP. OF LEGENDRE POL.            1      55.0      55.0      0.00      0.00
 152 LTINV_CTL   - M TO L TRANSPOSITION           4165      91.7      91.7      0.00      0.00
 153 LTDIR_CTL   - L TO M TRANSPOSITION           4006      44.7      44.7      0.00      0.00
 157 FTINV_CTL   - L TO G TRANSPOSITION           4165      93.3      93.3      0.00      0.00
 158 FTDIR_CTL   - G TO L TRANSPOSITION           4006      38.1      38.1      0.00      0.00
 400 GSTATS                                     223224       0.0       0.0      0.00      0.00
 401 GSTATS HOOK                                207696       0.0       0.0      0.00      0.00
TOTAL MEASURED IMBALANCE =       0.0 SECONDS,  0.0 PERCENT
TOTAL WALLCLOCK TIME  -148079.3 CPU TIME   66338.9 VECTOR TIME    66338.9


===-=== END   OF TIMING STATISTICS ===-===
  *** END CNT0 *** 
------------------------------------------------
Moving to projects directory: /opt/boinc/instance_homes/boinc_31418/slots/3/ICMGGh7zg+001920
Moving to projects directory: /opt/boinc/instance_homes/boinc_31418/slots/3/ICMSHh7zg+001920
Moving to projects directory: /opt/boinc/instance_homes/boinc_31418/slots/3/ICMUAh7zg+001920
Adding to the zip: /opt/boinc/instance_homes/boinc_31418/slots/3/NODE.001_01
Adding to the zip: /opt/boinc/instance_homes/boinc_31418/slots/3/ifs.stat
Adding to the zip: /opt/boinc/instance_homes/boinc_31418/projects/climateprediction.net/oifs_43r3_bl_12291233/ICMUAh7zg+001824
Adding to the zip: /opt/boinc/instance_homes/boinc_31418/projects/climateprediction.net/oifs_43r3_bl_12291233/ICMSHh7zg+001860
Adding to the zip: /opt/boinc/instance_homes/boinc_31418/projects/climateprediction.net/oifs_43r3_bl_12291233/ICMUAh7zg+001884
Adding to the zip: /opt/boinc/instance_homes/boinc_31418/projects/climateprediction.net/oifs_43r3_bl_12291233/ICMSHh7zg+001848
Adding to the zip: /opt/boinc/instance_homes/boinc_31418/projects/climateprediction.net/oifs_43r3_bl_12291233/ICMSHh7zg+001920
Adding to the zip: /opt/boinc/instance_homes/boinc_31418/projects/climateprediction.net/oifs_43r3_bl_12291233/ICMUAh7zg+001920
Adding to the zip: /opt/boinc/instance_homes/boinc_31418/projects/climateprediction.net/oifs_43r3_bl_12291233/ICMSHh7zg+001824
Adding to the zip: /opt/boinc/instance_homes/boinc_31418/projects/climateprediction.net/oifs_43r3_bl_12291233/ICMUAh7zg+001908
Adding to the zip: /opt/boinc/instance_homes/boinc_31418/projects/climateprediction.net/oifs_43r3_bl_12291233/ICMSHh7zg+001872
Adding to the zip: /opt/boinc/instance_homes/boinc_31418/projects/climateprediction.net/oifs_43r3_bl_12291233/ICMUAh7zg+001860
Adding to the zip: /opt/boinc/instance_homes/boinc_31418/projects/climateprediction.net/oifs_43r3_bl_12291233/ICMSHh7zg+001908
Adding to the zip: /opt/boinc/instance_homes/boinc_31418/projects/climateprediction.net/oifs_43r3_bl_12291233/ICMUAh7zg+001872
Adding to the zip: /opt/boinc/instance_homes/boinc_31418/projects/climateprediction.net/oifs_43r3_bl_12291233/ICMGGh7zg+001836
Adding to the zip: /opt/boinc/instance_homes/boinc_31418/projects/climateprediction.net/oifs_43r3_bl_12291233/ICMGGh7zg+001860
Adding to the zip: /opt/boinc/instance_homes/boinc_31418/projects/climateprediction.net/oifs_43r3_bl_12291233/ICMGGh7zg+001884
Adding to the zip: /opt/boinc/instance_homes/boinc_31418/projects/climateprediction.net/oifs_43r3_bl_12291233/ICMSHh7zg+001836
Adding to the zip: /opt/boinc/instance_homes/boinc_31418/projects/climateprediction.net/oifs_43r3_bl_12291233/ICMGGh7zg+001824
Adding to the zip: /opt/boinc/instance_homes/boinc_31418/projects/climateprediction.net/oifs_43r3_bl_12291233/ICMGGh7zg+001920
Adding to the zip: /opt/boinc/instance_homes/boinc_31418/projects/climateprediction.net/oifs_43r3_bl_12291233/ICMSHh7zg+001896
Adding to the zip: /opt/boinc/instance_homes/boinc_31418/projects/climateprediction.net/oifs_43r3_bl_12291233/ICMGGh7zg+001872
Adding to the zip: /opt/boinc/instance_homes/boinc_31418/projects/climateprediction.net/oifs_43r3_bl_12291233/ICMGGh7zg+001848
Adding to the zip: /opt/boinc/instance_homes/boinc_31418/projects/climateprediction.net/oifs_43r3_bl_12291233/ICMUAh7zg+001848
Adding to the zip: /opt/boinc/instance_homes/boinc_31418/projects/climateprediction.net/oifs_43r3_bl_12291233/ICMUAh7zg+001836
Adding to the zip: /opt/boinc/instance_homes/boinc_31418/projects/climateprediction.net/oifs_43r3_bl_12291233/ICMGGh7zg+001908
Adding to the zip: /opt/boinc/instance_homes/boinc_31418/projects/climateprediction.net/oifs_43r3_bl_12291233/ICMSHh7zg+001884
Adding to the zip: /opt/boinc/instance_homes/boinc_31418/projects/climateprediction.net/oifs_43r3_bl_12291233/ICMUAh7zg+001896
Adding to the zip: /opt/boinc/instance_homes/boinc_31418/projects/climateprediction.net/oifs_43r3_bl_12291233/ICMGGh7zg+001896
Zipping up the final file: /opt/boinc/instance_homes/boinc_31418/projects/climateprediction.net/oifs_43r3_bl_a28q_2016092300_20_1018_12291233_0_r690183884_19.zip
Uploading the final file: upload_file_19.zip
Uploading trickle at timestep: 1727100
08:23:05 (423590): called boinc_finish(0)

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
15 Jun 2024 07:14:27 1550946 22444832 oifs_43r3_bl_a28q_2016092300_20_1018_12291233_0 1,727,100 66,339 0.0384
14 Jun 2024 20:57:50 1550946 22444832 oifs_43r3_bl_a28q_2016092300_20_1018_12291233_0 864,000 32,449 0.0376


©2024 cpdn.org