climateprediction.net home page
Task 22443688

Task 22443688

Name oifs_43r3_bl_a1d7_2016092300_20_1018_12290098_0
Workunit 12290098
Created 12 Jun 2024, 22:31:24 UTC
Sent 13 Jun 2024, 19:55:37 UTC
Report deadline 12 Aug 2024, 19:55:37 UTC
Received 17 Jun 2024, 4:13:17 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 9 (0x00000009) Unknown error code
Computer ID 1532338
Run time 22 hours 52 min 40 sec
CPU time 22 hours 51 min 47 sec
Validate state Invalid
Credit 2,635.55
Device peak FLOPS 5.63 GFLOPS
Application version OpenIFS 43r3 Baroclinic Lifecycle v1.13
x86_64-pc-linux-gnu
Peak working set size 5,565.13 MB
Peak swap size 5,981.12 MB
Peak disk usage 1,350.87 MB
Stderr
<core_client_version>7.16.16</core_client_version>
<![CDATA[
<message>
process exited with code 9 (0x9, -247)</message>
<stderr_txt>
03:0.001] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1
[EC_DRHOOK:PREMIUM2:1:1:869903:869903] [20240616:201643:1718569003:0.001] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1
[EC_DRHOOK:PREMIUM2:1:1:869903:869903] [20240616:201643:1718569003:0.001] [ignore_signals@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef>
[EC_DRHOOK:PREMIUM2:1:1:869903:869903] [20240616:201643:1718569003:0.001] [restore_default_signals@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef>
[EC_DRHOOK:PREMIUM2:1:1:869903:869903] [20240616:201643:1718569003:0.001] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:PREMIUM2:1:1:869903:869903] [20240616:201643:1718569003:0.001] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x820cf0 (old at (nil))
[EC_DRHOOK:PREMIUM2:1:1:869903:869903] [20240616:201643:1718569003:0.001] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:PREMIUM2:1:1:869903:869903] [20240616:201643:1718569003:0.001] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x820cf0 (old at (nil))
[EC_DRHOOK:PREMIUM2:1:1:869903:869903] [20240616:201643:1718569003:0.001] [trapfpe_treatment@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:PREMIUM2:1:1:869903:869903] [20240616:201643:1718569003:0.001] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:PREMIUM2:1:1:869903:869903] [20240616:201643:1718569003:0.001] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:PREMIUM2:1:1:869903:869903] [20240616:201643:1718569003:0.001] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x820cf0 (old at (nil))
[EC_DRHOOK:PREMIUM2:1:1:869903:869903] [20240616:201643:1718569003:0.001] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:PREMIUM2:1:1:869903:869903] [20240616:201643:1718569003:0.001] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:PREMIUM2:1:1:869903:869903] [20240616:201643:1718569003:0.001] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:PREMIUM2:1:1:869903:869903] [20240616:201643:1718569003:0.001] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x820cf0 (old at (nil))
[EC_DRHOOK:PREMIUM2:1:1:869903:869903] [20240616:201643:1718569003:0.001] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x820cf0 (old at (nil))
[EC_DRHOOK:PREMIUM2:1:1:869903:869903] [20240616:201643:1718569003:0.001] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x820cf0 (old at (nil))
[EC_DRHOOK:PREMIUM2:1:1:869903:869903] [20240616:201643:1718569003:0.001] [catch_signals@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
  20:17:49 STEP 1344 H= 336:00 +CPU= 58.622
  20:18:37 STEP 1345 H= 336:15 +CPU= 47.240
  20:19:25 STEP 1346 H= 336:30 +CPU= 48.509
  20:20:19 STEP 1347 H= 336:45 +CPU= 54.082
  20:21:13 STEP 1348 H= 337:00 +CPU= 53.799
  20:22:12 STEP 1349 H= 337:15 +CPU= 58.857
  20:23:01 STEP 1350 H= 337:30 +CPU= 49.086
  20:23:58 STEP 1351 H= 337:45 +CPU= 56.637
  20:24:45 STEP 1352 H= 338:00 +CPU= 46.622
  20:25:30 STEP 1353 H= 338:15 +CPU= 45.421
  20:26:19 STEP 1354 H= 338:30 +CPU= 48.572
  20:27:11 STEP 1355 H= 338:45 +CPU= 52.704
  20:28:25 STEP 1356 H= 339:00 +CPU= 73.991
Moving to projects directory: /var/lib/boinc-client/slots/27/ICMGGh7zg+001356
Moving to projects directory: /var/lib/boinc-client/slots/27/ICMSHh7zg+001356
Moving to projects directory: /var/lib/boinc-client/slots/27/ICMUAh7zg+001356
  20:29:16 STEP 1357 H= 339:15 +CPU= 50.527
  20:30:07 STEP 1358 H= 339:30 +CPU= 51.234
  20:30:51 STEP 1359 H= 339:45 +CPU= 43.637
  20:31:38 STEP 1360 H= 340:00 +CPU= 47.288
  20:32:25 STEP 1361 H= 340:15 +CPU= 46.706
  20:33:09 STEP 1362 H= 340:30 +CPU= 44.014
  20:33:56 STEP 1363 H= 340:45 +CPU= 46.776
  20:34:37 STEP 1364 H= 341:00 +CPU= 41.719
  20:35:18 STEP 1365 H= 341:15 +CPU= 40.526
  20:36:08 STEP 1366 H= 341:30 +CPU= 49.482
  20:36:54 STEP 1367 H= 341:45 +CPU= 46.581
  20:37:50 STEP 1368 H= 342:00 +CPU= 56.154
Moving to projects directory: /var/lib/boinc-client/slots/27/ICMGGh7zg+001368
Moving to projects directory: /var/lib/boinc-client/slots/27/ICMSHh7zg+001368
Moving to projects directory: /var/lib/boinc-client/slots/27/ICMUAh7zg+001368
  20:38:35 STEP 1369 H= 342:15 +CPU= 44.507
  20:39:24 STEP 1370 H= 342:30 +CPU= 49.103
  20:40:20 STEP 1371 H= 342:45 +CPU= 56.436
  20:41:05 STEP 1372 H= 343:00 +CPU= 44.855
  20:41:51 STEP 1373 H= 343:15 +CPU= 45.318
  20:42:27 STEP 1374 H= 343:30 +CPU= 36.833
  20:43:13 STEP 1375 H= 343:45 +CPU= 45.160
  20:43:50 STEP 1376 H= 344:00 +CPU= 37.144
  20:44:32 STEP 1377 H= 344:15 +CPU= 42.621
  20:45:21 STEP 1378 H= 344:30 +CPU= 48.264
  20:46:08 STEP 1379 H= 344:45 +CPU= 46.910
  20:46:55 STEP 1380 H= 345:00 +CPU= 47.204
Moving to projects directory: /var/lib/boinc-client/slots/27/ICMGGh7zg+001380
Moving to projects directory: /var/lib/boinc-client/slots/27/ICMSHh7zg+001380
Moving to projects directory: /var/lib/boinc-client/slots/27/ICMUAh7zg+001380
  20:47:44 STEP 1381 H= 345:15 +CPU= 49.028
  20:48:18 STEP 1382 H= 345:30 +CPU= 34.203
  20:49:02 STEP 1383 H= 345:45 +CPU= 44.253
  20:49:43 STEP 1384 H= 346:00 +CPU= 41.081
  20:50:24 STEP 1385 H= 346:15 +CPU= 40.695
  20:51:00 STEP 1386 H= 346:30 +CPU= 35.589
  20:51:40 STEP 1387 H= 346:45 +CPU= 40.036
  20:52:23 STEP 1388 H= 347:00 +CPU= 43.010
  20:53:01 STEP 1389 H= 347:15 +CPU= 37.775
  20:53:45 STEP 1390 H= 347:30 +CPU= 44.820
  20:54:30 STEP 1391 H= 347:45 +CPU= 44.962
  20:55:35 STEP 1392 H= 348:00 +CPU= 64.647
Moving to projects directory: /var/lib/boinc-client/slots/27/ICMGGh7zg+001392
Moving to projects directory: /var/lib/boinc-client/slots/27/ICMSHh7zg+001392
Moving to projects directory: /var/lib/boinc-client/slots/27/ICMUAh7zg+001392
  20:56:21 STEP 1393 H= 348:15 +CPU= 46.194
  20:56:57 STEP 1394 H= 348:30 +CPU= 35.847
  20:57:38 STEP 1395 H= 348:45 +CPU= 40.640
  20:58:25 STEP 1396 H= 349:00 +CPU= 46.960
  20:59:03 STEP 1397 H= 349:15 +CPU= 38.681
  20:59:50 STEP 1398 H= 349:30 +CPU= 46.421
  21:00:40 STEP 1399 H= 349:45 +CPU= 50.419
  21:01:27 STEP 1400 H= 350:00 +CPU= 46.533
  21:02:07 STEP 1401 H= 350:15 +CPU= 40.615
  21:03:00 STEP 1402 H= 350:30 +CPU= 52.398
  21:03:39 STEP 1403 H= 350:45 +CPU= 39.205
  21:04:29 STEP 1404 H= 351:00 +CPU= 49.840
Moving to projects directory: /var/lib/boinc-client/slots/27/ICMGGh7zg+001404
Moving to projects directory: /var/lib/boinc-client/slots/27/ICMSHh7zg+001404
Moving to projects directory: /var/lib/boinc-client/slots/27/ICMUAh7zg+001404
  21:05:01 STEP 1405 H= 351:15 +CPU= 32.372
  21:05:44 STEP 1406 H= 351:30 +CPU= 43.022
  21:06:21 STEP 1407 H= 351:45 +CPU= 36.269
  21:07:09 STEP 1408 H= 352:00 +CPU= 48.697
  21:08:02 STEP 1409 H= 352:15 +CPU= 52.926
  21:08:42 STEP 1410 H= 352:30 +CPU= 39.944
  21:09:29 STEP 1411 H= 352:45 +CPU= 46.233
  21:10:17 STEP 1412 H= 353:00 +CPU= 48.058
  21:11:01 STEP 1413 H= 353:15 +CPU= 44.049
  21:11:48 STEP 1414 H= 353:30 +CPU= 46.914
  21:12:22 STEP 1415 H= 353:45 +CPU= 34.155
  21:13:14 STEP 1416 H= 354:00 +CPU= 52.349
Moving to projects directory: /var/lib/boinc-client/slots/27/ICMGGh7zg+001416
Moving to projects directory: /var/lib/boinc-client/slots/27/ICMSHh7zg+001416
Moving to projects directory: /var/lib/boinc-client/slots/27/ICMUAh7zg+001416
  21:13:53 STEP 1417 H= 354:15 +CPU= 38.623
  21:14:36 STEP 1418 H= 354:30 +CPU= 42.987
  21:15:23 STEP 1419 H= 354:45 +CPU= 47.024
  21:16:10 STEP 1420 H= 355:00 +CPU= 47.400
  21:16:51 STEP 1421 H= 355:15 +CPU= 40.996
  21:17:34 STEP 1422 H= 355:30 +CPU= 42.317
  21:18:17 STEP 1423 H= 355:45 +CPU= 43.337
  21:19:06 STEP 1424 H= 356:00 +CPU= 49.163
  21:19:54 STEP 1425 H= 356:15 +CPU= 47.428
  21:20:37 STEP 1426 H= 356:30 +CPU= 43.903
  21:21:25 STEP 1427 H= 356:45 +CPU= 47.768
  21:22:26 STEP 1428 H= 357:00 +CPU= 61.068
Moving to projects directory: /var/lib/boinc-client/slots/27/ICMGGh7zg+001428
Moving to projects directory: /var/lib/boinc-client/slots/27/ICMSHh7zg+001428
Moving to projects directory: /var/lib/boinc-client/slots/27/ICMUAh7zg+001428
  21:23:07 STEP 1429 H= 357:15 +CPU= 40.277
  21:23:54 STEP 1430 H= 357:30 +CPU= 47.376
  21:24:42 STEP 1431 H= 357:45 +CPU= 47.786
  21:25:27 STEP 1432 H= 358:00 +CPU= 45.347
  21:26:19 STEP 1433 H= 358:15 +CPU= 51.473
  21:27:02 STEP 1434 H= 358:30 +CPU= 42.924
  21:27:36 STEP 1435 H= 358:45 +CPU= 34.216
  21:28:19 STEP 1436 H= 359:00 +CPU= 43.491
  21:29:00 STEP 1437 H= 359:15 +CPU= 40.507
  21:29:45 STEP 1438 H= 359:30 +CPU= 45.145
  21:30:25 STEP 1439 H= 359:45 +CPU= 40.429
  21:31:29 STEP 1440 H= 360:00 +CPU= 63.603
Moving to projects directory: /var/lib/boinc-client/slots/27/ICMGGh7zg+001440
Moving to projects directory: /var/lib/boinc-client/slots/27/ICMSHh7zg+001440
Moving to projects directory: /var/lib/boinc-client/slots/27/ICMUAh7zg+001440
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290098/ICMGGh7zg+001344
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290098/ICMSHh7zg+001344
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290098/ICMUAh7zg+001344
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290098/ICMGGh7zg+001356
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290098/ICMSHh7zg+001356
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290098/ICMUAh7zg+001356
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290098/ICMGGh7zg+001368
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290098/ICMSHh7zg+001368
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290098/ICMUAh7zg+001368
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290098/ICMGGh7zg+001380
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290098/ICMSHh7zg+001380
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290098/ICMUAh7zg+001380
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290098/ICMGGh7zg+001392
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290098/ICMSHh7zg+001392
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290098/ICMUAh7zg+001392
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290098/ICMGGh7zg+001404
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290098/ICMSHh7zg+001404
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290098/ICMUAh7zg+001404
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290098/ICMGGh7zg+001416
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290098/ICMSHh7zg+001416
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290098/ICMUAh7zg+001416
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290098/ICMGGh7zg+001428
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290098/ICMSHh7zg+001428
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290098/ICMUAh7zg+001428
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a1d7_2016092300_20_1018_12290098_0_r110879949_14.zip
Uploading the intermediate file: upload_file_14.zip
  21:32:07 STEP 1441 H= 360:15 +CPU= 37.619
  21:32:58 STEP 1442 H= 360:30 +CPU= 51.662
  21:33:42 STEP 1443 H= 360:45 +CPU= 43.238
  21:34:27 STEP 1444 H= 361:00 +CPU= 45.017
  21:35:04 STEP 1445 H= 361:15 +CPU= 37.054
  21:35:46 STEP 1446 H= 361:30 +CPU= 42.551
  21:36:23 STEP 1447 H= 361:45 +CPU= 36.958
  21:36:57 STEP 1448 H= 362:00 +CPU= 33.586
  21:37:45 STEP 1449 H= 362:15 +CPU= 48.696
  21:38:30 STEP 1450 H= 362:30 +CPU= 44.354
  21:39:13 STEP 1451 H= 362:45 +CPU= 43.540
  21:40:06 STEP 1452 H= 363:00 +CPU= 52.824
Moving to projects directory: /var/lib/boinc-client/slots/27/ICMGGh7zg+001452
Moving to projects directory: /var/lib/boinc-client/slots/27/ICMSHh7zg+001452
Moving to projects directory: /var/lib/boinc-client/slots/27/ICMUAh7zg+001452
  21:40:51 STEP 1453 H= 363:15 +CPU= 44.940
  21:41:41 STEP 1454 H= 363:30 +CPU= 49.901
  21:42:21 STEP 1455 H= 363:45 +CPU= 39.559
  21:43:01 STEP 1456 H= 364:00 +CPU= 40.452
  21:43:36 STEP 1457 H= 364:15 +CPU= 34.928
  21:44:17 STEP 1458 H= 364:30 +CPU= 41.084
  21:44:58 STEP 1459 H= 364:45 +CPU= 40.542
  21:45:39 STEP 1460 H= 365:00 +CPU= 41.315
  21:46:18 STEP 1461 H= 365:15 +CPU= 39.002
  21:47:08 STEP 1462 H= 365:30 +CPU= 50.138
  21:47:51 STEP 1463 H= 365:45 +CPU= 42.591
  21:48:38 STEP 1464 H= 366:00 +CPU= 46.730
Moving to projects directory: /var/lib/boinc-client/slots/27/ICMGGh7zg+001464
Moving to projects directory: /var/lib/boinc-client/slots/27/ICMSHh7zg+001464
Moving to projects directory: /var/lib/boinc-client/slots/27/ICMUAh7zg+001464
  21:49:16 STEP 1465 H= 366:15 +CPU= 38.332
  21:49:51 STEP 1466 H= 366:30 +CPU= 35.366
  21:50:31 STEP 1467 H= 366:45 +CPU= 39.575
  21:51:10 STEP 1468 H= 367:00 +CPU= 39.142
  21:51:55 STEP 1469 H= 367:15 +CPU= 45.295
  21:52:36 STEP 1470 H= 367:30 +CPU= 40.986
  21:53:15 STEP 1471 H= 367:45 +CPU= 38.828
  21:53:58 STEP 1472 H= 368:00 +CPU= 43.221
  21:54:42 STEP 1473 H= 368:15 +CPU= 43.450
  21:55:27 STEP 1474 H= 368:30 +CPU= 44.722
  21:56:13 STEP 1475 H= 368:45 +CPU= 46.391
  21:57:09 STEP 1476 H= 369:00 +CPU= 56.072
Moving to projects directory: /var/lib/boinc-client/slots/27/ICMGGh7zg+001476
Moving to projects directory: /var/lib/boinc-client/slots/27/ICMSHh7zg+001476
Moving to projects directory: /var/lib/boinc-client/slots/27/ICMUAh7zg+001476
  21:57:49 STEP 1477 H= 369:15 +CPU= 39.693
  21:58:41 STEP 1478 H= 369:30 +CPU= 51.714
  21:59:23 STEP 1479 H= 369:45 +CPU= 42.391
  22:00:04 STEP 1480 H= 370:00 +CPU= 41.201
  22:00:40 STEP 1481 H= 370:15 +CPU= 36.147
  22:01:16 STEP 1482 H= 370:30 +CPU= 35.424
  22:01:57 STEP 1483 H= 370:45 +CPU= 41.120
  22:02:44 STEP 1484 H= 371:00 +CPU= 47.080
  22:03:33 STEP 1485 H= 371:15 +CPU= 48.604
  22:04:20 STEP 1486 H= 371:30 +CPU= 47.106
  22:05:07 STEP 1487 H= 371:45 +CPU= 47.247
  22:06:13 STEP 1488 H= 372:00 +CPU= 65.960
Moving to projects directory: /var/lib/boinc-client/slots/27/ICMGGh7zg+001488
Moving to projects directory: /var/lib/boinc-client/slots/27/ICMSHh7zg+001488
Moving to projects directory: /var/lib/boinc-client/slots/27/ICMUAh7zg+001488
  22:06:54 STEP 1489 H= 372:15 +CPU= 41.176
  22:07:29 STEP 1490 H= 372:30 +CPU= 34.762
  22:08:07 STEP 1491 H= 372:45 +CPU= 37.939
  22:08:48 STEP 1492 H= 373:00 +CPU= 40.714
  22:09:28 STEP 1493 H= 373:15 +CPU= 40.289
  22:10:09 STEP 1494 H= 373:30 +CPU= 40.833
  22:10:54 STEP 1495 H= 373:45 +CPU= 44.802
  22:11:28 STEP 1496 H= 374:00 +CPU= 34.182
  22:12:02 STEP 1497 H= 374:15 +CPU= 34.289
  22:12:36 STEP 1498 H= 374:30 +CPU= 34.101
  22:13:14 STEP 1499 H= 374:45 +CPU= 37.522
  22:14:16 STEP 1500 H= 375:00 +CPU= 62.081
Moving to projects directory: /var/lib/boinc-client/slots/27/ICMGGh7zg+001500
Moving to projects directory: /var/lib/boinc-client/slots/27/ICMSHh7zg+001500
Moving to projects directory: /var/lib/boinc-client/slots/27/ICMUAh7zg+001500
  22:15:07 STEP 1501 H= 375:15 +CPU= 50.734
  22:15:49 STEP 1502 H= 375:30 +CPU= 42.434
  22:16:38 STEP 1503 H= 375:45 +CPU= 48.741
  22:17:21 STEP 1504 H= 376:00 +CPU= 43.161
  22:18:03 STEP 1505 H= 376:15 +CPU= 42.260
  22:18:44 STEP 1506 H= 376:30 +CPU= 40.535
  22:19:28 STEP 1507 H= 376:45 +CPU= 43.808
  22:20:02 STEP 1508 H= 377:00 +CPU= 33.968
  22:20:39 STEP 1509 H= 377:15 +CPU= 37.618
  22:21:18 STEP 1510 H= 377:30 +CPU= 38.716
  22:21:59 STEP 1511 H= 377:45 +CPU= 40.801
  22:22:57 STEP 1512 H= 378:00 +CPU= 58.053
Moving to projects directory: /var/lib/boinc-client/slots/27/ICMGGh7zg+001512
Moving to projects directory: /var/lib/boinc-client/slots/27/ICMSHh7zg+001512
Moving to projects directory: /var/lib/boinc-client/slots/27/ICMUAh7zg+001512
  22:23:44 STEP 1513 H= 378:15 +CPU= 46.957
  22:24:29 STEP 1514 H= 378:30 +CPU= 45.289
  22:25:05 STEP 1515 H= 378:45 +CPU= 35.437
  22:25:56 STEP 1516 H= 379:00 +CPU= 51.566
  22:26:47 STEP 1517 H= 379:15 +CPU= 50.482
  22:27:32 STEP 1518 H= 379:30 +CPU= 45.050
  22:28:12 STEP 1519 H= 379:45 +CPU= 40.515
  22:28:58 STEP 1520 H= 380:00 +CPU= 45.657
  22:29:35 STEP 1521 H= 380:15 +CPU= 36.975
  22:30:17 STEP 1522 H= 380:30 +CPU= 41.718
  22:31:07 STEP 1523 H= 380:45 +CPU= 50.285
  22:31:58 STEP 1524 H= 381:00 +CPU= 51.325
Moving to projects directory: /var/lib/boinc-client/slots/27/ICMGGh7zg+001524
Moving to projects directory: /var/lib/boinc-client/slots/27/ICMSHh7zg+001524
Moving to projects directory: /var/lib/boinc-client/slots/27/ICMUAh7zg+001524
  22:32:47 STEP 1525 H= 381:15 +CPU= 48.658
  22:33:33 STEP 1526 H= 381:30 +CPU= 46.464
  22:34:06 STEP 1527 H= 381:45 +CPU= 32.705
  22:34:44 STEP 1528 H= 382:00 +CPU= 37.428
  22:35:31 STEP 1529 H= 382:15 +CPU= 47.466
  22:36:24 STEP 1530 H= 382:30 +CPU= 52.604
  22:37:05 STEP 1531 H= 382:45 +CPU= 41.075
  22:37:49 STEP 1532 H= 383:00 +CPU= 43.801
  22:38:23 STEP 1533 H= 383:15 +CPU= 34.046
  22:39:01 STEP 1534 H= 383:30 +CPU= 38.145
  22:39:40 STEP 1535 H= 383:45 +CPU= 39.696
  22:40:44 STEP 1536 H= 384:00 +CPU= 63.389
Moving to projects directory: /var/lib/boinc-client/slots/27/ICMGGh7zg+001536
Moving to projects directory: /var/lib/boinc-client/slots/27/ICMSHh7zg+001536
Moving to projects directory: /var/lib/boinc-client/slots/27/ICMUAh7zg+001536
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290098/ICMGGh7zg+001440
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290098/ICMSHh7zg+001440
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290098/ICMUAh7zg+001440
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290098/ICMGGh7zg+001452
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290098/ICMSHh7zg+001452
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290098/ICMUAh7zg+001452
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290098/ICMGGh7zg+001464
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290098/ICMSHh7zg+001464
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290098/ICMUAh7zg+001464
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290098/ICMGGh7zg+001476
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290098/ICMSHh7zg+001476
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290098/ICMUAh7zg+001476
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290098/ICMGGh7zg+001488
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290098/ICMSHh7zg+001488
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290098/ICMUAh7zg+001488
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290098/ICMGGh7zg+001500
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290098/ICMSHh7zg+001500
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290098/ICMUAh7zg+001500
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290098/ICMGGh7zg+001512
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290098/ICMSHh7zg+001512
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290098/ICMUAh7zg+001512
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290098/ICMGGh7zg+001524
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290098/ICMSHh7zg+001524
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290098/ICMUAh7zg+001524
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a1d7_2016092300_20_1018_12290098_0_r110879949_15.zip
Uploading the intermediate file: upload_file_15.zip
  22:41:29 STEP 1537 H= 384:15 +CPU= 45.549
  22:42:18 STEP 1538 H= 384:30 +CPU= 48.223
  22:43:04 STEP 1539 H= 384:45 +CPU= 46.498
  22:43:39 STEP 1540 H= 385:00 +CPU= 34.355
  22:44:18 STEP 1541 H= 385:15 +CPU= 39.129
  22:45:02 STEP 1542 H= 385:30 +CPU= 43.905
  22:45:46 STEP 1543 H= 385:45 +CPU= 44.247
  22:46:32 STEP 1544 H= 386:00 +CPU= 46.441
  22:47:11 STEP 1545 H= 386:15 +CPU= 38.167
  22:47:52 STEP 1546 H= 386:30 +CPU= 41.832
  22:48:41 STEP 1547 H= 386:45 +CPU= 48.259
  22:49:29 STEP 1548 H= 387:00 +CPU= 48.362
Moving to projects directory: /var/lib/boinc-client/slots/27/ICMGGh7zg+001548
Moving to projects directory: /var/lib/boinc-client/slots/27/ICMSHh7zg+001548
Moving to projects directory: /var/lib/boinc-client/slots/27/ICMUAh7zg+001548
  22:50:10 STEP 1549 H= 387:15 +CPU= 41.458
  22:50:49 STEP 1550 H= 387:30 +CPU= 38.371
  22:51:29 STEP 1551 H= 387:45 +CPU= 39.640
  22:52:05 STEP 1552 H= 388:00 +CPU= 36.906
  22:52:42 STEP 1553 H= 388:15 +CPU= 36.330
  22:53:26 STEP 1554 H= 388:30 +CPU= 44.507
  22:54:08 STEP 1555 H= 388:45 +CPU= 41.249
  22:55:01 STEP 1556 H= 389:00 +CPU= 53.287
  22:55:46 STEP 1557 H= 389:15 +CPU= 45.580
  22:56:33 STEP 1558 H= 389:30 +CPU= 46.395
  22:57:22 STEP 1559 H= 389:45 +CPU= 48.819
  22:58:16 STEP 1560 H= 390:00 +CPU= 54.018
Moving to projects directory: /var/lib/boinc-client/slots/27/ICMGGh7zg+001560
Moving to projects directory: /var/lib/boinc-client/slots/27/ICMSHh7zg+001560
Moving to projects directory: /var/lib/boinc-client/slots/27/ICMUAh7zg+001560
  22:58:59 STEP 1561 H= 390:15 +CPU= 43.342
  22:59:47 STEP 1562 H= 390:30 +CPU= 47.707
  23:00:28 STEP 1563 H= 390:45 +CPU= 40.946
  23:01:11 STEP 1564 H= 391:00 +CPU= 43.399
  23:01:52 STEP 1565 H= 391:15 +CPU= 40.767
  23:02:39 STEP 1566 H= 391:30 +CPU= 47.378
  23:03:24 STEP 1567 H= 391:45 +CPU= 44.122
  23:04:00 STEP 1568 H= 392:00 +CPU= 36.089
  23:04:37 STEP 1569 H= 392:15 +CPU= 37.087
  23:05:16 STEP 1570 H= 392:30 +CPU= 38.880
  23:05:56 STEP 1571 H= 392:45 +CPU= 40.371
  23:06:39 STEP 1572 H= 393:00 +CPU= 43.065
Moving to projects directory: /var/lib/boinc-client/slots/27/ICMGGh7zg+001572
Moving to projects directory: /var/lib/boinc-client/slots/27/ICMSHh7zg+001572
Moving to projects directory: /var/lib/boinc-client/slots/27/ICMUAh7zg+001572
  23:07:26 STEP 1573 H= 393:15 +CPU= 46.857
  23:08:16 STEP 1574 H= 393:30 +CPU= 49.977
  23:09:08 STEP 1575 H= 393:45 +CPU= 51.724
  23:09:59 STEP 1576 H= 394:00 +CPU= 51.190
  23:10:42 STEP 1577 H= 394:15 +CPU= 43.264
  23:11:26 STEP 1578 H= 394:30 +CPU= 43.766
  23:12:11 STEP 1579 H= 394:45 +CPU= 44.502
  23:12:54 STEP 1580 H= 395:00 +CPU= 43.284
  23:13:44 STEP 1581 H= 395:15 +CPU= 49.978
  23:14:30 STEP 1582 H= 395:30 +CPU= 46.534
  23:15:04 STEP 1583 H= 395:45 +CPU= 33.764
  23:15:54 STEP 1584 H= 396:00 +CPU= 49.560
Moving to projects directory: /var/lib/boinc-client/slots/27/ICMGGh7zg+001584
Moving to projects directory: /var/lib/boinc-client/slots/27/ICMSHh7zg+001584
Moving to projects directory: /var/lib/boinc-client/slots/27/ICMUAh7zg+001584
  23:16:44 STEP 1585 H= 396:15 +CPU= 50.618
  23:17:26 STEP 1586 H= 396:30 +CPU= 41.775
  23:18:17 STEP 1587 H= 396:45 +CPU= 50.456
  23:19:02 STEP 1588 H= 397:00 +CPU= 44.958
  23:19:42 STEP 1589 H= 397:15 +CPU= 40.419
  23:20:29 STEP 1590 H= 397:30 +CPU= 46.666
  23:21:13 STEP 1591 H= 397:45 +CPU= 43.942
  23:22:02 STEP 1592 H= 398:00 +CPU= 49.230
  23:22:46 STEP 1593 H= 398:15 +CPU= 43.795
  23:23:24 STEP 1594 H= 398:30 +CPU= 38.212
  23:24:07 STEP 1595 H= 398:45 +CPU= 42.782
  23:25:04 STEP 1596 H= 399:00 +CPU= 56.981
Moving to projects directory: /var/lib/boinc-client/slots/27/ICMGGh7zg+001596
Moving to projects directory: /var/lib/boinc-client/slots/27/ICMSHh7zg+001596
Moving to projects directory: /var/lib/boinc-client/slots/27/ICMUAh7zg+001596
  23:25:47 STEP 1597 H= 399:15 +CPU= 43.407
  23:26:29 STEP 1598 H= 399:30 +CPU= 42.215
  23:27:10 STEP 1599 H= 399:45 +CPU= 40.786
  23:27:56 STEP 1600 H= 400:00 +CPU= 46.270
  23:28:42 STEP 1601 H= 400:15 +CPU= 45.091
  23:29:33 STEP 1602 H= 400:30 +CPU= 51.396
  23:30:15 STEP 1603 H= 400:45 +CPU= 41.606
  23:30:57 STEP 1604 H= 401:00 +CPU= 42.378
  23:31:33 STEP 1605 H= 401:15 +CPU= 36.076
  23:32:14 STEP 1606 H= 401:30 +CPU= 40.605
  23:32:58 STEP 1607 H= 401:45 +CPU= 44.073
  23:33:50 STEP 1608 H= 402:00 +CPU= 51.877
Moving to projects directory: /var/lib/boinc-client/slots/27/ICMGGh7zg+001608
Moving to projects directory: /var/lib/boinc-client/slots/27/ICMSHh7zg+001608
Moving to projects directory: /var/lib/boinc-client/slots/27/ICMUAh7zg+001608
  23:34:28 STEP 1609 H= 402:15 +CPU= 38.237
  23:35:13 STEP 1610 H= 402:30 +CPU= 44.872
  23:35:54 STEP 1611 H= 402:45 +CPU= 40.974
  23:36:32 STEP 1612 H= 403:00 +CPU= 38.074
  23:37:24 STEP 1613 H= 403:15 +CPU= 52.110
  23:38:06 STEP 1614 H= 403:30 +CPU= 41.541
  23:38:51 STEP 1615 H= 403:45 +CPU= 45.574
  23:39:34 STEP 1616 H= 404:00 +CPU= 42.437
  23:40:11 STEP 1617 H= 404:15 +CPU= 37.587
  23:40:49 STEP 1618 H= 404:30 +CPU= 38.088
  23:41:40 STEP 1619 H= 404:45 +CPU= 50.908
  23:42:43 STEP 1620 H= 405:00 +CPU= 62.587
Moving to projects directory: /var/lib/boinc-client/slots/27/ICMGGh7zg+001620
Moving to projects directory: /var/lib/boinc-client/slots/27/ICMSHh7zg+001620
Moving to projects directory: /var/lib/boinc-client/slots/27/ICMUAh7zg+001620
  23:43:36 STEP 1621 H= 405:15 +CPU= 53.026
  23:44:13 STEP 1622 H= 405:30 +CPU= 37.408
  23:44:50 STEP 1623 H= 405:45 +CPU= 37.198
  23:45:33 STEP 1624 H= 406:00 +CPU= 42.110
  23:46:18 STEP 1625 H= 406:15 +CPU= 45.244
  23:47:05 STEP 1626 H= 406:30 +CPU= 46.914
  23:47:47 STEP 1627 H= 406:45 +CPU= 41.948
  23:48:27 STEP 1628 H= 407:00 +CPU= 39.846
  23:49:11 STEP 1629 H= 407:15 +CPU= 44.790
  23:49:52 STEP 1630 H= 407:30 +CPU= 40.735
  23:50:26 STEP 1631 H= 407:45 +CPU= 34.131
  23:51:29 STEP 1632 H= 408:00 +CPU= 62.171
Moving to projects directory: /var/lib/boinc-client/slots/27/ICMGGh7zg+001632
Moving to projects directory: /var/lib/boinc-client/slots/27/ICMSHh7zg+001632
Moving to projects directory: /var/lib/boinc-client/slots/27/ICMUAh7zg+001632
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290098/ICMGGh7zg+001536
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290098/ICMSHh7zg+001536
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290098/ICMUAh7zg+001536
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290098/ICMGGh7zg+001548
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290098/ICMSHh7zg+001548
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290098/ICMUAh7zg+001548
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290098/ICMGGh7zg+001560
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290098/ICMSHh7zg+001560
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290098/ICMUAh7zg+001560
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290098/ICMGGh7zg+001572
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290098/ICMSHh7zg+001572
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290098/ICMUAh7zg+001572
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290098/ICMGGh7zg+001584
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290098/ICMSHh7zg+001584
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290098/ICMUAh7zg+001584
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290098/ICMGGh7zg+001596
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290098/ICMSHh7zg+001596
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290098/ICMUAh7zg+001596
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290098/ICMGGh7zg+001608
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290098/ICMSHh7zg+001608
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290098/ICMUAh7zg+001608
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290098/ICMGGh7zg+001620
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290098/ICMSHh7zg+001620
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290098/ICMUAh7zg+001620
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a1d7_2016092300_20_1018_12290098_0_r110879949_16.zip
Uploading the intermediate file: upload_file_16.zip
  23:52:19 STEP 1633 H= 408:15 +CPU= 50.804
  23:53:01 STEP 1634 H= 408:30 +CPU= 41.613
  23:53:50 STEP 1635 H= 408:45 +CPU= 49.012
  23:54:44 STEP 1636 H= 409:00 +CPU= 53.651
  23:55:24 STEP 1637 H= 409:15 +CPU= 40.798
  23:56:17 STEP 1638 H= 409:30 +CPU= 52.033
  23:57:05 STEP 1639 H= 409:45 +CPU= 48.924
  23:57:53 STEP 1640 H= 410:00 +CPU= 47.827
  23:58:31 STEP 1641 H= 410:15 +CPU= 37.899
  23:59:12 STEP 1642 H= 410:30 +CPU= 40.531
  23:59:53 STEP 1643 H= 410:45 +CPU= 41.556
  00:00:40 STEP 1644 H= 411:00 +CPU= 46.641
Moving to projects directory: /var/lib/boinc-client/slots/27/ICMGGh7zg+001644
Moving to projects directory: /var/lib/boinc-client/slots/27/ICMSHh7zg+001644
Moving to projects directory: /var/lib/boinc-client/slots/27/ICMUAh7zg+001644
  00:01:28 STEP 1645 H= 411:15 +CPU= 47.775
  00:02:13 STEP 1646 H= 411:30 +CPU= 45.124
  00:02:49 STEP 1647 H= 411:45 +CPU= 36.228
  00:03:34 STEP 1648 H= 412:00 +CPU= 44.676
  00:04:16 STEP 1649 H= 412:15 +CPU= 41.801
  00:04:50 STEP 1650 H= 412:30 +CPU= 34.372
  00:05:29 STEP 1651 H= 412:45 +CPU= 39.159
  00:06:14 STEP 1652 H= 413:00 +CPU= 44.926
  00:06:56 STEP 1653 H= 413:15 +CPU= 42.162
  00:07:39 STEP 1654 H= 413:30 +CPU= 42.160
  00:08:24 STEP 1655 H= 413:45 +CPU= 45.016
  00:09:19 STEP 1656 H= 414:00 +CPU= 55.594
Moving to projects directory: /var/lib/boinc-client/slots/27/ICMGGh7zg+001656
Moving to projects directory: /var/lib/boinc-client/slots/27/ICMSHh7zg+001656
Moving to projects directory: /var/lib/boinc-client/slots/27/ICMUAh7zg+001656
  00:10:02 STEP 1657 H= 414:15 +CPU= 42.523
  00:10:42 STEP 1658 H= 414:30 +CPU= 40.685
  00:11:32 STEP 1659 H= 414:45 +CPU= 49.872
  00:12:15 STEP 1660 H= 415:00 +CPU= 42.489
  00:12:53 STEP 1661 H= 415:15 +CPU= 38.654
  00:13:29 STEP 1662 H= 415:30 +CPU= 35.873
  00:14:12 STEP 1663 H= 415:45 +CPU= 42.323
  00:14:54 STEP 1664 H= 416:00 +CPU= 42.282
  00:15:44 STEP 1665 H= 416:15 +CPU= 50.157
  00:16:30 STEP 1666 H= 416:30 +CPU= 45.849
  00:17:09 STEP 1667 H= 416:45 +CPU= 39.455
  00:18:12 STEP 1668 H= 417:00 +CPU= 62.154
Moving to projects directory: /var/lib/boinc-client/slots/27/ICMGGh7zg+001668
Moving to projects directory: /var/lib/boinc-client/slots/27/ICMSHh7zg+001668
Moving to projects directory: /var/lib/boinc-client/slots/27/ICMUAh7zg+001668
  00:18:48 STEP 1669 H= 417:15 +CPU= 36.369
  00:19:34 STEP 1670 H= 417:30 +CPU= 46.424
  00:20:26 STEP 1671 H= 417:45 +CPU= 51.514
  00:21:07 STEP 1672 H= 418:00 +CPU= 40.621
  00:21:45 STEP 1673 H= 418:15 +CPU= 38.749
  00:22:22 STEP 1674 H= 418:30 +CPU= 36.774
  00:23:06 STEP 1675 H= 418:45 +CPU= 44.055
  00:23:42 STEP 1676 H= 419:00 +CPU= 36.231
  00:24:15 STEP 1677 H= 419:15 +CPU= 32.846
  00:24:50 STEP 1678 H= 419:30 +CPU= 34.301
  00:25:39 STEP 1679 H= 419:45 +CPU= 48.974
  00:26:29 STEP 1680 H= 420:00 +CPU= 50.649
Moving to projects directory: /var/lib/boinc-client/slots/27/ICMGGh7zg+001680
Moving to projects directory: /var/lib/boinc-client/slots/27/ICMSHh7zg+001680
Moving to projects directory: /var/lib/boinc-client/slots/27/ICMUAh7zg+001680
  00:27:14 STEP 1681 H= 420:15 +CPU= 44.617
  00:27:52 STEP 1682 H= 420:30 +CPU= 37.717
  00:28:38 STEP 1683 H= 420:45 +CPU= 45.879
  00:29:12 STEP 1684 H= 421:00 +CPU= 34.218
  00:29:56 STEP 1685 H= 421:15 +CPU= 44.403
  00:30:40 STEP 1686 H= 421:30 +CPU= 44.003
  00:31:23 STEP 1687 H= 421:45 +CPU= 43.248
  00:32:12 STEP 1688 H= 422:00 +CPU= 48.356
  00:32:52 STEP 1689 H= 422:15 +CPU= 40.174
  00:33:37 STEP 1690 H= 422:30 +CPU= 44.539
  00:34:14 STEP 1691 H= 422:45 +CPU= 37.594
  00:35:07 STEP 1692 H= 423:00 +CPU= 52.682
Moving to projects directory: /var/lib/boinc-client/slots/27/ICMGGh7zg+001692
Moving to projects directory: /var/lib/boinc-client/slots/27/ICMSHh7zg+001692
Moving to projects directory: /var/lib/boinc-client/slots/27/ICMUAh7zg+001692
  00:35:55 STEP 1693 H= 423:15 +CPU= 47.745
  00:36:34 STEP 1694 H= 423:30 +CPU= 39.287
  00:37:22 STEP 1695 H= 423:45 +CPU= 47.933
  00:37:58 STEP 1696 H= 424:00 +CPU= 36.142
  00:38:36 STEP 1697 H= 424:15 +CPU= 37.566
  00:39:25 STEP 1698 H= 424:30 +CPU= 49.440
  00:40:06 STEP 1699 H= 424:45 +CPU= 40.491
  00:40:47 STEP 1700 H= 425:00 +CPU= 41.480
  00:41:26 STEP 1701 H= 425:15 +CPU= 39.044
  00:42:11 STEP 1702 H= 425:30 +CPU= 45.006
  00:42:50 STEP 1703 H= 425:45 +CPU= 39.280
  00:43:43 STEP 1704 H= 426:00 +CPU= 52.161
Moving to projects directory: /var/lib/boinc-client/slots/27/ICMGGh7zg+001704
Moving to projects directory: /var/lib/boinc-client/slots/27/ICMSHh7zg+001704
Moving to projects directory: /var/lib/boinc-client/slots/27/ICMUAh7zg+001704
  00:44:28 STEP 1705 H= 426:15 +CPU= 45.722
  00:45:08 STEP 1706 H= 426:30 +CPU= 39.294
  00:45:47 STEP 1707 H= 426:45 +CPU= 39.516
  00:46:29 STEP 1708 H= 427:00 +CPU= 42.228
  00:47:17 STEP 1709 H= 427:15 +CPU= 47.400
  00:48:08 STEP 1710 H= 427:30 +CPU= 50.907
  00:48:49 STEP 1711 H= 427:45 +CPU= 41.633
  00:49:30 STEP 1712 H= 428:00 +CPU= 41.012
  00:50:17 STEP 1713 H= 428:15 +CPU= 46.462
  00:51:03 STEP 1714 H= 428:30 +CPU= 46.448
  00:51:40 STEP 1715 H= 428:45 +CPU= 36.845
  00:52:41 STEP 1716 H= 429:00 +CPU= 60.658
Moving to projects directory: /var/lib/boinc-client/slots/27/ICMGGh7zg+001716
Moving to projects directory: /var/lib/boinc-client/slots/27/ICMSHh7zg+001716
Moving to projects directory: /var/lib/boinc-client/slots/27/ICMUAh7zg+001716
  00:53:34 STEP 1717 H= 429:15 +CPU= 52.869
  00:54:13 STEP 1718 H= 429:30 +CPU= 38.882
  00:54:59 STEP 1719 H= 429:45 +CPU= 46.733
  00:55:44 STEP 1720 H= 430:00 +CPU= 44.349
  00:56:28 STEP 1721 H= 430:15 +CPU= 44.591
  00:57:15 STEP 1722 H= 430:30 +CPU= 46.271
  00:57:58 STEP 1723 H= 430:45 +CPU= 43.769
  00:58:45 STEP 1724 H= 431:00 +CPU= 46.959
  00:59:20 STEP 1725 H= 431:15 +CPU= 34.125
  00:59:53 STEP 1726 H= 431:30 +CPU= 33.926
  01:00:43 STEP 1727 H= 431:45 +CPU= 49.076
  01:01:38 STEP 1728 H= 432:00 +CPU= 55.506
Moving to projects directory: /var/lib/boinc-client/slots/27/ICMGGh7zg+001728
Moving to projects directory: /var/lib/boinc-client/slots/27/ICMSHh7zg+001728
Moving to projects directory: /var/lib/boinc-client/slots/27/ICMUAh7zg+001728
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290098/ICMGGh7zg+001632
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290098/ICMSHh7zg+001632
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290098/ICMUAh7zg+001632
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290098/ICMGGh7zg+001644
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290098/ICMSHh7zg+001644
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290098/ICMUAh7zg+001644
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290098/ICMGGh7zg+001656
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290098/ICMSHh7zg+001656
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290098/ICMUAh7zg+001656
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290098/ICMGGh7zg+001668
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290098/ICMSHh7zg+001668
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290098/ICMUAh7zg+001668
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290098/ICMGGh7zg+001680
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290098/ICMSHh7zg+001680
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290098/ICMUAh7zg+001680
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290098/ICMGGh7zg+001692
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290098/ICMSHh7zg+001692
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290098/ICMUAh7zg+001692
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290098/ICMGGh7zg+001704
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290098/ICMSHh7zg+001704
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290098/ICMUAh7zg+001704
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290098/ICMGGh7zg+001716
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290098/ICMSHh7zg+001716
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290098/ICMUAh7zg+001716
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a1d7_2016092300_20_1018_12290098_0_r110879949_17.zip
Uploading the intermediate file: upload_file_17.zip
  01:02:25 STEP 1729 H= 432:15 +CPU= 47.255
  01:03:11 STEP 1730 H= 432:30 +CPU= 45.855
  01:03:55 STEP 1731 H= 432:45 +CPU= 43.390
  01:04:34 STEP 1732 H= 433:00 +CPU= 39.353
  01:05:15 STEP 1733 H= 433:15 +CPU= 40.477
  01:06:00 STEP 1734 H= 433:30 +CPU= 45.344
  01:06:45 STEP 1735 H= 433:45 +CPU= 44.836
  01:07:22 STEP 1736 H= 434:00 +CPU= 37.247
  01:08:04 STEP 1737 H= 434:15 +CPU= 41.685
  01:08:44 STEP 1738 H= 434:30 +CPU= 40.241
  01:09:25 STEP 1739 H= 434:45 +CPU= 40.674
  01:10:15 STEP 1740 H= 435:00 +CPU= 50.495
Moving to projects directory: /var/lib/boinc-client/slots/27/ICMGGh7zg+001740
Moving to projects directory: /var/lib/boinc-client/slots/27/ICMSHh7zg+001740
Moving to projects directory: /var/lib/boinc-client/slots/27/ICMUAh7zg+001740
  01:10:50 STEP 1741 H= 435:15 +CPU= 34.778
  01:11:32 STEP 1742 H= 435:30 +CPU= 41.738
  01:12:14 STEP 1743 H= 435:45 +CPU= 42.182
  01:12:59 STEP 1744 H= 436:00 +CPU= 45.310
  01:13:46 STEP 1745 H= 436:15 +CPU= 46.866
  01:14:29 STEP 1746 H= 436:30 +CPU= 43.151
  01:15:04 STEP 1747 H= 436:45 +CPU= 34.814
  01:15:50 STEP 1748 H= 437:00 +CPU= 45.607
  01:16:34 STEP 1749 H= 437:15 +CPU= 44.186
  01:17:19 STEP 1750 H= 437:30 +CPU= 45.217
  01:18:00 STEP 1751 H= 437:45 +CPU= 40.973
  01:18:41 STEP 1752 H= 438:00 +CPU= 41.058
Moving to projects directory: /var/lib/boinc-client/slots/27/ICMGGh7zg+001752
Moving to projects directory: /var/lib/boinc-client/slots/27/ICMSHh7zg+001752
Moving to projects directory: /var/lib/boinc-client/slots/27/ICMUAh7zg+001752
  01:19:35 STEP 1753 H= 438:15 +CPU= 54.265
  01:20:17 STEP 1754 H= 438:30 +CPU= 41.537
  01:21:05 STEP 1755 H= 438:45 +CPU= 48.192
  01:21:51 STEP 1756 H= 439:00 +CPU= 46.168
  01:22:41 STEP 1757 H= 439:15 +CPU= 49.329
  01:23:25 STEP 1758 H= 439:30 +CPU= 44.426
  01:24:00 STEP 1759 H= 439:45 +CPU= 34.983
  01:24:38 STEP 1760 H= 440:00 +CPU= 37.923
  01:25:24 STEP 1761 H= 440:15 +CPU= 45.679
  01:26:09 STEP 1762 H= 440:30 +CPU= 44.995
  01:26:47 STEP 1763 H= 440:45 +CPU= 38.224
  01:27:47 STEP 1764 H= 441:00 +CPU= 60.291
Moving to projects directory: /var/lib/boinc-client/slots/27/ICMGGh7zg+001764
Moving to projects directory: /var/lib/boinc-client/slots/27/ICMSHh7zg+001764
Moving to projects directory: /var/lib/boinc-client/slots/27/ICMUAh7zg+001764
  01:28:30 STEP 1765 H= 441:15 +CPU= 42.433
  01:29:17 STEP 1766 H= 441:30 +CPU= 47.345
  01:30:05 STEP 1767 H= 441:45 +CPU= 48.009
  01:30:44 STEP 1768 H= 442:00 +CPU= 38.963
  01:31:35 STEP 1769 H= 442:15 +CPU= 50.355
  01:32:13 STEP 1770 H= 442:30 +CPU= 38.887
  01:33:07 STEP 1771 H= 442:45 +CPU= 53.311
  01:33:44 STEP 1772 H= 443:00 +CPU= 36.788
  01:34:22 STEP 1773 H= 443:15 +CPU= 38.881
  01:35:14 STEP 1774 H= 443:30 +CPU= 51.611
  01:35:54 STEP 1775 H= 443:45 +CPU= 39.956
  01:36:46 STEP 1776 H= 444:00 +CPU= 51.525
Moving to projects directory: /var/lib/boinc-client/slots/27/ICMGGh7zg+001776
Moving to projects directory: /var/lib/boinc-client/slots/27/ICMSHh7zg+001776
Moving to projects directory: /var/lib/boinc-client/slots/27/ICMUAh7zg+001776
  01:37:25 STEP 1777 H= 444:15 +CPU= 39.664
  01:38:11 STEP 1778 H= 444:30 +CPU= 45.995
  01:38:54 STEP 1779 H= 444:45 +CPU= 42.830
  01:39:30 STEP 1780 H= 445:00 +CPU= 35.405
  01:40:15 STEP 1781 H= 445:15 +CPU= 45.779
  01:40:58 STEP 1782 H= 445:30 +CPU= 43.147
  01:41:39 STEP 1783 H= 445:45 +CPU= 40.267
  01:42:17 STEP 1784 H= 446:00 +CPU= 38.624
  01:43:03 STEP 1785 H= 446:15 +CPU= 45.364
  01:43:49 STEP 1786 H= 446:30 +CPU= 45.690
  01:44:41 STEP 1787 H= 446:45 +CPU= 52.825
  01:45:34 STEP 1788 H= 447:00 +CPU= 52.266
Moving to projects directory: /var/lib/boinc-client/slots/27/ICMGGh7zg+001788
Moving to projects directory: /var/lib/boinc-client/slots/27/ICMSHh7zg+001788
Moving to projects directory: /var/lib/boinc-client/slots/27/ICMUAh7zg+001788
  01:46:20 STEP 1789 H= 447:15 +CPU= 46.525
  01:47:01 STEP 1790 H= 447:30 +CPU= 40.616
  01:47:45 STEP 1791 H= 447:45 +CPU= 43.923
  01:48:35 STEP 1792 H= 448:00 +CPU= 50.658
  01:49:25 STEP 1793 H= 448:15 +CPU= 49.227
  01:50:03 STEP 1794 H= 448:30 +CPU= 38.346
  01:50:48 STEP 1795 H= 448:45 +CPU= 44.602
  01:51:35 STEP 1796 H= 449:00 +CPU= 47.660
  01:52:12 STEP 1797 H= 449:15 +CPU= 36.445
  01:52:58 STEP 1798 H= 449:30 +CPU= 46.084
  01:53:37 STEP 1799 H= 449:45 +CPU= 38.810
  01:54:27 STEP 1800 H= 450:00 +CPU= 50.247
Moving to projects directory: /var/lib/boinc-client/slots/27/ICMGGh7zg+001800
Moving to projects directory: /var/lib/boinc-client/slots/27/ICMSHh7zg+001800
Moving to projects directory: /var/lib/boinc-client/slots/27/ICMUAh7zg+001800
  01:55:02 STEP 1801 H= 450:15 +CPU= 34.931
  01:55:41 STEP 1802 H= 450:30 +CPU= 39.538
  01:56:24 STEP 1803 H= 450:45 +CPU= 42.471
  01:57:14 STEP 1804 H= 451:00 +CPU= 50.091
  01:58:03 STEP 1805 H= 451:15 +CPU= 49.140
  01:58:51 STEP 1806 H= 451:30 +CPU= 47.355
  01:59:46 STEP 1807 H= 451:45 +CPU= 54.925
  02:00:31 STEP 1808 H= 452:00 +CPU= 45.813
  02:01:18 STEP 1809 H= 452:15 +CPU= 46.265
  02:01:53 STEP 1810 H= 452:30 +CPU= 35.600
  02:02:29 STEP 1811 H= 452:45 +CPU= 35.449
  02:03:17 STEP 1812 H= 453:00 +CPU= 48.738
Moving to projects directory: /var/lib/boinc-client/slots/27/ICMGGh7zg+001812
Moving to projects directory: /var/lib/boinc-client/slots/27/ICMSHh7zg+001812
Moving to projects directory: /var/lib/boinc-client/slots/27/ICMUAh7zg+001812
  02:03:52 STEP 1813 H= 453:15 +CPU= 35.021
  02:04:25 STEP 1814 H= 453:30 +CPU= 32.380
  02:05:04 STEP 1815 H= 453:45 +CPU= 38.934
  02:05:44 STEP 1816 H= 454:00 +CPU= 40.094
  02:06:35 STEP 1817 H= 454:15 +CPU= 50.771
  02:07:13 STEP 1818 H= 454:30 +CPU= 38.350
  02:07:52 STEP 1819 H= 454:45 +CPU= 38.577
  02:08:27 STEP 1820 H= 455:00 +CPU= 35.099
  02:09:01 STEP 1821 H= 455:15 +CPU= 34.311
  02:09:37 STEP 1822 H= 455:30 +CPU= 36.220
  02:10:14 STEP 1823 H= 455:45 +CPU= 36.677
  02:11:03 STEP 1824 H= 456:00 +CPU= 49.311
Moving to projects directory: /var/lib/boinc-client/slots/27/ICMGGh7zg+001824
Moving to projects directory: /var/lib/boinc-client/slots/27/ICMSHh7zg+001824
Moving to projects directory: /var/lib/boinc-client/slots/27/ICMUAh7zg+001824
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290098/ICMGGh7zg+001728
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290098/ICMSHh7zg+001728
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290098/ICMUAh7zg+001728
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290098/ICMGGh7zg+001740
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290098/ICMSHh7zg+001740
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290098/ICMUAh7zg+001740
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290098/ICMGGh7zg+001752
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290098/ICMSHh7zg+001752
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290098/ICMUAh7zg+001752
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290098/ICMGGh7zg+001764
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290098/ICMSHh7zg+001764
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290098/ICMUAh7zg+001764
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290098/ICMGGh7zg+001776
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290098/ICMSHh7zg+001776
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290098/ICMUAh7zg+001776
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290098/ICMGGh7zg+001788
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290098/ICMSHh7zg+001788
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290098/ICMUAh7zg+001788
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290098/ICMGGh7zg+001800
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290098/ICMSHh7zg+001800
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290098/ICMUAh7zg+001800
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290098/ICMGGh7zg+001812
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290098/ICMSHh7zg+001812
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290098/ICMUAh7zg+001812
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a1d7_2016092300_20_1018_12290098_0_r110879949_18.zip
Uploading the intermediate file: upload_file_18.zip
  02:11:43 STEP 1825 H= 456:15 +CPU= 40.105
  02:12:29 STEP 1826 H= 456:30 +CPU= 45.303
  02:13:16 STEP 1827 H= 456:45 +CPU= 47.202
  02:13:55 STEP 1828 H= 457:00 +CPU= 38.679
  02:14:41 STEP 1829 H= 457:15 +CPU= 46.172
  02:15:29 STEP 1830 H= 457:30 +CPU= 48.062
  02:16:12 STEP 1831 H= 457:45 +CPU= 42.975
  02:17:04 STEP 1832 H= 458:00 +CPU= 51.559
  02:17:44 STEP 1833 H= 458:15 +CPU= 40.621
  02:18:22 STEP 1834 H= 458:30 +CPU= 37.894
  02:19:09 STEP 1835 H= 458:45 +CPU= 46.846
  02:19:56 STEP 1836 H= 459:00 +CPU= 47.052
Moving to projects directory: /var/lib/boinc-client/slots/27/ICMGGh7zg+001836
Moving to projects directory: /var/lib/boinc-client/slots/27/ICMSHh7zg+001836
Moving to projects directory: /var/lib/boinc-client/slots/27/ICMUAh7zg+001836
  02:20:34 STEP 1837 H= 459:15 +CPU= 38.044
  02:21:12 STEP 1838 H= 459:30 +CPU= 37.479
  02:21:52 STEP 1839 H= 459:45 +CPU= 40.452
  02:22:30 STEP 1840 H= 460:00 +CPU= 38.230
  02:23:10 STEP 1841 H= 460:15 +CPU= 40.028
  02:23:59 STEP 1842 H= 460:30 +CPU= 48.563
  02:24:36 STEP 1843 H= 460:45 +CPU= 37.217
  02:25:17 STEP 1844 H= 461:00 +CPU= 41.225
  02:26:02 STEP 1845 H= 461:15 +CPU= 44.639
  02:26:47 STEP 1846 H= 461:30 +CPU= 45.215
  02:27:29 STEP 1847 H= 461:45 +CPU= 41.717
  02:28:24 STEP 1848 H= 462:00 +CPU= 55.292
Moving to projects directory: /var/lib/boinc-client/slots/27/ICMGGh7zg+001848
Moving to projects directory: /var/lib/boinc-client/slots/27/ICMSHh7zg+001848
Moving to projects directory: /var/lib/boinc-client/slots/27/ICMUAh7zg+001848
  02:29:13 STEP 1849 H= 462:15 +CPU= 48.971
  02:30:03 STEP 1850 H= 462:30 +CPU= 49.901
  02:30:52 STEP 1851 H= 462:45 +CPU= 48.393
  02:31:28 STEP 1852 H= 463:00 +CPU= 36.374
  02:32:13 STEP 1853 H= 463:15 +CPU= 44.735
  02:32:57 STEP 1854 H= 463:30 +CPU= 44.637
  02:33:46 STEP 1855 H= 463:45 +CPU= 49.010
  02:34:28 STEP 1856 H= 464:00 +CPU= 41.760
  02:35:13 STEP 1857 H= 464:15 +CPU= 44.797
  02:35:55 STEP 1858 H= 464:30 +CPU= 42.016
  02:36:37 STEP 1859 H= 464:45 +CPU= 41.982
  02:37:31 STEP 1860 H= 465:00 +CPU= 54.299
Moving to projects directory: /var/lib/boinc-client/slots/27/ICMGGh7zg+001860
Moving to projects directory: /var/lib/boinc-client/slots/27/ICMSHh7zg+001860
Moving to projects directory: /var/lib/boinc-client/slots/27/ICMUAh7zg+001860
  02:38:18 STEP 1861 H= 465:15 +CPU= 47.153
  02:39:03 STEP 1862 H= 465:30 +CPU= 44.563
  02:39:36 STEP 1863 H= 465:45 +CPU= 33.155
  02:40:10 STEP 1864 H= 466:00 +CPU= 34.082
  02:41:01 STEP 1865 H= 466:15 +CPU= 50.431
  02:41:40 STEP 1866 H= 466:30 +CPU= 38.960
  02:42:16 STEP 1867 H= 466:45 +CPU= 36.452
  02:42:58 STEP 1868 H= 467:00 +CPU= 42.072
  02:43:45 STEP 1869 H= 467:15 +CPU= 46.274
  02:44:36 STEP 1870 H= 467:30 +CPU= 51.763
  02:45:11 STEP 1871 H= 467:45 +CPU= 34.916
  02:46:06 STEP 1872 H= 468:00 +CPU= 54.448
Moving to projects directory: /var/lib/boinc-client/slots/27/ICMGGh7zg+001872
Moving to projects directory: /var/lib/boinc-client/slots/27/ICMSHh7zg+001872
Moving to projects directory: /var/lib/boinc-client/slots/27/ICMUAh7zg+001872
  02:46:50 STEP 1873 H= 468:15 +CPU= 44.703
  02:47:31 STEP 1874 H= 468:30 +CPU= 40.661
  02:48:06 STEP 1875 H= 468:45 +CPU= 34.637
  02:48:52 STEP 1876 H= 469:00 +CPU= 46.055
  02:49:29 STEP 1877 H= 469:15 +CPU= 37.215
  02:50:04 STEP 1878 H= 469:30 +CPU= 35.137
  02:50:47 STEP 1879 H= 469:45 +CPU= 42.644
  02:51:22 STEP 1880 H= 470:00 +CPU= 34.959
  02:52:09 STEP 1881 H= 470:15 +CPU= 46.827
  02:52:53 STEP 1882 H= 470:30 +CPU= 43.907
  02:53:32 STEP 1883 H= 470:45 +CPU= 39.629
  02:54:15 STEP 1884 H= 471:00 +CPU= 42.345
Moving to projects directory: /var/lib/boinc-client/slots/27/ICMGGh7zg+001884
Moving to projects directory: /var/lib/boinc-client/slots/27/ICMSHh7zg+001884
Moving to projects directory: /var/lib/boinc-client/slots/27/ICMUAh7zg+001884
  02:54:57 STEP 1885 H= 471:15 +CPU= 42.218
  02:55:48 STEP 1886 H= 471:30 +CPU= 50.841
  02:56:36 STEP 1887 H= 471:45 +CPU= 48.693
  02:57:27 STEP 1888 H= 472:00 +CPU= 50.590
  02:58:14 STEP 1889 H= 472:15 +CPU= 46.768
  02:58:48 STEP 1890 H= 472:30 +CPU= 34.603
  02:59:32 STEP 1891 H= 472:45 +CPU= 43.465
  03:00:10 STEP 1892 H= 473:00 +CPU= 38.005
  03:00:59 STEP 1893 H= 473:15 +CPU= 49.387
  03:01:53 STEP 1894 H= 473:30 +CPU= 53.295
  03:02:31 STEP 1895 H= 473:45 +CPU= 38.603
  03:03:19 STEP 1896 H= 474:00 +CPU= 48.039
Moving to projects directory: /var/lib/boinc-client/slots/27/ICMGGh7zg+001896
Moving to projects directory: /var/lib/boinc-client/slots/27/ICMSHh7zg+001896
Moving to projects directory: /var/lib/boinc-client/slots/27/ICMUAh7zg+001896
  03:04:00 STEP 1897 H= 474:15 +CPU= 40.785
  03:04:38 STEP 1898 H= 474:30 +CPU= 38.193
  03:05:20 STEP 1899 H= 474:45 +CPU= 41.774
  03:06:04 STEP 1900 H= 475:00 +CPU= 44.067
  03:06:50 STEP 1901 H= 475:15 +CPU= 45.473
  03:07:35 STEP 1902 H= 475:30 +CPU= 45.808
  03:08:19 STEP 1903 H= 475:45 +CPU= 43.456
  03:09:06 STEP 1904 H= 476:00 +CPU= 46.687
  03:09:52 STEP 1905 H= 476:15 +CPU= 46.415
  03:10:41 STEP 1906 H= 476:30 +CPU= 48.709
  03:11:20 STEP 1907 H= 476:45 +CPU= 39.647
  03:12:16 STEP 1908 H= 477:00 +CPU= 55.382
Moving to projects directory: /var/lib/boinc-client/slots/27/ICMGGh7zg+001908
Moving to projects directory: /var/lib/boinc-client/slots/27/ICMSHh7zg+001908
Moving to projects directory: /var/lib/boinc-client/slots/27/ICMUAh7zg+001908
  03:13:03 STEP 1909 H= 477:15 +CPU= 46.979
  03:13:47 STEP 1910 H= 477:30 +CPU= 44.511
  03:14:30 STEP 1911 H= 477:45 +CPU= 42.196
  03:15:21 STEP 1912 H= 478:00 +CPU= 51.774
  03:16:05 STEP 1913 H= 478:15 +CPU= 43.783
  03:16:47 STEP 1914 H= 478:30 +CPU= 42.218
  03:17:32 STEP 1915 H= 478:45 +CPU= 45.099
  03:18:21 STEP 1916 H= 479:00 +CPU= 48.711
  03:19:00 STEP 1917 H= 479:15 +CPU= 39.078
  03:19:41 STEP 1918 H= 479:30 +CPU= 40.504
  03:20:20 STEP 1919 H= 479:45 +CPU= 39.644
  03:21:02 STEP 1920 H= 480:00 +CPU= 41.636
..The child process terminated with status: 0
>>> Printing last 70 lines from file: NODE.001_01

 
DDH------------------------------------------------------------------------
I                                                                         I
I TIME =  480.000H DDH * Diagnostic Var.,     AREA                GLOBAL  I
I                                                                         I
I-------------------------------------------------------------------------I
I   VARIABLE   I      Initial value         I        Current value        I
I-------------------------------------------------------------------------I
I  OMEGA (P/S) I     -0.9896107611E-21      I       0.4579133989E-07      I
ICloud fractionI      0.0000000000E+00      I       0.5900955108E-02      I
I  Relat. Hum. I      0.4277555747E+00      I       0.4438559764E+00      I
I  PASS 01     I      0.0000000000E+00      I       0.1212706829E+02      I
DDH------------------------------------------------------------------------
  
  MAXGPFV : MAX. VALUE =   0.000000000000000E+000
  MAXGPFV : MAX. VALUE =   0.000000000000000E+000
 NSTEP =  1920 SCAN2M_HPOS  P
 IO-STREAM SETUP - IOTYPE =           2  NUMIOPROCS =           1  CPATH =
 ICMGGh7zg+001920 MODE=a
 IO-STREAM CLOSED - ICMGGh7zg+001920
 MPI-TASK:   1 -    296864820 BYTES IN      7 RECORDS TRANSFERRED IN    0.0011 SECONDS269877.1 Mbytes/s, TOTAL TIME=    0.0199( 5.5%)
 03:21:02 STEP 1920 H= 480:00 +CPU= 41.636
 END CNT3
 NSTEP =  1920 CNT0   000000000  30.650  30.650  30.660   1.000               0               0               0               0               0
IO-STREAM STATISTICS, TOTAL NO OF REC/BYTES READ           46/  1069125708 WRITTEN        17160/************
 -TASK-OPENED-OPEN-RECS IN -KBYTE IN    -RECS OUT-KBYTE OUT-WALL   -WALL IN-WALL
  OU-TOT IN -TOT OUT
   1    303    0       46      1044068    17160 ************    42.2     2.4    39.8     4.6    85.1
===-=== START OF TIMING STATISTICS ===-===
 
STATS FOR ALL TASKS
 NUM ROUTINE                                     CALLS  MEAN(ms)   MAX(ms)   FRAC(%)  UNBAL(%)
   0 CNT0     - COMPLETE EXECUTION                   1 ********* *********    100.00      0.00
   1 CNT4     - FORWARD INTEGRATION                  1 ********* *********     99.97      0.00
   8 SCAN2M - GRID-POINT DYNAMICS                  625    7563.6    7563.6     18.57      0.00
   9 SPCM     - SPECTRAL COMP.                     576    2397.6    2397.6      5.42      0.00
  10 SCAN2M - PHYSICS                              577   19041.9   19041.9     43.16      0.00
  11 IOPACK   - OUTPUT P.P. RESULTS                 48    1377.1    1377.1      0.26      0.00
  12 SPNORM   - SPECTRAL NORM COMP.                 25      80.3      80.3      0.01      0.00
  17 GRIDFPOS IN CNT4                               48      49.5      49.5      0.01      0.00
  27 RESTART FILES - WRITING                        12    5508.5    5508.5      0.26      0.00
  28 RESTART FILES - READING                         1    6721.0    6721.0      0.03      0.00
  29 SU4FPOS IN CNT4                                48       0.1       0.1      0.00      0.00
  30 DYNFPOS IN CNT4                                48    8293.3    8293.3      1.56      0.00
  31 POSDDH IN STEPO                                 3       1.4       1.4      0.00      0.00
  37 CPGLAG   - SL COMPUTATIONS                    577    8633.6    8633.6     19.57      0.00
  39 SU0YOMB                                         1     541.2     541.2      0.00      0.00
  51 SCAN2M   - SL COMM. PART 1                    577      38.2      38.2      0.09      0.00
  54 SPCM     - M TO S/S TO M TRANSP.              576    1145.0    1145.0      2.59      0.00
  55 SPCIMPF  - S TO M/M TO S TRANSP.              576     104.5     104.5      0.24      0.00
  56 SPNORM   - SPECTRAL NORM COMM.                 25       0.9       0.9      0.00      0.00
 102 LTINV_CTL   - INVERSE LEGENDRE TRANSFORM     1252     610.4     610.4      3.00      0.00
 103 LTDIR_CTL   - DIRECT LEGENDRE TRANSFORM      1200     313.9     313.9      1.48      0.00
 106 FTDIR_CTL   - DIRECT FOURIER TRANSFORM       1200     133.7     133.7      0.63      0.00
 107 FTINV_CTL   - INVERSE FOURIER TRANSFORM      1252     222.5     222.5      1.09      0.00
 140 SULEG       - COMP. OF LEGENDRE POL.            1      66.6      66.6      0.00      0.00
 152 LTINV_CTL   - M TO L TRANSPOSITION           1252     111.6     111.6      0.55      0.00
 153 LTDIR_CTL   - L TO M TRANSPOSITION           1200      74.7      74.7      0.35      0.00
 157 FTINV_CTL   - L TO G TRANSPOSITION           1252     194.6     194.6      0.96      0.00
 158 FTDIR_CTL   - G TO L TRANSPOSITION           1200      97.6      97.6      0.46      0.00
 400 GSTATS                                      67705       0.0       0.0      0.00      0.00
 401 GSTATS HOOK                                 62941       0.0       0.0      0.00      0.00
TOTAL MEASURED IMBALANCE =       0.0 SECONDS,  0.0 PERCENT
TOTAL WALLCLOCK TIME    25459.0 CPU TIME   25450.6 VECTOR TIME    25450.6


===-=== END   OF TIMING STATISTICS ===-===
FORECAST DAYS PER DAY       67.9
  *** END CNT0 *** 
------------------------------------------------
Moving to projects directory: /var/lib/boinc-client/slots/27/ICMGGh7zg+001920
Moving to projects directory: /var/lib/boinc-client/slots/27/ICMSHh7zg+001920
Moving to projects directory: /var/lib/boinc-client/slots/27/ICMUAh7zg+001920
Adding to the zip: /var/lib/boinc-client/slots/27/NODE.001_01
Adding to the zip: /var/lib/boinc-client/slots/27/ifs.stat
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290098/ICMUAh7zg+001872
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290098/ICMSHh7zg+001824
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290098/ICMSHh7zg+001872
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290098/ICMUAh7zg+001908
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290098/ICMSHh7zg+001860
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290098/ICMUAh7zg+001896
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290098/ICMGGh7zg+001896
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290098/ICMGGh7zg+001908
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290098/ICMGGh7zg+001848
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290098/ICMUAh7zg+001884
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290098/ICMUAh7zg+001836
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290098/ICMUAh7zg+001824
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290098/ICMGGh7zg+001836
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290098/ICMGGh7zg+001920
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290098/ICMSHh7zg+001884
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290098/ICMSHh7zg+001908
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290098/ICMGGh7zg+001884
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290098/ICMUAh7zg+001860
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290098/ICMGGh7zg+001872
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290098/ICMSHh7zg+001896
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290098/ICMSHh7zg+001848
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290098/ICMSHh7zg+001920
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290098/ICMSHh7zg+001836
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290098/ICMUAh7zg+001848
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290098/ICMGGh7zg+001824
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290098/ICMGGh7zg+001860
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290098/ICMUAh7zg+001920
Zipping up the final file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a1d7_2016092300_20_1018_12290098_0_r110879949_19.zip
Uploading the final file: upload_file_19.zip
Uploading trickle at timestep: 1727100
03:24:33 (869899): called boinc_finish(0)

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
17 Jun 2024 04:13:42 1532338 22443688 oifs_43r3_bl_a1d7_2016092300_20_1018_12290098_0 1,727,100 82,307 0.0477
15 Jun 2024 04:21:45 1532338 22443688 oifs_43r3_bl_a1d7_2016092300_20_1018_12290098_0 864,000 40,323 0.0467


©2024 cpdn.org