climateprediction.net home page
Task 22247449

Task 22247449

Name oifs_43r3_ps_2341_2021050100_123_947_12165430_0
Workunit 12165430
Created 29 Nov 2022, 13:43:21 UTC
Sent 29 Nov 2022, 19:47:43 UTC
Report deadline 29 Dec 2022, 19:47:43 UTC
Received 3 Dec 2022, 8:52:48 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 148 (0x00000094) Unknown error code
Computer ID 1526251
Run time 6 hours 39 min 17 sec
CPU time 6 hours 35 min 17 sec
Validate state Invalid
Credit 4,354.56
Device peak FLOPS 6.80 GFLOPS
Application version OpenIFS 43r3 Perturbed Surface v1.01
x86_64-pc-linux-gnu
Peak working set size 4,415.24 MB
Peak swap size 4,974.12 MB
Peak disk usage 1,211.06 MB
Stderr
<core_client_version>7.16.6</core_client_version>
<![CDATA[
<message>
process exited with code 148 (0x94, -108)</message>
<stderr_txt>
oinc-client/projects/climateprediction.net/oifs_43r3_ps_12165430/ICMGGhpi1+000348
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12165430/ICMSHhpi1+000348
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12165430/ICMUAhpi1+000348
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_2341_2021050100_123_947_12165430_0_r1843840361_14.zip
Uploading the intermediate file: upload_file_14.zip
  20:34:32 STEP  361 H= 361:00 +CPU= 18.887
Uploading trickle at timestep: 1296000
  20:34:52 STEP  362 H= 362:00 +CPU= 20.147
  20:35:21 STEP  363 H= 363:00 +CPU= 28.795
  20:35:40 STEP  364 H= 364:00 +CPU= 19.755
  20:36:00 STEP  365 H= 365:00 +CPU= 19.100
  20:36:30 STEP  366 H= 366:00 +CPU= 30.468
  20:36:49 STEP  367 H= 367:00 +CPU= 19.384
  20:37:09 STEP  368 H= 368:00 +CPU= 19.944
  20:37:40 STEP  369 H= 369:00 +CPU= 30.036
  20:37:59 STEP  370 H= 370:00 +CPU= 19.752
  20:38:17 STEP  371 H= 371:00 +CPU= 18.002
  20:38:49 STEP  372 H= 372:00 +CPU= 31.758
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGhpi1+000372
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHhpi1+000372
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAhpi1+000372
  20:39:08 STEP  373 H= 373:00 +CPU= 18.693
  20:39:27 STEP  374 H= 374:00 +CPU= 19.538
  20:39:56 STEP  375 H= 375:00 +CPU= 28.611
  20:40:15 STEP  376 H= 376:00 +CPU= 18.594
  20:40:33 STEP  377 H= 377:00 +CPU= 18.231
  20:41:02 STEP  378 H= 378:00 +CPU= 29.387
  20:41:23 STEP  379 H= 379:00 +CPU= 20.829
  20:41:45 STEP  380 H= 380:00 +CPU= 21.446
  20:42:16 STEP  381 H= 381:00 +CPU= 31.456
  20:42:37 STEP  382 H= 382:00 +CPU= 21.331
  20:42:59 STEP  383 H= 383:00 +CPU= 21.523
  20:43:37 STEP  384 H= 384:00 +CPU= 37.640
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGhpi1+000384
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHhpi1+000384
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAhpi1+000384
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12165430/ICMGGhpi1+000360
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12165430/ICMSHhpi1+000360
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12165430/ICMUAhpi1+000360
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12165430/ICMGGhpi1+000372
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12165430/ICMSHhpi1+000372
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12165430/ICMUAhpi1+000372
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_2341_2021050100_123_947_12165430_0_r1843840361_15.zip
Uploading the intermediate file: upload_file_15.zip
  20:43:57 STEP  385 H= 385:00 +CPU= 20.700
Uploading trickle at timestep: 1382400
  20:44:19 STEP  386 H= 386:00 +CPU= 21.262
  20:44:50 STEP  387 H= 387:00 +CPU= 31.589
  20:45:11 STEP  388 H= 388:00 +CPU= 21.005
  20:45:32 STEP  389 H= 389:00 +CPU= 20.553
  20:46:04 STEP  390 H= 390:00 +CPU= 32.371
  20:46:25 STEP  391 H= 391:00 +CPU= 20.715
  20:46:46 STEP  392 H= 392:00 +CPU= 21.378
  20:47:18 STEP  393 H= 393:00 +CPU= 31.458
  20:47:39 STEP  394 H= 394:00 +CPU= 21.183
  20:48:00 STEP  395 H= 395:00 +CPU= 20.666
  20:48:34 STEP  396 H= 396:00 +CPU= 34.474
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGhpi1+000396
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHhpi1+000396
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAhpi1+000396
  20:48:55 STEP  397 H= 397:00 +CPU= 21.196
  20:49:17 STEP  398 H= 398:00 +CPU= 21.442
  20:49:49 STEP  399 H= 399:00 +CPU= 31.547
  20:50:09 STEP  400 H= 400:00 +CPU= 20.864
  20:50:30 STEP  401 H= 401:00 +CPU= 20.919
  20:51:03 STEP  402 H= 402:00 +CPU= 32.200
  20:51:24 STEP  403 H= 403:00 +CPU= 20.933
  20:51:45 STEP  404 H= 404:00 +CPU= 21.178
  20:52:17 STEP  405 H= 405:00 +CPU= 32.040
  20:52:38 STEP  406 H= 406:00 +CPU= 21.106
  20:52:59 STEP  407 H= 407:00 +CPU= 21.158
  20:53:37 STEP  408 H= 408:00 +CPU= 37.251
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGhpi1+000408
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHhpi1+000408
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAhpi1+000408
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12165430/ICMGGhpi1+000384
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12165430/ICMSHhpi1+000384
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12165430/ICMUAhpi1+000384
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12165430/ICMGGhpi1+000396
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12165430/ICMSHhpi1+000396
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12165430/ICMUAhpi1+000396
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_2341_2021050100_123_947_12165430_0_r1843840361_16.zip
Uploading the intermediate file: upload_file_16.zip
  20:53:58 STEP  409 H= 409:00 +CPU= 21.138
Uploading trickle at timestep: 1468800
  20:54:19 STEP  410 H= 410:00 +CPU= 21.348
  20:54:51 STEP  411 H= 411:00 +CPU= 32.008
  20:55:12 STEP  412 H= 412:00 +CPU= 21.068
  20:55:33 STEP  413 H= 413:00 +CPU= 20.702
  20:56:06 STEP  414 H= 414:00 +CPU= 32.444
  20:56:27 STEP  415 H= 415:00 +CPU= 20.889
  20:56:48 STEP  416 H= 416:00 +CPU= 21.148
  20:57:19 STEP  417 H= 417:00 +CPU= 31.497
  20:57:41 STEP  418 H= 418:00 +CPU= 21.709
  20:58:03 STEP  419 H= 419:00 +CPU= 21.346
  20:58:39 STEP  420 H= 420:00 +CPU= 36.699
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGhpi1+000420
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHhpi1+000420
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAhpi1+000420
  20:58:53 STEP  421 H= 421:00 +CPU= 13.816
  20:59:11 STEP  422 H= 422:00 +CPU= 17.556
  20:59:48 STEP  423 H= 423:00 +CPU= 36.525
  21:00:14 STEP  424 H= 424:00 +CPU= 26.177
  21:00:39 STEP  425 H= 425:00 +CPU= 25.341
  21:01:18 STEP  426 H= 426:00 +CPU= 39.271
  21:01:41 STEP  427 H= 427:00 +CPU= 22.042
  21:02:05 STEP  428 H= 428:00 +CPU= 24.497
  21:02:44 STEP  429 H= 429:00 +CPU= 38.621
  21:03:03 STEP  430 H= 430:00 +CPU= 19.039
  21:03:27 STEP  431 H= 431:00 +CPU= 23.997
  21:04:12 STEP  432 H= 432:00 +CPU= 45.209
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGhpi1+000432
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHhpi1+000432
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAhpi1+000432
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12165430/ICMGGhpi1+000408
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12165430/ICMSHhpi1+000408
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12165430/ICMUAhpi1+000408
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12165430/ICMGGhpi1+000420
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12165430/ICMSHhpi1+000420
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12165430/ICMUAhpi1+000420
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_2341_2021050100_123_947_12165430_0_r1843840361_17.zip
Uploading the intermediate file: upload_file_17.zip
Uploading trickle at timestep: 1555200
  21:04:37 STEP  433 H= 433:00 +CPU= 24.826
  21:05:03 STEP  434 H= 434:00 +CPU= 26.171
  21:05:38 STEP  435 H= 435:00 +CPU= 35.079
  21:06:00 STEP  436 H= 436:00 +CPU= 21.581
  21:06:21 STEP  437 H= 437:00 +CPU= 20.485
  21:06:52 STEP  438 H= 438:00 +CPU= 31.242
  21:07:04 STEP  439 H= 439:00 +CPU= 11.924
  21:07:18 STEP  440 H= 440:00 +CPU= 14.637
  21:07:43 STEP  441 H= 441:00 +CPU= 24.628
  21:08:00 STEP  442 H= 442:00 +CPU= 17.358
  21:08:18 STEP  443 H= 443:00 +CPU= 17.683
  21:08:47 STEP  444 H= 444:00 +CPU= 28.772
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGhpi1+000444
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHhpi1+000444
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAhpi1+000444
  21:09:04 STEP  445 H= 445:00 +CPU= 17.009
  21:09:22 STEP  446 H= 446:00 +CPU= 17.798
  21:09:48 STEP  447 H= 447:00 +CPU= 26.024
  21:10:05 STEP  448 H= 448:00 +CPU= 17.330
  21:10:22 STEP  449 H= 449:00 +CPU= 17.043
  21:10:50 STEP  450 H= 450:00 +CPU= 27.841
  21:11:09 STEP  451 H= 451:00 +CPU= 19.004
  21:11:28 STEP  452 H= 452:00 +CPU= 19.196
  21:11:56 STEP  453 H= 453:00 +CPU= 27.361
  21:12:14 STEP  454 H= 454:00 +CPU= 18.402
  21:12:32 STEP  455 H= 455:00 +CPU= 17.689
  21:13:02 STEP  456 H= 456:00 +CPU= 30.550
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGhpi1+000456
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHhpi1+000456
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAhpi1+000456
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12165430/ICMGGhpi1+000432
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12165430/ICMSHhpi1+000432
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12165430/ICMUAhpi1+000432
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12165430/ICMGGhpi1+000444
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12165430/ICMSHhpi1+000444
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12165430/ICMUAhpi1+000444
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_2341_2021050100_123_947_12165430_0_r1843840361_18.zip
Uploading the intermediate file: upload_file_18.zip
  21:13:18 STEP  457 H= 457:00 +CPU= 15.666
Uploading trickle at timestep: 1641600
  21:13:35 STEP  458 H= 458:00 +CPU= 16.952
  21:14:00 STEP  459 H= 459:00 +CPU= 25.232
  21:14:17 STEP  460 H= 460:00 +CPU= 16.547
  21:14:33 STEP  461 H= 461:00 +CPU= 16.477
  21:15:00 STEP  462 H= 462:00 +CPU= 26.374
  21:15:16 STEP  463 H= 463:00 +CPU= 16.072
  21:15:32 STEP  464 H= 464:00 +CPU= 16.441
  21:15:58 STEP  465 H= 465:00 +CPU= 25.939
  21:16:15 STEP  466 H= 466:00 +CPU= 16.679
  21:16:32 STEP  467 H= 467:00 +CPU= 16.772
  21:17:03 STEP  468 H= 468:00 +CPU= 31.233
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGhpi1+000468
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHhpi1+000468
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAhpi1+000468
  21:17:22 STEP  469 H= 469:00 +CPU= 18.185
  21:17:39 STEP  470 H= 470:00 +CPU= 17.524
  21:18:04 STEP  471 H= 471:00 +CPU= 24.831
  21:18:20 STEP  472 H= 472:00 +CPU= 16.485
  21:18:37 STEP  473 H= 473:00 +CPU= 16.616
  21:19:02 STEP  474 H= 474:00 +CPU= 25.032
  21:19:19 STEP  475 H= 475:00 +CPU= 16.771
  21:19:35 STEP  476 H= 476:00 +CPU= 16.528
  21:20:02 STEP  477 H= 477:00 +CPU= 26.577
  21:20:19 STEP  478 H= 478:00 +CPU= 17.081
  21:20:41 STEP  479 H= 479:00 +CPU= 22.074
  21:21:23 STEP  480 H= 480:00 +CPU= 41.366
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGhpi1+000480
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHhpi1+000480
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAhpi1+000480
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12165430/ICMGGhpi1+000456
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12165430/ICMSHhpi1+000456
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12165430/ICMUAhpi1+000456
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12165430/ICMGGhpi1+000468
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12165430/ICMSHhpi1+000468
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12165430/ICMUAhpi1+000468
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_2341_2021050100_123_947_12165430_0_r1843840361_19.zip
Uploading the intermediate file: upload_file_19.zip
  21:21:46 STEP  481 H= 481:00 +CPU= 23.467
Uploading trickle at timestep: 1728000
  21:22:10 STEP  482 H= 482:00 +CPU= 24.161
  21:22:47 STEP  483 H= 483:00 +CPU= 36.265
  21:23:11 STEP  484 H= 484:00 +CPU= 23.823
  21:23:34 STEP  485 H= 485:00 +CPU= 23.727
  21:24:09 STEP  486 H= 486:00 +CPU= 34.801
  21:24:31 STEP  487 H= 487:00 +CPU= 21.822
  21:24:53 STEP  488 H= 488:00 +CPU= 22.287
  21:25:28 STEP  489 H= 489:00 +CPU= 34.241
  21:25:51 STEP  490 H= 490:00 +CPU= 23.422
  21:26:14 STEP  491 H= 491:00 +CPU= 22.389
  21:26:50 STEP  492 H= 492:00 +CPU= 36.445
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGhpi1+000492
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHhpi1+000492
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAhpi1+000492
  21:27:12 STEP  493 H= 493:00 +CPU= 22.197
  21:27:35 STEP  494 H= 494:00 +CPU= 22.520
  21:28:08 STEP  495 H= 495:00 +CPU= 33.319
  21:28:31 STEP  496 H= 496:00 +CPU= 23.271
  21:28:54 STEP  497 H= 497:00 +CPU= 22.382
  21:29:28 STEP  498 H= 498:00 +CPU= 33.983
  21:29:51 STEP  499 H= 499:00 +CPU= 22.735
  21:30:13 STEP  500 H= 500:00 +CPU= 22.839
  21:30:47 STEP  501 H= 501:00 +CPU= 33.579
  21:31:10 STEP  502 H= 502:00 +CPU= 22.718
  21:31:33 STEP  503 H= 503:00 +CPU= 23.133
  21:32:13 STEP  504 H= 504:00 +CPU= 39.930
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGhpi1+000504
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHhpi1+000504
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAhpi1+000504
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12165430/ICMGGhpi1+000480
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12165430/ICMSHhpi1+000480
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12165430/ICMUAhpi1+000480
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12165430/ICMGGhpi1+000492
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12165430/ICMSHhpi1+000492
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12165430/ICMUAhpi1+000492
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_2341_2021050100_123_947_12165430_0_r1843840361_20.zip
Uploading the intermediate file: upload_file_20.zip
  21:32:36 STEP  505 H= 505:00 +CPU= 22.614
Uploading trickle at timestep: 1814400
  21:32:58 STEP  506 H= 506:00 +CPU= 22.793
  21:33:32 STEP  507 H= 507:00 +CPU= 33.592
  21:33:55 STEP  508 H= 508:00 +CPU= 22.974
  21:34:19 STEP  509 H= 509:00 +CPU= 23.854
  21:34:54 STEP  510 H= 510:00 +CPU= 34.560
  21:35:16 STEP  511 H= 511:00 +CPU= 22.757
  21:35:39 STEP  512 H= 512:00 +CPU= 22.524
  21:36:12 STEP  513 H= 513:00 +CPU= 33.474
  21:36:35 STEP  514 H= 514:00 +CPU= 22.985
  21:36:57 STEP  515 H= 515:00 +CPU= 21.826
  21:37:35 STEP  516 H= 516:00 +CPU= 37.274
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGhpi1+000516
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHhpi1+000516
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAhpi1+000516
  21:37:58 STEP  517 H= 517:00 +CPU= 22.983
  21:38:22 STEP  518 H= 518:00 +CPU= 24.243
  21:38:59 STEP  519 H= 519:00 +CPU= 36.551
  21:39:23 STEP  520 H= 520:00 +CPU= 23.877
  21:39:46 STEP  521 H= 521:00 +CPU= 23.068
  21:40:20 STEP  522 H= 522:00 +CPU= 34.614
  21:40:43 STEP  523 H= 523:00 +CPU= 22.137
  21:41:05 STEP  524 H= 524:00 +CPU= 22.819
  21:41:39 STEP  525 H= 525:00 +CPU= 33.641
  21:42:01 STEP  526 H= 526:00 +CPU= 22.323
  21:42:25 STEP  527 H= 527:00 +CPU= 23.415
  21:43:06 STEP  528 H= 528:00 +CPU= 40.557
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGhpi1+000528
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHhpi1+000528
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAhpi1+000528
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12165430/ICMGGhpi1+000504
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12165430/ICMSHhpi1+000504
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12165430/ICMUAhpi1+000504
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12165430/ICMGGhpi1+000516
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12165430/ICMSHhpi1+000516
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12165430/ICMUAhpi1+000516
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_2341_2021050100_123_947_12165430_0_r1843840361_21.zip
Uploading the intermediate file: upload_file_21.zip
  21:43:29 STEP  529 H= 529:00 +CPU= 22.803
Uploading trickle at timestep: 1900800
  21:43:52 STEP  530 H= 530:00 +CPU= 22.945
  21:44:25 STEP  531 H= 531:00 +CPU= 33.369
  21:44:47 STEP  532 H= 532:00 +CPU= 22.363
  21:45:09 STEP  533 H= 533:00 +CPU= 21.504
  21:45:42 STEP  534 H= 534:00 +CPU= 33.548
  21:46:04 STEP  535 H= 535:00 +CPU= 21.875
  21:46:27 STEP  536 H= 536:00 +CPU= 22.720
  21:47:01 STEP  537 H= 537:00 +CPU= 33.541
  21:47:24 STEP  538 H= 538:00 +CPU= 22.866
  21:47:47 STEP  539 H= 539:00 +CPU= 23.524
  21:48:25 STEP  540 H= 540:00 +CPU= 38.097
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGhpi1+000540
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHhpi1+000540
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAhpi1+000540
  21:48:48 STEP  541 H= 541:00 +CPU= 22.292
  21:49:11 STEP  542 H= 542:00 +CPU= 23.281
  21:49:46 STEP  543 H= 543:00 +CPU= 34.707
  21:50:08 STEP  544 H= 544:00 +CPU= 22.359
  21:50:32 STEP  545 H= 545:00 +CPU= 23.654
  21:51:06 STEP  546 H= 546:00 +CPU= 34.255
  21:51:29 STEP  547 H= 547:00 +CPU= 22.488
  21:51:52 STEP  548 H= 548:00 +CPU= 23.610
  21:52:25 STEP  549 H= 549:00 +CPU= 33.038
  21:52:49 STEP  550 H= 550:00 +CPU= 23.653
  21:53:12 STEP  551 H= 551:00 +CPU= 23.347
  21:53:52 STEP  552 H= 552:00 +CPU= 39.696
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGhpi1+000552
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHhpi1+000552
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAhpi1+000552
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12165430/ICMGGhpi1+000528
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12165430/ICMSHhpi1+000528
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12165430/ICMUAhpi1+000528
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12165430/ICMGGhpi1+000540
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12165430/ICMSHhpi1+000540
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12165430/ICMUAhpi1+000540
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_2341_2021050100_123_947_12165430_0_r1843840361_22.zip
Uploading the intermediate file: upload_file_22.zip
  21:54:14 STEP  553 H= 553:00 +CPU= 22.108
Uploading trickle at timestep: 1987200
  21:54:37 STEP  554 H= 554:00 +CPU= 22.680
  21:55:11 STEP  555 H= 555:00 +CPU= 34.154
  21:55:35 STEP  556 H= 556:00 +CPU= 23.668
  21:55:58 STEP  557 H= 557:00 +CPU= 22.941
  21:56:32 STEP  558 H= 558:00 +CPU= 33.947
  21:56:54 STEP  559 H= 559:00 +CPU= 22.081
  21:57:17 STEP  560 H= 560:00 +CPU= 23.093
  21:57:51 STEP  561 H= 561:00 +CPU= 33.263
  21:58:15 STEP  562 H= 562:00 +CPU= 24.127
  21:58:38 STEP  563 H= 563:00 +CPU= 22.603
  21:59:14 STEP  564 H= 564:00 +CPU= 36.670
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGhpi1+000564
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHhpi1+000564
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAhpi1+000564
  21:59:37 STEP  565 H= 565:00 +CPU= 22.870
  22:00:00 STEP  566 H= 566:00 +CPU= 22.874
  22:00:33 STEP  567 H= 567:00 +CPU= 33.020
  22:00:56 STEP  568 H= 568:00 +CPU= 22.496
  22:01:18 STEP  569 H= 569:00 +CPU= 22.409
  22:01:52 STEP  570 H= 570:00 +CPU= 33.890
  22:02:11 STEP  571 H= 571:00 +CPU= 18.529
  22:02:23 STEP  572 H= 572:00 +CPU= 12.236
  22:02:52 STEP  573 H= 573:00 +CPU= 29.038
  22:03:15 STEP  574 H= 574:00 +CPU= 22.513
  22:03:37 STEP  575 H= 575:00 +CPU= 22.887
  22:04:18 STEP  576 H= 576:00 +CPU= 40.166
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGhpi1+000576
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHhpi1+000576
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAhpi1+000576
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12165430/ICMGGhpi1+000552
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12165430/ICMSHhpi1+000552
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12165430/ICMUAhpi1+000552
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12165430/ICMGGhpi1+000564
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12165430/ICMSHhpi1+000564
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12165430/ICMUAhpi1+000564
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_2341_2021050100_123_947_12165430_0_r1843840361_23.zip
Uploading the intermediate file: upload_file_23.zip
  22:04:41 STEP  577 H= 577:00 +CPU= 23.244
Uploading trickle at timestep: 2073600
  22:05:04 STEP  578 H= 578:00 +CPU= 23.332
  22:05:38 STEP  579 H= 579:00 +CPU= 33.596
  22:06:01 STEP  580 H= 580:00 +CPU= 22.711
  22:06:23 STEP  581 H= 581:00 +CPU= 22.501
  22:06:57 STEP  582 H= 582:00 +CPU= 34.075
  22:07:20 STEP  583 H= 583:00 +CPU= 22.883
  22:07:43 STEP  584 H= 584:00 +CPU= 22.859
  22:08:16 STEP  585 H= 585:00 +CPU= 33.203
  22:08:39 STEP  586 H= 586:00 +CPU= 22.370
  22:09:01 STEP  587 H= 587:00 +CPU= 22.238
  22:09:38 STEP  588 H= 588:00 +CPU= 37.196
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGhpi1+000588
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHhpi1+000588
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAhpi1+000588
  22:10:00 STEP  589 H= 589:00 +CPU= 21.977
  22:10:23 STEP  590 H= 590:00 +CPU= 22.735
  22:10:57 STEP  591 H= 591:00 +CPU= 33.354
  22:11:19 STEP  592 H= 592:00 +CPU= 22.818
  22:11:41 STEP  593 H= 593:00 +CPU= 21.771
  22:12:16 STEP  594 H= 594:00 +CPU= 35.035
  22:12:39 STEP  595 H= 595:00 +CPU= 22.764
  22:13:03 STEP  596 H= 596:00 +CPU= 24.193
  22:13:38 STEP  597 H= 597:00 +CPU= 34.461
  22:14:01 STEP  598 H= 598:00 +CPU= 23.058
  22:14:24 STEP  599 H= 599:00 +CPU= 23.123
  22:15:04 STEP  600 H= 600:00 +CPU= 39.873
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGhpi1+000600
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHhpi1+000600
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAhpi1+000600
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12165430/ICMGGhpi1+000576
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12165430/ICMSHhpi1+000576
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12165430/ICMUAhpi1+000576
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12165430/ICMGGhpi1+000588
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12165430/ICMSHhpi1+000588
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12165430/ICMUAhpi1+000588
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_2341_2021050100_123_947_12165430_0_r1843840361_24.zip
Uploading the intermediate file: upload_file_24.zip
  22:15:26 STEP  601 H= 601:00 +CPU= 22.073
Uploading trickle at timestep: 2160000
  22:15:49 STEP  602 H= 602:00 +CPU= 22.826
  22:16:23 STEP  603 H= 603:00 +CPU= 33.237
  22:16:45 STEP  604 H= 604:00 +CPU= 22.813
  22:17:07 STEP  605 H= 605:00 +CPU= 21.796
  22:17:42 STEP  606 H= 606:00 +CPU= 34.164
  22:18:05 STEP  607 H= 607:00 +CPU= 23.119
  22:18:28 STEP  608 H= 608:00 +CPU= 22.947
  22:19:02 STEP  609 H= 609:00 +CPU= 33.964
  22:19:26 STEP  610 H= 610:00 +CPU= 24.139
  22:19:48 STEP  611 H= 611:00 +CPU= 22.412
  22:20:27 STEP  612 H= 612:00 +CPU= 38.394
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGhpi1+000612
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHhpi1+000612
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAhpi1+000612
  22:20:49 STEP  613 H= 613:00 +CPU= 22.269
  22:21:12 STEP  614 H= 614:00 +CPU= 23.243
  22:21:49 STEP  615 H= 615:00 +CPU= 36.384
  22:22:12 STEP  616 H= 616:00 +CPU= 23.525
  22:22:35 STEP  617 H= 617:00 +CPU= 23.034
  22:23:11 STEP  618 H= 618:00 +CPU= 35.246
  22:23:34 STEP  619 H= 619:00 +CPU= 23.483
  22:23:59 STEP  620 H= 620:00 +CPU= 24.264
  22:24:35 STEP  621 H= 621:00 +CPU= 36.163
  22:24:59 STEP  622 H= 622:00 +CPU= 24.521
  22:25:24 STEP  623 H= 623:00 +CPU= 24.490
  22:26:05 STEP  624 H= 624:00 +CPU= 41.497
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGhpi1+000624
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHhpi1+000624
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAhpi1+000624
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12165430/ICMGGhpi1+000600
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12165430/ICMSHhpi1+000600
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12165430/ICMUAhpi1+000600
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12165430/ICMGGhpi1+000612
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12165430/ICMSHhpi1+000612
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12165430/ICMUAhpi1+000612
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_2341_2021050100_123_947_12165430_0_r1843840361_25.zip
Uploading the intermediate file: upload_file_25.zip
  22:26:29 STEP  625 H= 625:00 +CPU= 23.349
Uploading trickle at timestep: 2246400
  22:26:53 STEP  626 H= 626:00 +CPU= 24.459
  22:27:28 STEP  627 H= 627:00 +CPU= 35.053
  22:27:52 STEP  628 H= 628:00 +CPU= 23.988
  22:28:16 STEP  629 H= 629:00 +CPU= 23.510
  22:28:52 STEP  630 H= 630:00 +CPU= 35.963
  22:29:16 STEP  631 H= 631:00 +CPU= 23.675
  22:29:40 STEP  632 H= 632:00 +CPU= 24.185
  22:30:15 STEP  633 H= 633:00 +CPU= 35.193
  22:30:39 STEP  634 H= 634:00 +CPU= 23.866
  22:31:03 STEP  635 H= 635:00 +CPU= 23.731
  22:31:42 STEP  636 H= 636:00 +CPU= 39.002
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGhpi1+000636
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHhpi1+000636
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAhpi1+000636
  22:32:06 STEP  637 H= 637:00 +CPU= 23.657
  22:32:30 STEP  638 H= 638:00 +CPU= 24.143
  22:33:06 STEP  639 H= 639:00 +CPU= 35.649
  22:33:30 STEP  640 H= 640:00 +CPU= 23.923
  22:33:53 STEP  641 H= 641:00 +CPU= 23.496
  22:34:29 STEP  642 H= 642:00 +CPU= 35.853
  22:34:53 STEP  643 H= 643:00 +CPU= 23.942
  22:35:17 STEP  644 H= 644:00 +CPU= 24.004
  22:35:52 STEP  645 H= 645:00 +CPU= 34.833
  22:36:16 STEP  646 H= 646:00 +CPU= 24.107
  22:36:40 STEP  647 H= 647:00 +CPU= 24.405
  22:37:22 STEP  648 H= 648:00 +CPU= 41.393
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGhpi1+000648
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHhpi1+000648
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAhpi1+000648
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12165430/ICMGGhpi1+000624
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12165430/ICMSHhpi1+000624
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12165430/ICMUAhpi1+000624
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12165430/ICMGGhpi1+000636
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12165430/ICMSHhpi1+000636
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12165430/ICMUAhpi1+000636
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_2341_2021050100_123_947_12165430_0_r1843840361_26.zip
Uploading the intermediate file: upload_file_26.zip
  22:37:46 STEP  649 H= 649:00 +CPU= 23.599
Uploading trickle at timestep: 2332800
  22:38:10 STEP  650 H= 650:00 +CPU= 24.443
  22:38:46 STEP  651 H= 651:00 +CPU= 35.348
  22:39:10 STEP  652 H= 652:00 +CPU= 23.890
  22:39:33 STEP  653 H= 653:00 +CPU= 23.251
  22:40:10 STEP  654 H= 654:00 +CPU= 36.844
  22:40:34 STEP  655 H= 655:00 +CPU= 23.766
  22:40:58 STEP  656 H= 656:00 +CPU= 24.281
  22:41:34 STEP  657 H= 657:00 +CPU= 35.379
  22:41:58 STEP  658 H= 658:00 +CPU= 24.029
  22:42:21 STEP  659 H= 659:00 +CPU= 23.476
  22:43:00 STEP  660 H= 660:00 +CPU= 39.001
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGhpi1+000660
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHhpi1+000660
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAhpi1+000660
  22:43:24 STEP  661 H= 661:00 +CPU= 23.722
  22:43:48 STEP  662 H= 662:00 +CPU= 24.131
  22:44:24 STEP  663 H= 663:00 +CPU= 35.345
  22:44:48 STEP  664 H= 664:00 +CPU= 24.404
  22:45:11 STEP  665 H= 665:00 +CPU= 23.268
  22:45:47 STEP  666 H= 666:00 +CPU= 35.452
  22:46:10 STEP  667 H= 667:00 +CPU= 23.374
  22:46:34 STEP  668 H= 668:00 +CPU= 23.857
  22:47:10 STEP  669 H= 669:00 +CPU= 35.909
  22:47:34 STEP  670 H= 670:00 +CPU= 23.988
  22:47:59 STEP  671 H= 671:00 +CPU= 24.326
  22:48:41 STEP  672 H= 672:00 +CPU= 42.104
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGhpi1+000672
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHhpi1+000672
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAhpi1+000672
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12165430/ICMGGhpi1+000648
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12165430/ICMSHhpi1+000648
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12165430/ICMUAhpi1+000648
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12165430/ICMGGhpi1+000660
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12165430/ICMSHhpi1+000660
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12165430/ICMUAhpi1+000660
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_2341_2021050100_123_947_12165430_0_r1843840361_27.zip
Uploading the intermediate file: upload_file_27.zip
Uploading trickle at timestep: 2419200
  22:49:05 STEP  673 H= 673:00 +CPU= 23.665
  22:49:29 STEP  674 H= 674:00 +CPU= 24.245
  22:50:05 STEP  675 H= 675:00 +CPU= 35.400
  22:50:29 STEP  676 H= 676:00 +CPU= 24.032
  22:50:52 STEP  677 H= 677:00 +CPU= 23.044
  22:51:28 STEP  678 H= 678:00 +CPU= 35.513
  22:51:51 STEP  679 H= 679:00 +CPU= 23.654
  22:52:16 STEP  680 H= 680:00 +CPU= 24.521
  22:52:52 STEP  681 H= 681:00 +CPU= 36.415
  22:53:17 STEP  682 H= 682:00 +CPU= 24.848
  22:53:42 STEP  683 H= 683:00 +CPU= 24.371
  22:54:22 STEP  684 H= 684:00 +CPU= 40.222
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGhpi1+000684
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHhpi1+000684
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAhpi1+000684
  22:54:46 STEP  685 H= 685:00 +CPU= 24.323
  22:55:12 STEP  686 H= 686:00 +CPU= 25.648
  22:55:48 STEP  687 H= 687:00 +CPU= 35.886
  22:56:13 STEP  688 H= 688:00 +CPU= 25.107
  22:56:37 STEP  689 H= 689:00 +CPU= 24.463
  22:57:15 STEP  690 H= 690:00 +CPU= 37.069
  22:57:39 STEP  691 H= 691:00 +CPU= 24.547
  22:58:04 STEP  692 H= 692:00 +CPU= 24.873
  22:58:28 STEP  693 H= 693:00 +CPU= 23.632
  22:58:48 STEP  694 H= 694:00 +CPU= 19.615
  22:59:13 STEP  695 H= 695:00 +CPU= 25.004
  22:59:56 STEP  696 H= 696:00 +CPU= 43.458
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGhpi1+000696
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHhpi1+000696
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAhpi1+000696
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12165430/ICMGGhpi1+000672
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12165430/ICMSHhpi1+000672
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12165430/ICMUAhpi1+000672
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12165430/ICMGGhpi1+000684
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12165430/ICMSHhpi1+000684
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12165430/ICMUAhpi1+000684
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_2341_2021050100_123_947_12165430_0_r1843840361_28.zip
Uploading the intermediate file: upload_file_28.zip
  23:00:21 STEP  697 H= 697:00 +CPU= 24.626
Uploading trickle at timestep: 2505600
  23:00:46 STEP  698 H= 698:00 +CPU= 25.272
  23:01:23 STEP  699 H= 699:00 +CPU= 37.134
  23:01:48 STEP  700 H= 700:00 +CPU= 24.604
  23:02:13 STEP  701 H= 701:00 +CPU= 25.009
  23:02:51 STEP  702 H= 702:00 +CPU= 38.034
  23:03:15 STEP  703 H= 703:00 +CPU= 24.095
  23:03:40 STEP  704 H= 704:00 +CPU= 24.385
  23:04:17 STEP  705 H= 705:00 +CPU= 37.491
  23:04:42 STEP  706 H= 706:00 +CPU= 24.486
  23:05:06 STEP  707 H= 707:00 +CPU= 24.384
  23:05:48 STEP  708 H= 708:00 +CPU= 41.287
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGhpi1+000708
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHhpi1+000708
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAhpi1+000708
  23:06:13 STEP  709 H= 709:00 +CPU= 25.293
  23:06:38 STEP  710 H= 710:00 +CPU= 25.489
  23:07:15 STEP  711 H= 711:00 +CPU= 37.001
  23:07:41 STEP  712 H= 712:00 +CPU= 25.302
  23:08:06 STEP  713 H= 713:00 +CPU= 24.824
  23:08:43 STEP  714 H= 714:00 +CPU= 37.490
  23:09:09 STEP  715 H= 715:00 +CPU= 25.327
  23:09:34 STEP  716 H= 716:00 +CPU= 25.820
  23:10:11 STEP  717 H= 717:00 +CPU= 36.509
  23:10:37 STEP  718 H= 718:00 +CPU= 25.490
  23:11:05 STEP  719 H= 719:00 +CPU= 27.542
  23:11:52 STEP  720 H= 720:00 +CPU= 47.297
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGhpi1+000720
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHhpi1+000720
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAhpi1+000720
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12165430/ICMGGhpi1+000696
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12165430/ICMSHhpi1+000696
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12165430/ICMUAhpi1+000696
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12165430/ICMGGhpi1+000708
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12165430/ICMSHhpi1+000708
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12165430/ICMUAhpi1+000708
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_2341_2021050100_123_947_12165430_0_r1843840361_29.zip
Uploading the intermediate file: upload_file_29.zip
  23:12:17 STEP  721 H= 721:00 +CPU= 24.634
Uploading trickle at timestep: 2592000
  23:12:42 STEP  722 H= 722:00 +CPU= 25.501
  23:13:20 STEP  723 H= 723:00 +CPU= 37.075
  23:13:45 STEP  724 H= 724:00 +CPU= 24.858
  23:14:09 STEP  725 H= 725:00 +CPU= 24.304
  23:14:47 STEP  726 H= 726:00 +CPU= 37.933
  23:15:12 STEP  727 H= 727:00 +CPU= 24.502
  23:15:38 STEP  728 H= 728:00 +CPU= 25.868
  23:16:14 STEP  729 H= 729:00 +CPU= 36.776
  23:16:40 STEP  730 H= 730:00 +CPU= 25.294
  23:17:05 STEP  731 H= 731:00 +CPU= 24.606
  23:17:45 STEP  732 H= 732:00 +CPU= 39.977
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGhpi1+000732
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHhpi1+000732
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAhpi1+000732
  23:18:09 STEP  733 H= 733:00 +CPU= 24.400
  23:18:34 STEP  734 H= 734:00 +CPU= 24.854
  23:19:10 STEP  735 H= 735:00 +CPU= 36.198
  23:19:36 STEP  736 H= 736:00 +CPU= 25.542
  23:20:01 STEP  737 H= 737:00 +CPU= 24.855
  23:20:38 STEP  738 H= 738:00 +CPU= 37.678
  23:21:03 STEP  739 H= 739:00 +CPU= 24.703
  23:21:28 STEP  740 H= 740:00 +CPU= 25.161
  23:22:05 STEP  741 H= 741:00 +CPU= 36.582
  23:22:30 STEP  742 H= 742:00 +CPU= 24.640
  23:22:55 STEP  743 H= 743:00 +CPU= 25.096
  23:23:39 STEP  744 H= 744:00 +CPU= 43.750
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGhpi1+000744
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHhpi1+000744
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAhpi1+000744
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12165430/ICMGGhpi1+000720
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12165430/ICMSHhpi1+000720
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12165430/ICMUAhpi1+000720
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12165430/ICMGGhpi1+000732
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12165430/ICMSHhpi1+000732
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12165430/ICMUAhpi1+000732
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_2341_2021050100_123_947_12165430_0_r1843840361_30.zip
Uploading the intermediate file: upload_file_30.zip
Uploading trickle at timestep: 2678400
  23:24:04 STEP  745 H= 745:00 +CPU= 24.492
  23:24:29 STEP  746 H= 746:00 +CPU= 25.228
  23:25:06 STEP  747 H= 747:00 +CPU= 37.193
  23:25:31 STEP  748 H= 748:00 +CPU= 25.225
  23:25:56 STEP  749 H= 749:00 +CPU= 24.345
  23:26:33 STEP  750 H= 750:00 +CPU= 37.596
  23:26:58 STEP  751 H= 751:00 +CPU= 24.793
  23:27:23 STEP  752 H= 752:00 +CPU= 25.097
  23:28:00 STEP  753 H= 753:00 +CPU= 36.505
  23:28:25 STEP  754 H= 754:00 +CPU= 24.890
  23:28:50 STEP  755 H= 755:00 +CPU= 24.513
  23:29:30 STEP  756 H= 756:00 +CPU= 40.561
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGhpi1+000756
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHhpi1+000756
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAhpi1+000756
  23:29:55 STEP  757 H= 757:00 +CPU= 24.521
  23:30:21 STEP  758 H= 758:00 +CPU= 25.503
  23:30:57 STEP  759 H= 759:00 +CPU= 36.689
  23:31:22 STEP  760 H= 760:00 +CPU= 24.784
  23:31:47 STEP  761 H= 761:00 +CPU= 24.918
  23:32:25 STEP  762 H= 762:00 +CPU= 37.842
  23:32:50 STEP  763 H= 763:00 +CPU= 24.483
  23:33:15 STEP  764 H= 764:00 +CPU= 25.197
  23:33:53 STEP  765 H= 765:00 +CPU= 37.739
  23:34:18 STEP  766 H= 766:00 +CPU= 24.709
  23:34:42 STEP  767 H= 767:00 +CPU= 24.958
  23:35:25 STEP  768 H= 768:00 +CPU= 42.796
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGhpi1+000768
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHhpi1+000768
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAhpi1+000768
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12165430/ICMGGhpi1+000744
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12165430/ICMSHhpi1+000744
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12165430/ICMUAhpi1+000744
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12165430/ICMGGhpi1+000756
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12165430/ICMSHhpi1+000756
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12165430/ICMUAhpi1+000756
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_2341_2021050100_123_947_12165430_0_r1843840361_31.zip
Uploading the intermediate file: upload_file_31.zip
  23:35:50 STEP  769 H= 769:00 +CPU= 24.718
Uploading trickle at timestep: 2764800
  23:36:15 STEP  770 H= 770:00 +CPU= 24.885
  23:36:51 STEP  771 H= 771:00 +CPU= 36.269
  23:37:16 STEP  772 H= 772:00 +CPU= 24.811
  23:37:41 STEP  773 H= 773:00 +CPU= 24.642
  23:38:18 STEP  774 H= 774:00 +CPU= 36.952
  23:38:43 STEP  775 H= 775:00 +CPU= 24.630
  23:39:08 STEP  776 H= 776:00 +CPU= 24.969
  23:39:45 STEP  777 H= 777:00 +CPU= 37.041
  23:40:10 STEP  778 H= 778:00 +CPU= 25.306
  23:40:35 STEP  779 H= 779:00 +CPU= 24.692
  23:41:15 STEP  780 H= 780:00 +CPU= 40.338
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGhpi1+000780
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHhpi1+000780
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAhpi1+000780
  23:41:40 STEP  781 H= 781:00 +CPU= 24.486
  23:42:05 STEP  782 H= 782:00 +CPU= 25.090
  23:42:42 STEP  783 H= 783:00 +CPU= 37.434
  23:43:08 STEP  784 H= 784:00 +CPU= 25.191
  23:43:32 STEP  785 H= 785:00 +CPU= 24.603
  23:44:08 STEP  786 H= 786:00 +CPU= 35.694
  23:44:30 STEP  787 H= 787:00 +CPU= 22.377
  23:44:53 STEP  788 H= 788:00 +CPU= 23.171
  23:45:28 STEP  789 H= 789:00 +CPU= 34.398
  23:45:51 STEP  790 H= 790:00 +CPU= 23.018
  23:46:14 STEP  791 H= 791:00 +CPU= 22.846
  23:46:54 STEP  792 H= 792:00 +CPU= 40.280
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGhpi1+000792
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHhpi1+000792
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAhpi1+000792
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12165430/ICMGGhpi1+000768
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12165430/ICMSHhpi1+000768
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12165430/ICMUAhpi1+000768
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12165430/ICMGGhpi1+000780
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12165430/ICMSHhpi1+000780
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12165430/ICMUAhpi1+000780
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_2341_2021050100_123_947_12165430_0_r1843840361_32.zip
Uploading the intermediate file: upload_file_32.zip
Uploading trickle at timestep: 2851200
  23:47:17 STEP  793 H= 793:00 +CPU= 22.506
  23:47:39 STEP  794 H= 794:00 +CPU= 22.145
  23:48:12 STEP  795 H= 795:00 +CPU= 32.622
  23:48:34 STEP  796 H= 796:00 +CPU= 22.285
  23:48:54 STEP  797 H= 797:00 +CPU= 20.344
  23:49:25 STEP  798 H= 798:00 +CPU= 30.634
  23:49:45 STEP  799 H= 799:00 +CPU= 20.188
  23:50:07 STEP  800 H= 800:00 +CPU= 21.335
  23:50:39 STEP  801 H= 801:00 +CPU= 31.830
  23:50:59 STEP  802 H= 802:00 +CPU= 20.065
  23:51:18 STEP  803 H= 803:00 +CPU= 19.559
  23:51:53 STEP  804 H= 804:00 +CPU= 34.180
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGhpi1+000804
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHhpi1+000804
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAhpi1+000804
  23:52:16 STEP  805 H= 805:00 +CPU= 23.533
  23:52:40 STEP  806 H= 806:00 +CPU= 23.836
  23:53:14 STEP  807 H= 807:00 +CPU= 33.875
  23:53:37 STEP  808 H= 808:00 +CPU= 22.821
  23:54:00 STEP  809 H= 809:00 +CPU= 22.918
  23:54:35 STEP  810 H= 810:00 +CPU= 35.376
  23:54:54 STEP  811 H= 811:00 +CPU= 19.261
  23:55:07 STEP  812 H= 812:00 +CPU= 12.505
  23:55:46 STEP  813 H= 813:00 +CPU= 39.027
  23:56:14 STEP  814 H= 814:00 +CPU= 27.576
  23:56:41 STEP  815 H= 815:00 +CPU= 27.148
  23:57:28 STEP  816 H= 816:00 +CPU= 47.362
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGhpi1+000816
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHhpi1+000816
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAhpi1+000816
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12165430/ICMGGhpi1+000792
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12165430/ICMSHhpi1+000792
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12165430/ICMUAhpi1+000792
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12165430/ICMGGhpi1+000804
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12165430/ICMSHhpi1+000804
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12165430/ICMUAhpi1+000804
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_2341_2021050100_123_947_12165430_0_r1843840361_33.zip
Uploading the intermediate file: upload_file_33.zip
  23:57:54 STEP  817 H= 817:00 +CPU= 25.565
Uploading trickle at timestep: 2937600
  23:58:22 STEP  818 H= 818:00 +CPU= 27.637
  23:59:01 STEP  819 H= 819:00 +CPU= 39.460
  23:59:14 STEP  820 H= 820:00 +CPU= 13.180
  23:59:35 STEP  821 H= 821:00 +CPU= 20.512
  00:00:05 STEP  822 H= 822:00 +CPU= 30.340
  00:00:25 STEP  823 H= 823:00 +CPU= 19.881
  00:00:46 STEP  824 H= 824:00 +CPU= 20.630
  00:01:18 STEP  825 H= 825:00 +CPU= 31.382
  00:01:39 STEP  826 H= 826:00 +CPU= 21.494
  00:01:59 STEP  827 H= 827:00 +CPU= 20.263
  00:02:32 STEP  828 H= 828:00 +CPU= 32.610
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGhpi1+000828
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHhpi1+000828
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAhpi1+000828
  00:02:51 STEP  829 H= 829:00 +CPU= 18.877
  00:03:10 STEP  830 H= 830:00 +CPU= 19.255
  00:03:41 STEP  831 H= 831:00 +CPU= 30.180
  00:04:00 STEP  832 H= 832:00 +CPU= 19.697
  00:04:19 STEP  833 H= 833:00 +CPU= 18.450
  00:04:48 STEP  834 H= 834:00 +CPU= 29.433
  00:05:09 STEP  835 H= 835:00 +CPU= 20.978
  00:05:32 STEP  836 H= 836:00 +CPU= 22.876
  00:06:06 STEP  837 H= 837:00 +CPU= 33.838
  00:06:28 STEP  838 H= 838:00 +CPU= 22.116
  00:06:51 STEP  839 H= 839:00 +CPU= 22.304
  00:07:30 STEP  840 H= 840:00 +CPU= 39.249
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGhpi1+000840
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHhpi1+000840
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAhpi1+000840
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12165430/ICMGGhpi1+000816
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12165430/ICMSHhpi1+000816
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12165430/ICMUAhpi1+000816
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12165430/ICMGGhpi1+000828
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12165430/ICMSHhpi1+000828
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12165430/ICMUAhpi1+000828
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_2341_2021050100_123_947_12165430_0_r1843840361_34.zip
Uploading the intermediate file: upload_file_34.zip
  00:07:52 STEP  841 H= 841:00 +CPU= 21.684
Uploading trickle at timestep: 3024000
  00:08:14 STEP  842 H= 842:00 +CPU= 21.992
  00:08:47 STEP  843 H= 843:00 +CPU= 33.166
  00:09:09 STEP  844 H= 844:00 +CPU= 21.836
  00:09:30 STEP  845 H= 845:00 +CPU= 21.576
  00:10:05 STEP  846 H= 846:00 +CPU= 34.418
  00:10:27 STEP  847 H= 847:00 +CPU= 21.646
  00:10:49 STEP  848 H= 848:00 +CPU= 22.107
  00:11:22 STEP  849 H= 849:00 +CPU= 33.582
  00:11:45 STEP  850 H= 850:00 +CPU= 22.443
  00:12:06 STEP  851 H= 851:00 +CPU= 21.666
  00:12:44 STEP  852 H= 852:00 +CPU= 37.417
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGhpi1+000852
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHhpi1+000852
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAhpi1+000852
  00:13:05 STEP  853 H= 853:00 +CPU= 21.351
  00:13:28 STEP  854 H= 854:00 +CPU= 22.416
  00:14:02 STEP  855 H= 855:00 +CPU= 34.126
  00:14:25 STEP  856 H= 856:00 +CPU= 22.612
  00:14:47 STEP  857 H= 857:00 +CPU= 22.234
  00:15:21 STEP  858 H= 858:00 +CPU= 33.986
  00:15:43 STEP  859 H= 859:00 +CPU= 21.362
  00:16:06 STEP  860 H= 860:00 +CPU= 23.219
  00:16:40 STEP  861 H= 861:00 +CPU= 33.931
  00:17:02 STEP  862 H= 862:00 +CPU= 22.049
  00:17:25 STEP  863 H= 863:00 +CPU= 22.860
  00:18:05 STEP  864 H= 864:00 +CPU= 39.506
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGhpi1+000864
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHhpi1+000864
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAhpi1+000864
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12165430/ICMGGhpi1+000840
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12165430/ICMSHhpi1+000840
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12165430/ICMUAhpi1+000840
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12165430/ICMGGhpi1+000852
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12165430/ICMSHhpi1+000852
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12165430/ICMUAhpi1+000852
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_2341_2021050100_123_947_12165430_0_r1843840361_35.zip
Uploading the intermediate file: upload_file_35.zip
  00:18:27 STEP  865 H= 865:00 +CPU= 22.149
Uploading trickle at timestep: 3110400
  00:18:50 STEP  866 H= 866:00 +CPU= 23.287
  00:19:23 STEP  867 H= 867:00 +CPU= 33.071
  00:19:46 STEP  868 H= 868:00 +CPU= 22.515
  00:20:07 STEP  869 H= 869:00 +CPU= 21.200
  00:20:42 STEP  870 H= 870:00 +CPU= 34.212
  00:21:03 STEP  871 H= 871:00 +CPU= 21.543
  00:21:25 STEP  872 H= 872:00 +CPU= 21.893
  00:21:58 STEP  873 H= 873:00 +CPU= 32.493
  00:22:20 STEP  874 H= 874:00 +CPU= 22.279
  00:22:41 STEP  875 H= 875:00 +CPU= 21.226
  00:23:18 STEP  876 H= 876:00 +CPU= 36.494
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGhpi1+000876
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHhpi1+000876
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAhpi1+000876
  00:23:39 STEP  877 H= 877:00 +CPU= 21.463
  00:24:02 STEP  878 H= 878:00 +CPU= 22.366
  00:24:35 STEP  879 H= 879:00 +CPU= 33.084
  00:24:57 STEP  880 H= 880:00 +CPU= 22.376
  00:25:19 STEP  881 H= 881:00 +CPU= 21.850
  00:25:53 STEP  882 H= 882:00 +CPU= 33.867
  00:26:15 STEP  883 H= 883:00 +CPU= 21.691
  00:26:36 STEP  884 H= 884:00 +CPU= 21.749
  00:27:10 STEP  885 H= 885:00 +CPU= 33.438
  00:27:32 STEP  886 H= 886:00 +CPU= 22.053
  00:27:54 STEP  887 H= 887:00 +CPU= 22.412
  00:28:35 STEP  888 H= 888:00 +CPU= 39.986
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGhpi1+000888
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHhpi1+000888
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAhpi1+000888
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12165430/ICMGGhpi1+000864
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12165430/ICMSHhpi1+000864
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12165430/ICMUAhpi1+000864
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12165430/ICMGGhpi1+000876
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12165430/ICMSHhpi1+000876
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12165430/ICMUAhpi1+000876
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_2341_2021050100_123_947_12165430_0_r1843840361_36.zip
Uploading the intermediate file: upload_file_36.zip
  00:28:57 STEP  889 H= 889:00 +CPU= 22.576
Uploading trickle at timestep: 3196800
  00:29:21 STEP  890 H= 890:00 +CPU= 23.830
  00:29:55 STEP  891 H= 891:00 +CPU= 33.615
  00:30:17 STEP  892 H= 892:00 +CPU= 22.690
  00:30:39 STEP  893 H= 893:00 +CPU= 21.444
  00:31:13 STEP  894 H= 894:00 +CPU= 34.015
  00:31:35 STEP  895 H= 895:00 +CPU= 22.079
  00:31:57 STEP  896 H= 896:00 +CPU= 21.926
  00:32:30 STEP  897 H= 897:00 +CPU= 33.392
  00:32:53 STEP  898 H= 898:00 +CPU= 22.291
  00:33:15 STEP  899 H= 899:00 +CPU= 21.732
  00:33:51 STEP  900 H= 900:00 +CPU= 36.603
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGhpi1+000900
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHhpi1+000900
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAhpi1+000900
  00:34:13 STEP  901 H= 901:00 +CPU= 21.450
  00:34:36 STEP  902 H= 902:00 +CPU= 23.333
  00:35:10 STEP  903 H= 903:00 +CPU= 34.133
  00:35:33 STEP  904 H= 904:00 +CPU= 22.292
[EC_DRHOOK:LINUX-VM-12700K:1:1:2936:2936] [20221203:003535:1670020535:23763.753] [signal_drhook@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1538] Received signal#15 (SIGTERM) :: 3539MB (heap), 4415MB (maxrss), 0MB (maxstack), 0 (paging), nsigs = 1
[EC_DRHOOK:LINUX-VM-12700K:1:1:2936:2936] [20221203:003535:1670020535:23763.753] [signal_drhook@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1542] Also activating Harakiri-alarm (SIGALRM=14) to expire after 500s elapsed to prevent hangs, nsigs = 1
[EC_DRHOOK:LINUX-VM-12700K:1:1:2936:2936] [20221203:003535:1670020535:23763.753] [signal_drhook@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1544] Harakiri signal handler 'signal_harakiri' for signal#14 (SIGALRM) installed at 0x81f3c0 (old at (nil))
[EC_DRHOOK:LINUX-VM-12700K:1:1:2936:2936] [20221203:003535:1670020535:23763.753] [signal_drhook@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1617] Signal#15 was caused by unrecognized si_code [memaddr=0x1], nsigs = 1
[EC_DRHOOK:LINUX-VM-12700K:1:1:2936:2936] [20221203:003535:1670020535:23763.753] [signal_drhook@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1686] Starting DrHook backtrace for signal#15, nsigs = 1
[EC_DRHOOK:LINUX-VM-12700K:1:1:2936:2936] [20221203:003535:1670020535:23763.753] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3843] 3539 MB (maxheap), 4415 MB (maxrss), 0 MB (maxstack)
[EC_DRHOOK:LINUX-VM-12700K:1:1:2936:2936] [20221203:003535:1670020535:23763.753] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :  MASTER 
[EC_DRHOOK:LINUX-VM-12700K:1:1:2936:2936] [20221203:003535:1670020535:23763.753] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :   CNT0 
[EC_DRHOOK:LINUX-VM-12700K:1:1:2936:2936] [20221203:003535:1670020535:23763.753] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :    CNT1 
[EC_DRHOOK:LINUX-VM-12700K:1:1:2936:2936] [20221203:003535:1670020535:23763.753] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :     CNT2 
[EC_DRHOOK:LINUX-VM-12700K:1:1:2936:2936] [20221203:003535:1670020535:23763.753] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :      CNT3 
[EC_DRHOOK:LINUX-VM-12700K:1:1:2936:2936] [20221203:003535:1670020535:23763.753] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :       CNT4 
[EC_DRHOOK:LINUX-VM-12700K:1:1:2936:2936] [20221203:003535:1670020535:23763.753] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :        STEPO 
[EC_DRHOOK:LINUX-VM-12700K:1:1:2936:2936] [20221203:003535:1670020535:23763.753] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :         SCAN2M 
[EC_DRHOOK:LINUX-VM-12700K:1:1:2936:2936] [20221203:003535:1670020535:23763.753] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :          GP_MODEL_HEAP 
[EC_DRHOOK:LINUX-VM-12700K:1:1:2936:2936] [20221203:003535:1670020535:23763.753] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :           GP_MODEL 
[EC_DRHOOK:LINUX-VM-12700K:1:1:2936:2936] [20221203:003535:1670020535:23763.753] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :            CPG_DRV 
[EC_DRHOOK:LINUX-VM-12700K:1:1:2936:2936] [20221203:003535:1670020535:23763.753] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :             >OMP-CPG                  (1025) 
[EC_DRHOOK:LINUX-VM-12700K:1:1:2936:2936] [20221203:003535:1670020535:23763.753] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :              CPG 
[EC_DRHOOK:LINUX-VM-12700K:1:1:2936:2936] [20221203:003535:1670020535:23763.753] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :               CPG_DIA 
[EC_DRHOOK:LINUX-VM-12700K:1:1:2936:2936] [20221203:003535:1670020535:23763.753] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :                GPRH 
[EC_DRHOOK:LINUX-VM-12700K:1:1:2936:2936] [20221203:003536:1670020536:23764.754] [signal_drhook@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1734] DrHook backtrace done for signal#15, nsigs = 1
[EC_DRHOOK:LINUX-VM-12700K:1:1:2936:2936] [20221203:003536:1670020536:23764.754] [signal_drhook@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1785] Calling previous signal handler at 0x1ce8bb0 for signal#15, nsigs = 1
forrtl: error (78): process killed (SIGTERM)
Image              PC                Routine            Line        Source             
master.exe         0000000001CE916B  Unknown               Unknown  Unknown
master.exe         000000000081FFF1  Unknown               Unknown  Unknown
master.exe         0000000001DC9090  Unknown               Unknown  Unknown
master.exe         0000000001CC0AA4  Unknown               Unknown  Unknown
master.exe         0000000000CD7AF6  gprh_                     128  gprh.F90
master.exe         0000000000C89CEC  cpg_dia_                  600  cpg_dia.F90
master.exe         0000000000C2F59F  cpg_                      718  cpg.F90
master.exe         0000000000C2C638  cpg_drv_                  351  cpg_drv.F90
master.exe         0000000000BF17C8  gp_model_                 419  gp_model.F90
master.exe         00000000012E9482  gp_model_heap_             74  gp_model_heap.F90
master.exe         0000000000BBC1CE  scan2m_                   535  scan2m.F90
master.exe         000000000057A664  stepo_                    327  stepo.F90
master.exe         000000000055DEEC  cnt4_                    1133  cnt4.F90
master.exe         00000000005471C9  cnt3_                     267  cnt3.F90
master.exe         0000000000546412  cnt2_                      88  cnt2.F90
master.exe         0000000000545E28  cnt1_                      92  cnt1.F90
master.exe         000000000040708D  cnt0_                     146  cnt0.F90
master.exe         000000000040220F  MAIN__                     96  master.F90
master.exe         00000000004021A2  Unknown               Unknown  Unknown
master.exe         0000000001DCA390  Unknown               Unknown  Unknown
master.exe         000000000040206E  Unknown               Unknown  Unknown

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
09 May 2023 15:28:59 1526251 22247449 oifs_43r3_ps_2341_2021050100_123_947_12165430_0 3,196,800 23,305 0.0073
09 May 2023 15:28:59 1526251 22247449 oifs_43r3_ps_2341_2021050100_123_947_12165430_0 3,110,400 22,674 0.0073
09 May 2023 15:28:59 1526251 22247449 oifs_43r3_ps_2341_2021050100_123_947_12165430_0 3,024,000 22,044 0.0073
09 May 2023 15:27:40 1526251 22247449 oifs_43r3_ps_2341_2021050100_123_947_12165430_0 2,937,600 21,444 0.0073
09 May 2023 15:27:40 1526251 22247449 oifs_43r3_ps_2341_2021050100_123_947_12165430_0 2,851,200 20,803 0.0073
09 May 2023 15:27:40 1526251 22247449 oifs_43r3_ps_2341_2021050100_123_947_12165430_0 2,764,800 20,122 0.0073
09 May 2023 15:27:40 1526251 22247449 oifs_43r3_ps_2341_2021050100_123_947_12165430_0 2,678,400 19,411 0.0072
09 May 2023 15:27:40 1526251 22247449 oifs_43r3_ps_2341_2021050100_123_947_12165430_0 2,592,000 18,711 0.0072
09 May 2023 15:27:32 1526251 22247449 oifs_43r3_ps_2341_2021050100_123_947_12165430_0 2,505,600 18,000 0.0072
09 May 2023 15:27:32 1526251 22247449 oifs_43r3_ps_2341_2021050100_123_947_12165430_0 2,419,200 17,320 0.0072
09 May 2023 15:27:32 1526251 22247449 oifs_43r3_ps_2341_2021050100_123_947_12165430_0 2,332,800 16,650 0.0071
09 May 2023 15:27:32 1526251 22247449 oifs_43r3_ps_2341_2021050100_123_947_12165430_0 2,246,400 15,969 0.0071
09 May 2023 15:27:32 1526251 22247449 oifs_43r3_ps_2341_2021050100_123_947_12165430_0 2,160,000 15,308 0.0071
09 May 2023 15:27:32 1526251 22247449 oifs_43r3_ps_2341_2021050100_123_947_12165430_0 2,073,600 14,667 0.0071
09 May 2023 15:27:25 1526251 22247449 oifs_43r3_ps_2341_2021050100_123_947_12165430_0 1,987,200 14,036 0.0071
09 May 2023 15:27:25 1526251 22247449 oifs_43r3_ps_2341_2021050100_123_947_12165430_0 1,900,800 13,395 0.0070
09 May 2023 15:27:25 1526251 22247449 oifs_43r3_ps_2341_2021050100_123_947_12165430_0 1,814,400 12,744 0.0070
09 May 2023 15:27:25 1526251 22247449 oifs_43r3_ps_2341_2021050100_123_947_12165430_0 1,728,000 12,093 0.0070
09 May 2023 15:27:25 1526251 22247449 oifs_43r3_ps_2341_2021050100_123_947_12165430_0 1,641,600 11,593 0.0071
09 May 2023 15:27:25 1526251 22247449 oifs_43r3_ps_2341_2021050100_123_947_12165430_0 1,555,200 11,062 0.0071


©2024 climateprediction.net