Name | oifs_43r3_bl_a3f0_2016092300_20_1018_12292755_0 |
Workunit | 12292755 |
Created | 13 Jun 2024, 2:26:04 UTC |
Sent | 14 Jun 2024, 9:22:35 UTC |
Report deadline | 13 Aug 2024, 9:22:35 UTC |
Received | 25 Jun 2024, 2:51:53 UTC |
Server state | Over |
Outcome | Computation error |
Client state | Compute error |
Exit status | 1 (0x00000001) Unknown error code |
Computer ID | 1485804 |
Run time | 3 hours 0 min 18 sec |
CPU time | 2 hours 59 min 28 sec |
Validate state | Invalid |
Credit | 0.00 |
Device peak FLOPS | 6.82 GFLOPS |
Application version | OpenIFS 43r3 Baroclinic Lifecycle v1.13 x86_64-pc-linux-gnu |
Peak working set size | 5,554.35 MB |
Peak swap size | 5,981.07 MB |
Peak disk usage | 1,368.95 MB |
Stderr | <core_client_version>7.24.1</core_client_version> <![CDATA[ <message> process exited with code 1 (0x1, -255)</message> <stderr_txt> 18:06:03 STEP 383 H= 95:45 +CPU= 12.357 18:06:21 STEP 384 H= 96:00 +CPU= 18.595 Moving to projects directory: /var/lib/boinc/slots/2/ICMGGh7zg+000384 Moving to projects directory: /var/lib/boinc/slots/2/ICMSHh7zg+000384 Moving to projects directory: /var/lib/boinc/slots/2/ICMUAh7zg+000384 Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12292755/ICMGGh7zg+000288 Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12292755/ICMSHh7zg+000288 Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12292755/ICMUAh7zg+000288 Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12292755/ICMGGh7zg+000300 Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12292755/ICMSHh7zg+000300 Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12292755/ICMUAh7zg+000300 Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12292755/ICMGGh7zg+000312 Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12292755/ICMSHh7zg+000312 Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12292755/ICMUAh7zg+000312 Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12292755/ICMGGh7zg+000324 Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12292755/ICMSHh7zg+000324 Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12292755/ICMUAh7zg+000324 Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12292755/ICMGGh7zg+000336 Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12292755/ICMSHh7zg+000336 Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12292755/ICMUAh7zg+000336 Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12292755/ICMGGh7zg+000348 Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12292755/ICMSHh7zg+000348 Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12292755/ICMUAh7zg+000348 Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12292755/ICMGGh7zg+000360 Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12292755/ICMSHh7zg+000360 Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12292755/ICMUAh7zg+000360 Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12292755/ICMGGh7zg+000372 Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12292755/ICMSHh7zg+000372 Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12292755/ICMUAh7zg+000372 Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_a3f0_2016092300_20_1018_12292755_0_r47306190_3.zip 18:06:34 STEP 385 H= 96:15 +CPU= 12.487 Uploading the intermediate file: upload_file_3.zip 18:06:46 STEP 386 H= 96:30 +CPU= 12.468 18:06:59 STEP 387 H= 96:45 +CPU= 12.462 18:07:12 STEP 388 H= 97:00 +CPU= 13.199 18:07:24 STEP 389 H= 97:15 +CPU= 12.317 18:07:37 STEP 390 H= 97:30 +CPU= 12.343 18:07:49 STEP 391 H= 97:45 +CPU= 12.369 18:08:02 STEP 392 H= 98:00 +CPU= 13.079 18:08:15 STEP 393 H= 98:15 +CPU= 12.589 18:08:27 STEP 394 H= 98:30 +CPU= 12.764 18:08:40 STEP 395 H= 98:45 +CPU= 12.775 18:08:56 STEP 396 H= 99:00 +CPU= 16.013 Moving to projects directory: /var/lib/boinc/slots/2/ICMGGh7zg+000396 Moving to projects directory: /var/lib/boinc/slots/2/ICMSHh7zg+000396 Moving to projects directory: /var/lib/boinc/slots/2/ICMUAh7zg+000396 18:09:09 STEP 397 H= 99:15 +CPU= 12.455 18:09:21 STEP 398 H= 99:30 +CPU= 12.386 18:09:33 STEP 399 H= 99:45 +CPU= 12.479 18:09:46 STEP 400 H= 100:00 +CPU= 12.728 18:09:59 STEP 401 H= 100:15 +CPU= 12.303 18:10:11 STEP 402 H= 100:30 +CPU= 12.674 18:10:24 STEP 403 H= 100:45 +CPU= 12.911 18:10:37 STEP 404 H= 101:00 +CPU= 13.351 18:10:50 STEP 405 H= 101:15 +CPU= 12.625 18:11:03 STEP 406 H= 101:30 +CPU= 12.617 18:11:15 STEP 407 H= 101:45 +CPU= 12.520 18:11:31 STEP 408 H= 102:00 +CPU= 16.194 Moving to projects directory: /var/lib/boinc/slots/2/ICMGGh7zg+000408 Moving to projects directory: /var/lib/boinc/slots/2/ICMSHh7zg+000408 Moving to projects directory: /var/lib/boinc/slots/2/ICMUAh7zg+000408 18:11:44 STEP 409 H= 102:15 +CPU= 12.441 18:11:56 STEP 410 H= 102:30 +CPU= 12.569 18:12:09 STEP 411 H= 102:45 +CPU= 12.600 18:12:22 STEP 412 H= 103:00 +CPU= 12.883 18:12:35 STEP 413 H= 103:15 +CPU= 13.101 18:12:49 STEP 414 H= 103:30 +CPU= 13.624 18:13:02 STEP 415 H= 103:45 +CPU= 13.520 18:13:17 STEP 416 H= 104:00 +CPU= 14.705 18:13:30 STEP 417 H= 104:15 +CPU= 13.492 18:13:44 STEP 418 H= 104:30 +CPU= 13.236 18:13:57 STEP 419 H= 104:45 +CPU= 12.919 18:14:14 STEP 420 H= 105:00 +CPU= 17.257 Moving to projects directory: /var/lib/boinc/slots/2/ICMGGh7zg+000420 Moving to projects directory: /var/lib/boinc/slots/2/ICMSHh7zg+000420 Moving to projects directory: /var/lib/boinc/slots/2/ICMUAh7zg+000420 18:14:28 STEP 421 H= 105:15 +CPU= 13.855 18:14:41 STEP 422 H= 105:30 +CPU= 13.357 18:14:55 STEP 423 H= 105:45 +CPU= 13.569 18:15:09 STEP 424 H= 106:00 +CPU= 13.879 18:15:22 STEP 425 H= 106:15 +CPU= 13.815 Suspend request received from the BOINC client, suspending the child process Resuming the child process 18:15:58 STEP 426 H= 106:30 +CPU= 13.170 18:16:10 STEP 427 H= 106:45 +CPU= 12.865 18:16:24 STEP 428 H= 107:00 +CPU= 13.244 18:16:37 STEP 429 H= 107:15 +CPU= 13.219 18:16:50 STEP 430 H= 107:30 +CPU= 12.896 18:17:04 STEP 431 H= 107:45 +CPU= 13.765 18:17:24 STEP 432 H= 108:00 +CPU= 20.122 Moving to projects directory: /var/lib/boinc/slots/2/ICMGGh7zg+000432 Moving to projects directory: /var/lib/boinc/slots/2/ICMSHh7zg+000432 Moving to projects directory: /var/lib/boinc/slots/2/ICMUAh7zg+000432 18:17:37 STEP 433 H= 108:15 +CPU= 13.336 18:17:50 STEP 434 H= 108:30 +CPU= 13.344 18:18:04 STEP 435 H= 108:45 +CPU= 13.192 18:18:18 STEP 436 H= 109:00 +CPU= 14.072 18:18:31 STEP 437 H= 109:15 +CPU= 13.548 18:18:45 STEP 438 H= 109:30 +CPU= 13.431 18:18:58 STEP 439 H= 109:45 +CPU= 13.403 18:19:12 STEP 440 H= 110:00 +CPU= 14.374 18:19:26 STEP 441 H= 110:15 +CPU= 13.664 18:19:40 STEP 442 H= 110:30 +CPU= 14.134 18:19:54 STEP 443 H= 110:45 +CPU= 14.074 18:20:12 STEP 444 H= 111:00 +CPU= 17.734 Moving to projects directory: /var/lib/boinc/slots/2/ICMGGh7zg+000444 Moving to projects directory: /var/lib/boinc/slots/2/ICMSHh7zg+000444 Moving to projects directory: /var/lib/boinc/slots/2/ICMUAh7zg+000444 18:20:26 STEP 445 H= 111:15 +CPU= 13.983 18:20:40 STEP 446 H= 111:30 +CPU= 13.889 18:20:54 STEP 447 H= 111:45 +CPU= 13.811 18:21:08 STEP 448 H= 112:00 +CPU= 14.084 18:21:22 STEP 449 H= 112:15 +CPU= 13.894 18:21:35 STEP 450 H= 112:30 +CPU= 13.529 18:21:49 STEP 451 H= 112:45 +CPU= 13.727 18:22:04 STEP 452 H= 113:00 +CPU= 14.391 18:22:18 STEP 453 H= 113:15 +CPU= 13.995 18:22:31 STEP 454 H= 113:30 +CPU= 13.743 18:22:44 STEP 455 H= 113:45 +CPU= 13.123 18:23:01 STEP 456 H= 114:00 +CPU= 16.795 Moving to projects directory: /var/lib/boinc/slots/2/ICMGGh7zg+000456 Moving to projects directory: /var/lib/boinc/slots/2/ICMSHh7zg+000456 Moving to projects directory: /var/lib/boinc/slots/2/ICMUAh7zg+000456 18:23:14 STEP 457 H= 114:15 +CPU= 12.743 18:23:27 STEP 458 H= 114:30 +CPU= 12.599 18:23:39 STEP 459 H= 114:45 +CPU= 12.570 18:23:52 STEP 460 H= 115:00 +CPU= 13.132 18:24:05 STEP 461 H= 115:15 +CPU= 13.162 18:24:18 STEP 462 H= 115:30 +CPU= 12.695 18:24:31 STEP 463 H= 115:45 +CPU= 12.487 18:24:44 STEP 464 H= 116:00 +CPU= 13.440 18:24:57 STEP 465 H= 116:15 +CPU= 13.250 18:25:11 STEP 466 H= 116:30 +CPU= 13.915 18:25:25 STEP 467 H= 116:45 +CPU= 14.159 18:25:43 STEP 468 H= 117:00 +CPU= 17.354 Moving to projects directory: /var/lib/boinc/slots/2/ICMGGh7zg+000468 Moving to projects directory: /var/lib/boinc/slots/2/ICMSHh7zg+000468 Moving to projects directory: /var/lib/boinc/slots/2/ICMUAh7zg+000468 18:25:56 STEP 469 H= 117:15 +CPU= 13.607 18:26:10 STEP 470 H= 117:30 +CPU= 13.879 18:26:24 STEP 471 H= 117:45 +CPU= 13.713 18:26:38 STEP 472 H= 118:00 +CPU= 14.042 18:26:52 STEP 473 H= 118:15 +CPU= 13.659 18:27:06 STEP 474 H= 118:30 +CPU= 14.072 18:27:20 STEP 475 H= 118:45 +CPU= 13.789 18:27:34 STEP 476 H= 119:00 +CPU= 13.987 18:27:47 STEP 477 H= 119:15 +CPU= 13.401 18:28:00 STEP 478 H= 119:30 +CPU= 13.477 18:28:14 STEP 479 H= 119:45 +CPU= 13.982 18:28:35 STEP 480 H= 120:00 +CPU= 20.317 Moving to projects directory: /var/lib/boinc/slots/2/ICMGGh7zg+000480 Moving to projects directory: /var/lib/boinc/slots/2/ICMSHh7zg+000480 Moving to projects directory: /var/lib/boinc/slots/2/ICMUAh7zg+000480 Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12292755/ICMGGh7zg+000384 Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12292755/ICMSHh7zg+000384 Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12292755/ICMUAh7zg+000384 Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12292755/ICMGGh7zg+000396 Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12292755/ICMSHh7zg+000396 Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12292755/ICMUAh7zg+000396 Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12292755/ICMGGh7zg+000408 Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12292755/ICMSHh7zg+000408 Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12292755/ICMUAh7zg+000408 Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12292755/ICMGGh7zg+000420 Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12292755/ICMSHh7zg+000420 Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12292755/ICMUAh7zg+000420 Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12292755/ICMGGh7zg+000432 Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12292755/ICMSHh7zg+000432 Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12292755/ICMUAh7zg+000432 Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12292755/ICMGGh7zg+000444 Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12292755/ICMSHh7zg+000444 Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12292755/ICMUAh7zg+000444 Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12292755/ICMGGh7zg+000456 Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12292755/ICMSHh7zg+000456 Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12292755/ICMUAh7zg+000456 Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12292755/ICMGGh7zg+000468 Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12292755/ICMSHh7zg+000468 Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12292755/ICMUAh7zg+000468 Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_a3f0_2016092300_20_1018_12292755_0_r47306190_4.zip Uploading the intermediate file: upload_file_4.zip 18:28:49 STEP 481 H= 120:15 +CPU= 14.293 18:29:03 STEP 482 H= 120:30 +CPU= 13.900 18:29:17 STEP 483 H= 120:45 +CPU= 13.831 18:29:31 STEP 484 H= 121:00 +CPU= 14.354 18:29:45 STEP 485 H= 121:15 +CPU= 13.806 18:29:59 STEP 486 H= 121:30 +CPU= 13.796 18:30:13 STEP 487 H= 121:45 +CPU= 14.058 18:30:27 STEP 488 H= 122:00 +CPU= 14.406 18:30:41 STEP 489 H= 122:15 +CPU= 13.825 18:30:55 STEP 490 H= 122:30 +CPU= 13.867 18:31:09 STEP 491 H= 122:45 +CPU= 13.980 18:31:27 STEP 492 H= 123:00 +CPU= 17.538 Moving to projects directory: /var/lib/boinc/slots/2/ICMGGh7zg+000492 Moving to projects directory: /var/lib/boinc/slots/2/ICMSHh7zg+000492 Moving to projects directory: /var/lib/boinc/slots/2/ICMUAh7zg+000492 18:31:40 STEP 493 H= 123:15 +CPU= 13.481 18:31:54 STEP 494 H= 123:30 +CPU= 13.429 18:32:07 STEP 495 H= 123:45 +CPU= 13.836 18:32:22 STEP 496 H= 124:00 +CPU= 14.644 18:32:36 STEP 497 H= 124:15 +CPU= 13.991 18:32:50 STEP 498 H= 124:30 +CPU= 13.863 18:33:04 STEP 499 H= 124:45 +CPU= 14.249 18:33:19 STEP 500 H= 125:00 +CPU= 14.455 18:33:33 STEP 501 H= 125:15 +CPU= 13.942 18:33:46 STEP 502 H= 125:30 +CPU= 13.615 18:34:00 STEP 503 H= 125:45 +CPU= 13.569 18:34:17 STEP 504 H= 126:00 +CPU= 16.879 Moving to projects directory: /var/lib/boinc/slots/2/ICMGGh7zg+000504 Moving to projects directory: /var/lib/boinc/slots/2/ICMSHh7zg+000504 Moving to projects directory: /var/lib/boinc/slots/2/ICMUAh7zg+000504 18:34:30 STEP 505 H= 126:15 +CPU= 13.296 18:34:43 STEP 506 H= 126:30 +CPU= 12.520 18:34:55 STEP 507 H= 126:45 +CPU= 12.694 18:35:09 STEP 508 H= 127:00 +CPU= 14.188 18:35:23 STEP 509 H= 127:15 +CPU= 13.262 18:35:36 STEP 510 H= 127:30 +CPU= 13.525 18:35:49 STEP 511 H= 127:45 +CPU= 13.004 18:36:03 STEP 512 H= 128:00 +CPU= 13.616 Suspend request received from the BOINC client, suspending the child process Resuming the child process 18:36:37 STEP 513 H= 128:15 +CPU= 12.850 18:36:49 STEP 514 H= 128:30 +CPU= 12.511 18:37:02 STEP 515 H= 128:45 +CPU= 12.884 18:37:19 STEP 516 H= 129:00 +CPU= 16.480 Moving to projects directory: /var/lib/boinc/slots/2/ICMGGh7zg+000516 Moving to projects directory: /var/lib/boinc/slots/2/ICMSHh7zg+000516 Moving to projects directory: /var/lib/boinc/slots/2/ICMUAh7zg+000516 18:37:31 STEP 517 H= 129:15 +CPU= 12.726 18:37:44 STEP 518 H= 129:30 +CPU= 13.049 18:37:57 STEP 519 H= 129:45 +CPU= 12.605 18:38:10 STEP 520 H= 130:00 +CPU= 13.274 18:38:24 STEP 521 H= 130:15 +CPU= 13.579 18:38:37 STEP 522 H= 130:30 +CPU= 13.154 18:38:50 STEP 523 H= 130:45 +CPU= 13.014 18:39:04 STEP 524 H= 131:00 +CPU= 13.510 18:39:17 STEP 525 H= 131:15 +CPU= 13.191 18:39:30 STEP 526 H= 131:30 +CPU= 12.856 18:39:43 STEP 527 H= 131:45 +CPU= 13.144 18:40:03 STEP 528 H= 132:00 +CPU= 20.093 Moving to projects directory: /var/lib/boinc/slots/2/ICMGGh7zg+000528 Moving to projects directory: /var/lib/boinc/slots/2/ICMSHh7zg+000528 Moving to projects directory: /var/lib/boinc/slots/2/ICMUAh7zg+000528 18:40:16 STEP 529 H= 132:15 +CPU= 13.612 18:40:30 STEP 530 H= 132:30 +CPU= 13.318 18:40:43 STEP 531 H= 132:45 +CPU= 13.515 18:40:58 STEP 532 H= 133:00 +CPU= 14.243 18:41:11 STEP 533 H= 133:15 +CPU= 13.441 18:41:24 STEP 534 H= 133:30 +CPU= 13.040 18:41:38 STEP 535 H= 133:45 +CPU= 13.577 18:41:51 STEP 536 H= 134:00 +CPU= 13.477 18:42:05 STEP 537 H= 134:15 +CPU= 13.546 18:42:18 STEP 538 H= 134:30 +CPU= 13.053 18:42:31 STEP 539 H= 134:45 +CPU= 13.184 18:42:47 STEP 540 H= 135:00 +CPU= 16.453 Moving to projects directory: /var/lib/boinc/slots/2/ICMGGh7zg+000540 Moving to projects directory: /var/lib/boinc/slots/2/ICMSHh7zg+000540 Moving to projects directory: /var/lib/boinc/slots/2/ICMUAh7zg+000540 18:43:00 STEP 541 H= 135:15 +CPU= 13.040 18:43:13 STEP 542 H= 135:30 +CPU= 12.698 18:43:26 STEP 543 H= 135:45 +CPU= 13.177 18:43:40 STEP 544 H= 136:00 +CPU= 13.420 18:43:52 STEP 545 H= 136:15 +CPU= 12.726 18:44:05 STEP 546 H= 136:30 +CPU= 12.813 18:44:18 STEP 547 H= 136:45 +CPU= 12.778 18:44:31 STEP 548 H= 137:00 +CPU= 13.191 18:44:44 STEP 549 H= 137:15 +CPU= 12.758 18:44:57 STEP 550 H= 137:30 +CPU= 12.806 18:45:10 STEP 551 H= 137:45 +CPU= 12.837 18:45:26 STEP 552 H= 138:00 +CPU= 16.397 Moving to projects directory: /var/lib/boinc/slots/2/ICMGGh7zg+000552 Moving to projects directory: /var/lib/boinc/slots/2/ICMSHh7zg+000552 Moving to projects directory: /var/lib/boinc/slots/2/ICMUAh7zg+000552 18:45:39 STEP 553 H= 138:15 +CPU= 12.662 18:45:51 STEP 554 H= 138:30 +CPU= 12.778 18:46:04 STEP 555 H= 138:45 +CPU= 12.692 18:46:17 STEP 556 H= 139:00 +CPU= 13.142 18:46:30 STEP 557 H= 139:15 +CPU= 12.531 18:46:42 STEP 558 H= 139:30 +CPU= 12.608 18:46:55 STEP 559 H= 139:45 +CPU= 12.722 18:47:08 STEP 560 H= 140:00 +CPU= 13.198 18:47:21 STEP 561 H= 140:15 +CPU= 12.908 18:47:34 STEP 562 H= 140:30 +CPU= 12.858 18:47:47 STEP 563 H= 140:45 +CPU= 12.831 18:48:04 STEP 564 H= 141:00 +CPU= 16.544 Moving to projects directory: /var/lib/boinc/slots/2/ICMGGh7zg+000564 Moving to projects directory: /var/lib/boinc/slots/2/ICMSHh7zg+000564 Moving to projects directory: /var/lib/boinc/slots/2/ICMUAh7zg+000564 18:48:16 STEP 565 H= 141:15 +CPU= 12.682 18:48:29 STEP 566 H= 141:30 +CPU= 12.788 18:48:42 STEP 567 H= 141:45 +CPU= 12.879 18:48:55 STEP 568 H= 142:00 +CPU= 13.231 18:49:08 STEP 569 H= 142:15 +CPU= 12.874 18:49:21 STEP 570 H= 142:30 +CPU= 12.785 18:49:34 STEP 571 H= 142:45 +CPU= 12.709 18:49:47 STEP 572 H= 143:00 +CPU= 13.312 18:50:00 STEP 573 H= 143:15 +CPU= 12.808 18:50:13 STEP 574 H= 143:30 +CPU= 13.011 18:50:26 STEP 575 H= 143:45 +CPU= 12.905 18:50:44 STEP 576 H= 144:00 +CPU= 18.918 Moving to projects directory: /var/lib/boinc/slots/2/ICMGGh7zg+000576 Moving to projects directory: /var/lib/boinc/slots/2/ICMSHh7zg+000576 Moving to projects directory: /var/lib/boinc/slots/2/ICMUAh7zg+000576 Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12292755/ICMGGh7zg+000480 Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12292755/ICMSHh7zg+000480 Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12292755/ICMUAh7zg+000480 Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12292755/ICMGGh7zg+000492 Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12292755/ICMSHh7zg+000492 Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12292755/ICMUAh7zg+000492 Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12292755/ICMGGh7zg+000504 Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12292755/ICMSHh7zg+000504 Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12292755/ICMUAh7zg+000504 Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12292755/ICMGGh7zg+000516 Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12292755/ICMSHh7zg+000516 Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12292755/ICMUAh7zg+000516 Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12292755/ICMGGh7zg+000528 Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12292755/ICMSHh7zg+000528 Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12292755/ICMUAh7zg+000528 Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12292755/ICMGGh7zg+000540 Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12292755/ICMSHh7zg+000540 Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12292755/ICMUAh7zg+000540 Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12292755/ICMGGh7zg+000552 Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12292755/ICMSHh7zg+000552 Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12292755/ICMUAh7zg+000552 Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12292755/ICMGGh7zg+000564 Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12292755/ICMSHh7zg+000564 Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12292755/ICMUAh7zg+000564 Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_a3f0_2016092300_20_1018_12292755_0_r47306190_5.zip Uploading the intermediate file: upload_file_5.zip 18:50:58 STEP 577 H= 144:15 +CPU= 13.085 18:51:11 STEP 578 H= 144:30 +CPU= 13.095 18:51:24 STEP 579 H= 144:45 +CPU= 12.960 18:51:37 STEP 580 H= 145:00 +CPU= 13.324 18:51:50 STEP 581 H= 145:15 +CPU= 13.122 18:52:03 STEP 582 H= 145:30 +CPU= 12.956 18:52:16 STEP 583 H= 145:45 +CPU= 13.025 18:52:29 STEP 584 H= 146:00 +CPU= 13.418 18:52:42 STEP 585 H= 146:15 +CPU= 12.963 18:52:55 STEP 586 H= 146:30 +CPU= 12.907 18:53:08 STEP 587 H= 146:45 +CPU= 12.841 18:53:25 STEP 588 H= 147:00 +CPU= 16.427 Moving to projects directory: /var/lib/boinc/slots/2/ICMGGh7zg+000588 Moving to projects directory: /var/lib/boinc/slots/2/ICMSHh7zg+000588 Moving to projects directory: /var/lib/boinc/slots/2/ICMUAh7zg+000588 18:53:38 STEP 589 H= 147:15 +CPU= 13.148 18:53:51 STEP 590 H= 147:30 +CPU= 12.963 18:54:04 STEP 591 H= 147:45 +CPU= 12.995 18:54:17 STEP 592 H= 148:00 +CPU= 13.295 18:54:30 STEP 593 H= 148:15 +CPU= 12.868 18:54:43 STEP 594 H= 148:30 +CPU= 12.833 18:54:56 STEP 595 H= 148:45 +CPU= 12.907 18:55:09 STEP 596 H= 149:00 +CPU= 13.289 18:55:22 STEP 597 H= 149:15 +CPU= 12.890 18:55:35 STEP 598 H= 149:30 +CPU= 12.866 18:55:48 STEP 599 H= 149:45 +CPU= 12.929 18:56:04 STEP 600 H= 150:00 +CPU= 16.628 Moving to projects directory: /var/lib/boinc/slots/2/ICMGGh7zg+000600 Moving to projects directory: /var/lib/boinc/slots/2/ICMSHh7zg+000600 Moving to projects directory: /var/lib/boinc/slots/2/ICMUAh7zg+000600 18:56:17 STEP 601 H= 150:15 +CPU= 12.888 18:56:30 STEP 602 H= 150:30 +CPU= 13.002 18:56:43 STEP 603 H= 150:45 +CPU= 12.964 18:56:56 STEP 604 H= 151:00 +CPU= 13.295 18:57:09 STEP 605 H= 151:15 +CPU= 12.907 18:57:22 STEP 606 H= 151:30 +CPU= 12.949 18:57:35 STEP 607 H= 151:45 +CPU= 12.897 18:57:48 STEP 608 H= 152:00 +CPU= 13.201 18:58:01 STEP 609 H= 152:15 +CPU= 12.887 18:58:14 STEP 610 H= 152:30 +CPU= 12.947 18:58:27 STEP 611 H= 152:45 +CPU= 12.880 18:58:44 STEP 612 H= 153:00 +CPU= 16.659 Moving to projects directory: /var/lib/boinc/slots/2/ICMGGh7zg+000612 Moving to projects directory: /var/lib/boinc/slots/2/ICMSHh7zg+000612 Moving to projects directory: /var/lib/boinc/slots/2/ICMUAh7zg+000612 18:58:57 STEP 613 H= 153:15 +CPU= 12.915 18:59:10 STEP 614 H= 153:30 +CPU= 12.899 18:59:23 STEP 615 H= 153:45 +CPU= 12.866 18:59:36 STEP 616 H= 154:00 +CPU= 13.368 18:59:49 STEP 617 H= 154:15 +CPU= 12.899 19:00:02 STEP 618 H= 154:30 +CPU= 12.988 19:00:15 STEP 619 H= 154:45 +CPU= 12.951 19:00:28 STEP 620 H= 155:00 +CPU= 13.396 19:00:41 STEP 621 H= 155:15 +CPU= 12.925 19:00:54 STEP 622 H= 155:30 +CPU= 13.011 19:01:07 STEP 623 H= 155:45 +CPU= 12.903 19:01:27 STEP 624 H= 156:00 +CPU= 19.541 Moving to projects directory: /var/lib/boinc/slots/2/ICMGGh7zg+000624 Moving to projects directory: /var/lib/boinc/slots/2/ICMSHh7zg+000624 Moving to projects directory: /var/lib/boinc/slots/2/ICMUAh7zg+000624 19:01:40 STEP 625 H= 156:15 +CPU= 13.163 19:01:53 STEP 626 H= 156:30 +CPU= 13.586 19:02:06 STEP 627 H= 156:45 +CPU= 13.183 19:02:20 STEP 628 H= 157:00 +CPU= 13.709 19:02:33 STEP 629 H= 157:15 +CPU= 13.130 19:02:47 STEP 630 H= 157:30 +CPU= 13.318 19:03:00 STEP 631 H= 157:45 +CPU= 13.055 19:03:13 STEP 632 H= 158:00 +CPU= 13.466 19:03:26 STEP 633 H= 158:15 +CPU= 13.089 19:03:39 STEP 634 H= 158:30 +CPU= 13.121 19:03:52 STEP 635 H= 158:45 +CPU= 12.969 19:04:09 STEP 636 H= 159:00 +CPU= 16.522 Moving to projects directory: /var/lib/boinc/slots/2/ICMGGh7zg+000636 Moving to projects directory: /var/lib/boinc/slots/2/ICMSHh7zg+000636 Moving to projects directory: /var/lib/boinc/slots/2/ICMUAh7zg+000636 19:04:22 STEP 637 H= 159:15 +CPU= 12.992 19:04:35 STEP 638 H= 159:30 +CPU= 13.000 19:04:48 STEP 639 H= 159:45 +CPU= 12.961 19:05:01 STEP 640 H= 160:00 +CPU= 13.314 19:05:14 STEP 641 H= 160:15 +CPU= 12.844 19:05:27 STEP 642 H= 160:30 +CPU= 12.955 19:05:40 STEP 643 H= 160:45 +CPU= 12.927 19:05:53 STEP 644 H= 161:00 +CPU= 13.333 19:06:06 STEP 645 H= 161:15 +CPU= 13.015 19:06:19 STEP 646 H= 161:30 +CPU= 12.919 19:06:32 STEP 647 H= 161:45 +CPU= 12.981 19:06:49 STEP 648 H= 162:00 +CPU= 16.508 Moving to projects directory: /var/lib/boinc/slots/2/ICMGGh7zg+000648 Moving to projects directory: /var/lib/boinc/slots/2/ICMSHh7zg+000648 Moving to projects directory: /var/lib/boinc/slots/2/ICMUAh7zg+000648 19:07:02 STEP 649 H= 162:15 +CPU= 12.981 19:07:15 STEP 650 H= 162:30 +CPU= 12.962 19:07:28 STEP 651 H= 162:45 +CPU= 12.889 19:07:41 STEP 652 H= 163:00 +CPU= 13.438 19:07:54 STEP 653 H= 163:15 +CPU= 13.020 19:08:07 STEP 654 H= 163:30 +CPU= 13.101 19:08:20 STEP 655 H= 163:45 +CPU= 12.972 19:08:33 STEP 656 H= 164:00 +CPU= 13.294 19:08:46 STEP 657 H= 164:15 +CPU= 13.008 19:08:59 STEP 658 H= 164:30 +CPU= 13.012 19:09:12 STEP 659 H= 164:45 +CPU= 12.848 19:09:29 STEP 660 H= 165:00 +CPU= 16.544 Moving to projects directory: /var/lib/boinc/slots/2/ICMGGh7zg+000660 Moving to projects directory: /var/lib/boinc/slots/2/ICMSHh7zg+000660 Moving to projects directory: /var/lib/boinc/slots/2/ICMUAh7zg+000660 19:09:42 STEP 661 H= 165:15 +CPU= 12.983 19:09:55 STEP 662 H= 165:30 +CPU= 13.045 19:10:09 STEP 663 H= 165:45 +CPU= 13.764 19:10:22 STEP 664 H= 166:00 +CPU= 13.805 19:10:36 STEP 665 H= 166:15 +CPU= 13.561 19:10:50 STEP 666 H= 166:30 +CPU= 13.669 19:11:03 STEP 667 H= 166:45 +CPU= 13.256 19:11:17 STEP 668 H= 167:00 +CPU= 14.143 19:11:30 STEP 669 H= 167:15 +CPU= 13.013 19:11:43 STEP 670 H= 167:30 +CPU= 13.051 19:11:56 STEP 671 H= 167:45 +CPU= 13.075 19:12:15 STEP 672 H= 168:00 +CPU= 19.260 Moving to projects directory: /var/lib/boinc/slots/2/ICMGGh7zg+000672 Moving to projects directory: /var/lib/boinc/slots/2/ICMSHh7zg+000672 Moving to projects directory: /var/lib/boinc/slots/2/ICMUAh7zg+000672 Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12292755/ICMGGh7zg+000576 Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12292755/ICMSHh7zg+000576 Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12292755/ICMUAh7zg+000576 Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12292755/ICMGGh7zg+000588 Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12292755/ICMSHh7zg+000588 Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12292755/ICMUAh7zg+000588 Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12292755/ICMGGh7zg+000600 Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12292755/ICMSHh7zg+000600 Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12292755/ICMUAh7zg+000600 Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12292755/ICMGGh7zg+000612 Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12292755/ICMSHh7zg+000612 Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12292755/ICMUAh7zg+000612 Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12292755/ICMGGh7zg+000624 Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12292755/ICMSHh7zg+000624 Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12292755/ICMUAh7zg+000624 Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12292755/ICMGGh7zg+000636 Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12292755/ICMSHh7zg+000636 Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12292755/ICMUAh7zg+000636 Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12292755/ICMGGh7zg+000648 Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12292755/ICMSHh7zg+000648 Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12292755/ICMUAh7zg+000648 Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12292755/ICMGGh7zg+000660 Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12292755/ICMSHh7zg+000660 Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12292755/ICMUAh7zg+000660 Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_a3f0_2016092300_20_1018_12292755_0_r47306190_6.zip Uploading the intermediate file: upload_file_6.zip 19:12:29 STEP 673 H= 168:15 +CPU= 13.143 19:12:42 STEP 674 H= 168:30 +CPU= 13.074 19:12:55 STEP 675 H= 168:45 +CPU= 13.223 19:13:09 STEP 676 H= 169:00 +CPU= 13.754 19:13:22 STEP 677 H= 169:15 +CPU= 13.315 19:13:36 STEP 678 H= 169:30 +CPU= 13.818 19:13:49 STEP 679 H= 169:45 +CPU= 13.025 19:14:02 STEP 680 H= 170:00 +CPU= 13.548 19:14:16 STEP 681 H= 170:15 +CPU= 13.221 19:14:29 STEP 682 H= 170:30 +CPU= 13.473 19:14:42 STEP 683 H= 170:45 +CPU= 13.156 19:14:59 STEP 684 H= 171:00 +CPU= 17.029 Moving to projects directory: /var/lib/boinc/slots/2/ICMGGh7zg+000684 Moving to projects directory: /var/lib/boinc/slots/2/ICMSHh7zg+000684 Moving to projects directory: /var/lib/boinc/slots/2/ICMUAh7zg+000684 19:15:13 STEP 685 H= 171:15 +CPU= 13.653 19:15:27 STEP 686 H= 171:30 +CPU= 13.919 19:15:41 STEP 687 H= 171:45 +CPU= 14.306 19:15:55 STEP 688 H= 172:00 +CPU= 14.277 19:16:09 STEP 689 H= 172:15 +CPU= 13.792 19:16:23 STEP 690 H= 172:30 +CPU= 14.150 19:16:37 STEP 691 H= 172:45 +CPU= 13.552 19:16:50 STEP 692 H= 173:00 +CPU= 13.533 19:17:03 STEP 693 H= 173:15 +CPU= 12.977 19:17:17 STEP 694 H= 173:30 +CPU= 13.044 19:17:30 STEP 695 H= 173:45 +CPU= 13.057 19:17:46 STEP 696 H= 174:00 +CPU= 16.640 Moving to projects directory: /var/lib/boinc/slots/2/ICMGGh7zg+000696 Moving to projects directory: /var/lib/boinc/slots/2/ICMSHh7zg+000696 Moving to projects directory: /var/lib/boinc/slots/2/ICMUAh7zg+000696 19:17:59 STEP 697 H= 174:15 +CPU= 13.148 19:18:13 STEP 698 H= 174:30 +CPU= 13.190 19:18:26 STEP 699 H= 174:45 +CPU= 13.167 19:18:39 STEP 700 H= 175:00 +CPU= 13.484 19:18:52 STEP 701 H= 175:15 +CPU= 13.075 19:19:06 STEP 702 H= 175:30 +CPU= 13.299 19:19:19 STEP 703 H= 175:45 +CPU= 13.278 19:19:32 STEP 704 H= 176:00 +CPU= 13.547 19:19:46 STEP 705 H= 176:15 +CPU= 13.318 19:19:59 STEP 706 H= 176:30 +CPU= 13.295 19:20:12 STEP 707 H= 176:45 +CPU= 13.427 19:20:29 STEP 708 H= 177:00 +CPU= 16.942 Moving to projects directory: /var/lib/boinc/slots/2/ICMGGh7zg+000708 Moving to projects directory: /var/lib/boinc/slots/2/ICMSHh7zg+000708 Moving to projects directory: /var/lib/boinc/slots/2/ICMUAh7zg+000708 19:20:43 STEP 709 H= 177:15 +CPU= 13.297 19:20:56 STEP 710 H= 177:30 +CPU= 13.282 19:21:09 STEP 711 H= 177:45 +CPU= 13.174 19:21:23 STEP 712 H= 178:00 +CPU= 14.155 19:21:37 STEP 713 H= 178:15 +CPU= 13.394 19:21:50 STEP 714 H= 178:30 +CPU= 13.583 19:22:04 STEP 715 H= 178:45 +CPU= 13.446 19:22:18 STEP 716 H= 179:00 +CPU= 13.721 19:22:31 STEP 717 H= 179:15 +CPU= 13.212 19:22:44 STEP 718 H= 179:30 +CPU= 13.107 19:22:57 STEP 719 H= 179:45 +CPU= 13.118 19:23:16 STEP 720 H= 180:00 +CPU= 19.244 Moving to projects directory: /var/lib/boinc/slots/2/ICMGGh7zg+000720 Moving to projects directory: /var/lib/boinc/slots/2/ICMSHh7zg+000720 Moving to projects directory: /var/lib/boinc/slots/2/ICMUAh7zg+000720 19:23:30 STEP 721 H= 180:15 +CPU= 13.293 19:23:43 STEP 722 H= 180:30 +CPU= 13.303 19:23:56 STEP 723 H= 180:45 +CPU= 13.249 19:24:10 STEP 724 H= 181:00 +CPU= 13.830 19:24:23 STEP 725 H= 181:15 +CPU= 13.362 19:24:37 STEP 726 H= 181:30 +CPU= 13.305 19:24:50 STEP 727 H= 181:45 +CPU= 13.242 19:25:03 STEP 728 H= 182:00 +CPU= 13.635 19:25:17 STEP 729 H= 182:15 +CPU= 13.265 19:25:30 STEP 730 H= 182:30 +CPU= 13.271 19:25:43 STEP 731 H= 182:45 +CPU= 13.121 19:26:00 STEP 732 H= 183:00 +CPU= 16.741 Moving to projects directory: /var/lib/boinc/slots/2/ICMGGh7zg+000732 Moving to projects directory: /var/lib/boinc/slots/2/ICMSHh7zg+000732 Moving to projects directory: /var/lib/boinc/slots/2/ICMUAh7zg+000732 19:26:13 STEP 733 H= 183:15 +CPU= 13.259 19:26:27 STEP 734 H= 183:30 +CPU= 13.400 19:26:40 STEP 735 H= 183:45 +CPU= 13.286 19:26:53 STEP 736 H= 184:00 +CPU= 13.593 19:27:07 STEP 737 H= 184:15 +CPU= 13.267 19:27:20 STEP 738 H= 184:30 +CPU= 13.253 19:27:33 STEP 739 H= 184:45 +CPU= 13.218 19:27:47 STEP 740 H= 185:00 +CPU= 13.620 19:28:00 STEP 741 H= 185:15 +CPU= 13.149 19:28:13 STEP 742 H= 185:30 +CPU= 13.259 19:28:26 STEP 743 H= 185:45 +CPU= 13.207 19:28:43 STEP 744 H= 186:00 +CPU= 16.815 Moving to projects directory: /var/lib/boinc/slots/2/ICMGGh7zg+000744 Moving to projects directory: /var/lib/boinc/slots/2/ICMSHh7zg+000744 Moving to projects directory: /var/lib/boinc/slots/2/ICMUAh7zg+000744 19:28:56 STEP 745 H= 186:15 +CPU= 13.257 19:29:10 STEP 746 H= 186:30 +CPU= 13.315 19:29:23 STEP 747 H= 186:45 +CPU= 13.218 19:29:37 STEP 748 H= 187:00 +CPU= 13.699 19:29:50 STEP 749 H= 187:15 +CPU= 13.256 19:30:03 STEP 750 H= 187:30 +CPU= 13.157 19:30:17 STEP 751 H= 187:45 +CPU= 13.371 19:30:30 STEP 752 H= 188:00 +CPU= 13.642 19:30:43 STEP 753 H= 188:15 +CPU= 13.300 19:30:57 STEP 754 H= 188:30 +CPU= 13.299 19:31:10 STEP 755 H= 188:45 +CPU= 13.252 19:31:27 STEP 756 H= 189:00 +CPU= 16.832 Moving to projects directory: /var/lib/boinc/slots/2/ICMGGh7zg+000756 Moving to projects directory: /var/lib/boinc/slots/2/ICMSHh7zg+000756 Moving to projects directory: /var/lib/boinc/slots/2/ICMUAh7zg+000756 19:31:40 STEP 757 H= 189:15 +CPU= 13.411 19:31:53 STEP 758 H= 189:30 +CPU= 13.206 19:32:07 STEP 759 H= 189:45 +CPU= 13.100 19:32:20 STEP 760 H= 190:00 +CPU= 13.590 19:32:33 STEP 761 H= 190:15 +CPU= 13.229 19:32:46 STEP 762 H= 190:30 +CPU= 13.045 19:33:00 STEP 763 H= 190:45 +CPU= 13.242 19:33:13 STEP 764 H= 191:00 +CPU= 13.588 19:33:26 STEP 765 H= 191:15 +CPU= 13.093 19:33:39 STEP 766 H= 191:30 +CPU= 13.125 19:33:53 STEP 767 H= 191:45 +CPU= 13.166 19:34:12 STEP 768 H= 192:00 +CPU= 19.318 Moving to projects directory: /var/lib/boinc/slots/2/ICMGGh7zg+000768 Moving to projects directory: /var/lib/boinc/slots/2/ICMSHh7zg+000768 Moving to projects directory: /var/lib/boinc/slots/2/ICMUAh7zg+000768 Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12292755/ICMGGh7zg+000672 Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12292755/ICMSHh7zg+000672 Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12292755/ICMUAh7zg+000672 Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12292755/ICMGGh7zg+000684 Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12292755/ICMSHh7zg+000684 Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12292755/ICMUAh7zg+000684 Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12292755/ICMGGh7zg+000696 Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12292755/ICMSHh7zg+000696 Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12292755/ICMUAh7zg+000696 Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12292755/ICMGGh7zg+000708 Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12292755/ICMSHh7zg+000708 Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12292755/ICMUAh7zg+000708 Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12292755/ICMGGh7zg+000720 Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12292755/ICMSHh7zg+000720 Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12292755/ICMUAh7zg+000720 Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12292755/ICMGGh7zg+000732 Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12292755/ICMSHh7zg+000732 Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12292755/ICMUAh7zg+000732 Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12292755/ICMGGh7zg+000744 Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12292755/ICMSHh7zg+000744 Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12292755/ICMUAh7zg+000744 Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12292755/ICMGGh7zg+000756 Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12292755/ICMSHh7zg+000756 Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12292755/ICMUAh7zg+000756 Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_a3f0_2016092300_20_1018_12292755_0_r47306190_7.zip Uploading the intermediate file: upload_file_7.zip 19:34:25 STEP 769 H= 192:15 +CPU= 13.220 19:34:38 STEP 770 H= 192:30 +CPU= 13.130 19:34:52 STEP 771 H= 192:45 +CPU= 13.254 19:35:05 STEP 772 H= 193:00 +CPU= 13.642 19:35:18 STEP 773 H= 193:15 +CPU= 13.209 19:35:32 STEP 774 H= 193:30 +CPU= 13.165 19:35:45 STEP 775 H= 193:45 +CPU= 13.321 19:35:59 STEP 776 H= 194:00 +CPU= 13.850 19:36:12 STEP 777 H= 194:15 +CPU= 13.334 19:36:25 STEP 778 H= 194:30 +CPU= 13.339 19:36:39 STEP 779 H= 194:45 +CPU= 13.332 19:36:56 STEP 780 H= 195:00 +CPU= 16.955 Moving to projects directory: /var/lib/boinc/slots/2/ICMGGh7zg+000780 Moving to projects directory: /var/lib/boinc/slots/2/ICMSHh7zg+000780 Moving to projects directory: /var/lib/boinc/slots/2/ICMUAh7zg+000780 19:37:09 STEP 781 H= 195:15 +CPU= 13.646 19:37:23 STEP 782 H= 195:30 +CPU= 13.433 19:37:36 STEP 783 H= 195:45 +CPU= 13.308 19:37:50 STEP 784 H= 196:00 +CPU= 13.666 19:38:03 STEP 785 H= 196:15 +CPU= 13.356 19:38:16 STEP 786 H= 196:30 +CPU= 13.244 19:38:30 STEP 787 H= 196:45 +CPU= 13.130 19:38:43 STEP 788 H= 197:00 +CPU= 13.444 19:38:56 STEP 789 H= 197:15 +CPU= 13.154 19:39:09 STEP 790 H= 197:30 +CPU= 13.238 19:39:23 STEP 791 H= 197:45 +CPU= 13.160 19:39:39 STEP 792 H= 198:00 +CPU= 16.717 Moving to projects directory: /var/lib/boinc/slots/2/ICMGGh7zg+000792 Moving to projects directory: /var/lib/boinc/slots/2/ICMSHh7zg+000792 Moving to projects directory: /var/lib/boinc/slots/2/ICMUAh7zg+000792 19:39:53 STEP 793 H= 198:15 +CPU= 13.368 19:40:06 STEP 794 H= 198:30 +CPU= 13.146 19:40:19 STEP 795 H= 198:45 +CPU= 13.273 19:40:33 STEP 796 H= 199:00 +CPU= 13.610 19:40:46 STEP 797 H= 199:15 +CPU= 13.274 19:40:59 STEP 798 H= 199:30 +CPU= 13.193 19:41:13 STEP 799 H= 199:45 +CPU= 13.355 19:41:26 STEP 800 H= 200:00 +CPU= 13.805 19:41:40 STEP 801 H= 200:15 +CPU= 13.395 19:41:53 STEP 802 H= 200:30 +CPU= 13.156 19:42:06 STEP 803 H= 200:45 +CPU= 13.460 19:42:24 STEP 804 H= 201:00 +CPU= 17.591 Moving to projects directory: /var/lib/boinc/slots/2/ICMGGh7zg+000804 Moving to projects directory: /var/lib/boinc/slots/2/ICMSHh7zg+000804 Moving to projects directory: /var/lib/boinc/slots/2/ICMUAh7zg+000804 19:42:38 STEP 805 H= 201:15 +CPU= 13.779 19:42:51 STEP 806 H= 201:30 +CPU= 13.289 19:43:05 STEP 807 H= 201:45 +CPU= 13.500 19:43:18 STEP 808 H= 202:00 +CPU= 13.590 19:43:31 STEP 809 H= 202:15 +CPU= 13.345 19:43:45 STEP 810 H= 202:30 +CPU= 13.210 19:43:58 STEP 811 H= 202:45 +CPU= 13.258 19:44:11 STEP 812 H= 203:00 +CPU= 13.515 19:44:25 STEP 813 H= 203:15 +CPU= 13.197 [EC_DRHOOK:cheong-fun:1:1:280375:280375] [20240624:194431:1719283471:10834.000] [signal_drhook@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1538] Received signal#8 (SIGFPE) :: 4412MB (heap), 5564MB (maxrss), 0MB (maxstack), 0 (paging), nsigs = 1 [EC_DRHOOK:cheong-fun:1:1:280375:280375] [20240624:194431:1719283471:10834.002] [signal_drhook@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1542] Also activating Harakiri-alarm (SIGALRM=14) to expire after 500s elapsed to prevent hangs, nsigs = 1 [EC_DRHOOK:cheong-fun:1:1:280375:280375] [20240624:194431:1719283471:10834.002] [signal_drhook@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1544] Harakiri signal handler 'signal_harakiri' for signal#14 (SIGALRM) installed at 0x820890 (old at (nil)) [EC_DRHOOK:cheong-fun:1:1:280375:280375] [20240624:194431:1719283471:10834.002] [signal_drhook@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1617] Signal#8 was caused by floating-point overflow [memaddr=0x1cc6692], nsigs = 1 [EC_DRHOOK:cheong-fun:1:1:280375:280375] [20240624:194431:1719283471:10834.002] [signal_drhook@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1686] Starting DrHook backtrace for signal#8, nsigs = 1 [EC_DRHOOK:cheong-fun:1:1:280375:280375] [20240624:194431:1719283471:10834.002] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3843] 4412 MB (maxheap), 5564 MB (maxrss), 0 MB (maxstack) [EC_DRHOOK:cheong-fun:1:1:280375:280375] [20240624:194431:1719283471:10834.003] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] : MASTER [EC_DRHOOK:cheong-fun:1:1:280375:280375] [20240624:194431:1719283471:10834.003] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] : CNT0 [EC_DRHOOK:cheong-fun:1:1:280375:280375] [20240624:194431:1719283471:10834.003] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] : CNT1 [EC_DRHOOK:cheong-fun:1:1:280375:280375] [20240624:194431:1719283471:10834.003] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] : CNT2 [EC_DRHOOK:cheong-fun:1:1:280375:280375] [20240624:194431:1719283471:10834.003] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] : CNT3 [EC_DRHOOK:cheong-fun:1:1:280375:280375] [20240624:194431:1719283471:10834.003] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] : CNT4 [EC_DRHOOK:cheong-fun:1:1:280375:280375] [20240624:194431:1719283471:10834.003] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] : STEPO [EC_DRHOOK:cheong-fun:1:1:280375:280375] [20240624:194431:1719283471:10834.003] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] : SCAN2M [EC_DRHOOK:cheong-fun:1:1:280375:280375] [20240624:194431:1719283471:10834.003] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] : GP_MODEL_HEAP [EC_DRHOOK:cheong-fun:1:1:280375:280375] [20240624:194431:1719283471:10834.003] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] : GP_MODEL [EC_DRHOOK:cheong-fun:1:1:280375:280375] [20240624:194431:1719283471:10834.003] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] : EC_PHYS_DRV [EC_DRHOOK:cheong-fun:1:1:280375:280375] [20240624:194431:1719283471:10834.003] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] : >OMP-PHYSICS (1001) [EC_DRHOOK:cheong-fun:1:1:280375:280375] [20240624:194431:1719283471:10834.003] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] : EC_PHYS [EC_DRHOOK:cheong-fun:1:1:280375:280375] [20240624:194431:1719283471:10834.003] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] : CALLPAR [EC_DRHOOK:cheong-fun:1:1:280375:280375] [20240624:194431:1719283471:10834.003] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] : TURBULENCE_LAYER [EC_DRHOOK:cheong-fun:1:1:280375:280375] [20240624:194431:1719283471:10834.003] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] : VDFOUTER [EC_DRHOOK:cheong-fun:1:1:280375:280375] [20240624:194431:1719283471:10834.003] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] : VDFMAIN [EC_DRHOOK:cheong-fun:1:1:280375:280375] [20240624:194432:1719283472:10835.004] [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:240] Backtrace(s) for program '/var/lib/boinc/slots/2/oifs_43r3_model.exe' : sigcontextptr=0x7ffe1c427510 [EC_DRHOOK:cheong-fun:1:1:280375:280375] [20240624:194432:1719283472:10835.004] [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:277] Backtrace (size = 24) with plain hex-dump [EC_DRHOOK:cheong-fun:1:1:280375:280375] [20240624:194432:1719283472:10835.004] [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:340] [0]: [0x83a8f3] : 0x83a8f3 [EC_DRHOOK:cheong-fun:1:1:280375:280375] [20240624:194432:1719283472:10835.004] [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:340] [1]: [0x83aef9] : 0x83aef9 [EC_DRHOOK:cheong-fun:1:1:280375:280375] [20240624:194432:1719283472:10835.004] [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:340] [2]: [0x1dd5490] : 0x1dd5490 [EC_DRHOOK:cheong-fun:1:1:280375:280375] [20240624:194432:1719283472:10835.004] [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:340] [3]: [0x1cc6692] : 0x1cc6692 [EC_DRHOOK:cheong-fun:1:1:280375:280375] [20240624:194432:1719283472:10835.004] [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:340] [4]: [0x121fd8b] : 0x121fd8b [EC_DRHOOK:cheong-fun:1:1:280375:280375] [20240624:194432:1719283472:10835.004] [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:340] [5]: [0x1207e29] : 0x1207e29 [EC_DRHOOK:cheong-fun:1:1:280375:280375] [20240624:194432:1719283472:10835.004] [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:340] [6]: [0x11fdcb2] : 0x11fdcb2 [EC_DRHOOK:cheong-fun:1:1:280375:280375] [20240624:194432:1719283472:10835.004] [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:340] [7]: [0xfac003] : 0xfac003 [EC_DRHOOK:cheong-fun:1:1:280375:280375] [20240624:194432:1719283472:10835.004] [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:340] [8]: [0xf5fa6b] : 0xf5fa6b [EC_DRHOOK:cheong-fun:1:1:280375:280375] [20240624:194432:1719283472:10835.004] [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:340] [9]: [0xf4dbc4] : 0xf4dbc4 [EC_DRHOOK:cheong-fun:1:1:280375:280375] [20240624:194432:1719283472:10835.004] [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:340] [10]: [0xbd7131] : 0xbd7131 [EC_DRHOOK:cheong-fun:1:1:280375:280375] [20240624:194432:1719283472:10835.004] [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:340] [11]: [0x12c5002] : 0x12c5002 [EC_DRHOOK:cheong-fun:1:1:280375:280375] [20240624:194432:1719283472:10835.004] [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:340] [12]: [0xbacbae] : 0xbacbae [EC_DRHOOK:cheong-fun:1:1:280375:280375] [20240624:194432:1719283472:10835.004] [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:340] [13]: [0x688153] : 0x688153 [EC_DRHOOK:cheong-fun:1:1:280375:280375] [20240624:194432:1719283472:10835.004] [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:340] [14]: [0x4cd1dc] : 0x4cd1dc [EC_DRHOOK:cheong-fun:1:1:280375:280375] [20240624:194432:1719283472:10835.004] [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:340] [15]: [0x4b5d85] : 0x4b5d85 [EC_DRHOOK:cheong-fun:1:1:280375:280375] [20240624:194432:1719283472:10835.004] [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:340] [16]: [0x4b4f52] : 0x4b4f52 [EC_DRHOOK:cheong-fun:1:1:280375:280375] [20240624:194432:1719283472:10835.004] [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:340] [17]: [0x49d638] : 0x49d638 [EC_DRHOOK:cheong-fun:1:1:280375:280375] [20240624:194432:1719283472:10835.004] [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:340] [18]: [0x406fbd] : 0x406fbd [EC_DRHOOK:cheong-fun:1:1:280375:280375] [20240624:194432:1719283472:10835.004] [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:340] [19]: [0x401e7f] : 0x401e7f [EC_DRHOOK:cheong-fun:1:1:280375:280375] [20240624:194432:1719283472:10835.004] [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:340] [20]: [0x401e12] : 0x401e12 [EC_DRHOOK:cheong-fun:1:1:280375:280375] [20240624:194432:1719283472:10835.004] [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:340] [21]: [0x1dcc34a] : 0x1dcc34a [EC_DRHOOK:cheong-fun:1:1:280375:280375] [20240624:194432:1719283472:10835.004] [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:340] [22]: [0x1dcdbe7] : 0x1dcdbe7 [EC_DRHOOK:cheong-fun:1:1:280375:280375] [20240624:194432:1719283472:10835.004] [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:340] [23]: [0x401cd5] : 0x401cd5 [EC_DRHOOK:cheong-fun:1:1:280375:280375] [20240624:194432:1719283472:10835.004] [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:370] End of backtrace(s) Process 1 thread 1 calling linux_trbk from intel_trbk() [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:240] Backtrace(s) for program '/var/lib/boinc/slots/2/oifs_43r3_model.exe' : sigcontextptr=0x7ffe1c427420 [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:277] Backtrace (size = 25) with plain hex-dump [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:340] [0]: [0x83a8f3] : 0x83a8f3 [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:340] [1]: [0x83aef9] : 0x83aef9 [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:340] [2]: [0x822540] : 0x822540 [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:340] [3]: [0x1dd5490] : 0x1dd5490 [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:340] [4]: [0x1cc6692] : 0x1cc6692 [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:340] [5]: [0x121fd8b] : 0x121fd8b [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:340] [6]: [0x1207e29] : 0x1207e29 [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:340] [7]: [0x11fdcb2] : 0x11fdcb2 [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:340] [8]: [0xfac003] : 0xfac003 [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:340] [9]: [0xf5fa6b] : 0xf5fa6b [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:340] [10]: [0xf4dbc4] : 0xf4dbc4 [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:340] [11]: [0xbd7131] : 0xbd7131 [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:340] [12]: [0x12c5002] : 0x12c5002 [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:340] [13]: [0xbacbae] : 0xbacbae [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:340] [14]: [0x688153] : 0x688153 [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:340] [15]: [0x4cd1dc] : 0x4cd1dc [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:340] [16]: [0x4b5d85] : 0x4b5d85 [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:340] [17]: [0x4b4f52] : 0x4b4f52 [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:340] [18]: [0x49d638] : 0x49d638 [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:340] [19]: [0x406fbd] : 0x406fbd [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:340] [20]: [0x401e7f] : 0x401e7f [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:340] [21]: [0x401e12] : 0x401e12 [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:340] [22]: [0x1dcc34a] : 0x1dcc34a [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:340] [23]: [0x1dcdbe7] : 0x1dcdbe7 [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:340] [24]: [0x401cd5] : 0x401cd5 [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:370] End of backtrace(s) [EC_DRHOOK:cheong-fun:1:1:280375:280375] [20240624:194432:1719283472:10835.017] [signal_drhook@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1734] DrHook backtrace done for signal#8, nsigs = 1 [EC_DRHOOK:cheong-fun:1:1:280375:280375] [20240624:194432:1719283472:10835.017] [signal_drhook@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1785] Calling previous signal handler at 0x1cf8da0 for signal#8, nsigs = 1 forrtl: error (72): floating overflow Image PC Routine Line Source oifs_43r3_model.e 0000000001CF935B Unknown Unknown Unknown oifs_43r3_model.e 00000000008214C1 Unknown Unknown Unknown oifs_43r3_model.e 0000000001DD5490 Unknown Unknown Unknown oifs_43r3_model.e 0000000001CC6692 Unknown Unknown Unknown oifs_43r3_model.e 000000000121FD8B vdfmain_ 874 vdfmain.F90 oifs_43r3_model.e 0000000001207E29 vdfouter_ 739 vdfouter.F90 oifs_43r3_model.e 00000000011FDCB2 turbulence_layer_ 158 turbulence_layer.F90 oifs_43r3_model.e 0000000000FAC003 callpar_ 869 callpar.F90 oifs_43r3_model.e 0000000000F5FA6B ec_phys_ 670 ec_phys.F90 oifs_43r3_model.e 0000000000F4DBC4 ec_phys_drv_ 599 ec_phys_drv.F90 oifs_43r3_model.e 0000000000BD7131 gp_model_ 613 gp_model.F90 oifs_43r3_model.e 00000000012C5002 gp_model_heap_ 74 gp_model_heap.F90 oifs_43r3_model.e 0000000000BACBAE scan2m_ 535 scan2m.F90 oifs_43r3_model.e 0000000000688153 stepo_ 327 stepo.F90 oifs_43r3_model.e 00000000004CD1DC cnt4_ 1133 cnt4.F90 oifs_43r3_model.e 00000000004B5D85 cnt3_ 267 cnt3.F90 oifs_43r3_model.e 00000000004B4F52 cnt2_ 88 cnt2.F90 oifs_43r3_model.e 000000000049D638 cnt1_ 92 cnt1.F90 oifs_43r3_model.e 0000000000406FBD cnt0_ 146 cnt0.F90 oifs_43r3_model.e 0000000000401E7F MAIN__ 96 master.F90 oifs_43r3_model.e 0000000000401E12 Unknown Unknown Unknown oifs_43r3_model.e 0000000001DCC34A Unknown Unknown Unknown oifs_43r3_model.e 0000000001DCDBE7 Unknown Unknown Unknown oifs_43r3_model.e 0000000000401CD5 Unknown Unknown Unknown ..The child process has been killed with signal: 6 >>> Printing last 70 lines from file: NODE.001_01 AVE 0.674881899773880E-05 0.000000000000000E+00 0.208575625642168E-01 GPNORM SFL AVERAGE MINIMUM MAXIMUM AVE 0.839112379390870E-05 0.000000000000000E+00 0.693933898321451E-02 GPNORM CRFL AVERAGE MINIMUM MAXIMUM AVE 0.194274025907302E-05 0.000000000000000E+00 0.158146199311095E-01 GPNORM CSFL AVERAGE MINIMUM MAXIMUM AVE 0.914118914997818E-06 0.000000000000000E+00 0.946078032778046E-02 GPNORM PFRC AVERAGE MINIMUM MAXIMUM AVE 0.132605244708554E+00 0.000000000000000E+00 0.100000000000000E+01 NSTEP = 804 STEPO A00000000 MAXGPFV : MAX. VALUE = 0.000000000000000E+000 MAXGPFV : MAX. VALUE = 0.000000000000000E+000 NSTEP = 804 SCAN2M_HPOS P IO-STREAM SETUP - IOTYPE = 2 NUMIOPROCS = 1 CPATH = ICMGGh7zg+000804 MODE=w IO-STREAM CLOSED - ICMGGh7zg+000804 MPI-TASK: 1 - 300003252 BYTES IN 6 RECORDS TRANSFERRED IN 0.0005 SECONDS600006.5 Mbytes/s, TOTAL TIME= 0.0057( 8.8%) NSTEP = 804 STEPO 0AA000000 IO-STREAM SETUP - IOTYPE = 2 NUMIOPROCS = 1 CPATH = ./ICMSHh7zg+000804 MODE=w IO-STREAM CLOSED - ./ICMSHh7zg+000804 MPI-TASK: 1 - 707399250 BYTES IN 202 RECORDS TRANSFERRED IN 0.0117 SECONDS 60461.5 Mbytes/s, TOTAL TIME= 0.1524( 7.7%) IO-STREAM SETUP - IOTYPE = 2 NUMIOPROCS = 1 CPATH = ./ICMUAh7zg+000804 MODE=w IO-STREAM CLOSED - ./ICMUAh7zg+000804 MPI-TASK: 1 - 4800052032 BYTES IN 125 RECORDS TRANSFERRED IN 0.0077 SECONDS623383.4 Mbytes/s, TOTAL TIME= 0.1259( 6.1%) STEPO_FPOS WAS : B00000F00E IO-STREAM SETUP - IOTYPE = 2 NUMIOPROCS = 1 CPATH = ./ICMUAh7zg+000804 MODE=a IO-STREAM CLOSED - ./ICMUAh7zg+000804 MPI-TASK: 1 - 10 BYTES IN 2 RECORDS TRANSFERRED IN 0.0002 SECONDS 0.0 Mbytes/s, TOTAL TIME= 0.0023( 8.7%) STEPO_FPOS WAS : V00000000Y IO-STREAM SETUP - IOTYPE = 2 NUMIOPROCS = 1 CPATH = ./ICMUAh7zg+000804 MODE=a IO-STREAM CLOSED - ./ICMUAh7zg+000804 MPI-TASK: 1 - 291423523 BYTES IN 4 RECORDS TRANSFERRED IN 0.0003 SECONDS971411.7 Mbytes/s, TOTAL TIME= 0.0037( 8.1%) STEPO_FPOS WAS : T00000000M NSTEP = 804 STEPO 0AAA00AAA MAXGPFV : MAX. VALUE = 0.000000000000000E+000 MAXGPFV : MAX. VALUE = 0.000000000000000E+000 NSTEP = 804 SCAN2M_HPOS P IO-STREAM SETUP - IOTYPE = 2 NUMIOPROCS = 1 CPATH = ICMGGh7zg+000804 MODE=a IO-STREAM CLOSED - ICMGGh7zg+000804 MPI-TASK: 1 - 300003252 BYTES IN 7 RECORDS TRANSFERRED IN 0.0007 SECONDS428576.1 Mbytes/s, TOTAL TIME= 0.0067(10.4%) 19:42:24 STEP 804 H= 201:00 +CPU= 17.591 ISTEP= 805 RSOLINC= 1361.4482 RI0= 1365.0000 ZI0= 1361.4482 RIP0= 1361.4482 ISTEP= 805 ZI0= 1361.4482 ZSEASON= 1.000000000 REA=149597870000.00 RDEASO=149597870000.00 NSTEP = 805 STEPO 0AAA00AAA 19:42:38 STEP 805 H= 201:15 +CPU= 13.779 NSTEP = 806 STEPO 0AAA00AAA 19:42:51 STEP 806 H= 201:30 +CPU= 13.289 NSTEP = 807 STEPO 0AAA00AAA 19:43:05 STEP 807 H= 201:45 +CPU= 13.500 NSTEP = 808 STEPO 0AAA00AAA 19:43:18 STEP 808 H= 202:00 +CPU= 13.590 NSTEP = 809 STEPO 0AAA00AAA 19:43:31 STEP 809 H= 202:15 +CPU= 13.345 ISTEP= 810 RSOLINC= 1361.4482 RI0= 1365.0000 ZI0= 1361.4482 RIP0= 1361.4482 ISTEP= 810 ZI0= 1361.4482 ZSEASON= 1.000000000 REA=149597870000.00 RDEASO=149597870000.00 NSTEP = 810 STEPO 0AAA00AAA 19:43:45 STEP 810 H= 202:30 +CPU= 13.210 NSTEP = 811 STEPO 0AAA00AAA 19:43:58 STEP 811 H= 202:45 +CPU= 13.258 NSTEP = 812 STEPO 0AAA00AAA 19:44:11 STEP 812 H= 203:00 +CPU= 13.515 NSTEP = 813 STEPO 0AAA00AAA 19:44:25 STEP 813 H= 203:15 +CPU= 13.197 NSTEP = 814 STEPO 0AAA00AAA ------------------------------------------------ CNT0 not found; string returned was: 'STEPO' >>> Printing last 8 lines from file: ifs.stat 19:43:05 0AAA00AAA STEPO 808 13.500 13.500 13.502 178:01 179:07 0.26025939753379E-04 2GB 0MB 19:43:18 0AAA00AAA STEPO 809 13.591 13.591 13.592 178:14 179:20 0.26025939753379E-04 2GB 0MB 19:43:31 0AAA00AAA STEPO 810 13.345 13.345 13.346 178:28 179:34 0.26025939753379E-04 2GB 0MB 19:43:45 0AAA00AAA STEPO 811 13.210 13.210 13.211 178:41 179:47 0.26025939753379E-04 2GB 0MB 19:43:58 0AAA00AAA STEPO 812 13.258 13.258 13.267 178:54 180:00 0.26025939753379E-04 2GB 0MB 19:44:11 0AAA00AAA STEPO 813 13.515 13.515 13.519 179:08 180:14 0.26025939753379E-04 2GB 0MB 19:44:25 0AAA00AAA STEPO 814 13.197 13.197 13.201 179:21 180:27 0.26025939753379E-04 2GB 0MB ------------------------------------------------ >>> Printing last 11 lines from file: rcf CSTEP = " 768", CTIME = "00080000 ", NSTEPLPP = 201, 202, 49, 228226, 228227, 2*0, 756, 2*0, IPRGPNSRES = 1, IPRGPEWRES = 1, IPRTRWRES = 1, IPRTRVRES = 1, GMASS0 = 0.000000000000000E+000, GMASSI = 0.000000000000000E+000 / ------------------------------------------------ >>> Printing last 8 lines from file: /var/lib/boinc/slots/2/progress_file_12292755.xml <running_values> <last_cpu_time>10766.290000</last_cpu_time> <upload_file_number>8</upload_file_number> <last_iter>814</last_iter> <last_upload>691200</last_upload> <model_completed>0</model_completed> </running_values> ------------------------------------------------ ..Failed, model did not complete successfully </stderr_txt> ]]> |
No trickles! |
---|
©2024 cpdn.org