Name | oifs_43r3_bl_a3f0_2016092300_20_1018_12292755_1 |
Workunit | 12292755 |
Created | 25 Jun 2024, 2:51:58 UTC |
Sent | 25 Jun 2024, 2:52:52 UTC |
Report deadline | 24 Aug 2024, 2:52:52 UTC |
Received | 25 Jun 2024, 5:45:45 UTC |
Server state | Over |
Outcome | Computation error |
Client state | Compute error |
Exit status | 1 (0x00000001) Unknown error code |
Computer ID | 1543890 |
Run time | 1 hours 57 min |
CPU time | 1 hours 55 min 48 sec |
Validate state | Invalid |
Credit | 0.00 |
Device peak FLOPS | 8.53 GFLOPS |
Application version | OpenIFS 43r3 Baroclinic Lifecycle v1.13 x86_64-pc-linux-gnu |
Peak working set size | 5,021.58 MB |
Peak swap size | 5,981.07 MB |
Peak disk usage | 1,285.94 MB |
Stderr | <core_client_version>7.18.1</core_client_version> <![CDATA[ <message> process exited with code 1 (0x1, -255)</message> <stderr_txt> 391 H= 97:45 +CPU= 7.849 06:38:01 STEP 392 H= 98:00 +CPU= 8.059 06:38:09 STEP 393 H= 98:15 +CPU= 7.748 06:38:16 STEP 394 H= 98:30 +CPU= 7.717 06:38:24 STEP 395 H= 98:45 +CPU= 7.836 06:38:34 STEP 396 H= 99:00 +CPU= 10.010 Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGh7zg+000396 Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHh7zg+000396 Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAh7zg+000396 06:38:42 STEP 397 H= 99:15 +CPU= 7.765 06:38:50 STEP 398 H= 99:30 +CPU= 7.784 06:38:57 STEP 399 H= 99:45 +CPU= 7.829 06:39:06 STEP 400 H= 100:00 +CPU= 8.015 06:39:13 STEP 401 H= 100:15 +CPU= 7.715 06:39:21 STEP 402 H= 100:30 +CPU= 7.772 06:39:29 STEP 403 H= 100:45 +CPU= 7.769 06:39:37 STEP 404 H= 101:00 +CPU= 8.026 06:39:45 STEP 405 H= 101:15 +CPU= 7.972 06:39:53 STEP 406 H= 101:30 +CPU= 7.868 06:40:01 STEP 407 H= 101:45 +CPU= 7.936 06:40:11 STEP 408 H= 102:00 +CPU= 9.982 Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGh7zg+000408 Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHh7zg+000408 Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAh7zg+000408 06:40:18 STEP 409 H= 102:15 +CPU= 7.877 06:40:27 STEP 410 H= 102:30 +CPU= 8.190 06:40:35 STEP 411 H= 102:45 +CPU= 8.097 06:40:43 STEP 412 H= 103:00 +CPU= 8.279 06:40:51 STEP 413 H= 103:15 +CPU= 8.222 06:41:00 STEP 414 H= 103:30 +CPU= 8.201 06:41:08 STEP 415 H= 103:45 +CPU= 8.138 06:41:16 STEP 416 H= 104:00 +CPU= 8.240 06:41:24 STEP 417 H= 104:15 +CPU= 8.006 06:41:32 STEP 418 H= 104:30 +CPU= 8.118 06:41:40 STEP 419 H= 104:45 +CPU= 8.128 06:41:51 STEP 420 H= 105:00 +CPU= 10.379 Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGh7zg+000420 Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHh7zg+000420 Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAh7zg+000420 06:41:59 STEP 421 H= 105:15 +CPU= 7.916 06:42:07 STEP 422 H= 105:30 +CPU= 7.967 06:42:15 STEP 423 H= 105:45 +CPU= 7.995 06:42:23 STEP 424 H= 106:00 +CPU= 8.197 06:42:31 STEP 425 H= 106:15 +CPU= 8.252 06:42:39 STEP 426 H= 106:30 +CPU= 7.976 06:42:47 STEP 427 H= 106:45 +CPU= 8.030 06:42:56 STEP 428 H= 107:00 +CPU= 8.476 06:43:04 STEP 429 H= 107:15 +CPU= 7.927 06:43:12 STEP 430 H= 107:30 +CPU= 8.085 06:43:20 STEP 431 H= 107:45 +CPU= 8.244 06:43:31 STEP 432 H= 108:00 +CPU= 11.316 Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGh7zg+000432 Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHh7zg+000432 Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAh7zg+000432 06:43:39 STEP 433 H= 108:15 +CPU= 7.992 06:43:47 STEP 434 H= 108:30 +CPU= 8.040 06:43:55 STEP 435 H= 108:45 +CPU= 8.069 06:44:04 STEP 436 H= 109:00 +CPU= 8.302 06:44:12 STEP 437 H= 109:15 +CPU= 8.206 06:44:20 STEP 438 H= 109:30 +CPU= 8.312 06:44:29 STEP 439 H= 109:45 +CPU= 8.319 06:44:37 STEP 440 H= 110:00 +CPU= 8.305 06:44:45 STEP 441 H= 110:15 +CPU= 7.981 06:44:53 STEP 442 H= 110:30 +CPU= 8.181 06:45:01 STEP 443 H= 110:45 +CPU= 8.008 06:45:12 STEP 444 H= 111:00 +CPU= 10.217 Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGh7zg+000444 Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHh7zg+000444 Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAh7zg+000444 06:45:19 STEP 445 H= 111:15 +CPU= 7.946 06:45:27 STEP 446 H= 111:30 +CPU= 8.024 06:45:36 STEP 447 H= 111:45 +CPU= 8.127 06:45:44 STEP 448 H= 112:00 +CPU= 8.191 06:45:52 STEP 449 H= 112:15 +CPU= 8.038 06:46:00 STEP 450 H= 112:30 +CPU= 8.054 06:46:08 STEP 451 H= 112:45 +CPU= 8.328 06:46:17 STEP 452 H= 113:00 +CPU= 8.788 06:46:26 STEP 453 H= 113:15 +CPU= 8.521 06:46:34 STEP 454 H= 113:30 +CPU= 8.515 06:46:43 STEP 455 H= 113:45 +CPU= 8.478 06:46:53 STEP 456 H= 114:00 +CPU= 10.667 Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGh7zg+000456 Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHh7zg+000456 Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAh7zg+000456 06:47:02 STEP 457 H= 114:15 +CPU= 8.477 06:47:10 STEP 458 H= 114:30 +CPU= 8.493 06:47:19 STEP 459 H= 114:45 +CPU= 8.463 06:47:28 STEP 460 H= 115:00 +CPU= 8.747 06:47:36 STEP 461 H= 115:15 +CPU= 8.495 06:47:44 STEP 462 H= 115:30 +CPU= 8.334 06:47:53 STEP 463 H= 115:45 +CPU= 8.308 06:48:01 STEP 464 H= 116:00 +CPU= 8.492 06:48:09 STEP 465 H= 116:15 +CPU= 8.018 06:48:17 STEP 466 H= 116:30 +CPU= 7.957 06:48:25 STEP 467 H= 116:45 +CPU= 8.090 06:48:35 STEP 468 H= 117:00 +CPU= 10.171 Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGh7zg+000468 Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHh7zg+000468 Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAh7zg+000468 06:48:43 STEP 469 H= 117:15 +CPU= 7.988 06:48:51 STEP 470 H= 117:30 +CPU= 7.943 06:49:00 STEP 471 H= 117:45 +CPU= 8.535 06:49:08 STEP 472 H= 118:00 +CPU= 8.478 06:49:17 STEP 473 H= 118:15 +CPU= 8.258 06:49:25 STEP 474 H= 118:30 +CPU= 8.311 06:49:33 STEP 475 H= 118:45 +CPU= 7.960 06:49:42 STEP 476 H= 119:00 +CPU= 8.627 06:49:50 STEP 477 H= 119:15 +CPU= 7.972 06:49:58 STEP 478 H= 119:30 +CPU= 7.990 06:50:06 STEP 479 H= 119:45 +CPU= 7.967 06:50:17 STEP 480 H= 120:00 +CPU= 11.343 Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGh7zg+000480 Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHh7zg+000480 Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAh7zg+000480 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292755/ICMGGh7zg+000384 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292755/ICMSHh7zg+000384 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292755/ICMUAh7zg+000384 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292755/ICMGGh7zg+000396 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292755/ICMSHh7zg+000396 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292755/ICMUAh7zg+000396 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292755/ICMGGh7zg+000408 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292755/ICMSHh7zg+000408 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292755/ICMUAh7zg+000408 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292755/ICMGGh7zg+000420 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292755/ICMSHh7zg+000420 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292755/ICMUAh7zg+000420 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292755/ICMGGh7zg+000432 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292755/ICMSHh7zg+000432 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292755/ICMUAh7zg+000432 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292755/ICMGGh7zg+000444 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292755/ICMSHh7zg+000444 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292755/ICMUAh7zg+000444 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292755/ICMGGh7zg+000456 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292755/ICMSHh7zg+000456 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292755/ICMUAh7zg+000456 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292755/ICMGGh7zg+000468 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292755/ICMSHh7zg+000468 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292755/ICMUAh7zg+000468 Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a3f0_2016092300_20_1018_12292755_1_r663842021_4.zip Uploading the intermediate file: upload_file_4.zip 06:50:26 STEP 481 H= 120:15 +CPU= 9.008 06:50:34 STEP 482 H= 120:30 +CPU= 8.216 06:50:43 STEP 483 H= 120:45 +CPU= 8.289 06:50:51 STEP 484 H= 121:00 +CPU= 8.611 06:50:59 STEP 485 H= 121:15 +CPU= 8.131 06:51:08 STEP 486 H= 121:30 +CPU= 8.274 06:51:16 STEP 487 H= 121:45 +CPU= 8.144 06:51:24 STEP 488 H= 122:00 +CPU= 8.250 06:51:32 STEP 489 H= 122:15 +CPU= 8.099 06:51:40 STEP 490 H= 122:30 +CPU= 8.144 06:51:48 STEP 491 H= 122:45 +CPU= 8.081 06:51:59 STEP 492 H= 123:00 +CPU= 10.719 Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGh7zg+000492 Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHh7zg+000492 Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAh7zg+000492 06:52:07 STEP 493 H= 123:15 +CPU= 8.176 06:52:16 STEP 494 H= 123:30 +CPU= 8.208 06:52:24 STEP 495 H= 123:45 +CPU= 8.325 06:52:32 STEP 496 H= 124:00 +CPU= 8.385 06:52:40 STEP 497 H= 124:15 +CPU= 8.023 06:52:48 STEP 498 H= 124:30 +CPU= 8.095 06:52:57 STEP 499 H= 124:45 +CPU= 8.095 06:53:05 STEP 500 H= 125:00 +CPU= 8.285 06:53:13 STEP 501 H= 125:15 +CPU= 8.049 06:53:21 STEP 502 H= 125:30 +CPU= 8.287 06:53:29 STEP 503 H= 125:45 +CPU= 8.066 06:53:40 STEP 504 H= 126:00 +CPU= 10.776 Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGh7zg+000504 Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHh7zg+000504 Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAh7zg+000504 06:53:49 STEP 505 H= 126:15 +CPU= 8.555 06:53:57 STEP 506 H= 126:30 +CPU= 8.551 06:54:06 STEP 507 H= 126:45 +CPU= 8.591 06:54:15 STEP 508 H= 127:00 +CPU= 8.833 06:54:23 STEP 509 H= 127:15 +CPU= 8.588 06:54:32 STEP 510 H= 127:30 +CPU= 8.831 06:54:41 STEP 511 H= 127:45 +CPU= 8.576 06:54:49 STEP 512 H= 128:00 +CPU= 8.775 06:54:58 STEP 513 H= 128:15 +CPU= 8.559 06:55:07 STEP 514 H= 128:30 +CPU= 8.621 06:55:15 STEP 515 H= 128:45 +CPU= 8.323 06:55:25 STEP 516 H= 129:00 +CPU= 10.471 06:55:34 STEP 517 H= 129:15 +CPU= 8.275 Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGh7zg+000516 Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHh7zg+000516 Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAh7zg+000516 06:55:42 STEP 518 H= 129:30 +CPU= 8.239 06:55:50 STEP 519 H= 129:45 +CPU= 8.116 06:55:59 STEP 520 H= 130:00 +CPU= 8.391 06:56:07 STEP 521 H= 130:15 +CPU= 8.271 06:56:15 STEP 522 H= 130:30 +CPU= 8.257 06:56:23 STEP 523 H= 130:45 +CPU= 8.239 06:56:32 STEP 524 H= 131:00 +CPU= 8.359 06:56:40 STEP 525 H= 131:15 +CPU= 8.107 06:56:48 STEP 526 H= 131:30 +CPU= 8.111 06:56:56 STEP 527 H= 131:45 +CPU= 8.167 06:57:08 STEP 528 H= 132:00 +CPU= 11.509 Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGh7zg+000528 Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHh7zg+000528 Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAh7zg+000528 06:57:16 STEP 529 H= 132:15 +CPU= 8.105 06:57:24 STEP 530 H= 132:30 +CPU= 8.119 06:57:32 STEP 531 H= 132:45 +CPU= 8.183 06:57:41 STEP 532 H= 133:00 +CPU= 8.614 06:57:49 STEP 533 H= 133:15 +CPU= 8.658 06:57:58 STEP 534 H= 133:30 +CPU= 8.501 06:58:06 STEP 535 H= 133:45 +CPU= 8.174 06:58:14 STEP 536 H= 134:00 +CPU= 8.301 06:58:23 STEP 537 H= 134:15 +CPU= 8.099 06:58:31 STEP 538 H= 134:30 +CPU= 8.138 06:58:39 STEP 539 H= 134:45 +CPU= 8.149 06:58:49 STEP 540 H= 135:00 +CPU= 10.272 Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGh7zg+000540 Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHh7zg+000540 Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAh7zg+000540 06:58:57 STEP 541 H= 135:15 +CPU= 8.207 06:59:06 STEP 542 H= 135:30 +CPU= 8.242 06:59:14 STEP 543 H= 135:45 +CPU= 8.103 06:59:22 STEP 544 H= 136:00 +CPU= 8.561 06:59:31 STEP 545 H= 136:15 +CPU= 8.255 06:59:39 STEP 546 H= 136:30 +CPU= 8.199 06:59:47 STEP 547 H= 136:45 +CPU= 8.164 06:59:55 STEP 548 H= 137:00 +CPU= 8.368 07:00:04 STEP 549 H= 137:15 +CPU= 8.142 07:00:12 STEP 550 H= 137:30 +CPU= 8.118 07:00:20 STEP 551 H= 137:45 +CPU= 8.160 07:00:30 STEP 552 H= 138:00 +CPU= 10.261 Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGh7zg+000552 Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHh7zg+000552 Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAh7zg+000552 07:00:38 STEP 553 H= 138:15 +CPU= 8.245 07:00:47 STEP 554 H= 138:30 +CPU= 8.284 07:00:55 STEP 555 H= 138:45 +CPU= 8.230 07:01:03 STEP 556 H= 139:00 +CPU= 8.451 07:01:12 STEP 557 H= 139:15 +CPU= 8.411 07:01:21 STEP 558 H= 139:30 +CPU= 8.694 07:01:29 STEP 559 H= 139:45 +CPU= 8.721 07:01:38 STEP 560 H= 140:00 +CPU= 8.887 07:01:47 STEP 561 H= 140:15 +CPU= 8.702 07:01:56 STEP 562 H= 140:30 +CPU= 8.695 07:02:04 STEP 563 H= 140:45 +CPU= 8.717 07:02:15 STEP 564 H= 141:00 +CPU= 10.917 07:02:24 STEP 565 H= 141:15 +CPU= 8.770 Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGh7zg+000564 Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHh7zg+000564 Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAh7zg+000564 07:02:33 STEP 566 H= 141:30 +CPU= 8.708 07:02:41 STEP 567 H= 141:45 +CPU= 8.788 07:02:50 STEP 568 H= 142:00 +CPU= 8.783 07:02:59 STEP 569 H= 142:15 +CPU= 8.424 07:03:07 STEP 570 H= 142:30 +CPU= 8.304 07:03:15 STEP 571 H= 142:45 +CPU= 8.396 07:03:24 STEP 572 H= 143:00 +CPU= 8.461 07:03:32 STEP 573 H= 143:15 +CPU= 8.232 07:03:40 STEP 574 H= 143:30 +CPU= 8.210 07:03:49 STEP 575 H= 143:45 +CPU= 8.489 07:04:01 STEP 576 H= 144:00 +CPU= 11.744 Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGh7zg+000576 Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHh7zg+000576 Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAh7zg+000576 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292755/ICMGGh7zg+000480 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292755/ICMSHh7zg+000480 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292755/ICMUAh7zg+000480 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292755/ICMGGh7zg+000492 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292755/ICMSHh7zg+000492 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292755/ICMUAh7zg+000492 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292755/ICMGGh7zg+000504 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292755/ICMSHh7zg+000504 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292755/ICMUAh7zg+000504 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292755/ICMGGh7zg+000516 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292755/ICMSHh7zg+000516 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292755/ICMUAh7zg+000516 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292755/ICMGGh7zg+000528 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292755/ICMSHh7zg+000528 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292755/ICMUAh7zg+000528 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292755/ICMGGh7zg+000540 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292755/ICMSHh7zg+000540 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292755/ICMUAh7zg+000540 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292755/ICMGGh7zg+000552 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292755/ICMSHh7zg+000552 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292755/ICMUAh7zg+000552 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292755/ICMGGh7zg+000564 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292755/ICMSHh7zg+000564 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292755/ICMUAh7zg+000564 Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a3f0_2016092300_20_1018_12292755_1_r663842021_5.zip 07:04:10 STEP 577 H= 144:15 +CPU= 8.920 Uploading the intermediate file: upload_file_5.zip 07:04:18 STEP 578 H= 144:30 +CPU= 8.435 07:04:26 STEP 579 H= 144:45 +CPU= 8.268 07:04:35 STEP 580 H= 145:00 +CPU= 8.520 07:04:43 STEP 581 H= 145:15 +CPU= 8.526 07:04:53 STEP 582 H= 145:30 +CPU= 9.418 07:05:01 STEP 583 H= 145:45 +CPU= 8.502 07:05:10 STEP 584 H= 146:00 +CPU= 8.860 07:05:19 STEP 585 H= 146:15 +CPU= 8.497 07:05:28 STEP 586 H= 146:30 +CPU= 9.301 07:05:37 STEP 587 H= 146:45 +CPU= 8.697 07:05:47 STEP 588 H= 147:00 +CPU= 10.505 Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGh7zg+000588 Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHh7zg+000588 Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAh7zg+000588 07:05:56 STEP 589 H= 147:15 +CPU= 8.299 07:06:04 STEP 590 H= 147:30 +CPU= 8.367 07:06:12 STEP 591 H= 147:45 +CPU= 8.345 07:06:21 STEP 592 H= 148:00 +CPU= 8.591 07:06:29 STEP 593 H= 148:15 +CPU= 8.404 07:06:38 STEP 594 H= 148:30 +CPU= 8.290 07:06:46 STEP 595 H= 148:45 +CPU= 8.283 07:06:54 STEP 596 H= 149:00 +CPU= 8.438 07:07:03 STEP 597 H= 149:15 +CPU= 8.255 07:07:11 STEP 598 H= 149:30 +CPU= 8.316 07:07:19 STEP 599 H= 149:45 +CPU= 8.289 07:07:30 STEP 600 H= 150:00 +CPU= 10.424 Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGh7zg+000600 Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHh7zg+000600 Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAh7zg+000600 07:07:38 STEP 601 H= 150:15 +CPU= 8.357 07:07:47 STEP 602 H= 150:30 +CPU= 8.566 07:07:55 STEP 603 H= 150:45 +CPU= 8.515 07:08:04 STEP 604 H= 151:00 +CPU= 8.508 07:08:13 STEP 605 H= 151:15 +CPU= 8.851 07:08:21 STEP 606 H= 151:30 +CPU= 8.435 07:08:30 STEP 607 H= 151:45 +CPU= 8.562 07:08:39 STEP 608 H= 152:00 +CPU= 9.028 07:08:47 STEP 609 H= 152:15 +CPU= 8.797 07:08:56 STEP 610 H= 152:30 +CPU= 8.860 07:09:05 STEP 611 H= 152:45 +CPU= 8.798 07:09:16 STEP 612 H= 153:00 +CPU= 11.059 Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGh7zg+000612 Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHh7zg+000612 Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAh7zg+000612 07:09:25 STEP 613 H= 153:15 +CPU= 8.848 07:09:34 STEP 614 H= 153:30 +CPU= 8.803 07:09:43 STEP 615 H= 153:45 +CPU= 8.836 07:09:52 STEP 616 H= 154:00 +CPU= 9.115 07:10:01 STEP 617 H= 154:15 +CPU= 8.801 07:10:09 STEP 618 H= 154:30 +CPU= 8.820 07:10:18 STEP 619 H= 154:45 +CPU= 8.473 07:10:26 STEP 620 H= 155:00 +CPU= 8.412 07:10:34 STEP 621 H= 155:15 +CPU= 8.146 07:10:43 STEP 622 H= 155:30 +CPU= 8.143 07:10:51 STEP 623 H= 155:45 +CPU= 8.065 07:11:02 STEP 624 H= 156:00 +CPU= 11.417 07:11:10 STEP 625 H= 156:15 +CPU= 8.273 Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGh7zg+000624 Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHh7zg+000624 Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAh7zg+000624 07:11:19 STEP 626 H= 156:30 +CPU= 8.153 07:11:27 STEP 627 H= 156:45 +CPU= 8.121 07:11:35 STEP 628 H= 157:00 +CPU= 8.380 07:11:43 STEP 629 H= 157:15 +CPU= 8.206 07:11:52 STEP 630 H= 157:30 +CPU= 8.240 07:12:00 STEP 631 H= 157:45 +CPU= 8.239 07:12:08 STEP 632 H= 158:00 +CPU= 8.278 07:12:16 STEP 633 H= 158:15 +CPU= 8.129 07:12:24 STEP 634 H= 158:30 +CPU= 8.063 07:12:32 STEP 635 H= 158:45 +CPU= 8.108 07:12:43 STEP 636 H= 159:00 +CPU= 10.157 07:12:51 STEP 637 H= 159:15 +CPU= 8.218 Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGh7zg+000636 Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHh7zg+000636 Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAh7zg+000636 07:12:59 STEP 638 H= 159:30 +CPU= 8.071 07:13:07 STEP 639 H= 159:45 +CPU= 8.125 07:13:15 STEP 640 H= 160:00 +CPU= 8.401 07:13:24 STEP 641 H= 160:15 +CPU= 8.252 07:13:32 STEP 642 H= 160:30 +CPU= 8.261 07:13:40 STEP 643 H= 160:45 +CPU= 8.251 07:13:48 STEP 644 H= 161:00 +CPU= 8.288 07:13:57 STEP 645 H= 161:15 +CPU= 8.193 07:14:05 STEP 646 H= 161:30 +CPU= 8.229 07:14:13 STEP 647 H= 161:45 +CPU= 8.211 07:14:24 STEP 648 H= 162:00 +CPU= 10.396 Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGh7zg+000648 Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHh7zg+000648 Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAh7zg+000648 07:14:32 STEP 649 H= 162:15 +CPU= 8.160 07:14:40 STEP 650 H= 162:30 +CPU= 8.269 07:14:48 STEP 651 H= 162:45 +CPU= 8.237 07:14:57 STEP 652 H= 163:00 +CPU= 8.448 07:15:05 STEP 653 H= 163:15 +CPU= 8.258 07:15:13 STEP 654 H= 163:30 +CPU= 8.167 07:15:21 STEP 655 H= 163:45 +CPU= 8.262 07:15:30 STEP 656 H= 164:00 +CPU= 8.524 07:15:38 STEP 657 H= 164:15 +CPU= 8.291 07:15:46 STEP 658 H= 164:30 +CPU= 8.163 07:15:55 STEP 659 H= 164:45 +CPU= 8.292 07:16:05 STEP 660 H= 165:00 +CPU= 10.295 Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGh7zg+000660 Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHh7zg+000660 Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAh7zg+000660 07:16:13 STEP 661 H= 165:15 +CPU= 8.310 07:16:22 STEP 662 H= 165:30 +CPU= 8.277 07:16:30 STEP 663 H= 165:45 +CPU= 8.236 07:16:38 STEP 664 H= 166:00 +CPU= 8.311 07:16:46 STEP 665 H= 166:15 +CPU= 8.208 07:16:55 STEP 666 H= 166:30 +CPU= 8.293 07:17:03 STEP 667 H= 166:45 +CPU= 8.203 07:17:11 STEP 668 H= 167:00 +CPU= 8.383 07:17:20 STEP 669 H= 167:15 +CPU= 8.287 07:17:28 STEP 670 H= 167:30 +CPU= 8.238 07:17:36 STEP 671 H= 167:45 +CPU= 8.235 07:17:48 STEP 672 H= 168:00 +CPU= 11.569 Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGh7zg+000672 Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHh7zg+000672 Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAh7zg+000672 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292755/ICMGGh7zg+000576 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292755/ICMSHh7zg+000576 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292755/ICMUAh7zg+000576 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292755/ICMGGh7zg+000588 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292755/ICMSHh7zg+000588 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292755/ICMUAh7zg+000588 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292755/ICMGGh7zg+000600 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292755/ICMSHh7zg+000600 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292755/ICMUAh7zg+000600 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292755/ICMGGh7zg+000612 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292755/ICMSHh7zg+000612 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292755/ICMUAh7zg+000612 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292755/ICMGGh7zg+000624 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292755/ICMSHh7zg+000624 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292755/ICMUAh7zg+000624 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292755/ICMGGh7zg+000636 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292755/ICMSHh7zg+000636 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292755/ICMUAh7zg+000636 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292755/ICMGGh7zg+000648 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292755/ICMSHh7zg+000648 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292755/ICMUAh7zg+000648 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292755/ICMGGh7zg+000660 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292755/ICMSHh7zg+000660 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292755/ICMUAh7zg+000660 Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a3f0_2016092300_20_1018_12292755_1_r663842021_6.zip 07:17:56 STEP 673 H= 168:15 +CPU= 8.554 Uploading the intermediate file: upload_file_6.zip 07:18:05 STEP 674 H= 168:30 +CPU= 8.541 07:18:13 STEP 675 H= 168:45 +CPU= 8.187 07:18:21 STEP 676 H= 169:00 +CPU= 8.393 07:18:30 STEP 677 H= 169:15 +CPU= 8.270 07:18:38 STEP 678 H= 169:30 +CPU= 8.329 07:18:46 STEP 679 H= 169:45 +CPU= 8.198 07:18:55 STEP 680 H= 170:00 +CPU= 8.512 07:19:03 STEP 681 H= 170:15 +CPU= 8.274 07:19:11 STEP 682 H= 170:30 +CPU= 8.308 07:19:20 STEP 683 H= 170:45 +CPU= 8.341 07:19:30 STEP 684 H= 171:00 +CPU= 10.380 Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGh7zg+000684 Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHh7zg+000684 Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAh7zg+000684 07:19:38 STEP 685 H= 171:15 +CPU= 8.211 07:19:46 STEP 686 H= 171:30 +CPU= 8.218 07:19:55 STEP 687 H= 171:45 +CPU= 8.202 07:20:03 STEP 688 H= 172:00 +CPU= 8.527 07:20:11 STEP 689 H= 172:15 +CPU= 8.294 07:20:20 STEP 690 H= 172:30 +CPU= 8.192 07:20:28 STEP 691 H= 172:45 +CPU= 8.142 07:20:36 STEP 692 H= 173:00 +CPU= 8.438 07:20:45 STEP 693 H= 173:15 +CPU= 8.287 07:20:53 STEP 694 H= 173:30 +CPU= 8.232 07:21:01 STEP 695 H= 173:45 +CPU= 8.303 07:21:11 STEP 696 H= 174:00 +CPU= 10.427 Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGh7zg+000696 Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHh7zg+000696 Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAh7zg+000696 07:21:20 STEP 697 H= 174:15 +CPU= 8.275 07:21:28 STEP 698 H= 174:30 +CPU= 8.198 07:21:36 STEP 699 H= 174:45 +CPU= 8.304 07:21:45 STEP 700 H= 175:00 +CPU= 8.353 07:21:53 STEP 701 H= 175:15 +CPU= 8.183 07:22:01 STEP 702 H= 175:30 +CPU= 8.178 07:22:09 STEP 703 H= 175:45 +CPU= 8.361 07:22:18 STEP 704 H= 176:00 +CPU= 8.601 07:22:27 STEP 705 H= 176:15 +CPU= 8.693 07:22:36 STEP 706 H= 176:30 +CPU= 8.865 07:22:44 STEP 707 H= 176:45 +CPU= 8.627 07:22:55 STEP 708 H= 177:00 +CPU= 10.724 Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGh7zg+000708 Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHh7zg+000708 Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAh7zg+000708 07:23:04 STEP 709 H= 177:15 +CPU= 8.604 07:23:12 STEP 710 H= 177:30 +CPU= 8.528 07:23:21 STEP 711 H= 177:45 +CPU= 8.562 07:23:29 STEP 712 H= 178:00 +CPU= 8.747 07:23:38 STEP 713 H= 178:15 +CPU= 8.733 07:23:47 STEP 714 H= 178:30 +CPU= 8.609 07:23:55 STEP 715 H= 178:45 +CPU= 8.526 07:24:04 STEP 716 H= 179:00 +CPU= 8.741 07:24:13 STEP 717 H= 179:15 +CPU= 8.456 07:24:21 STEP 718 H= 179:30 +CPU= 8.537 07:24:30 STEP 719 H= 179:45 +CPU= 8.615 07:24:42 STEP 720 H= 180:00 +CPU= 12.058 Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGh7zg+000720 Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHh7zg+000720 Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAh7zg+000720 07:24:50 STEP 721 H= 180:15 +CPU= 8.618 07:24:59 STEP 722 H= 180:30 +CPU= 8.481 07:25:08 STEP 723 H= 180:45 +CPU= 8.615 07:25:17 STEP 724 H= 181:00 +CPU= 8.950 07:25:25 STEP 725 H= 181:15 +CPU= 8.837 07:25:34 STEP 726 H= 181:30 +CPU= 8.615 07:25:43 STEP 727 H= 181:45 +CPU= 8.712 07:25:52 STEP 728 H= 182:00 +CPU= 8.770 07:26:00 STEP 729 H= 182:15 +CPU= 8.626 07:26:09 STEP 730 H= 182:30 +CPU= 8.816 07:26:18 STEP 731 H= 182:45 +CPU= 9.075 07:26:29 STEP 732 H= 183:00 +CPU= 10.878 Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGh7zg+000732 Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHh7zg+000732 Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAh7zg+000732 07:26:38 STEP 733 H= 183:15 +CPU= 8.556 07:26:46 STEP 734 H= 183:30 +CPU= 8.538 07:26:55 STEP 735 H= 183:45 +CPU= 8.589 07:27:04 STEP 736 H= 184:00 +CPU= 8.726 07:27:12 STEP 737 H= 184:15 +CPU= 8.579 07:27:21 STEP 738 H= 184:30 +CPU= 8.658 07:27:29 STEP 739 H= 184:45 +CPU= 8.566 07:27:38 STEP 740 H= 185:00 +CPU= 8.811 07:27:47 STEP 741 H= 185:15 +CPU= 8.642 07:27:56 STEP 742 H= 185:30 +CPU= 8.616 07:28:04 STEP 743 H= 185:45 +CPU= 8.759 07:28:16 STEP 744 H= 186:00 +CPU= 11.220 Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGh7zg+000744 Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHh7zg+000744 Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAh7zg+000744 07:28:25 STEP 745 H= 186:15 +CPU= 9.022 07:28:34 STEP 746 H= 186:30 +CPU= 9.087 07:28:43 STEP 747 H= 186:45 +CPU= 9.005 07:28:52 STEP 748 H= 187:00 +CPU= 9.295 07:29:01 STEP 749 H= 187:15 +CPU= 9.033 07:29:10 STEP 750 H= 187:30 +CPU= 9.037 07:29:19 STEP 751 H= 187:45 +CPU= 9.024 07:29:28 STEP 752 H= 188:00 +CPU= 9.263 07:29:37 STEP 753 H= 188:15 +CPU= 9.016 07:29:46 STEP 754 H= 188:30 +CPU= 8.628 07:29:55 STEP 755 H= 188:45 +CPU= 8.594 07:30:05 STEP 756 H= 189:00 +CPU= 10.787 Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGh7zg+000756 Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHh7zg+000756 Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAh7zg+000756 07:30:14 STEP 757 H= 189:15 +CPU= 8.480 07:30:22 STEP 758 H= 189:30 +CPU= 8.526 07:30:31 STEP 759 H= 189:45 +CPU= 8.437 07:30:40 STEP 760 H= 190:00 +CPU= 8.730 07:30:49 STEP 761 H= 190:15 +CPU= 8.828 07:30:57 STEP 762 H= 190:30 +CPU= 8.567 07:31:06 STEP 763 H= 190:45 +CPU= 8.622 07:31:15 STEP 764 H= 191:00 +CPU= 8.742 07:31:23 STEP 765 H= 191:15 +CPU= 8.720 07:31:32 STEP 766 H= 191:30 +CPU= 8.801 07:31:41 STEP 767 H= 191:45 +CPU= 8.843 07:31:53 STEP 768 H= 192:00 +CPU= 12.007 Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGh7zg+000768 Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHh7zg+000768 Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAh7zg+000768 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292755/ICMGGh7zg+000672 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292755/ICMSHh7zg+000672 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292755/ICMUAh7zg+000672 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292755/ICMGGh7zg+000684 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292755/ICMSHh7zg+000684 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292755/ICMUAh7zg+000684 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292755/ICMGGh7zg+000696 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292755/ICMSHh7zg+000696 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292755/ICMUAh7zg+000696 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292755/ICMGGh7zg+000708 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292755/ICMSHh7zg+000708 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292755/ICMUAh7zg+000708 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292755/ICMGGh7zg+000720 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292755/ICMSHh7zg+000720 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292755/ICMUAh7zg+000720 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292755/ICMGGh7zg+000732 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292755/ICMSHh7zg+000732 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292755/ICMUAh7zg+000732 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292755/ICMGGh7zg+000744 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292755/ICMSHh7zg+000744 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292755/ICMUAh7zg+000744 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292755/ICMGGh7zg+000756 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292755/ICMSHh7zg+000756 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292755/ICMUAh7zg+000756 Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a3f0_2016092300_20_1018_12292755_1_r663842021_7.zip Uploading the intermediate file: upload_file_7.zip 07:32:03 STEP 769 H= 192:15 +CPU= 9.676 07:32:11 STEP 770 H= 192:30 +CPU= 8.575 07:32:20 STEP 771 H= 192:45 +CPU= 8.503 07:32:29 STEP 772 H= 193:00 +CPU= 8.886 07:32:37 STEP 773 H= 193:15 +CPU= 8.775 07:32:46 STEP 774 H= 193:30 +CPU= 8.593 07:32:55 STEP 775 H= 193:45 +CPU= 8.463 07:33:03 STEP 776 H= 194:00 +CPU= 8.747 07:33:12 STEP 777 H= 194:15 +CPU= 8.518 07:33:20 STEP 778 H= 194:30 +CPU= 8.529 07:33:29 STEP 779 H= 194:45 +CPU= 8.511 07:33:40 STEP 780 H= 195:00 +CPU= 10.835 Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGh7zg+000780 Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHh7zg+000780 Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAh7zg+000780 07:33:48 STEP 781 H= 195:15 +CPU= 8.504 07:33:57 STEP 782 H= 195:30 +CPU= 8.453 07:34:05 STEP 783 H= 195:45 +CPU= 8.783 07:34:14 STEP 784 H= 196:00 +CPU= 8.952 07:34:23 STEP 785 H= 196:15 +CPU= 8.816 07:34:32 STEP 786 H= 196:30 +CPU= 8.512 07:34:40 STEP 787 H= 196:45 +CPU= 8.560 07:34:49 STEP 788 H= 197:00 +CPU= 8.929 07:34:58 STEP 789 H= 197:15 +CPU= 8.640 07:35:07 STEP 790 H= 197:30 +CPU= 8.725 07:35:15 STEP 791 H= 197:45 +CPU= 8.532 07:35:26 STEP 792 H= 198:00 +CPU= 10.694 Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGh7zg+000792 Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHh7zg+000792 Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAh7zg+000792 07:35:35 STEP 793 H= 198:15 +CPU= 9.049 07:35:44 STEP 794 H= 198:30 +CPU= 9.258 07:35:53 STEP 795 H= 198:45 +CPU= 9.205 07:36:03 STEP 796 H= 199:00 +CPU= 9.241 07:36:12 STEP 797 H= 199:15 +CPU= 9.049 07:36:21 STEP 798 H= 199:30 +CPU= 9.040 07:36:30 STEP 799 H= 199:45 +CPU= 9.068 07:36:39 STEP 800 H= 200:00 +CPU= 9.288 07:36:48 STEP 801 H= 200:15 +CPU= 9.058 07:36:57 STEP 802 H= 200:30 +CPU= 9.062 07:37:06 STEP 803 H= 200:45 +CPU= 8.818 07:37:17 STEP 804 H= 201:00 +CPU= 10.696 Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGh7zg+000804 Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHh7zg+000804 Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAh7zg+000804 07:37:25 STEP 805 H= 201:15 +CPU= 8.630 07:37:34 STEP 806 H= 201:30 +CPU= 8.600 07:37:43 STEP 807 H= 201:45 +CPU= 8.537 07:37:51 STEP 808 H= 202:00 +CPU= 8.723 07:38:00 STEP 809 H= 202:15 +CPU= 8.636 07:38:09 STEP 810 H= 202:30 +CPU= 8.691 07:38:17 STEP 811 H= 202:45 +CPU= 8.546 07:38:27 STEP 812 H= 203:00 +CPU= 9.215 07:38:35 STEP 813 H= 203:15 +CPU= 8.559 07:38:44 STEP 814 H= 203:30 +CPU= 8.882 07:38:53 STEP 815 H= 203:45 +CPU= 8.548 07:39:05 STEP 816 H= 204:00 +CPU= 11.959 Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGh7zg+000816 Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHh7zg+000816 Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAh7zg+000816 07:39:13 STEP 817 H= 204:15 +CPU= 8.498 07:39:22 STEP 818 H= 204:30 +CPU= 8.534 07:39:30 STEP 819 H= 204:45 +CPU= 8.880 [EC_DRHOOK:Ubuntu-KI:1:1:7604:7604] [20240625:073935:1719293975:6957.612] [signal_drhook@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1538] Received signal#8 (SIGFPE) :: 4412MB (heap), 5025MB (maxrss), 0MB (maxstack), 0 (paging), nsigs = 1 [EC_DRHOOK:Ubuntu-KI:1:1:7604:7604] [20240625:073935:1719293975:6957.612] [signal_drhook@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1542] Also activating Harakiri-alarm (SIGALRM=14) to expire after 500s elapsed to prevent hangs, nsigs = 1 [EC_DRHOOK:Ubuntu-KI:1:1:7604:7604] [20240625:073935:1719293975:6957.612] [signal_drhook@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1544] Harakiri signal handler 'signal_harakiri' for signal#14 (SIGALRM) installed at 0x820890 (old at (nil)) [EC_DRHOOK:Ubuntu-KI:1:1:7604:7604] [20240625:073935:1719293975:6957.612] [signal_drhook@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1617] Signal#8 was caused by floating-point overflow [memaddr=0x1cc6692], nsigs = 1 [EC_DRHOOK:Ubuntu-KI:1:1:7604:7604] [20240625:073935:1719293975:6957.612] [signal_drhook@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1686] Starting DrHook backtrace for signal#8, nsigs = 1 [EC_DRHOOK:Ubuntu-KI:1:1:7604:7604] [20240625:073935:1719293975:6957.612] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3843] 4412 MB (maxheap), 5025 MB (maxrss), 0 MB (maxstack) [EC_DRHOOK:Ubuntu-KI:1:1:7604:7604] [20240625:073935:1719293975:6957.612] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] : MASTER [EC_DRHOOK:Ubuntu-KI:1:1:7604:7604] [20240625:073935:1719293975:6957.612] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] : CNT0 [EC_DRHOOK:Ubuntu-KI:1:1:7604:7604] [20240625:073935:1719293975:6957.612] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] : CNT1 [EC_DRHOOK:Ubuntu-KI:1:1:7604:7604] [20240625:073935:1719293975:6957.612] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] : CNT2 [EC_DRHOOK:Ubuntu-KI:1:1:7604:7604] [20240625:073935:1719293975:6957.612] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] : CNT3 [EC_DRHOOK:Ubuntu-KI:1:1:7604:7604] [20240625:073935:1719293975:6957.612] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] : CNT4 [EC_DRHOOK:Ubuntu-KI:1:1:7604:7604] [20240625:073935:1719293975:6957.613] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] : STEPO [EC_DRHOOK:Ubuntu-KI:1:1:7604:7604] [20240625:073935:1719293975:6957.613] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] : SCAN2M [EC_DRHOOK:Ubuntu-KI:1:1:7604:7604] [20240625:073935:1719293975:6957.613] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] : GP_MODEL_HEAP [EC_DRHOOK:Ubuntu-KI:1:1:7604:7604] [20240625:073935:1719293975:6957.613] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] : GP_MODEL [EC_DRHOOK:Ubuntu-KI:1:1:7604:7604] [20240625:073935:1719293975:6957.613] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] : EC_PHYS_DRV [EC_DRHOOK:Ubuntu-KI:1:1:7604:7604] [20240625:073935:1719293975:6957.613] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] : >OMP-PHYSICS (1001) [EC_DRHOOK:Ubuntu-KI:1:1:7604:7604] [20240625:073935:1719293975:6957.613] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] : EC_PHYS [EC_DRHOOK:Ubuntu-KI:1:1:7604:7604] [20240625:073935:1719293975:6957.613] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] : CALLPAR [EC_DRHOOK:Ubuntu-KI:1:1:7604:7604] [20240625:073935:1719293975:6957.613] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] : TURBULENCE_LAYER [EC_DRHOOK:Ubuntu-KI:1:1:7604:7604] [20240625:073935:1719293975:6957.613] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] : VDFOUTER [EC_DRHOOK:Ubuntu-KI:1:1:7604:7604] [20240625:073935:1719293975:6957.613] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] : VDFMAIN [EC_DRHOOK:Ubuntu-KI:1:1:7604:7604] [20240625:073936:1719293976:6958.615] [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:240] Backtrace(s) for program '/var/lib/boinc-client/slots/2/oifs_43r3_model.exe' : sigcontextptr=0x7ffebea697d0 [EC_DRHOOK:Ubuntu-KI:1:1:7604:7604] [20240625:073936:1719293976:6958.615] [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:277] Backtrace (size = 24) with addr2line-cmd [EC_DRHOOK:Ubuntu-KI:1:1:7604:7604] [20240625:073936:1719293976:6958.615] [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:302] /usr/bin/addr2line -fs -e '/var/lib/boinc-client/slots/2/oifs_43r3_model.exe' 0x83a8f3 0x83aef9 0x1dd5490 0x1cc6692 0x121fd8b 0x1207e29 0x11fdcb2 0xfac003 0xf5fa6b 0xf4dbc4 0xbd7131 0x12c5002 0xbacbae 0x688153 0x4cd1dc 0x4b5d85 0x4b4f52 0x49d638 0x406fbd 0x401e7f 0x401e12 0x1dcc34a 0x1dcdbe7 0x401cd5 [EC_DRHOOK:Ubuntu-KI:1:1:7604:7604] [20240625:073936:1719293976:6958.615] [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [0]: [0x83a8f3] : ??() at ??:0 [EC_DRHOOK:Ubuntu-KI:1:1:7604:7604] [20240625:073936:1719293976:6958.615] [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [1]: [0x83aef9] : ??() at ??:0 [EC_DRHOOK:Ubuntu-KI:1:1:7604:7604] [20240625:073936:1719293976:6958.615] [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [2]: [0x1dd5490] : ??() at ??:0 [EC_DRHOOK:Ubuntu-KI:1:1:7604:7604] [20240625:073936:1719293976:6958.615] [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [3]: [0x1cc6692] : ??() at ??:0 [EC_DRHOOK:Ubuntu-KI:1:1:7604:7604] [20240625:073936:1719293976:6958.615] [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [4]: [0x121fd8b] : ??() at ??:0 [EC_DRHOOK:Ubuntu-KI:1:1:7604:7604] [20240625:073936:1719293976:6958.615] [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [5]: [0x1207e29] : ??() at ??:0 [EC_DRHOOK:Ubuntu-KI:1:1:7604:7604] [20240625:073936:1719293976:6958.615] [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [6]: [0x11fdcb2] : ??() at ??:0 [EC_DRHOOK:Ubuntu-KI:1:1:7604:7604] [20240625:073936:1719293976:6958.615] [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [7]: [0xfac003] : ??() at ??:0 [EC_DRHOOK:Ubuntu-KI:1:1:7604:7604] [20240625:073936:1719293976:6958.615] [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [8]: [0xf5fa6b] : ??() at ??:0 [EC_DRHOOK:Ubuntu-KI:1:1:7604:7604] [20240625:073936:1719293976:6958.615] [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [9]: [0xf4dbc4] : ??() at ??:0 [EC_DRHOOK:Ubuntu-KI:1:1:7604:7604] [20240625:073936:1719293976:6958.615] [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [10]: [0xbd7131] : ??() at ??:0 [EC_DRHOOK:Ubuntu-KI:1:1:7604:7604] [20240625:073936:1719293976:6958.615] [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [11]: [0x12c5002] : ??() at ??:0 [EC_DRHOOK:Ubuntu-KI:1:1:7604:7604] [20240625:073936:1719293976:6958.615] [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [12]: [0xbacbae] : ??() at ??:0 [EC_DRHOOK:Ubuntu-KI:1:1:7604:7604] [20240625:073936:1719293976:6958.615] [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [13]: [0x688153] : ??() at ??:0 [EC_DRHOOK:Ubuntu-KI:1:1:7604:7604] [20240625:073936:1719293976:6958.615] [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [14]: [0x4cd1dc] : ??() at ??:0 [EC_DRHOOK:Ubuntu-KI:1:1:7604:7604] [20240625:073936:1719293976:6958.615] [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [15]: [0x4b5d85] : ??() at ??:0 [EC_DRHOOK:Ubuntu-KI:1:1:7604:7604] [20240625:073936:1719293976:6958.615] [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [16]: [0x4b4f52] : ??() at ??:0 [EC_DRHOOK:Ubuntu-KI:1:1:7604:7604] [20240625:073936:1719293976:6958.615] [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [17]: [0x49d638] : ??() at ??:0 [EC_DRHOOK:Ubuntu-KI:1:1:7604:7604] [20240625:073936:1719293976:6958.615] [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [18]: [0x406fbd] : ??() at ??:0 [EC_DRHOOK:Ubuntu-KI:1:1:7604:7604] [20240625:073936:1719293976:6958.615] [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [19]: [0x401e7f] : ??() at ??:0 [EC_DRHOOK:Ubuntu-KI:1:1:7604:7604] [20240625:073936:1719293976:6958.615] [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [20]: [0x401e12] : ??() at ??:0 [EC_DRHOOK:Ubuntu-KI:1:1:7604:7604] [20240625:073936:1719293976:6958.615] [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [21]: [0x1dcc34a] : ??() at ??:0 [EC_DRHOOK:Ubuntu-KI:1:1:7604:7604] [20240625:073936:1719293976:6958.615] [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [22]: [0x1dcdbe7] : ??() at ??:0 [EC_DRHOOK:Ubuntu-KI:1:1:7604:7604] [20240625:073936:1719293976:6958.615] [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [23]: [0x401cd5] : ??() at ??:0 [EC_DRHOOK:Ubuntu-KI:1:1:7604:7604] [20240625:073936:1719293976:6958.615] [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:370] End of backtrace(s) Process 1 thread 1 calling linux_trbk from intel_trbk() [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:240] Backtrace(s) for program '/var/lib/boinc-client/slots/2/oifs_43r3_model.exe' : sigcontextptr=0x7ffebea696e0 [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:277] Backtrace (size = 25) with addr2line-cmd [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:302] /usr/bin/addr2line -fs -e '/var/lib/boinc-client/slots/2/oifs_43r3_model.exe' 0x83a8f3 0x83aef9 0x822540 0x1dd5490 0x1cc6692 0x121fd8b 0x1207e29 0x11fdcb2 0xfac003 0xf5fa6b 0xf4dbc4 0xbd7131 0x12c5002 0xbacbae 0x688153 0x4cd1dc 0x4b5d85 0x4b4f52 0x49d638 0x406fbd 0x401e7f 0x401e12 0x1dcc34a 0x1dcdbe7 0x401cd5 [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [0]: [0x83a8f3] : ??() at ??:0 [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [1]: [0x83aef9] : ??() at ??:0 [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [2]: [0x822540] : ??() at ??:0 [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [3]: [0x1dd5490] : ??() at ??:0 [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [4]: [0x1cc6692] : ??() at ??:0 [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [5]: [0x121fd8b] : ??() at ??:0 [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [6]: [0x1207e29] : ??() at ??:0 [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [7]: [0x11fdcb2] : ??() at ??:0 [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [8]: [0xfac003] : ??() at ??:0 [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [9]: [0xf5fa6b] : ??() at ??:0 [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [10]: [0xf4dbc4] : ??() at ??:0 [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [11]: [0xbd7131] : ??() at ??:0 [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [12]: [0x12c5002] : ??() at ??:0 [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [13]: [0xbacbae] : ??() at ??:0 [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [14]: [0x688153] : ??() at ??:0 [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [15]: [0x4cd1dc] : ??() at ??:0 [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [16]: [0x4b5d85] : ??() at ??:0 [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [17]: [0x4b4f52] : ??() at ??:0 [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [18]: [0x49d638] : ??() at ??:0 [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [19]: [0x406fbd] : ??() at ??:0 [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [20]: [0x401e7f] : ??() at ??:0 [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [21]: [0x401e12] : ??() at ??:0 [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [22]: [0x1dcc34a] : ??() at ??:0 [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [23]: [0x1dcdbe7] : ??() at ??:0 [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [24]: [0x401cd5] : ??() at ??:0 [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:370] End of backtrace(s) [EC_DRHOOK:Ubuntu-KI:1:1:7604:7604] [20240625:073936:1719293976:6958.635] [signal_drhook@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1734] DrHook backtrace done for signal#8, nsigs = 1 [EC_DRHOOK:Ubuntu-KI:1:1:7604:7604] [20240625:073936:1719293976:6958.635] [signal_drhook@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1785] Calling previous signal handler at 0x1cf8da0 for signal#8, nsigs = 1 forrtl: error (72): floating overflow Image PC Routine Line Source oifs_43r3_model.e 0000000001CF935B Unknown Unknown Unknown oifs_43r3_model.e 00000000008214C1 Unknown Unknown Unknown oifs_43r3_model.e 0000000001DD5490 Unknown Unknown Unknown oifs_43r3_model.e 0000000001CC6692 Unknown Unknown Unknown oifs_43r3_model.e 000000000121FD8B vdfmain_ 874 vdfmain.F90 oifs_43r3_model.e 0000000001207E29 vdfouter_ 739 vdfouter.F90 oifs_43r3_model.e 00000000011FDCB2 turbulence_layer_ 158 turbulence_layer.F90 oifs_43r3_model.e 0000000000FAC003 callpar_ 869 callpar.F90 oifs_43r3_model.e 0000000000F5FA6B ec_phys_ 670 ec_phys.F90 oifs_43r3_model.e 0000000000F4DBC4 ec_phys_drv_ 599 ec_phys_drv.F90 oifs_43r3_model.e 0000000000BD7131 gp_model_ 613 gp_model.F90 oifs_43r3_model.e 00000000012C5002 gp_model_heap_ 74 gp_model_heap.F90 oifs_43r3_model.e 0000000000BACBAE scan2m_ 535 scan2m.F90 oifs_43r3_model.e 0000000000688153 stepo_ 327 stepo.F90 oifs_43r3_model.e 00000000004CD1DC cnt4_ 1133 cnt4.F90 oifs_43r3_model.e 00000000004B5D85 cnt3_ 267 cnt3.F90 oifs_43r3_model.e 00000000004B4F52 cnt2_ 88 cnt2.F90 oifs_43r3_model.e 000000000049D638 cnt1_ 92 cnt1.F90 oifs_43r3_model.e 0000000000406FBD cnt0_ 146 cnt0.F90 oifs_43r3_model.e 0000000000401E7F MAIN__ 96 master.F90 oifs_43r3_model.e 0000000000401E12 Unknown Unknown Unknown oifs_43r3_model.e 0000000001DCC34A Unknown Unknown Unknown oifs_43r3_model.e 0000000001DCDBE7 Unknown Unknown Unknown oifs_43r3_model.e 0000000000401CD5 Unknown Unknown Unknown ..The child process has been killed with signal: 6 >>> Printing last 70 lines from file: NODE.001_01 GPNORM CLW AVERAGE MINIMUM MAXIMUM AVE 0.171101882032133E-05 0.000000000000000E+00 0.439261451256841E-02 GPNORM CIW AVERAGE MINIMUM MAXIMUM AVE 0.140299021183049E-04 0.000000000000000E+00 0.656471576495311E-02 GPNORM CC AVERAGE MINIMUM MAXIMUM AVE 0.225687387517157E+00 0.000000000000000E+00 0.100000000000000E+01 GPNORM RFL AVERAGE MINIMUM MAXIMUM AVE 0.904378808590624E-05 0.000000000000000E+00 0.162175743984559E-01 GPNORM SFL AVERAGE MINIMUM MAXIMUM AVE 0.881347220608338E-05 0.000000000000000E+00 0.585574944083263E-02 GPNORM CRFL AVERAGE MINIMUM MAXIMUM AVE 0.196918495577767E-05 0.000000000000000E+00 0.147636898426931E-01 GPNORM CSFL AVERAGE MINIMUM MAXIMUM AVE 0.854591454953805E-06 0.000000000000000E+00 0.105737714541392E-01 GPNORM PFRC AVERAGE MINIMUM MAXIMUM AVE 0.142137156066957E+00 0.000000000000000E+00 0.100000000000000E+01 NSTEP = 816 STEPO F00000000 CREATE RESTART FILE ./srf00081200.0001 IO-STREAM SETUP - IOTYPE = 2 NUMIOPROCS = 1 CPATH = ./srf00081200.0001 MODE=w IO-STREAM CLOSED - ./srf00081200.0001 MPI-TASK: 1 - ************ BYTES IN 46 RECORDS TRANSFERRED IN 0.7871 SECONDS******** Mbytes/s, TOTAL TIME= 1.0601(74.2%) CREATE RESTART CONTROL FILE ./rcf WRRESF: DELETED PREVIOUS RESTART FILE OK: ./srf00080000.0001 MAXGPFV : MAX. VALUE = 0.000000000000000E+000 MAXGPFV : MAX. VALUE = 0.000000000000000E+000 NSTEP = 816 SCAN2M_HPOS P IO-STREAM SETUP - IOTYPE = 2 NUMIOPROCS = 1 CPATH = ICMGGh7zg+000816 MODE=w IO-STREAM CLOSED - ICMGGh7zg+000816 MPI-TASK: 1 - 300090980 BYTES IN 6 RECORDS TRANSFERRED IN 0.0001 SECONDS******** Mbytes/s, TOTAL TIME= 0.0034( 2.9%) NSTEP = 816 STEPO 0AA000000 IO-STREAM SETUP - IOTYPE = 2 NUMIOPROCS = 1 CPATH = ./ICMSHh7zg+000816 MODE=w IO-STREAM CLOSED - ./ICMSHh7zg+000816 MPI-TASK: 1 - 707399250 BYTES IN 202 RECORDS TRANSFERRED IN 0.0037 SECONDS191189.0 Mbytes/s, TOTAL TIME= 0.0850( 4.4%) IO-STREAM SETUP - IOTYPE = 2 NUMIOPROCS = 1 CPATH = ./ICMUAh7zg+000816 MODE=w IO-STREAM CLOSED - ./ICMUAh7zg+000816 MPI-TASK: 1 - 4801455680 BYTES IN 125 RECORDS TRANSFERRED IN 0.0024 SECONDS******** Mbytes/s, TOTAL TIME= 0.0745( 3.2%) STEPO_FPOS WAS : B00000F00E IO-STREAM SETUP - IOTYPE = 2 NUMIOPROCS = 1 CPATH = ./ICMUAh7zg+000816 MODE=a IO-STREAM CLOSED - ./ICMUAh7zg+000816 MPI-TASK: 1 - 10 BYTES IN 2 RECORDS TRANSFERRED IN 0.0001 SECONDS 0.1 Mbytes/s, TOTAL TIME= 0.0016( 6.3%) STEPO_FPOS WAS : V00000000Y IO-STREAM SETUP - IOTYPE = 2 NUMIOPROCS = 1 CPATH = ./ICMUAh7zg+000816 MODE=a IO-STREAM CLOSED - ./ICMUAh7zg+000816 MPI-TASK: 1 - 291511251 BYTES IN 4 RECORDS TRANSFERRED IN 0.0001 SECONDS******** Mbytes/s, TOTAL TIME= 0.0024( 4.2%) STEPO_FPOS WAS : T00000000M NSTEP = 816 STEPO 0AAA00AAA MAXGPFV : MAX. VALUE = 0.000000000000000E+000 MAXGPFV : MAX. VALUE = 0.000000000000000E+000 NSTEP = 816 SCAN2M_HPOS P IO-STREAM SETUP - IOTYPE = 2 NUMIOPROCS = 1 CPATH = ICMGGh7zg+000816 MODE=a IO-STREAM CLOSED - ICMGGh7zg+000816 MPI-TASK: 1 - 300090980 BYTES IN 7 RECORDS TRANSFERRED IN 0.0002 SECONDS******** Mbytes/s, TOTAL TIME= 0.0040( 5.0%) 07:39:05 STEP 816 H= 204:00 +CPU= 11.959 NSTEP = 817 STEPO 0AAA00AAA 07:39:13 STEP 817 H= 204:15 +CPU= 8.498 NSTEP = 818 STEPO 0AAA00AAA 07:39:22 STEP 818 H= 204:30 +CPU= 8.534 NSTEP = 819 STEPO 0AAA00AAA 07:39:30 STEP 819 H= 204:45 +CPU= 8.880 ISTEP= 820 RSOLINC= 1361.4482 RI0= 1365.0000 ZI0= 1361.4482 RIP0= 1361.4482 ISTEP= 820 ZI0= 1361.4482 ZSEASON= 1.000000000 REA=149597870000.00 RDEASO=149597870000.00 NSTEP = 820 STEPO 0AAA00AAA ------------------------------------------------ CNT0 not found; string returned was: 'STEPO' >>> Printing last 8 lines from file: ifs.stat 07:38:55 FULLPOS-V DYNFPOS 816 0.995 0.995 0.996 115:08 115:18 0.27461762584923E-04 2GB 0MB 07:38:56 FULLPOS-T DYNFPOS 816 0.190 0.190 0.190 115:09 115:18 0.27461762584923E-04 2GB 0MB 07:38:56 0AAA00AAA STEPO 816 0.216 0.216 0.218 115:09 115:18 0.27461762584923E-04 2GB 0MB 07:39:05 0AAA00AAA STEPO 817 8.787 8.787 8.800 115:18 115:27 0.27461762584923E-04 2GB 0MB 07:39:13 0AAA00AAA STEPO 818 8.498 8.498 8.502 115:26 115:35 0.27461762584923E-04 2GB 0MB 07:39:22 0AAA00AAA STEPO 819 8.534 8.534 8.541 115:35 115:44 0.27461762584923E-04 2GB 0MB 07:39:30 0AAA00AAA STEPO 820 8.880 8.880 8.916 115:44 115:53 0.27461762584923E-04 2GB 0MB ------------------------------------------------ >>> Printing last 11 lines from file: rcf CSTEP = " 816", CTIME = "00081200 ", NSTEPLPP = 201, 202, 49, 228226, 228227, 2*0, 804, 2*0, IPRGPNSRES = 1, IPRGPEWRES = 1, IPRTRWRES = 1, IPRTRVRES = 1, GMASS0 = 0.000000000000000E+000, GMASSI = 0.000000000000000E+000 / ------------------------------------------------ >>> Printing last 8 lines from file: /var/lib/boinc-client/slots/2/progress_file_12292755.xml <running_values> <last_cpu_time>6945.230000</last_cpu_time> <upload_file_number>8</upload_file_number> <last_iter>820</last_iter> <last_upload>691200</last_upload> <model_completed>0</model_completed> </running_values> ------------------------------------------------ ..Failed, model did not complete successfully </stderr_txt> ]]> |
No trickles! |
---|
©2024 cpdn.org