climateprediction.net home page
Task 22296106

Task 22296106

Name oifs_43r3_ps_0705_1999050100_123_968_12185349_1
Workunit 12185349
Created 6 Jan 2023, 19:47:16 UTC
Sent 6 Jan 2023, 19:56:23 UTC
Report deadline 5 Feb 2023, 19:56:23 UTC
Received 7 Jan 2023, 22:47:35 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 196 (0x000000C4) EXIT_DISK_LIMIT_EXCEEDED
Computer ID 1494567
Run time 22 hours 31 min 31 sec
CPU time 22 hours 23 min 50 sec
Validate state Invalid
Credit 13,910.40
Device peak FLOPS 4.53 GFLOPS
Application version OpenIFS 43r3 Perturbed Surface v1.05
x86_64-pc-linux-gnu
Peak working set size 4,410.82 MB
Peak swap size 4,978.07 MB
Peak disk usage 7,758.67 MB
Stderr
<core_client_version>7.16.6</core_client_version>
<![CDATA[
<message>
Disk usage limit exceeded</message>
<stderr_txt>
STEP 2321 H=2321:00 +CPU= 21.859
  09:37:28 STEP 2322 H=2322:00 +CPU= 35.896
  09:37:50 STEP 2323 H=2323:00 +CPU= 22.033
  09:38:12 STEP 2324 H=2324:00 +CPU= 22.494
  09:38:48 STEP 2325 H=2325:00 +CPU= 35.173
  09:39:10 STEP 2326 H=2326:00 +CPU= 22.703
  09:39:33 STEP 2327 H=2327:00 +CPU= 22.476
  09:40:14 STEP 2328 H=2328:00 +CPU= 40.872
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhq0f+002328
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhq0f+002328
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhq0f+002328
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185349/ICMGGhq0f+002304
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185349/ICMSHhq0f+002304
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185349/ICMUAhq0f+002304
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185349/ICMGGhq0f+002316
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185349/ICMSHhq0f+002316
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185349/ICMUAhq0f+002316
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0705_1999050100_123_968_12185349_1_r2025426554_96.zip
Uploading the intermediate file: upload_file_96.zip
  09:40:36 STEP 2329 H=2329:00 +CPU= 22.043
  09:40:58 STEP 2330 H=2330:00 +CPU= 22.293
  09:41:34 STEP 2331 H=2331:00 +CPU= 35.191
  09:41:56 STEP 2332 H=2332:00 +CPU= 22.681
  09:42:18 STEP 2333 H=2333:00 +CPU= 21.682
  09:42:54 STEP 2334 H=2334:00 +CPU= 36.014
  09:43:16 STEP 2335 H=2335:00 +CPU= 22.079
  09:43:38 STEP 2336 H=2336:00 +CPU= 22.354
  09:44:14 STEP 2337 H=2337:00 +CPU= 35.291
  09:44:37 STEP 2338 H=2338:00 +CPU= 22.748
  09:44:58 STEP 2339 H=2339:00 +CPU= 21.725
  09:45:37 STEP 2340 H=2340:00 +CPU= 38.880
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhq0f+002340
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhq0f+002340
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhq0f+002340
  09:45:59 STEP 2341 H=2341:00 +CPU= 22.084
  09:46:22 STEP 2342 H=2342:00 +CPU= 22.584
  09:46:57 STEP 2343 H=2343:00 +CPU= 35.263
  09:47:20 STEP 2344 H=2344:00 +CPU= 22.716
  09:47:42 STEP 2345 H=2345:00 +CPU= 21.844
  09:48:18 STEP 2346 H=2346:00 +CPU= 35.893
  09:48:40 STEP 2347 H=2347:00 +CPU= 22.025
  09:49:02 STEP 2348 H=2348:00 +CPU= 22.507
  09:49:37 STEP 2349 H=2349:00 +CPU= 35.186
  09:50:00 STEP 2350 H=2350:00 +CPU= 22.703
  09:50:23 STEP 2351 H=2351:00 +CPU= 22.465
  09:51:04 STEP 2352 H=2352:00 +CPU= 40.926
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhq0f+002352
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhq0f+002352
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhq0f+002352
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185349/ICMGGhq0f+002328
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185349/ICMSHhq0f+002328
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185349/ICMUAhq0f+002328
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185349/ICMGGhq0f+002340
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185349/ICMSHhq0f+002340
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185349/ICMUAhq0f+002340
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0705_1999050100_123_968_12185349_1_r2025426554_97.zip
Uploading the intermediate file: upload_file_97.zip
  09:51:26 STEP 2353 H=2353:00 +CPU= 22.060
  09:51:48 STEP 2354 H=2354:00 +CPU= 22.302
  09:52:23 STEP 2355 H=2355:00 +CPU= 35.244
  09:52:46 STEP 2356 H=2356:00 +CPU= 22.710
  09:53:08 STEP 2357 H=2357:00 +CPU= 21.697
  09:53:44 STEP 2358 H=2358:00 +CPU= 36.028
  09:54:06 STEP 2359 H=2359:00 +CPU= 22.108
  09:54:28 STEP 2360 H=2360:00 +CPU= 22.380
  09:55:04 STEP 2361 H=2361:00 +CPU= 35.321
  09:55:27 STEP 2362 H=2362:00 +CPU= 22.774
  09:55:48 STEP 2363 H=2363:00 +CPU= 21.722
  09:56:27 STEP 2364 H=2364:00 +CPU= 38.925
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhq0f+002364
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhq0f+002364
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhq0f+002364
  09:56:49 STEP 2365 H=2365:00 +CPU= 22.125
  09:57:12 STEP 2366 H=2366:00 +CPU= 22.546
  09:57:47 STEP 2367 H=2367:00 +CPU= 35.236
  09:58:10 STEP 2368 H=2368:00 +CPU= 22.719
  09:58:32 STEP 2369 H=2369:00 +CPU= 21.883
  09:59:08 STEP 2370 H=2370:00 +CPU= 35.942
  09:59:30 STEP 2371 H=2371:00 +CPU= 22.014
  09:59:52 STEP 2372 H=2372:00 +CPU= 22.482
  10:00:27 STEP 2373 H=2373:00 +CPU= 35.185
  10:00:50 STEP 2374 H=2374:00 +CPU= 22.658
  10:01:13 STEP 2375 H=2375:00 +CPU= 22.471
  10:01:54 STEP 2376 H=2376:00 +CPU= 40.938
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhq0f+002376
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhq0f+002376
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhq0f+002376
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185349/ICMGGhq0f+002352
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185349/ICMSHhq0f+002352
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185349/ICMUAhq0f+002352
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185349/ICMGGhq0f+002364
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185349/ICMSHhq0f+002364
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185349/ICMUAhq0f+002364
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0705_1999050100_123_968_12185349_1_r2025426554_98.zip
Uploading the intermediate file: upload_file_98.zip
  10:02:16 STEP 2377 H=2377:00 +CPU= 22.071
  10:02:38 STEP 2378 H=2378:00 +CPU= 22.301
  10:03:13 STEP 2379 H=2379:00 +CPU= 35.270
  10:03:36 STEP 2380 H=2380:00 +CPU= 22.709
  10:03:58 STEP 2381 H=2381:00 +CPU= 21.686
  10:04:34 STEP 2382 H=2382:00 +CPU= 35.996
  10:04:56 STEP 2383 H=2383:00 +CPU= 22.082
  10:05:18 STEP 2384 H=2384:00 +CPU= 22.366
  10:05:54 STEP 2385 H=2385:00 +CPU= 35.287
  10:06:16 STEP 2386 H=2386:00 +CPU= 22.765
  10:06:38 STEP 2387 H=2387:00 +CPU= 21.700
  10:07:17 STEP 2388 H=2388:00 +CPU= 38.891
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhq0f+002388
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhq0f+002388
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhq0f+002388
  10:07:39 STEP 2389 H=2389:00 +CPU= 22.111
  10:08:02 STEP 2390 H=2390:00 +CPU= 22.555
  10:08:37 STEP 2391 H=2391:00 +CPU= 35.264
  10:09:00 STEP 2392 H=2392:00 +CPU= 22.660
  10:09:21 STEP 2393 H=2393:00 +CPU= 21.818
  10:09:57 STEP 2394 H=2394:00 +CPU= 35.934
  10:10:19 STEP 2395 H=2395:00 +CPU= 21.984
  10:10:42 STEP 2396 H=2396:00 +CPU= 22.464
  10:11:17 STEP 2397 H=2397:00 +CPU= 35.208
  10:11:40 STEP 2398 H=2398:00 +CPU= 22.611
  10:12:02 STEP 2399 H=2399:00 +CPU= 22.419
  10:12:43 STEP 2400 H=2400:00 +CPU= 40.933
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhq0f+002400
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhq0f+002400
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhq0f+002400
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185349/ICMGGhq0f+002376
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185349/ICMSHhq0f+002376
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185349/ICMUAhq0f+002376
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185349/ICMGGhq0f+002388
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185349/ICMSHhq0f+002388
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185349/ICMUAhq0f+002388
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0705_1999050100_123_968_12185349_1_r2025426554_99.zip
Uploading the intermediate file: upload_file_99.zip
  10:13:05 STEP 2401 H=2401:00 +CPU= 22.085
  10:13:28 STEP 2402 H=2402:00 +CPU= 22.324
  10:14:03 STEP 2403 H=2403:00 +CPU= 35.257
  10:14:26 STEP 2404 H=2404:00 +CPU= 22.741
  10:14:47 STEP 2405 H=2405:00 +CPU= 21.683
  10:15:24 STEP 2406 H=2406:00 +CPU= 36.057
  10:15:46 STEP 2407 H=2407:00 +CPU= 22.135
  10:16:08 STEP 2408 H=2408:00 +CPU= 22.384
  10:16:43 STEP 2409 H=2409:00 +CPU= 35.312
  10:17:06 STEP 2410 H=2410:00 +CPU= 22.789
  10:17:28 STEP 2411 H=2411:00 +CPU= 21.744
  10:18:07 STEP 2412 H=2412:00 +CPU= 38.933
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhq0f+002412
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhq0f+002412
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhq0f+002412
  10:18:29 STEP 2413 H=2413:00 +CPU= 22.124
  10:18:52 STEP 2414 H=2414:00 +CPU= 22.507
  10:19:27 STEP 2415 H=2415:00 +CPU= 35.231
  10:19:49 STEP 2416 H=2416:00 +CPU= 22.647
  10:20:11 STEP 2417 H=2417:00 +CPU= 21.766
  10:20:47 STEP 2418 H=2418:00 +CPU= 35.949
  10:21:09 STEP 2419 H=2419:00 +CPU= 21.972
  10:21:32 STEP 2420 H=2420:00 +CPU= 22.411
  10:22:07 STEP 2421 H=2421:00 +CPU= 35.200
  10:22:29 STEP 2422 H=2422:00 +CPU= 22.602
  10:22:52 STEP 2423 H=2423:00 +CPU= 22.379
  10:23:33 STEP 2424 H=2424:00 +CPU= 40.955
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhq0f+002424
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhq0f+002424
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhq0f+002424
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185349/ICMGGhq0f+002400
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185349/ICMSHhq0f+002400
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185349/ICMUAhq0f+002400
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185349/ICMGGhq0f+002412
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185349/ICMSHhq0f+002412
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185349/ICMUAhq0f+002412
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0705_1999050100_123_968_12185349_1_r2025426554_100.zip
Uploading the intermediate file: upload_file_100.zip
  10:23:55 STEP 2425 H=2425:00 +CPU= 22.082
  10:24:17 STEP 2426 H=2426:00 +CPU= 22.332
  10:24:53 STEP 2427 H=2427:00 +CPU= 35.276
  10:25:15 STEP 2428 H=2428:00 +CPU= 22.751
  10:25:37 STEP 2429 H=2429:00 +CPU= 21.691
  10:26:13 STEP 2430 H=2430:00 +CPU= 36.015
  10:26:35 STEP 2431 H=2431:00 +CPU= 22.126
  10:26:58 STEP 2432 H=2432:00 +CPU= 22.369
  10:27:33 STEP 2433 H=2433:00 +CPU= 35.287
  10:27:56 STEP 2434 H=2434:00 +CPU= 22.772
  10:28:17 STEP 2435 H=2435:00 +CPU= 21.711
  10:28:56 STEP 2436 H=2436:00 +CPU= 38.917
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhq0f+002436
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhq0f+002436
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhq0f+002436
  10:29:19 STEP 2437 H=2437:00 +CPU= 22.144
  10:29:41 STEP 2438 H=2438:00 +CPU= 22.527
  10:30:16 STEP 2439 H=2439:00 +CPU= 35.244
  10:30:39 STEP 2440 H=2440:00 +CPU= 22.661
  10:31:01 STEP 2441 H=2441:00 +CPU= 21.787
  10:31:37 STEP 2442 H=2442:00 +CPU= 35.954
  10:31:59 STEP 2443 H=2443:00 +CPU= 21.964
  10:32:21 STEP 2444 H=2444:00 +CPU= 22.417
  10:32:56 STEP 2445 H=2445:00 +CPU= 35.175
  10:33:19 STEP 2446 H=2446:00 +CPU= 22.615
  10:33:41 STEP 2447 H=2447:00 +CPU= 22.411
  10:34:23 STEP 2448 H=2448:00 +CPU= 40.942
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhq0f+002448
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhq0f+002448
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhq0f+002448
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185349/ICMGGhq0f+002424
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185349/ICMSHhq0f+002424
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185349/ICMUAhq0f+002424
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185349/ICMGGhq0f+002436
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185349/ICMSHhq0f+002436
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185349/ICMUAhq0f+002436
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0705_1999050100_123_968_12185349_1_r2025426554_101.zip
Uploading the intermediate file: upload_file_101.zip
  10:34:45 STEP 2449 H=2449:00 +CPU= 22.075
  10:35:07 STEP 2450 H=2450:00 +CPU= 22.324
  10:35:42 STEP 2451 H=2451:00 +CPU= 35.259
  10:36:05 STEP 2452 H=2452:00 +CPU= 22.747
  10:36:27 STEP 2453 H=2453:00 +CPU= 21.700
  10:37:03 STEP 2454 H=2454:00 +CPU= 36.044
  10:37:25 STEP 2455 H=2455:00 +CPU= 22.147
  10:37:47 STEP 2456 H=2456:00 +CPU= 22.388
  10:38:23 STEP 2457 H=2457:00 +CPU= 35.322
  10:38:46 STEP 2458 H=2458:00 +CPU= 22.778
  10:39:07 STEP 2459 H=2459:00 +CPU= 21.732
  10:39:46 STEP 2460 H=2460:00 +CPU= 38.909
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhq0f+002460
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhq0f+002460
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhq0f+002460
  10:40:08 STEP 2461 H=2461:00 +CPU= 22.123
  10:40:31 STEP 2462 H=2462:00 +CPU= 22.540
  10:41:06 STEP 2463 H=2463:00 +CPU= 35.233
  10:41:29 STEP 2464 H=2464:00 +CPU= 22.688
  10:41:51 STEP 2465 H=2465:00 +CPU= 21.827
  10:42:27 STEP 2466 H=2466:00 +CPU= 35.950
  10:42:49 STEP 2467 H=2467:00 +CPU= 21.988
  10:43:11 STEP 2468 H=2468:00 +CPU= 22.478
  10:43:46 STEP 2469 H=2469:00 +CPU= 35.222
  10:44:09 STEP 2470 H=2470:00 +CPU= 22.633
  10:44:32 STEP 2471 H=2471:00 +CPU= 22.441
  10:45:13 STEP 2472 H=2472:00 +CPU= 40.979
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhq0f+002472
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhq0f+002472
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhq0f+002472
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185349/ICMGGhq0f+002448
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185349/ICMSHhq0f+002448
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185349/ICMUAhq0f+002448
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185349/ICMGGhq0f+002460
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185349/ICMSHhq0f+002460
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185349/ICMUAhq0f+002460
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0705_1999050100_123_968_12185349_1_r2025426554_102.zip
Uploading the intermediate file: upload_file_102.zip
  10:45:35 STEP 2473 H=2473:00 +CPU= 22.077
  10:45:57 STEP 2474 H=2474:00 +CPU= 22.321
  10:46:32 STEP 2475 H=2475:00 +CPU= 35.302
  10:46:55 STEP 2476 H=2476:00 +CPU= 22.749
  10:47:17 STEP 2477 H=2477:00 +CPU= 21.677
  10:47:53 STEP 2478 H=2478:00 +CPU= 36.029
  10:48:15 STEP 2479 H=2479:00 +CPU= 22.105
  10:48:37 STEP 2480 H=2480:00 +CPU= 22.379
  10:49:13 STEP 2481 H=2481:00 +CPU= 35.324
  10:49:36 STEP 2482 H=2482:00 +CPU= 22.774
  10:49:57 STEP 2483 H=2483:00 +CPU= 21.729
  10:50:36 STEP 2484 H=2484:00 +CPU= 38.885
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhq0f+002484
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhq0f+002484
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhq0f+002484
  10:50:58 STEP 2485 H=2485:00 +CPU= 22.122
  10:51:21 STEP 2486 H=2486:00 +CPU= 22.552
  10:51:56 STEP 2487 H=2487:00 +CPU= 35.257
  10:52:19 STEP 2488 H=2488:00 +CPU= 22.707
  10:52:41 STEP 2489 H=2489:00 +CPU= 21.851
  10:53:17 STEP 2490 H=2490:00 +CPU= 35.951
  10:53:39 STEP 2491 H=2491:00 +CPU= 22.023
  10:54:01 STEP 2492 H=2492:00 +CPU= 22.468
  10:54:36 STEP 2493 H=2493:00 +CPU= 35.196
  10:54:59 STEP 2494 H=2494:00 +CPU= 22.636
  10:55:22 STEP 2495 H=2495:00 +CPU= 22.439
  10:56:03 STEP 2496 H=2496:00 +CPU= 40.944
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhq0f+002496
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhq0f+002496
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhq0f+002496
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185349/ICMGGhq0f+002472
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185349/ICMSHhq0f+002472
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185349/ICMUAhq0f+002472
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185349/ICMGGhq0f+002484
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185349/ICMSHhq0f+002484
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185349/ICMUAhq0f+002484
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0705_1999050100_123_968_12185349_1_r2025426554_103.zip
Uploading the intermediate file: upload_file_103.zip
  10:56:25 STEP 2497 H=2497:00 +CPU= 22.059
  10:56:47 STEP 2498 H=2498:00 +CPU= 22.313
  10:57:22 STEP 2499 H=2499:00 +CPU= 35.262
  10:57:45 STEP 2500 H=2500:00 +CPU= 22.732
  10:58:07 STEP 2501 H=2501:00 +CPU= 21.676
  10:58:43 STEP 2502 H=2502:00 +CPU= 36.062
  10:59:05 STEP 2503 H=2503:00 +CPU= 22.135
  10:59:27 STEP 2504 H=2504:00 +CPU= 22.369
  11:00:03 STEP 2505 H=2505:00 +CPU= 35.302
  11:00:26 STEP 2506 H=2506:00 +CPU= 22.769
  11:00:47 STEP 2507 H=2507:00 +CPU= 21.733
  11:01:26 STEP 2508 H=2508:00 +CPU= 38.909
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhq0f+002508
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhq0f+002508
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhq0f+002508
  11:01:48 STEP 2509 H=2509:00 +CPU= 22.096
  11:02:11 STEP 2510 H=2510:00 +CPU= 22.540
  11:02:46 STEP 2511 H=2511:00 +CPU= 35.212
  11:03:09 STEP 2512 H=2512:00 +CPU= 22.698
  11:03:31 STEP 2513 H=2513:00 +CPU= 21.845
  11:04:07 STEP 2514 H=2514:00 +CPU= 35.909
  11:04:29 STEP 2515 H=2515:00 +CPU= 22.027
  11:04:51 STEP 2516 H=2516:00 +CPU= 22.471
  11:05:26 STEP 2517 H=2517:00 +CPU= 35.177
  11:05:49 STEP 2518 H=2518:00 +CPU= 22.678
  11:06:11 STEP 2519 H=2519:00 +CPU= 22.469
  11:06:53 STEP 2520 H=2520:00 +CPU= 40.940
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhq0f+002520
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhq0f+002520
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhq0f+002520
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185349/ICMGGhq0f+002496
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185349/ICMSHhq0f+002496
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185349/ICMUAhq0f+002496
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185349/ICMGGhq0f+002508
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185349/ICMSHhq0f+002508
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185349/ICMUAhq0f+002508
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0705_1999050100_123_968_12185349_1_r2025426554_104.zip
Uploading the intermediate file: upload_file_104.zip
  11:07:15 STEP 2521 H=2521:00 +CPU= 22.083
Uploading trickle at timestep: 9072000
  11:07:37 STEP 2522 H=2522:00 +CPU= 22.321
  11:08:12 STEP 2523 H=2523:00 +CPU= 35.264
  11:08:35 STEP 2524 H=2524:00 +CPU= 22.723
  11:08:57 STEP 2525 H=2525:00 +CPU= 21.696
  11:09:33 STEP 2526 H=2526:00 +CPU= 36.059
  11:09:55 STEP 2527 H=2527:00 +CPU= 22.123
  11:10:17 STEP 2528 H=2528:00 +CPU= 22.369
  11:10:53 STEP 2529 H=2529:00 +CPU= 35.304
  11:11:15 STEP 2530 H=2530:00 +CPU= 22.788
  11:11:37 STEP 2531 H=2531:00 +CPU= 21.744
  11:12:16 STEP 2532 H=2532:00 +CPU= 39.013
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhq0f+002532
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhq0f+002532
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhq0f+002532
  11:12:38 STEP 2533 H=2533:00 +CPU= 22.122
  11:13:01 STEP 2534 H=2534:00 +CPU= 22.551
  11:13:36 STEP 2535 H=2535:00 +CPU= 35.274
  11:13:59 STEP 2536 H=2536:00 +CPU= 22.708
  11:14:21 STEP 2537 H=2537:00 +CPU= 21.870
  11:14:57 STEP 2538 H=2538:00 +CPU= 35.933
  11:15:19 STEP 2539 H=2539:00 +CPU= 22.019
  11:15:41 STEP 2540 H=2540:00 +CPU= 22.500
  11:16:17 STEP 2541 H=2541:00 +CPU= 35.172
  11:16:39 STEP 2542 H=2542:00 +CPU= 22.680
  11:17:02 STEP 2543 H=2543:00 +CPU= 22.489
  11:17:43 STEP 2544 H=2544:00 +CPU= 40.900
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhq0f+002544
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhq0f+002544
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhq0f+002544
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185349/ICMGGhq0f+002520
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185349/ICMSHhq0f+002520
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185349/ICMUAhq0f+002520
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185349/ICMGGhq0f+002532
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185349/ICMSHhq0f+002532
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185349/ICMUAhq0f+002532
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0705_1999050100_123_968_12185349_1_r2025426554_105.zip
Uploading the intermediate file: upload_file_105.zip
  11:18:05 STEP 2545 H=2545:00 +CPU= 22.066
  11:18:27 STEP 2546 H=2546:00 +CPU= 22.320
  11:19:03 STEP 2547 H=2547:00 +CPU= 35.232
  11:19:25 STEP 2548 H=2548:00 +CPU= 22.708
  11:19:47 STEP 2549 H=2549:00 +CPU= 21.692
  11:20:23 STEP 2550 H=2550:00 +CPU= 35.991
  11:20:45 STEP 2551 H=2551:00 +CPU= 22.082
  11:21:07 STEP 2552 H=2552:00 +CPU= 22.366
  11:21:43 STEP 2553 H=2553:00 +CPU= 35.250
  11:22:05 STEP 2554 H=2554:00 +CPU= 22.715
  11:22:27 STEP 2555 H=2555:00 +CPU= 21.727
  11:23:06 STEP 2556 H=2556:00 +CPU= 38.904
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhq0f+002556
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhq0f+002556
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhq0f+002556
  11:23:28 STEP 2557 H=2557:00 +CPU= 22.102
  11:23:51 STEP 2558 H=2558:00 +CPU= 22.620
  11:24:26 STEP 2559 H=2559:00 +CPU= 35.249
  11:24:49 STEP 2560 H=2560:00 +CPU= 22.771
  11:25:11 STEP 2561 H=2561:00 +CPU= 21.919
  11:25:47 STEP 2562 H=2562:00 +CPU= 35.937
  11:26:09 STEP 2563 H=2563:00 +CPU= 22.077
  11:26:32 STEP 2564 H=2564:00 +CPU= 22.571
  11:27:07 STEP 2565 H=2565:00 +CPU= 35.196
  11:27:29 STEP 2566 H=2566:00 +CPU= 22.773
  11:27:52 STEP 2567 H=2567:00 +CPU= 22.587
  11:28:33 STEP 2568 H=2568:00 +CPU= 40.878
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhq0f+002568
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhq0f+002568
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhq0f+002568
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185349/ICMGGhq0f+002544
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185349/ICMSHhq0f+002544
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185349/ICMUAhq0f+002544
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185349/ICMGGhq0f+002556
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185349/ICMSHhq0f+002556
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185349/ICMUAhq0f+002556
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0705_1999050100_123_968_12185349_1_r2025426554_106.zip
Uploading the intermediate file: upload_file_106.zip
  11:28:55 STEP 2569 H=2569:00 +CPU= 22.049
  11:29:18 STEP 2570 H=2570:00 +CPU= 22.356
  11:29:53 STEP 2571 H=2571:00 +CPU= 35.239
  11:30:15 STEP 2572 H=2572:00 +CPU= 22.603
  11:30:37 STEP 2573 H=2573:00 +CPU= 21.729
  11:31:13 STEP 2574 H=2574:00 +CPU= 35.996
  11:31:35 STEP 2575 H=2575:00 +CPU= 21.989
  11:31:58 STEP 2576 H=2576:00 +CPU= 22.424
  11:32:33 STEP 2577 H=2577:00 +CPU= 35.300
  11:32:56 STEP 2578 H=2578:00 +CPU= 22.674
  11:33:17 STEP 2579 H=2579:00 +CPU= 21.799
  11:33:56 STEP 2580 H=2580:00 +CPU= 38.919
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhq0f+002580
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhq0f+002580
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhq0f+002580
  11:34:19 STEP 2581 H=2581:00 +CPU= 22.097
  11:34:41 STEP 2582 H=2582:00 +CPU= 22.705
  11:35:17 STEP 2583 H=2583:00 +CPU= 35.359
  11:35:40 STEP 2584 H=2584:00 +CPU= 23.000
  11:36:02 STEP 2585 H=2585:00 +CPU= 21.957
  11:36:38 STEP 2586 H=2586:00 +CPU= 36.068
  11:37:00 STEP 2587 H=2587:00 +CPU= 22.300
  11:37:23 STEP 2588 H=2588:00 +CPU= 22.628
  11:37:58 STEP 2589 H=2589:00 +CPU= 35.264
  11:38:21 STEP 2590 H=2590:00 +CPU= 22.864
  11:38:43 STEP 2591 H=2591:00 +CPU= 22.570
  11:39:24 STEP 2592 H=2592:00 +CPU= 40.898
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhq0f+002592
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhq0f+002592
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhq0f+002592
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185349/ICMGGhq0f+002568
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185349/ICMSHhq0f+002568
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185349/ICMUAhq0f+002568
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185349/ICMGGhq0f+002580
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185349/ICMSHhq0f+002580
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185349/ICMUAhq0f+002580
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0705_1999050100_123_968_12185349_1_r2025426554_107.zip
Uploading the intermediate file: upload_file_107.zip
  11:39:47 STEP 2593 H=2593:00 +CPU= 22.055
  11:40:09 STEP 2594 H=2594:00 +CPU= 22.389
  11:40:44 STEP 2595 H=2595:00 +CPU= 35.182
  11:41:07 STEP 2596 H=2596:00 +CPU= 22.619
  11:41:29 STEP 2597 H=2597:00 +CPU= 21.789
  11:42:05 STEP 2598 H=2598:00 +CPU= 35.969
  11:42:27 STEP 2599 H=2599:00 +CPU= 22.000
  11:42:49 STEP 2600 H=2600:00 +CPU= 22.461
  11:43:24 STEP 2601 H=2601:00 +CPU= 35.244
  11:43:47 STEP 2602 H=2602:00 +CPU= 22.676
  11:44:09 STEP 2603 H=2603:00 +CPU= 21.811
  11:44:48 STEP 2604 H=2604:00 +CPU= 38.858
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhq0f+002604
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhq0f+002604
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhq0f+002604
  11:45:10 STEP 2605 H=2605:00 +CPU= 22.103
  11:45:32 STEP 2606 H=2606:00 +CPU= 22.679
  11:46:08 STEP 2607 H=2607:00 +CPU= 35.266
  11:46:31 STEP 2608 H=2608:00 +CPU= 22.914
  11:46:53 STEP 2609 H=2609:00 +CPU= 21.958
  11:47:29 STEP 2610 H=2610:00 +CPU= 36.001
  11:47:51 STEP 2611 H=2611:00 +CPU= 22.254
  11:48:14 STEP 2612 H=2612:00 +CPU= 22.649
  11:48:49 STEP 2613 H=2613:00 +CPU= 35.240
  11:49:12 STEP 2614 H=2614:00 +CPU= 22.889
  11:49:34 STEP 2615 H=2615:00 +CPU= 22.587
  11:50:15 STEP 2616 H=2616:00 +CPU= 40.951
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhq0f+002616
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhq0f+002616
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhq0f+002616
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185349/ICMGGhq0f+002592
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185349/ICMSHhq0f+002592
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185349/ICMUAhq0f+002592
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185349/ICMGGhq0f+002604
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185349/ICMSHhq0f+002604
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185349/ICMUAhq0f+002604
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0705_1999050100_123_968_12185349_1_r2025426554_108.zip
Uploading the intermediate file: upload_file_108.zip
  11:50:37 STEP 2617 H=2617:00 +CPU= 22.065
  11:51:00 STEP 2618 H=2618:00 +CPU= 22.383
  11:51:35 STEP 2619 H=2619:00 +CPU= 35.226
  11:51:58 STEP 2620 H=2620:00 +CPU= 22.631
  11:52:20 STEP 2621 H=2621:00 +CPU= 21.774
  11:52:56 STEP 2622 H=2622:00 +CPU= 36.030
  11:53:18 STEP 2623 H=2623:00 +CPU= 22.013
  11:53:40 STEP 2624 H=2624:00 +CPU= 22.456
  11:54:15 STEP 2625 H=2625:00 +CPU= 35.340
  11:54:38 STEP 2626 H=2626:00 +CPU= 22.696
  11:55:00 STEP 2627 H=2627:00 +CPU= 21.804
  11:55:39 STEP 2628 H=2628:00 +CPU= 38.910
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhq0f+002628
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhq0f+002628
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhq0f+002628
  11:56:01 STEP 2629 H=2629:00 +CPU= 22.072
  11:56:24 STEP 2630 H=2630:00 +CPU= 22.679
  11:56:59 STEP 2631 H=2631:00 +CPU= 35.400
  11:57:22 STEP 2632 H=2632:00 +CPU= 22.963
  11:57:44 STEP 2633 H=2633:00 +CPU= 21.958
  11:58:20 STEP 2634 H=2634:00 +CPU= 36.036
  11:58:42 STEP 2635 H=2635:00 +CPU= 22.265
  11:59:05 STEP 2636 H=2636:00 +CPU= 22.650
  11:59:40 STEP 2637 H=2637:00 +CPU= 35.414
  12:00:03 STEP 2638 H=2638:00 +CPU= 23.042
  12:00:26 STEP 2639 H=2639:00 +CPU= 22.591
  12:01:07 STEP 2640 H=2640:00 +CPU= 40.936
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhq0f+002640
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhq0f+002640
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhq0f+002640
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185349/ICMGGhq0f+002616
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185349/ICMSHhq0f+002616
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185349/ICMUAhq0f+002616
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185349/ICMGGhq0f+002628
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185349/ICMSHhq0f+002628
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185349/ICMUAhq0f+002628
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0705_1999050100_123_968_12185349_1_r2025426554_109.zip
Uploading the intermediate file: upload_file_109.zip
  12:01:29 STEP 2641 H=2641:00 +CPU= 22.076
  12:01:52 STEP 2642 H=2642:00 +CPU= 22.386
  12:02:27 STEP 2643 H=2643:00 +CPU= 35.285
  12:02:50 STEP 2644 H=2644:00 +CPU= 22.655
  12:03:11 STEP 2645 H=2645:00 +CPU= 21.741
  12:03:47 STEP 2646 H=2646:00 +CPU= 36.032
  12:04:09 STEP 2647 H=2647:00 +CPU= 22.025
  12:04:32 STEP 2648 H=2648:00 +CPU= 22.429
  12:05:07 STEP 2649 H=2649:00 +CPU= 35.277
  12:05:30 STEP 2650 H=2650:00 +CPU= 22.690
  12:05:52 STEP 2651 H=2651:00 +CPU= 21.783
  12:06:31 STEP 2652 H=2652:00 +CPU= 38.872
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhq0f+002652
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhq0f+002652
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhq0f+002652
  12:06:53 STEP 2653 H=2653:00 +CPU= 22.083
  12:07:15 STEP 2654 H=2654:00 +CPU= 22.685
  12:07:51 STEP 2655 H=2655:00 +CPU= 35.309
  12:08:14 STEP 2656 H=2656:00 +CPU= 22.920
  12:08:36 STEP 2657 H=2657:00 +CPU= 21.982
  12:09:12 STEP 2658 H=2658:00 +CPU= 36.043
  12:09:34 STEP 2659 H=2659:00 +CPU= 22.272
  12:09:57 STEP 2660 H=2660:00 +CPU= 22.616
  12:10:32 STEP 2661 H=2661:00 +CPU= 35.247
  12:10:55 STEP 2662 H=2662:00 +CPU= 22.864
  12:11:17 STEP 2663 H=2663:00 +CPU= 22.557
  12:11:58 STEP 2664 H=2664:00 +CPU= 40.931
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhq0f+002664
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhq0f+002664
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhq0f+002664
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185349/ICMGGhq0f+002640
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185349/ICMSHhq0f+002640
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185349/ICMUAhq0f+002640
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185349/ICMGGhq0f+002652
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185349/ICMSHhq0f+002652
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185349/ICMUAhq0f+002652
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0705_1999050100_123_968_12185349_1_r2025426554_110.zip
Uploading the intermediate file: upload_file_110.zip
  12:12:21 STEP 2665 H=2665:00 +CPU= 22.074
  12:12:43 STEP 2666 H=2666:00 +CPU= 22.411
  12:13:18 STEP 2667 H=2667:00 +CPU= 35.209
  12:13:41 STEP 2668 H=2668:00 +CPU= 22.620
  12:14:03 STEP 2669 H=2669:00 +CPU= 21.801
  12:14:39 STEP 2670 H=2670:00 +CPU= 35.943
  12:15:01 STEP 2671 H=2671:00 +CPU= 22.012
  12:15:23 STEP 2672 H=2672:00 +CPU= 22.496
  12:15:58 STEP 2673 H=2673:00 +CPU= 35.245
  12:16:21 STEP 2674 H=2674:00 +CPU= 22.706
  12:16:43 STEP 2675 H=2675:00 +CPU= 21.853
  12:17:22 STEP 2676 H=2676:00 +CPU= 38.841
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhq0f+002676
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhq0f+002676
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhq0f+002676
  12:17:44 STEP 2677 H=2677:00 +CPU= 22.085
  12:18:07 STEP 2678 H=2678:00 +CPU= 22.636
  12:18:42 STEP 2679 H=2679:00 +CPU= 35.232
  12:19:05 STEP 2680 H=2680:00 +CPU= 22.868
  12:19:27 STEP 2681 H=2681:00 +CPU= 21.933
  12:20:03 STEP 2682 H=2682:00 +CPU= 35.969
  12:20:25 STEP 2683 H=2683:00 +CPU= 22.214
  12:20:47 STEP 2684 H=2684:00 +CPU= 22.592
  12:21:23 STEP 2685 H=2685:00 +CPU= 35.263
  12:21:46 STEP 2686 H=2686:00 +CPU= 22.850
  12:22:08 STEP 2687 H=2687:00 +CPU= 22.512
  12:22:49 STEP 2688 H=2688:00 +CPU= 40.927
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhq0f+002688
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhq0f+002688
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhq0f+002688
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185349/ICMGGhq0f+002664
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185349/ICMSHhq0f+002664
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185349/ICMUAhq0f+002664
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185349/ICMGGhq0f+002676
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185349/ICMSHhq0f+002676
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185349/ICMUAhq0f+002676
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0705_1999050100_123_968_12185349_1_r2025426554_111.zip
Uploading the intermediate file: upload_file_111.zip
  12:23:11 STEP 2689 H=2689:00 +CPU= 22.085
  12:23:34 STEP 2690 H=2690:00 +CPU= 22.439
  12:24:09 STEP 2691 H=2691:00 +CPU= 35.214
  12:24:32 STEP 2692 H=2692:00 +CPU= 22.629
  12:24:54 STEP 2693 H=2693:00 +CPU= 21.850
  12:25:30 STEP 2694 H=2694:00 +CPU= 35.998
  12:25:52 STEP 2695 H=2695:00 +CPU= 22.048
  12:26:14 STEP 2696 H=2696:00 +CPU= 22.523
  12:26:49 STEP 2697 H=2697:00 +CPU= 35.274
  12:27:12 STEP 2698 H=2698:00 +CPU= 22.701
  12:27:34 STEP 2699 H=2699:00 +CPU= 21.864
  12:28:13 STEP 2700 H=2700:00 +CPU= 38.893
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhq0f+002700
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhq0f+002700
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhq0f+002700
  12:28:35 STEP 2701 H=2701:00 +CPU= 22.110
  12:28:58 STEP 2702 H=2702:00 +CPU= 22.634
  12:29:33 STEP 2703 H=2703:00 +CPU= 35.305
  12:29:56 STEP 2704 H=2704:00 +CPU= 22.885
  12:30:18 STEP 2705 H=2705:00 +CPU= 21.883
  12:30:54 STEP 2706 H=2706:00 +CPU= 36.014
  12:31:16 STEP 2707 H=2707:00 +CPU= 22.248
  12:31:39 STEP 2708 H=2708:00 +CPU= 22.607
  12:32:14 STEP 2709 H=2709:00 +CPU= 35.243
  12:32:37 STEP 2710 H=2710:00 +CPU= 22.844
  12:32:59 STEP 2711 H=2711:00 +CPU= 22.574
  12:33:41 STEP 2712 H=2712:00 +CPU= 40.967
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhq0f+002712
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhq0f+002712
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhq0f+002712
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185349/ICMGGhq0f+002688
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185349/ICMSHhq0f+002688
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185349/ICMUAhq0f+002688
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185349/ICMGGhq0f+002700
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185349/ICMSHhq0f+002700
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185349/ICMUAhq0f+002700
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0705_1999050100_123_968_12185349_1_r2025426554_112.zip
Uploading the intermediate file: upload_file_112.zip
  12:34:03 STEP 2713 H=2713:00 +CPU= 22.094
  12:34:25 STEP 2714 H=2714:00 +CPU= 22.403
  12:35:00 STEP 2715 H=2715:00 +CPU= 35.217
  12:35:23 STEP 2716 H=2716:00 +CPU= 22.633
  12:35:45 STEP 2717 H=2717:00 +CPU= 21.795
  12:36:21 STEP 2718 H=2718:00 +CPU= 36.036
  12:36:43 STEP 2719 H=2719:00 +CPU= 22.033
  12:37:05 STEP 2720 H=2720:00 +CPU= 22.477
  12:37:41 STEP 2721 H=2721:00 +CPU= 35.330
  12:38:03 STEP 2722 H=2722:00 +CPU= 22.734
  12:38:25 STEP 2723 H=2723:00 +CPU= 21.808
  12:39:04 STEP 2724 H=2724:00 +CPU= 38.941
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhq0f+002724
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhq0f+002724
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhq0f+002724
  12:39:26 STEP 2725 H=2725:00 +CPU= 22.099
  12:39:49 STEP 2726 H=2726:00 +CPU= 22.670
  12:40:24 STEP 2727 H=2727:00 +CPU= 35.376
  12:40:47 STEP 2728 H=2728:00 +CPU= 22.930
  12:41:09 STEP 2729 H=2729:00 +CPU= 21.979
  12:41:45 STEP 2730 H=2730:00 +CPU= 36.012
  12:42:08 STEP 2731 H=2731:00 +CPU= 22.214
  12:42:30 STEP 2732 H=2732:00 +CPU= 22.605
  12:43:06 STEP 2733 H=2733:00 +CPU= 35.312
  12:43:28 STEP 2734 H=2734:00 +CPU= 22.841
  12:43:51 STEP 2735 H=2735:00 +CPU= 22.558
  12:44:32 STEP 2736 H=2736:00 +CPU= 40.979
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhq0f+002736
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhq0f+002736
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhq0f+002736
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185349/ICMGGhq0f+002712
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185349/ICMSHhq0f+002712
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185349/ICMUAhq0f+002712
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185349/ICMGGhq0f+002724
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185349/ICMSHhq0f+002724
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185349/ICMUAhq0f+002724
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0705_1999050100_123_968_12185349_1_r2025426554_113.zip
Uploading the intermediate file: upload_file_113.zip
  12:44:54 STEP 2737 H=2737:00 +CPU= 22.054
  12:45:17 STEP 2738 H=2738:00 +CPU= 22.385
  12:45:52 STEP 2739 H=2739:00 +CPU= 35.301
  12:46:15 STEP 2740 H=2740:00 +CPU= 22.651
  12:46:36 STEP 2741 H=2741:00 +CPU= 21.738
  12:47:12 STEP 2742 H=2742:00 +CPU= 36.079
  12:47:34 STEP 2743 H=2743:00 +CPU= 22.055
  12:47:57 STEP 2744 H=2744:00 +CPU= 22.406
  12:48:32 STEP 2745 H=2745:00 +CPU= 35.307
  12:48:55 STEP 2746 H=2746:00 +CPU= 22.720
  12:49:17 STEP 2747 H=2747:00 +CPU= 21.774
  12:49:56 STEP 2748 H=2748:00 +CPU= 38.898
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhq0f+002748
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhq0f+002748
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhq0f+002748
  12:50:18 STEP 2749 H=2749:00 +CPU= 22.110
  12:50:40 STEP 2750 H=2750:00 +CPU= 22.674
  12:51:16 STEP 2751 H=2751:00 +CPU= 35.349
  12:51:39 STEP 2752 H=2752:00 +CPU= 22.828
  12:52:01 STEP 2753 H=2753:00 +CPU= 21.914
  12:52:37 STEP 2754 H=2754:00 +CPU= 35.966
  12:52:59 STEP 2755 H=2755:00 +CPU= 22.187
  12:53:21 STEP 2756 H=2756:00 +CPU= 22.580
  12:53:57 STEP 2757 H=2757:00 +CPU= 35.220
  12:54:19 STEP 2758 H=2758:00 +CPU= 22.855
  12:54:43 STEP 2759 H=2759:00 +CPU= 23.847
  12:55:29 STEP 2760 H=2760:00 +CPU= 42.609
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhq0f+002760
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhq0f+002760
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhq0f+002760
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185349/ICMGGhq0f+002736
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185349/ICMSHhq0f+002736
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185349/ICMUAhq0f+002736
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185349/ICMGGhq0f+002748
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185349/ICMSHhq0f+002748
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185349/ICMUAhq0f+002748
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0705_1999050100_123_968_12185349_1_r2025426554_114.zip
Uploading the intermediate file: upload_file_114.zip
  12:55:51 STEP 2761 H=2761:00 +CPU= 22.063
Uploading trickle at timestep: 9936000
  12:56:14 STEP 2762 H=2762:00 +CPU= 22.833
  12:56:50 STEP 2763 H=2763:00 +CPU= 36.139
  12:57:14 STEP 2764 H=2764:00 +CPU= 23.391
  12:57:36 STEP 2765 H=2765:00 +CPU= 22.698
  12:58:13 STEP 2766 H=2766:00 +CPU= 36.883
  12:58:36 STEP 2767 H=2767:00 +CPU= 22.791
  12:58:59 STEP 2768 H=2768:00 +CPU= 23.415
  12:59:36 STEP 2769 H=2769:00 +CPU= 36.121
  12:59:59 STEP 2770 H=2770:00 +CPU= 23.462
  13:00:22 STEP 2771 H=2771:00 +CPU= 22.786
  13:01:02 STEP 2772 H=2772:00 +CPU= 39.754
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhq0f+002772
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhq0f+002772
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhq0f+002772
  13:01:24 STEP 2773 H=2773:00 +CPU= 22.788
  13:01:48 STEP 2774 H=2774:00 +CPU= 23.434
  13:02:24 STEP 2775 H=2775:00 +CPU= 36.126
  13:02:48 STEP 2776 H=2776:00 +CPU= 23.427
  13:03:10 STEP 2777 H=2777:00 +CPU= 22.712
  13:03:47 STEP 2778 H=2778:00 +CPU= 36.854
  13:04:10 STEP 2779 H=2779:00 +CPU= 22.748
  13:04:33 STEP 2780 H=2780:00 +CPU= 23.380
  13:05:09 STEP 2781 H=2781:00 +CPU= 36.096
  13:05:33 STEP 2782 H=2782:00 +CPU= 23.401
  13:05:57 STEP 2783 H=2783:00 +CPU= 23.438
  13:06:41 STEP 2784 H=2784:00 +CPU= 41.795
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhq0f+002784
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhq0f+002784
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhq0f+002784
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185349/ICMGGhq0f+002760
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185349/ICMSHhq0f+002760
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185349/ICMUAhq0f+002760
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185349/ICMGGhq0f+002772
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185349/ICMSHhq0f+002772
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185349/ICMUAhq0f+002772
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0705_1999050100_123_968_12185349_1_r2025426554_115.zip
Uploading the intermediate file: upload_file_115.zip
  13:07:04 STEP 2785 H=2785:00 +CPU= 22.677
  13:07:27 STEP 2786 H=2786:00 +CPU= 23.329
  13:08:03 STEP 2787 H=2787:00 +CPU= 36.120
  13:08:27 STEP 2788 H=2788:00 +CPU= 23.425
  13:08:49 STEP 2789 H=2789:00 +CPU= 22.697
  13:09:26 STEP 2790 H=2790:00 +CPU= 36.937
  13:09:49 STEP 2791 H=2791:00 +CPU= 22.791
  13:10:13 STEP 2792 H=2792:00 +CPU= 23.394
  13:10:49 STEP 2793 H=2793:00 +CPU= 36.158
  13:11:12 STEP 2794 H=2794:00 +CPU= 23.450
  13:11:35 STEP 2795 H=2795:00 +CPU= 22.758
  13:12:15 STEP 2796 H=2796:00 +CPU= 39.767
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhq0f+002796
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhq0f+002796
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhq0f+002796
  13:12:38 STEP 2797 H=2797:00 +CPU= 22.834
  13:13:01 STEP 2798 H=2798:00 +CPU= 23.423
  13:13:38 STEP 2799 H=2799:00 +CPU= 36.206
  13:14:01 STEP 2800 H=2800:00 +CPU= 23.480
  13:14:24 STEP 2801 H=2801:00 +CPU= 22.754
  13:15:01 STEP 2802 H=2802:00 +CPU= 36.953
  13:15:24 STEP 2803 H=2803:00 +CPU= 22.833
  13:15:47 STEP 2804 H=2804:00 +CPU= 23.373
  13:16:23 STEP 2805 H=2805:00 +CPU= 36.198
  13:16:47 STEP 2806 H=2806:00 +CPU= 23.477
  13:17:11 STEP 2807 H=2807:00 +CPU= 23.492
  13:17:53 STEP 2808 H=2808:00 +CPU= 41.919
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhq0f+002808
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhq0f+002808
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhq0f+002808
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185349/ICMGGhq0f+002784
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185349/ICMSHhq0f+002784
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185349/ICMUAhq0f+002784
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185349/ICMGGhq0f+002796
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185349/ICMSHhq0f+002796
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185349/ICMUAhq0f+002796
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0705_1999050100_123_968_12185349_1_r2025426554_116.zip
Uploading the intermediate file: upload_file_116.zip
  13:18:16 STEP 2809 H=2809:00 +CPU= 22.768
  13:18:40 STEP 2810 H=2810:00 +CPU= 23.376
  13:19:16 STEP 2811 H=2811:00 +CPU= 36.168
  13:19:39 STEP 2812 H=2812:00 +CPU= 23.497
  13:20:02 STEP 2813 H=2813:00 +CPU= 22.700
  13:20:39 STEP 2814 H=2814:00 +CPU= 36.999
  13:21:02 STEP 2815 H=2815:00 +CPU= 22.810
  13:21:25 STEP 2816 H=2816:00 +CPU= 23.434
  13:22:02 STEP 2817 H=2817:00 +CPU= 36.164
  13:22:25 STEP 2818 H=2818:00 +CPU= 23.527
  13:22:48 STEP 2819 H=2819:00 +CPU= 22.735
  13:23:28 STEP 2820 H=2820:00 +CPU= 39.912
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhq0f+002820
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhq0f+002820
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhq0f+002820
  13:23:51 STEP 2821 H=2821:00 +CPU= 22.839
  13:24:14 STEP 2822 H=2822:00 +CPU= 23.437
  13:24:50 STEP 2823 H=2823:00 +CPU= 36.161
  13:25:14 STEP 2824 H=2824:00 +CPU= 23.496
  13:25:37 STEP 2825 H=2825:00 +CPU= 22.680
  13:26:14 STEP 2826 H=2826:00 +CPU= 36.941
  13:26:36 STEP 2827 H=2827:00 +CPU= 22.771
  13:27:00 STEP 2828 H=2828:00 +CPU= 23.312
  13:27:36 STEP 2829 H=2829:00 +CPU= 36.149
  13:27:59 STEP 2830 H=2830:00 +CPU= 23.424
  13:28:23 STEP 2831 H=2831:00 +CPU= 23.396
  13:29:05 STEP 2832 H=2832:00 +CPU= 41.910
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhq0f+002832
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhq0f+002832
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhq0f+002832
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185349/ICMGGhq0f+002808
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185349/ICMSHhq0f+002808
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185349/ICMUAhq0f+002808
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185349/ICMGGhq0f+002820
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185349/ICMSHhq0f+002820
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185349/ICMUAhq0f+002820
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0705_1999050100_123_968_12185349_1_r2025426554_117.zip
Uploading the intermediate file: upload_file_117.zip
  13:29:28 STEP 2833 H=2833:00 +CPU= 22.731
  13:29:51 STEP 2834 H=2834:00 +CPU= 23.266
  13:30:28 STEP 2835 H=2835:00 +CPU= 36.108
  13:30:51 STEP 2836 H=2836:00 +CPU= 23.445
  13:31:14 STEP 2837 H=2837:00 +CPU= 22.753
Quit request received from BOINC client, ending the child process
..Failed, model did not complete successfully
(argv0) ../../projects/climateprediction.net/oifs_43r3_ps_1.05_x86_64-pc-linux-gnu
(argv1) start_date: 1999050100
(argv2) exptid: hq0f
(argv3) unique_member_id: 0705
(argv4) batchid: 968
(argv5) wuid: 12185349
(argv6) fclen: 123
(argv7) app_name: oifs_43r3_ps
(argv8) nthreads: 1
Working directory is: /var/lib/boinc-client/slots/1
Project directory is: /var/lib/boinc-client/projects/climateprediction.net/
app name: oifs_43r3_ps
version: 1.05
Location of temp folder: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185349
..mkdir for temp folder for results failed
Copying: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip to: /var/lib/boinc-client/slots/1/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Unzipping the app zip file: /var/lib/boinc-client/slots/1/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Copying the namelist files from: ../../projects/climateprediction.net/jf_6d039ceb4895ab8ab0732ff789ea1b49 to: /var/lib/boinc-client/slots/1/oifs_43r3_ps_0705_1999050100_123_968_12185349.zip
Unzipping the namelist zip file: /var/lib/boinc-client/slots/1/oifs_43r3_ps_0705_1999050100_123_968_12185349.zip
ic_ancil_file: ic_ancil_12185349
ifsdata_file: ifsdata_12185349
climate_data_file: clim_data_12185349
horiz_resolution: 159
vert_resolution: 60
grid_type: l_2
upload_interval: 24
utstep: 3600
nfrres: restart dump frequency (steps) 24
Copying IC ancils from: ../../projects/climateprediction.net/jf_15979f9ba9ad98edd65fc7ea4df72e0e to: /var/lib/boinc-client/slots/1/ic_ancil_12185349.zip
Unzipping the IC ancils zip file: /var/lib/boinc-client/slots/1/ic_ancil_12185349.zip
..mkdir for ifsdata folder failed
Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_de2b6911604b7f7301746580d8363475 to: /var/lib/boinc-client/slots/1/ifsdata/ifsdata_12185349.zip
Unzipping the ifsdata_zip file: /var/lib/boinc-client/slots/1/ifsdata/ifsdata_12185349.zip
..mkdir for the climate data folder failed
Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /var/lib/boinc-client/slots/1/159l_2/clim_data_12185349.zip
Unzipping the climate data zip file: /var/lib/boinc-client/slots/1/159l_2/clim_data_12185349.zip
Checking for progress XML file: /var/lib/boinc-client/slots/1/progress_file_12185349.xml
Opened progress file ok : /var/lib/boinc-client/slots/1/progress_file_12185349.xml
-- Model is restarting --
Adjusting last_iter, 2838, to previous model restart step.
Creating progress file: /var/lib/boinc-client/slots/1/progress_file_12185349.xml
last_cpu_time: 79784
upload_file_number: 118
last_iter: 2831
last_upload: 10195200
model_completed: 0
total_length_of_simulation: 10627200
result_base_name: oifs_43r3_ps_0705_1999050100_123_968_12185349_1_r2025426554
The child process has been launched with process id: 62566
Executing the command: /var/lib/boinc-client/slots/1/oifs_43r3_model.exe
[EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1
[EC_DRHOOK:CB-Boinc-01:1:1:62566:62566] [20230107:133227:1673127147:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2091] fp = 0x3129fe0
[EC_DRHOOK:CB-Boinc-01:1:1:62566:62566] [20230107:133227:1673127147:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1
[EC_DRHOOK:CB-Boinc-01:1:1:62566:62566] [20230107:133227:1673127147:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0)
[EC_DRHOOK:CB-Boinc-01:1:1:62566:62566] [20230107:133227:1673127147:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1
[EC_DRHOOK:CB-Boinc-01:1:1:62566:62566] [20230107:133227:1673127147:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000
[EC_DRHOOK:CB-Boinc-01:1:1:62566:62566] [20230107:133227:1673127147:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0  (RAND_MAX=2147483647)
[EC_DRHOOK:CB-Boinc-01:1:1:62566:62566] [20230107:133227:1673127147:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16
[EC_DRHOOK:CB-Boinc-01:1:1:62566:62566] [20230107:133227:1673127147:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0
[EC_DRHOOK:CB-Boinc-01:1:1:62566:62566] [20230107:133227:1673127147:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500
[EC_DRHOOK:CB-Boinc-01:1:1:62566:62566] [20230107:133227:1673127147:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1
[EC_DRHOOK:CB-Boinc-01:1:1:62566:62566] [20230107:133227:1673127147:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1
[EC_DRHOOK:CB-Boinc-01:1:1:62566:62566] [20230107:133227:1673127147:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1
[EC_DRHOOK:CB-Boinc-01:1:1:62566:62566] [20230107:133227:1673127147:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1
[EC_DRHOOK:CB-Boinc-01:1:1:62566:62566] [20230107:133227:1673127147:0.000] [ignore_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef>
[EC_DRHOOK:CB-Boinc-01:1:1:62566:62566] [20230107:133227:1673127147:0.000] [restore_default_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef>
[EC_DRHOOK:CB-Boinc-01:1:1:62566:62566] [20230107:133227:1673127147:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:CB-Boinc-01:1:1:62566:62566] [20230107:133227:1673127147:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x81f820 (old at (nil))
[EC_DRHOOK:CB-Boinc-01:1:1:62566:62566] [20230107:133227:1673127147:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:CB-Boinc-01:1:1:62566:62566] [20230107:133227:1673127147:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x81f820 (old at (nil))
[EC_DRHOOK:CB-Boinc-01:1:1:62566:62566] [20230107:133227:1673127147:0.000] [trapfpe_treatment@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:CB-Boinc-01:1:1:62566:62566] [20230107:133227:1673127147:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:CB-Boinc-01:1:1:62566:62566] [20230107:133227:1673127147:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:CB-Boinc-01:1:1:62566:62566] [20230107:133227:1673127147:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x81f820 (old at (nil))
[EC_DRHOOK:CB-Boinc-01:1:1:62566:62566] [20230107:133227:1673127147:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:CB-Boinc-01:1:1:62566:62566] [20230107:133227:1673127147:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:CB-Boinc-01:1:1:62566:62566] [20230107:133227:1673127147:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:CB-Boinc-01:1:1:62566:62566] [20230107:133227:1673127147:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x81f820 (old at (nil))
[EC_DRHOOK:CB-Boinc-01:1:1:62566:62566] [20230107:133227:1673127147:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x81f820 (old at (nil))
[EC_DRHOOK:CB-Boinc-01:1:1:62566:62566] [20230107:133227:1673127147:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x81f820 (old at (nil))
[EC_DRHOOK:CB-Boinc-01:1:1:62566:62566] [20230107:133227:1673127147:0.000] [catch_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
  13:33:21 STEP 2832 H=2832:00 +CPU= 40.615
  13:33:43 STEP 2833 H=2833:00 +CPU= 21.967
  13:34:06 STEP 2834 H=2834:00 +CPU= 23.004
  13:34:42 STEP 2835 H=2835:00 +CPU= 35.875
  13:35:05 STEP 2836 H=2836:00 +CPU= 22.676
  13:35:27 STEP 2837 H=2837:00 +CPU= 22.146
  13:36:04 STEP 2838 H=2838:00 +CPU= 36.805
  13:36:26 STEP 2839 H=2839:00 +CPU= 22.737
  13:36:50 STEP 2840 H=2840:00 +CPU= 23.384
  13:37:26 STEP 2841 H=2841:00 +CPU= 36.105
  13:37:49 STEP 2842 H=2842:00 +CPU= 23.508
  13:38:12 STEP 2843 H=2843:00 +CPU= 22.713
  13:38:52 STEP 2844 H=2844:00 +CPU= 39.794
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhq0f+002844
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhq0f+002844
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhq0f+002844
  13:39:15 STEP 2845 H=2845:00 +CPU= 22.730
  13:39:38 STEP 2846 H=2846:00 +CPU= 23.404
  13:40:14 STEP 2847 H=2847:00 +CPU= 36.003
  13:40:38 STEP 2848 H=2848:00 +CPU= 23.350
  13:41:00 STEP 2849 H=2849:00 +CPU= 22.637
  13:41:37 STEP 2850 H=2850:00 +CPU= 36.774
  13:42:00 STEP 2851 H=2851:00 +CPU= 22.646
  13:42:23 STEP 2852 H=2852:00 +CPU= 23.204
  13:42:59 STEP 2853 H=2853:00 +CPU= 35.957
  13:43:23 STEP 2854 H=2854:00 +CPU= 23.443
  13:43:47 STEP 2855 H=2855:00 +CPU= 23.362
  13:44:29 STEP 2856 H=2856:00 +CPU= 41.869
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhq0f+002856
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhq0f+002856
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhq0f+002856
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185349/ICMGGhq0f+002832
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185349/ICMSHhq0f+002832
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185349/ICMUAhq0f+002832
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185349/ICMGGhq0f+002844
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185349/ICMSHhq0f+002844
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185349/ICMUAhq0f+002844
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0705_1999050100_123_968_12185349_1_r2025426554_118.zip
Uploading the intermediate file: upload_file_118.zip
  13:44:51 STEP 2857 H=2857:00 +CPU= 22.504
  13:45:15 STEP 2858 H=2858:00 +CPU= 23.310
  13:45:51 STEP 2859 H=2859:00 +CPU= 35.957
  13:46:14 STEP 2860 H=2860:00 +CPU= 23.356
  13:46:37 STEP 2861 H=2861:00 +CPU= 22.594
Abort request received from BOINC client, ending the child process

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
09 May 2023 16:12:04 1494567 22296106 oifs_43r3_ps_0705_1999050100_123_968_12185349_1 9,936,000 77,647 0.0078
09 May 2023 16:12:01 1494567 22296106 oifs_43r3_ps_0705_1999050100_123_968_12185349_1 9,072,000 71,145 0.0078
09 May 2023 16:11:55 1494567 22296106 oifs_43r3_ps_0705_1999050100_123_968_12185349_1 8,208,000 64,649 0.0079
09 May 2023 16:11:50 1494567 22296106 oifs_43r3_ps_0705_1999050100_123_968_12185349_1 7,344,000 58,063 0.0079
09 May 2023 16:11:45 1494567 22296106 oifs_43r3_ps_0705_1999050100_123_968_12185349_1 6,480,000 51,355 0.0079
09 May 2023 16:11:40 1494567 22296106 oifs_43r3_ps_0705_1999050100_123_968_12185349_1 5,616,000 44,662 0.0080
09 May 2023 16:11:34 1494567 22296106 oifs_43r3_ps_0705_1999050100_123_968_12185349_1 4,752,000 37,957 0.0080
09 May 2023 16:11:30 1494567 22296106 oifs_43r3_ps_0705_1999050100_123_968_12185349_1 3,888,000 31,263 0.0080


©2024 cpdn.org