climateprediction.net home page
Task 22279722

Task 22279722

Name oifs_43r3_ps_0263_2008050100_123_977_12193907_0
Workunit 12193907
Created 23 Dec 2022, 17:58:53 UTC
Sent 1 Jan 2023, 14:35:40 UTC
Report deadline 31 Jan 2023, 14:35:40 UTC
Received 2 Jan 2023, 7:02:11 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 1 (0x00000001) Unknown error code
Computer ID 1378058
Run time 5 hours 43 min 23 sec
CPU time 5 hours 40 min 15 sec
Validate state Invalid
Credit 3,628.80
Device peak FLOPS 4.96 GFLOPS
Application version OpenIFS 43r3 Perturbed Surface v1.05
x86_64-pc-linux-gnu
Peak working set size 4,411.67 MB
Peak swap size 4,974.25 MB
Peak disk usage 1,654.54 MB
Stderr
<core_client_version>7.20.2</core_client_version>
<![CDATA[
<message>
process exited with code 1 (0x1, -255)</message>
<stderr_txt>
P  238 H= 238:00 +CPU= 21.983
  10:27:40 STEP  239 H= 239:00 +CPU= 21.366
  10:28:19 STEP  240 H= 240:00 +CPU= 39.681
Moving to projects directory: /misc/boinc/slots/17/ICMGGhq0f+000240
Moving to projects directory: /misc/boinc/slots/17/ICMSHhq0f+000240
Moving to projects directory: /misc/boinc/slots/17/ICMUAhq0f+000240
Adding to the zip: /misc/boinc/projects/climateprediction.net/oifs_43r3_ps_12193907/ICMGGhq0f+000216
Adding to the zip: /misc/boinc/projects/climateprediction.net/oifs_43r3_ps_12193907/ICMSHhq0f+000216
Adding to the zip: /misc/boinc/projects/climateprediction.net/oifs_43r3_ps_12193907/ICMUAhq0f+000216
Adding to the zip: /misc/boinc/projects/climateprediction.net/oifs_43r3_ps_12193907/ICMGGhq0f+000228
Adding to the zip: /misc/boinc/projects/climateprediction.net/oifs_43r3_ps_12193907/ICMSHhq0f+000228
Adding to the zip: /misc/boinc/projects/climateprediction.net/oifs_43r3_ps_12193907/ICMUAhq0f+000228
Zipping up the intermediate file: /misc/boinc/projects/climateprediction.net/oifs_43r3_ps_0263_2008050100_123_977_12193907_0_r28860629_9.zip
Uploading the intermediate file: upload_file_9.zip
  10:28:40 STEP  241 H= 241:00 +CPU= 20.223
Uploading trickle at timestep: 864000
  10:29:02 STEP  242 H= 242:00 +CPU= 21.945
  10:29:36 STEP  243 H= 243:00 +CPU= 34.308
  10:29:57 STEP  244 H= 244:00 +CPU= 21.369
  10:30:19 STEP  245 H= 245:00 +CPU= 21.610
  10:30:53 STEP  246 H= 246:00 +CPU= 33.226
  10:31:12 STEP  247 H= 247:00 +CPU= 19.605
  10:31:34 STEP  248 H= 248:00 +CPU= 21.252
  10:32:07 STEP  249 H= 249:00 +CPU= 33.528
  10:32:28 STEP  250 H= 250:00 +CPU= 20.804
  10:32:49 STEP  251 H= 251:00 +CPU= 20.767
  10:33:25 STEP  252 H= 252:00 +CPU= 35.906
Moving to projects directory: /misc/boinc/slots/17/ICMGGhq0f+000252
Moving to projects directory: /misc/boinc/slots/17/ICMSHhq0f+000252
Moving to projects directory: /misc/boinc/slots/17/ICMUAhq0f+000252
  10:33:46 STEP  253 H= 253:00 +CPU= 21.677
  10:34:07 STEP  254 H= 254:00 +CPU= 20.267
  10:34:39 STEP  255 H= 255:00 +CPU= 32.487
  10:35:02 STEP  256 H= 256:00 +CPU= 22.420
  10:35:23 STEP  257 H= 257:00 +CPU= 20.799
  10:35:56 STEP  258 H= 258:00 +CPU= 33.318
  10:36:16 STEP  259 H= 259:00 +CPU= 20.296
  10:36:38 STEP  260 H= 260:00 +CPU= 21.295
  10:37:11 STEP  261 H= 261:00 +CPU= 33.089
  10:37:35 STEP  262 H= 262:00 +CPU= 24.602
  10:38:00 STEP  263 H= 263:00 +CPU= 24.337
  10:38:39 STEP  264 H= 264:00 +CPU= 39.054
Moving to projects directory: /misc/boinc/slots/17/ICMGGhq0f+000264
Moving to projects directory: /misc/boinc/slots/17/ICMSHhq0f+000264
Moving to projects directory: /misc/boinc/slots/17/ICMUAhq0f+000264
Adding to the zip: /misc/boinc/projects/climateprediction.net/oifs_43r3_ps_12193907/ICMGGhq0f+000240
Adding to the zip: /misc/boinc/projects/climateprediction.net/oifs_43r3_ps_12193907/ICMSHhq0f+000240
Adding to the zip: /misc/boinc/projects/climateprediction.net/oifs_43r3_ps_12193907/ICMUAhq0f+000240
Adding to the zip: /misc/boinc/projects/climateprediction.net/oifs_43r3_ps_12193907/ICMGGhq0f+000252
Adding to the zip: /misc/boinc/projects/climateprediction.net/oifs_43r3_ps_12193907/ICMSHhq0f+000252
Adding to the zip: /misc/boinc/projects/climateprediction.net/oifs_43r3_ps_12193907/ICMUAhq0f+000252
Zipping up the intermediate file: /misc/boinc/projects/climateprediction.net/oifs_43r3_ps_0263_2008050100_123_977_12193907_0_r28860629_10.zip
Uploading the intermediate file: upload_file_10.zip
  10:39:01 STEP  265 H= 265:00 +CPU= 21.693
  10:39:23 STEP  266 H= 266:00 +CPU= 22.138
  10:39:56 STEP  267 H= 267:00 +CPU= 32.725
  10:40:19 STEP  268 H= 268:00 +CPU= 23.037
  10:40:40 STEP  269 H= 269:00 +CPU= 20.751
  10:41:14 STEP  270 H= 270:00 +CPU= 33.965
  10:41:35 STEP  271 H= 271:00 +CPU= 21.325
  10:41:57 STEP  272 H= 272:00 +CPU= 21.520
  10:42:29 STEP  273 H= 273:00 +CPU= 32.236
  10:42:51 STEP  274 H= 274:00 +CPU= 21.283
  10:43:10 STEP  275 H= 275:00 +CPU= 19.033
  10:43:45 STEP  276 H= 276:00 +CPU= 35.304
Moving to projects directory: /misc/boinc/slots/17/ICMGGhq0f+000276
Moving to projects directory: /misc/boinc/slots/17/ICMSHhq0f+000276
Moving to projects directory: /misc/boinc/slots/17/ICMUAhq0f+000276
  10:44:07 STEP  277 H= 277:00 +CPU= 21.767
  10:44:29 STEP  278 H= 278:00 +CPU= 21.584
  10:45:02 STEP  279 H= 279:00 +CPU= 32.525
  10:45:23 STEP  280 H= 280:00 +CPU= 21.301
  10:45:44 STEP  281 H= 281:00 +CPU= 20.629
  10:46:18 STEP  282 H= 282:00 +CPU= 33.922
  10:46:38 STEP  283 H= 283:00 +CPU= 19.867
  10:46:59 STEP  284 H= 284:00 +CPU= 21.175
  10:47:33 STEP  285 H= 285:00 +CPU= 33.908
  10:47:54 STEP  286 H= 286:00 +CPU= 20.346
  10:48:14 STEP  287 H= 287:00 +CPU= 20.347
  10:48:53 STEP  288 H= 288:00 +CPU= 37.708
Moving to projects directory: /misc/boinc/slots/17/ICMGGhq0f+000288
Moving to projects directory: /misc/boinc/slots/17/ICMSHhq0f+000288
Moving to projects directory: /misc/boinc/slots/17/ICMUAhq0f+000288
Adding to the zip: /misc/boinc/projects/climateprediction.net/oifs_43r3_ps_12193907/ICMGGhq0f+000264
Adding to the zip: /misc/boinc/projects/climateprediction.net/oifs_43r3_ps_12193907/ICMSHhq0f+000264
Adding to the zip: /misc/boinc/projects/climateprediction.net/oifs_43r3_ps_12193907/ICMUAhq0f+000264
Adding to the zip: /misc/boinc/projects/climateprediction.net/oifs_43r3_ps_12193907/ICMGGhq0f+000276
Adding to the zip: /misc/boinc/projects/climateprediction.net/oifs_43r3_ps_12193907/ICMSHhq0f+000276
Adding to the zip: /misc/boinc/projects/climateprediction.net/oifs_43r3_ps_12193907/ICMUAhq0f+000276
Zipping up the intermediate file: /misc/boinc/projects/climateprediction.net/oifs_43r3_ps_0263_2008050100_123_977_12193907_0_r28860629_11.zip
Uploading the intermediate file: upload_file_11.zip
  10:49:13 STEP  289 H= 289:00 +CPU= 20.376
  10:49:34 STEP  290 H= 290:00 +CPU= 20.775
  10:50:08 STEP  291 H= 291:00 +CPU= 33.806
  10:50:29 STEP  292 H= 292:00 +CPU= 20.836
  10:50:49 STEP  293 H= 293:00 +CPU= 19.410
  10:51:24 STEP  294 H= 294:00 +CPU= 35.284
  10:51:45 STEP  295 H= 295:00 +CPU= 20.762
  10:52:08 STEP  296 H= 296:00 +CPU= 22.417
  10:52:42 STEP  297 H= 297:00 +CPU= 34.158
  10:53:02 STEP  298 H= 298:00 +CPU= 19.716
  10:53:21 STEP  299 H= 299:00 +CPU= 19.576
  10:53:57 STEP  300 H= 300:00 +CPU= 35.923
Moving to projects directory: /misc/boinc/slots/17/ICMGGhq0f+000300
Moving to projects directory: /misc/boinc/slots/17/ICMSHhq0f+000300
Moving to projects directory: /misc/boinc/slots/17/ICMUAhq0f+000300
  10:54:18 STEP  301 H= 301:00 +CPU= 20.611
  10:54:39 STEP  302 H= 302:00 +CPU= 21.426
  10:55:11 STEP  303 H= 303:00 +CPU= 32.287
  10:55:34 STEP  304 H= 304:00 +CPU= 22.146
  10:55:53 STEP  305 H= 305:00 +CPU= 19.155
  10:56:25 STEP  306 H= 306:00 +CPU= 32.136
  10:56:43 STEP  307 H= 307:00 +CPU= 18.076
  10:57:03 STEP  308 H= 308:00 +CPU= 19.443
  10:57:33 STEP  309 H= 309:00 +CPU= 30.741
  10:57:54 STEP  310 H= 310:00 +CPU= 20.199
  10:58:14 STEP  311 H= 311:00 +CPU= 20.654
  10:58:54 STEP  312 H= 312:00 +CPU= 35.408
Moving to projects directory: /misc/boinc/slots/17/ICMGGhq0f+000312
Moving to projects directory: /misc/boinc/slots/17/ICMSHhq0f+000312
Moving to projects directory: /misc/boinc/slots/17/ICMUAhq0f+000312
Adding to the zip: /misc/boinc/projects/climateprediction.net/oifs_43r3_ps_12193907/ICMGGhq0f+000288
Adding to the zip: /misc/boinc/projects/climateprediction.net/oifs_43r3_ps_12193907/ICMSHhq0f+000288
Adding to the zip: /misc/boinc/projects/climateprediction.net/oifs_43r3_ps_12193907/ICMUAhq0f+000288
Adding to the zip: /misc/boinc/projects/climateprediction.net/oifs_43r3_ps_12193907/ICMGGhq0f+000300
Adding to the zip: /misc/boinc/projects/climateprediction.net/oifs_43r3_ps_12193907/ICMSHhq0f+000300
Adding to the zip: /misc/boinc/projects/climateprediction.net/oifs_43r3_ps_12193907/ICMUAhq0f+000300
Zipping up the intermediate file: /misc/boinc/projects/climateprediction.net/oifs_43r3_ps_0263_2008050100_123_977_12193907_0_r28860629_12.zip
Uploading the intermediate file: upload_file_12.zip
  10:59:13 STEP  313 H= 313:00 +CPU= 19.750
  10:59:33 STEP  314 H= 314:00 +CPU= 19.535
  11:00:05 STEP  315 H= 315:00 +CPU= 31.814
  11:00:25 STEP  316 H= 316:00 +CPU= 19.974
  11:00:45 STEP  317 H= 317:00 +CPU= 20.642
  11:01:18 STEP  318 H= 318:00 +CPU= 32.388
  11:01:40 STEP  319 H= 319:00 +CPU= 21.985
  11:02:03 STEP  320 H= 320:00 +CPU= 22.980
  11:02:36 STEP  321 H= 321:00 +CPU= 33.601
  11:02:58 STEP  322 H= 322:00 +CPU= 21.096
  11:03:17 STEP  323 H= 323:00 +CPU= 19.928
  11:03:56 STEP  324 H= 324:00 +CPU= 38.405
Moving to projects directory: /misc/boinc/slots/17/ICMGGhq0f+000324
Moving to projects directory: /misc/boinc/slots/17/ICMSHhq0f+000324
Moving to projects directory: /misc/boinc/slots/17/ICMUAhq0f+000324
  11:04:16 STEP  325 H= 325:00 +CPU= 20.341
  11:04:37 STEP  326 H= 326:00 +CPU= 21.147
  11:05:10 STEP  327 H= 327:00 +CPU= 32.417
  11:05:32 STEP  328 H= 328:00 +CPU= 21.605
  11:05:53 STEP  329 H= 329:00 +CPU= 21.132
  11:06:24 STEP  330 H= 330:00 +CPU= 31.199
  11:06:45 STEP  331 H= 331:00 +CPU= 21.212
  11:07:06 STEP  332 H= 332:00 +CPU= 20.400
  11:07:37 STEP  333 H= 333:00 +CPU= 31.226
  11:07:57 STEP  334 H= 334:00 +CPU= 20.443
  11:08:17 STEP  335 H= 335:00 +CPU= 19.759
  11:08:55 STEP  336 H= 336:00 +CPU= 37.661
Moving to projects directory: /misc/boinc/slots/17/ICMGGhq0f+000336
Moving to projects directory: /misc/boinc/slots/17/ICMSHhq0f+000336
Moving to projects directory: /misc/boinc/slots/17/ICMUAhq0f+000336
Adding to the zip: /misc/boinc/projects/climateprediction.net/oifs_43r3_ps_12193907/ICMGGhq0f+000312
Adding to the zip: /misc/boinc/projects/climateprediction.net/oifs_43r3_ps_12193907/ICMSHhq0f+000312
Adding to the zip: /misc/boinc/projects/climateprediction.net/oifs_43r3_ps_12193907/ICMUAhq0f+000312
Adding to the zip: /misc/boinc/projects/climateprediction.net/oifs_43r3_ps_12193907/ICMGGhq0f+000324
Adding to the zip: /misc/boinc/projects/climateprediction.net/oifs_43r3_ps_12193907/ICMSHhq0f+000324
Adding to the zip: /misc/boinc/projects/climateprediction.net/oifs_43r3_ps_12193907/ICMUAhq0f+000324
Zipping up the intermediate file: /misc/boinc/projects/climateprediction.net/oifs_43r3_ps_0263_2008050100_123_977_12193907_0_r28860629_13.zip
Uploading the intermediate file: upload_file_13.zip
  11:09:16 STEP  337 H= 337:00 +CPU= 20.951
  11:09:38 STEP  338 H= 338:00 +CPU= 21.493
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  11:17:05 STEP  339 H= 339:00 +CPU= 32.061
  11:17:26 STEP  340 H= 340:00 +CPU= 21.003
  11:17:51 STEP  341 H= 341:00 +CPU= 24.936
  11:18:23 STEP  342 H= 342:00 +CPU= 32.048
  11:18:44 STEP  343 H= 343:00 +CPU= 20.209
  11:19:04 STEP  344 H= 344:00 +CPU= 19.998
  11:19:36 STEP  345 H= 345:00 +CPU= 32.191
  11:19:57 STEP  346 H= 346:00 +CPU= 20.777
  11:20:16 STEP  347 H= 347:00 +CPU= 19.031
  11:20:49 STEP  348 H= 348:00 +CPU= 33.210
Moving to projects directory: /misc/boinc/slots/17/ICMGGhq0f+000348
Moving to projects directory: /misc/boinc/slots/17/ICMSHhq0f+000348
Moving to projects directory: /misc/boinc/slots/17/ICMUAhq0f+000348
  11:21:09 STEP  349 H= 349:00 +CPU= 20.074
  11:21:30 STEP  350 H= 350:00 +CPU= 20.373
  11:22:00 STEP  351 H= 351:00 +CPU= 30.483
  11:22:22 STEP  352 H= 352:00 +CPU= 21.651
  11:22:42 STEP  353 H= 353:00 +CPU= 20.024
  11:23:16 STEP  354 H= 354:00 +CPU= 33.499
  11:23:36 STEP  355 H= 355:00 +CPU= 20.852
  11:23:57 STEP  356 H= 356:00 +CPU= 20.307
  11:24:30 STEP  357 H= 357:00 +CPU= 32.757
  11:24:52 STEP  358 H= 358:00 +CPU= 22.235
  11:25:15 STEP  359 H= 359:00 +CPU= 22.742
  11:25:54 STEP  360 H= 360:00 +CPU= 37.603
Moving to projects directory: /misc/boinc/slots/17/ICMGGhq0f+000360
Moving to projects directory: /misc/boinc/slots/17/ICMSHhq0f+000360
Moving to projects directory: /misc/boinc/slots/17/ICMUAhq0f+000360
Adding to the zip: /misc/boinc/projects/climateprediction.net/oifs_43r3_ps_12193907/ICMGGhq0f+000336
Adding to the zip: /misc/boinc/projects/climateprediction.net/oifs_43r3_ps_12193907/ICMSHhq0f+000336
Adding to the zip: /misc/boinc/projects/climateprediction.net/oifs_43r3_ps_12193907/ICMUAhq0f+000336
Adding to the zip: /misc/boinc/projects/climateprediction.net/oifs_43r3_ps_12193907/ICMGGhq0f+000348
Adding to the zip: /misc/boinc/projects/climateprediction.net/oifs_43r3_ps_12193907/ICMSHhq0f+000348
Adding to the zip: /misc/boinc/projects/climateprediction.net/oifs_43r3_ps_12193907/ICMUAhq0f+000348
Zipping up the intermediate file: /misc/boinc/projects/climateprediction.net/oifs_43r3_ps_0263_2008050100_123_977_12193907_0_r28860629_14.zip
Uploading the intermediate file: upload_file_14.zip
  11:26:13 STEP  361 H= 361:00 +CPU= 18.843
  11:26:34 STEP  362 H= 362:00 +CPU= 21.319
  11:27:07 STEP  363 H= 363:00 +CPU= 32.804
  11:27:29 STEP  364 H= 364:00 +CPU= 21.595
  11:27:51 STEP  365 H= 365:00 +CPU= 21.845
  11:28:25 STEP  366 H= 366:00 +CPU= 33.819
  11:28:49 STEP  367 H= 367:00 +CPU= 23.920
  11:29:11 STEP  368 H= 368:00 +CPU= 22.375
  11:29:46 STEP  369 H= 369:00 +CPU= 33.593
  11:30:09 STEP  370 H= 370:00 +CPU= 23.050
  11:30:33 STEP  371 H= 371:00 +CPU= 23.258
  11:31:10 STEP  372 H= 372:00 +CPU= 37.432
Moving to projects directory: /misc/boinc/slots/17/ICMGGhq0f+000372
Moving to projects directory: /misc/boinc/slots/17/ICMSHhq0f+000372
Moving to projects directory: /misc/boinc/slots/17/ICMUAhq0f+000372
  11:31:32 STEP  373 H= 373:00 +CPU= 21.410
  11:31:53 STEP  374 H= 374:00 +CPU= 21.688
  11:32:26 STEP  375 H= 375:00 +CPU= 32.651
  11:32:47 STEP  376 H= 376:00 +CPU= 20.618
  11:33:07 STEP  377 H= 377:00 +CPU= 20.597
  11:33:42 STEP  378 H= 378:00 +CPU= 34.479
  11:34:03 STEP  379 H= 379:00 +CPU= 21.522
  11:34:27 STEP  380 H= 380:00 +CPU= 22.993
  11:35:00 STEP  381 H= 381:00 +CPU= 33.525
  11:35:22 STEP  382 H= 382:00 +CPU= 21.772
  11:35:45 STEP  383 H= 383:00 +CPU= 22.353
  11:36:25 STEP  384 H= 384:00 +CPU= 39.886
Moving to projects directory: /misc/boinc/slots/17/ICMGGhq0f+000384
Moving to projects directory: /misc/boinc/slots/17/ICMSHhq0f+000384
Moving to projects directory: /misc/boinc/slots/17/ICMUAhq0f+000384
Adding to the zip: /misc/boinc/projects/climateprediction.net/oifs_43r3_ps_12193907/ICMGGhq0f+000360
Adding to the zip: /misc/boinc/projects/climateprediction.net/oifs_43r3_ps_12193907/ICMSHhq0f+000360
Adding to the zip: /misc/boinc/projects/climateprediction.net/oifs_43r3_ps_12193907/ICMUAhq0f+000360
Adding to the zip: /misc/boinc/projects/climateprediction.net/oifs_43r3_ps_12193907/ICMGGhq0f+000372
Adding to the zip: /misc/boinc/projects/climateprediction.net/oifs_43r3_ps_12193907/ICMSHhq0f+000372
Adding to the zip: /misc/boinc/projects/climateprediction.net/oifs_43r3_ps_12193907/ICMUAhq0f+000372
Zipping up the intermediate file: /misc/boinc/projects/climateprediction.net/oifs_43r3_ps_0263_2008050100_123_977_12193907_0_r28860629_15.zip
Uploading the intermediate file: upload_file_15.zip
  11:36:47 STEP  385 H= 385:00 +CPU= 21.914
  11:37:08 STEP  386 H= 386:00 +CPU= 21.650
  11:37:41 STEP  387 H= 387:00 +CPU= 32.532
  11:38:04 STEP  388 H= 388:00 +CPU= 22.129
  11:38:25 STEP  389 H= 389:00 +CPU= 21.332
  11:38:58 STEP  390 H= 390:00 +CPU= 33.392
  11:39:21 STEP  391 H= 391:00 +CPU= 22.140
  11:39:43 STEP  392 H= 392:00 +CPU= 22.268
  11:40:17 STEP  393 H= 393:00 +CPU= 32.518
  11:40:37 STEP  394 H= 394:00 +CPU= 20.243
  11:40:58 STEP  395 H= 395:00 +CPU= 21.013
  11:41:34 STEP  396 H= 396:00 +CPU= 35.751
Moving to projects directory: /misc/boinc/slots/17/ICMGGhq0f+000396
Moving to projects directory: /misc/boinc/slots/17/ICMSHhq0f+000396
Moving to projects directory: /misc/boinc/slots/17/ICMUAhq0f+000396
  11:41:55 STEP  397 H= 397:00 +CPU= 21.012
  11:42:16 STEP  398 H= 398:00 +CPU= 20.651
  11:42:50 STEP  399 H= 399:00 +CPU= 34.169
  11:43:12 STEP  400 H= 400:00 +CPU= 21.997
  11:43:32 STEP  401 H= 401:00 +CPU= 20.585
  11:44:07 STEP  402 H= 402:00 +CPU= 34.262
  11:44:26 STEP  403 H= 403:00 +CPU= 19.524
  11:44:47 STEP  404 H= 404:00 +CPU= 21.249
  11:45:18 STEP  405 H= 405:00 +CPU= 30.688
  11:45:38 STEP  406 H= 406:00 +CPU= 20.082
  11:45:57 STEP  407 H= 407:00 +CPU= 18.486
  11:46:33 STEP  408 H= 408:00 +CPU= 35.819
Moving to projects directory: /misc/boinc/slots/17/ICMGGhq0f+000408
Moving to projects directory: /misc/boinc/slots/17/ICMSHhq0f+000408
Moving to projects directory: /misc/boinc/slots/17/ICMUAhq0f+000408
Adding to the zip: /misc/boinc/projects/climateprediction.net/oifs_43r3_ps_12193907/ICMGGhq0f+000384
Adding to the zip: /misc/boinc/projects/climateprediction.net/oifs_43r3_ps_12193907/ICMSHhq0f+000384
Adding to the zip: /misc/boinc/projects/climateprediction.net/oifs_43r3_ps_12193907/ICMUAhq0f+000384
Adding to the zip: /misc/boinc/projects/climateprediction.net/oifs_43r3_ps_12193907/ICMGGhq0f+000396
Adding to the zip: /misc/boinc/projects/climateprediction.net/oifs_43r3_ps_12193907/ICMSHhq0f+000396
Adding to the zip: /misc/boinc/projects/climateprediction.net/oifs_43r3_ps_12193907/ICMUAhq0f+000396
Zipping up the intermediate file: /misc/boinc/projects/climateprediction.net/oifs_43r3_ps_0263_2008050100_123_977_12193907_0_r28860629_16.zip
Uploading the intermediate file: upload_file_16.zip
  11:46:53 STEP  409 H= 409:00 +CPU= 20.103
  11:47:14 STEP  410 H= 410:00 +CPU= 20.727
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:56:12 STEP  411 H= 411:00 +CPU= 31.718
  16:56:34 STEP  412 H= 412:00 +CPU= 21.766
  16:56:55 STEP  413 H= 413:00 +CPU= 20.986
  16:57:28 STEP  414 H= 414:00 +CPU= 33.800
  16:57:51 STEP  415 H= 415:00 +CPU= 20.977
  16:58:12 STEP  416 H= 416:00 +CPU= 20.744
  16:58:45 STEP  417 H= 417:00 +CPU= 33.737
  16:59:08 STEP  418 H= 418:00 +CPU= 22.613
  16:59:28 STEP  419 H= 419:00 +CPU= 19.907
  17:00:06 STEP  420 H= 420:00 +CPU= 37.760
Moving to projects directory: /misc/boinc/slots/17/ICMGGhq0f+000420
Moving to projects directory: /misc/boinc/slots/17/ICMSHhq0f+000420
Moving to projects directory: /misc/boinc/slots/17/ICMUAhq0f+000420
  17:00:26 STEP  421 H= 421:00 +CPU= 20.327
  17:00:47 STEP  422 H= 422:00 +CPU= 20.421
  17:01:19 STEP  423 H= 423:00 +CPU= 32.151
  17:01:40 STEP  424 H= 424:00 +CPU= 21.167
  17:02:01 STEP  425 H= 425:00 +CPU= 21.046
  17:02:34 STEP  426 H= 426:00 +CPU= 32.516
  17:02:53 STEP  427 H= 427:00 +CPU= 18.574
  17:03:13 STEP  428 H= 428:00 +CPU= 20.305
  17:03:46 STEP  429 H= 429:00 +CPU= 32.711
  17:04:08 STEP  430 H= 430:00 +CPU= 21.978
  17:04:29 STEP  431 H= 431:00 +CPU= 21.435
  17:05:06 STEP  432 H= 432:00 +CPU= 36.502
Moving to projects directory: /misc/boinc/slots/17/ICMGGhq0f+000432
Moving to projects directory: /misc/boinc/slots/17/ICMSHhq0f+000432
Moving to projects directory: /misc/boinc/slots/17/ICMUAhq0f+000432
Adding to the zip: /misc/boinc/projects/climateprediction.net/oifs_43r3_ps_12193907/ICMGGhq0f+000408
Adding to the zip: /misc/boinc/projects/climateprediction.net/oifs_43r3_ps_12193907/ICMSHhq0f+000408
Adding to the zip: /misc/boinc/projects/climateprediction.net/oifs_43r3_ps_12193907/ICMUAhq0f+000408
Adding to the zip: /misc/boinc/projects/climateprediction.net/oifs_43r3_ps_12193907/ICMGGhq0f+000420
Adding to the zip: /misc/boinc/projects/climateprediction.net/oifs_43r3_ps_12193907/ICMSHhq0f+000420
Adding to the zip: /misc/boinc/projects/climateprediction.net/oifs_43r3_ps_12193907/ICMUAhq0f+000420
Zipping up the intermediate file: /misc/boinc/projects/climateprediction.net/oifs_43r3_ps_0263_2008050100_123_977_12193907_0_r28860629_17.zip
Uploading the intermediate file: upload_file_17.zip
  17:05:27 STEP  433 H= 433:00 +CPU= 20.852
  17:05:50 STEP  434 H= 434:00 +CPU= 22.914
  17:06:24 STEP  435 H= 435:00 +CPU= 34.407
  17:06:46 STEP  436 H= 436:00 +CPU= 21.259
  17:07:07 STEP  437 H= 437:00 +CPU= 21.314
  17:07:39 STEP  438 H= 438:00 +CPU= 32.231
  17:08:00 STEP  439 H= 439:00 +CPU= 19.669
  17:08:22 STEP  440 H= 440:00 +CPU= 21.954
  17:08:54 STEP  441 H= 441:00 +CPU= 31.636
  17:09:16 STEP  442 H= 442:00 +CPU= 21.919
  17:09:37 STEP  443 H= 443:00 +CPU= 21.321
  17:10:13 STEP  444 H= 444:00 +CPU= 35.913
Moving to projects directory: /misc/boinc/slots/17/ICMGGhq0f+000444
Moving to projects directory: /misc/boinc/slots/17/ICMSHhq0f+000444
Moving to projects directory: /misc/boinc/slots/17/ICMUAhq0f+000444
  17:10:34 STEP  445 H= 445:00 +CPU= 21.280
  17:10:56 STEP  446 H= 446:00 +CPU= 21.898
  17:11:30 STEP  447 H= 447:00 +CPU= 33.949
  17:11:51 STEP  448 H= 448:00 +CPU= 21.203
  17:12:12 STEP  449 H= 449:00 +CPU= 20.666
  17:12:46 STEP  450 H= 450:00 +CPU= 34.156
  17:13:08 STEP  451 H= 451:00 +CPU= 21.444
  17:13:31 STEP  452 H= 452:00 +CPU= 22.860
  17:14:05 STEP  453 H= 453:00 +CPU= 33.804
  17:14:25 STEP  454 H= 454:00 +CPU= 20.340
  17:14:47 STEP  455 H= 455:00 +CPU= 22.438
  17:15:26 STEP  456 H= 456:00 +CPU= 38.435
Moving to projects directory: /misc/boinc/slots/17/ICMGGhq0f+000456
Moving to projects directory: /misc/boinc/slots/17/ICMSHhq0f+000456
Moving to projects directory: /misc/boinc/slots/17/ICMUAhq0f+000456
Adding to the zip: /misc/boinc/projects/climateprediction.net/oifs_43r3_ps_12193907/ICMGGhq0f+000432
Adding to the zip: /misc/boinc/projects/climateprediction.net/oifs_43r3_ps_12193907/ICMSHhq0f+000432
Adding to the zip: /misc/boinc/projects/climateprediction.net/oifs_43r3_ps_12193907/ICMUAhq0f+000432
Adding to the zip: /misc/boinc/projects/climateprediction.net/oifs_43r3_ps_12193907/ICMGGhq0f+000444
Adding to the zip: /misc/boinc/projects/climateprediction.net/oifs_43r3_ps_12193907/ICMSHhq0f+000444
Adding to the zip: /misc/boinc/projects/climateprediction.net/oifs_43r3_ps_12193907/ICMUAhq0f+000444
Zipping up the intermediate file: /misc/boinc/projects/climateprediction.net/oifs_43r3_ps_0263_2008050100_123_977_12193907_0_r28860629_18.zip
Uploading the intermediate file: upload_file_18.zip
  17:15:47 STEP  457 H= 457:00 +CPU= 21.235
  17:16:09 STEP  458 H= 458:00 +CPU= 21.717
  17:16:42 STEP  459 H= 459:00 +CPU= 33.508
  17:17:05 STEP  460 H= 460:00 +CPU= 22.312
  17:17:26 STEP  461 H= 461:00 +CPU= 20.937
  17:17:59 STEP  462 H= 462:00 +CPU= 33.012
  17:18:18 STEP  463 H= 463:00 +CPU= 19.686
  17:18:40 STEP  464 H= 464:00 +CPU= 21.869
  17:19:12 STEP  465 H= 465:00 +CPU= 31.790
  17:19:34 STEP  466 H= 466:00 +CPU= 21.483
  17:19:54 STEP  467 H= 467:00 +CPU= 20.601
  17:20:32 STEP  468 H= 468:00 +CPU= 37.638
Moving to projects directory: /misc/boinc/slots/17/ICMGGhq0f+000468
Moving to projects directory: /misc/boinc/slots/17/ICMSHhq0f+000468
Moving to projects directory: /misc/boinc/slots/17/ICMUAhq0f+000468
  17:20:52 STEP  469 H= 469:00 +CPU= 19.704
  17:21:13 STEP  470 H= 470:00 +CPU= 21.680
  17:21:44 STEP  471 H= 471:00 +CPU= 30.447
  17:22:04 STEP  472 H= 472:00 +CPU= 20.093
  17:22:24 STEP  473 H= 473:00 +CPU= 20.175
  17:22:57 STEP  474 H= 474:00 +CPU= 33.069
  17:23:17 STEP  475 H= 475:00 +CPU= 19.630
  17:23:39 STEP  476 H= 476:00 +CPU= 21.436
  17:24:11 STEP  477 H= 477:00 +CPU= 32.237
  17:24:32 STEP  478 H= 478:00 +CPU= 21.353
  17:24:53 STEP  479 H= 479:00 +CPU= 20.324
  17:25:31 STEP  480 H= 480:00 +CPU= 37.407
Moving to projects directory: /misc/boinc/slots/17/ICMGGhq0f+000480
Moving to projects directory: /misc/boinc/slots/17/ICMSHhq0f+000480
Moving to projects directory: /misc/boinc/slots/17/ICMUAhq0f+000480
Adding to the zip: /misc/boinc/projects/climateprediction.net/oifs_43r3_ps_12193907/ICMGGhq0f+000456
Adding to the zip: /misc/boinc/projects/climateprediction.net/oifs_43r3_ps_12193907/ICMSHhq0f+000456
Adding to the zip: /misc/boinc/projects/climateprediction.net/oifs_43r3_ps_12193907/ICMUAhq0f+000456
Adding to the zip: /misc/boinc/projects/climateprediction.net/oifs_43r3_ps_12193907/ICMGGhq0f+000468
Adding to the zip: /misc/boinc/projects/climateprediction.net/oifs_43r3_ps_12193907/ICMSHhq0f+000468
Adding to the zip: /misc/boinc/projects/climateprediction.net/oifs_43r3_ps_12193907/ICMUAhq0f+000468
Zipping up the intermediate file: /misc/boinc/projects/climateprediction.net/oifs_43r3_ps_0263_2008050100_123_977_12193907_0_r28860629_19.zip
Uploading the intermediate file: upload_file_19.zip
  17:25:53 STEP  481 H= 481:00 +CPU= 21.397
Uploading trickle at timestep: 1728000
  17:26:15 STEP  482 H= 482:00 +CPU= 22.409
  17:26:49 STEP  483 H= 483:00 +CPU= 33.505
  17:27:10 STEP  484 H= 484:00 +CPU= 21.211
  17:27:31 STEP  485 H= 485:00 +CPU= 20.499
  17:28:02 STEP  486 H= 486:00 +CPU= 31.419
  17:28:20 STEP  487 H= 487:00 +CPU= 17.445
  17:28:42 STEP  488 H= 488:00 +CPU= 21.963
  17:29:15 STEP  489 H= 489:00 +CPU= 33.908
  17:29:34 STEP  490 H= 490:00 +CPU= 18.861
  17:29:54 STEP  491 H= 491:00 +CPU= 19.956
  17:30:31 STEP  492 H= 492:00 +CPU= 36.571
Moving to projects directory: /misc/boinc/slots/17/ICMGGhq0f+000492
Moving to projects directory: /misc/boinc/slots/17/ICMSHhq0f+000492
Moving to projects directory: /misc/boinc/slots/17/ICMUAhq0f+000492
  17:30:53 STEP  493 H= 493:00 +CPU= 22.228
  17:31:16 STEP  494 H= 494:00 +CPU= 23.003
  17:31:50 STEP  495 H= 495:00 +CPU= 33.616
  17:32:12 STEP  496 H= 496:00 +CPU= 22.152
  17:32:31 STEP  497 H= 497:00 +CPU= 18.603
  17:33:04 STEP  498 H= 498:00 +CPU= 33.250
  17:33:25 STEP  499 H= 499:00 +CPU= 20.612
  17:33:47 STEP  500 H= 500:00 +CPU= 22.322
  17:34:19 STEP  501 H= 501:00 +CPU= 32.133
  17:34:41 STEP  502 H= 502:00 +CPU= 21.958
  17:35:04 STEP  503 H= 503:00 +CPU= 22.643
  17:35:43 STEP  504 H= 504:00 +CPU= 38.192
Moving to projects directory: /misc/boinc/slots/17/ICMGGhq0f+000504
Moving to projects directory: /misc/boinc/slots/17/ICMSHhq0f+000504
Moving to projects directory: /misc/boinc/slots/17/ICMUAhq0f+000504
Adding to the zip: /misc/boinc/projects/climateprediction.net/oifs_43r3_ps_12193907/ICMGGhq0f+000480
Adding to the zip: /misc/boinc/projects/climateprediction.net/oifs_43r3_ps_12193907/ICMSHhq0f+000480
Adding to the zip: /misc/boinc/projects/climateprediction.net/oifs_43r3_ps_12193907/ICMUAhq0f+000480
Adding to the zip: /misc/boinc/projects/climateprediction.net/oifs_43r3_ps_12193907/ICMGGhq0f+000492
Adding to the zip: /misc/boinc/projects/climateprediction.net/oifs_43r3_ps_12193907/ICMSHhq0f+000492
Adding to the zip: /misc/boinc/projects/climateprediction.net/oifs_43r3_ps_12193907/ICMUAhq0f+000492
Zipping up the intermediate file: /misc/boinc/projects/climateprediction.net/oifs_43r3_ps_0263_2008050100_123_977_12193907_0_r28860629_20.zip
Uploading the intermediate file: upload_file_20.zip
  17:36:04 STEP  505 H= 505:00 +CPU= 21.276
  17:36:26 STEP  506 H= 506:00 +CPU= 21.653
  17:37:00 STEP  507 H= 507:00 +CPU= 34.212
  17:37:22 STEP  508 H= 508:00 +CPU= 21.910
  17:37:45 STEP  509 H= 509:00 +CPU= 22.264
  17:38:18 STEP  510 H= 510:00 +CPU= 33.000
  17:38:38 STEP  511 H= 511:00 +CPU= 20.420
  17:39:01 STEP  512 H= 512:00 +CPU= 22.074
  17:39:37 STEP  513 H= 513:00 +CPU= 32.840
  17:40:05 STEP  514 H= 514:00 +CPU= 22.520
  17:40:38 STEP  515 H= 515:00 +CPU= 22.547
  17:41:34 STEP  516 H= 516:00 +CPU= 39.340
Moving to projects directory: /misc/boinc/slots/17/ICMGGhq0f+000516
Moving to projects directory: /misc/boinc/slots/17/ICMSHhq0f+000516
Moving to projects directory: /misc/boinc/slots/17/ICMUAhq0f+000516
  17:42:01 STEP  517 H= 517:00 +CPU= 22.082
  17:42:26 STEP  518 H= 518:00 +CPU= 22.515
  17:43:04 STEP  519 H= 519:00 +CPU= 34.503
  17:43:29 STEP  520 H= 520:00 +CPU= 22.726
  17:43:53 STEP  521 H= 521:00 +CPU= 21.628
  17:44:27 STEP  522 H= 522:00 +CPU= 34.609
  17:44:47 STEP  523 H= 523:00 +CPU= 20.292
  17:45:09 STEP  524 H= 524:00 +CPU= 21.132
  17:45:42 STEP  525 H= 525:00 +CPU= 33.353
  17:46:04 STEP  526 H= 526:00 +CPU= 21.892
  17:46:26 STEP  527 H= 527:00 +CPU= 21.849
  17:47:04 STEP  528 H= 528:00 +CPU= 37.926
Moving to projects directory: /misc/boinc/slots/17/ICMGGhq0f+000528
Moving to projects directory: /misc/boinc/slots/17/ICMSHhq0f+000528
Moving to projects directory: /misc/boinc/slots/17/ICMUAhq0f+000528
Adding to the zip: /misc/boinc/projects/climateprediction.net/oifs_43r3_ps_12193907/ICMGGhq0f+000504
Adding to the zip: /misc/boinc/projects/climateprediction.net/oifs_43r3_ps_12193907/ICMSHhq0f+000504
Adding to the zip: /misc/boinc/projects/climateprediction.net/oifs_43r3_ps_12193907/ICMUAhq0f+000504
Adding to the zip: /misc/boinc/projects/climateprediction.net/oifs_43r3_ps_12193907/ICMGGhq0f+000516
Adding to the zip: /misc/boinc/projects/climateprediction.net/oifs_43r3_ps_12193907/ICMSHhq0f+000516
Adding to the zip: /misc/boinc/projects/climateprediction.net/oifs_43r3_ps_12193907/ICMUAhq0f+000516
Zipping up the intermediate file: /misc/boinc/projects/climateprediction.net/oifs_43r3_ps_0263_2008050100_123_977_12193907_0_r28860629_21.zip
Uploading the intermediate file: upload_file_21.zip
  17:47:25 STEP  529 H= 529:00 +CPU= 21.298
  17:47:47 STEP  530 H= 530:00 +CPU= 21.330
  17:48:18 STEP  531 H= 531:00 +CPU= 31.463
  17:48:39 STEP  532 H= 532:00 +CPU= 20.624
  17:49:00 STEP  533 H= 533:00 +CPU= 20.830
  17:49:35 STEP  534 H= 534:00 +CPU= 35.161
  17:49:57 STEP  535 H= 535:00 +CPU= 22.350
  17:50:18 STEP  536 H= 536:00 +CPU= 21.066
  17:50:52 STEP  537 H= 537:00 +CPU= 33.569
  17:51:13 STEP  538 H= 538:00 +CPU= 20.919
  17:51:33 STEP  539 H= 539:00 +CPU= 20.110
  17:52:12 STEP  540 H= 540:00 +CPU= 38.621
Moving to projects directory: /misc/boinc/slots/17/ICMGGhq0f+000540
Moving to projects directory: /misc/boinc/slots/17/ICMSHhq0f+000540
Moving to projects directory: /misc/boinc/slots/17/ICMUAhq0f+000540
  17:52:34 STEP  541 H= 541:00 +CPU= 21.922
  17:52:55 STEP  542 H= 542:00 +CPU= 21.816
  17:53:30 STEP  543 H= 543:00 +CPU= 34.070
  17:53:52 STEP  544 H= 544:00 +CPU= 22.057
  17:54:14 STEP  545 H= 545:00 +CPU= 22.416
  17:54:49 STEP  546 H= 546:00 +CPU= 34.428
  17:55:09 STEP  547 H= 547:00 +CPU= 20.327
  17:55:29 STEP  548 H= 548:00 +CPU= 19.983
  17:56:02 STEP  549 H= 549:00 +CPU= 33.026
  17:56:23 STEP  550 H= 550:00 +CPU= 20.740
  17:56:46 STEP  551 H= 551:00 +CPU= 23.098
  17:57:26 STEP  552 H= 552:00 +CPU= 39.999
Moving to projects directory: /misc/boinc/slots/17/ICMGGhq0f+000552
Moving to projects directory: /misc/boinc/slots/17/ICMSHhq0f+000552
Moving to projects directory: /misc/boinc/slots/17/ICMUAhq0f+000552
Adding to the zip: /misc/boinc/projects/climateprediction.net/oifs_43r3_ps_12193907/ICMGGhq0f+000528
Adding to the zip: /misc/boinc/projects/climateprediction.net/oifs_43r3_ps_12193907/ICMSHhq0f+000528
Adding to the zip: /misc/boinc/projects/climateprediction.net/oifs_43r3_ps_12193907/ICMUAhq0f+000528
Adding to the zip: /misc/boinc/projects/climateprediction.net/oifs_43r3_ps_12193907/ICMGGhq0f+000540
Adding to the zip: /misc/boinc/projects/climateprediction.net/oifs_43r3_ps_12193907/ICMSHhq0f+000540
Adding to the zip: /misc/boinc/projects/climateprediction.net/oifs_43r3_ps_12193907/ICMUAhq0f+000540
Zipping up the intermediate file: /misc/boinc/projects/climateprediction.net/oifs_43r3_ps_0263_2008050100_123_977_12193907_0_r28860629_22.zip
Uploading the intermediate file: upload_file_22.zip
  17:57:47 STEP  553 H= 553:00 +CPU= 20.847
  17:58:09 STEP  554 H= 554:00 +CPU= 21.480
  17:58:42 STEP  555 H= 555:00 +CPU= 33.283
  17:59:04 STEP  556 H= 556:00 +CPU= 22.056
  17:59:23 STEP  557 H= 557:00 +CPU= 19.275
  17:59:56 STEP  558 H= 558:00 +CPU= 32.792
  18:00:17 STEP  559 H= 559:00 +CPU= 20.934
  18:00:40 STEP  560 H= 560:00 +CPU= 22.317
  18:01:13 STEP  561 H= 561:00 +CPU= 33.344
  18:01:33 STEP  562 H= 562:00 +CPU= 20.405
  18:01:55 STEP  563 H= 563:00 +CPU= 21.524
  18:02:33 STEP  564 H= 564:00 +CPU= 37.566
Moving to projects directory: /misc/boinc/slots/17/ICMGGhq0f+000564
Moving to projects directory: /misc/boinc/slots/17/ICMSHhq0f+000564
Moving to projects directory: /misc/boinc/slots/17/ICMUAhq0f+000564
  18:02:56 STEP  565 H= 565:00 +CPU= 23.092
  18:03:19 STEP  566 H= 566:00 +CPU= 23.346
  18:03:53 STEP  567 H= 567:00 +CPU= 33.280
  18:04:15 STEP  568 H= 568:00 +CPU= 22.199
  18:04:37 STEP  569 H= 569:00 +CPU= 22.307
  18:05:12 STEP  570 H= 570:00 +CPU= 34.520
  18:05:34 STEP  571 H= 571:00 +CPU= 22.233
  18:06:02 STEP  572 H= 572:00 +CPU= 27.880
  18:06:38 STEP  573 H= 573:00 +CPU= 35.902
  18:07:02 STEP  574 H= 574:00 +CPU= 23.341
  18:07:25 STEP  575 H= 575:00 +CPU= 22.807
  18:08:06 STEP  576 H= 576:00 +CPU= 41.156
Moving to projects directory: /misc/boinc/slots/17/ICMGGhq0f+000576
Moving to projects directory: /misc/boinc/slots/17/ICMSHhq0f+000576
Moving to projects directory: /misc/boinc/slots/17/ICMUAhq0f+000576
Adding to the zip: /misc/boinc/projects/climateprediction.net/oifs_43r3_ps_12193907/ICMGGhq0f+000552
Adding to the zip: /misc/boinc/projects/climateprediction.net/oifs_43r3_ps_12193907/ICMSHhq0f+000552
Adding to the zip: /misc/boinc/projects/climateprediction.net/oifs_43r3_ps_12193907/ICMUAhq0f+000552
Adding to the zip: /misc/boinc/projects/climateprediction.net/oifs_43r3_ps_12193907/ICMGGhq0f+000564
Adding to the zip: /misc/boinc/projects/climateprediction.net/oifs_43r3_ps_12193907/ICMSHhq0f+000564
Adding to the zip: /misc/boinc/projects/climateprediction.net/oifs_43r3_ps_12193907/ICMUAhq0f+000564
Zipping up the intermediate file: /misc/boinc/projects/climateprediction.net/oifs_43r3_ps_0263_2008050100_123_977_12193907_0_r28860629_23.zip
Uploading the intermediate file: upload_file_23.zip
  18:08:29 STEP  577 H= 577:00 +CPU= 23.522
  18:08:52 STEP  578 H= 578:00 +CPU= 22.419
  18:09:24 STEP  579 H= 579:00 +CPU= 32.379
  18:09:46 STEP  580 H= 580:00 +CPU= 22.228
  18:10:08 STEP  581 H= 581:00 +CPU= 21.816
  18:10:41 STEP  582 H= 582:00 +CPU= 32.239
  18:11:02 STEP  583 H= 583:00 +CPU= 20.921
  18:11:23 STEP  584 H= 584:00 +CPU= 21.893
  18:11:58 STEP  585 H= 585:00 +CPU= 33.968
  18:12:20 STEP  586 H= 586:00 +CPU= 21.967
  18:12:41 STEP  587 H= 587:00 +CPU= 21.296
  18:13:19 STEP  588 H= 588:00 +CPU= 36.971
Moving to projects directory: /misc/boinc/slots/17/ICMGGhq0f+000588
Moving to projects directory: /misc/boinc/slots/17/ICMSHhq0f+000588
Moving to projects directory: /misc/boinc/slots/17/ICMUAhq0f+000588
  18:13:39 STEP  589 H= 589:00 +CPU= 20.475
  18:14:02 STEP  590 H= 590:00 +CPU= 22.019
  18:14:37 STEP  591 H= 591:00 +CPU= 34.703
  18:14:59 STEP  592 H= 592:00 +CPU= 22.429
  18:15:21 STEP  593 H= 593:00 +CPU= 21.913
  18:15:54 STEP  594 H= 594:00 +CPU= 33.065
  18:16:16 STEP  595 H= 595:00 +CPU= 21.951
  18:16:39 STEP  596 H= 596:00 +CPU= 22.413
  18:17:14 STEP  597 H= 597:00 +CPU= 34.641
  18:17:36 STEP  598 H= 598:00 +CPU= 22.178
  18:17:57 STEP  599 H= 599:00 +CPU= 21.298
  18:18:35 STEP  600 H= 600:00 +CPU= 37.817
Moving to projects directory: /misc/boinc/slots/17/ICMGGhq0f+000600
Moving to projects directory: /misc/boinc/slots/17/ICMSHhq0f+000600
Moving to projects directory: /misc/boinc/slots/17/ICMUAhq0f+000600
Adding to the zip: /misc/boinc/projects/climateprediction.net/oifs_43r3_ps_12193907/ICMGGhq0f+000576
Adding to the zip: /misc/boinc/projects/climateprediction.net/oifs_43r3_ps_12193907/ICMSHhq0f+000576
Adding to the zip: /misc/boinc/projects/climateprediction.net/oifs_43r3_ps_12193907/ICMUAhq0f+000576
Adding to the zip: /misc/boinc/projects/climateprediction.net/oifs_43r3_ps_12193907/ICMGGhq0f+000588
Adding to the zip: /misc/boinc/projects/climateprediction.net/oifs_43r3_ps_12193907/ICMSHhq0f+000588
Adding to the zip: /misc/boinc/projects/climateprediction.net/oifs_43r3_ps_12193907/ICMUAhq0f+000588
Zipping up the intermediate file: /misc/boinc/projects/climateprediction.net/oifs_43r3_ps_0263_2008050100_123_977_12193907_0_r28860629_24.zip
Uploading the intermediate file: upload_file_24.zip
  18:18:56 STEP  601 H= 601:00 +CPU= 21.025
  18:19:18 STEP  602 H= 602:00 +CPU= 21.924
  18:19:50 STEP  603 H= 603:00 +CPU= 31.264
  18:20:12 STEP  604 H= 604:00 +CPU= 22.360
  18:20:34 STEP  605 H= 605:00 +CPU= 22.000
  18:21:07 STEP  606 H= 606:00 +CPU= 31.901
  18:21:28 STEP  607 H= 607:00 +CPU= 21.308
  18:21:50 STEP  608 H= 608:00 +CPU= 21.999
  18:22:24 STEP  609 H= 609:00 +CPU= 33.946
  18:22:47 STEP  610 H= 610:00 +CPU= 21.992
  18:23:08 STEP  611 H= 611:00 +CPU= 20.909
  18:23:46 STEP  612 H= 612:00 +CPU= 37.940
Moving to projects directory: /misc/boinc/slots/17/ICMGGhq0f+000612
Moving to projects directory: /misc/boinc/slots/17/ICMSHhq0f+000612
Moving to projects directory: /misc/boinc/slots/17/ICMUAhq0f+000612
  18:24:07 STEP  613 H= 613:00 +CPU= 21.156
  18:24:29 STEP  614 H= 614:00 +CPU= 22.200
  18:25:02 STEP  615 H= 615:00 +CPU= 32.985
  18:25:25 STEP  616 H= 616:00 +CPU= 22.437
  18:25:48 STEP  617 H= 617:00 +CPU= 23.750
  18:26:23 STEP  618 H= 618:00 +CPU= 34.232
  18:26:44 STEP  619 H= 619:00 +CPU= 21.264
  18:27:06 STEP  620 H= 620:00 +CPU= 21.627
  18:27:38 STEP  621 H= 621:00 +CPU= 32.812
  18:27:59 STEP  622 H= 622:00 +CPU= 20.652
  18:28:21 STEP  623 H= 623:00 +CPU= 22.169
  18:28:59 STEP  624 H= 624:00 +CPU= 37.454
Moving to projects directory: /misc/boinc/slots/17/ICMGGhq0f+000624
Moving to projects directory: /misc/boinc/slots/17/ICMSHhq0f+000624
Moving to projects directory: /misc/boinc/slots/17/ICMUAhq0f+000624
Adding to the zip: /misc/boinc/projects/climateprediction.net/oifs_43r3_ps_12193907/ICMGGhq0f+000600
Adding to the zip: /misc/boinc/projects/climateprediction.net/oifs_43r3_ps_12193907/ICMSHhq0f+000600
Adding to the zip: /misc/boinc/projects/climateprediction.net/oifs_43r3_ps_12193907/ICMUAhq0f+000600
Adding to the zip: /misc/boinc/projects/climateprediction.net/oifs_43r3_ps_12193907/ICMGGhq0f+000612
Adding to the zip: /misc/boinc/projects/climateprediction.net/oifs_43r3_ps_12193907/ICMSHhq0f+000612
Adding to the zip: /misc/boinc/projects/climateprediction.net/oifs_43r3_ps_12193907/ICMUAhq0f+000612
Zipping up the intermediate file: /misc/boinc/projects/climateprediction.net/oifs_43r3_ps_0263_2008050100_123_977_12193907_0_r28860629_25.zip
Uploading the intermediate file: upload_file_25.zip
  18:29:20 STEP  625 H= 625:00 +CPU= 20.713
  18:29:42 STEP  626 H= 626:00 +CPU= 21.779
  18:30:16 STEP  627 H= 627:00 +CPU= 34.124
  18:30:39 STEP  628 H= 628:00 +CPU= 22.665
  18:31:01 STEP  629 H= 629:00 +CPU= 20.738
  18:31:34 STEP  630 H= 630:00 +CPU= 33.360
  18:31:55 STEP  631 H= 631:00 +CPU= 20.193
  18:32:15 STEP  632 H= 632:00 +CPU= 19.665
  18:32:48 STEP  633 H= 633:00 +CPU= 33.065
  18:33:10 STEP  634 H= 634:00 +CPU= 22.311
  18:33:31 STEP  635 H= 635:00 +CPU= 20.820
  18:34:09 STEP  636 H= 636:00 +CPU= 37.127
Moving to projects directory: /misc/boinc/slots/17/ICMGGhq0f+000636
Moving to projects directory: /misc/boinc/slots/17/ICMSHhq0f+000636
Moving to projects directory: /misc/boinc/slots/17/ICMUAhq0f+000636
  18:34:29 STEP  637 H= 637:00 +CPU= 20.698
  18:34:52 STEP  638 H= 638:00 +CPU= 22.305
  18:35:26 STEP  639 H= 639:00 +CPU= 34.037
  18:35:49 STEP  640 H= 640:00 +CPU= 22.246
  18:36:11 STEP  641 H= 641:00 +CPU= 21.905
  18:36:44 STEP  642 H= 642:00 +CPU= 33.171
  18:37:05 STEP  643 H= 643:00 +CPU= 21.386
  18:37:27 STEP  644 H= 644:00 +CPU= 21.306
  18:37:59 STEP  645 H= 645:00 +CPU= 31.702
  18:38:21 STEP  646 H= 646:00 +CPU= 22.268
  18:38:44 STEP  647 H= 647:00 +CPU= 22.705
  18:39:23 STEP  648 H= 648:00 +CPU= 39.258
Moving to projects directory: /misc/boinc/slots/17/ICMGGhq0f+000648
Moving to projects directory: /misc/boinc/slots/17/ICMSHhq0f+000648
Moving to projects directory: /misc/boinc/slots/17/ICMUAhq0f+000648
Adding to the zip: /misc/boinc/projects/climateprediction.net/oifs_43r3_ps_12193907/ICMGGhq0f+000624
Adding to the zip: /misc/boinc/projects/climateprediction.net/oifs_43r3_ps_12193907/ICMSHhq0f+000624
Adding to the zip: /misc/boinc/projects/climateprediction.net/oifs_43r3_ps_12193907/ICMUAhq0f+000624
Adding to the zip: /misc/boinc/projects/climateprediction.net/oifs_43r3_ps_12193907/ICMGGhq0f+000636
Adding to the zip: /misc/boinc/projects/climateprediction.net/oifs_43r3_ps_12193907/ICMSHhq0f+000636
Adding to the zip: /misc/boinc/projects/climateprediction.net/oifs_43r3_ps_12193907/ICMUAhq0f+000636
Zipping up the intermediate file: /misc/boinc/projects/climateprediction.net/oifs_43r3_ps_0263_2008050100_123_977_12193907_0_r28860629_26.zip
Uploading the intermediate file: upload_file_26.zip
  18:39:45 STEP  649 H= 649:00 +CPU= 21.155
  18:40:07 STEP  650 H= 650:00 +CPU= 21.791
  18:40:40 STEP  651 H= 651:00 +CPU= 32.801
  18:41:02 STEP  652 H= 652:00 +CPU= 22.214
  18:41:23 STEP  653 H= 653:00 +CPU= 20.635
  18:41:56 STEP  654 H= 654:00 +CPU= 33.040
  18:42:18 STEP  655 H= 655:00 +CPU= 21.914
  18:42:39 STEP  656 H= 656:00 +CPU= 21.335
  18:43:12 STEP  657 H= 657:00 +CPU= 32.401
  18:43:35 STEP  658 H= 658:00 +CPU= 22.429
  18:43:55 STEP  659 H= 659:00 +CPU= 20.242
  18:44:32 STEP  660 H= 660:00 +CPU= 37.209
Moving to projects directory: /misc/boinc/slots/17/ICMGGhq0f+000660
Moving to projects directory: /misc/boinc/slots/17/ICMSHhq0f+000660
Moving to projects directory: /misc/boinc/slots/17/ICMUAhq0f+000660
  18:44:54 STEP  661 H= 661:00 +CPU= 21.619
  18:45:16 STEP  662 H= 662:00 +CPU= 22.064
  18:45:50 STEP  663 H= 663:00 +CPU= 33.677
  18:46:12 STEP  664 H= 664:00 +CPU= 21.805
  18:46:33 STEP  665 H= 665:00 +CPU= 21.644
  18:47:10 STEP  666 H= 666:00 +CPU= 36.289
  18:47:32 STEP  667 H= 667:00 +CPU= 22.103
  18:47:56 STEP  668 H= 668:00 +CPU= 24.258
  18:48:32 STEP  669 H= 669:00 +CPU= 36.003
  18:48:57 STEP  670 H= 670:00 +CPU= 24.438
  18:49:20 STEP  671 H= 671:00 +CPU= 23.386
  18:50:01 STEP  672 H= 672:00 +CPU= 40.522
Moving to projects directory: /misc/boinc/slots/17/ICMGGhq0f+000672
Moving to projects directory: /misc/boinc/slots/17/ICMSHhq0f+000672
Moving to projects directory: /misc/boinc/slots/17/ICMUAhq0f+000672
Adding to the zip: /misc/boinc/projects/climateprediction.net/oifs_43r3_ps_12193907/ICMGGhq0f+000648
Adding to the zip: /misc/boinc/projects/climateprediction.net/oifs_43r3_ps_12193907/ICMSHhq0f+000648
Adding to the zip: /misc/boinc/projects/climateprediction.net/oifs_43r3_ps_12193907/ICMUAhq0f+000648
Adding to the zip: /misc/boinc/projects/climateprediction.net/oifs_43r3_ps_12193907/ICMGGhq0f+000660
Adding to the zip: /misc/boinc/projects/climateprediction.net/oifs_43r3_ps_12193907/ICMSHhq0f+000660
Adding to the zip: /misc/boinc/projects/climateprediction.net/oifs_43r3_ps_12193907/ICMUAhq0f+000660
Zipping up the intermediate file: /misc/boinc/projects/climateprediction.net/oifs_43r3_ps_0263_2008050100_123_977_12193907_0_r28860629_27.zip
Uploading the intermediate file: upload_file_27.zip
  18:50:22 STEP  673 H= 673:00 +CPU= 21.321
  18:50:44 STEP  674 H= 674:00 +CPU= 21.644
  18:51:17 STEP  675 H= 675:00 +CPU= 33.395
  18:51:42 STEP  676 H= 676:00 +CPU= 21.974
  18:52:02 STEP  677 H= 677:00 +CPU= 20.806
  18:52:36 STEP  678 H= 678:00 +CPU= 33.533
  18:52:58 STEP  679 H= 679:00 +CPU= 21.814
  18:53:20 STEP  680 H= 680:00 +CPU= 21.961
  18:53:53 STEP  681 H= 681:00 +CPU= 32.755
  18:54:15 STEP  682 H= 682:00 +CPU= 21.947
  18:54:36 STEP  683 H= 683:00 +CPU= 21.333
  18:55:13 STEP  684 H= 684:00 +CPU= 36.715
Moving to projects directory: /misc/boinc/slots/17/ICMGGhq0f+000684
Moving to projects directory: /misc/boinc/slots/17/ICMSHhq0f+000684
Moving to projects directory: /misc/boinc/slots/17/ICMUAhq0f+000684
  18:55:34 STEP  685 H= 685:00 +CPU= 21.517
  18:55:55 STEP  686 H= 686:00 +CPU= 20.762
  18:56:29 STEP  687 H= 687:00 +CPU= 34.171
  18:56:50 STEP  688 H= 688:00 +CPU= 21.251
  18:57:10 STEP  689 H= 689:00 +CPU= 19.545
  18:57:42 STEP  690 H= 690:00 +CPU= 32.259
  18:58:04 STEP  691 H= 691:00 +CPU= 21.259
  18:58:23 STEP  692 H= 692:00 +CPU= 19.568
  18:58:55 STEP  693 H= 693:00 +CPU= 31.618
  18:59:14 STEP  694 H= 694:00 +CPU= 19.459
  18:59:34 STEP  695 H= 695:00 +CPU= 19.846
  19:00:13 STEP  696 H= 696:00 +CPU= 38.918
Moving to projects directory: /misc/boinc/slots/17/ICMGGhq0f+000696
Moving to projects directory: /misc/boinc/slots/17/ICMSHhq0f+000696
Moving to projects directory: /misc/boinc/slots/17/ICMUAhq0f+000696
Adding to the zip: /misc/boinc/projects/climateprediction.net/oifs_43r3_ps_12193907/ICMGGhq0f+000672
Adding to the zip: /misc/boinc/projects/climateprediction.net/oifs_43r3_ps_12193907/ICMSHhq0f+000672
Adding to the zip: /misc/boinc/projects/climateprediction.net/oifs_43r3_ps_12193907/ICMUAhq0f+000672
Adding to the zip: /misc/boinc/projects/climateprediction.net/oifs_43r3_ps_12193907/ICMGGhq0f+000684
Adding to the zip: /misc/boinc/projects/climateprediction.net/oifs_43r3_ps_12193907/ICMSHhq0f+000684
Adding to the zip: /misc/boinc/projects/climateprediction.net/oifs_43r3_ps_12193907/ICMUAhq0f+000684
Zipping up the intermediate file: /misc/boinc/projects/climateprediction.net/oifs_43r3_ps_0263_2008050100_123_977_12193907_0_r28860629_28.zip
Uploading the intermediate file: upload_file_28.zip
  19:00:34 STEP  697 H= 697:00 +CPU= 20.809
  19:00:55 STEP  698 H= 698:00 +CPU= 21.131
  19:01:27 STEP  699 H= 699:00 +CPU= 32.013
  19:01:50 STEP  700 H= 700:00 +CPU= 22.111
  19:02:11 STEP  701 H= 701:00 +CPU= 21.101
  19:02:45 STEP  702 H= 702:00 +CPU= 34.288
  19:03:06 STEP  703 H= 703:00 +CPU= 21.043
  19:03:28 STEP  704 H= 704:00 +CPU= 22.176
  19:04:02 STEP  705 H= 705:00 +CPU= 33.405
  19:04:24 STEP  706 H= 706:00 +CPU= 22.657
  19:04:46 STEP  707 H= 707:00 +CPU= 21.763
  19:05:24 STEP  708 H= 708:00 +CPU= 37.285
Moving to projects directory: /misc/boinc/slots/17/ICMGGhq0f+000708
Moving to projects directory: /misc/boinc/slots/17/ICMSHhq0f+000708
Moving to projects directory: /misc/boinc/slots/17/ICMUAhq0f+000708
  19:05:45 STEP  709 H= 709:00 +CPU= 21.052
  19:06:05 STEP  710 H= 710:00 +CPU= 20.513
  19:06:38 STEP  711 H= 711:00 +CPU= 33.032
  19:07:00 STEP  712 H= 712:00 +CPU= 21.921
  19:07:21 STEP  713 H= 713:00 +CPU= 21.097
  19:07:54 STEP  714 H= 714:00 +CPU= 32.849
  19:08:16 STEP  715 H= 715:00 +CPU= 21.830
  19:08:38 STEP  716 H= 716:00 +CPU= 21.846
  19:09:11 STEP  717 H= 717:00 +CPU= 32.995
  19:09:33 STEP  718 H= 718:00 +CPU= 22.080
  19:09:55 STEP  719 H= 719:00 +CPU= 22.051
  19:10:35 STEP  720 H= 720:00 +CPU= 39.729
Moving to projects directory: /misc/boinc/slots/17/ICMGGhq0f+000720
Moving to projects directory: /misc/boinc/slots/17/ICMSHhq0f+000720
Moving to projects directory: /misc/boinc/slots/17/ICMUAhq0f+000720
Adding to the zip: /misc/boinc/projects/climateprediction.net/oifs_43r3_ps_12193907/ICMGGhq0f+000696
Adding to the zip: /misc/boinc/projects/climateprediction.net/oifs_43r3_ps_12193907/ICMSHhq0f+000696
Adding to the zip: /misc/boinc/projects/climateprediction.net/oifs_43r3_ps_12193907/ICMUAhq0f+000696
Adding to the zip: /misc/boinc/projects/climateprediction.net/oifs_43r3_ps_12193907/ICMGGhq0f+000708
Adding to the zip: /misc/boinc/projects/climateprediction.net/oifs_43r3_ps_12193907/ICMSHhq0f+000708
Adding to the zip: /misc/boinc/projects/climateprediction.net/oifs_43r3_ps_12193907/ICMUAhq0f+000708
Zipping up the intermediate file: /misc/boinc/projects/climateprediction.net/oifs_43r3_ps_0263_2008050100_123_977_12193907_0_r28860629_29.zip
Uploading the intermediate file: upload_file_29.zip
  19:10:58 STEP  721 H= 721:00 +CPU= 22.729
Uploading trickle at timestep: 2592000
  19:11:20 STEP  722 H= 722:00 +CPU= 22.566
  19:11:53 STEP  723 H= 723:00 +CPU= 33.057
  19:12:15 STEP  724 H= 724:00 +CPU= 21.562
  19:12:37 STEP  725 H= 725:00 +CPU= 22.425
  19:13:12 STEP  726 H= 726:00 +CPU= 34.569
  19:13:34 STEP  727 H= 727:00 +CPU= 21.565
  19:13:55 STEP  728 H= 728:00 +CPU= 21.639
  19:14:28 STEP  729 H= 729:00 +CPU= 33.010
  19:14:49 STEP  730 H= 730:00 +CPU= 21.146
  19:15:10 STEP  731 H= 731:00 +CPU= 19.998
  19:15:48 STEP  732 H= 732:00 +CPU= 38.432
Moving to projects directory: /misc/boinc/slots/17/ICMGGhq0f+000732
Moving to projects directory: /misc/boinc/slots/17/ICMSHhq0f+000732
Moving to projects directory: /misc/boinc/slots/17/ICMUAhq0f+000732
  19:16:10 STEP  733 H= 733:00 +CPU= 22.052
  19:16:32 STEP  734 H= 734:00 +CPU= 22.056
  19:17:05 STEP  735 H= 735:00 +CPU= 33.326
  19:17:26 STEP  736 H= 736:00 +CPU= 20.747
  19:17:45 STEP  737 H= 737:00 +CPU= 18.577
  19:18:17 STEP  738 H= 738:00 +CPU= 31.704
  19:18:37 STEP  739 H= 739:00 +CPU= 20.153
  19:18:59 STEP  740 H= 740:00 +CPU= 21.910
  19:19:31 STEP  741 H= 741:00 +CPU= 32.031
  19:19:49 STEP  742 H= 742:00 +CPU= 17.794
  19:20:09 STEP  743 H= 743:00 +CPU= 20.612
  19:20:49 STEP  744 H= 744:00 +CPU= 36.011
Moving to projects directory: /misc/boinc/slots/17/ICMGGhq0f+000744
Moving to projects directory: /misc/boinc/slots/17/ICMSHhq0f+000744
Moving to projects directory: /misc/boinc/slots/17/ICMUAhq0f+000744
Adding to the zip: /misc/boinc/projects/climateprediction.net/oifs_43r3_ps_12193907/ICMGGhq0f+000720
Adding to the zip: /misc/boinc/projects/climateprediction.net/oifs_43r3_ps_12193907/ICMSHhq0f+000720
Adding to the zip: /misc/boinc/projects/climateprediction.net/oifs_43r3_ps_12193907/ICMUAhq0f+000720
Adding to the zip: /misc/boinc/projects/climateprediction.net/oifs_43r3_ps_12193907/ICMGGhq0f+000732
Adding to the zip: /misc/boinc/projects/climateprediction.net/oifs_43r3_ps_12193907/ICMSHhq0f+000732
Adding to the zip: /misc/boinc/projects/climateprediction.net/oifs_43r3_ps_12193907/ICMUAhq0f+000732
Zipping up the intermediate file: /misc/boinc/projects/climateprediction.net/oifs_43r3_ps_0263_2008050100_123_977_12193907_0_r28860629_30.zip
Uploading the intermediate file: upload_file_30.zip
  19:21:10 STEP  745 H= 745:00 +CPU= 20.654
  19:21:31 STEP  746 H= 746:00 +CPU= 20.711
  19:22:02 STEP  747 H= 747:00 +CPU= 31.261
  19:22:24 STEP  748 H= 748:00 +CPU= 21.975
  19:22:45 STEP  749 H= 749:00 +CPU= 21.083
  19:23:21 STEP  750 H= 750:00 +CPU= 35.499
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  19:31:02 STEP  751 H= 751:00 +CPU= 20.537
  19:31:23 STEP  752 H= 752:00 +CPU= 20.994
  19:31:56 STEP  753 H= 753:00 +CPU= 32.651
  19:32:16 STEP  754 H= 754:00 +CPU= 20.286
  19:32:37 STEP  755 H= 755:00 +CPU= 21.246
  19:33:15 STEP  756 H= 756:00 +CPU= 37.641
Moving to projects directory: /misc/boinc/slots/17/ICMGGhq0f+000756
Moving to projects directory: /misc/boinc/slots/17/ICMSHhq0f+000756
Moving to projects directory: /misc/boinc/slots/17/ICMUAhq0f+000756
  19:33:36 STEP  757 H= 757:00 +CPU= 21.182
  19:33:59 STEP  758 H= 758:00 +CPU= 23.061
  19:34:32 STEP  759 H= 759:00 +CPU= 32.683
  19:34:52 STEP  760 H= 760:00 +CPU= 19.785
  19:35:12 STEP  761 H= 761:00 +CPU= 20.410
  19:35:45 STEP  762 H= 762:00 +CPU= 32.459
  19:36:06 STEP  763 H= 763:00 +CPU= 21.168
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  23:54:30 STEP  764 H= 764:00 +CPU= 22.395
  23:55:06 STEP  765 H= 765:00 +CPU= 36.440
  23:55:28 STEP  766 H= 766:00 +CPU= 21.431
  23:55:49 STEP  767 H= 767:00 +CPU= 20.658
  23:56:29 STEP  768 H= 768:00 +CPU= 38.093
Moving to projects directory: /misc/boinc/slots/17/ICMGGhq0f+000768
Moving to projects directory: /misc/boinc/slots/17/ICMSHhq0f+000768
Moving to projects directory: /misc/boinc/slots/17/ICMUAhq0f+000768
Adding to the zip: /misc/boinc/projects/climateprediction.net/oifs_43r3_ps_12193907/ICMGGhq0f+000744
Adding to the zip: /misc/boinc/projects/climateprediction.net/oifs_43r3_ps_12193907/ICMSHhq0f+000744
Adding to the zip: /misc/boinc/projects/climateprediction.net/oifs_43r3_ps_12193907/ICMUAhq0f+000744
Adding to the zip: /misc/boinc/projects/climateprediction.net/oifs_43r3_ps_12193907/ICMGGhq0f+000756
Adding to the zip: /misc/boinc/projects/climateprediction.net/oifs_43r3_ps_12193907/ICMSHhq0f+000756
Adding to the zip: /misc/boinc/projects/climateprediction.net/oifs_43r3_ps_12193907/ICMUAhq0f+000756
Zipping up the intermediate file: /misc/boinc/projects/climateprediction.net/oifs_43r3_ps_0263_2008050100_123_977_12193907_0_r28860629_31.zip
Uploading the intermediate file: upload_file_31.zip
  23:56:47 STEP  769 H= 769:00 +CPU= 18.631
  23:57:05 STEP  770 H= 770:00 +CPU= 17.835
  23:57:39 STEP  771 H= 771:00 +CPU= 33.660
  23:58:05 STEP  772 H= 772:00 +CPU= 25.525
  23:58:27 STEP  773 H= 773:00 +CPU= 22.275
  23:59:04 STEP  774 H= 774:00 +CPU= 37.278
  23:59:29 STEP  775 H= 775:00 +CPU= 24.837
  23:59:52 STEP  776 H= 776:00 +CPU= 22.508
  00:00:31 STEP  777 H= 777:00 +CPU= 38.910
  00:00:50 STEP  778 H= 778:00 +CPU= 19.764
  00:01:12 STEP  779 H= 779:00 +CPU= 21.370
  00:01:50 STEP  780 H= 780:00 +CPU= 38.170
Moving to projects directory: /misc/boinc/slots/17/ICMGGhq0f+000780
Moving to projects directory: /misc/boinc/slots/17/ICMSHhq0f+000780
Moving to projects directory: /misc/boinc/slots/17/ICMUAhq0f+000780
  00:02:11 STEP  781 H= 781:00 +CPU= 21.184
  00:02:39 STEP  782 H= 782:00 +CPU= 25.832
  00:03:13 STEP  783 H= 783:00 +CPU= 33.881
  00:03:33 STEP  784 H= 784:00 +CPU= 20.798
  00:03:53 STEP  785 H= 785:00 +CPU= 19.798
  00:04:30 STEP  786 H= 786:00 +CPU= 36.703
  00:04:49 STEP  787 H= 787:00 +CPU= 18.723
  00:05:12 STEP  788 H= 788:00 +CPU= 23.174
  00:05:45 STEP  789 H= 789:00 +CPU= 33.030
  00:06:06 STEP  790 H= 790:00 +CPU= 21.215
  00:06:32 STEP  791 H= 791:00 +CPU= 25.870
  00:07:11 STEP  792 H= 792:00 +CPU= 38.639
Moving to projects directory: /misc/boinc/slots/17/ICMGGhq0f+000792
Moving to projects directory: /misc/boinc/slots/17/ICMSHhq0f+000792
Moving to projects directory: /misc/boinc/slots/17/ICMUAhq0f+000792
Adding to the zip: /misc/boinc/projects/climateprediction.net/oifs_43r3_ps_12193907/ICMGGhq0f+000768
Adding to the zip: /misc/boinc/projects/climateprediction.net/oifs_43r3_ps_12193907/ICMSHhq0f+000768
Adding to the zip: /misc/boinc/projects/climateprediction.net/oifs_43r3_ps_12193907/ICMUAhq0f+000768
Adding to the zip: /misc/boinc/projects/climateprediction.net/oifs_43r3_ps_12193907/ICMGGhq0f+000780
Adding to the zip: /misc/boinc/projects/climateprediction.net/oifs_43r3_ps_12193907/ICMSHhq0f+000780
Adding to the zip: /misc/boinc/projects/climateprediction.net/oifs_43r3_ps_12193907/ICMUAhq0f+000780
Zipping up the intermediate file: /misc/boinc/projects/climateprediction.net/oifs_43r3_ps_0263_2008050100_123_977_12193907_0_r28860629_32.zip
Uploading the intermediate file: upload_file_32.zip
  00:07:36 STEP  793 H= 793:00 +CPU= 24.699
  MAX U WIND=   300.133208538637     
  MAX U WIND=   359.046841831282     
  U WIND =   359.046841831282       IS TOO STRONG, EXPLOSION.
  LEVEL=           42  POINT=            5
  LON  =    108.000000000000       degrees
  LAT  =    65.6068636130102       degrees
 ABORT!    1  !U WIND TOO STRONG, EXPLOSION!!!
[EC_DRHOOK:minstrel:1:1:19370:19370] [20230102:000739:1672639659:55796.174] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3843] 4745 MB (maxheap), 4415 MB (maxrss), 0 MB (maxstack)
[EC_DRHOOK:minstrel:1:1:19370:19370] [20230102:000739:1672639659:55796.195] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :  MASTER 
[EC_DRHOOK:minstrel:1:1:19370:19370] [20230102:000739:1672639659:55796.199] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :   CNT0 
[EC_DRHOOK:minstrel:1:1:19370:19370] [20230102:000739:1672639659:55796.199] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :    CNT1 
[EC_DRHOOK:minstrel:1:1:19370:19370] [20230102:000739:1672639659:55796.199] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :     CNT2 
[EC_DRHOOK:minstrel:1:1:19370:19370] [20230102:000739:1672639659:55796.199] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :      CNT3 
[EC_DRHOOK:minstrel:1:1:19370:19370] [20230102:000739:1672639659:55796.199] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :       CNT4 
[EC_DRHOOK:minstrel:1:1:19370:19370] [20230102:000739:1672639659:55796.199] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :        STEPO 
[EC_DRHOOK:minstrel:1:1:19370:19370] [20230102:000739:1672639659:55796.199] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :         SCAN2M 
[EC_DRHOOK:minstrel:1:1:19370:19370] [20230102:000739:1672639659:55796.200] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :          GP_MODEL_HEAP 
[EC_DRHOOK:minstrel:1:1:19370:19370] [20230102:000739:1672639659:55796.200] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :           GP_MODEL 
[EC_DRHOOK:minstrel:1:1:19370:19370] [20230102:000739:1672639659:55796.200] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :            CALL_SL_HEAP 
[EC_DRHOOK:minstrel:1:1:19370:19370] [20230102:000739:1672639659:55796.200] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :             CALL_SL 
[EC_DRHOOK:minstrel:1:1:19370:19370] [20230102:000739:1672639659:55796.200] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :              >OMP-CALL_SL     1        (1004) 
[EC_DRHOOK:minstrel:1:1:19370:19370] [20230102:000739:1672639659:55796.200] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :               LAPINEA 
[EC_DRHOOK:minstrel:1:1:19370:19370] [20230102:000739:1672639659:55796.200] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :                LARMES 
 SDL_TRACEBACK: Calling INTEL_TRBK, THRD =            1
 Process            1  thread            1  calling linux_trbk from intel_trbk()
  [LinuxTraceBack@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/utilities/linuxtrbk.c:240] Backtrace(s) for program '/misc/boinc/slots/17/oifs_43r3_model.exe' : sigcontextptr=0x7fff82002ea0
  [LinuxTraceBack@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/utilities/linuxtrbk.c:277] Backtrace (size = 21) with addr2line-cmd
  [LinuxTraceBack@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/utilities/linuxtrbk.c:302] /usr/bin/addr2line -fs -e '/misc/boinc/slots/17/oifs_43r3_model.exe' 0x839273 0x839879 0x8c2957 0x81d89e 0xde7edb 0xde50fd 0xd7a4ec 0xd784fd 0xbf9958 0x12e9482 0xbbc1ce 0x57a664 0x55deec 0x5471c9 0x546412 0x545e28 0x40708d 0x40220f 0x4021a2 0x1dca390 0x40206e
  [LinuxTraceBack@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/utilities/linuxtrbk.c:319] [0]: [0x839273] : ??() at ??:0
  [LinuxTraceBack@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/utilities/linuxtrbk.c:319] [1]: [0x839879] : ??() at ??:0
  [LinuxTraceBack@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/utilities/linuxtrbk.c:319] [2]: [0x8c2957] : ??() at ??:0
  [LinuxTraceBack@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/utilities/linuxtrbk.c:319] [3]: [0x81d89e] : ??() at ??:0
  [LinuxTraceBack@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/utilities/linuxtrbk.c:319] [4]: [0xde7edb] : ??() at ??:0
  [LinuxTraceBack@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/utilities/linuxtrbk.c:319] [5]: [0xde50fd] : ??() at ??:0
  [LinuxTraceBack@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/utilities/linuxtrbk.c:319] [6]: [0xd7a4ec] : ??() at ??:0
  [LinuxTraceBack@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/utilities/linuxtrbk.c:319] [7]: [0xd784fd] : ??() at ??:0
  [LinuxTraceBack@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/utilities/linuxtrbk.c:319] [8]: [0xbf9958] : ??() at ??:0
  [LinuxTraceBack@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/utilities/linuxtrbk.c:319] [9]: [0x12e9482] : ??() at ??:0
  [LinuxTraceBack@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/utilities/linuxtrbk.c:319] [10]: [0xbbc1ce] : ??() at ??:0
  [LinuxTraceBack@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/utilities/linuxtrbk.c:319] [11]: [0x57a664] : ??() at ??:0
  [LinuxTraceBack@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/utilities/linuxtrbk.c:319] [12]: [0x55deec] : ??() at ??:0
  [LinuxTraceBack@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/utilities/linuxtrbk.c:319] [13]: [0x5471c9] : ??() at ??:0
  [LinuxTraceBack@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/utilities/linuxtrbk.c:319] [14]: [0x546412] : ??() at ??:0
  [LinuxTraceBack@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/utilities/linuxtrbk.c:319] [15]: [0x545e28] : ??() at ??:0
  [LinuxTraceBack@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/utilities/linuxtrbk.c:319] [16]: [0x40708d] : ??() at ??:0
  [LinuxTraceBack@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/utilities/linuxtrbk.c:319] [17]: [0x40220f] : ??() at ??:0
  [LinuxTraceBack@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/utilities/linuxtrbk.c:319] [18]: [0x4021a2] : ??() at ??:0
  [LinuxTraceBack@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/utilities/linuxtrbk.c:319] [19]: [0x1dca390] : ??() at ??:0
  [LinuxTraceBack@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/utilities/linuxtrbk.c:319] [20]: [0x40206e] : ??() at ??:0
  [LinuxTraceBack@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/utilities/linuxtrbk.c:370] End of backtrace(s)
 SDL_TRACEBACK: Done INTEL_TRBK, THRD =            1
[EC_DRHOOK:minstrel:1:1:19370:19370] [20230102:000740:1672639660:55796.633] [signal_drhook@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1538] Received signal#6 (SIGABRT) :: 4745MB (heap), 4415MB (maxrss), 0MB (maxstack), 0 (paging), nsigs = 1
[EC_DRHOOK:minstrel:1:1:19370:19370] [20230102:000740:1672639660:55796.633] [signal_drhook@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1542] Also activating Harakiri-alarm (SIGALRM=14) to expire after 500s elapsed to prevent hangs, nsigs = 1
[EC_DRHOOK:minstrel:1:1:19370:19370] [20230102:000740:1672639660:55796.635] [signal_drhook@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1544] Harakiri signal handler 'signal_harakiri' for signal#14 (SIGALRM) installed at 0x81f3c0 (old at (nil))
[EC_DRHOOK:minstrel:1:1:19370:19370] [20230102:000740:1672639660:55796.635] [signal_drhook@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1617] Signal#6 was caused by unrecognized si_code [memaddr=0x6700004baa], nsigs = 1
[EC_DRHOOK:minstrel:1:1:19370:19370] [20230102:000740:1672639660:55796.635] [signal_drhook@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1686] Starting DrHook backtrace for signal#6, nsigs = 1
[EC_DRHOOK:minstrel:1:1:19370:19370] [20230102:000741:1672639661:55797.635] [signal_drhook@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1734] DrHook backtrace done for signal#6, nsigs = 1
[EC_DRHOOK:minstrel:1:1:19370:19370] [20230102:000741:1672639661:55797.635] [signal_drhook@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1785] Calling previous signal handler at 0x1ce8bb0 for signal#6, nsigs = 1
forrtl: error (76): Abort trap signal
Image              PC                Routine            Line        Source             
oifs_43r3_model.e  0000000001CE916B  Unknown               Unknown  Unknown
oifs_43r3_model.e  000000000081FFF1  Unknown               Unknown  Unknown
oifs_43r3_model.e  0000000001DC9090  Unknown               Unknown  Unknown
oifs_43r3_model.e  0000000001DC903B  Unknown               Unknown  Unknown
oifs_43r3_model.e  00000000008C2880  sdl_mod_mp_sdl_sr         100  sdl_mod.F90
oifs_43r3_model.e  000000000081D8AF  abor1_                     41  abor1.F90
oifs_43r3_model.e  0000000000DE7EDB  larmes_                   331  larmes.F90
oifs_43r3_model.e  0000000000DE50FD  lapinea_                  270  lapinea.F90
oifs_43r3_model.e  0000000000D7A4EC  call_sl_                  300  call_sl.F90
oifs_43r3_model.e  0000000000D784FD  call_sl_heap_              94  call_sl_heap.F90
oifs_43r3_model.e  0000000000BF9958  gp_model_                 533  gp_model.F90
oifs_43r3_model.e  00000000012E9482  gp_model_heap_             74  gp_model_heap.F90
oifs_43r3_model.e  0000000000BBC1CE  scan2m_                   535  scan2m.F90
oifs_43r3_model.e  000000000057A664  stepo_                    327  stepo.F90
oifs_43r3_model.e  000000000055DEEC  cnt4_                    1133  cnt4.F90
oifs_43r3_model.e  00000000005471C9  cnt3_                     267  cnt3.F90
oifs_43r3_model.e  0000000000546412  cnt2_                      88  cnt2.F90
oifs_43r3_model.e  0000000000545E28  cnt1_                      92  cnt1.F90
oifs_43r3_model.e  000000000040708D  cnt0_                     146  cnt0.F90
oifs_43r3_model.e  000000000040220F  MAIN__                     96  master.F90
oifs_43r3_model.e  00000000004021A2  Unknown               Unknown  Unknown
oifs_43r3_model.e  0000000001DCA390  Unknown               Unknown  Unknown
oifs_43r3_model.e  000000000040206E  Unknown               Unknown  Unknown
The child process terminated with status: 0
..Failed, model did not complete successfully

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
09 May 2023 16:05:34 1378058 22279722 oifs_43r3_ps_0263_2008050100_123_977_12193907_0 2,592,000 18,525 0.0071
09 May 2023 16:05:29 1378058 22279722 oifs_43r3_ps_0263_2008050100_123_977_12193907_0 1,728,000 12,296 0.0071
09 May 2023 16:05:13 1378058 22279722 oifs_43r3_ps_0263_2008050100_123_977_12193907_0 864,000 6,215 0.0072
09 May 2023 16:05:13 1378058 22279722 oifs_43r3_ps_0263_2008050100_123_977_12193907_0 864,000 6,215 0.0072


©2024 cpdn.org