climateprediction.net home page
Task 13072821

Task 13072821

Name famous_wn5h_1099_200_007117116_2
Workunit 7315476
Created 4 Jul 2011, 11:13:27 UTC
Sent 4 Jul 2011, 11:15:32 UTC
Report deadline 3 Oct 2011, 18:42:43 UTC
Received 10 Jul 2011, 19:19:40 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 22 (0x00000016) Unknown error code
Computer ID 922557
Run time
CPU time 9 hours 9 min
Validate state Invalid
Credit 92.73
Device peak FLOPS 1.73 GFLOPS
Application version UK Met Office FAMOUS v6.11
i686-pc-linux-gnu
Stderr
<core_client_version>5.10.45</core_client_version>
<![CDATA[
<message>
process exited with code 22 (0x16, -234)
</message>
<stderr_txt>
Starting work on result famous_wn5h_1099_200_007117116_2...
Starting model in /home/jsc/BOINC/projects/climateprediction.net...
Unzipping global model data file...
Unzipping workunit data file...
Created shared memory region key = 134340 of size 743572 bytes (version 608)
Copying files for startup...
In pre_initialise_phase (part 1 of 3)
In initialise_phase (part 2 of 3)
In startup_phase (part 3 of 3)
Copying model control files...
Starting model ID famous_wn5h_1099_200_007117116   Phase 1
Program launched with process id # 23246
Climate model starting - use graphics to monitor progress.
Or visit the website to see the graphs for this run.
Getting pthread attributes - retval=0
Setting pthread size (62914560 bytes) - retval=0
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu 134340 /home/jsc/BOINC/slots/0
famous_wn5h_1099_200_007117116 - PH 1 TS 0000001 A - 01/12/1099 01:00 - H:M:S=0000:00:00 AVG= 0.47 DLT= 0.47
famous_wn5h_1099_200_007117116 - PH 1 TS 0000391 A - 16/12/1099 01:00 - H:M:S=0000:04:53 AVG= 0.75 DLT= 1.55
famous_wn5h_1099_200_007117116 - PH 1 TS 0000781 A - 01/01/1100 01:00 - H:M:S=0000:09:49 AVG= 0.75 DLT= 1.38
famous_wn5h_1099_200_007117116 - PH 1 TS 0001171 A - 16/01/1100 01:00 - H:M:S=0000:14:41 AVG= 0.75 DLT= 1.47
famous_wn5h_1099_200_007117116 - PH 1 TS 0001561 A - 01/02/1100 01:00 - H:M:S=0000:19:33 AVG= 0.75 DLT= 1.37
famous_wn5h_1099_200_007117116 - PH 1 TS 0001951 A - 16/02/1100 01:00 - H:M:S=0000:24:30 AVG= 0.75 DLT= 1.70
famous_wn5h_1099_200_007117116 - PH 1 TS 0002341 A - 01/03/1100 01:00 - H:M:S=0000:29:28 AVG= 0.76 DLT= 1.49
famous_wn5h_1099_200_007117116 - PH 1 TS 0002731 A - 16/03/1100 01:00 - H:M:S=0000:34:27 AVG= 0.76 DLT= 1.44
famous_wn5h_1099_200_007117116 - PH 1 TS 0003121 A - 01/04/1100 01:00 - H:M:S=0000:39:24 AVG= 0.76 DLT= 1.63

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  
Model restart required...
Preparing for restart attempt # 1...
Starting model ID famous_wn5h_1099_200_007117116   Phase 1
Program launched with process id # 25953
Climate model starting - use graphics to monitor progress.
Or visit the website to see the graphs for this run.
Getting pthread attributes - retval=0
Setting pthread size (62914560 bytes) - retval=0
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu 134340 /home/jsc/BOINC/slots/0
famous_wn5h_1099_200_007117116 - PH 1 TS 0003511 A - 16/04/1100 01:00 - H:M:S=0000:46:32 AVG= 0.80 DLT= 1.40
famous_wn5h_1099_200_007117116 - PH 1 TS 0003901 A - 01/05/1100 01:00 - H:M:S=0000:51:30 AVG= 0.79 DLT= 1.36

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  
Model restart required...
Preparing for restart attempt # 1...
Starting model ID famous_wn5h_1099_200_007117116   Phase 1
Getting pthread attributes - retval=0
Setting pthread size (62914560 bytes) - retval=0
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu 134340 /home/jsc/BOINC/slots/0
Program launched with process id # 26827
Climate model starting - use graphics to monitor progress.
Or visit the website to see the graphs for this run.
famous_wn5h_1099_200_007117116 - PH 1 TS 0004291 A - 16/05/1100 01:00 - H:M:S=0000:59:31 AVG= 0.83 DLT= 1.36

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  
Model restart required...
Preparing for restart attempt # 1...
Starting model ID famous_wn5h_1099_200_007117116   Phase 1
Getting pthread attributes - retval=0
Setting pthread size (62914560 bytes) - retval=0
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu 134340 /home/jsc/BOINC/slots/0
Program launched with process id # 27298
Climate model starting - use graphics to monitor progress.
Or visit the website to see the graphs for this run.
famous_wn5h_1099_200_007117116 - PH 1 TS 0004681 A - 01/06/1100 01:00 - H:M:S=0001:06:28 AVG= 0.85 DLT= 1.53
famous_wn5h_1099_200_007117116 - PH 1 TS 0005071 A - 16/06/1100 01:00 - H:M:S=0001:11:24 AVG= 0.84 DLT= 1.24
famous_wn5h_1099_200_007117116 - PH 1 TS 0005461 A - 01/07/1100 01:00 - H:M:S=0001:16:20 AVG= 0.84 DLT= 1.77
famous_wn5h_1099_200_007117116 - PH 1 TS 0005851 A - 16/07/1100 01:00 - H:M:S=0001:21:17 AVG= 0.83 DLT= 1.29

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  
Model restart required...
Preparing for restart attempt # 1...
Starting model ID famous_wn5h_1099_200_007117116   Phase 1
Program launched with process id # 28818
Climate model starting - use graphics to monitor progress.
Or visit the website to see the graphs for this run.
Getting pthread attributes - retval=0
Setting pthread size (62914560 bytes) - retval=0
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu 134340 /home/jsc/BOINC/slots/0
famous_wn5h_1099_200_007117116 - PH 1 TS 0006241 A - 01/08/1100 01:00 - H:M:S=0001:29:38 AVG= 0.86 DLT= 1.18
famous_wn5h_1099_200_007117116 - PH 1 TS 0006631 A - 16/08/1100 01:00 - H:M:S=0001:34:38 AVG= 0.86 DLT= 1.36
famous_wn5h_1099_200_007117116 - PH 1 TS 0007021 A - 01/09/1100 01:00 - H:M:S=0001:39:40 AVG= 0.85 DLT= 1.33
famous_wn5h_1099_200_007117116 - PH 1 TS 0007411 A - 16/09/1100 01:00 - H:M:S=0001:44:40 AVG= 0.85 DLT= 1.22
famous_wn5h_1099_200_007117116 - PH 1 TS 0007801 A - 01/10/1100 01:00 - H:M:S=0001:49:42 AVG= 0.84 DLT= 1.45

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  
Model restart required...
Preparing for restart attempt # 1...
Starting model ID famous_wn5h_1099_200_007117116   Phase 1
Program launched with process id # 30565
Climate model starting - use graphics to monitor progress.
Or visit the website to see the graphs for this run.
Getting pthread attributes - retval=0
Setting pthread size (62914560 bytes) - retval=0
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu 134340 /home/jsc/BOINC/slots/0
famous_wn5h_1099_200_007117116 - PH 1 TS 0007801 A - 01/10/1100 01:00 - H:M:S=0001:49:48 AVG= 0.84 DLT= 0.00

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  
Model restart required...
Preparing for restart attempt # 2...
Starting model ID famous_wn5h_1099_200_007117116   Phase 1
Getting pthread attributes - retval=0
Setting pthread size (62914560 bytes) - retval=0
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu 134340 /home/jsc/BOINC/slots/0
Program launched with process id # 30690
Climate model starting - use graphics to monitor progress.
Or visit the website to see the graphs for this run.
famous_wn5h_1099_200_007117116 - PH 1 TS 0008191 A - 16/10/1100 01:00 - H:M:S=0001:57:07 AVG= 0.86 DLT= 1.64
famous_wn5h_1099_200_007117116 - PH 1 TS 0008581 A - 01/11/1100 01:00 - H:M:S=0002:02:06 AVG= 0.85 DLT= 1.67
famous_wn5h_1099_200_007117116 - PH 1 TS 0008971 A - 16/11/1100 01:00 - H:M:S=0002:07:04 AVG= 0.85 DLT= 1.57
Trickling yearly means for 1100
Building file list for 1100 in dataout -- 4 entries
Creating trickle file trickle_famous_wn5h_1099_200_007117116_2_1100.zip for upload...
famous_wn5h_1099_200_007117116 - PH 1 TS 0009361 A - 01/12/1100 01:00 - H:M:S=0002:12:01 AVG= 0.85 DLT= 1.61
famous_wn5h_1099_200_007117116 - PH 1 TS 0009751 A - 16/12/1100 01:00 - H:M:S=0002:16:58 AVG= 0.84 DLT= 1.54
famous_wn5h_1099_200_007117116 - PH 1 TS 0010141 A - 01/01/1101 01:00 - H:M:S=0002:21:56 AVG= 0.84 DLT= 1.20
famous_wn5h_1099_200_007117116 - PH 1 TS 0010531 A - 16/01/1101 01:00 - H:M:S=0002:26:52 AVG= 0.84 DLT= 1.25
famous_wn5h_1099_200_007117116 - PH 1 TS 0010921 A - 01/02/1101 01:00 - H:M:S=0002:31:51 AVG= 0.83 DLT= 1.41

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  
Model restart required...
Preparing for restart attempt # 1...
Starting model ID famous_wn5h_1099_200_007117116   Phase 1
Getting pthread attributes - retval=0
Setting pthread size (62914560 bytes) - retval=0
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu 134340 /home/jsc/BOINC/slots/0
Program launched with process id # 1087
Climate model starting - use graphics to monitor progress.
Or visit the website to see the graphs for this run.
famous_wn5h_1099_200_007117116 - PH 1 TS 0011311 A - 16/02/1101 01:00 - H:M:S=0002:38:33 AVG= 0.84 DLT= 1.50

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  
Model restart required...
Preparing for restart attempt # 1...
Starting model ID famous_wn5h_1099_200_007117116   Phase 1
Getting pthread attributes - retval=0
Setting pthread size (62914560 bytes) - retval=0
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu 134340 /home/jsc/BOINC/slots/0
Program launched with process id # 1593
Climate model starting - use graphics to monitor progress.
Or visit the website to see the graphs for this run.
famous_wn5h_1099_200_007117116 - PH 1 TS 0011701 A - 01/03/1101 01:00 - H:M:S=0002:45:47 AVG= 0.85 DLT= 1.30
famous_wn5h_1099_200_007117116 - PH 1 TS 0012091 A - 16/03/1101 01:00 - H:M:S=0002:50:45 AVG= 0.85 DLT= 1.22
famous_wn5h_1099_200_007117116 - PH 1 TS 0012481 A - 01/04/1101 01:00 - H:M:S=0002:55:44 AVG= 0.84 DLT= 1.49
famous_wn5h_1099_200_007117116 - PH 1 TS 0012871 A - 16/04/1101 01:00 - H:M:S=0003:00:44 AVG= 0.84 DLT= 1.48
famous_wn5h_1099_200_007117116 - PH 1 TS 0013261 A - 01/05/1101 01:00 - H:M:S=0003:05:45 AVG= 0.84 DLT= 1.20

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  
Model restart required...
Preparing for restart attempt # 1...
Starting model ID famous_wn5h_1099_200_007117116   Phase 1
Getting pthread attributes - retval=0
Setting pthread size (62914560 bytes) - retval=0
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu 134340 /home/jsc/BOINC/slots/0
Program launched with process id # 3296
Climate model starting - use graphics to monitor progress.
Or visit the website to see the graphs for this run.

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  
Model restart required...
Preparing for restart attempt # 2...
Starting model ID famous_wn5h_1099_200_007117116   Phase 1
Getting pthread attributes - retval=0
Setting pthread size (62914560 bytes) - retval=0
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu 134340 /home/jsc/BOINC/slots/0
Program launched with process id # 3325
Climate model starting - use graphics to monitor progress.
Or visit the website to see the graphs for this run.
famous_wn5h_1099_200_007117116 - PH 1 TS 0013651 A - 16/05/1101 01:00 - H:M:S=0003:11:27 AVG= 0.84 DLT= 1.63
famous_wn5h_1099_200_007117116 - PH 1 TS 0014041 A - 01/06/1101 01:00 - H:M:S=0003:16:29 AVG= 0.84 DLT= 1.51

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  
Model restart required...
Preparing for restart attempt # 1...
Starting model ID famous_wn5h_1099_200_007117116   Phase 1
Getting pthread attributes - retval=0
Setting pthread size (62914560 bytes) - retval=0
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu 134340 /home/jsc/BOINC/slots/0
Program launched with process id # 4460
Climate model starting - use graphics to monitor progress.
Or visit the website to see the graphs for this run.
famous_wn5h_1099_200_007117116 - PH 1 TS 0014431 A - 16/06/1101 01:00 - H:M:S=0003:22:22 AVG= 0.84 DLT= 1.41
famous_wn5h_1099_200_007117116 - PH 1 TS 0014821 A - 01/07/1101 01:00 - H:M:S=0003:27:18 AVG= 0.84 DLT= 1.58

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  
Model restart required...
Preparing for restart attempt # 1...
Starting model ID famous_wn5h_1099_200_007117116   Phase 1
Getting pthread attributes - retval=0
Setting pthread size (62914560 bytes) - retval=0
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu 134340 /home/jsc/BOINC/slots/0
Program launched with process id # 5345
Climate model starting - use graphics to monitor progress.
Or visit the website to see the graphs for this run.

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  
Model restart required...
Preparing for restart attempt # 2...
Starting model ID famous_wn5h_1099_200_007117116   Phase 1
Getting pthread attributes - retval=0
Setting pthread size (62914560 bytes) - retval=0
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu 134340 /home/jsc/BOINC/slots/0
Program launched with process id # 5454
Climate model starting - use graphics to monitor progress.
Or visit the website to see the graphs for this run.
famous_wn5h_1099_200_007117116 - PH 1 TS 0015211 A - 16/07/1101 01:00 - H:M:S=0003:34:26 AVG= 0.85 DLT= 1.27

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  
Model restart required...
Preparing for restart attempt # 1...
Starting model ID famous_wn5h_1099_200_007117116   Phase 1
Program launched with process id # 5870
Climate model starting - use graphics to monitor progress.
Or visit the website to see the graphs for this run.
Getting pthread attributes - retval=0
Setting pthread size (62914560 bytes) - retval=0
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu 134340 /home/jsc/BOINC/slots/0
famous_wn5h_1099_200_007117116 - PH 1 TS 0015601 A - 01/08/1101 01:00 - H:M:S=0003:40:20 AVG= 0.85 DLT= 1.30
famous_wn5h_1099_200_007117116 - PH 1 TS 0015991 A - 16/08/1101 01:00 - H:M:S=0003:45:19 AVG= 0.85 DLT= 1.37

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  
Model restart required...
Preparing for restart attempt # 1...
Starting model ID famous_wn5h_1099_200_007117116   Phase 1
Getting pthread attributes - retval=0
Setting pthread size (62914560 bytes) - retval=0
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu 134340 /home/jsc/BOINC/slots/0
Program launched with process id # 7068
Climate model starting - use graphics to monitor progress.
Or visit the website to see the graphs for this run.
famous_wn5h_1099_200_007117116 - PH 1 TS 0016381 A - 01/09/1101 01:00 - H:M:S=0003:54:40 AVG= 0.86 DLT= 1.39
famous_wn5h_1099_200_007117116 - PH 1 TS 0016771 A - 16/09/1101 01:00 - H:M:S=0003:59:43 AVG= 0.86 DLT= 1.36
famous_wn5h_1099_200_007117116 - PH 1 TS 0017161 A - 01/10/1101 01:00 - H:M:S=0004:04:46 AVG= 0.86 DLT= 1.29
famous_wn5h_1099_200_007117116 - PH 1 TS 0017551 A - 16/10/1101 01:00 - H:M:S=0004:09:46 AVG= 0.85 DLT= 1.39
famous_wn5h_1099_200_007117116 - PH 1 TS 0017941 A - 01/11/1101 01:00 - H:M:S=0004:14:47 AVG= 0.85 DLT= 1.44
famous_wn5h_1099_200_007117116 - PH 1 TS 0018331 A - 16/11/1101 01:00 - H:M:S=0004:19:44 AVG= 0.85 DLT= 1.29
Trickling yearly means for 1101
Building file list for 1101 in dataout -- 4 entries
Creating trickle file trickle_famous_wn5h_1099_200_007117116_2_1101.zip for upload...
famous_wn5h_1099_200_007117116 - PH 1 TS 0018721 A - 01/12/1101 01:00 - H:M:S=0004:24:43 AVG= 0.85 DLT= 1.66

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  
Model restart required...
Preparing for restart attempt # 1...
Starting model ID famous_wn5h_1099_200_007117116   Phase 1
Getting pthread attributes - retval=0
Setting pthread size (62914560 bytes) - retval=0
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu 134340 /home/jsc/BOINC/slots/0
Program launched with process id # 9531
Climate model starting - use graphics to monitor progress.
Or visit the website to see the graphs for this run.

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 60 - Return code = 1

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 61 - Return code = 1

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 68 - Return code = 1

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 69 - Return code = 1
famous_wn5h_1099_200_007117116 - PH 1 TS 0019111 A - 16/12/1101 01:00 - H:M:S=0004:30:06 AVG= 0.85 DLT= 1.14
famous_wn5h_1099_200_007117116 - PH 1 TS 0019501 A - 01/01/1102 01:00 - H:M:S=0004:35:02 AVG= 0.85 DLT= 1.38
famous_wn5h_1099_200_007117116 - PH 1 TS 0019891 A - 16/01/1102 01:00 - H:M:S=0004:39:59 AVG= 0.84 DLT= 1.50

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  
Model restart required...
Preparing for restart attempt # 1...
Starting model ID famous_wn5h_1099_200_007117116   Phase 1
Getting pthread attributes - retval=0
Setting pthread size (62914560 bytes) - retval=0
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu 134340 /home/jsc/BOINC/slots/0
Program launched with process id # 10842
Climate model starting - use graphics to monitor progress.
Or visit the website to see the graphs for this run.

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  
Model restart required...
Preparing for restart attempt # 2...
Starting model ID famous_wn5h_1099_200_007117116   Phase 1
Getting pthread attributes - retval=0
Setting pthread size (62914560 bytes) - retval=0
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu 134340 /home/jsc/BOINC/slots/0
Program launched with process id # 11066
Climate model starting - use graphics to monitor progress.
Or visit the website to see the graphs for this run.
famous_wn5h_1099_200_007117116 - PH 1 TS 0020281 A - 01/02/1102 01:00 - H:M:S=0004:47:55 AVG= 0.85 DLT= 1.40
famous_wn5h_1099_200_007117116 - PH 1 TS 0020671 A - 16/02/1102 01:00 - H:M:S=0004:52:53 AVG= 0.85 DLT= 1.65
famous_wn5h_1099_200_007117116 - PH 1 TS 0021061 A - 01/03/1102 01:00 - H:M:S=0004:57:50 AVG= 0.85 DLT= 1.45

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  
Model restart required...
Preparing for restart attempt # 1...
Starting model ID famous_wn5h_1099_200_007117116   Phase 1
Getting pthread attributes - retval=0
Setting pthread size (62914560 bytes) - retval=0
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu 134340 /home/jsc/BOINC/slots/0
Program launched with process id # 12191
Climate model starting - use graphics to monitor progress.
Or visit the website to see the graphs for this run.
famous_wn5h_1099_200_007117116 - PH 1 TS 0021451 A - 16/03/1102 01:00 - H:M:S=0005:04:04 AVG= 0.85 DLT= 1.53
famous_wn5h_1099_200_007117116 - PH 1 TS 0021841 A - 01/04/1102 01:00 - H:M:S=0005:09:02 AVG= 0.85 DLT= 1.44
famous_wn5h_1099_200_007117116 - PH 1 TS 0022231 A - 16/04/1102 01:00 - H:M:S=0005:13:58 AVG= 0.85 DLT= 1.50
famous_wn5h_1099_200_007117116 - PH 1 TS 0022621 A - 01/05/1102 01:00 - H:M:S=0005:18:54 AVG= 0.85 DLT= 1.61

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  
Model restart required...
Preparing for restart attempt # 1...
Starting model ID famous_wn5h_1099_200_007117116   Phase 1
Getting pthread attributes - retval=0
Setting pthread size (62914560 bytes) - retval=0
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu 134340 /home/jsc/BOINC/slots/0
Program launched with process id # 13526
Climate model starting - use graphics to monitor progress.
Or visit the website to see the graphs for this run.
famous_wn5h_1099_200_007117116 - PH 1 TS 0023011 A - 16/05/1102 01:00 - H:M:S=0005:25:34 AVG= 0.85 DLT= 1.58
famous_wn5h_1099_200_007117116 - PH 1 TS 0023401 A - 01/06/1102 01:00 - H:M:S=0005:30:33 AVG= 0.85 DLT= 1.42
famous_wn5h_1099_200_007117116 - PH 1 TS 0023791 A - 16/06/1102 01:00 - H:M:S=0005:35:32 AVG= 0.85 DLT= 1.18

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  
Model restart required...
Preparing for restart attempt # 1...
Starting model ID famous_wn5h_1099_200_007117116   Phase 1
Program launched with process id # 14673
Climate model starting - use graphics to monitor progress.
Or visit the website to see the graphs for this run.
Getting pthread attributes - retval=0
Setting pthread size (62914560 bytes) - retval=0
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu 134340 /home/jsc/BOINC/slots/0

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  
Model restart required...
Preparing for restart attempt # 2...
Starting model ID famous_wn5h_1099_200_007117116   Phase 1
Getting pthread attributes - retval=0
Setting pthread size (62914560 bytes) - retval=0
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu 134340 /home/jsc/BOINC/slots/0
Program launched with process id # 14829
Climate model starting - use graphics to monitor progress.
Or visit the website to see the graphs for this run.
famous_wn5h_1099_200_007117116 - PH 1 TS 0024181 A - 01/07/1102 01:00 - H:M:S=0005:44:08 AVG= 0.85 DLT= 1.50
famous_wn5h_1099_200_007117116 - PH 1 TS 0024571 A - 16/07/1102 01:00 - H:M:S=0005:49:03 AVG= 0.85 DLT= 1.56
famous_wn5h_1099_200_007117116 - PH 1 TS 0024961 A - 01/08/1102 01:00 - H:M:S=0005:54:01 AVG= 0.85 DLT= 1.45
famous_wn5h_1099_200_007117116 - PH 1 TS 0025351 A - 16/08/1102 01:00 - H:M:S=0005:58:57 AVG= 0.85 DLT= 1.41
famous_wn5h_1099_200_007117116 - PH 1 TS 0025741 A - 01/09/1102 01:00 - H:M:S=0006:04:00 AVG= 0.85 DLT= 1.51

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  
Model restart required...
Preparing for restart attempt # 1...
Starting model ID famous_wn5h_1099_200_007117116   Phase 1
Getting pthread attributes - retval=0
Setting pthread size (62914560 bytes) - retval=0
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu 134340 /home/jsc/BOINC/slots/0
Program launched with process id # 16720
Climate model starting - use graphics to monitor progress.
Or visit the website to see the graphs for this run.

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  
Model restart required...
Preparing for restart attempt # 2...
Starting model ID famous_wn5h_1099_200_007117116   Phase 1
Program launched with process id # 16961
Climate model starting - use graphics to monitor progress.
Or visit the website to see the graphs for this run.
Getting pthread attributes - retval=0
Setting pthread size (62914560 bytes) - retval=0
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu 134340 /home/jsc/BOINC/slots/0
famous_wn5h_1099_200_007117116 - PH 1 TS 0026131 A - 16/09/1102 01:00 - H:M:S=0006:15:45 AVG= 0.86 DLT= 1.43
famous_wn5h_1099_200_007117116 - PH 1 TS 0026521 A - 01/10/1102 01:00 - H:M:S=0006:20:48 AVG= 0.86 DLT= 1.65

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  
Model restart required...
Preparing for restart attempt # 1...
Starting model ID famous_wn5h_1099_200_007117116   Phase 1
Getting pthread attributes - retval=0
Setting pthread size (62914560 bytes) - retval=0
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu 134340 /home/jsc/BOINC/slots/0
Program launched with process id # 17738
Climate model starting - use graphics to monitor progress.
Or visit the website to see the graphs for this run.
famous_wn5h_1099_200_007117116 - PH 1 TS 0026911 A - 16/10/1102 01:00 - H:M:S=0006:27:25 AVG= 0.86 DLT= 1.21
famous_wn5h_1099_200_007117116 - PH 1 TS 0027301 A - 01/11/1102 01:00 - H:M:S=0006:32:26 AVG= 0.86 DLT= 1.51
famous_wn5h_1099_200_007117116 - PH 1 TS 0027691 A - 16/11/1102 01:00 - H:M:S=0006:37:24 AVG= 0.86 DLT= 1.47

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  
Model restart required...
Preparing for restart attempt # 1...
Starting model ID famous_wn5h_1099_200_007117116   Phase 1
Getting pthread attributes - retval=0
Setting pthread size (62914560 bytes) - retval=0
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu 134340 /home/jsc/BOINC/slots/0
Program launched with process id # 18874
Climate model starting - use graphics to monitor progress.
Or visit the website to see the graphs for this run.
famous_wn5h_1099_200_007117116 - PH 1 TS 0027691 A - 16/11/1102 01:00 - H:M:S=0006:37:40 AVG= 0.86 DLT= 0.00
Trickling yearly means for 1102
Building file list for 1102 in dataout -- 4 entries
Creating trickle file trickle_famous_wn5h_1099_200_007117116_2_1102.zip for upload...
famous_wn5h_1099_200_007117116 - PH 1 TS 0028081 A - 01/12/1102 01:00 - H:M:S=0006:42:39 AVG= 0.86 DLT= 1.51

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  
Model restart required...
Preparing for restart attempt # 1...
Starting model ID famous_wn5h_1099_200_007117116   Phase 1
Getting pthread attributes - retval=0
Setting pthread size (62914560 bytes) - retval=0
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu 134340 /home/jsc/BOINC/slots/0
Program launched with process id # 19300
Climate model starting - use graphics to monitor progress.
Or visit the website to see the graphs for this run.

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 60 - Return code = 1

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 61 - Return code = 1

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 68 - Return code = 1

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 69 - Return code = 1

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  
Model restart required...
Preparing for restart attempt # 2...
Starting model ID famous_wn5h_1099_200_007117116   Phase 1
Getting pthread attributes - retval=0
Setting pthread size (62914560 bytes) - retval=0
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu 134340 /home/jsc/BOINC/slots/0
Program launched with process id # 19552
Climate model starting - use graphics to monitor progress.
Or visit the website to see the graphs for this run.

BUFFIN: Read Failed: Inappropriate ioctl for device
BUFFIN: C I/O Error feof - Unit 60 - Return code = 1

BUFFIN: Read Failed: Invalid argument
BUFFIN: C I/O Error feof - Unit 61 - Return code = 1

BUFFIN: Read Failed: Invalid argument
BUFFIN: C I/O Error feof - Unit 68 - Return code = 1

BUFFIN: Read Failed: Invalid argument
BUFFIN: C I/O Error feof - Unit 69 - Return code = 1
famous_wn5h_1099_200_007117116 - PH 1 TS 0028471 A - 16/12/1102 01:00 - H:M:S=0006:52:57 AVG= 0.87 DLT= 1.37
famous_wn5h_1099_200_007117116 - PH 1 TS 0028861 A - 01/01/1103 01:00 - H:M:S=0006:57:54 AVG= 0.87 DLT= 1.10

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  
Model restart required...
Preparing for restart attempt # 1...
Starting model ID famous_wn5h_1099_200_007117116   Phase 1
Getting pthread attributes - retval=0
Setting pthread size (62914560 bytes) - retval=0
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu 134340 /home/jsc/BOINC/slots/0
Program launched with process id # 20101
Climate model starting - use graphics to monitor progress.
Or visit the website to see the graphs for this run.
famous_wn5h_1099_200_007117116 - PH 1 TS 0029251 A - 16/01/1103 01:00 - H:M:S=0007:03:17 AVG= 0.87 DLT= 1.47
famous_wn5h_1099_200_007117116 - PH 1 TS 0029641 A - 01/02/1103 01:00 - H:M:S=0007:08:09 AVG= 0.87 DLT= 1.17
famous_wn5h_1099_200_007117116 - PH 1 TS 0030031 A - 16/02/1103 01:00 - H:M:S=0007:13:04 AVG= 0.87 DLT= 1.13

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  
Model restart required...
Preparing for restart attempt # 1...
Starting model ID famous_wn5h_1099_200_007117116   Phase 1
Getting pthread attributes - retval=0
Setting pthread size (62914560 bytes) - retval=0
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu 134340 /home/jsc/BOINC/slots/0
Program launched with process id # 21341
Climate model starting - use graphics to monitor progress.
Or visit the website to see the graphs for this run.

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  
Model restart required...
Preparing for restart attempt # 2...
Starting model ID famous_wn5h_1099_200_007117116   Phase 1
Program launched with process id # 21343
Climate model starting - use graphics to monitor progress.
Or visit the website to see the graphs for this run.
Getting pthread attributes - retval=0
Setting pthread size (62914560 bytes) - retval=0
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu 134340 /home/jsc/BOINC/slots/0

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  
Model restart required...
Preparing for restart attempt # 3...
Starting model ID famous_wn5h_1099_200_007117116   Phase 1
Getting pthread attributes - retval=0
Setting pthread size (62914560 bytes) - retval=0
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu 134340 /home/jsc/BOINC/slots/0
Program launched with process id # 21597
Climate model starting - use graphics to monitor progress.
Or visit the website to see the graphs for this run.

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  
Model restart required...
Preparing for restart attempt # 4...
Starting model ID famous_wn5h_1099_200_007117116   Phase 1
Program launched with process id # 21756
Climate model starting - use graphics to monitor progress.
Or visit the website to see the graphs for this run.
Getting pthread attributes - retval=0
Setting pthread size (62914560 bytes) - retval=0
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu 134340 /home/jsc/BOINC/slots/0
famous_wn5h_1099_200_007117116 - PH 1 TS 0030421 A - 01/03/1103 01:00 - H:M:S=0007:26:36 AVG= 0.88 DLT= 1.17
famous_wn5h_1099_200_007117116 - PH 1 TS 0030811 A - 16/03/1103 01:00 - H:M:S=0007:31:36 AVG= 0.88 DLT= 1.27
famous_wn5h_1099_200_007117116 - PH 1 TS 0031201 A - 01/04/1103 01:00 - H:M:S=0007:36:32 AVG= 0.88 DLT= 1.41

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  
Model restart required...
Preparing for restart attempt # 1...
Starting model ID famous_wn5h_1099_200_007117116   Phase 1
Getting pthread attributes - retval=0
Setting pthread size (62914560 bytes) - retval=0
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu 134340 /home/jsc/BOINC/slots/0
Program launched with process id # 22892
Climate model starting - use graphics to monitor progress.
Or visit the website to see the graphs for this run.

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  
Model restart required...
Preparing for restart attempt # 2...
Starting model ID famous_wn5h_1099_200_007117116   Phase 1
Program launched with process id # 22934
Climate model starting - use graphics to monitor progress.
Or visit the website to see the graphs for this run.
Getting pthread attributes - retval=0
Setting pthread size (62914560 bytes) - retval=0
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu 134340 /home/jsc/BOINC/slots/0
famous_wn5h_1099_200_007117116 - PH 1 TS 0031591 A - 16/04/1103 01:00 - H:M:S=0007:43:36 AVG= 0.88 DLT= 1.38
famous_wn5h_1099_200_007117116 - PH 1 TS 0031981 A - 01/05/1103 01:00 - H:M:S=0007:48:36 AVG= 0.88 DLT= 1.48
famous_wn5h_1099_200_007117116 - PH 1 TS 0032371 A - 16/05/1103 01:00 - H:M:S=0007:53:35 AVG= 0.88 DLT= 1.18

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  
Model restart required...
Preparing for restart attempt # 1...
Starting model ID famous_wn5h_1099_200_007117116   Phase 1
Getting pthread attributes - retval=0
Setting pthread size (62914560 bytes) - retval=0
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu 134340 /home/jsc/BOINC/slots/0
Program launched with process id # 24353
Climate model starting - use graphics to monitor progress.
Or visit the website to see the graphs for this run.
famous_wn5h_1099_200_007117116 - PH 1 TS 0032761 A - 01/06/1103 01:00 - H:M:S=0008:01:25 AVG= 0.88 DLT= 1.51
famous_wn5h_1099_200_007117116 - PH 1 TS 0033151 A - 16/06/1103 01:00 - H:M:S=0008:06:22 AVG= 0.88 DLT= 1.31

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  
Model restart required...
Preparing for restart attempt # 1...
Starting model ID famous_wn5h_1099_200_007117116   Phase 1
Program launched with process id # 25259
Climate model starting - use graphics to monitor progress.
Or visit the website to see the graphs for this run.
Getting pthread attributes - retval=0
Setting pthread size (62914560 bytes) - retval=0
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu 134340 /home/jsc/BOINC/slots/0
famous_wn5h_1099_200_007117116 - PH 1 TS 0033541 A - 01/07/1103 01:00 - H:M:S=0008:13:14 AVG= 0.88 DLT= 1.42

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  
Model restart required...
Preparing for restart attempt # 1...
Starting model ID famous_wn5h_1099_200_007117116   Phase 1
Program launched with process id # 25908
Climate model starting - use graphics to monitor progress.
Or visit the website to see the graphs for this run.
Getting pthread attributes - retval=0
Setting pthread size (62914560 bytes) - retval=0
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu 134340 /home/jsc/BOINC/slots/0
famous_wn5h_1099_200_007117116 - PH 1 TS 0033931 A - 16/07/1103 01:00 - H:M:S=0008:20:59 AVG= 0.89 DLT= 1.39
famous_wn5h_1099_200_007117116 - PH 1 TS 0034321 A - 01/08/1103 01:00 - H:M:S=0008:25:57 AVG= 0.88 DLT= 1.63
famous_wn5h_1099_200_007117116 - PH 1 TS 0034711 A - 16/08/1103 01:00 - H:M:S=0008:30:55 AVG= 0.88 DLT= 1.24

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  
Model restart required...
Preparing for restart attempt # 1...
Starting model ID famous_wn5h_1099_200_007117116   Phase 1
Program launched with process id # 27140
Climate model starting - use graphics to monitor progress.
Or visit the website to see the graphs for this run.
Getting pthread attributes - retval=0
Setting pthread size (62914560 bytes) - retval=0
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu 134340 /home/jsc/BOINC/slots/0
famous_wn5h_1099_200_007117116 - PH 1 TS 0035101 A - 01/09/1103 01:00 - H:M:S=0008:36:59 AVG= 0.88 DLT= 1.79
famous_wn5h_1099_200_007117116 - PH 1 TS 0035491 A - 16/09/1103 01:00 - H:M:S=0008:41:58 AVG= 0.88 DLT= 1.58

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  
Model restart required...
Preparing for restart attempt # 1...
Starting model ID famous_wn5h_1099_200_007117116   Phase 1
Getting pthread attributes - retval=0
Setting pthread size (62914560 bytes) - retval=0
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu 134340 /home/jsc/BOINC/slots/0
Program launched with process id # 28171
Climate model starting - use graphics to monitor progress.
Or visit the website to see the graphs for this run.

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  
Model restart required...
Preparing for restart attempt # 2...
Starting model ID famous_wn5h_1099_200_007117116   Phase 1
Getting pthread attributes - retval=0
Setting pthread size (62914560 bytes) - retval=0
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu 134340 /home/jsc/BOINC/slots/0
Program launched with process id # 28425
Climate model starting - use graphics to monitor progress.
Or visit the website to see the graphs for this run.
famous_wn5h_1099_200_007117116 - PH 1 TS 0035881 A - 01/10/1103 01:00 - H:M:S=0008:49:42 AVG= 0.89 DLT= 1.30

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  
Model restart required...
Preparing for restart attempt # 1...
Starting model ID famous_wn5h_1099_200_007117116   Phase 1
Getting pthread attributes - retval=0
Setting pthread size (62914560 bytes) - retval=0
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu 134340 /home/jsc/BOINC/slots/0
Program launched with process id # 28897
Climate model starting - use graphics to monitor progress.
Or visit the website to see the graphs for this run.
famous_wn5h_1099_200_007117116 - PH 1 TS 0035881 A - 01/10/1103 01:00 - H:M:S=0008:49:53 AVG= 0.89 DLT= 0.00

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  
Model restart required...
Preparing for restart attempt # 2...
Starting model ID famous_wn5h_1099_200_007117116   Phase 1
Getting pthread attributes - retval=0
Setting pthread size (62914560 bytes) - retval=0
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu 134340 /home/jsc/BOINC/slots/0
Program launched with process id # 28933
Climate model starting - use graphics to monitor progress.
Or visit the website to see the graphs for this run.
famous_wn5h_1099_200_007117116 - PH 1 TS 0035881 A - 01/10/1103 01:00 - H:M:S=0008:50:09 AVG= 0.89 DLT= 0.00

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  
Model restart required...
Preparing for restart attempt # 3...
Starting model ID famous_wn5h_1099_200_007117116   Phase 1
Getting pthread attributes - retval=0
Setting pthread size (62914560 bytes) - retval=0
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu 134340 /home/jsc/BOINC/slots/0
Program launched with process id # 29342
Climate model starting - use graphics to monitor progress.
Or visit the website to see the graphs for this run.

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  
Model restart required...
Preparing for restart attempt # 4...
Starting model ID famous_wn5h_1099_200_007117116   Phase 1
Program launched with process id # 29350
Climate model starting - use graphics to monitor progress.
Or visit the website to see the graphs for this run.
Getting pthread attributes - retval=0
Setting pthread size (62914560 bytes) - retval=0
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu 134340 /home/jsc/BOINC/slots/0
famous_wn5h_1099_200_007117116 - PH 1 TS 0036271 A - 16/10/1103 01:00 - H:M:S=0008:59:43 AVG= 0.89 DLT= 1.43

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  
Model restart required...
Preparing for restart attempt # 1...
Starting model ID famous_wn5h_1099_200_007117116   Phase 1
Getting pthread attributes - retval=0
Setting pthread size (62914560 bytes) - retval=0
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu 134340 /home/jsc/BOINC/slots/0
Program launched with process id # 29935
Climate model starting - use graphics to monitor progress.
Or visit the website to see the graphs for this run.

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  
Model restart required...
Preparing for restart attempt # 2...
Starting model ID famous_wn5h_1099_200_007117116   Phase 1
Getting pthread attributes - retval=0
Setting pthread size (62914560 bytes) - retval=0
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu 134340 /home/jsc/BOINC/slots/0
Program launched with process id # 29988
Climate model starting - use graphics to monitor progress.
Or visit the website to see the graphs for this run.

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  
Model restart required...
Preparing for restart attempt # 3...
Starting model ID famous_wn5h_1099_200_007117116   Phase 1
Getting pthread attributes - retval=0
Setting pthread size (62914560 bytes) - retval=0
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu 134340 /home/jsc/BOINC/slots/0
Program launched with process id # 30000
Climate model starting - use graphics to monitor progress.
Or visit the website to see the graphs for this run.

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  
Model restart required...
Preparing for restart attempt # 4...
Starting model ID famous_wn5h_1099_200_007117116   Phase 1
Getting pthread attributes - retval=0
Setting pthread size (62914560 bytes) - retval=0
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu 134340 /home/jsc/BOINC/slots/0
Program launched with process id # 30504
Climate model starting - use graphics to monitor progress.
Or visit the website to see the graphs for this run.

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  
Model restart required...
Preparing for restart attempt # 5...
Starting model ID famous_wn5h_1099_200_007117116   Phase 1
Getting pthread attributes - retval=0
Setting pthread size (62914560 bytes) - retval=0
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu 134340 /home/jsc/BOINC/slots/0
Program launched with process id # 30691
Climate model starting - use graphics to monitor progress.
Or visit the website to see the graphs for this run.

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  
Sorry, too many model crashes! :-(
Model restart required...
Sorry, too many model crashes! :-(
Cleaning up from the run...
 (23234): called boinc_finish
Detaching shared memory...

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
10 Jul 2011 13:43:47 922557 13072821 famous_wn5h_1099_200_007117116_2 28,106 24,159 0.8596
10 Jul 2011 09:06:48 922557 13072821 famous_wn5h_1099_200_007117116_2 18,746 15,883 0.8473
10 Jul 2011 04:20:14 922557 13072821 famous_wn5h_1099_200_007117116_2 9,386 7,921 0.8439


©2024 cpdn.org