climateprediction.net home page
Task 12023225

Task 12023225

Name famous_w90x_599_200_006758385_1
Workunit 6961701
Created 14 Nov 2010, 15:23:52 UTC
Sent 14 Nov 2010, 15:25:39 UTC
Report deadline 13 Feb 2011, 22:52:50 UTC
Received 20 Nov 2010, 6:06:31 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 22 (0x00000016) Unknown error code
Computer ID 852663
Run time
CPU time 4 days 0 hours 26 min 16 sec
Validate state Invalid
Credit 2,377.97
Device peak FLOPS 3.23 GFLOPS
Application version UK Met Office FAMOUS v6.11
i686-pc-linux-gnu
Stderr
<core_client_version>5.10.45</core_client_version>
<![CDATA[
<message>
process exited with code 22 (0x16, -234)
</message>
<stderr_txt>
PH 1 TS 0533521 A - 01/12/0656 01:00 - H:M:S=0071:01:43 AVG= 0.48 DLT= 1.24
CPDN Monitor - Quit request from BOINC...
Detaching shared memory...
Starting work on result famous_w90x_599_200_006758385_1...
Starting model in /home/wilkinc/Boinc/BOINC/projects/climateprediction.net...
Trying to kill old process # 5067
Trying to kill old process # 5069
Created shared memory region key = 127635 of size 743572 bytes (version 608)
Starting model ID famous_w90x_599_200_006758385   Phase 1
Getting pthread attributes - retval=0
Setting pthread size (62914560 bytes) - retval=0
Executing program /home/wilkinc/Boinc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu
Executing program /home/wilkinc/Boinc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu 127635 /home/wilkinc/Boinc/BOINC/slots/3
Program launched with process id # 9756
Climate model starting - use graphics to monitor progress.
Or visit the website to see the graphs for this run.

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 60 - Return code = 1

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 61 - Return code = 1

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 68 - Return code = 1

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 69 - Return code = 1
famous_w90x_599_200_006758385 - PH 1 TS 0533521 A - 01/12/0656 01:00 - H:M:S=0071:01:43 AVG= 0.48 DLT= 0.00
famous_w90x_599_200_006758385 - PH 1 TS 0533911 A - 16/12/0656 01:00 - H:M:S=0071:04:45 AVG= 0.48 DLT= 1.75
famous_w90x_599_200_006758385 - PH 1 TS 0534301 A - 01/01/0657 01:00 - H:M:S=0071:07:47 AVG= 0.48 DLT= 1.30
famous_w90x_599_200_006758385 - PH 1 TS 0534691 A - 16/01/0657 01:00 - H:M:S=0071:10:49 AVG= 0.48 DLT= 1.60
famous_w90x_599_200_006758385 - PH 1 TS 0535081 A - 01/02/0657 01:00 - H:M:S=0071:13:50 AVG= 0.48 DLT= 1.75
famous_w90x_599_200_006758385 - PH 1 TS 0535471 A - 16/02/0657 01:00 - H:M:S=0071:16:52 AVG= 0.48 DLT= 1.41
famous_w90x_599_200_006758385 - PH 1 TS 0535861 A - 01/03/0657 01:00 - H:M:S=0071:19:55 AVG= 0.48 DLT= 1.86
famous_w90x_599_200_006758385 - PH 1 TS 0536251 A - 16/03/0657 01:00 - H:M:S=0071:22:58 AVG= 0.48 DLT= 1.05
famous_w90x_599_200_006758385 - PH 1 TS 0536641 A - 01/04/0657 01:00 - H:M:S=0071:26:02 AVG= 0.48 DLT= 1.29
famous_w90x_599_200_006758385 - PH 1 TS 0537031 A - 16/04/0657 01:00 - H:M:S=0071:29:05 AVG= 0.48 DLT= 1.20
famous_w90x_599_200_006758385 - PH 1 TS 0537421 A - 01/05/0657 01:00 - H:M:S=0071:32:07 AVG= 0.48 DLT= 1.25
famous_w90x_599_200_006758385 - PH 1 TS 0537811 A - 16/05/0657 01:00 - H:M:S=0071:35:11 AVG= 0.48 DLT= 1.78
famous_w90x_599_200_006758385 - PH 1 TS 0538201 A - 01/06/0657 01:00 - H:M:S=0071:38:14 AVG= 0.48 DLT= 1.39
famous_w90x_599_200_006758385 - PH 1 TS 0538591 A - 16/06/0657 01:00 - H:M:S=0071:41:17 AVG= 0.48 DLT= 0.80
famous_w90x_599_200_006758385 - PH 1 TS 0538981 A - 01/07/0657 01:00 - H:M:S=0071:44:19 AVG= 0.48 DLT= 1.45
famous_w90x_599_200_006758385 - PH 1 TS 0539371 A - 16/07/0657 01:00 - H:M:S=0071:47:22 AVG= 0.48 DLT= 1.50
famous_w90x_599_200_006758385 - PH 1 TS 0539761 A - 01/08/0657 01:00 - H:M:S=0071:50:27 AVG= 0.48 DLT= 0.70
famous_w90x_599_200_006758385 - PH 1 TS 0540151 A - 16/08/0657 01:00 - H:M:S=0071:53:31 AVG= 0.48 DLT= 1.26
famous_w90x_599_200_006758385 - PH 1 TS 0540541 A - 01/09/0657 01:00 - H:M:S=0071:56:36 AVG= 0.48 DLT= 1.60
famous_w90x_599_200_006758385 - PH 1 TS 0540931 A - 16/09/0657 01:00 - H:M:S=0071:59:42 AVG= 0.48 DLT= 1.61
famous_w90x_599_200_006758385 - PH 1 TS 0541321 A - 01/10/0657 01:00 - H:M:S=0072:02:47 AVG= 0.48 DLT= 1.40
famous_w90x_599_200_006758385 - PH 1 TS 0541711 A - 16/10/0657 01:00 - H:M:S=0072:05:51 AVG= 0.48 DLT= 0.80
famous_w90x_599_200_006758385 - PH 1 TS 0542101 A - 01/11/0657 01:00 - H:M:S=0072:08:55 AVG= 0.48 DLT= 1.46
famous_w90x_599_200_006758385 - PH 1 TS 0542491 A - 16/11/0657 01:00 - H:M:S=0072:11:58 AVG= 0.48 DLT= 1.10
Trickling yearly means for 657
Building file list for 657 in dataout -- 4 entries
Creating trickle file trickle_famous_w90x_599_200_006758385_1_657.zip for upload...
famous_w90x_599_200_006758385 - PH 1 TS 0542881 A - 01/12/0657 01:00 - H:M:S=0072:14:59 AVG= 0.48 DLT= 1.21
famous_w90x_599_200_006758385 - PH 1 TS 0543271 A - 16/12/0657 01:00 - H:M:S=0072:18:00 AVG= 0.48 DLT= 0.89
famous_w90x_599_200_006758385 - PH 1 TS 0543661 A - 01/01/0658 01:00 - H:M:S=0072:21:02 AVG= 0.48 DLT= 1.62
famous_w90x_599_200_006758385 - PH 1 TS 0544051 A - 16/01/0658 01:00 - H:M:S=0072:24:06 AVG= 0.48 DLT= 1.63
famous_w90x_599_200_006758385 - PH 1 TS 0544441 A - 01/02/0658 01:00 - H:M:S=0072:27:07 AVG= 0.48 DLT= 1.62
famous_w90x_599_200_006758385 - PH 1 TS 0544831 A - 16/02/0658 01:00 - H:M:S=0072:30:09 AVG= 0.48 DLT= 1.60
famous_w90x_599_200_006758385 - PH 1 TS 0545221 A - 01/03/0658 01:00 - H:M:S=0072:33:11 AVG= 0.48 DLT= 0.69
famous_w90x_599_200_006758385 - PH 1 TS 0545611 A - 16/03/0658 01:00 - H:M:S=0072:36:15 AVG= 0.48 DLT= 0.73
famous_w90x_599_200_006758385 - PH 1 TS 0546001 A - 01/04/0658 01:00 - H:M:S=0072:39:19 AVG= 0.48 DLT= 0.94
famous_w90x_599_200_006758385 - PH 1 TS 0546391 A - 16/04/0658 01:00 - H:M:S=0072:42:22 AVG= 0.48 DLT= 0.68
famous_w90x_599_200_006758385 - PH 1 TS 0546781 A - 01/05/0658 01:00 - H:M:S=0072:45:25 AVG= 0.48 DLT= 0.70
famous_w90x_599_200_006758385 - PH 1 TS 0547171 A - 16/05/0658 01:00 - H:M:S=0072:48:28 AVG= 0.48 DLT= 1.00
famous_w90x_599_200_006758385 - PH 1 TS 0547561 A - 01/06/0658 01:00 - H:M:S=0072:51:32 AVG= 0.48 DLT= 0.70
famous_w90x_599_200_006758385 - PH 1 TS 0547951 A - 16/06/0658 01:00 - H:M:S=0072:54:36 AVG= 0.48 DLT= 1.27
famous_w90x_599_200_006758385 - PH 1 TS 0548341 A - 01/07/0658 01:00 - H:M:S=0072:57:40 AVG= 0.48 DLT= 1.63
famous_w90x_599_200_006758385 - PH 1 TS 0548731 A - 16/07/0658 01:00 - H:M:S=0073:00:44 AVG= 0.48 DLT= 1.31
famous_w90x_599_200_006758385 - PH 1 TS 0549121 A - 01/08/0658 01:00 - H:M:S=0073:03:49 AVG= 0.48 DLT= 1.40
famous_w90x_599_200_006758385 - PH 1 TS 0549511 A - 16/08/0658 01:00 - H:M:S=0073:06:55 AVG= 0.48 DLT= 1.42
famous_w90x_599_200_006758385 - PH 1 TS 0549901 A - 01/09/0658 01:00 - H:M:S=0073:10:00 AVG= 0.48 DLT= 1.70
famous_w90x_599_200_006758385 - PH 1 TS 0550291 A - 16/09/0658 01:00 - H:M:S=0073:13:05 AVG= 0.48 DLT= 1.22
famous_w90x_599_200_006758385 - PH 1 TS 0550681 A - 01/10/0658 01:00 - H:M:S=0073:16:11 AVG= 0.48 DLT= 1.29
famous_w90x_599_200_006758385 - PH 1 TS 0551071 A - 16/10/0658 01:00 - H:M:S=0073:19:16 AVG= 0.48 DLT= 0.80
famous_w90x_599_200_006758385 - PH 1 TS 0551461 A - 01/11/0658 01:00 - H:M:S=0073:22:19 AVG= 0.48 DLT= 1.16
famous_w90x_599_200_006758385 - PH 1 TS 0551851 A - 16/11/0658 01:00 - H:M:S=0073:25:22 AVG= 0.48 DLT= 1.68
Trickling yearly means for 658
Building file list for 658 in dataout -- 4 entries
Creating trickle file trickle_famous_w90x_599_200_006758385_1_658.zip for upload...
famous_w90x_599_200_006758385 - PH 1 TS 0552241 A - 01/12/0658 01:00 - H:M:S=0073:28:23 AVG= 0.48 DLT= 1.50
famous_w90x_599_200_006758385 - PH 1 TS 0552631 A - 16/12/0658 01:00 - H:M:S=0073:31:24 AVG= 0.48 DLT= 1.27
famous_w90x_599_200_006758385 - PH 1 TS 0553021 A - 01/01/0659 01:00 - H:M:S=0073:34:26 AVG= 0.48 DLT= 1.20
famous_w90x_599_200_006758385 - PH 1 TS 0553411 A - 16/01/0659 01:00 - H:M:S=0073:37:28 AVG= 0.48 DLT= 1.63
famous_w90x_599_200_006758385 - PH 1 TS 0553801 A - 01/02/0659 01:00 - H:M:S=0073:40:30 AVG= 0.48 DLT= 0.90
famous_w90x_599_200_006758385 - PH 1 TS 0554191 A - 16/02/0659 01:00 - H:M:S=0073:43:32 AVG= 0.48 DLT= 1.30
famous_w90x_599_200_006758385 - PH 1 TS 0554581 A - 01/03/0659 01:00 - H:M:S=0073:46:35 AVG= 0.48 DLT= 0.80
famous_w90x_599_200_006758385 - PH 1 TS 0554971 A - 16/03/0659 01:00 - H:M:S=0073:49:38 AVG= 0.48 DLT= 1.28
famous_w90x_599_200_006758385 - PH 1 TS 0555361 A - 01/04/0659 01:00 - H:M:S=0073:52:42 AVG= 0.48 DLT= 1.28
famous_w90x_599_200_006758385 - PH 1 TS 0555751 A - 16/04/0659 01:00 - H:M:S=0073:55:46 AVG= 0.48 DLT= 1.19
famous_w90x_599_200_006758385 - PH 1 TS 0556141 A - 01/05/0659 01:00 - H:M:S=0073:58:49 AVG= 0.48 DLT= 1.78
famous_w90x_599_200_006758385 - PH 1 TS 0556531 A - 16/05/0659 01:00 - H:M:S=0074:01:53 AVG= 0.48 DLT= 0.84
famous_w90x_599_200_006758385 - PH 1 TS 0556921 A - 01/06/0659 01:00 - H:M:S=0074:04:55 AVG= 0.48 DLT= 0.90
famous_w90x_599_200_006758385 - PH 1 TS 0557311 A - 16/06/0659 01:00 - H:M:S=0074:07:59 AVG= 0.48 DLT= 1.40
famous_w90x_599_200_006758385 - PH 1 TS 0557701 A - 01/07/0659 01:00 - H:M:S=0074:11:02 AVG= 0.48 DLT= 1.41
famous_w90x_599_200_006758385 - PH 1 TS 0558091 A - 16/07/0659 01:00 - H:M:S=0074:14:05 AVG= 0.48 DLT= 0.78
famous_w90x_599_200_006758385 - PH 1 TS 0558481 A - 01/08/0659 01:00 - H:M:S=0074:17:09 AVG= 0.48 DLT= 1.33
famous_w90x_599_200_006758385 - PH 1 TS 0558871 A - 16/08/0659 01:00 - H:M:S=0074:20:13 AVG= 0.48 DLT= 1.56
famous_w90x_599_200_006758385 - PH 1 TS 0559261 A - 01/09/0659 01:00 - H:M:S=0074:23:19 AVG= 0.48 DLT= 0.83
famous_w90x_599_200_006758385 - PH 1 TS 0559651 A - 16/09/0659 01:00 - H:M:S=0074:26:25 AVG= 0.48 DLT= 1.20
famous_w90x_599_200_006758385 - PH 1 TS 0560041 A - 01/10/0659 01:00 - H:M:S=0074:29:31 AVG= 0.48 DLT= 0.77
famous_w90x_599_200_006758385 - PH 1 TS 0560431 A - 16/10/0659 01:00 - H:M:S=0074:32:35 AVG= 0.48 DLT= 1.60
famous_w90x_599_200_006758385 - PH 1 TS 0560821 A - 01/11/0659 01:00 - H:M:S=0074:35:38 AVG= 0.48 DLT= 1.60
famous_w90x_599_200_006758385 - PH 1 TS 0561211 A - 16/11/0659 01:00 - H:M:S=0074:38:41 AVG= 0.48 DLT= 0.99
Trickling yearly means for 659
Building file list for 659 in dataout -- 4 entries
Creating trickle file trickle_famous_w90x_599_200_006758385_1_659.zip for upload...
Processing decadal means for 650 through 659
Queuing intermediate upload for CPDN/BOINC: cpdnout6.zip
famous_w90x_599_200_006758385 - PH 1 TS 0561991 A - 16/12/0659 01:00 - H:M:S=0074:44:45 AVG= 0.48 DLT= 1.12
famous_w90x_599_200_006758385 - PH 1 TS 0562381 A - 01/01/0660 01:00 - H:M:S=0074:47:46 AVG= 0.48 DLT= 0.70
famous_w90x_599_200_006758385 - PH 1 TS 0562771 A - 16/01/0660 01:00 - H:M:S=0074:50:48 AVG= 0.48 DLT= 1.74
famous_w90x_599_200_006758385 - PH 1 TS 0563161 A - 01/02/0660 01:00 - H:M:S=0074:53:50 AVG= 0.48 DLT= 1.70
famous_w90x_599_200_006758385 - PH 1 TS 0563551 A - 16/02/0660 01:00 - H:M:S=0074:56:52 AVG= 0.48 DLT= 1.59
famous_w90x_599_200_006758385 - PH 1 TS 0563941 A - 01/03/0660 01:00 - H:M:S=0074:59:55 AVG= 0.48 DLT= 1.70
famous_w90x_599_200_006758385 - PH 1 TS 0564331 A - 16/03/0660 01:00 - H:M:S=0075:02:59 AVG= 0.48 DLT= 0.60
famous_w90x_599_200_006758385 - PH 1 TS 0564721 A - 01/04/0660 01:00 - H:M:S=0075:06:03 AVG= 0.48 DLT= 1.30
famous_w90x_599_200_006758385 - PH 1 TS 0565111 A - 16/04/0660 01:00 - H:M:S=0075:09:07 AVG= 0.48 DLT= 1.80
famous_w90x_599_200_006758385 - PH 1 TS 0565501 A - 01/05/0660 01:00 - H:M:S=0075:12:10 AVG= 0.48 DLT= 1.48
famous_w90x_599_200_006758385 - PH 1 TS 0565891 A - 16/05/0660 01:00 - H:M:S=0075:15:13 AVG= 0.48 DLT= 1.10
famous_w90x_599_200_006758385 - PH 1 TS 0566281 A - 01/06/0660 01:00 - H:M:S=0075:18:16 AVG= 0.48 DLT= 0.98
famous_w90x_599_200_006758385 - PH 1 TS 0566671 A - 16/06/0660 01:00 - H:M:S=0075:21:19 AVG= 0.48 DLT= 1.10
famous_w90x_599_200_006758385 - PH 1 TS 0567061 A - 01/07/0660 01:00 - H:M:S=0075:24:22 AVG= 0.48 DLT= 0.68
famous_w90x_599_200_006758385 - PH 1 TS 0567451 A - 16/07/0660 01:00 - H:M:S=0075:27:26 AVG= 0.48 DLT= 1.58
famous_w90x_599_200_006758385 - PH 1 TS 0567841 A - 01/08/0660 01:00 - H:M:S=0075:30:30 AVG= 0.48 DLT= 1.40
famous_w90x_599_200_006758385 - PH 1 TS 0568231 A - 16/08/0660 01:00 - H:M:S=0075:33:35 AVG= 0.48 DLT= 0.80
famous_w90x_599_200_006758385 - PH 1 TS 0568621 A - 01/09/0660 01:00 - H:M:S=0075:36:40 AVG= 0.48 DLT= 0.83
famous_w90x_599_200_006758385 - PH 1 TS 0569011 A - 16/09/0660 01:00 - H:M:S=0075:39:45 AVG= 0.48 DLT= 1.62
famous_w90x_599_200_006758385 - PH 1 TS 0569401 A - 01/10/0660 01:00 - H:M:S=0075:42:50 AVG= 0.48 DLT= 1.80
famous_w90x_599_200_006758385 - PH 1 TS 0569791 A - 16/10/0660 01:00 - H:M:S=0075:45:54 AVG= 0.48 DLT= 1.10
famous_w90x_599_200_006758385 - PH 1 TS 0570181 A - 01/11/0660 01:00 - H:M:S=0075:48:57 AVG= 0.48 DLT= 0.95
famous_w90x_599_200_006758385 - PH 1 TS 0570571 A - 16/11/0660 01:00 - H:M:S=0075:52:00 AVG= 0.48 DLT= 1.10
Trickling yearly means for 660
Building file list for 660 in dataout -- 4 entries
Creating trickle file trickle_famous_w90x_599_200_006758385_1_660.zip for upload...
famous_w90x_599_200_006758385 - PH 1 TS 0570961 A - 01/12/0660 01:00 - H:M:S=0075:55:02 AVG= 0.48 DLT= 1.20
famous_w90x_599_200_006758385 - PH 1 TS 0571351 A - 16/12/0660 01:00 - H:M:S=0075:58:03 AVG= 0.48 DLT= 0.77
famous_w90x_599_200_006758385 - PH 1 TS 0571741 A - 01/01/0661 01:00 - H:M:S=0076:01:04 AVG= 0.48 DLT= 0.80
famous_w90x_599_200_006758385 - PH 1 TS 0572131 A - 16/01/0661 01:00 - H:M:S=0076:04:06 AVG= 0.48 DLT= 1.60
famous_w90x_599_200_006758385 - PH 1 TS 0572521 A - 01/02/0661 01:00 - H:M:S=0076:07:07 AVG= 0.48 DLT= 1.51
famous_w90x_599_200_006758385 - PH 1 TS 0572911 A - 16/02/0661 01:00 - H:M:S=0076:10:08 AVG= 0.48 DLT= 0.72
famous_w90x_599_200_006758385 - PH 1 TS 0573301 A - 01/03/0661 01:00 - H:M:S=0076:13:09 AVG= 0.48 DLT= 1.68
famous_w90x_599_200_006758385 - PH 1 TS 0573691 A - 16/03/0661 01:00 - H:M:S=0076:16:12 AVG= 0.48 DLT= 0.99
famous_w90x_599_200_006758385 - PH 1 TS 0574081 A - 01/04/0661 01:00 - H:M:S=0076:19:16 AVG= 0.48 DLT= 0.89
famous_w90x_599_200_006758385 - PH 1 TS 0574471 A - 16/04/0661 01:00 - H:M:S=0076:22:19 AVG= 0.48 DLT= 1.23
famous_w90x_599_200_006758385 - PH 1 TS 0574861 A - 01/05/0661 01:00 - H:M:S=0076:25:21 AVG= 0.48 DLT= 1.56
famous_w90x_599_200_006758385 - PH 1 TS 0575251 A - 16/05/0661 01:00 - H:M:S=0076:28:24 AVG= 0.48 DLT= 0.99
famous_w90x_599_200_006758385 - PH 1 TS 0575641 A - 01/06/0661 01:00 - H:M:S=0076:31:27 AVG= 0.48 DLT= 0.93
famous_w90x_599_200_006758385 - PH 1 TS 0576031 A - 16/06/0661 01:00 - H:M:S=0076:34:30 AVG= 0.48 DLT= 1.50
famous_w90x_599_200_006758385 - PH 1 TS 0576421 A - 01/07/0661 01:00 - H:M:S=0076:37:34 AVG= 0.48 DLT= 1.00
famous_w90x_599_200_006758385 - PH 1 TS 0576811 A - 16/07/0661 01:00 - H:M:S=0076:40:37 AVG= 0.48 DLT= 1.49
famous_w90x_599_200_006758385 - PH 1 TS 0577201 A - 01/08/0661 01:00 - H:M:S=0076:43:41 AVG= 0.48 DLT= 1.80
famous_w90x_599_200_006758385 - PH 1 TS 0577591 A - 16/08/0661 01:00 - H:M:S=0076:46:45 AVG= 0.48 DLT= 1.75
famous_w90x_599_200_006758385 - PH 1 TS 0577981 A - 01/09/0661 01:00 - H:M:S=0076:49:49 AVG= 0.48 DLT= 0.90
famous_w90x_599_200_006758385 - PH 1 TS 0578371 A - 16/09/0661 01:00 - H:M:S=0076:52:54 AVG= 0.48 DLT= 1.25
famous_w90x_599_200_006758385 - PH 1 TS 0578761 A - 01/10/0661 01:00 - H:M:S=0076:55:59 AVG= 0.48 DLT= 1.06
famous_w90x_599_200_006758385 - PH 1 TS 0579151 A - 16/10/0661 01:00 - H:M:S=0076:59:02 AVG= 0.48 DLT= 0.80
famous_w90x_599_200_006758385 - PH 1 TS 0579541 A - 01/11/0661 01:00 - H:M:S=0077:02:04 AVG= 0.48 DLT= 1.41
famous_w90x_599_200_006758385 - PH 1 TS 0579931 A - 16/11/0661 01:00 - H:M:S=0077:05:06 AVG= 0.48 DLT= 1.70
Trickling yearly means for 661
Building file list for 661 in dataout -- 4 entries
Creating trickle file trickle_famous_w90x_599_200_006758385_1_661.zip for upload...
famous_w90x_599_200_006758385 - PH 1 TS 0580321 A - 01/12/0661 01:00 - H:M:S=0077:08:07 AVG= 0.48 DLT= 1.89
famous_w90x_599_200_006758385 - PH 1 TS 0580711 A - 16/12/0661 01:00 - H:M:S=0077:11:08 AVG= 0.48 DLT= 0.80
famous_w90x_599_200_006758385 - PH 1 TS 0581101 A - 01/01/0662 01:00 - H:M:S=0077:14:09 AVG= 0.48 DLT= 0.70
famous_w90x_599_200_006758385 - PH 1 TS 0581491 A - 16/01/0662 01:00 - H:M:S=0077:17:10 AVG= 0.48 DLT= 1.10
famous_w90x_599_200_006758385 - PH 1 TS 0581881 A - 01/02/0662 01:00 - H:M:S=0077:20:12 AVG= 0.48 DLT= 1.70
famous_w90x_599_200_006758385 - PH 1 TS 0582271 A - 16/02/0662 01:00 - H:M:S=0077:23:13 AVG= 0.48 DLT= 1.00
famous_w90x_599_200_006758385 - PH 1 TS 0582661 A - 01/03/0662 01:00 - H:M:S=0077:26:16 AVG= 0.48 DLT= 0.83
famous_w90x_599_200_006758385 - PH 1 TS 0583051 A - 16/03/0662 01:00 - H:M:S=0077:29:19 AVG= 0.48 DLT= 1.90
famous_w90x_599_200_006758385 - PH 1 TS 0583441 A - 01/04/0662 01:00 - H:M:S=0077:32:23 AVG= 0.48 DLT= 0.99
famous_w90x_599_200_006758385 - PH 1 TS 0583831 A - 16/04/0662 01:00 - H:M:S=0077:35:26 AVG= 0.48 DLT= 1.68
famous_w90x_599_200_006758385 - PH 1 TS 0584221 A - 01/05/0662 01:00 - H:M:S=0077:38:29 AVG= 0.48 DLT= 0.99
famous_w90x_599_200_006758385 - PH 1 TS 0584611 A - 16/05/0662 01:00 - H:M:S=0077:41:31 AVG= 0.48 DLT= 1.58
famous_w90x_599_200_006758385 - PH 1 TS 0585001 A - 01/06/0662 01:00 - H:M:S=0077:44:34 AVG= 0.48 DLT= 0.80
famous_w90x_599_200_006758385 - PH 1 TS 0585391 A - 16/06/0662 01:00 - H:M:S=0077:47:37 AVG= 0.48 DLT= 1.60
famous_w90x_599_200_006758385 - PH 1 TS 0585781 A - 01/07/0662 01:00 - H:M:S=0077:50:40 AVG= 0.48 DLT= 1.30
famous_w90x_599_200_006758385 - PH 1 TS 0586171 A - 16/07/0662 01:00 - H:M:S=0077:53:43 AVG= 0.48 DLT= 1.55
famous_w90x_599_200_006758385 - PH 1 TS 0586561 A - 01/08/0662 01:00 - H:M:S=0077:56:47 AVG= 0.48 DLT= 0.92
famous_w90x_599_200_006758385 - PH 1 TS 0586951 A - 16/08/0662 01:00 - H:M:S=0077:59:51 AVG= 0.48 DLT= 1.13
famous_w90x_599_200_006758385 - PH 1 TS 0587341 A - 01/09/0662 01:00 - H:M:S=0078:02:55 AVG= 0.48 DLT= 1.37
famous_w90x_599_200_006758385 - PH 1 TS 0587731 A - 16/09/0662 01:00 - H:M:S=0078:06:00 AVG= 0.48 DLT= 1.28
famous_w90x_599_200_006758385 - PH 1 TS 0588121 A - 01/10/0662 01:00 - H:M:S=0078:09:05 AVG= 0.48 DLT= 1.40
famous_w90x_599_200_006758385 - PH 1 TS 0588511 A - 16/10/0662 01:00 - H:M:S=0078:12:09 AVG= 0.48 DLT= 0.98
famous_w90x_599_200_006758385 - PH 1 TS 0588901 A - 01/11/0662 01:00 - H:M:S=0078:15:12 AVG= 0.48 DLT= 1.00
famous_w90x_599_200_006758385 - PH 1 TS 0589291 A - 16/11/0662 01:00 - H:M:S=0078:18:13 AVG= 0.48 DLT= 1.49
Trickling yearly means for 662
Building file list for 662 in dataout -- 4 entries
Creating trickle file trickle_famous_w90x_599_200_006758385_1_662.zip for upload...
famous_w90x_599_200_006758385 - PH 1 TS 0589681 A - 01/12/0662 01:00 - H:M:S=0078:21:15 AVG= 0.48 DLT= 1.22
famous_w90x_599_200_006758385 - PH 1 TS 0590071 A - 16/12/0662 01:00 - H:M:S=0078:24:16 AVG= 0.48 DLT= 1.30
famous_w90x_599_200_006758385 - PH 1 TS 0590461 A - 01/01/0663 01:00 - H:M:S=0078:27:17 AVG= 0.48 DLT= 1.53
famous_w90x_599_200_006758385 - PH 1 TS 0590851 A - 16/01/0663 01:00 - H:M:S=0078:30:17 AVG= 0.48 DLT= 1.80
famous_w90x_599_200_006758385 - PH 1 TS 0591241 A - 01/02/0663 01:00 - H:M:S=0078:33:19 AVG= 0.48 DLT= 1.29
famous_w90x_599_200_006758385 - PH 1 TS 0591631 A - 16/02/0663 01:00 - H:M:S=0078:36:22 AVG= 0.48 DLT= 0.79
famous_w90x_599_200_006758385 - PH 1 TS 0592021 A - 01/03/0663 01:00 - H:M:S=0078:39:24 AVG= 0.48 DLT= 1.17
famous_w90x_599_200_006758385 - PH 1 TS 0592411 A - 16/03/0663 01:00 - H:M:S=0078:42:28 AVG= 0.48 DLT= 1.56
famous_w90x_599_200_006758385 - PH 1 TS 0592801 A - 01/04/0663 01:00 - H:M:S=0078:45:32 AVG= 0.48 DLT= 1.71
famous_w90x_599_200_006758385 - PH 1 TS 0593191 A - 16/04/0663 01:00 - H:M:S=0078:48:36 AVG= 0.48 DLT= 1.70
famous_w90x_599_200_006758385 - PH 1 TS 0593581 A - 01/05/0663 01:00 - H:M:S=0078:51:40 AVG= 0.48 DLT= 1.19
famous_w90x_599_200_006758385 - PH 1 TS 0593971 A - 16/05/0663 01:00 - H:M:S=0078:54:43 AVG= 0.48 DLT= 1.15
famous_w90x_599_200_006758385 - PH 1 TS 0594361 A - 01/06/0663 01:00 - H:M:S=0078:57:47 AVG= 0.48 DLT= 1.69
famous_w90x_599_200_006758385 - PH 1 TS 0594751 A - 16/06/0663 01:00 - H:M:S=0079:00:51 AVG= 0.48 DLT= 0.79
famous_w90x_599_200_006758385 - PH 1 TS 0595141 A - 01/07/0663 01:00 - H:M:S=0079:03:54 AVG= 0.48 DLT= 1.60
famous_w90x_599_200_006758385 - PH 1 TS 0595531 A - 16/07/0663 01:00 - H:M:S=0079:06:57 AVG= 0.48 DLT= 1.20
famous_w90x_599_200_006758385 - PH 1 TS 0595921 A - 01/08/0663 01:00 - H:M:S=0079:10:01 AVG= 0.48 DLT= 1.70
famous_w90x_599_200_006758385 - PH 1 TS 0596311 A - 16/08/0663 01:00 - H:M:S=0079:13:06 AVG= 0.48 DLT= 1.86
famous_w90x_599_200_006758385 - PH 1 TS 0596701 A - 01/09/0663 01:00 - H:M:S=0079:16:11 AVG= 0.48 DLT= 0.72
famous_w90x_599_200_006758385 - PH 1 TS 0597091 A - 16/09/0663 01:00 - H:M:S=0079:19:17 AVG= 0.48 DLT= 1.60
famous_w90x_599_200_006758385 - PH 1 TS 0597481 A - 01/10/0663 01:00 - H:M:S=0079:22:23 AVG= 0.48 DLT= 1.47
famous_w90x_599_200_006758385 - PH 1 TS 0597871 A - 16/10/0663 01:00 - H:M:S=0079:25:28 AVG= 0.48 DLT= 1.20
famous_w90x_599_200_006758385 - PH 1 TS 0598261 A - 01/11/0663 01:00 - H:M:S=0079:28:31 AVG= 0.48 DLT= 0.99
famous_w90x_599_200_006758385 - PH 1 TS 0598651 A - 16/11/0663 01:00 - H:M:S=0079:31:33 AVG= 0.48 DLT= 0.99
Trickling yearly means for 663
Building file list for 663 in dataout -- 4 entries
Creating trickle file trickle_famous_w90x_599_200_006758385_1_663.zip for upload...
famous_w90x_599_200_006758385 - PH 1 TS 0599041 A - 01/12/0663 01:00 - H:M:S=0079:34:36 AVG= 0.48 DLT= 1.81
famous_w90x_599_200_006758385 - PH 1 TS 0599431 A - 16/12/0663 01:00 - H:M:S=0079:37:38 AVG= 0.48 DLT= 1.09
famous_w90x_599_200_006758385 - PH 1 TS 0599821 A - 01/01/0664 01:00 - H:M:S=0079:40:40 AVG= 0.48 DLT= 0.98
famous_w90x_599_200_006758385 - PH 1 TS 0600211 A - 16/01/0664 01:00 - H:M:S=0079:43:42 AVG= 0.48 DLT= 1.66
famous_w90x_599_200_006758385 - PH 1 TS 0600601 A - 01/02/0664 01:00 - H:M:S=0079:46:43 AVG= 0.48 DLT= 1.40
famous_w90x_599_200_006758385 - PH 1 TS 0600991 A - 16/02/0664 01:00 - H:M:S=0079:49:46 AVG= 0.48 DLT= 1.33
famous_w90x_599_200_006758385 - PH 1 TS 0601381 A - 01/03/0664 01:00 - H:M:S=0079:52:49 AVG= 0.48 DLT= 0.70
famous_w90x_599_200_006758385 - PH 1 TS 0601771 A - 16/03/0664 01:00 - H:M:S=0079:55:54 AVG= 0.48 DLT= 1.26

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  
Model restart required...
Preparing for restart attempt # 1...
Starting model ID famous_w90x_599_200_006758385   Phase 1
Getting pthread attributes - retval=0
Setting pthread size (62914560 bytes) - retval=0
Executing program /home/wilkinc/Boinc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu
Executing program /home/wilkinc/Boinc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu 127635 /home/wilkinc/Boinc/BOINC/slots/3
Program launched with process id # 11739
Climate model starting - use graphics to monitor progress.
Or visit the website to see the graphs for this run.
famous_w90x_599_200_006758385 - PH 1 TS 0602161 A - 01/04/0664 01:00 - H:M:S=0080:00:26 AVG= 0.48 DLT= 1.38
famous_w90x_599_200_006758385 - PH 1 TS 0602551 A - 16/04/0664 01:00 - H:M:S=0080:03:30 AVG= 0.48 DLT= 1.10
famous_w90x_599_200_006758385 - PH 1 TS 0602941 A - 01/05/0664 01:00 - H:M:S=0080:06:33 AVG= 0.48 DLT= 1.44
famous_w90x_599_200_006758385 - PH 1 TS 0603331 A - 16/05/0664 01:00 - H:M:S=0080:09:36 AVG= 0.48 DLT= 1.35
famous_w90x_599_200_006758385 - PH 1 TS 0603721 A - 01/06/0664 01:00 - H:M:S=0080:12:40 AVG= 0.48 DLT= 1.54
famous_w90x_599_200_006758385 - PH 1 TS 0604111 A - 16/06/0664 01:00 - H:M:S=0080:15:43 AVG= 0.48 DLT= 1.50
famous_w90x_599_200_006758385 - PH 1 TS 0604501 A - 01/07/0664 01:00 - H:M:S=0080:18:46 AVG= 0.48 DLT= 1.50
famous_w90x_599_200_006758385 - PH 1 TS 0604891 A - 16/07/0664 01:00 - H:M:S=0080:21:49 AVG= 0.48 DLT= 0.90
famous_w90x_599_200_006758385 - PH 1 TS 0605281 A - 01/08/0664 01:00 - H:M:S=0080:24:53 AVG= 0.48 DLT= 1.39
famous_w90x_599_200_006758385 - PH 1 TS 0605671 A - 16/08/0664 01:00 - H:M:S=0080:27:59 AVG= 0.48 DLT= 1.10
famous_w90x_599_200_006758385 - PH 1 TS 0606061 A - 01/09/0664 01:00 - H:M:S=0080:31:04 AVG= 0.48 DLT= 1.26
famous_w90x_599_200_006758385 - PH 1 TS 0606451 A - 16/09/0664 01:00 - H:M:S=0080:34:10 AVG= 0.48 DLT= 1.00
famous_w90x_599_200_006758385 - PH 1 TS 0606841 A - 01/10/0664 01:00 - H:M:S=0080:37:16 AVG= 0.48 DLT= 1.52
famous_w90x_599_200_006758385 - PH 1 TS 0607231 A - 16/10/0664 01:00 - H:M:S=0080:40:20 AVG= 0.48 DLT= 1.43
famous_w90x_599_200_006758385 - PH 1 TS 0607621 A - 01/11/0664 01:00 - H:M:S=0080:43:23 AVG= 0.48 DLT= 1.10
famous_w90x_599_200_006758385 - PH 1 TS 0608011 A - 16/11/0664 01:00 - H:M:S=0080:46:26 AVG= 0.48 DLT= 1.71
Trickling yearly means for 664
Building file list for 664 in dataout -- 4 entries
Creating trickle file trickle_famous_w90x_599_200_006758385_1_664.zip for upload...
famous_w90x_599_200_006758385 - PH 1 TS 0608401 A - 01/12/0664 01:00 - H:M:S=0080:49:28 AVG= 0.48 DLT= 1.18
famous_w90x_599_200_006758385 - PH 1 TS 0608791 A - 16/12/0664 01:00 - H:M:S=0080:52:30 AVG= 0.48 DLT= 1.20
famous_w90x_599_200_006758385 - PH 1 TS 0609181 A - 01/01/0665 01:00 - H:M:S=0080:55:32 AVG= 0.48 DLT= 1.70
famous_w90x_599_200_006758385 - PH 1 TS 0609571 A - 16/01/0665 01:00 - H:M:S=0080:58:34 AVG= 0.48 DLT= 1.30
famous_w90x_599_200_006758385 - PH 1 TS 0609961 A - 01/02/0665 01:00 - H:M:S=0081:01:36 AVG= 0.48 DLT= 1.39
famous_w90x_599_200_006758385 - PH 1 TS 0610351 A - 16/02/0665 01:00 - H:M:S=0081:04:38 AVG= 0.48 DLT= 1.19
famous_w90x_599_200_006758385 - PH 1 TS 0610741 A - 01/03/0665 01:00 - H:M:S=0081:07:40 AVG= 0.48 DLT= 0.90
famous_w90x_599_200_006758385 - PH 1 TS 0611131 A - 16/03/0665 01:00 - H:M:S=0081:10:44 AVG= 0.48 DLT= 1.30
famous_w90x_599_200_006758385 - PH 1 TS 0611521 A - 01/04/0665 01:00 - H:M:S=0081:13:48 AVG= 0.48 DLT= 0.79
famous_w90x_599_200_006758385 - PH 1 TS 0611911 A - 16/04/0665 01:00 - H:M:S=0081:16:52 AVG= 0.48 DLT= 1.00
famous_w90x_599_200_006758385 - PH 1 TS 0612301 A - 01/05/0665 01:00 - H:M:S=0081:19:54 AVG= 0.48 DLT= 1.00
famous_w90x_599_200_006758385 - PH 1 TS 0612691 A - 16/05/0665 01:00 - H:M:S=0081:22:57 AVG= 0.48 DLT= 1.01
famous_w90x_599_200_006758385 - PH 1 TS 0613081 A - 01/06/0665 01:00 - H:M:S=0081:26:01 AVG= 0.48 DLT= 1.10
famous_w90x_599_200_006758385 - PH 1 TS 0613471 A - 16/06/0665 01:00 - H:M:S=0081:29:05 AVG= 0.48 DLT= 0.96
famous_w90x_599_200_006758385 - PH 1 TS 0613861 A - 01/07/0665 01:00 - H:M:S=0081:32:08 AVG= 0.48 DLT= 1.79
famous_w90x_599_200_006758385 - PH 1 TS 0614251 A - 16/07/0665 01:00 - H:M:S=0081:35:11 AVG= 0.48 DLT= 0.79
famous_w90x_599_200_006758385 - PH 1 TS 0614641 A - 01/08/0665 01:00 - H:M:S=0081:38:16 AVG= 0.48 DLT= 1.10
famous_w90x_599_200_006758385 - PH 1 TS 0615031 A - 16/08/0665 01:00 - H:M:S=0081:41:21 AVG= 0.48 DLT= 1.30
famous_w90x_599_200_006758385 - PH 1 TS 0615421 A - 01/09/0665 01:00 - H:M:S=0081:44:26 AVG= 0.48 DLT= 1.17
famous_w90x_599_200_006758385 - PH 1 TS 0615811 A - 16/09/0665 01:00 - H:M:S=0081:47:31 AVG= 0.48 DLT= 1.15
famous_w90x_599_200_006758385 - PH 1 TS 0616201 A - 01/10/0665 01:00 - H:M:S=0081:50:37 AVG= 0.48 DLT= 1.47
famous_w90x_599_200_006758385 - PH 1 TS 0616591 A - 16/10/0665 01:00 - H:M:S=0081:53:42 AVG= 0.48 DLT= 1.50
famous_w90x_599_200_006758385 - PH 1 TS 0616981 A - 01/11/0665 01:00 - H:M:S=0081:56:45 AVG= 0.48 DLT= 0.93
famous_w90x_599_200_006758385 - PH 1 TS 0617371 A - 16/11/0665 01:00 - H:M:S=0081:59:47 AVG= 0.48 DLT= 1.23
Trickling yearly means for 665
Building file list for 665 in dataout -- 4 entries
Creating trickle file trickle_famous_w90x_599_200_006758385_1_665.zip for upload...
famous_w90x_599_200_006758385 - PH 1 TS 0617761 A - 01/12/0665 01:00 - H:M:S=0082:02:49 AVG= 0.48 DLT= 1.08
famous_w90x_599_200_006758385 - PH 1 TS 0618151 A - 16/12/0665 01:00 - H:M:S=0082:05:50 AVG= 0.48 DLT= 0.84
famous_w90x_599_200_006758385 - PH 1 TS 0618541 A - 01/01/0666 01:00 - H:M:S=0082:08:53 AVG= 0.48 DLT= 1.47
famous_w90x_599_200_006758385 - PH 1 TS 0618931 A - 16/01/0666 01:00 - H:M:S=0082:11:56 AVG= 0.48 DLT= 1.43
famous_w90x_599_200_006758385 - PH 1 TS 0619321 A - 01/02/0666 01:00 - H:M:S=0082:14:58 AVG= 0.48 DLT= 0.90
famous_w90x_599_200_006758385 - PH 1 TS 0619711 A - 16/02/0666 01:00 - H:M:S=0082:18:00 AVG= 0.48 DLT= 0.76
famous_w90x_599_200_006758385 - PH 1 TS 0620101 A - 01/03/0666 01:00 - H:M:S=0082:21:03 AVG= 0.48 DLT= 1.70
famous_w90x_599_200_006758385 - PH 1 TS 0620491 A - 16/03/0666 01:00 - H:M:S=0082:24:07 AVG= 0.48 DLT= 1.27
famous_w90x_599_200_006758385 - PH 1 TS 0620881 A - 01/04/0666 01:00 - H:M:S=0082:27:12 AVG= 0.48 DLT= 1.00
famous_w90x_599_200_006758385 - PH 1 TS 0621271 A - 16/04/0666 01:00 - H:M:S=0082:30:15 AVG= 0.48 DLT= 1.37
famous_w90x_599_200_006758385 - PH 1 TS 0621661 A - 01/05/0666 01:00 - H:M:S=0082:33:17 AVG= 0.48 DLT= 1.73
famous_w90x_599_200_006758385 - PH 1 TS 0622051 A - 16/05/0666 01:00 - H:M:S=0082:36:20 AVG= 0.48 DLT= 0.80
famous_w90x_599_200_006758385 - PH 1 TS 0622441 A - 01/06/0666 01:00 - H:M:S=0082:39:23 AVG= 0.48 DLT= 0.90
famous_w90x_599_200_006758385 - PH 1 TS 0622831 A - 16/06/0666 01:00 - H:M:S=0082:42:27 AVG= 0.48 DLT= 1.36
famous_w90x_599_200_006758385 - PH 1 TS 0623221 A - 01/07/0666 01:00 - H:M:S=0082:45:31 AVG= 0.48 DLT= 0.70
famous_w90x_599_200_006758385 - PH 1 TS 0623611 A - 16/07/0666 01:00 - H:M:S=0082:48:34 AVG= 0.48 DLT= 1.14
famous_w90x_599_200_006758385 - PH 1 TS 0624001 A - 01/08/0666 01:00 - H:M:S=0082:51:38 AVG= 0.48 DLT= 0.79
famous_w90x_599_200_006758385 - PH 1 TS 0624391 A - 16/08/0666 01:00 - H:M:S=0082:54:42 AVG= 0.48 DLT= 0.84
famous_w90x_599_200_006758385 - PH 1 TS 0624781 A - 01/09/0666 01:00 - H:M:S=0082:57:46 AVG= 0.48 DLT= 1.10
famous_w90x_599_200_006758385 - PH 1 TS 0625171 A - 16/09/0666 01:00 - H:M:S=0083:00:52 AVG= 0.48 DLT= 1.56
famous_w90x_599_200_006758385 - PH 1 TS 0625561 A - 01/10/0666 01:00 - H:M:S=0083:03:56 AVG= 0.48 DLT= 0.80
famous_w90x_599_200_006758385 - PH 1 TS 0625951 A - 16/10/0666 01:00 - H:M:S=0083:07:01 AVG= 0.48 DLT= 1.30
famous_w90x_599_200_006758385 - PH 1 TS 0626341 A - 01/11/0666 01:00 - H:M:S=0083:10:05 AVG= 0.48 DLT= 1.64
famous_w90x_599_200_006758385 - PH 1 TS 0626731 A - 16/11/0666 01:00 - H:M:S=0083:13:07 AVG= 0.48 DLT= 0.98
Trickling yearly means for 666
Building file list for 666 in dataout -- 4 entries
Creating trickle file trickle_famous_w90x_599_200_006758385_1_666.zip for upload...
famous_w90x_599_200_006758385 - PH 1 TS 0627121 A - 01/12/0666 01:00 - H:M:S=0083:16:10 AVG= 0.48 DLT= 1.60
famous_w90x_599_200_006758385 - PH 1 TS 0627511 A - 16/12/0666 01:00 - H:M:S=0083:19:12 AVG= 0.48 DLT= 1.43
famous_w90x_599_200_006758385 - PH 1 TS 0627901 A - 01/01/0667 01:00 - H:M:S=0083:22:13 AVG= 0.48 DLT= 1.40
famous_w90x_599_200_006758385 - PH 1 TS 0628291 A - 16/01/0667 01:00 - H:M:S=0083:25:15 AVG= 0.48 DLT= 0.73
famous_w90x_599_200_006758385 - PH 1 TS 0628681 A - 01/02/0667 01:00 - H:M:S=0083:28:17 AVG= 0.48 DLT= 0.76
famous_w90x_599_200_006758385 - PH 1 TS 0629071 A - 16/02/0667 01:00 - H:M:S=0083:31:19 AVG= 0.48 DLT= 0.87
famous_w90x_599_200_006758385 - PH 1 TS 0629461 A - 01/03/0667 01:00 - H:M:S=0083:34:21 AVG= 0.48 DLT= 0.90
famous_w90x_599_200_006758385 - PH 1 TS 0629851 A - 16/03/0667 01:00 - H:M:S=0083:37:24 AVG= 0.48 DLT= 1.12
famous_w90x_599_200_006758385 - PH 1 TS 0630241 A - 01/04/0667 01:00 - H:M:S=0083:40:27 AVG= 0.48 DLT= 1.20
famous_w90x_599_200_006758385 - PH 1 TS 0630631 A - 16/04/0667 01:00 - H:M:S=0083:43:30 AVG= 0.48 DLT= 0.80
famous_w90x_599_200_006758385 - PH 1 TS 0631021 A - 01/05/0667 01:00 - H:M:S=0083:46:33 AVG= 0.48 DLT= 0.88
famous_w90x_599_200_006758385 - PH 1 TS 0631411 A - 16/05/0667 01:00 - H:M:S=0083:49:37 AVG= 0.48 DLT= 1.80
famous_w90x_599_200_006758385 - PH 1 TS 0631801 A - 01/06/0667 01:00 - H:M:S=0083:52:39 AVG= 0.48 DLT= 1.70
famous_w90x_599_200_006758385 - PH 1 TS 0632191 A - 16/06/0667 01:00 - H:M:S=0083:55:42 AVG= 0.48 DLT= 1.55
famous_w90x_599_200_006758385 - PH 1 TS 0632581 A - 01/07/0667 01:00 - H:M:S=0083:58:45 AVG= 0.48 DLT= 1.47
famous_w90x_599_200_006758385 - PH 1 TS 0632971 A - 16/07/0667 01:00 - H:M:S=0084:01:49 AVG= 0.48 DLT= 0.80
famous_w90x_599_200_006758385 - PH 1 TS 0633361 A - 01/08/0667 01:00 - H:M:S=0084:04:53 AVG= 0.48 DLT= 0.79
famous_w90x_599_200_006758385 - PH 1 TS 0633751 A - 16/08/0667 01:00 - H:M:S=0084:07:56 AVG= 0.48 DLT= 0.91
famous_w90x_599_200_006758385 - PH 1 TS 0634141 A - 01/09/0667 01:00 - H:M:S=0084:11:01 AVG= 0.48 DLT= 0.93
famous_w90x_599_200_006758385 - PH 1 TS 0634531 A - 16/09/0667 01:00 - H:M:S=0084:14:07 AVG= 0.48 DLT= 1.20
famous_w90x_599_200_006758385 - PH 1 TS 0634921 A - 01/10/0667 01:00 - H:M:S=0084:17:12 AVG= 0.48 DLT= 1.05
famous_w90x_599_200_006758385 - PH 1 TS 0635311 A - 16/10/0667 01:00 - H:M:S=0084:20:17 AVG= 0.48 DLT= 1.16
famous_w90x_599_200_006758385 - PH 1 TS 0635701 A - 01/11/0667 01:00 - H:M:S=0084:23:21 AVG= 0.48 DLT= 0.97
famous_w90x_599_200_006758385 - PH 1 TS 0636091 A - 16/11/0667 01:00 - H:M:S=0084:26:24 AVG= 0.48 DLT= 1.00
Trickling yearly means for 667
Building file list for 667 in dataout -- 4 entries
Creating trickle file trickle_famous_w90x_599_200_006758385_1_667.zip for upload...
famous_w90x_599_200_006758385 - PH 1 TS 0636481 A - 01/12/0667 01:00 - H:M:S=0084:29:27 AVG= 0.48 DLT= 1.30
famous_w90x_599_200_006758385 - PH 1 TS 0636871 A - 16/12/0667 01:00 - H:M:S=0084:32:30 AVG= 0.48 DLT= 1.00
famous_w90x_599_200_006758385 - PH 1 TS 0637261 A - 01/01/0668 01:00 - H:M:S=0084:35:32 AVG= 0.48 DLT= 1.46
famous_w90x_599_200_006758385 - PH 1 TS 0637651 A - 16/01/0668 01:00 - H:M:S=0084:38:34 AVG= 0.48 DLT= 1.10
famous_w90x_599_200_006758385 - PH 1 TS 0638041 A - 01/02/0668 01:00 - H:M:S=0084:41:35 AVG= 0.48 DLT= 0.80
famous_w90x_599_200_006758385 - PH 1 TS 0638431 A - 16/02/0668 01:00 - H:M:S=0084:44:37 AVG= 0.48 DLT= 1.80
famous_w90x_599_200_006758385 - PH 1 TS 0638821 A - 01/03/0668 01:00 - H:M:S=0084:47:41 AVG= 0.48 DLT= 1.20
famous_w90x_599_200_006758385 - PH 1 TS 0639211 A - 16/03/0668 01:00 - H:M:S=0084:50:44 AVG= 0.48 DLT= 1.30
famous_w90x_599_200_006758385 - PH 1 TS 0639601 A - 01/04/0668 01:00 - H:M:S=0084:53:48 AVG= 0.48 DLT= 0.99
famous_w90x_599_200_006758385 - PH 1 TS 0639991 A - 16/04/0668 01:00 - H:M:S=0084:56:52 AVG= 0.48 DLT= 1.01
famous_w90x_599_200_006758385 - PH 1 TS 0640381 A - 01/05/0668 01:00 - H:M:S=0084:59:56 AVG= 0.48 DLT= 1.10
famous_w90x_599_200_006758385 - PH 1 TS 0640771 A - 16/05/0668 01:00 - H:M:S=0085:02:59 AVG= 0.48 DLT= 1.50
famous_w90x_599_200_006758385 - PH 1 TS 0641161 A - 01/06/0668 01:00 - H:M:S=0085:06:02 AVG= 0.48 DLT= 1.07
famous_w90x_599_200_006758385 - PH 1 TS 0641551 A - 16/06/0668 01:00 - H:M:S=0085:09:06 AVG= 0.48 DLT= 1.39
famous_w90x_599_200_006758385 - PH 1 TS 0641941 A - 01/07/0668 01:00 - H:M:S=0085:12:10 AVG= 0.48 DLT= 1.64
famous_w90x_599_200_006758385 - PH 1 TS 0642331 A - 16/07/0668 01:00 - H:M:S=0085:15:14 AVG= 0.48 DLT= 1.31
famous_w90x_599_200_006758385 - PH 1 TS 0642721 A - 01/08/0668 01:00 - H:M:S=0085:18:18 AVG= 0.48 DLT= 0.73
famous_w90x_599_200_006758385 - PH 1 TS 0643111 A - 16/08/0668 01:00 - H:M:S=0085:21:23 AVG= 0.48 DLT= 0.80
famous_w90x_599_200_006758385 - PH 1 TS 0643501 A - 01/09/0668 01:00 - H:M:S=0085:24:28 AVG= 0.48 DLT= 1.49
famous_w90x_599_200_006758385 - PH 1 TS 0643891 A - 16/09/0668 01:00 - H:M:S=0085:27:33 AVG= 0.48 DLT= 1.46
famous_w90x_599_200_006758385 - PH 1 TS 0644281 A - 01/10/0668 01:00 - H:M:S=0085:30:39 AVG= 0.48 DLT= 0.80
famous_w90x_599_200_006758385 - PH 1 TS 0644671 A - 16/10/0668 01:00 - H:M:S=0085:33:44 AVG= 0.48 DLT= 1.26
famous_w90x_599_200_006758385 - PH 1 TS 0645061 A - 01/11/0668 01:00 - H:M:S=0085:36:48 AVG= 0.48 DLT= 0.70
famous_w90x_599_200_006758385 - PH 1 TS 0645451 A - 16/11/0668 01:00 - H:M:S=0085:39:50 AVG= 0.48 DLT= 1.30
Trickling yearly means for 668
Building file list for 668 in dataout -- 4 entries
Creating trickle file trickle_famous_w90x_599_200_006758385_1_668.zip for upload...
famous_w90x_599_200_006758385 - PH 1 TS 0645841 A - 01/12/0668 01:00 - H:M:S=0085:42:53 AVG= 0.48 DLT= 1.65
famous_w90x_599_200_006758385 - PH 1 TS 0646231 A - 16/12/0668 01:00 - H:M:S=0085:45:55 AVG= 0.48 DLT= 0.68
famous_w90x_599_200_006758385 - PH 1 TS 0646621 A - 01/01/0669 01:00 - H:M:S=0085:48:56 AVG= 0.48 DLT= 1.60
famous_w90x_599_200_006758385 - PH 1 TS 0647011 A - 16/01/0669 01:00 - H:M:S=0085:51:58 AVG= 0.48 DLT= 1.50
famous_w90x_599_200_006758385 - PH 1 TS 0647401 A - 01/02/0669 01:00 - H:M:S=0085:55:00 AVG= 0.48 DLT= 1.30
famous_w90x_599_200_006758385 - PH 1 TS 0647791 A - 16/02/0669 01:00 - H:M:S=0085:58:03 AVG= 0.48 DLT= 0.76
famous_w90x_599_200_006758385 - PH 1 TS 0648181 A - 01/03/0669 01:00 - H:M:S=0086:01:06 AVG= 0.48 DLT= 1.08
famous_w90x_599_200_006758385 - PH 1 TS 0648571 A - 16/03/0669 01:00 - H:M:S=0086:04:11 AVG= 0.48 DLT= 0.65
famous_w90x_599_200_006758385 - PH 1 TS 0648961 A - 01/04/0669 01:00 - H:M:S=0086:07:15 AVG= 0.48 DLT= 1.30
famous_w90x_599_200_006758385 - PH 1 TS 0649351 A - 16/04/0669 01:00 - H:M:S=0086:10:19 AVG= 0.48 DLT= 1.48
famous_w90x_599_200_006758385 - PH 1 TS 0649741 A - 01/05/0669 01:00 - H:M:S=0086:13:23 AVG= 0.48 DLT= 0.80
famous_w90x_599_200_006758385 - PH 1 TS 0650131 A - 16/05/0669 01:00 - H:M:S=0086:16:27 AVG= 0.48 DLT= 1.08
famous_w90x_599_200_006758385 - PH 1 TS 0650521 A - 01/06/0669 01:00 - H:M:S=0086:19:31 AVG= 0.48 DLT= 1.38
famous_w90x_599_200_006758385 - PH 1 TS 0650911 A - 16/06/0669 01:00 - H:M:S=0086:22:34 AVG= 0.48 DLT= 1.50
famous_w90x_599_200_006758385 - PH 1 TS 0651301 A - 01/07/0669 01:00 - H:M:S=0086:25:37 AVG= 0.48 DLT= 0.98
famous_w90x_599_200_006758385 - PH 1 TS 0651691 A - 16/07/0669 01:00 - H:M:S=0086:28:42 AVG= 0.48 DLT= 1.68
famous_w90x_599_200_006758385 - PH 1 TS 0652081 A - 01/08/0669 01:00 - H:M:S=0086:31:46 AVG= 0.48 DLT= 1.40
famous_w90x_599_200_006758385 - PH 1 TS 0652471 A - 16/08/0669 01:00 - H:M:S=0086:34:51 AVG= 0.48 DLT= 0.93
famous_w90x_599_200_006758385 - PH 1 TS 0652861 A - 01/09/0669 01:00 - H:M:S=0086:37:56 AVG= 0.48 DLT= 1.27
famous_w90x_599_200_006758385 - PH 1 TS 0653251 A - 16/09/0669 01:00 - H:M:S=0086:41:03 AVG= 0.48 DLT= 1.35
famous_w90x_599_200_006758385 - PH 1 TS 0653641 A - 01/10/0669 01:00 - H:M:S=0086:44:09 AVG= 0.48 DLT= 1.57
famous_w90x_599_200_006758385 - PH 1 TS 0654031 A - 16/10/0669 01:00 - H:M:S=0086:47:14 AVG= 0.48 DLT= 1.76
famous_w90x_599_200_006758385 - PH 1 TS 0654421 A - 01/11/0669 01:00 - H:M:S=0086:50:17 AVG= 0.48 DLT= 1.62
famous_w90x_599_200_006758385 - PH 1 TS 0654811 A - 16/11/0669 01:00 - H:M:S=0086:53:19 AVG= 0.48 DLT= 1.20
Trickling yearly means for 669
Building file list for 669 in dataout -- 4 entries
Creating trickle file trickle_famous_w90x_599_200_006758385_1_669.zip for upload...
Processing decadal means for 660 through 669
Queuing intermediate upload for CPDN/BOINC: cpdnout7.zip
famous_w90x_599_200_006758385 - PH 1 TS 0655591 A - 16/12/0669 01:00 - H:M:S=0086:59:23 AVG= 0.48 DLT= 0.70
famous_w90x_599_200_006758385 - PH 1 TS 0655981 A - 01/01/0670 01:00 - H:M:S=0087:02:26 AVG= 0.48 DLT= 0.89
famous_w90x_599_200_006758385 - PH 1 TS 0656371 A - 16/01/0670 01:00 - H:M:S=0087:05:28 AVG= 0.48 DLT= 1.36
famous_w90x_599_200_006758385 - PH 1 TS 0656761 A - 01/02/0670 01:00 - H:M:S=0087:08:29 AVG= 0.48 DLT= 1.10
famous_w90x_599_200_006758385 - PH 1 TS 0657151 A - 16/02/0670 01:00 - H:M:S=0087:11:31 AVG= 0.48 DLT= 1.75
famous_w90x_599_200_006758385 - PH 1 TS 0657541 A - 01/03/0670 01:00 - H:M:S=0087:14:34 AVG= 0.48 DLT= 1.73
famous_w90x_599_200_006758385 - PH 1 TS 0657931 A - 16/03/0670 01:00 - H:M:S=0087:17:38 AVG= 0.48 DLT= 1.09
famous_w90x_599_200_006758385 - PH 1 TS 0658321 A - 01/04/0670 01:00 - H:M:S=0087:20:43 AVG= 0.48 DLT= 0.83
famous_w90x_599_200_006758385 - PH 1 TS 0658711 A - 16/04/0670 01:00 - H:M:S=0087:23:47 AVG= 0.48 DLT= 0.96
famous_w90x_599_200_006758385 - PH 1 TS 0659101 A - 01/05/0670 01:00 - H:M:S=0087:26:50 AVG= 0.48 DLT= 1.80
famous_w90x_599_200_006758385 - PH 1 TS 0659491 A - 16/05/0670 01:00 - H:M:S=0087:29:54 AVG= 0.48 DLT= 1.40
famous_w90x_599_200_006758385 - PH 1 TS 0659881 A - 01/06/0670 01:00 - H:M:S=0087:32:58 AVG= 0.48 DLT= 1.50
famous_w90x_599_200_006758385 - PH 1 TS 0660271 A - 16/06/0670 01:00 - H:M:S=0087:36:02 AVG= 0.48 DLT= 0.91
famous_w90x_599_200_006758385 - PH 1 TS 0660661 A - 01/07/0670 01:00 - H:M:S=0087:39:05 AVG= 0.48 DLT= 0.90
famous_w90x_599_200_006758385 - PH 1 TS 0661051 A - 16/07/0670 01:00 - H:M:S=0087:42:08 AVG= 0.48 DLT= 1.60
famous_w90x_599_200_006758385 - PH 1 TS 0661441 A - 01/08/0670 01:00 - H:M:S=0087:45:13 AVG= 0.48 DLT= 0.90
famous_w90x_599_200_006758385 - PH 1 TS 0661831 A - 16/08/0670 01:00 - H:M:S=0087:48:18 AVG= 0.48 DLT= 1.73
famous_w90x_599_200_006758385 - PH 1 TS 0662221 A - 01/09/0670 01:00 - H:M:S=0087:51:23 AVG= 0.48 DLT= 1.11
famous_w90x_599_200_006758385 - PH 1 TS 0662611 A - 16/09/0670 01:00 - H:M:S=0087:54:29 AVG= 0.48 DLT= 1.60
famous_w90x_599_200_006758385 - PH 1 TS 0663001 A - 01/10/0670 01:00 - H:M:S=0087:57:35 AVG= 0.48 DLT= 0.96
famous_w90x_599_200_006758385 - PH 1 TS 0663391 A - 16/10/0670 01:00 - H:M:S=0088:00:39 AVG= 0.48 DLT= 0.70
famous_w90x_599_200_006758385 - PH 1 TS 0663781 A - 01/11/0670 01:00 - H:M:S=0088:03:42 AVG= 0.48 DLT= 1.09
famous_w90x_599_200_006758385 - PH 1 TS 0664171 A - 16/11/0670 01:00 - H:M:S=0088:06:45 AVG= 0.48 DLT= 1.48
Trickling yearly means for 670
Building file list for 670 in dataout -- 4 entries
Creating trickle file trickle_famous_w90x_599_200_006758385_1_670.zip for upload...
famous_w90x_599_200_006758385 - PH 1 TS 0664561 A - 01/12/0670 01:00 - H:M:S=0088:09:47 AVG= 0.48 DLT= 1.89
famous_w90x_599_200_006758385 - PH 1 TS 0664951 A - 16/12/0670 01:00 - H:M:S=0088:12:50 AVG= 0.48 DLT= 1.50
famous_w90x_599_200_006758385 - PH 1 TS 0665341 A - 01/01/0671 01:00 - H:M:S=0088:15:52 AVG= 0.48 DLT= 1.32
famous_w90x_599_200_006758385 - PH 1 TS 0665731 A - 16/01/0671 01:00 - H:M:S=0088:18:53 AVG= 0.48 DLT= 1.70
famous_w90x_599_200_006758385 - PH 1 TS 0666121 A - 01/02/0671 01:00 - H:M:S=0088:21:54 AVG= 0.48 DLT= 1.10
famous_w90x_599_200_006758385 - PH 1 TS 0666511 A - 16/02/0671 01:00 - H:M:S=0088:24:56 AVG= 0.48 DLT= 1.08
famous_w90x_599_200_006758385 - PH 1 TS 0666901 A - 01/03/0671 01:00 - H:M:S=0088:27:58 AVG= 0.48 DLT= 0.90
famous_w90x_599_200_006758385 - PH 1 TS 0667291 A - 16/03/0671 01:00 - H:M:S=0088:31:01 AVG= 0.48 DLT= 1.00
famous_w90x_599_200_006758385 - PH 1 TS 0667681 A - 01/04/0671 01:00 - H:M:S=0088:34:06 AVG= 0.48 DLT= 1.04
famous_w90x_599_200_006758385 - PH 1 TS 0668071 A - 16/04/0671 01:00 - H:M:S=0088:37:09 AVG= 0.48 DLT= 1.43
famous_w90x_599_200_006758385 - PH 1 TS 0668461 A - 01/05/0671 01:00 - H:M:S=0088:40:12 AVG= 0.48 DLT= 1.50
famous_w90x_599_200_006758385 - PH 1 TS 0668851 A - 16/05/0671 01:00 - H:M:S=0088:43:16 AVG= 0.48 DLT= 1.36
famous_w90x_599_200_006758385 - PH 1 TS 0669241 A - 01/06/0671 01:00 - H:M:S=0088:46:20 AVG= 0.48 DLT= 0.83
famous_w90x_599_200_006758385 - PH 1 TS 0669631 A - 16/06/0671 01:00 - H:M:S=0088:49:24 AVG= 0.48 DLT= 0.80
famous_w90x_599_200_006758385 - PH 1 TS 0670021 A - 01/07/0671 01:00 - H:M:S=0088:52:27 AVG= 0.48 DLT= 1.71
famous_w90x_599_200_006758385 - PH 1 TS 0670411 A - 16/07/0671 01:00 - H:M:S=0088:55:30 AVG= 0.48 DLT= 0.90
famous_w90x_599_200_006758385 - PH 1 TS 0670801 A - 01/08/0671 01:00 - H:M:S=0088:58:33 AVG= 0.48 DLT= 1.63
famous_w90x_599_200_006758385 - PH 1 TS 0671191 A - 16/08/0671 01:00 - H:M:S=0089:01:37 AVG= 0.48 DLT= 1.59
famous_w90x_599_200_006758385 - PH 1 TS 0671581 A - 01/09/0671 01:00 - H:M:S=0089:04:43 AVG= 0.48 DLT= 1.81
famous_w90x_599_200_006758385 - PH 1 TS 0671971 A - 16/09/0671 01:00 - H:M:S=0089:07:47 AVG= 0.48 DLT= 1.32
famous_w90x_599_200_006758385 - PH 1 TS 0672361 A - 01/10/0671 01:00 - H:M:S=0089:10:53 AVG= 0.48 DLT= 1.00
famous_w90x_599_200_006758385 - PH 1 TS 0672751 A - 16/10/0671 01:00 - H:M:S=0089:13:58 AVG= 0.48 DLT= 1.49
famous_w90x_599_200_006758385 - PH 1 TS 0673141 A - 01/11/0671 01:00 - H:M:S=0089:17:01 AVG= 0.48 DLT= 1.12
famous_w90x_599_200_006758385 - PH 1 TS 0673531 A - 16/11/0671 01:00 - H:M:S=0089:20:04 AVG= 0.48 DLT= 1.52
Trickling yearly means for 671
Building file list for 671 in dataout -- 4 entries
Creating trickle file trickle_famous_w90x_599_200_006758385_1_671.zip for upload...
famous_w90x_599_200_006758385 - PH 1 TS 0673921 A - 01/12/0671 01:00 - H:M:S=0089:23:06 AVG= 0.48 DLT= 1.27
famous_w90x_599_200_006758385 - PH 1 TS 0674311 A - 16/12/0671 01:00 - H:M:S=0089:26:07 AVG= 0.48 DLT= 0.96
famous_w90x_599_200_006758385 - PH 1 TS 0674701 A - 01/01/0672 01:00 - H:M:S=0089:29:09 AVG= 0.48 DLT= 1.48
famous_w90x_599_200_006758385 - PH 1 TS 0675091 A - 16/01/0672 01:00 - H:M:S=0089:32:11 AVG= 0.48 DLT= 1.10
famous_w90x_599_200_006758385 - PH 1 TS 0675481 A - 01/02/0672 01:00 - H:M:S=0089:35:14 AVG= 0.48 DLT= 1.35
famous_w90x_599_200_006758385 - PH 1 TS 0675871 A - 16/02/0672 01:00 - H:M:S=0089:38:16 AVG= 0.48 DLT= 0.90
famous_w90x_599_200_006758385 - PH 1 TS 0676261 A - 01/03/0672 01:00 - H:M:S=0089:41:19 AVG= 0.48 DLT= 1.58
famous_w90x_599_200_006758385 - PH 1 TS 0676651 A - 16/03/0672 01:00 - H:M:S=0089:44:22 AVG= 0.48 DLT= 0.89
famous_w90x_599_200_006758385 - PH 1 TS 0677041 A - 01/04/0672 01:00 - H:M:S=0089:47:27 AVG= 0.48 DLT= 1.61
famous_w90x_599_200_006758385 - PH 1 TS 0677431 A - 16/04/0672 01:00 - H:M:S=0089:50:31 AVG= 0.48 DLT= 0.80
famous_w90x_599_200_006758385 - PH 1 TS 0677821 A - 01/05/0672 01:00 - H:M:S=0089:53:35 AVG= 0.48 DLT= 1.43
famous_w90x_599_200_006758385 - PH 1 TS 0678211 A - 16/05/0672 01:00 - H:M:S=0089:56:38 AVG= 0.48 DLT= 1.89
famous_w90x_599_200_006758385 - PH 1 TS 0678601 A - 01/06/0672 01:00 - H:M:S=0089:59:42 AVG= 0.48 DLT= 1.05
famous_w90x_599_200_006758385 - PH 1 TS 0678991 A - 16/06/0672 01:00 - H:M:S=0090:02:45 AVG= 0.48 DLT= 1.51
famous_w90x_599_200_006758385 - PH 1 TS 0679381 A - 01/07/0672 01:00 - H:M:S=0090:05:49 AVG= 0.48 DLT= 1.50
famous_w90x_599_200_006758385 - PH 1 TS 0679771 A - 16/07/0672 01:00 - H:M:S=0090:08:52 AVG= 0.48 DLT= 1.72
famous_w90x_599_200_006758385 - PH 1 TS 0680161 A - 01/08/0672 01:00 - H:M:S=0090:11:56 AVG= 0.48 DLT= 0.89
famous_w90x_599_200_006758385 - PH 1 TS 0680551 A - 16/08/0672 01:00 - H:M:S=0090:15:01 AVG= 0.48 DLT= 0.86
famous_w90x_599_200_006758385 - PH 1 TS 0680941 A - 01/09/0672 01:00 - H:M:S=0090:18:06 AVG= 0.48 DLT= 1.33
famous_w90x_599_200_006758385 - PH 1 TS 0681331 A - 16/09/0672 01:00 - H:M:S=0090:21:12 AVG= 0.48 DLT= 0.80
famous_w90x_599_200_006758385 - PH 1 TS 0681721 A - 01/10/0672 01:00 - H:M:S=0090:24:17 AVG= 0.48 DLT= 1.70
famous_w90x_599_200_006758385 - PH 1 TS 0682111 A - 16/10/0672 01:00 - H:M:S=0090:27:22 AVG= 0.48 DLT= 1.50
famous_w90x_599_200_006758385 - PH 1 TS 0682501 A - 01/11/0672 01:00 - H:M:S=0090:30:25 AVG= 0.48 DLT= 0.90
famous_w90x_599_200_006758385 - PH 1 TS 0682891 A - 16/11/0672 01:00 - H:M:S=0090:33:28 AVG= 0.48 DLT= 1.30
Trickling yearly means for 672
Building file list for 672 in dataout -- 4 entries
Creating trickle file trickle_famous_w90x_599_200_006758385_1_672.zip for upload...
famous_w90x_599_200_006758385 - PH 1 TS 0683281 A - 01/12/0672 01:00 - H:M:S=0090:36:31 AVG= 0.48 DLT= 0.90
famous_w90x_599_200_006758385 - PH 1 TS 0683671 A - 16/12/0672 01:00 - H:M:S=0090:39:32 AVG= 0.48 DLT= 1.30
famous_w90x_599_200_006758385 - PH 1 TS 0684061 A - 01/01/0673 01:00 - H:M:S=0090:42:33 AVG= 0.48 DLT= 0.83
famous_w90x_599_200_006758385 - PH 1 TS 0684451 A - 16/01/0673 01:00 - H:M:S=0090:45:35 AVG= 0.48 DLT= 0.99
famous_w90x_599_200_006758385 - PH 1 TS 0684841 A - 01/02/0673 01:00 - H:M:S=0090:48:37 AVG= 0.48 DLT= 0.69
famous_w90x_599_200_006758385 - PH 1 TS 0685231 A - 16/02/0673 01:00 - H:M:S=0090:51:40 AVG= 0.48 DLT= 0.70
famous_w90x_599_200_006758385 - PH 1 TS 0685621 A - 01/03/0673 01:00 - H:M:S=0090:54:43 AVG= 0.48 DLT= 0.80
famous_w90x_599_200_006758385 - PH 1 TS 0686011 A - 16/03/0673 01:00 - H:M:S=0090:57:46 AVG= 0.48 DLT= 1.40
famous_w90x_599_200_006758385 - PH 1 TS 0686401 A - 01/04/0673 01:00 - H:M:S=0091:00:51 AVG= 0.48 DLT= 1.00
famous_w90x_599_200_006758385 - PH 1 TS 0686791 A - 16/04/0673 01:00 - H:M:S=0091:03:54 AVG= 0.48 DLT= 1.50
famous_w90x_599_200_006758385 - PH 1 TS 0687181 A - 01/05/0673 01:00 - H:M:S=0091:06:58 AVG= 0.48 DLT= 1.64
famous_w90x_599_200_006758385 - PH 1 TS 0687571 A - 16/05/0673 01:00 - H:M:S=0091:10:02 AVG= 0.48 DLT= 1.49
famous_w90x_599_200_006758385 - PH 1 TS 0687961 A - 01/06/0673 01:00 - H:M:S=0091:13:04 AVG= 0.48 DLT= 0.70
famous_w90x_599_200_006758385 - PH 1 TS 0688351 A - 16/06/0673 01:00 - H:M:S=0091:16:08 AVG= 0.48 DLT= 1.49
famous_w90x_599_200_006758385 - PH 1 TS 0688741 A - 01/07/0673 01:00 - H:M:S=0091:19:11 AVG= 0.48 DLT= 1.19
famous_w90x_599_200_006758385 - PH 1 TS 0689131 A - 16/07/0673 01:00 - H:M:S=0091:22:15 AVG= 0.48 DLT= 1.30
famous_w90x_599_200_006758385 - PH 1 TS 0689521 A - 01/08/0673 01:00 - H:M:S=0091:25:19 AVG= 0.48 DLT= 1.70
famous_w90x_599_200_006758385 - PH 1 TS 0689911 A - 16/08/0673 01:00 - H:M:S=0091:28:25 AVG= 0.48 DLT= 1.60
famous_w90x_599_200_006758385 - PH 1 TS 0690301 A - 01/09/0673 01:00 - H:M:S=0091:31:29 AVG= 0.48 DLT= 1.80
famous_w90x_599_200_006758385 - PH 1 TS 0690691 A - 16/09/0673 01:00 - H:M:S=0091:34:35 AVG= 0.48 DLT= 0.82
famous_w90x_599_200_006758385 - PH 1 TS 0691081 A - 01/10/0673 01:00 - H:M:S=0091:37:40 AVG= 0.48 DLT= 0.99
famous_w90x_599_200_006758385 - PH 1 TS 0691471 A - 16/10/0673 01:00 - H:M:S=0091:40:44 AVG= 0.48 DLT= 0.75
famous_w90x_599_200_006758385 - PH 1 TS 0691861 A - 01/11/0673 01:00 - H:M:S=0091:43:48 AVG= 0.48 DLT= 0.90
famous_w90x_599_200_006758385 - PH 1 TS 0692251 A - 16/11/0673 01:00 - H:M:S=0091:46:51 AVG= 0.48 DLT= 1.73
Trickling yearly means for 673
Building file list for 673 in dataout -- 4 entries
Creating trickle file trickle_famous_w90x_599_200_006758385_1_673.zip for upload...
famous_w90x_599_200_006758385 - PH 1 TS 0692641 A - 01/12/0673 01:00 - H:M:S=0091:49:53 AVG= 0.48 DLT= 1.69
famous_w90x_599_200_006758385 - PH 1 TS 0693031 A - 16/12/0673 01:00 - H:M:S=0091:52:55 AVG= 0.48 DLT= 1.50
famous_w90x_599_200_006758385 - PH 1 TS 0693421 A - 01/01/0674 01:00 - H:M:S=0091:55:58 AVG= 0.48 DLT= 1.09
famous_w90x_599_200_006758385 - PH 1 TS 0693811 A - 16/01/0674 01:00 - H:M:S=0091:58:59 AVG= 0.48 DLT= 1.72
famous_w90x_599_200_006758385 - PH 1 TS 0694201 A - 01/02/0674 01:00 - H:M:S=0092:02:01 AVG= 0.48 DLT= 1.60
famous_w90x_599_200_006758385 - PH 1 TS 0694591 A - 16/02/0674 01:00 - H:M:S=0092:05:04 AVG= 0.48 DLT= 1.24
famous_w90x_599_200_006758385 - PH 1 TS 0694981 A - 01/03/0674 01:00 - H:M:S=0092:08:07 AVG= 0.48 DLT= 1.11
famous_w90x_599_200_006758385 - PH 1 TS 0695371 A - 16/03/0674 01:00 - H:M:S=0092:11:11 AVG= 0.48 DLT= 1.18
famous_w90x_599_200_006758385 - PH 1 TS 0695761 A - 01/04/0674 01:00 - H:M:S=0092:14:16 AVG= 0.48 DLT= 1.52
famous_w90x_599_200_006758385 - PH 1 TS 0696151 A - 16/04/0674 01:00 - H:M:S=0092:17:20 AVG= 0.48 DLT= 1.70
famous_w90x_599_200_006758385 - PH 1 TS 0696541 A - 01/05/0674 01:00 - H:M:S=0092:20:23 AVG= 0.48 DLT= 1.50
famous_w90x_599_200_006758385 - PH 1 TS 0696931 A - 16/05/0674 01:00 - H:M:S=0092:23:26 AVG= 0.48 DLT= 1.50
famous_w90x_599_200_006758385 - PH 1 TS 0697321 A - 01/06/0674 01:00 - H:M:S=0092:26:30 AVG= 0.48 DLT= 1.30
famous_w90x_599_200_006758385 - PH 1 TS 0697711 A - 16/06/0674 01:00 - H:M:S=0092:29:32 AVG= 0.48 DLT= 1.76
famous_w90x_599_200_006758385 - PH 1 TS 0698101 A - 01/07/0674 01:00 - H:M:S=0092:32:36 AVG= 0.48 DLT= 1.68
famous_w90x_599_200_006758385 - PH 1 TS 0698491 A - 16/07/0674 01:00 - H:M:S=0092:35:39 AVG= 0.48 DLT= 1.60
famous_w90x_599_200_006758385 - PH 1 TS 0698881 A - 01/08/0674 01:00 - H:M:S=0092:38:44 AVG= 0.48 DLT= 1.39
famous_w90x_599_200_006758385 - PH 1 TS 0699271 A - 16/08/0674 01:00 - H:M:S=0092:41:49 AVG= 0.48 DLT= 0.74
famous_w90x_599_200_006758385 - PH 1 TS 0699661 A - 01/09/0674 01:00 - H:M:S=0092:44:53 AVG= 0.48 DLT= 1.70
famous_w90x_599_200_006758385 - PH 1 TS 0700051 A - 16/09/0674 01:00 - H:M:S=0092:47:58 AVG= 0.48 DLT= 1.35
famous_w90x_599_200_006758385 - PH 1 TS 0700441 A - 01/10/0674 01:00 - H:M:S=0092:51:04 AVG= 0.48 DLT= 0.90
famous_w90x_599_200_006758385 - PH 1 TS 0700831 A - 16/10/0674 01:00 - H:M:S=0092:54:08 AVG= 0.48 DLT= 1.20
famous_w90x_599_200_006758385 - PH 1 TS 0701221 A - 01/11/0674 01:00 - H:M:S=0092:57:11 AVG= 0.48 DLT= 1.29
famous_w90x_599_200_006758385 - PH 1 TS 0701611 A - 16/11/0674 01:00 - H:M:S=0093:00:13 AVG= 0.48 DLT= 0.77
Trickling yearly means for 674
Building file list for 674 in dataout -- 4 entries
Creating trickle file trickle_famous_w90x_599_200_006758385_1_674.zip for upload...
famous_w90x_599_200_006758385 - PH 1 TS 0702001 A - 01/12/0674 01:00 - H:M:S=0093:03:15 AVG= 0.48 DLT= 1.82
famous_w90x_599_200_006758385 - PH 1 TS 0702391 A - 16/12/0674 01:00 - H:M:S=0093:06:17 AVG= 0.48 DLT= 0.80
famous_w90x_599_200_006758385 - PH 1 TS 0702781 A - 01/01/0675 01:00 - H:M:S=0093:09:19 AVG= 0.48 DLT= 1.40
famous_w90x_599_200_006758385 - PH 1 TS 0703171 A - 16/01/0675 01:00 - H:M:S=0093:12:21 AVG= 0.48 DLT= 1.69
famous_w90x_599_200_006758385 - PH 1 TS 0703561 A - 01/02/0675 01:00 - H:M:S=0093:15:23 AVG= 0.48 DLT= 1.50
famous_w90x_599_200_006758385 - PH 1 TS 0703951 A - 16/02/0675 01:00 - H:M:S=0093:18:25 AVG= 0.48 DLT= 1.05
famous_w90x_599_200_006758385 - PH 1 TS 0704341 A - 01/03/0675 01:00 - H:M:S=0093:21:27 AVG= 0.48 DLT= 1.38
famous_w90x_599_200_006758385 - PH 1 TS 0704731 A - 16/03/0675 01:00 - H:M:S=0093:24:30 AVG= 0.48 DLT= 1.26
famous_w90x_599_200_006758385 - PH 1 TS 0705121 A - 01/04/0675 01:00 - H:M:S=0093:27:35 AVG= 0.48 DLT= 1.41
famous_w90x_599_200_006758385 - PH 1 TS 0705511 A - 16/04/0675 01:00 - H:M:S=0093:30:38 AVG= 0.48 DLT= 1.00
famous_w90x_599_200_006758385 - PH 1 TS 0705901 A - 01/05/0675 01:00 - H:M:S=0093:33:41 AVG= 0.48 DLT= 0.84
famous_w90x_599_200_006758385 - PH 1 TS 0706291 A - 16/05/0675 01:00 - H:M:S=0093:36:44 AVG= 0.48 DLT= 1.24
famous_w90x_599_200_006758385 - PH 1 TS 0706681 A - 01/06/0675 01:00 - H:M:S=0093:39:48 AVG= 0.48 DLT= 1.80
famous_w90x_599_200_006758385 - PH 1 TS 0707071 A - 16/06/0675 01:00 - H:M:S=0093:42:52 AVG= 0.48 DLT= 1.30
famous_w90x_599_200_006758385 - PH 1 TS 0707461 A - 01/07/0675 01:00 - H:M:S=0093:45:55 AVG= 0.48 DLT= 1.70
famous_w90x_599_200_006758385 - PH 1 TS 0707851 A - 16/07/0675 01:00 - H:M:S=0093:48:58 AVG= 0.48 DLT= 0.80
famous_w90x_599_200_006758385 - PH 1 TS 0708241 A - 01/08/0675 01:00 - H:M:S=0093:52:02 AVG= 0.48 DLT= 1.16
famous_w90x_599_200_006758385 - PH 1 TS 0708631 A - 16/08/0675 01:00 - H:M:S=0093:55:08 AVG= 0.48 DLT= 0.80
famous_w90x_599_200_006758385 - PH 1 TS 0709021 A - 01/09/0675 01:00 - H:M:S=0093:58:13 AVG= 0.48 DLT= 1.56
famous_w90x_599_200_006758385 - PH 1 TS 0709411 A - 16/09/0675 01:00 - H:M:S=0094:01:19 AVG= 0.48 DLT= 0.98
famous_w90x_599_200_006758385 - PH 1 TS 0709801 A - 01/10/0675 01:00 - H:M:S=0094:04:24 AVG= 0.48 DLT= 1.19
famous_w90x_599_200_006758385 - PH 1 TS 0710191 A - 16/10/0675 01:00 - H:M:S=0094:07:28 AVG= 0.48 DLT= 1.45
famous_w90x_599_200_006758385 - PH 1 TS 0710581 A - 01/11/0675 01:00 - H:M:S=0094:10:31 AVG= 0.48 DLT= 1.20
famous_w90x_599_200_006758385 - PH 1 TS 0710971 A - 16/11/0675 01:00 - H:M:S=0094:13:34 AVG= 0.48 DLT= 1.00
Trickling yearly means for 675
Building file list for 675 in dataout -- 4 entries
Creating trickle file trickle_famous_w90x_599_200_006758385_1_675.zip for upload...
famous_w90x_599_200_006758385 - PH 1 TS 0711361 A - 01/12/0675 01:00 - H:M:S=0094:16:36 AVG= 0.48 DLT= 1.88
famous_w90x_599_200_006758385 - PH 1 TS 0711751 A - 16/12/0675 01:00 - H:M:S=0094:19:37 AVG= 0.48 DLT= 1.48
famous_w90x_599_200_006758385 - PH 1 TS 0712141 A - 01/01/0676 01:00 - H:M:S=0094:22:39 AVG= 0.48 DLT= 1.60
famous_w90x_599_200_006758385 - PH 1 TS 0712531 A - 16/01/0676 01:00 - H:M:S=0094:25:42 AVG= 0.48 DLT= 0.76
famous_w90x_599_200_006758385 - PH 1 TS 0712921 A - 01/02/0676 01:00 - H:M:S=0094:28:45 AVG= 0.48 DLT= 1.28
famous_w90x_599_200_006758385 - PH 1 TS 0713311 A - 16/02/0676 01:00 - H:M:S=0094:31:47 AVG= 0.48 DLT= 1.26
famous_w90x_599_200_006758385 - PH 1 TS 0713701 A - 01/03/0676 01:00 - H:M:S=0094:34:49 AVG= 0.48 DLT= 0.97
famous_w90x_599_200_006758385 - PH 1 TS 0714091 A - 16/03/0676 01:00 - H:M:S=0094:37:54 AVG= 0.48 DLT= 1.09
famous_w90x_599_200_006758385 - PH 1 TS 0714481 A - 01/04/0676 01:00 - H:M:S=0094:40:58 AVG= 0.48 DLT= 0.68
famous_w90x_599_200_006758385 - PH 1 TS 0714871 A - 16/04/0676 01:00 - H:M:S=0094:44:03 AVG= 0.48 DLT= 1.74
famous_w90x_599_200_006758385 - PH 1 TS 0715261 A - 01/05/0676 01:00 - H:M:S=0094:47:06 AVG= 0.48 DLT= 0.89
famous_w90x_599_200_006758385 - PH 1 TS 0715651 A - 16/05/0676 01:00 - H:M:S=0094:50:09 AVG= 0.48 DLT= 1.82
famous_w90x_599_200_006758385 - PH 1 TS 0716041 A - 01/06/0676 01:00 - H:M:S=0094:53:13 AVG= 0.48 DLT= 1.80
famous_w90x_599_200_006758385 - PH 1 TS 0716431 A - 16/06/0676 01:00 - H:M:S=0094:56:16 AVG= 0.48 DLT= 1.09
famous_w90x_599_200_006758385 - PH 1 TS 0716821 A - 01/07/0676 01:00 - H:M:S=0094:59:19 AVG= 0.48 DLT= 1.32
famous_w90x_599_200_006758385 - PH 1 TS 0717211 A - 16/07/0676 01:00 - H:M:S=0095:02:22 AVG= 0.48 DLT= 1.56
famous_w90x_599_200_006758385 - PH 1 TS 0717601 A - 01/08/0676 01:00 - H:M:S=0095:05:26 AVG= 0.48 DLT= 1.39
famous_w90x_599_200_006758385 - PH 1 TS 0717991 A - 16/08/0676 01:00 - H:M:S=0095:08:31 AVG= 0.48 DLT= 1.37
famous_w90x_599_200_006758385 - PH 1 TS 0718381 A - 01/09/0676 01:00 - H:M:S=0095:11:37 AVG= 0.48 DLT= 1.70
famous_w90x_599_200_006758385 - PH 1 TS 0718771 A - 16/09/0676 01:00 - H:M:S=0095:14:44 AVG= 0.48 DLT= 0.79
famous_w90x_599_200_006758385 - PH 1 TS 0719161 A - 01/10/0676 01:00 - H:M:S=0095:17:50 AVG= 0.48 DLT= 0.85
famous_w90x_599_200_006758385 - PH 1 TS 0719551 A - 16/10/0676 01:00 - H:M:S=0095:20:55 AVG= 0.48 DLT= 0.79
famous_w90x_599_200_006758385 - PH 1 TS 0719941 A - 01/11/0676 01:00 - H:M:S=0095:23:58 AVG= 0.48 DLT= 1.80
famous_w90x_599_200_006758385 - PH 1 TS 0720331 A - 16/11/0676 01:00 - H:M:S=0095:27:01 AVG= 0.48 DLT= 1.40
Trickling yearly means for 676
Building file list for 676 in dataout -- 4 entries
Creating trickle file trickle_famous_w90x_599_200_006758385_1_676.zip for upload...
famous_w90x_599_200_006758385 - PH 1 TS 0720721 A - 01/12/0676 01:00 - H:M:S=0095:30:04 AVG= 0.48 DLT= 1.60
famous_w90x_599_200_006758385 - PH 1 TS 0721111 A - 16/12/0676 01:00 - H:M:S=0095:33:05 AVG= 0.48 DLT= 1.54
famous_w90x_599_200_006758385 - PH 1 TS 0721501 A - 01/01/0677 01:00 - H:M:S=0095:36:07 AVG= 0.48 DLT= 1.00
famous_w90x_599_200_006758385 - PH 1 TS 0721891 A - 16/01/0677 01:00 - H:M:S=0095:39:09 AVG= 0.48 DLT= 1.85
famous_w90x_599_200_006758385 - PH 1 TS 0722281 A - 01/02/0677 01:00 - H:M:S=0095:42:11 AVG= 0.48 DLT= 1.80
famous_w90x_599_200_006758385 - PH 1 TS 0722671 A - 16/02/0677 01:00 - H:M:S=0095:45:13 AVG= 0.48 DLT= 1.70
famous_w90x_599_200_006758385 - PH 1 TS 0723061 A - 01/03/0677 01:00 - H:M:S=0095:48:16 AVG= 0.48 DLT= 1.32
famous_w90x_599_200_006758385 - PH 1 TS 0723451 A - 16/03/0677 01:00 - H:M:S=0095:51:20 AVG= 0.48 DLT= 1.80
famous_w90x_599_200_006758385 - PH 1 TS 0723841 A - 01/04/0677 01:00 - H:M:S=0095:54:25 AVG= 0.48 DLT= 0.70
famous_w90x_599_200_006758385 - PH 1 TS 0724231 A - 16/04/0677 01:00 - H:M:S=0095:57:28 AVG= 0.48 DLT= 1.16
famous_w90x_599_200_006758385 - PH 1 TS 0724621 A - 01/05/0677 01:00 - H:M:S=0096:00:31 AVG= 0.48 DLT= 0.80
famous_w90x_599_200_006758385 - PH 1 TS 0725011 A - 16/05/0677 01:00 - H:M:S=0096:03:34 AVG= 0.48 DLT= 1.00
famous_w90x_599_200_006758385 - PH 1 TS 0725401 A - 01/06/0677 01:00 - H:M:S=0096:06:37 AVG= 0.48 DLT= 1.77
famous_w90x_599_200_006758385 - PH 1 TS 0725791 A - 16/06/0677 01:00 - H:M:S=0096:09:39 AVG= 0.48 DLT= 1.20
famous_w90x_599_200_006758385 - PH 1 TS 0726181 A - 01/07/0677 01:00 - H:M:S=0096:12:43 AVG= 0.48 DLT= 0.76

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  
Model restart required...
Preparing for restart attempt # 1...
Starting model ID famous_w90x_599_200_006758385   Phase 1
Program launched with process id # 15777
Climate model starting - use graphics to monitor progress.
Or visit the website to see the graphs for this run.
Getting pthread attributes - retval=0
Setting pthread size (62914560 bytes) - retval=0
Executing program /home/wilkinc/Boinc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu
Executing program /home/wilkinc/Boinc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu 127635 /home/wilkinc/Boinc/BOINC/slots/3

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  
Model restart required...
Preparing for restart attempt # 2...
Starting model ID famous_w90x_599_200_006758385   Phase 1
Program launched with process id # 15779
Climate model starting - use graphics to monitor progress.
Or visit the website to see the graphs for this run.
Getting pthread attributes - retval=0
Setting pthread size (62914560 bytes) - retval=0
Executing program /home/wilkinc/Boinc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu
Executing program /home/wilkinc/Boinc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu 127635 /home/wilkinc/Boinc/BOINC/slots/3

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  
Model restart required...
Preparing for restart attempt # 3...
Starting model ID famous_w90x_599_200_006758385   Phase 1
Program launched with process id # 15781
Climate model starting - use graphics to monitor progress.
Or visit the website to see the graphs for this run.
Getting pthread attributes - retval=0
Setting pthread size (62914560 bytes) - retval=0
Executing program /home/wilkinc/Boinc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu
Executing program /home/wilkinc/Boinc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu 127635 /home/wilkinc/Boinc/BOINC/slots/3

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  
Model restart required...
Preparing for restart attempt # 4...
Starting model ID famous_w90x_599_200_006758385   Phase 1
Program launched with process id # 15783
Climate model starting - use graphics to monitor progress.
Or visit the website to see the graphs for this run.
Getting pthread attributes - retval=0
Setting pthread size (62914560 bytes) - retval=0
Executing program /home/wilkinc/Boinc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu
Executing program /home/wilkinc/Boinc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu 127635 /home/wilkinc/Boinc/BOINC/slots/3

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  
Model restart required...
Preparing for restart attempt # 5...
Starting model ID famous_w90x_599_200_006758385   Phase 1
Program launched with process id # 15813
Climate model starting - use graphics to monitor progress.
Or visit the website to see the graphs for this run.
Getting pthread attributes - retval=0
Setting pthread size (62914560 bytes) - retval=0
Executing program /home/wilkinc/Boinc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu
Executing program /home/wilkinc/Boinc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu 127635 /home/wilkinc/Boinc/BOINC/slots/3

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  
Sorry, too many model crashes! :-(
Model restart required...
Sorry, too many model crashes! :-(
Cleaning up from the run...
 (9750): called boinc_finish
Detaching shared memory...

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
20 Nov 2010 00:24:57 852663 12023225 famous_w90x_599_200_006758385_1 720,746 343,804 0.4770
19 Nov 2010 23:10:18 852663 12023225 famous_w90x_599_200_006758385_1 711,386 339,396 0.4771
19 Nov 2010 21:51:36 852663 12023225 famous_w90x_599_200_006758385_1 702,026 334,995 0.4772
19 Nov 2010 20:33:14 852663 12023225 famous_w90x_599_200_006758385_1 692,666 330,593 0.4773
19 Nov 2010 19:15:46 852663 12023225 famous_w90x_599_200_006758385_1 683,306 326,191 0.4774
19 Nov 2010 18:02:37 852663 12023225 famous_w90x_599_200_006758385_1 673,946 321,786 0.4775
19 Nov 2010 16:45:00 852663 12023225 famous_w90x_599_200_006758385_1 664,586 317,387 0.4776
19 Nov 2010 15:27:10 852663 12023225 famous_w90x_599_200_006758385_1 655,226 312,981 0.4777
19 Nov 2010 14:08:59 852663 12023225 famous_w90x_599_200_006758385_1 645,866 308,573 0.4778
19 Nov 2010 12:53:42 852663 12023225 famous_w90x_599_200_006758385_1 636,506 304,167 0.4779
19 Nov 2010 11:36:15 852663 12023225 famous_w90x_599_200_006758385_1 627,146 299,770 0.4780
19 Nov 2010 10:17:59 852663 12023225 famous_w90x_599_200_006758385_1 617,786 295,369 0.4781
19 Nov 2010 09:01:15 852663 12023225 famous_w90x_599_200_006758385_1 608,426 290,968 0.4782
19 Nov 2010 07:41:41 852663 12023225 famous_w90x_599_200_006758385_1 599,066 286,476 0.4782
19 Nov 2010 06:30:05 852663 12023225 famous_w90x_599_200_006758385_1 589,706 282,075 0.4783
19 Nov 2010 06:23:19 852663 12023225 famous_w90x_599_200_006758385_1 580,346 277,687 0.4785
19 Nov 2010 06:23:18 852663 12023225 famous_w90x_599_200_006758385_1 570,986 273,302 0.4786
19 Nov 2010 06:23:18 852663 12023225 famous_w90x_599_200_006758385_1 561,626 268,904 0.4788
19 Nov 2010 06:23:19 852663 12023225 famous_w90x_599_200_006758385_1 552,266 264,503 0.4789
19 Nov 2010 00:03:48 852663 12023225 famous_w90x_599_200_006758385_1 542,906 260,099 0.4791


©2024 climateprediction.net