climateprediction.net home page
Combine for multi core
Combine for multi core
log in

Advanced search

Questions and Answers : Windows : Combine for multi core

Author Message
BRG
Send message
Joined: 24 Dec 16
Posts: 15
Credit: 1,470,720
RAC: 0
Message 55598 - Posted: 29 Jan 2017, 18:12:31 UTC

Hi all,

Are any of the projects multi core? By that I mean 1 work unit shared by x number of user set cores?

I have 24 cores so that gives me 24 work units, issue is with my slower core speeds this will take me weeks to fold (originally said 7 days once downloaded but its going to be more like 12+!), however, if I was to fold one of those work units using all 24 cores it would day a couple of days if that.

Are there any work units that allow this or is everything one work unit per core?

Overclocking isn't an option and nor is buying another machine!

Profile Dave Jackson
Send message
Joined: 15 May 09
Posts: 1793
Credit: 2,671,578
RAC: 898
Message 55599 - Posted: 29 Jan 2017, 18:34:39 UTC - in response to Message 55598.

Certainly none of the CPDN tasks are multi-core. The problem with multi-core for CPDN is that each climate calculation depends on the result of the previous one so there would be little to be gained by going multi-core. Don't even know if any time could be saved by doing different parts of calculations on different cores.

#wellbeyondmyprogramminglevel!

BRG
Send message
Joined: 24 Dec 16
Posts: 15
Credit: 1,470,720
RAC: 0
Message 55600 - Posted: 29 Jan 2017, 19:49:33 UTC - in response to Message 55599.

Certainly none of the CPDN tasks are multi-core. The problem with multi-core for CPDN is that each climate calculation depends on the result of the previous one so there would be little to be gained by going multi-core. Don't even know if any time could be saved by doing different parts of calculations on different cores.

#wellbeyondmyprogramminglevel!


May have to retire this pc for other task Dave, just lost 4+ days x 23 worth of worth due to errors, think CPDN maybe better on the faster newer systems as 2.9ghz just can not process it fast enough :(

Is there shorter duration tasks available for example working in a different field? ties up a cpu for say 1 or 2 days, 3 at a push!?!?!

Les Bayliss
Volunteer moderator
Send message
Joined: 5 Sep 04
Posts: 6408
Credit: 16,839,542
RAC: 21,887
Message 55601 - Posted: 29 Jan 2017, 20:10:24 UTC

2.9 ghz isn't all that bad. More likely to be other factors.
Can't see your computer, so can you post the error messages please.

****************

Multi-core was tested 4-5 years ago, but was so unstable at the boundary of the global/regional modelling that it didn't even get out of alpha testing into beta.

But the climate people are OK with the models taking a few weeks to process.
As long as they don't take 6 months. :)

Some ideas for improving the chances of a task surviving are here.

PS
I think that in the BOINC versions since then, the Suspend work if CPU usage is above setting needs to be 100%, not zero, to turn it off.

Profile JIM
Send message
Joined: 31 Dec 07
Posts: 983
Credit: 14,320,108
RAC: 19,627
Message 55604 - Posted: 30 Jan 2017, 1:45:55 UTC - in response to Message 55600.
Last modified: 30 Jan 2017, 1:46:40 UTC

I agree, your 2.9 GHz processor is most likely not whats causing your very high failure rate. I run CPDN on 3 2.6 GHz laptops and most finish successfully. How much memory to you have? Two GB’s per core is not excessive for this project.
P.S. if you are looking for a project that can use multiple cores per WU Milkyway is able to do that.
____________

BRG
Send message
Joined: 24 Dec 16
Posts: 15
Credit: 1,470,720
RAC: 0
Message 55608 - Posted: 30 Jan 2017, 14:55:29 UTC - in response to Message 55601.

2.9 ghz isn't all that bad. More likely to be other factors.
Can't see your computer, so can you post the error messages please.

****************

Multi-core was tested 4-5 years ago, but was so unstable at the boundary of the global/regional modelling that it didn't even get out of alpha testing into beta.

But the climate people are OK with the models taking a few weeks to process.
As long as they don't take 6 months. :)

Some ideas for improving the chances of a task surviving are here.

PS
I think that in the BOINC versions since then, the Suspend work if CPU usage is above setting needs to be 100%, not zero, to turn it off.



30/01/2017 10:41:37 AM | climateprediction.net | Sending scheduler request: To send trickle-up message. 30/01/2017 10:41:37 AM | climateprediction.net | Not requesting tasks: "no new tasks" requested via Manager 30/01/2017 10:41:40 AM | climateprediction.net | Started upload of wah2_eas50_a17w_199212_13_499_010835885_1_r1606541754_4.zip 30/01/2017 10:41:41 AM | climateprediction.net | Scheduler request completed 30/01/2017 10:48:00 AM | climateprediction.net | Finished upload of wah2_eas50_a17w_199212_13_499_010835885_1_r1606541754_4.zip


there is very little in the event log, I'm not sure if this is because other projects have forced it out?

BRG
Send message
Joined: 24 Dec 16
Posts: 15
Credit: 1,470,720
RAC: 0
Message 55610 - Posted: 30 Jan 2017, 15:00:55 UTC - in response to Message 55604.

I agree, your 2.9 GHz processor is most likely not whats causing your very high failure rate. I run CPDN on 3 2.6 GHz laptops and most finish successfully. How much memory to you have? Two GB’s per core is not excessive for this project.
P.S. if you are looking for a project that can use multiple cores per WU Milkyway is able to do that.


The cpus are 2.6 each and turbo to 2.9 but they are all unlocked and run at 2.9 all the time...

Ram, I have 32g of ecc ram.

I only work 3 projects, burp, has work as and when but currently top pc for that! LHCb and this... but once I got task for cpdn I stopped new tasks for lhcb.

Les Bayliss
Volunteer moderator
Send message
Joined: 5 Sep 04
Posts: 6408
Credit: 16,839,542
RAC: 21,887
Message 55614 - Posted: 30 Jan 2017, 20:05:52 UTC - in response to Message 55608.

The messages are also in stdoutdae.txt in the BOINC folder.

And in the individual pages for each tasks, under stderr out.

BRG
Send message
Joined: 24 Dec 16
Posts: 15
Credit: 1,470,720
RAC: 0
Message 55618 - Posted: 31 Jan 2017, 11:24:34 UTC - in response to Message 55614.

The messages are also in stdoutdae.txt in the BOINC folder.

And in the individual pages for each tasks, under stderr out.


Ah, didn't know that! I restarted pc last night so it looks like its cleared it out, there is max of 9 lines for climate predication in there.

Profile Dave Jackson
Send message
Joined: 15 May 09
Posts: 1793
Credit: 2,671,578
RAC: 898
Message 55620 - Posted: 31 Jan 2017, 12:00:00 UTC - in response to Message 55618.

Ah, didn't know that! I restarted pc last night so it looks like its cleared it out, there is max of 9 lines for climate predication in there.


And previous entries should be in stdoutdae.old unless you have reset things more than once to clear that out as well.

BRG
Send message
Joined: 24 Dec 16
Posts: 15
Credit: 1,470,720
RAC: 0
Message 55624 - Posted: 31 Jan 2017, 17:51:21 UTC - in response to Message 55620.
Last modified: 31 Jan 2017, 17:59:26 UTC

28-Jan-2017 16:55:03 [climateprediction.net] Sending scheduler request: To send trickle-up message. 28-Jan-2017 16:55:03 [climateprediction.net] Not requesting tasks: "no new tasks" requested via Manager 28-Jan-2017 16:55:06 [climateprediction.net] Scheduler request completed 28-Jan-2017 16:55:37 [climateprediction.net] Started upload of wah2_eas50_a0zk_199112_13_499_010835585_1_r196476645_2.zip 28-Jan-2017 17:02:20 [climateprediction.net] Finished upload of wah2_eas50_a0zk_199112_13_499_010835585_1_r196476645_2.zip 28-Jan-2017 17:53:10 [climateprediction.net] Started upload of wah2_eas50_a4bj_200912_13_499_010839904_0_r1587076778_2.zip 28-Jan-2017 17:55:46 [climateprediction.net] Sending scheduler request: To send trickle-up message. 28-Jan-2017 17:55:46 [climateprediction.net] Not requesting tasks: "no new tasks" requested via Manager 28-Jan-2017 17:55:50 [climateprediction.net] Scheduler request completed 28-Jan-2017 17:59:17 [climateprediction.net] Finished upload of wah2_eas50_a4bj_200912_13_499_010839904_0_r1587076778_2.zip 28-Jan-2017 18:11:44 [climateprediction.net] Started upload of wah2_eas50_a1lu_199412_13_499_010836387_0_r1646819255_2.zip 28-Jan-2017 18:17:53 [climateprediction.net] Finished upload of wah2_eas50_a1lu_199412_13_499_010836387_0_r1646819255_2.zip 28-Jan-2017 18:56:29 [climateprediction.net] Sending scheduler request: To send trickle-up message. 28-Jan-2017 18:56:29 [climateprediction.net] Not requesting tasks: "no new tasks" requested via Manager 28-Jan-2017 18:56:32 [climateprediction.net] Scheduler request completed 28-Jan-2017 19:39:49 [climateprediction.net] Started upload of wah2_eas50_a3sq_200612_13_499_010839227_0_r1023192574_2.zip 28-Jan-2017 19:45:57 [climateprediction.net] Finished upload of wah2_eas50_a3sq_200612_13_499_010839227_0_r1023192574_2.zip 28-Jan-2017 19:48:07 [climateprediction.net] Started upload of wah2_eas50_a1v9_199612_13_499_010836726_0_r210940876_2.zip 28-Jan-2017 19:54:18 [climateprediction.net] Finished upload of wah2_eas50_a1v9_199612_13_499_010836726_0_r210940876_2.zip 28-Jan-2017 19:57:13 [climateprediction.net] Sending scheduler request: To send trickle-up message. 28-Jan-2017 19:57:13 [climateprediction.net] Not requesting tasks: "no new tasks" requested via Manager 28-Jan-2017 19:57:16 [climateprediction.net] Scheduler request completed 28-Jan-2017 20:14:25 [climateprediction.net] Started upload of wah2_eas50_a17w_199212_13_499_010835885_1_r1606541754_2.zip 28-Jan-2017 20:23:13 [climateprediction.net] Error reported by file upload server: can't lock file wah2_eas50_a17w_199212_13_499_010835885_1_r1606541754_2.zip: Success locked by PID=27354 28-Jan-2017 20:23:13 [climateprediction.net] Temporarily failed upload of wah2_eas50_a17w_199212_13_499_010835885_1_r1606541754_2.zip: transient upload error 28-Jan-2017 20:23:13 [climateprediction.net] Backing off 00:03:01 on upload of wah2_eas50_a17w_199212_13_499_010835885_1_r1606541754_2.zip 28-Jan-2017 20:26:15 [climateprediction.net] Started upload of wah2_eas50_a17w_199212_13_499_010835885_1_r1606541754_2.zip 28-Jan-2017 20:30:01 [climateprediction.net] Finished upload of wah2_eas50_a17w_199212_13_499_010835885_1_r1606541754_2.zip 28-Jan-2017 20:57:52 [climateprediction.net] Sending scheduler request: To send trickle-up message. 28-Jan-2017 20:57:52 [climateprediction.net] Not requesting tasks: "no new tasks" requested via Manager 28-Jan-2017 20:57:55 [climateprediction.net] Scheduler request completed 28-Jan-2017 21:55:15 [climateprediction.net] Started upload of wah2_eas50_a4y1_201312_13_499_010840714_0_r421289772_1.zip 28-Jan-2017 21:58:34 [climateprediction.net] Sending scheduler request: To send trickle-up message. 28-Jan-2017 21:58:34 [climateprediction.net] Not requesting tasks: "no new tasks" requested via Manager 28-Jan-2017 21:58:38 [climateprediction.net] Scheduler request completed 28-Jan-2017 22:01:23 [climateprediction.net] Finished upload of wah2_eas50_a4y1_201312_13_499_010840714_0_r421289772_1.zip 29-Jan-2017 01:23:50 [climateprediction.net] Sending scheduler request: To send trickle-up message. 29-Jan-2017 01:23:50 [climateprediction.net] Not requesting tasks: "no new tasks" requested via Manager 29-Jan-2017 01:23:53 [climateprediction.net] Scheduler request completed 29-Jan-2017 01:24:06 [climateprediction.net] Started upload of wah2_eas50_a0b7_198712_13_499_010834708_0_r334907102_3.zip 29-Jan-2017 01:30:06 [climateprediction.net] Finished upload of wah2_eas50_a0b7_198712_13_499_010834708_0_r334907102_3.zip 29-Jan-2017 01:31:21 [climateprediction.net] Started upload of wah2_eas50_a0ai_198712_13_499_010834683_0_r1989751714_3.zip 29-Jan-2017 01:37:20 [climateprediction.net] Finished upload of wah2_eas50_a0ai_198712_13_499_010834683_0_r1989751714_3.zip 29-Jan-2017 01:51:25 [climateprediction.net] Started upload of wah2_eas50_a242_199712_13_499_010837043_0_r1044285999_3.zip 29-Jan-2017 01:57:23 [climateprediction.net] Finished upload of wah2_eas50_a242_199712_13_499_010837043_0_r1044285999_3.zip 29-Jan-2017 02:24:32 [climateprediction.net] Sending scheduler request: To send trickle-up message. 29-Jan-2017 02:24:32 [climateprediction.net] Not requesting tasks: "no new tasks" requested via Manager 29-Jan-2017 02:24:35 [climateprediction.net] Scheduler request completed 29-Jan-2017 03:14:33 [climateprediction.net] Started upload of wah2_eas50_a2vf_200112_13_499_010838028_0_r355118105_3.zip 29-Jan-2017 03:20:30 [climateprediction.net] Finished upload of wah2_eas50_a2vf_200112_13_499_010838028_0_r355118105_3.zip 29-Jan-2017 03:25:15 [climateprediction.net] Sending scheduler request: To send trickle-up message. 29-Jan-2017 03:25:15 [climateprediction.net] Not requesting tasks: "no new tasks" requested via Manager 29-Jan-2017 03:25:18 [climateprediction.net] Scheduler request completed 29-Jan-2017 03:40:49 [climateprediction.net] Started upload of wah2_eas50_a2lh_200012_13_499_010837670_0_r1356820796_3.zip 29-Jan-2017 03:46:49 [climateprediction.net] Finished upload of wah2_eas50_a2lh_200012_13_499_010837670_0_r1356820796_3.zip 29-Jan-2017 04:03:43 [climateprediction.net] Started upload of wah2_eas50_a2zr_200212_13_499_010838184_0_r831112727_2.zip 29-Jan-2017 04:09:44 [climateprediction.net] Finished upload of wah2_eas50_a2zr_200212_13_499_010838184_0_r831112727_2.zip 29-Jan-2017 04:25:55 [climateprediction.net] Sending scheduler request: To send trickle-up message. 29-Jan-2017 04:25:55 [climateprediction.net] Not requesting tasks: "no new tasks" requested via Manager 29-Jan-2017 04:25:59 [climateprediction.net] Scheduler request completed 29-Jan-2017 04:50:35 [climateprediction.net] Started upload of wah2_eas50_a4ql_201112_13_499_010840446_0_r517252223_3.zip 29-Jan-2017 04:56:34 [climateprediction.net] Finished upload of wah2_eas50_a4ql_201112_13_499_010840446_0_r517252223_3.zip 29-Jan-2017 05:14:39 [climateprediction.net] Started upload of wah2_eas50_a10l_199112_13_499_010835622_0_r2004546266_3.zip 29-Jan-2017 05:20:37 [climateprediction.net] Finished upload of wah2_eas50_a10l_199112_13_499_010835622_0_r2004546266_3.zip 29-Jan-2017 05:26:40 [climateprediction.net] Sending scheduler request: To send trickle-up message. 29-Jan-2017 05:26:40 [climateprediction.net] Not requesting tasks: "no new tasks" requested via Manager 29-Jan-2017 05:26:43 [climateprediction.net] Scheduler request completed 29-Jan-2017 05:37:45 [climateprediction.net] Started upload of wah2_eas50_a1hl_199412_13_499_010836234_0_r664695825_3.zip 29-Jan-2017 05:43:44 [climateprediction.net] Finished upload of wah2_eas50_a1hl_199412_13_499_010836234_0_r664695825_3.zip 29-Jan-2017 06:27:20 [climateprediction.net] Sending scheduler request: To send trickle-up message. 29-Jan-2017 06:27:20 [climateprediction.net] Not requesting tasks: "no new tasks" requested via Manager 29-Jan-2017 06:27:23 [climateprediction.net] Scheduler request completed 29-Jan-2017 06:44:02 [BURP] Sending scheduler request: To fetch work. 29-Jan-2017 06:44:02 [BURP] Requesting new tasks for CPU and NVIDIA GPU 29-Jan-2017 06:44:04 [BURP] Scheduler request completed: got 0 new tasks 29-Jan-2017 06:44:04 [BURP] Project has no tasks available 29-Jan-2017 07:48:05 [climateprediction.net] Sending scheduler request: To send trickle-up message. 29-Jan-2017 07:48:05 [climateprediction.net] Not requesting tasks: "no new tasks" requested via Manager 29-Jan-2017 07:48:08 [climateprediction.net] Scheduler request completed 29-Jan-2017 07:48:25 [climateprediction.net] Started upload of wah2_eas50_a4vf_201212_13_499_010840620_1_r1466254938_3.zip 29-Jan-2017 07:54:24 [climateprediction.net] Finished upload of wah2_eas50_a4vf_201212_13_499_010840620_1_r1466254938_3.zip 29-Jan-2017 08:26:23 [climateprediction.net] Started upload of wah2_eas50_a3bg_200412_13_499_010838605_0_r1337051767_3.zip 29-Jan-2017 08:27:19 [climateprediction.net] Started upload of wah2_eas50_a1ot_199512_13_499_010836494_0_r892364341_2.zip 29-Jan-2017 08:37:21 [climateprediction.net] Finished upload of wah2_eas50_a3bg_200412_13_499_010838605_0_r1337051767_3.zip 29-Jan-2017 08:38:14 [climateprediction.net] Finished upload of wah2_eas50_a1ot_199512_13_499_010836494_0_r892364341_2.zip 29-Jan-2017 08:48:46 [climateprediction.net] Sending scheduler request: To send trickle-up message. 29-Jan-2017 08:48:46 [climateprediction.net] Not requesting tasks: "no new tasks" requested via Manager 29-Jan-2017 08:48:49 [climateprediction.net] Scheduler request completed 29-Jan-2017 12:38:15 [climateprediction.net] Sending scheduler request: To send trickle-up message. 29-Jan-2017 12:38:15 [climateprediction.net] Not requesting tasks: "no new tasks" requested via Manager 29-Jan-2017 12:38:18 [climateprediction.net] Scheduler request completed 29-Jan-2017 12:38:32 [climateprediction.net] Started upload of wah2_eas50_a0az_198712_13_499_010834700_0_r1717651186_2.zip 29-Jan-2017 12:44:35 [climateprediction.net] Finished upload of wah2_eas50_a0az_198712_13_499_010834700_0_r1717651186_2.zip 29-Jan-2017 12:47:17 [climateprediction.net] Started upload of wah2_eas50_a4vx_201212_13_499_010840638_0_r361045950_3.zip 29-Jan-2017 12:53:22 [climateprediction.net] Finished upload of wah2_eas50_a4vx_201212_13_499_010840638_0_r361045950_3.zip 29-Jan-2017 13:35:07 [climateprediction.net] Started upload of wah2_eas50_a4xr_201312_13_499_010840704_0_r1970444616_3.zip 29-Jan-2017 13:38:58 [climateprediction.net] Sending scheduler request: To send trickle-up message. 29-Jan-2017 13:38:58 [climateprediction.net] Not requesting tasks: "no new tasks" requested via Manager 29-Jan-2017 13:39:02 [climateprediction.net] Scheduler request completed 29-Jan-2017 13:41:04 [climateprediction.net] Finished upload of wah2_eas50_a4xr_201312_13_499_010840704_0_r1970444616_3.zip 29-Jan-2017 16:53:54 [climateprediction.net] task wah2_afr50_l11a_200712_13_500_010842703_0 aborted by user 29-Jan-2017 16:53:54 [climateprediction.net] task wah2_afr50_l10k_200612_13_500_010842677_0 aborted by user 29-Jan-2017 16:53:54 [climateprediction.net] task wah2_afr50_l0s8_200112_13_500_010842377_0 aborted by user 29-Jan-2017 16:53:54 [climateprediction.net] task wah2_afr50_l0ju_199612_13_500_010842075_0 aborted by user 29-Jan-2017 16:53:55 [climateprediction.net] task wah2_afr50_l0fq_199412_13_500_010841927_0 aborted by user 29-Jan-2017 16:53:55 [climateprediction.net] task wah2_afr50_l0sz_200212_13_500_010842404_0 aborted by user 29-Jan-2017 16:53:55 [climateprediction.net] task wah2_eas50_a4hp_201012_13_499_010840126_0 aborted by user 29-Jan-2017 16:53:55 [climateprediction.net] task wah2_eas50_a3ka_200512_13_499_010838923_0 aborted by user 29-Jan-2017 16:53:55 [climateprediction.net] task wah2_eas50_a4mg_201112_13_499_010840297_0 aborted by user 29-Jan-2017 16:53:55 [climateprediction.net] Computation for task wah2_eas50_a4hp_201012_13_499_010840126_0 finished 29-Jan-2017 16:53:55 [climateprediction.net] Computation for task wah2_eas50_a3ka_200512_13_499_010838923_0 finished 29-Jan-2017 16:53:55 [climateprediction.net] Computation for task wah2_eas50_a4mg_201112_13_499_010840297_0 finished 29-Jan-2017 16:53:55 [climateprediction.net] Computation for task wah2_afr50_l10k_200612_13_500_010842677_0 finished 29-Jan-2017 16:53:55 [climateprediction.net] Computation for task wah2_afr50_l0s8_200112_13_500_010842377_0 finished 29-Jan-2017 16:53:55 [climateprediction.net] Computation for task wah2_afr50_l0fq_199412_13_500_010841927_0 finished 29-Jan-2017 16:53:55 [climateprediction.net] Computation for task wah2_afr50_l11a_200712_13_500_010842703_0 finished 29-Jan-2017 16:53:55 [climateprediction.net] Computation for task wah2_afr50_l0ju_199612_13_500_010842075_0 finished 29-Jan-2017 16:53:55 [climateprediction.net] Computation for task wah2_afr50_l0sz_200212_13_500_010842404_0 finished 29-Jan-2017 16:57:21 [climateprediction.net] update requested by user 29-Jan-2017 16:57:23 [climateprediction.net] Sending scheduler request: Requested by user. 29-Jan-2017 16:57:23 [climateprediction.net] Reporting 9 completed tasks 29-Jan-2017 16:57:23 [climateprediction.net] Not requesting tasks: "no new tasks" requested via Manager 29-Jan-2017 16:57:23 [BURP] update requested by user 29-Jan-2017 16:57:26 [climateprediction.net] Scheduler request completed 29-Jan-2017 16:57:32 [BURP] Sending scheduler request: Requested by user. 29-Jan-2017 16:57:32 [BURP] Requesting new tasks for CPU and NVIDIA GPU 29-Jan-2017 16:57:32 [climateprediction.net] task wah2_eas50_a0b7_198712_13_499_010834708_0 suspended by user 29-Jan-2017 16:57:32 [climateprediction.net] task wah2_eas50_a0ai_198712_13_499_010834683_0 suspended by user 29-Jan-2017 16:57:32 [climateprediction.net] task wah2_eas50_a2lh_200012_13_499_010837670_0 suspended by user 29-Jan-2017 16:57:32 [climateprediction.net] task wah2_eas50_a2vf_200112_13_499_010838028_0 suspended by user 29-Jan-2017 16:57:32 [climateprediction.net] task wah2_eas50_a242_199712_13_499_010837043_0 suspended by user 29-Jan-2017 16:57:32 [climateprediction.net] task wah2_eas50_a1hl_199412_13_499_010836234_0 suspended by user 29-Jan-2017 16:57:32 [climateprediction.net] task wah2_eas50_a4ql_201112_13_499_010840446_0 suspended by user 29-Jan-2017 16:57:32 [climateprediction.net] task wah2_eas50_a4vf_201212_13_499_010840620_1 suspended by user 29-Jan-2017 16:57:32 [climateprediction.net] task wah2_eas50_a10l_199112_13_499_010835622_0 suspended by user 29-Jan-2017 16:57:33 [climateprediction.net] task wah2_eas50_a3bg_200412_13_499_010838605_0 suspended by user 29-Jan-2017 16:57:37 [BURP] Sch 29-Jan-2017 19:31:18 [climateprediction.net] Computation for task wah2_eas50_a1lu_199412_13_499_010836387_0 finished 29-Jan-2017 19:31:18 [climateprediction.net] Output file wah2_eas50_a1lu_199412_13_499_010836387_0_r1646819255_3.zip for task wah2_eas50_a1lu_199412_13_499_010836387_0 absent 29-Jan-2017 19:31:18 [climateprediction.net] Output file wah2_eas50_a1lu_199412_13_499_010836387_0_r1646819255_4.zip for task wah2_eas50_a1lu_199412_13_499_010836387_0 absent 29-Jan-2017 19:31:18 [climateprediction.net] Output file wah2_eas50_a1lu_199412_13_499_010836387_0_r1646819255_5.zip for task wah2_eas50_a1lu_199412_13_499_010836387_0 absent 29-Jan-2017 19:31:18 [climateprediction.net] Output file wah2_eas50_a1lu_199412_13_499_010836387_0_r1646819255_6.zip for task wah2_eas50_a1lu_199412_13_499_010836387_0 absent 29-Jan-2017 19:31:18 [climateprediction.net] Output file wah2_eas50_a1lu_199412_13_499_010836387_0_r1646819255_7.zip for task wah2_eas50_a1lu_199412_13_499_010836387_0 absent 29-Jan-2017 19:31:18 [climateprediction.net] Output file wah2_eas50_a1lu_199412_13_499_010836387_0_r1646819255_8.zip for task wah2_eas50_a1lu_199412_13_499_010836387_0 absent 29-Jan-2017 19:31:18 [climateprediction.net] Output file wah2_eas50_a1lu_199412_13_499_010836387_0_r1646819255_9.zip for task wah2_eas50_a1lu_199412_13_499_010836387_0 absent 29-Jan-2017 19:31:18 [climateprediction.net] Output file wah2_eas50_a1lu_199412_13_499_010836387_0_r1646819255_10.zip for task wah2_eas50_a1lu_199412_13_499_010836387_0 absent 29-Jan-2017 19:31:18 [climateprediction.net] Output file wah2_eas50_a1lu_199412_13_499_010836387_0_r1646819255_11.zip for task wah2_eas50_a1lu_199412_13_499_010836387_0 absent 29-Jan-2017 19:31:18 [climateprediction.net] Output file wah2_eas50_a1lu_199412_13_499_010836387_0_r1646819255_12.zip for task wah2_eas50_a1lu_199412_13_499_010836387_0 absent 29-Jan-2017 19:31:18 [climateprediction.net] Output file wah2_eas50_a1lu_199412_13_499_010836387_0_r1646819255_13.zip for task wah2_eas50_a1lu_199412_13_499_010836387_0 absent 29-Jan-2017 19:31:18 [climateprediction.net] Output file wah2_eas50_a1lu_199412_13_499_010836387_0_r1646819255_restart.zip for task wah2_eas50_a1lu_199412_13_499_010836387_0 absent 29-Jan-2017 19:31:18 [climateprediction.net] Output file wah2_eas50_a1lu_199412_13_499_010836387_0_r1646819255_out.zip for task wah2_eas50_a1lu_199412_13_499_010836387_0 absent 29-Jan-2017 19:31:18 [climateprediction.net] Computation for task wah2_eas50_a1v9_199612_13_499_010836726_0 finished 29-Jan-2017 19:31:18 [climateprediction.net] Output file wah2_eas50_a1v9_199612_13_499_010836726_0_r210940876_3.zip for task wah2_eas50_a1v9_199612_13_499_010836726_0 absent 29-Jan-2017 19:31:18 [climateprediction.net] Output file wah2_eas50_a1v9_199612_13_499_010836726_0_r210940876_4.zip for task wah2_eas50_a1v9_199612_13_499_010836726_0 absent 29-Jan-2017 19:31:18 [climateprediction.net] Output file wah2_eas50_a1v9_199612_13_499_010836726_0_r210940876_5.zip for task wah2_eas50_a1v9_199612_13_499_010836726_0 absent 29-Jan-2017 19:31:18 [climateprediction.net] Output file wah2_eas50_a1v9_199612_13_499_010836726_0_r210940876_6.zip for task wah2_eas50_a1v9_199612_13_499_010836726_0 absent 29-Jan-2017 19:31:18 [climateprediction.net] Output file wah2_eas50_a1v9_199612_13_499_010836726_0_r210940876_7.zip for task wah2_eas50_a1v9_199612_13_499_010836726_0 absent 29-Jan-2017 19:31:18 [climateprediction.net] Output file wah2_eas50_a1v9_199612_13_499_010836726_0_r210940876_8.zip for task wah2_eas50_a1v9_199612_13_499_010836726_0 absent 29-Jan-2017 19:31:18 [climateprediction.net] Output file wah2_eas50_a1v9_199612_13_499_010836726_0_r210940876_9.zip for task wah2_eas50_a1v9_199612_13_499_010836726_0 absent 29-Jan-2017 19:31:18 [climateprediction.net] Output file wah2_eas50_a1v9_199612_13_499_010836726_0_r210940876_10.zip for task wah2_eas50_a1v9_199612_13_499_010836726_0 absent 29-Jan-2017 19:31:18 [climateprediction.net] Output file wah2_eas50_a1v9_199612_13_499_010836726_0_r210940876_11.zip for task wah2_eas50_a1v9_199612_13_499_010836726_0 absent 29-Jan-2017 19:31:18 [climateprediction.net] Output file wah2_eas50_a1v9_199612_13_499_010836726_0_r210940876_12.zip for task wah2_eas50_a1v9_199612_13_499_010836726_0 absent 29-Jan-2017 19:31:18 [climateprediction.net] Output file wah2_eas50_a1v9_199612_13_499_010836726_0_r210940876_13.zip for task wah2_eas50_a1v9_199612_13_499_010836726_0 absent 29-Jan-2017 19:31:18 [climateprediction.net] Output file wah2_eas50_a1v9_199612_13_499_010836726_0_r210940876_restart.zip for task wah2_eas50_a1v9_199612_13_499_010836726_0 absent 29-Jan-2017 19:31:18 [climateprediction.net] Output file wah2_eas50_a1v9_199612_13_499_010836726_0_r210940876_out.zip for task wah2_eas50_a1v9_199612_13_499_010836726_0 absent 29-Jan-2017 19:31:18 [climateprediction.net] Computation for task wah2_eas50_a0zk_199112_13_499_010835585_1 finished 29-Jan-2017 19:31:18 [climateprediction.net] Output file wah2_eas50_a0zk_199112_13_499_010835585_1_r196476645_3.zip for task wah2_eas50_a0zk_199112_13_499_010835585_1 absent 29-Jan-2017 19:31:18 [climateprediction.net] Output file wah2_eas50_a0zk_199112_13_499_010835585_1_r196476645_4.zip for task wah2_eas50_a0zk_199112_13_499_010835585_1 absent 29-Jan-2017 19:31:18 [climateprediction.net] Output file wah2_eas50_a0zk_199112_13_499_010835585_1_r196476645_5.zip for task wah2_eas50_a0zk_199112_13_499_010835585_1 absent 29-Jan-2017 19:31:18 [climateprediction.net] Output file wah2_eas50_a0zk_199112_13_499_010835585_1_r196476645_6.zip for task wah2_eas50_a0zk_199112_13_499_010835585_1 absent 29-Jan-2017 19:31:18 [climateprediction.net] Output file wah2_eas50_a0zk_199112_13_499_010835585_1_r196476645_7.zip for task wah2_eas50_a0zk_199112_13_499_010835585_1 absent 29-Jan-2017 19:31:18 [climateprediction.net] Output file wah2_eas50_a0zk_199112_13_499_010835585_1_r196476645_8.zip for task wah2_eas50_a0zk_199112_13_499_010835585_1 absent 29-Jan-2017 19:31:18 [climateprediction.net] Output file wah2_eas50_a0zk_199112_13_499_010835585_1_r196476645_9.zip for task wah2_eas50_a0zk_199112_13_499_010835585_1 absent 29-Jan-2017 19:31:18 [climateprediction.net] Output file wah2_eas50_a0zk_199112_13_499_010835585_1_r196476645_10.zip for task wah2_eas50_a0zk_199112_13_499_010835585_1 absent 29-Jan-2017 19:31:18 [climateprediction.net] Output file wah2_eas50_a0zk_199112_13_499_010835585_1_r196476645_11.zip for task wah2_eas50_a0zk_199112_13_499_010835585_1 absent 29-Jan-2017 19:31:18 [climateprediction.net] Output file wah2_eas50_a0zk_199112_13_499_010835585_1_r196476645_12.zip for task wah2_eas50_a0zk_199112_13_499_010835585_1 absent 29-Jan-2017 19:31:18 [climateprediction.net] Output file wah2_eas50_a0zk_199112_13_499_010835585_1_r196476645_13.zip for task wah2_eas50_a0zk_199112_13_499_010835585_1 absent 29-Jan-2017 19:31:18 [climateprediction.net] Output file wah2_eas50_a0zk_199112_13_499_010835585_1_r196476645_restart.zip for task wah2_eas50_a0zk_199112_13_499_010835585_1 absent 29-Jan-2017 19:31:18 [climateprediction.net] Output file wah2_eas50_a0zk_199112_13_499_010835585_1_r196476645_out.zip for task wah2_eas50_a0zk_199112_13_499_010835585_1 absent 29-Jan-2017 19:31:18 [climateprediction.net] Computation for task wah2_eas50_a4vx_201212_13_499_010840638_0 finished 29-Jan-2017 19:31:18 [climateprediction.net] Output file wah2_eas50_a4vx_201212_13_499_010840638_0_r361045950_4.zip for task wah2_eas50_a4vx_201212_13_499_010840638_0 absent 29-Jan-2017 19:31:18 [climateprediction.net] Output file wah2_eas50_a4vx_201212_13_499_010840638_0_r361045950_5.zip for task wah2_eas50_a4vx_201212_13_499_010840638_0 absent 29-Jan-2017 19:31:18 [climateprediction.net] Output file wah2_eas50_a4vx_201212_13_499_010840638_0_r361045950_6.zip for task wah2_eas50_a4vx_201212_13_499_010840638_0 absent 29-Jan-2017 19:31:18 [climateprediction.net] Output file wah2_eas50_a4vx_201212_13_499_010840638_0_r361045950_7.zip for task wah2_eas50_a4vx_201212_13_499_010840638_0 absent 29-Jan-2017 19:31:18 [climateprediction.net] Output file wah2_eas50_a4vx_201212_13_499_010840638_0_r361045950_8.zip for task wah2_eas50_a4vx_201212_13_499_010840638_0 absent 29-Jan-2017 19:31:18 [climateprediction.net] Output file wah2_eas50_a4vx_201212_13_499_010840638_0_r361045950_9.zip for task wah2_eas50_a4vx_201212_13_499_010840638_0 absent 29-Jan-2017 19:31:18 [climateprediction.net] Output file wah2_eas50_a4vx_201212_13_499_010840638_0_r361045950_10.zip for task wah2_eas50_a4vx_201212_13_499_010840638_0 absent 29-Jan-2017 19:31:18 [climateprediction.net] Output file wah2_eas50_a4vx_201212_13_499_010840638_0_r361045950_11.zip for task wah2_eas50_a4vx_201212_13_499_010840638_0 absent 29-Jan-2017 19:31:18 [climateprediction.net] Output file wah2_eas50_a4vx_201212_13_499_010840638_0_r361045950_12.zip for task wah2_eas50_a4vx_201212_13_499_010840638_0 absent 29-Jan-2017 19:31:18 [climateprediction.net] Output file wah2_eas50_a4vx_201212_13_499_010840638_0_r361045950_13.zip for task wah2_eas50_a4vx_201212_13_499_010840638_0 absent 29-Jan-2017 19:31:18 [climateprediction.net] Output file wah2_eas50_a4vx_201212_13_499_010840638_0_r361045950_restart.zip for task wah2_eas50_a4vx_201212_13_499_010840638_0 absent 29-Jan-2017 19:31:18 [climateprediction.net] Output file wah2_eas50_a4vx_201212_13_499_010840638_0_r361045950_out.zip for task wah2_eas50_a4vx_201212_13_499_010840638_0 absent 29-Jan-2017 19:31:18 [climateprediction.net] Computation for task wah2_eas50_a4bj_200912_13_499_010839904_0 finished 29-Jan-2017 19:31:18 [climateprediction.net] Output file wah2_eas50_a4bj_200912_13_499_010839904_0_r1587076778_3.zip for task wah2_eas50_a4bj_200912_13_499_010839904_0 absent 29-Jan-2017 19:31:18 [climateprediction.net] Output file wah2_eas50_a4bj_200912_13_499_010839904_0_r1587076778_4.zip for task wah2_eas50_a4bj_200912_13_499_010839904_0 absent 29-Jan-2017 19:31:18 [climateprediction.net] Output file wah2_eas50_a4bj_200912_13_499_010839904_0_r1587076778_5.zip for task wah2_eas50_a4bj_200912_13_499_010839904_0 absent 29-Jan-2017 19:31:18 [climateprediction.net] Output file wah2_eas50_a4bj_200912_13_499_010839904_0_r1587076778_6.zip for task wah2_eas50_a4bj_200912_13_499_010839904_0 absent 29-Jan-2017 19:31:18 [climateprediction.net] Output file wah2_eas50_a4bj_200912_13_499_010839904_0_r1587076778_7.zip for task wah2_eas50_a4bj_200912_13_499_010839904_0 absent 29-Jan-2017 19:31:18 [climateprediction.net] Output file wah2_eas50_a4bj_200912_13_499_010839904_0_r1587076778_8.zip for task wah2_eas50_a4bj_200912_13_499_010839904_0 absent 29-Jan-2017 19:31:18 [climateprediction.net] Output file wah2_eas50_a4bj_200912_13_499_010839904_0_r1587076778_9.zip for task wah2_eas50_a4bj_200912_13_499_010839904_0 absent 29-Jan-2017 19:31:18 [climateprediction.net] Output file wah2_eas50_a4bj_200912_13_499_010839904_0_r1587076778_10.zip for task wah2_eas50_a4bj_200912_13_499_010839904_0 absent 29-Jan-2017 19:31:18 [climateprediction.net] Output file wah2_eas50_a4bj_200912_13_499_010839904_0_r1587076778_11.zip for task wah2_eas50_a4bj_200912_13_499_010839904_0 absent 29-Jan-2017 19:31:18 [climateprediction.net] Output file wah2_eas50_a4bj_200912_13_499_010839904_0_r1587076778_12.zip for task wah2_eas50_a4bj_200912_13_499_010839904_0 absent 29-Jan-2017 19:31:18 [climateprediction.net] Output file wah2_eas50_a4bj_200912_13_499_010839904_0_r1587076778_13.zip for task wah2_eas50_a4bj_200912_13_499_010839904_0 absent 29-Jan-2017 19:31:18 [climateprediction.net] Output file wah2_eas50_a4bj_200912_13_499_010839904_0_r1587076778_restart.zip for task wah2_eas50_a4bj_200912_13_499_010839904_0 absent 29-Jan-2017 19:31:18 [climateprediction.net] Output file wah2_eas50_a4bj_200912_13_499_010839904_0_r1587076778_out.zip for task wah2_eas50_a4bj_200912_13_499_010839904_0 absent 29-Jan-2017 19:31:18 [climateprediction.net] Computation for task wah2_eas50_a3sq_200612_13_499_010839227_0 finished 29-Jan-2017 19:31:18 [climateprediction.net] Output file wah2_eas50_a3sq_200612_13_499_010839227_0_r1023192574_3.zip for task wah2_eas50_a3sq_200612_13_499_010839227_0 absent 29-Jan-2017 19:31:18 [climateprediction.net] Output file wah2_eas50_a3sq_200612_13_499_010839227_0_r1023192574_4.zip for task wah2_eas50_a3sq_200612_13_499_010839227_0 absent 29-Jan-2017 19:31:18 [climateprediction.net] Output file wah2_eas50_a3sq_200612_13_499_010839227_0_r1023192574_5.zip for task wah2_eas50_a3sq_200612_13_499_010839227_0 absent 29-Jan-2017 19:31:18 [climateprediction.net] Output file wah2_eas50_a3sq_200612_13_499_010839227_0_r1023192574_6.zip for task wah2_eas50_a3sq_200612_13_499_010839227_0 absent 29-Jan-2017 19:31:18 [climateprediction.net] Output file wah2_eas50_a3sq_200612_13_499_010839227_0_r1023192574_7.zip for task wah2_eas50_a3sq_200612_13_499_010839227_0 absent 29-Jan-2017 19:31:18 [climateprediction.net] Output file wah2_eas50_a3sq_200612_13_499_010839227_0_r1023192574_8.zip for task wah2_eas50_a3sq_200612_13_499_010839227_0 absent 29-Jan-2017 19:31:18 [climateprediction.net] Output file wah2_eas50_a3sq_200612_13_499_010839227_0_r1023192574_9.zip for task wah2_eas50_a3sq_200612_13_499_010839227_0 absent 29-Jan-2017 19:31:18 [climateprediction.net] Output file wah2_eas50_a3sq_200612_13_499_010839227_0_r1023192574_10.zip for task wah2_eas50_a3sq_200612_13_499_010839227_0 absent 29-Jan-2017 19:31:18 [climateprediction.net] Output file wah2_eas50_a3sq_200612_13_499_010839227_0_r1023192574_11.zip for task wah2_eas50_a3sq_200612_13_499_010839227_0 absent 29-Jan-2017 19:31:18 [climateprediction.net] Output file wah2_eas50_a3sq_200612_13_499_010839227_0_r1023192574_12.zip for task wah2_eas50_a3sq_200612_13_499_010839227_0 absent 29-Jan-2017 19:31:18 [climateprediction.net] Output file wah2_eas50_a3sq_200612_13_499_010839227_0_r1023192574_13.zip for task wah2_eas50_a3sq_200612_13_499_010839227_0 absent 29-Jan-2017 19:31:18 [climateprediction.net] Output file wah2_eas50_a3sq_200612_13_499_010839227_0_r1023192574_restart.zip for task wah2_eas50_a3sq_200612_13_499_010839227_0 absent 29-Jan-2017 19:31:18 [climateprediction.net] Output file wah2_eas50_a3sq_200612_13_499_010839227_0_r1023192574_out.zip for task wah2_eas50_a3sq_200612_13_499_010839227_0 absent 29-Jan-2017 19:31:18 [climateprediction.net] Computation for task wah2_eas50_a4xr_201312_13_499_010840704_0 finished 29-Jan-2017 19:31:18 [climateprediction.net] Output file wah2_eas50_a4xr_201312_13_499_010840704_0_r1970444616_4.zip for task wah2_eas50_a4xr_201312_13_499_010840704_0 absent 29-Jan-2017 19:31:18 [climateprediction.net] Output file wah2_eas50_a4xr_201312_13_499_010840704_0_r1970444616_5.zip for task wah2_eas50_a4xr_201312_13_499_010840704_0 absent 29-Jan-2017 19:31:18 [climateprediction.net] Output file wah2_eas50_a4xr_201312_13_499_010840704_0_r1970444616_6.zip for task wah2_eas50_a4xr_201312_13_499_010840704_0 absent 29-Jan-2017 19:31:18 [climateprediction.net] Output file wah2_eas50_a4xr_201312_13_499_010840704_0_r1970444616_7.zip for task wah2_eas50_a4xr_201312_13_499_010840704_0 absent 29-Jan-2017 19:31:18 [climateprediction.net] Output file wah2_eas50_a4xr_201312_13_499_010840704_0_r1970444616_8.zip for task wah2_eas50_a4xr_201312_13_499_010840704_0 absent 29-Jan-2017 19:31:18 [climateprediction.net] Output file wah2_eas50_a4xr_201312_13_499_010840704_0_r1970444616_9.zip for task wah2_eas50_a4xr_201312_13_499_010840704_0 absent 29-Jan-2017 19:31:18 [climateprediction.net] Output file wah2_eas50_a4xr_201312_13_499_010840704_0_r1970444616_10.zip for task wah2_eas50_a4xr_201312_13_499_010840704_0 absent 29-Jan-2017 19:31:18 [climateprediction.net] Output file wah2_eas50_a4xr_201312_13_499_010840704_0_r1970444616_11.zip for task wah2_eas50_a4xr_201312_13_499_010840704_0 absent 29-Jan-2017 19:31:18 [climateprediction.net] Output file wah2_eas50_a4xr_201312_13_499_010840704_0_r1970444616_12.zip for task wah2_eas50_a4xr_201312_13_499_010840704_0 absent 29-Jan-2017 19:31:18 [climateprediction.net] Output file wah2_eas50_a4xr_201312_13_499_010840704_0_r1970444616_13.zip for task wah2_eas50_a4xr_201312_13_499_010840704_0 absent 29-Jan-2017 19:31:18 [climateprediction.net] Output file wah2_eas50_a4xr_201312_13_499_010840704_0_r1970444616_restart.zip for task wah2_eas50_a4xr_201312_13_499_010840704_0 absent 29-Jan-2017 19:31:18 [climateprediction.net] Output file wah2_eas50_a4xr_201312_13_499_010840704_0_r1970444616_out.zip for task wah2_eas50_a4xr_201312_13_499_010840704_0 absent 29-Jan-2017 19:31:18 [climateprediction.net] Computation for task wah2_eas50_a2zr_200212_13_499_010838184_0 finished 29-Jan-2017 19:31:18 [climateprediction.net] Output file wah2_eas50_a2zr_200212_13_499_010838184_0_r831112727_3.zip for task wah2_eas50_a2zr_200212_13_499_010838184_0 absent 29-Jan-2017 19:31:18 [climateprediction.net] Output file wah2_eas50_a2zr_200212_13_499_010838184_0_r831112727_4.zip for task wah2_eas50_a2zr_200212_13_499_010838184_0 absent 29-Jan-2017 19:31:18 [climateprediction.net] Output file wah2_eas50_a2zr_200212_13_499_010838184_0_r831112727_5.zip for task wah2_eas50_a2zr_200212_13_499_010838184_0 absent 29-Jan-2017 19:31:18 [climateprediction.net] Output file wah2_eas50_a2zr_200212_13_499_010838184_0_r831112727_6.zip for task wah2_eas50_a2zr_200212_13_499_010838184_0 absent 29-Jan-2017 19:31:18 [climateprediction.net] Output file wah2_eas50_a2zr_200212_13_499_010838184_0_r831112727_7.zip for task wah2_eas50_a2zr_200212_13_499_010838184_0 absent 29-Jan-2017 19:31:18 [climateprediction.net] Output file wah2_eas50_a2zr_200212_13_499_010838184_0_r831112727_8.zip for task wah2_eas50_a2zr_200212_13_499_010838184_0 absent 29-Jan-2017 19:31:18 [climateprediction.net] Output file wah2_eas50_a2zr_200212_13_499_010838184_0_r831112727_9.zip for task wah2_eas50_a2zr_200212_13_499_010838184_0 absent 29-Jan-2017 19:31:18 [climateprediction.net] Output file wah2_eas50_a2zr_200212_13_499_010838184_0_r831112727_10.zip for task wah2_eas50_a2zr_200212_13_499_010838184_0 absent 29-Jan-2017 19:31:18 [climateprediction.net] Output file wah2_eas50_a2zr_200212_13_499_010838184_0_r831112727_11.zip for task wah2_eas50_a2zr_200212_13_499_010838184_0 absent 29-Jan-2017 19:31:18 [climateprediction.net] Output file wah2_eas50_a2zr_200212_13_499_010838184_0_r831112727_12.zip for task wah2_eas50_a2zr_200212_13_499_010838184_0 absent 29-Jan-2017 19:31:18 [climateprediction.net] Output file wah2_eas50_a2zr_200212_13_499_010838184_0_r831112727_13.zip for task wah2_eas50_a2zr_200212_13_499_010838184_0 absent 29-Jan-2017 19:31:18 [climateprediction.net] Output file wah2_eas50_a2zr_200212_13_499_010838184_0_r831112727_restart.zip for task wah2_eas50_a2zr_200212_13_499_010838184_0 absent 29-Jan-2017 19:31:18 [climateprediction.net] Output file wah2_eas50_a2zr_200212_13_499_010838184_0_r831112727_out.zip for task wah2_eas50_a2zr_200212_13_499_010838184_0 absent 29-Jan-2017 19:31:18 [climateprediction.net] Computation for task wah2_eas50_a1ot_199512_13_499_010836494_0 finished 29-Jan-2017 19:31:18 [climateprediction.net] Output file wah2_eas50_a1ot_199512_13_499_010836494_0_r892364341_3.zip for task wah2_eas50_a1ot_199512_13_499_010836494_0 absent 29-Jan-2017 19:31:18 [climateprediction.net] Output file wah2_eas50_a1ot_199512_13_499_010836494_0_r892364341_4.zip for task wah2_eas50_a1ot_199512_13_499_010836494_0 absent 29-Jan-2017 19:31:18 [climateprediction.net] Output file wah2_eas50_a1ot_199512_13_499_010836494_0_r892364341_5.zip for task wah2_eas50_a1ot_199512_13_499_010836494_0 absent 29-Jan-2017 19:31:18 [climateprediction.net] Output file wah2_eas50_a1ot_199512_13_499_010836494_0_r892364341_6.zip for task wah2_eas50_a1ot_199512_13_499_010836494_0 absent 29-Jan-2017 19:31:18 [climateprediction.net] Output file wah2_eas50_a1ot_199512_13_499_010836494_0_r892364341_7.zip for task wah2_eas50_a1ot_199512_13_499_010836494_0 absent 29-Jan-2017 19:31:18 [climateprediction.net] Output file wah2_eas50_a1ot_199512_13_499_010836494_0_r892364341_8.zip for task wah2_eas50_a1ot_199512_13_499_010836494_0 absent 29-Jan-2017 19:31:18 [climateprediction.net] Output file wah2_eas50_a1ot_199512_13_499_010836494_0_r892364341_9.zip for task wah2_eas50_a1ot_199512_13_499_010836494_0 absent 29-Jan-2017 19:31:18 [climateprediction.net] Output file wah2_eas50_a1ot_199512_13_499_010836494_0_r892364341_10.zip for task wah2_eas50_a1ot_199512_13_499_010836494_0 absent 29-Jan-2017 19:31:18 [climateprediction.net] Output file wah2_eas50_a1ot_199512_13_499_010836494_0_r892364341_11.zip for task wah2_eas50_a1ot_199512_13_499_010836494_0 absent 29-Jan-2017 19:31:18 [climateprediction.net] Output file wah2_eas50_a1ot_199512_13_499_010836494_0_r892364341_12.zip for task wah2_eas50_a1ot_199512_13_499_010836494_0 absent 29-Jan-2017 19:31:18 [climateprediction.net] Output file wah2_eas50_a1ot_199512_13_499_010836494_0_r892364341_13.zip for task wah2_eas50_a1ot_199512_13_499_010836494_0 absent 29-Jan-2017 19:31:18 [climateprediction.net] Output file wah2_eas50_a1ot_199512_13_499_010836494_0_r892364341_restart.zip for task wah2_eas50_a1ot_199512_13_499_010836494_0 absent 29-Jan-2017 19:31:18 [climateprediction.net] Output file wah2_eas50_a1ot_199512_13_499_010836494_0_r892364341_out.zip for task wah2_eas50_a1ot_199512_13_499_010836494_0 absent 29-Jan-2017 19:31:18 [climateprediction.net] Computation for task wah2_eas50_a0az_198712_13_499_010834700_0 finished 29-Jan-2017 19:31:18 [climateprediction.net] Output file wah2_eas50_a0az_198712_13_499_010834700_0_r1717651186_3.zip for task wah2_eas50_a0az_198712_13_499_010834700_0 absent 29-Jan-2017 19:31:18 [climateprediction.net] Output file wah2_eas50_a0az_198712_13_499_010834700_0_r1717651186_4.zip for task wah2_eas50_a0az_198712_13_499_010834700_0 absent 29-Jan-2017 19:31:18 [climateprediction.net] Output file wah2_eas50_a0az_198712_13_499_010834700_0_r1717651186_5.zip for task wah2_eas50_a0az_198712_13_499_010834700_0 absent 29-Jan-2017 19:31:18 [climateprediction.net] Output file wah2_eas50_a0az_198712_13_499_010834700_0_r1717651186_6.zip for task wah2_eas50_a0az_198712_13_499_010834700_0 absent 29-Jan-2017 19:31:18 [climateprediction.net] Output file wah2_eas50_a0az_198712_13_499_010834700_0_r1717651186_7.zip for task wah2_eas50_a0az_198712_13_499_010834700_0 absent 29-Jan-2017 19:31:18 [climateprediction.net] Output file wah2_eas50_a0az_198712_13_499_010834700_0_r1717651186_8.zip for task wah2_eas50_a0az_198712_13_499_010834700_0 absent 29-Jan-2017 19:31:18 [climateprediction.net] Output file wah2_eas50_a0az_198712_13_499_010834700_0_r1717651186_9.zip for task wah2_eas50_a0az_198712_13_499_010834700_0 absent 29-Jan-2017 19:31:18 [climateprediction.net] Output file wah2_eas50_a0az_198712_13_499_010834700_0_r1717651186_10.zip for task wah2_eas50_a0az_198712_13_499_010834700_0 absent 29-Jan-2017 19:31:18 [climateprediction.net] Output file wah2_eas50_a0az_198712_13_499_010834700_0_r1717651186_11.zip for task wah2_eas50_a0az_198712_13_499_010834700_0 absent 29-Jan-2017 19:31:18 [climateprediction.net] Output file wah2_eas50_a0az_198712_13_499_010834700_0_r1717651186_12.zip for task wah2_eas50_a0az_198712_13_499_010834700_0 absent 29-Jan-2017 19:31:18 [climateprediction.net] Output file wah2_eas50_a0az_198712_13_499_010834700_0_r1717651186_13.zip for task wah2_eas50_a0az_198712_13_499_010834700_0 absent 29-Jan-2017 19:31:18 [climateprediction.net] Output file wah2_eas50_a0az_198712_13_499_010834700_0_r1717651186_restart.zip for task wah2_eas50_a0az_198712_13_499_010834700_0 absent 29-Jan-2017 19:31:18 [climateprediction.net] Output file wah2_eas50_a0az_198712_13_499_010834700_0_r1717651186_out.zip for task wah2_eas50_a0az_198712_13_499_010834700_0 absent 29-Jan-2017 19:31:18 [climateprediction.net] Computation for task wah2_eas50_a2c6_199812_13_499_010837335_0 finished 29-Jan-2017 19:31:18 [climateprediction.net] Output file wah2_eas50_a2c6_199812_13_499_010837335_0_r581780030_1.zip for task wah2_eas50_a2c6_199812_13_499_010837335_0 absent 29-Jan-2017 19:31:18 [climateprediction.net] Output file wah2_eas50_a2c6_199812_13_499_010837335_0_r581780030_2.zip for task wah2_eas50_a2c6_199812_13_499_010837335_0 absent 29-Jan-2017 19:31:18 [climateprediction.net] Output file wah2_eas50_a2c6_199812_13_499_010837335_0_r581780030_3.zip for task wah2_eas50_a2c6_199812_13_499_010837335_0 absent 29-Jan-2017 19:31:18 [climateprediction.net] Output file wah2_eas50_a2c6_199812_13_499_010837335_0_r581780030_4.zip for task wah2_eas50_a2c6_199812_13_499_010837335_0 absent 29-Jan-2017 19:31:18 [climateprediction.net] Output file wah2_eas50_a2c6_199812_13_499_010837335_0_r581780030_5.zip for task wah2_eas50_a2c6_199812_13_499_010837335_0 absent 29-Jan-2017 19:31:18 [climateprediction.net] Output file wah2_eas50_a2c6_199812_13_499_010837335_0_r581780030_6.zip for task wah2_eas50_a2c6_199812_13_499_010837335_0 absent 29-Jan-2017 19:31:18 [climateprediction.net] Output file wah2_eas50_a2c6_199812_13_499_010837335_0_r581780030_7.zip for task wah2_eas50_a2c6_199812_13_499_010837335_0 absent 29-Jan-2017 19:31:18 [climateprediction.net] Output file wah2_eas50_a2c6_199812_13_499_010837335_0_r581780030_8.zip for task wah2_eas50_a2c6_199812_13_499_010837335_0 absent 29-Jan-2017 19:31:18 [climateprediction.net] Output file wah2_eas50_a2c6_199812_13_499_010837335_0_r581780030_9.zip for task wah2_eas50_a2c6_199812_13_499_010837335_0 absent 29-Jan-2017 19:31:18 [climateprediction.net] Output file wah2_eas50_a2c6_199812_13_499_010837335_0_r581780030_10.zip for task wah2_eas50_a2c6_199812_13_499_010837335_0 absent 29-Jan-2017 19:31:18 [climateprediction.net] Output file wah2_eas50_a2c6_199812_13_499_010837335_0_r581780030_11.zip for task wah2_eas50_a2c6_199812_13_499_010837335_0 absent 29-Jan-2017 19:31:18 [climateprediction.net] Output file wah2_eas50_a2c6_199812_13_499_010837335_0_r581780030_12.zip for task wah2_eas50_a2c6_199812_13_499_010837335_0 absent 29-Jan-2017 19:31:18 [climateprediction.net] Output file wah2_eas50_a2c6_199812_13_499_010837335_0_r581780030_13.zip for task wah2_eas50_a2c6_199812_13_499_010837335_0 absent 29-Jan-2017 19:31:18 [climateprediction.net] Output file wah2_eas50_a2c6_199812_13_499_010837335_0_r581780030_restart.zip for task wah2_eas50_a2c6_199812_13_499_010837335_0 absent 29-Jan-2017 19:31:18 [climateprediction.net] Output file wah2_eas50_a2c6_199812_13_499_010837335_0_r581780030_out.zip for task wah2_eas50_a2c6_199812_13_499_010837335_0 absent 29-Jan-2017 19:31:18 [climateprediction.net] Computation for task wah2_eas50_a4vq_201212_13_499_010840631_0 finished 29-Jan-2017 19:31:18 [climateprediction.net] Output file wah2_eas50_a4vq_201212_13_499_010840631_0_r1396856624_1.zip for task wah2_eas50_a4vq_201212_13_499_010840631_0 absent 29-Jan-2017 19:31:18 [climateprediction.net] Output file wah2_eas50_a4vq_201212_13_499_010840631_0_r1396856624_2.zip for task wah2_eas50_a4vq_201212_13_499_010840631_0 absent 29-Jan-2017 19:31:18 [climateprediction.net] Output file wah2_eas50_a4vq_201212_13_499_010840631_0_r1396856624_3.zip for task wah2_eas50_a4vq_201212_13_499_010840631_0 absent 29-Jan-2017 19:31:18 [climateprediction.net] Output file wah2_eas50_a4vq_201212_13_499_010840631_0_r1396856624_4.zip for task wah2_eas50_a4vq_201212_13_499_010840631_0 absent 29-Jan-2017 19:31:18 [climateprediction.net] Output file wah2_eas50_a4vq_201212_13_499_010840631_0_r1396856624_5.zip for task wah2_eas50_a4vq_201212_13_499_010840631_0 absent 29-Jan-2017 19:31:18 [climateprediction.net] Output file wah2_eas50_a4vq_201212_13_499_010840631_0_r1396856624_6.zip for task wah2_eas50_a4vq_201212_13_499_010840631_0 absent 29-Jan-2017 19:31:18 [climateprediction.net] Output file wah2_eas50_a4vq_201212_13_499_010840631_0_r1396856624_7.zip for task wah2_eas50_a4vq_201212_13_499_010840631_0 absent 29-Jan-2017 19:31:18 [climateprediction.net] Output file wah2_eas50_a4vq_201212_13_499_010840631_0_r1396856624_8.zip for task wah2_eas50_a4vq_201212_13_499_010840631_0 absent 29-Jan-2017 19:31:18 [climateprediction.net] Output file wah2_eas50_a4vq_201212_13_499_010840631_0_r1396856624_9.zip for task wah2_eas50_a4vq_201212_13_499_010840631_0 absent 29-Jan-2017 19:31:18 [climateprediction.net] Output file wah2_eas50_a4vq_201212_13_499_010840631_0_r1396856624_10.zip for task wah2_eas50_a4vq_201212_13_499_010840631_0 absent 29-Jan-2017 19:31:18 [climateprediction.net] Output file wah2_eas50_a4vq_201212_13_499_010840631_0_r1396856624_11.zip for task wah2_eas50_a4vq_201212_13_499_010840631_0 absent 29-Jan-2017 19:31:18 [climateprediction.net] Output file wah2_eas50_a4vq_201212_13_499_010840631_0_r1396856624_12.zip for task wah2_eas50_a4vq_201212_13_499_010840631_0 absent 29-Jan-2017 19:31:18 [climateprediction.net] Output file wah2_eas50_a4vq_201212_13_499_010840631_0_r1396856624_13.zip for task wah2_eas50_a4vq_201212_13_499_010840631_0 absent 29-Jan-2017 19:31:18 [climateprediction.net] Output file wah2_eas50_a4vq_201212_13_499_010840631_0_r1396856624_restart.zip for task wah2_eas50_a4vq_201212_13_499_010840631_0 absent 29-Jan-2017 19:31:18 [climateprediction.net] Output file wah2_eas50_a4vq_201212_13_499_010840631_0_r1396856624_out.zip for task wah2_eas50_a4vq_201212_13_499_010840631_0 absent 29-Jan-2017 19:31:20 [climateprediction.net] Computation for task wah2_eas50_a4y1_201312_13_499_010840714_0 finished 29-Jan-2017 19:31:20 [climateprediction.net] Output file wah2_eas50_a4y1_201312_13_499_010840714_0_r421289772_2.zip for task wah2_eas50_a4y1_201312_13_499_010840714_0 absent 29-Jan-2017 19:31:20 [climateprediction.net] Output file wah2_eas50_a4y1_201312_13_499_010840714_0_r421289772_3.zip for task wah2_eas50_a4y1_201312_13_499_010840714_0 absent 29-Jan-2017 19:31:20 [climateprediction.net] Output file wah2_eas50_a4y1_201312_13_499_010840714_0_r421289772_4.zip for task wah2_eas50_a4y1_201312_13_499_010840714_0 absent 29-Jan-2017 19:31:20 [climateprediction.net] Output file wah2_eas50_a4y1_201312_13_499_010840714_0_r421289772_5.zip for task wah2_eas50_a4y1_201312_13_499_010840714_0 absent 29-Jan-2017 19:31:20 [climateprediction.net] Output file wah2_eas50_a4y1_201312_13_499_010840714_0_r421289772_6.zip for task wah2_eas50_a4y1_201312_13_499_010840714_0 absent 29-Jan-2017 19:31:20 [climateprediction.net] Output file wah2_eas50_a4y1_201312_13_499_010840714_0_r421289772_7.zip for task wah2_eas50_a4y1_201312_13_499_010840714_0 absent 29-Jan-2017 19:31:20 [climateprediction.net] Output file wah2_eas50_a4y1_201312_13_499_010840714_0_r421289772_8.zip for task wah2_eas50_a4y1_201312_13_499_010840714_0 absent 29-Jan-2017 19:31:20 [climateprediction.net] Output file wah2_eas50_a4y1_201312_13_499_010840714_0_r421289772_9.zip for task wah2_eas50_a4y1_201312_13_499_010840714_0 absent 29-Jan-2017 19:31:20 [climateprediction.net] Output file wah2_eas50_a4y1_201312_13_499_010840714_0_r421289772_10.zip for task wah2_eas50_a4y1_201312_13_499_010840714_0 absent 29-Jan-2017 19:31:20 [climateprediction.net] Output file wah2_eas50_a4y1_201312_13_499_010840714_0_r421289772_11.zip for task wah2_eas50_a4y1_201312_13_499_010840714_0 absent 29-Jan-2017 19:31:20 [climateprediction.net] Output file wah2_eas50_a4y1_201312_13_499_010840714_0_r421289772_12.zip for task wah2_eas50_a4y1_201312_13_499_010840714_0 absent 29-Jan-2017 19:31:20 [climateprediction.net] Output file wah2_eas50_a4y1_201312_13_499_010840714_0_r421289772_13.zip for task wah2_eas50_a4y1_201312_13_499_010840714_0 absent 29-Jan-2017 19:31:20 [climateprediction.net] Output file wah2_eas50_a4y1_201312_13_499_010840714_0_r421289772_restart.zip for task wah2_eas50_a4y1_201312_13_499_010840714_0 absent 29-Jan-2017 19:31:22 [climateprediction.net] Started upload of wah2_eas50_a4y1_201312_13_499_010840714_0_r421289772_out.zip 29-Jan-2017 19:31:26 [climateprediction.net] Finished upload of wah2_eas50_a4y1_201312_13_499_010840714_0_r421289772_out.zip 29-Jan-2017 19:38:32 [climateprediction.net] Fetching scheduler list 29-Jan-2017 19:38:35 [climateprediction.net] Master file download succeeded 29-Jan-2017 19:38:40 [climateprediction.net] Sending scheduler request: To report completed tasks. 29-Jan-2017 19:38:40 [climateprediction.net] Reporting 13 completed tasks 29-Jan-2017 19:38:40 [climateprediction.net] Not requesting tasks: "no new tasks" requested via Manager 29-Jan-2017 19:38:45 [climateprediction.net] Scheduler request completed 29-Jan-2017 19:44:14 [climateprediction.net] task wah2_eas50_a0b7_198712_13_499_010834708_0 resumed by user 29-Jan-2017 19:44:14 [climateprediction.net] task wah2_eas50_a0ai_198712_13_499_010834683_0 resumed by user 29-Jan-2017 19:44:14 [climateprediction.net] task wah2_eas50_a2lh_200012_13_499_010837670_0 resumed by user 29-Jan-2017 19:44:14 [climateprediction.net] task wah2_eas50_a2vf_200112_13_499_010838028_0 resumed by user 29-Jan-2017 19:44:14 [climateprediction.net] task wah2_eas50_a242_199712_13_499_010837043_0 resumed by user 29-Jan-2017 19:44:14 [climateprediction.net] task wah2_eas50_a1hl_199412_13_499_010836234_0 resumed by user 29-Jan-2017 19:44:14 [climateprediction.net] task wah2_eas50_a4ql_201112_13_499_010840446_0 resumed by user 29-Jan-2017 19:44:14 [climateprediction.net] task wah2_eas50_a4vf_201212_13_499_010840620_1 resumed by user 29-Jan-2017 19:44:14 [climateprediction.net] task wah2_eas50_a10l_199112_13_499_010835622_0 resumed by user 29-Jan-2017 19:44:14 [climateprediction.net] task wah2_eas50_a3bg_200412_13_499_010838605_0 resumed by user 29-Jan-2017 19:44:41 [climateprediction.net] Computation for task wah2_eas50_a0ai_198712_13_499_010834683_0 finished 29-Jan-2017 19:44:41 [climateprediction.net] Output file wah2_eas50_a0ai_198712_13_499_010834683_0_r1989751714_4.zip for task wah2_eas50_a0ai_198712_13_499_010834683_0 absent 29-Jan-2017 19:44:41 [climateprediction.net] Output file wah2_eas50_a0ai_198712_13_499_010834683_0_r1989751714_5.zip for task wah2_eas50_a0ai_198712_13_499_010834683_0 absent 29-Jan-2017 19:44:41 [climateprediction.net] Output file wah2_eas50_a0ai_198712_13_499_010834683_0_r1989751714_6.zip for task wah2_eas50_a0ai_198712_13_499_010834683_0 absent 29-Jan-2017 19:44:41 [climateprediction.net] Output file wah2_eas50_a0ai_198712_13_499_010834683_0_r1989751714_7.zip for task wah2_eas50_a0ai_198712_13_499_010834683_0 absent 29-Jan-2017 19:44:41 [climateprediction.net] Output file wah2_eas50_a0ai_198712_13_499_010834683_0_r1989751714_8.zip for task wah2_eas50_a0ai_198712_13_499_010834683_0 absent 29-Jan-2017 19:44:41 [climateprediction.net] Output file wah2_eas50_a0ai_198712_13_499_010834683_0_r1989751714_9.zip for task wah2_eas50_a0ai_198712_13_499_010834683_0 absent 29-Jan-2017 19:44:41 [climateprediction.net] Output file wah2_eas50_a0ai_198712_13_499_010834683_0_r1989751714_10.zip for task wah2_eas50_a0ai_198712_13_499_010834683_0 absent 29-Jan-2017 19:44:41 [climateprediction.net] Output file wah2_eas50_a0ai_198712_13_499_010834683_0_r1989751714_11.zip for task wah2_eas50_a0ai_198712_13_499_010834683_0 absent 29-Jan-2017 19:44:41 [climateprediction.net] Output file wah2_eas50_a0ai_198712_13_499_010834683_0_r1989751714_12.zip for task wah2_eas50_a0ai_198712_13_499_010834683_0 absent 29-Jan-2017 19:44:41 [climateprediction.net] Output file wah2_eas50_a0ai_198712_13_499_010834683_0_r1989751714_13.zip for task wah2_eas50_a0ai_198712_13_499_010834683_0 absent 29-Jan-2017 19:44:41 [climateprediction.net] Output file wah2_eas50_a0ai_198712_13_499_010834683_0_r1989751714_restart.zip for task wah2_eas50_a0ai_198712_13_499_010834683_0 absent 29-Jan-2017 19:44:41 [climateprediction.net] Output file wah2_eas50_a0ai_198712_13_499_010834683_0_r1989751714_out.zip for task wah2_eas50_a0ai_198712_13_499_010834683_0 absent 29-Jan-2017 19:44:41 [climateprediction.net] Computation for task wah2_eas50_a10l_199112_13_499_010835622_0 finished 29-Jan-2017 19:44:41 [climateprediction.net] Output file wah2_eas50_a10l_199112_13_499_010835622_0_r2004546266_4.zip for task wah2_eas50_a10l_199112_13_499_010835622_0 absent 29-Jan-2017 19:44:41 [climateprediction.net] Output file wah2_eas50_a10l_199112_13_499_010835622_0_r2004546266_5.zip for task wah2_eas50_a10l_199112_13_499_010835622_0 absent 29-Jan-2017 19:44:41 [climateprediction.net] Output file wah2_eas50_a10l_199112_13_499_010835622_0_r2004546266_6.zip for task wah2_eas50_a10l_199112_13_499_010835622_0 absent 29-Jan-2017 19:44:41 [climateprediction.net] Output file wah2_eas50_a10l_199112_13_499_010835622_0_r2004546266_7.zip for task wah2_eas50_a10l_199112_13_499_010835622_0 absent 29-Jan-2017 19:44:41 [climateprediction.net] Output file wah2_eas50_a10l_199112_13_499_010835622_0_r2004546266_8.zip for task wah2_eas50_a10l_199112_13_499_010835622_0 absent 29-Jan-2017 19:44:41 [climateprediction.net] Output file wah2_eas50_a10l_199112_13_499_010835622_0_r2004546266_9.zip for task wah2_eas50_a10l_199112_13_499_010835622_0 absent 29-Jan-2017 19:44:41 [climateprediction.net] Output file wah2_eas50_a10l_199112_13_499_010835622_0_r2004546266_10.zip for task wah2_eas50_a10l_199112_13_499_010835622_0 absent 29-Jan-2017 19:44:41 [climateprediction.net] Output file wah2_eas50_a10l_199112_13_499_010835622_0_r2004546266_11.zip for task wah2_eas50_a10l_199112_13_499_010835622_0 absent 29-Jan-2017 19:44:41 [climateprediction.net] Output file wah2_eas50_a10l_199112_13_499_010835622_0_r2004546266_12.zip for task wah2_eas50_a10l_199112_13_499_010835622_0 absent 29-Jan-2017 19:44:41 [climateprediction.net] Output file wah2_eas50_a10l_199112_13_499_010835622_0_r2004546266_13.zip for task wah2_eas50_a10l_199112_13_499_010835622_0 absent 29-Jan-2017 19:44:41 [climateprediction.net] Output file wah2_eas50_a10l_199112_13_499_010835622_0_r2004546266_restart.zip for task wah2_eas50_a10l_199112_13_499_010835622_0 absent 29-Jan-2017 19:44:41 [climateprediction.net] Output file wah2_eas50_a10l_199112_13_499_010835622_0_r2004546266_out.zip for task wah2_eas50_a10l_199112_13_499_010835622_0 absent 29-Jan-2017 19:44:41 [climateprediction.net] Computation for task wah2_eas50_a2vf_200112_13_499_010838028_0 finished 29-Jan-2017 19:44:41 [climateprediction.net] Output file wah2_eas50_a2vf_200112_13_499_010838028_0_r355118105_4.zip for task wah2_eas50_a2vf_200112_13_499_010838028_0 absent 29-Jan-2017 19:44:41 [climateprediction.net] Output file wah2_eas50_a2vf_200112_13_499_010838028_0_r355118105_5.zip for task wah2_eas50_a2vf_200112_13_499_010838028_0 absent 29-Jan-2017 19:44:41 [climateprediction.net] Output file wah2_eas50_a2vf_200112_13_499_010838028_0_r355118105_6.zip for task wah2_eas50_a2vf_200112_13_499_010838028_0 absent 29-Jan-2017 19:44:41 [climateprediction.net] Output file wah2_eas50_a2vf_200112_13_499_010838028_0_r355118105_7.zip for task wah2_eas50_a2vf_200112_13_499_010838028_0 absent 29-Jan-2017 19:44:41 [climateprediction.net] Output file wah2_eas50_a2vf_200112_13_499_010838028_0_r355118105_8.zip for task wah2_eas50_a2vf_200112_13_499_010838028_0 absent 29-Jan-2017 19:44:41 [climateprediction.net] Output file wah2_eas50_a2vf_200112_13_499_010838028_0_r355118105_9.zip for task wah2_eas50_a2vf_200112_13_499_010838028_0 absent 29-Jan-2017 19:44:41 [climateprediction.net] Output file wah2_eas50_a2vf_200112_13_499_010838028_0_r355118105_10.zip for task wah2_eas50_a2vf_200112_13_499_010838028_0 absent 29-Jan-2017 19:44:41 [climateprediction.net] Output file wah2_eas50_a2vf_200112_13_499_010838028_0_r355118105_11.zip for task wah2_eas50_a2vf_200112_13_499_010838028_0 absent 29-Jan-2017 19:44:41 [climateprediction.net] Output file wah2_eas50_a2vf_200112_13_499_010838028_0_r355118105_12.zip for task wah2_eas50_a2vf_200112_13_499_010838028_0 absent 29-Jan-2017 19:44:41 [climateprediction.net] Output file wah2_eas50_a2vf_200112_13_499_010838028_0_r355118105_13.zip for task wah2_eas50_a2vf_200112_13_499_010838028_0 absent 29-Jan-2017 19:44:41 [climateprediction.net] Output file wah2_eas50_a2vf_200112_13_499_010838028_0_r355118105_restart.zip for task wah2_eas50_a2vf_200112_13_499_010838028_0 absent 29-Jan-2017 19:44:41 [climateprediction.net] Output file wah2_eas50_a2vf_200112_13_499_010838028_0_r355118105_out.zip for task wah2_eas50_a2vf_200112_13_499_010838028_0 absent 29-Jan-2017 19:44:41 [climateprediction.net] Computation for task wah2_eas50_a4ql_201112_13_499_010840446_0 finished 29-Jan-2017 19:44:41 [climateprediction.net] Output file wah2_eas50_a4ql_201112_13_499_010840446_0_r517252223_4.zip for task wah2_eas50_a4ql_201112_13_499_010840446_0 absent 29-Jan-2017 19:44:41 [climateprediction.net] Output file wah2_eas50_a4ql_201112_13_499_010840446_0_r517252223_5.zip for task wah2_eas50_a4ql_201112_13_499_010840446_0 absent 29-Jan-2017 19:44:41 [climateprediction.net] Output file wah2_eas50_a4ql_201112_13_499_010840446_0_r517252223_6.zip for task wah2_eas50_a4ql_201112_13_499_010840446_0 absent 29-Jan-2017 19:44:41 [climateprediction.net] Output file wah2_eas50_a4ql_201112_13_499_010840446_0_r517252223_7.zip for task wah2_eas50_a4ql_201112_13_499_010840446_0 absent 29-Jan-2017 19:44:41 [climateprediction.net] Output file wah2_eas50_a4ql_201112_13_499_010840446_0_r517252223_8.zip for task wah2_eas50_a4ql_201112_13_499_010840446_0 absent 29-Jan-2017 19:44:41 [climateprediction.net] Output file wah2_eas50_a4ql_201112_13_499_010840446_0_r517252223_9.zip for task wah2_eas50_a4ql_201112_13_499_010840446_0 absent 29-Jan-2017 19:44:41 [climateprediction.net] Output file wah2_eas50_a4ql_201112_13_499_010840446_0_r517252223_10.zip for task wah2_eas50_a4ql_201112_13_499_010840446_0 absent 29-Jan-2017 19:44:41 [climateprediction.net] Output file wah2_eas50_a4ql_201112_13_499_010840446_0_r517252223_11.zip for task wah2_eas50_a4ql_201112_13_499_010840446_0 absent 29-Jan-2017 19:44:41 [climateprediction.net] Output file wah2_eas50_a4ql_201112_13_499_010840446_0_r517252223_12.zip for task wah2_eas50_a4ql_201112_13_499_010840446_0 absent 29-Jan-2017 19:44:41 [climateprediction.net] Output file wah2_eas50_a4ql_201112_13_499_010840446_0_r517252223_13.zip for task wah2_eas50_a4ql_201112_13_499_010840446_0 absent 29-Jan-2017 19:44:41 [climateprediction.net] Output file wah2_eas50_a4ql_201112_13_499_010840446_0_r517252223_restart.zip for task wah2_eas50_a4ql_201112_13_499_010840446_0 absent 29-Jan-2017 19:44:41 [climateprediction.net] Output file wah2_eas50_a4ql_201112_13_499_010840446_0_r517252223_out.zip for task wah2_eas50_a4ql_201112_13_499_010840446_0 absent 29-Jan-2017 19:44:41 [climateprediction.net] Computation for task wah2_eas50_a1hl_199412_13_499_010836234_0 finished 29-Jan-2017 19:44:41 [climateprediction.net] Output file wah2_eas50_a1hl_199412_13_499_010836234_0_r664695825_4.zip for task wah2_eas50_a1hl_199412_13_499_010836234_0 absent 29-Jan-2017 19:44:41 [climateprediction.net] Output file wah2_eas50_a1hl_199412_13_499_010836234_0_r664695825_5.zip for task wah2_eas50_a1hl_199412_13_499_010836234_0 absent 29-Jan-2017 19:44:41 [climateprediction.net] Output file wah2_eas50_a1hl_199412_13_499_010836234_0_r664695825_6.zip for task wah2_eas50_a1hl_199412_13_499_010836234_0 absent 29-Jan-2017 19:44:41 [climateprediction.net] Output file wah2_eas50_a1hl_199412_13_499_010836234_0_r664695825_7.zip for task wah2_eas50_a1hl_199412_13_499_010836234_0 absent 29-Jan-2017 19:44:41 [climateprediction.net] Output file wah2_eas50_a1hl_199412_13_499_010836234_0_r664695825_8.zip for task wah2_eas50_a1hl_199412_13_499_010836234_0 absent 29-Jan-2017 19:44:41 [climateprediction.net] Output file wah2_eas50_a1hl_199412_13_499_010836234_0_r664695825_9.zip for task wah2_eas50_a1hl_199412_13_499_010836234_0 absent 29-Jan-2017 19:44:41 [climateprediction.net] Output file wah2_eas50_a1hl_199412_13_499_010836234_0_r664695825_10.zip for task wah2_eas50_a1hl_199412_13_499_010836234_0 absent 29-Jan-2017 19:44:41 [climateprediction.net] Output file wah2_eas50_a1hl_199412_13_499_010836234_0_r664695825_11.zip for task wah2_eas50_a1hl_199412_13_499_010836234_0 absent 29-Jan-2017 19:44:41 [climateprediction.net] Output file wah2_eas50_a1hl_199412_13_499_010836234_0_r664695825_12.zip for task wah2_eas50_a1hl_199412_13_499_010836234_0 absent 29-Jan-2017 19:44:41 [climateprediction.net] Output file wah2_eas50_a1hl_199412_13_499_010836234_0_r664695825_13.zip for task wah2_eas50_a1hl_199412_13_499_010836234_0 absent 29-Jan-2017 19:44:41 [climateprediction.net] Output file wah2_eas50_a1hl_199412_13_499_010836234_0_r664695825_restart.zip for task wah2_eas50_a1hl_199412_13_499_010836234_0 absent 29-Jan-2017 19:44:41 [climateprediction.net] Output file wah2_eas50_a1hl_199412_13_499_010836234_0_r664695825_out.zip for task wah2_eas50_a1hl_199412_13_499_010836234_0 absent 29-Jan-2017 19:44:41 [climateprediction.net] Computation for task wah2_eas50_a2lh_200012_13_499_010837670_0 finished 29-Jan-2017 19:44:41 [climateprediction.net] Output file wah2_eas50_a2lh_200012_13_499_010837670_0_r1356820796_4.zip for task wah2_eas50_a2lh_200012_13_499_010837670_0 absent 29-Jan-2017 19:44:41 [climateprediction.net] Output file wah2_eas50_a2lh_200012_13_499_010837670_0_r1356820796_5.zip for task wah2_eas50_a2lh_200012_13_499_010837670_0 absent 29-Jan-2017 19:44:41 [climateprediction.net] Output file wah2_eas50_a2lh_200012_13_499_010837670_0_r1356820796_6.zip for task wah2_eas50_a2lh_200012_13_499_010837670_0 absent 29-Jan-2017 19:44:41 [climateprediction.net] Output file wah2_eas50_a2lh_200012_13_499_010837670_0_r1356820796_7.zip for task wah2_eas50_a2lh_200012_13_499_010837670_0 absent 29-Jan-2017 19:44:41 [climateprediction.net] Output file wah2_eas50_a2lh_200012_13_499_010837670_0_r1356820796_8.zip for task wah2_eas50_a2lh_200012_13_499_010837670_0 absent 29-Jan-2017 19:44:41 [climateprediction.net] Output file wah2_eas50_a2lh_200012_13_499_010837670_0_r1356820796_9.zip for task wah2_eas50_a2lh_200012_13_499_010837670_0 absent 29-Jan-2017 19:44:41 [climateprediction.net] Output file wah2_eas50_a2lh_200012_13_499_010837670_0_r1356820796_10.zip for task wah2_eas50_a2lh_200012_13_499_010837670_0 absent 29-Jan-2017 19:44:41 [climateprediction.net] Output file wah2_eas50_a2lh_200012_13_499_010837670_0_r1356820796_11.zip for task wah2_eas50_a2lh_200012_13_499_010837670_0 absent 29-Jan-2017 19:44:41 [climateprediction.net] Output file wah2_eas50_a2lh_200012_13_499_010837670_0_r1356820796_12.zip for task wah2_eas50_a2lh_200012_13_499_010837670_0 absent 29-Jan-2017 19:44:41 [climateprediction.net] Output file wah2_eas50_a2lh_200012_13_499_010837670_0_r1356820796_13.zip for task wah2_eas50_a2lh_200012_13_499_010837670_0 absent 29-Jan-2017 19:44:41 [climateprediction.net] Output file wah2_eas50_a2lh_200012_13_499_010837670_0_r1356820796_restart.zip for task wah2_eas50_a2lh_200012_13_499_010837670_0 absent 29-Jan-2017 19:44:41 [climateprediction.net] Output file wah2_eas50_a2lh_200012_13_499_010837670_0_r1356820796_out.zip for task wah2_eas50_a2lh_200012_13_499_010837670_0 absent 29-Jan-2017 19:44:41 [climateprediction.net] Computation for task wah2_eas50_a0b7_198712_13_499_010834708_0 finished 29-Jan-2017 19:44:41 [climateprediction.net] Output file wah2_eas50_a0b7_198712_13_499_010834708_0_r334907102_4.zip for task wah2_eas50_a0b7_198712_13_499_010834708_0 absent 29-Jan-2017 19:44:41 [climateprediction.net] Output file wah2_eas50_a0b7_198712_13_499_010834708_0_r334907102_5.zip for task wah2_eas50_a0b7_198712_13_499_010834708_0 absent 29-Jan-2017 19:44:41 [climateprediction.net] Output file wah2_eas50_a0b7_198712_13_499_010834708_0_r334907102_6.zip for task wah2_eas50_a0b7_198712_13_499_010834708_0 absent 29-Jan-2017 19:44:41 [climateprediction.net] Output file wah2_eas50_a0b7_198712_13_499_010834708_0_r334907102_7.zip for task wah2_eas50_a0b7_198712_13_499_010834708_0 absent 29-Jan-2017 19:44:41 [climateprediction.net] Output file wah2_eas50_a0b7_198712_13_499_010834708_0_r334907102_8.zip for task wah2_eas50_a0b7_198712_13_499_010834708_0 absent 29-Jan-2017 19:44:41 [climateprediction.net] Output file wah2_eas50_a0b7_198712_13_499_010834708_0_r334907102_9.zip for task wah2_eas50_a0b7_198712_13_499_010834708_0 absent 29-Jan-2017 19:44:41 [climateprediction.net] Output file wah2_eas50_a0b7_198712_13_499_010834708_0_r334907102_10.zip for task wah2_eas50_a0b7_198712_13_499_010834708_0 absent 29-Jan-2017 19:44:41 [climateprediction.net] Output file wah2_eas50_a0b7_198712_13_499_010834708_0_r334907102_11.zip for task wah2_eas50_a0b7_198712_13_499_010834708_0 absent 29-Jan-2017 19:44:41 [climateprediction.net] Output file wah2_eas50_a0b7_198712_13_499_010834708_0_r334907102_12.zip for task wah2_eas50_a0b7_198712_13_499_010834708_0 absent 29-Jan-2017 19:44:41 [climateprediction.net] Output file wah2_eas50_a0b7_198712_13_499_010834708_0_r334907102_13.zip for task wah2_eas50_a0b7_198712_13_499_010834708_0 absent 29-Jan-2017 19:44:41 [climateprediction.net] Output file wah2_eas50_a0b7_198712_13_499_010834708_0_r334907102_restart.zip for task wah2_eas50_a0b7_198712_13_499_010834708_0 absent


Tons more but I can not add that, was hoping for a nice little scroll box, but it doesn't seem to happen.

Profile Dave Jackson
Send message
Joined: 15 May 09
Posts: 1793
Credit: 2,671,578
RAC: 898
Message 55625 - Posted: 31 Jan 2017, 18:51:14 UTC - in response to Message 55624.

I think more useful will be the stder on the model page. If you click the plus sign next to stder it there should be some sort of error message. The missing output files are just because they weren't generated as the model crashed before it reached that point. If you can post the links to a couple of the tasks it might give some clues.

BRG
Send message
Joined: 24 Dec 16
Posts: 15
Credit: 1,470,720
RAC: 0
Message 55626 - Posted: 31 Jan 2017, 19:19:09 UTC - in response to Message 55625.

I think more useful will be the stder on the model page. If you click the plus sign next to stder it there should be some sort of error message. The missing output files are just because they weren't generated as the model crashed before it reached that point. If you can post the links to a couple of the tasks it might give some clues.


Can you pm me, walking me through it please Dave as I have got no idea what you ask!

Profile Dave Jackson
Send message
Joined: 15 May 09
Posts: 1793
Credit: 2,671,578
RAC: 898
Message 55627 - Posted: 1 Feb 2017, 8:49:10 UTC - in response to Message 55626.

Will post here in case anyone else struggles to find it. Click on the your account link at the bottom of the page, scroll down till you see, "Computers on this account." Click on, "View" Choose the computer with the problems click on, "Tasks" and then look for a task that has failed. When you click on it, scroll down till you come to stderr

Here is one of mine that failed.

The pattern in that one of lots of suspend requests is what you can get when something intensive is interrupting BOINC lot. Invalid theta is a message you get when an impossible climate e.g. negative pressure occurs. If you are getting lots of these, it suggests an instability in your computer and I would suggest running memtest to check out memory. There will be a small percentage of these at the extremes of conditions looked at by a bunch of tasks.

BRG
Send message
Joined: 24 Dec 16
Posts: 15
Credit: 1,470,720
RAC: 0
Message 55633 - Posted: 1 Feb 2017, 19:29:30 UTC - in response to Message 55627.

Will post here in case anyone else struggles to find it. Click on the your account link at the bottom of the page, scroll down till you see, "Computers on this account." Click on, "View" Choose the computer with the problems click on, "Tasks" and then look for a task that has failed. When you click on it, scroll down till you come to stderr

Here is one of mine that failed.

The pattern in that one of lots of suspend requests is what you can get when something intensive is interrupting BOINC lot. Invalid theta is a message you get when an impossible climate e.g. negative pressure occurs. If you are getting lots of these, it suggests an instability in your computer and I would suggest running memtest to check out memory. There will be a small percentage of these at the extremes of conditions looked at by a bunch of tasks.


Had a little rummage and picked this one at random...

<core_client_version>7.6.33</core_client_version> <![CDATA[ <stderr_txt> 20:53:33 (732408): start_timer_thread(): CreateThread() failed, errno 0 20:53:36 (733964): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 22:29:51 (779868): start_timer_thread(): CreateThread() failed, errno 0 22:30:01 (780368): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 23:34:32 (794896): start_timer_thread(): CreateThread() failed, errno 0 23:34:35 (794944): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 01:34:21 (814408): start_timer_thread(): CreateThread() failed, errno 0 01:34:24 (817780): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 01:43:58 (772360): start_timer_thread(): CreateThread() failed, errno 0 01:44:03 (812588): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 02:02:09 (811136): start_timer_thread(): CreateThread() failed, errno 0 02:02:14 (811772): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=837492, iMonCtr=1 03:37:18 (842648): start_timer_thread(): CreateThread() failed, errno 0 Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=0, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=842648, selfPID=843684, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_ain::Monitor... 03:37:29 (843684): called boinc_finish(0) </stderr_txt> <message> upload failure: <file_xfer_error> <file_name>wah2_eas50_n2p6_201312_10_505_010856939_1_r2042226602_1.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>wah2_eas50_n2p6_201312_10_505_010856939_1_r2042226602_2.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>wah2_eas50_n2p6_201312_10_505_010856939_1_r2042226602_3.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>wah2_eas50_n2p6_201312_10_505_010856939_1_r2042226602_4.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>wah2_eas50_n2p6_201312_10_505_010856939_1_r2042226602_5.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>wah2_eas50_n2p6_201312_10_505_010856939_1_r2042226602_6.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>wah2_eas50_n2p6_201312_10_505_010856939_1_r2042226602_7.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>wah2_eas50_n2p6_201312_10_505_010856939_1_r2042226602_8.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>wah2_eas50_n2p6_201312_10_505_010856939_1_r2042226602_9.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>wah2_eas50_n2p6_201312_10_505_010856939_1_r2042226602_10.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>wah2_eas50_n2p6_201312_10_505_010856939_1_r2042226602_restart.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> </message> ]]>

Les Bayliss
Volunteer moderator
Send message
Joined: 5 Sep 04
Posts: 6408
Credit: 16,839,542
RAC: 21,887
Message 55634 - Posted: 1 Feb 2017, 20:19:17 UTC - in response to Message 55633.

The program didn't even get as far as creating zip 1, so it failed early, possibly within seconds of starting.

************

Doing a web search:
start_timer_thread(): CreateThread() failed, errno 0 seems to be a cpdn problem.

CreateThread() failed, errno 0 might be a Windows 10 problem.

Anti-virus blocking something?
Hard disk busy with other work?
Permissions?

Profile Alan K
Send message
Joined: 22 Feb 06
Posts: 203
Credit: 10,727,650
RAC: 8,191
Message 55635 - Posted: 1 Feb 2017, 23:28:32 UTC - in response to Message 55634.

Have you tried reducing the number of cores you are using from the 24 you have? This can be set from the options menu in BOINC Manager in the computing tab - "at most use x% of processors".

BRG
Send message
Joined: 24 Dec 16
Posts: 15
Credit: 1,470,720
RAC: 0
Message 55639 - Posted: 2 Feb 2017, 19:13:11 UTC - in response to Message 55635.

Have you tried reducing the number of cores you are using from the 24 you have? This can be set from the options menu in BOINC Manager in the computing tab - "at most use x% of processors".


its set to use 20 cores leaving 4 spare to do whatever I need to do, daily tasks... if I need more cores then I suspend stuff in the morning and let it run at night again.

The program didn't even get as far as creating zip 1, so it failed early, possibly within seconds of starting.

************

Doing a web search:
start_timer_thread(): CreateThread() failed, errno 0 seems to be a cpdn problem.

CreateThread() failed, errno 0 might be a Windows 10 problem.

Anti-virus blocking something?
Hard disk busy with other work?
Permissions?


Anti virus shouldn't be blocking anything..
Main drive is an SSD so should be ok...
should all be clear to run?!?!

Questions and Answers : Windows : Combine for multi core


Main page · Your account · Message boards


Copyright © 2017 climateprediction.net