Re: No DirectRunner found

2016-12-09 Thread Davor Bonaci
Fixed! (earlier today in the quickstart) On Fri, Dec 9, 2016 at 1:46 PM, Trevor Pering wrote: > I'm trying the Beam Quickstart on http://beam.incubator. > apache.org/get-started/quickstart/ and it can't find the default > DIrectRunner. If I try to specify a --runner

Re: is beam's core stable now? or when will the beam's first stable version release?

2016-11-10 Thread Davor Bonaci
Beam's codebase is "fairly stable" right now. We've done the majority of backward-incompatible changes that were planned and known. There are still some remaining, but they shouldn't cause excessive pain. From the code stability perspective, you might want to try Beam right away, with the

Re: expected a valid 'gs://' path but was given '/tmp/tmpLocation'

2016-05-24 Thread Davor Bonaci
Yes -- MinimalWordCount example currently defaults to the DataflowPipelineRunner, which runs pipelines on the Google Cloud Dataflow service. (We'll be changing this.) In general, Cloud-based runners don't have access to your local machine, hence the exception you saw. DirectPipelineRunner can

Re: Collecting Results to Executing Process

2016-05-20 Thread Davor Bonaci
The question of displaying contents of a (small) PCollection has been asked several times. There are various reasons why this is challenging, primarily centered around leading users into a sub-optimal outcome / experience. On the other hand, usefulness and educational value is certainly there.

Re: subscribe

2016-03-22 Thread Davor Bonaci
I think you want: user-subscr...@beam.incubator.apache.org. On Tue, Mar 22, 2016 at 3:55 PM, Dongjoon Hyun wrote: > >

Re: Debugging pipelines

2016-03-20 Thread Davor Bonaci
Of course, this functionality can be implemented manually in a DoFn -- this wouldn't be a primitive. That said, an argument could be made that a Beam SDK should provide a composite that logs elements in a PCollection. This can further be augmented with proposals like "log_every_n_seconds" or

Re: subscribe

2016-03-04 Thread Davor Bonaci
You probably wanted to email: user-subscr...@beam.incubator.apache.org. On Fri, Mar 4, 2016 at 4:07 PM, Anandha L Ranganathan wrote: > >