Re: Not able to run beam appliction on Flink cluster environment

Hi Till, I'm not sure as i'm following correct steps...there is no log file generated on flink cluster. 1. followed the steps mentinoned in below link to setup flink cluster (Standalone) https://ci.apache.org/projects/flink/flink-docs-release-1.2/setup/cluster_setup.html Then 2.run beam word

Re: [DISCUSS] Capability Matrix revamp

Oh, I missed 11. Quantitative properties. This seems like an interesting and important project all on its own. Since Beam is so generic, we need pretty diverse measurements for a user to have a hope of extrapolating to their use case. Kenn On Tue, Aug 22, 2017 at 7:22 PM, Kenneth Knowles

Re: [DISCUSS] Capability Matrix revamp

OK, so adding these good ideas to the list: 8. Plain-English summary that comes before the nitty-gritty. 9. Comment on production readiness from maintainers. Maybe testimonials are helpful if they can be obtained? 10. Versioning of all of the above Any more thoughts? I'll summarize in a JIRA in

Re: [RESULT][VOTE] Release 2.1.0, release candidate #3

I believe this release is complete now. Thank you JB for pushing this release, and everyone else who contributed to it. On Tue, Aug 22, 2017 at 4:26 PM, Ahmet Altay wrote: > Remaining items for closing this release are: > - Move source distribution from dev repository to

Re: [RESULT][VOTE] Release 2.1.0, release candidate #3

Remaining items for closing this release are: - Move source distribution from dev repository to release repository in dist.apache.org - Finalize the version in JIRA. - Announce on user@ and other places. On Tue, Aug 22, 2017 at 2:18 PM, Ahmet Altay wrote: > > > On Tue, Aug 22,

Re: [RESULT][VOTE] Release 2.1.0, release candidate #3

On Tue, Aug 22, 2017 at 2:07 PM, Ahmet Altay wrote: > > > On Tue, Aug 22, 2017 at 12:08 PM, Ahmet Altay wrote: > >> >> >> On Tue, Aug 22, 2017 at 10:59 AM, Ahmet Altay wrote: >> >>> Thank you JB. >>> >>> On Mon, Aug 21, 2017 at 11:33 PM,

Re: [RESULT][VOTE] Release 2.1.0, release candidate #3

On Tue, Aug 22, 2017 at 12:08 PM, Ahmet Altay wrote: > > > On Tue, Aug 22, 2017 at 10:59 AM, Ahmet Altay wrote: > >> Thank you JB. >> >> On Mon, Aug 21, 2017 at 11:33 PM, Jean-Baptiste Onofré >> wrote: >> >>> Hi >>> >>> This vote passed

Re: [RESULT][VOTE] Release 2.1.0, release candidate #3

On Tue, Aug 22, 2017 at 10:59 AM, Ahmet Altay wrote: > Thank you JB. > > On Mon, Aug 21, 2017 at 11:33 PM, Jean-Baptiste Onofré > wrote: > >> Hi >> >> This vote passed with only +1. >> >> I'm promoting the artifacts to central and update Jira. >> > > Are you

Re: [Proposal] Progress Reporting in Fn API

I put together https://docs.google.com/document/d/1Dx18qBTvFWNqwLeecemOpKfleKzFyeV3Qwh71SHATvY/edit?usp=sharing which explains a bit how I think about progress and might be helpful. On Mon, Aug 21, 2017 at 10:22 AM, Vikas RK wrote: > Hi, > > I have updated the proposal >

Re: [RESULT][VOTE] Release 2.1.0, release candidate #3

Thank you JB. On Mon, Aug 21, 2017 at 11:33 PM, Jean-Baptiste Onofré wrote: > Hi > > This vote passed with only +1. > > I'm promoting the artifacts to central and update Jira. > Are you also pushing the PyPI artifacts? Do you want me to do it? > As I'm in vacation can a

Re: [DISCUSS] Capability Matrix revamp

Hi, I'd also like to ask if versioning as proposed in BEAM-166 < https://issues.apache.org/jira/browse/BEAM-166> is still relevant? If it is, would this be something we want to add to this proposal? G On 21 August 2017 at 08:31, Tyler Akidau wrote: > Is there any

Re: How to Retain File Name while using TextIO for pattern

You'll have to write your own source to do this. You can copy large parts of TextIO/CompressedSource to get what you want. On Mon, Aug 21, 2017 at 10:12 PM, Siddharth Mittal wrote: > Hi Team, > > We want to retain the File name while reading a zip file using TextIO api. >

Re: How to read files in distributed way from a pcollection

TextIO doesn't retain filenames. Looks like proposed API for reading whole files [1] retain filesnames so you should be able to use that to produce a PCollection of KV once it's available. - Cham [1] https://issues.apache.org/jira/browse/BEAM-2750 On Mon, Aug 21, 2017 at 9:59 PM

Including a proto from a git repo?

Hi, For BEAM-2774 , I had proposed to create a new Variant proto as the type of the returned PCollection. I was originally planning to define it somewhere within Beam, but since then we've decided it may be better to define it in a more generic

Re: Not able to run beam appliction on Flink cluster environment

Hi Ramanji, do you have the logs of the Flink master running at 192.168.56.1:6123? Cheers, Till On Tue, Aug 22, 2017 at 2:43 PM, P. Ramanjaneya Reddy wrote: > Hi All, > > We followed the steps mentinoned in below link to setup flink cluster > (Standalone) >

Jenkins build became unstable: beam_Release_NightlySnapshot #511

See