Presentations about Apche Beam

Dear Beam Community, My name is David and i’m a studet of University of Molise, Italy. I’m studing “Security of Software System” and during this degree I’m attending the course of “Complex Software Architecture and Styes”; for the exam I have to analyse an Apache complex system. I selected

Re: [VOTE] Release 2.3.0, release candidate #3

+1 (binding) pending Flink verification. I have checked the signatures and checksums of the artifacts, and that it agrees with commit 67b5e1bab25d284cdac2127b47f44acc8e83499e on github *except* for 76 places where -SNAPSHOT was removed. FWIW, http://www.apache.org/dev/release-distribution now

Re: [VOTE] Release 2.3.0, release candidate #3

+1 Thank you JB and thank you everyone for doing the validations. On Wed, Feb 14, 2018 at 5:24 PM, Eugene Kirpichov wrote: > Thanks Kenn. I retract my -1, but then someone must verify it with Flink > 1.4. I might give it a shot tomorrow (installing Flink 1.4 on Dataproc).

Re: [VOTE] Release 2.3.0, release candidate #3

Thanks Kenn. I retract my -1, but then someone must verify it with Flink 1.4. I might give it a shot tomorrow (installing Flink 1.4 on Dataproc). On Wed, Feb 14, 2018 at 4:53 PM Reuven Lax wrote: > +1 (binding) > > On Wed, Feb 14, 2018 at 10:42 AM, Alan Myrvold

Re: [VOTE] Release 2.3.0, release candidate #3

+1 (binding) On Wed, Feb 14, 2018 at 10:42 AM, Alan Myrvold wrote: > +1 Validated java quickstarts for direct, dataflow, apex, flink, and spark. > > On Wed, Feb 14, 2018 at 9:21 AM, Lukasz Cwik wrote: > >> +1 (binding) >> Validated several quickstarts

Re: [VOTE] Release 2.3.0, release candidate #3

The FlinkRunner on the release-2.3.0 branch explicitly specifies Flink version 1.4.0. I think your initialization action is the culprit. On Wed, Feb 14, 2018 at 2:00 PM, Eugene Kirpichov wrote: > Tentative -1. > > I tried to validate quickstart on Flink on a Dataproc

Re: [VOTE] Release 2.3.0, release candidate #3

Tentative -1. I tried to validate quickstart on Flink on a Dataproc cluster and ran into a couple of issues. Here's the script I followed: $ curl https://raw.githubusercontent.com/GoogleCloudPlatform/dataproc-initialization-actions/master/flink/flink.sh -o flink.sh $ gsutil cp flink.sh

Re: [VOTE] Release 2.3.0, release candidate #3

+1, Validated Python - Mobile game walkthrough, Python - Quickstart (Streaming Alpha). On Wed, Feb 14, 2018 at 10:42 AM, Alan Myrvold wrote: > +1 Validated java quickstarts for direct, dataflow, apex, flink, and spark. > > On Wed, Feb 14, 2018 at 9:21 AM, Lukasz Cwik

Re: Plan for a Parquet new release and writing Parquet file with outputstream

Great !! In the mean time, I started to PoC around directly parquet-common to see if I can implement a BeamParquetReader and a BeamParquetWriter. I might also propose some PRs. I will continue tomorrow around that. Thanks again ! Regards JB On 02/14/2018 08:04 PM, Ryan Blue wrote: > Additions

Re: [VOTE] Release 2.3.0, release candidate #3

+1 Validated java quickstarts for direct, dataflow, apex, flink, and spark. On Wed, Feb 14, 2018 at 9:21 AM, Lukasz Cwik wrote: > +1 (binding) > Validated several quickstarts including the regression that I originally > reported with Spark. > > On Wed, Feb 14, 2018 at 5:34 AM,

Re: [VOTE] Release 2.3.0, release candidate #3

+1 (binding) Validated several quickstarts including the regression that I originally reported with Spark. On Wed, Feb 14, 2018 at 5:34 AM, Ismaël Mejía wrote: > +1 (binding) > > Validated SHAs + tag vs source.zip file. > Run mvn clean install -Prelease OK > Validated that

Fwd: Travel Assistance applications open. Please inform your communities

See this email for info on travel assistance for ApacheCon NA 2018 in Montreal. I hope the Beam community will be well-represented! -- Forwarded message -- From: Gavin McDonald Date: Wed, Feb 14, 2018 at 1:34 AM Subject: Travel Assistance applications

Travel Assistance applications open for ApacheCon NA '18

Hi all, I inform you that the travel assistance applications (http://www.apache.org/travel/) are now open. If you plan to attend to ApacheCon, but we can't for financial reason, you can apply to the program. Lot of committers, PMC members and members will be present, so it's a great opportunity

Re: PipelineOptions fromSystemProps?

this is part of the PR without any transformation - as requested. I'm happy to do a follow up PR to do the same transformations than in deltaspike for instance:

Re: PipelineOptions fromSystemProps?

+1 to Romain idea with Kenn's approach, we should probably reserve the 'beam.' namespace too because we are already using it for system properties in the spark runner, following along the convention of 'spark.*' in Apache Spark. Any ideas on how to handle this for the env vraiables case ? maybe

Re: [VOTE] Release 2.3.0, release candidate #3

+1 (binding) Validated SHAs + tag vs source.zip file. Run mvn clean install -Prelease OK Validated that the 3 regressions reported for RC1 were fixed. Run Nexmark on Direct/Flink runner on local mode, no regressions now. Installed python version on virtualenv and run local wordcount with success.

Jenkins build is back to stable : beam_Release_NightlySnapshot #685

See

Re: PipelineOptions fromSystemProps?

FYI created https://github.com/apache/beam/pull/4683 about it Romain Manni-Bucau @rmannibucau | Blog | Old Blog | Github | LinkedIn