Re: Recordings and presentations from Beam Summit London 2018
Thanks for sharing. The YouTube channel link is https://www.youtube.com/channel/UChNnb_YO_7B0HlW6FhAXZZQ Thanks, Manu Zhang On Nov 2, 2018, 11:06 PM +0800, Matthias Baetens , wrote: > Hi everyone, > > Very happy to be sharing the great materials from the speakers and > contributors at the Beam Summit we had in London last month in the new > blogpost on the website: > https://beam.apache.org/blog/2018/10/31/beam-summit-aftermath.html > > You can find the full list of presentations and recordings of the sessions > there, or you can head over to our YouTube channel. > > Thanks for everyone who helped, contributed, was a speaker or sponsor at the > event. > > Best, > Matthias > -- >
Re: Slack invitation
invitation sent to both of you. Welcome ! On Mon, Aug 21, 2017 at 9:56 PM Shekhar Singh wrote: > Me too, please. My email ID is: shekhar.si...@msn.com > > > On 21-Aug-2017, at 7:10 PM, Vilhelm von Ehrenheim > wrote: > > Hi! > Can I get a Slack invitation, please? > > Thanks! > Vilhelm von Ehrenheim > > >
Re: Failed to run Wordcount example
I have seen the same error. There is a word-count-beam subproject under the root from the first command. The project has a different version (0.1) than its parent (2.0.0). It makes all beam dependencies to version 0.1. Once I change the version to 2.0.0, the second command can run successfully. I guess it's problematic to have a different child version than its parent in maven, no? Thanks, Manu On Wed, Aug 16, 2017 at 6:07 PM Vincent Wang wrote: > Oh, that's weird. > I just used a new environment and reproduced this problem. I checked the > network and all the artifacts are correctly fetched except > the beam-sdks-java-extensions-google-cloud-platform-core. > > I noticed maven is trying to resolve > beam-sdks-java-extensions-google-cloud-platform-core-0.1.jar but > > https://repo.maven.apache.org/maven2/org/apache/beam/beam-sdks-java-extensions-google-cloud-platform-core/0.1/beam-sdks-java-extensions-google-cloud-platform-core-0.1.jar > does > not exist. > > I'll have a deeper dig into it. > > Thanks, > Huafeng > > Ismaël Mejía 于2017年8月16日周三 下午4:29写道： > >> I just executed the same commands that you pasted in your email and it >> worked for me, can you verify that you are not having network issues >> while downloading the dependencies with maven ? >> >> On Wed, Aug 16, 2017 at 10:06 AM, Vincent Wang >> wrote: >> > Hi Ismaël, >> > >> > I'm running the command >> > >> > mvn archetype:generate \ >> > -DarchetypeGroupId=org.apache.beam \ >> > -DarchetypeArtifactId=beam-sdks-java-maven-archetypes-examples \ >> > -DarchetypeVersion=2.0.0 \ >> > -DgroupId=org.example \ >> > -DartifactId=word-count-beam \ >> > -Dversion="0.1" \ >> > -Dpackage=org.apache.beam.examples \ >> > -DinteractiveMode=false >> > >> > and >> > >> > mvn compile exec:java >> -Dexec.mainClass=org.apache.beam.examples.WordCount \ >> > -Dexec.args="--inputFile=pom.xml --output=counts" -Pdirect-runner >> > >> > just the way on the quick start page. It seems that the example somehow >> > takes its own version as some beam dependency's version accidentally. >> > >> > BTW, I'm using the latest master branch. >> > >> > Thanks, >> > Huafeng >> > >> > >> > Ismaël Mejía 于2017年8月16日周三 下午3:57写道： >> >> >> >> Hello, >> >> >> >> The error message shows that it is looking for the Beam 0.1 version >> >> and that version does not exist in maven central. >> >> You have to replace the version of Beam in the command you executed >> >> with the latest version that means 2.0.0 at this moment and it should >> >> work. >> >> >> >> Regards, >> >> Ismaël >> >> >> >> >> >> On Wed, Aug 16, 2017 at 8:21 AM, Vincent Wang >> wrote: >> >> > Hi guys, >> >> > >> >> > I'm trying to run the wordcount example according to the quick >> start >> >> > but I >> >> > got following error: >> >> > >> >> > [INFO] >> >> > >> >> >> > [INFO] Building word-count-beam 0.1 >> >> > [INFO] >> >> > >> >> >> > [WARNING] The POM for org.eclipse.m2e:lifecycle-mapping:jar:1.0.0 is >> >> > missing, no dependency information available >> >> > [WARNING] Failed to retrieve plugin descriptor for >> >> > org.eclipse.m2e:lifecycle-mapping:1.0.0: Plugin >> >> > org.eclipse.m2e:lifecycle-mapping:1.0.0 or one of its dependencies >> could >> >> > not >> >> > be resolved: Failure to find >> org.eclipse.m2e:lifecycle-mapping:jar:1.0.0 >> >> > in >> >> > https://repo.maven.apache.org/maven2 was cached in the local >> repository, >> >> > resolution will not be reattempted until the update interval of >> central >> >> > has >> >> > elapsed or updates are forced >> >> > [WARNING] The POM for org.apache.beam:beam-sdks-java-core:jar:0.1 is >> >> > missing, no dependency information available >> >> > [WARNING] The POM for >> >> > >> >> > >> org.apache.beam:beam-sdks-java-extensions-google-cloud-platform-core:jar:0.1 >> >> > is missing, no dependency information available >> >> > [WARNING] The POM for >> >> > org.apache.beam:beam-sdks-java-extensions-protobuf:jar:0.1 is >> missing, >> >> > no >> >> > dependency information available >> >> > [INFO] >> >> > >> >> >> > [INFO] BUILD FAILURE >> >> > [INFO] >> >> > >> >> >> > [INFO] Total time: 0.960 s >> >> > [INFO] Finished at: 2017-08-16T14:14:42+08:00 >> >> > [INFO] Final Memory: 18M/309M >> >> > [INFO] >> >> > >> >> >> > [ERROR] Failed to execute goal on project word-count-beam: Could not >> >> > resolve >> >> > dependencies for project org.example:word-count-beam:jar:0.1: The >> >> > following >> >> > artifacts could not be resolved: >> >> > >> >> > >> org.apache.beam:beam-sdks-java-extensions-google-cloud-platform-core:jar:0.1, >> >> > org.apache.bea
Re: Slack channel
Invitation sent. Welcome. On Wed, Aug 16, 2017 at 11:41 AM shen yu wrote: > Hi, I'd like to join the Slack channel for Apache Beam. I work at Klook > and would like to get involved in the Apache Beam community. My email is > you...@klook.com >
Re: Left join
Hi Prabeesh,
You may checkout
https://github.com/apache/beam/blob/master/sdks/java/extensions/join-library/src/main/java/org/apache/beam/sdk/extensions/joinlibrary/Join.java
for
reference.
Thanks,
Manu
On Mon, Jul 31, 2017 at 3:40 PM Prabeesh K. wrote:
> pcoll1 = [('key1', [values]), ('key2', [values])]
>
> pcoll2 = [('key1', value), ('key3', value)]
>
>
> On 31 July 2017 at 11:21, Prabeesh K. wrote:
>
>> Hi,
>>
>> help me to improve the left Joiner. Is this the right way to join the
>> Pcollection in the beam ?
>>
>>
>> pcoll1 = ..
>> pcoll2 = ..
>>
>> left_joined = (
>> {'left': pcoll1, 'right': pcoll2}
>> | 'LeftJoiner: Combine' >> beam.CoGroupByKey()
>> | 'LeftJoiner: ExtractValues' >> beam.Values()
>> | 'LeftJoiner: JoinValues' >> beam.ParDo(LeftJoinerFn())
>> )
>>
>> class LeftJoinerFn(beam.DoFn):
>>
>> def __init__(self):
>> super(LeftJoinerFn, self).__init__()
>>
>> def process(self, row, **kwargs):
>>
>> left = row['left']
>> right = row['right']
>>
>> if left and right:
>> for each in left:
>> yield each + right[0]
>>
>> elif left:
>> for each in left:
>> yield each
>>
>>
>
Re: Slack Invite
Hi Saravana, You've been invited. On Thu, Jul 6, 2017 at 9:43 PM Durairaj, Saravanakumar < saravanakumar_durai...@homedepot.com> wrote: > Hi, > > > > I would like to join the slack channel. > > > > Thank you, > > Saravana > > -- > > The information in this Internet Email is confidential and may be legally > privileged. It is intended solely for the addressee. Access to this Email > by anyone else is unauthorized. If you are not the intended recipient, any > disclosure, copying, distribution or any action taken or omitted to be > taken in reliance on it, is prohibited and may be unlawful. When addressed > to our clients any opinions or advice contained in this Email are subject > to the terms and conditions expressed in any applicable governing The Home > Depot terms of business or client engagement letter. The Home Depot > disclaims all responsibility and liability for the accuracy and content of > this attachment and for any damages or losses arising from any > inaccuracies, errors, viruses, e.g., worms, trojan horses, etc., or other > items of a destructive nature, which may be contained in this attachment > and shall not be liable for direct, indirect, consequential or special > damages in connection with this e-mail message or its attachment. >
Re: Regarding Beam Slack Channel
Welcome Ratnakar!!! On Sat, Jun 24, 2017 at 10:18 AM Ratnakar Malla wrote: > Hello Manu, > Can you please invite me to the slack channel as well. > Thanks > Ratnakar > > On Fri, Jun 23, 2017 at 5:44 PM, Manu Zhang > wrote: > >> Sent to both of you >> >> On Sat, Jun 24, 2017 at 4:03 AM Hillerman, Carl < >> carl_hiller...@homedepot.com> wrote: >> >>> Ditto >>> >>> >>> >>> *Carl Hillerman | Staff Software Engineer* >>> >>> *The **Home** Depot *| *S*tore Support *C*enter >>> >>> Email: carl_hiller...@homedepot.com >>> >>> Office: (770)433-8211 <(770)%20433-8211> | Extn: 24292 >>> >>> Jabber: (470)689-4292 <(470)%20689-4292> >>> >>> >>> >>> *From: *Jyotirmoy Sundi >>> *Reply-To: *"user@beam.apache.org" >>> *Date: *Friday, June 23, 2017 at 4:00 PM >>> *To: *"user@beam.apache.org" >>> *Subject: *Re: Regarding Beam Slack Channel >>> >>> >>> >>> Hi Manu, >>> >>> May you please also send to me ? >>> >>> >>> >>> On Fri, Jun 23, 2017 at 4:31 AM, Manu Zhang >>> wrote: >>> >>> Hey Kamil, >>> >>> >>> >>> Just sent you an invitation. >>> >>> >>> >>> >>> >>> On Fri, Jun 23, 2017 at 6:38 PM Kamil Szewczyk >>> wrote: >>> >>> Hello, >>> >>> Can someone please add me to the Beam slack channel? >>> >>> Thanks. >>> >>> >>> >>> >>> >>> -- >>> >>> Best Regards, >>> Jyotirmoy Sundi >>> >>> >>> >>> -- >>> >>> The information in this Internet Email is confidential and may be >>> legally privileged. It is intended solely for the addressee. Access to this >>> Email by anyone else is unauthorized. If you are not the intended >>> recipient, any disclosure, copying, distribution or any action taken or >>> omitted to be taken in reliance on it, is prohibited and may be unlawful. >>> When addressed to our clients any opinions or advice contained in this >>> Email are subject to the terms and conditions expressed in any applicable >>> governing The Home Depot terms of business or client engagement letter. The >>> Home Depot disclaims all responsibility and liability for the accuracy and >>> content of this attachment and for any damages or losses arising from any >>> inaccuracies, errors, viruses, e.g., worms, trojan horses, etc., or other >>> items of a destructive nature, which may be contained in this attachment >>> and shall not be liable for direct, indirect, consequential or special >>> damages in connection with this e-mail message or its attachment. >>> >> >
Re: Regarding Beam Slack Channel
Sent to both of you On Sat, Jun 24, 2017 at 4:03 AM Hillerman, Carl < carl_hiller...@homedepot.com> wrote: > Ditto > > > > *Carl Hillerman | Staff Software Engineer* > > *The **Home** Depot *| *S*tore Support *C*enter > > Email: carl_hiller...@homedepot.com > > Office: (770)433-8211 <(770)%20433-8211> | Extn: 24292 > > Jabber: (470)689-4292 <(470)%20689-4292> > > > > *From: *Jyotirmoy Sundi > *Reply-To: *"user@beam.apache.org" > *Date: *Friday, June 23, 2017 at 4:00 PM > *To: *"user@beam.apache.org" > *Subject: *Re: Regarding Beam Slack Channel > > > > Hi Manu, > > May you please also send to me ? > > > > On Fri, Jun 23, 2017 at 4:31 AM, Manu Zhang > wrote: > > Hey Kamil, > > > > Just sent you an invitation. > > > > > > On Fri, Jun 23, 2017 at 6:38 PM Kamil Szewczyk wrote: > > Hello, > > Can someone please add me to the Beam slack channel? > > Thanks. > > > > > > -- > > Best Regards, > Jyotirmoy Sundi > > > > -- > > The information in this Internet Email is confidential and may be legally > privileged. It is intended solely for the addressee. Access to this Email > by anyone else is unauthorized. If you are not the intended recipient, any > disclosure, copying, distribution or any action taken or omitted to be > taken in reliance on it, is prohibited and may be unlawful. When addressed > to our clients any opinions or advice contained in this Email are subject > to the terms and conditions expressed in any applicable governing The Home > Depot terms of business or client engagement letter. The Home Depot > disclaims all responsibility and liability for the accuracy and content of > this attachment and for any damages or losses arising from any > inaccuracies, errors, viruses, e.g., worms, trojan horses, etc., or other > items of a destructive nature, which may be contained in this attachment > and shall not be liable for direct, indirect, consequential or special > damages in connection with this e-mail message or its attachment. >
Re: Regarding Beam Slack Channel
Hey Kamil, Just sent you an invitation. On Fri, Jun 23, 2017 at 6:38 PM Kamil Szewczyk wrote: > Hello, > > Can someone please add me to the Beam slack channel? > > Thanks. >
