Re: [GSoC2022] Interest in contributing to Runner Comparison / Capability Matrix revamp

2022-04-19 Thread Ais K
will pass the selection and be able to join the >> Apache Beam Community and gain my first experience in contributing to an >> open-source project. >> >> Thank you. >> >> Best Regards, >> Aisulu Karimbaeva ㅣ 이수아 >> Tel: +82 10 2748 1605 <+82%2010-2748-1605> >> Email: alive.k...@gmail.com >> >> >>

[GSoC2022] Interest in contributing to Runner Comparison / Capability Matrix revamp

2022-04-17 Thread Ais K
ticipating in an open-source project. So I really hope that I will pass the selection and be able to join the Apache Beam Community and gain my first experience in contributing to an open-source project. Thank you. Best Regards, Aisulu Karimbaeva ㅣ 이수아 Tel: +82 10 2748 1605 Email: alive.k...@gmail.com

Contributing to BEAM-11956

2021-08-23 Thread Sebastian Montero
/questions/66553275/i-get-504-deadline-exceeded-in-apache-beam-using-readfromspanner/68836916#68836916 On the Stack Overflow thread above @Chamikara suggested to contribute to the Apache Beam library which I would be more than happy to do; however, this is my first time contributing to the library

Intro to Beam and Contributing Workshops

2020-07-19 Thread Austin Bennett
Hi All, I'm a huge fan of HOPE <https://www.hope.net>. In the virtual edition this year, I am giving 2 talks. * a 2hr introduction to Beam. * a 1hr introduction to contributing to open source (with specific examples from Beam). These to occur on 30/31 July, schedule found:

Re: Contributing to Beam Go-SDK Roadmap tickets

2020-07-06 Thread Adham Ehab
n the Repo are accurate for setting up a good client for Go > SDK work: > https://github.com/apache/beam/blob/master/sdks/go/README.md#contributing-to-the-go-sdk. > > Thank you for bearing with this information dump. I know it's a lot. > I look forward to seeing what you come up wit

Re: Contributing to Beam Go-SDK Roadmap tickets

2020-07-06 Thread Robert Burke
has the contribution instructions. The Go SDK instructions in the Repo are accurate for setting up a good client for Go SDK work: https://github.com/apache/beam/blob/master/sdks/go/README.md#contributing-to-the-go-sdk . Thank you for bearing with this information dump. I know it's a lot. I look

Contributing to Beam Go-SDK Roadmap tickets

2020-07-05 Thread Adham Ehab
Hi Robert Burke, Hope this email finds you and your loved one safe! Based on beam road map found here and the Jira board. All of BEAM-3304 , BEAM-4152

Re: Contributing Twister2 runner to Apache Beam

2020-04-03 Thread Pulasthi Supun Wickramasinghe
Hi Ismaël, Thanks for the update, No problem at all, please take your time and let me know if my assistance is needed, The virus has affected everyone's timetables. I hope you are safe. Best Regards, Pulasthi On Fri, Apr 3, 2020 at 12:14 PM Ismaël Mejía wrote: > Hello Pulasthi, > > Please

Re: Contributing Twister2 runner to Apache Beam

2020-04-03 Thread Ismaël Mejía
Hello Pulasthi, Please excuse me for my delay, I have probably 1/3 of my common available time since the coronavirus lockdown so I have not advanced as expected. I hope to catch up rapidly and ping you. Our expected target of merging it before the 2.21.0 release seems to be hard to get at this

Re: Contributing Twister2 runner to Apache Beam

2020-04-02 Thread Pulasthi Supun Wickramasinghe
Hi Ismaël Did you get some free time to perform a code review on the pull request Best Regards Pulasthi On Tue, Mar 10, 2020 at 3:30 PM Luke Cwik wrote: > I have to disagree. Allowing for runners within the Apache Beam repo and > SDKs that reach into the implementation details of each other

Re: [Newbie Contributing Question] How to add a dependency?

2020-03-17 Thread Jacob Ferriero
It seemed to be something I had wrong locally in my IntelliJ setup. I got past this. Thanks for your help! On Thu, Mar 12, 2020 at 11:10 AM Tomo Suzuki wrote: > Jacob, > > It works fine for me. > https://gist.github.com/suztomo/d90951a2c028c7406d87b13bd43e6eaa > Do you want to share the output?

Re: [Newbie Contributing Question] How to add a dependency?

2020-03-12 Thread Tomo Suzuki
Jacob, It works fine for me. https://gist.github.com/suztomo/d90951a2c028c7406d87b13bd43e6eaa Do you want to share the output? On Wed, Mar 11, 2020 at 8:49 PM Jacob Ferriero wrote: > Thanks that was helpful in getting my dependencies added! > I am not having a an issue where the testCompile

Re: [Newbie Contributing Question] How to add a dependency?

2020-03-11 Thread Jacob Ferriero
Thanks that was helpful in getting my dependencies added! I am not having a an issue where the testCompile dependencies such as junit aren't getting resolved when running ``` ./gradlew -p sdks/java/io/google-cloud-platform/ test ``` I didn't touch these. Is there some place I have to add new

Re: [Newbie Contributing Question] How to add a dependency?

2020-03-10 Thread Tomo Suzuki
Hi Jacob, You'll need to modify BeamModulePlugin.groovy, which defines a big map of Maven artifacts. The map is referenced by each module such as the google-cloud-platform/build.gradle. Example PR to touch dependencies: https://github.com/apache/beam/pull/11063/files On Tue, Mar 10, 2020 at

[Newbie Contributing Question] How to add a dependency?

2020-03-10 Thread Jacob Ferriero
Hi beam dev list, Hoping to find some pointers on how to best add a dependency for a new GCP IO connector. Specifically I want to add a dependency on the Cloud Healthcare API or the equivalent of this section of a maven pom.xml: ```xml v1alpha2-rev20190901-1.30.1 1.30.1

Re: Contributing Twister2 runner to Apache Beam

2020-03-10 Thread Luke Cwik
I have to disagree. Allowing for runners within the Apache Beam repo and SDKs that reach into the implementation details of each other are usability, feature development, maintenance and complexity problems. The usability issue comes from our public core facing APIs exposing methods that runners

Re: Contributing Twister2 runner to Apache Beam

2020-03-10 Thread Kenneth Knowles
I do support all the efforts to get Dataflow, Flink, and Spark to 3 (Fn API). But I disagree with it as a requirement; the whole point of ptransforms with URNs is that if the runner can figure out how to execute it according to semantics, then it is fine. A runner meets (1) and (2) but can only

Re: Contributing Twister2 runner to Apache Beam

2020-03-10 Thread Luke Cwik
I would like to move away from having runners access APIs that are related to pipeline construction and other internal SDK APIs and I would like for SDKs to not inspect internal runner APIs. This would enable the community to improve each independently without needing to fix the world all the time

Re: Contributing Twister2 runner to Apache Beam

2020-03-10 Thread Kenneth Knowles
There are a lot of different meanings to "portable runner". Here are some: (1) A runner that accepts a pipeline proto and either runs it or says it cannot run it (2) A runner that accepts jobs via the job management APIs (3) A runner that executes UDFs via the Fn API (4) A runner that can execute

Re: Contributing Twister2 runner to Apache Beam

2020-03-10 Thread Luke Cwik
+1 On Tue, Mar 10, 2020 at 12:59 AM Alex Van Boxel wrote: > One last thing, for any runner after this one... wouldn't it be a good > acceptance criteria to only accept portable implementations anymore? > > _/ > _/ Alex Van Boxel > > > On Mon, Mar 9, 2020 at 10:42 PM Ismaël Mejía wrote: > >>

Re: Contributing Twister2 runner to Apache Beam

2020-03-10 Thread Alex Van Boxel
One last thing, for any runner after this one... wouldn't it be a good acceptance criteria to only accept portable implementations anymore? _/ _/ Alex Van Boxel On Mon, Mar 9, 2020 at 10:42 PM Ismaël Mejía wrote: > Good points Kenn. I think we mostly agree on what has been discussed in >

Re: Contributing Twister2 runner to Apache Beam

2020-03-09 Thread Ismaël Mejía
Good points Kenn. I think we mostly agree on what has been discussed in this thread the pros/cons of having runners on our repository, but this is probably not the best moment in time to change any policy in that aspect. So if nobody objects I think we can proceed. I am OOO this week so with less

Re: Contributing Twister2 runner to Apache Beam

2020-03-08 Thread Kenneth Knowles
I haven't heard anyone suggest that we need a vote. I haven't heard anyone object to this being merged to master. Some time ago, we mostly decided to favor master instead of branches, because it is so much smoother for contributors and users. So I am poking this thread one last time and otherwise

Re: Contributing Twister2 runner to Apache Beam

2020-03-06 Thread Pulasthi Supun Wickramasinghe
I understand that the discussion is on a more broad level than the Twister2 runner. From my experience developing the runner the main advantage of being inside the beam project was the easy access to the wide range of tests and other core/utility code as Kyle pointed out. Unmerging runners that

Re: Contributing Twister2 runner to Apache Beam

2020-03-05 Thread Robert Bradshaw
I think we will get to a point where it makes sense for runners to live in their own repositories, with their own release cadence, but we're not at that point yet. One prerequisite is a stable API--we're closing in on that with the portability protos, but many (java) runners actually share the

Re: Contributing Twister2 runner to Apache Beam

2020-03-05 Thread Kenneth Knowles
I agree with both of you, mostly :-) The monorepo approach doesn't work/scale well for shipped libraries (name a Google library that silently just works and never causes any dependency problems) and the pain we feel has been constant and increasing, but I don't think we are at the breaking point.

Re: Contributing Twister2 runner to Apache Beam

2020-03-04 Thread Kyle Weaver
> Should runners, current and future, be in the same repository as Beam > core? In the distant past, runners lived in their own repositories, and then were donated to Beam. But Beam's current uber-repo setup allows a lot of convenience. For example, a ton of code (including core functionality and

Re: Contributing Twister2 runner to Apache Beam

2020-03-04 Thread Elliotte Rusty Harold
Generic question without commenting on Twister2 specifically: Should runners, current and future, be in the same repository as Beam core? Can or should they be completely separate products with their own release cycles? Generally, loose coupling leads to more maintainable, reliable projects.

Re: Contributing Twister2 runner to Apache Beam

2020-03-04 Thread Pulasthi Supun Wickramasinghe
Hi I believe the pull request is pretty complete now with the help of Ismaël. Kenn, would you be able to take a look at it and suggest any changes if needed?. The build checks and validations tests are passing at the moment. I will start working on the documentation that you mentioned in an

Contributing Twister2 runner to Apache Beam

2020-02-18 Thread Pulasthi Supun Wickramasinghe
Hi All, I have created the initial pull request [1] to contribute the Twister2 Beam runner to the Apache Beam codebase. More information on Twister2 can be found here[2] and the Twister2 codebase is available here[3]. At the moment only batch mode is supported in the runner, but we are planning

Re: Cassandra IO issues and contributing

2020-01-11 Thread Vincent Marquez
I have opened up a PR for BEAM-9008. I wasn't sure if I should initiate any 'checks' from CI on the PR, so please let me know if I need to and any other changes/issues. Thanks. On Fri, Dec 20, 2019 at 7:20 AM Ismaël Mejía wrote: > For ref this is the JIRA ticket >

Re: Cassandra IO issues and contributing

2019-12-20 Thread Ismaël Mejía
For ref this is the JIRA ticket https://issues.apache.org/jira/browse/BEAM-9008 The improvement makes total sense and the change in the internal implementation from BoundedSource to ParDo has no backwards consequences for the final users so looks good. This connector does not support Dynamic Work

Re: Cassandra IO issues and contributing

2019-12-19 Thread Vincent Marquez
On Thu, Dec 12, 2019 at 8:43 PM Kenneth Knowles wrote: > On Thu, Dec 12, 2019 at 3:30 PM Vincent Marquez > wrote: > >> Hello, as I've mentioned in previous emails, I've found the CassandraIO >> connector lacking some essential features for efficient batch processing in >> real world scenarios.

Re: Unifying Build/contributing instructions

2019-12-19 Thread Udi Meiri
+1 for website focus On Thu, Dec 19, 2019 at 10:22 AM Elliotte Rusty Harold wrote: > That's two votes for > https://beam.apache.org/contribute/contribution-guide/ and a lot of > abstentions. I'll update the PR to move content to > https://beam.apache.org/contribute/contribution-guide/ > > On

Re: Unifying Build/contributing instructions

2019-12-19 Thread Elliotte Rusty Harold
That's two votes for https://beam.apache.org/contribute/contribution-guide/ and a lot of abstentions. I'll update the PR to move content to https://beam.apache.org/contribute/contribution-guide/ On Thu, Dec 19, 2019 at 12:29 PM Luke Cwik wrote: > > +1 on Kenn's suggestion. > > On Thu, Dec 12,

Re: Unifying Build/contributing instructions

2019-12-19 Thread Luke Cwik
+1 on Kenn's suggestion. On Thu, Dec 12, 2019 at 8:17 PM Kenneth Knowles wrote: > Thanks for taking this on! My preference would be to have CONTRIBUTING.md > link to https://beam.apache.org/contribute/contribution-guide/ and focus > work on the latter. > > Kenn > > On Thu, Dec 12, 2019 at 12:38

Re: Cassandra IO issues and contributing

2019-12-12 Thread Kenneth Knowles
On Thu, Dec 12, 2019 at 3:30 PM Vincent Marquez wrote: > Hello, as I've mentioned in previous emails, I've found the CassandraIO > connector lacking some essential features for efficient batch processing in > real world scenarios. We've developed a more fully featured connector and > had good

Re: Unifying Build/contributing instructions

2019-12-12 Thread Kenneth Knowles
Thanks for taking this on! My preference would be to have CONTRIBUTING.md link to https://beam.apache.org/contribute/contribution-guide/ and focus work on the latter. Kenn On Thu, Dec 12, 2019 at 12:38 PM Elliotte Rusty Harold wrote: > I've started work on updating and combine the four (or

Cassandra IO issues and contributing

2019-12-12 Thread Vincent Marquez
Hello, as I've mentioned in previous emails, I've found the CassandraIO connector lacking some essential features for efficient batch processing in real world scenarios. We've developed a more fully featured connector and had good results with it. Could I perhaps write up a JIRA proposal for

Unifying Build/contributing instructions

2019-12-12 Thread Elliotte Rusty Harold
I've started work on updating and combine the four (or omre?) different pages where build instructions are found. The initial PR is here: https://github.com/apache/beam/pull/10366 To put a stake in the ground, this PR chooses CONTRIBUTING.md as the ultimate source of truth. A possible

Re: Contributing to Beam javadoc

2019-11-07 Thread Luke Cwik
Welcome and I just merged your PR. On Wed, Nov 6, 2019 at 1:15 PM Ismaël Mejía wrote: > Done, you can now self assign issues too, welcome Jonathan! > > On Wed, Nov 6, 2019 at 10:00 PM Jonathan Alvarez-Gutierrez > wrote: > > > > Hey, > > > > I just filed

Re: Contributing to Beam javadoc

2019-11-06 Thread Ismaël Mejía
Done, you can now self assign issues too, welcome Jonathan! On Wed, Nov 6, 2019 at 10:00 PM Jonathan Alvarez-Gutierrez wrote: > > Hey, > > I just filed https://issues.apache.org/jira/browse/BEAM-8573 and wanted to > create a PR with a fix. > > I should also check if there's an extant

Contributing to Beam javadoc

2019-11-06 Thread Jonathan Alvarez-Gutierrez
Hey, I just filed https://issues.apache.org/jira/browse/BEAM-8573 and wanted to create a PR with a fix. I should also check if there's an extant documentation / Splittable DoFn project that would pre-empt or subsume my teeny documentation fix. If not, I'd like to assign the issue to

Re: Pointers on Contributing to Structured Streaming Spark Runner

2019-09-24 Thread Alexey Romanenko
I don’t see any updates on my calendar. Does it work for others? > On 19 Sep 2019, at 17:16, Ismaël Mejía wrote: > > 25/09 looks ok. I just updated the meeting invitation to the new > date.I will prepare a mini agenda in the shared minute document in the > meantime. > I cannot see the old

Re: Pointers on Contributing to Structured Streaming Spark Runner

2019-09-24 Thread Vishwas Bm
Hi Ismael, Can you also add me to this meeting. I would also like to contribute. Regards, Vishwas On 2019/09/19 12:13:40, Etienne Chauchot wrote: > Hi Rahul and Xinyu,I just added you to the list of guests in the meeting. > Time is 5pm GMT +2. That being said, for some > reason last meeting

Re: Pointers on Contributing to Structured Streaming Spark Runner

2019-09-19 Thread Ismaël Mejía
25/09 looks ok. I just updated the meeting invitation to the new date.I will prepare a mini agenda in the shared minute document in the meantime. I cannot see the old invitees, can someone please confirm me they see the date updated. Thanks, Ismaël On Thu, Sep 19, 2019 at 2:13 PM Etienne Chauchot

Re: Pointers on Contributing to Structured Streaming Spark Runner

2019-09-18 Thread rahul patwari
Hi, I would love to join the call. Can you also share the meeting invitation with me? Thanks, Rahul On Wed 18 Sep, 2019, 11:48 PM Xinyu Liu, wrote: > Alexey and Etienne: I'm very happy to join the sync-up meeting. Please > forward the meeting info to me. I am based in California, US and

Re: Pointers on Contributing to Structured Streaming Spark Runner

2019-09-18 Thread Xinyu Liu
Alexey and Etienne: I'm very happy to join the sync-up meeting. Please forward the meeting info to me. I am based in California, US and hopefully the time will work :). Thanks, Xinyu On Wed, Sep 18, 2019 at 6:39 AM Etienne Chauchot wrote: > Hi Xinyu, > > Thanks for offering help ! My comments

Re: Pointers on Contributing to Structured Streaming Spark Runner

2019-09-18 Thread Etienne Chauchot
Hi Xinyu, Thanks for offering help ! My comments are inline: Le vendredi 13 septembre 2019 à 12:16 -0700, Xinyu Liu a écrit : > Hi, Etienne, > The slides are very informative! Thanks for sharing the details about how the > Beam API are mapped into Spark > Structural Streaming. Thanks ! > We

Re: Pointers on Contributing to Structured Streaming Spark Runner

2019-09-18 Thread Etienne Chauchot
Hi Rui,Thanks for proposing to contribute to this new runner ! Here are the pointers:- SS runner branch: https://github.com/apache/beam/tree/spark-runner_structured-streaming- spark design doc for multiple watermarks support:

Re: Pointers on Contributing to Structured Streaming Spark Runner

2019-09-17 Thread Rui Wang
+1 on merging the runner into master, which make it more discoverable and easy to contribute (I am also interested in contributing). -Rui On Tue, Sep 17, 2019 at 3:36 AM Alexey Romanenko wrote: > Hi Xinyu, > > Great to hear that you wish to contribute into new Spark runner! We used

Re: Pointers on Contributing to Structured Streaming Spark Runner

2019-09-17 Thread Alexey Romanenko
Hi Xinyu, Great to hear that you wish to contribute into new Spark runner! We used to have the sync meetings about all Spark runners in general every two weeks, so feel free to let know us if you want to participate too. Also, as one of the contributors for Structural Streaming Spark runner

Re: Pointers on Contributing to Structured Streaming Spark Runner

2019-09-13 Thread Xinyu Liu
Hi, Etienne, The slides are very informative! Thanks for sharing the details about how the Beam API are mapped into Spark Structural Streaming. We (LinkedIn) are also interested in trying the new SparkRunner to run Beam pipeine in batch, and contribute to it too. From my understanding, seems the

Re: Pointers on Contributing to Structured Streaming Spark Runner

2019-09-11 Thread Rui Wang
Hello Etienne, Your slide mentioned that streaming mode development is blocked because Spark lacks supporting multiple-aggregations in its streaming mode but design is ongoing. Do you have a link or something else to their design discussion/doc? -Rui On Wed, Sep 11, 2019 at 5:10 PM Etienne

Re: Contributing Beam Kata (Java & Python)

2019-05-22 Thread hsuryawirawan
Btw the Beam Kata courses have been reviewed and endorsed by JetBrains on Stepik. They are now featured courses, which adds more credibility when the students browse the available courses. JetBrains is also interested to come up with promotion activities to promote the courses. Will inform here

Re: Contributing Beam Kata (Java & Python)

2019-05-15 Thread Henry Suryawirawan
Hi Austin, Yes I agree with you that we need to come up with the publishing process. We should publish to Stepik only if it has been merged to master. I can add more authors & instructors to the courses on Stepik so that more people can update the courses. I uploaded the initial version to Stepik

Re: Contributing Beam Kata (Java & Python)

2019-05-15 Thread Henry Suryawirawan
Sure, let me try to write one. I've created a JIRA for it: https://issues.apache.org/jira/browse/BEAM-7332 *From: *Pablo Estrada *Date: *Thu, May 16, 2019 at 2:20 AM *To: *dev I think a blog post is a great idea. Would you be able to write one? > See here for an example of a PR adding one: >

Re: Contributing Beam Kata (Java & Python)

2019-05-15 Thread Pablo Estrada
I think a blog post is a great idea. Would you be able to write one? See here for an example of a PR adding one: https://github.com/apache/beam/pull/8391 Best -P. *From: *hsuryawira...@google.com *Date: *Wed, May 15, 2019, 12:51 AM *To: * Thanks for merging it Reuven! > > Quick question,

Re: Contributing Beam Kata (Java & Python)

2019-05-15 Thread Austin Bennett
Stepik: should we thinking about release versions for what gets uploaded there? If the point of merging was to encourage additional contributions - then should we also have a mechanism for publishing the updates there? In that case, then uploading to stepik should be part of publishing releases?

Re: Contributing Beam Kata (Java & Python)

2019-05-14 Thread hsuryawirawan
Thanks for merging it Reuven! Quick question, would it be useful if we write a blog post on the Kata so that we can build more awareness for people to try out? I've also uploaded the course to Stepik which has seamless integration within the IDE for people to easily start the course. On

Re: Contributing Beam Kata (Java & Python)

2019-05-14 Thread Reuven Lax
Merged *From: *Reza Rokni *Date: *Tue, May 14, 2019 at 1:29 PM *To: * *Cc: *Lars Francke +1 :-) > > *From: *Lukasz Cwik > *Date: *Wed, 15 May 2019 at 04:29 > *To: *dev > *Cc: *Lars Francke > > +1 >> >> *From: *Pablo Estrada >> *Date: *Tue, May 14, 2019 at 1:27 PM >> *To: *dev >> *Cc: *Lars

Re: Contributing Beam Kata (Java & Python)

2019-05-14 Thread Lukasz Cwik
+1 *From: *Pablo Estrada *Date: *Tue, May 14, 2019 at 1:27 PM *To: *dev *Cc: *Lars Francke +1 on merging. > > *From: *Reuven Lax > *Date: *Tue, May 14, 2019 at 1:23 PM > *To: *dev > *Cc: *Lars Francke > > I've been playing around with this that past day .or two, and it's great! >> I'm inclined

Re: Contributing Beam Kata (Java & Python)

2019-05-14 Thread Reuven Lax
I've been playing around with this that past day .or two, and it's great! I'm inclined to merge this PR (if nobody objects) so that others in the community can contribute more training katas. Reuven *From: *Ismaël Mejía *Date: *Tue, Apr 23, 2019 at 6:43 AM *To: *Lars Francke *Cc: * Thanks for

Re: Contributing Beam Kata (Java & Python)

2019-05-14 Thread Reza Rokni
+1 :-) *From: *Lukasz Cwik *Date: *Wed, 15 May 2019 at 04:29 *To: *dev *Cc: *Lars Francke +1 > > *From: *Pablo Estrada > *Date: *Tue, May 14, 2019 at 1:27 PM > *To: *dev > *Cc: *Lars Francke > > +1 on merging. >> >> *From: *Reuven Lax >> *Date: *Tue, May 14, 2019 at 1:23 PM >> *To: *dev >>

Re: Contributing Beam Kata (Java & Python)

2019-05-14 Thread Henry Suryawirawan
I have uploaded the Kata to Stepik which allows a seamless setup directly from the IDE. Please refer to the following comment for an updated instruction on how to set it up on your machine. https://github.com/apache/beam/pull/8358#issuecomment-492296450 On 2019/04/19 11:16:22, hs...@google.com

Re: Contributing to Beam

2019-05-07 Thread Shehzaad Nakhoda
Thanks all! On Mon, May 6, 2019 at 2:34 PM Lukasz Cwik wrote: > Welcome. > > On Mon, May 6, 2019 at 2:23 PM Reuven Lax wrote: > >> Welcome! >> >> On Mon, May 6, 2019 at 2:15 PM Kenneth Knowles wrote: >> >>> Welcome! >>> >>> On Mon, May 6, 2019 at 9:20 AM Ahmet Altay wrote: >>> Welcome

Re: Contributing to Beam

2019-05-06 Thread Lukasz Cwik
Welcome. On Mon, May 6, 2019 at 2:23 PM Reuven Lax wrote: > Welcome! > > On Mon, May 6, 2019 at 2:15 PM Kenneth Knowles wrote: > >> Welcome! >> >> On Mon, May 6, 2019 at 9:20 AM Ahmet Altay wrote: >> >>> Welcome Shehzaad! >>> >>> *From: *Ismaël Mejía >>> *Date: *Sat, May 4, 2019 at 2:30 PM

Re: Contributing to Beam

2019-05-06 Thread Reuven Lax
Welcome! On Mon, May 6, 2019 at 2:15 PM Kenneth Knowles wrote: > Welcome! > > On Mon, May 6, 2019 at 9:20 AM Ahmet Altay wrote: > >> Welcome Shehzaad! >> >> *From: *Ismaël Mejía >> *Date: *Sat, May 4, 2019 at 2:30 PM >> *To: * >> >> Done, welcome! >>> >>> On Sat, May 4, 2019 at 3:43 AM

Re: Contributing to Beam

2019-05-06 Thread Kenneth Knowles
Welcome! On Mon, May 6, 2019 at 9:20 AM Ahmet Altay wrote: > Welcome Shehzaad! > > *From: *Ismaël Mejía > *Date: *Sat, May 4, 2019 at 2:30 PM > *To: * > > Done, welcome! >> >> On Sat, May 4, 2019 at 3:43 AM Shehzaad Nakhoda >> wrote: >> >>> Hello >>> >>> I’m hoping to work with Rueven Lax

Re: Contributing to Beam

2019-05-06 Thread Ahmet Altay
Welcome Shehzaad! *From: *Ismaël Mejía *Date: *Sat, May 4, 2019 at 2:30 PM *To: * Done, welcome! > > On Sat, May 4, 2019 at 3:43 AM Shehzaad Nakhoda > wrote: > >> Hello >> >> I’m hoping to work with Rueven Lax (Google) on some enhancements and >> existing issues. >> >> I would appreciate the

Re: Contributing to Beam

2019-05-04 Thread Ismaël Mejía
Done, welcome! On Sat, May 4, 2019 at 3:43 AM Shehzaad Nakhoda wrote: > Hello > > I’m hoping to work with Rueven Lax (Google) on some enhancements and > existing issues. > > I would appreciate the ability to create and assign tickets to myself. > > My JIRA ID is shehzaadn. > > Thanks in

Contributing to Beam

2019-05-03 Thread Shehzaad Nakhoda
Hello I’m hoping to work with Rueven Lax (Google) on some enhancements and existing issues. I would appreciate the ability to create and assign tickets to myself. My JIRA ID is shehzaadn. Thanks in advance! -- [image: VentureDive] *Shehzaad Nakhoda* Chief Technology Officer

Re: Contributing Beam Kata (Java & Python)

2019-04-23 Thread Ismaël Mejía
Thanks for answering Lars, The 'interesting' part is that the tutorial has a full IDE integrated experience based on the Jetbrains edu platform [1]. So maybe interesting to see if it could make sense to have projects like this in the new trainings incubator project or if they became too platform

Re: Contributing Beam Kata (Java & Python)

2019-04-23 Thread Lars Francke
Thanks Ismaël. I must admit I'm a tad confused. What has JetBrains got to do with this? This looks pretty cool and specific to Beam though, or is this more generic? But yeah something along those lines could be interesting for hands-on type things in training. On Fri, Apr 19, 2019 at 12:10 PM

Re: Contributing Beam Kata (Java & Python)

2019-04-20 Thread Willem Pienaar
Awesome work Henry!! On Fri, Apr 19, 2019, at 7:16 PM, hsuryawira...@google.com wrote: > I've created a PR for the Beam Kata. > https://github.com/apache/beam/pull/8358 > > If you're interested to experience it, please find the instruction on > how to set it up on your machine >

Re: Contributing Beam Kata (Java & Python)

2019-04-19 Thread hsuryawirawan
I've created a PR for the Beam Kata. https://github.com/apache/beam/pull/8358 If you're interested to experience it, please find the instruction on how to set it up on your machine https://github.com/apache/beam/pull/8358#issuecomment-484855236 Should you have any issue or further question,

Re: Contributing Beam Kata (Java & Python)

2019-04-19 Thread Ismaël Mejía
+lars.fran...@gmail.com who is in the Apache training project and may be interested in this one or at least the JetBrains like approach. On Fri, Apr 19, 2019 at 12:01 PM Ismaël Mejía wrote: > > This looks great, nice for bringing this to the project Henry! > > On Fri, Apr 19, 2019 at 10:53 AM

Re: Contributing Beam Kata (Java & Python)

2019-04-19 Thread Ismaël Mejía
This looks great, nice for bringing this to the project Henry! On Fri, Apr 19, 2019 at 10:53 AM hsuryawira...@google.com wrote: > > Thanks Altay. > I'll create it under "learning/" first as this is not exactly example. > Please do let me know if it's not the right place. > > On 2019/04/18

Re: Contributing Beam Kata (Java & Python)

2019-04-19 Thread hsuryawirawan
Thanks Altay. I'll create it under "learning/" first as this is not exactly example. Please do let me know if it's not the right place. On 2019/04/18 22:49:47, Ahmet Altay wrote: > This looks great. > > +David Cavazos was working on interactive colab based > examples

Re: Contributing Beam Kata (Java & Python)

2019-04-19 Thread hsuryawirawan
Thanks Kenneth. Yeah from a glance this might fit with the incubating training project. As of this moment, the kata is using solely the direct runner as the focus currently is to teach about Beam primitives. There are ideas on how to also have it running on other runner (e.g. Dataflow), but so

Re: Contributing Beam Kata (Java & Python)

2019-04-19 Thread hsuryawirawan
Thanks Lukasz. Yes you can try the kata. I will write a short instruction on how to use it, maybe along with the PR. On 2019/04/18 21:21:28, Lukasz Cwik wrote: > Also agree that this is really nice. Is there a place where we can try out > what you have created so far? > > Opening a PR with

Re: Contributing Beam Kata (Java & Python)

2019-04-19 Thread hsuryawirawan
Hi Pablo, The file structure at the moment is structured around the language. * beam-kata/ * beam-kata/java/ * beam-kata/java/ * beam-kata/python/ * beam-kata/python/ Adding a new language in the future should be quite easy. For students to use the kata, they actually don't need to checkout the

Re: Contributing

2018-03-15 Thread Ahmet Altay
Hi Austin, It was great meeting with you. We mentioned a list of starter bugs, here is that list [1]. It might give you some ides on where to start. [1]

Contributing

2018-03-15 Thread Austin Bennett
Hi All, Enjoyed meeting many of you yesterday, and look forward to helping the project! I'll hope in the next week or two to submit some bit of code, and then [slowly] to get up to speed on conventions, guidelines, appropriate style, etc. Ideally, with some guidance. Also, should we be able to

Re: Contributing to Beam

2017-05-29 Thread Jean-Baptiste Onofré
Hi Umang, I suggest to take a look on the contribution guide: https://beam.apache.org/contribute/contribution-guide/ Regards JB On 05/29/2017 09:55 PM, Umang Sharma wrote: Hi everyone , I am Umang Sharma from India, java developer and data scientist ,I am looking to contribute to Apache

Contributing to Beam

2017-05-29 Thread Umang Sharma
Hi everyone , I am Umang Sharma from India, java developer and data scientist ,I am looking to contribute to Apache beam -please guide me through the process. Thanks , Umang