Re: [ANNOUNCE] Apache Beam 2.6.0 released!

2018-08-09 Thread Ismaël Mejía
Two really interesting features in 2.6.0 not mentioned in the announcement email: - Bounded SplittableDoFn support is available now in all runners (SDF is the new IO connector API). - HBaseIO was updated to be the first IO supporting Bounded SDF (using readAll). On Fri, Aug 10, 2018 at 12:14

Re: [ANNOUNCE] Apache Beam 2.6.0 released!

2018-08-09 Thread Connell O'Callaghan
Pablo and all involved thank you for working to get this release completed!!! On Thu, Aug 9, 2018 at 3:06 PM Pablo Estrada wrote: > Of course, I messed that link up again. The release notes should be here: > > https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12319527&version=1234

Re: [ANNOUNCE] Apache Beam 2.6.0 released!

2018-08-09 Thread Pablo Estrada
Of course, I messed that link up again. The release notes should be here: https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12319527&version=12343392 On Thu, Aug 9, 2018 at 10:11 AM Pablo Estrada wrote: > As was pointed out to me by Ryan Williams, the link I posted with the > rele

Re: [VOTE] Community Examples Repository

2018-08-09 Thread Robert Bradshaw
(3) In particular, I see a lot of value for (quoting the proposal) """ Since then, there have been numerous updates, increased Python parity, and new features that do not have accompanying examples employing best practices and demonstrating an end-to-end experience for new users. We would like to

Re: [VOTE] Community Examples Repository

2018-08-09 Thread Ismaël Mejía
3 for all the reasons discussed above. I think there are better ways to improve the status quo without the extra maintenance of having a new repo for this. On Thu, Aug 9, 2018 at 7:00 PM Ahmet Altay wrote: > If we go forward with (3), could we actually update our documentation on > how we will s

Re: [Vote] Create apache-beam-wheels repo like beam-site

2018-08-09 Thread Ahmet Altay
+1 On Thu, Aug 9, 2018 at 1:10 PM, Boyuan Zhang wrote: > Hey all, > > With some ongoing discussions happened in "Apache Beam Python Wheels > Repository" thread, we are decided to move forward to start this vote > process. We want to create a new apache repo like beam-site >

[Vote] Create apache-beam-wheels repo like beam-site

2018-08-09 Thread Boyuan Zhang
Hey all, With some ongoing discussions happened in "Apache Beam Python Wheels Repository" thread, we are decided to move forward to start this vote process. We want to create a new apache repo like beam-site to facilitate building python wheels on multi-os. P

Re: [DISCUSS] Communicating in dev@

2018-08-09 Thread Reuven Lax
Thank you, this is something that has come up several times and is worth addressing. I tend to agree with your main points here. Google Docs makes a good tool for collaborative editing and commenting, and is great while iterating on a design. However once the iterative process is done, the final d

Build failed in Jenkins: beam_Release_Python_NightlySnapshot #5

2018-08-09 Thread Apache Jenkins Server
See -- [...truncated 88.35 KB...] adding 'apache-beam-2.7.0.dev0/apache_beam/runners/direct/util.py' adding 'apache-beam-2.7.0.dev0/apache_beam/runners/direct/direct_metr

Re: [DISCUSSION] Tracking & Visualizing various metrics of the Beam community

2018-08-09 Thread Mikhail Gryzykhin
Hi, The UI looks cool and powerful. I'm not sure about using the devstats service, since it only has github statistics as I can understand. I would prefer to have single entry point for all of our dashboards: build stats, eng metrics, tests, project health metrics, etc. However, devstats uses gra

Build failed in Jenkins: beam_Release_Python_NightlySnapshot #4

2018-08-09 Thread Apache Jenkins Server
See -- [...truncated 88.62 KB...] adding 'apache-beam-2.7.0.dev0/apache_beam/runners/direct/util.py' adding 'apache-beam-2.7.0.dev0/apache_beam/runners/direct/direct_metr

Re: [ANNOUNCE] Apache Beam 2.6.0 released!

2018-08-09 Thread Pablo Estrada
As was pointed out to me by Ryan Williams, the link I posted with the release notes is not right. Here is a link with Beam 2.6.0 release notes for those interested: https://issues.apache.org/jira/projects/BEAM/versions/12343392 On Thu, Aug 9, 2018 at 9:41 AM Alexey Romanenko wrote: > Great news

Re: [VOTE] Community Examples Repository

2018-08-09 Thread Ahmet Altay
If we go forward with (3), could we actually update our documentation on how we will support casual example contributions? I think we will need to have information on how to add links to the new examples people want to add to the set, what examples would be good additions to the Beam repo and what

Re: [DISCUSS] Communicating in dev@

2018-08-09 Thread Ahmet Altay
Great thoughts. On Thu, Aug 9, 2018 at 9:11 AM, Rafael Fernandez wrote: > Hi, > > I think it's important we all discuss in the community what we want to > do to make sure we communicate effectively. I ask because I've seen > preferences expressed in dev@, and want to make sure we're conscious >

Re: [VOTE] Community Examples Repository

2018-08-09 Thread Mikhail Gryzykhin
3 (if contributors are up for voting) - We want to have beam maintained examples in main repo. This will give good man to users and allow us to test those easily with minimal maintenance. We can add links to opensource user repositories to our documentation/wiki. This will be flexible enough to pr

Re: [ANNOUNCE] Apache Beam 2.6.0 released!

2018-08-09 Thread Alexey Romanenko
Great news! Thanks to Pablo for driving this and to all contributors of this release! > On 9 Aug 2018, at 00:48, Pablo Estrada wrote: > > The Apache Beam team is pleased to announce the release of 2.6.0 version! > > Apache Beam is an open source unified programming model to define and > execut

[DISCUSS] Communicating in dev@

2018-08-09 Thread Rafael Fernandez
Hi, I think it's important we all discuss in the community what we want to do to make sure we communicate effectively. I ask because I've seen preferences expressed in dev@, and want to make sure we're conscious about our practices. I think we all want discussions to be accessible to all members

Re: [VOTE] Community Examples Repository

2018-08-09 Thread Rafael Fernandez
Here is the Rose', David's, and Gris' proposal in text form, I hope the copy/paste helps: Apache Beam Examples Repository Authors: Rose Nguyen (rtngu...@google.com), David Cavazos (dcava...@google.com), Gris Cuevas (g...@apache.org) Status: Proposal Created: 2018-07-30 Updated: 2018-07-30 Summ

Re: [VOTE] Community Examples Repository

2018-08-09 Thread Łukasz Gajowy
I'd also vote for 3: I don't see much added value in separating the repos and I see much additional effort to be done in maintaining extra repo(s) (updating examples when new version of beam sdk comes out) and their infrastructure (jenkins, etc). What Lukasz Cwik said about mvn archetypes and how e

Re: [VOTE] Community Examples Repository

2018-08-09 Thread Alexey Romanenko
3 - I agree with JB, Charles and Lukasz arguments above saying why we need to have examples and main code in the same repository (+ website code base will move there soon). I don’t see any huge benefits to have examples aside and, at the same time, it will bring additional complexity and burden

Jenkins build is back to normal : beam_Release_Gradle_NightlySnapshot #136

2018-08-09 Thread Apache Jenkins Server
See