Re: [DISCUSS] Structuring Java based DSLs

it is that this would bring Euphoria "closer" to Beam core > development (which would be good, it is part of the project anyway, > right? :)) and help better drive features, that although currently > needed mostly by SQL, might be needed by other Java users anyway. > &

Re: contributor in the Beam

PM Chaim Turkel wrote: >> >> hi, >> i added another pr for the case of a self signed certificate ssl on >> the mongodb server >> >> https://github.com/apache/beam/pull/7162 >> On Wed, Nov 28, 2018 at 5:16 PM Jean-Baptiste Onofré >> wrote: >

Re: [VOTE] Release 2.9.0, release candidate #1

+1 (binding) Regards JB Le 13 déc. 2018 à 20:11, à 20:11, Reuven Lax a écrit: >+1 (binding) > >On Thu, Dec 13, 2018 at 8:39 AM Kenneth Knowles >wrote: > >> +1 (binding) >> >> A new feature request >(https://issues.apache.org/jira/browse/BEAM-6212) >> had been filed against 2.9.0 release ( >> ht

Re: [PROPOSAL] Prepare Beam 2.10.0 release

oob7seouanigd0%40group.calendar.google.com&ctz=America%2FLos_Angeles > [2] https://issues.apache.org/jira/projects/BEAM/versions/12344540 -- Jean-Baptiste Onofré jbono...@apache.org http://blog.nanthrax.net Talend - http://www.talend.com

Re: Enforce javadoc comments in public methods?

> > [1] > https://github.com/apache/beam/blame/5ceffb246c0c38ad68dd208e951a1f39c90ef85c/sdks/java/build-tools/src/main/resources/beam/checkstyle.xml#L111 > > > Cheers,  > -- Jean-Baptiste Onofré jbono...@apache.org http://blog.nanthrax.net Talend - http://www.talend.com

Re: Connection leaks with PostgreSQL instance

s/observations, please correct me if I am >> wrong (I am not from the java environment, so some can seem pretty >> trivial) : >> >> - Does the apply method handles SQLException or I/O errors ? >> >> - Would the use of a connection

Re: [DISCUSSION] UTests and embedded backends

asures to protect against jenkins overload. > > WDYT ? > > Etienne > > -- Jean-Baptiste Onofré jbono...@apache.org http://blog.nanthrax.net Talend - http://www.talend.com

Re: BEAM-6324 / #7340: "I've pretty much given up on the PR being merged. I use my own fork for my projects"

le to work on Beam in >>> 2019, but I'll comment on that PR now too as it's missing tests. >>> >>> >>> >>> >>> >>> On Fri, Jan 25, 2019 at 7:27 AM Kenneth Knowles >>> mailto:k...@apache.org>>

Re: BEAM-6324 / #7340: "I've pretty much given up on the PR being merged. I use my own fork for my projects"

   the PR that it's been acknowledged would likely be enough to > >>>         engage the contributor - they would hopefully then ping the > >>>         individual if it then slips for a long time. > >>> > >>>         Next week will be my fir

Re: [DISCUSS] Should File based IOs implement readAll() or just readFiles()

e nice to > see what the python guys think on this too. > > This discussion comes from a recent slack conversation with Łukasz > Gajowy, and we wanted to settle into one approach to make the IO > signatures consistent, so any opinions/preferences? > -- Jean-Baptiste Onofré jbono...@apache.org http://blog.nanthrax.net Talend - http://www.talend.com

Re: [VOTE] Release 2.10.0, release candidate #2

eam/KEYS > <https://dist.apache.org/repos/dist/release/beam/KEYS> > [4] https://repository.apache.org/content/repositories/orgapachebeam-1057/ > [5] https://github.com/apache/beam/tree/v2.10.0-RC2 > [6] https://github.com/apache/beam/pull/7651/files > [7] https://github.com/apache/beam-si

Re: [DISCUSS] Should File based IOs implement readAll() or just readFiles()

;> >> Thanks, >> Cham >> >> On Fri, Feb 1, 2019 at 7:41 AM Jean-Baptiste Onofré >> wrote: >>> >>> Hi, >>> >>> readFiles() should be used IMHO. We should remove readAll() to avoid >>> confusion. >>> >>&

Issue building master

am-2.12.0.dev0/PKG-INFO Unapproved/unknown license: sdks/python/apache-beam-2.12.0.dev0/setup.cfg Do you have the same issue ? In the mean time, I'm checking on Jenkins and the environment. Regards JB -- Jean-Baptiste Onofré jbono...@apache.org http://blog.nanthrax.net Talend - http://www.talend.com

Re: Issue building master

Hi Reuven, I tried with Python 2.7.x. Let me try with Python 3. Regards JB On 24/02/2019 23:02, Reuven Lax wrote: > > Hi JB. Good to hear from you! > > What version of Python do you have installed? > > Reuven > > On Sun, Feb 24, 2019 at 11:28 AM Jean-Ba

Re: [VOTE] Release 2.11.0, release candidate #1

st/release/beam/KEYS > [4] https://repository.apache.org/content/repositories/orgapachebeam-1061/ > [5] https://github.com/apache/beam/tree/v2.11.0-RC1 > [6] https://github.com/apache/beam/pull/7924 > [7] https://github.com/apache/beam-site/pull/587 > [8]  > https://docs.goo

Re: Issue building master

. > > Kenn > > On Sun, Feb 24, 2019 at 2:02 PM Reuven Lax <mailto:re...@google.com>> wrote: > > > Hi JB. Good to hear from you! > > What version of Python do you have installed? > > Reuven > > On Sun, Feb 24, 2019 at 11:28 AM

Re: Issue building master

produced with > license included or if the need to be excluded from rat checks, as Kenn > suggested. > > hth, > michel > > > On Mon, Feb 25, 2019 at 7:05 AM Jean-Baptiste Onofré <mailto:j...@nanthrax.net>> wrote: > > Hi Kenn, > > I started

Re: [VOTE] Release 2.11.0, release candidate #2

eam/KEYS > [4] https://repository.apache.org/content/repositories/orgapachebeam-1064/ > [5] https://github.com/apache/beam/tree/v2.11.0-RC2 > [6] https://github.com/apache/beam/pull/7924 > [7] https://github.com/apache/beam-site/pull/587 > [8] > https://docs.google.com/spreadsheets

Re: [spark runner dataset POC] workCount works !

Congrats and huge thanks ! (I'm glad to be one of the little "launcher" to this effort ;) ) Regards JB On 21/03/2019 15:47, Ismaël Mejía wrote: This is excellent news. Congrats Etienne, Alexey and the others involved for the great work! On Thu, Mar 21, 2019 at 3:10 PM Etienne Chauchot wrote:

Re: [DISCUSS] Migrate Jira to GitHub Issues?

Hi, I don't have concerns: if Beam is OK with the issue single milestone use, that's fine with me ;) Thanks for the detailed document, it helps! Regards JB On Tue, Feb 15, 2022 at 6:52 AM Aizhamal Nurmamat kyzy wrote: > Very humbly, I think the benefits of moving to GitHub Issues outweigh the

Re: [Proposal] => JMSIO dynamic topic publishing

Hi Vincent, It looks interesting. Another possible approach is to have some implicit (instead of being explicit) but defining the destination on the JmsRecord. If the JmsRecord contains the destination (that could be "dynamic"), we use it, overriding the destination provided on the IO configuratio

Re: [Proposal] => JMSIO dynamic topic publishing

t of the topic would be extracted at any stage of the > pipeline. > > So for me it would be more flexible to not be tied with JmsRecord. > > > > Regards > > > > Vincent BALLADA > > > > De : Jean-Baptiste Onofré > Date : samedi, 19 février 2022 à 06:

Re: [Proposal] => JMSIO dynamic topic publishing

gt; > It would introduce also a breaking change as the current implementation takes > a Pcollection as input. > > Plus the new standard for IO implementation seems to be parameterized > read/write (see annotated document). > > > > Thanks, > > > > Regards > &g

Re: [VOTE] Release 2.37.0, release candidate #2

+1 (binding) Regards JB On Wed, Feb 23, 2022 at 6:37 PM Brian Hulette wrote: > > Hi everyone, > Please review and vote on release candidate #2 version 2.37.0, as follows: > [ ] +1, Approve the release > [ ] -1, Do not approve the release (please provide specific comments) > > Reviewers are encou

Re: [VOTE] Release 2.37.0, release candidate #3

+1 (binding) Regards JB On Tue, Mar 1, 2022 at 3:29 AM Brian Hulette wrote: > Hi everyone, > Please review and vote on release candidate #3 for version 2.37.0, as > follows: > [ ] +1, Approve the release > [ ] -1, Do not approve the release (please provide specific comments) > > Reviewers are e

Re: [PROPOSAL] Stop Spark2 support in Spark Runner

+1 for me to drop Spark 2.x support. Users who want to still use Spark 2.x can be back on a previous Beam release. Regards JB On Thu, Mar 31, 2022 at 5:51 PM Alexey Romanenko wrote: > > Hi everyone, > > For the moment, Beam Spark Runner supports two versions of Spark - 2.x and > 3.x. > > Takin

Re: [VOTE] Release 2.39.0, candidate #1

+1 (binding) Smoke quick tests with the direct runner. Regards JB On Tue, May 17, 2022 at 5:05 PM Ahmet Altay wrote: > > +1 (binding). I validated python quick starts on Direct runner and on > Dataflow. > > Thank you Yichi! > > On Mon, May 16, 2022 at 11:58 PM Yichi Zhang wrote: >> >> Hi ever

Re: [JmsIO] => Pull Request to fix message acknowledgement issue

Hi Vincent, thanks, I will take a look (as original JmsIO author ;)). Regards JB On Mon, Aug 29, 2022 at 6:43 PM BALLADA Vincent wrote: > > Hi all, > > > > Here is a PR related to the following issue (Runner acknowledges messages on > closed session): > > https://github.com/apache/beam/issues/

Re: [VOTE] Release 2.16.0, release candidate #1

pull/9667 > [7] https://github.com/apache/beam-site/pull/593 > [8] https://github.com/apache/beam/pull/9671 > [9] > https://docs.google.com/spreadsheets/d/1qk-N5vjXvbcEk68GjbkSZTR8AGqyNUM-oLFo_ZXBpJw/edit#gid=890914284 > [10] https://hub.docker.com/u/apachebeam -- Jean-Baptiste Onofré jbono...@apache.org http://blog.nanthrax.net Talend - http://www.talend.com

Re: [spark structured streaming runner] merge to master?

ramework from the Spark community) > > - Runner can execute Nexmark > > - Some things are not wired up yet > >     - Beam Schemas not wired with Spark Schemas > >     - Optional features of the model not implemented:  state api, timer > api, splittable doFn a

Re: [PROPOSAL] Preparing for Beam 2.17.0 release

EAM%20AND%20status%20in%20(Reopened%2C%20Open%2C%20%22In%20Progress%22%2C%20%22Under%20Discussion%22%2C%20%22In%20Implementation%22%2C%20%22Triage%20Needed%22)%20AND%20fixVersion%20%3D%202.17.0 -- Jean-Baptiste Onofré jbono...@apache.org http://blog.nanthrax.net Talend - http://www.talend.com

Re: Contributor permission for Beam Jira tickets

?name=iht). > > Please could anyone give me that permission in JIRA? > > Thanks in advance. > > Israel > -- Jean-Baptiste Onofré jbono...@apache.org http://blog.nanthrax.net Talend - http://www.talend.com

Re: JdbcIO read needs to fit in memory

HiJdbcIO is basically a DoFn. So it could load all on a single executor (there's no obvious way to split).It's what you mean ?RegardsJBLe 24 oct. 2019 15:26, Jozef Vilcek a écrit :Hi,I am in a need to read a big-ish data set via JdbcIO. This forced me to bump up memory for my executor (right now u

Re: [spark structured streaming runner] merge to master?

I agree, it would be the easiest way and allow users to switch easily as well using a single artifact. Regards JB On 29/10/2019 23:54, Kenneth Knowles wrote: Is it just as easy to have two jars and build an uber jar with both included? Then the runner can still be toggled with a flag. Kenn

Re: RabbitMqIO issues and open PRs

clean living' than an > urgent issue. > > Aside from the open issues, given the low response rate so far, I'd be > more than happy to take on a more active role in maintaining/reviewing > the rabbitmq io for java. For now, however, is this list the best way to > 'bump' these open issues and move forward? Further, is the general > approach before opening a PR to ask some preliminary questions in this > email list? > > Thank you, > -Daniel Robert > -- Jean-Baptiste Onofré jbono...@apache.org http://blog.nanthrax.net Talend - http://www.talend.com

Re: RabbitMqIO issues and open PRs

less > significant and I've put it here more for 'good, clean living' than an > urgent issue. > > Aside from the open issues, given the low response rate so far, I'd be > more than happy to take on a more active role in maintaining/reviewing > the rabbitmq io for java. For now, however, is this list the best way to > 'bump' these open issues and move forward? Further, is the general > approach before opening a PR to ask some preliminary questions in this > email list? > > Thank you, > -Daniel Robert > -- Jean-Baptiste Onofré jbono...@apache.org http://blog.nanthrax.net Talend - http://www.talend.com

Re: Contributor permissions

ashanka" > > Thanks in advance. > > _Regards_ >   Shashanka Balakuntala Srinivasa >        -- Jean-Baptiste Onofré jbono...@apache.org http://blog.nanthrax.net Talend - http://www.talend.com

Re: [VOTE] Release 2.18.0, release candidate #1

nd vote on the release candidate #3 > for the version 1.2.3, as follows: > >>> >>>>>>>>> [ ] +1, Approve the release > >>> >>>>>>>>> [ ] -1, Do not approve the release (please provide > specific comments) > >>> >>>>>>>>> > >>> >>>>>>>>> > >>> >>>>>>>>> The complete staging area is available for your > review, which includes: > >>> >>>>>>>>> * JIRA release notes [1], > >>> >>>>>>>>> * the official Apache source release to be > deployed to dist.apache.org <http://dist.apache.org> [2], which > is signed with the key with fingerprint 8961 F3EF 8E79 6688 > 4067  87CF 587B 049C 36DA AFE6 [3], > >>> >>>>>>>>> * all artifacts to be deployed to the Maven > Central Repository [4], > >>> >>>>>>>>> * source code tag "v1.2.3-RC3" [5], > >>> >>>>>> > >>> >>>>>> > >>> >>>>>> Tag is "v2.18.0-RC1". This is correct in the > referenced link. > >>> >>>>>> > >>> >>>>>>>>> > >>> >>>>>>>>> * website pull request listing the release [6], > publishing the API reference manual [7], and the blog post [8]. > >>> >>>>>>>>> * Java artifacts were built with Maven > MAVEN_VERSION and OpenJDK/Oracle JDK JDK_VERSION. > >>> >>>>>>>>> TODO: do these versions matter, and are they > stamped into the artifacts? > >>> >>>>>>>>> * Python artifacts are deployed along with the > source release to the dist.apache.org <http://dist.apache.org> [2]. > >>> >>>>>>>>> * Validation sheet with a tab for 2.18.0 release > to help with validation [9]. > >>> >>>>>>>>> * Docker images published to Docker Hub [10]. > >>> >>>>>>>>> > >>> >>>>>>>>> The vote will be open for at least 72 hours. It is > adopted by majority approval, with at least 3 PMC affirmative votes. > >>> >>>>>>>>> > >>> >>>>>>>>> Thanks, > >>> >>>>>>>>> Release Manager > >>> >>>>>>>>> > >>> >>>>>>>>> [1] > > https://issues.apache.org/jira/secure/ReleaseNote.jspa?version=12346383&projectId=12319527 > >>> >>>>>>>>> [2] > https://dist.apache.org/repos/dist/dev/beam/2.18.0/ > >>> >>>>>>>>> [3] > https://dist.apache.org/repos/dist/release/beam/KEYS > >>> >>>>>>>>> [4] > https://repository.apache.org/content/repositories/orgapachebeam-1090/ > >>> >>>>>>>>> [5] https://github.com/apache/beam/tree/v2.18.0-RC1 > >>> >>>>>>>>> [6] https://github.com/apache/beam/pull/10574 > >>> >>>>>>>>> [7] https://github.com/apache/beam-site/pull/595 > >>> >>>>>>>>> [8] https://github.com/apache/beam/pull/10575 > >>> >>>>>>>>> [9] > > https://docs.google.com/spreadsheets/d/1qk-N5vjXvbcEk68GjbkSZTR8AGqyNUM-oLFo_ZXBpJw/edit#gid=1178617819 > >>> >>>>>>>>> [10] https://hub.docker.com/u/apachebeam > -- Jean-Baptiste Onofré jbono...@apache.org http://blog.nanthrax.net Talend - http://www.talend.com

Re: New contributor

28, 2020 at 12:04 PM Ludovic Boutros <mailto:boutr...@gmail.com>> wrote: > > Dear all, > > please, could you add me as a contributor in Jira ? My user name > is lboutros. > > Thank you, > > Ludovic. > -- Jean-Baptiste Onofré jbono...@apache.org http://blog.nanthrax.net Talend - http://www.talend.com

Re: Release 2.19.0, release candidate #1

am/pull/10713 > [7] https://github.com/apache/beam-site/pull/597 > [8] https://github.com/apache/beam/pull/10722 > [9]  > https://docs.google.com/spreadsheets/d/1qk-N5vjXvbcEk68GjbkSZTR8AGqyNUM-oLFo_ZXBpJw/edit#gid=1148160512 > [10] https://hub.docker.com/u/apachebeam -- Jean-Baptiste Onofré jbono...@apache.org http://blog.nanthrax.net Talend - http://www.talend.com

Re: Compile error on Java 11 when running :examples:java:test

HiNo jdk 11 is not yet fully supported.I?ve started to work on it but it?s not yet ready.RegardsJBLe ven. 7 f?vr. 2020 ? 20:20, David Cavazos a ?crit :Hi Beamers,I'm trying to run the tests for the Java examples using Java 11 and there is a compilation error due to an incompatible version.I'm usin

Re: Labels on PR

ThanksIt sounds good to me. Regards JBLe lun. 10 f?vr. 2020 ? 08:35, Alex Van Boxel a ?crit :I've started putting labels on PR's. I've done the first page for now (as I'm afraid putting them on older once could affect the stale bot. I hope this is ok.For now I'm only focussing on language and I'm

Re: [PROPOSAL] Vendored bytebuddy dependency release

+1RegardsJBLe sam. 22 f?vr. 2020 ? 15:02, Isma?l Mej?a a ?crit :The version of bytebuddy Beam is vendoring (1.9.3) is more than 16 months old. Iwould like to propose that we upgrade it [1] to the most recent version (1.10.8)[2] so we can benefit of the latest improvements for Java 11 and upgraded

Re: [VOTE] Upgrade gradle to 6.2

+1It makes sense. Thanks. Regards JBLe lun. 24 f?vr. 2020 ? 22:37, Alex Van Boxel a ?crit :Anyone objections that I upgrade gradle to 6.2. If ok this will be done over several commits where I will:Upgrade pluginsUpgrade gradle to 6.2See where we can use some of the new features _/_/ Alex Van Boxel

Re: [VOTE] Upgrade gradle to 6.2

Hi AlexI also have couple of contacts at Gradle. Let me know if needed. Regards JBLe mar. 25 f?vr. 2020 ? 08:20, Alex Van Boxel a ?crit :OK, great. I know someone that works at gradle, so I can ping them when I have some problems.Any other know pitfalls I can expect, let me know :-) _/_/ Alex Van

Re: [VOTE] Vendored Dependencies Release Byte Buddy 1.10.8

+1Regards JBLe mar. 25 f?vr. 2020 ? 13:43, Isma?l Mej?a a ?crit :Please review the release of the following artifacts that we vendor: * beam-vendor-bytebuddy-1_10_8Hi everyone,Please review and vote on the release candidate #1 for the version 0.1, as follows:[ ] +1, Approve the release[ ] -1, Do n

Re: [VOTE] Vendored Dependencies Release gRPC 1.26.0 v0.3 for BEAM-9288

+1 (binding)RegardsJBLe mar. 3 mars 2020 ? 19:31, Luke Cwik a ?crit :Please review the release of the following artifacts that we vendor: * beam-vendor-grpc-1_26_0Hi everyone,Please review and vote on the release candidate #1 for the version 0.3, as follows:[ ] +1, Approve the release[ ] -1, Do no

Re: JdbcIO for writing to Dynamic Schemas in Postgres

Did you create a jira about that already ?I will do the improvement on JdbcIO. Regards JBThanksRegards JBLe dim. 31 mai 2020 ? 11:25, Willem Pienaar a ?crit :Hi Reuven,To be clear, we already have this solved for BigQueryIO. I am hoping there is a similar solution for JdbcIO.Regards,WillemOn Sun,

Re: How are gdoc managed? Is it needed? Is it tooled?

Hi Romain, we already discussed about that. I stated the following while ago (quick short summary): "No problem to use Google Doc but a summary/discussion has to always be sent on the mailing list" Regards JB On 09/03/2018 23:14, Romain Manni-Bucau wrote: Hi guys A lot of design docs are

Re: [PROPOSITION] schedule some sanity tests on a daily basis

Good ideas ! Validates runner tests and Integration tests should be nightly executed. For the Performance tests, it's a great idea, but not sure daily basis is required. Maybe two times per week ? As these tests could be long, we should avoid to block executors that could impact our PR build a

Re: (java) stream & beam?

Hi Romain, I remember we have discussed about the way to express pipeline while ago. I was fan of a "DSL" compared to the one we have in Camel: instead of using apply(), use a dedicated form (like .map(), .reduce(), etc, AFAIR, it's the approach in flume). However, we agreed that apply() synt

Re: Releases and user support

Hi I don't think this statement is appropriate as it sounds more like product than project. Let me explain. At Apache, anyone can propose and do a release based on any version, including very old ones. Support sounds like the assessment that we are committed to provide fixes. That's more a pr

Re: NoSuchElementException in reader.getCurrent*.

I agree. I don't think it's useful to expose getCurrent to the user. That's more runner related. Regards JB Le 12 mars 2018 à 11:06, à 11:06, Romain Manni-Bucau a écrit: >I agree Thomas but I kind of read it as "yes we can drop that >constraint". >If not we should also check we are used in a t

Re: Releases and user support

happen on a non active branch). In that sense of "support" and wording, I agree. Regards JB Le 13 mars 2018 à 05:23, à 05:23, Romain Manni-Bucau a écrit: >2018-03-13 12:50 GMT+01:00 Jean-Baptiste Onofré : > >> Hi >> >> I don't think this statement is ap

Re: Releases and user support

><https://github.com/rmannibucau> | >LinkedIn <https://www.linkedin.com/in/rmannibucau> | Book ><https://www.packtpub.com/application-development/java-ee-8-high-performance> > >2018-03-13 13:39 GMT+01:00 Jean-Baptiste Onofré : > >> That's the statement I&#x

Re: Releases and user support

;>> >>> >>> Romain Manni-Bucau >>> @rmannibucau <https://twitter.com/rmannibucau> | Blog >>> <https://rmannibucau.metawerx.net/> | Old Blog >>> <http://rmannibucau.wordpress.com> | Github >>> <https://github.com/rmannib

Re: Releases and user support

bugs in >supported >> SDKs (subject to vote of course, but there hasn't been opposition to >such >> point releases in the past). Support window makes perfect sense for >these >> organizations, and each one might have a different support window. >However >

Re: slack @the-asf?

Same for me but better to have Apache "hosted" 😁 Regards JB Le 14 mars 2018 à 08:48, à 08:48, Reuven Lax a écrit: >I don't have a strong feeling here. As long as there are instructions >on >how to use the new slack channel, sounds good to me! > > >On Wed, Mar 14, 2018 at 1:35 AM Romain Manni-Buc

Re: slack @the-asf?

Do you want me to prepare the site PR with you ? Regards JB Le 14 mars 2018 à 09:12, à 09:12, Romain Manni-Bucau a écrit: >updated the slack message (feel free to rephrase/reformat it, the >length is >quite limited so it is ok) and will send the message just after this >one on >#general >will n

Re: slack @the-asf?

8 at 9:19 AM, Romain Manni-Bucau < >>>>> rmannibu...@gmail.com> wrote: >>>>> >>>>>> Can help but I have no idea how to do it yet, don't hesitate to >ping >>>>>> me if you don't have much cycles. >>>>>> >&g

Re: New beam contributor experience?

Good point. As mentioned, maybe the contribution guide is not enough, we also have the "low hanging fruit" tagged Jira that new contributors can take a look. Maybe for both users and new contributors, it would be great to have additional concrete examples. Today, the game examples is great but

Re: Beam 2.4.0

t forward? >>> >>> >>> Romain Manni-Bucau >>> @rmannibucau <https://twitter.com/rmannibucau> | Blog >>> <https://rmannibucau.metawerx.net/> | Old Blog >>> <http://rmannibucau.wordpress.com> | Github >>> <https://

Re: Board report - March '18

ort sometime in >the >next 24 hours. > >Thanks! > >Davor > >[1] >https://docs.google.com/document/d/1ngoI27CQ25TcxjJlyLBa6Qbj3t7inzf1_20UPN5hBiE/ > >On Sun, Mar 4, 2018 at 10:36 AM, Jean-Baptiste Onofré >wrote: > >> Hi guys, >> >> In orde

Re: [PROPOSITION] schedule some sanity tests on a daily basis

Hi, I would suggest to prepare a Maven profile to perform nexmark runs. Then, I can setup a job (seed/manual) in Jenkins to run this. Regards JB On 15/03/2018 22:13, Etienne Chauchot wrote: So what next? Shall we schedule nexmark runs and add a Bigquery sink to nexmark output? Le lundi 1

Re: Contributing

Hi Great to see you yesterday and welcome aboard ! I'm looking forward your contributions ! Please ping me or the team if you need help or guidance ! Regards JB Le 15 mars 2018 à 17:31, à 17:31, Austin Bennett a écrit: >Hi All, > >Enjoyed meeting many of you yesterday, and look forward to he

Re: Looking for I/O transform to untar a tar.gz

Hi TextIO supports compressed file. Do you want to read files in text ? Can you detail a bit the use case ? Thanks Regards JB Le 15 mars 2018 à 18:28, à 18:28, Shirish Jamthe a écrit: >Hi, > >My input is a tar.gz or .zip file which contains thousands of tar.gz >files >and other files. >I would

Re: Looking for I/O transform to untar a tar.gz

t;>>> >>>>>>> PipelineOptions optios = >>>>>>> PipelineOptionsFactory.fromArgs(args).withValidation().create(); >>>>>>> Pipeline p = Pipeline.create(optios); >>>>>>> >>>>>>>* p.

Re: (java) stream & beam?

Big +1 Regards JB Le 16 mars 2018 à 15:59, à 15:59, Reuven Lax a écrit: >BTW while it's true that raw GBK can't be fluent (due to constraint on >element type). once we have schema support we can introduce >groupByField, >and that can be fluent. > > >On Wed, Mar 14, 2018 at 11:50 PM Robert Bradsh

Re: slack @the-asf?

using SSO, so you need to sign up using your ASF >ID but >>> create an ASF-slack-specific account. >>> >>> >>> On Wed, Mar 14, 2018 at 11:12 AM Lukasz Cwik >wrote: >>> >>>> An ASF admin graciously created the self enrollment link. I up

Re: [VOTE] Release 2.4.0, release candidate #3

+1 (binding) Verified on beam samples (Java) with spark, direct and flink runner. No major change regarding execution time with nexmark. Thanks Regards JB Le 19 mars 2018 à 21:49, à 21:49, Robert Bradshaw a écrit: >Thanks! > >BTW, in case anyone's wondering where the md5 files went, they're no

Re: Implementing @OnWindowExpiration in StatefulParDo [BEAM-1589]

+1 It sounds good to me. Regards JB Le 20 mars 2018 à 00:52, à 00:52, Huygaa Batsaikhan a écrit: >Hi everyone, I am working on BEAM-1589 >. In short, currently, >there is no default way of saving/flushing state before a window is >garbage >collec

Re: beam 3?

; | Github <https://github.com/rmannibucau> | > LinkedIn <https://www.linkedin.com/in/rmannibucau> | Book > <https://www.packtpub.com/application-development/java-ee-8-high-performance> -- Jean-Baptiste Onofré jbono...@apache.org http://blog.nanthrax.net Talend - http://www.talend.com

Re: beam 3?

Hi, Starting from scratch is an option, but don't you think it's a huge effort ? Anyway, we will reuse part of the existing codebase. Let's see what the team is thinking. Regards JB On 03/21/2018 09:26 AM, Romain Manni-Bucau wrote: > > > 2018-03-21 9:13 GMT+01

Re: Apache Beam 2.4.0 release process retrospective and automation possibilities

eady change the versions in the POMs (like a mvn versions:set). I guess you are talking about some other files ? Maybe those files could use the project.version from the pom ? > * Some copy/paste errors when creating the voting emails.> * Many steps > are not possible for non-committe

Beam Summit - IO brainstorming

ew Jiras for HDF5 and other new IOs - We have to work on documentation/explanation about portability layer & IOs - I will start a separate thread for error handling discussion - Nothing to do about schema: it has already started. Regards JB -- Jean-Baptiste Onofré jbono...@apach

Re: [PROPOSAL] Scripting extension based on Java JSR-223

> [2] https://github.com/rmannibucau/beam-jsr223 > [3] > https://cloud.google.com/blog/big-data/2018/03/pre-built-cloud-dataflow-templates-kiss-for-data-movement > [4] https://issues.apache.org/jira/browse/BEAM-3921 > [5} https://github.com/apache/beam/pull/4944 > -- Jean-Baptiste Onofré jbono...@apache.org http://blog.nanthrax.net Talend - http://www.talend.com

Re: Beam Summit - IO brainstorming

ed support. > I have created a ticket on their system. https://forum.hdfgroup.org/ and will > follow up after that to make sure that this is not being forgotten. > Please let me know if you have any comments > > Best, > Eila > > > On Fri, Mar 23, 2018 at 3:07 AM, Jean-

Re: executing the pipeline from datalab

ate] > if self._job.currentState 744 else PipelineState.UNKNOWN) 745 KeyError: > CurrentStateValueValuesEnum(JOB_STATE_PENDING, 9) > > > > > -- > Eila > www.orielresearch.org <http://www.orielresearch.org> > https://www.meetup.com/Deep-Learning-In-Production/ -- Jean-Baptiste Onofré jbono...@apache.org http://blog.nanthrax.net Talend - http://www.talend.com

Re: Migrating to Gradle: Community Fixit day

x27;re interested in participating, please respond and let me know along > with > which dates work best for you. I'll start off by suggesting one of two days: > Wednesday March 28 or Tuesday April 3. > > Reuven -- Jean-Baptiste Onofré jbono...@apache.org http://blog.nanthrax.net Talend - http://www.talend.com

Re: change on the experimental public metrics API

om/apache/beam/pull/4918 > > Best, > Etienne -- Jean-Baptiste Onofré jbono...@apache.org http://blog.nanthrax.net Talend - http://www.talend.com

Re: [DISCUSSION] Runner agnostic metrics extractor?

e Chauchot wrote: >>>>>> Hi all, >>>>>> >>>>>> I came by this ticket https://issues.apache.org/jira/browse/BEAM-2456. >>>>> I know >>>>>> that the metrics subject has already been discussed a lot, but I

Re: waitUntilFinish@direct runner

://rmannibucau.metawerx.net/> | Old Blog > <http://rmannibucau.wordpress.com> | Github <https://github.com/rmannibucau> | > LinkedIn <https://www.linkedin.com/in/rmannibucau> | Book > <https://www.packtpub.com/application-development/java-ee-8-high-performance> -- J

Re: [ANNOUCEMENT] New Foundation members!

undation. They can vote for the Board, incubate new projects, >nominate >new members, participate in any PMC-private discussions, and contribute >to >any project. > >(For the Beam community, this election nearly doubles the number of >Foundation members. The new members are joining

Re: DirectRunner in test - await completion of workers threads?

Indeed. It's exactly what Romain's PR is about. Regards JB Le 1 avr. 2018 à 19:33, à 19:33, Reuven Lax a écrit: >Correct - teardown is currently run in the direct runner, but >asynchronously. I believe Romain's pending PRs should solve this for >your >use case. > >On Sun, Apr 1, 2018 at 3:13 AM

Re: Python SDK feature set

atrix > <https://beam.apache.org/documentation/runners/capability-matrix/>, would it > be > useful to track SDK capabilities in a similar way so that users know what’s > supported? > > Thanks, > Thomas > -- Jean-Baptiste Onofré jbono...@apache.org http://blog.nanthrax.net Talend - http://www.talend.com

Re: Gradle migration fixit: April 3

ly over to Gradle. > A > lot of work has already been done on 1., and we've made some progress on 2.. > Slightly longer-term the goal is to delete all of the pom files; I'm not sure > we'll get as far as completely deleting Maven in one day, but we should get > within st

Re: Gradle migration fixit: April 3

> LinkedIn <https://www.linkedin.com/in/rmannibucau> | Book > <https://www.packtpub.com/application-development/java-ee-8-high-performance> > > 2018-04-03 18:27 GMT+02:00 Jean-Baptiste Onofré <mailto:j...@nanthrax.net>>: > > Hi guys, > > "

Re: Gradle migration fixit: April 3

with gradle-related stuff along with complete > switch to gradle in building process to avoid a confusion for users. > > What do you think? > > WBR, > Alexey > >> On 3 Apr 2018, at 18:35, Jean-Baptiste Onofré > <mailto:j...@nanthrax.net>> wrote: >> >&

Re: Gradle migration fixit: April 3

> Romain Manni-Bucau > @rmannibucau <https://twitter.com/rmannibucau> |  Blog > <https://rmannibucau.metawerx.net/> | Old Blog > <http://rmannibucau.wordpress.com> | Github <https://github.com/rmannibucau> | > LinkedIn <https://www.linkedin.com/in/rmannibucau> | Book &

Re: Gradle migration fixit: April 3

og > <http://rmannibucau.wordpress.com> | Github > <https://github.com/rmannibucau> | LinkedIn > <https://www.linkedin.com/in/rmannibucau> | Book > > <https://www.packtpub.com/application-development/java-ee-8-high-performance> &g

Re: Gradle Tips and tricks

favorite > gradle 'incantations' there and other related knowledge. We will > migrate this info to the website afterwards. > > https://s.apache.org/beam-gradle-tips-edit > -- Jean-Baptiste Onofré jbono...@apache.org http://blog.nanthrax.net Talend - http://www.talend.com

Re: Gradle Tips and tricks

d a shared doc yesterday to share some of those and other gradle > tips and tricks. I invite everyone who can help to add their favorite > gradle 'incantations' there and other related knowledge. We will > migrate this info to the website afterwards. > > https://s.apache.org/beam

[PROPOSAL] Preparing 2.5.0 release next week

cycle per Beam part. I think it would be interesting to have different release cycle: SDKs, DSLs, Runners, IOs. That's another discussion, I will start a thread about that. Thoughts ? Regards JB -- Jean-Baptiste Onofré jbono...@apache.org http://blog.nanthrax.net Talend - http://www.talend.com

Re: [PROPOSAL] Preparing 2.5.0 release next week

Up ? Regards JB On 04/06/2018 10:48 AM, Jean-Baptiste Onofré wrote: > Hi guys, > > Apache Beam 2.4.0 has been released on March 20th. > > According to our cycle of release (roughly 6 weeks), we should think about > 2.5.0. > > I'm volunteer to tackle this re

Re: [PROPOSAL] Preparing 2.5.0 release next week

eek - are we at the point where we can > try > running this release purely using Gradle, or should we wait until 2.6.0? > > Reuven > > On Mon, Apr 9, 2018 at 8:01 AM Jean-Baptiste Onofré <mailto:j...@nanthrax.net>> wrote: > > Up ? > > Regards >

Re: [PROPOSAL] Preparing 2.5.0 release next week

;>>>> > >>>>> http://maven.apache.org/POM/4.0.0"; > >>>>> xsi:schemaLocation="http://maven.apache.org/POM/4.0.0 > >>>>> http://maven.apache.org/xsd/maven-4.0.0.xsd"; > >

Re: Gradle Status [April 6]

Hi all, I did multiple gradle build since last week and I would like to share one of my concern: it's about the communities. If I think our users won't see any change for them due to Gradle build (I think that most of our users will still use Maven with artifacts provided by Gradle), I'm mor

Re: Gradle Status [April 6]

explicit point of origin (not strings smashed together in a loop) When in doubt, a little redundancy to improve readability is worth it in this context. Kenn On Mon, Apr 9, 2018 at 9:47 AM Jean-Baptiste Onofré mailto:j...@nanthrax.net>> wrote: Hi all, I di

Re: [PROPOSAL] Preparing 2.5.0 release next week

; > >>>>> xsi:schemaLocation="http://maven.apache.org/POM/4.0.0 > >>>>> http://maven.apache.org/xsd/maven-4.0.0.xsd"; > >>>>> xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance";&

Re: Gradle Status [April 6]

8 GMT+02:00 Etienne Chauchot : As a gradle beginner, I could not agree more ! +1 Etienne Le lundi 09 avril 2018 à 18:47 +0200, Jean-Baptiste Onofré a écrit : Hi all, I did multiple gradle build since last week and I would like to share one of my concern: it's about the communities. If I thi

<    1   2   3   4   5   6   7   8   9   10   >