[VOTE] Apache Beam release 0.4.0-incubating

Hi everyone, Please review and vote on the release candidate #3 for the Apache Beam, version 0.4.0-incubating, as follows: [ ] +1, Approve the release [ ] -1, Do not approve the release (please provide specific comments) The complete staging area is available for your review, which includes:

[RESULT][VOTE] Release 0.4.0-incubating, release candidate #3

Hi, I'm happy to announce that we have unanimously approved this release. There are 8 approving votes, 5 of which are binding: * Kenneth Knowles * Davor Bonaci * Jean-Baptiste Onofré * Dan Halperin * Aljoscha Krettek There are no disapproving votes. Thanks everyone! Regards JB On 12/16/2016

Re: [VOTE] Release 0.4.0-incubating, release candidate #3

, 2016 at 10:14 PM, Jean-Baptiste Onofré <j...@nanthrax.net> wrote: Hi guys, The good thing is that my issue to access repository.apache.org Nexus is now fixed. To update the signature files, we have to drop the Nexus repository to stage a new one, meaning cancel the current vote to do a n

Re: [VOTE] Release 0.4.0-incubating, release candidate #3

t on tickets. Even with that, our JIRA titles could use a lot of improvement. On Fri, Dec 16, 2016 at 5:06 AM, Jean-Baptiste Onofré <j...@nanthrax.net> wrote: Hi everyone, Please review and vote on the release candidate #3 for the version 0.4.0-incubating, as follows: [ ] +1, Approve the releas

[VOTE] Release 0.4.0-incubating, release candidate #3

Hi everyone, Please review and vote on the release candidate #3 for the version 0.4.0-incubating, as follows: [ ] +1, Approve the release [ ] -1, Do not approve the release (please provide specific comments) The complete staging area is available for your review, which includes: * JIRA release

Re: [component] tag in JIRA tickets

issues are already tagged with) in a custom release notes template? https://developer. atlassian.com/jiradev/jira-platform/jira-architecture/ jira-templates-and-jsps/creating-a-custom-release-notes-template-containing- release-comments On Thu, Dec 15, 2016 at 6:15 AM, Jean-Baptiste Onofré &l

Re: [VOTE] Release 0.4.0-incubating, release candidate #1

>> > > - verified signatures + checksums >> > > - run mvn clean verify -Prelease, all artifacts+tests run >smoothly >> > > >> > > The release artifacts are signed with the key with fingerprint >8F0D334F >> > > https://dist.apach

Re: [VOTE] Release 0.4.0-incubating, release candidate #1

was probably too eager to mark them fixed after merge and I accidentally put 0.4.0 as the Fix Version. I made the changes in JIRA now. Thanks, Amit On Thu, Dec 15, 2016 at 3:09 PM Jean-Baptiste Onofré <j...@nanthrax.net> wrote: Reviewing and testing the release, I see: 16/12/15 14:04:47

Re: [VOTE] Release 0.4.0-incubating, release candidate #1

that metrics don't work anymore. I'm investigating. Regards JB On 12/15/2016 01:46 PM, Jean-Baptiste Onofré wrote: Hi everyone, Please review and vote on the release candidate #1 for the version 0.4.0-incubating, as follows: [ ] +1, Approve the release [ ] -1, Do not approve the release (please

Re: HiveIO

in contributing to this. On Thu, Dec 15, 2016 at 4:44 AM, Ismaël Mejía <ieme...@gmail.com> wrote: For ref, I just created a JIRA so people can track the progress/contribute to the progress of HiveIO. https://issues.apache.org/jira/browse/BEAM-1158 On Wed, Dec 7, 2016 at 5:39 PM, Jean-Baptiste Ono

Re: Hosting data stores for IO Transform testing

EE8I/edit?ts=58349aec# On Wed, Nov 23, 2016 at 12:48 AM Jean-Baptiste Onofré <j...@nanthrax.net> wrote: I second Etienne there. We worked together on the ElasticsearchIO and definitely, the high valuable test we did were integration tests with ES on docker and high volume. I think we have

Re: Hbase IO preview

might be available in? -- Jean-Baptiste Onofré jbono...@apache.org http://blog.nanthrax.net Talend - http://www.talend.com

Re: Review on Jira for 0.4.0-incubating

ed off all the 0.4.0-incubating blockers, including postponing some. JB is going to start the release process soon! On Sat, Dec 3, 2016 at 10:42 PM, Jean-Baptiste Onofré <j...@nanthrax.net> wrote: Very good point Frances. Definitely something we have to do. Regards JB On 12/04/2016 07:38

Re: Beam Tuple

SDK would benefit from a proper TupleX support ? Thanks, Amit -- Jean-Baptiste Onofré jbono...@apache.org http://blog.nanthrax.net Talend - http://www.talend.com

Re: Scio Beam Scala API

supports 150+ production Scio users within Spotify so we simply don't have the bandwidth to maintain 2 diverging repo (spotify/scio vs apache/beam-incubating) right now. We'll probably revisit this when internal users switch over to Beam sometime next year. On Sun, Dec 11, 2016 at 4:45 PM Jean-Bap

Re: Scio Beam Scala API

Hi I'm working on a feature branch with Neville and his guys. I already updated to last changes. I would like to propose a feature branch later this week. Regards JB⁣​ On Dec 11, 2016, 16:39, at 16:39, Aviem Zur wrote: >Hi, > >I've heard there has been work towards porting

Re: Jenkins build is still unstable: beam_PostCommit_Java_RunnableOnService_Dataflow #1787

pache.org/job/beam_PostCommit_Java_ RunnableOnService_Dataflow/changes> -- Jean-Baptiste Onofré jbono...@apache.org http://blog.nanthrax.net Talend - http://www.talend.com

Re: Performance Benchmarking Beam

. Regards, Otavio. 2016-12-09 15:11 GMT-02:00 Jean-Baptiste Onofré <j...@nanthrax.net>: Happy to help too ;) @Jason, as discussed together, I will send my config (Marathon JSON, Dockerfile, ...), I'm so sorry to be late on this. Regards JB On 12/09/2016 05:59 PM, Amit Sela

Re: Performance Benchmarking Beam

moving forward with this. Jason -- --- Jason Kuster Apache Beam (Incubating) / Google Cloud Dataflow -- Jean-Baptiste Onofré jbono...@apache.org http://blog.nanthrax.net Talend - http://www.talend.com

Re: [DISCUSS] ExecIO

he shell) and easier to execute shell commands within a DoFn, I think that covers many more use cases. On Thu, Dec 8, 2016 at 12:23 PM Robert Bradshaw <rober...@google.com.invalid> wrote: On Wed, Dec 7, 2016 at 1:32 AM, Jean-Baptiste Onofré <j...@nanthrax.net> wrote: By the way, just t

Re: Naming and API for executing shell commands

its stderr, and its error code. I think these options call for a more flexible naming and set of APIs than read and write. And more flexible than a single DoFn, too (which is something I hadn't thought of before - this connector definitely has room for doing some interesting things). On Wed, Dec 7, 20

Re: HiveIO

Yes that's the first idea ;) Regards JB⁣​ On Dec 7, 2016, 17:27, at 17:27, Vinoth Chandar <vin...@uber.com> wrote: >Interesting. So all the planning & execution is done by Hive, and Beam >will >process the results of the query? > >On Wed, Dec 7, 2016 at 8:24 AM

Re: HiveIO

remember that you can use >the >> Hive Jdbc driver, and achieve this with Beam using the JdbcIO (this >is >> probably less efficient for the streaming case but still a valid >solution). >> >> Ismaël >> >> >> On Tue, Dec 6, 2016 at 12:04 PM, Vinoth Chan

Re: [DISCUSS] ExecIO

while away and it doesn't have to block work on a utility for executing shell commands. Though it'd be nice if the utility was forward-compatible with that future world. On Tue, Dec 6, 2016 at 2:16 AM Jean-Baptiste Onofré <j...@nanthrax.net> wrote: Hi Eugene, thanks for the extended questions.

Re: [DISCUSS] ExecIO

area than on "pure" classic big data processing. I think it would give a new "dimension" to Beam. Thoughts ? Regards JB -- Jean-Baptiste Onofré jbono...@apache.org http://blog.nanthrax.net Talend - http://www.talend.com -- Jean-Baptiste Onofré jbono...@apache.org http://blog.nanthrax.net Talend - http://www.talend.com

Re: HiveIO

, Saw a post around HiveIO on the users list with a PR followup. I am interested in this too and can pitch in on developement and testing.. Who & where is this work happening? Thanks VInoth -- Jean-Baptiste Onofré jbono...@apache.org http://blog.nanthrax.net Talend - http://www.talend.com

[INFO] Spark runner build is failing

uccess aggregator should be greater than zero. Expected: not <0> but: was <0> I'm fixing that asap. Sorry about that. Regards JB -- Jean-Baptiste Onofré jbono...@apache.org http://blog.nanthrax.net Talend - http://www.talend.com

[DISCUSS] ExecIO

processing. I think it would give a new "dimension" to Beam. Thoughts ? Regards JB -- Jean-Baptiste Onofré jbono...@apache.org http://blog.nanthrax.net Talend - http://www.talend.com

Re: HBase IO

By the way, I will share a branch with preview of HBase IO. Regards JB On 12/05/2016 08:10 AM, Jean-Baptiste Onofré wrote: Hi, Ismaël started to experiment and PoC a HBaseIO. As a workaround waiting for the IO (even if it won't provide all features), you can use our own DoFn. Regards JB

Re: HBase IO

-Baptiste Onofré jbono...@apache.org http://blog.nanthrax.net Talend - http://www.talend.com

Re: Introduction + new contributions

Regards, Vladisav On Sun, Dec 4, 2016 at 6:33 AM, Jean-Baptiste Onofré <j...@nanthrax.net> wrote: Welcome aboard ! Regards JB On 12/03/2016 03:08 PM, Vladisav Jelisavcic wrote: Hi, my name is Vladisav, and I would like to get involved in Apache Beam. For starters, I'll do something simpl

Re: Review on Jira for 0.4.0-incubating

out 0.4.0-incubating. I know we've made some significant progress there in the last few weeks, but I don't think we've quite finished. For example, https://issues.apache.org/jira/browse/BEAM-909 is unresolved and marked as 0.4.0-incubating. On Sat, Dec 3, 2016 at 10:26 PM, Jean-Baptiste Onofré &l

Review on Jira for 0.4.0-incubating

release. Thanks Regards JB -- Jean-Baptiste Onofré jbono...@apache.org http://blog.nanthrax.net Talend - http://www.talend.com

Re: Introduction + new contributions

Welcome aboard ! Regards JB On 12/03/2016 03:08 PM, Vladisav Jelisavcic wrote: Hi, my name is Vladisav, and I would like to get involved in Apache Beam. For starters, I'll do something simple, e.g.: BEAM-961 Best regards, Vladisav -- Jean-Baptiste Onofré jbono...@apache.org http

Re: Unable to clone beam site

-- Jean-Baptiste Onofré jbono...@apache.org http://blog.nanthrax.net Talend - http://www.talend.com

Re: Meet up at Strata+Hadoop World in Singapore

league) -- Jean-Baptiste Onofré jbono...@apache.org http://blog.nanthrax.net Talend - http://www.talend.com

Re: PCollection to PCollection Conversion

a base of discussion. Regards JB On 11/29/2016 09:23 PM, Jesse Anderson wrote: @jb Sounds good. Just let us know once you've pushed. On Tue, Nov 29, 2016 at 2:54 PM Jean-Baptiste Onofré <j...@nanthrax.net> wrote: Good point Eugene. Right now, it's a DoFn collection to experiment a bit (a pu

Re: PCollection to PCollection Conversion

/29/2016 09:23 PM, Jesse Anderson wrote: @jb Sounds good. Just let us know once you've pushed. On Tue, Nov 29, 2016 at 2:54 PM Jean-Baptiste Onofré <j...@nanthrax.net> wrote: Good point Eugene. Right now, it's a DoFn collection to experiment a bit (a pure extension). It's pretty

Re: PCollection to PCollection Conversion

. On Tue, Nov 29, 2016 at 11:15 AM Jean-Baptiste Onofré <j...@nanthrax.net> wrote: By the way Jesse, I gonna push my DATAFORMAT branch on my github and I will post on the dev mailing list when done. Regards JB On 11/29/2016 07:01 PM, Jesse Anderson wrote: I want to bring this thread back up

Re: PCollection to PCollection Conversion

ransforms to reside in the Beam repository at least for visibility reasons. One additional question is if these transforms represent a different DSL or if those could be grouped with the current extensions (e.g. Join and SortValues) into something more general that we as a community could maintain, but

Re: [PROPOSAL] "IOChannelFactory" Redesign and Make it Configurable

to investigate Hadoop FileSystem interface. -- Pei On Thu, Nov 17, 2016 at 1:21 AM, Jean-Baptiste Onofré <j...@nanthrax.net> wrote: By the way, Pei, for the record: why introducing BeamFileSystem and not using the Hadoop FileSystem interface ? Thanks Regards JB On 11/17/2016 01:09 AM,

Re: PCollection to PCollection Conversion

ory at least for visibility reasons. One additional question is if these transforms represent a different DSL or if those could be grouped with the current extensions (e.g. Join and SortValues) into something more general that we as a community could maintain, but well even if it is not the

Re: DoFn relying on Microservices

hat you mean by microservice ? Regards JB On 11/25/2016 01:18 PM, Sergio Fernández wrote: Hi JB, On Tue, Nov 22, 2016 at 11:14 AM, Jean-Baptiste Onofré <j...@nanthrax.net> wrote: DoFn will execute per element (with eventually a hook on StartBundle, FinishBundle, and Teardown). It's basi

Re: Hosting data stores for IO Transform testing

ly the simplest solution in terms of orchestration, but it depends on having a proper "embedded" implementation for an IO. Does this make sense to you ? have you considered it ? Thanks, Amit On Tue, Nov 22, 2016 at 8:20 AM Jean-Baptiste Onofré <j...@nanthrax.net> wrote: Hi Steph

Re: Hosting data stores for IO Transform testing

n, but it depends on having a proper "embedded" implementation for an IO. Does this make sense to you ? have you considered it ? Thanks, Amit On Tue, Nov 22, 2016 at 8:20 AM Jean-Baptiste Onofré <j...@nanthrax.net> wrote: Hi Stephen, as already discussed a bit togeth

Re: Hosting data stores for IO Transform testing

considered it ? Thanks, Amit On Tue, Nov 22, 2016 at 8:20 AM Jean-Baptiste Onofré <j...@nanthrax.net> wrote: Hi Stephen, as already discussed a bit together, it sounds great ! Especially I like it as a both integration test platform and good coverage for IOs. I'm very late on this but,

Re: [DISCUSS] Graduation to a top-level project

://community.apache.org/apache-way/apache-project- maturity-model.html [2] http://beam.incubator.apache.org/contribute/maturity-model/ -- Jean-Baptiste Onofré jbono...@apache.org http://blog.nanthrax.net Talend - http://www.talend.com

Re: DoFn relying on Microservices

gine would be to have it running outside (Functions in GCP, Lambdas in AWS, Microservices generally speaking). Therefore, does the current Beam model provide the sense of a DoFn which actually runs externally? Thanks in advance for the feedback. Cheers, -- Jean-Baptiste Onofré jbono...@apach

Re: Hosting data stores for IO Transform testing

ed larger runner instances, so it should play well with Spark, Flink, etc… As I discussed earlier on the mailing list, it looks like hosting docker containers on kubernetes, docker swarm or mesos+marathon would be a good solution. Thanks, Stephen Sisk -- Jean-Baptiste Onofré jbono...@apache.org http://b

Re: [PROPOSAL] "IOChannelFactory" Redesign and Make it Configurable

s.google.com/document/d/1-7vo9nLRsEEzDGnb562PuL4q9mUiq_ZVpCAiyyJw8p8/edit#heading=h.p3gc3colc2cs> Summary: Old API: IOChannelUtils.getFactory(glob).match(glob); New API: BeamFileSystems.getFileSystem(glob, config).match(glob); Looking for comments and feedback. Thanks -- Pei -- Jean-Baptiste Ono

Re: Including Apex runner in Beam tutorial at Strata - Singapore

to explore possibility of including the Apex runner as a part of that tutorial. As Apex runner is recently merged into master branch of Beam, it would be of interest to many people. Please let us know if we can do so. I can accordingly work on the same. Regards, Sandeep -- Jean-Baptiste Onofré jbono...@

ApacheCon: Apache Beam BoF and Beam diner

at 10:00 PM, Neelesh Salian <nsal...@cloudera.com> wrote: Anyone here today? On Nov 11, 2016 12:01 PM, "Stephan Ewen" <se...@apache.org> wrote: I'll also be in Sevilla Monday and Tuesday morning and happy to meet. Stephan On Fri, Nov 11, 2016 at 11:55 AM, Jean-Baptiste Ono

Re: Meet up at ApacheCon Seville

ri, Nov 11, 2016 at 11:55 AM, Jean-Baptiste Onofré <j...@nanthrax.net> wrote: Cool !! See you there ! Regards JB On 11/11/2016 11:42 AM, Neelesh Salian wrote: I'm getting there on Sunday and will be there all week. I have a Spark talk on Thursday. See you folks there. :) On Nov 11, 2

Re: Introduction + contributing to docs

://github.com/apache/incubator-beam-site/pull/76 [2] https://github.com/apache/incubator-beam-site/pull/77 [3] https://issues.apache.org/jira/browse/BEAM-193 -- Jean-Baptiste Onofré jbono...@apache.org http://blog.nanthrax.net Talend - http://www.talend.com

Re: Meet up at ApacheCon Seville

Cool !! See you there ! Regards JB On 11/11/2016 11:42 AM, Neelesh Salian wrote: I'm getting there on Sunday and will be there all week. I have a Spark talk on Thursday. See you folks there. :) On Nov 11, 2016 11:25 AM, "Jean-Baptiste Onofré" <j...@nanthrax.net> wrote: Hi

Re: Meet up at ApacheCon Seville

uys, I'll be there for the whole Apache Big Data, so it'll be great to meet you there! As far as I can seem, there are three Beam-focused talks: * Introduction to Apache Beam - Jean-Baptiste Onofré, Apache Software Foundation & Dan Halperin, Google (16th at 11h) * Going Under the Hood with Apache Beam - Siobh

Re: Meet up at ApacheCon Seville

will be there to give a Beam talk Wednesday morning; I'm around all week. I'd love to sync in person with anyone who wants to talk Beam. Please reach out to me directly if you'd like to meet. Thanks! Dan -- Jean-Baptiste Onofré jbono...@apache.org http://blog.nanthrax.net Talend - http

Re: [DISCUSS] Change "RunnableOnService" To A More Intuitive Name

. Maybe we can come up with a name this is tight to runner. Currently, I have two names in my head: - TestsWithRunners - RunnerExecutable Any thoughts? Thanks, Mark -- Jean-Baptiste Onofré jbono...@apache.org http://blog.nanthrax.net Talend - http://www.talend.com

Re: SBT/ivy dependency issues

pendencies. Did anyone with SBT/ivy encounter this issue. Thanks, Abbass, -- Jean-Baptiste Onofré jbono...@apache.org http://blog.nanthrax.net Talend - http://www.talend.com

Re: PCollection to PCollection Conversion

: Is converting to a PCollection mostly needed when you're using TextIO.Write? Will a general purpose transform only work in certain cases and you'll normally have to write custom code format the strings the way you want them? IMHO, it's yes to both. I'd prefer to add Object support to TextIO.W

Re: PCollection to PCollection Conversion

Agree. That's why I think it could be interesting to provide ready to use type converter ParDo with popular data format (string but more than that json, XML, ...). It's what I meant by type converters. Regards JB ⁣​ On Nov 8, 2016, 16:31, at 16:31, Lukasz Cwik

Re: [PROPOSAL] Merge apex-runner to master branch

+1 Great work Thomas !! Regards JB ⁣​ On Nov 8, 2016, 14:54, at 14:54, Thomas Weise wrote: >Hi, > >As per previous discussion [1], I would like to propose to merge the >apex-runner branch into master. The runner satisfies the criteria >outlined >in [2] and merging it to

Re: Timer and Window behavior

. This is bug or incorrect using API from my side? -- Jean-Baptiste Onofré jbono...@apache.org http://blog.nanthrax.net Talend - http://www.talend.com

Re: Tutorials

Hi Jesse, Not a full day. I did kind of half day tutorial to my team. Regards JB On 11/04/2016 07:23 PM, Jesse Anderson wrote: Has anyone done a full day (~6 hours) tutorial on Beam yet? Thanks, Jesse -- Jean-Baptiste Onofré jbono...@apache.org http://blog.nanthrax.net Talend - http

Re: Contributing to Beam docs

his new structure in a pull request <https://github.com/apache/incubator-beam-site/pull/62>, which is staged here <http://apache-beam-website-pull-requests.storage.googleapis.com/62/index.html>. If you've worked on the website before, you've probably run into this - note that you'l

Re: Podling Report Reminder - November 2016

or PMC members elected? The following committers were elected on 2016/10/20: * Thomas Weise * Jesse Anderson * Thomas Groh Signed-off-by: [ ](beam) Jean-Baptiste Onofre [ ](beam) Venkatesh Seetharam [ ](beam) Ted Dunning Shepherd/Mentor notes: -- Jean-Baptiste Onofré jbono...@apache.org http

Re: PAssert.GroupedGlobally defaults to a single empty Iterable.

ing/PAssert.java#L825> that it will result in a singe empty iterable even if the input PCollection is empty. This is a weird behaviour as it may cause following assertions to fail. Wouldn't it be more correct to remove (filter out ?) this element ? Thanks, Amit -- Jean-Baptiste Onofré

Re: Podling Report Reminder - November 2016

-by: [ ](beam) Jean-Baptiste Onofre [ ](beam) Venkatesh Seetharam [ ](beam) Ted Dunning Shepherd/Mentor notes: On Mon, Oct 31, 2016 at 10:55 PM, Jean-Baptiste Onofré <j...@nanthrax.net> wrote: Hi James, Sorry to bother you again: do you have any update about the podling report (I c

Re: Podling Report Reminder - November 2016

mplate. Mentors --- Mentors should review reports for their project(s) and sign them off on the Incubator wiki page. Signing off reports shows that you are following the project - projects that are not signed may raise alarms for the Incubator PMC. Incubator PMC -- Jean-Baptiste Onofré

Re: [ANNOUNCE] Beam 0.3.0-incubating Released

slowly propagate through the Apache servers. I'll also send an email to the user list to highlight some of the new features. Cheers, Aljoscha -- Jean-Baptiste Onofré jbono...@apache.org http://blog.nanthrax.net Talend - http://www.talend.com

Re: Podling Report Reminder - November 2016

lowing the project - projects that are not signed may raise alarms for the Incubator PMC. Incubator PMC -- Jean-Baptiste Onofré jbono...@apache.org http://blog.nanthrax.net Talend - http://www.talend.com

Re: Contributing for improvement of the Beam website

Hi You can submit PR on incubator-beam-website. Take a look on site README about the Jekyll use etc. Regards JB ⁣​ On Oct 29, 2016, 12:54, at 12:54, Minudika Malshan wrote: >Hi all, > >I would like to know how to submit patches for Apache Beam website? >I went through

Re: [VOTE] Apache Beam release 0.3.0-incubating

+1 (binding) Regards JB ⁣​ On Oct 28, 2016, 10:58, at 10:58, Aljoscha Krettek wrote: >Hi everyone, >Please review and vote on the release candidate #1 for the Apache Beam >version 0.3.0-incubating, as follows: >[ ] +1, Approve the release >[ ] -1, Do not approve the

Re: [VOTE] Apache Beam release 0.3.0-incubating

Hi John Rat is supposed to run with the release profile. We are going to check that and why DEPENDENCIES file has not been checked. Regarding Kinesis, the dependency should not be embedded in any Beam jar or distribution. The user has to explicitly define the dependency to be able to use the

Re: Podling Report Reminder - November 2016

Perfect. Thanks James ! Regards JB ⁣​ On Oct 27, 2016, 01:05, at 01:05, James Malone wrote: >Hello everyone! > >Unless anyone disagrees or wants to do it, I am happy to volunteer to >draft >this podling report for review before we submit it. I can get it done

Re: Can we have more quick start examples ?

Yes it sounds good to me. I would love to see this as part of the examples. Ismael and I also started the beam-samples (http://github.com/jbonofre/beam-samples) that could be part of the examples. The purpose is to have more real use cases implementation with real data. Regards JB ⁣​ On Oct

Re: [DISCUSS] Using Verbs for Transforms

gt;block a >> change. >> >> Let's go with Distinct. It's important to align Beam with the open >source >> big data community. (And thanks Jesse, our newest (*tied) committer, >for >> pushing us in the right direction!) >> >> Jesse, can you please take

Re: [DISCUSS] Using Verbs for Transforms

ch >solution, but at the end of the day I don't think anyone wants to block >a >change. > >Let's go with Distinct. It's important to align Beam with the open >source >big data community. (And thanks Jesse, our newest (*tied) committer, >for >pushing us in the right direction!) &g

Re: [PROPOSAL] New Beam website design?

all, > >I would like to join for the development of the new site. >Is there any issue tracking method for this? (Are there any jirra >issues) > >Thank you! > > > >On Thu, Oct 27, 2016 at 4:01 PM, Jean-Baptiste Onofré <j...@nanthrax.net> >wrote: > >

Re: [PROPOSAL] New Beam website design?

t; Hi Davor, >>> >>> I am done with my local setup to start contributing, I have forked >and >>> merged pull request *(**pull/51)* into my local repo. Then I read >the >>> >>> google docs, their are two tasks mentioned in it, as [Beam-500] and &g

Re: [DISCUSS] Using Verbs for Transforms

t sound like the >duplicates >> are removed, rather than a new PCollection without duplicates being >> returned. >> >> On Wed, Oct 26, 2016, 7:36 AM Jean-Baptiste Onofré <j...@nanthrax.net> >> wrote: >> >> > Agree. It was more a transition proposal

Re: Apex runner status and next steps

+1 Good idea and fully agree about the three points. Regards JB ⁣​ On Oct 26, 2016, 19:24, at 19:24, Thomas Weise wrote: >Hi, > >The Apex runner is currently in a feature branch: > >https://github.com/apache/incubator-beam/tree/apex-runner > >Focus till here has been on

Re: [DISCUSS] Using Verbs for Transforms

ates makes it sound like the >duplicates >> are removed, rather than a new PCollection without duplicates being >> returned. >> >> On Wed, Oct 26, 2016, 7:36 AM Jean-Baptiste Onofré <j...@nanthrax.net> >> wrote: >> >> > Agree. It was more a transition

Re: [DISCUSS] Using Verbs for Transforms

Agree. It was more a transition proposal. Regards JB ⁣​ On Oct 26, 2016, 08:31, at 08:31, Robert Bradshaw <rober...@google.com.INVALID> wrote: >On Mon, Oct 24, 2016 at 11:02 PM, Jean-Baptiste Onofré ><j...@nanthrax.net> wrote: >> And what about use RemoveDuplicates and

Re: [DISCUSS] Using Verbs for Transforms

gt;> >> ⁣​ >> >> On Oct 26, 2016, 07:16, at 07:16, Jesse Anderson ><je...@smokinghand.com> >> wrote: >> >We need to make a decision on this so Neelesh can finish his commit. >> >Should >> >we take a vote or something? >> > >> >

Re: [DISCUSS] Using Verbs for Transforms

And what about use RemoveDuplicates and create an alias Distinct ? It doesn't break the API and would address both SQL users and more "big data" users. My $0.01 ;) Regards JB ⁣​ On Oct 24, 2016, 22:23, at 22:23, Dan Halperin wrote: >I find "MakeDistinct" more

Re: [DISCUSS] Current ongoing work on runners

ser DoFns (coupled with new-style DoFn) (not yet >completely in master) > * SplittableDoFn > >This would allow tracking the process in each of these for each runner >and >would not require hunting for that information in email threads. > >On Tue, 25 Oct 2016 at 08:12 Jean-

Re: [DISCUSS] Using Verbs for Transforms

;we take a vote or something? > >On Tue, Oct 25, 2016, 7:55 AM Jean-Baptiste Onofré <j...@nanthrax.net> >wrote: > >> Sounds good to me. >> >> ⁣​ >> >> On Oct 24, 2016, 19:11, at 19:11, je...@smokinghand.com wrote: >> >I prefer MakeDistinct if we have to make it a verb. >>

Re: [VOTE] Release 0.3.0-incubating, release candidate #1

Agree. We already discussed about that on the mailing list. I mentionned this some weeks ago. Regards JB ⁣​ On Oct 26, 2016, 02:26, at 02:26, Dan Halperin wrote: >My reading of the LEGAL threads is that since we are not including >(shading >or bundling) the

Re: [DISCUSS] Merging master -> feature branch

Agree. When possible it would be great to have the branch merged on master quickly, even when it's not fully ready. It would give more visibility to potential contributors. Regards JB ⁣​ On Oct 25, 2016, 23:34, at 23:34, Kenneth Knowles wrote: >Hi all, > >While

Re: [VOTE] Release 0.3.0-incubating, release candidate #1

Thanks Sergio ;) Just tried to explain to the others what is a binding vote ;) Regards JB ⁣​ On Oct 25, 2016, 11:53, at 11:53, "Sergio Fernández" <wik...@apache.org> wrote: >On Tue, Oct 25, 2016 at 11:36 AM, Jean-Baptiste Onofré ><j...@nanthrax.net> >wr

Re: [VOTE] Release 0.3.0-incubating, release candidate #1

hecksum in the >file >with one that was derived from the zip. I hope that's still ok for the >release to go through? > >Cheers, >Aljoscha > >On Tue, 25 Oct 2016 at 11:53 Sergio Fernández <wik...@apache.org> >wrote: > >> On Tue, Oct 25, 2016 at 11:36 AM, Jean

Re: [VOTE] Release 0.3.0-incubating, release candidate #1

By the way, your vote is not binding from a podling perspective (you are not PPMC). Your vote is binding from IPMC perspective (so when you will vote on the incubator mailing list). So this vote is +1 (non binding). Regards JB ⁣​ On Oct 25, 2016, 11:33, at 11:33, "Sergio Fernández"

Re: [VOTE] Release 0.3.0-incubating, release candidate #1

essfully > >One thing to add for future vote calls [idea copied from the latest >flink >vote ;)]: > >The release artifacts are signed with the key with fingerprint 121D7293 >https://dist.apache.org/repos/dist/release/incubator/beam/KEYS >​ > > >On Tue, Oct 25, 2016 at 7:55

Re: [DISCUSS] Current ongoing work on runners

+1. For me it's one of the most important point for the new website. We should give a clear and exhaustive list of what we have, both for runners and IOs (with supported features). Regards JB ⁣​ On Oct 24, 2016, 21:52, at 21:52, "Ismaël Mejía" wrote: >Hello, > >I am really

Re: Podling Report Reminder - November 2016

Hi guys @James do you want to prepare this podling report ? I will review. Let me know if you need any help. Thanks Regards JB ⁣​ On Oct 25, 2016, 02:02, at 02:02, johndam...@apache.org wrote: >Dear podling, > >This email was sent by an automated system on behalf of the Apache >Incubator PMC.

Re: [DISCUSS] Using Verbs for Transforms

Sounds good to me. ⁣​ On Oct 24, 2016, 19:11, at 19:11, je...@smokinghand.com wrote: >I prefer MakeDistinct if we have to make it a verb.

Re: [ANNOUNCEMENT] New committers!

, 2016, 16:10, at 16:10, Christian Schneider <ch...@die-schneider.net> wrote: >I was just a bit concerned that new committers might have to do >comparable contributions like the current three new committers .. which > >might be quite a high bar :-) > >Christian > >On 2

Re: [ANNOUNCEMENT] New committers!

e if you would propose someone, what would be the minimum >level of contribution before you have a good feeling to propose >him/her. > >Christian > >On 24.10.2016 12:20, Jean-Baptiste Onofré wrote: >> Hi Christian, >> >> Your e-mail sounds "weird" to me: lik

Re: [ANNOUNCEMENT] New committers!

Hi Christian, Your e-mail sounds "weird" to me: like other Apache projects, if your contribution is valuable and sustained, then you will deserve committer-ship. It's meritocracy based. Working part time is not a problem, it would make little bit more time to get into. So, just a timing

  1   2   3   4   >