Re: [VOTE] Release 0.5.0-incubating, release candidate #1

2019-09-14 Thread nishith agarwal
+1 (binding) Amazing job Balaji! checksums [success] verified signatures [success] mvn clean install -DskipTests [success] Thanks, Nishith On Sat, Sep 14, 2019 at 7:39 PM vbal...@apache.org wrote: > Good point Vinoth. It looks like this is needed for incubator projects. > Let me go ahead and

Re: [DISCUSS] [VOTE] JDBC incremental load with DeltaStreamer

2019-09-14 Thread vbal...@apache.org
+1. Agree with everyone's point. Go for it Taher !! Balaji.VOn Saturday, September 14, 2019, 07:44:04 PM PDT, Bhavani Sudha Saktheeswaran wrote: +1 I  think adding new sources to DeltaStreamer is really valuable. Thanks, Sudha On Sat, Sep 14, 2019 at 7:52 AM vino yang wrote: > Hi

Re: ApacheCon NA 19 slides

2019-09-14 Thread Vinoth Chandar
Yes will look for opportunities to repeat in the bay area. Updated the site with talk and already tweeted from apache hudi handle! On Fri, Sep 13, 2019 at 1:13 PM Thomas Weise wrote: > Thanks for sharing. The presentation provides a nice intro into Hudi that > will help making new folks more

Re: [DISCUSS] [VOTE] JDBC incremental load with DeltaStreamer

2019-09-14 Thread Bhavani Sudha Saktheeswaran
+1 I think adding new sources to DeltaStreamer is really valuable. Thanks, Sudha On Sat, Sep 14, 2019 at 7:52 AM vino yang wrote: > Hi Taher, > > IMO, it's a good supplement to Hudi. > > So +1 from my side. > > Vinoth Chandar 于2019年9月14日周六 下午10:23写道: > > > Hi Taher, > > > > I am fully

Re: [VOTE] Release 0.5.0-incubating, release candidate #1

2019-09-14 Thread vbal...@apache.org
Good point Vinoth. It looks like this is needed for incubator projects.  Let me go ahead and add this DISCLAIMER file and also check if NOTICE files can be cleaned up. Folks,  I am going to -1 and drop release candidate-1.  I will create a new RC release after I fixed the above. Thanks a lot

Re: [VOTE] Release 0.5.0-incubating, release candidate #1

2019-09-14 Thread Bhavani Sudha Saktheeswaran
+1 (non-binding) on other aspects. - verified checksums and signatures [SUCCESS] - built from source release (mvn clean install -DskipTests) [SUCCESS] - ran local docker tests [SUCCESS] - ran some IDE tests [SUCCESS] Thanks, Sudha On Sat, Sep 14, 2019 at 6:46 PM Vinoth Chandar wrote: > -1

Re: [VOTE] Release 0.5.0-incubating, release candidate #1

2019-09-14 Thread Vinoth Chandar
-1 (binding) - Checksums & Signatures verify - Built the branch & tests pass - My own test jobs seem to work - Checked pom for version - NOTICE and LICENSE I think were updated right before RC was cut. Should be good to go - Source files all have ASF license . Tested rat plugin fails build if

Re: Merging schema's during Incremental load

2019-09-14 Thread Gautam Nayak
Thanks Balaji for the detailed information.One of our pipeline sources data from databases [1] (incremental Sqoop) as parquet files and the other pipeline sources system generated incremental CSV’s [2] , both of which have to be persisted and read as Hive/Presto tables.In both these cases, We

Re: [VOTE] Release 0.5.0-incubating, release candidate #1

2019-09-14 Thread Prasanna Rajaperumal
+1 (binding) Great job getting the RC out! - verified checksums - verified signatures - Built the branch and my tests pass On 2019/09/14 13:19:25, leesf wrote: > +1 (non-binding) > > - verified checksums and signatures - OK > - checked that all pom.xml files point to the same >

Re: [DISCUSS] [VOTE] JDBC incremental load with DeltaStreamer

2019-09-14 Thread Vinoth Chandar
Hi Taher, I am fully onboard on this. This is such a frequently asked question and having it all doable with a simple DeltaStreamer command would be really powerful. +1 - Vinoth On 2019/09/14 05:51:05, Taher Koitawala wrote: > Hi All, > Currently, we are trying to pull data

Re: [VOTE] Release 0.5.0-incubating, release candidate #1

2019-09-14 Thread leesf
+1 (non-binding) - verified checksums and signatures - OK - checked that all pom.xml files point to the same version(0.5.0-incubating-rc1) - OK - built from source(mvn clean install -DskipTests) - OK - ran some tests in IDE - OK Best, Leesf vbal...@apache.org 于2019年9月14日周六 上午6:32写道: > Hi

Re: Merging schema's during Incremental load

2019-09-14 Thread vbal...@apache.org
Hi Gautam, What I understood was you are trying to incrementally ingest from RowBasedSource. It is not clear to me if this upstream source is another HoodieIncrSource. If that is the case, not sure how the second batch will miss the columns. Can you elaborate more on the setup and what your