Re: Podling Report Reminder - October 2019

2019-10-01 Thread Thomas Weise
Looks good, signed off. On Mon, Sep 30, 2019 at 5:34 AM Vinoth Chandar wrote: > @mentors, I have updated the wiki with draft notes. Kindly review. > > -- Forwarded message - > From: > Date: Sat, Sep 28, 2019 at 5:44 PM > Subject: Podling Report Reminder - October 2019 > To: >

Podling Hudi Report Reminder - October 2019

2019-10-01 Thread jmclean
Dear podling, This email was sent by an automated system on behalf of the Apache Incubator PMC. It is an initial reminder to give you plenty of time to prepare your quarterly board report. The board meeting is scheduled for Wed, 16 October 2019, 10:30 am PDT. The report for your podling will

Re: Kafka read exception when using HoodieDeltaStreamer

2019-10-01 Thread Vinoth Chandar
Thanks for the detailed notes. helps. Could you give a quick shot trying to override the version in a custom build ? Wondering if just upgrading Kafka would suffice for your scenario (without needing the 2.12 scala bundle) On Tue, Oct 1, 2019 at 10:14 AM Gautam Nayak wrote: > Thanks Nishith

Re: Using Hudi to Pull multiple tables

2019-10-01 Thread Vinoth Chandar
I think this has come up before. +1 to the point pratyaksh mentioned. I would like to add a few more - Schema could be fetched dynamically from a registry based on topic/dataset name. Solvable - The hudi keys, partition fields and the inputs you need for configuring hudi needs to be

Re: Using Hudi to Pull multiple tables

2019-10-01 Thread Pratyaksh Sharma
Hi Gurudatt, With a minimal code change, you can subscribe to multiple Kafka topics using KafkaOffsetGen.java class. I feel the bigger problem in this case is going to be managing multiple target schemas because we register ParquetWriter with a single target schema at a time. I would also like to