Re: Hudi Concurrent Ingestion with Spark Streaming

2020-09-17 Thread nishith agarwal
Great! -Nishith On Thu, Sep 17, 2020 at 10:28 AM tanu dua wrote: > Thank you so much Nisheth. I understand now how it’s going to work. > > On Wed, 16 Sep 2020 at 11:15 PM, nishith agarwal > wrote: > > > Tanu, > > > > > > > > I'm assuming you're talking about multiple kafka partitions from a

Re: Hudi Concurrent Ingestion with Spark Streaming

2020-09-17 Thread tanu dua
Thank you so much Nisheth. I understand now how it’s going to work. On Wed, 16 Sep 2020 at 11:15 PM, nishith agarwal wrote: > Tanu, > > > > I'm assuming you're talking about multiple kafka partitions from a single > > Spark Streaming job. In this case, your job can read from > > multiple

Re: [DISCUSS] New Community Weekly Sync up Time

2020-09-17 Thread Vinoth Chandar
Anyone else want to chime in, before we decide on moving this an hour earlier? We will wait for another day or so. Please chime in On Tue, Sep 15, 2020 at 8:42 PM nishith agarwal wrote: > The current time suits well for me personally as well. But I'm fine with > 8-9 pm if that helps accommodate