Great!
-Nishith
On Thu, Sep 17, 2020 at 10:28 AM tanu dua wrote:
> Thank you so much Nisheth. I understand now how it’s going to work.
>
> On Wed, 16 Sep 2020 at 11:15 PM, nishith agarwal
> wrote:
>
> > Tanu,
> >
> >
> >
> > I'm assuming you're talking about multiple kafka partitions from a si
Thank you so much Nisheth. I understand now how it’s going to work.
On Wed, 16 Sep 2020 at 11:15 PM, nishith agarwal
wrote:
> Tanu,
>
>
>
> I'm assuming you're talking about multiple kafka partitions from a single
>
> Spark Streaming job. In this case, your job can read from
>
> multiple partiti
Tanu,
I'm assuming you're talking about multiple kafka partitions from a single
Spark Streaming job. In this case, your job can read from
multiple partitions but at the end, this data should be written to a single
table. The dataset/rdd resulting from reading multiple partitions is passed
as a who
Hi,
I need to try myself more on this but how Hudi concurrent ingestion works
with Spark Streaming.
We have multiple Kafka partitions on which Spark is listening on so there
is a possibility that at any given point of time multiple executors will be
reading the kafka partitions and start ingesting
