Re: Consuming delta from Hive tables

2019-05-17 Thread Bhargav Bipinchandra Naik (Seller Platform-BLR)
Thanks, -Bhargav On Tue, May 7, 2019 at 6:02 PM Bhargav Bipinchandra Naik (Seller Platform-BLR) wrote: > Hi Jesus and Alan, > > Thanks for the prompt reply. > Had a follow up question. > > *timestamp:* t1 < t2 < t3 < t4 < t5 < t6 > > *w1 -* transaction

Re: Consuming delta from Hive tables

2019-05-20 Thread Bhargav Bipinchandra Naik (Seller Platform-BLR)
records magically > reappearing. > > Alan. > > On Fri, May 17, 2019 at 4:44 AM Bhargav Bipinchandra Naik (Seller > Platform-BLR) wrote: > >> Is the following scenario supported? >> >> *timestamp:* t1 < t2 < t3 < t4 < t5 < t6 >> >> *w1 -*

Re: Consuming delta from Hive tables

2019-05-07 Thread Bhargav Bipinchandra Naik (Seller Platform-BLR)
interest you). The mapping of writeids > (table specific) to transaction ids (system wide) is also cleaned > intermittently, again erasing history. And there's no way to get the > mapping from writeids to transaction ids from outside of Hive. > > Alan. > > On Mon, May 6, 2

Consuming delta from Hive tables

2019-05-06 Thread Bhargav Bipinchandra Naik (Seller Platform-BLR)
We have a scenario where we want to consume only delta updates from Hive tables. - Multiple producers are updating data in Hive table - Multiple consumer reading data from the Hive table Consumption pattern: - Get all data that has been updated since last time I read. Is there any mechanism in