Re: When do the deltas of a transaction become observable?

2018-12-03 Thread Granville Barnett
Thanks Gopal, that was very helpful. Granville On Mon, 26 Nov 2018 at 08:14, Gopal Vijayaraghavan wrote: > > >release of the locks) but I can't seem to find it. As it's a > transactional > >system I'd expect we observe both deltas or none at all, at the point > of > >successful

When do the deltas of a transaction become observable?

2018-11-23 Thread Granville Barnett
Hi All, I'm trying to figure out where in the Hive codebase that all deltas that are the side effect of a Hive 3.x transaction become observable. (My current investigation is for HDFS.) For example, from table1 insert into table2 select x insert into table3 select x; This transaction generates

Re: Why are TXN IDs not partitioned per database?

2018-11-20 Thread Granville Barnett
> Alan. > > On Tue, Nov 20, 2018 at 7:32 AM Granville Barnett < > granvillebarn...@gmail.com> wrote: > > > Hi, > > > > Reading the source code of Hive 3.x and I have a question regarding > > transaction IDs which form the span of a transaction: it's begin

Why are TXN IDs not partitioned per database?

2018-11-20 Thread Granville Barnett
Hi, Reading the source code of Hive 3.x and I have a question regarding transaction IDs which form the span of a transaction: it's begin (TXN ID) and commit ID (NEXT_TXN_ID at time of commit). Why is it that we have a global timeline for transactions rather than a timeline partitioned at the