Re: DISCUSS code, config, design walk through sessions

2020-07-23 Thread Adam Feldman
Great! Thank you On Thu, Jul 23, 2020, 10:49 Vinoth Chandar wrote: > Hi Adam, > > Next week. July 30th 8AM PST. > > I will be sending dial in information over the weekend. > > > > On Thu, Jul 23, 2020 at 7:47 AM Adam Feldman wrote: > > > Hey, wa

Re: DISCUSS code, config, design walk through sessions

2020-07-23 Thread Adam Feldman
y 23/30 Thursday 8 AM PST work for > everyone? > > On Tue, Jul 14, 2020 at 12:17 PM Shiyan Xu > wrote: > > > +1 > > > > On Tue, Jul 14, 2020, 11:34 AM Vinoth Chandar wrote: > > > > > Typo: date TBD (not data :)) > > > > > > On Tue, Jul 14,

Incremental Query missing Deletions

2020-07-16 Thread Adam Feldman
Hi, When querying a table using an incremental query, the result is a table or records that have been added or updated between the beginInstantTime and the END_INSTANTTIME_OPT_KEY or How can we get the incremental query to return the full incremental difference including marked records that were

Re: Handling delta

2020-07-16 Thread Adam Feldman
: RECORDKEY_FIELD_OPT_KEY is the key variable mapped to the hoodie.datasource.write.recordkey.field configuration. Thanks, Adam Feldman On Thu, Jul 16, 2020 at 1:00 PM Sivaprakash wrote: > Looks like this property does the trick > > Property: hoodie.datasource.write.recordkey.field, Default: uuid > Reco

Re: Handling delta

2020-07-16 Thread Adam Feldman
Hi Sivaprakash, Not an expert here either, but for your second question. Yes, I believe when writing delta to the table you must identify the actual delta yourself and only write the new/changed/removed records. I guess we could put a request in for hudi to take care of this, but two possible

Re: DISCUSS code, config, design walk through sessions

2020-07-14 Thread Adam Feldman
> > > > > Vinoth > > > > > > > > > > > > > > > On Sun, Jul 12, 2020 at 4:12 PM Ranganath Tirumala < > > > > > ranganath.tirum...@gmail.com> wrote: > > > > > > > > > > > So, Is this confirmed for 14th

Re: DISCUSS code, config, design walk through sessions

2020-07-09 Thread Adam Feldman
Yea, time zones are tough. That's midnight in EST and the middle of the night if anyone is in Western Europe... On Thu, Jul 9, 2020, 23:08 wei li wrote: > +1 > > On 2020/07/06 03:30:43, Vinoth Chandar wrote: > > Hi all, > > > > As we scale the community, its important that more of us are able

Re: DISCUSS code, config, design walk through sessions

2020-07-08 Thread Adam Feldman
uly 6, 2020, 09:11:47 AM PDT, Bhavani Sudha < > > > bhavanisud...@gmail.com> wrote: > > > > > > +1 this is a great idea! > > > > > > On Mon, Jul 6, 2020 at 7:54 AM vino yang > wrote: > > > > > > > +1 > > > > &

Re: DISCUSS code, config, design walk through sessions

2020-07-06 Thread Adam Feldman
Interested On Mon, Jul 6, 2020, 08:29 Sivabalan wrote: > +1 for sure > > On Mon, Jul 6, 2020 at 4:42 AM Gurudatt Kulkarni > wrote: > > > +1 > > Really a great idea. Will help in understanding the project better. > > > > On Mon, Jul 6, 2020 at 1:35 PM Pratyaksh Sharma > > wrote: > > > > > This