Re: Upsert after Delete

2019-09-02 Thread Kabeer Ahmed
gt; > > > > > I have dug into the issue in detail and it seems it is a bug. I have > > > filed > > > > > it at: https://github.com/apache/incubator-hudi/issues/859 ( > > > > > > > > > > https://link.getmailspring.com/l

Re: Upsert after Delete

2019-08-31 Thread Vinoth Chandar
a3...@getmailspring.com/0?redirect=https%3A%2F%2Fgithub.com%2Fapache%2Fincubator-hudi%2Fissues%2F859=ZGV2QGh1ZGkuYXBhY2hlLm9yZw%3D%3D > > ). > > > > Let me know if more information is required. > > > > Thank you, > > > > > > > > On Aug 23 2019, at

Re: Upsert after Delete

2019-08-31 Thread Jaimin Shah
ZGV2QGh1ZGkuYXBhY2hlLm9yZw%3D%3D > ). > > > Let me know if more information is required. > > > Thank you, > > > > > > On Aug 23 2019, at 1:37 am, Vinoth Chandar wrote: > > > > yes. I was asking about the HUDI storage type.. > > > > > > > > There is not

Re: Upsert after Delete

2019-08-30 Thread Vinoth Chandar
ect=https%3A%2F%2Fgithub.com%2Fapache%2Fincubator-hudi%2Fissues%2F859=ZGV2QGh1ZGkuYXBhY2hlLm9yZw%3D%3D > ). > > > Let me know if more information is required. > > > Thank you, > > > > > > On Aug 23 2019, at 1:37 am, Vinoth Chandar wrote: > > > > yes

Re: Upsert after Delete

2019-08-30 Thread Kabeer Ahmed
m%2Fapache%2Fincubator-hudi%2Fissues%2F859=ZGV2QGh1ZGkuYXBhY2hlLm9yZw%3D%3D > > ). > > > Let me know if more information is required. > > > Thank you, > > > > > > On Aug 23 2019, at 1:37 am, Vinoth Chandar wrote: > > > > y

Re: Upsert after Delete

2019-08-30 Thread Vinoth Chandar
s%2F859=ZGV2QGh1ZGkuYXBhY2hlLm9yZw%3D%3D > ). > > Let me know if more information is required. > > Thank you, > > > > On Aug 23 2019, at 1:37 am, Vinoth Chandar wrote: > > > yes. I was asking about the HUDI storage type.. > > > > > > There is no

Re: Upsert after Delete

2019-08-29 Thread Jaimin Shah
is required. > Thank you, > > On Aug 23 2019, at 1:37 am, Vinoth Chandar wrote: > > yes. I was asking about the HUDI storage type.. > > > > There is nothing complex about upsert() after delete(). It almost as if a > > delete() for (2, vinoth) happened in between.

Re: Upsert after Delete

2019-08-28 Thread vbal...@apache.org
ype.. > > There is nothing complex about upsert() after delete(). It almost as if a > delete() for (2, vinoth) happened in between. > > Are you able to repro this literally with this tiny example with 3 records? > Some things to check > > - This sequence would have created 3 commits. You can

Re: Upsert after Delete

2019-08-28 Thread Kabeer Ahmed
information is required. Thank you, On Aug 23 2019, at 1:37 am, Vinoth Chandar wrote: > yes. I was asking about the HUDI storage type.. > > There is nothing complex about upsert() after delete(). It almost as if a > delete() for (2, vinoth) happened in between. > > Are you able to re

Re: Upsert after Delete

2019-08-22 Thread Vinoth Chandar
yes. I was asking about the HUDI storage type.. There is nothing complex about upsert() after delete(). It almost as if a delete() for (2, vinoth) happened in between. Are you able to repro this literally with this tiny example with 3 records? Some things to check - This sequence would have

Upsert after Delete

2019-08-22 Thread Kabeer Ahmed
Value(IndexedRecord > currentValue, > chema schema) { > return Optional.empty(); > } > @Override > public Optional getInsertValue(Schema schema) { > return Optional.empty(); > } > } ------ Forwarded Message - From: Vinoth Chandar Subject: Re: Upsert after De

Re: Upsert after Delete

2019-08-22 Thread Vinoth Chandar
in the table is: (2, vinoth) and it is > visible via sql through Presto/Hive. > > Upsert a new record into the same table (3, balaji). Query the table and > only record that is visible is: (3, balaji). The record (2, vinoth) is not > displayed in the results. > > Any ideas on what coul