Re: Searching for duplicates during feed ingestion.

Got the point now… I would image If the record has a version number that could potentially solve some problems here. However, it would be a totally difference story then.. > On May 8, 2017, at 12:39 PM, Mike Carey wrote: > > Note that upserts don't avoid searches (Still

Re: Searching for duplicates during feed ingestion.

Aha, never knew that before. We will definitely try upsert feed next time! Thanks for pointing it out! > On May 8, 2017, at 12:07 PM, Ildar Absalyamov > wrote: > > I believe we already support upsert feeds ;) >

Re: Searching for duplicates during feed ingestion.

I believe we already support upsert feeds ;) https://github.com/apache/asterixdb/blob/master/asterixdb/asterix-app/src/test/resources/runtimets/queries/feeds/upsert-feed/upsert-feed.1.ddl.aql

Re: Searching for duplicates during feed ingestion.

I also observe this getting slower problem every-time when we re-ingest the twitter data. One difference is that the duplicate key could happen, and we know that is indeed duplicate record. To skip the search, we would expect an “upsert” logic ( just replace the old one :-) ) instead of an

Re: Searching for duplicates during feed ingestion.

+1 for auto-generated ID case Best, Taewoo On Mon, May 8, 2017 at 8:57 AM, Yingyi Bu wrote: > Abdullah has a pending change that disables searches if there's no > secondary indexes [1]. > Auto-generated ID could be another case for which we can disable searches > as well. >

Re: Searching for duplicates during feed ingestion.

Abdullah has a pending change that disables searches if there's no secondary indexes [1]. Auto-generated ID could be another case for which we can disable searches as well. Best, Yingyi [1] https://asterix-gerrit.ics.uci.edu/#/c/1711/ On Mon, May 8, 2017 at 4:30 AM, Wail Alkowaileet

ASTERIXDB-1371: Support the standard GIS objects

Hi, I have been selected to contribute to the issue ASTERIXDB-1371 for GSoC this time. This being the community bonding period I am trying to familiarize myself with the code base of AsterixDB and to get a grasp of the task. I am under the