Re: index-only plans

2016-08-11 Thread Taewoo Kim
Thanks Till for reviewing this giant patch set. At this moment, what I can try to do is removing all necessary test cases and changes that are related to full-text search preparation (changing the function name of "contains" to "string-contains") since I thought this index-only plan branch could

The configuration file (asterix-configuration.xml) now supports multiples of the unit byte.

2016-08-12 Thread Taewoo Kim
Hello All, As https://issues.apache.org/jira/browse/ASTERIXDB-1569 states, you can use multiples of the unit byte (e.g., KB, MB, GB ...) to specify a byte value in the following parameters in the configuration file. You can check out the current master codebase to apply the changes. You can also

Re: index-only plans

2016-08-12 Thread Taewoo Kim
@Chen, @Till: Thanks. I will try. Best, Taewoo On Thu, Aug 11, 2016 at 10:55 PM, Chen Li <che...@gmail.com> wrote: > I am always a big fan of separating a big merge into multiple small > changes. It will be good to do this "partitioning." > > Chen > > On Th

Re: questions about index-only change

2016-07-12 Thread Taewoo Kim
e the knowledge. > > Chen > > On Fri, Jul 8, 2016 at 1:43 PM, Yingyi Bu <buyin...@gmail.com> wrote: > > Cool, thanks a lot, Taewoo! > > > > Best, > > Yingyi > > > > On Fri, Jul 8, 2016 at 1:36 PM, Taewoo Kim <wangs...@gmail.com> wrote: >

A question regarding RecoverIT

2016-07-19 Thread Taewoo Kim
Hello All, I'm trying to add a test case for RecoverIT. When I check the query directory, I found that there is not a corresponding 'result' directory for some test cases. For example, primary_plus_rtree_index test cases in

Re: Errors, exceptions, and error codes

2016-07-15 Thread Taewoo Kim
It's a great idea. Can you show us a before/after example that you have replaced already in your branch if there is any? Best, Taewoo On Fri, Jul 15, 2016 at 11:50 AM, Till Westmann wrote: > Hi, > > triggered by a recent bug fix that required an non-trivial error >

Re: Errors, exceptions, and error codes

2016-07-15 Thread Taewoo Kim
Got it. Thanks! Best, Taewoo On Fri, Jul 15, 2016 at 1:30 PM, Till Westmann <ti...@apache.org> wrote: > There’s not example so far. I think/hope that we’ll see one in one of > Abdullah’s bug fixes :) > > > On 15 Jul 2016, at 13:16, Taewoo Kim wrote: > > It's a

Re: Debugging source code

2016-07-29 Thread Taewoo Kim
@Michael: it's good to know this. I will try and let you know. Best, Taewoo On Fri, Jul 29, 2016 at 9:25 AM, Michael Blow wrote: > I have a change propose to Gerrit which enables debugging the generated > functions by way of the original java files: > >

Re: Choosing defaults for AsterixDB

2017-02-03 Thread Taewoo Kim
Regarding this, I have a question. Does the new revised HTTP API - Query Service (/query/service) support AQL? I am asking this since inside the code, it gets the SQLPP compilation provider. public class CCApplicationEntryPoint implements ICCApplicationEntryPoint { protected IServlet

Re: Google Summer of Code

2017-01-31 Thread Taewoo Kim
I would like to suggest one feature: adding a security feature to the AsterixDB: setting DB accounts and privileges. Also, use them when access the Web Interface or API call. Best, Taewoo On Tue, Jan 31, 2017 at 9:52 PM, Yingyi Bu wrote: > Yeah, sounds good to me. > > Best,

Re: An exception: Input/output error?

2017-01-30 Thread Taewoo Kim
00 25 af ed 30 00 00 08 00 *end_request: I/O error, dev sdb, sector 632286512* Best, Taewoo On Sun, Jan 29, 2017 at 6:14 PM, Taewoo Kim <wangs...@gmail.com> wrote: > @Yingyi: Thanks. I will look into that error. > > Best, > Taewoo > > On Sun, Jan 29, 20

Re: [VOTE] Release Apache AsterixDB 0.9.0 and Hyracks 0.3.0 (RC2)

2017-01-20 Thread Taewoo Kim
+1 Followed the instruction that Ian wrote at the following and confirmed that everything works as expected. https://cwiki.apache.org/confluence/display/ASTERIXDB/Release+Verification Best, Taewoo On Thu, Jan 19, 2017 at 4:24 PM, Xikui Wang wrote: > +1 > > Verified twitter

Re: IPageManager.createMetadataFrame(): java.lang.NoSuchMethodError

2017-02-19 Thread Taewoo Kim
It happened on the Sensorium cluster. Best, Taewoo On Sun, Feb 19, 2017 at 2:54 PM, Mike Carey <dtab...@gmail.com> wrote: > Which cluster hardware? > > > > On 2/19/17 2:42 PM, Taewoo Kim wrote: > >> Nope. I was keeping the same binary for 10 days now. >> >

Re: IPageManager.createMetadataFrame(): java.lang.NoSuchMethodError

2017-02-19 Thread Taewoo Kim
I see. I checked the disk related errors and found nothing special. Best, Taewoo On Sun, Feb 19, 2017 at 3:01 PM, Mike Carey <dtab...@gmail.com> wrote: > Got it. (So not attributable to the all-too-frequent Asterix cluster I/O > misbehavior...) > > > > On 2/19/17 2

IPageManager.createMetadataFrame(): java.lang.NoSuchMethodError

2017-02-19 Thread Taewoo Kim
Hi All, I have a CC and nine NCs. After I stopped the cluster and restarted the instance, I saw the following exception on one NC. Has anybody seen this error? Feb 19, 2017 2:05:21 PM org.apache.hyracks.control.nc.NCDriver main SEVERE: Setting uncaught exception handler

Re: IPageManager.createMetadataFrame(): java.lang.NoSuchMethodError

2017-02-19 Thread Taewoo Kim
Nope. I was keeping the same binary for 10 days now. Best, Taewoo On Sun, Feb 19, 2017 at 2:20 PM, abdullah alamoudi <bamou...@gmail.com> wrote: > Taewoo, > Did you change the binary in between? > > > > On Feb 19, 2017, at 2:18 PM, Taewoo Kim <wangs...@gmail

Re: IPageManager.createMetadataFrame(): java.lang.NoSuchMethodError

2017-02-19 Thread Taewoo Kim
; Does this error affect the system behavior? > > Cheers, > Till > > On 19 Feb 2017, at 15:05, Taewoo Kim wrote: > > > I see. I checked the disk related errors and found nothing special. > > > > Best, > > Taewoo > > > > On Sun, Feb 19

Re: IPageManager.createMetadataFrame(): java.lang.NoSuchMethodError

2017-02-19 Thread Taewoo Kim
; Abdullah. > > > On Feb 19, 2017, at 9:52 PM, Taewoo Kim <wangs...@gmail.com> wrote: > > > > @Till: Thanks for the answer. I usually saw this error when I change one > > binary to a newer binary and there was a meta-data change in-between. > But, > > the s

Re: Creating RTree: no space left

2016-09-13 Thread Taewoo Kim
n Wail and I talked F2F - his data has a > lot of duplicate points, so maybe something goes awry in that case. I > wonder if we've sufficiently tested that case? (E.g., what if there are > gazillions of records originating from a small handful of points?) > > > On 8/26/16 9:55 AM

Re: How to set the lsm component size?

2016-09-12 Thread Taewoo Kim
It would be really helpful this conversation can be applied in the description of each parameter. Currently, I think that is too short. Best, Taewoo On Mon, Sep 12, 2016 at 2:19 PM, Jianfeng Jia wrote: > Clear. Thanks. > > And Ian’s parameters works. I can have a

Re: How to set the lsm component size?

2016-09-12 Thread Taewoo Kim
On Mon, Sep 12, 2016 at 4:10 PM, Mike Carey <dtab...@gmail.com> wrote: > +1 > > > > On 9/12/16 3:42 PM, Taewoo Kim wrote: > >> It would be really helpful this conversation can be applied in the >> description of each parameter. Currently, I think that

Re: Function name change: contains() -> string-contains()

2016-09-15 Thread Taewoo Kim
gt;> my chosen parameters) which avoid the problem of dealing with positions. >> We do have a nested datamodel, so we could put it to good use here :) >> >> Does this make sense? >> >> Cheers, >> Till >> >> On 15 Sep 2016, at 16:26, Taewoo Kim

Re: Function name change: contains() -> string-contains()

2016-09-15 Thread Taewoo Kim
her had is not keyword free and so each time we introduce a > new > one, we create a backwards compatibility problem. It seems that for AQL > using a > function-based syntax would create fewer problems. > > Cheers, > Till > > On 2 Mar 2016, at 18:25, Taewoo Kim wrote: >

Do we allow optional parameter in a function?

2016-09-23 Thread Taewoo Kim
Hi all, Here is my question. Can a function have an optional parameter? For example, if a function F requires three parameters - a, b, c, can we omit the last one? F(a,b,c) VS F(a,b). I tried and Asterix says that F(a,b) is not defined. If someone knows the workaround, it would be really nice.

Re: Function name change: contains() -> string-contains()

2016-09-15 Thread Taewoo Kim
/1j6_YSCc_8gEReAWFP84geI30wlnsz7uMFq4TCm7GRz8/edit?usp=sharing MySQL: match(), against() Oracle: contains(), catsearch(), matches() MongoDB: $text AsterixDB: follows XQuery spec(e.g., $o.title *contains text* "hello") Best, Taewoo On Thu, Sep 15, 2016 at 2:07 PM, Taewoo Kim <wangs...@gmail.com> wrote: > There

Re: Function name change: contains() -> string-contains()

2016-09-15 Thread Taewoo Kim
fulltext search in > SQL++, probably using the same functions like Oracle. If the AQL fulltext > syntax is translated into fulltext functions by the language translator, we > can easily support them in SQL++. > > Best, > Yingyi > > > On Thu, Sep 15, 2016 at 2:20 PM, Taewo

Re: Function name change: contains() -> string-contains()

2016-09-15 Thread Taewoo Kim
ill...@lambda.nu> wrote: > Making "text" a reserved word seems like a more breaking change than the > function names, doesn't it? > > Ceej > aka Chris Hillery > > On Sep 15, 2016 1:57 PM, "Taewoo Kim" <wangs...@gmail.com> wrote: > > > Reminder: &g

Re: Function name change: contains() -> string-contains()

2016-09-15 Thread Taewoo Kim
e. Here are more details about this change: On Wed, Mar 2, 2016 at 6:25 PM, Taewoo Kim <wangs...@gmail.com> wrote: > Hello All, > > I would like to suggest a current function name change. I am currently > working on Full Text Search features. XQuery Full-text search spec [1]

Re: Function name change: contains() -> string-contains()

2016-09-15 Thread Taewoo Kim
d stay as a SQL++ > builtin function (like Oracle SQL). > Thanks! > > Best, > Yingyi > > On Thu, Sep 15, 2016 at 2:40 PM, Taewoo Kim <wangs...@gmail.com> wrote: > > > @Yingyi: Yes. It's just a syntactic sugar - it can be anything: > > "contains_text&quo

Re: Creating RTree: no space left

2016-08-26 Thread Taewoo Kim
Based on a rough calculation, per partition, each point field takes 3.6GB (16 bytes * 2887453794 records / 12 partition). To sort 3.6GB, we are generating 625 files (96MB or 128MB each) = 157GB. Since Wail mentioned that there was no issue when creating a B+ tree index, we need to check what SORT

Re: Physical Operator Tag Change (SPLIT -> REPLICATE)

2016-09-28 Thread Taewoo Kim
ot;PartitionSplit" for now. > > > 2. Do what you proposed in the next change which only does the > renaming. > > > > > > That makes reviews less overwhelming and easier. > > > > > > Best, > > > Yingyi > > > > >

Re: Physical Operator Tag Change (SPLIT -> REPLICATE)

2016-09-27 Thread Taewoo Kim
ge which only does the renaming. > > That makes reviews less overwhelming and easier. > > Best, > Yingyi > > > On Tue, Sep 27, 2016 at 5:01 PM, Taewoo Kim <wangs...@gmail.com> wrote: > > > Hello All, > > > > Regarding the index-only plan, I am going to

Re: Do we allow optional parameter in a function?

2016-09-24 Thread Taewoo Kim
function > signatures. They can share code underneath, but we are strict about > parameter count. The other option would be for the user to pass some null > representation for the third value. > Steven > > On Friday, September 23, 2016, Taewoo Kim <wangs...@gmail.com> wrote: > >

Line limit (120) is not enforced for an assignment statement.

2016-10-25 Thread Taewoo Kim
There is a formatter issue regarding an assignment statement whose length is over 120. An example is as follows: private final IBinaryComparator strLowerCaseTokenCmp = AqlBinaryComparatorFactoryProvider.UTF8STRING_LOWERCASE_TOKEN_POINTABLE_INSTANCE.createBinaryComparator(); Currently, the

Re: Eclipse - Plugin execution not covered by lifecycle configuration error

2016-10-19 Thread Taewoo Kim
It looks like that there is no m2e connector for analyze-only plugin. I think we need to add this plugin to the plugin management section of pom.xml file so that this could be ignored on Eclipse only. Best, Taewoo On Wed, Oct 19, 2016 at 5:06 PM, Taewoo Kim <wangs...@gmail.com> wrote: &g

Function name and format change in the codebase

2016-10-14 Thread Taewoo Kim
Hi All, I would like to talk about 1) Function name convention and Format change in the codebase. 1) Function name When we invent a new function name, would it be better if we avoid using '-'(dash) in a new function name and use "_" instead to avoid two versions for the same function in AQL and

Status

2016-10-21 Thread Taewoo Kim
I will not be able to attend the Weekly meeting. So, I have attached my status here: [Paper] - Conducting a preliminary experiment on similarity search paper (preparing similar search queries and sending them to a small dataset) [Individual] - Addressed Ian's comments on the full-text

Fwd: [jira] [Created] (ASTERIXDB-1736) Grace Hash Join and Hybrid Hash Join are not being used.

2016-11-19 Thread Taewoo Kim
ira/browse/ASTERIXDB-1736> -- Forwarded message -- From: Taewoo Kim (JIRA) <j...@apache.org> Date: Fri, Nov 18, 2016 at 5:06 PM Subject: [jira] [Created] (ASTERIXDB-1736) Grace Hash Join and Hybrid Hash Join are not being used. To: notificati...@asterixdb.incubator.apache.org

Re: One of NC node is not stopping for a hash join.

2016-12-07 Thread Taewoo Kim
the way, I found some optimization chances and excessive byte[] allocation issues and fixing this will increase the performance. :-) Best, Taewoo On Mon, Dec 5, 2016 at 9:39 PM, Taewoo Kim <wangs...@gmail.com> wrote: > @Abdullah: Thanks. I missed your e-mail and just checked that. Will try.

Re: One of NC node is not stopping for a hash join.

2016-12-08 Thread Taewoo Kim
hey've been joining > things recently?) > > Cheers, > > Mike > > > > On 12/7/16 3:08 PM, Taewoo Kim wrote: > >> In short, the reason on why a specific one node among 9 nodes didn't stop >> its hash-join job was due to a skewness (out of 9M records, 40,000 reco

Re: BAD flag on code reviews

2016-12-15 Thread Taewoo Kim
@Steven: can we check this locally before uploading a patch set? Best, Taewoo On Thu, Dec 15, 2016 at 9:37 AM, Ian Maxon wrote: > As a sidenote, it doesn't block, the flag acts the same as SonarQube. If it > does break though, please do add a BAD fellow to the review so there's

Re: Line limit (120) is not enforced for an assignment statement.

2017-01-09 Thread Taewoo Kim
en't... > You can update this row: > > "org.eclipse.jdt.core.formatter.comment.clear_blank_ > lines_in_javadoc_comment" > value="false"/> > > Thanks! > > Yingyi > > > On Tue, Oct 25, 2016 at 4:26 PM, Till Westmann <ti...@apache.org> wrote: &

Re: One of NC node is not stopping for a hash join.

2016-12-05 Thread Taewoo Kim
gt; Trying to help without enough context :-). Cheers, > Abdullah. > > > On Dec 2, 2016, at 10:22 AM, Taewoo Kim <wangs...@gmail.com> wrote: > > > > Additional note: @Till: Yes. It happened again for the same hash-join > > query. As we can see in the bold part of

Re: One of NC node is not stopping for a hash join.

2016-12-02 Thread Taewoo Kim
stener notifyJobFinish INFO: NO NEED TO NOTIFY JOB FINISH! Dec 02, 2016 12:30:19 AM org.apache.hyracks.control.common.work.WorkQueue$WorkerThread run INFO: Executing: GetResultPartitionLocations: JobId@JID:5 ResultSetId@RSID:0 Known@null Best, Taewoo On Thu, Dec 1, 2016 at 10:43 PM, Taewoo Kim

Re: One of NC node is not stopping for a hash join.

2016-12-01 Thread Taewoo Kim
> Hi Taewoo, > > is this behavior reproducible? > > Cheers, > Till > > > On 1 Dec 2016, at 22:14, Taewoo Kim wrote: > > PS: It took 2 more hours to finish the job on one NC. I wonder why this >> happens. >> >> Dec 01, 2016 7:19:35 PM >> or

Re: Exception refactoring proposal

2017-01-06 Thread Taewoo Kim
+1 Best, Taewoo On Fri, Jan 6, 2017 at 3:27 PM, Till Westmann wrote: > Hi, > > I like the proposal and I’d like to propose on more change: > Let’s not start the names of ErrorCodes with "ERROR_". > In the code they are usually used as > >

Re: Anybody seen this error? HyracksDataException: The file with absolute path: XXX is outside all io devices

2016-12-20 Thread Taewoo Kim
d ensure that indexes are built in the right place and things > should be good to go. you can also take a look at how FileSplits and > location constraints > are selected for other indexes and do the same. Then the failures should > go away. > > Cheers, > Abdullah. > > >

Re: New cluster installation options

2017-04-04 Thread Taewoo Kim
ly missing feature in those two installation > options? > > >> Unless they don't support it, it may be early to deprecate the managix? > It's deprecated for common use cases -- I'm not sure how many people are > using the Java UDF? > > Best, > Yingyi > > > On Tu

Re: New cluster installation options

2017-04-04 Thread Taewoo Kim
Sorry for the late response. Do Ansible and AWS support "installing libraries" like the managix does? Just checked the documentation. I'm talking about this: https://ci.apache.org/projects/asterixdb/udf.html. Unless they don't support it, it may be early to deprecate the managix? Best, Taewoo

Re: [VOTE] Release Apache AsterixDB 0.9.1 and Hyracks 0.3.1 (RC1)

2017-04-08 Thread Taewoo Kim
+1 Best, Taewoo On Sat, Apr 8, 2017 at 2:11 PM, Akshay Manchale Sridhar wrote: > +1 > > - verified hashes > - source compilation works > - NCservice works > > On Fri, Apr 7, 2017 at 7:51 AM, Mike Carey wrote: > > > +1 to release - I just verified that the

Re: JSON viewing in our web UI

2017-03-11 Thread Taewoo Kim
Like this? http://rawgit.com/abodelot/jquery.json-viewer/master/demo.html Best, Taewoo On Sat, Mar 11, 2017 at 12:14 PM, Mike Carey wrote: > Hmmm... Check out the Chrome JSON handling functionality about 5 minutes > into

Re: Nested type + open-enforced-index question.

2017-07-14 Thread Taewoo Kim
0:54 PM, Yingyi Bu wrote: > >> Hi Taewoo, >> >> The first query shouldn't fail because indexnl is just a hint. >> The second query should succeed because it's a valid indexing statement. >> High nesting levels in open record like JSON is not uncommon. >> >

Nested type + open-enforced-index question.

2017-07-13 Thread Taewoo Kim
Currently, I am working on a field type propagation without using initializing the OptimizableSubTree in the current index access method. I am encountering an issue with an open-type enforced index. So, I just want to make sure that my understanding is correct. It looks like we can't have an

Re: Nested type + open-enforced-index question.

2017-07-13 Thread Taewoo Kim
like a bug to me. > > > > > > > > On 7/13/17 7:59 PM, Taewoo Kim wrote: > > > >> Currently, I am working on a field type propagation without using > >> initializing the OptimizableSubTree in the current index access method. > I > >> am

Re: Nested type + open-enforced-index question.

2017-07-14 Thread Taewoo Kim
in dataset('DBLP') > for $b in dataset('CSX') > where $a.nested.one.title /*+ indexnl */ = $b.nested.one.title > return {"arec": $a, "brec": $b} > > Will this query return anything, but empty result? > > To me it feels like that should be compile time error in bo

Re: Nested type + open-enforced-index question.

2017-07-14 Thread Taewoo Kim
perspective of current implementation a runtime exception is a > bug, instead it should have caught this issue during compile time. > > > On Jul 13, 2017, at 23:10, Taewoo Kim <wangs...@gmail.com> wrote: > > > > @Yingyi: thanks. > > > > @Mike: Yeah. My problem

Re: SqlppExecutionWithCancellationTest fail

2017-07-08 Thread Taewoo Kim
times or so locally and hope they get > to see the failure. > > Hope that helps, > Abdullah. > > > > On Jul 7, 2017, at 6:36 PM, Taewoo Kim <wangs...@gmail.com> wrote: > > > > Hi all, > > > > I have several failing test cases for the > &

SqlppExecutionWithCancellationTest fail

2017-07-07 Thread Taewoo Kim
Hi all, I have several failing test cases for the SqlppExecutionWithCancellationTest. I am not sure how to deal with this issue. When I execute this on my local Eclipse, it generates an Assertion error saying that the number of canceled query is not greater than zero. But the Jenkins shows an

Re: Nested type + open-enforced-index question.

2017-07-14 Thread Taewoo Kim
; top-level type leads to exception, because it relies of a fact that there > > is a compile-time type information for a field “nested”. This type > > information is used to build a type for aforementioned cast operator. > > > Form the perspective of current implementation

Re: asterix-gerrit-source-assemblies build error

2017-07-04 Thread Taewoo Kim
> > Best, > Xikui > > On Tue, Jul 4, 2017 at 2:31 PM, Taewoo Kim <wangs...@gmail.com> wrote: > > > Hi all, > > > > Has anyone seen the following error in asterix-gerrit-source-assemblies > > and > > know how to fix this? The file exists in the d

asterix-gerrit-source-assemblies build error

2017-07-04 Thread Taewoo Kim
Hi all, Has anyone seen the following error in asterix-gerrit-source-assemblies and know how to fix this? The file exists in the directory. https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-source-assemblies/558/ [ERROR] Failed to execute goal

Re: [VOTE] Release Apache AsterixDB 0.9.1 and Hyracks 0.3.1 (RC2)

2017-04-21 Thread Taewoo Kim
+1 mvn verify works! Best, Taewoo On Fri, Apr 21, 2017 at 9:24 AM, Till Westmann wrote: > +1 to all artifacts. > > Checked the source artifacts: > - Signatures and hashes correct > — LICENSE and NOTICE look ok > - Source files have Apache header > - No unexpected binary

Re: [VOTE] Release Apache AsterixDB 0.9.2 and Hyracks 0.3.2 (RC1)

2017-08-22 Thread Taewoo Kim
+1 - Verified the signatures - Compiled the source codes - Executed the sample cluster and sent some queries Best, Taewoo On Fri, Aug 18, 2017 at 5:03 PM, Ildar Absalyamov < ildar.absalya...@gmail.com> wrote: > Sorry, that was a problem in my local dev version. > +1 in this case. > > > On Aug

Re: Searching for duplicates during feed ingestion.

2017-05-08 Thread Taewoo Kim
+1 for auto-generated ID case Best, Taewoo On Mon, May 8, 2017 at 8:57 AM, Yingyi Bu wrote: > Abdullah has a pending change that disables searches if there's no > secondary indexes [1]. > Auto-generated ID could be another case for which we can disable searches > as well. >

Re: Integration tests failing

2017-10-12 Thread Taewoo Kim
I simply skimmed errors. It looks like some of RebalanceWithCancellationIT tests generate errors [1]. This patch set [2] would be a good starting point to understand. At least somebody who reviewed the patch set could give more idea about this integration test to give some idea for a possible

Re: Time to deprecate AQL?

2017-09-07 Thread Taewoo Kim
For similarity join, we use AQL+ that is based on AQL. I think deprecating (not removing) AQL is OK. Ultimately, AQL+ should be converted to SQL++ :-) Best, Taewoo On Thu, Sep 7, 2017 at 9:04 PM, Steven Jacobs wrote: > I’ll give the BADest +1 I can :) > Steven > > On Thu, Sep

Re: ILogicalOperator.isMap

2017-09-03 Thread Taewoo Kim
My understanding is that isMap() is set to true when the cardinality of the input may not be equal to the the cardinality of the output. To settle this issue, I come up with one explicit property in my Limit Push down branch. The attribute is called canDecreaseCardinality. On Sun, Sep 3, 2017 at

Re: Entity locks in asterixdb

2017-09-03 Thread Taewoo Kim
Sure. I will take a look after my break. Thanks. On Sun, Sep 3, 2017 at 19:38 abdullah alamoudi wrote: > Hi All, > I have created a wiki entry for entity level locks in asterixdb at > https://cwiki.apache.org/confluence/display/ASTERIXDB/Entity+locks+in+AsterixDB > < >

Re: Primary key lookup plan

2017-12-03 Thread Taewoo Kim
My understanding is that if a select condition can be covered by the primary key (i.e., only contains the primary key condition and B+Tree can be utilized), then only unnest-map should survive. Best, Taewoo On Sun, Dec 3, 2017 at 4:03 PM, Chen Luo wrote: > I don't think it's

Re: Primary key lookup plan

2017-12-03 Thread Taewoo Kim
was wondering why the > select op is there. > > On Dec 3, 2017 16:36, "Taewoo Kim" <wangs...@gmail.com> wrote: > > > Hm... type-casting should happen in that case. You are saying providing > an > > INT to BIGINT primary index? > > > > Best,

Re: Primary key lookup plan

2017-12-03 Thread Taewoo Kim
>From Line 531 https://github.com/apache/asterixdb/blob/master/asterixdb/asterix-algebra/src/main/java/org/apache/asterix/optimizer/rules/am/BTreeAccessMethod.java Best, Taewoo On Sun, Dec 3, 2017 at 4:05 PM, Taewoo Kim <wangs...@gmail.com> wrote: > My understanding is that

Re: Strange error trying to run Asterix master

2017-10-25 Thread Taewoo Kim
> Steven > > On Tue, Oct 24, 2017 at 8:10 PM Taewoo Kim <wangs...@gmail.com> wrote: > > > Have you found a solution? I just have encountered this issue. I'm trying > > to rebuild. > > > > Best, > > Taewoo > > > > On Wed, Oct 4, 2017 at 9:02 PM

Is it OK for Hyracks to access the config option?

2017-10-24 Thread Taewoo Kim
Hello All, Here is the background. I'm currently fixing an inverted-index search OOM issue. This could happen because the core inverted-index search module does not have any budget limit. One might ask that B+-tree and R-tree search doesn't have any budget limit either. However, a difference is

Re: Is it OK for Hyracks to access the config option?

2017-10-24 Thread Taewoo Kim
, this problem doesn't exist since there is no intermediate result calculation. Best, Taewoo On Tue, Oct 24, 2017 at 9:21 AM, Taewoo Kim <wangs...@gmail.com> wrote: > Hello All, > > Here is the background. I'm currently fixing an inverted-index search OOM > issue. This could happe

Re: Strange error trying to run Asterix master

2017-10-24 Thread Taewoo Kim
Have you found a solution? I just have encountered this issue. I'm trying to rebuild. Best, Taewoo On Wed, Oct 4, 2017 at 9:02 PM, Steven Jacobs wrote: > Hi Wail, I've tried this many times. This does solve another strange > Eclipse error that I've had in the past, but it

Ansible script - starting the cluster error?

2018-06-14 Thread Taewoo Kim
Hello devs, Has anyone seen this error when starting the cluster using opt/ansible/bin/start.sh? TASK [Copy cluster config to CC] * fatal: [128.195.11.42]:

Re: Ansible script - starting the cluster error?

2018-06-14 Thread Taewoo Kim
ansible.cfg in the opt/ansible/bin. Put the following contents in the file. [defaults] remote_user = YOURACCOUNTNAME Best, Taewoo On Thu, Jun 14, 2018 at 4:08 PM, Taewoo Kim wrote: > Hello devs, > > Has anyone seen this error when starting the cluster using > opt/ansible/bin/start.sh? &g

Re: Stability Q

2018-05-01 Thread Taewoo Kim
+1 Best, Taewoo On Tue, May 1, 2018 at 8:49 AM, Akshay Manchale Sridhar wrote: > I was running into the same issue while running replication experiments. A > quick fix is to increase the default value of HEARTBEAT_MAX_MISSES. There > are times in a loaded cluster when some

Re: Comparison semantics for complex types

2017-12-29 Thread Taewoo Kim
element equality for arrays, cardinality and > order-independent equality for bags, field by field equality for records, > and recursively through all of them.) > > > > > >> On 12/28/17 11:14 PM, Taewoo Kim wrote: > >> If I remember correctly, we don't support deep e

Re: Comparison semantics for complex types

2017-12-29 Thread Taewoo Kim
> One reason is that we don't want to do hash join where the key is a complex > type (i.e what would be the hash function?). > > On Fri, Dec 29, 2017 at 10:24 AM, Taewoo Kim <wangs...@gmail.com> wrote: > > > @Heri: I'm sorry for not mentioning your deep_equal function. Yeah,

Index-only plan has been merged.

2018-02-16 Thread Taewoo Kim
Hi All, Finally, the index-only plan branch has been merged. Thanks to all who have reviewed this patch set. Here are a few things that I would like to post. - The Index-only plan will be triggered on a B+ tree or an R tree (point or rectangle field only) index. The field should be a closed-type

Inverted-index search is constrained by the budget.

2018-02-19 Thread Taewoo Kim
Hi all, A new config parameter is added and I would like to share this with you. The inverted-index-search in AsterixDB is different from B-Tree or R-Tree search (they only require a certain number of frames at a time - no budget is necessary). However, the inverted-index-search needs to read

Re: Comparison semantics for complex types

2017-12-28 Thread Taewoo Kim
If I remember correctly, we don't support deep equality comparison in AsterixDB yet. Best, Taewoo On Thu, Dec 28, 2017 at 9:19 PM, Wail Alkowaileet wrote: > Hi Devs, > > Currently we have an inconsistent behavior regarding the comparators: > > In join, we allow such

Re: Logging.properties

2017-12-21 Thread Taewoo Kim
ricks", not "org.apache.hyracks.algebricks.level". Thanks again @Murthada. Best, Taewoo On Wed, Dec 20, 2017 at 5:22 PM, Taewoo Kim <wangs...@gmail.com> wrote: > @Murtadha: forgot to reply. Thank you so much! > > Best, > Taewoo > > On Tue, Dec 19, 2017 at 11:53 PM, M

Re: Logging.properties

2017-12-20 Thread Taewoo Kim
html > [2] https://logging.apache.org/log4j/2.0/log4j-jul/index.html > > On 12/20/2017, 10:38 AM, "Taewoo Kim" <wangs...@gmail.com> wrote: > > Hello All, > > Not long time ago, for each test suite (e.g., OptimizerTest), we can >

Re: URGENT: Please shorten test filenames!

2018-03-10 Thread Taewoo Kim
@Chris: I have renamed the current index-only plan related test cases to short ones. The changes are reflected on the master. Let me know if the issue still remains. Thanks. Best, Taewoo On Fri, Mar 9, 2018 at 2:33 PM, Xikui Wang wrote: > I see... I was able to avoid the issue

Re: Is there an easier way to wrap/unwrap the entire tuple as a ByteBuffer?

2018-04-10 Thread Taewoo Kim
Hello Ahmed, This doc might help. https://code.google.com/archive/p/asterixdb/wikis/Serialization.wiki Best, Taewoo On Tue, Apr 10, 2018 at 5:30 PM, Ahmed Eldawy wrote: > Mike, > > What you're suggesting makes more sense. We just don't know how to do it :) > BTW, is there any

Re: Optimizer Tests for SQLPP

2018-04-14 Thread Taewoo Kim
rather than also testing > its component parts?) > > > On 4/14/18 10:42 AM, Taewoo Kim wrote: > > For now, please do not remove AQL optimizer test cases since AQL+ > > functionality that is used for the similarity join depends on them. I > will > > go through runtime t

Requesting node X to shutdown to ensure failure?

2018-09-30 Thread Taewoo Kim
Hi devs, I saw the following log messages in the cc.log of the Cloudberrry cluster. Yesterday around 9:50 pm, a task cluster was created and executed. And around 9:51 pm, the cluster shows the following message. In the nc.log of the node 2, there were no noticeable log messages. I wonder what

Re: Requesting node X to shutdown to ensure failure?

2018-09-30 Thread Taewoo Kim
as they have missed too many heartbeats. And you can > see in the later logs that indeed more than 80s passed without receiving a > heartbeat. > Could it be that the machines were too busy to send/receive heartbeats? > > Cheers, > Till > > On 30 Sep 2018, at 10:52, Taewoo K

Number of lines of the current master branch

2018-10-15 Thread Taewoo Kim
For some reason, I wanted to get the number of lines of the current master branch. :-) 91112 text files. 50239 unique files. 63478 files ignored. http://cloc.sourceforge.net v 1.64 T=1429.40 s (20.7 files/s, 3277.3 lines/s)

Re: Requesting node X to shutdown to ensure failure?

2018-10-01 Thread Taewoo Kim
n idea of the load on the CC? > Is is possible that it was too busy to receive the heartbeats? > > Cheers, > Till > > > On 30 Sep 2018, at 13:48, Taewoo Kim wrote: > > OK. I got that part. There are five nodes (separate NUC machines) and the >> first node runs CC and NC. >

Re: [VOTE] Release AsterixDB 0.9.4 and Hyracks 0.3.4 (RC2)

2018-09-22 Thread Taewoo Kim
+1 [v] Verify the signatures and hashes. [v] Verify that source builds correctly. [v] Verify that a query works. Only one minor comment: https://dist.apache.org/repos/dist/dev/asterixdb/apache-asterixdb-0.9.4-source-release.zip.sha25

Re: [VOTE] Release Apache AsterixDB 0.9.4.1 and Hyracks 0.3.4.1 (RC2)

2019-02-21 Thread Taewoo Kim
[X] +1 release these packages as Apache AsterixDB 0.9.4.1 and Apache Hyracks 0.3.4.1 - Verified the SHA256 signatures - Verified the source builds - Verified the binary by executing a metadata query on the Web interface Best, Taewoo On Thu, Feb 21, 2019 at 7:24 PM Xikui Wang wrote: > [X] +1

Re: Firewall Blocked Local Host Site

2019-05-31 Thread Taewoo Kim
In addition to Chen Luo's comment: If we decide to open ports: Open firewall ports in Windows 10 https://www.tomshardware.com/news/how-to-open-firewall-ports-in-windows-10,36451.html Ports that need to be opened based on the following doc: https://ci.apache.org/projects/asterixdb/ncservice.html

Re: Code review steps

2019-06-07 Thread Taewoo Kim
That clearly works. Or why don't we add reviewers only if the self-review is done? :-) Best, Taewoo On Fri, Jun 7, 2019 at 12:51 AM Mike Carey wrote: > +1 ! > > On 6/6/19 6:07 PM, Till Westmann wrote: > > Hi, > > > > I've proposed an addition to our code review steps on > >

Re: Code review steps

2019-06-09 Thread Taewoo Kim
review we’d need to remove > reviewers and re-add them. > A 2nd +1 seems easier (and less error-prone) in that case. > > Cheers, > Till > > > On Jun 7, 2019, at 22:04, Taewoo Kim wrote: > > > > That clearly works. Or why don't we add reviewers only if the

Re: [VOTE] Release Apache AsterixDB 0.9.5 and Hyracks 0.3.5 (RC1)

2019-07-03 Thread Taewoo Kim
[V] +1 release these packages as Apache AsterixDB 0.9.5 and Apache Hyracks 0.3.5 - Checked the SHA256 of the zip files. - Builds were successful without any error. - Smoke test using the binary was successful. Best, Taewoo On Tue, Jul 2, 2019 at 12:25 AM Ian Maxon wrote: > Hi everyone, > >

Re: [VOTE] Release Apache AsterixDB 0.9.5 and Hyracks 0.3.5 (RC2)

2019-07-12 Thread Taewoo Kim
-1 - Checked the SHA256 of each zip file: SHA256 of the binary file ( https://dist.apache.org/repos/dist/dev/asterixdb/asterix-server-0.9.5-binary-assembly.zip) doesn't match. Could you check? Expected: d80ff63ea5796022f6ce58676d3954438ce703a1da06c5f382b8ace3d4719445 Actual:

Re: [VOTE] Release Apache AsterixDB 0.9.5 and Hyracks 0.3.5 (RC0)

2019-06-25 Thread Taewoo Kim
Thanks Ian for preparing this release candidate. [V] Download files [V] Verify hashes of downloaded files. [X] Verify that source builds correctly - Hyracks build was successful. - AsterixDB build was not successful. @Ian Maxon : I could not build AsterixDB. Could you check the following error

  1   2   >