[jira] [Commented] (ASTERIXDB-1131) The function-generated Null is omitted when construct a List

[ASF subversion and git services (JIRA)]

[ 
https://issues.apache.org/jira/browse/ASTERIXDB-1131?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15315363#comment-15315363
 ] 

ASF subversion and git services commented on ASTERIXDB-1131:


Commit 91a840d5bbd95a5c31b9f2b9224af53f8c585399 in incubator-asterixdb's branch 
refs/heads/master from [~buyingyi]
[ https://git-wip-us.apache.org/repos/asf?p=incubator-asterixdb.git;h=91a840d ]

ASTERIXDB-1131 and ASTERIXDB-1230: add regression tests.

Change-Id: I3b520d27e2c9ea2fbbd0cf5fbbcfa6d24ed094d9
Reviewed-on: https://asterix-gerrit.ics.uci.edu/907
Reviewed-by: Jenkins 
Tested-by: Jenkins 
Reviewed-by: Jianfeng Jia 
Reviewed-by: Ildar Absalyamov 


> The function-generated Null is omitted when construct a List
> 
>
> Key: ASTERIXDB-1131
> URL: https://issues.apache.org/jira/browse/ASTERIXDB-1131
> Project: Apache AsterixDB
>  Issue Type: Bug
>  Components: Data Model
>Reporter: Jianfeng Jia
>Assignee: Yingyi Bu
>
> I hit a failed test case in which I was building a list with the elements 
> generated from a build-in function, as below,
> for $a in [
> starts-with("xyz",  null),
> starts-with("xy", "x")
> ]
> return $a
> If any of the elements is Null, it will be omitted in the returned list, e.g. 
> the above query returns the following result:
> [ true
>  ]
> However if I explicitly add a null in the list, all the Nulls will be 
> returned.
> the following query:
> for $a in [
> null,
> starts-with("xy",  null),
> starts-with("xy", "x")
> ]
> return $a
> will return the expected result:
> [ null
> , null
> , true
>  ]
> It applies for other similar functions which return an option value. 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (ASTERIXDB-1438) BufferCache spins indefinitely when cache is exceeded

[ASF subversion and git services (JIRA)]

[ 
https://issues.apache.org/jira/browse/ASTERIXDB-1438?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15314184#comment-15314184
 ] 

ASF subversion and git services commented on ASTERIXDB-1438:


Commit 4bab67bf282e650a6e8c41b338f357b0d47c9714 in incubator-asterixdb's branch 
refs/heads/master from [~mblow]
[ https://git-wip-us.apache.org/repos/asf?p=incubator-asterixdb.git;h=4bab67b ]

ASTERIXDB-1438: BufferCache spins indefinitely...

Fixes ASTERIXDB-1438: BufferCache spins indefinitely when cache is exceeded

After three unsuccessful cycles (each traversing clock pages three times)
and waiting for dirty pages to be cleaned, an exception is thrown

Change-Id: I327a7423bd630c96e16601b1a3a2a21f558f9f50
Reviewed-on: https://asterix-gerrit.ics.uci.edu/894
Tested-by: Jenkins 
Reviewed-by: Till Westmann 


> BufferCache spins indefinitely when cache is exceeded
> -
>
> Key: ASTERIXDB-1438
> URL: https://issues.apache.org/jira/browse/ASTERIXDB-1438
> Project: Apache AsterixDB
>  Issue Type: Bug
>Reporter: Michael Blow
>Assignee: Michael Blow
>Priority: Critical
>
> In case of cache exhaustion, BufferCache.findPage/confiscatePage() will spin 
> forever waiting for pages to be returned to the cache.  These should give up 
> and fail the request after a reasonable number of attempts.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (ASTERIXDB-1438) BufferCache spins indefinitely when cache is exceeded

[ASF subversion and git services (JIRA)]

[ 
https://issues.apache.org/jira/browse/ASTERIXDB-1438?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15314183#comment-15314183
 ] 

ASF subversion and git services commented on ASTERIXDB-1438:


Commit 4bab67bf282e650a6e8c41b338f357b0d47c9714 in incubator-asterixdb's branch 
refs/heads/master from [~mblow]
[ https://git-wip-us.apache.org/repos/asf?p=incubator-asterixdb.git;h=4bab67b ]

ASTERIXDB-1438: BufferCache spins indefinitely...

Fixes ASTERIXDB-1438: BufferCache spins indefinitely when cache is exceeded

After three unsuccessful cycles (each traversing clock pages three times)
and waiting for dirty pages to be cleaned, an exception is thrown

Change-Id: I327a7423bd630c96e16601b1a3a2a21f558f9f50
Reviewed-on: https://asterix-gerrit.ics.uci.edu/894
Tested-by: Jenkins 
Reviewed-by: Till Westmann 


> BufferCache spins indefinitely when cache is exceeded
> -
>
> Key: ASTERIXDB-1438
> URL: https://issues.apache.org/jira/browse/ASTERIXDB-1438
> Project: Apache AsterixDB
>  Issue Type: Bug
>Reporter: Michael Blow
>Assignee: Michael Blow
>Priority: Critical
>
> In case of cache exhaustion, BufferCache.findPage/confiscatePage() will spin 
> forever waiting for pages to be returned to the cache.  These should give up 
> and fail the request after a reasonable number of attempts.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (ASTERIXDB-1439) Add test cases for big objects

[ASF subversion and git services (JIRA)]

[ 
https://issues.apache.org/jira/browse/ASTERIXDB-1439?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15319344#comment-15319344
 ] 

ASF subversion and git services commented on ASTERIXDB-1439:


Commit 1acad30572e92af472cd016f4b722dbbac3074fc in incubator-asterixdb's branch 
refs/heads/master from [~mblow]
[ https://git-wip-us.apache.org/repos/asf?p=incubator-asterixdb.git;h=1acad30 ]

ASTERIXDB-1439: Add Feed Big Object Test

Add a 20M object feed ingestion test case

Change-Id: I7fa46ae04e043bb2fd8ff316496318b0ae222baf
Reviewed-on: https://asterix-gerrit.ics.uci.edu/911
Reviewed-by: Jenkins 
Tested-by: Jenkins 
Reviewed-by: Till Westmann 


> Add test cases for big objects
> --
>
> Key: ASTERIXDB-1439
> URL: https://issues.apache.org/jira/browse/ASTERIXDB-1439
> Project: Apache AsterixDB
>  Issue Type: Test
>Reporter: Michael Blow
>Assignee: Michael Blow
>
> With ASTERIXDB-1436 fixed, regression tests should be added to ensure load, 
> feed ingestion & inserting via external dataset with large objects remain 
> working, at least up to 20MB.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (ASTERIXDB-1467) NonTaggedDataForma.infer() fail on Insert (deployment mode)

[ASF subversion and git services (JIRA)]

[ 
https://issues.apache.org/jira/browse/ASTERIXDB-1467?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15308127#comment-15308127
 ] 

ASF subversion and git services commented on ASTERIXDB-1467:


Commit 2d2a2007bbd8298b49e9feb2ec5a637e8fe1904a in incubator-asterixdb's branch 
refs/heads/master from [~mhubail]
[ https://git-wip-us.apache.org/repos/asf?p=incubator-asterixdb.git;h=2d2a200 ]

ASTERIXDB-1467: Allow PrivilegedAccessor in Deployment Mode

Change-Id: I15130c84584e316cde62e62c6010639e58d5050f
Reviewed-on: https://asterix-gerrit.ics.uci.edu/898
Reviewed-by: Yingyi Bu 
Reviewed-by: Jenkins 
Tested-by: Jenkins 


> NonTaggedDataForma.infer() fail on Insert (deployment mode)
> ---
>
> Key: ASTERIXDB-1467
> URL: https://issues.apache.org/jira/browse/ASTERIXDB-1467
> Project: Apache AsterixDB
>  Issue Type: Bug
>  Components: AsterixDB, Maven
>Reporter: Wail Alkowaileet
>Assignee: Murtadha Hubail
>Priority: Blocker
>
> After spending sometime to know why AsterixDB fails on deploy mode but not on 
> test mode ...
> There's a tiny problem with the POM in asterix-app:
> {noformat}
> 
>   com.e-movimento.tinytools
>   privilegedaccessor
>   1.2.2
>   test
> 
> {noformat}
> I think the scope should be changed to compile.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (ASTERIXDB-1216) Aggregation on open nested TypeComputer fails

[ASF subversion and git services (JIRA)]

[ 
https://issues.apache.org/jira/browse/ASTERIXDB-1216?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15299092#comment-15299092
 ] 

ASF subversion and git services commented on ASTERIXDB-1216:


Commit 35390c82bcec95ed574001ce82f5ac8f47405092 in incubator-asterixdb's branch 
refs/heads/master from [~buyingyi]
[ https://git-wip-us.apache.org/repos/asf?p=incubator-asterixdb.git;h=35390c8 ]

ASTERIXDB-1190, ASTERIXDB-1216, ASTERIXDB-1317:  fixes and regression tests.

Change-Id: If21ad96b1bff59fa2da601b920d4a61900cad81f
Reviewed-on: https://asterix-gerrit.ics.uci.edu/885
Reviewed-by: Jenkins 
Tested-by: Jenkins 
Reviewed-by: Till Westmann 


> Aggregation on open nested TypeComputer fails
> -
>
> Key: ASTERIXDB-1216
> URL: https://issues.apache.org/jira/browse/ASTERIXDB-1216
> Project: Apache AsterixDB
>  Issue Type: Bug
>  Components: AsterixDB, Functions - AQL
>Reporter: Wail Alkowaileet
>Assignee: Yingyi Bu
>
> Another issue has been reported in the result type computer for aggregate 
> function (avg) similat to 
> https://issues.apache.org/jira/browse/ASTERIXDB-1190.
> The issue appears when the IVariableTypeEnvironment infer ATypeTag.ANY.
> - Reproduce:
> {noformat}
> let $l := [[1.2, 2.3, 3.4],[6,3,7,2]]
> for $x in $l // for each list in the outer list
> return avg($x)
> {noformat}
> Solution:
> Early exit when see ANY to be handled at runtime
> I can fix both this one and issue 1190.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (ASTERIXDB-769) Incorrect variable propagation when loading a dataset in subquery

[ASF subversion and git services (JIRA)]

[ 
https://issues.apache.org/jira/browse/ASTERIXDB-769?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15397732#comment-15397732
 ] 

ASF subversion and git services commented on ASTERIXDB-769:
---

Commit a2a402afdb78c152a185841ba60db1d4cbc52677 in asterixdb's branch 
refs/heads/master from [~buyingyi]
[ https://git-wip-us.apache.org/repos/asf?p=asterixdb.git;h=a2a402a ]

ASTERIXDB-769: adds a regression test.

Change-Id: Ifaa6a37de981c5f60a416db85d3485d042558f63
Reviewed-on: https://asterix-gerrit.ics.uci.edu/1027
Reviewed-by: Michael Blow 
Tested-by: Michael Blow 


> Incorrect variable propagation when loading a dataset in subquery
> -
>
> Key: ASTERIXDB-769
> URL: https://issues.apache.org/jira/browse/ASTERIXDB-769
> Project: Apache AsterixDB
>  Issue Type: Bug
>  Components: AsterixDB, Optimizer
>Reporter: JArod Wen
>Assignee: Yingyi Bu
>Priority: Critical
>
> Incorrect variable propagation when loading a dataset in subquery



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (ASTERIXDB-1527) incorrect operator precedence order

[ASF subversion and git services (JIRA)]

[ 
https://issues.apache.org/jira/browse/ASTERIXDB-1527?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15396407#comment-15396407
 ] 

ASF subversion and git services commented on ASTERIXDB-1527:


Commit 79ccdac8a7d2f6d39fce8cc15e3bd4b40bec8e81 in asterixdb's branch 
refs/heads/master from [~buyingyi]
[ https://git-wip-us.apache.org/repos/asf?p=asterixdb.git;h=79ccdac ]

ASTERIXDB-1527: fix operator precedence order.

Change-Id: Ib16477c4fad341685e9b1349f40eeabfc74b0165
Reviewed-on: https://asterix-gerrit.ics.uci.edu/1025
Sonar-Qube: Jenkins 
Tested-by: Jenkins 
Integration-Tests: Jenkins 
Reviewed-by: Till Westmann 


> incorrect operator precedence order
> ---
>
> Key: ASTERIXDB-1527
> URL: https://issues.apache.org/jira/browse/ASTERIXDB-1527
> Project: Apache AsterixDB
>  Issue Type: Bug
>  Components: Optimizer
>Reporter: Yingyi Bu
>Assignee: Yingyi Bu
>
> Query:
> 2 * 3^2;
> Output:
> 36
> It should return 18.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (ASTERIXDB-1531) Order by bug for composite order keys and nested fields

[ASF subversion and git services (JIRA)]

[ 
https://issues.apache.org/jira/browse/ASTERIXDB-1531?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15398225#comment-15398225
 ] 

ASF subversion and git services commented on ASTERIXDB-1531:


Commit af8255b8a33847e2309567d4a6f0482a565662d9 in asterixdb's branch 
refs/heads/master from [~buyingyi]
[ https://git-wip-us.apache.org/repos/asf?p=asterixdb.git;h=af8255b ]

ASTERIXDB-1531: fix ORDER BY with primary keys as non-prefix sort keys.

- clean up the local property inference implemenation;
- avoid side-effects for data properties during property matching.

Change-Id: Iee7fcdd6eb1279e8ee14ba75ee31ac118b00c806
Reviewed-on: https://asterix-gerrit.ics.uci.edu/1022
Tested-by: Jenkins 
Integration-Tests: Jenkins 
Reviewed-by: Yingyi Bu 


> Order by bug for composite order keys and nested fields
> ---
>
> Key: ASTERIXDB-1531
> URL: https://issues.apache.org/jira/browse/ASTERIXDB-1531
> Project: Apache AsterixDB
>  Issue Type: Bug
>  Components: AsterixDB, Translator - AQL
> Environment: 101-like demo (modified TinySocial) on current/latest 
> binary bits for Mac
>Reporter: Michael J. Carey
>Assignee: Yingyi Bu
>Priority: Critical
> Attachments: tinysocialnew.zip
>
>
> use dataverse TinySocial;  // okay, a name-modified version thereof
> from $cm in dataset ChirpMessages
> order by $cm.user.screen-name, $cm.chirpid
> select $cm;
> ---> This just orders by chirpid.  (You can repro by doing the same thing 
> with the current TinySocial data using the non-renamed stuff - so I won't 
> attach all the repro stuff here unless you want me too, in which case I can.)



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (ASTERIXDB-1551) Shutdown servlet delays shutdown

[ASF subversion and git services (JIRA)]

[ 
https://issues.apache.org/jira/browse/ASTERIXDB-1551?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15396629#comment-15396629
 ] 

ASF subversion and git services commented on ASTERIXDB-1551:


Commit 6448824afa714c65c319250988b8dc26fc9181c1 in asterixdb's branch 
refs/heads/master from [~mblow]
[ https://git-wip-us.apache.org/repos/asf?p=asterixdb.git;h=6448824 ]

ASTERIXDB-1551: Shutdown Servlet Delays Shutdown

Change-Id: I80d74b13dc3aa8df9aedf49cb766751e4c091198
Reviewed-on: https://asterix-gerrit.ics.uci.edu/1026
Tested-by: Jenkins 
Sonar-Qube: Jenkins 
Integration-Tests: Jenkins 
Reviewed-by: Till Westmann 


> Shutdown servlet delays shutdown
> 
>
> Key: ASTERIXDB-1551
> URL: https://issues.apache.org/jira/browse/ASTERIXDB-1551
> Project: Apache AsterixDB
>  Issue Type: Bug
>  Components: AsterixDB
>Reporter: Michael Blow
>Assignee: Michael Blow
>   Original Estimate: 2h
>  Remaining Estimate: 2h
>
> Shutting down the Asterix cluster via the ShutdownAPIServlet causes a 9 
> second delay before an exception is thrown and the shutdown can proceed, due 
> to the servlet request itself blocking the shutdown.  After the 9 second 
> delay, the following exception is thrown, causing the servlet to exit, 
> unblocking the shutdown:
> SEVERE: CC refused to release connection after 9 seconds
> org.apache.hyracks.ipc.exceptions.IPCException: CC refused to release 
> connection after 9 seconds
>   at 
> org.apache.hyracks.api.client.HyracksClientInterfaceRemoteProxy.stopCluster(HyracksClientInterfaceRemoteProxy.java:131)
>   at 
> org.apache.hyracks.api.client.HyracksConnection.stopCluster(HyracksConnection.java:191)
>   at 
> org.apache.asterix.api.http.servlet.ShutdownAPIServlet.doPost(ShutdownAPIServlet.java:60)
>   at javax.servlet.http.HttpServlet.service(HttpServlet.java:755)



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (ASTERIXDB-1552) Add test case for asterix-server local sample cluster

[ASF subversion and git services (JIRA)]

[ 
https://issues.apache.org/jira/browse/ASTERIXDB-1552?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15396630#comment-15396630
 ] 

ASF subversion and git services commented on ASTERIXDB-1552:


Commit 70908dfb463f70a7d50dcb94cfc14defd76fa720 in asterixdb's branch 
refs/heads/master from [~mblow]
[ https://git-wip-us.apache.org/repos/asf?p=asterixdb.git;h=70908df ]

ASTERIXDB-1552: Test Case for Sample Local Cluster

Change-Id: I2eacbd033a65661d22dc2a848afd83bbcc43677f
Reviewed-on: https://asterix-gerrit.ics.uci.edu/1028
Sonar-Qube: Jenkins 
Tested-by: Jenkins 
Integration-Tests: Jenkins 
Reviewed-by: Till Westmann 


> Add test case for asterix-server local sample cluster
> -
>
> Key: ASTERIXDB-1552
> URL: https://issues.apache.org/jira/browse/ASTERIXDB-1552
> Project: Apache AsterixDB
>  Issue Type: Test
>  Components: AsterixDB
>Reporter: Michael Blow
>Assignee: Michael Blow
>   Original Estimate: 3h
>  Remaining Estimate: 3h
>
> Tests should be added that ensure no regressions in the local cluster sample 
> shipped in asterix-server.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (ASTERIXDB-1561) EXPLAIN should be case insensitive

[ASF subversion and git services (JIRA)]

[ 
https://issues.apache.org/jira/browse/ASTERIXDB-1561?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15405194#comment-15405194
 ] 

ASF subversion and git services commented on ASTERIXDB-1561:


Commit 516d1a85b19f50e374b6a7882440d69aee29a579 in asterixdb's branch 
refs/heads/master from [~tillw]
[ https://git-wip-us.apache.org/repos/asf?p=asterixdb.git;h=516d1a8 ]

ASTERIXDB-1561: EXPLAIN should be case insensitive

Change-Id: I5add61c5ca07f0653f6811fdd4be215ce4f67eee
Reviewed-on: https://asterix-gerrit.ics.uci.edu/1042
Sonar-Qube: Jenkins 
Reviewed-by: Yingyi Bu 
Tested-by: Jenkins 
Integration-Tests: Jenkins 


> EXPLAIN should be case insensitive
> --
>
> Key: ASTERIXDB-1561
> URL: https://issues.apache.org/jira/browse/ASTERIXDB-1561
> Project: Apache AsterixDB
>  Issue Type: Bug
>  Components: AsterixDB
>Reporter: Yingyi Bu
>Assignee: Till
>
> "explain SELECT 1" works, but "EXPLAIN SELECT 1" doesn't.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (ASTERIXDB-883) NPE Exception - using three "for" loops

[ASF subversion and git services (JIRA)]

[ 
https://issues.apache.org/jira/browse/ASTERIXDB-883?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15416359#comment-15416359
 ] 

ASF subversion and git services commented on ASTERIXDB-883:
---

Commit 37cd8f1035edc4ce5c4c776d7b50f57050206cea in asterixdb's branch 
refs/heads/master from [~buyingyi]
[ https://git-wip-us.apache.org/repos/asf?p=asterixdb.git;h=37cd8f1 ]

ASTERIXDB-883: fix and a regression test.

Change-Id: I34dbe4e12492337746d630a9b130331abfefe78e
Reviewed-on: https://asterix-gerrit.ics.uci.edu/1059
Sonar-Qube: Jenkins 
Reviewed-by: Till Westmann 
Tested-by: Jenkins 
Integration-Tests: Jenkins 


> NPE Exception - using three "for" loops
> ---
>
> Key: ASTERIXDB-883
> URL: https://issues.apache.org/jira/browse/ASTERIXDB-883
> Project: Apache AsterixDB
>  Issue Type: Bug
>  Components: AsterixDB, Optimizer
>Reporter: asterixdb-importer
>Assignee: Yingyi Bu
>Priority: Critical
>
> NPE Exception - using three "for" loops



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (ASTERIXDB-1569) The configuration file should support byte units (KB, MB, GB ...).

[ASF subversion and git services (JIRA)]

[ 
https://issues.apache.org/jira/browse/ASTERIXDB-1569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15418263#comment-15418263
 ] 

ASF subversion and git services commented on ASTERIXDB-1569:


Commit bddc811068f42795c3b07c20cf027270bdd83762 in asterixdb's branch 
refs/heads/master from [~wangsaeu]
[ https://git-wip-us.apache.org/repos/asf?p=asterixdb.git;h=bddc811 ]

ASTERIXDB-1569: the config file now supports unit, comma, and decimal.

 - This patch fixes an issue that the config file only supports byte
   value for the byte required parameters. Now, we can use unit (KB, MB, GB 
...),
   comma, and decimal.

Change-Id: I763d1b06e93f75775c0294da0d609c2bf3e102c9
Reviewed-on: https://asterix-gerrit.ics.uci.edu/1064
Reviewed-by: Yingyi Bu 
Reviewed-by: Till Westmann 
Tested-by: Jenkins 
Integration-Tests: Jenkins 


> The configuration file should support byte units (KB, MB, GB ...).
> --
>
> Key: ASTERIXDB-1569
> URL: https://issues.apache.org/jira/browse/ASTERIXDB-1569
> Project: Apache AsterixDB
>  Issue Type: Improvement
>Reporter: Taewoo Kim
>Assignee: Taewoo Kim
>
> In the asterix-configuration.xml file, we set bytes for some settings (e.g., 
> compiler.sortmemory). It would be more convenient if a user can specify byte 
> units in the number like the following:
> compiler.sortmemory = 5242880
> compiler.sortmemory = 5,242,880
> compiler.sortmemory = 5120kb
> compiler.sortmemory = 5120KB
> compiler.sortmemory = 5,120KB
> compiler.sortmemory = 5MB
> compiler.sortmemory = 5mb
> compiler.sortmemory = 0.5GB



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (ASTERIXDB-1490) NPE for negative expression

[ASF subversion and git services (JIRA)]

[ 
https://issues.apache.org/jira/browse/ASTERIXDB-1490?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15414645#comment-15414645
 ] 

ASF subversion and git services commented on ASTERIXDB-1490:


Commit 7a670581888ea09e5f272682624fae40cb4968e3 in asterixdb's branch 
refs/heads/master from [~buyingyi]
[ https://git-wip-us.apache.org/repos/asf?p=asterixdb.git;h=7a67058 ]

ASTERIXDB-1490: fix and a regression test.

Change-Id: Iec1a9caec796d4e1cbbf776f0acc7b085b27e19e
Reviewed-on: https://asterix-gerrit.ics.uci.edu/1060
Sonar-Qube: Jenkins 
Tested-by: Jenkins 
Integration-Tests: Jenkins 
Reviewed-by: Michael Blow 


> NPE for negative expression
> ---
>
> Key: ASTERIXDB-1490
> URL: https://issues.apache.org/jira/browse/ASTERIXDB-1490
> Project: Apache AsterixDB
>  Issue Type: Bug
>  Components: Optimizer
>Reporter: Yingyi Bu
>Assignee: Yingyi Bu
>Priority: Critical
>
> Query:
> {noformat}
> SELECT VALUE COUNT(1)
> FROM (
>SELECT DISTINCT VALUE -n.foo
>FROM Bar n 
> ) tmp;
> {noformat}
> Exception trace:
> {noformat}
> java.lang.NullPointerException
>   at 
> org.apache.asterix.om.typecomputer.impl.ListConstructorTypeComputer.computeTypeFromItems(ListConstructorTypeComputer.java:59)
>   at 
> org.apache.asterix.om.typecomputer.impl.ListConstructorTypeComputer.computeType(ListConstructorTypeComputer.java:50)
>   at 
> org.apache.asterix.dataflow.data.common.AqlExpressionTypeComputer.getTypeForFunction(AqlExpressionTypeComputer.java:75)
>   at 
> org.apache.asterix.dataflow.data.common.AqlExpressionTypeComputer.getType(AqlExpressionTypeComputer.java:53)
>   at 
> org.apache.hyracks.algebricks.core.algebra.operators.logical.AggregateOperator.computeOutputTypeEnvironment(AggregateOperator.java:106)
>   at 
> org.apache.hyracks.algebricks.core.rewriter.base.AlgebricksOptimizationContext.computeAndSetTypeEnvironmentForOperator(AlgebricksOptimizationContext.java:295)
>   at 
> org.apache.hyracks.algebricks.rewriter.rules.InferTypesRule.rewritePost(InferTypesRule.java:42)
>   at 
> org.apache.hyracks.algebricks.core.rewriter.base.AbstractRuleController.rewriteOperatorRef(AbstractRuleController.java:125)
>   at 
> org.apache.hyracks.algebricks.core.rewriter.base.AbstractRuleController.rewriteOperatorRef(AbstractRuleController.java:111)
>   at 
> org.apache.hyracks.algebricks.core.rewriter.base.AbstractRuleController.rewriteOperatorRef(AbstractRuleController.java:99)
>   at 
> org.apache.hyracks.algebricks.core.rewriter.base.AbstractRuleController.rewriteOperatorRef(AbstractRuleController.java:99)
>   at 
> org.apache.hyracks.algebricks.core.rewriter.base.AbstractRuleController.rewriteOperatorRef(AbstractRuleController.java:99)
>   at 
> org.apache.hyracks.algebricks.core.rewriter.base.AbstractRuleController.rewriteOperatorRef(AbstractRuleController.java:99)
>   at 
> org.apache.hyracks.algebricks.core.rewriter.base.AbstractRuleController.rewriteOperatorRef(AbstractRuleController.java:99)
>   at 
> org.apache.hyracks.algebricks.core.rewriter.base.AbstractRuleController.rewriteOperatorRef(AbstractRuleController.java:99)
>   at 
> org.apache.hyracks.algebricks.core.rewriter.base.AbstractRuleController.rewriteOperatorRef(AbstractRuleController.java:99)
>   at 
> org.apache.hyracks.algebricks.compiler.rewriter.rulecontrollers.SequentialOnceRuleController.rewriteWithRuleCollection(SequentialOnceRuleController.java:44)
>   at 
> org.apache.hyracks.algebricks.core.rewriter.base.HeuristicOptimizer.runOptimizationSets(HeuristicOptimizer.java:95)
>   at 
> org.apache.hyracks.algebricks.core.rewriter.base.HeuristicOptimizer.optimize(HeuristicOptimizer.java:82)
>   at 
> org.apache.hyracks.algebricks.compiler.api.HeuristicCompilerFactoryBuilder$1$1.optimize(HeuristicCompilerFactoryBuilder.java:88)
>   at 
> org.apache.asterix.api.common.APIFramework.compileQuery(APIFramework.java:263)
>   at 
> org.apache.asterix.aql.translator.QueryTranslator.rewriteCompileQuery(QueryTranslator.java:1959)
>   at 
> org.apache.asterix.aql.translator.QueryTranslator.handleQuery(QueryTranslator.java:2521)
>   at 
> org.apache.asterix.aql.translator.QueryTranslator.compileAndExecute(QueryTranslator.java:389)
>   at 
> org.apache.asterix.aql.translator.QueryTranslator.compileAndExecute(QueryTranslator.java:253)
>   at 
> org.apache.asterix.api.http.servlet.APIServlet.doPost(APIServlet.java:148)
>   at javax.servlet.http.HttpServlet.service(HttpServlet.java:754)
>   at javax.servlet.http.HttpServlet.service(HttpServlet.java:847)
>   at 
> 

[jira] [Commented] (ASTERIXDB-1529) Query 7 in AsterixDB 101 is broken

[ASF subversion and git services (JIRA)]

[ 
https://issues.apache.org/jira/browse/ASTERIXDB-1529?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15416109#comment-15416109
 ] 

ASF subversion and git services commented on ASTERIXDB-1529:


Commit dcd9112fa71689c015a525adcdbe3ce78c79f17f in asterixdb's branch 
refs/heads/master from [~buyingyi]
[ https://git-wip-us.apache.org/repos/asf?p=asterixdb.git;h=dcd9112 ]

ASTERIXDB-1529: remove "not" from reserved keywords in AQL.

Change-Id: Ib79fee208acc7ae28f8e082eebb26ed728b39723
Reviewed-on: https://asterix-gerrit.ics.uci.edu/1062
Sonar-Qube: Jenkins 
Tested-by: Jenkins 
Integration-Tests: Jenkins 
Reviewed-by: Till Westmann 


> Query 7 in AsterixDB 101 is broken
> --
>
> Key: ASTERIXDB-1529
> URL: https://issues.apache.org/jira/browse/ASTERIXDB-1529
> Project: Apache AsterixDB
>  Issue Type: Bug
>  Components: Documentation
> Environment: Latest binary download from Apache AsterixDB site 
> (master)
>Reporter: Michael J. Carey
>Assignee: Yingyi Bu
>
> Query 7 in the 101 tutorial is:
> use dataverse TinySocial;
> from $fbu in dataset FacebookUsers
> where (every $e in $fbu.employment satisfies not(is-null($e.end-date)))
> select $fbu;
> This query no longer works at all - instead it gives a syntax error:
> Error: Encountered " "not" "not "" at line 4, column 50.
> Was expecting one of:
> "dataset" ...
> "every" ...
> "for" ...
> "from" ...
> "if" ...
> "let" ...
> "some" ...
> "with" ...
> "-" ...
> "+" ...
> "(" ...
> "[" ...
> "{" ...
> "{{" ...
>  ...
> "missing" ...
> "null" ...
> "true" ...
> "false" ...
>  ...
>  ...
>  ...
>  ...
>  ...
> 
> ==> where (every $e in $fbu.employment satisfies 
> not(is-null($e.end-date)))



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (ASTERIXDB-1354) Foreign key select error of UNION

[ASF subversion and git services (JIRA)]

[ 
https://issues.apache.org/jira/browse/ASTERIXDB-1354?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15407847#comment-15407847
 ] 

ASF subversion and git services commented on ASTERIXDB-1354:


Commit b762457537a6ba163714beb2e43b11b5e8b97c7d in asterixdb's branch 
refs/heads/master from [~buyingyi]
[ https://git-wip-us.apache.org/repos/asf?p=asterixdb.git;h=b762457 ]

Support UNION ALL.

- support heterogenous input types for UNION ALL and the output is resolved to 
a mimimally generalized type;
- fix the partitioning property inference for UnionAllPOperator;
- fix for ASTERIXDB-1354, a bug in IsomorphismVariableMappingVisitor.

Change-Id: Ifadf1707bb2b6bed22f8fc5792c635e87291a468
Reviewed-on: https://asterix-gerrit.ics.uci.edu/1035
Tested-by: Jenkins 
Integration-Tests: Jenkins 
Reviewed-by: Yingyi Bu 


> Foreign key select error of UNION
> -
>
> Key: ASTERIXDB-1354
> URL: https://issues.apache.org/jira/browse/ASTERIXDB-1354
> Project: Apache AsterixDB
>  Issue Type: Bug
>  Components: AsterixDB
> Environment: General Environment.
>Reporter: Wenhai
>Assignee: Yingyi Bu
>Priority: Critical
>  Labels: patch
>
> If we set up a composite primary key (i.e. LineItem(l_orderkey, 
> l_linenumber)) referring to another table (i.e. Orders(o_orderkey)), the same 
> selection condition will introduce a readCount error.
> Schemas
> {noformat}
> use dataverse tpch;
> create type LineItemType as closed {
>   l_orderkey: int32, 
>   l_partkey: int32, 
>   l_suppkey: int32, 
>   l_linenumber: int32, 
>   l_quantity: int32, 
>   l_extendedprice: double,
>   l_discount: double, 
>   l_tax: double,
>   l_returnflag: string, 
>   l_linestatus: string, 
>   l_shipdate: string,
>   l_commitdate: string, 
>   l_receiptdate: string, 
>   l_shipinstruct: string, 
>   l_shipmode: string, 
>   l_comment: string
> }
> create type OrderType as closed {
>   o_orderkey: int32, 
>   o_custkey: int32, 
>   o_orderstatus: string, 
>   o_totalprice: double, 
>   o_orderdate: string, 
>   o_orderpriority: string,
>   o_clerk: string, 
>   o_shippriority: int32, 
>   o_comment: string
> }
> create dataset LineItem(LineItemType) primary key l_orderkey, l_linenumber;
> create dataset Orders(OrderType) primary key o_orderkey;
> use dataverse tpch;
> load dataset LineItem 
> using localfs
> (("path"="asterix_nc1://data/tpch0.001/lineitem.tbl"),("format"="delimited-text"),("delimiter"="|"));
> load dataset Orders 
> using localfs
> (("path"="asterix_nc2://data/tpch0.001/orders.tbl"),("format"="delimited-text"),("delimiter"="|"));
> {noformat}
> Query:
> {noformat}
> use dataverse tpch;
> let $l := for $r in dataset LineItem where $r.l_orderkey = 2
> return $r.l_linenumber
> let $o := for $s in dataset Orders where $s.o_orderkey =2
> return $s.o_custkey
> let $c := $l union $o
> return $c
> {noformat}
> Error:
> {noformat}
> Invalid LSM disk component readerCount: -1 [IllegalStateException]
> {noformat}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (ASTERIXDB-1463) Could not resolve type for function-call: field-access-by-name

[ASF subversion and git services (JIRA)]

[ 
https://issues.apache.org/jira/browse/ASTERIXDB-1463?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15418277#comment-15418277
 ] 

ASF subversion and git services commented on ASTERIXDB-1463:


Commit bd3a535b171a5cc7486175f159048cf64b16c840 in asterixdb's branch 
refs/heads/master from [~buyingyi]
[ https://git-wip-us.apache.org/repos/asf?p=asterixdb.git;h=bd3a535 ]

ASTERIXDB-1463: add a regression test.

Change-Id: Iaf3a5a616799af2ee58ba559e1dc1db8b6e010ad
Reviewed-on: https://asterix-gerrit.ics.uci.edu/1067
Sonar-Qube: Jenkins 
Tested-by: Jenkins 
Reviewed-by: Jianfeng Jia 
Integration-Tests: Jenkins 


> Could not resolve type for function-call: field-access-by-name
> --
>
> Key: ASTERIXDB-1463
> URL: https://issues.apache.org/jira/browse/ASTERIXDB-1463
> Project: Apache AsterixDB
>  Issue Type: Bug
>  Components: Optimizer
>Reporter: Jianfeng Jia
>Assignee: Yingyi Bu
>
> The query is a bit long:
> {code}
> use dataverse twitter
> let $common := (
> for $t in dataset twitter.ds_tweet_help
> where similarity-jaccard(word-tokens($t."text"), word-tokens("help")) > 0.0
> where
> ($t."create_at">= datetime("2012-02-01T00:00:00.000Z")
> and $t."create_at" < datetime("2016-05-23T14:00:57.000Z"))
> let $set := [ 
> 37,51,24,11,10,34,42,9,44,48,35,4,40,6,20,32,8,49,12,22,28,1,13,45,5,47,21,29,54,17,18,39,19,55,26,27,31,56,41,46,16,30,53,38,25,36,50,33,23,2
>  ]
> for $sid in $set
> where $t.geo_tag.stateID = $sid
> return $t
> )
> let $hashtag := (
> for $t in $common
> where not(is-null($t.hashtags))
> for $h in $t.hashtags
> group by $tag := $h with $h
> let $c := count($h)
> order by $c desc
> limit 50
> return { "key": $tag, "count" : $c}
> )
> return $hashtag
> {code}
> It throws the following error: 
> {code}
> SEVERE: Could not resolve type for function-call: asterix:scan-collection, 
> Args:[function-call: asterix:field-access-by-name, Args:[%0->$$0, AString: 
> {hashtags}]],please check whether the used variables has been defined!
> org.apache.hyracks.algebricks.common.exceptions.AlgebricksException: Could 
> not resolve type for function-call: asterix:scan-collection, 
> Args:[function-call: asterix:field-access-by-name, Args:[%0->$$0, AString: 
> {hashtags}]],please check whether the used variables has been defined!
> at 
> org.apache.hyracks.algebricks.core.algebra.typing.AbstractTypeEnvironment.getType(AbstractTypeEnvironment.java:48)
> at 
> org.apache.hyracks.algebricks.core.algebra.operators.logical.UnnestOperator.computeOutputTypeEnvironment(UnnestOperator.java:51)
> at 
> org.apache.hyracks.algebricks.core.rewriter.base.AlgebricksOptimizationContext.computeAndSetTypeEnvironmentForOperator(AlgebricksOptimizationContext.java:295)
> at 
> org.apache.hyracks.algebricks.core.algebra.util.OperatorPropertiesUtil.typeOpRec(OperatorPropertiesUtil.java:256)
> at 
> org.apache.hyracks.algebricks.core.algebra.util.OperatorPropertiesUtil.typeOpRec(OperatorPropertiesUtil.java:249)
> at 
> org.apache.hyracks.algebricks.core.algebra.util.OperatorPropertiesUtil.typeOpRec(OperatorPropertiesUtil.java:249)
> .
> Caused by: java.lang.NullPointerException
> at 
> org.apache.asterix.om.util.NonTaggedFormatUtil.isOptional(NonTaggedFormatUtil.java:105)
>   
> 
> at 
> org.apache.asterix.om.typecomputer.impl.NonTaggedCollectionMemberResultType.computeType(NonTaggedCollectionMemberResultType.java:46)
> at 
> org.apache.asterix.dataflow.data.common.AqlExpressionTypeComputer.getTypeForFunction(AqlExpressionTypeComputer.java:86)
> at 
> org.apache.asterix.dataflow.data.common.AqlExpressionTypeComputer.getType(AqlExpressionTypeComputer.java:57)
> at 
> org.apache.hyracks.algebricks.core.algebra.typing.AbstractTypeEnvironment.getType(AbstractTypeEnvironment.java:46)
> {code}
> The ddl is following
> {code}
> create dataverse twitter if not exists;
> use dataverse twitter
> create type typeUser if not exists as open {
> id: int64,
> name: string,
> screen_name : string,
> lang : string,
> location: string,
> create_at: date,
> description: string,
> followers_count: int32,
> friends_count: int32,
> statues_count: int64
> }
> create type typePlace if not exists as open{
> country : string,
> country_code : string,
> full_name : string,
> id : string,
> name : string,
> place_type : string,
> bounding_box : rectangle
> }
> create type typeGeoTag if not exists as open {
> stateID: int32,
> stateName: string,
> countyID: int32,
> countyName: string,
> 

[jira] [Commented] (ASTERIXDB-867) string value turns into "null" value when not casted

[ASF subversion and git services (JIRA)]

[ 
https://issues.apache.org/jira/browse/ASTERIXDB-867?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15412770#comment-15412770
 ] 

ASF subversion and git services commented on ASTERIXDB-867:
---

Commit 112b39eea5914a422c60b900f2d6c2b741eb19f7 in asterixdb's branch 
refs/heads/master from [~buyingyi]
[ https://git-wip-us.apache.org/repos/asf?p=asterixdb.git;h=112b39e ]

ASTERIXDB-867: add a regression test.

Change-Id: I84f2df6c9c6da127990c5e2e2bec67d73d33fe88
Reviewed-on: https://asterix-gerrit.ics.uci.edu/1055
Sonar-Qube: Jenkins 
Tested-by: Jenkins 
Integration-Tests: Jenkins 
Reviewed-by: Till Westmann 


> string value turns into "null" value when not casted
> 
>
> Key: ASTERIXDB-867
> URL: https://issues.apache.org/jira/browse/ASTERIXDB-867
> Project: Apache AsterixDB
>  Issue Type: Bug
>  Components: AsterixDB
>Reporter: asterixdb-importer
>Assignee: Yingyi Bu
>Priority: Critical
> Attachments: page_views_test.adm
>
>
> string value turns into "null" value when not casted



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (ASTERIXDB-830) Need to investigate why this query blows the frame size

[ASF subversion and git services (JIRA)]

[ 
https://issues.apache.org/jira/browse/ASTERIXDB-830?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15403175#comment-15403175
 ] 

ASF subversion and git services commented on ASTERIXDB-830:
---

Commit 1e73f46aa7130079e922b75658b370cecf4646f4 in asterixdb's branch 
refs/heads/master from [~buyingyi]
[ https://git-wip-us.apache.org/repos/asf?p=asterixdb.git;h=1e73f46 ]

ASTERIXDB-830: adds regression tests.

Change-Id: I2e352726bcac831e8024858f9a9ad49ef777d50e
Reviewed-on: https://asterix-gerrit.ics.uci.edu/1037
Sonar-Qube: Jenkins 
Tested-by: Jenkins 
Reviewed-by: Till Westmann 
Integration-Tests: Jenkins 


> Need to investigate why this query blows the frame size
> ---
>
> Key: ASTERIXDB-830
> URL: https://issues.apache.org/jira/browse/ASTERIXDB-830
> Project: Apache AsterixDB
>  Issue Type: Bug
>  Components: AsterixDB, Optimizer
>Reporter: Till
>Assignee: Yingyi Bu
>Priority: Critical
>
> Need to investigate why this query blows the frame size



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (ASTERIXDB-971) Semantically equivalent FLWOR expressions involving dataset lookup; one executes fine, other fails with NPE during compilation

[ASF subversion and git services (JIRA)]

[ 
https://issues.apache.org/jira/browse/ASTERIXDB-971?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15421157#comment-15421157
 ] 

ASF subversion and git services commented on ASTERIXDB-971:
---

Commit 8671ddf83ed402dce7465759d6399ed84993f967 in asterixdb's branch 
refs/heads/master from [~buyingyi]
[ https://git-wip-us.apache.org/repos/asf?p=asterixdb.git;h=8671ddf ]

Clean up GROUP BY and WITH clause.

- fix ASTERIXDB-971, i.e., the expression to plan translator for FLWOGR without 
a "for";
- fix the scoping for nested WITH clause;
- fix the scoping for nested GROUP BY clause;
- fix default fields in group variables;
- fix/unify the expression substition AST visitor;
- enhance RemoveUnusedAssignAndAggregateRule to be able to remove unused GROUP 
BY
  decoration varaibles;
- clearly sperate SQL++ aggregate functions and SQL-92 aggregate functions, 
i.e.,
  SQL-92 aggregate sugars cannot apply to SQL++ aggregate functions;
- fix PushAggregateIntoGroupbyRule for nested plan deletions;
- enhance RemoveCartesianProductWithEmptyBranchRule;
- add ExtractGroupByDecorVariablesRule;
- add an aggregate function first-element;
- fix ASTERIXDB-1560, an error message issue.

Change-Id: I62fca7f937aa007d97ed87c75cef19f6aa3e5ade
Reviewed-on: https://asterix-gerrit.ics.uci.edu/1050
Tested-by: Jenkins 
Integration-Tests: Jenkins 
Reviewed-by: Till Westmann 


> Semantically equivalent FLWOR expressions involving dataset lookup; one 
> executes fine, other fails with NPE during compilation
> --
>
> Key: ASTERIXDB-971
> URL: https://issues.apache.org/jira/browse/ASTERIXDB-971
> Project: Apache AsterixDB
>  Issue Type: Bug
>  Components: AsterixDB, Optimizer, Translator - AQL
>Reporter: asterixdb-importer
>Assignee: Yingyi Bu
>Priority: Critical
> Attachments: Exception.txt
>
>
> Semantically equivalent FLWOR expressions involving dataset lookup; one 
> executes fine, other fails with NPE during compilation



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (ASTERIXDB-1560) Misleading SQL++ error message when variables are undefined

[ASF subversion and git services (JIRA)]

[ 
https://issues.apache.org/jira/browse/ASTERIXDB-1560?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15421158#comment-15421158
 ] 

ASF subversion and git services commented on ASTERIXDB-1560:


Commit 8671ddf83ed402dce7465759d6399ed84993f967 in asterixdb's branch 
refs/heads/master from [~buyingyi]
[ https://git-wip-us.apache.org/repos/asf?p=asterixdb.git;h=8671ddf ]

Clean up GROUP BY and WITH clause.

- fix ASTERIXDB-971, i.e., the expression to plan translator for FLWOGR without 
a "for";
- fix the scoping for nested WITH clause;
- fix the scoping for nested GROUP BY clause;
- fix default fields in group variables;
- fix/unify the expression substition AST visitor;
- enhance RemoveUnusedAssignAndAggregateRule to be able to remove unused GROUP 
BY
  decoration varaibles;
- clearly sperate SQL++ aggregate functions and SQL-92 aggregate functions, 
i.e.,
  SQL-92 aggregate sugars cannot apply to SQL++ aggregate functions;
- fix PushAggregateIntoGroupbyRule for nested plan deletions;
- enhance RemoveCartesianProductWithEmptyBranchRule;
- add ExtractGroupByDecorVariablesRule;
- add an aggregate function first-element;
- fix ASTERIXDB-1560, an error message issue.

Change-Id: I62fca7f937aa007d97ed87c75cef19f6aa3e5ade
Reviewed-on: https://asterix-gerrit.ics.uci.edu/1050
Tested-by: Jenkins 
Integration-Tests: Jenkins 
Reviewed-by: Till Westmann 


> Misleading SQL++ error message when variables are  undefined
> 
>
> Key: ASTERIXDB-1560
> URL: https://issues.apache.org/jira/browse/ASTERIXDB-1560
> Project: Apache AsterixDB
>  Issue Type: Bug
>  Components: AsterixDB, Error Reporting
>Reporter: Michael J. Carey
>Assignee: Yingyi Bu
>Priority: Minor
>
> This query:
> SELECT u.name AS uname, m.message AS message
> FROM GleambookUsers u
> UNNEST GleambookMessages m
> WHERE m.authorId = user.id;
> Yields this error message:
> Cannot resolve ambiguous alias (variable) reference for identifier user 
> [AlgebricksException]
> The reference is undefined, not ambiguous, in this case.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (ASTERIXDB-1576) Select * with more than two tables in from clause without aliases throws AlgebricksException

[ASF subversion and git services (JIRA)]

[ 
https://issues.apache.org/jira/browse/ASTERIXDB-1576?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15425254#comment-15425254
 ] 

ASF subversion and git services commented on ASTERIXDB-1576:


Commit d015b566fba1cc1048cb045791357ceb30bfbbd7 in asterixdb's branch 
refs/heads/master from [~buyingyi]
[ https://git-wip-us.apache.org/repos/asf?p=asterixdb.git;h=d015b56 ]

ASTERIXDB-1576: fix and add negative regression tests.

Change-Id: I8b4f66907f8ac8043fe245c9c5a331884db2b005
Reviewed-on: https://asterix-gerrit.ics.uci.edu/1079
Tested-by: Jenkins 
Integration-Tests: Jenkins 
Sonar-Qube: Jenkins 
Reviewed-by: Yingyi Bu 


> Select * with more than two tables in from clause without aliases throws 
> AlgebricksException
> 
>
> Key: ASTERIXDB-1576
> URL: https://issues.apache.org/jira/browse/ASTERIXDB-1576
> Project: Apache AsterixDB
>  Issue Type: Bug
> Environment: Master branch with latest commit id: 
> bd3a535b171a5cc7486175
>Reporter: Vignesh Raghunathan
>Assignee: Yingyi Bu
>  Labels: soon
>
> To reproduce the issue, execute the following sqlpp statements:
> {code}
> drop dataverse sampdb if exists;
> create dataverse sampdb;
> use sampdb;
> drop dataset samptable if exists;
> drop type samptabletype if exists;
> create type samptabletype as closed {
>   id: int8
> };
> create dataset samptable1(samptabletype) primary key id;
> insert into samptable1 ({'id' : 0});
> insert into samptable1 ({'id' : 1});
> select * 
> from samptable1, samptable1, samptable1;
> {code}
> Result:
> {code}
> org.apache.hyracks.algebricks.common.exceptions.AlgebricksException: The 
> input type for input argument 0(ARecord) is not expected.
>   at 
> org.apache.asterix.om.typecomputer.impl.CollectionMemberResultType.checkArgType(CollectionMemberResultType.java:40)
>   at 
> org.apache.asterix.om.typecomputer.base.AbstractResultTypeComputer.lambda$computeType$2(AbstractResultTypeComputer.java:39)
>   at 
> org.apache.asterix.om.typecomputer.base.AbstractResultTypeComputer$$Lambda$23/2116803859.checkArgTypes(Unknown
>  Source)
>   at 
> org.apache.asterix.om.typecomputer.impl.TypeComputeUtils.resolveResultType(TypeComputeUtils.java:92)
>   at 
> org.apache.asterix.om.typecomputer.base.AbstractResultTypeComputer.computeType(AbstractResultTypeComputer.java:39)
>   at 
> org.apache.asterix.dataflow.data.common.AqlExpressionTypeComputer.getTypeForFunction(AqlExpressionTypeComputer.java:80)
>   at 
> org.apache.asterix.dataflow.data.common.AqlExpressionTypeComputer.getType(AqlExpressionTypeComputer.java:53)
>   at 
> org.apache.hyracks.algebricks.core.algebra.typing.AbstractTypeEnvironment.getType(AbstractTypeEnvironment.java:45)
>   at 
> org.apache.hyracks.algebricks.core.algebra.operators.logical.UnnestOperator.computeOutputTypeEnvironment(UnnestOperator.java:51)
>   at 
> org.apache.hyracks.algebricks.core.rewriter.base.AlgebricksOptimizationContext.computeAndSetTypeEnvironmentForOperator(AlgebricksOptimizationContext.java:298)
>   at 
> org.apache.hyracks.algebricks.rewriter.rules.InferTypesRule.rewritePost(InferTypesRule.java:42)
>   at 
> org.apache.hyracks.algebricks.core.rewriter.base.AbstractRuleController.rewriteOperatorRef(AbstractRuleController.java:126)
>   at 
> org.apache.hyracks.algebricks.core.rewriter.base.AbstractRuleController.rewriteOperatorRef(AbstractRuleController.java:100)
>   at 
> org.apache.hyracks.algebricks.core.rewriter.base.AbstractRuleController.rewriteOperatorRef(AbstractRuleController.java:100)
>   at 
> org.apache.hyracks.algebricks.core.rewriter.base.AbstractRuleController.rewriteOperatorRef(AbstractRuleController.java:100)
>   at 
> org.apache.hyracks.algebricks.core.rewriter.base.AbstractRuleController.rewriteOperatorRef(AbstractRuleController.java:100)
>   at 
> org.apache.hyracks.algebricks.compiler.rewriter.rulecontrollers.SequentialOnceRuleController.rewriteWithRuleCollection(SequentialOnceRuleController.java:44)
>   at 
> org.apache.hyracks.algebricks.core.rewriter.base.HeuristicOptimizer.runOptimizationSets(HeuristicOptimizer.java:102)
>   at 
> org.apache.hyracks.algebricks.core.rewriter.base.HeuristicOptimizer.optimize(HeuristicOptimizer.java:82)
>   at 
> org.apache.hyracks.algebricks.compiler.api.HeuristicCompilerFactoryBuilder$1$1.optimize(HeuristicCompilerFactoryBuilder.java:90)
>   at 
> org.apache.asterix.api.common.APIFramework.compileQuery(APIFramework.java:268)
>   at 
> org.apache.asterix.aql.translator.QueryTranslator.rewriteCompileQuery(QueryTranslator.java:1938)
>   at 
> 

[jira] [Commented] (ASTERIXDB-1778) Calculating the edit-distance in SimilarityMetricEditDistance class can be improved.

[ASF subversion and git services (JIRA)]

[ 
https://issues.apache.org/jira/browse/ASTERIXDB-1778?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15853163#comment-15853163
 ] 

ASF subversion and git services commented on ASTERIXDB-1778:


Commit 56189fb1116a25aca29b3989814ceea00d470e39 in asterixdb's branch 
refs/heads/master from [~wangsaeu]
[ https://git-wip-us.apache.org/repos/asf?p=asterixdb.git;h=56189fb ]

ASTERIXDB-1778: Optimize the edit-distance-check function

 - Only calculate 2 * (threshold + 1) cells, rather than all cells per row.
 - Terminate the calculation steps early when it become obvious that
   the possible edit-distance value is greater than the given threshold.
   There is no reason to compute all cells in the 2 dimensional array.
 - Move the location of IListIterator to Hyracks since we now have
   a CharacterIterator in a String. Change the name to ISequenceIterator.
 - Add the section for the function in the manual.
 - Remove letter counting filtering method since it is only applicable for
   the string in ASCII range (0 ~ 127).

Change-Id: Ibc8729c4514bb87c347dd7d50358fd897b769977
Reviewed-on: https://asterix-gerrit.ics.uci.edu/1481
Sonar-Qube: Jenkins 
Tested-by: Jenkins 
BAD: Jenkins 
Integration-Tests: Jenkins 
Reviewed-by: Jianfeng Jia 


> Calculating the edit-distance in SimilarityMetricEditDistance class can be 
> improved.
> 
>
> Key: ASTERIXDB-1778
> URL: https://issues.apache.org/jira/browse/ASTERIXDB-1778
> Project: Apache AsterixDB
>  Issue Type: Improvement
>Reporter: Taewoo Kim
>Assignee: Taewoo Kim
>Priority: Minor
>
> Local optimization of the current edit-distance handling code in AsterixDB: 
> Can we terminate the edit distance calculation based on a given edit-distance 
> threshold T? I think the answer is yes.
> Basic Algorithm:
> For two strings X and Y, 
> Init:
> Construct D(len(X)+1=M, len(Y)+1=N).
> D(i,0) = i
> D(j,0) = j
> Iteration:
> {code}
> For each i = 1 to M
> For each j = 1 to N
> D(i,j) = min( D(i-1,j) + 1 // deletion case
>   D(i,j-1) + 1 // insertion case
>   D(i-1,j-1) + cost (cost is 2 if X(i) != Y(j), 
>  cost is 0 if X(i) = Y(j))
> )
> {code}
> Result:
> D(M,N) is the edit distance value.
> Example:
> Early Termination condition:
> So, for the given threshold T, we can stop the computation early if the 
> values of three cases are greater than T. That is,
> min (D(i-1,j), D(i,j-1), D(i-1,j-1)) > T
> This holds since if the cost of all possible cases (insertion, deletion, and 
> substitution) is greater than T, all future operations will be greater than T 
> in any cases.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

[jira] [Commented] (ASTERIXDB-1738) Change feed fails to delete record with meta PK

[ASF subversion and git services (JIRA)]

[ 
https://issues.apache.org/jira/browse/ASTERIXDB-1738?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15858839#comment-15858839
 ] 

ASF subversion and git services commented on ASTERIXDB-1738:


Commit d195de1443b0ccf8222770452cced8bcb5c25d5f in asterixdb's branch 
refs/heads/master from [~iabsalyamov]
[ https://git-wip-us.apache.org/repos/asf?p=asterixdb.git;h=d195de1 ]

Fix for ASTERIXDB-1738: Change feed fails to delete record with meta PK

Change-Id: I5ce8d9c69f96593ee305cfad4b44e486c9f1d6cc
Reviewed-on: https://asterix-gerrit.ics.uci.edu/1351
Reviewed-by: abdullah alamoudi 
Sonar-Qube: Jenkins 
Tested-by: Jenkins 
BAD: Jenkins 
Integration-Tests: Jenkins 


> Change feed fails to delete record with meta PK
> ---
>
> Key: ASTERIXDB-1738
> URL: https://issues.apache.org/jira/browse/ASTERIXDB-1738
> Project: Apache AsterixDB
>  Issue Type: Bug
>Reporter: Ildar Absalyamov
>
> I am trying to create the following dataset with meta PK and feed in data to 
> it using change-feed localFS adapter
> {noformat}
> drop dataverse test if exists;
> create dataverse test;
> use dataverse test;
> create type TestType as closed {
> test: string
> }
> create type MetaType as {
> id:int
> }
> create dataset TestDS(TestType) with meta(MetaType) primary key meta().id;
> create index TestIdx on TestDS(test);
> drop feed TestFeed if exists;
> create feed TestFeed using adapter
> (
> ("parser"="record-with-metadata"),
> ("reader"="localfs"),
> ("path"="localhost:///ABSOLUTE_PATH/test.adm"),
> //type of the record
> ("type-name"="TestType"),
> //type of the meta record
> ("meta-type-name"="MetaType"),
> //format of the record
> ("record-format"="adm"),
> // format of the meta record
> ("format"="csv"),
> ("delimiter"=","),
> // index of the primary key the record (meta or orig)
> ("key-indexes"="0"),
> // indicates that PK originates from meta
> ("key-indicators"="1"),
>   //index of the record in the meta record
> ("record-index"="1"),
> ("change-feed"="true"),
> // whether CSV header is present in the input
> ("header"="false")
> );
> set wait-for-completion-feed "false";
> connect feed TestFeed to dataset TestDS;
> {noformat}
> Contents of the test.adm:
> {noformat}
> 1,"{""test"":""test1""}"
> 2,"{""test"":""test2""}"
> 3,"{""test"":""test3""}"
> 3,
> 2,"{""test"":""test4""}"
> {noformat}
> Ingestion is able to update the record with id=2, but fails to delete the 
> third record:
> {noformat}
> for $x in dataset TestDS return {"record": $x, "id": meta().id}
> {noformat}
> Result:
> {noformat}
> { "record": { "test": "test1" }, "id": 1 }
> { "record": { "test": "test4" }, "id": 2 }
> { "record": { "test": "test3" }, "id": 3 }
> {noformat}



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

[jira] [Commented] (ASTERIXDB-1785) Remove servlet dependencies in AsterixDB

[ASF subversion and git services (JIRA)]

[ 
https://issues.apache.org/jira/browse/ASTERIXDB-1785?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15852823#comment-15852823
 ] 

ASF subversion and git services commented on ASTERIXDB-1785:


Commit 2343e1c13f03f9f04f50229d883e84c2ec82bada in asterixdb's branch 
refs/heads/master from [~tillw]
[ https://git-wip-us.apache.org/repos/asf?p=asterixdb.git;h=2343e1c ]

ASTERIXDB-1785: Remove servlet dependencies

Change-Id: I12bbd0754755982c95b522a9ade19e9f9690d95a
Reviewed-on: https://asterix-gerrit.ics.uci.edu/1484
Reviewed-by: abdullah alamoudi 
Sonar-Qube: Jenkins 
Tested-by: Jenkins 
BAD: Jenkins 
Integration-Tests: Jenkins 


> Remove servlet dependencies in AsterixDB
> 
>
> Key: ASTERIXDB-1785
> URL: https://issues.apache.org/jira/browse/ASTERIXDB-1785
> Project: Apache AsterixDB
>  Issue Type: Task
>  Components: AsterixDB
>Reporter: Till
>Assignee: Till
>
> Remove the remaining dependencies on the Servlet API or Jetty from 
> asterixdb/...



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

[jira] [Commented] (ASTERIXDB-1323) LICENSE fixes from release-0.8.8

[ASF subversion and git services (JIRA)]

[ 
https://issues.apache.org/jira/browse/ASTERIXDB-1323?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15836680#comment-15836680
 ] 

ASF subversion and git services commented on ASTERIXDB-1323:


Commit 622496642caca7a61b2d411cb1608b93c9fa4d03 in asterixdb's branch 
refs/heads/master from [~mblow]
[ https://git-wip-us.apache.org/repos/asf?p=asterixdb.git;h=6224966 ]

ASTERIXDB-1320, ASTERIXDB-1323: License Fixes

ASTERIXDB-1320:
- LICENSE lists a large number of CDDL licensed bits of software
  CDDL is Category B we should provide a link to the source code (see 3.1.
  Availability of Source Code in (1)). Previous advice on legal-discuss
  was this goes in NOTICE but recent discussions have left this a bit more 
muddled.

ASTERIXDB-1323:
- Missing normalize.css (MIT) 
./asterix-examples/src/main/resources/admaql101-demo
  /static/css/bootstrap.min.css
- Missing license for second bottle file (MIT) ./asterix-examples/src/main/
  resources/tweetbook-demo/bottle.py
- Bootstrap version bundled is Apache licensed not MIT licensed 
./asterix-app/src/
  main/resources/webui/static/js/bootstrap.min.js
- It’s also not mentioned for all licenses what each license is (MIT/BSD etc) 
that
  can be helpful. The version of the bundled software is also helpful.
- Should include text of RainbowVis-JS license (or better still a pointer to a 
copy
  of the license file) [5] not a pointer to a URL on github

Also, misc cleanup.

Change-Id: Ie9fe9c18f63624896ccda420e1bf83ae0127021e
Reviewed-on: https://asterix-gerrit.ics.uci.edu/1463
Sonar-Qube: Jenkins 
Tested-by: Jenkins 
BAD: Jenkins 
Reviewed-by: Ian Maxon 


> LICENSE fixes from release-0.8.8
> 
>
> Key: ASTERIXDB-1323
> URL: https://issues.apache.org/jira/browse/ASTERIXDB-1323
> Project: Apache AsterixDB
>  Issue Type: Task
>  Components: Licensing
>Reporter: Ian Maxon
>Assignee: Michael Blow
>Priority: Blocker
>  Labels: soon
>
> To paraphrase from our release review comments
> For the LICENSE:
> - Missing normalize.css (MIT) 
> ./asterix-examples/src/main/resources/admaql101-demo/static/css/bootstrap.min.css
> - Missing license for second bottle file (MIT)  
> ./asterix-examples/src/main/resources/tweetbook-demo/bottle.py
> - Bootstrap version bundled is Apache licensed not MIT licensed 
> ./asterix-app/src/main/resources/webui/static/js/bootstrap.min.js
> - Short form of licenses in LICENSE is preferred i.e. pointers to the license 
> files  http://www.apache.org/dev/licensing-howto.html#permissive-deps
> - It’s also not mentioned for all licenses what each license is (MIT/BSD etc) 
> that can be helpful. The version of the bundled software is also helpful.
> - Should include text of RainbowVis-JS license (or better still a pointer to 
> a copy of the license file) [5] not a pointer to a URL on github



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (ASTERIXDB-1323) LICENSE fixes from release-0.8.8

[ASF subversion and git services (JIRA)]

[ 
https://issues.apache.org/jira/browse/ASTERIXDB-1323?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15836682#comment-15836682
 ] 

ASF subversion and git services commented on ASTERIXDB-1323:


Commit 622496642caca7a61b2d411cb1608b93c9fa4d03 in asterixdb's branch 
refs/heads/master from [~mblow]
[ https://git-wip-us.apache.org/repos/asf?p=asterixdb.git;h=6224966 ]

ASTERIXDB-1320, ASTERIXDB-1323: License Fixes

ASTERIXDB-1320:
- LICENSE lists a large number of CDDL licensed bits of software
  CDDL is Category B we should provide a link to the source code (see 3.1.
  Availability of Source Code in (1)). Previous advice on legal-discuss
  was this goes in NOTICE but recent discussions have left this a bit more 
muddled.

ASTERIXDB-1323:
- Missing normalize.css (MIT) 
./asterix-examples/src/main/resources/admaql101-demo
  /static/css/bootstrap.min.css
- Missing license for second bottle file (MIT) ./asterix-examples/src/main/
  resources/tweetbook-demo/bottle.py
- Bootstrap version bundled is Apache licensed not MIT licensed 
./asterix-app/src/
  main/resources/webui/static/js/bootstrap.min.js
- It’s also not mentioned for all licenses what each license is (MIT/BSD etc) 
that
  can be helpful. The version of the bundled software is also helpful.
- Should include text of RainbowVis-JS license (or better still a pointer to a 
copy
  of the license file) [5] not a pointer to a URL on github

Also, misc cleanup.

Change-Id: Ie9fe9c18f63624896ccda420e1bf83ae0127021e
Reviewed-on: https://asterix-gerrit.ics.uci.edu/1463
Sonar-Qube: Jenkins 
Tested-by: Jenkins 
BAD: Jenkins 
Reviewed-by: Ian Maxon 


> LICENSE fixes from release-0.8.8
> 
>
> Key: ASTERIXDB-1323
> URL: https://issues.apache.org/jira/browse/ASTERIXDB-1323
> Project: Apache AsterixDB
>  Issue Type: Task
>  Components: Licensing
>Reporter: Ian Maxon
>Assignee: Michael Blow
>Priority: Blocker
>  Labels: soon
>
> To paraphrase from our release review comments
> For the LICENSE:
> - Missing normalize.css (MIT) 
> ./asterix-examples/src/main/resources/admaql101-demo/static/css/bootstrap.min.css
> - Missing license for second bottle file (MIT)  
> ./asterix-examples/src/main/resources/tweetbook-demo/bottle.py
> - Bootstrap version bundled is Apache licensed not MIT licensed 
> ./asterix-app/src/main/resources/webui/static/js/bootstrap.min.js
> - Short form of licenses in LICENSE is preferred i.e. pointers to the license 
> files  http://www.apache.org/dev/licensing-howto.html#permissive-deps
> - It’s also not mentioned for all licenses what each license is (MIT/BSD etc) 
> that can be helpful. The version of the bundled software is also helpful.
> - Should include text of RainbowVis-JS license (or better still a pointer to 
> a copy of the license file) [5] not a pointer to a URL on github



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (ASTERIXDB-1320) Improvements to LICENSE/NOTICE in binary artifacts

[ASF subversion and git services (JIRA)]

[ 
https://issues.apache.org/jira/browse/ASTERIXDB-1320?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15836679#comment-15836679
 ] 

ASF subversion and git services commented on ASTERIXDB-1320:


Commit 622496642caca7a61b2d411cb1608b93c9fa4d03 in asterixdb's branch 
refs/heads/master from [~mblow]
[ https://git-wip-us.apache.org/repos/asf?p=asterixdb.git;h=6224966 ]

ASTERIXDB-1320, ASTERIXDB-1323: License Fixes

ASTERIXDB-1320:
- LICENSE lists a large number of CDDL licensed bits of software
  CDDL is Category B we should provide a link to the source code (see 3.1.
  Availability of Source Code in (1)). Previous advice on legal-discuss
  was this goes in NOTICE but recent discussions have left this a bit more 
muddled.

ASTERIXDB-1323:
- Missing normalize.css (MIT) 
./asterix-examples/src/main/resources/admaql101-demo
  /static/css/bootstrap.min.css
- Missing license for second bottle file (MIT) ./asterix-examples/src/main/
  resources/tweetbook-demo/bottle.py
- Bootstrap version bundled is Apache licensed not MIT licensed 
./asterix-app/src/
  main/resources/webui/static/js/bootstrap.min.js
- It’s also not mentioned for all licenses what each license is (MIT/BSD etc) 
that
  can be helpful. The version of the bundled software is also helpful.
- Should include text of RainbowVis-JS license (or better still a pointer to a 
copy
  of the license file) [5] not a pointer to a URL on github

Also, misc cleanup.

Change-Id: Ie9fe9c18f63624896ccda420e1bf83ae0127021e
Reviewed-on: https://asterix-gerrit.ics.uci.edu/1463
Sonar-Qube: Jenkins 
Tested-by: Jenkins 
BAD: Jenkins 
Reviewed-by: Ian Maxon 


> Improvements to LICENSE/NOTICE in binary artifacts
> --
>
> Key: ASTERIXDB-1320
> URL: https://issues.apache.org/jira/browse/ASTERIXDB-1320
> Project: Apache AsterixDB
>  Issue Type: Task
>  Components: AsterixDB, Hyracks, Licensing
>Reporter: Till
>Assignee: Michael Blow
>Priority: Blocker
>  Labels: soon
>
> for AsterixDB (0.8.8-incubating) and Hyracks (0.2.17-incubating) (RC1):
> * some of those jars contain bundled software which may need to be added to 
> LICENSE and NOTICE
> * LICENSE lists a large number of CDDL licensed bits of software. CDDL is 
> Category B we should provide a link to the source code (see 3.1. Availability 
> of Source Code in (1)). Previous advice on legal-discuss was this goes in 
> NOTICE but recent discussions have left this a bit more muddled.
> * There's no need to list in NOTICE the copyright years and name of an ASF 
> licensed product or the line " This product includes software developed by”.
> * The NOTICE files have a lot of not required information in them (2)
> (1) https://opensource.org/licenses/CDDL-1.0
> (2) http://www.apache.org/dev/licensing-howto.html#mod-notice



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (ASTERIXDB-1320) Improvements to LICENSE/NOTICE in binary artifacts

[ASF subversion and git services (JIRA)]

[ 
https://issues.apache.org/jira/browse/ASTERIXDB-1320?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15836681#comment-15836681
 ] 

ASF subversion and git services commented on ASTERIXDB-1320:


Commit 622496642caca7a61b2d411cb1608b93c9fa4d03 in asterixdb's branch 
refs/heads/master from [~mblow]
[ https://git-wip-us.apache.org/repos/asf?p=asterixdb.git;h=6224966 ]

ASTERIXDB-1320, ASTERIXDB-1323: License Fixes

ASTERIXDB-1320:
- LICENSE lists a large number of CDDL licensed bits of software
  CDDL is Category B we should provide a link to the source code (see 3.1.
  Availability of Source Code in (1)). Previous advice on legal-discuss
  was this goes in NOTICE but recent discussions have left this a bit more 
muddled.

ASTERIXDB-1323:
- Missing normalize.css (MIT) 
./asterix-examples/src/main/resources/admaql101-demo
  /static/css/bootstrap.min.css
- Missing license for second bottle file (MIT) ./asterix-examples/src/main/
  resources/tweetbook-demo/bottle.py
- Bootstrap version bundled is Apache licensed not MIT licensed 
./asterix-app/src/
  main/resources/webui/static/js/bootstrap.min.js
- It’s also not mentioned for all licenses what each license is (MIT/BSD etc) 
that
  can be helpful. The version of the bundled software is also helpful.
- Should include text of RainbowVis-JS license (or better still a pointer to a 
copy
  of the license file) [5] not a pointer to a URL on github

Also, misc cleanup.

Change-Id: Ie9fe9c18f63624896ccda420e1bf83ae0127021e
Reviewed-on: https://asterix-gerrit.ics.uci.edu/1463
Sonar-Qube: Jenkins 
Tested-by: Jenkins 
BAD: Jenkins 
Reviewed-by: Ian Maxon 


> Improvements to LICENSE/NOTICE in binary artifacts
> --
>
> Key: ASTERIXDB-1320
> URL: https://issues.apache.org/jira/browse/ASTERIXDB-1320
> Project: Apache AsterixDB
>  Issue Type: Task
>  Components: AsterixDB, Hyracks, Licensing
>Reporter: Till
>Assignee: Michael Blow
>Priority: Blocker
>  Labels: soon
>
> for AsterixDB (0.8.8-incubating) and Hyracks (0.2.17-incubating) (RC1):
> * some of those jars contain bundled software which may need to be added to 
> LICENSE and NOTICE
> * LICENSE lists a large number of CDDL licensed bits of software. CDDL is 
> Category B we should provide a link to the source code (see 3.1. Availability 
> of Source Code in (1)). Previous advice on legal-discuss was this goes in 
> NOTICE but recent discussions have left this a bit more muddled.
> * There's no need to list in NOTICE the copyright years and name of an ASF 
> licensed product or the line " This product includes software developed by”.
> * The NOTICE files have a lot of not required information in them (2)
> (1) https://opensource.org/licenses/CDDL-1.0
> (2) http://www.apache.org/dev/licensing-howto.html#mod-notice



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (ASTERIXDB-1760) Customize compiler parameters to each individual query

[ASF subversion and git services (JIRA)]

[ 
https://issues.apache.org/jira/browse/ASTERIXDB-1760?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15833210#comment-15833210
 ] 

ASF subversion and git services commented on ASTERIXDB-1760:


Commit 84b097702f6a1d8d8c68964670fbab2326646800 in asterixdb's branch 
refs/heads/master from [~buyingyi]
[ https://git-wip-us.apache.org/repos/asf?p=asterixdb.git;h=84b0977 ]

ASTERIXDB-1760: support per-query customizations for compilation parameters.

Change-Id: I6e18f3f7706e574553a02e15a39daddda3c413b2
Reviewed-on: https://asterix-gerrit.ics.uci.edu/1458
Sonar-Qube: Jenkins 
Tested-by: Jenkins 
BAD: Jenkins 
Integration-Tests: Jenkins 
Reviewed-by: Till Westmann 


> Customize compiler parameters to each individual query
> --
>
> Key: ASTERIXDB-1760
> URL: https://issues.apache.org/jira/browse/ASTERIXDB-1760
> Project: Apache AsterixDB
>  Issue Type: Improvement
>  Components: Compiler
>Reporter: Yingyi Bu
>Assignee: Yingyi Bu
>
> Allow each individual query to set its own compiler parameters, e.g., 
> compiler.groupmemory, compiler.joinmemory, compiler.parallelism etc.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (ASTERIXDB-1747) Improve Asterix Capabilities to pre-distribute jobs

[ASF subversion and git services (JIRA)]

[ 
https://issues.apache.org/jira/browse/ASTERIXDB-1747?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15870801#comment-15870801
 ] 

ASF subversion and git services commented on ASTERIXDB-1747:


Commit 34ee3335a0d1ebe62762c678cce1a07d8da4a3f6 in asterixdb's branch 
refs/heads/master from [~sjaco002]
[ https://git-wip-us.apache.org/repos/asf?p=asterixdb.git;h=34ee333 ]

ASTERIXDB-1747 Implemented full lifecycle capabilities for pre-distributed jobs

Added distribute and destroy functionality
Removed serialization and bytes when running pred-distributed jobs
Cleaned up methods
Enabled Mockito testing for CCS and NCS
Added Unit Test for Distributed Jobs

Change-Id: I59c3422d5c1ab7756a6a4685ac527dfe50434954
Reviewed-on: https://asterix-gerrit.ics.uci.edu/1377
Tested-by: Jenkins 
Integration-Tests: Jenkins 
Reviewed-by: Yingyi Bu 


> Improve Asterix Capabilities to pre-distribute jobs
> ---
>
> Key: ASTERIXDB-1747
> URL: https://issues.apache.org/jira/browse/ASTERIXDB-1747
> Project: Apache AsterixDB
>  Issue Type: Bug
>Reporter: Steven Jacobs
>Assignee: Steven Jacobs
>
> Currently, we are able to store the ActivityClusterGraph for a job at the NC 
> level. We need to add the following:
> Don't bother passing the bytes around when the graph is already at the NC.
> Don't serialize the bytes at the CC side when they aren't needed at the NC.
> Remove the ActivityClusterGraph from the NC when the job is no longer needed.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

[jira] [Commented] (ASTERIXDB-1791) HyracksDataException: Premature file in Join operator

[ASF subversion and git services (JIRA)]

[ 
https://issues.apache.org/jira/browse/ASTERIXDB-1791?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15882004#comment-15882004
 ] 

ASF subversion and git services commented on ASTERIXDB-1791:


Commit 34f2384ea66a4b62627cb5a3ff3544b6d4558469 in asterixdb's branch 
refs/heads/master from [~buyingyi]
[ https://git-wip-us.apache.org/repos/asf?p=asterixdb.git;h=34f2384 ]

ASTERIXDB-1791, ASTERIXDB-1796: fix failure handling in runtime operators.

This change includes the following parts:
- Fix the implementation of fail() and close() in several runtime operators
  to avoid file handle leak and job hang;
- Add an erase method to RunFileWriter which closes files before deleting
  them in order release the holding disk space;
- Call RunFileWriter.close() and RunFileReader.close() in "finally" blocks.
- Fix RunFileReader to not truncate files to be deleted - it is not the root
  cause of un-released disk space - open deleted files are the root cuase;
- Check file handle leaks in LangExecutionUtil.tearDown().

Change-Id: I203168171e6dac16b57d2eda960823e3810e22a3
Reviewed-on: https://asterix-gerrit.ics.uci.edu/1513
Tested-by: Jenkins 
Integration-Tests: Jenkins 
Reviewed-by: Till Westmann 


> HyracksDataException: Premature file in Join operator
> -
>
> Key: ASTERIXDB-1791
> URL: https://issues.apache.org/jira/browse/ASTERIXDB-1791
> Project: Apache AsterixDB
>  Issue Type: Bug
>Reporter: Yingyi Bu
>Assignee: Yingyi Bu
>
> Configuration:
> 2 NC
> 1 GB RAM each
> TPC-H dataset with SF=2
> Query (TPC-H Q18):
> {noformat}
> USE tpch;
> SET `compiler.joinmemory` "8MB"
> SET `compiler.groupmemory` "8MB"
> SET `compiler.sortmemory` "8MB"
> WITH tmp AS
> (
> SELECT l_orderkey, SUM(l_quantity) t_sum_quantity
> FROM  LineItem
> GROUP BY l_orderkey
> )
> SELECT c.c_name, c.c_custkey, o.o_orderkey, o.o_orderdate, o.o_totalprice,
>SUM(l.l_quantity) sum_quantity
> FROM  LineItem l
> JOIN  tmp t ON t.l_orderkey = l.l_orderkey
> JOIN  Orders o ON o.o_orderkey = t.l_orderkey
> JOIN  Customer c ON c.c_custkey = o.o_custkey
> WHERE t.t_sum_quantity > 30
> GROUP BY c.c_name, c.c_custkey, o.o_orderkey, o.o_orderdate, o.o_totalprice
> ORDER BY o.o_totalprice DESC, o.o_orderdate
> LIMIT 100
> ;
> {noformat}
> Error:
> {noformat}
> Premature end of file
> at 
> org.apache.hyracks.control.cc.job.JobRun.waitForCompletion(JobRun.java:223)
> at 
> org.apache.hyracks.control.cc.work.WaitForJobCompletionWork$1.run(WaitForJobCompletionWork.java:50)
> at 
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
> at 
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
> at java.lang.Thread.run(Thread.java:745)
> Caused by: org.apache.hyracks.api.exceptions.HyracksDataException: Premature 
> end of file
> at 
> org.apache.hyracks.api.exceptions.HyracksDataException.create(HyracksDataException.java:41)
> at 
> org.apache.hyracks.control.common.utils.ExceptionUtils.setNodeIds(ExceptionUtils.java:62)
> at org.apache.hyracks.control.nc.Task.run(Task.java:330)
> ... 3 more
> Caused by: org.apache.hyracks.api.exceptions.HyracksDataException: Premature 
> end of file
> at 
> org.apache.hyracks.dataflow.common.io.RunFileReader.nextFrame(RunFileReader.java:66)
> at 
> org.apache.hyracks.dataflow.std.join.OptimizedHybridHashJoinOperatorDescriptor$ProbeAndJoinActivityNode$1.applyInMemHashJoin(OptimizedHybridHashJoinOperatorDescriptor.java:672)
> at 
> org.apache.hyracks.dataflow.std.join.OptimizedHybridHashJoinOperatorDescriptor$ProbeAndJoinActivityNode$1.joinPartitionPair(OptimizedHybridHashJoinOperatorDescriptor.java:503)
> at 
> org.apache.hyracks.dataflow.std.join.OptimizedHybridHashJoinOperatorDescriptor$ProbeAndJoinActivityNode$1.close(OptimizedHybridHashJoinOperatorDescriptor.java:435)
> at 
> org.apache.hyracks.dataflow.std.join.OptimizedHybridHashJoinOperatorDescriptor$ProbeAndJoinActivityNode$1.close(OptimizedHybridHashJoinOperatorDescriptor.java:439)
> at org.apache.hyracks.control.nc.Task.pushFrames(Task.java:367)
> at org.apache.hyracks.control.nc.Task.run(Task.java:308)
> ... 3 more
> Feb 13, 2017 4:05:33 PM 
> org.apache.asterix.api.http.server.QueryServiceServlet handleRequest
> SEVERE: Job failed on account of:
> Premature end of file
> org.apache.hyracks.api.exceptions.HyracksException: Job failed on account of:
> Premature end of file
> {noformat}



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

[jira] [Commented] (ASTERIXDB-1796) Job hanging after "no space on device"

[ASF subversion and git services (JIRA)]

[ 
https://issues.apache.org/jira/browse/ASTERIXDB-1796?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15882005#comment-15882005
 ] 

ASF subversion and git services commented on ASTERIXDB-1796:


Commit 34f2384ea66a4b62627cb5a3ff3544b6d4558469 in asterixdb's branch 
refs/heads/master from [~buyingyi]
[ https://git-wip-us.apache.org/repos/asf?p=asterixdb.git;h=34f2384 ]

ASTERIXDB-1791, ASTERIXDB-1796: fix failure handling in runtime operators.

This change includes the following parts:
- Fix the implementation of fail() and close() in several runtime operators
  to avoid file handle leak and job hang;
- Add an erase method to RunFileWriter which closes files before deleting
  them in order release the holding disk space;
- Call RunFileWriter.close() and RunFileReader.close() in "finally" blocks.
- Fix RunFileReader to not truncate files to be deleted - it is not the root
  cause of un-released disk space - open deleted files are the root cuase;
- Check file handle leaks in LangExecutionUtil.tearDown().

Change-Id: I203168171e6dac16b57d2eda960823e3810e22a3
Reviewed-on: https://asterix-gerrit.ics.uci.edu/1513
Tested-by: Jenkins 
Integration-Tests: Jenkins 
Reviewed-by: Till Westmann 


> Job hanging after "no space on device"
> --
>
> Key: ASTERIXDB-1796
> URL: https://issues.apache.org/jira/browse/ASTERIXDB-1796
> Project: Apache AsterixDB
>  Issue Type: Bug
>  Components: Hyracks Core
>Reporter: Yingyi Bu
>Assignee: Yingyi Bu
>
> Setting:
> 2 NCs
> 1GB RAM per NC
> one partition per NC
> TPC-H data: 2GB
> Query:
> {noformat}
> USE tpch;
> SET `compiler.joinmemory` "8MB"
> SET `compiler.groupmemory` "8MB"
> SET `compiler.sortmemory` "8MB"
> WITH tmp AS
> (
> SELECT l_orderkey, SUM(l_quantity) t_sum_quantity
> FROM  LineItem
> GROUP BY l_orderkey
> )
> SELECT c.c_name, c.c_custkey, o.o_orderkey, o.o_orderdate, o.o_totalprice,
>SUM(l.l_quantity) sum_quantity
> FROM  LineItem l
> JOIN  tmp t ON t.l_orderkey = l.l_orderkey
> JOIN  Orders o ON o.o_orderkey = t.l_orderkey
> JOIN  Customer c ON c.c_custkey = o.o_custkey
> WHERE t.t_sum_quantity > 30
> GROUP BY c.c_name, c.c_custkey, o.o_orderkey, o.o_orderdate, o.o_totalprice
> ORDER BY o.o_totalprice DESC, o.o_orderdate
> LIMIT 100
> ;
> {noformat}
> {noformat}
> org.apache.hyracks.api.exceptions.HyracksDataException: No space left on 
> device
> at org.apache.hyracks.control.nc.Task.pushFrames(Task.java:376)
> at org.apache.hyracks.control.nc.Task.run(Task.java:308)
> at 
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
> at 
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
> at java.lang.Thread.run(Thread.java:745)
> Caused by: org.apache.hyracks.api.exceptions.HyracksDataException: No space 
> left on device
> at org.apache.hyracks.control.nc.io.IOManager.syncWrite(IOManager.java:143)
> at 
> org.apache.hyracks.dataflow.common.io.RunFileWriter.nextFrame(RunFileWriter.java:60)
> at 
> org.apache.hyracks.dataflow.std.buffermanager.VPartitionTupleBufferManager.flushPartition(VPartitionTupleBufferManager.java:285)
> at 
> org.apache.hyracks.dataflow.std.join.OptimizedHybridHashJoin.probe(OptimizedHybridHashJoin.java:514)
> at 
> org.apache.hyracks.dataflow.std.join.OptimizedHybridHashJoinOperatorDescriptor$ProbeAndJoinActivityNode$1.nextFrame(OptimizedHybridHashJoinOperatorDescriptor.java:405)
> at org.apache.hyracks.control.nc.Task.pushFrames(Task.java:360)
> ... 4 more
> Caused by: java.io.IOException: No space left on device
> at sun.nio.ch.FileDispatcherImpl.pwrite0(Native Method)
> at sun.nio.ch.FileDispatcherImpl.pwrite(FileDispatcherImpl.java:66)
> at sun.nio.ch.IOUtil.writeFromNativeBuffer(IOUtil.java:89)
> at sun.nio.ch.IOUtil.write(IOUtil.java:65)
> at sun.nio.ch.FileChannelImpl.writeInternal(FileChannelImpl.java:778)
> at sun.nio.ch.FileChannelImpl.write(FileChannelImpl.java:764)
> at org.apache.hyracks.control.nc.io.IOManager.syncWrite(IOManager.java:130)
> ... 9 more
> {noformat}



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

[jira] [Commented] (ASTERIXDB-1711) Clean up class names

[ASF subversion and git services (JIRA)]

[ 
https://issues.apache.org/jira/browse/ASTERIXDB-1711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15881654#comment-15881654
 ] 

ASF subversion and git services commented on ASTERIXDB-1711:


Commit 452ec9f6fa25e266713d9eaebb5909edef5c1149 in asterixdb's branch 
refs/heads/master from [~tillw]
[ https://git-wip-us.apache.org/repos/asf?p=asterixdb.git;h=452ec9f ]

ASTERIXDB-1711: Move test infra from test.aql

Change-Id: I5d631a2028fb80c823fbaafb7269f15d07685dc9
Reviewed-on: https://asterix-gerrit.ics.uci.edu/1512
Tested-by: Jenkins 
Integration-Tests: Jenkins 
Reviewed-by: abdullah alamoudi 


> Clean up class names
> 
>
> Key: ASTERIXDB-1711
> URL: https://issues.apache.org/jira/browse/ASTERIXDB-1711
> Project: Apache AsterixDB
>  Issue Type: Task
>  Components: AsterixDB, Hyracks
>Reporter: Till
>Assignee: Till
>
> Some classes have names that include "AQL" (even though they are not language 
> specific) or "Asterix" (even tough that's part of package names).
> We should aim to name classes based on their functionality and clean up class 
> names that are not named that way.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

[jira] [Commented] (ASTERIXDB-1786) Remove Servlet dependency for Hyracks admin console.

[ASF subversion and git services (JIRA)]

[ 
https://issues.apache.org/jira/browse/ASTERIXDB-1786?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15883942#comment-15883942
 ] 

ASF subversion and git services commented on ASTERIXDB-1786:


Commit 68e290a43022cc469a915063f74cbb60f8b7d00d in asterixdb's branch 
refs/heads/master from [~tillw]
[ https://git-wip-us.apache.org/repos/asf?p=asterixdb.git;h=68e290a ]

ASTERIXDB-1786: Remove servlet/jetty dependency

Change-Id: Id72b394fa967dd130c0df7e813812e3c6b985c84
Reviewed-on: https://asterix-gerrit.ics.uci.edu/1527
Sonar-Qube: Jenkins 
Tested-by: Jenkins 
Integration-Tests: Jenkins 
Reviewed-by: Michael Blow 


> Remove Servlet dependency for Hyracks admin console.
> 
>
> Key: ASTERIXDB-1786
> URL: https://issues.apache.org/jira/browse/ASTERIXDB-1786
> Project: Apache AsterixDB
>  Issue Type: Task
>  Components: Hyracks
>Reporter: Till
>Assignee: Till
>




--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

[jira] [Commented] (ASTERIXDB-1786) Remove Servlet dependency for Hyracks admin console.

[ASF subversion and git services (JIRA)]

[ 
https://issues.apache.org/jira/browse/ASTERIXDB-1786?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15880484#comment-15880484
 ] 

ASF subversion and git services commented on ASTERIXDB-1786:


Commit ea666c9c4f273bbb0cc6f9529f8cc336f0675aef in asterixdb's branch 
refs/heads/master from [~tillw]
[ https://git-wip-us.apache.org/repos/asf?p=asterixdb.git;h=ea666c9 ]

ASTERIXDB-1786: Remove Hyracks Servlets.

Change-Id: Ifcd240591d12baab2db4ce3163c635a1dde5c4ba
Reviewed-on: https://asterix-gerrit.ics.uci.edu/1508
Reviewed-by: abdullah alamoudi 
Tested-by: Jenkins 
Integration-Tests: Jenkins 


> Remove Servlet dependency for Hyracks admin console.
> 
>
> Key: ASTERIXDB-1786
> URL: https://issues.apache.org/jira/browse/ASTERIXDB-1786
> Project: Apache AsterixDB
>  Issue Type: Task
>  Components: Hyracks
>Reporter: Till
>Assignee: Till
>




--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

[jira] [Commented] (ASTERIXDB-1804) HTTP framework does not handle all HTTP verbs

[ASF subversion and git services (JIRA)]

[ 
https://issues.apache.org/jira/browse/ASTERIXDB-1804?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15876783#comment-15876783
 ] 

ASF subversion and git services commented on ASTERIXDB-1804:


Commit 6fc1f7b31ee6d2c86c5478e6a0d0cf4d2b711bf0 in asterixdb's branch 
refs/heads/master from [~alamoudi]
[ https://git-wip-us.apache.org/repos/asf?p=asterixdb.git;h=6fc1f7b ]

ASTERIXDB-1804: support more HTTP verbs

- add verb-based routing to AbstractServlet.handle (subclasses implement
  verb-specific methods like get, post, ...)
- move construction logic for IServletRequests from HttpUtil to request
  classes
- remove verb-checking from HttpServerHandler

Change-Id: I2d14ce9c3c34d345fe71a44518b1e95b79c37dab
Reviewed-on: https://asterix-gerrit.ics.uci.edu/1516
Reviewed-by: abdullah alamoudi 
Tested-by: Jenkins 


> HTTP framework does not handle all HTTP verbs
> -
>
> Key: ASTERIXDB-1804
> URL: https://issues.apache.org/jira/browse/ASTERIXDB-1804
> Project: Apache AsterixDB
>  Issue Type: Bug
>  Components: HTTP API, Hyracks
>Reporter: Till
>Assignee: Till
>
> The HTTP framework in org.apache.hyracks.http currently only supports GET and 
> POST requests. It needs to be extended to support all HTTP verbs.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

[jira] [Commented] (ASTERIXDB-1711) Clean up class names

[ASF subversion and git services (JIRA)]

[ 
https://issues.apache.org/jira/browse/ASTERIXDB-1711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15828548#comment-15828548
 ] 

ASF subversion and git services commented on ASTERIXDB-1711:


Commit 7ff91d02c6a535682fe05891c09f2e84efbce8d4 in asterixdb's branch 
refs/heads/master from [~tillw]
[ https://git-wip-us.apache.org/repos/asf?p=asterixdb.git;h=7ff91d0 ]

ASTERIXDB-1711: remove "Aql"

- AQLAPIServlet -> FullAPIServlet
- AqlPrimitiveValueProviderFactory -> PrimitiveValueProviderFactory
- remove AqlLogicalPlanAndMetadataImpl
- remore AqlMetadataImplConfig

Change-Id: I8e371941ba509d10193649aaed48a74a08d2d1f5
Reviewed-on: https://asterix-gerrit.ics.uci.edu/1447
Tested-by: Jenkins 
BAD: Jenkins 
Integration-Tests: Jenkins 
Reviewed-by: abdullah alamoudi 


> Clean up class names
> 
>
> Key: ASTERIXDB-1711
> URL: https://issues.apache.org/jira/browse/ASTERIXDB-1711
> Project: Apache AsterixDB
>  Issue Type: Task
>  Components: AsterixDB, Hyracks
>Reporter: Till
>Assignee: Till
>
> Some classes have names that include "AQL" (even though they are not language 
> specific) or "Asterix" (even tough that's part of package names).
> We should aim to name classes based on their functionality and clean up class 
> names that are not named that way.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (ASTERIXDB-1587) upsert runtime assumes that the datatype comes from the same dataverse as the dataset

[ASF subversion and git services (JIRA)]

[ 
https://issues.apache.org/jira/browse/ASTERIXDB-1587?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15427482#comment-15427482
 ] 

ASF subversion and git services commented on ASTERIXDB-1587:


Commit 15217bb8c03631b506a8f4b33f1061bc5de2cbd5 in asterixdb's branch 
refs/heads/master from [~sjaco002]
[ https://git-wip-us.apache.org/repos/asf?p=asterixdb.git;h=15217bb ]

ASTERIXDB-1587 Test upsert when using foreign datatype

Change-Id: I4c374a44389af5916c8398afb3be8628b7872389
Reviewed-on: https://asterix-gerrit.ics.uci.edu/1091
Sonar-Qube: Jenkins 
Tested-by: Jenkins 
Reviewed-by: Till Westmann 


> upsert runtime assumes that the datatype comes from the same dataverse as the 
> dataset
> -
>
> Key: ASTERIXDB-1587
> URL: https://issues.apache.org/jira/browse/ASTERIXDB-1587
> Project: Apache AsterixDB
>  Issue Type: Bug
>Reporter: Steven Jacobs
>Assignee: Steven Jacobs
>
> It throws an error if they aren't from the same dataverse. It should work 
> instead.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (ASTERIXDB-1571) Subquery in from clause throws NullPointerException

[ASF subversion and git services (JIRA)]

[ 
https://issues.apache.org/jira/browse/ASTERIXDB-1571?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15422026#comment-15422026
 ] 

ASF subversion and git services commented on ASTERIXDB-1571:


Commit 33dfae50935b82ac31a1cb0a4d53d5c427abbc18 in asterixdb's branch 
refs/heads/master from [~buyingyi]
[ https://git-wip-us.apache.org/repos/asf?p=asterixdb.git;h=33dfae5 ]

ASTERIXDB-1571: fix and add regression tests.

- also fix the left outer type propagation policy.

Change-Id: I45d6dbabdef709c9ba3cb883412301ab7fd69a85
Reviewed-on: https://asterix-gerrit.ics.uci.edu/1075
Sonar-Qube: Jenkins 
Tested-by: Jenkins 
Reviewed-by: Till Westmann 


> Subquery in from clause throws NullPointerException
> ---
>
> Key: ASTERIXDB-1571
> URL: https://issues.apache.org/jira/browse/ASTERIXDB-1571
> Project: Apache AsterixDB
>  Issue Type: Bug
> Environment: Master branch with latest commit id: 
> bd3a535b171a5cc7486175
>Reporter: Vignesh Raghunathan
>Assignee: Yingyi Bu
>
> To reproduce the issue, run the following sqlpp statements
> {code}
> drop dataverse sampdb if exists;
> create dataverse sampdb;
> use sampdb;
> drop dataset samptable if exists;
> drop type samptabletype if exists;
> create type samptabletype as closed {
>   id: int8
> };
> create dataset samptable(samptabletype) primary key id;
> insert into samptable ({'id' : 0});
> insert into samptable ({'id' : 1});
> select *
> from
> (
> select * from samptable
> );
> {code}
> Result:
> {code}
> Aug 12, 2016 1:57:08 PM org.apache.asterix.api.http.servlet.APIServlet doPost
> SEVERE: null
> java.lang.NullPointerException
>   at 
> org.apache.asterix.lang.sqlpp.visitor.SqlppFormatPrintVisitor.visit(SqlppFormatPrintVisitor.java:130)
>   at 
> org.apache.asterix.lang.sqlpp.visitor.SqlppFormatPrintVisitor.visit(SqlppFormatPrintVisitor.java:1)
>   at 
> org.apache.asterix.lang.sqlpp.clause.Projection.accept(Projection.java:45)
>   at 
> org.apache.asterix.lang.sqlpp.visitor.SqlppFormatPrintVisitor.visit(SqlppFormatPrintVisitor.java:193)
>   at 
> org.apache.asterix.lang.sqlpp.visitor.SqlppFormatPrintVisitor.visit(SqlppFormatPrintVisitor.java:1)
>   at 
> org.apache.asterix.lang.sqlpp.clause.SelectRegular.accept(SelectRegular.java:40)
>   at 
> org.apache.asterix.lang.sqlpp.visitor.SqlppFormatPrintVisitor.visit(SqlppFormatPrintVisitor.java:169)
>   at 
> org.apache.asterix.lang.sqlpp.visitor.SqlppFormatPrintVisitor.visit(SqlppFormatPrintVisitor.java:1)
>   at 
> org.apache.asterix.lang.sqlpp.clause.SelectClause.accept(SelectClause.java:42)
>   at 
> org.apache.asterix.lang.sqlpp.visitor.SqlppFormatPrintVisitor.visit(SqlppFormatPrintVisitor.java:140)
>   at 
> org.apache.asterix.lang.sqlpp.visitor.SqlppFormatPrintVisitor.visit(SqlppFormatPrintVisitor.java:1)
>   at 
> org.apache.asterix.lang.sqlpp.struct.SetOperationInput.accept(SetOperationInput.java:56)
>   at 
> org.apache.asterix.lang.sqlpp.visitor.SqlppFormatPrintVisitor.visit(SqlppFormatPrintVisitor.java:201)
>   at 
> org.apache.asterix.lang.sqlpp.visitor.SqlppFormatPrintVisitor.visit(SqlppFormatPrintVisitor.java:1)
>   at 
> org.apache.asterix.lang.sqlpp.clause.SelectSetOperation.accept(SelectSetOperation.java:47)
>   at 
> org.apache.asterix.lang.sqlpp.visitor.SqlppFormatPrintVisitor.visit(SqlppFormatPrintVisitor.java:223)
>   at 
> org.apache.asterix.lang.sqlpp.visitor.SqlppFormatPrintVisitor.visit(SqlppFormatPrintVisitor.java:1)
>   at 
> org.apache.asterix.lang.sqlpp.expression.SelectExpression.accept(SelectExpression.java:55)
>   at 
> org.apache.asterix.lang.sqlpp.util.SqlppFormatPrintUtil.toString(SqlppFormatPrintUtil.java:90)
>   at 
> org.apache.asterix.lang.sqlpp.util.SqlppFormatPrintUtil.toString(SqlppFormatPrintUtil.java:76)
>   at 
> org.apache.asterix.lang.sqlpp.util.ExpressionToVariableUtil.getGeneratedIdentifier(ExpressionToVariableUtil.java:48)
>   at 
> org.apache.asterix.lang.sqlpp.util.ExpressionToVariableUtil.getGeneratedVariable(ExpressionToVariableUtil.java:91)
>   at 
> org.apache.asterix.lang.sqlpp.parser.SQLPPParser.FromTerm(SQLPPParser.java:3767)
>   at 
> org.apache.asterix.lang.sqlpp.parser.SQLPPParser.FromClause(SQLPPParser.java:3674)
>   at 
> org.apache.asterix.lang.sqlpp.parser.SQLPPParser.SelectBlock(SQLPPParser.java:3342)
>   at 
> org.apache.asterix.lang.sqlpp.parser.SQLPPParser.SelectSetOperation(SQLPPParser.java:3255)
>   at 
> org.apache.asterix.lang.sqlpp.parser.SQLPPParser.SelectExpression(SQLPPParser.java:3226)
>   at 
> org.apache.asterix.lang.sqlpp.parser.SQLPPParser.Query(SQLPPParser.java:2176)
>   at 
> 

[jira] [Commented] (ASTERIXDB-1478) using localfs goes wrong

[ASF subversion and git services (JIRA)]

[ 
https://issues.apache.org/jira/browse/ASTERIXDB-1478?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15426865#comment-15426865
 ] 

ASF subversion and git services commented on ASTERIXDB-1478:


Commit c1ff430d6dc7338e3a7c6d5076e453156ccddc3a in asterixdb's branch 
refs/heads/master from Michael
[ https://git-wip-us.apache.org/repos/asf?p=asterixdb.git;h=c1ff430 ]

ASTERIXDB-1478: fix the utf8 reader.

 1. Fix the ASTERIXDB-1478.
 2. Add the utf8 testCases.

Change-Id: Idb302dc604fcd71811de550d3d4bd727c81a13ee
Reviewed-on: https://asterix-gerrit.ics.uci.edu/1077
Sonar-Qube: Jenkins 
Tested-by: Jenkins 
Reviewed-by: Yingyi Bu 


> using localfs goes wrong
> 
>
> Key: ASTERIXDB-1478
> URL: https://issues.apache.org/jira/browse/ASTERIXDB-1478
> Project: Apache AsterixDB
>  Issue Type: Bug
>  Components: Error Reporting
> Environment: AsterixDB 0.8.9(pulled from github today)
> Ubuntu 14.0
> Java -version 1.8.0_79
> Computer has 1 ssd and 1 hhd
>Reporter: yipzifai
>Assignee: Wenhai
>  Labels: features
> Attachments: cc.log, cpu.jpg, execute.log, my_asterix_nc1.log, 
> my_asterix_nc2.log
>
>
> I load data file using localfs but AsterixDB keeps running for a long long 
> time.(ps:CPU utilization ~= 100%) I have been waiting over 8 hours 
> yesterday.Then i found that the storage folder in workingdir didn't add any 
> files.
> Exectly, I try to use feeding or AQL "Insert", but it still goes wrong.
> AQL:
> use dataverse test;
> drop dataset relationship_B if exists;
> drop type relationshipB if exists;
> create type relationshipB as closed{
> pkId:int64,
> who_id:int64,
> who_name:string,
> id:int64,
> name:string,
> code:string,
> shortname:string,
> brief:string,
> validateDate:date?,
> gfType:string,
> shijizengjianchi:string,
> chiyoushuliang:double,
> chigubianhua:string,
> zhanbi:double,
> konggugongsiID:int64?,
> konggugongsiName:string?,
> rType:string,
> source:string,
> method:string
> };
> create dataset relationship_B(relationshipB) primary key pkId;
> use dataverse test;
> load dataset relationship_B
> using localfs
> (("path"="127.0.0.1:///home/to/adbSrc/ddl/relationshipB.adm"),("format"="adm"));
> About data files:
> one file is big object insertion(each record has over 30,000 characters); 
> each record of another file has 100~200 characters.
> {code}
> local.xml
> 
> 
> /usr/local/jdk1.8.0_91/jre
> 
> /home/to/adbSrc/asterix-mgmt/clusters/local/working_dir/logs
> 
> /home/to/adbSrc/asterix-mgmt/clusters/local/working_dir/txnLogs
> storage
> 
> /home/to/adbSrc/asterix-mgmt/clusters/local/working_dir
> true
> 
>   
> /home/to/adbSrc/asterix-mgmt/clusters/local/working_dir/nc/p1,/home/to/adbSrc/asterix-mgmt/clusters/local/working_dir/nc/p2
> 
> master
> 127.0.0.1
> 127.0.0.1
> 1098
> 1099
> 
> 8900
> 
> 
> nc1
> 127.0.0.1
> 
> /home/to/adbSrc/asterix-mgmt/clusters/local/working_dir/nc1/txnLogs
>  
> 8901
> 
> 
> nc2
> 127.0.0.1
> 
> /home/to/adbSrc/asterix-mgmt/clusters/local/working_dir/nc2/txnLogs
>   
> 8902
> 
> 1
> 5
> 0
> 5
> 10
> 8640
> 6
> 
> {code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (ASTERIXDB-1478) using localfs goes wrong

[ASF subversion and git services (JIRA)]

[ 
https://issues.apache.org/jira/browse/ASTERIXDB-1478?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15426864#comment-15426864
 ] 

ASF subversion and git services commented on ASTERIXDB-1478:


Commit c1ff430d6dc7338e3a7c6d5076e453156ccddc3a in asterixdb's branch 
refs/heads/master from Michael
[ https://git-wip-us.apache.org/repos/asf?p=asterixdb.git;h=c1ff430 ]

ASTERIXDB-1478: fix the utf8 reader.

 1. Fix the ASTERIXDB-1478.
 2. Add the utf8 testCases.

Change-Id: Idb302dc604fcd71811de550d3d4bd727c81a13ee
Reviewed-on: https://asterix-gerrit.ics.uci.edu/1077
Sonar-Qube: Jenkins 
Tested-by: Jenkins 
Reviewed-by: Yingyi Bu 


> using localfs goes wrong
> 
>
> Key: ASTERIXDB-1478
> URL: https://issues.apache.org/jira/browse/ASTERIXDB-1478
> Project: Apache AsterixDB
>  Issue Type: Bug
>  Components: Error Reporting
> Environment: AsterixDB 0.8.9(pulled from github today)
> Ubuntu 14.0
> Java -version 1.8.0_79
> Computer has 1 ssd and 1 hhd
>Reporter: yipzifai
>Assignee: Wenhai
>  Labels: features
> Attachments: cc.log, cpu.jpg, execute.log, my_asterix_nc1.log, 
> my_asterix_nc2.log
>
>
> I load data file using localfs but AsterixDB keeps running for a long long 
> time.(ps:CPU utilization ~= 100%) I have been waiting over 8 hours 
> yesterday.Then i found that the storage folder in workingdir didn't add any 
> files.
> Exectly, I try to use feeding or AQL "Insert", but it still goes wrong.
> AQL:
> use dataverse test;
> drop dataset relationship_B if exists;
> drop type relationshipB if exists;
> create type relationshipB as closed{
> pkId:int64,
> who_id:int64,
> who_name:string,
> id:int64,
> name:string,
> code:string,
> shortname:string,
> brief:string,
> validateDate:date?,
> gfType:string,
> shijizengjianchi:string,
> chiyoushuliang:double,
> chigubianhua:string,
> zhanbi:double,
> konggugongsiID:int64?,
> konggugongsiName:string?,
> rType:string,
> source:string,
> method:string
> };
> create dataset relationship_B(relationshipB) primary key pkId;
> use dataverse test;
> load dataset relationship_B
> using localfs
> (("path"="127.0.0.1:///home/to/adbSrc/ddl/relationshipB.adm"),("format"="adm"));
> About data files:
> one file is big object insertion(each record has over 30,000 characters); 
> each record of another file has 100~200 characters.
> {code}
> local.xml
> 
> 
> /usr/local/jdk1.8.0_91/jre
> 
> /home/to/adbSrc/asterix-mgmt/clusters/local/working_dir/logs
> 
> /home/to/adbSrc/asterix-mgmt/clusters/local/working_dir/txnLogs
> storage
> 
> /home/to/adbSrc/asterix-mgmt/clusters/local/working_dir
> true
> 
>   
> /home/to/adbSrc/asterix-mgmt/clusters/local/working_dir/nc/p1,/home/to/adbSrc/asterix-mgmt/clusters/local/working_dir/nc/p2
> 
> master
> 127.0.0.1
> 127.0.0.1
> 1098
> 1099
> 
> 8900
> 
> 
> nc1
> 127.0.0.1
> 
> /home/to/adbSrc/asterix-mgmt/clusters/local/working_dir/nc1/txnLogs
>  
> 8901
> 
> 
> nc2
> 127.0.0.1
> 
> /home/to/adbSrc/asterix-mgmt/clusters/local/working_dir/nc2/txnLogs
>   
> 8902
> 
> 1
> 5
> 0
> 5
> 10
> 8640
> 6
> 
> {code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (ASTERIXDB-1516) Unable to find free page in buffer cache after 3 cycle

[ASF subversion and git services (JIRA)]

[ 
https://issues.apache.org/jira/browse/ASTERIXDB-1516?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15408022#comment-15408022
 ] 

ASF subversion and git services commented on ASTERIXDB-1516:


Commit 9dfebec1af0e81e3de835c0f59c35b9b56c7e225 in asterixdb's branch 
refs/heads/master from [~mblow]
[ https://git-wip-us.apache.org/repos/asf?p=asterixdb.git;h=9dfebec ]

ASTERIXDB-1516: Unable to find free page in buffer cache after 3 cycles

Update exhaustion logic to be two-tiered:
- emit warning when cycle count exceeds warning threshold (3)
- fail if cycle count reaches the failure threshold (1000)

Change-Id: I46fa6bbda8c2f81e5e570dd6c07e4f4b794ef5bb
Reviewed-on: https://asterix-gerrit.ics.uci.edu/1038
Tested-by: Jenkins 
Integration-Tests: Jenkins 
Reviewed-by: Murtadha Hubail 


> Unable to find free page in buffer cache after 3 cycle
> --
>
> Key: ASTERIXDB-1516
> URL: https://issues.apache.org/jira/browse/ASTERIXDB-1516
> Project: Apache AsterixDB
>  Issue Type: Bug
>  Components: Storage
>Reporter: Yingyi Bu
>Assignee: Michael Blow
>Priority: Critical
>
> I run into this issue on jenkins:
> {noformat}
> Regression
> org.apache.asterix.test.runtime.ExecutionTest.test[ExecutionTest 1169: 
> big-object: big_object_feed_20M]
> Failing for the past 1 build (Since Unstable#1819 )
> Took 7.3 sec.
> Error Message
> Test 
> "src/test/resources/runtimets/queries/big-object/big_object_feed_20M/big_object_feed_20M.3.query.aql"
>  FAILED!
> Stacktrace
> java.lang.Exception: Test 
> "src/test/resources/runtimets/queries/big-object/big_object_feed_20M/big_object_feed_20M.3.query.aql"
>  FAILED!
>   at 
> org.apache.asterix.test.aql.TestExecutor.executeHttpMethod(TestExecutor.java:275)
>   at 
> org.apache.asterix.test.aql.TestExecutor.executeQuery(TestExecutor.java:305)
>   at 
> org.apache.asterix.test.aql.TestExecutor.executeTest(TestExecutor.java:515)
>   at 
> org.apache.asterix.test.aql.TestExecutor.executeTest(TestExecutor.java:762)
>   at 
> org.apache.asterix.test.runtime.ExecutionTest.test(ExecutionTest.java:106)
> Standard Error
> org.apache.hyracks.api.exceptions.HyracksDataException: Unable to find free 
> page in buffer cache after 3 cycles (buffer cache undersized?)
>   at 
> org.apache.hyracks.storage.common.buffercache.BufferCache.confiscatePage(BufferCache.java:1320)
>   at 
> org.apache.hyracks.storage.common.buffercache.BufferCache.confiscatePage(BufferCache.java:1187)
>   at 
> org.apache.hyracks.storage.am.bloomfilter.impls.BloomFilter$BloomFilterBuilder.allocateAndInitMetaDataPage(BloomFilter.java:253)
>   at 
> org.apache.hyracks.storage.am.bloomfilter.impls.BloomFilter$BloomFilterBuilder.end(BloomFilter.java:283)
>   at 
> org.apache.hyracks.storage.am.lsm.btree.impls.LSMBTree.flush(LSMBTree.java:481)
>   at 
> org.apache.hyracks.storage.am.lsm.common.impls.LSMHarness.flush(LSMHarness.java:430)
>   at 
> org.apache.hyracks.storage.am.lsm.common.impls.LSMTreeIndexAccessor.flush(LSMTreeIndexAccessor.java:105)
>   at 
> org.apache.hyracks.storage.am.lsm.btree.impls.LSMBTreeFlushOperation.call(LSMBTreeFlushOperation.java:71)
>   at 
> org.apache.hyracks.storage.am.lsm.btree.impls.LSMBTreeFlushOperation.call(LSMBTreeFlushOperation.java:34)
>   at java.util.concurrent.FutureTask.run(FutureTask.java:266)
>   at 
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
>   at 
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
>   at java.lang.Thread.run(Thread.java:745)
> org.apache.hyracks.api.exceptions.HyracksDataException: 
> java.util.concurrent.ExecutionException: 
> org.apache.hyracks.api.exceptions.HyracksDataException: 
> org.apache.hyracks.api.exceptions.HyracksDataException: Unable to find free 
> page in buffer cache after 3 cycles (buffer cache undersized?)
>   at 
> org.apache.hyracks.api.rewriter.runtime.SuperActivityOperatorNodePushable.runInParallel(SuperActivityOperatorNodePushable.java:218)
>   at 
> org.apache.hyracks.api.rewriter.runtime.SuperActivityOperatorNodePushable.initialize(SuperActivityOperatorNodePushable.java:83)
>   at org.apache.hyracks.control.nc.Task.run(Task.java:263)
>   at 
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
>   at 
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
>   at java.lang.Thread.run(Thread.java:745)
> Caused by: java.util.concurrent.ExecutionException: 
> org.apache.hyracks.api.exceptions.HyracksDataException: 
> org.apache.hyracks.api.exceptions.HyracksDataException: Unable to find free 
> page in 

[jira] [Commented] (ASTERIXDB-1592) Combining SQL-92 type join and left outer join throws NullPointerException

[ASF subversion and git services (JIRA)]

[ 
https://issues.apache.org/jira/browse/ASTERIXDB-1592?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15436862#comment-15436862
 ] 

ASF subversion and git services commented on ASTERIXDB-1592:


Commit 437d819cee08ed0a00672c1fff1f93afcdeb8ae1 in asterixdb's branch 
refs/heads/master from [~buyingyi]
[ https://git-wip-us.apache.org/repos/asf?p=asterixdb.git;h=437d819 ]

ASTERIXDB-1592: fix and regression tests.

Change-Id: Id59ae2fd79302211973cfb3b82829eb3836da4bc
Reviewed-on: https://asterix-gerrit.ics.uci.edu/1110
Sonar-Qube: Jenkins 
Tested-by: Jenkins 
Reviewed-by: Till Westmann 
Integration-Tests: Jenkins 


> Combining SQL-92 type join and left outer join throws NullPointerException
> --
>
> Key: ASTERIXDB-1592
> URL: https://issues.apache.org/jira/browse/ASTERIXDB-1592
> Project: Apache AsterixDB
>  Issue Type: Bug
> Environment: Master branch with latest commit 
> 0339b475f323e6e2777dbcb13ee2
>Reporter: Vignesh Raghunathan
>Assignee: Yingyi Bu
>
> To reproduce the issue, run the following sqlpp query after creating datasets 
> using tpcdsadb.txt:
> {code}
> use tpcds;
> select *
>  from
>catalog_sales cs1
>left outer join
>catalog_returns cr1
>on (cs1.cs_order_number = cr1.cr_order_number
> and cs1.cs_item_sk = cr1.cr_item_sk)
>   ,item i1
>  where
>   i1.i_item_sk = cs1.cs_item_sk;
> {code}
> Result:
> {code}
> java.lang.NullPointerException
>   at 
> org.apache.hyracks.algebricks.core.algebra.properties.LocalGroupingProperty.retainVariables(LocalGroupingProperty.java:88)
>   at 
> org.apache.hyracks.algebricks.core.algebra.operators.physical.AbstractPropagatePropertiesForUsedVariablesPOperator.computeDeliveredPropertiesForUsedVariables(AbstractPropagatePropertiesForUsedVariablesPOperator.java:42)
>   at 
> org.apache.hyracks.algebricks.core.algebra.operators.physical.StreamProjectPOperator.computeDeliveredProperties(StreamProjectPOperator.java:81)
>   at 
> org.apache.hyracks.algebricks.core.algebra.operators.logical.AbstractLogicalOperator.computeDeliveredPhysicalProperties(AbstractLogicalOperator.java:131)
>   at 
> org.apache.hyracks.algebricks.rewriter.rules.EnforceStructuralPropertiesRule.physOptimizeOp(EnforceStructuralPropertiesRule.java:214)
>   at 
> org.apache.hyracks.algebricks.rewriter.rules.EnforceStructuralPropertiesRule.physOptimizeOp(EnforceStructuralPropertiesRule.java:211)
>   at 
> org.apache.hyracks.algebricks.rewriter.rules.EnforceStructuralPropertiesRule.physOptimizeOp(EnforceStructuralPropertiesRule.java:211)
>   at 
> org.apache.hyracks.algebricks.rewriter.rules.EnforceStructuralPropertiesRule.physOptimizeOp(EnforceStructuralPropertiesRule.java:211)
>   at 
> org.apache.hyracks.algebricks.rewriter.rules.EnforceStructuralPropertiesRule.rewritePre(EnforceStructuralPropertiesRule.java:130)
>   at 
> org.apache.hyracks.algebricks.core.rewriter.base.AbstractRuleController.rewriteOperatorRef(AbstractRuleController.java:91)
>   at 
> org.apache.hyracks.algebricks.compiler.rewriter.rulecontrollers.SequentialOnceRuleController.rewriteWithRuleCollection(SequentialOnceRuleController.java:44)
>   at 
> org.apache.hyracks.algebricks.core.rewriter.base.HeuristicOptimizer.runOptimizationSets(HeuristicOptimizer.java:102)
>   at 
> org.apache.hyracks.algebricks.core.rewriter.base.HeuristicOptimizer.runPhysicalOptimizations(HeuristicOptimizer.java:133)
>   at 
> org.apache.hyracks.algebricks.core.rewriter.base.HeuristicOptimizer.optimize(HeuristicOptimizer.java:84)
>   at 
> org.apache.hyracks.algebricks.compiler.api.HeuristicCompilerFactoryBuilder$1$1.optimize(HeuristicCompilerFactoryBuilder.java:90)
>   at 
> org.apache.asterix.api.common.APIFramework.compileQuery(APIFramework.java:268)
>   at 
> org.apache.asterix.aql.translator.QueryTranslator.rewriteCompileQuery(QueryTranslator.java:1938)
>   at 
> org.apache.asterix.aql.translator.QueryTranslator.handleQuery(QueryTranslator.java:2533)
>   at 
> org.apache.asterix.aql.translator.QueryTranslator.compileAndExecute(QueryTranslator.java:365)
>   at 
> org.apache.asterix.aql.translator.QueryTranslator.compileAndExecute(QueryTranslator.java:258)
>   at 
> org.apache.asterix.api.http.servlet.APIServlet.doPost(APIServlet.java:130)
>   at javax.servlet.http.HttpServlet.service(HttpServlet.java:707)
>   at javax.servlet.http.HttpServlet.service(HttpServlet.java:790)
>   at 
> org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:845)
>   at 
> org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:583)
>   at 
> 

[jira] [Commented] (ASTERIXDB-1238) Refactor AqlMetadataProvider

[ASF subversion and git services (JIRA)]

[ 
https://issues.apache.org/jira/browse/ASTERIXDB-1238?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15458602#comment-15458602
 ] 

ASF subversion and git services commented on ASTERIXDB-1238:


Commit 55a558f21a5b7d864f46b4bd247f7719e7fe864b in asterixdb's branch 
refs/heads/master from [~mhubail]
[ https://git-wip-us.apache.org/repos/asf?p=asterixdb.git;h=55a558f ]

ASTERIXDB-1238: Refactor AqlMetadataProvider

Change-Id: If2720817c5659622e1f713653856825d612eb892
Reviewed-on: https://asterix-gerrit.ics.uci.edu/1016
Tested-by: Jenkins 
Integration-Tests: Jenkins 
Reviewed-by: abdullah alamoudi 


> Refactor AqlMetadataProvider
> 
>
> Key: ASTERIXDB-1238
> URL: https://issues.apache.org/jira/browse/ASTERIXDB-1238
> Project: Apache AsterixDB
>  Issue Type: Improvement
>  Components: AsterixDB, Metadata
>Reporter: Abdullah Alamoudi
>Assignee: Murtadha Hubail
>Priority: Minor
>
> The infamous AqlMetadataProvider is over stuffed with compiler related 
> functionalities. In particular, the task of transforming physical operator 
> into hyracks operator descriptors.
> It grew to more than 3000 lines of code and clearly needs to be refactored.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (ASTERIXDB-1581) Subquery inside case when clause - ConcurrentModificationException is thrown

[ASF subversion and git services (JIRA)]

[ 
https://issues.apache.org/jira/browse/ASTERIXDB-1581?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15469516#comment-15469516
 ] 

ASF subversion and git services commented on ASTERIXDB-1581:


Commit c89d668f68e5430a6ba4455daf8f9cd6f7040dd8 in asterixdb's branch 
refs/heads/master from [~buyingyi]
[ https://git-wip-us.apache.org/repos/asf?p=asterixdb.git;h=c89d668 ]

ASTERIXDB-1581: fix subquery decorrelation.

- fix concurrent modification exception;
- fix variable substitution ordering;
- fix required partitioning property for DataSourceScan;
- fix partitioning property enforcer for nested operators;
- fix recursive subplan decorrelation;
- fix CardinalityInferenceVisitor;
- add a rule to switch inner join branches;
- fix SimpleUnnestToProductRule;
- add test cases which are variants of ASTERIXDB-1581.

Change-Id: Ia2fa4b5b836eafee1975bd1164ae7c22199a4af0
Reviewed-on: https://asterix-gerrit.ics.uci.edu/1125
Tested-by: Jenkins 
Integration-Tests: Jenkins 
Reviewed-by: Till Westmann 


> Subquery inside case when clause - ConcurrentModificationException is thrown
> 
>
> Key: ASTERIXDB-1581
> URL: https://issues.apache.org/jira/browse/ASTERIXDB-1581
> Project: Apache AsterixDB
>  Issue Type: Bug
> Environment: Master branch with latest commit id: 
> bd3a535b171a5cc7486175
>Reporter: Vignesh Raghunathan
>Assignee: Yingyi Bu
>Priority: Critical
>  Labels: soon
> Attachments: tpcdsadb.txt
>
>
> To reproduce the issue run the following sqlpp query after creating the types 
> and datasets in the attached file tpcdsadb:
> {code}
> select case when (select value count(ss)
>   from store_sales ss
>   where ss_quantity >= 1 and ss_quantity <= 20) > 25437
> then (select avg(ss_ext_discount_amt)
>   from store_sales
>   where ss_quantity >= 1 and ss_quantity <= 20)
> else (select avg(ss_net_profit)
>   from store_sales
>   where ss_quantity >= 1 and ss_quantity <= 20) end bucket1 
> from reason
> where r_reason_sk = 1;
> {code}
> Result:
> {code}
> java.util.ConcurrentModificationException
>   at java.util.HashMap$HashIterator.nextNode(HashMap.java:1429)
>   at java.util.HashMap$KeyIterator.next(HashMap.java:1453)
>   at 
> org.apache.asterix.optimizer.rules.subplan.InlineAllNtsInSubplanVisitor.visitAggregateOperator(InlineAllNtsInSubplanVisitor.java:640)
>   at 
> org.apache.asterix.optimizer.rules.subplan.InlineAllNtsInSubplanVisitor.visitAggregateOperator(InlineAllNtsInSubplanVisitor.java:183)
>   at 
> org.apache.asterix.optimizer.rules.subplan.InlineAllNtsInSubplanVisitor.visitAggregateOperator(InlineAllNtsInSubplanVisitor.java:126)
>   at 
> org.apache.hyracks.algebricks.core.algebra.operators.logical.AggregateOperator.accept(AggregateOperator.java:55)
>   at 
> org.apache.asterix.optimizer.rules.subplan.InlineAllNtsInSubplanVisitor.visitSingleInputOperator(InlineAllNtsInSubplanVisitor.java:690)
>   at 
> org.apache.asterix.optimizer.rules.subplan.InlineAllNtsInSubplanVisitor.visitAssignOperator(InlineAllNtsInSubplanVisitor.java:469)
>   at 
> org.apache.asterix.optimizer.rules.subplan.InlineAllNtsInSubplanVisitor.visitAssignOperator(InlineAllNtsInSubplanVisitor.java:126)
>   at 
> org.apache.hyracks.algebricks.core.algebra.operators.logical.AssignOperator.accept(AssignOperator.java:63)
>   at 
> org.apache.asterix.optimizer.rules.subplan.InlineAllNtsInSubplanVisitor.visitSingleInputOperator(InlineAllNtsInSubplanVisitor.java:690)
>   at 
> org.apache.asterix.optimizer.rules.subplan.InlineAllNtsInSubplanVisitor.visitAggregateOperator(InlineAllNtsInSubplanVisitor.java:635)
>   at 
> org.apache.asterix.optimizer.rules.subplan.InlineAllNtsInSubplanVisitor.visitAggregateOperator(InlineAllNtsInSubplanVisitor.java:183)
>   at 
> org.apache.asterix.optimizer.rules.subplan.InlineAllNtsInSubplanVisitor.visitAggregateOperator(InlineAllNtsInSubplanVisitor.java:126)
>   at 
> org.apache.hyracks.algebricks.core.algebra.operators.logical.AggregateOperator.accept(AggregateOperator.java:55)
>   at 
> org.apache.asterix.optimizer.rules.subplan.SubplanFlatteningUtil.inlineAllNestedTupleSource(SubplanFlatteningUtil.java:67)
>   at 
> org.apache.asterix.optimizer.rules.subplan.InlineSubplanInputForNestedTupleSourceRule.applyGeneralFlattening(InlineSubplanInputForNestedTupleSourceRule.java:351)
>   at 
> org.apache.asterix.optimizer.rules.subplan.InlineSubplanInputForNestedTupleSourceRule.rewriteSubplanOperator(InlineSubplanInputForNestedTupleSourceRule.java:291)
>   at 
> 

[jira] [Commented] (ASTERIXDB-1581) Subquery inside case when clause - ConcurrentModificationException is thrown

[ASF subversion and git services (JIRA)]

[ 
https://issues.apache.org/jira/browse/ASTERIXDB-1581?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15469517#comment-15469517
 ] 

ASF subversion and git services commented on ASTERIXDB-1581:


Commit c89d668f68e5430a6ba4455daf8f9cd6f7040dd8 in asterixdb's branch 
refs/heads/master from [~buyingyi]
[ https://git-wip-us.apache.org/repos/asf?p=asterixdb.git;h=c89d668 ]

ASTERIXDB-1581: fix subquery decorrelation.

- fix concurrent modification exception;
- fix variable substitution ordering;
- fix required partitioning property for DataSourceScan;
- fix partitioning property enforcer for nested operators;
- fix recursive subplan decorrelation;
- fix CardinalityInferenceVisitor;
- add a rule to switch inner join branches;
- fix SimpleUnnestToProductRule;
- add test cases which are variants of ASTERIXDB-1581.

Change-Id: Ia2fa4b5b836eafee1975bd1164ae7c22199a4af0
Reviewed-on: https://asterix-gerrit.ics.uci.edu/1125
Tested-by: Jenkins 
Integration-Tests: Jenkins 
Reviewed-by: Till Westmann 


> Subquery inside case when clause - ConcurrentModificationException is thrown
> 
>
> Key: ASTERIXDB-1581
> URL: https://issues.apache.org/jira/browse/ASTERIXDB-1581
> Project: Apache AsterixDB
>  Issue Type: Bug
> Environment: Master branch with latest commit id: 
> bd3a535b171a5cc7486175
>Reporter: Vignesh Raghunathan
>Assignee: Yingyi Bu
>Priority: Critical
>  Labels: soon
> Attachments: tpcdsadb.txt
>
>
> To reproduce the issue run the following sqlpp query after creating the types 
> and datasets in the attached file tpcdsadb:
> {code}
> select case when (select value count(ss)
>   from store_sales ss
>   where ss_quantity >= 1 and ss_quantity <= 20) > 25437
> then (select avg(ss_ext_discount_amt)
>   from store_sales
>   where ss_quantity >= 1 and ss_quantity <= 20)
> else (select avg(ss_net_profit)
>   from store_sales
>   where ss_quantity >= 1 and ss_quantity <= 20) end bucket1 
> from reason
> where r_reason_sk = 1;
> {code}
> Result:
> {code}
> java.util.ConcurrentModificationException
>   at java.util.HashMap$HashIterator.nextNode(HashMap.java:1429)
>   at java.util.HashMap$KeyIterator.next(HashMap.java:1453)
>   at 
> org.apache.asterix.optimizer.rules.subplan.InlineAllNtsInSubplanVisitor.visitAggregateOperator(InlineAllNtsInSubplanVisitor.java:640)
>   at 
> org.apache.asterix.optimizer.rules.subplan.InlineAllNtsInSubplanVisitor.visitAggregateOperator(InlineAllNtsInSubplanVisitor.java:183)
>   at 
> org.apache.asterix.optimizer.rules.subplan.InlineAllNtsInSubplanVisitor.visitAggregateOperator(InlineAllNtsInSubplanVisitor.java:126)
>   at 
> org.apache.hyracks.algebricks.core.algebra.operators.logical.AggregateOperator.accept(AggregateOperator.java:55)
>   at 
> org.apache.asterix.optimizer.rules.subplan.InlineAllNtsInSubplanVisitor.visitSingleInputOperator(InlineAllNtsInSubplanVisitor.java:690)
>   at 
> org.apache.asterix.optimizer.rules.subplan.InlineAllNtsInSubplanVisitor.visitAssignOperator(InlineAllNtsInSubplanVisitor.java:469)
>   at 
> org.apache.asterix.optimizer.rules.subplan.InlineAllNtsInSubplanVisitor.visitAssignOperator(InlineAllNtsInSubplanVisitor.java:126)
>   at 
> org.apache.hyracks.algebricks.core.algebra.operators.logical.AssignOperator.accept(AssignOperator.java:63)
>   at 
> org.apache.asterix.optimizer.rules.subplan.InlineAllNtsInSubplanVisitor.visitSingleInputOperator(InlineAllNtsInSubplanVisitor.java:690)
>   at 
> org.apache.asterix.optimizer.rules.subplan.InlineAllNtsInSubplanVisitor.visitAggregateOperator(InlineAllNtsInSubplanVisitor.java:635)
>   at 
> org.apache.asterix.optimizer.rules.subplan.InlineAllNtsInSubplanVisitor.visitAggregateOperator(InlineAllNtsInSubplanVisitor.java:183)
>   at 
> org.apache.asterix.optimizer.rules.subplan.InlineAllNtsInSubplanVisitor.visitAggregateOperator(InlineAllNtsInSubplanVisitor.java:126)
>   at 
> org.apache.hyracks.algebricks.core.algebra.operators.logical.AggregateOperator.accept(AggregateOperator.java:55)
>   at 
> org.apache.asterix.optimizer.rules.subplan.SubplanFlatteningUtil.inlineAllNestedTupleSource(SubplanFlatteningUtil.java:67)
>   at 
> org.apache.asterix.optimizer.rules.subplan.InlineSubplanInputForNestedTupleSourceRule.applyGeneralFlattening(InlineSubplanInputForNestedTupleSourceRule.java:351)
>   at 
> org.apache.asterix.optimizer.rules.subplan.InlineSubplanInputForNestedTupleSourceRule.rewriteSubplanOperator(InlineSubplanInputForNestedTupleSourceRule.java:291)
>   at 
> 

[jira] [Commented] (ASTERIXDB-1334) [IndexOutOfBoundsException/ArrayIndexOutOfBoundsException] Malformed records' offset and length on nested ADM types

[ASF subversion and git services (JIRA)]

[ 
https://issues.apache.org/jira/browse/ASTERIXDB-1334?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15482465#comment-15482465
 ] 

ASF subversion and git services commented on ASTERIXDB-1334:


Commit dd3660520bcf3bbd1fb209af62a454e5259e69f2 in asterixdb's branch 
refs/heads/master from [~wyk]
[ https://git-wip-us.apache.org/repos/asf?p=asterixdb.git;h=dd36605 ]

ASTERIXDB-1334 and ASTERIXDB-1616: Fix null bitmap size.

Change-Id: I1eaa215b8fc2df02fecb7f86cc5169f07765b09d
Reviewed-on: https://asterix-gerrit.ics.uci.edu/1163
Sonar-Qube: Jenkins 
Tested-by: Jenkins 
Integration-Tests: Jenkins 
Reviewed-by: Yingyi Bu 


> [IndexOutOfBoundsException/ArrayIndexOutOfBoundsException] Malformed records' 
> offset and length on nested ADM types
> ---
>
> Key: ASTERIXDB-1334
> URL: https://issues.apache.org/jira/browse/ASTERIXDB-1334
> Project: Apache AsterixDB
>  Issue Type: Bug
>  Components: Data Model
>Reporter: Wail Alkowaileet
>Assignee: Yingyi Bu
>Priority: Critical
>
> Hi AsterixDB team,
> There's a problem when I fully define the ADM type. The computed field length 
> and offset seem to off.
> To reproduce:
> Download the data:
> https://www.dropbox.com/s/94llrvl08x85z9n/tweet.json?dl=0
> (Sorry it contains Arabic content)
> DDL:
> {noformat}
> create type coordinatesType1 as open {
> 'coordinates':[double],
> 'type':string
> }
> create type geoType1 as open {
> 'coordinates':[double],
> 'type':string
> }
> create type metadataType1 as open {
> 'iso_language_code':string,
> 'result_type':string
> }
> create type bounding_boxType1 as open {
> 'coordinates':[[[double]]],
> 'type':string
> }
> create type placeType1 as open {
> 'bounding_box':bounding_boxType1,
> 'country':string,
> 'country_code':string,
> 'full_name':string,
> 'id':string,
> 'name':string,
> 'place_type':string,
> 'url':string
> }
> create type listType1 as open {
> 'display_url':string,
> 'expanded_url':string,
> 'indices':[int64],
> 'url':string
> }
> create type urlType1 as open {
> 'urls':[listType1]
> }
> create type listType2 as open {
> 'display_url':string?,
> 'expanded_url':string?,
> 'indices':[int64]?,
> 'url':string?
> }
> create type descriptionType1 as open {
> 'urls':[listType2]
> }
> create type entitiesType1 as open {
> 'url':urlType1?,
> 'description':descriptionType1?
> }
> create type userType1 as open {
> 'contributors_enabled':boolean,
> 'created_at':string,
> 'default_profile':boolean,
> 'default_profile_image':boolean,
> 'description':string,
> 'favourites_count':int64,
> 'followers_count':int64,
> 'friends_count':int64,
> 'geo_enabled':boolean,
> 'has_extended_profile':boolean,
> 'id':int64,
> 'id_str':string,
> 'is_translation_enabled':boolean,
> 'is_translator':boolean,
> 'lang':string,
> 'listed_count':int64,
> 'location':string,
> 'name':string,
> 'profile_background_color':string,
> 'profile_background_image_url':string,
> 'profile_background_image_url_https':string,
> 'profile_background_tile':boolean,
> 'profile_banner_url':string?,
> 'profile_image_url':string,
> 'profile_image_url_https':string,
> 'profile_link_color':string,
> 'profile_sidebar_border_color':string,
> 'profile_sidebar_fill_color':string,
> 'profile_text_color':string,
> 'profile_use_background_image':boolean,
> 'protected':boolean,
> 'screen_name':string,
> 'statuses_count':int64,
> 'time_zone':string?,
> 'utc_offset':int64?,
> 'verified':boolean,
> 'entities':entitiesType1?,
> 'url':string?
> }
> create type listType3 as open {
> 'display_url':string?,
> 'expanded_url':string?,
> 'indices':[int64]?,
> 'url':string?
> }
> create type listType4 as open {
> 'indices':[int64]?,
> 'text':string?
> }
> create type listType5 as open {
> 'id':int64?,
> 'id_str':string?,
> 'indices':[int64]?,
> 'name':string?,
> 'screen_name':string?
> }
> create type largeType1 as open {
> 'h':int64,
> 'resize':string,
> 'w':int64
> }
> create type mediumType1 as open {
> 'h':int64,
> 'resize':string,
> 'w':int64
> }
> create type smallType1 as open {
> 'h':int64,
> 'resize':string,
> 'w':int64
> }
> create type thumbType1 as open {
> 'h':int64,
> 'resize':string,
> 'w':int64
> }
> create type sizesType1 as open {
> 'large':largeType1,
> 'medium':mediumType1,
> 'small':smallType1,
>   

[jira] [Commented] (ASTERIXDB-1616) NPE when printing record inside open type with unicode fields

[ASF subversion and git services (JIRA)]

[ 
https://issues.apache.org/jira/browse/ASTERIXDB-1616?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15482466#comment-15482466
 ] 

ASF subversion and git services commented on ASTERIXDB-1616:


Commit dd3660520bcf3bbd1fb209af62a454e5259e69f2 in asterixdb's branch 
refs/heads/master from [~wyk]
[ https://git-wip-us.apache.org/repos/asf?p=asterixdb.git;h=dd36605 ]

ASTERIXDB-1334 and ASTERIXDB-1616: Fix null bitmap size.

Change-Id: I1eaa215b8fc2df02fecb7f86cc5169f07765b09d
Reviewed-on: https://asterix-gerrit.ics.uci.edu/1163
Sonar-Qube: Jenkins 
Tested-by: Jenkins 
Integration-Tests: Jenkins 
Reviewed-by: Yingyi Bu 


> NPE when printing record inside open type with unicode fields
> -
>
> Key: ASTERIXDB-1616
> URL: https://issues.apache.org/jira/browse/ASTERIXDB-1616
> Project: Apache AsterixDB
>  Issue Type: Bug
>Reporter: Ian Maxon
>Assignee: Ian Maxon
>
> DDL: 
> https://github.com/kevincoakley/asterixdb_tests/blob/master/notebooks/asterixdb-spark/Count%20one_percent%20Tweets%20Spark%20Single.ipynb
> Data: 
> https://object.cloud.sdsc.edu/v1/AUTH_kcoakley/asterixdblogs/2015_11_07_00_onepercent.txt
> Basically just a scan+limit on the one_percent dataset will give 
> IndexOutOfBounds. 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (ASTERIXDB-1635) Overlap-bins does not start at the correct bin for dates

[ASF subversion and git services (JIRA)]

[ 
https://issues.apache.org/jira/browse/ASTERIXDB-1635?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15477531#comment-15477531
 ] 

ASF subversion and git services commented on ASTERIXDB-1635:


Commit 2a73f411264b282aefed51fa35322187f892d707 in asterixdb's branch 
refs/heads/master from [~prestonc]
[ https://git-wip-us.apache.org/repos/asf?p=asterixdb.git;h=2a73f41 ]

ASTERIXDB-1635 Fix for overlap-bins start for dates.

The fix involves two code changes and several sonar fixes.
The code changes are the following:
 - DurationArithmeticOperations line 75:
When the month was zero, an index out of bound error occured in line 88 or 
92.
The month value should be between 1 and 12.
 - OverlapBinsDescriptor line 170:
The Gregorian Calendar is expecting a value in ms. When a date value comes 
in,
AsterixDB represents the value as the number of days from epoc. So the year
for a date basically allways translated to 1970. In lines 121, a condition
was added to check if the interval was a date, if so, convert the date to
ms.

Change-Id: I24122a84ef9edda4b05260af881c430177f1dc86
Reviewed-on: https://asterix-gerrit.ics.uci.edu/1151
Tested-by: Jenkins 
Integration-Tests: Jenkins 
Reviewed-by: Steven Jacobs 


> Overlap-bins does not start at the correct bin for dates
> 
>
> Key: ASTERIXDB-1635
> URL: https://issues.apache.org/jira/browse/ASTERIXDB-1635
> Project: Apache AsterixDB
>  Issue Type: Bug
>Reporter: Preston Carman
>Assignee: Preston Carman
>Priority: Minor
>
> Using the example on the documentation, I changed the date overlap-bins to 
> use 10 years. The change now produces the wrong result. The result starts 
> from 1970 instead of the correct year. 
> The issue is because the days are not converted to ms when picking the 
> starting bin.
> Sample query:
> {noformat}
> let $itv1 := interval(time("17:23:37"), time("18:30:21"))
> let $itv2 := interval(date("1984-03-17"), date("2013-08-22"))
> let $itv3 := interval(datetime("1800-01-01T23:59:48.938"), 
> datetime("2015-07-26T13:28:30.218"))
> return { "timebins": overlap-bins($itv1, time("00:00:00"), 
> day-time-duration("PT30M")),
>   "datebins": overlap-bins($itv2, date("1990-01-01"), 
> year-month-duration("P10Y")),
>   "datetimebins": overlap-bins($itv3, datetime("1900-01-01T00:00:00.000"), 
> year-month-duration("P100Y")) }
> {noformat}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (ASTERIXDB-1628) The number of partitions in External Hash-Groupby is calculated improperly for smaller data size.

[ASF subversion and git services (JIRA)]

[ 
https://issues.apache.org/jira/browse/ASTERIXDB-1628?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15476210#comment-15476210
 ] 

ASF subversion and git services commented on ASTERIXDB-1628:


Commit b0dc27e8dfb8a0cc909874fe1bbaaffa97ddfc29 in asterixdb's branch 
refs/heads/master from [~wangsaeu]
[ https://git-wip-us.apache.org/repos/asf?p=asterixdb.git;h=b0dc27e ]

ASTERIXDB-1628: Fixed an issue in External Hash Group by

 - The number of partitions in External Hash Group By is now
   properly calculated by considering a corner case.

Change-Id: I8901d2b64659fb0d2b97d73f45a9fe113232e860
Reviewed-on: https://asterix-gerrit.ics.uci.edu/1144
Tested-by: Jenkins 
Integration-Tests: Jenkins 
Reviewed-by: Taewoo Kim 


> The number of partitions in External Hash-Groupby is calculated improperly 
> for smaller data size.
> -
>
> Key: ASTERIXDB-1628
> URL: https://issues.apache.org/jira/browse/ASTERIXDB-1628
> Project: Apache AsterixDB
>  Issue Type: Bug
>Reporter: Taewoo Kim
>Assignee: Taewoo Kim
>  Labels: soon
>
> If the number of frames required for a data (e.g., external file), say A,  is 
> slightly larger than the number of available frames (= memory budget), say B, 
> then the number of partitions may be calculated as 1 and it will cause the 
> infinite cycles during the merge phase.
> If the number of partition is 1, the current code assumes that there is no 
> spilling due to the out of memory budget and the output of the build phase is 
> directly generated as the final output. 
> But, if A > B, then a spill would happen and once a partition is spilled to 
> the disk, it can't be generated as the final output. So, the merge process 
> goes to the next round that just creates only one partition again and tries 
> to generate some as final output. But, it can't. Thus, an infinite cycle 
> begins.
> The resolution is that if A > B, we should not set the number of partition as 
> one.   



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (ASTERIXDB-1572) Multiple and/or conditions in where clause inside a subquery in from clause throws AlgebricksException

[ASF subversion and git services (JIRA)]

[ 
https://issues.apache.org/jira/browse/ASTERIXDB-1572?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15481054#comment-15481054
 ] 

ASF subversion and git services commented on ASTERIXDB-1572:


Commit 834e17314ae8ecb12fce43c59cc6f613f2dee124 in asterixdb's branch 
refs/heads/master from [~buyingyi]
[ https://git-wip-us.apache.org/repos/asf?p=asterixdb.git;h=834e173 ]

ASTERIXDB-1572 and ASTERIXDB-1591: fix and regression tests.

- push aggregates into subplans;
- fix recursive variable mapping in subquery decorrelation.

Change-Id: I7092dd2fa7c9193ff919b27464854936f48261b0
Reviewed-on: https://asterix-gerrit.ics.uci.edu/1161
Tested-by: Jenkins 
Integration-Tests: Jenkins 
Reviewed-by: Till Westmann 


> Multiple and/or conditions in where clause inside a subquery in from clause 
> throws AlgebricksException
> --
>
> Key: ASTERIXDB-1572
> URL: https://issues.apache.org/jira/browse/ASTERIXDB-1572
> Project: Apache AsterixDB
>  Issue Type: Bug
> Environment: Master branch with latest commit id: 
> bd3a535b171a5cc7486175
>Reporter: Vignesh Raghunathan
>Assignee: Yingyi Bu
>Priority: Critical
>  Labels: soon
>
> To reproduce the issue run the following sqlpp statements:
> {code}
> drop dataverse sampdb if exists;
> create dataverse sampdb;
> use sampdb;
> drop dataset samptable if exists;
> drop type samptabletype if exists;
> create type samptabletype as closed {
>   id: int8
> };
> create dataset samptable(samptabletype) primary key id;
> insert into samptable ({'id' : 0});
> insert into samptable ({'id' : 1});
> select *
> from
> (
> select id from samptable
> where (id in [0] and id in [1]) 
> or (id in [1] and id in [2]) 
> ) st1;
> {code}
> Result:
> {code}
> org.apache.hyracks.algebricks.common.exceptions.AlgebricksException: 
> Attempting to construct a nested plan with 4 operator descriptors. Currently, 
> nested plans can only consist in linear pipelines of Asterix micro operators.
>   at 
> org.apache.hyracks.algebricks.core.algebra.operators.physical.AbstractPhysicalOperator.buildPipelineWithProjection(AbstractPhysicalOperator.java:144)
>   at 
> org.apache.hyracks.algebricks.core.algebra.operators.physical.AbstractPhysicalOperator.compileSubplans(AbstractPhysicalOperator.java:125)
>   at 
> org.apache.hyracks.algebricks.core.algebra.operators.physical.SubplanPOperator.contributeRuntimeOperator(SubplanPOperator.java:92)
>   at 
> org.apache.hyracks.algebricks.core.algebra.operators.logical.AbstractLogicalOperator.contributeRuntimeOperator(AbstractLogicalOperator.java:166)
>   at 
> org.apache.hyracks.algebricks.core.jobgen.impl.PlanCompiler.compileOpRef(PlanCompiler.java:98)
>   at 
> org.apache.hyracks.algebricks.core.jobgen.impl.PlanCompiler.compileOpRef(PlanCompiler.java:85)
>   at 
> org.apache.hyracks.algebricks.core.jobgen.impl.PlanCompiler.compileOpRef(PlanCompiler.java:85)
>   at 
> org.apache.hyracks.algebricks.core.jobgen.impl.PlanCompiler.compileOpRef(PlanCompiler.java:85)
>   at 
> org.apache.hyracks.algebricks.core.jobgen.impl.PlanCompiler.compileOpRef(PlanCompiler.java:85)
>   at 
> org.apache.hyracks.algebricks.core.jobgen.impl.PlanCompiler.compileOpRef(PlanCompiler.java:85)
>   at 
> org.apache.hyracks.algebricks.core.jobgen.impl.PlanCompiler.compileOpRef(PlanCompiler.java:85)
>   at 
> org.apache.hyracks.algebricks.core.jobgen.impl.PlanCompiler.compileOpRef(PlanCompiler.java:85)
>   at 
> org.apache.hyracks.algebricks.core.jobgen.impl.PlanCompiler.compileOpRef(PlanCompiler.java:85)
>   at 
> org.apache.hyracks.algebricks.core.jobgen.impl.PlanCompiler.compileOpRef(PlanCompiler.java:85)
>   at 
> org.apache.hyracks.algebricks.core.jobgen.impl.PlanCompiler.compileOpRef(PlanCompiler.java:85)
>   at 
> org.apache.hyracks.algebricks.core.jobgen.impl.PlanCompiler.compileOpRef(PlanCompiler.java:85)
>   at 
> org.apache.hyracks.algebricks.core.jobgen.impl.PlanCompiler.compileOpRef(PlanCompiler.java:85)
>   at 
> org.apache.hyracks.algebricks.core.jobgen.impl.PlanCompiler.compileOpRef(PlanCompiler.java:85)
>   at 
> org.apache.hyracks.algebricks.core.jobgen.impl.PlanCompiler.compileOpRef(PlanCompiler.java:85)
>   at 
> org.apache.hyracks.algebricks.core.jobgen.impl.PlanCompiler.compileOpRef(PlanCompiler.java:85)
>   at 
> org.apache.hyracks.algebricks.core.jobgen.impl.PlanCompiler.compileOpRef(PlanCompiler.java:85)
>   at 
> org.apache.hyracks.algebricks.core.jobgen.impl.PlanCompiler.compileOpRef(PlanCompiler.java:85)
>   at 
> 

[jira] [Commented] (ASTERIXDB-1591) Multiple exists in where throws NullPointerException

[ASF subversion and git services (JIRA)]

[ 
https://issues.apache.org/jira/browse/ASTERIXDB-1591?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15481055#comment-15481055
 ] 

ASF subversion and git services commented on ASTERIXDB-1591:


Commit 834e17314ae8ecb12fce43c59cc6f613f2dee124 in asterixdb's branch 
refs/heads/master from [~buyingyi]
[ https://git-wip-us.apache.org/repos/asf?p=asterixdb.git;h=834e173 ]

ASTERIXDB-1572 and ASTERIXDB-1591: fix and regression tests.

- push aggregates into subplans;
- fix recursive variable mapping in subquery decorrelation.

Change-Id: I7092dd2fa7c9193ff919b27464854936f48261b0
Reviewed-on: https://asterix-gerrit.ics.uci.edu/1161
Tested-by: Jenkins 
Integration-Tests: Jenkins 
Reviewed-by: Till Westmann 


> Multiple exists in where throws NullPointerException
> 
>
> Key: ASTERIXDB-1591
> URL: https://issues.apache.org/jira/browse/ASTERIXDB-1591
> Project: Apache AsterixDB
>  Issue Type: Bug
> Environment: Master branch with latest commit 
> 0339b475f323e6e2777dbcb13ee2
>Reporter: Vignesh Raghunathan
>Assignee: Yingyi Bu
> Attachments: tpcdsadb.txt
>
>
> To reproduce the issue, run the following sqlpp query after creating datasets 
> using dml statements in tpcdsadb.txt:
> {code}
> use tpcds;
> select *
> from
>   customer c,customer_address ca,customer_demographics
>  where
>   c.c_current_addr_sk = ca.ca_address_sk and
>   cd_demo_sk = c.c_current_cdemo_sk and
>   exists (select *
>   from store_sales ss1,date_dim dd1
>   where c.c_customer_sk = ss1.ss_customer_sk and
> ss1.ss_sold_date_sk = dd1.d_date_sk and
> dd1.d_year = 1999 and
> dd1.d_qoy < 4) and
>(exists (select *
> from web_sales ws1,date_dim dd1
> where c.c_customer_sk = ws1.ws_bill_customer_sk and
>   ws1.ws_sold_date_sk = dd1.d_date_sk and
>   dd1.d_year = 1999 and
>   dd1.d_qoy < 4) or
> exists (select *
> from catalog_sales cs1,date_dim dd1
> where c.c_customer_sk = cs1.cs_ship_customer_sk and
>   cs1.cs_sold_date_sk = dd1.d_date_sk and
>   dd1.d_year = 1999 and
>   dd1.d_qoy < 4))
>   limit 100;
> {code}
> Result:
> {code}
> java.lang.NullPointerException
>   at 
> org.apache.asterix.metadata.declared.AqlMetadataProvider.buildBtreeRuntime(AqlMetadataProvider.java:659)
>   at 
> org.apache.asterix.metadata.declared.AqlMetadataProvider.buildInternalDatasetScan(AqlMetadataProvider.java:482)
>   at 
> org.apache.asterix.metadata.declared.AqlMetadataProvider.getScannerRuntime(AqlMetadataProvider.java:342)
>   at 
> org.apache.hyracks.algebricks.core.algebra.operators.physical.DataSourceScanPOperator.contributeRuntimeOperator(DataSourceScanPOperator.java:87)
>   at 
> org.apache.hyracks.algebricks.core.algebra.operators.logical.AbstractLogicalOperator.contributeRuntimeOperator(AbstractLogicalOperator.java:166)
>   at 
> org.apache.hyracks.algebricks.core.jobgen.impl.PlanCompiler.compileOpRef(PlanCompiler.java:98)
>   at 
> org.apache.hyracks.algebricks.core.jobgen.impl.PlanCompiler.compileOpRef(PlanCompiler.java:85)
>   at 
> org.apache.hyracks.algebricks.core.jobgen.impl.PlanCompiler.compileOpRef(PlanCompiler.java:85)
>   at 
> org.apache.hyracks.algebricks.core.jobgen.impl.PlanCompiler.compileOpRef(PlanCompiler.java:85)
>   at 
> org.apache.hyracks.algebricks.core.jobgen.impl.PlanCompiler.compileOpRef(PlanCompiler.java:85)
>   at 
> org.apache.hyracks.algebricks.core.jobgen.impl.PlanCompiler.compileOpRef(PlanCompiler.java:85)
>   at 
> org.apache.hyracks.algebricks.core.jobgen.impl.PlanCompiler.compileOpRef(PlanCompiler.java:85)
>   at 
> org.apache.hyracks.algebricks.core.jobgen.impl.PlanCompiler.compileOpRef(PlanCompiler.java:85)
>   at 
> org.apache.hyracks.algebricks.core.jobgen.impl.PlanCompiler.compileOpRef(PlanCompiler.java:85)
>   at 
> org.apache.hyracks.algebricks.core.jobgen.impl.PlanCompiler.compileOpRef(PlanCompiler.java:85)
>   at 
> org.apache.hyracks.algebricks.core.jobgen.impl.PlanCompiler.compileOpRef(PlanCompiler.java:85)
>   at 
> org.apache.hyracks.algebricks.core.jobgen.impl.PlanCompiler.compilePlan(PlanCompiler.java:61)
>   at 
> org.apache.hyracks.algebricks.core.algebra.operators.physical.AbstractPhysicalOperator.buildPipelineWithProjection(AbstractPhysicalOperator.java:136)
>   at 
> org.apache.hyracks.algebricks.core.algebra.operators.physical.AbstractPhysicalOperator.compileSubplans(AbstractPhysicalOperator.java:125)
>   at 
> 

[jira] [Commented] (ASTERIXDB-1616) NPE when printing record inside open type with unicode fields

[ASF subversion and git services (JIRA)]

[ 
https://issues.apache.org/jira/browse/ASTERIXDB-1616?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15488901#comment-15488901
 ] 

ASF subversion and git services commented on ASTERIXDB-1616:


Commit 93a67deebf5bcbcb525623cd183b09ac9f0f5e02 in asterixdb's branch 
refs/heads/master from [~buyingyi]
[ https://git-wip-us.apache.org/repos/asf?p=asterixdb.git;h=93a67de ]

ASTERIXDB-1334 and ASTERIXDB-1616: Add a regression test.

Change-Id: I7e88adbfa2721fa589e1d0564bb9e0889b722e2e
Reviewed-on: https://asterix-gerrit.ics.uci.edu/1165
Sonar-Qube: Jenkins 
Tested-by: Jenkins 
Reviewed-by: Ian Maxon 
Integration-Tests: Jenkins 


> NPE when printing record inside open type with unicode fields
> -
>
> Key: ASTERIXDB-1616
> URL: https://issues.apache.org/jira/browse/ASTERIXDB-1616
> Project: Apache AsterixDB
>  Issue Type: Bug
>Reporter: Ian Maxon
>Assignee: Ian Maxon
>
> DDL: 
> https://github.com/kevincoakley/asterixdb_tests/blob/master/notebooks/asterixdb-spark/Count%20one_percent%20Tweets%20Spark%20Single.ipynb
> Data: 
> https://object.cloud.sdsc.edu/v1/AUTH_kcoakley/asterixdblogs/2015_11_07_00_onepercent.txt
> Basically just a scan+limit on the one_percent dataset will give 
> IndexOutOfBounds. 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (ASTERIXDB-1334) [IndexOutOfBoundsException/ArrayIndexOutOfBoundsException] Malformed records' offset and length on nested ADM types

[ASF subversion and git services (JIRA)]

[ 
https://issues.apache.org/jira/browse/ASTERIXDB-1334?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15488900#comment-15488900
 ] 

ASF subversion and git services commented on ASTERIXDB-1334:


Commit 93a67deebf5bcbcb525623cd183b09ac9f0f5e02 in asterixdb's branch 
refs/heads/master from [~buyingyi]
[ https://git-wip-us.apache.org/repos/asf?p=asterixdb.git;h=93a67de ]

ASTERIXDB-1334 and ASTERIXDB-1616: Add a regression test.

Change-Id: I7e88adbfa2721fa589e1d0564bb9e0889b722e2e
Reviewed-on: https://asterix-gerrit.ics.uci.edu/1165
Sonar-Qube: Jenkins 
Tested-by: Jenkins 
Reviewed-by: Ian Maxon 
Integration-Tests: Jenkins 


> [IndexOutOfBoundsException/ArrayIndexOutOfBoundsException] Malformed records' 
> offset and length on nested ADM types
> ---
>
> Key: ASTERIXDB-1334
> URL: https://issues.apache.org/jira/browse/ASTERIXDB-1334
> Project: Apache AsterixDB
>  Issue Type: Bug
>  Components: Data Model
>Reporter: Wail Alkowaileet
>Assignee: Yingyi Bu
>Priority: Critical
>
> Hi AsterixDB team,
> There's a problem when I fully define the ADM type. The computed field length 
> and offset seem to off.
> To reproduce:
> Download the data:
> https://www.dropbox.com/s/94llrvl08x85z9n/tweet.json?dl=0
> (Sorry it contains Arabic content)
> DDL:
> {noformat}
> create type coordinatesType1 as open {
> 'coordinates':[double],
> 'type':string
> }
> create type geoType1 as open {
> 'coordinates':[double],
> 'type':string
> }
> create type metadataType1 as open {
> 'iso_language_code':string,
> 'result_type':string
> }
> create type bounding_boxType1 as open {
> 'coordinates':[[[double]]],
> 'type':string
> }
> create type placeType1 as open {
> 'bounding_box':bounding_boxType1,
> 'country':string,
> 'country_code':string,
> 'full_name':string,
> 'id':string,
> 'name':string,
> 'place_type':string,
> 'url':string
> }
> create type listType1 as open {
> 'display_url':string,
> 'expanded_url':string,
> 'indices':[int64],
> 'url':string
> }
> create type urlType1 as open {
> 'urls':[listType1]
> }
> create type listType2 as open {
> 'display_url':string?,
> 'expanded_url':string?,
> 'indices':[int64]?,
> 'url':string?
> }
> create type descriptionType1 as open {
> 'urls':[listType2]
> }
> create type entitiesType1 as open {
> 'url':urlType1?,
> 'description':descriptionType1?
> }
> create type userType1 as open {
> 'contributors_enabled':boolean,
> 'created_at':string,
> 'default_profile':boolean,
> 'default_profile_image':boolean,
> 'description':string,
> 'favourites_count':int64,
> 'followers_count':int64,
> 'friends_count':int64,
> 'geo_enabled':boolean,
> 'has_extended_profile':boolean,
> 'id':int64,
> 'id_str':string,
> 'is_translation_enabled':boolean,
> 'is_translator':boolean,
> 'lang':string,
> 'listed_count':int64,
> 'location':string,
> 'name':string,
> 'profile_background_color':string,
> 'profile_background_image_url':string,
> 'profile_background_image_url_https':string,
> 'profile_background_tile':boolean,
> 'profile_banner_url':string?,
> 'profile_image_url':string,
> 'profile_image_url_https':string,
> 'profile_link_color':string,
> 'profile_sidebar_border_color':string,
> 'profile_sidebar_fill_color':string,
> 'profile_text_color':string,
> 'profile_use_background_image':boolean,
> 'protected':boolean,
> 'screen_name':string,
> 'statuses_count':int64,
> 'time_zone':string?,
> 'utc_offset':int64?,
> 'verified':boolean,
> 'entities':entitiesType1?,
> 'url':string?
> }
> create type listType3 as open {
> 'display_url':string?,
> 'expanded_url':string?,
> 'indices':[int64]?,
> 'url':string?
> }
> create type listType4 as open {
> 'indices':[int64]?,
> 'text':string?
> }
> create type listType5 as open {
> 'id':int64?,
> 'id_str':string?,
> 'indices':[int64]?,
> 'name':string?,
> 'screen_name':string?
> }
> create type largeType1 as open {
> 'h':int64,
> 'resize':string,
> 'w':int64
> }
> create type mediumType1 as open {
> 'h':int64,
> 'resize':string,
> 'w':int64
> }
> create type smallType1 as open {
> 'h':int64,
> 'resize':string,
> 'w':int64
> }
> create type thumbType1 as open {
> 'h':int64,
> 'resize':string,
> 'w':int64
> }
> create type sizesType1 as open {
> 'large':largeType1,
> 'medium':mediumType1,
> 

[jira] [Commented] (ASTERIXDB-1629) Union All with global aggregates fails

[ASF subversion and git services (JIRA)]

[ 
https://issues.apache.org/jira/browse/ASTERIXDB-1629?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15488993#comment-15488993
 ] 

ASF subversion and git services commented on ASTERIXDB-1629:


Commit f798175f238d1646d474e717ddded33c4432e880 in asterixdb's branch 
refs/heads/master from [~buyingyi]
[ https://git-wip-us.apache.org/repos/asf?p=asterixdb.git;h=f798175 ]

ASTERIXDB-1629: fix the open record constructor type computer.

Change-Id: I1a6ad39a889a774d6e448b2efe90134b5490f7c8
Reviewed-on: https://asterix-gerrit.ics.uci.edu/1167
Sonar-Qube: Jenkins 
Tested-by: Jenkins 
Integration-Tests: Jenkins 
Reviewed-by: Till Westmann 


> Union All with global aggregates fails
> --
>
> Key: ASTERIXDB-1629
> URL: https://issues.apache.org/jira/browse/ASTERIXDB-1629
> Project: Apache AsterixDB
>  Issue Type: Bug
>  Components: Optimizer
>Reporter: Yingyi Bu
>Assignee: Yingyi Bu
>
> query:
> {noformat}
> SELECT COUNT(1)  AS one FROM items
> UNION ALL
> SELECT COUNT(1) AS one FROM items;
> {noformat}
> A runtime error is thrown:
> {noformat}
> Invalid types for casting, required type generalized-record-type: closed {
>   one: UNION(INT64, NULL, MISSING)
> }
> , input type null: closed {
>   one: UNION(INT64, NULL, MISSING)
> }
>  [IllegalStateException]
> {noformat}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (ASTERIXDB-1630) ATypeHierarchy doesn't consider promoting type ANY

[ASF subversion and git services (JIRA)]

[ 
https://issues.apache.org/jira/browse/ASTERIXDB-1630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15489228#comment-15489228
 ] 

ASF subversion and git services commented on ASTERIXDB-1630:


Commit 06370fe90e1074ce97b515231b504460a6dd07d1 in asterixdb's branch 
refs/heads/master from [~buyingyi]
[ https://git-wip-us.apache.org/repos/asf?p=asterixdb.git;h=06370fe ]

ASTERIXDB-1630: fix ATypeHierarchy to handle ANY.

Change-Id: Ic22421d12b1a6a17f15283e1e1403961e7fe17d0
Reviewed-on: https://asterix-gerrit.ics.uci.edu/1168
Sonar-Qube: Jenkins 
Tested-by: Jenkins 
Reviewed-by: Taewoo Kim 
Integration-Tests: Jenkins 


> ATypeHierarchy doesn't consider promoting type ANY
> --
>
> Key: ASTERIXDB-1630
> URL: https://issues.apache.org/jira/browse/ASTERIXDB-1630
> Project: Apache AsterixDB
>  Issue Type: Bug
>Reporter: Abdullah Alamoudi
>Assignee: Yingyi Bu
>
> Methods such as compatible with any will always return false.
> Not sure if this is the expected behavior.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (ASTERIXDB-1451) Upsert: Open Index test fails with duplicate rows in result when VBC page size is reduced

[ASF subversion and git services (JIRA)]

[ 
https://issues.apache.org/jira/browse/ASTERIXDB-1451?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15485309#comment-15485309
 ] 

ASF subversion and git services commented on ASTERIXDB-1451:


Commit 534d589297cc4fadbd61b4de70af5c406299814c in asterixdb's branch 
refs/heads/master from [~alamoudi]
[ https://git-wip-us.apache.org/repos/asf?p=asterixdb.git;h=534d589 ]

ASTERIXDB-1451: Remove Record Casting for insert/delete/upsert

This change includes the following:
- Introduce cast function in case of delete operation
  after the primary index to ensure types are passed
  correctly to enforced indexes.
- Introduce cast function in case of upsert operation
  before old secondary keys extraction to ensure types
  are passed correctly to enforced indexes.
- Replace all record casts with open field casts for
  insert/delete/upsert operations.
- Sonar-Qube fixes.

Change-Id: I6a80105798ea1c86a6a0eb69a79b9573b54931b7
Reviewed-on: https://asterix-gerrit.ics.uci.edu/1146
Tested-by: Jenkins 
Integration-Tests: Jenkins 
Reviewed-by: abdullah alamoudi 


> Upsert: Open Index test fails with duplicate rows in result when VBC page 
> size is reduced
> -
>
> Key: ASTERIXDB-1451
> URL: https://issues.apache.org/jira/browse/ASTERIXDB-1451
> Project: Apache AsterixDB
>  Issue Type: Bug
>Reporter: Michael Blow
>Assignee: Murtadha Hubail
>
> To repro:
> - configure storage.memorycomponent.pagesize to 8k, and increase 
> storage.memorycomponent.numpages to 24
> - run asterix-app runtime tests
> - observe failure in open-index test with duplicated rows as shown below.
> $ diff -du 
> src/test/resources/runtimets/results/upsert/open-index/open-index.1.adm 
> rttest/results/upsert/open-index.adm
> --- src/test/resources/runtimets/results/upsert/open-index/open-index.1.adm   
> 2016-04-27 20:40:58.0 -0700
> +++ rttest/results/upsert/open-index.adm  2016-05-16 19:08:57.0 
> -0700
> @@ -1099,11 +1099,15 @@
>  { "o_orderkey": 5927, "o_custkey": 116 }
>  { "o_orderkey": 5952, "o_custkey": 148 }
>  { "o_orderkey": 5955, "o_custkey": 94 }
> +{ "o_orderkey": 5955, "o_custkey": 94 }
> +{ "o_orderkey": 5957, "o_custkey": 89 }
>  { "o_orderkey": 5957, "o_custkey": 89 }
>  { "o_orderkey": 5958, "o_custkey": 115 }
>  { "o_orderkey": 5984, "o_custkey": 70 }
>  { "o_orderkey": 5985, "o_custkey": 143 }
>  { "o_orderkey": 5986, "o_custkey": 115 }
> +{ "o_orderkey": 5986, "o_custkey": 115 }
> +{ "o_orderkey": 5987, "o_custkey": 64 }
>  { "o_orderkey": 5987, "o_custkey": 64 }
>  { "o_orderkey": 10986, "o_custkey": 115 }
>  { "o_orderkey": 10987, "o_custkey": 64 }



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (ASTERIXDB-1602) Nested subqueries in with clause throws StackOverflowError

[ASF subversion and git services (JIRA)]

[ 
https://issues.apache.org/jira/browse/ASTERIXDB-1602?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15481240#comment-15481240
 ] 

ASF subversion and git services commented on ASTERIXDB-1602:


Commit 7477a58a9274d28f3b5d47bd93c3cd8619d92f7c in asterixdb's branch 
refs/heads/master from [~buyingyi]
[ https://git-wip-us.apache.org/repos/asf?p=asterixdb.git;h=7477a58 ]

ASTERIXDB-1602: fix the reset of lastUsedClusterId in 
ExtractCommonOperatorsRule.

Change-Id: Ic1a9a638906a3f973b3b932489c3282132e10c37
Reviewed-on: https://asterix-gerrit.ics.uci.edu/1154
Sonar-Qube: Jenkins 
Tested-by: Jenkins 
Reviewed-by: Till Westmann 
Integration-Tests: Jenkins 


> Nested subqueries in with clause throws StackOverflowError
> --
>
> Key: ASTERIXDB-1602
> URL: https://issues.apache.org/jira/browse/ASTERIXDB-1602
> Project: Apache AsterixDB
>  Issue Type: Bug
> Environment: Master branch with latest change id 
> I363df794c48644ca806958f583a05aea10a93166
>Reporter: Vignesh Raghunathan
>Assignee: Yingyi Bu
> Attachments: adblog.txt, tpcdsadb.txt
>
>
> To reproduce the issue, run the following sqlpp query after creating datasets 
> using tpcdsadb.txt
> {code}
> use tpcds;
> with tab as
>  (select *
>  from item,
>   date_dim d1
>   where d1.d_datein
>   (select d2.d_date
>   from date_dim d2
>   where d2.d_week_seq in
>   (select d3.d_week_seq
>   from date_dim d3
> where d3.d_date in 
> [date('1998-01-02'),date('1998-10-15'),date('1998-11-10')]))
>  group by i_item_id)
>   select  *
>  from tab t1, tab t2;
> {code}
> Result:
> Please check adblog.txt



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (ASTERIXDB-1539) Create aliases for builtin types in SQL++

[ASF subversion and git services (JIRA)]

[ 
https://issues.apache.org/jira/browse/ASTERIXDB-1539?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15523424#comment-15523424
 ] 

ASF subversion and git services commented on ASTERIXDB-1539:


Commit 635d70375fc03c1c03feae0d1ee4e241fd895782 in asterixdb's branch 
refs/heads/master from [~buyingyi]
[ https://git-wip-us.apache.org/repos/asf?p=asterixdb.git;h=635d703 ]

ASTERIXDB-1539: add function mapping for AQL.

- allow all SQL++/AQL functions to be "_"-based;
- still accept "-"-based functions.

Change-Id: I6ab87a02c8c270535059bdec8281c72801418551
Reviewed-on: https://asterix-gerrit.ics.uci.edu/1210
Sonar-Qube: Jenkins 
Tested-by: Jenkins 
Reviewed-by: Till Westmann 
Integration-Tests: Jenkins 


> Create aliases for builtin types in SQL++
> -
>
> Key: ASTERIXDB-1539
> URL: https://issues.apache.org/jira/browse/ASTERIXDB-1539
> Project: Apache AsterixDB
>  Issue Type: Improvement
>  Components: AsterixDB
>Reporter: Yingyi Bu
>Assignee: Yingyi Bu
>  Labels: soon
>
> Create SQL standard aliases for builtin types:
>  Boolean
>  Int8 (deprecated) -> TINYINT
>  Int16 (deprecated) -> SMALLINT
>  Int32 (deprecated) -> INT
>  Int64 (deprecated) ->  BIGINT
>  Float -> FLOAT
>  Double -> DOUBLE
>  Double -> DOUBLE PRECISION
>  String -> STRING
>  Binary -> BINARY
>  Point -> POINT
>  Line -> LINE
>  Rectangle -> Rectangle
>  Circle -> CIRCLE
>  Polygon -> POLYGON
>  Date -> DATE
>  Time -> TIME
>  Datetime  -> TIMESTAMP
>  Duration/Year-month-duration (deprecated) /Day-time-duration 
> (deprecated) -> DURATION/YEAR_MONTH_DURATION/DAY_TIME_DURATION
>  Interval -> INTERVAL
>  UUID -> UUID
>  Record -> RECORD
>  OrderedList   —> ARRAY
>  UnorderedList --> MULTISET
> Here is the PostgreSQL reference:
> https://www.postgresql.org/docs/9.5/static/datatype.html
> Sub-tasks:
> 1. Check the difference between SQL array and JSON array;
> 2. Think about suitable aliases for 
> Duration/Year-month-duration/Day-time-duration.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (ASTERIXDB-1567) Add upsert option for Feed Ingestion

[ASF subversion and git services (JIRA)]

[ 
https://issues.apache.org/jira/browse/ASTERIXDB-1567?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15519144#comment-15519144
 ] 

ASF subversion and git services commented on ASTERIXDB-1567:


Commit 0608bf58feff796865833f098038e6fbef3e5166 in asterixdb's branch 
refs/heads/master from [~mblow]
[ https://git-wip-us.apache.org/repos/asf?p=asterixdb.git;h=0608bf5 ]

Add upsert option for feed

For ASTERIXDB-1567. Provide "upsert-feed"="true" for
feed configuration, which changes the default record
insert to upsert. Added one test case for upsert feed.

Change-Id: Ic5133e7c6941fea4110cc9983f99502f364dc810
Reviewed-on: https://asterix-gerrit.ics.uci.edu/1068
Sonar-Qube: Jenkins 
Tested-by: Jenkins 
Integration-Tests: Jenkins 
Reviewed-by: Michael Blow 


> Add upsert option for Feed Ingestion
> 
>
> Key: ASTERIXDB-1567
> URL: https://issues.apache.org/jira/browse/ASTERIXDB-1567
> Project: Apache AsterixDB
>  Issue Type: Improvement
>Reporter: Xikui Wang
>Assignee: Xikui Wang
>
> Allow feed ingestion to use upsert for processing incoming records.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (ASTERIXDB-1679) Unused horizontal space in builtin functions documentation

[ASF subversion and git services (JIRA)]

[ 
https://issues.apache.org/jira/browse/ASTERIXDB-1679?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15550534#comment-15550534
 ] 

ASF subversion and git services commented on ASTERIXDB-1679:


Commit 58f631628f2a53e4d14b3ea26223345c1722c98e in asterixdb's branch 
refs/heads/master from [~buyingyi]
[ https://git-wip-us.apache.org/repos/asf?p=asterixdb.git;h=58f6316 ]

ASTERIXDB-1679: fix the function doc.

Change-Id: I19223af41a552a321e25e4ff3927b094d59a904e
Reviewed-on: https://asterix-gerrit.ics.uci.edu/1256
Sonar-Qube: Jenkins 
Tested-by: Jenkins 
Reviewed-by: Till Westmann 


> Unused horizontal space in builtin functions documentation
> --
>
> Key: ASTERIXDB-1679
> URL: https://issues.apache.org/jira/browse/ASTERIXDB-1679
> Project: Apache AsterixDB
>  Issue Type: Improvement
>  Components: Documentation
>Reporter: Vignesh Raghunathan
>Assignee: Yingyi Bu
>
> In builtin functions documentation, the first line in the interval section 
> could be broken down into several lines. It is making the overall horizontal 
> layout of the document huge.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (ASTERIXDB-1636) Feed cannot re-ingest after cluster restart

[ASF subversion and git services (JIRA)]

[ 
https://issues.apache.org/jira/browse/ASTERIXDB-1636?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15550947#comment-15550947
 ] 

ASF subversion and git services commented on ASTERIXDB-1636:


Commit ecba52e0b9eca4f59b9b7fc082b720d677b4d98d in asterixdb's branch 
refs/heads/master from [~imaxon]
[ https://git-wip-us.apache.org/repos/asf?p=asterixdb.git;h=ecba52e ]

Tests for ASTERIXDB-1636

This is a test for the scenario described in the Jira issue. The only
thing I have taken liberty with is changing the socket feed to a file
one. The test case fails when I revert AqlMetadataProvider to the
previous version, and should pass now with this parent.

Change-Id: Ic1521f1d53121b6768ac123e49e731932c85
Reviewed-on: https://asterix-gerrit.ics.uci.edu/1248
Sonar-Qube: Jenkins 
Reviewed-by: Taewoo Kim 
Tested-by: Jenkins 
Integration-Tests: Jenkins 


> Feed cannot re-ingest after cluster restart
> ---
>
> Key: ASTERIXDB-1636
> URL: https://issues.apache.org/jira/browse/ASTERIXDB-1636
> Project: Apache AsterixDB
>  Issue Type: Bug
>  Components: Feeds, Storage
> Environment: master
> commit c89d668f68e5430a6ba4455daf8f9cd6f7040dd8
> Date:   Tue Sep 6 18:29:23 2016 -0700
>Reporter: Jianfeng Jia
>Assignee: Ian Maxon
>Priority: Blocker
>  Labels: soon
>
> Here are steps to reproduce the problem:
> 1. start the cluster
> 2. ingest the initial data using file feed 
> [script|https://gist.github.com/JavierJia/9ed7744c938c5cb66aba63007b86a987]
> 2.1: file for ingestion: 
> https://drive.google.com/open?id=0B423M7wGZj9dNE5HenFqcjhuUFk
> 3. start another socket feed 
> [script|https://gist.github.com/JavierJia/565cefd9322df35c7abeefbfcfcee9f8] 
> to ingest the live data  
> 4. restart the cluster
> 5. start that live socket feed again.
> 6. with your own twitter credential you can use [this 
> script|https://github.com/ISG-ICS/cloudberry/blob/master/streamFeed.sh]  to 
> ingest the tweet
> 7. It will send at most 280 tweets and stops forever.
> [~imaxon] [~idleft] if you can help that will be great.
> related to ASTERIXDB-1264



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (ASTERIXDB-1671) Order by + Limit 0 results in NPE

[ASF subversion and git services (JIRA)]

[ 
https://issues.apache.org/jira/browse/ASTERIXDB-1671?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15545990#comment-15545990
 ] 

ASF subversion and git services commented on ASTERIXDB-1671:


Commit 6adeec2d19f0051d5696f9453e52b86e7a02461d in asterixdb's branch 
refs/heads/master from [~buyingyi]
[ https://git-wip-us.apache.org/repos/asf?p=asterixdb.git;h=6adeec2 ]

ASTERIXDB-1671: fix non-positive limit with order by.

Change-Id: Id28218c100e4cca0f94e37eda82d3bc6ae78322f
Reviewed-on: https://asterix-gerrit.ics.uci.edu/1240
Sonar-Qube: Jenkins 
Tested-by: Jenkins 
Reviewed-by: Till Westmann 
Integration-Tests: Jenkins 
Reviewed-by: Taewoo Kim 


> Order by + Limit 0 results in NPE
> -
>
> Key: ASTERIXDB-1671
> URL: https://issues.apache.org/jira/browse/ASTERIXDB-1671
> Project: Apache AsterixDB
>  Issue Type: Bug
>Reporter: Yingyi Bu
>Assignee: Yingyi Bu
>
> query:
> {noformat}
> select * from Metadata.`Dataset` order by DatasetName limit 0;
> {noformat}
> stack trace:
> {noformat}
> Caused by: java.lang.NullPointerException
> at 
> org.apache.hyracks.dataflow.std.sort.TupleSorterHeapSort$HeapEntry.reset(TupleSorterHeapSort.java:102)
>  ~[hyracks-dataflow-std-0.2.18-SNAPSHOT.jar:0.2.18-SNAPSHOT]
> at 
> org.apache.hyracks.dataflow.std.sort.TupleSorterHeapSort$HeapEntry.reset(TupleSorterHeapSort.java:57)
>  ~[hyracks-dataflow-std-0.2.18-SNAPSHOT.jar:0.2.18-SNAPSHOT]
> at 
> org.apache.hyracks.dataflow.std.structures.MaxHeap.peekMax(MaxHeap.java:58) 
> ~[hyracks-dataflow-std-0.2.18-SNAPSHOT.jar:0.2.18-SNAPSHOT]
> at 
> org.apache.hyracks.dataflow.std.sort.TupleSorterHeapSort.insertTuple(TupleSorterHeapSort.java:159)
>  ~[hyracks-dataflow-std-0.2.18-SNAPSHOT.jar:0.2.18-SNAPSHOT]
> at 
> org.apache.hyracks.dataflow.std.sort.HybridTopKSortRunGenerator.nextFrame(HybridTopKSortRunGenerator.java:74)
>  ~[hyracks-dataflow-std-0.2.18-SNAPSHOT.jar:0.2.18-SNAPSHOT]
> at 
> org.apache.hyracks.dataflow.std.sort.AbstractSorterOperatorDescriptor$SortActivity$1.nextFrame(AbstractSorterOperatorDescriptor.java:125)
>  ~[hyracks-dataflow-std-0.2.18-SNAPSHOT.jar:0.2.18-SNAPSHOT]
> at 
> org.apache.hyracks.dataflow.common.comm.io.AbstractFrameAppender.write(AbstractFrameAppender.java:92)
>  ~[hyracks-dataflow-common-0.2.18-SNAPSHOT.jar:0.2.18-SNAPSHOT]
> at 
> org.apache.hyracks.algebricks.runtime.operators.base.AbstractOneInputOneOutputOneFramePushRuntime.flushAndReset(AbstractOneInputOneOutputOneFramePushRuntime.java:63)
>  ~[algebricks-runtime-0.2.18-SNAPSHOT.jar:0.2.18-SNAPSHOT]
> at 
> org.apache.hyracks.algebricks.runtime.operators.base.AbstractOneInputOneOutputOneFramePushRuntime.flushIfNotFailed(AbstractOneInputOneOutputOneFramePushRuntime.java:69)
>  ~[algebricks-runtime-0.2.18-SNAPSHOT.jar:0.2.18-SNAPSHOT]
> at 
> org.apache.hyracks.algebricks.runtime.operators.base.AbstractOneInputOneOutputOneFramePushRuntime.close(AbstractOneInputOneOutputOneFramePushRuntime.java:55)
>  ~[algebricks-runtime-0.2.18-SNAPSHOT.jar:0.2.18-SNAPSHOT]
> at 
> org.apache.hyracks.algebricks.runtime.operators.meta.AlgebricksMetaOperatorDescriptor$2.close(AlgebricksMetaOperatorDescriptor.java:153)
>  ~[algebricks-runtime-0.2.18-SNAPSHOT.jar:0.2.18-SNAPSHOT]
> at 
> org.apache.hyracks.storage.am.common.dataflow.IndexSearchOperatorNodePushable.close(IndexSearchOperatorNodePushable.java:230)
>  ~[hyracks-storage-am-common-0.2.18-SNAPSHOT.jar:0.2.18-SNAPSHOT]
> at 
> org.apache.hyracks.algebricks.runtime.operators.std.EmptyTupleSourceRuntimeFactory$1.close(EmptyTupleSourceRuntimeFactory.java:60)
>  ~[algebricks-runtime-0.2.18-SNAPSHOT.jar:0.2.18-SNAPSHOT]
> at 
> org.apache.hyracks.algebricks.runtime.operators.meta.AlgebricksMetaOperatorDescriptor$1.initialize(AlgebricksMetaOperatorDescriptor.java:116)
>  ~[algebricks-runtime-0.2.18-SNAPSHOT.jar:0.2.18-SNAPSHOT]
> at 
> org.apache.hyracks.api.rewriter.runtime.SuperActivityOperatorNodePushable.lambda$initialize$0(SuperActivityOperatorNodePushable.java:83)
>  ~[hyracks-api-0.2.18-SNAPSHOT.jar:0.2.18-SNAPSHOT]
> at 
> org.apache.hyracks.api.rewriter.runtime.SuperActivityOperatorNodePushable$$Lambda$10/1701417721.runAction(Unknown
>  Source) ~[?:?]
> at 
> org.apache.hyracks.api.rewriter.runtime.SuperActivityOperatorNodePushable$1.call(SuperActivityOperatorNodePushable.java:205)
>  ~[hyracks-api-0.2.18-SNAPSHOT.jar:0.2.18-SNAPSHOT]
> at 
> org.apache.hyracks.api.rewriter.runtime.SuperActivityOperatorNodePushable$1.call(SuperActivityOperatorNodePushable.java:202)
>  ~[hyracks-api-0.2.18-SNAPSHOT.jar:0.2.18-SNAPSHOT]
> 

[jira] [Commented] (ASTERIXDB-1626) Multiple global aggregations result in sub-optimal plan

[ASF subversion and git services (JIRA)]

[ 
https://issues.apache.org/jira/browse/ASTERIXDB-1626?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15502501#comment-15502501
 ] 

ASF subversion and git services commented on ASTERIXDB-1626:


Commit 4b30d79012e7bc8283ae6506cc381078fe92ea6c in asterixdb's branch 
refs/heads/master from [~buyingyi]
[ https://git-wip-us.apache.org/repos/asf?p=asterixdb.git;h=4b30d79 ]

ASTERIXDB-1626: performance improvement for multiple global aggregates.

- add a groupAll option for preclustered group-by.
- the listify function is removed in multiple global aggregate plans.

Change-Id: I85bb47748950cc909ddbd9720f613e0b8956d320
Reviewed-on: https://asterix-gerrit.ics.uci.edu/1185
Tested-by: Jenkins 
Reviewed-by: Till Westmann 
Integration-Tests: Jenkins 


> Multiple global aggregations result in sub-optimal plan
> ---
>
> Key: ASTERIXDB-1626
> URL: https://issues.apache.org/jira/browse/ASTERIXDB-1626
> Project: Apache AsterixDB
>  Issue Type: Bug
>  Components: Optimizer
>Reporter: Yingyi Bu
>Assignee: Yingyi Bu
>  Labels: soon
>
> query:
> {noformat}
> Select count(*), avg(I_ID) 
> FROM  items;
> {noformat}
> {noformat}
> istribute result [%0->$$24]
> -- DISTRIBUTE_RESULT  |UNPARTITIONED|
>   exchange
>   -- ONE_TO_ONE_EXCHANGE  |UNPARTITIONED|
> project ([$$24])
> -- STREAM_PROJECT  |UNPARTITIONED|
>   assign [$$24] <- [function-call: asterix:closed-record-constructor, 
> Args:[AString: {$1}, function-call: asterix:sql-count, Args:[%0->$$19], 
> AString: {$2}, function-call: asterix:sql-avg, Args:[%0->$$23]]]
>   -- ASSIGN  |UNPARTITIONED|
> project ([$$19, $$23])
> -- STREAM_PROJECT  |UNPARTITIONED|
>   subplan {
> aggregate [$$23] <- [function-call: asterix:listify, 
> Args:[%0->$$22]]
> -- AGGREGATE  |UNPARTITIONED|
>   assign [$$22] <- [function-call: 
> asterix:field-access-by-name, Args:[%0->$$27, AString: {I_ID}]]
>   -- ASSIGN  |UNPARTITIONED|
> assign [$$27] <- [function-call: 
> asterix:field-access-by-index, Args:[%0->$$12, AInt32: {0}]]
> -- ASSIGN  |UNPARTITIONED|
>   unnest $$12 <- function-call: 
> asterix:scan-collection, Args:[%0->$$15]
>   -- UNNEST  |UNPARTITIONED|
> nested tuple source
> -- NESTED_TUPLE_SOURCE  |UNPARTITIONED|
>  }
>   -- SUBPLAN  |UNPARTITIONED|
> project ([$$19, $$15])
> -- STREAM_PROJECT  |UNPARTITIONED|
>   subplan {
> aggregate [$$19] <- [function-call: asterix:listify, 
> Args:[%0->$$18]]
> -- AGGREGATE  |UNPARTITIONED|
>   unnest $$11 <- function-call: 
> asterix:scan-collection, Args:[%0->$$15]
>   -- UNNEST  |UNPARTITIONED|
> nested tuple source
> -- NESTED_TUPLE_SOURCE  |UNPARTITIONED|
>  }
>   -- SUBPLAN  |UNPARTITIONED|
> assign [$$18] <- [AInt64: {1}]
> -- ASSIGN  |UNPARTITIONED|
>   aggregate [$$15] <- [function-call: asterix:listify, 
> Args:[%0->$$10]]
>   -- AGGREGATE  |UNPARTITIONED|
> exchange
> -- RANDOM_MERGE_EXCHANGE  |PARTITIONED|
>   project ([$$10])
>   -- STREAM_PROJECT  |PARTITIONED|
> assign [$$10] <- [function-call: 
> asterix:closed-record-constructor, Args:[AString: {items}, %0->$$7]]
> -- ASSIGN  |PARTITIONED|
>   project ([$$7])
>   -- STREAM_PROJECT  |PARTITIONED|
> exchange
> -- ONE_TO_ONE_EXCHANGE  |PARTITIONED|
>   data-scan []<-[$$25, $$7, $$26] <- 
> CouchbaseAnalytics:items
>   -- DATASOURCE_SCAN  |PARTITIONED|
> exchange
> -- ONE_TO_ONE_EXCHANGE  |PARTITIONED|
>   empty-tuple-source
>   -- EMPTY_TUPLE_SOURCE  |PARTITIONED|
> {noformat}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (ASTERIXDB-1652) dataverse.f() ignores dataverse if f is a builtin function

[ASF subversion and git services (JIRA)]

[ 
https://issues.apache.org/jira/browse/ASTERIXDB-1652?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15511752#comment-15511752
 ] 

ASF subversion and git services commented on ASTERIXDB-1652:


Commit 83108375a45ffe9d81c9e3305595803066bc6139 in asterixdb's branch 
refs/heads/master from [~buyingyi]
[ https://git-wip-us.apache.org/repos/asf?p=asterixdb.git;h=8310837 ]

ASTERIXDB-1652: fix dataverse.function(...) to check the existence of the 
dataverse.

Change-Id: I7779db56f540fdd645bb85c769baeaa37f620a0d
Reviewed-on: https://asterix-gerrit.ics.uci.edu/1192
Reviewed-by: Till Westmann 
Tested-by: Jenkins 
Integration-Tests: Jenkins 


> dataverse.f() ignores dataverse if f is a builtin function
> --
>
> Key: ASTERIXDB-1652
> URL: https://issues.apache.org/jira/browse/ASTERIXDB-1652
> Project: Apache AsterixDB
>  Issue Type: Bug
>  Components: Functions - AQL
>Reporter: Yingyi Bu
>Assignee: Yingyi Bu
>
> SQL++ query:
> test.length("test");
> This query should be errored out if dataverse test doesn't exist.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (ASTERIXDB-1081) RemoveUnusedAssignAndAggregateRule bug - removes a variable that is used

[ASF subversion and git services (JIRA)]

[ 
https://issues.apache.org/jira/browse/ASTERIXDB-1081?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15507962#comment-15507962
 ] 

ASF subversion and git services commented on ASTERIXDB-1081:


Commit e89ad03baa16e92b3116e2c49e48d8e7fe6f2789 in asterixdb's branch 
refs/heads/master from [~wangsaeu]
[ https://git-wip-us.apache.org/repos/asf?p=asterixdb.git;h=e89ad03 ]

ASTERIXDB-1081, ASTERIXDB-1086, ASTERIXDB-1246: proper multiple plan paths 
handling

 - ASTERIXDB-1081: Fixed RemoveUnusedAssignAndAggregateRule to reflect multiple 
paths in the plan.
 - ASTERIXDB-1086: Fixed IntroduceProjectsRule to reflect multiples paths in 
the plan.
 - ASTERIXDB-1246: Fixed RemoveRedundantGroupByDecorVarsRule to remove 
duplicate/unnecessary
   decor variables before IntroduceProjects rule fires.

Change-Id: I69e055572f024f28a857d4e64916b4806e63c083
Reviewed-on: https://asterix-gerrit.ics.uci.edu/1073
Sonar-Qube: Jenkins 
Tested-by: Jenkins 
Reviewed-by: Yingyi Bu 
Integration-Tests: Jenkins 


> RemoveUnusedAssignAndAggregateRule bug - removes a variable that is used
> 
>
> Key: ASTERIXDB-1081
> URL: https://issues.apache.org/jira/browse/ASTERIXDB-1081
> Project: Apache AsterixDB
>  Issue Type: Bug
>  Components: AsterixDB, Optimizer
>Reporter: Taewoo Kim
>Assignee: Taewoo Kim
>  Labels: with-index-only
>
> RemoveUnusedAssignAndAggregateRule removes a variable that is used in the one 
> of two paths after SPLIT (REPLICATE) operator. In my branch, I am trying to 
> optimize the index-search. In order to implement this, there is an ASSIGN 
> operator and it assigns a variable that is going to be used in the SELECT 
> operator. After ASSIGN, there is SPLIT operator. It divides the path into two 
> - the left path contains the SELECT and the other path contains no operator. 
> Two paths will be merged by UNION operator. 
> The issue is RemoveUnusedAssignAndAggregateRule can't consider all paths at 
> the same time. Thus, when it checks the right path, it removes one variable 
> in the ASSIGN before SPLIT since it thinks that the variable is not used 
> after ASSIGN operator. In fact, the variable is used in the left path. 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (ASTERIXDB-1246) Unnecessary decor variables of a group-by are not removed until PushProjectDownRule is fired.

[ASF subversion and git services (JIRA)]

[ 
https://issues.apache.org/jira/browse/ASTERIXDB-1246?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15507964#comment-15507964
 ] 

ASF subversion and git services commented on ASTERIXDB-1246:


Commit e89ad03baa16e92b3116e2c49e48d8e7fe6f2789 in asterixdb's branch 
refs/heads/master from [~wangsaeu]
[ https://git-wip-us.apache.org/repos/asf?p=asterixdb.git;h=e89ad03 ]

ASTERIXDB-1081, ASTERIXDB-1086, ASTERIXDB-1246: proper multiple plan paths 
handling

 - ASTERIXDB-1081: Fixed RemoveUnusedAssignAndAggregateRule to reflect multiple 
paths in the plan.
 - ASTERIXDB-1086: Fixed IntroduceProjectsRule to reflect multiples paths in 
the plan.
 - ASTERIXDB-1246: Fixed RemoveRedundantGroupByDecorVarsRule to remove 
duplicate/unnecessary
   decor variables before IntroduceProjects rule fires.

Change-Id: I69e055572f024f28a857d4e64916b4806e63c083
Reviewed-on: https://asterix-gerrit.ics.uci.edu/1073
Sonar-Qube: Jenkins 
Tested-by: Jenkins 
Reviewed-by: Yingyi Bu 
Integration-Tests: Jenkins 


> Unnecessary decor variables of a group-by are not removed until 
> PushProjectDownRule is fired.
> -
>
> Key: ASTERIXDB-1246
> URL: https://issues.apache.org/jira/browse/ASTERIXDB-1246
> Project: Apache AsterixDB
>  Issue Type: Bug
>Reporter: Taewoo Kim
>Assignee: Taewoo Kim
>
> Unnecessary decor variables of a group-by is not removed until 
> PushProjectDownRule is fired.
> Currently, group-by for a subplan is introduced when 
> IntroduceGroupByForSubplanRule is fired. At this time, decor variables for 
> the new group-by operator are also added based on the variable usage after 
> the new group-by operator.
> After this rule, other optimizations might make decor variables unnecessary. 
> One example is that an assign after group-by can be moved before the group-by 
> operator so that a record variable (e.g., $$0) that is required for the given 
> assign does not need to be passed through the group-by operator. These 
> unnecessary decor variables will be removed only when PushProjectDownRule is 
> fired. 
> As the rule name suggests, PushProjectDownRule rule will be fired only when 
> we have a project operator in the plan. Currently in my branch (index-only 
> plan branch), this affects the IntroduceSelectAccessMethodRule, which 
> transforms a plan into indexes-utilization plan. In this rule, it checks 
> whether the given plan is an index-only plan by checking variables used after 
> a SELECT operator. If only secondary key and/or primary key are used, then 
> the given plan is an index-only plan and we can use a secodnary-index search 
> to return SK and PK. 
> The issue is that IntroduceSelectAccessMethodRule is fired before 
> PushProjectDownRule and generally there is no project is introduced in the 
> plan before IntroduceSelectAccessMethodRule. So, these unnecessary decor 
> variables are not used; however, they still sit in the plan so that the 
> optimizer wrongly decides the given plan as a non-index-only plan. The 
> following is an example query. If we have a secondary index on count1 
> (PK:tweetid), then this should be qualified as an index-only plan for the 
> outer branch. In fact, it doesn't because of unnecessary decor variables that 
> still sit after some optimizations.
> for $t1 in dataset('TweetMessages')
> where $t1.countA > 0
> return {
> "tweetid1": $t1.tweetid,
> "count1":$t1.countA,
> "t2info": for $t2 in dataset('TweetMessages')
> where $t1.countA /* +indexnl */= $t2.tweetid
> return {"tweetid2": $t2.tweetid,
> "count2": $t2.countB}
> }
> We can separate PushProjectDownRule rule into two rules: push project down 
> and clean decor variables. 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (ASTERIXDB-1086) IntroduceProjectsRule creates a wrong PROJECT operator when there are multiple paths.

[ASF subversion and git services (JIRA)]

[ 
https://issues.apache.org/jira/browse/ASTERIXDB-1086?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15507966#comment-15507966
 ] 

ASF subversion and git services commented on ASTERIXDB-1086:


Commit e89ad03baa16e92b3116e2c49e48d8e7fe6f2789 in asterixdb's branch 
refs/heads/master from [~wangsaeu]
[ https://git-wip-us.apache.org/repos/asf?p=asterixdb.git;h=e89ad03 ]

ASTERIXDB-1081, ASTERIXDB-1086, ASTERIXDB-1246: proper multiple plan paths 
handling

 - ASTERIXDB-1081: Fixed RemoveUnusedAssignAndAggregateRule to reflect multiple 
paths in the plan.
 - ASTERIXDB-1086: Fixed IntroduceProjectsRule to reflect multiples paths in 
the plan.
 - ASTERIXDB-1246: Fixed RemoveRedundantGroupByDecorVarsRule to remove 
duplicate/unnecessary
   decor variables before IntroduceProjects rule fires.

Change-Id: I69e055572f024f28a857d4e64916b4806e63c083
Reviewed-on: https://asterix-gerrit.ics.uci.edu/1073
Sonar-Qube: Jenkins 
Tested-by: Jenkins 
Reviewed-by: Yingyi Bu 
Integration-Tests: Jenkins 


> IntroduceProjectsRule creates a wrong PROJECT operator when there are 
> multiple paths.
> -
>
> Key: ASTERIXDB-1086
> URL: https://issues.apache.org/jira/browse/ASTERIXDB-1086
> Project: Apache AsterixDB
>  Issue Type: Bug
>  Components: AsterixDB, Optimizer
>Reporter: Taewoo Kim
>Assignee: Taewoo Kim
>  Labels: with-index-only
>
> IntroduceProjectsRule introduce a wrong project to filter out a variable that 
> is used in the one of two paths after SPLIT (REPLICATE) operator. In my 
> branch, I am trying to optimize the index-search. In order to implement this, 
> there is an ASSIGN operator and it assigns a variable that is going to be 
> used in the SELECT operator. After ASSIGN, there is SPLIT operator. It 
> divides the path into two - the left path contains the SELECT and the other 
> path contains no operator. Two paths will be merged by UNION operator. The 
> issue is IntroduceProjectRule can't consider all paths at the same time. 
> Thus, when it checks the right path, it introduces a wrong PROJECT operator 
> that filters out one variable in the ASSIGN before SPLIT since it thinks that 
> the variable is not used after ASSIGN operator. In fact, the variable is used 
> in the left path.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (ASTERIXDB-1081) RemoveUnusedAssignAndAggregateRule bug - removes a variable that is used

[ASF subversion and git services (JIRA)]

[ 
https://issues.apache.org/jira/browse/ASTERIXDB-1081?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15507965#comment-15507965
 ] 

ASF subversion and git services commented on ASTERIXDB-1081:


Commit e89ad03baa16e92b3116e2c49e48d8e7fe6f2789 in asterixdb's branch 
refs/heads/master from [~wangsaeu]
[ https://git-wip-us.apache.org/repos/asf?p=asterixdb.git;h=e89ad03 ]

ASTERIXDB-1081, ASTERIXDB-1086, ASTERIXDB-1246: proper multiple plan paths 
handling

 - ASTERIXDB-1081: Fixed RemoveUnusedAssignAndAggregateRule to reflect multiple 
paths in the plan.
 - ASTERIXDB-1086: Fixed IntroduceProjectsRule to reflect multiples paths in 
the plan.
 - ASTERIXDB-1246: Fixed RemoveRedundantGroupByDecorVarsRule to remove 
duplicate/unnecessary
   decor variables before IntroduceProjects rule fires.

Change-Id: I69e055572f024f28a857d4e64916b4806e63c083
Reviewed-on: https://asterix-gerrit.ics.uci.edu/1073
Sonar-Qube: Jenkins 
Tested-by: Jenkins 
Reviewed-by: Yingyi Bu 
Integration-Tests: Jenkins 


> RemoveUnusedAssignAndAggregateRule bug - removes a variable that is used
> 
>
> Key: ASTERIXDB-1081
> URL: https://issues.apache.org/jira/browse/ASTERIXDB-1081
> Project: Apache AsterixDB
>  Issue Type: Bug
>  Components: AsterixDB, Optimizer
>Reporter: Taewoo Kim
>Assignee: Taewoo Kim
>  Labels: with-index-only
>
> RemoveUnusedAssignAndAggregateRule removes a variable that is used in the one 
> of two paths after SPLIT (REPLICATE) operator. In my branch, I am trying to 
> optimize the index-search. In order to implement this, there is an ASSIGN 
> operator and it assigns a variable that is going to be used in the SELECT 
> operator. After ASSIGN, there is SPLIT operator. It divides the path into two 
> - the left path contains the SELECT and the other path contains no operator. 
> Two paths will be merged by UNION operator. 
> The issue is RemoveUnusedAssignAndAggregateRule can't consider all paths at 
> the same time. Thus, when it checks the right path, it removes one variable 
> in the ASSIGN before SPLIT since it thinks that the variable is not used 
> after ASSIGN operator. In fact, the variable is used in the left path. 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (ASTERIXDB-1246) Unnecessary decor variables of a group-by are not removed until PushProjectDownRule is fired.

[ASF subversion and git services (JIRA)]

[ 
https://issues.apache.org/jira/browse/ASTERIXDB-1246?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15507968#comment-15507968
 ] 

ASF subversion and git services commented on ASTERIXDB-1246:


Commit e89ad03baa16e92b3116e2c49e48d8e7fe6f2789 in asterixdb's branch 
refs/heads/master from [~wangsaeu]
[ https://git-wip-us.apache.org/repos/asf?p=asterixdb.git;h=e89ad03 ]

ASTERIXDB-1081, ASTERIXDB-1086, ASTERIXDB-1246: proper multiple plan paths 
handling

 - ASTERIXDB-1081: Fixed RemoveUnusedAssignAndAggregateRule to reflect multiple 
paths in the plan.
 - ASTERIXDB-1086: Fixed IntroduceProjectsRule to reflect multiples paths in 
the plan.
 - ASTERIXDB-1246: Fixed RemoveRedundantGroupByDecorVarsRule to remove 
duplicate/unnecessary
   decor variables before IntroduceProjects rule fires.

Change-Id: I69e055572f024f28a857d4e64916b4806e63c083
Reviewed-on: https://asterix-gerrit.ics.uci.edu/1073
Sonar-Qube: Jenkins 
Tested-by: Jenkins 
Reviewed-by: Yingyi Bu 
Integration-Tests: Jenkins 


> Unnecessary decor variables of a group-by are not removed until 
> PushProjectDownRule is fired.
> -
>
> Key: ASTERIXDB-1246
> URL: https://issues.apache.org/jira/browse/ASTERIXDB-1246
> Project: Apache AsterixDB
>  Issue Type: Bug
>Reporter: Taewoo Kim
>Assignee: Taewoo Kim
>
> Unnecessary decor variables of a group-by is not removed until 
> PushProjectDownRule is fired.
> Currently, group-by for a subplan is introduced when 
> IntroduceGroupByForSubplanRule is fired. At this time, decor variables for 
> the new group-by operator are also added based on the variable usage after 
> the new group-by operator.
> After this rule, other optimizations might make decor variables unnecessary. 
> One example is that an assign after group-by can be moved before the group-by 
> operator so that a record variable (e.g., $$0) that is required for the given 
> assign does not need to be passed through the group-by operator. These 
> unnecessary decor variables will be removed only when PushProjectDownRule is 
> fired. 
> As the rule name suggests, PushProjectDownRule rule will be fired only when 
> we have a project operator in the plan. Currently in my branch (index-only 
> plan branch), this affects the IntroduceSelectAccessMethodRule, which 
> transforms a plan into indexes-utilization plan. In this rule, it checks 
> whether the given plan is an index-only plan by checking variables used after 
> a SELECT operator. If only secondary key and/or primary key are used, then 
> the given plan is an index-only plan and we can use a secodnary-index search 
> to return SK and PK. 
> The issue is that IntroduceSelectAccessMethodRule is fired before 
> PushProjectDownRule and generally there is no project is introduced in the 
> plan before IntroduceSelectAccessMethodRule. So, these unnecessary decor 
> variables are not used; however, they still sit in the plan so that the 
> optimizer wrongly decides the given plan as a non-index-only plan. The 
> following is an example query. If we have a secondary index on count1 
> (PK:tweetid), then this should be qualified as an index-only plan for the 
> outer branch. In fact, it doesn't because of unnecessary decor variables that 
> still sit after some optimizations.
> for $t1 in dataset('TweetMessages')
> where $t1.countA > 0
> return {
> "tweetid1": $t1.tweetid,
> "count1":$t1.countA,
> "t2info": for $t2 in dataset('TweetMessages')
> where $t1.countA /* +indexnl */= $t2.tweetid
> return {"tweetid2": $t2.tweetid,
> "count2": $t2.countB}
> }
> We can separate PushProjectDownRule rule into two rules: push project down 
> and clean decor variables. 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (ASTERIXDB-1631) TypeComputeUtils doesn't work well with type ANY

[ASF subversion and git services (JIRA)]

[ 
https://issues.apache.org/jira/browse/ASTERIXDB-1631?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15508845#comment-15508845
 ] 

ASF subversion and git services commented on ASTERIXDB-1631:


Commit 2816885d1a4a2efd969df78abc0b735e40f65a38 in asterixdb's branch 
refs/heads/master from [~buyingyi]
[ https://git-wip-us.apache.org/repos/asf?p=asterixdb.git;h=2816885 ]

ASTERIXDB-1631: let TypeComputeUtils handle input type ANY properly.

Change-Id: Ie6b3f0e9d9b4ddd9280e06f72a5ca30aa776315d
Reviewed-on: https://asterix-gerrit.ics.uci.edu/1191
Sonar-Qube: Jenkins 
Tested-by: Jenkins 
Integration-Tests: Jenkins 
Reviewed-by: Till Westmann 


> TypeComputeUtils doesn't work well with type ANY
> 
>
> Key: ASTERIXDB-1631
> URL: https://issues.apache.org/jira/browse/ASTERIXDB-1631
> Project: Apache AsterixDB
>  Issue Type: Bug
>Reporter: Abdullah Alamoudi
>Assignee: Yingyi Bu
>
> Type ANY can be nullable or missable but it is not treated that way.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (ASTERIXDB-1587) upsert runtime assumes that the datatype comes from the same dataverse as the dataset

[ASF subversion and git services (JIRA)]

[ 
https://issues.apache.org/jira/browse/ASTERIXDB-1587?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15425696#comment-15425696
 ] 

ASF subversion and git services commented on ASTERIXDB-1587:


Commit ddc760f59b906e3124a5da7d73fa7d3575fd79b1 in asterixdb's branch 
refs/heads/master from [~sjaco002]
[ https://git-wip-us.apache.org/repos/asf?p=asterixdb.git;h=ddc760f ]

ASTERIXDB-1587 Made upsert look in the correct dataverse for datatypes

Change-Id: Iccf04c2210a1535cd7de6eeea88dfefec9ba206a
Reviewed-on: https://asterix-gerrit.ics.uci.edu/1085
Reviewed-by: Preston Carman 
Sonar-Qube: Jenkins 
Tested-by: Jenkins 


> upsert runtime assumes that the datatype comes from the same dataverse as the 
> dataset
> -
>
> Key: ASTERIXDB-1587
> URL: https://issues.apache.org/jira/browse/ASTERIXDB-1587
> Project: Apache AsterixDB
>  Issue Type: Bug
>Reporter: Steven Jacobs
>Assignee: Steven Jacobs
>
> It throws an error if they aren't from the same dataverse. It should work 
> instead.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (ASTERIXDB-159) count( dataset('dataset-name') ); should return count

[ASF subversion and git services (JIRA)]

[ 
https://issues.apache.org/jira/browse/ASTERIXDB-159?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15442796#comment-15442796
 ] 

ASF subversion and git services commented on ASTERIXDB-159:
---

Commit 8fec331e46539bd85d5988937626b6c8907a9396 in asterixdb's branch 
refs/heads/master from [~buyingyi]
[ https://git-wip-us.apache.org/repos/asf?p=asterixdb.git;h=8fec331 ]

ASTERIXDB-1577: fix error handling for field access over a dataset.

- add a rewrite rule to handle unnesting functions that do not appear
  in an unnest operator or left outer unnest operator;
- ASTERIXDB-159 is fixed as well.

Change-Id: Id0dc4db91a6251d55dafd734d9ea5bfb6c11c315
Reviewed-on: https://asterix-gerrit.ics.uci.edu/1113
Sonar-Qube: Jenkins 
Tested-by: Jenkins 
Integration-Tests: Jenkins 
Reviewed-by: Yingyi Bu 


> count( dataset('dataset-name') ); should return count
> -
>
> Key: ASTERIXDB-159
> URL: https://issues.apache.org/jira/browse/ASTERIXDB-159
> Project: Apache AsterixDB
>  Issue Type: Bug
>  Components: AsterixDB, Optimizer
>Reporter: Khurram Faraaz
>Assignee: Yingyi Bu
>Priority: Minor
>
> count( dataset('dataset-name') ); should return count



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (ASTERIXDB-1534) NPE when restart the server

[ASF subversion and git services (JIRA)]

[ 
https://issues.apache.org/jira/browse/ASTERIXDB-1534?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15439624#comment-15439624
 ] 

ASF subversion and git services commented on ASTERIXDB-1534:


Commit 82ac2f006453ac88ad3c7f742a5933f1424a73ea in asterixdb's branch 
refs/heads/master from [~imaxon]
[ https://git-wip-us.apache.org/repos/asf?p=asterixdb.git;h=82ac2f0 ]

Fixes related to ASTERIXDB-1534

- Cleanup boolean conditions and exceptions from SonarQube comments
- Fix issue where filter page in on-disk LSM components
  can be confused with root page on restart

Change-Id: If51e0cd183f9d5ed6edaebef4a0568a6c67062e3
Reviewed-on: https://asterix-gerrit.ics.uci.edu/
Sonar-Qube: Jenkins 
Tested-by: Jenkins 
Integration-Tests: Jenkins 
Reviewed-by: Jianfeng Jia 
Reviewed-by: Michael Blow 


> NPE when restart the server
> ---
>
> Key: ASTERIXDB-1534
> URL: https://issues.apache.org/jira/browse/ASTERIXDB-1534
> Project: Apache AsterixDB
>  Issue Type: Bug
>  Components: Storage
> Environment: master 
> commit a89fae64ac21fb8eefde79f79d2dbe1a0e54c364
> Date:   Wed Jul 6 07:58:55 2016 -0700
>Reporter: Jianfeng Jia
>Assignee: Ian Maxon
>Priority: Blocker
>  Labels: soon
> Attachments: asterix-configuration.xml, ingest.sh
>
>
> When I stop and start the cluster by managix, I hit the following error:
> {code}
> ERROR: 
> /rhome/jianfeng/managix/home/asterix/cloudberry/.nfs02180534118e 
> (No such file or directory)
> j
> {code}
> And no nc and cc got started.
> After a while, I ran the managix start again, the cluster restart 
> successfully. 
> But one of the dataset  can't answer any queries. The simplest select query
> {code}
> for $t in dataset twitter.ds_tweet limit 5 return $t
> {code}
>  will give me the following error:
> {code}
> Caused by: org.apache.hyracks.api.exceptions.HyracksDataException: 
> org.apache.hyracks.api.exceptions.HyracksDataException: 
> java.util.concurrent.ExecutionException: 
> org.apache.hyracks.api.exceptions.HyracksDataException: 
> java.lang.NullPointerException
> at 
> org.apache.hyracks.control.common.utils.ExceptionUtils.setNodeIds(ExceptionUtils.java:45)
> at org.apache.hyracks.control.nc.Task.run(Task.java:319)
> ... 3 more
> Caused by: org.apache.hyracks.api.exceptions.HyracksDataException: 
> java.util.concurrent.ExecutionException: 
> org.apache.hyracks.api.exceptions.HyracksDataException: 
> java.lang.NullPointerException
> at 
> org.apache.hyracks.api.rewriter.runtime.SuperActivityOperatorNodePushable.runInParallel(SuperActivityOperatorNodePushable.java:218)
> at 
> org.apache.hyracks.api.rewriter.runtime.SuperActivityOperatorNodePushable.initialize(SuperActivityOperatorNodePushable.java:83)
> at org.apache.hyracks.control.nc.Task.run(Task.java:263)
> ... 3 more
> Caused by: java.util.concurrent.ExecutionException: 
> org.apache.hyracks.api.exceptions.HyracksDataException: 
> java.lang.NullPointerException
> at java.util.concurrent.FutureTask.report(FutureTask.java:122)
> at java.util.concurrent.FutureTask.get(FutureTask.java:192)
> at 
> org.apache.hyracks.api.rewriter.runtime.SuperActivityOperatorNodePushable.runInParallel(SuperActivityOperatorNodePushable.java:212)
> ... 5 more
> Caused by: org.apache.hyracks.api.exceptions.HyracksDataException: 
> java.lang.NullPointerException
> at 
> org.apache.hyracks.storage.am.common.dataflow.IndexSearchOperatorNodePushable.nextFrame(IndexSearchOperatorNodePushable.java:187)
> at 
> org.apache.hyracks.dataflow.common.comm.io.AbstractFrameAppender.write(AbstractFrameAppender.java:93)
> at 
> org.apache.hyracks.algebricks.runtime.operators.base.AbstractOneInputOneOutputOneFramePushRuntime.flushAndReset(AbstractOneInputOneOutputOneFramePushRuntime.java:63)
> at 
> org.apache.hyracks.algebricks.runtime.operators.base.AbstractOneInputOneOutputOneFramePushRuntime.flushIfNotFailed(AbstractOneInputOneOutputOneFramePushRuntime.java:69)
> at 
> org.apache.hyracks.algebricks.runtime.operators.base.AbstractOneInputOneOutputOneFramePushRuntime.close(AbstractOneInputOneOutputOneFramePushRuntime.java:55)
> at 
> org.apache.hyracks.algebricks.runtime.operators.std.AssignRuntimeFactory$1.close(AssignRuntimeFactory.java:122)
> at 
> org.apache.hyracks.algebricks.runtime.operators.std.EmptyTupleSourceRuntimeFactory$1.close(EmptyTupleSourceRuntimeFactory.java:60)
> at 
> org.apache.hyracks.algebricks.runtime.operators.meta.AlgebricksMetaOperatorDescriptor$1.initialize(AlgebricksMetaOperatorDescriptor.java:116)
> at 
> 

[jira] [Commented] (ASTERIXDB-1614) DatasetDirectoryService.deinitState() fix intermittently fails

[ASF subversion and git services (JIRA)]

[ 
https://issues.apache.org/jira/browse/ASTERIXDB-1614?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15444381#comment-15444381
 ] 

ASF subversion and git services commented on ASTERIXDB-1614:


Commit 2302d875f2f6e00db4d93134373806a7bfa3033e in asterixdb's branch 
refs/heads/master from [~mblow]
[ https://git-wip-us.apache.org/repos/asf?p=asterixdb.git;h=2302d87 ]

Workaround ASTERIXDB-1614

Change-Id: I6d016b680c0991c50e1a82e27f51dfcfeb2f0d97
Reviewed-on: https://asterix-gerrit.ics.uci.edu/1124
Tested-by: Jenkins 
Integration-Tests: Jenkins 
Reviewed-by: Till Westmann 


> DatasetDirectoryService.deinitState() fix intermittently fails
> --
>
> Key: ASTERIXDB-1614
> URL: https://issues.apache.org/jira/browse/ASTERIXDB-1614
> Project: Apache AsterixDB
>  Issue Type: Bug
>  Components: Hyracks
>Reporter: Michael Blow
>
> After merging a fix for type-correctness in 
> DatasetDirectoryService.deinitState(), tests started intermittently failing.  
> e.g. 
> https://asterix-jenkins.ics.uci.edu/view/All/job/asterix-integration-tests/208/
> java.lang.NullPointerException
>   at 
> org.apache.hyracks.control.cc.dataset.DatasetDirectoryService.registerResultPartitionLocation(DatasetDirectoryService.java:98)
>   at 
> org.apache.hyracks.control.cc.work.RegisterResultPartitionLocationWork.run(RegisterResultPartitionLocationWork.java:58)
>   at 
> org.apache.hyracks.control.common.work.WorkQueue$WorkerThread.run(WorkQueue.java:133)
> java.lang.NullPointerException
>   at 
> org.apache.hyracks.control.cc.dataset.DatasetDirectoryService.reportResultPartitionWriteCompletion(DatasetDirectoryService.java:133)
>   at 
> org.apache.hyracks.control.cc.work.ReportResultPartitionWriteCompletionWork.run(ReportResultPartitionWriteCompletionWork.java:45)
>   at 
> org.apache.hyracks.control.common.work.WorkQueue$WorkerThread.run(WorkQueue.java:133)
> org.apache.hyracks.api.exceptions.HyracksDataException: Requested JobId 
> JID:1968 doesn't exist
>   at 
> org.apache.hyracks.control.cc.dataset.DatasetDirectoryService.updatedRecords(DatasetDirectoryService.java:253)
>   at 
> org.apache.hyracks.control.cc.dataset.DatasetDirectoryService.getResultPartitionLocations(DatasetDirectoryService.java:210)
>   at 
> org.apache.hyracks.control.cc.work.GetResultPartitionLocationsWork$1.run(GetResultPartitionLocationsWork.java:59)
>   at 
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
>   at 
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
>   at java.lang.Thread.run(Thread.java:745)



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (ASTERIXDB-1186) Index Join Hint on an index with composite keys causes query to return incorrect results

[ASF subversion and git services (JIRA)]

[ 
https://issues.apache.org/jira/browse/ASTERIXDB-1186?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15437541#comment-15437541
 ] 

ASF subversion and git services commented on ASTERIXDB-1186:


Commit 52a9d992dfadf6bb3057968416bf217c9a42dffb in asterixdb's branch 
refs/heads/master from [~wangsaeu]
[ https://git-wip-us.apache.org/repos/asf?p=asterixdb.git;h=52a9d99 ]

ASTERIXDB-1186: fixed a composite primary index search issue.

 - Providing only one field to a composite primary index search
   now works properly by broadcasting search predicates to all nodes.

Change-Id: I0f75229ea804a02e7cacd04f7269a4907668eab0
Reviewed-on: https://asterix-gerrit.ics.uci.edu/1094
Sonar-Qube: Jenkins 
Tested-by: Jenkins 
Integration-Tests: Jenkins 
Reviewed-by: Taewoo Kim 


> Index Join Hint on an index with composite keys causes query to return 
> incorrect results
> 
>
> Key: ASTERIXDB-1186
> URL: https://issues.apache.org/jira/browse/ASTERIXDB-1186
> Project: Apache AsterixDB
>  Issue Type: Bug
>  Components: AsterixDB, Optimizer
> Environment: AsterixDB 0.8.7-SNAPSHOT
>Reporter: Pouria
>Assignee: Taewoo Kim
>Priority: Critical
>  Labels: soon
>
> If one of the attributes in the join predicate is a *composite* PK (consists 
> of more than one attribute), if the Index Join hint is used the query plan 
> includes wrong exchange (partitioning) which results in wrong results (only a 
> subset of the correct total results will be returned).
> The root cause of it is that the records from the PK side (which is 
> composite) are hash-partitioned on a "combination" of hash values of all 
> attributes in the PK. As a result the records of the non-PK side need to be 
> sent to "all" partitions, but the plan contains the wrong exchange and the 
> runtime wont send them to all partitions. 
> Below is an example:
> > Here is DDL:
> create type LineItemType as {
>   l_orderkey: int64,
>   l_partkey: int64,
>   l_suppkey: int64,
>   l_linenumber: int32,
>   l_quantity: int32,
>   l_extendedprice: double,
>   l_discount: double,
>   l_tax: double,
>   l_returnflag: string,
>   l_linestatus: string,
>   l_shipdate: string,
>   l_commitdate: string,
>   l_receiptdate: string,
>   l_shipinstruct: string,
>   l_shipmode: string,
>   l_comment: string
> }
> create type OrderType as {
>   o_orderkey: int64,
>   o_custkey: int64,
>   o_orderstatus: string,
>   o_totalprice: double,
>   o_orderdate: string,
>   o_orderpriority: string,
>   o_clerk: string,
>   o_shippriority: int32,
>   o_comment: string
> }
> create dataset LineItem(LineItemType) primary key l_orderkey, l_linenumber;
> create dataset Orders(OrderType)  primary key o_orderkey;
> > The following query returns wrong (a subset) of results:
> for $o in dataset('Orders')
> for $l in dataset('LineItem')
> where 
> $l.l_orderkey  /*+ indexnl */ = $o.o_orderkey
> return{
> "o_orderkey": $o.o_orderkey,
> "l_orderkey": $l.l_orderkey
> }
> Here is the plan - As you can see the Orders record are One-on-One exchanged 
> (rather than broadcast). The issue is that the l_orderkey is not the 
> partitioning attribute of LineItem, and matching Orders for a specific 
> order_key can be in any partition (depending on their l_linenumber value - 
> which is the 2nd component of PK in LineItem)
> distribute result [%0->$$13]
> -- DISTRIBUTE_RESULT  |UNPARTITIONED|
>   exchange 
>   -- ONE_TO_ONE_EXCHANGE  |UNPARTITIONED|
> aggregate [$$13] <- [function-call: asterix:agg-sum, Args:[%0->$$19]]
> -- AGGREGATE  |UNPARTITIONED|
>   exchange 
>   -- RANDOM_MERGE_EXCHANGE  |PARTITIONED|
> aggregate [$$19] <- [function-call: asterix:agg-count, Args:[%0->$$9]]
> -- AGGREGATE  |PARTITIONED|
>   project ([$$9])
>   -- STREAM_PROJECT  |PARTITIONED|
> assign [$$9] <- [function-call: 
> asterix:closed-record-constructor, Args:[AString: {o_orderkey}, %0->$$16, 
> AString: {l_orderkey}, %0->$$17]]
> -- ASSIGN  |PARTITIONED|
>   project ([$$17, $$16])
>   -- STREAM_PROJECT  |PARTITIONED|
> exchange 
> -- ONE_TO_ONE_EXCHANGE  |PARTITIONED|
>   unnest-map [$$17, $$18, $$1] <- function-call: 
> asterix:index-search, Args:[AString: {LineItem}, AInt32: {0}, AString: 
> {dummy}, AString: {LineItem}, ABoolean: {true}, ABoolean: {false}, ABoolean: 
> {true}, AInt32: {1}, %0->$$16, AInt32: {1}, %0->$$16, TRUE, TRUE, TRUE]
>   -- BTREE_SEARCH  |PARTITIONED|
> exchange 
> -- ONE_TO_ONE_EXCHANGE  |PARTITIONED|
>  

[jira] [Commented] (ASTERIXDB-1597) Ordering by aggregated field throws NullPointerException

[ASF subversion and git services (JIRA)]

[ 
https://issues.apache.org/jira/browse/ASTERIXDB-1597?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15438471#comment-15438471
 ] 

ASF subversion and git services commented on ASTERIXDB-1597:


Commit e6a6cc392dd84aac1a088803ab5fecd67b00dc9f in asterixdb's branch 
refs/heads/master from [~buyingyi]
[ https://git-wip-us.apache.org/repos/asf?p=asterixdb.git;h=e6a6cc3 ]

ASTERIXDB-1597: fix and add a regression test.

- Change the order of rule applications, let 
PushAggFuncIntoStandaloneAggregateRule
  run after ExtractCommonExpressionsRule

Change-Id: Ifc7d757f4d0073dc00a5b2a5aca16581f12cec1d
Reviewed-on: https://asterix-gerrit.ics.uci.edu/1116
Sonar-Qube: Jenkins 
Tested-by: Jenkins 
Integration-Tests: Jenkins 
Reviewed-by: Till Westmann 


> Ordering by aggregated field throws NullPointerException
> 
>
> Key: ASTERIXDB-1597
> URL: https://issues.apache.org/jira/browse/ASTERIXDB-1597
> Project: Apache AsterixDB
>  Issue Type: Bug
> Environment: Master branch with latest commit 
> 0339b475f323e6e2777dbcb13ee2
>Reporter: Vignesh Raghunathan
>Assignee: Yingyi Bu
>
> To reproduce the issue, run the following sqlpp statements:
> {code}
> drop dataverse sampdb if exists;
> create dataverse sampdb;
> use sampdb;
> drop dataset samptable if exists;
> drop type samptabletype if exists;
> create type samptabletype as closed {
>   id: int8
> };
> create dataset samptable1(samptabletype) primary key id;
> insert into samptable1 ({'id' : 0});
> insert into samptable1 ({'id' : 1});
> select sumid
> from (
> select sum(id) sumid from samptable1 
> ) t1
> order by sumid;
> {code}
> Result:
> {code}
> java.lang.NullPointerException
>   at 
> org.apache.asterix.om.typecomputer.impl.TypeComputeUtils.getActualType(TypeComputeUtils.java:174)
>   at 
> org.apache.asterix.om.typecomputer.impl.TypeComputeUtils.getActualType(TypeComputeUtils.java:153)
>   at 
> org.apache.asterix.om.typecomputer.impl.TypeComputeUtils.resolveResultType(TypeComputeUtils.java:84)
>   at 
> org.apache.asterix.om.typecomputer.base.AbstractResultTypeComputer.computeType(AbstractResultTypeComputer.java:39)
>   at 
> org.apache.asterix.dataflow.data.common.AqlExpressionTypeComputer.getTypeForFunction(AqlExpressionTypeComputer.java:80)
>   at 
> org.apache.asterix.dataflow.data.common.AqlExpressionTypeComputer.getType(AqlExpressionTypeComputer.java:53)
>   at 
> org.apache.hyracks.algebricks.core.algebra.typing.AbstractTypeEnvironment.getType(AbstractTypeEnvironment.java:45)
>   at 
> org.apache.asterix.om.typecomputer.impl.OpenRecordConstructorResultType.computeType(OpenRecordConstructorResultType.java:70)
>   at 
> org.apache.asterix.dataflow.data.common.AqlExpressionTypeComputer.getTypeForFunction(AqlExpressionTypeComputer.java:80)
>   at 
> org.apache.asterix.dataflow.data.common.AqlExpressionTypeComputer.getType(AqlExpressionTypeComputer.java:53)
>   at 
> org.apache.hyracks.algebricks.core.algebra.operators.logical.AssignOperator.computeOutputTypeEnvironment(AssignOperator.java:92)
>   at 
> org.apache.asterix.optimizer.rules.IntroduceEnforcedListTypeRule.rewritePost(IntroduceEnforcedListTypeRule.java:79)
>   at 
> org.apache.hyracks.algebricks.core.rewriter.base.AbstractRuleController.rewriteOperatorRef(AbstractRuleController.java:126)
>   at 
> org.apache.hyracks.algebricks.core.rewriter.base.AbstractRuleController.rewriteOperatorRef(AbstractRuleController.java:100)
>   at 
> org.apache.hyracks.algebricks.core.rewriter.base.AbstractRuleController.rewriteOperatorRef(AbstractRuleController.java:100)
>   at 
> org.apache.hyracks.algebricks.compiler.rewriter.rulecontrollers.SequentialFixpointRuleController.rewriteWithRuleCollection(SequentialFixpointRuleController.java:53)
>   at 
> org.apache.hyracks.algebricks.core.rewriter.base.HeuristicOptimizer.runOptimizationSets(HeuristicOptimizer.java:102)
>   at 
> org.apache.hyracks.algebricks.core.rewriter.base.HeuristicOptimizer.optimize(HeuristicOptimizer.java:82)
>   at 
> org.apache.hyracks.algebricks.compiler.api.HeuristicCompilerFactoryBuilder$1$1.optimize(HeuristicCompilerFactoryBuilder.java:90)
>   at 
> org.apache.asterix.api.common.APIFramework.compileQuery(APIFramework.java:268)
>   at 
> org.apache.asterix.aql.translator.QueryTranslator.rewriteCompileQuery(QueryTranslator.java:1938)
>   at 
> org.apache.asterix.aql.translator.QueryTranslator.handleQuery(QueryTranslator.java:2533)
>   at 
> org.apache.asterix.aql.translator.QueryTranslator.compileAndExecute(QueryTranslator.java:365)
>   at 
> 

[jira] [Commented] (ASTERIXDB-1657) Failure in Tasks Start Job on an NC doesn't abort job

[ASF subversion and git services (JIRA)]

[ 
https://issues.apache.org/jira/browse/ASTERIXDB-1657?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15540917#comment-15540917
 ] 

ASF subversion and git services commented on ASTERIXDB-1657:


Commit d63cd3838d8027ecff5ea54a0b00f1f5cda9f447 in asterixdb's branch 
refs/heads/master from [~alamoudi]
[ https://git-wip-us.apache.org/repos/asf?p=asterixdb.git;h=d63cd38 ]

ASTERIXDB-1642,ASTERIXDB-1657,ASTERIXDB-1658 Fix Task Failure Handling

Change-Id: I2ec2c798b704ca426d5937f22e6d2bd394a9095a
Reviewed-on: https://asterix-gerrit.ics.uci.edu/1197
Sonar-Qube: Jenkins 
Tested-by: Jenkins 
Integration-Tests: Jenkins 
Reviewed-by: Yingyi Bu 


> Failure in Tasks Start Job on an NC doesn't abort job
> -
>
> Key: ASTERIXDB-1657
> URL: https://issues.apache.org/jira/browse/ASTERIXDB-1657
> Project: Apache AsterixDB
>  Issue Type: Bug
>Reporter: Abdullah Alamoudi
>Assignee: Abdullah Alamoudi
>




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (ASTERIXDB-1642) Failure in a job with massively parallel task only stops tasks that have already started

[ASF subversion and git services (JIRA)]

[ 
https://issues.apache.org/jira/browse/ASTERIXDB-1642?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15540916#comment-15540916
 ] 

ASF subversion and git services commented on ASTERIXDB-1642:


Commit d63cd3838d8027ecff5ea54a0b00f1f5cda9f447 in asterixdb's branch 
refs/heads/master from [~alamoudi]
[ https://git-wip-us.apache.org/repos/asf?p=asterixdb.git;h=d63cd38 ]

ASTERIXDB-1642,ASTERIXDB-1657,ASTERIXDB-1658 Fix Task Failure Handling

Change-Id: I2ec2c798b704ca426d5937f22e6d2bd394a9095a
Reviewed-on: https://asterix-gerrit.ics.uci.edu/1197
Sonar-Qube: Jenkins 
Tested-by: Jenkins 
Integration-Tests: Jenkins 
Reviewed-by: Yingyi Bu 


> Failure in a job with massively parallel task only stops tasks that have 
> already started
> 
>
> Key: ASTERIXDB-1642
> URL: https://issues.apache.org/jira/browse/ASTERIXDB-1642
> Project: Apache AsterixDB
>  Issue Type: Bug
>Reporter: Abdullah Alamoudi
>Assignee: Abdullah Alamoudi
>




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (ASTERIXDB-1658) Abort Tasks job doesn't abort a currently blocking task start job

[ASF subversion and git services (JIRA)]

[ 
https://issues.apache.org/jira/browse/ASTERIXDB-1658?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15540918#comment-15540918
 ] 

ASF subversion and git services commented on ASTERIXDB-1658:


Commit d63cd3838d8027ecff5ea54a0b00f1f5cda9f447 in asterixdb's branch 
refs/heads/master from [~alamoudi]
[ https://git-wip-us.apache.org/repos/asf?p=asterixdb.git;h=d63cd38 ]

ASTERIXDB-1642,ASTERIXDB-1657,ASTERIXDB-1658 Fix Task Failure Handling

Change-Id: I2ec2c798b704ca426d5937f22e6d2bd394a9095a
Reviewed-on: https://asterix-gerrit.ics.uci.edu/1197
Sonar-Qube: Jenkins 
Tested-by: Jenkins 
Integration-Tests: Jenkins 
Reviewed-by: Yingyi Bu 


> Abort Tasks job doesn't abort a currently blocking task start job
> -
>
> Key: ASTERIXDB-1658
> URL: https://issues.apache.org/jira/browse/ASTERIXDB-1658
> Project: Apache AsterixDB
>  Issue Type: Bug
>Reporter: Abdullah Alamoudi
>Assignee: Abdullah Alamoudi
>




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (ASTERIXDB-1611) AsterixDB + Hyracks daemon threads should have reasonable names

[ASF subversion and git services (JIRA)]

[ 
https://issues.apache.org/jira/browse/ASTERIXDB-1611?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15534685#comment-15534685
 ] 

ASF subversion and git services commented on ASTERIXDB-1611:


Commit 102ef590b1475731732feadf8c7e7302b7bb9968 in asterixdb's branch 
refs/heads/master from [~mblow]
[ https://git-wip-us.apache.org/repos/asf?p=asterixdb.git;h=102ef59 ]

ASTERIXDB-1611: Improve Thread Names

Executor threads are now named as follows:

- "Executor-:"

Change-Id: Iea54740c51a9ac9388337cf88260a8482ff4a334
Reviewed-on: https://asterix-gerrit.ics.uci.edu/1226
Sonar-Qube: Jenkins 
Tested-by: Jenkins 
Integration-Tests: Jenkins 
Reviewed-by: Till Westmann 


> AsterixDB + Hyracks daemon threads should have reasonable names
> ---
>
> Key: ASTERIXDB-1611
> URL: https://issues.apache.org/jira/browse/ASTERIXDB-1611
> Project: Apache AsterixDB
>  Issue Type: Bug
>  Components: AsterixDB, Hyracks
>Reporter: Michael Blow
>Assignee: Michael Blow
>
> A number of threads are started in AsterixDB that do not have well-named 
> threads.  This hinders the ability to debug / diagnose problems.
> This includes:
> - LogManager.FlushLogsLogger
> - LogFlusher
> - BufferCache.CleanerThread
> - ResultStateSweeper
> - (hyracks.control.common.work.)WorkQueue.WorkerThread
> - (asterix.hyracks.bootstrap.)ClusterWorkExecutor



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (ASTERIXDB-1636) Feed cannot re-ingest after cluster restart

[ASF subversion and git services (JIRA)]

[ 
https://issues.apache.org/jira/browse/ASTERIXDB-1636?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15534686#comment-15534686
 ] 

ASF subversion and git services commented on ASTERIXDB-1636:


Commit 2685b60d9e03a515fcc5260a3dd4399740f5ec40 in asterixdb's branch 
refs/heads/master from [~imaxon]
[ https://git-wip-us.apache.org/repos/asf?p=asterixdb.git;h=2685b60 ]

Fixes for ASTERIXDB-1636

The index of the tuple field for filters from SecondaryIndexOperationsHelper 
and AqlMetadataProvider
differed. The one in AqlMetadataProvider was wrong, as it was attempting to 
take into account the
presence of a partitioning field in the incoming tuple, which is not there in 
the case of an
insert/upsert.

There was also an issue where on merge, for components with a filter page but 
no min/max, the merge
would fail. I fixed this by skipping over null entries while getting the 
min/max of merging components.

Finally, there was a very silly error in LSMComponentFilterManager which was 
causing the filter page
to appear as blank, because the page was being pinned with the wrong argument. 
That is also fixed.

Change-Id: Ib4bc413fcda9a5c98ae57f94e1c8a68fe9aacda3
Reviewed-on: https://asterix-gerrit.ics.uci.edu/1205
Sonar-Qube: Jenkins 
Reviewed-by: Taewoo Kim 
Tested-by: Jenkins 
Integration-Tests: Jenkins 


> Feed cannot re-ingest after cluster restart
> ---
>
> Key: ASTERIXDB-1636
> URL: https://issues.apache.org/jira/browse/ASTERIXDB-1636
> Project: Apache AsterixDB
>  Issue Type: Bug
>  Components: Feeds, Storage
> Environment: master
> commit c89d668f68e5430a6ba4455daf8f9cd6f7040dd8
> Date:   Tue Sep 6 18:29:23 2016 -0700
>Reporter: Jianfeng Jia
>Assignee: Ian Maxon
>Priority: Blocker
>  Labels: soon
>
> Here are steps to reproduce the problem:
> 1. start the cluster
> 2. ingest the initial data using file feed 
> [script|https://gist.github.com/JavierJia/9ed7744c938c5cb66aba63007b86a987]
> 2.1: file for ingestion: 
> https://drive.google.com/open?id=0B423M7wGZj9dNE5HenFqcjhuUFk
> 3. start another socket feed 
> [script|https://gist.github.com/JavierJia/565cefd9322df35c7abeefbfcfcee9f8] 
> to ingest the live data  
> 4. restart the cluster
> 5. start that live socket feed again.
> 6. with your own twitter credential you can use [this 
> script|https://github.com/ISG-ICS/cloudberry/blob/master/streamFeed.sh]  to 
> ingest the tweet
> 7. It will send at most 280 tweets and stops forever.
> [~imaxon] [~idleft] if you can help that will be great.
> related to ASTERIXDB-1264



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (ASTERIXDB-1573) Refactor extensibility of re-write rules

[ASF subversion and git services (JIRA)]

[ 
https://issues.apache.org/jira/browse/ASTERIXDB-1573?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15606876#comment-15606876
 ] 

ASF subversion and git services commented on ASTERIXDB-1573:


Commit 109e48515676ef04afb7d66e92e02c650f02ac44 in asterixdb's branch 
refs/heads/master from [~sjaco002]
[ https://git-wip-us.apache.org/repos/asf?p=asterixdb.git;h=109e485 ]

ASTERIXDB-1573 Allow Extension of Rewrite Rules

Add IRuleSetFactory which builds rewrite Rule Set
Can be extended by Asterix Extensions

Removed some obsolete extension code
Change-Id: I7f59dea86b0ef4ee9d31b56766a97bd2b34ec02c
Reviewed-on: https://asterix-gerrit.ics.uci.edu/1304
Tested-by: Jenkins 
Integration-Tests: Jenkins 
Reviewed-by: Till Westmann 


> Refactor extensibility of re-write rules
> 
>
> Key: ASTERIXDB-1573
> URL: https://issues.apache.org/jira/browse/ASTERIXDB-1573
> Project: Apache AsterixDB
>  Issue Type: Improvement
>Reporter: Abdullah Alamoudi
>Assignee: Steven Jacobs
>
> Currently, extension mechanism doesn't provide a good generic way of 
> extending re-write rules.
> A provider should be introduced to improve this.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (ASTERIXDB-1710) Recovery redo fails whenever deadlock-free locking protocol invoked

[ASF subversion and git services (JIRA)]

[ 
https://issues.apache.org/jira/browse/ASTERIXDB-1710?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15612986#comment-15612986
 ] 

ASF subversion and git services commented on ASTERIXDB-1710:


Commit 82a831d26d8c3c45478240f77dab9cf1b4c9eb79 in asterixdb's branch 
refs/heads/master from [~imaxon]
[ https://git-wip-us.apache.org/repos/asf?p=asterixdb.git;h=82a831d ]

ASTERIXDB-1710: Redo fails on WAIT log record

Simple fix :)

It would be best to have a test for this (and all other logtypes),
but the LogManager will have to be maniupulated into generating the record
for this specifically because the conditions upon which it happens naturally
are hard to encounter.

Change-Id: I4443b716bc791878fabbbf3b374fc7c7c592668f
Reviewed-on: https://asterix-gerrit.ics.uci.edu/1315
Sonar-Qube: Jenkins 
Tested-by: Jenkins 
Integration-Tests: Jenkins 
Reviewed-by: Murtadha Hubail 


> Recovery redo fails whenever deadlock-free locking protocol invoked
> ---
>
> Key: ASTERIXDB-1710
> URL: https://issues.apache.org/jira/browse/ASTERIXDB-1710
> Project: Apache AsterixDB
>  Issue Type: Bug
>Reporter: Ian Maxon
>
> The WAIT log isn't handled in the switch/case for the redo phase. It should 
> get through analysis fine. The stack will be something like this: 
> org.apache.asterix.common.exceptions.ACIDException: Unsupported LogType: 6
>   at 
> org.apache.asterix.transaction.management.service.recovery.RecoveryManager.startRecoveryRedoPhase(RecoveryManager.java:412)
>   at 
> org.apache.asterix.transaction.management.service.recovery.RecoveryManager.replayPartitionsLogs(RecoveryManager.java:202)
>   at 
> org.apache.asterix.transaction.management.service.recovery.RecoveryManager.startRecovery(RecoveryManager.java:194)
>   at 
> org.apache.asterix.hyracks.bootstrap.NCApplicationEntryPoint.start(NCApplicationEntryPoint.java:151)
>   at 
> org.apache.hyracks.control.nc.NodeControllerService.startApplication(NodeControllerService.java:342)
>   at 
> org.apache.hyracks.control.nc.NodeControllerService.start(NodeControllerService.java:271)
>   at org.apache.hyracks.control.nc.NCDriver.main(NCDriver.java:48)



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (ASTERIXDB-1570) Sporadic test failure "Unable to find free page in buffer cache after 1000 cycles"

[ASF subversion and git services (JIRA)]

[ 
https://issues.apache.org/jira/browse/ASTERIXDB-1570?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15644899#comment-15644899
 ] 

ASF subversion and git services commented on ASTERIXDB-1570:


Commit 9af8a4b559cb6274d1842d786725705f404155d2 in asterixdb's branch 
refs/heads/master from [~mblow]
[ https://git-wip-us.apache.org/repos/asf?p=asterixdb.git;h=9af8a4b ]

ASTERIXDB-1570: "Unable to find free page in buffer cache after 1000 cycles"

Increase test buffer cache size to reliably accomodate 20M values

Change-Id: I620de9ade875f7f7de26aa7495d9fd873824ac83
Reviewed-on: https://asterix-gerrit.ics.uci.edu/1346
Sonar-Qube: Jenkins 
Tested-by: Jenkins 
Integration-Tests: Jenkins 
Reviewed-by: Till Westmann 


> Sporadic test failure "Unable to find free page in buffer cache after 1000 
> cycles"
> --
>
> Key: ASTERIXDB-1570
> URL: https://issues.apache.org/jira/browse/ASTERIXDB-1570
> Project: Apache AsterixDB
>  Issue Type: Bug
>  Components: Storage
>Reporter: Yingyi Bu
>Assignee: Michael Blow
>Priority: Critical
>  Labels: soon
>
> It happened on my recent jenkins job:
> {noformat}
> Error Message
> Test 
> "src/test/resources/runtimets/queries/big-object/big_object_feed_20M/big_object_feed_20M.3.query.aql"
>  FAILED!
> Stacktrace
> java.lang.Exception: Test 
> "src/test/resources/runtimets/queries/big-object/big_object_feed_20M/big_object_feed_20M.3.query.aql"
>  FAILED!
>   at 
> org.apache.asterix.test.aql.TestExecutor.executeHttpRequest(TestExecutor.java:278)
>   at 
> org.apache.asterix.test.aql.TestExecutor.executeQuery(TestExecutor.java:288)
>   at 
> org.apache.asterix.test.aql.TestExecutor.executeTest(TestExecutor.java:538)
>   at 
> org.apache.asterix.test.aql.TestExecutor.executeTest(TestExecutor.java:785)
>   at 
> org.apache.asterix.test.runtime.ExecutionTest.test(ExecutionTest.java:110)
> Standard Error
> org.apache.hyracks.api.exceptions.HyracksDataException: Unable to find free 
> page in buffer cache after 1000 cycles (buffer cache undersized?)
>   at 
> org.apache.hyracks.storage.common.buffercache.BufferCache.getPageLoop(BufferCache.java:1287)
>   at 
> org.apache.hyracks.storage.common.buffercache.BufferCache.confiscatePage(BufferCache.java:1154)
>   at 
> org.apache.hyracks.storage.common.buffercache.BufferCache.confiscatePage(BufferCache.java:1141)
>   at 
> org.apache.hyracks.storage.am.bloomfilter.impls.BloomFilter$BloomFilterBuilder.allocateAndInitMetaDataPage(BloomFilter.java:253)
>   at 
> org.apache.hyracks.storage.am.bloomfilter.impls.BloomFilter$BloomFilterBuilder.end(BloomFilter.java:283)
>   at 
> org.apache.hyracks.storage.am.lsm.btree.impls.LSMBTree.flush(LSMBTree.java:481)
>   at 
> org.apache.hyracks.storage.am.lsm.common.impls.LSMHarness.flush(LSMHarness.java:434)
>   at 
> org.apache.hyracks.storage.am.lsm.common.impls.LSMTreeIndexAccessor.flush(LSMTreeIndexAccessor.java:105)
>   at 
> org.apache.hyracks.storage.am.lsm.btree.impls.LSMBTreeFlushOperation.call(LSMBTreeFlushOperation.java:73)
>   at 
> org.apache.hyracks.storage.am.lsm.btree.impls.LSMBTreeFlushOperation.call(LSMBTreeFlushOperation.java:34)
>   at java.util.concurrent.FutureTask.run(FutureTask.java:266)
>   at 
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
>   at 
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
>   at java.lang.Thread.run(Thread.java:745)
> org.apache.hyracks.api.exceptions.HyracksDataException: 
> org.apache.hyracks.api.exceptions.HyracksDataException: Unable to find free 
> page in buffer cache after 1000 cycles (buffer cache undersized?)
>   at 
> org.apache.hyracks.api.rewriter.runtime.SuperActivityOperatorNodePushable.runInParallel(SuperActivityOperatorNodePushable.java:218)
>   at 
> org.apache.hyracks.api.rewriter.runtime.SuperActivityOperatorNodePushable.initialize(SuperActivityOperatorNodePushable.java:83)
>   at org.apache.hyracks.control.nc.Task.run(Task.java:263)
>   at 
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
>   at 
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
>   at java.lang.Thread.run(Thread.java:745)
> Caused by: java.util.concurrent.ExecutionException: 
> org.apache.hyracks.api.exceptions.HyracksDataException: Unable to find free 
> page in buffer cache after 1000 cycles (buffer cache undersized?)
>   at java.util.concurrent.FutureTask.report(FutureTask.java:122)
>   at 

[jira] [Commented] (ASTERIXDB-1725) Root page location calculation does not account for multipages

[ASF subversion and git services (JIRA)]

[ 
https://issues.apache.org/jira/browse/ASTERIXDB-1725?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15648824#comment-15648824
 ] 

ASF subversion and git services commented on ASTERIXDB-1725:


Commit 38845d54f1cd0d8b867bb3adfe0c8120cb94e167 in asterixdb's branch 
refs/heads/master from [~imaxon]
[ https://git-wip-us.apache.org/repos/asf?p=asterixdb.git;h=38845d5 ]

Tests for ASTERIXDB-1725

Just inserts a really big record, stops, and starts again.
This should always work, but for the bug, it'd cause a nullpointer
upon querying the dataset.

Change-Id: I8b241acebbdcd658e734a43d03259a1ea24d8b57
Reviewed-on: https://asterix-gerrit.ics.uci.edu/1344
Sonar-Qube: Jenkins 
Tested-by: Jenkins 
Integration-Tests: Jenkins 
Reviewed-by: Michael Blow 


> Root page location calculation does not account for multipages
> --
>
> Key: ASTERIXDB-1725
> URL: https://issues.apache.org/jira/browse/ASTERIXDB-1725
> Project: Apache AsterixDB
>  Issue Type: Bug
>Reporter: Ian Maxon
>Assignee: Ian Maxon
>
> The root page calculation is based on a fixed number of pages. This is 
> usually fine, unless the root page happens to be a leaf page. In this case it 
> may consist of any number of pages due to large object storage. 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (ASTERIXDB-1714) Eliminate dependency on JSON (org.json:json:*) library

[ASF subversion and git services (JIRA)]

[ 
https://issues.apache.org/jira/browse/ASTERIXDB-1714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15652681#comment-15652681
 ] 

ASF subversion and git services commented on ASTERIXDB-1714:


Commit 4ad756062d7afde7c03801705dad4ca9854ccf87 in asterixdb's branch 
refs/heads/master from [~tillw]
[ https://git-wip-us.apache.org/repos/asf?p=asterixdb.git;h=4ad7560 ]

ASTERIXDB-1714: Eliminate dependency on org.json

Change-Id: I3ada73e15c781a77b5b3019f246e1a1fc23a2377
Reviewed-on: https://asterix-gerrit.ics.uci.edu/1318
Sonar-Qube: Jenkins 
Tested-by: Jenkins 
Integration-Tests: Jenkins 
Reviewed-by: Michael Blow 


> Eliminate dependency on JSON (org.json:json:*) library
> --
>
> Key: ASTERIXDB-1714
> URL: https://issues.apache.org/jira/browse/ASTERIXDB-1714
> Project: Apache AsterixDB
>  Issue Type: Bug
>  Components: Other
>Reporter: Michael Blow
>Assignee: Till
>Priority: Blocker
>
> The JSON library has a controversial license, which stipulates that it can 
> only be used for "Good, not Evil".  We should eliminate our dependency on 
> this package in lieu of one that has a license free of subjective limitations.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (ASTERIXDB-1727) Adding grouping hint breaks the query

[ASF subversion and git services (JIRA)]

[ 
https://issues.apache.org/jira/browse/ASTERIXDB-1727?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15655798#comment-15655798
 ] 

ASF subversion and git services commented on ASTERIXDB-1727:


Commit f40081f5ad0146885e9f9a416598bf46661a2f54 in asterixdb's branch 
refs/heads/master from [~wangsaeu]
[ https://git-wip-us.apache.org/repos/asf?p=asterixdb.git;h=f40081f ]

ASTERIXDB-1727: Fix an issue with multiple aggregates in one group-by

 - Although the hash group-by hint is given, if multiple aggregate operators
   exist in the subplan of group-by, the physical operator of the given group-by
   should not be set as EXTERNAL_GROUP_BY since we don't support multiple 
aggregates
   in the external group by physical operator.

Change-Id: Ifb5619cc3ece00ab83962d53e004f203684df9ee
Reviewed-on: https://asterix-gerrit.ics.uci.edu/1343
Sonar-Qube: Jenkins 
Tested-by: Jenkins 
Integration-Tests: Jenkins 
Reviewed-by: Yingyi Bu 


> Adding grouping hint breaks the query
> -
>
> Key: ASTERIXDB-1727
> URL: https://issues.apache.org/jira/browse/ASTERIXDB-1727
> Project: Apache AsterixDB
>  Issue Type: Bug
>Reporter: Pouria
>Assignee: Taewoo Kim
>
> The following query works fine with no hint. Adding a hint to use hash-based 
> group-by breaks it with the following error:
> {noformat}
> Variable $$43 could not be found in any input schema. [AlgebricksException]
> {noformat}
> Here is the query:
> {noformat}
> let $customer := {{ {"cid" : 1}, {"cid" : 2} }}
> let $orders := {{ 
>   {"oid": 100, 
>   "ocid" : 1, 
>   "priority" : 10,
>"class" : "A",
>"items" : [{"price" : 1000}, { "price" : 2000}]
>   },
>   {"oid": 200, 
>   "ocid" : 2, 
>   "priority" : 20,
>"class" : "A",
>"items" : [{"price" : 2000}, {"price" : 3000}]
>   }
> }}
> for $c in $customer
> for $o in $orders
> where
>   $c.cid = $o.ocid 
> for $i in $o.items
> /*+ hash*/
> group by $o_orderid := $o.oid, $o_class := $o.class, $o_priority := 
> $o.priority
>   with $i
> let $price := sum (
>   for $t in $i 
>   return 
> $t.price
> )
> order by $price desc, $o_class
> return {  
>   "o_orderkey": $o_orderid,
>   "price": $price,
>   "o_class": $o_class,
>   "o_priority": $o_priority 
> }
> {noformat}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (ASTERIXDB-1719) Clean up conventions for HTTP requests in tests

[ASF subversion and git services (JIRA)]

[ 
https://issues.apache.org/jira/browse/ASTERIXDB-1719?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15637869#comment-15637869
 ] 

ASF subversion and git services commented on ASTERIXDB-1719:


Commit 314c0df168fec698291a0fa8706d1e307505637e in asterixdb's branch 
refs/heads/master from [~mblow]
[ https://git-wip-us.apache.org/repos/asf?p=asterixdb.git;h=314c0df ]

ASTERIXDB-1719 - Align HTTP Test Requests to $METHOD.http

Change-Id: I60958f77226f1afb2585baf9248682c4867758d8
Reviewed-on: https://asterix-gerrit.ics.uci.edu/1341
Sonar-Qube: Jenkins 
Tested-by: Jenkins 
Integration-Tests: Jenkins 
Reviewed-by: Till Westmann 


> Clean up conventions for HTTP requests in tests
> ---
>
> Key: ASTERIXDB-1719
> URL: https://issues.apache.org/jira/browse/ASTERIXDB-1719
> Project: Apache AsterixDB
>  Issue Type: Improvement
>  Components: AsterixDB
>Reporter: Till
>Assignee: Michael Blow
>
> Currently test steps that invoke an HTTP API have the file suffix 
> {{httpapi.aql}}. This doesn't seem right as there's really no AQL involved 
> here. Instead we could generalize and clean up the support for HTTP by 
> - allowing all HTTP methods and
> - changing the file extension to {{$METHOD.http}}.
> (We could also consider having a way to specify the port to allow for tests 
> against the non-default port.)



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (ASTERIXDB-1695) More entities in the default dataverse

[ASF subversion and git services (JIRA)]

[ 
https://issues.apache.org/jira/browse/ASTERIXDB-1695?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15587720#comment-15587720
 ] 

ASF subversion and git services commented on ASTERIXDB-1695:


Commit e3e49c174708ca2bd0ae08b0c5785d4d2938ef85 in asterixdb's branch 
refs/heads/master from [~alamoudi]
[ https://git-wip-us.apache.org/repos/asf?p=asterixdb.git;h=e3e49c1 ]

ASTERIXDB-1695 Fix Functions in Default Dataverse

Change-Id: I7f08c0acaccdcfaeb4fc9cfb1529214b543d0e86
Reviewed-on: https://asterix-gerrit.ics.uci.edu/1297
Sonar-Qube: Jenkins 
Tested-by: Jenkins 
Integration-Tests: Jenkins 
Reviewed-by: Yingyi Bu 


> More entities in the default dataverse
> --
>
> Key: ASTERIXDB-1695
> URL: https://issues.apache.org/jira/browse/ASTERIXDB-1695
> Project: Apache AsterixDB
>  Issue Type: Bug
>Reporter: Yingyi Bu
>Assignee: Abdullah Alamoudi
>
> The following query works fine.
> {noformat}
> DROP function foo if exists;
> CREATE function foo(){
>   1
> }
> SELECT Default.foo();
> {noformat}
> But the next one doesn't work:
> {noformat}
> DROP function foo if exists;
> CREATE function foo(){
>   1
> }
> SELECT foo();
> {noformat}
> I got this error message:
> "msg": "function null.foo@0 is not defined",
> I'm guessing that it is related to the default dataverse change.
> I guess we need to verify all metadata entities can work under the default 
> dataverse.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (ASTERIXDB-1693) NPE when creating a dataset inside the Default dataverse

[ASF subversion and git services (JIRA)]

[ 
https://issues.apache.org/jira/browse/ASTERIXDB-1693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15575687#comment-15575687
 ] 

ASF subversion and git services commented on ASTERIXDB-1693:


Commit c9cbb2c071d4bbc2b4b0e338ac67c56542b92726 in asterixdb's branch 
refs/heads/master from [~mhubail]
[ https://git-wip-us.apache.org/repos/asf?p=asterixdb.git;h=c9cbb2c ]

ASTERIXDB-1693: Fix Default dataverse types referencing

Change-Id: Iae7ed8a2de345531345e4df2f9e06aa0d7680ebc
Reviewed-on: https://asterix-gerrit.ics.uci.edu/1284
Sonar-Qube: Jenkins 
Reviewed-by: abdullah alamoudi 
Tested-by: Jenkins 
Integration-Tests: Jenkins 


> NPE when creating a dataset inside the Default dataverse
> 
>
> Key: ASTERIXDB-1693
> URL: https://issues.apache.org/jira/browse/ASTERIXDB-1693
> Project: Apache AsterixDB
>  Issue Type: Bug
>  Components: Translator - AQL
>Reporter: Yingyi Bu
>Assignee: Murtadha Hubail
>
> DDLs:
> {noformat}
> drop type UserType if exists;
> drop type MsgType if exists;
> create type UserType AS {
>   id: bigint
> };
> create type MsgType AS {
>   messageId: bigint 
> };
> create dataset GleambookUsers(UserType) primary key id;
> {noformat}
> Exception:
> {noformat}
> java.lang.NullPointerException
>   at 
> org.apache.asterix.app.translator.QueryTranslator.handleCreateDatasetStatement(QueryTranslator.java:516)
>  ~[classes/:?]
>   at 
> com.couchbase.analytics.lang.CBStatementExecutor.handleCreateDatasetStatement(CBStatementExecutor.java:59)
>  ~[classes/:?]
>   at 
> org.apache.asterix.app.translator.QueryTranslator.compileAndExecute(QueryTranslator.java:308)
>  ~[classes/:?]
>   at 
> org.apache.asterix.app.translator.QueryTranslator.compileAndExecute(QueryTranslator.java:268)
>  ~[classes/:?]
>   at 
> org.apache.asterix.api.http.servlet.APIServlet.doPost(APIServlet.java:132) 
> [classes/:?]
>   at javax.servlet.http.HttpServlet.service(HttpServlet.java:707) 
> [javax.servlet-api-3.1.0.jar:3.1.0]
>   at javax.servlet.http.HttpServlet.service(HttpServlet.java:790) 
> [javax.servlet-api-3.1.0.jar:3.1.0]
>   at 
> org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:845) 
> [jetty-servlet-9.3.11.v20160721.jar:9.3.11.v20160721]
>   at 
> org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:583) 
> [jetty-servlet-9.3.11.v20160721.jar:9.3.11.v20160721]
>   at 
> org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:224)
>  [jetty-server-9.3.11.v20160721.jar:9.3.11.v20160721]
>   at 
> org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1180)
>  [jetty-server-9.3.11.v20160721.jar:9.3.11.v20160721]
>   at 
> org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:511) 
> [jetty-servlet-9.3.11.v20160721.jar:9.3.11.v20160721]
>   at 
> org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:185)
>  [jetty-server-9.3.11.v20160721.jar:9.3.11.v20160721]
>   at 
> org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1112)
>  [jetty-server-9.3.11.v20160721.jar:9.3.11.v20160721]
>   at 
> org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) 
> [jetty-server-9.3.11.v20160721.jar:9.3.11.v20160721]
>   at 
> org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:134)
>  [jetty-server-9.3.11.v20160721.jar:9.3.11.v20160721]
>   at org.eclipse.jetty.server.Server.handle(Server.java:524) 
> [jetty-server-9.3.11.v20160721.jar:9.3.11.v20160721]
>   at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:319) 
> [jetty-server-9.3.11.v20160721.jar:9.3.11.v20160721]
>   at 
> org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:253) 
> [jetty-server-9.3.11.v20160721.jar:9.3.11.v20160721]
>   at 
> org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:273)
>  [jetty-io-9.3.11.v20160721.jar:9.3.11.v20160721]
>   at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:95) 
> [jetty-io-9.3.11.v20160721.jar:9.3.11.v20160721]
>   at 
> org.eclipse.jetty.io.SelectChannelEndPoint$2.run(SelectChannelEndPoint.java:93)
>  [jetty-io-9.3.11.v20160721.jar:9.3.11.v20160721]
>   at 
> org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.executeProduceConsume(ExecuteProduceConsume.java:303)
>  [jetty-util-9.3.11.v20160721.jar:9.3.11.v20160721]
>   at 
> org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.produceConsume(ExecuteProduceConsume.java:148)
>  [jetty-util-9.3.11.v20160721.jar:9.3.11.v20160721]
>   at 
> 

[jira] [Commented] (ASTERIXDB-1696) Big objects spanning log file boundary produces ArrayIndexOutOfBoundsException

[ASF subversion and git services (JIRA)]

[ 
https://issues.apache.org/jira/browse/ASTERIXDB-1696?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15586318#comment-15586318
 ] 

ASF subversion and git services commented on ASTERIXDB-1696:


Commit f309eb4afc5387f120359c27a3742d6b03eda30f in asterixdb's branch 
refs/heads/master from [~mblow]
[ https://git-wip-us.apache.org/repos/asf?p=asterixdb.git;h=f309eb4 ]

ASTERIXDB-1696 - Big Object Spanning Log File Boundary

- Big objects spanning log file boundary produces
ArrayIndexOutOfBoundsException.  Refactored large log page logic to
correctly handle big objects at log file boundaries.
- Add regression test

Change-Id: Ifd5ac08a8bcf4a1e0804aa05bd7e52169a0cf1bc
Reviewed-on: https://asterix-gerrit.ics.uci.edu/1296
Reviewed-by: Murtadha Hubail 
Reviewed-by: Ian Maxon 
Tested-by: Jenkins 


> Big objects spanning log file boundary produces ArrayIndexOutOfBoundsException
> --
>
> Key: ASTERIXDB-1696
> URL: https://issues.apache.org/jira/browse/ASTERIXDB-1696
> Project: Apache AsterixDB
>  Issue Type: Bug
>  Components: AsterixDB
>Reporter: Michael Blow
>Assignee: Michael Blow
>
> FYI: each test will be run 1000 times.
> [1/1000] Expected results file: 
> /var/folders/5x/qdtntlds0fgcgknzwf61khvhgn/T/template.5778240242743996115.big_object_feed_20M.1.adm
> [2/1000] Expected results file: 
> /var/folders/5x/qdtntlds0fgcgknzwf61khvhgn/T/template.1266068079871898912.big_object_feed_20M.1.adm
> [3/1000] Expected results file: 
> /var/folders/5x/qdtntlds0fgcgknzwf61khvhgn/T/template.6993159241126337116.big_object_feed_20M.1.adm
> [4/1000] Expected results file: 
> /var/folders/5x/qdtntlds0fgcgknzwf61khvhgn/T/template.596733397297092827.big_object_feed_20M.1.adm
> [5/1000] java.lang.ArrayIndexOutOfBoundsException
>   at java.lang.System.arraycopy(Native Method)
>   at 
> org.apache.hyracks.storage.am.common.tuples.SimpleTupleWriter.writeTuple(SimpleTupleWriter.java:82)
>   at 
> org.apache.asterix.common.transactions.LogRecord.writeTuple(LogRecord.java:212)
>   at 
> org.apache.asterix.common.transactions.LogRecord.doWriteLogRecord(LogRecord.java:146)
>   at 
> org.apache.asterix.common.transactions.LogRecord.writeLogRecord(LogRecord.java:182)
>   at 
> org.apache.asterix.transaction.management.service.logging.LogBuffer.append(LogBuffer.java:92)
>   at 
> org.apache.asterix.transaction.management.service.logging.LogManager.syncAppendToLogTail(LogManager.java:170)
>   at 
> org.apache.asterix.transaction.management.service.logging.LogManager.appendToLogTail(LogManager.java:128)
>   at 
> org.apache.asterix.transaction.management.service.logging.LogManager.log(LogManager.java:124)
>   at 
> org.apache.asterix.transaction.management.opcallbacks.AbstractIndexModificationOperationCallback.log(AbstractIndexModificationOperationCallback.java:81)
>   at 
> org.apache.asterix.transaction.management.opcallbacks.PrimaryIndexModificationOperationCallback.found(PrimaryIndexModificationOperationCallback.java:108)
>   at 
> org.apache.hyracks.storage.am.btree.impls.BTree.insertLeaf(BTree.java:376)
>   at 
> org.apache.hyracks.storage.am.btree.impls.BTree.upsertLeaf(BTree.java:530)
>   at 
> org.apache.hyracks.storage.am.btree.impls.BTree.performOp(BTree.java:771)
>   at 
> org.apache.hyracks.storage.am.btree.impls.BTree.insertUpdateOrDelete(BTree.java:312)
>   at 
> org.apache.hyracks.storage.am.btree.impls.BTree.upsert(BTree.java:345)
>   at 
> org.apache.hyracks.storage.am.btree.impls.BTree.access$500(BTree.java:74)
>   at 
> org.apache.hyracks.storage.am.btree.impls.BTree$BTreeAccessor.upsertIfConditionElseInsert(BTree.java:953)
>   at 
> org.apache.hyracks.storage.am.lsm.btree.impls.LSMBTree.insert(LSMBTree.java:402)
>   at 
> org.apache.hyracks.storage.am.lsm.btree.impls.LSMBTree.modify(LSMBTree.java:343)
>   at 
> org.apache.hyracks.storage.am.lsm.common.impls.LSMHarness.modify(LSMHarness.java:376)
>   at 
> org.apache.hyracks.storage.am.lsm.common.impls.LSMHarness.modify(LSMHarness.java:363)
>   at 
> org.apache.hyracks.storage.am.lsm.common.impls.LSMTreeIndexAccessor.insert(LSMTreeIndexAccessor.java:50)
>   at 
> org.apache.asterix.common.dataflow.AsterixLSMInsertDeleteOperatorNodePushable.nextFrame(AsterixLSMInsertDeleteOperatorNodePushable.java:126)
>   at 
> org.apache.asterix.external.feed.dataflow.SyncFeedRuntimeInputHandler.nextFrame(SyncFeedRuntimeInputHandler.java:46)
>   at 
> org.apache.asterix.external.operators.FeedMetaStoreNodePushable.nextFrame(FeedMetaStoreNodePushable.java:145)
>   at org.apache.hyracks.control.nc.Task.pushFrames(Task.java:361)
>   at 

[jira] [Commented] (ASTERIXDB-1701) A txn log file partition may be used forever

[ASF subversion and git services (JIRA)]

[ 
https://issues.apache.org/jira/browse/ASTERIXDB-1701?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15595738#comment-15595738
 ] 

ASF subversion and git services commented on ASTERIXDB-1701:


Commit 8e043cfa1ea7a16463cc823a922deb92505fa55c in asterixdb's branch 
refs/heads/master from [~mhubail]
[ https://git-wip-us.apache.org/repos/asf?p=asterixdb.git;h=8e043cf ]

ASTERIXDB-1701: Fix log file boundry check

Change-Id: I538a8b931f3d50a00b092f218887a9731d14e235
Reviewed-on: https://asterix-gerrit.ics.uci.edu/1306
Sonar-Qube: Jenkins 
Tested-by: Jenkins 
Integration-Tests: Jenkins 
Reviewed-by: Ian Maxon 
Reviewed-by: Michael Blow 


> A txn log file partition may be used forever
> 
>
> Key: ASTERIXDB-1701
> URL: https://issues.apache.org/jira/browse/ASTERIXDB-1701
> Project: Apache AsterixDB
>  Issue Type: Bug
>  Components: AsterixDB
>Reporter: Murtadha Hubail
>Assignee: Murtadha Hubail
>Priority: Critical
>
> Currently, a log file partition size may be exceeded if the last log page 
> doesn't fall exactly at the boundary of the log file. Since we have variable 
> size log pages, a single log file may be used forever.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (ASTERIXDB-1700) edit-distance-check on the fields with the 2-gram and the 3-gram index generates a null pointer exception.

[ASF subversion and git services (JIRA)]

[ 
https://issues.apache.org/jira/browse/ASTERIXDB-1700?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15593861#comment-15593861
 ] 

ASF subversion and git services commented on ASTERIXDB-1700:


Commit 68c8e9befabfa7def67ce3a1cc93dba05966bd15 in asterixdb's branch 
refs/heads/master from [~wangsaeu]
[ https://git-wip-us.apache.org/repos/asf?p=asterixdb.git;h=68c8e9b ]

ASTERIXDB-1700: fixed multiple same type of index application error on the same 
field

 - Fixed an issue that multiple same type of indexes can be applied for the 
same field.
   For this situation, applying only one index will be enough.
   (e.g., 2-gram and 3-gram index on the same field)

Change-Id: I450f3adb20c777d5b9a8f638e010076b9d817942
Reviewed-on: https://asterix-gerrit.ics.uci.edu/1307
Tested-by: Jenkins 
Integration-Tests: Jenkins 
Reviewed-by: Jianfeng Jia 


> edit-distance-check on the fields with the 2-gram and the 3-gram index 
> generates a null pointer exception.
> --
>
> Key: ASTERIXDB-1700
> URL: https://issues.apache.org/jira/browse/ASTERIXDB-1700
> Project: Apache AsterixDB
>  Issue Type: Bug
>Reporter: Taewoo Kim
>Assignee: Taewoo Kim
>
> If there multiple indexes on the same field, we use intersect operator to 
> integrate the result from each index. In the following AQL query, we have two 
> n-gram indexes on the same field. And, the null pointer exception happens.
> {code}
> java.lang.NullPointerException
>   at 
> org.apache.hyracks.api.job.JobSpecification.getInputConnectorDescriptor(JobSpecification.java:192)
>   at 
> org.apache.hyracks.api.job.JobSpecification.getInputConnectorDescriptor(JobSpecification.java:188)
>   at 
> org.apache.hyracks.api.client.impl.JobActivityGraphBuilder.addSourceEdge(JobActivityGraphBuilder.java:81)
>   at 
> org.apache.hyracks.dataflow.std.base.AbstractSingleActivityOperatorDescriptor.contributeActivities(AbstractSingleActivityOperatorDescriptor.java:54)
>   at 
> org.apache.hyracks.api.client.impl.JobSpecificationActivityClusterGraphGeneratorFactory$2.visit(JobSpecificationActivityClusterGraphGeneratorFactory.java:67)
>   at 
> org.apache.hyracks.api.client.impl.PlanUtils.visitOperator(PlanUtils.java:41)
>   at org.apache.hyracks.api.client.impl.PlanUtils.visit(PlanUtils.java:34)
>   at 
> org.apache.hyracks.api.client.impl.JobSpecificationActivityClusterGraphGeneratorFactory.createActivityClusterGraphGenerator(JobSpecificationActivityClusterGraphGeneratorFactory.java:64)
>   at 
> org.apache.hyracks.control.cc.work.JobStartWork.doRun(JobStartWork.java:61)
>   at 
> org.apache.hyracks.control.common.work.SynchronizableWork.run(SynchronizableWork.java:39)
>   at 
> org.apache.hyracks.control.common.work.WorkQueue$WorkerThread.run(WorkQueue.java:127)
> Oct 19, 2016 7:10:22 PM org.apache.asterix.app.translator.QueryTranslator 
> handleQuery
> {code}
> {code}
> create type DBLPType as closed {
>   id: int64,
>   dblpid: string,
>   title: string,
>   authors: string,
>   misc: string
> }
> create dataset DBLP(DBLPType)
>   primary key id on group1;
> create index ngram2_index on DBLP(authors) type ngram(2);
> create index ngram3_index on DBLP(authors) type ngram(3);
> for $o in dataset('DBLP')
> let $ed := edit-distance-check($o.authors, "Amihay Motro", 1)
> where $ed[0]
> return $o
> {code}
> {code}
> -- DISTRIBUTE_RESULT  |PARTITIONED|
>   exchange
>   -- ONE_TO_ONE_EXCHANGE  |PARTITIONED|
> select (function-call: asterix:get-item, Args:[function-call: 
> asterix:edit-distance-check, Args:[function-call: 
> asterix:field-access-by-index, Args:[%0->$$0, AInt32: {3}], AString: {Amihay 
> Motro}, AInt64: {1}], AInt64: {0}])
> -- STREAM_SELECT  |PARTITIONED|
>   project ([$$0])
>   -- STREAM_PROJECT  |PARTITIONED|
> exchange
> -- ONE_TO_ONE_EXCHANGE  |PARTITIONED|
>   unnest-map [$$6, $$0] <- function-call: asterix:index-search, 
> Args:[AString: {DBLP}, AInt32: {0}, AString: {test}, AString: {DBLP}, 
> ABoolean: {false}, ABoolean: {false}, AInt32: {1}, %0->$$9, AInt32: {1}, 
> %0->$$9, TRUE, TRUE, TRUE]
>   -- BTREE_SEARCH  |PARTITIONED|
> exchange
> -- ONE_TO_ONE_EXCHANGE  |PARTITIONED|
>   intersect ([$$9] <- [[$$9], [$$11]])
>   -- INTERSECT  |PARTITIONED|
> exchange
> -- ONE_TO_ONE_EXCHANGE  |PARTITIONED|
>   order (ASC, %0->$$9) 
>   -- STABLE_SORT [$$9(ASC)]  |PARTITIONED|
> exchange
> -- ONE_TO_ONE_EXCHANGE  |PARTITIONED|
>   unnest-map [$$9] <- 

[jira] [Commented] (ASTERIXDB-1711) Clean up class names

[ASF subversion and git services (JIRA)]

[ 
https://issues.apache.org/jira/browse/ASTERIXDB-1711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15691826#comment-15691826
 ] 

ASF subversion and git services commented on ASTERIXDB-1711:


Commit 426005929cac4d839899f948389e3e89cfce0db2 in asterixdb's branch 
refs/heads/master from [~tillw]
[ https://git-wip-us.apache.org/repos/asf?p=asterixdb.git;h=4260059 ]

ASTERIXDB-1711: remove some Aql-prefixes

Change-Id: Ia0b64ffa7c50cd62fc3303fdb44eb769f56c978a
Reviewed-on: https://asterix-gerrit.ics.uci.edu/1314
Tested-by: Jenkins 
Integration-Tests: Jenkins 
Reviewed-by: abdullah alamoudi 


> Clean up class names
> 
>
> Key: ASTERIXDB-1711
> URL: https://issues.apache.org/jira/browse/ASTERIXDB-1711
> Project: Apache AsterixDB
>  Issue Type: Task
>  Components: AsterixDB, Hyracks
>Reporter: Till
>Assignee: Till
>
> Some classes have names that include "AQL" (even though they are not language 
> specific) or "Asterix" (even tough that's part of package names).
> We should aim to name classes based on their functionality and clean up class 
> names that are not named that way.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (ASTERIXDB-1728) hyracks adminconsole is broken

[ASF subversion and git services (JIRA)]

[ 
https://issues.apache.org/jira/browse/ASTERIXDB-1728?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15633761#comment-15633761
 ] 

ASF subversion and git services commented on ASTERIXDB-1728:


Commit aee552c086cbdd2747a800640f0abaa686b9eb71 in asterixdb's branch 
refs/heads/master from [~tillw]
[ https://git-wip-us.apache.org/repos/asf?p=asterixdb.git;h=aee552c ]

ASTERIXDB-1728: revert to version 20090211 of JSON lib

Change-Id: I0430cb84c54dec9d452625232803c03681e94099
Reviewed-on: https://asterix-gerrit.ics.uci.edu/1338
Sonar-Qube: Jenkins 
Reviewed-by: Michael Blow 
Tested-by: Jenkins 


> hyracks adminconsole is broken
> --
>
> Key: ASTERIXDB-1728
> URL: https://issues.apache.org/jira/browse/ASTERIXDB-1728
> Project: Apache AsterixDB
>  Issue Type: Bug
>  Components: Hyracks
>Reporter: Yingyi Bu
>Assignee: Till
>
> {noformat}
>org.apache.wicket.WicketRuntimeException: Error attaching this 
> container for rendering: [Page class = 
> org.apache.hyracks.control.cc.adminconsole.pages.IndexPage, id = 0, render 
> count = 1]
> at 
> org.apache.wicket.MarkupContainer.onBeforeRenderChildren(MarkupContainer.java:1797)
>  ~[wicket-core-1.5.2.jar:1.5.2]
> at org.apache.wicket.Component.onBeforeRender(Component.java:3773) 
> ~[wicket-core-1.5.2.jar:1.5.2]
> at org.apache.wicket.Page.onBeforeRender(Page.java:823) 
> ~[wicket-core-1.5.2.jar:1.5.2]
> at 
> org.apache.wicket.Component.internalBeforeRender(Component.java:980) 
> ~[wicket-core-1.5.2.jar:1.5.2] 
> at org.apache.wicket.Component.beforeRender(Component.java:1014) 
> ~[wicket-core-1.5.2.jar:1.5.2] 
> at 
> org.apache.wicket.Component.internalPrepareForRender(Component.java:2183) 
> ~[wicket-core-1.5.2.jar:1.5.2] 
> at org.apache.wicket.Page.internalPrepareForRender(Page.java:280) 
> ~[wicket-core-1.5.2.jar:1.5.2] 
> at org.apache.wicket.Component.render(Component.java:2270) 
> ~[wicket-core-1.5.2.jar:1.5.2] 
> at org.apache.wicket.Page.renderPage(Page.java:1035) 
> ~[wicket-core-1.5.2.jar:1.5.2] 
> at 
> org.apache.wicket.request.handler.render.WebPageRenderer.renderPage(WebPageRenderer.java:105)
>  ~[wicket-core-1.5.2.jar:1.5.2] 
> at 
> org.apache.wicket.request.handler.render.WebPageRenderer.respond(WebPageRenderer.java:224)
>  ~[wicket-core-1.5.2.jar:1.5.2] 
> at 
> org.apache.wicket.request.handler.RenderPageRequestHandler.respond(RenderPageRequestHandler.java:167)
>  ~[wicket-core-1.5.2.jar:1.5.2] 
> at 
> org.apache.wicket.request.cycle.RequestCycle$HandlerExecutor.respond(RequestCycle.java:750)
>  ~[wicket-core-1.5.2.jar:1.5.2] 
> at 
> org.apache.wicket.request.RequestHandlerStack.execute(RequestHandlerStack.java:64)
>  ~[wicket-request-1.5.2.jar:1.5.2] 
> at 
> org.apache.wicket.request.cycle.RequestCycle.execute(RequestCycle.java:252) 
> [wicket-core-1.5.2.jar:1.5.2] 
> at 
> org.apache.wicket.request.cycle.RequestCycle.processRequest(RequestCycle.java:209)
>  [wicket-core-1.5.2.jar:1.5.2] 
> at 
> org.apache.wicket.request.cycle.RequestCycle.processRequestAndDetach(RequestCycle.java:280)
>  [wicket-core-1.5.2.jar:1.5.2] 
> at 
> org.apache.wicket.protocol.http.WicketFilter.processRequest(WicketFilter.java:162)
>  [wicket-core-1.5.2.jar:1.5.2] 
> at 
> org.apache.wicket.protocol.http.WicketFilter.doFilter(WicketFilter.java:218) 
> [wicket-core-1.5.2.jar:1.5.2] 
> at 
> org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1676)
>  [jetty-servlet-9.3.11.v20160721.jar:9.3.11.v20160721] 
> at 
> org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:581) 
> [jetty-servlet-9.3.11.v20160721.jar:9.3.11.v20160721] 
> at 
> org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:224)
>  [jetty-server-9.3.11.v20160721.jar:9.3.11.v20160721] 
> at 
> org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1180)
>  [jetty-server-9.3.11.v20160721.jar:9.3.11.v20160721] 
> at 
> org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:511) 
> [jetty-servlet-9.3.11.v20160721.jar:9.3.11.v20160721] 
> at 
> org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:185)
>  [jetty-server-9.3.11.v20160721.jar:9.3.11.v20160721] 
> at 
> org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1112)
>  [jetty-server-9.3.11.v20160721.jar:9.3.11.v20160721] 
> at 
> org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) 
> [jetty-server-9.3.11.v20160721.jar:9.3.11.v20160721] 
> at 
> 

[jira] [Commented] (ASTERIXDB-1725) Root page location calculation does not account for multipages

[ASF subversion and git services (JIRA)]

[ 
https://issues.apache.org/jira/browse/ASTERIXDB-1725?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15635534#comment-15635534
 ] 

ASF subversion and git services commented on ASTERIXDB-1725:


Commit 15e49e0db5a40d68e6e6dbf60138d6ec61fd15b0 in asterixdb's branch 
refs/heads/master from [~imaxon]
[ https://git-wip-us.apache.org/repos/asf?p=asterixdb.git;h=15e49e0 ]

Fix for ASTERIXDB-1725

This is tricky, the best method I could think to fix this involved simply
putting the root page number in the metadata page rather than trying to
calculate it somehow going backwards from the end of the file.

I also fixed a bug discovered by Mike B where getLSNOffset was not
taking into consideration page header sizes.

Change-Id: I9f21e96ab045d331e4fc1c77b5c73b975e6260fa
Reviewed-on: https://asterix-gerrit.ics.uci.edu/1331
Sonar-Qube: Jenkins 
Tested-by: Jenkins 
Integration-Tests: Jenkins 
Reviewed-by: Michael Blow 


> Root page location calculation does not account for multipages
> --
>
> Key: ASTERIXDB-1725
> URL: https://issues.apache.org/jira/browse/ASTERIXDB-1725
> Project: Apache AsterixDB
>  Issue Type: Bug
>Reporter: Ian Maxon
>Assignee: Ian Maxon
>
> The root page calculation is based on a fixed number of pages. This is 
> usually fine, unless the root page happens to be a leaf page. In this case it 
> may consist of any number of pages due to large object storage. 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (ASTERIXDB-1687) asterixhelper get_cluster_state can hang forever

[ASF subversion and git services (JIRA)]

[ 
https://issues.apache.org/jira/browse/ASTERIXDB-1687?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15572674#comment-15572674
 ] 

ASF subversion and git services commented on ASTERIXDB-1687:


Commit 791cc5d751200d9941efeaf8c5b81e3b79d82b35 in asterixdb's branch 
refs/heads/master from [~mblow]
[ https://git-wip-us.apache.org/repos/asf?p=asterixdb.git;h=791cc5d ]

ASTERIXDB-1687 - Configure Timeout On HTTP Connection

Fixes ASTERIXDB-1687 - asterixhelper get_cluster_state can hang forever,
by configuring a timeout on connect and read for HTTP calls, in the
event the CC is in a bad state and cannot answer requests

Change-Id: Ice9606acaec8f27b56d1d8ed947cc1588074ff2f
Reviewed-on: https://asterix-gerrit.ics.uci.edu/1276
Sonar-Qube: Jenkins 
Tested-by: Jenkins 
Integration-Tests: Jenkins 
Reviewed-by: Till Westmann 


> asterixhelper get_cluster_state can hang forever
> 
>
> Key: ASTERIXDB-1687
> URL: https://issues.apache.org/jira/browse/ASTERIXDB-1687
> Project: Apache AsterixDB
>  Issue Type: Bug
>Reporter: Ian Maxon
>Assignee: Michael Blow
>
> It seems like asterixhelper can hang forever. I was trying it on a machine 
> that had a stuck CC process running that I wasn't aware of at the time, and 
> it hung trying to connect to it until I killed it. 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)