Change in asterixdb[master]: Full-text implementation step 1

2016-11-16 Thread Jenkins (Code Review) 
Jenkins has posted comments on this change.

Change subject: Full-text implementation step 1
..


Patch Set 22:

WARNING: THIS CHANGE CONTAINS CROSS-PRODUCT CHANGES IN:
* asterixdb
* hyracks-fullstack

PLEASE REVIEW CAREFULLY AND LOOK FOR API CHANGES!

-- 
To view, visit https://asterix-gerrit.ics.uci.edu/1228
To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings

Gerrit-MessageType: comment
Gerrit-Change-Id: If00a871a8241d6aa6931f97b694d65f164d3ab8c
Gerrit-PatchSet: 22
Gerrit-Project: asterixdb
Gerrit-Branch: master
Gerrit-Owner: Taewoo Kim 
Gerrit-Reviewer: Heri Ramampiaro 
Gerrit-Reviewer: Ian Maxon 
Gerrit-Reviewer: Jenkins 
Gerrit-Reviewer: Jianfeng Jia 
Gerrit-Reviewer: Michael Blow 
Gerrit-Reviewer: Taewoo Kim 
Gerrit-Reviewer: Till Westmann 
Gerrit-Reviewer: Yingyi Bu 
Gerrit-HasComments: No

Change in asterixdb[master]: Full-text implementation step 1

2016-11-16 Thread Jenkins (Code Review) 
Jenkins has posted comments on this change.

Change subject: Full-text implementation step 1
..


Patch Set 22:

Build Started 
https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-notopic/3300/

-- 
To view, visit https://asterix-gerrit.ics.uci.edu/1228
To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings

Gerrit-MessageType: comment
Gerrit-Change-Id: If00a871a8241d6aa6931f97b694d65f164d3ab8c
Gerrit-PatchSet: 22
Gerrit-Project: asterixdb
Gerrit-Branch: master
Gerrit-Owner: Taewoo Kim 
Gerrit-Reviewer: Heri Ramampiaro 
Gerrit-Reviewer: Ian Maxon 
Gerrit-Reviewer: Jenkins 
Gerrit-Reviewer: Jianfeng Jia 
Gerrit-Reviewer: Michael Blow 
Gerrit-Reviewer: Taewoo Kim 
Gerrit-Reviewer: Till Westmann 
Gerrit-Reviewer: Yingyi Bu 
Gerrit-HasComments: No

[jira] [Commented] (ASTERIXDB-1556) Hash Table used by External hash group-by doesn't conform to the budget.

2016-11-16 Thread Taewoo Kim (JIRA) 

[ 
https://issues.apache.org/jira/browse/ASTERIXDB-1556?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15672016#comment-15672016
 ] 

Taewoo Kim commented on ASTERIXDB-1556:
---

Discussion with [~dtabass] and [~che...@gmail.com]: 

1) To solve the atomicity issue, between splitting insertion operation to the 
hash table into two pieces (make space and actual writing) and undoing the last 
insertion to the Data Table, the latter (undoing) is more preferable in terms 
of the code complexity: in case where an insertion into the Data Table succeeds 
and that insertion into the Hash Table fails. 

2) Regarding the finding victim policy in case we can't allocate a frame to the 
Data Table, a spilled data partition should not be chosen again unless the 
incoming tuple is being inserted into that partition since after spilling, 
there will be only one frame for that partition and keep spilling a partial 
frame (rather than writing a full frame to the disk) will not be good. 

> Hash Table used by External hash group-by doesn't conform to the budget.
> 
>
> Key: ASTERIXDB-1556
> URL: https://issues.apache.org/jira/browse/ASTERIXDB-1556
> Project: Apache AsterixDB
>  Issue Type: Bug
>Reporter: Taewoo Kim
>Assignee: Taewoo Kim
>Priority: Critical
>  Labels: soon
> Attachments: 2wayjoin.pdf, 2wayjoin.rtf, 2wayjoinplan.rtf, 
> 3wayjoin.pdf, 3wayjoin.rtf, 3wayjoinplan.rtf
>
>
> When we enable prefix-based fuzzy-join and apply the multi-way fuzzy-join ( > 
> 2), the system generates an out-of-memory exception. 
> Since a fuzzy-join is created using 30-40 lines of AQL codes and this AQL is 
> translated into massive number of operators (more than 200 operators in the 
> plan for a 3-way fuzzy join), it could generate out-of-memory exception.
> /// Update: as the discussion goes, we found that hash table in the external 
> hash group by doesn't conform to the frame limit. So, an out of memory 
> exception happens during the execution of an external hash group by operator.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Change in asterixdb[master]: Full-text implementation step 1

2016-11-16 Thread Jenkins (Code Review) 
Jenkins has posted comments on this change.

Change subject: Full-text implementation step 1
..


Patch Set 22:

WARNING: THIS CHANGE CONTAINS CROSS-PRODUCT CHANGES IN:
* asterixdb
* hyracks-fullstack

PLEASE REVIEW CAREFULLY AND LOOK FOR API CHANGES!

-- 
To view, visit https://asterix-gerrit.ics.uci.edu/1228
To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings

Gerrit-MessageType: comment
Gerrit-Change-Id: If00a871a8241d6aa6931f97b694d65f164d3ab8c
Gerrit-PatchSet: 22
Gerrit-Project: asterixdb
Gerrit-Branch: master
Gerrit-Owner: Taewoo Kim 
Gerrit-Reviewer: Heri Ramampiaro 
Gerrit-Reviewer: Ian Maxon 
Gerrit-Reviewer: Jenkins 
Gerrit-Reviewer: Jianfeng Jia 
Gerrit-Reviewer: Michael Blow 
Gerrit-Reviewer: Taewoo Kim 
Gerrit-Reviewer: Till Westmann 
Gerrit-Reviewer: Yingyi Bu 
Gerrit-HasComments: No

Change in asterixdb[master]: Full-text implementation step 1

2016-11-16 Thread Jenkins (Code Review) 
Jenkins has posted comments on this change.

Change subject: Full-text implementation step 1
..


Patch Set 22:

Build Started 
https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-notopic/3299/

-- 
To view, visit https://asterix-gerrit.ics.uci.edu/1228
To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings

Gerrit-MessageType: comment
Gerrit-Change-Id: If00a871a8241d6aa6931f97b694d65f164d3ab8c
Gerrit-PatchSet: 22
Gerrit-Project: asterixdb
Gerrit-Branch: master
Gerrit-Owner: Taewoo Kim 
Gerrit-Reviewer: Heri Ramampiaro 
Gerrit-Reviewer: Ian Maxon 
Gerrit-Reviewer: Jenkins 
Gerrit-Reviewer: Jianfeng Jia 
Gerrit-Reviewer: Michael Blow 
Gerrit-Reviewer: Taewoo Kim 
Gerrit-Reviewer: Till Westmann 
Gerrit-Reviewer: Yingyi Bu 
Gerrit-HasComments: No

Change in asterixdb[master]: Full-text implementation step 1

2016-11-16 Thread Taewoo Kim (Code Review) 
Hello Ian Maxon, Jenkins,

I'd like you to reexamine a change.  Please visit

https://asterix-gerrit.ics.uci.edu/1228

to look at the new patch set (#22).

Change subject: Full-text implementation step 1
..

Full-text implementation step 1

 - Introduced ftcontains() that conducts the full-text search
 - This version doesn't support index-based full-text search yet.
   After this step, the functionality will be added as a separate patch.
 - Added BinaryHashSet from BinaryHashMap class.

Change-Id: If00a871a8241d6aa6931f97b694d65f164d3ab8c
---
M 
asterixdb/asterix-algebra/src/main/java/org/apache/asterix/compiler/provider/DefaultRuleSetFactory.java
M 
asterixdb/asterix-algebra/src/main/java/org/apache/asterix/optimizer/base/RuleCollections.java
A 
asterixdb/asterix-algebra/src/main/java/org/apache/asterix/optimizer/rules/FullTextContainsParameterCheckRule.java
M 
asterixdb/asterix-algebra/src/main/java/org/apache/asterix/optimizer/rules/am/InvertedIndexAccessMethod.java
M 
asterixdb/asterix-algebra/src/main/java/org/apache/asterix/translator/util/FunctionCollection.java
A 
asterixdb/asterix-app/src/test/resources/runtimets/queries/fulltext/fulltext-01/fulltext-01.1.ddl.aql
A 
asterixdb/asterix-app/src/test/resources/runtimets/queries/fulltext/fulltext-01/fulltext-01.2.update.aql
A 
asterixdb/asterix-app/src/test/resources/runtimets/queries/fulltext/fulltext-01/fulltext-01.3.query.aql
A 
asterixdb/asterix-app/src/test/resources/runtimets/queries/fulltext/fulltext-01/fulltext-01.4.query.aql
A 
asterixdb/asterix-app/src/test/resources/runtimets/queries/fulltext/fulltext-01/fulltext-01.5.query.aql
A 
asterixdb/asterix-app/src/test/resources/runtimets/queries/fulltext/fulltext-02/fulltext-02.1.ddl.aql
A 
asterixdb/asterix-app/src/test/resources/runtimets/queries/fulltext/fulltext-02/fulltext-02.2.update.aql
A 
asterixdb/asterix-app/src/test/resources/runtimets/queries/fulltext/fulltext-02/fulltext-02.3.query.aql
A 
asterixdb/asterix-app/src/test/resources/runtimets/queries/fulltext/fulltext-02/fulltext-02.4.query.aql
A 
asterixdb/asterix-app/src/test/resources/runtimets/queries/fulltext/fulltext-02/fulltext-02.5.query.aql
A 
asterixdb/asterix-app/src/test/resources/runtimets/queries/fulltext/fulltext-02/fulltext-02.6.query.aql
A 
asterixdb/asterix-app/src/test/resources/runtimets/queries/fulltext/fulltext-03/fulltext-03.1.ddl.aql
A 
asterixdb/asterix-app/src/test/resources/runtimets/queries/fulltext/fulltext-03/fulltext-03.2.update.aql
A 
asterixdb/asterix-app/src/test/resources/runtimets/queries/fulltext/fulltext-03/fulltext-03.3.query.aql
A 
asterixdb/asterix-app/src/test/resources/runtimets/queries/fulltext/fulltext-03/fulltext-03.4.query.aql
A 
asterixdb/asterix-app/src/test/resources/runtimets/queries/fulltext/fulltext-03/fulltext-03.5.query.aql
A 
asterixdb/asterix-app/src/test/resources/runtimets/queries/fulltext/fulltext-03/fulltext-03.6.query.aql
A 
asterixdb/asterix-app/src/test/resources/runtimets/queries/fulltext/fulltext-03/fulltext-03.7.query.aql
A 
asterixdb/asterix-app/src/test/resources/runtimets/queries/fulltext/fulltext-03/fulltext-03.8.query.aql
A 
asterixdb/asterix-app/src/test/resources/runtimets/queries/fulltext/fulltext-04/fulltext-04.1.ddl.aql
A 
asterixdb/asterix-app/src/test/resources/runtimets/queries/fulltext/fulltext-04/fulltext-04.2.update.aql
A 
asterixdb/asterix-app/src/test/resources/runtimets/queries/fulltext/fulltext-04/fulltext-04.3.query.aql
A 
asterixdb/asterix-app/src/test/resources/runtimets/queries/fulltext/fulltext-05/fulltext-05.1.ddl.aql
A 
asterixdb/asterix-app/src/test/resources/runtimets/queries/fulltext/fulltext-05/fulltext-05.2.update.aql
A 
asterixdb/asterix-app/src/test/resources/runtimets/queries/fulltext/fulltext-05/fulltext-05.3.query.aql
A 
asterixdb/asterix-app/src/test/resources/runtimets/queries/fulltext/fulltext-06/fulltext-06.1.ddl.aql
A 
asterixdb/asterix-app/src/test/resources/runtimets/queries/fulltext/fulltext-06/fulltext-06.2.update.aql
A 
asterixdb/asterix-app/src/test/resources/runtimets/queries/fulltext/fulltext-06/fulltext-06.3.query.aql
A 
asterixdb/asterix-app/src/test/resources/runtimets/queries/fulltext/fulltext-07/fulltext-07.1.ddl.aql
A 
asterixdb/asterix-app/src/test/resources/runtimets/queries/fulltext/fulltext-07/fulltext-07.2.update.aql
A 
asterixdb/asterix-app/src/test/resources/runtimets/queries/fulltext/fulltext-07/fulltext-07.3.query.aql
A 
asterixdb/asterix-app/src/test/resources/runtimets/queries/fulltext/fulltext-07/fulltext-07.4.query.aql
A 
asterixdb/asterix-app/src/test/resources/runtimets/results/fulltext/fulltext-01/fulltext-01.3.adm
A 
asterixdb/asterix-app/src/test/resources/runtimets/results/fulltext/fulltext-01/fulltext-01.4.adm
A 
asterixdb/asterix-app/src/test/resources/runtimets/results/fulltext/fulltext-01/fulltext-01.5.adm
A 
asterixdb/asterix-app/src/test/resources/runtimets/results/fulltext/fulltext-02/fulltext-02.3.adm
A

[jira] [Updated] (ASTERIXDB-1735) Unable to load HDFS data to AsterixDB

2016-11-16 Thread Mingda Li (JIRA) 

 [ 
https://issues.apache.org/jira/browse/ASTERIXDB-1735?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Mingda Li updated ASTERIXDB-1735:
-
Description: 
I met a problem when loading data use following query:
use dataverse tpcds3;

load dataset inventory 

using 
hdfs(("hdfs"="hdfs://SCAI01.CS.UCLA.EDU:9000"),("path"="/clash/datasets/tpcds/10/inventory"),("format"="delimited-text"),("delimiter"="|"));



The Error in web interface is:

Internal error. Please check instance logs for further details. 
[NullPointerException]



I check the cc.log (cluster controller) and find the following problem:

SEVERE: Unable to create adapter\
org.apache.hyracks.algebricks.common.exceptions.AlgebricksException: Unable to 
create adapter\
at 
org.apache.asterix.metadata.declared.AqlMetadataProvider.getConfiguredAdapterFactory(AqlMetadataProvider.java:990)\
at 
org.apache.asterix.metadata.declared.LoadableDataSource.buildDatasourceScanRuntime(LoadableDataSource.java:141)\
at 
org.apache.asterix.metadata.declared.AqlMetadataProvider.getScannerRuntime(AqlMetadataProvider.java:383)\
at 
org.apache.hyracks.algebricks.core.algebra.operators.physical.DataSourceScanPOperator.contributeRuntimeOperator(DataSourceScanPOperator.java:112)\
at 
org.apache.hyracks.algebricks.core.algebra.operators.logical.AbstractLogicalOperator.contributeRuntimeOperator(AbstractLogicalOperator.java:166)\
at 
org.apache.hyracks.algebricks.core.jobgen.impl.PlanCompiler.compileOpRef(PlanCompiler.java:98)\
at 
org.apache.hyracks.algebricks.core.jobgen.impl.PlanCompiler.compileOpRef(PlanCompiler.java:85)\
at 
org.apache.hyracks.algebricks.core.jobgen.impl.PlanCompiler.compileOpRef(PlanCompiler.java:85)\
at 
org.apache.hyracks.algebricks.core.jobgen.impl.PlanCompiler.compileOpRef(PlanCompiler.java:85)\
at 
org.apache.hyracks.algebricks.core.jobgen.impl.PlanCompiler.compileOpRef(PlanCompiler.java:85)\
at 
org.apache.hyracks.algebricks.core.jobgen.impl.PlanCompiler.compileOpRef(PlanCompiler.java:85)\
at 
org.apache.hyracks.algebricks.core.jobgen.impl.PlanCompiler.compileOpRef(PlanCompiler.java:85)\
at 
org.apache.hyracks.algebricks.core.jobgen.impl.PlanCompiler.compileOpRef(PlanCompiler.java:85)\
at 
org.apache.hyracks.algebricks.core.jobgen.impl.PlanCompiler.compileOpRef(PlanCompiler.java:85)\
at 
org.apache.hyracks.algebricks.core.jobgen.impl.PlanCompiler.compileOpRef(PlanCompiler.java:85)\
at 
org.apache.hyracks.algebricks.core.jobgen.impl.PlanCompiler.compileOpRef(PlanCompiler.java:85)\
at 
org.apache.hyracks.algebricks.core.jobgen.impl.PlanCompiler.compilePlan(PlanCompiler.java:61)\
at 
org.apache.hyracks.algebricks.compiler.api.HeuristicCompilerFactoryBuilder$1$1.createJob(HeuristicCompilerFactoryBuilder.java:107)\
at 
org.apache.asterix.api.common.APIFramework.compileQuery(APIFramework.java:344)\
at 
org.apache.asterix.app.translator.QueryTranslator.handleLoadStatement(QueryTranslator.java:1845)\
at 
org.apache.asterix.app.translator.QueryTranslator.compileAndExecute(QueryTranslator.java:341)\
at 
org.apache.asterix.app.translator.QueryTranslator.compileAndExecute(QueryTranslator.java:268)\
at 
org.apache.asterix.api.http.servlet.APIServlet.doPost(APIServlet.java:132)\
at javax.servlet.http.HttpServlet.service(HttpServlet.java:707)\
at javax.servlet.http.HttpServlet.service(HttpServlet.java:790)\
at 
org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:845)\
at 
org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:583)\
at 
org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:224)\
at 
org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1180)\
at 
org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:511)\
at 
org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:185)\
at 
org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1112)\
at 
org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)\
at 
org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:134)\
at org.eclipse.jetty.server.Server.handle(Server.java:524)\
at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:319)\
at 
org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:253)\
at 
org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:273)\
at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:95)\
at 
org.eclipse.jetty.io.SelectChannelEndPoint$2.run(SelectChannelEndPoint.java:93)\
at

[jira] [Created] (ASTERIXDB-1735) Unable to load HDFS to AsterixDB

2016-11-16 Thread Mingda Li (JIRA) 
Mingda Li created ASTERIXDB-1735:


 Summary: Unable to load HDFS to AsterixDB
 Key: ASTERIXDB-1735
 URL: https://issues.apache.org/jira/browse/ASTERIXDB-1735
 Project: Apache AsterixDB
  Issue Type: Bug
Reporter: Mingda Li


I met a problem when loading data use following query:
use dataverse tpcds3;

load dataset inventory 

using 
hdfs(("hdfs"="hdfs://SCAI01.CS.UCLA.EDU:9000"),("path"="/clash/datasets/tpcds/10/inventory"),("format"="delimited-text"),("delimiter"="|"));



The Error in web interface is:

Internal error. Please check instance logs for further details. 
[NullPointerException]



I check the cc.log (cluster controller) and find the following problem:

SEVERE: Unable to create adapter\
org.apache.hyracks.algebricks.common.exceptions.AlgebricksException: Unable to 
create adapter\
at 
org.apache.asterix.metadata.declared.AqlMetadataProvider.getConfiguredAdapterFactory(AqlMetadataProvider.java:990)\
at 
org.apache.asterix.metadata.declared.LoadableDataSource.buildDatasourceScanRuntime(LoadableDataSource.java:141)\
at 
org.apache.asterix.metadata.declared.AqlMetadataProvider.getScannerRuntime(AqlMetadataProvider.java:383)\
at 
org.apache.hyracks.algebricks.core.algebra.operators.physical.DataSourceScanPOperator.contributeRuntimeOperator(DataSourceScanPOperator.java:112)\
at 
org.apache.hyracks.algebricks.core.algebra.operators.logical.AbstractLogicalOperator.contributeRuntimeOperator(AbstractLogicalOperator.java:166)\
at 
org.apache.hyracks.algebricks.core.jobgen.impl.PlanCompiler.compileOpRef(PlanCompiler.java:98)\
at 
org.apache.hyracks.algebricks.core.jobgen.impl.PlanCompiler.compileOpRef(PlanCompiler.java:85)\
at 
org.apache.hyracks.algebricks.core.jobgen.impl.PlanCompiler.compileOpRef(PlanCompiler.java:85)\
at 
org.apache.hyracks.algebricks.core.jobgen.impl.PlanCompiler.compileOpRef(PlanCompiler.java:85)\
at 
org.apache.hyracks.algebricks.core.jobgen.impl.PlanCompiler.compileOpRef(PlanCompiler.java:85)\
at 
org.apache.hyracks.algebricks.core.jobgen.impl.PlanCompiler.compileOpRef(PlanCompiler.java:85)\
at 
org.apache.hyracks.algebricks.core.jobgen.impl.PlanCompiler.compileOpRef(PlanCompiler.java:85)\
at 
org.apache.hyracks.algebricks.core.jobgen.impl.PlanCompiler.compileOpRef(PlanCompiler.java:85)\
at 
org.apache.hyracks.algebricks.core.jobgen.impl.PlanCompiler.compileOpRef(PlanCompiler.java:85)\
at 
org.apache.hyracks.algebricks.core.jobgen.impl.PlanCompiler.compileOpRef(PlanCompiler.java:85)\
at 
org.apache.hyracks.algebricks.core.jobgen.impl.PlanCompiler.compileOpRef(PlanCompiler.java:85)\
at 
org.apache.hyracks.algebricks.core.jobgen.impl.PlanCompiler.compilePlan(PlanCompiler.java:61)\
at 
org.apache.hyracks.algebricks.compiler.api.HeuristicCompilerFactoryBuilder$1$1.createJob(HeuristicCompilerFactoryBuilder.java:107)\
at 
org.apache.asterix.api.common.APIFramework.compileQuery(APIFramework.java:344)\
at 
org.apache.asterix.app.translator.QueryTranslator.handleLoadStatement(QueryTranslator.java:1845)\
at 
org.apache.asterix.app.translator.QueryTranslator.compileAndExecute(QueryTranslator.java:341)\
at 
org.apache.asterix.app.translator.QueryTranslator.compileAndExecute(QueryTranslator.java:268)\
at 
org.apache.asterix.api.http.servlet.APIServlet.doPost(APIServlet.java:132)\
at javax.servlet.http.HttpServlet.service(HttpServlet.java:707)\
at javax.servlet.http.HttpServlet.service(HttpServlet.java:790)\
at 
org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:845)\
at 
org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:583)\
at 
org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:224)\
at 
org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1180)\
at 
org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:511)\
at 
org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:185)\
at 
org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1112)\
at 
org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)\
at 
org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:134)\
at org.eclipse.jetty.server.Server.handle(Server.java:524)\
at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:319)\
at 
org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:253)\
at 
org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:273)\
at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:95)\
at

[jira] [Updated] (ASTERIXDB-1735) Unable to load HDFS data to AsterixDB

2016-11-16 Thread Mingda Li (JIRA) 

 [ 
https://issues.apache.org/jira/browse/ASTERIXDB-1735?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Mingda Li updated ASTERIXDB-1735:
-
Summary: Unable to load HDFS data to AsterixDB  (was: Unable to load HDFS 
to AsterixDB)

> Unable to load HDFS data to AsterixDB
> -
>
> Key: ASTERIXDB-1735
> URL: https://issues.apache.org/jira/browse/ASTERIXDB-1735
> Project: Apache AsterixDB
>  Issue Type: Bug
>Reporter: Mingda Li
>
> I met a problem when loading data use following query:
> use dataverse tpcds3;
> load dataset inventory 
> using 
> hdfs(("hdfs"="hdfs://SCAI01.CS.UCLA.EDU:9000"),("path"="/clash/datasets/tpcds/10/inventory"),("format"="delimited-text"),("delimiter"="|"));
> The Error in web interface is:
> Internal error. Please check instance logs for further details. 
> [NullPointerException]
> I check the cc.log (cluster controller) and find the following problem:
> SEVERE: Unable to create adapter\
> org.apache.hyracks.algebricks.common.exceptions.AlgebricksException: Unable 
> to create adapter\
>   at 
> org.apache.asterix.metadata.declared.AqlMetadataProvider.getConfiguredAdapterFactory(AqlMetadataProvider.java:990)\
>   at 
> org.apache.asterix.metadata.declared.LoadableDataSource.buildDatasourceScanRuntime(LoadableDataSource.java:141)\
>   at 
> org.apache.asterix.metadata.declared.AqlMetadataProvider.getScannerRuntime(AqlMetadataProvider.java:383)\
>   at 
> org.apache.hyracks.algebricks.core.algebra.operators.physical.DataSourceScanPOperator.contributeRuntimeOperator(DataSourceScanPOperator.java:112)\
>   at 
> org.apache.hyracks.algebricks.core.algebra.operators.logical.AbstractLogicalOperator.contributeRuntimeOperator(AbstractLogicalOperator.java:166)\
>   at 
> org.apache.hyracks.algebricks.core.jobgen.impl.PlanCompiler.compileOpRef(PlanCompiler.java:98)\
>   at 
> org.apache.hyracks.algebricks.core.jobgen.impl.PlanCompiler.compileOpRef(PlanCompiler.java:85)\
>   at 
> org.apache.hyracks.algebricks.core.jobgen.impl.PlanCompiler.compileOpRef(PlanCompiler.java:85)\
>   at 
> org.apache.hyracks.algebricks.core.jobgen.impl.PlanCompiler.compileOpRef(PlanCompiler.java:85)\
>   at 
> org.apache.hyracks.algebricks.core.jobgen.impl.PlanCompiler.compileOpRef(PlanCompiler.java:85)\
>   at 
> org.apache.hyracks.algebricks.core.jobgen.impl.PlanCompiler.compileOpRef(PlanCompiler.java:85)\
>   at 
> org.apache.hyracks.algebricks.core.jobgen.impl.PlanCompiler.compileOpRef(PlanCompiler.java:85)\
>   at 
> org.apache.hyracks.algebricks.core.jobgen.impl.PlanCompiler.compileOpRef(PlanCompiler.java:85)\
>   at 
> org.apache.hyracks.algebricks.core.jobgen.impl.PlanCompiler.compileOpRef(PlanCompiler.java:85)\
>   at 
> org.apache.hyracks.algebricks.core.jobgen.impl.PlanCompiler.compileOpRef(PlanCompiler.java:85)\
>   at 
> org.apache.hyracks.algebricks.core.jobgen.impl.PlanCompiler.compileOpRef(PlanCompiler.java:85)\
>   at 
> org.apache.hyracks.algebricks.core.jobgen.impl.PlanCompiler.compilePlan(PlanCompiler.java:61)\
>   at 
> org.apache.hyracks.algebricks.compiler.api.HeuristicCompilerFactoryBuilder$1$1.createJob(HeuristicCompilerFactoryBuilder.java:107)\
>   at 
> org.apache.asterix.api.common.APIFramework.compileQuery(APIFramework.java:344)\
>   at 
> org.apache.asterix.app.translator.QueryTranslator.handleLoadStatement(QueryTranslator.java:1845)\
>   at 
> org.apache.asterix.app.translator.QueryTranslator.compileAndExecute(QueryTranslator.java:341)\
>   at 
> org.apache.asterix.app.translator.QueryTranslator.compileAndExecute(QueryTranslator.java:268)\
>   at 
> org.apache.asterix.api.http.servlet.APIServlet.doPost(APIServlet.java:132)\
>   at javax.servlet.http.HttpServlet.service(HttpServlet.java:707)\
>   at javax.servlet.http.HttpServlet.service(HttpServlet.java:790)\
>   at 
> org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:845)\
>   at 
> org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:583)\
>   at 
> org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:224)\
>   at 
> org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1180)\
>   at 
> org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:511)\
>   at 
> org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:185)\
>   at 
> org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1112)\
>   at 
> org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)\
>   at 
> org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:134)\
>   at org.eclipse.jetty.server.Server.handle(Server.java:524)\
>   at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:319)\
>

Change in asterixdb[master]: Address Don's comments for the query section doc.

2016-11-16 Thread Yingyi Bu (Code Review) 
Yingyi Bu has submitted this change and it was merged.

Change subject: Address Don's comments for the query section doc.
..


Address Don's comments for the query section doc.

Change-Id: I30ab472d87221d6b1c709f24c4dba1bdfaa2c0b4
Reviewed-on: https://asterix-gerrit.ics.uci.edu/1329
Sonar-Qube: Jenkins 
Tested-by: Jenkins 
Integration-Tests: Jenkins 
Reviewed-by: Till Westmann 
---
M asterixdb/asterix-doc/src/main/markdown/sqlpp/3_query.md
1 file changed, 142 insertions(+), 48 deletions(-)

Approvals:
  Till Westmann: Looks good to me, approved
  Jenkins: Verified; No violations found; Verified



diff --git a/asterixdb/asterix-doc/src/main/markdown/sqlpp/3_query.md 
b/asterixdb/asterix-doc/src/main/markdown/sqlpp/3_query.md
index 85787e8..dc760ba 100644
--- a/asterixdb/asterix-doc/src/main/markdown/sqlpp/3_query.md
+++ b/asterixdb/asterix-doc/src/main/markdown/sqlpp/3_query.md
@@ -33,13 +33,13 @@
 Subquery   ::= "(" SelectStatement ")"
 
 SelectBlock::= SelectClause
-   ( FromClause ( WithClause )?)?
+   ( FromClause ( LetClause )?)?
( WhereClause )?
( GroupbyClause ( LetClause )? ( HavingClause )? )?
|
-   FromClause ( WithClause )?
+   FromClause ( LetClause )?
( WhereClause )?
-   ( GroupbyClause ( WithClause )? ( HavingClause )? )?
+   ( GroupbyClause ( LetClause )? ( HavingClause )? )?
SelectClause
 
 SelectClause   ::=  (  |  )? ( SelectRegular | 
SelectValue )
@@ -48,10 +48,10 @@
 Projection ::= ( Expression (  )? Identifier | "*" )
 
 FromClause ::=  FromTerm ( "," FromTerm )*
-FromTerm   ::= Expression ((  )? Variable)? (  Variable )?
+FromTerm   ::= Expression ((  )? Variable)?
( ( JoinType )? ( JoinClause | UnnestClause ) )*
 
-JoinClause ::=  Expression ((  )? Variable)? ( 
Variable)?  Expression
+JoinClause ::=  Expression ((  )? Variable)?  
Expression
 UnnestClause   ::= (  |  |  ) Expression
(  )? Variable (  Variable )?
 JoinType   ::= (  |  (  )? )
@@ -74,13 +74,13 @@
 
 In this section, we will make use of two stored collections of objects 
(datasets), `GleambookUsers` and `GleambookMessages`, in a series of running 
examples to explain `SELECT` queries. The contents of the example collections 
are as follows:
 
-`GleambookUsers` collection:
+`GleambookUsers` collection (or, dataset):
 
 
{"id":1,"alias":"Margarita","name":"MargaritaStoddard","nickname":"Mags","userSince":"2012-08-20T10:10:00","friendIds":[2,3,6,10],"employment":[{"organizationName":"Codetechno","start-date":"2006-08-06"},{"organizationName":"geomedia","start-date":"2010-06-17","end-date":"2010-01-26"}],"gender":"F"}
 
{"id":2,"alias":"Isbel","name":"IsbelDull","nickname":"Izzy","userSince":"2011-01-22T10:10:00","friendIds":[1,4],"employment":[{"organizationName":"Hexviafind","startDate":"2010-04-27"}]}
 
{"id":3,"alias":"Emory","name":"EmoryUnk","userSince":"2012-07-10T10:10:00","friendIds":[1,5,8,9],"employment":[{"organizationName":"geomedia","startDate":"2010-06-17","endDate":"2010-01-26"}]}
 
-`GleambookMessages` collection:
+`GleambookMessages` collection (or, dataset):
 
 
{"messageId":2,"authorId":1,"inResponseTo":4,"senderLocation":[41.66,80.87],"message":"
 dislike iphone its touch-screen is horrible"}
 
{"messageId":3,"authorId":2,"inResponseTo":4,"senderLocation":[48.09,81.01],"message":"
 like samsung the plan is amazing"}
@@ -136,6 +136,7 @@
 In SQL++, the traditional SQL-style `SELECT` syntax is also supported.
 This syntax can also be reformulated in a `SELECT VALUE` based manner in SQL++.
 (E.g., `SELECT expA AS fldA, expB AS fldB` is syntactic sugar for `SELECT 
VALUE { 'fldA': expA, 'fldB': expB }`.)
+Unlike in SQL, the result of an SQL++ query does not preserve the order of 
expressions in the `SELECT` clause.
 
 # Example
 SELECT user.alias user_alias, user.name user_name
@@ -150,7 +151,9 @@
 } ]
 
 ### SELECT *
-In SQL++, `SELECT *` returns a object with a nested field for each input 
tuple. Each field has as its field name the name of a binding variable 
generated by either the `FROM` clause or `GROUP BY` clause in the current 
enclosing `SELECT` statement, and its field is the value of that binding 
variable.
+In SQL++, `SELECT *` returns a object with a nested field for each input tuple.
+Each field has as its field name the name of a binding variable generated by 
either the `FROM` clause or `GROUP BY`
+clause in the

Change in asterixdb[master]: Address Don's comments for the query section doc.

2016-11-16 Thread Till Westmann (Code Review) 
Till Westmann has posted comments on this change.

Change subject: Address Don's comments for the query section doc.
..


Patch Set 1: Code-Review+2

-- 
To view, visit https://asterix-gerrit.ics.uci.edu/1329
To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings

Gerrit-MessageType: comment
Gerrit-Change-Id: I30ab472d87221d6b1c709f24c4dba1bdfaa2c0b4
Gerrit-PatchSet: 1
Gerrit-Project: asterixdb
Gerrit-Branch: master
Gerrit-Owner: Yingyi Bu 
Gerrit-Reviewer: Jenkins 
Gerrit-Reviewer: Till Westmann 
Gerrit-HasComments: No

Change in asterixdb[master]: Add record reader and parser for CAP messages

2016-11-16 Thread Till Westmann (Code Review) 
Till Westmann has posted comments on this change.

Change subject: Add record reader and parser for CAP messages
..


Patch Set 10: Code-Review-1

Marking -1 due to the org.json issue.

-- 
To view, visit https://asterix-gerrit.ics.uci.edu/1269
To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings

Gerrit-MessageType: comment
Gerrit-Change-Id: Ia36101a0761973a9edb96b42d3dcc117661301da
Gerrit-PatchSet: 10
Gerrit-Project: asterixdb
Gerrit-Branch: master
Gerrit-Owner: Xikui Wang 
Gerrit-Reviewer: Ian Maxon 
Gerrit-Reviewer: Jenkins 
Gerrit-Reviewer: Till Westmann 
Gerrit-Reviewer: Xikui Wang 
Gerrit-Reviewer: abdullah alamoudi 
Gerrit-HasComments: No