date:20160909

Change in asterixdb[master]: Add HTTP API to Collect Threaddumps From NCs

2016-09-09 Thread Jenkins (Code Review)

Jenkins has posted comments on this change.

Change subject: Add HTTP API to Collect Threaddumps From NCs
..


Patch Set 4:

Integration Tests Started 
https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-integration-tests/611/

-- 
To view, visit https://asterix-gerrit.ics.uci.edu/1159
To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings

Gerrit-MessageType: comment
Gerrit-Change-Id: I536606a1fbc394c6c70bb8ce14791cc411691617
Gerrit-PatchSet: 4
Gerrit-Project: asterixdb
Gerrit-Branch: master
Gerrit-Owner: Michael Blow 
Gerrit-Reviewer: Jenkins 
Gerrit-Reviewer: Till Westmann 
Gerrit-HasComments: No

Change in asterixdb[master]: ASTERIXDB-1572 and ASTERIXDB-1591: fix and regression tests.

2016-09-09 Thread Jenkins (Code Review)

Jenkins has posted comments on this change.

Change subject: ASTERIXDB-1572 and ASTERIXDB-1591: fix and regression tests.
..


Patch Set 3: Integration-Tests+1

Integration Tests Successful

https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-integration-tests/610/ : 
SUCCESS

-- 
To view, visit https://asterix-gerrit.ics.uci.edu/1161
To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings

Gerrit-MessageType: comment
Gerrit-Change-Id: I7092dd2fa7c9193ff919b27464854936f48261b0
Gerrit-PatchSet: 3
Gerrit-Project: asterixdb
Gerrit-Branch: master
Gerrit-Owner: Yingyi Bu 
Gerrit-Reviewer: Jenkins 
Gerrit-Reviewer: Till Westmann 
Gerrit-HasComments: No

Change in asterixdb[master]: Add HTTP API to Collect Threaddumps From NCs

2016-09-09 Thread Jenkins (Code Review)

Jenkins has posted comments on this change.

Change subject: Add HTTP API to Collect Threaddumps From NCs
..


Patch Set 4:

WARNING: THIS CHANGE CONTAINS CROSS-PRODUCT CHANGES IN:
* asterixdb
* hyracks-fullstack

PLEASE REVIEW CAREFULLY AND LOOK FOR API CHANGES!

-- 
To view, visit https://asterix-gerrit.ics.uci.edu/1159
To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings

Gerrit-MessageType: comment
Gerrit-Change-Id: I536606a1fbc394c6c70bb8ce14791cc411691617
Gerrit-PatchSet: 4
Gerrit-Project: asterixdb
Gerrit-Branch: master
Gerrit-Owner: Michael Blow 
Gerrit-Reviewer: Jenkins 
Gerrit-Reviewer: Till Westmann 
Gerrit-HasComments: No

Change in asterixdb[master]: Add HTTP API to Collect Threaddumps From NCs

2016-09-09 Thread Michael Blow (Code Review)

Hello Jenkins,

I'd like you to reexamine a change.  Please visit

https://asterix-gerrit.ics.uci.edu/1159

to look at the new patch set (#4).

Change subject: Add HTTP API to Collect Threaddumps From NCs
..

Add HTTP API to Collect Threaddumps From NCs

Thread dump returned in JSON format.

e.g. http://localhost:19002/admin/cluster/node/asterix_nc2/threaddump

Also, add CC config, stats, threaddumps

Change-Id: I536606a1fbc394c6c70bb8ce14791cc411691617
---
M 
asterixdb/asterix-app/src/main/java/org/apache/asterix/api/common/AsterixHyracksIntegrationUtil.java
M 
asterixdb/asterix-app/src/main/java/org/apache/asterix/api/http/servlet/ClusterAPIServlet.java
A 
asterixdb/asterix-app/src/main/java/org/apache/asterix/api/http/servlet/ClusterCCDetailsAPIServlet.java
M 
asterixdb/asterix-app/src/main/java/org/apache/asterix/api/http/servlet/ClusterNodeDetailsAPIServlet.java
M 
asterixdb/asterix-app/src/main/java/org/apache/asterix/hyracks/bootstrap/CCApplicationEntryPoint.java
A asterixdb/asterix-app/src/test/resources/runtimets/queries/api/APIQueries.xml
A 
asterixdb/asterix-app/src/test/resources/runtimets/queries/api/cluster_state_cc_1/cluster_state_cc_1.1.cstate.aql
M 
asterixdb/asterix-app/src/test/resources/runtimets/queries/comparison/ComparisonQueries.xml
M 
asterixdb/asterix-app/src/test/resources/runtimets/queries/comparison/deep_equal/DeepEqualQueries.xml
M 
asterixdb/asterix-app/src/test/resources/runtimets/queries/records/RecordsQueries.xml
M 
asterixdb/asterix-app/src/test/resources/runtimets/results/api/cluster_state_1/cluster_state_1.1.adm
M 
asterixdb/asterix-app/src/test/resources/runtimets/results/api/cluster_state_3/cluster_state_3.1.adm
M 
asterixdb/asterix-app/src/test/resources/runtimets/results/api/cluster_state_4/cluster_state_4.1.adm
A 
asterixdb/asterix-app/src/test/resources/runtimets/results/api/cluster_state_cc_1/cluster_state_cc_1.1.adm
M asterixdb/asterix-app/src/test/resources/runtimets/testsuite.xml
M 
asterixdb/asterix-common/src/main/java/org/apache/asterix/common/utils/ServletUtil.java
M 
hyracks-fullstack/hyracks/hyracks-api/src/main/java/org/apache/hyracks/api/client/HyracksClientInterfaceFunctions.java
M 
hyracks-fullstack/hyracks/hyracks-api/src/main/java/org/apache/hyracks/api/client/HyracksClientInterfaceRemoteProxy.java
M 
hyracks-fullstack/hyracks/hyracks-api/src/main/java/org/apache/hyracks/api/client/HyracksConnection.java
M 
hyracks-fullstack/hyracks/hyracks-api/src/main/java/org/apache/hyracks/api/client/IHyracksClientConnection.java
M 
hyracks-fullstack/hyracks/hyracks-api/src/main/java/org/apache/hyracks/api/client/IHyracksClientInterface.java
M 
hyracks-fullstack/hyracks/hyracks-control/hyracks-control-cc/src/main/java/org/apache/hyracks/control/cc/ClusterControllerService.java
M 
hyracks-fullstack/hyracks/hyracks-control/hyracks-control-cc/src/main/java/org/apache/hyracks/control/cc/NodeControllerState.java
M 
hyracks-fullstack/hyracks/hyracks-control/hyracks-control-cc/src/main/java/org/apache/hyracks/control/cc/work/GetNodeDetailsJSONWork.java
A 
hyracks-fullstack/hyracks/hyracks-control/hyracks-control-cc/src/main/java/org/apache/hyracks/control/cc/work/GetThreadDumpWork.java
A 
hyracks-fullstack/hyracks/hyracks-control/hyracks-control-cc/src/main/java/org/apache/hyracks/control/cc/work/NotifyThreadDumpResponse.java
M 
hyracks-fullstack/hyracks/hyracks-control/hyracks-control-common/src/main/java/org/apache/hyracks/control/common/base/IClusterController.java
M 
hyracks-fullstack/hyracks/hyracks-control/hyracks-control-common/src/main/java/org/apache/hyracks/control/common/base/INodeController.java
M 
hyracks-fullstack/hyracks/hyracks-control/hyracks-control-common/src/main/java/org/apache/hyracks/control/common/ipc/CCNCFunctions.java
M 
hyracks-fullstack/hyracks/hyracks-control/hyracks-control-common/src/main/java/org/apache/hyracks/control/common/ipc/ClusterControllerRemoteProxy.java
M 
hyracks-fullstack/hyracks/hyracks-control/hyracks-control-common/src/main/java/org/apache/hyracks/control/common/ipc/NodeControllerRemoteProxy.java
A 
hyracks-fullstack/hyracks/hyracks-control/hyracks-control-common/src/main/java/org/apache/hyracks/control/common/work/ThreadDumpWork.java
M 
hyracks-fullstack/hyracks/hyracks-control/hyracks-control-nc/src/main/java/org/apache/hyracks/control/nc/NodeControllerService.java
A 
hyracks-fullstack/hyracks/hyracks-control/hyracks-control-nc/src/main/java/org/apache/hyracks/control/nc/work/NodeThreadDumpWork.java
34 files changed, 1,180 insertions(+), 485 deletions(-)


  git pull ssh://asterix-gerrit.ics.uci.edu:29418/asterixdb 
refs/changes/59/1159/4
-- 
To view, visit https://asterix-gerrit.ics.uci.edu/1159
To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings

Gerrit-MessageType: newpatchset
Gerrit-Change-Id: I536606a1fbc394c6c70bb8ce14791cc411691617
Gerrit-PatchSet: 4
Gerrit-Project: asterixdb
Gerrit-Branch: master
Gerrit-Owner: Michael Blow

Change in asterixdb[master]: Add HTTP API to Collect Threaddumps From NCs

2016-09-09 Thread Jenkins (Code Review)

Jenkins has posted comments on this change.

Change subject: Add HTTP API to Collect Threaddumps From NCs
..


Patch Set 4:

Build Started 
https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-notopic/2593/

-- 
To view, visit https://asterix-gerrit.ics.uci.edu/1159
To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings

Gerrit-MessageType: comment
Gerrit-Change-Id: I536606a1fbc394c6c70bb8ce14791cc411691617
Gerrit-PatchSet: 4
Gerrit-Project: asterixdb
Gerrit-Branch: master
Gerrit-Owner: Michael Blow 
Gerrit-Reviewer: Jenkins 
Gerrit-Reviewer: Till Westmann 
Gerrit-HasComments: No

Change in asterixdb[master]: ASTERIXDB-1572 and ASTERIXDB-1591: fix and regression tests.

2016-09-09 Thread Jenkins (Code Review)

Jenkins has posted comments on this change.

Change subject: ASTERIXDB-1572 and ASTERIXDB-1591: fix and regression tests.
..


Patch Set 3:

Integration Tests Started 
https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-integration-tests/610/

-- 
To view, visit https://asterix-gerrit.ics.uci.edu/1161
To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings

Gerrit-MessageType: comment
Gerrit-Change-Id: I7092dd2fa7c9193ff919b27464854936f48261b0
Gerrit-PatchSet: 3
Gerrit-Project: asterixdb
Gerrit-Branch: master
Gerrit-Owner: Yingyi Bu 
Gerrit-Reviewer: Jenkins 
Gerrit-Reviewer: Till Westmann 
Gerrit-HasComments: No

Change in asterixdb[master]: ASTERIXDB-1572 and ASTERIXDB-1591: fix and regression tests.

2016-09-09 Thread Jenkins (Code Review)

Jenkins has posted comments on this change.

Change subject: ASTERIXDB-1572 and ASTERIXDB-1591: fix and regression tests.
..


Patch Set 3:

WARNING: THIS CHANGE CONTAINS CROSS-PRODUCT CHANGES IN:
* asterixdb
* hyracks-fullstack

PLEASE REVIEW CAREFULLY AND LOOK FOR API CHANGES!

-- 
To view, visit https://asterix-gerrit.ics.uci.edu/1161
To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings

Gerrit-MessageType: comment
Gerrit-Change-Id: I7092dd2fa7c9193ff919b27464854936f48261b0
Gerrit-PatchSet: 3
Gerrit-Project: asterixdb
Gerrit-Branch: master
Gerrit-Owner: Yingyi Bu 
Gerrit-Reviewer: Jenkins 
Gerrit-Reviewer: Till Westmann 
Gerrit-HasComments: No

Change in asterixdb[master]: ASTERIXDB-1572 and ASTERIXDB-1591: fix and regression tests.

2016-09-09 Thread Yingyi Bu (Code Review)

Hello Jenkins,

I'd like you to reexamine a change.  Please visit

https://asterix-gerrit.ics.uci.edu/1161

to look at the new patch set (#3).

Change subject: ASTERIXDB-1572 and ASTERIXDB-1591: fix and regression tests.
..

ASTERIXDB-1572 and ASTERIXDB-1591: fix and regression tests.

- push aggregates into subplans;
- fix recursive variable mapping in subquery decorrelation.

Change-Id: I7092dd2fa7c9193ff919b27464854936f48261b0
---
M 
asterixdb/asterix-algebra/src/main/java/org/apache/asterix/optimizer/rules/PushAggregateIntoNestedSubplanRule.java
M 
asterixdb/asterix-algebra/src/main/java/org/apache/asterix/optimizer/rules/subplan/InlineSubplanInputForNestedTupleSourceRule.java
M asterixdb/asterix-app/data/tpcds/catalog_sales.csv
M asterixdb/asterix-app/data/tpcds/date_dim.csv
M asterixdb/asterix-app/data/tpcds/store_sales.csv
A 
asterixdb/asterix-app/src/test/resources/optimizerts/queries/subquery/query-ASTERIXDB-1572.sqlpp
A 
asterixdb/asterix-app/src/test/resources/optimizerts/queries/tpcds/query-ASTERIXDB-1591.sqlpp
M 
asterixdb/asterix-app/src/test/resources/optimizerts/results/inverted-index-join/issue741.plan
M 
asterixdb/asterix-app/src/test/resources/optimizerts/results/query-ASTERIXDB-159-3.plan
M 
asterixdb/asterix-app/src/test/resources/optimizerts/results/query-issue562.plan
M 
asterixdb/asterix-app/src/test/resources/optimizerts/results/subquery/exists.plan
M 
asterixdb/asterix-app/src/test/resources/optimizerts/results/subquery/not_exists.plan
A 
asterixdb/asterix-app/src/test/resources/optimizerts/results/subquery/query-ASTERIXDB-1572.plan
M 
asterixdb/asterix-app/src/test/resources/optimizerts/results/tpcds/query-ASTERIXDB-1581-correlated.plan
M 
asterixdb/asterix-app/src/test/resources/optimizerts/results/tpcds/query-ASTERIXDB-1581.plan
A 
asterixdb/asterix-app/src/test/resources/optimizerts/results/tpcds/query-ASTERIXDB-1591.plan
M 
asterixdb/asterix-app/src/test/resources/optimizerts/results/udfs/query-ASTERIXDB-1020.plan
M 
asterixdb/asterix-app/src/test/resources/optimizerts/results/udfs/query-ASTERIXDB-1308-1.plan
A 
asterixdb/asterix-app/src/test/resources/runtimets/queries_sqlpp/subquery/query-ASTERIXDB-1572/query-ASTERIXDB-1572.1.ddl.sqlpp
A 
asterixdb/asterix-app/src/test/resources/runtimets/queries_sqlpp/subquery/query-ASTERIXDB-1572/query-ASTERIXDB-1572.2.update.sqlpp
A 
asterixdb/asterix-app/src/test/resources/runtimets/queries_sqlpp/subquery/query-ASTERIXDB-1572/query-ASTERIXDB-1572.3.query.sqlpp
A 
asterixdb/asterix-app/src/test/resources/runtimets/queries_sqlpp/tpcds/query-ASTERIXDB-1591/query-ASTERIXDB-1591.1.ddl.sqlpp
A 
asterixdb/asterix-app/src/test/resources/runtimets/queries_sqlpp/tpcds/query-ASTERIXDB-1591/query-ASTERIXDB-1591.2.update.sqlpp
A 
asterixdb/asterix-app/src/test/resources/runtimets/queries_sqlpp/tpcds/query-ASTERIXDB-1591/query-ASTERIXDB-1591.3.query.sqlpp
A 
asterixdb/asterix-app/src/test/resources/runtimets/results/subquery/query-ASTERIXDB-1572/query-ASTERIXDB-1572.1.adm
A 
asterixdb/asterix-app/src/test/resources/runtimets/results/tpcds/query-ASTERIXDB-1591/query-ASTERIXDB-1591.1.adm
M 
asterixdb/asterix-app/src/test/resources/runtimets/results/tpcds/query-ASTERIXDB-1596/query-ASTERIXDB-1596.1.adm
M asterixdb/asterix-app/src/test/resources/runtimets/testsuite_sqlpp.xml
M 
hyracks-fullstack/algebricks/algebricks-core/src/main/java/org/apache/hyracks/algebricks/core/algebra/util/OperatorManipulationUtil.java
M 
hyracks-fullstack/algebricks/algebricks-rewriter/src/main/java/org/apache/hyracks/algebricks/rewriter/rules/RemoveUnusedAssignAndAggregateRule.java
M 
hyracks-fullstack/algebricks/algebricks-rewriter/src/main/java/org/apache/hyracks/algebricks/rewriter/rules/SetExecutionModeRule.java
31 files changed, 1,451 insertions(+), 428 deletions(-)


  git pull ssh://asterix-gerrit.ics.uci.edu:29418/asterixdb 
refs/changes/61/1161/3
-- 
To view, visit https://asterix-gerrit.ics.uci.edu/1161
To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings

Gerrit-MessageType: newpatchset
Gerrit-Change-Id: I7092dd2fa7c9193ff919b27464854936f48261b0
Gerrit-PatchSet: 3
Gerrit-Project: asterixdb
Gerrit-Branch: master
Gerrit-Owner: Yingyi Bu 
Gerrit-Reviewer: Jenkins 
Gerrit-Reviewer: Till Westmann

Change in asterixdb[master]: Rename class: PushAggregateIntoGroupbyRule -> PushAggregateI...

2016-09-09 Thread Yingyi Bu (Code Review)

Yingyi Bu has submitted this change and it was merged.

Change subject: Rename class: PushAggregateIntoGroupbyRule -> 
PushAggregateIntoNestedSubplanRule.
..


Rename class: PushAggregateIntoGroupbyRule -> 
PushAggregateIntoNestedSubplanRule.

Change-Id: If700bb44e06267f61acdb976ada9066cc85455b6
Reviewed-on: https://asterix-gerrit.ics.uci.edu/1162
Reviewed-by: Till Westmann 
Tested-by: Jenkins 
Integration-Tests: Jenkins 
---
M 
asterixdb/asterix-algebra/src/main/java/org/apache/asterix/optimizer/base/RuleCollections.java
R 
asterixdb/asterix-algebra/src/main/java/org/apache/asterix/optimizer/rules/PushAggregateIntoNestedSubplanRule.java
2 files changed, 5 insertions(+), 5 deletions(-)

Approvals:
  Till Westmann: Looks good to me, approved
  Jenkins: Verified; Verified

Objections:
  Jenkins: Violations found



diff --git 
a/asterixdb/asterix-algebra/src/main/java/org/apache/asterix/optimizer/base/RuleCollections.java
 
b/asterixdb/asterix-algebra/src/main/java/org/apache/asterix/optimizer/base/RuleCollections.java
index 582cac9..c247b49 100644
--- 
a/asterixdb/asterix-algebra/src/main/java/org/apache/asterix/optimizer/base/RuleCollections.java
+++ 
b/asterixdb/asterix-algebra/src/main/java/org/apache/asterix/optimizer/base/RuleCollections.java
@@ -55,7 +55,7 @@
 import org.apache.asterix.optimizer.rules.MetaFunctionToMetaVariableRule;
 import org.apache.asterix.optimizer.rules.NestGroupByRule;
 import 
org.apache.asterix.optimizer.rules.PushAggFuncIntoStandaloneAggregateRule;
-import org.apache.asterix.optimizer.rules.PushAggregateIntoGroupbyRule;
+import org.apache.asterix.optimizer.rules.PushAggregateIntoNestedSubplanRule;
 import org.apache.asterix.optimizer.rules.PushFieldAccessRule;
 import org.apache.asterix.optimizer.rules.PushGroupByThroughProduct;
 import org.apache.asterix.optimizer.rules.PushLimitIntoOrderByRule;
@@ -212,7 +212,7 @@
 condPushDownAndJoinInference.add(new 
RemoveUnusedAssignAndAggregateRule());
 
 condPushDownAndJoinInference.add(new 
FactorRedundantGroupAndDecorVarsRule());
-condPushDownAndJoinInference.add(new PushAggregateIntoGroupbyRule());
+condPushDownAndJoinInference.add(new 
PushAggregateIntoNestedSubplanRule());
 condPushDownAndJoinInference.add(new EliminateSubplanRule());
 condPushDownAndJoinInference.add(new PushProperJoinThroughProduct());
 condPushDownAndJoinInference.add(new PushGroupByThroughProduct());
@@ -221,7 +221,7 @@
 condPushDownAndJoinInference.add(new PushSubplanIntoGroupByRule());
 condPushDownAndJoinInference.add(new NestedSubplanToJoinRule());
 condPushDownAndJoinInference.add(new 
EliminateSubplanWithInputCardinalityOneRule());
-// The following rule should be fired after 
PushAggregateIntoGroupbyRule because
+// The following rule should be fired after 
PushAggregateIntoNestedSubplanRule because
 // pulling invariants out of a subplan will make 
PushAggregateIntoGroupby harder.
 condPushDownAndJoinInference.add(new 
AsterixMoveFreeVariableOperatorOutOfSubplanRule());
 
diff --git 
a/asterixdb/asterix-algebra/src/main/java/org/apache/asterix/optimizer/rules/PushAggregateIntoGroupbyRule.java
 
b/asterixdb/asterix-algebra/src/main/java/org/apache/asterix/optimizer/rules/PushAggregateIntoNestedSubplanRule.java
similarity index 99%
rename from 
asterixdb/asterix-algebra/src/main/java/org/apache/asterix/optimizer/rules/PushAggregateIntoGroupbyRule.java
rename to 
asterixdb/asterix-algebra/src/main/java/org/apache/asterix/optimizer/rules/PushAggregateIntoNestedSubplanRule.java
index 168019b..b346417 100644
--- 
a/asterixdb/asterix-algebra/src/main/java/org/apache/asterix/optimizer/rules/PushAggregateIntoGroupbyRule.java
+++ 
b/asterixdb/asterix-algebra/src/main/java/org/apache/asterix/optimizer/rules/PushAggregateIntoNestedSubplanRule.java
@@ -54,7 +54,7 @@
 import org.apache.hyracks.algebricks.core.algebra.util.OperatorPropertiesUtil;
 import org.apache.hyracks.algebricks.core.rewriter.base.IAlgebraicRewriteRule;
 
-public class PushAggregateIntoGroupbyRule implements IAlgebraicRewriteRule {
+public class PushAggregateIntoNestedSubplanRule implements 
IAlgebraicRewriteRule {
 
 @Override
 public boolean rewritePost(Mutable opRef, 
IOptimizationContext context) {
@@ -451,7 +451,7 @@
 }
 opRef1InSubplan = opRef2InSubplan;
 if (opRef1InSubplan.getValue().getInputs().size() 
== 0) {
-throw new 
IllegalStateException("PushAggregateIntoGroupbyRule: could not find UNNEST.");
+throw new 
IllegalStateException("PushAggregateIntoNestedSubplanRule: could not find 
UNNEST.");
 }
 }

[jira] [Created] (ASTERIXDB-1639) Need a spatial test case with a high point dup factor

2016-09-09 Thread Michael J. Carey (JIRA)

Michael J. Carey created ASTERIXDB-1639:
---

 Summary: Need a spatial test case with a high point dup factor
 Key: ASTERIXDB-1639
 URL: https://issues.apache.org/jira/browse/ASTERIXDB-1639
 Project: Apache AsterixDB
  Issue Type: Test
  Components: AsterixDB, Hyracks, Storage
Reporter: Michael J. Carey
Assignee: Taewoo Kim


We need a few LSM R-tree test cases where we have many leaves worth of data 
(which could be achieved by making an artificially small NC config?) that have 
the same key - to make sure that we can handle that case properly.  (I'm 
wondering after talking with Wail if that's the root of his problems a few 
weeks ago - he had a high duplicate rate.)  E.g., we should trying to insert a 
ton of data all at one of the same 2-3 unique spatial points.  It would be good 
for there to be enough data that multi-level Hilbert sorting is required as 
well.  This is likely to be a time-consuming test so it should be in our period 
(not per-checkin) tests.  We should actually do this extreme-dup-case test for 
all index types, but R trees are suspected of maybe doing this wrong.  Who 
would be best to write/run this test w/o much effort?



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Change in asterixdb[master]: Rename class: PushAggregateIntoGroupbyRule -> PushAggregateI...

2016-09-09 Thread Jenkins (Code Review)

Jenkins has posted comments on this change.

Change subject: Rename class: PushAggregateIntoGroupbyRule -> 
PushAggregateIntoNestedSubplanRule.
..


Patch Set 1:

Integration Tests Started 
https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-integration-tests/609/

-- 
To view, visit https://asterix-gerrit.ics.uci.edu/1162
To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings

Gerrit-MessageType: comment
Gerrit-Change-Id: If700bb44e06267f61acdb976ada9066cc85455b6
Gerrit-PatchSet: 1
Gerrit-Project: asterixdb
Gerrit-Branch: master
Gerrit-Owner: Yingyi Bu 
Gerrit-Reviewer: Ian Maxon 
Gerrit-Reviewer: Jenkins 
Gerrit-Reviewer: Till Westmann 
Gerrit-HasComments: No

Change in asterixdb[master]: ASTERIXDB-1572 and ASTERIXDB-1591: fix and regression tests.

2016-09-09 Thread Jenkins (Code Review)

Jenkins has posted comments on this change.

Change subject: ASTERIXDB-1572 and ASTERIXDB-1591: fix and regression tests.
..


Patch Set 2:

Integration Tests Started 
https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-integration-tests/608/

-- 
To view, visit https://asterix-gerrit.ics.uci.edu/1161
To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings

Gerrit-MessageType: comment
Gerrit-Change-Id: I7092dd2fa7c9193ff919b27464854936f48261b0
Gerrit-PatchSet: 2
Gerrit-Project: asterixdb
Gerrit-Branch: master
Gerrit-Owner: Yingyi Bu 
Gerrit-Reviewer: Jenkins 
Gerrit-Reviewer: Till Westmann 
Gerrit-HasComments: No

Change in asterixdb[master]: Rename class: PushAggregateIntoGroupbyRule -> PushAggregateI...

2016-09-09 Thread Till Westmann (Code Review)

Till Westmann has posted comments on this change.

Change subject: Rename class: PushAggregateIntoGroupbyRule -> 
PushAggregateIntoNestedSubplanRule.
..


Patch Set 1: Code-Review+2

-- 
To view, visit https://asterix-gerrit.ics.uci.edu/1162
To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings

Gerrit-MessageType: comment
Gerrit-Change-Id: If700bb44e06267f61acdb976ada9066cc85455b6
Gerrit-PatchSet: 1
Gerrit-Project: asterixdb
Gerrit-Branch: master
Gerrit-Owner: Yingyi Bu 
Gerrit-Reviewer: Ian Maxon 
Gerrit-Reviewer: Jenkins 
Gerrit-Reviewer: Till Westmann 
Gerrit-HasComments: No

Change in asterixdb[master]: ASTERIXDB-1572 and ASTERIXDB-1591: fix and regression tests.

2016-09-09 Thread Jenkins (Code Review)

Jenkins has posted comments on this change.

Change subject: ASTERIXDB-1572 and ASTERIXDB-1591: fix and regression tests.
..


Patch Set 4:

Integration Tests Successful

https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-integration-tests/607/ : 
SUCCESS

-- 
To view, visit https://asterix-gerrit.ics.uci.edu/1158
To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings

Gerrit-MessageType: comment
Gerrit-Change-Id: Ie38c51ab25e313f9dca3312c33b92e3bdb187420
Gerrit-PatchSet: 4
Gerrit-Project: asterixdb
Gerrit-Branch: master
Gerrit-Owner: Yingyi Bu 
Gerrit-Reviewer: Jenkins 
Gerrit-HasComments: No

Change in asterixdb[master]: Add HTTP API to Collect Threaddumps From NCs

2016-09-09 Thread Jenkins (Code Review)

Jenkins has posted comments on this change.

Change subject: Add HTTP API to Collect Threaddumps From NCs
..


Patch Set 3: Integration-Tests+1

Integration Tests Successful

https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-integration-tests/606/ : 
SUCCESS

-- 
To view, visit https://asterix-gerrit.ics.uci.edu/1159
To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings

Gerrit-MessageType: comment
Gerrit-Change-Id: I536606a1fbc394c6c70bb8ce14791cc411691617
Gerrit-PatchSet: 3
Gerrit-Project: asterixdb
Gerrit-Branch: master
Gerrit-Owner: Michael Blow 
Gerrit-Reviewer: Jenkins 
Gerrit-Reviewer: Till Westmann 
Gerrit-HasComments: No

[jira] [Commented] (ASTERIXDB-1609) TwitterParser does not parse closed-nullable fields.

2016-09-09 Thread Yingyi Bu (JIRA)


[ 
https://issues.apache.org/jira/browse/ASTERIXDB-1609?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15478700#comment-15478700
 ] 

Yingyi Bu commented on ASTERIXDB-1609:
--

I'm not sure if the TwitterParser/ADMParser needs to deal with those 
complicated type stuff. IMO, we could parse the input as completely open, e.g. 
of type {}. Then we can inject a CastType function to do the type casting job, 
according to what's the type of the dataset. In this way, we can keep 
XXXParsers relatively simple.  I'm guessing today's XXXParsers might still have 
type bugs even we fixed things here and there.

> TwitterParser does not parse closed-nullable fields.
> 
>
> Key: ASTERIXDB-1609
> URL: https://issues.apache.org/jira/browse/ASTERIXDB-1609
> Project: Apache AsterixDB
>  Issue Type: Bug
>  Components: Data Model, Feeds
>Reporter: Wail Alkowaileet
>Assignee: Xikui Wang
>
> TwitterParser doesn't support types NULL/MISSING
> To reproduce, connect TwitterFeed using the defined type below. I 
> roundtrip-ed it using load statement and it was successfully loaded. 
> DDL:
> {noformat}
> drop dataverse feeds if exists;
> create dataverse feeds;
> use dataverse feeds;
> create type userType1 as open {
> 'utc_offset':int64?,
> 'friends_count':int64?,
> 'profile_image_url_https':string?,
> 'listed_count':int64?,
> 'profile_background_image_url':string?,
> 'default_profile_image':boolean?,
> 'favourites_count':int64?,
> 'description':string?,
> 'created_at':string?,
> 'is_translator':boolean?,
> 'profile_background_image_url_https':string?,
> 'protected':boolean?,
> 'screen_name':string?,
> 'id_str':string?,
> 'profile_link_color':string?,
> 'id':int64?,
> 'geo_enabled':boolean?,
> 'profile_background_color':string?,
> 'lang':string?,
> 'profile_sidebar_border_color':string?,
> 'profile_text_color':string?,
> 'verified':boolean?,
> 'profile_image_url':string?,
> 'time_zone':string?,
> 'contributors_enabled':boolean?,
> 'profile_background_tile':boolean?,
> 'profile_banner_url':string?,
> 'statuses_count':int64?,
> 'followers_count':int64?,
> 'profile_use_background_image':boolean?,
> 'default_profile':boolean?,
> 'name':string?,
> 'location':string?,
> 'profile_sidebar_fill_color':string?,
> 'url':string?
> }
> create type smallType1 as open {
> 'w':int64?,
> 'h':int64?,
> 'resize':string?
> }
> create type largeType1 as open {
> 'w':int64?,
> 'h':int64?,
> 'resize':string?
> }
> create type thumbType1 as open {
> 'w':int64?,
> 'h':int64?,
> 'resize':string?
> }
> create type mediumType1 as open {
> 'w':int64?,
> 'h':int64?,
> 'resize':string?
> }
> create type sizesType1 as open {
> 'small':smallType1?,
> 'large':largeType1?,
> 'thumb':thumbType1?,
> 'medium':mediumType1?
> }
> create type listType2 as open {
> 'content_type':string?,
> 'bitrate':int64?,
> 'url':string?
> }
> create type video_infoType1 as open {
> 'aspect_ratio':[int64]?,
> 'duration_millis':int64?,
> 'variants':[listType2]?
> }
> create type listType1 as open {
> 'display_url':string?,
> 'indices':[int64]?,
> 'sizes':sizesType1?,
> 'id_str':string?,
> 'expanded_url':string?,
> 'media_url_https':string?,
> 'id':int64?,
> 'type':string?,
> 'media_url':string?,
> 'url':string?,
> 'video_info':video_infoType1?,
> 'source_user_id':int64?,
> 'source_status_id':int64?,
> 'source_status_id_str':string?,
> 'source_user_id_str':string?
> }
> create type extended_entitiesType1 as open {
> 'media':[listType1]?
> }
> create type smallType2 as open {
> 'w':int64?,
> 'h':int64?,
> 'resize':string?
> }
> create type largeType2 as open {
> 'w':int64?,
> 'h':int64?,
> 'resize':string?
> }
> create type thumbType2 as open {
> 'w':int64?,
> 'h':int64?,
> 'resize':string?
> }
> create type mediumType2 as open {
> 'w':int64?,
> 'h':int64?,
> 'resize':string?
> }
> create type sizesType2 as open {
> 'small':smallType2?,
> 'large':largeType2?,
> 'thumb':thumbType2?,
> 'medium':mediumType2?
> }
> create type listType3 as open {
> 'display_url':string?,
> 'indices':[int64]?,
> 'sizes':sizesType2?,
> 'id_str':string?,
> 'expanded_url':string?,
> 'media_url_https':string?,
> 'id':int64?,
> 'type':string?,
> 'media_url':string?,
> 'url':string?,
> 'source_user_id':int64?,
> 'source_status_id':int64?,
> 'source_status_id_str':string?,
> 'source_user_id_str':string?
> }
> create type listType4 as open {
> 'display_url':string?,
> 'indices':[int64]?,
>

[jira] [Comment Edited] (ASTERIXDB-1609) TwitterParser does not parse closed-nullable fields.

2016-09-09 Thread Xikui Wang (JIRA)


[ 
https://issues.apache.org/jira/browse/ASTERIXDB-1609?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15478689#comment-15478689
 ] 

Xikui Wang edited comment on ASTERIXDB-1609 at 9/9/16 11:47 PM:


I found out the JSONObject seems to be necessary here. Since there are certain 
datatype can be 'closed', we have to tailor some attributes to fit the 
datatype. :(  So we can reuse the ADMDataParser but the memory usage is still 
there.


was (Author: idleft):
I found out the JSONObject seems to be necessary here. Since there are certain 
datatype can be 'closed', we have to tailor some attributes to fit the 
datatype. :( 

> TwitterParser does not parse closed-nullable fields.
> 
>
> Key: ASTERIXDB-1609
> URL: https://issues.apache.org/jira/browse/ASTERIXDB-1609
> Project: Apache AsterixDB
>  Issue Type: Bug
>  Components: Data Model, Feeds
>Reporter: Wail Alkowaileet
>Assignee: Xikui Wang
>
> TwitterParser doesn't support types NULL/MISSING
> To reproduce, connect TwitterFeed using the defined type below. I 
> roundtrip-ed it using load statement and it was successfully loaded. 
> DDL:
> {noformat}
> drop dataverse feeds if exists;
> create dataverse feeds;
> use dataverse feeds;
> create type userType1 as open {
> 'utc_offset':int64?,
> 'friends_count':int64?,
> 'profile_image_url_https':string?,
> 'listed_count':int64?,
> 'profile_background_image_url':string?,
> 'default_profile_image':boolean?,
> 'favourites_count':int64?,
> 'description':string?,
> 'created_at':string?,
> 'is_translator':boolean?,
> 'profile_background_image_url_https':string?,
> 'protected':boolean?,
> 'screen_name':string?,
> 'id_str':string?,
> 'profile_link_color':string?,
> 'id':int64?,
> 'geo_enabled':boolean?,
> 'profile_background_color':string?,
> 'lang':string?,
> 'profile_sidebar_border_color':string?,
> 'profile_text_color':string?,
> 'verified':boolean?,
> 'profile_image_url':string?,
> 'time_zone':string?,
> 'contributors_enabled':boolean?,
> 'profile_background_tile':boolean?,
> 'profile_banner_url':string?,
> 'statuses_count':int64?,
> 'followers_count':int64?,
> 'profile_use_background_image':boolean?,
> 'default_profile':boolean?,
> 'name':string?,
> 'location':string?,
> 'profile_sidebar_fill_color':string?,
> 'url':string?
> }
> create type smallType1 as open {
> 'w':int64?,
> 'h':int64?,
> 'resize':string?
> }
> create type largeType1 as open {
> 'w':int64?,
> 'h':int64?,
> 'resize':string?
> }
> create type thumbType1 as open {
> 'w':int64?,
> 'h':int64?,
> 'resize':string?
> }
> create type mediumType1 as open {
> 'w':int64?,
> 'h':int64?,
> 'resize':string?
> }
> create type sizesType1 as open {
> 'small':smallType1?,
> 'large':largeType1?,
> 'thumb':thumbType1?,
> 'medium':mediumType1?
> }
> create type listType2 as open {
> 'content_type':string?,
> 'bitrate':int64?,
> 'url':string?
> }
> create type video_infoType1 as open {
> 'aspect_ratio':[int64]?,
> 'duration_millis':int64?,
> 'variants':[listType2]?
> }
> create type listType1 as open {
> 'display_url':string?,
> 'indices':[int64]?,
> 'sizes':sizesType1?,
> 'id_str':string?,
> 'expanded_url':string?,
> 'media_url_https':string?,
> 'id':int64?,
> 'type':string?,
> 'media_url':string?,
> 'url':string?,
> 'video_info':video_infoType1?,
> 'source_user_id':int64?,
> 'source_status_id':int64?,
> 'source_status_id_str':string?,
> 'source_user_id_str':string?
> }
> create type extended_entitiesType1 as open {
> 'media':[listType1]?
> }
> create type smallType2 as open {
> 'w':int64?,
> 'h':int64?,
> 'resize':string?
> }
> create type largeType2 as open {
> 'w':int64?,
> 'h':int64?,
> 'resize':string?
> }
> create type thumbType2 as open {
> 'w':int64?,
> 'h':int64?,
> 'resize':string?
> }
> create type mediumType2 as open {
> 'w':int64?,
> 'h':int64?,
> 'resize':string?
> }
> create type sizesType2 as open {
> 'small':smallType2?,
> 'large':largeType2?,
> 'thumb':thumbType2?,
> 'medium':mediumType2?
> }
> create type listType3 as open {
> 'display_url':string?,
> 'indices':[int64]?,
> 'sizes':sizesType2?,
> 'id_str':string?,
> 'expanded_url':string?,
> 'media_url_https':string?,
> 'id':int64?,
> 'type':string?,
> 'media_url':string?,
> 'url':string?,
> 'source_user_id':int64?,
> 'source_status_id':int64?,
> 'source_status_id_str':string?,
> 'source_user_id_str':string?
> }
> create type listType4 as open {
>

Change in asterixdb[master]: Rename class: PushAggregateIntoGroupbyRule -> PushAggregateI...

2016-09-09 Thread Jenkins (Code Review)

Jenkins has posted comments on this change.

Change subject: Rename class: PushAggregateIntoGroupbyRule -> 
PushAggregateIntoNestedSubplanRule.
..


Patch Set 1:

Build Started 
https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-notopic/2591/

-- 
To view, visit https://asterix-gerrit.ics.uci.edu/1162
To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings

Gerrit-MessageType: comment
Gerrit-Change-Id: If700bb44e06267f61acdb976ada9066cc85455b6
Gerrit-PatchSet: 1
Gerrit-Project: asterixdb
Gerrit-Branch: master
Gerrit-Owner: Yingyi Bu 
Gerrit-Reviewer: Jenkins 
Gerrit-HasComments: No

Change in asterixdb[master]: Rename class: PushAggregateIntoGroupbyRule -> PushAggregateI...

2016-09-09 Thread Yingyi Bu (Code Review)

Yingyi Bu has uploaded a new change for review.

  https://asterix-gerrit.ics.uci.edu/1162

Change subject: Rename class: PushAggregateIntoGroupbyRule -> 
PushAggregateIntoNestedSubplanRule.
..

Rename class: PushAggregateIntoGroupbyRule -> 
PushAggregateIntoNestedSubplanRule.

Change-Id: If700bb44e06267f61acdb976ada9066cc85455b6
---
M 
asterixdb/asterix-algebra/src/main/java/org/apache/asterix/optimizer/base/RuleCollections.java
R 
asterixdb/asterix-algebra/src/main/java/org/apache/asterix/optimizer/rules/PushAggregateIntoNestedSubplanRule.java
2 files changed, 5 insertions(+), 5 deletions(-)


  git pull ssh://asterix-gerrit.ics.uci.edu:29418/asterixdb 
refs/changes/62/1162/1

diff --git 
a/asterixdb/asterix-algebra/src/main/java/org/apache/asterix/optimizer/base/RuleCollections.java
 
b/asterixdb/asterix-algebra/src/main/java/org/apache/asterix/optimizer/base/RuleCollections.java
index 582cac9..c247b49 100644
--- 
a/asterixdb/asterix-algebra/src/main/java/org/apache/asterix/optimizer/base/RuleCollections.java
+++ 
b/asterixdb/asterix-algebra/src/main/java/org/apache/asterix/optimizer/base/RuleCollections.java
@@ -55,7 +55,7 @@
 import org.apache.asterix.optimizer.rules.MetaFunctionToMetaVariableRule;
 import org.apache.asterix.optimizer.rules.NestGroupByRule;
 import 
org.apache.asterix.optimizer.rules.PushAggFuncIntoStandaloneAggregateRule;
-import org.apache.asterix.optimizer.rules.PushAggregateIntoGroupbyRule;
+import org.apache.asterix.optimizer.rules.PushAggregateIntoNestedSubplanRule;
 import org.apache.asterix.optimizer.rules.PushFieldAccessRule;
 import org.apache.asterix.optimizer.rules.PushGroupByThroughProduct;
 import org.apache.asterix.optimizer.rules.PushLimitIntoOrderByRule;
@@ -212,7 +212,7 @@
 condPushDownAndJoinInference.add(new 
RemoveUnusedAssignAndAggregateRule());
 
 condPushDownAndJoinInference.add(new 
FactorRedundantGroupAndDecorVarsRule());
-condPushDownAndJoinInference.add(new PushAggregateIntoGroupbyRule());
+condPushDownAndJoinInference.add(new 
PushAggregateIntoNestedSubplanRule());
 condPushDownAndJoinInference.add(new EliminateSubplanRule());
 condPushDownAndJoinInference.add(new PushProperJoinThroughProduct());
 condPushDownAndJoinInference.add(new PushGroupByThroughProduct());
@@ -221,7 +221,7 @@
 condPushDownAndJoinInference.add(new PushSubplanIntoGroupByRule());
 condPushDownAndJoinInference.add(new NestedSubplanToJoinRule());
 condPushDownAndJoinInference.add(new 
EliminateSubplanWithInputCardinalityOneRule());
-// The following rule should be fired after 
PushAggregateIntoGroupbyRule because
+// The following rule should be fired after 
PushAggregateIntoNestedSubplanRule because
 // pulling invariants out of a subplan will make 
PushAggregateIntoGroupby harder.
 condPushDownAndJoinInference.add(new 
AsterixMoveFreeVariableOperatorOutOfSubplanRule());
 
diff --git 
a/asterixdb/asterix-algebra/src/main/java/org/apache/asterix/optimizer/rules/PushAggregateIntoGroupbyRule.java
 
b/asterixdb/asterix-algebra/src/main/java/org/apache/asterix/optimizer/rules/PushAggregateIntoNestedSubplanRule.java
similarity index 99%
rename from 
asterixdb/asterix-algebra/src/main/java/org/apache/asterix/optimizer/rules/PushAggregateIntoGroupbyRule.java
rename to 
asterixdb/asterix-algebra/src/main/java/org/apache/asterix/optimizer/rules/PushAggregateIntoNestedSubplanRule.java
index 168019b..b346417 100644
--- 
a/asterixdb/asterix-algebra/src/main/java/org/apache/asterix/optimizer/rules/PushAggregateIntoGroupbyRule.java
+++ 
b/asterixdb/asterix-algebra/src/main/java/org/apache/asterix/optimizer/rules/PushAggregateIntoNestedSubplanRule.java
@@ -54,7 +54,7 @@
 import org.apache.hyracks.algebricks.core.algebra.util.OperatorPropertiesUtil;
 import org.apache.hyracks.algebricks.core.rewriter.base.IAlgebraicRewriteRule;
 
-public class PushAggregateIntoGroupbyRule implements IAlgebraicRewriteRule {
+public class PushAggregateIntoNestedSubplanRule implements 
IAlgebraicRewriteRule {
 
 @Override
 public boolean rewritePost(Mutable opRef, 
IOptimizationContext context) {
@@ -451,7 +451,7 @@
 }
 opRef1InSubplan = opRef2InSubplan;
 if (opRef1InSubplan.getValue().getInputs().size() 
== 0) {
-throw new 
IllegalStateException("PushAggregateIntoGroupbyRule: could not find UNNEST.");
+throw new 
IllegalStateException("PushAggregateIntoNestedSubplanRule: could not find 
UNNEST.");
 }
 }
 }

-- 
To view, visit https://asterix-gerrit.ics.uci.edu/1162
To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings

Gerrit-MessageType: newchange
Gerrit-Change-Id: If700bb44e06267f61acdb976ada9066cc85455b6

Change in asterixdb[master]: ASTERIXDB-1572 and ASTERIXDB-1591: fix and regression tests.

2016-09-09 Thread Jenkins (Code Review)

Jenkins has posted comments on this change.

Change subject: ASTERIXDB-1572 and ASTERIXDB-1591: fix and regression tests.
..


Patch Set 2:

WARNING: THIS CHANGE CONTAINS CROSS-PRODUCT CHANGES IN:
* asterixdb
* hyracks-fullstack

PLEASE REVIEW CAREFULLY AND LOOK FOR API CHANGES!

-- 
To view, visit https://asterix-gerrit.ics.uci.edu/1161
To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings

Gerrit-MessageType: comment
Gerrit-Change-Id: I7092dd2fa7c9193ff919b27464854936f48261b0
Gerrit-PatchSet: 2
Gerrit-Project: asterixdb
Gerrit-Branch: master
Gerrit-Owner: Yingyi Bu 
Gerrit-Reviewer: Jenkins 
Gerrit-HasComments: No

Change in asterixdb[master]: ASTERIXDB-1572 and ASTERIXDB-1591: fix and regression tests.

2016-09-09 Thread Jenkins (Code Review)

Jenkins has posted comments on this change.

Change subject: ASTERIXDB-1572 and ASTERIXDB-1591: fix and regression tests.
..


Patch Set 2:

Build Started 
https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-notopic/2590/

-- 
To view, visit https://asterix-gerrit.ics.uci.edu/1161
To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings

Gerrit-MessageType: comment
Gerrit-Change-Id: I7092dd2fa7c9193ff919b27464854936f48261b0
Gerrit-PatchSet: 2
Gerrit-Project: asterixdb
Gerrit-Branch: master
Gerrit-Owner: Yingyi Bu 
Gerrit-Reviewer: Jenkins 
Gerrit-HasComments: No

Change in asterixdb[master]: ASTERIXDB-1572 and ASTERIXDB-1591: fix and regression tests.

2016-09-09 Thread Jenkins (Code Review)

Jenkins has posted comments on this change.

Change subject: ASTERIXDB-1572 and ASTERIXDB-1591: fix and regression tests.
..


Patch Set 1:

WARNING: THIS CHANGE CONTAINS CROSS-PRODUCT CHANGES IN:
* asterixdb
* hyracks-fullstack

PLEASE REVIEW CAREFULLY AND LOOK FOR API CHANGES!

-- 
To view, visit https://asterix-gerrit.ics.uci.edu/1160
To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings

Gerrit-MessageType: comment
Gerrit-Change-Id: Iea82f0939bcc48c2e6a4127f4303561d3bed30a5
Gerrit-PatchSet: 1
Gerrit-Project: asterixdb
Gerrit-Branch: master
Gerrit-Owner: Yingyi Bu 
Gerrit-Reviewer: Jenkins 
Gerrit-HasComments: No

Change in asterixdb[master]: ASTERIXDB-1572 and ASTERIXDB-1591: fix and regression tests.

2016-09-09 Thread Yingyi Bu (Code Review)

Yingyi Bu has uploaded a new patch set (#2).

Change subject: ASTERIXDB-1572 and ASTERIXDB-1591: fix and regression tests.
..

ASTERIXDB-1572 and ASTERIXDB-1591: fix and regression tests.

- push aggregates into subplans;
- fix recursive variable mapping in subquery decorrelation.

Change-Id: I7092dd2fa7c9193ff919b27464854936f48261b0
---
M 
asterixdb/asterix-algebra/src/main/java/org/apache/asterix/optimizer/base/RuleCollections.java
D 
asterixdb/asterix-algebra/src/main/java/org/apache/asterix/optimizer/rules/PushAggregateIntoGroupbyRule.java
A 
asterixdb/asterix-algebra/src/main/java/org/apache/asterix/optimizer/rules/PushAggregateIntoNestedSubplanRule.java
M 
asterixdb/asterix-algebra/src/main/java/org/apache/asterix/optimizer/rules/subplan/InlineSubplanInputForNestedTupleSourceRule.java
M asterixdb/asterix-app/data/tpcds/catalog_sales.csv
M asterixdb/asterix-app/data/tpcds/date_dim.csv
M asterixdb/asterix-app/data/tpcds/store_sales.csv
A 
asterixdb/asterix-app/src/test/resources/optimizerts/queries/subquery/query-ASTERIXDB-1572.sqlpp
A 
asterixdb/asterix-app/src/test/resources/optimizerts/queries/tpcds/query-ASTERIXDB-1591.sqlpp
M 
asterixdb/asterix-app/src/test/resources/optimizerts/results/inverted-index-join/issue741.plan
M 
asterixdb/asterix-app/src/test/resources/optimizerts/results/query-ASTERIXDB-159-3.plan
M 
asterixdb/asterix-app/src/test/resources/optimizerts/results/query-issue562.plan
M 
asterixdb/asterix-app/src/test/resources/optimizerts/results/subquery/exists.plan
M 
asterixdb/asterix-app/src/test/resources/optimizerts/results/subquery/not_exists.plan
A 
asterixdb/asterix-app/src/test/resources/optimizerts/results/subquery/query-ASTERIXDB-1572.plan
M 
asterixdb/asterix-app/src/test/resources/optimizerts/results/tpcds/query-ASTERIXDB-1581-correlated.plan
M 
asterixdb/asterix-app/src/test/resources/optimizerts/results/tpcds/query-ASTERIXDB-1581.plan
A 
asterixdb/asterix-app/src/test/resources/optimizerts/results/tpcds/query-ASTERIXDB-1591.plan
M 
asterixdb/asterix-app/src/test/resources/optimizerts/results/udfs/query-ASTERIXDB-1020.plan
M 
asterixdb/asterix-app/src/test/resources/optimizerts/results/udfs/query-ASTERIXDB-1308-1.plan
A 
asterixdb/asterix-app/src/test/resources/runtimets/queries_sqlpp/subquery/query-ASTERIXDB-1572/query-ASTERIXDB-1572.1.ddl.sqlpp
A 
asterixdb/asterix-app/src/test/resources/runtimets/queries_sqlpp/subquery/query-ASTERIXDB-1572/query-ASTERIXDB-1572.2.update.sqlpp
A 
asterixdb/asterix-app/src/test/resources/runtimets/queries_sqlpp/subquery/query-ASTERIXDB-1572/query-ASTERIXDB-1572.3.query.sqlpp
A 
asterixdb/asterix-app/src/test/resources/runtimets/queries_sqlpp/tpcds/query-ASTERIXDB-1591/query-ASTERIXDB-1591.1.ddl.sqlpp
A 
asterixdb/asterix-app/src/test/resources/runtimets/queries_sqlpp/tpcds/query-ASTERIXDB-1591/query-ASTERIXDB-1591.2.update.sqlpp
A 
asterixdb/asterix-app/src/test/resources/runtimets/queries_sqlpp/tpcds/query-ASTERIXDB-1591/query-ASTERIXDB-1591.3.query.sqlpp
A 
asterixdb/asterix-app/src/test/resources/runtimets/results/subquery/query-ASTERIXDB-1572/query-ASTERIXDB-1572.1.adm
A 
asterixdb/asterix-app/src/test/resources/runtimets/results/tpcds/query-ASTERIXDB-1591/query-ASTERIXDB-1591.1.adm
M 
asterixdb/asterix-app/src/test/resources/runtimets/results/tpcds/query-ASTERIXDB-1596/query-ASTERIXDB-1596.1.adm
M asterixdb/asterix-app/src/test/resources/runtimets/testsuite_sqlpp.xml
M 
hyracks-fullstack/algebricks/algebricks-core/src/main/java/org/apache/hyracks/algebricks/core/algebra/util/OperatorManipulationUtil.java
M 
hyracks-fullstack/algebricks/algebricks-rewriter/src/main/java/org/apache/hyracks/algebricks/rewriter/rules/RemoveUnusedAssignAndAggregateRule.java
M 
hyracks-fullstack/algebricks/algebricks-rewriter/src/main/java/org/apache/hyracks/algebricks/rewriter/rules/SetExecutionModeRule.java
33 files changed, 1,759 insertions(+), 735 deletions(-)


  git pull ssh://asterix-gerrit.ics.uci.edu:29418/asterixdb 
refs/changes/61/1161/2
-- 
To view, visit https://asterix-gerrit.ics.uci.edu/1161
To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings

Gerrit-MessageType: newpatchset
Gerrit-Change-Id: I7092dd2fa7c9193ff919b27464854936f48261b0
Gerrit-PatchSet: 2
Gerrit-Project: asterixdb
Gerrit-Branch: master
Gerrit-Owner: Yingyi Bu 
Gerrit-Reviewer: Jenkins

Change in asterixdb[master]: ASTERIXDB-1572 and ASTERIXDB-1591: fix and regression tests.

2016-09-09 Thread Jenkins (Code Review)

Jenkins has posted comments on this change.

Change subject: ASTERIXDB-1572 and ASTERIXDB-1591: fix and regression tests.
..


Patch Set 1:

Build Started 
https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-notopic/2589/

-- 
To view, visit https://asterix-gerrit.ics.uci.edu/1161
To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings

Gerrit-MessageType: comment
Gerrit-Change-Id: I7092dd2fa7c9193ff919b27464854936f48261b0
Gerrit-PatchSet: 1
Gerrit-Project: asterixdb
Gerrit-Branch: master
Gerrit-Owner: Yingyi Bu 
Gerrit-Reviewer: Jenkins 
Gerrit-HasComments: No

Change in asterixdb[master]: ASTERIXDB-1572 and ASTERIXDB-1591: fix and regression tests.

2016-09-09 Thread Jenkins (Code Review)

Jenkins has posted comments on this change.

Change subject: ASTERIXDB-1572 and ASTERIXDB-1591: fix and regression tests.
..


Patch Set 1:

Build Started 
https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-notopic/2588/

-- 
To view, visit https://asterix-gerrit.ics.uci.edu/1160
To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings

Gerrit-MessageType: comment
Gerrit-Change-Id: Iea82f0939bcc48c2e6a4127f4303561d3bed30a5
Gerrit-PatchSet: 1
Gerrit-Project: asterixdb
Gerrit-Branch: master
Gerrit-Owner: Yingyi Bu 
Gerrit-Reviewer: Jenkins 
Gerrit-HasComments: No

Change in asterixdb[master]: ASTERIXDB-1572 and ASTERIXDB-1591: fix and regression tests.

2016-09-09 Thread Yingyi Bu (Code Review)

Yingyi Bu has abandoned this change.

Change subject: ASTERIXDB-1572 and ASTERIXDB-1591: fix and regression tests.
..


Abandoned

-- 
To view, visit https://asterix-gerrit.ics.uci.edu/1160
To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings

Gerrit-MessageType: abandon
Gerrit-Change-Id: Iea82f0939bcc48c2e6a4127f4303561d3bed30a5
Gerrit-PatchSet: 1
Gerrit-Project: asterixdb
Gerrit-Branch: master
Gerrit-Owner: Yingyi Bu

Change in asterixdb[master]: ASTERIXDB-1572 and ASTERIXDB-1591: fix and regression tests.

2016-09-09 Thread Yingyi Bu (Code Review)

Yingyi Bu has abandoned this change.

Change subject: ASTERIXDB-1572 and ASTERIXDB-1591: fix and regression tests.
..


Abandoned

-- 
To view, visit https://asterix-gerrit.ics.uci.edu/1158
To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings

Gerrit-MessageType: abandon
Gerrit-Change-Id: Ie38c51ab25e313f9dca3312c33b92e3bdb187420
Gerrit-PatchSet: 7
Gerrit-Project: asterixdb
Gerrit-Branch: master
Gerrit-Owner: Yingyi Bu 
Gerrit-Reviewer: Jenkins

Change in asterixdb[master]: ASTERIXDB-1572 and ASTERIXDB-1591: fix and regression tests.

2016-09-09 Thread Jenkins (Code Review)

Jenkins has posted comments on this change.

Change subject: ASTERIXDB-1572 and ASTERIXDB-1591: fix and regression tests.
..


Patch Set 7:

WARNING: THIS CHANGE CONTAINS CROSS-PRODUCT CHANGES IN:
* asterixdb
* hyracks-fullstack

PLEASE REVIEW CAREFULLY AND LOOK FOR API CHANGES!

-- 
To view, visit https://asterix-gerrit.ics.uci.edu/1158
To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings

Gerrit-MessageType: comment
Gerrit-Change-Id: Ie38c51ab25e313f9dca3312c33b92e3bdb187420
Gerrit-PatchSet: 7
Gerrit-Project: asterixdb
Gerrit-Branch: master
Gerrit-Owner: Yingyi Bu 
Gerrit-Reviewer: Jenkins 
Gerrit-HasComments: No

Change in asterixdb[master]: ASTERIXDB-1572 and ASTERIXDB-1591: fix and regression tests.

2016-09-09 Thread Jenkins (Code Review)

Jenkins has posted comments on this change.

Change subject: ASTERIXDB-1572 and ASTERIXDB-1591: fix and regression tests.
..


Patch Set 7:

Build Started 
https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-notopic/2587/

-- 
To view, visit https://asterix-gerrit.ics.uci.edu/1158
To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings

Gerrit-MessageType: comment
Gerrit-Change-Id: Ie38c51ab25e313f9dca3312c33b92e3bdb187420
Gerrit-PatchSet: 7
Gerrit-Project: asterixdb
Gerrit-Branch: master
Gerrit-Owner: Yingyi Bu 
Gerrit-Reviewer: Jenkins 
Gerrit-HasComments: No

Change in asterixdb[master]: ASTERIXDB-1572 and ASTERIXDB-1591: fix and regression tests.

2016-09-09 Thread Jenkins (Code Review)

Jenkins has posted comments on this change.

Change subject: ASTERIXDB-1572 and ASTERIXDB-1591: fix and regression tests.
..


Patch Set 6:

WARNING: THIS CHANGE CONTAINS CROSS-PRODUCT CHANGES IN:
* asterixdb
* hyracks-fullstack

PLEASE REVIEW CAREFULLY AND LOOK FOR API CHANGES!

-- 
To view, visit https://asterix-gerrit.ics.uci.edu/1158
To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings

Gerrit-MessageType: comment
Gerrit-Change-Id: Ie38c51ab25e313f9dca3312c33b92e3bdb187420
Gerrit-PatchSet: 6
Gerrit-Project: asterixdb
Gerrit-Branch: master
Gerrit-Owner: Yingyi Bu 
Gerrit-Reviewer: Jenkins 
Gerrit-HasComments: No

Change in asterixdb[master]: ASTERIXDB-1572 and ASTERIXDB-1591: fix and regression tests.

2016-09-09 Thread Yingyi Bu (Code Review)

Hello Jenkins,

I'd like you to reexamine a change.  Please visit

https://asterix-gerrit.ics.uci.edu/1158

to look at the new patch set (#7).

Change subject: ASTERIXDB-1572 and ASTERIXDB-1591: fix and regression tests.
..

ASTERIXDB-1572 and ASTERIXDB-1591: fix and regression tests.

- push aggregates into subplans;
- fix recursive variable mapping in subquery decorrelation.

Change-Id: Ie38c51ab25e313f9dca3312c33b92e3bdb187420
---
M 
asterixdb/asterix-algebra/src/main/java/org/apache/asterix/optimizer/base/RuleCollections.java
D 
asterixdb/asterix-algebra/src/main/java/org/apache/asterix/optimizer/rules/PushAggregateIntoGroupbyRule.java
A 
asterixdb/asterix-algebra/src/main/java/org/apache/asterix/optimizer/rules/PushAggregateIntoNestedSubplanRule.java
M 
asterixdb/asterix-algebra/src/main/java/org/apache/asterix/optimizer/rules/subplan/InlineSubplanInputForNestedTupleSourceRule.java
M asterixdb/asterix-app/data/tpcds/catalog_sales.csv
M asterixdb/asterix-app/data/tpcds/date_dim.csv
M asterixdb/asterix-app/data/tpcds/store_sales.csv
A 
asterixdb/asterix-app/src/test/resources/optimizerts/queries/subquery/query-ASTERIXDB-1572.sqlpp
A 
asterixdb/asterix-app/src/test/resources/optimizerts/queries/tpcds/query-ASTERIXDB-1591.sqlpp
M 
asterixdb/asterix-app/src/test/resources/optimizerts/results/inverted-index-join/issue741.plan
M 
asterixdb/asterix-app/src/test/resources/optimizerts/results/query-ASTERIXDB-159-3.plan
M 
asterixdb/asterix-app/src/test/resources/optimizerts/results/query-issue562.plan
M 
asterixdb/asterix-app/src/test/resources/optimizerts/results/subquery/exists.plan
M 
asterixdb/asterix-app/src/test/resources/optimizerts/results/subquery/not_exists.plan
A 
asterixdb/asterix-app/src/test/resources/optimizerts/results/subquery/query-ASTERIXDB-1572.plan
M 
asterixdb/asterix-app/src/test/resources/optimizerts/results/tpcds/query-ASTERIXDB-1581-correlated.plan
M 
asterixdb/asterix-app/src/test/resources/optimizerts/results/tpcds/query-ASTERIXDB-1581.plan
A 
asterixdb/asterix-app/src/test/resources/optimizerts/results/tpcds/query-ASTERIXDB-1591.plan
M 
asterixdb/asterix-app/src/test/resources/optimizerts/results/udfs/query-ASTERIXDB-1020.plan
M 
asterixdb/asterix-app/src/test/resources/optimizerts/results/udfs/query-ASTERIXDB-1308-1.plan
A 
asterixdb/asterix-app/src/test/resources/runtimets/queries_sqlpp/subquery/query-ASTERIXDB-1572/query-ASTERIXDB-1572.1.ddl.sqlpp
A 
asterixdb/asterix-app/src/test/resources/runtimets/queries_sqlpp/subquery/query-ASTERIXDB-1572/query-ASTERIXDB-1572.2.update.sqlpp
A 
asterixdb/asterix-app/src/test/resources/runtimets/queries_sqlpp/subquery/query-ASTERIXDB-1572/query-ASTERIXDB-1572.3.query.sqlpp
A 
asterixdb/asterix-app/src/test/resources/runtimets/queries_sqlpp/tpcds/query-ASTERIXDB-1591/query-ASTERIXDB-1591.1.ddl.sqlpp
A 
asterixdb/asterix-app/src/test/resources/runtimets/queries_sqlpp/tpcds/query-ASTERIXDB-1591/query-ASTERIXDB-1591.2.update.sqlpp
A 
asterixdb/asterix-app/src/test/resources/runtimets/queries_sqlpp/tpcds/query-ASTERIXDB-1591/query-ASTERIXDB-1591.3.query.sqlpp
A 
asterixdb/asterix-app/src/test/resources/runtimets/results/subquery/query-ASTERIXDB-1572/query-ASTERIXDB-1572.1.adm
A 
asterixdb/asterix-app/src/test/resources/runtimets/results/tpcds/query-ASTERIXDB-1591/query-ASTERIXDB-1591.1.adm
M 
asterixdb/asterix-app/src/test/resources/runtimets/results/tpcds/query-ASTERIXDB-1596/query-ASTERIXDB-1596.1.adm
M asterixdb/asterix-app/src/test/resources/runtimets/testsuite_sqlpp.xml
M 
hyracks-fullstack/algebricks/algebricks-core/src/main/java/org/apache/hyracks/algebricks/core/algebra/util/OperatorManipulationUtil.java
M 
hyracks-fullstack/algebricks/algebricks-rewriter/src/main/java/org/apache/hyracks/algebricks/rewriter/rules/RemoveUnusedAssignAndAggregateRule.java
M 
hyracks-fullstack/algebricks/algebricks-rewriter/src/main/java/org/apache/hyracks/algebricks/rewriter/rules/SetExecutionModeRule.java
33 files changed, 1,759 insertions(+), 735 deletions(-)


  git pull ssh://asterix-gerrit.ics.uci.edu:29418/asterixdb 
refs/changes/58/1158/7
-- 
To view, visit https://asterix-gerrit.ics.uci.edu/1158
To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings

Gerrit-MessageType: newpatchset
Gerrit-Change-Id: Ie38c51ab25e313f9dca3312c33b92e3bdb187420
Gerrit-PatchSet: 7
Gerrit-Project: asterixdb
Gerrit-Branch: master
Gerrit-Owner: Yingyi Bu 
Gerrit-Reviewer: Jenkins

Change in asterixdb[master]: ASTERIXDB-1572 and ASTERIXDB-1591: fix and regression tests.

2016-09-09 Thread Jenkins (Code Review)

Jenkins has posted comments on this change.

Change subject: ASTERIXDB-1572 and ASTERIXDB-1591: fix and regression tests.
..


Patch Set 6:

Build Started 
https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-notopic/2586/

-- 
To view, visit https://asterix-gerrit.ics.uci.edu/1158
To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings

Gerrit-MessageType: comment
Gerrit-Change-Id: Ie38c51ab25e313f9dca3312c33b92e3bdb187420
Gerrit-PatchSet: 6
Gerrit-Project: asterixdb
Gerrit-Branch: master
Gerrit-Owner: Yingyi Bu 
Gerrit-Reviewer: Jenkins 
Gerrit-HasComments: No

Change in asterixdb[master]: ASTERIXDB-1572 and ASTERIXDB-1591: fix and regression tests.

2016-09-09 Thread Yingyi Bu (Code Review)

Hello Jenkins,

I'd like you to reexamine a change.  Please visit

https://asterix-gerrit.ics.uci.edu/1158

to look at the new patch set (#6).

Change subject: ASTERIXDB-1572 and ASTERIXDB-1591: fix and regression tests.
..

ASTERIXDB-1572 and ASTERIXDB-1591: fix and regression tests.

- push aggregates into subplans;
- fix recursive variable mapping in subquery decorrelation.

Change-Id: Ie38c51ab25e313f9dca3312c33b92e3bdb187420
---
M 
asterixdb/asterix-algebra/src/main/java/org/apache/asterix/optimizer/base/RuleCollections.java
D 
asterixdb/asterix-algebra/src/main/java/org/apache/asterix/optimizer/rules/PushAggregateIntoGroupbyRule.java
A 
asterixdb/asterix-algebra/src/main/java/org/apache/asterix/optimizer/rules/PushAggregateIntoNestedSubplanRule.java
M 
asterixdb/asterix-algebra/src/main/java/org/apache/asterix/optimizer/rules/subplan/InlineSubplanInputForNestedTupleSourceRule.java
M asterixdb/asterix-app/data/tpcds/catalog_sales.csv
M asterixdb/asterix-app/data/tpcds/date_dim.csv
M asterixdb/asterix-app/data/tpcds/store_sales.csv
A 
asterixdb/asterix-app/src/test/resources/optimizerts/queries/subquery/query-ASTERIXDB-1572.sqlpp
A 
asterixdb/asterix-app/src/test/resources/optimizerts/queries/tpcds/query-ASTERIXDB-1591.sqlpp
M 
asterixdb/asterix-app/src/test/resources/optimizerts/results/inverted-index-join/issue741.plan
M 
asterixdb/asterix-app/src/test/resources/optimizerts/results/query-ASTERIXDB-159-3.plan
M 
asterixdb/asterix-app/src/test/resources/optimizerts/results/query-issue562.plan
M 
asterixdb/asterix-app/src/test/resources/optimizerts/results/subquery/exists.plan
M 
asterixdb/asterix-app/src/test/resources/optimizerts/results/subquery/not_exists.plan
A 
asterixdb/asterix-app/src/test/resources/optimizerts/results/subquery/query-ASTERIXDB-1572.plan
M 
asterixdb/asterix-app/src/test/resources/optimizerts/results/tpcds/query-ASTERIXDB-1581-correlated.plan
M 
asterixdb/asterix-app/src/test/resources/optimizerts/results/tpcds/query-ASTERIXDB-1581.plan
A 
asterixdb/asterix-app/src/test/resources/optimizerts/results/tpcds/query-ASTERIXDB-1591.plan
M 
asterixdb/asterix-app/src/test/resources/optimizerts/results/udfs/query-ASTERIXDB-1020.plan
M 
asterixdb/asterix-app/src/test/resources/optimizerts/results/udfs/query-ASTERIXDB-1308-1.plan
A 
asterixdb/asterix-app/src/test/resources/runtimets/queries_sqlpp/subquery/query-ASTERIXDB-1572/query-ASTERIXDB-1572.1.ddl.sqlpp
A 
asterixdb/asterix-app/src/test/resources/runtimets/queries_sqlpp/subquery/query-ASTERIXDB-1572/query-ASTERIXDB-1572.2.update.sqlpp
A 
asterixdb/asterix-app/src/test/resources/runtimets/queries_sqlpp/subquery/query-ASTERIXDB-1572/query-ASTERIXDB-1572.3.query.sqlpp
A 
asterixdb/asterix-app/src/test/resources/runtimets/queries_sqlpp/tpcds/query-ASTERIXDB-1591/query-ASTERIXDB-1591.1.ddl.sqlpp
A 
asterixdb/asterix-app/src/test/resources/runtimets/queries_sqlpp/tpcds/query-ASTERIXDB-1591/query-ASTERIXDB-1591.2.update.sqlpp
A 
asterixdb/asterix-app/src/test/resources/runtimets/queries_sqlpp/tpcds/query-ASTERIXDB-1591/query-ASTERIXDB-1591.3.query.sqlpp
A 
asterixdb/asterix-app/src/test/resources/runtimets/results/subquery/query-ASTERIXDB-1572/query-ASTERIXDB-1572.1.adm
A 
asterixdb/asterix-app/src/test/resources/runtimets/results/tpcds/query-ASTERIXDB-1591/query-ASTERIXDB-1591.1.adm
M 
asterixdb/asterix-app/src/test/resources/runtimets/results/tpcds/query-ASTERIXDB-1596/query-ASTERIXDB-1596.1.adm
M asterixdb/asterix-app/src/test/resources/runtimets/testsuite_sqlpp.xml
M 
hyracks-fullstack/algebricks/algebricks-core/src/main/java/org/apache/hyracks/algebricks/core/algebra/util/OperatorManipulationUtil.java
M 
hyracks-fullstack/algebricks/algebricks-rewriter/src/main/java/org/apache/hyracks/algebricks/rewriter/rules/RemoveUnusedAssignAndAggregateRule.java
M 
hyracks-fullstack/algebricks/algebricks-rewriter/src/main/java/org/apache/hyracks/algebricks/rewriter/rules/SetExecutionModeRule.java
33 files changed, 1,758 insertions(+), 734 deletions(-)


  git pull ssh://asterix-gerrit.ics.uci.edu:29418/asterixdb 
refs/changes/58/1158/6
-- 
To view, visit https://asterix-gerrit.ics.uci.edu/1158
To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings

Gerrit-MessageType: newpatchset
Gerrit-Change-Id: Ie38c51ab25e313f9dca3312c33b92e3bdb187420
Gerrit-PatchSet: 6
Gerrit-Project: asterixdb
Gerrit-Branch: master
Gerrit-Owner: Yingyi Bu 
Gerrit-Reviewer: Jenkins

Change in asterixdb[master]: ASTERIXDB-1572 and ASTERIXDB-1591: fix and regression tests.

2016-09-09 Thread Jenkins (Code Review)

Jenkins has posted comments on this change.

Change subject: ASTERIXDB-1572 and ASTERIXDB-1591: fix and regression tests.
..


Patch Set 5:

WARNING: THIS CHANGE CONTAINS CROSS-PRODUCT CHANGES IN:
* asterixdb
* hyracks-fullstack

PLEASE REVIEW CAREFULLY AND LOOK FOR API CHANGES!

-- 
To view, visit https://asterix-gerrit.ics.uci.edu/1158
To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings

Gerrit-MessageType: comment
Gerrit-Change-Id: Ie38c51ab25e313f9dca3312c33b92e3bdb187420
Gerrit-PatchSet: 5
Gerrit-Project: asterixdb
Gerrit-Branch: master
Gerrit-Owner: Yingyi Bu 
Gerrit-Reviewer: Jenkins 
Gerrit-HasComments: No

Change in asterixdb[master]: ASTERIXDB-1572 and ASTERIXDB-1591: fix and regression tests.

2016-09-09 Thread Yingyi Bu (Code Review)

Hello Jenkins,

I'd like you to reexamine a change.  Please visit

https://asterix-gerrit.ics.uci.edu/1158

to look at the new patch set (#5).

Change subject: ASTERIXDB-1572 and ASTERIXDB-1591: fix and regression tests.
..

ASTERIXDB-1572 and ASTERIXDB-1591: fix and regression tests.

- push aggregates into subplans;
- fix recursive variable mapping in subquery decorrelation.

Change-Id: Ie38c51ab25e313f9dca3312c33b92e3bdb187420
---
M 
asterixdb/asterix-algebra/src/main/java/org/apache/asterix/optimizer/base/RuleCollections.java
D 
asterixdb/asterix-algebra/src/main/java/org/apache/asterix/optimizer/rules/PushAggregateIntoGroupbyRule.java
A 
asterixdb/asterix-algebra/src/main/java/org/apache/asterix/optimizer/rules/PushAggregateIntoNestedSubplanRule.java
M 
asterixdb/asterix-algebra/src/main/java/org/apache/asterix/optimizer/rules/subplan/InlineSubplanInputForNestedTupleSourceRule.java
M asterixdb/asterix-app/data/tpcds/catalog_sales.csv
M asterixdb/asterix-app/data/tpcds/date_dim.csv
M asterixdb/asterix-app/data/tpcds/store_sales.csv
A 
asterixdb/asterix-app/src/test/resources/optimizerts/queries/subquery/query-ASTERIXDB-1572.sqlpp
A 
asterixdb/asterix-app/src/test/resources/optimizerts/queries/tpcds/query-ASTERIXDB-1591.sqlpp
M 
asterixdb/asterix-app/src/test/resources/optimizerts/results/inverted-index-join/issue741.plan
M 
asterixdb/asterix-app/src/test/resources/optimizerts/results/query-ASTERIXDB-159-3.plan
M 
asterixdb/asterix-app/src/test/resources/optimizerts/results/query-issue562.plan
M 
asterixdb/asterix-app/src/test/resources/optimizerts/results/subquery/exists.plan
M 
asterixdb/asterix-app/src/test/resources/optimizerts/results/subquery/not_exists.plan
A 
asterixdb/asterix-app/src/test/resources/optimizerts/results/subquery/query-ASTERIXDB-1572.plan
M 
asterixdb/asterix-app/src/test/resources/optimizerts/results/tpcds/query-ASTERIXDB-1581-correlated.plan
M 
asterixdb/asterix-app/src/test/resources/optimizerts/results/tpcds/query-ASTERIXDB-1581.plan
A 
asterixdb/asterix-app/src/test/resources/optimizerts/results/tpcds/query-ASTERIXDB-1591.plan
M 
asterixdb/asterix-app/src/test/resources/optimizerts/results/udfs/query-ASTERIXDB-1020.plan
M 
asterixdb/asterix-app/src/test/resources/optimizerts/results/udfs/query-ASTERIXDB-1308-1.plan
A 
asterixdb/asterix-app/src/test/resources/runtimets/queries_sqlpp/subquery/query-ASTERIXDB-1572/query-ASTERIXDB-1572.1.ddl.sqlpp
A 
asterixdb/asterix-app/src/test/resources/runtimets/queries_sqlpp/subquery/query-ASTERIXDB-1572/query-ASTERIXDB-1572.2.update.sqlpp
A 
asterixdb/asterix-app/src/test/resources/runtimets/queries_sqlpp/subquery/query-ASTERIXDB-1572/query-ASTERIXDB-1572.3.query.sqlpp
A 
asterixdb/asterix-app/src/test/resources/runtimets/queries_sqlpp/tpcds/query-ASTERIXDB-1591/query-ASTERIXDB-1591.1.ddl.sqlpp
A 
asterixdb/asterix-app/src/test/resources/runtimets/queries_sqlpp/tpcds/query-ASTERIXDB-1591/query-ASTERIXDB-1591.2.update.sqlpp
A 
asterixdb/asterix-app/src/test/resources/runtimets/queries_sqlpp/tpcds/query-ASTERIXDB-1591/query-ASTERIXDB-1591.3.query.sqlpp
A 
asterixdb/asterix-app/src/test/resources/runtimets/results/subquery/query-ASTERIXDB-1572/query-ASTERIXDB-1572.1.adm
A 
asterixdb/asterix-app/src/test/resources/runtimets/results/tpcds/query-ASTERIXDB-1591/query-ASTERIXDB-1591.1.adm
M 
asterixdb/asterix-app/src/test/resources/runtimets/results/tpcds/query-ASTERIXDB-1596/query-ASTERIXDB-1596.1.adm
M asterixdb/asterix-app/src/test/resources/runtimets/testsuite_sqlpp.xml
M 
hyracks-fullstack/algebricks/algebricks-core/src/main/java/org/apache/hyracks/algebricks/core/algebra/util/OperatorManipulationUtil.java
M 
hyracks-fullstack/algebricks/algebricks-rewriter/src/main/java/org/apache/hyracks/algebricks/rewriter/rules/RemoveUnusedAssignAndAggregateRule.java
M 
hyracks-fullstack/algebricks/algebricks-rewriter/src/main/java/org/apache/hyracks/algebricks/rewriter/rules/SetExecutionModeRule.java
33 files changed, 1,758 insertions(+), 734 deletions(-)


  git pull ssh://asterix-gerrit.ics.uci.edu:29418/asterixdb 
refs/changes/58/1158/5
-- 
To view, visit https://asterix-gerrit.ics.uci.edu/1158
To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings

Gerrit-MessageType: newpatchset
Gerrit-Change-Id: Ie38c51ab25e313f9dca3312c33b92e3bdb187420
Gerrit-PatchSet: 5
Gerrit-Project: asterixdb
Gerrit-Branch: master
Gerrit-Owner: Yingyi Bu 
Gerrit-Reviewer: Jenkins

Change in asterixdb[master]: ASTERIXDB-1572 and ASTERIXDB-1591: fix and regression tests.

2016-09-09 Thread Jenkins (Code Review)

Jenkins has posted comments on this change.

Change subject: ASTERIXDB-1572 and ASTERIXDB-1591: fix and regression tests.
..


Patch Set 4:

Integration Tests Started 
https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-integration-tests/607/

-- 
To view, visit https://asterix-gerrit.ics.uci.edu/1158
To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings

Gerrit-MessageType: comment
Gerrit-Change-Id: Ie38c51ab25e313f9dca3312c33b92e3bdb187420
Gerrit-PatchSet: 4
Gerrit-Project: asterixdb
Gerrit-Branch: master
Gerrit-Owner: Yingyi Bu 
Gerrit-Reviewer: Jenkins 
Gerrit-HasComments: No

Change in asterixdb[master]: ASTERIXDB-1572 and ASTERIXDB-1591: fix and regression tests.

2016-09-09 Thread Jenkins (Code Review)

Jenkins has posted comments on this change.

Change subject: ASTERIXDB-1572 and ASTERIXDB-1591: fix and regression tests.
..


Patch Set 4:

WARNING: THIS CHANGE CONTAINS CROSS-PRODUCT CHANGES IN:
* asterixdb
* hyracks-fullstack

PLEASE REVIEW CAREFULLY AND LOOK FOR API CHANGES!

-- 
To view, visit https://asterix-gerrit.ics.uci.edu/1158
To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings

Gerrit-MessageType: comment
Gerrit-Change-Id: Ie38c51ab25e313f9dca3312c33b92e3bdb187420
Gerrit-PatchSet: 4
Gerrit-Project: asterixdb
Gerrit-Branch: master
Gerrit-Owner: Yingyi Bu 
Gerrit-Reviewer: Jenkins 
Gerrit-HasComments: No

[jira] [Commented] (ASTERIXDB-1636) Feed cannot re-ingest after cluster restart

2016-09-09 Thread Ian Maxon (JIRA)


[ 
https://issues.apache.org/jira/browse/ASTERIXDB-1636?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15478436#comment-15478436
 ] 

Ian Maxon commented on ASTERIXDB-1636:
--

Jianfeng, Xikui and I were discussing this. Apparently everything is fine until 
one tries to insert after restart. Queries seem to work fine. Overall it seems 
more likely a storage issue than a feeds issue. 

> Feed cannot re-ingest after cluster restart
> ---
>
> Key: ASTERIXDB-1636
> URL: https://issues.apache.org/jira/browse/ASTERIXDB-1636
> Project: Apache AsterixDB
>  Issue Type: Bug
>  Components: Feeds, Storage
> Environment: master
> commit c89d668f68e5430a6ba4455daf8f9cd6f7040dd8
> Date:   Tue Sep 6 18:29:23 2016 -0700
>Reporter: Jianfeng Jia
>Assignee: Abdullah Alamoudi
>Priority: Blocker
>  Labels: soon
>
> Here are steps to reproduce the problem:
> 1. start the cluster
> 2. ingest the initial data using file feed 
> [script|https://gist.github.com/JavierJia/9ed7744c938c5cb66aba63007b86a987]
> 2.1: file for ingestion: 
> https://drive.google.com/open?id=0B423M7wGZj9dNE5HenFqcjhuUFk
> 3. start another socket feed 
> [script|https://gist.github.com/JavierJia/565cefd9322df35c7abeefbfcfcee9f8] 
> to ingest the live data  
> 4. restart the cluster
> 5. start that live socket feed again.
> 6. with your own twitter credential you can use [this 
> script|https://github.com/ISG-ICS/cloudberry/blob/master/streamFeed.sh]  to 
> ingest the tweet
> 7. It will send at most 280 tweets and stops forever.
> [~imaxon] [~idleft] if you can help that will be great.
> related to ASTERIXDB-1264



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Change in asterixdb[master]: ASTERIXDB-1572 and ASTERIXDB-1591: fix and regression tests.

2016-09-09 Thread Yingyi Bu (Code Review)

Hello Jenkins,

I'd like you to reexamine a change.  Please visit

https://asterix-gerrit.ics.uci.edu/1158

to look at the new patch set (#4).

Change subject: ASTERIXDB-1572 and ASTERIXDB-1591: fix and regression tests.
..

ASTERIXDB-1572 and ASTERIXDB-1591: fix and regression tests.

- push aggregates into subplans;
- fix recursive variable mapping in subquery decorrelation.

Change-Id: Ie38c51ab25e313f9dca3312c33b92e3bdb187420
---
M 
asterixdb/asterix-algebra/src/main/java/org/apache/asterix/optimizer/base/RuleCollections.java
D 
asterixdb/asterix-algebra/src/main/java/org/apache/asterix/optimizer/rules/PushAggregateIntoGroupbyRule.java
A 
asterixdb/asterix-algebra/src/main/java/org/apache/asterix/optimizer/rules/PushAggregateIntoNestedSubplanRule.java
M 
asterixdb/asterix-algebra/src/main/java/org/apache/asterix/optimizer/rules/subplan/InlineSubplanInputForNestedTupleSourceRule.java
M asterixdb/asterix-app/data/tpcds/catalog_sales.csv
M asterixdb/asterix-app/data/tpcds/date_dim.csv
M asterixdb/asterix-app/data/tpcds/store_sales.csv
A 
asterixdb/asterix-app/src/test/resources/optimizerts/queries/subquery/query-ASTERIXDB-1572.sqlpp
A 
asterixdb/asterix-app/src/test/resources/optimizerts/queries/tpcds/query-ASTERIXDB-1591.sqlpp
M 
asterixdb/asterix-app/src/test/resources/optimizerts/results/inverted-index-join/issue741.plan
M 
asterixdb/asterix-app/src/test/resources/optimizerts/results/query-ASTERIXDB-159-3.plan
M 
asterixdb/asterix-app/src/test/resources/optimizerts/results/query-issue562.plan
M 
asterixdb/asterix-app/src/test/resources/optimizerts/results/subquery/exists.plan
M 
asterixdb/asterix-app/src/test/resources/optimizerts/results/subquery/not_exists.plan
A 
asterixdb/asterix-app/src/test/resources/optimizerts/results/subquery/query-ASTERIXDB-1572.plan
M 
asterixdb/asterix-app/src/test/resources/optimizerts/results/tpcds/query-ASTERIXDB-1581-correlated.plan
M 
asterixdb/asterix-app/src/test/resources/optimizerts/results/tpcds/query-ASTERIXDB-1581.plan
A 
asterixdb/asterix-app/src/test/resources/optimizerts/results/tpcds/query-ASTERIXDB-1591.plan
M 
asterixdb/asterix-app/src/test/resources/optimizerts/results/udfs/query-ASTERIXDB-1020.plan
M 
asterixdb/asterix-app/src/test/resources/optimizerts/results/udfs/query-ASTERIXDB-1308-1.plan
A 
asterixdb/asterix-app/src/test/resources/runtimets/queries_sqlpp/subquery/query-ASTERIXDB-1572/query-ASTERIXDB-1572.1.ddl.sqlpp
A 
asterixdb/asterix-app/src/test/resources/runtimets/queries_sqlpp/subquery/query-ASTERIXDB-1572/query-ASTERIXDB-1572.2.update.sqlpp
A 
asterixdb/asterix-app/src/test/resources/runtimets/queries_sqlpp/subquery/query-ASTERIXDB-1572/query-ASTERIXDB-1572.3.query.sqlpp
A 
asterixdb/asterix-app/src/test/resources/runtimets/queries_sqlpp/tpcds/query-ASTERIXDB-1591/query-ASTERIXDB-1591.1.ddl.sqlpp
A 
asterixdb/asterix-app/src/test/resources/runtimets/queries_sqlpp/tpcds/query-ASTERIXDB-1591/query-ASTERIXDB-1591.2.update.sqlpp
A 
asterixdb/asterix-app/src/test/resources/runtimets/queries_sqlpp/tpcds/query-ASTERIXDB-1591/query-ASTERIXDB-1591.3.query.sqlpp
A 
asterixdb/asterix-app/src/test/resources/runtimets/results/subquery/query-ASTERIXDB-1572/query-ASTERIXDB-1572.1.adm
A 
asterixdb/asterix-app/src/test/resources/runtimets/results/tpcds/query-ASTERIXDB-1591/query-ASTERIXDB-1591.1.adm
M 
asterixdb/asterix-app/src/test/resources/runtimets/results/tpcds/query-ASTERIXDB-1596/query-ASTERIXDB-1596.1.adm
M asterixdb/asterix-app/src/test/resources/runtimets/testsuite_sqlpp.xml
M 
hyracks-fullstack/algebricks/algebricks-core/src/main/java/org/apache/hyracks/algebricks/core/algebra/util/OperatorManipulationUtil.java
M 
hyracks-fullstack/algebricks/algebricks-rewriter/src/main/java/org/apache/hyracks/algebricks/rewriter/rules/RemoveUnusedAssignAndAggregateRule.java
M 
hyracks-fullstack/algebricks/algebricks-rewriter/src/main/java/org/apache/hyracks/algebricks/rewriter/rules/SetExecutionModeRule.java
33 files changed, 1,770 insertions(+), 734 deletions(-)


  git pull ssh://asterix-gerrit.ics.uci.edu:29418/asterixdb 
refs/changes/58/1158/4
-- 
To view, visit https://asterix-gerrit.ics.uci.edu/1158
To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings

Gerrit-MessageType: newpatchset
Gerrit-Change-Id: Ie38c51ab25e313f9dca3312c33b92e3bdb187420
Gerrit-PatchSet: 4
Gerrit-Project: asterixdb
Gerrit-Branch: master
Gerrit-Owner: Yingyi Bu 
Gerrit-Reviewer: Jenkins

Change in asterixdb[master]: Add HTTP API to Collect Threaddumps From NCs

2016-09-09 Thread Jenkins (Code Review)

Jenkins has posted comments on this change.

Change subject: Add HTTP API to Collect Threaddumps From NCs
..


Patch Set 3:

WARNING: THIS CHANGE CONTAINS CROSS-PRODUCT CHANGES IN:
* asterixdb
* hyracks-fullstack

PLEASE REVIEW CAREFULLY AND LOOK FOR API CHANGES!

-- 
To view, visit https://asterix-gerrit.ics.uci.edu/1159
To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings

Gerrit-MessageType: comment
Gerrit-Change-Id: I536606a1fbc394c6c70bb8ce14791cc411691617
Gerrit-PatchSet: 3
Gerrit-Project: asterixdb
Gerrit-Branch: master
Gerrit-Owner: Michael Blow 
Gerrit-Reviewer: Jenkins 
Gerrit-Reviewer: Till Westmann 
Gerrit-HasComments: No

Change in asterixdb[master]: Add HTTP API to Collect Threaddumps From NCs

2016-09-09 Thread Jenkins (Code Review)

Jenkins has posted comments on this change.

Change subject: Add HTTP API to Collect Threaddumps From NCs
..


Patch Set 3:

Build Started 
https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-notopic/2583/

-- 
To view, visit https://asterix-gerrit.ics.uci.edu/1159
To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings

Gerrit-MessageType: comment
Gerrit-Change-Id: I536606a1fbc394c6c70bb8ce14791cc411691617
Gerrit-PatchSet: 3
Gerrit-Project: asterixdb
Gerrit-Branch: master
Gerrit-Owner: Michael Blow 
Gerrit-Reviewer: Jenkins 
Gerrit-Reviewer: Till Westmann 
Gerrit-HasComments: No

Change in asterixdb[master]: Add HTTP API to Collect Threaddumps From NCs

2016-09-09 Thread Michael Blow (Code Review)

Hello Jenkins,

I'd like you to reexamine a change.  Please visit

https://asterix-gerrit.ics.uci.edu/1159

to look at the new patch set (#3).

Change subject: Add HTTP API to Collect Threaddumps From NCs
..

Add HTTP API to Collect Threaddumps From NCs

Thread dump returned in JSON format.

e.g. http://localhost:19002/admin/cluster/node/asterix_nc2/threaddump

Change-Id: I536606a1fbc394c6c70bb8ce14791cc411691617
---
M 
asterixdb/asterix-app/src/main/java/org/apache/asterix/api/common/AsterixHyracksIntegrationUtil.java
M 
asterixdb/asterix-app/src/main/java/org/apache/asterix/api/http/servlet/ClusterAPIServlet.java
M 
asterixdb/asterix-app/src/main/java/org/apache/asterix/api/http/servlet/ClusterNodeDetailsAPIServlet.java
M 
asterixdb/asterix-app/src/test/resources/runtimets/results/api/cluster_state_1/cluster_state_1.1.adm
M 
asterixdb/asterix-app/src/test/resources/runtimets/results/api/cluster_state_3/cluster_state_3.1.adm
M 
asterixdb/asterix-app/src/test/resources/runtimets/results/api/cluster_state_4/cluster_state_4.1.adm
M 
hyracks-fullstack/hyracks/hyracks-api/src/main/java/org/apache/hyracks/api/client/HyracksClientInterfaceFunctions.java
M 
hyracks-fullstack/hyracks/hyracks-api/src/main/java/org/apache/hyracks/api/client/HyracksClientInterfaceRemoteProxy.java
M 
hyracks-fullstack/hyracks/hyracks-api/src/main/java/org/apache/hyracks/api/client/HyracksConnection.java
M 
hyracks-fullstack/hyracks/hyracks-api/src/main/java/org/apache/hyracks/api/client/IHyracksClientConnection.java
M 
hyracks-fullstack/hyracks/hyracks-api/src/main/java/org/apache/hyracks/api/client/IHyracksClientInterface.java
M 
hyracks-fullstack/hyracks/hyracks-control/hyracks-control-cc/src/main/java/org/apache/hyracks/control/cc/ClusterControllerService.java
M 
hyracks-fullstack/hyracks/hyracks-control/hyracks-control-cc/src/main/java/org/apache/hyracks/control/cc/NodeControllerState.java
A 
hyracks-fullstack/hyracks/hyracks-control/hyracks-control-cc/src/main/java/org/apache/hyracks/control/cc/work/GetNodeThreadDumpWork.java
A 
hyracks-fullstack/hyracks/hyracks-control/hyracks-control-cc/src/main/java/org/apache/hyracks/control/cc/work/NotifyThreadDumpResponse.java
M 
hyracks-fullstack/hyracks/hyracks-control/hyracks-control-common/src/main/java/org/apache/hyracks/control/common/base/IClusterController.java
M 
hyracks-fullstack/hyracks/hyracks-control/hyracks-control-common/src/main/java/org/apache/hyracks/control/common/base/INodeController.java
M 
hyracks-fullstack/hyracks/hyracks-control/hyracks-control-common/src/main/java/org/apache/hyracks/control/common/ipc/CCNCFunctions.java
M 
hyracks-fullstack/hyracks/hyracks-control/hyracks-control-common/src/main/java/org/apache/hyracks/control/common/ipc/ClusterControllerRemoteProxy.java
M 
hyracks-fullstack/hyracks/hyracks-control/hyracks-control-common/src/main/java/org/apache/hyracks/control/common/ipc/NodeControllerRemoteProxy.java
M 
hyracks-fullstack/hyracks/hyracks-control/hyracks-control-nc/src/main/java/org/apache/hyracks/control/nc/NodeControllerService.java
A 
hyracks-fullstack/hyracks/hyracks-control/hyracks-control-nc/src/main/java/org/apache/hyracks/control/nc/work/ThreadDumpWork.java
22 files changed, 436 insertions(+), 54 deletions(-)


  git pull ssh://asterix-gerrit.ics.uci.edu:29418/asterixdb 
refs/changes/59/1159/3
-- 
To view, visit https://asterix-gerrit.ics.uci.edu/1159
To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings

Gerrit-MessageType: newpatchset
Gerrit-Change-Id: I536606a1fbc394c6c70bb8ce14791cc411691617
Gerrit-PatchSet: 3
Gerrit-Project: asterixdb
Gerrit-Branch: master
Gerrit-Owner: Michael Blow 
Gerrit-Reviewer: Jenkins 
Gerrit-Reviewer: Till Westmann

Change in asterixdb[master]: ASTERIXDB-1572 and ASTERIXDB-1591: fix and regression tests.

2016-09-09 Thread Jenkins (Code Review)

Jenkins has posted comments on this change.

Change subject: ASTERIXDB-1572 and ASTERIXDB-1591: fix and regression tests.
..


Patch Set 3:

WARNING: THIS CHANGE CONTAINS CROSS-PRODUCT CHANGES IN:
* asterixdb
* hyracks-fullstack

PLEASE REVIEW CAREFULLY AND LOOK FOR API CHANGES!

-- 
To view, visit https://asterix-gerrit.ics.uci.edu/1158
To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings

Gerrit-MessageType: comment
Gerrit-Change-Id: Ie38c51ab25e313f9dca3312c33b92e3bdb187420
Gerrit-PatchSet: 3
Gerrit-Project: asterixdb
Gerrit-Branch: master
Gerrit-Owner: Yingyi Bu 
Gerrit-Reviewer: Jenkins 
Gerrit-HasComments: No

Change in asterixdb[master]: ASTERIXDB-1572 and ASTERIXDB-1591: fix and regression tests.

2016-09-09 Thread Yingyi Bu (Code Review)

Hello Jenkins,

I'd like you to reexamine a change.  Please visit

https://asterix-gerrit.ics.uci.edu/1158

to look at the new patch set (#3).

Change subject: ASTERIXDB-1572 and ASTERIXDB-1591: fix and regression tests.
..

ASTERIXDB-1572 and ASTERIXDB-1591: fix and regression tests.

- push aggregates into subplans;
- fix recursive variable mapping in subquery decorrelation.

Change-Id: Ie38c51ab25e313f9dca3312c33b92e3bdb187420
---
M 
asterixdb/asterix-algebra/src/main/java/org/apache/asterix/optimizer/base/RuleCollections.java
D 
asterixdb/asterix-algebra/src/main/java/org/apache/asterix/optimizer/rules/PushAggregateIntoGroupbyRule.java
A 
asterixdb/asterix-algebra/src/main/java/org/apache/asterix/optimizer/rules/PushAggregateIntoNestedSubplanRule.java
M 
asterixdb/asterix-algebra/src/main/java/org/apache/asterix/optimizer/rules/subplan/InlineSubplanInputForNestedTupleSourceRule.java
M asterixdb/asterix-app/data/tpcds/catalog_sales.csv
M asterixdb/asterix-app/data/tpcds/date_dim.csv
M asterixdb/asterix-app/data/tpcds/store_sales.csv
A 
asterixdb/asterix-app/src/test/resources/optimizerts/queries/subquery/query-ASTERIXDB-1572.sqlpp
A 
asterixdb/asterix-app/src/test/resources/optimizerts/queries/tpcds/query-ASTERIXDB-1591.sqlpp
M 
asterixdb/asterix-app/src/test/resources/optimizerts/results/inverted-index-join/issue741.plan
M 
asterixdb/asterix-app/src/test/resources/optimizerts/results/query-ASTERIXDB-159-3.plan
M 
asterixdb/asterix-app/src/test/resources/optimizerts/results/query-issue562.plan
M 
asterixdb/asterix-app/src/test/resources/optimizerts/results/subquery/exists.plan
M 
asterixdb/asterix-app/src/test/resources/optimizerts/results/subquery/not_exists.plan
A 
asterixdb/asterix-app/src/test/resources/optimizerts/results/subquery/query-ASTERIXDB-1572.plan
M 
asterixdb/asterix-app/src/test/resources/optimizerts/results/tpcds/query-ASTERIXDB-1581-correlated.plan
M 
asterixdb/asterix-app/src/test/resources/optimizerts/results/tpcds/query-ASTERIXDB-1581.plan
A 
asterixdb/asterix-app/src/test/resources/optimizerts/results/tpcds/query-ASTERIXDB-1591.plan
M 
asterixdb/asterix-app/src/test/resources/optimizerts/results/udfs/query-ASTERIXDB-1020.plan
M 
asterixdb/asterix-app/src/test/resources/optimizerts/results/udfs/query-ASTERIXDB-1308-1.plan
A 
asterixdb/asterix-app/src/test/resources/runtimets/queries_sqlpp/subquery/query-ASTERIXDB-1572/query-ASTERIXDB-1572.1.ddl.sqlpp
A 
asterixdb/asterix-app/src/test/resources/runtimets/queries_sqlpp/subquery/query-ASTERIXDB-1572/query-ASTERIXDB-1572.2.update.sqlpp
A 
asterixdb/asterix-app/src/test/resources/runtimets/queries_sqlpp/subquery/query-ASTERIXDB-1572/query-ASTERIXDB-1572.3.query.sqlpp
A 
asterixdb/asterix-app/src/test/resources/runtimets/queries_sqlpp/tpcds/query-ASTERIXDB-1591/query-ASTERIXDB-1591.1.ddl.sqlpp
A 
asterixdb/asterix-app/src/test/resources/runtimets/queries_sqlpp/tpcds/query-ASTERIXDB-1591/query-ASTERIXDB-1591.2.update.sqlpp
A 
asterixdb/asterix-app/src/test/resources/runtimets/queries_sqlpp/tpcds/query-ASTERIXDB-1591/query-ASTERIXDB-1591.3.query.sqlpp
A 
asterixdb/asterix-app/src/test/resources/runtimets/results/subquery/query-ASTERIXDB-1572/query-ASTERIXDB-1572.1.adm
A 
asterixdb/asterix-app/src/test/resources/runtimets/results/tpcds/query-ASTERIXDB-1591/query-ASTERIXDB-1591.1.adm
M 
asterixdb/asterix-app/src/test/resources/runtimets/results/tpcds/query-ASTERIXDB-1596/query-ASTERIXDB-1596.1.adm
M asterixdb/asterix-app/src/test/resources/runtimets/testsuite_sqlpp.xml
M 
hyracks-fullstack/algebricks/algebricks-core/src/main/java/org/apache/hyracks/algebricks/core/algebra/util/OperatorManipulationUtil.java
M 
hyracks-fullstack/algebricks/algebricks-rewriter/src/main/java/org/apache/hyracks/algebricks/rewriter/rules/RemoveUnusedAssignAndAggregateRule.java
M 
hyracks-fullstack/algebricks/algebricks-rewriter/src/main/java/org/apache/hyracks/algebricks/rewriter/rules/SetExecutionModeRule.java
33 files changed, 1,770 insertions(+), 734 deletions(-)


  git pull ssh://asterix-gerrit.ics.uci.edu:29418/asterixdb 
refs/changes/58/1158/3
-- 
To view, visit https://asterix-gerrit.ics.uci.edu/1158
To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings

Gerrit-MessageType: newpatchset
Gerrit-Change-Id: Ie38c51ab25e313f9dca3312c33b92e3bdb187420
Gerrit-PatchSet: 3
Gerrit-Project: asterixdb
Gerrit-Branch: master
Gerrit-Owner: Yingyi Bu 
Gerrit-Reviewer: Jenkins

[jira] [Created] (ASTERIXDB-1638) Print the retainMissing flag for SelectOperator if the flag is true

2016-09-09 Thread Yingyi Bu (JIRA)

Yingyi Bu created ASTERIXDB-1638:


 Summary: Print the retainMissing flag for SelectOperator if the 
flag is true
 Key: ASTERIXDB-1638
 URL: https://issues.apache.org/jira/browse/ASTERIXDB-1638
 Project: Apache AsterixDB
  Issue Type: Bug
Reporter: Yingyi Bu
Assignee: Yingyi Bu
Priority: Minor


There is a retainMissing flag in the select operator. That's set to be true for 
the select operator that results from an index left outer join rewriting, e.g.:

select (function-call: algebricks:and, Args:[function-call: algebricks:neq, 
Args:[%0->$$26, %0->$$25], function-call: asterix:get-item, 
Args:[function-call: asterix:similarity-jaccard-check, Args:[%0->$$29, 
%0->$$30, AFloat:
{0.6}], AInt64: {0}]]) – |LOCAL|

It would be helpful to print that flag in the plan, e.g.:

select *[retainMissing=true]* (function-call: algebricks:and, 
Args:[function-call: algebricks:neq, Args:[%0->$$26, %0->$$25], function-call: 
asterix:get-item, Args:[function-call: asterix:similarity-jaccard-check, 
Args:[%0->$$29, %0->$$30, AFloat: {0.6}
], AInt64:
{0}
]]) – |LOCAL|



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Closed] (ASTERIXDB-1637) Incorrect plan generated by left outer index join rewriting

2016-09-09 Thread Yingyi Bu (JIRA)


 [ 
https://issues.apache.org/jira/browse/ASTERIXDB-1637?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Yingyi Bu closed ASTERIXDB-1637.

Resolution: Not A Problem

> Incorrect plan generated by left outer index join rewriting
> ---
>
> Key: ASTERIXDB-1637
> URL: https://issues.apache.org/jira/browse/ASTERIXDB-1637
> Project: Apache AsterixDB
>  Issue Type: Bug
>  Components: Optimizer
>Reporter: Yingyi Bu
>Assignee: Taewoo Kim
>
> For optimizer test 
> asterixdb/asterix-app/src/test/resources/optimizerts/queries/inverted-index-join/issue741.aql,
>  the optimized plan is not right.
> {noformat}
> for $t in dataset('TweetMessages')
> where $t.send_time >= datetime('2011-06-18T14:10:17')
> and
> $t.send_time < datetime('2011-06-18T15:10:17')
> return {
> "tweet": $t.tweetid,
> "similar-tweets": for $t2 in dataset('TweetMessages')
>   let $sim := 
> similarity-jaccard-check($t.referred_topics, $t2.referred_topics, 0.6f)
>   where $sim[0] and
>   $t2.tweetid != $t.tweetid
>   return $t2.tweetid
> }
> {noformat}
> {noformat}
> distribute result [%0->$$11]
> -- DISTRIBUTE_RESULT  |PARTITIONED|
>   exchange
>   -- ONE_TO_ONE_EXCHANGE  |PARTITIONED|
> project ([$$11])
> -- STREAM_PROJECT  |PARTITIONED|
>   assign [$$11] <- [function-call: asterix:closed-record-constructor, 
> Args:[AString: {tweet}, %0->$$33, AString: {similar-tweets}, %0->$$23]]
>   -- ASSIGN  |PARTITIONED|
> exchange
> -- ONE_TO_ONE_EXCHANGE  |PARTITIONED|
>   group by ([$$33 := %0->$$25]) decor ([]) {
> aggregate [$$23] <- [function-call: asterix:listify, 
> Args:[%0->$$26]]
> -- AGGREGATE  |LOCAL|
>   select (function-call: algebricks:not, 
> Args:[function-call: algebricks:is-missing, Args:[%0->$$26]])
>   -- STREAM_SELECT  |LOCAL|
> nested tuple source
> -- NESTED_TUPLE_SOURCE  |LOCAL|
>  }
>   -- PRE_CLUSTERED_GROUP_BY[$$25]  |PARTITIONED|
> exchange
> -- ONE_TO_ONE_EXCHANGE  |PARTITIONED|
>   order (ASC, %0->$$25) 
>   -- STABLE_SORT [$$25(ASC)]  |PARTITIONED|
> exchange
> -- HASH_PARTITION_EXCHANGE [$$25]  |PARTITIONED|
>   project ([$$25, $$26])
>   -- STREAM_PROJECT  |PARTITIONED|
> exchange
> -- ONE_TO_ONE_EXCHANGE  |PARTITIONED|
>   join (function-call: algebricks:eq, Args:[%0->$$36, 
> %0->$$25])
>   -- HYBRID_HASH_JOIN [$$36][$$25]  |PARTITIONED|
> exchange
> -- ONE_TO_ONE_EXCHANGE  |PARTITIONED|
>   project ([$$36])
>   -- STREAM_PROJECT  |PARTITIONED|
> select (function-call: algebricks:and, 
> Args:[function-call: algebricks:ge, Args:[%0->$$24, ADateTime: { 
> 2011-06-18T14:10:17.000Z }], function-call: algebricks:lt, Args:[%0->$$24, 
> ADateTime: { 2011-06-18T15:10:17.000Z }]])
> -- STREAM_SELECT  |PARTITIONED|
>   project ([$$36, $$24])
>   -- STREAM_PROJECT  |PARTITIONED|
> assign [$$24] <- [function-call: 
> asterix:field-access-by-index, Args:[%0->$$0, AInt32: {3}]]
> -- ASSIGN  |PARTITIONED|
>   exchange
>   -- ONE_TO_ONE_EXCHANGE  |PARTITIONED|
> data-scan []<-[$$36, $$0] <- 
> test:TweetMessages
> -- DATASOURCE_SCAN  |PARTITIONED|
>   exchange
>   -- ONE_TO_ONE_EXCHANGE  |PARTITIONED|
> empty-tuple-source
> -- EMPTY_TUPLE_SOURCE  |PARTITIONED|
> exchange
> -- HASH_PARTITION_EXCHANGE [$$25]  |PARTITIONED|
>   project ([$$25, $$26])
>   -- STREAM_PROJECT  |PARTITIONED|
> select (function-call: algebricks:and, 
> Args:[function-call: algebricks:neq, Args:[%0->$$26, %0->$$25], 
> function-call: asterix:get-item, Args:[function-call: 
> asterix:similarity-jaccard-check, Args:[%0->$$29, function-call: 
> asterix:field-access-by-index, Args:[%0->$$1, AInt32: {4}], AFloat: {0.6}], 
> AInt64: {0}]])
> -- STREAM_SELECT  |PARTITIONED|
>   project

[jira] [Commented] (ASTERIXDB-1637) Incorrect plan generated by left outer index join rewriting

2016-09-09 Thread Yingyi Bu (JIRA)


[ 
https://issues.apache.org/jira/browse/ASTERIXDB-1637?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15478392#comment-15478392
 ] 

Yingyi Bu commented on ASTERIXDB-1637:
--

After taking a look in the introduce join access method rule, I think the plan 
is correct, because in the select operator, it has a retainMissing flag. That's 
set to be true for the select operator:
 select (function-call: algebricks:and, Args:[function-call: algebricks:neq, 
Args:[%0->$$26, %0->$$25], function-call: asterix:get-item, 
Args:[function-call: asterix:similarity-jaccard-check, Args:[%0->$$29, 
%0->$$30, AFloat: {0.6}], AInt64: {0}]]) -- |LOCAL|
  
It would be helpful to print that flag in the plan, e.g.:

select *[retainMissing=true]* (function-call: algebricks:and, 
Args:[function-call: algebricks:neq, Args:[%0->$$26, %0->$$25], function-call: 
asterix:get-item, Args:[function-call: asterix:similarity-jaccard-check, 
Args:[%0->$$29, %0->$$30, AFloat: {0.6}], AInt64: {0}]]) -- |LOCAL|



> Incorrect plan generated by left outer index join rewriting
> ---
>
> Key: ASTERIXDB-1637
> URL: https://issues.apache.org/jira/browse/ASTERIXDB-1637
> Project: Apache AsterixDB
>  Issue Type: Bug
>  Components: Optimizer
>Reporter: Yingyi Bu
>Assignee: Taewoo Kim
>
> For optimizer test 
> asterixdb/asterix-app/src/test/resources/optimizerts/queries/inverted-index-join/issue741.aql,
>  the optimized plan is not right.
> {noformat}
> for $t in dataset('TweetMessages')
> where $t.send_time >= datetime('2011-06-18T14:10:17')
> and
> $t.send_time < datetime('2011-06-18T15:10:17')
> return {
> "tweet": $t.tweetid,
> "similar-tweets": for $t2 in dataset('TweetMessages')
>   let $sim := 
> similarity-jaccard-check($t.referred_topics, $t2.referred_topics, 0.6f)
>   where $sim[0] and
>   $t2.tweetid != $t.tweetid
>   return $t2.tweetid
> }
> {noformat}
> {noformat}
> distribute result [%0->$$11]
> -- DISTRIBUTE_RESULT  |PARTITIONED|
>   exchange
>   -- ONE_TO_ONE_EXCHANGE  |PARTITIONED|
> project ([$$11])
> -- STREAM_PROJECT  |PARTITIONED|
>   assign [$$11] <- [function-call: asterix:closed-record-constructor, 
> Args:[AString: {tweet}, %0->$$33, AString: {similar-tweets}, %0->$$23]]
>   -- ASSIGN  |PARTITIONED|
> exchange
> -- ONE_TO_ONE_EXCHANGE  |PARTITIONED|
>   group by ([$$33 := %0->$$25]) decor ([]) {
> aggregate [$$23] <- [function-call: asterix:listify, 
> Args:[%0->$$26]]
> -- AGGREGATE  |LOCAL|
>   select (function-call: algebricks:not, 
> Args:[function-call: algebricks:is-missing, Args:[%0->$$26]])
>   -- STREAM_SELECT  |LOCAL|
> nested tuple source
> -- NESTED_TUPLE_SOURCE  |LOCAL|
>  }
>   -- PRE_CLUSTERED_GROUP_BY[$$25]  |PARTITIONED|
> exchange
> -- ONE_TO_ONE_EXCHANGE  |PARTITIONED|
>   order (ASC, %0->$$25) 
>   -- STABLE_SORT [$$25(ASC)]  |PARTITIONED|
> exchange
> -- HASH_PARTITION_EXCHANGE [$$25]  |PARTITIONED|
>   project ([$$25, $$26])
>   -- STREAM_PROJECT  |PARTITIONED|
> exchange
> -- ONE_TO_ONE_EXCHANGE  |PARTITIONED|
>   join (function-call: algebricks:eq, Args:[%0->$$36, 
> %0->$$25])
>   -- HYBRID_HASH_JOIN [$$36][$$25]  |PARTITIONED|
> exchange
> -- ONE_TO_ONE_EXCHANGE  |PARTITIONED|
>   project ([$$36])
>   -- STREAM_PROJECT  |PARTITIONED|
> select (function-call: algebricks:and, 
> Args:[function-call: algebricks:ge, Args:[%0->$$24, ADateTime: { 
> 2011-06-18T14:10:17.000Z }], function-call: algebricks:lt, Args:[%0->$$24, 
> ADateTime: { 2011-06-18T15:10:17.000Z }]])
> -- STREAM_SELECT  |PARTITIONED|
>   project ([$$36, $$24])
>   -- STREAM_PROJECT  |PARTITIONED|
> assign [$$24] <- [function-call: 
> asterix:field-access-by-index, Args:[%0->$$0, AInt32: {3}]]
> -- ASSIGN  |PARTITIONED|
>   exchange
>   -- ONE_TO_ONE_EXCHANGE  |PARTITIONED|
> data-scan []<-[$$36, $$0] <- 
> test:TweetMessages
> -- DATASOURCE_SCAN  |PARTITIONED|
>   exchange
>   -- ONE_TO_ONE_EXCHANGE  |PARTITIONED|

[jira] [Commented] (ASTERIXDB-1637) Incorrect plan generated by left outer index join rewriting

2016-09-09 Thread Yingyi Bu (JIRA)


[ 
https://issues.apache.org/jira/browse/ASTERIXDB-1637?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15478245#comment-15478245
 ] 

Yingyi Bu commented on ASTERIXDB-1637:
--

Basically, I think this rewriting step is incorrect:

{noformat}
Sep 09, 2016 1:52:56 PM 
org.apache.hyracks.algebricks.core.rewriter.base.AbstractRuleController 
printRuleApplication
FINE:  Rule class 
org.apache.asterix.optimizer.rules.am.IntroduceJoinAccessMethodRule fired.

Sep 09, 2016 1:52:56 PM 
org.apache.hyracks.algebricks.core.rewriter.base.AbstractRuleController 
printRuleApplication
FINE:  Before plan
group by ([$$33 := %0->$$25]) decor ([%0->$$0; %0->$$24; %0->$$29]) {
  aggregate [$$23] <- [function-call: asterix:listify, Args:[%0->$$26]] 
-- |LOCAL|
select (function-call: algebricks:not, Args:[function-call: 
algebricks:is-missing, Args:[%0->$$32]]) -- |LOCAL|
  nested tuple source -- |LOCAL|
   } -- |PARTITIONED|
  left outer join (function-call: algebricks:and, Args:[function-call: 
algebricks:neq, Args:[%0->$$26, %0->$$25], function-call: asterix:get-item, 
Args:[function-call: asterix:similarity-jaccard-check, Args:[%0->$$29, 
%0->$$30, AFloat: {0.6}], AInt64: {0}]]) -- |PARTITIONED|
select (function-call: algebricks:and, Args:[function-call: algebricks:ge, 
Args:[%0->$$24, ADateTime: { 2011-06-18T14:10:17.000Z }], function-call: 
algebricks:lt, Args:[%0->$$24, ADateTime: { 2011-06-18T15:10:17.000Z }]]) -- 
|PARTITIONED|
  assign [$$29, $$24] <- [function-call: asterix:field-access-by-index, 
Args:[%0->$$0, AInt32: {4}], function-call: asterix:field-access-by-index, 
Args:[%0->$$0, AInt32: {3}]] -- |PARTITIONED|
data-scan []<-[$$25, $$0] <- test:TweetMessages -- |PARTITIONED|
  empty-tuple-source -- |PARTITIONED|
assign [$$32, $$30] <- [TRUE, function-call: asterix:field-access-by-index, 
Args:[%0->$$1, AInt32: {4}]] -- |PARTITIONED|
  data-scan []<-[$$26, $$1] <- test:TweetMessages -- |PARTITIONED|
empty-tuple-source -- |PARTITIONED|


Sep 09, 2016 1:52:56 PM 
org.apache.hyracks.algebricks.core.rewriter.base.AbstractRuleController 
printRuleApplication
FINE:  After plan
group by ([$$33 := %0->$$25]) decor ([%0->$$0; %0->$$24; %0->$$29]) {
  aggregate [$$23] <- [function-call: asterix:listify, Args:[%0->$$26]] 
-- |LOCAL|
select (function-call: algebricks:not, Args:[function-call: 
algebricks:is-missing, Args:[%0->$$26]]) -- |LOCAL|
  nested tuple source -- |LOCAL|
   } -- |PARTITIONED|
  join (function-call: algebricks:eq, Args:[%0->$$36, %0->$$25]) -- 
|PARTITIONED|
select (function-call: algebricks:and, Args:[function-call: algebricks:ge, 
Args:[%0->$$24, ADateTime: { 2011-06-18T14:10:17.000Z }], function-call: 
algebricks:lt, Args:[%0->$$24, ADateTime: { 2011-06-18T15:10:17.000Z }]]) -- 
|PARTITIONED|
  assign [$$34, $$24] <- [function-call: asterix:field-access-by-index, 
Args:[%0->$$0, AInt32: {4}], function-call: asterix:field-access-by-index, 
Args:[%0->$$0, AInt32: {3}]] -- |PARTITIONED|
data-scan []<-[$$36, $$0] <- test:TweetMessages -- |PARTITIONED|
  empty-tuple-source -- |PARTITIONED|
select (function-call: algebricks:and, Args:[function-call: algebricks:neq, 
Args:[%0->$$26, %0->$$25], function-call: asterix:get-item, 
Args:[function-call: asterix:similarity-jaccard-check, Args:[%0->$$29, 
%0->$$30, AFloat: {0.6}], AInt64: {0}]]) -- |LOCAL|
  assign [$$32, $$30] <- [TRUE, function-call: 
asterix:field-access-by-index, Args:[%0->$$1, AInt32: {4}]] -- |PARTITIONED|
left-outer-unnest-map [$$26, $$1] <- function-call: 
asterix:index-search, Args:[AString: {TweetMessages}, AInt32: {0}, AString: 
{test}, AString: {TweetMessages}, ABoolean: {true}, ABoolean: {false}, AInt32: 
{1}, %0->$$39, AInt32: {1}, %0->$$39, TRUE, TRUE, TRUE] -- |PARTITIONED|
  order (ASC, %0->$$39)  -- |LOCAL|
left-outer-unnest-map [$$39] <- function-call: 
asterix:index-search, Args:[AString: {topicIIx}, AInt32: {4}, AString: {test}, 
AString: {TweetMessages}, ABoolean: {true}, ABoolean: {true}, AInt32: {1}, 
AFloat: {0.6}, AInt32: {22}, AInt32: {1}, %0->$$29] -- |PARTITIONED|
  select (function-call: algebricks:and, Args:[function-call: 
algebricks:ge, Args:[%0->$$37, ADateTime: { 2011-06-18T14:10:17.000Z }], 
function-call: algebricks:lt, Args:[%0->$$37, ADateTime: { 
2011-06-18T15:10:17.000Z }]]) -- |PARTITIONED|
assign [$$29, $$37] <- [function-call: 
asterix:field-access-by-index, Args:[%0->$$38, AInt32: {4}], function-call: 
asterix:field-access-by-index, Args:[%0->$$38, AInt32: {3}]] -- |PARTITIONED|
  data-scan []<-[$$25, $$38] <- test:TweetMessages -- 
|PARTITIONED|
empty-tuple-source -- |PARTITIONED|
{noformat}



> Incorrect plan generated by left outer index join rewriting
>

Change in asterixdb[master]: ASTERIXDB-1081, ASTERIXDB-1086, ASTERIXDB-1246: proper multi...

2016-09-09 Thread Jenkins (Code Review)

Jenkins has posted comments on this change.

Change subject: ASTERIXDB-1081, ASTERIXDB-1086, ASTERIXDB-1246: proper multiple 
plan paths handling
..


Patch Set 9: Integration-Tests+1

Integration Tests Successful

https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-integration-tests/605/ : 
SUCCESS

-- 
To view, visit https://asterix-gerrit.ics.uci.edu/1073
To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings

Gerrit-MessageType: comment
Gerrit-Change-Id: I69e055572f024f28a857d4e64916b4806e63c083
Gerrit-PatchSet: 9
Gerrit-Project: asterixdb
Gerrit-Branch: master
Gerrit-Owner: Taewoo Kim 
Gerrit-Reviewer: Jenkins 
Gerrit-Reviewer: Taewoo Kim 
Gerrit-Reviewer: Till Westmann 
Gerrit-Reviewer: Yingyi Bu 
Gerrit-HasComments: No

[jira] [Updated] (ASTERIXDB-1637) Incorrect plan generated by left outer index join rewriting

2016-09-09 Thread Yingyi Bu (JIRA)


 [ 
https://issues.apache.org/jira/browse/ASTERIXDB-1637?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Yingyi Bu updated ASTERIXDB-1637:
-
Description: 
For optimizer test 
asterixdb/asterix-app/src/test/resources/optimizerts/queries/inverted-index-join/issue741.aql,
 the optimized plan is not right.

{noformat}
for $t in dataset('TweetMessages')
where $t.send_time >= datetime('2011-06-18T14:10:17')
and
$t.send_time < datetime('2011-06-18T15:10:17')
return {
"tweet": $t.tweetid,
"similar-tweets": for $t2 in dataset('TweetMessages')
  let $sim := similarity-jaccard-check($t.referred_topics, 
$t2.referred_topics, 0.6f)
  where $sim[0] and
  $t2.tweetid != $t.tweetid
  return $t2.tweetid
}
{noformat}

{noformat}
distribute result [%0->$$11]
-- DISTRIBUTE_RESULT  |PARTITIONED|
  exchange
  -- ONE_TO_ONE_EXCHANGE  |PARTITIONED|
project ([$$11])
-- STREAM_PROJECT  |PARTITIONED|
  assign [$$11] <- [function-call: asterix:closed-record-constructor, 
Args:[AString: {tweet}, %0->$$33, AString: {similar-tweets}, %0->$$23]]
  -- ASSIGN  |PARTITIONED|
exchange
-- ONE_TO_ONE_EXCHANGE  |PARTITIONED|
  group by ([$$33 := %0->$$25]) decor ([]) {
aggregate [$$23] <- [function-call: asterix:listify, 
Args:[%0->$$26]]
-- AGGREGATE  |LOCAL|
  select (function-call: algebricks:not, 
Args:[function-call: algebricks:is-missing, Args:[%0->$$26]])
  -- STREAM_SELECT  |LOCAL|
nested tuple source
-- NESTED_TUPLE_SOURCE  |LOCAL|
 }
  -- PRE_CLUSTERED_GROUP_BY[$$25]  |PARTITIONED|
exchange
-- ONE_TO_ONE_EXCHANGE  |PARTITIONED|
  order (ASC, %0->$$25) 
  -- STABLE_SORT [$$25(ASC)]  |PARTITIONED|
exchange
-- HASH_PARTITION_EXCHANGE [$$25]  |PARTITIONED|
  project ([$$25, $$26])
  -- STREAM_PROJECT  |PARTITIONED|
exchange
-- ONE_TO_ONE_EXCHANGE  |PARTITIONED|
  join (function-call: algebricks:eq, Args:[%0->$$36, 
%0->$$25])
  -- HYBRID_HASH_JOIN [$$36][$$25]  |PARTITIONED|
exchange
-- ONE_TO_ONE_EXCHANGE  |PARTITIONED|
  project ([$$36])
  -- STREAM_PROJECT  |PARTITIONED|
select (function-call: algebricks:and, 
Args:[function-call: algebricks:ge, Args:[%0->$$24, ADateTime: { 
2011-06-18T14:10:17.000Z }], function-call: algebricks:lt, Args:[%0->$$24, 
ADateTime: { 2011-06-18T15:10:17.000Z }]])
-- STREAM_SELECT  |PARTITIONED|
  project ([$$36, $$24])
  -- STREAM_PROJECT  |PARTITIONED|
assign [$$24] <- [function-call: 
asterix:field-access-by-index, Args:[%0->$$0, AInt32: {3}]]
-- ASSIGN  |PARTITIONED|
  exchange
  -- ONE_TO_ONE_EXCHANGE  |PARTITIONED|
data-scan []<-[$$36, $$0] <- 
test:TweetMessages
-- DATASOURCE_SCAN  |PARTITIONED|
  exchange
  -- ONE_TO_ONE_EXCHANGE  |PARTITIONED|
empty-tuple-source
-- EMPTY_TUPLE_SOURCE  |PARTITIONED|
exchange
-- HASH_PARTITION_EXCHANGE [$$25]  |PARTITIONED|
  project ([$$25, $$26])
  -- STREAM_PROJECT  |PARTITIONED|
select (function-call: algebricks:and, 
Args:[function-call: algebricks:neq, Args:[%0->$$26, %0->$$25], function-call: 
asterix:get-item, Args:[function-call: asterix:similarity-jaccard-check, 
Args:[%0->$$29, function-call: asterix:field-access-by-index, Args:[%0->$$1, 
AInt32: {4}], AFloat: {0.6}], AInt64: {0}]])
-- STREAM_SELECT  |PARTITIONED|
  project ([$$1, $$25, $$26, $$29])
  -- STREAM_PROJECT  |PARTITIONED|
exchange
-- ONE_TO_ONE_EXCHANGE  |PARTITIONED|
  left-outer-unnest-map [$$26, $$1] <- 
function-call: asterix:index-search, Args:[AString: {TweetMessages}, AInt32: 
{0}, AString: {test}, AString: {TweetMessages}, ABoolean: {true}, ABoolean: 
{false}, AInt32: {1}, %0->$$39, AInt32: {1}, %0->$$39, TRUE, TRUE, TRUE]
  -- BTREE_SEARCH  |PARTITIONED|

[jira] [Created] (ASTERIXDB-1637) Incorrect plan generated by left outer index join rewriting

2016-09-09 Thread Yingyi Bu (JIRA)

Yingyi Bu created ASTERIXDB-1637:


 Summary: Incorrect plan generated by left outer index join 
rewriting
 Key: ASTERIXDB-1637
 URL: https://issues.apache.org/jira/browse/ASTERIXDB-1637
 Project: Apache AsterixDB
  Issue Type: Bug
  Components: Optimizer
Reporter: Yingyi Bu
Assignee: Taewoo Kim


For optimizer test 
asterixdb/asterix-app/src/test/resources/optimizerts/queries/inverted-index-join/issue741.aql,
 the optimized plan is not right.

{noformat}
for $t in dataset('TweetMessages')
where $t.send_time >= datetime('2011-06-18T14:10:17')
and
$t.send_time < datetime('2011-06-18T15:10:17')
return {
"tweet": $t.tweetid,
"similar-tweets": for $t2 in dataset('TweetMessages')
  let $sim := similarity-jaccard-check($t.referred_topics, 
$t2.referred_topics, 0.6f)
  where $sim[0] and
  $t2.tweetid != $t.tweetid
  return $t2.tweetid
}
{noformat}

{noformat}
distribute result [%0->$$11]
-- DISTRIBUTE_RESULT  |PARTITIONED|
  exchange
  -- ONE_TO_ONE_EXCHANGE  |PARTITIONED|
project ([$$11])
-- STREAM_PROJECT  |PARTITIONED|
  assign [$$11] <- [function-call: asterix:closed-record-constructor, 
Args:[AString: {tweet}, %0->$$33, AString: {similar-tweets}, %0->$$23]]
  -- ASSIGN  |PARTITIONED|
exchange
-- ONE_TO_ONE_EXCHANGE  |PARTITIONED|
  group by ([$$33 := %0->$$25]) decor ([]) {
aggregate [$$23] <- [function-call: asterix:listify, 
Args:[%0->$$26]]
-- AGGREGATE  |LOCAL|
  select (function-call: algebricks:not, 
Args:[function-call: algebricks:is-missing, Args:[%0->$$26]])
  -- STREAM_SELECT  |LOCAL|
nested tuple source
-- NESTED_TUPLE_SOURCE  |LOCAL|
 }
  -- PRE_CLUSTERED_GROUP_BY[$$25]  |PARTITIONED|
exchange
-- ONE_TO_ONE_EXCHANGE  |PARTITIONED|
  order (ASC, %0->$$25) 
  -- STABLE_SORT [$$25(ASC)]  |PARTITIONED|
exchange
-- HASH_PARTITION_EXCHANGE [$$25]  |PARTITIONED|
  project ([$$25, $$26])
  -- STREAM_PROJECT  |PARTITIONED|
exchange
-- ONE_TO_ONE_EXCHANGE  |PARTITIONED|
  join (function-call: algebricks:eq, Args:[%0->$$36, 
%0->$$25])
  -- HYBRID_HASH_JOIN [$$36][$$25]  |PARTITIONED|
exchange
-- ONE_TO_ONE_EXCHANGE  |PARTITIONED|
  project ([$$36])
  -- STREAM_PROJECT  |PARTITIONED|
select (function-call: algebricks:and, 
Args:[function-call: algebricks:ge, Args:[%0->$$24, ADateTime: { 
2011-06-18T14:10:17.000Z }], function-call: algebricks:lt, Args:[%0->$$24, 
ADateTime: { 2011-06-18T15:10:17.000Z }]])
-- STREAM_SELECT  |PARTITIONED|
  project ([$$36, $$24])
  -- STREAM_PROJECT  |PARTITIONED|
assign [$$24] <- [function-call: 
asterix:field-access-by-index, Args:[%0->$$0, AInt32: {3}]]
-- ASSIGN  |PARTITIONED|
  exchange
  -- ONE_TO_ONE_EXCHANGE  |PARTITIONED|
data-scan []<-[$$36, $$0] <- 
test:TweetMessages
-- DATASOURCE_SCAN  |PARTITIONED|
  exchange
  -- ONE_TO_ONE_EXCHANGE  |PARTITIONED|
empty-tuple-source
-- EMPTY_TUPLE_SOURCE  |PARTITIONED|
exchange
-- HASH_PARTITION_EXCHANGE [$$25]  |PARTITIONED|
  project ([$$25, $$26])
  -- STREAM_PROJECT  |PARTITIONED|
select (function-call: algebricks:and, 
Args:[function-call: algebricks:neq, Args:[%0->$$26, %0->$$25], function-call: 
asterix:get-item, Args:[function-call: asterix:similarity-jaccard-check, 
Args:[%0->$$29, function-call: asterix:field-access-by-index, Args:[%0->$$1, 
AInt32: {4}], AFloat: {0.6}], AInt64: {0}]])
-- STREAM_SELECT  |PARTITIONED|
  project ([$$1, $$25, $$26, $$29])
  -- STREAM_PROJECT  |PARTITIONED|
exchange
-- ONE_TO_ONE_EXCHANGE  |PARTITIONED|
  left-outer-unnest-map [$$26, $$1] <- 
function-call: asterix:index-search, Args:[AString: {TweetMessages}, AInt32: 
{0}, AString: {test}, AString:

Change in asterixdb[master]: ASTERIXDB-1081, ASTERIXDB-1086, ASTERIXDB-1246: proper multi...

2016-09-09 Thread Jenkins (Code Review)

Jenkins has posted comments on this change.

Change subject: ASTERIXDB-1081, ASTERIXDB-1086, ASTERIXDB-1246: proper multiple 
plan paths handling
..


Patch Set 9:

Integration Tests Started 
https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-integration-tests/605/

-- 
To view, visit https://asterix-gerrit.ics.uci.edu/1073
To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings

Gerrit-MessageType: comment
Gerrit-Change-Id: I69e055572f024f28a857d4e64916b4806e63c083
Gerrit-PatchSet: 9
Gerrit-Project: asterixdb
Gerrit-Branch: master
Gerrit-Owner: Taewoo Kim 
Gerrit-Reviewer: Jenkins 
Gerrit-Reviewer: Taewoo Kim 
Gerrit-Reviewer: Till Westmann 
Gerrit-Reviewer: Yingyi Bu 
Gerrit-HasComments: No

Change in asterixdb[master]: ASTERIXDB-1081, ASTERIXDB-1086, ASTERIXDB-1246: proper multi...

2016-09-09 Thread Jenkins (Code Review)

Jenkins has posted comments on this change.

Change subject: ASTERIXDB-1081, ASTERIXDB-1086, ASTERIXDB-1246: proper multiple 
plan paths handling
..


Patch Set 9:

WARNING: THIS CHANGE CONTAINS CROSS-PRODUCT CHANGES IN:
* asterixdb
* hyracks-fullstack

PLEASE REVIEW CAREFULLY AND LOOK FOR API CHANGES!

-- 
To view, visit https://asterix-gerrit.ics.uci.edu/1073
To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings

Gerrit-MessageType: comment
Gerrit-Change-Id: I69e055572f024f28a857d4e64916b4806e63c083
Gerrit-PatchSet: 9
Gerrit-Project: asterixdb
Gerrit-Branch: master
Gerrit-Owner: Taewoo Kim 
Gerrit-Reviewer: Jenkins 
Gerrit-Reviewer: Taewoo Kim 
Gerrit-Reviewer: Till Westmann 
Gerrit-Reviewer: Yingyi Bu 
Gerrit-HasComments: No

Change in asterixdb[master]: ASTERIXDB-1081, ASTERIXDB-1086, ASTERIXDB-1246: proper multi...

2016-09-09 Thread Jenkins (Code Review)

Jenkins has posted comments on this change.

Change subject: ASTERIXDB-1081, ASTERIXDB-1086, ASTERIXDB-1246: proper multiple 
plan paths handling
..


Patch Set 9:

Build Started 
https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-notopic/2581/

-- 
To view, visit https://asterix-gerrit.ics.uci.edu/1073
To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings

Gerrit-MessageType: comment
Gerrit-Change-Id: I69e055572f024f28a857d4e64916b4806e63c083
Gerrit-PatchSet: 9
Gerrit-Project: asterixdb
Gerrit-Branch: master
Gerrit-Owner: Taewoo Kim 
Gerrit-Reviewer: Jenkins 
Gerrit-Reviewer: Taewoo Kim 
Gerrit-Reviewer: Till Westmann 
Gerrit-Reviewer: Yingyi Bu 
Gerrit-HasComments: No

Change in asterixdb[master]: ASTERIXDB-1566, ASTERIXDB-1628: Fixed External Hash Group By...

2016-09-09 Thread Jenkins (Code Review)

Jenkins has posted comments on this change.

Change subject: ASTERIXDB-1566, ASTERIXDB-1628: Fixed External Hash Group By to 
conform to the memory budget
..


Patch Set 10:

WARNING: THIS CHANGE CONTAINS CROSS-PRODUCT CHANGES IN:
* asterixdb
* hyracks-fullstack

PLEASE REVIEW CAREFULLY AND LOOK FOR API CHANGES!

-- 
To view, visit https://asterix-gerrit.ics.uci.edu/1056
To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings

Gerrit-MessageType: comment
Gerrit-Change-Id: I2b323e9a2141b4c1dd1652a360d2d9354d3bc3f5
Gerrit-PatchSet: 10
Gerrit-Project: asterixdb
Gerrit-Branch: master
Gerrit-Owner: Taewoo Kim 
Gerrit-Reviewer: Jenkins 
Gerrit-Reviewer: Jianfeng Jia 
Gerrit-Reviewer: Michael Blow 
Gerrit-Reviewer: Taewoo Kim 
Gerrit-Reviewer: Till Westmann 
Gerrit-Reviewer: Wenhai Li 
Gerrit-Reviewer: Yingyi Bu 
Gerrit-HasComments: No

Change in asterixdb[master]: ASTERIXDB-1566, ASTERIXDB-1628: Fixed External Hash Group By...

2016-09-09 Thread Jenkins (Code Review)

Jenkins has posted comments on this change.

Change subject: ASTERIXDB-1566, ASTERIXDB-1628: Fixed External Hash Group By to 
conform to the memory budget
..


Patch Set 10:

Build Started 
https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-notopic/2580/

-- 
To view, visit https://asterix-gerrit.ics.uci.edu/1056
To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings

Gerrit-MessageType: comment
Gerrit-Change-Id: I2b323e9a2141b4c1dd1652a360d2d9354d3bc3f5
Gerrit-PatchSet: 10
Gerrit-Project: asterixdb
Gerrit-Branch: master
Gerrit-Owner: Taewoo Kim 
Gerrit-Reviewer: Jenkins 
Gerrit-Reviewer: Jianfeng Jia 
Gerrit-Reviewer: Michael Blow 
Gerrit-Reviewer: Taewoo Kim 
Gerrit-Reviewer: Till Westmann 
Gerrit-Reviewer: Wenhai Li 
Gerrit-Reviewer: Yingyi Bu 
Gerrit-HasComments: No

Change in asterixdb[master]: ASTERIXDB-1566, ASTERIXDB-1628: Fixed External Hash Group By...

2016-09-09 Thread Taewoo Kim (Code Review)

Hello Jenkins,

I'd like you to reexamine a change.  Please visit

https://asterix-gerrit.ics.uci.edu/1056

to look at the new patch set (#10).

Change subject: ASTERIXDB-1566, ASTERIXDB-1628: Fixed External Hash Group By to 
conform to the memory budget
..

ASTERIXDB-1566, ASTERIXDB-1628: Fixed External Hash Group By to conform to the 
memory budget

 - External Hash Group By now conforms to the memory budget 
(compiler.groupmemory)
 - Added one option in the configuration file that can sets the size of hash 
table
   for External Hash Group By operator.
 - The number of partitions for the external hash group by is now calculated 
properly
   for a corner case.

Change-Id: I2b323e9a2141b4c1dd1652a360d2d9354d3bc3f5
---
M 
asterixdb/asterix-app/src/main/java/org/apache/asterix/api/common/APIFramework.java
M asterixdb/asterix-app/src/main/resources/asterix-build-configuration.xml
M 
asterixdb/asterix-common/src/main/java/org/apache/asterix/common/config/AsterixCompilerProperties.java
M asterixdb/asterix-docker/docker/asterix-configuration.xml
M 
asterixdb/asterix-experiments/src/main/resources/ingestion-experiment-binary-and-configs/configs/asterix-configuration.xml
M asterixdb/asterix-installer/src/main/resources/conf/asterix-configuration.xml
M 
asterixdb/asterix-installer/src/test/resources/integrationts/asterix-configuration.xml
M asterixdb/asterix-yarn/src/main/resources/base-asterix-configuration.xml
M 
asterixdb/asterix-yarn/src/main/resources/configs/base-asterix-configuration.xml
M 
hyracks-fullstack/hyracks/hyracks-dataflow-std/src/main/java/org/apache/hyracks/dataflow/std/buffermanager/IPartitionedTupleBufferManager.java
M 
hyracks-fullstack/hyracks/hyracks-dataflow-std/src/main/java/org/apache/hyracks/dataflow/std/buffermanager/PreferToSpillFullyOccupiedFramePolicy.java
M 
hyracks-fullstack/hyracks/hyracks-dataflow-std/src/main/java/org/apache/hyracks/dataflow/std/buffermanager/VPartitionTupleBufferManager.java
M 
hyracks-fullstack/hyracks/hyracks-dataflow-std/src/main/java/org/apache/hyracks/dataflow/std/group/HashSpillableTableFactory.java
M 
hyracks-fullstack/hyracks/hyracks-dataflow-std/src/main/java/org/apache/hyracks/dataflow/std/group/ISpillableTable.java
M 
hyracks-fullstack/hyracks/hyracks-dataflow-std/src/main/java/org/apache/hyracks/dataflow/std/group/external/ExternalHashGroupBy.java
M 
hyracks-fullstack/hyracks/hyracks-dataflow-std/src/main/java/org/apache/hyracks/dataflow/std/structures/ISerializableTable.java
M 
hyracks-fullstack/hyracks/hyracks-dataflow-std/src/main/java/org/apache/hyracks/dataflow/std/structures/SerializableHashTable.java
M 
hyracks-fullstack/hyracks/hyracks-dataflow-std/src/test/java/org/apache/hyracks/dataflow/std/structures/SerializableHashTableTest.java
M 
hyracks-fullstack/hyracks/hyracks-examples/hyracks-integration-tests/src/test/java/org/apache/hyracks/tests/unit/AbstractExternalGroupbyTest.java
19 files changed, 887 insertions(+), 193 deletions(-)


  git pull ssh://asterix-gerrit.ics.uci.edu:29418/asterixdb 
refs/changes/56/1056/10
-- 
To view, visit https://asterix-gerrit.ics.uci.edu/1056
To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings

Gerrit-MessageType: newpatchset
Gerrit-Change-Id: I2b323e9a2141b4c1dd1652a360d2d9354d3bc3f5
Gerrit-PatchSet: 10
Gerrit-Project: asterixdb
Gerrit-Branch: master
Gerrit-Owner: Taewoo Kim 
Gerrit-Reviewer: Jenkins 
Gerrit-Reviewer: Jianfeng Jia 
Gerrit-Reviewer: Michael Blow 
Gerrit-Reviewer: Taewoo Kim 
Gerrit-Reviewer: Till Westmann 
Gerrit-Reviewer: Wenhai Li 
Gerrit-Reviewer: Yingyi Bu

Change in asterixdb[master]: Added BAD as an extension to Asterix

2016-09-09 Thread Jenkins (Code Review)

Jenkins has posted comments on this change.

Change subject: Added BAD as an extension to Asterix
..


Patch Set 3:

Build Started 
https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-notopic/2579/

-- 
To view, visit https://asterix-gerrit.ics.uci.edu/1150
To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings

Gerrit-MessageType: comment
Gerrit-Change-Id: I65789d2a861d15232dd29156a6987d0635ec6c94
Gerrit-PatchSet: 3
Gerrit-Project: asterixdb
Gerrit-Branch: master
Gerrit-Owner: Steven Jacobs 
Gerrit-Reviewer: Jenkins 
Gerrit-Reviewer: Till Westmann 
Gerrit-Reviewer: Yingyi Bu 
Gerrit-Reviewer: abdullah alamoudi 
Gerrit-HasComments: No

Change in asterixdb[master]: Added BAD as an extension to Asterix

2016-09-09 Thread Steven Jacobs (Code Review)

Hello Jenkins,

I'd like you to reexamine a change.  Please visit

https://asterix-gerrit.ics.uci.edu/1150

to look at the new patch set (#3).

Change subject: Added BAD as an extension to Asterix
..

Added BAD as an extension to Asterix

Users can create and delete repetitive channels
Users can subscribe to and unsubscribe from channels
Users can create and drop brokers
Added Channel Tests

Additional Changes:

Allow commits to be non-sink operators (contnue job pipeline after commit)

Enhanced Insert AQL
Added "return records" and "returning [fieldName]"
"return records" returns to the user all records that were inserted
"returning [fieldName]" returns only the valuse inserted for [fieldName]

Change-Id: I65789d2a861d15232dd29156a6987d0635ec6c94
---
M .gitignore
M asterixdb/asterix-active/pom.xml
M 
asterixdb/asterix-active/src/main/java/org/apache/asterix/active/IActiveEntityEventsListener.java
M 
asterixdb/asterix-algebra/src/main/java/org/apache/asterix/algebra/extension/IExtensionStatement.java
M 
asterixdb/asterix-algebra/src/main/java/org/apache/asterix/algebra/operators/CommitOperator.java
M 
asterixdb/asterix-algebra/src/main/java/org/apache/asterix/algebra/operators/physical/CommitPOperator.java
M 
asterixdb/asterix-algebra/src/main/java/org/apache/asterix/algebra/operators/physical/CommitRuntime.java
M 
asterixdb/asterix-algebra/src/main/java/org/apache/asterix/algebra/operators/physical/CommitRuntimeFactory.java
M 
asterixdb/asterix-algebra/src/main/java/org/apache/asterix/algebra/operators/physical/UpsertCommitRuntime.java
M 
asterixdb/asterix-algebra/src/main/java/org/apache/asterix/optimizer/base/RuleCollections.java
M 
asterixdb/asterix-algebra/src/main/java/org/apache/asterix/optimizer/rules/IntroduceDynamicTypeCastRule.java
M 
asterixdb/asterix-algebra/src/main/java/org/apache/asterix/optimizer/rules/IntroduceSecondaryIndexInsertDeleteRule.java
M 
asterixdb/asterix-algebra/src/main/java/org/apache/asterix/optimizer/rules/IntroduceStaticTypeCastForInsertRule.java
R 
asterixdb/asterix-algebra/src/main/java/org/apache/asterix/optimizer/rules/SetupCommitExtensionOpRule.java
M 
asterixdb/asterix-algebra/src/main/java/org/apache/asterix/optimizer/rules/UnnestToDataScanRule.java
M 
asterixdb/asterix-algebra/src/main/java/org/apache/asterix/optimizer/rules/am/AbstractIntroduceAccessMethodRule.java
M 
asterixdb/asterix-algebra/src/main/java/org/apache/asterix/optimizer/rules/am/AccessMethodUtils.java
M 
asterixdb/asterix-algebra/src/main/java/org/apache/asterix/optimizer/rules/am/BTreeAccessMethod.java
M 
asterixdb/asterix-algebra/src/main/java/org/apache/asterix/optimizer/rules/am/IOptimizableFuncExpr.java
M 
asterixdb/asterix-algebra/src/main/java/org/apache/asterix/optimizer/rules/am/OptimizableFuncExpr.java
M 
asterixdb/asterix-algebra/src/main/java/org/apache/asterix/optimizer/rules/am/OptimizableOperatorSubTree.java
M 
asterixdb/asterix-algebra/src/main/java/org/apache/asterix/translator/CompiledStatements.java
M 
asterixdb/asterix-algebra/src/main/java/org/apache/asterix/translator/LangExpressionToPlanTranslator.java
M 
asterixdb/asterix-app/src/main/java/org/apache/asterix/api/http/servlet/FeedServlet.java
M 
asterixdb/asterix-app/src/main/java/org/apache/asterix/app/translator/QueryTranslator.java
M 
asterixdb/asterix-app/src/test/java/org/apache/asterix/app/bootstrap/TestNodeController.java
M 
asterixdb/asterix-app/src/test/java/org/apache/asterix/test/optimizer/OptimizerTest.java
M 
asterixdb/asterix-app/src/test/java/org/apache/asterix/test/runtime/ExecutionTestUtil.java
A 
asterixdb/asterix-app/src/test/resources/runtimets/queries/dml/insert-return-records/insert-return-records.1.ddl.aql
A 
asterixdb/asterix-app/src/test/resources/runtimets/queries/dml/insert-return-records/insert-return-records.3.query.aql
A 
asterixdb/asterix-app/src/test/resources/runtimets/queries/dml/insert-returning-fieldname/insert-returning-fieldname.1.ddl.aql
A 
asterixdb/asterix-app/src/test/resources/runtimets/queries/dml/insert-returning-fieldname/insert-returning-fieldname.3.query.aql
A 
asterixdb/asterix-app/src/test/resources/runtimets/results/dml/insert-return-records/insert-return-records.1.adm
A 
asterixdb/asterix-app/src/test/resources/runtimets/results/dml/insert-returning-fieldname/insert-returning-fieldname.1.adm
M asterixdb/asterix-app/src/test/resources/runtimets/testsuite.xml
R 
asterixdb/asterix-external-data/src/main/java/org/apache/asterix/external/feed/api/IActiveLifecycleEventSubscriber.java
R 
asterixdb/asterix-external-data/src/main/java/org/apache/asterix/external/feed/management/ActiveLifecycleEventSubscriber.java
M 
asterixdb/asterix-external-data/src/main/java/org/apache/asterix/external/feed/management/FeedEventsListener.java
D 
asterixdb/asterix-external-data/src/main/java/org/apache/asterix/external/feed/watch/FeedActivity.java
A

[jira] [Closed] (ASTERIXDB-1635) Overlap-bins does not start at the correct bin for dates

2016-09-09 Thread Preston Carman (JIRA)


 [ 
https://issues.apache.org/jira/browse/ASTERIXDB-1635?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Preston Carman closed ASTERIXDB-1635.
-
Resolution: Fixed

Now in master.

> Overlap-bins does not start at the correct bin for dates
> 
>
> Key: ASTERIXDB-1635
> URL: https://issues.apache.org/jira/browse/ASTERIXDB-1635
> Project: Apache AsterixDB
>  Issue Type: Bug
>Reporter: Preston Carman
>Assignee: Preston Carman
>Priority: Minor
>
> Using the example on the documentation, I changed the date overlap-bins to 
> use 10 years. The change now produces the wrong result. The result starts 
> from 1970 instead of the correct year. 
> The issue is because the days are not converted to ms when picking the 
> starting bin.
> Sample query:
> {noformat}
> let $itv1 := interval(time("17:23:37"), time("18:30:21"))
> let $itv2 := interval(date("1984-03-17"), date("2013-08-22"))
> let $itv3 := interval(datetime("1800-01-01T23:59:48.938"), 
> datetime("2015-07-26T13:28:30.218"))
> return { "timebins": overlap-bins($itv1, time("00:00:00"), 
> day-time-duration("PT30M")),
>   "datebins": overlap-bins($itv2, date("1990-01-01"), 
> year-month-duration("P10Y")),
>   "datetimebins": overlap-bins($itv3, datetime("1900-01-01T00:00:00.000"), 
> year-month-duration("P100Y")) }
> {noformat}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Change in asterixdb[master]: ASTERIXDB-1608, ASTERIXDB-1617 Match user query for nonpure ...

2016-09-09 Thread Steven Jacobs (Code Review)

Steven Jacobs has posted comments on this change.

Change subject: ASTERIXDB-1608, ASTERIXDB-1617 Match user query for nonpure 
function calls
..


Patch Set 7:

(7 comments)

Hopefully I addressed at least some of the concerns. As I mentioned in email, 
there are some serious underlying issues with the access methods that make this 
change uglier than it needs to be. Maybe if you still have a lot of concerns, 
we can have a meeting to discuss?

https://asterix-gerrit.ics.uci.edu/#/c/1057/7/asterixdb/asterix-algebra/src/main/java/org/apache/asterix/optimizer/rules/PushFieldAccessRule.java
File 
asterixdb/asterix-algebra/src/main/java/org/apache/asterix/optimizer/rules/PushFieldAccessRule.java:

Line 187: Object annotation = op2.getAnnotations().get("isMovable");
> call OperatorPropertiesUtil.isMovable(op2) instead?
This is because I altered OperatorPropertiesUtil.isMovable to include a check 
on whether the operator is non pure. In the case of this rule however, it is 
okay to move the field access below the non pure call, since this doesn't alter 
the plan in a way that goes against the user's query. So we only specifically 
check whether the manual flag has been set.


https://asterix-gerrit.ics.uci.edu/#/c/1057/7/asterixdb/asterix-algebra/src/main/java/org/apache/asterix/optimizer/rules/am/AccessMethodUtils.java
File 
asterixdb/asterix-algebra/src/main/java/org/apache/asterix/optimizer/rules/am/AccessMethodUtils.java:

Line 314: if (optFuncExpr.getNumConstantExpr() == 0) {
> Can you explain a bit in the comments, why getNumConstantExpr() == 0 means 
I'll add this to the comments, but here is the summary:
probeSubTree == null tells us that we are doing a select and not a join. In 
this case, the expression will either have a constant expr to compare to, or it 
will have two variables, where one variable is a reference to a nonPure call 
(i.e. numConstantExpr == 0)


Line 370: return new Pair(optFuncExpr.getConstantExpr(0), false);
> please address this.
okay


https://asterix-gerrit.ics.uci.edu/#/c/1057/7/asterixdb/asterix-algebra/src/main/java/org/apache/asterix/optimizer/rules/am/BTreeAccessMethod.java
File 
asterixdb/asterix-algebra/src/main/java/org/apache/asterix/optimizer/rules/am/BTreeAccessMethod.java:

Line 728: if (optFuncExpr.getFieldType(0) == null || 
optFuncExpr.getFieldType(1) == null) {
> Comment why this is the non-pure case? I still couldn't understand the cond
The previous code alone was already not 100% accurate. It says:
"If my expression involved two variables, and there is an index nests-loop join 
hint, return true." 
It doesn't check whether it successfully found the source of one of the 
variables or not. I think this gets by because these checks are done elsewhere.


https://asterix-gerrit.ics.uci.edu/#/c/1057/7/asterixdb/asterix-algebra/src/main/java/org/apache/asterix/optimizer/rules/am/OptimizableOperatorSubTree.java
File 
asterixdb/asterix-algebra/src/main/java/org/apache/asterix/optimizer/rules/am/OptimizableOperatorSubTree.java:

Line 112: while ((subTreeOp.getOperatorTag() == 
LogicalOperatorTag.ASSIGN
> pls address those.
okay


https://asterix-gerrit.ics.uci.edu/#/c/1057/7/asterixdb/asterix-app/src/test/resources/optimizerts/queries/nonpure/maintain-nonpure-location-in-join-cannot-index.aql
File 
asterixdb/asterix-app/src/test/resources/optimizerts/queries/nonpure/maintain-nonpure-location-in-join-cannot-index.aql:

Line 39: return {
> Why this one cannot use index?
This query doesn't pick up the index currently. I think it would be possible to 
do, but I never looked at optimizing the join case. It seems like an edge case 
to me. If this query were really desirable, it could be written in a way that 
makes sense logically and does use the index with my change, e.g.
BETTER QUERY1:
let $time := current-time()-time("123045678+0800")
for $y in dataset Users2
where $y.stamp > $time
for $x in dataset Users1
return {
   "x_id": $x.id,
   "y_id": $y.id
}

I can try with /*+ indexnl */ to see if it changes anything


https://asterix-gerrit.ics.uci.edu/#/c/1057/7/asterixdb/asterix-app/src/test/resources/optimizerts/results/query_issue849.plan
File 
asterixdb/asterix-app/src/test/resources/optimizerts/results/query_issue849.plan:

Line 28:   -- UNNEST  |UNPARTITIONED|
> ASTERIXDB-1368 is still open. But it seems your queries are able to use ind
I wasn't aware of 1368. I'd have to know more about the underlying issues to 
know for sure whether it is fixed or not.


-- 
To view, visit https://asterix-gerrit.ics.uci.edu/1057
To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings

Gerrit-MessageType: comment
Gerrit-Change-Id: I2dec322b30835625430c06acd7626d902bada137
Gerrit-PatchSet: 7
Gerrit-Project: asterixdb
Gerrit-Branch: master
Gerrit-Owner: Steven Jacobs 
Gerrit-Reviewer:

[jira] [Comment Edited] (ASTERIXDB-1636) Feed cannot re-ingest after cluster restart

2016-09-09 Thread Xikui Wang (JIRA)


[ 
https://issues.apache.org/jira/browse/ASTERIXDB-1636?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15477625#comment-15477625
 ] 

Xikui Wang edited comment on ASTERIXDB-1636 at 9/9/16 5:14 PM:
---

I got the log from Jianfeng. It seems the exception is raised after the record 
is parsed. Probably related to storage layer.

{quote}
org.apache.hyracks.api.exceptions.HyracksDataException: 3
at 
org.apache.asterix.common.dataflow.AsterixLSMInsertDeleteOperatorNodePushable.nextFrame(AsterixLSMInsertDeleteOperatorNodePushable.java:152)
at 
org.apache.hyracks.dataflow.common.comm.io.AbstractFrameAppender.write(AbstractFrameAppender.java:92)
at 
org.apache.hyracks.algebricks.runtime.operators.base.AbstractOneInputOneOutputOneFramePushRuntime.flushAndReset(AbstractOneInputOneOutputOneFramePushRuntime.java:63)
at 
org.apache.hyracks.algebricks.runtime.operators.base.AbstractOneInputOneOutputOneFramePushRuntime.appendProjectionToFrame(AbstractOneInputOneOutputOneFramePushRuntime.java:97)
at 
org.apache.hyracks.algebricks.runtime.operators.std.StreamProjectRuntimeFactory$1.nextFrame(StreamProjectRuntimeFactory.java:83)
at 
org.apache.hyracks.dataflow.common.comm.io.AbstractFrameAppender.write(AbstractFrameAppender.java:92)
at 
org.apache.hyracks.algebricks.runtime.operators.base.AbstractOneInputOneOutputOneFramePushRuntime.flushAndReset(AbstractOneInputOneOutputOneFramePushRuntime.java:63)
at 
org.apache.hyracks.algebricks.runtime.operators.base.AbstractOneInputOneOutputOneFramePushRuntime.appendToFrameFromTupleBuilder(AbstractOneInputOneOutputOneFramePushRuntime.java:85)
at 
org.apache.hyracks.algebricks.runtime.operators.std.AssignRuntimeFactory$1.nextFrame(AssignRuntimeFactory.java:154)
at 
org.apache.hyracks.algebricks.runtime.operators.meta.AlgebricksMetaOperatorDescriptor$2.nextFrame(AlgebricksMetaOperatorDescriptor.java:148)
at 
org.apache.hyracks.dataflow.common.comm.util.FrameUtils.flushFrame(FrameUtils.java:45)
at 
org.apache.asterix.common.dataflow.AsterixLSMInsertDeleteOperatorNodePushable.nextFrame(AsterixLSMInsertDeleteOperatorNodePushable.java:160)
at 
org.apache.asterix.external.feed.dataflow.SyncFeedRuntimeInputHandler.nextFrame(SyncFeedRuntimeInputHandler.java:46)
at 
org.apache.asterix.external.operators.FeedMetaStoreNodePushable.nextFrame(FeedMetaStoreNodePushable.java:145)
at org.apache.hyracks.control.nc.Task.pushFrames(Task.java:349)
at org.apache.hyracks.control.nc.Task.run(Task.java:297)
at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:744)
Caused by: java.lang.ArrayIndexOutOfBoundsException: 3
at 
org.apache.hyracks.storage.am.common.tuples.PermutingFrameTupleReference.getFieldLength(PermutingFrameTupleReference.java:56)
at 
org.apache.hyracks.storage.am.common.tuples.PermutingTupleReference.getFieldLength(PermutingTupleReference.java:54)
at 
org.apache.hyracks.storage.am.common.tuples.TypeAwareTupleWriter.bytesRequired(TypeAwareTupleWriter.java:43)
at 
org.apache.hyracks.storage.am.lsm.common.impls.LSMComponentFilter.update(LSMComponentFilter.java:68)
at 
org.apache.hyracks.storage.am.lsm.invertedindex.impls.LSMInvertedIndex.modify(LSMInvertedIndex.java:367)
at 
org.apache.hyracks.storage.am.lsm.common.impls.LSMHarness.modify(LSMHarness.java:376)
at 
org.apache.hyracks.storage.am.lsm.common.impls.LSMHarness.forceModify(LSMHarness.java:356)
at 
org.apache.hyracks.storage.am.lsm.invertedindex.impls.LSMInvertedIndexAccessor.forceInsert(LSMInvertedIndexAccessor.java:143)
at 
org.apache.asterix.common.dataflow.AsterixLSMInsertDeleteOperatorNodePushable.nextFrame(AsterixLSMInsertDeleteOperatorNodePushable.java:128)
... 18 more
{quote}


was (Author: idleft):
I got the log from Jianfeng. It seems the exception is raised after the record 
is parsed. Probably related to ASTERIXDB-1616

{quote}
org.apache.hyracks.api.exceptions.HyracksDataException: 3
at 
org.apache.asterix.common.dataflow.AsterixLSMInsertDeleteOperatorNodePushable.nextFrame(AsterixLSMInsertDeleteOperatorNodePushable.java:152)
at 
org.apache.hyracks.dataflow.common.comm.io.AbstractFrameAppender.write(AbstractFrameAppender.java:92)
at 
org.apache.hyracks.algebricks.runtime.operators.base.AbstractOneInputOneOutputOneFramePushRuntime.flushAndReset(AbstractOneInputOneOutputOneFramePushRuntime.java:63)
at 
org.apache.hyracks.algebricks.runtime.operators.base.AbstractOneInputOneOutputOneFramePushRuntime.appendProjectionToFrame(AbstractOneInputOneOutputOneFramePushRuntime.java:97)
at 
org.apache.hyracks.algebricks.runtime.operators.std.StreamProjectRuntimeFactory$1.nextFrame(StreamProjectRuntimeFactory.java:83)
at

[jira] [Commented] (ASTERIXDB-1636) Feed cannot re-ingest after cluster restart

2016-09-09 Thread Xikui Wang (JIRA)


[ 
https://issues.apache.org/jira/browse/ASTERIXDB-1636?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15477625#comment-15477625
 ] 

Xikui Wang commented on ASTERIXDB-1636:
---

I got the log from Jianfeng. It seems the exception is raised after the record 
is parsed. Probably related to ASTERIXDB-1616

{quote}
org.apache.hyracks.api.exceptions.HyracksDataException: 3
at 
org.apache.asterix.common.dataflow.AsterixLSMInsertDeleteOperatorNodePushable.nextFrame(AsterixLSMInsertDeleteOperatorNodePushable.java:152)
at 
org.apache.hyracks.dataflow.common.comm.io.AbstractFrameAppender.write(AbstractFrameAppender.java:92)
at 
org.apache.hyracks.algebricks.runtime.operators.base.AbstractOneInputOneOutputOneFramePushRuntime.flushAndReset(AbstractOneInputOneOutputOneFramePushRuntime.java:63)
at 
org.apache.hyracks.algebricks.runtime.operators.base.AbstractOneInputOneOutputOneFramePushRuntime.appendProjectionToFrame(AbstractOneInputOneOutputOneFramePushRuntime.java:97)
at 
org.apache.hyracks.algebricks.runtime.operators.std.StreamProjectRuntimeFactory$1.nextFrame(StreamProjectRuntimeFactory.java:83)
at 
org.apache.hyracks.dataflow.common.comm.io.AbstractFrameAppender.write(AbstractFrameAppender.java:92)
at 
org.apache.hyracks.algebricks.runtime.operators.base.AbstractOneInputOneOutputOneFramePushRuntime.flushAndReset(AbstractOneInputOneOutputOneFramePushRuntime.java:63)
at 
org.apache.hyracks.algebricks.runtime.operators.base.AbstractOneInputOneOutputOneFramePushRuntime.appendToFrameFromTupleBuilder(AbstractOneInputOneOutputOneFramePushRuntime.java:85)
at 
org.apache.hyracks.algebricks.runtime.operators.std.AssignRuntimeFactory$1.nextFrame(AssignRuntimeFactory.java:154)
at 
org.apache.hyracks.algebricks.runtime.operators.meta.AlgebricksMetaOperatorDescriptor$2.nextFrame(AlgebricksMetaOperatorDescriptor.java:148)
at 
org.apache.hyracks.dataflow.common.comm.util.FrameUtils.flushFrame(FrameUtils.java:45)
at 
org.apache.asterix.common.dataflow.AsterixLSMInsertDeleteOperatorNodePushable.nextFrame(AsterixLSMInsertDeleteOperatorNodePushable.java:160)
at 
org.apache.asterix.external.feed.dataflow.SyncFeedRuntimeInputHandler.nextFrame(SyncFeedRuntimeInputHandler.java:46)
at 
org.apache.asterix.external.operators.FeedMetaStoreNodePushable.nextFrame(FeedMetaStoreNodePushable.java:145)
at org.apache.hyracks.control.nc.Task.pushFrames(Task.java:349)
at org.apache.hyracks.control.nc.Task.run(Task.java:297)
at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:744)
Caused by: java.lang.ArrayIndexOutOfBoundsException: 3
at 
org.apache.hyracks.storage.am.common.tuples.PermutingFrameTupleReference.getFieldLength(PermutingFrameTupleReference.java:56)
at 
org.apache.hyracks.storage.am.common.tuples.PermutingTupleReference.getFieldLength(PermutingTupleReference.java:54)
at 
org.apache.hyracks.storage.am.common.tuples.TypeAwareTupleWriter.bytesRequired(TypeAwareTupleWriter.java:43)
at 
org.apache.hyracks.storage.am.lsm.common.impls.LSMComponentFilter.update(LSMComponentFilter.java:68)
at 
org.apache.hyracks.storage.am.lsm.invertedindex.impls.LSMInvertedIndex.modify(LSMInvertedIndex.java:367)
at 
org.apache.hyracks.storage.am.lsm.common.impls.LSMHarness.modify(LSMHarness.java:376)
at 
org.apache.hyracks.storage.am.lsm.common.impls.LSMHarness.forceModify(LSMHarness.java:356)
at 
org.apache.hyracks.storage.am.lsm.invertedindex.impls.LSMInvertedIndexAccessor.forceInsert(LSMInvertedIndexAccessor.java:143)
at 
org.apache.asterix.common.dataflow.AsterixLSMInsertDeleteOperatorNodePushable.nextFrame(AsterixLSMInsertDeleteOperatorNodePushable.java:128)
... 18 more
{quote}

> Feed cannot re-ingest after cluster restart
> ---
>
> Key: ASTERIXDB-1636
> URL: https://issues.apache.org/jira/browse/ASTERIXDB-1636
> Project: Apache AsterixDB
>  Issue Type: Bug
>  Components: Feeds, Storage
> Environment: master
> commit c89d668f68e5430a6ba4455daf8f9cd6f7040dd8
> Date:   Tue Sep 6 18:29:23 2016 -0700
>Reporter: Jianfeng Jia
>Assignee: Abdullah Alamoudi
>Priority: Blocker
>  Labels: soon
>
> Here are steps to reproduce the problem:
> 1. start the cluster
> 2. ingest the initial data using file feed 
> [script|https://gist.github.com/JavierJia/9ed7744c938c5cb66aba63007b86a987]
> 2.1: file for ingestion: 
> https://drive.google.com/open?id=0B423M7wGZj9dNE5HenFqcjhuUFk
> 3. start another socket feed 
> [script|https://gist.github.com/JavierJia/565cefd9322df35c7abeefbfcfcee9f8] 
> to ingest the live data  
> 4. restart the cluster
> 5. start that live socket feed again.
> 6. with your

Change in asterixdb[master]: AsterixDB Schema Inferencer

2016-09-09 Thread Jenkins (Code Review)

Jenkins has posted comments on this change.

Change subject: AsterixDB Schema Inferencer
..


Patch Set 6: Integration-Tests+1

Integration Tests Successful

https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-integration-tests/604/ : 
SUCCESS

-- 
To view, visit https://asterix-gerrit.ics.uci.edu/1003
To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings

Gerrit-MessageType: comment
Gerrit-Change-Id: Ia6077216ba457a182e8034ed47536fc5f4dcb639
Gerrit-PatchSet: 6
Gerrit-Project: asterixdb
Gerrit-Branch: master
Gerrit-Owner: Wail Alkowaileet 
Gerrit-Reviewer: Jenkins 
Gerrit-HasComments: No

Change in asterixdb[master]: ASTERIXDB-1081, ASTERIXDB-1086, ASTERIXDB-1246: proper multi...

2016-09-09 Thread Jenkins (Code Review)

Jenkins has posted comments on this change.

Change subject: ASTERIXDB-1081, ASTERIXDB-1086, ASTERIXDB-1246: proper multiple 
plan paths handling
..


Patch Set 8:

Build Started 
https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-notopic/2578/

-- 
To view, visit https://asterix-gerrit.ics.uci.edu/1073
To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings

Gerrit-MessageType: comment
Gerrit-Change-Id: I69e055572f024f28a857d4e64916b4806e63c083
Gerrit-PatchSet: 8
Gerrit-Project: asterixdb
Gerrit-Branch: master
Gerrit-Owner: Taewoo Kim 
Gerrit-Reviewer: Jenkins 
Gerrit-Reviewer: Taewoo Kim 
Gerrit-Reviewer: Till Westmann 
Gerrit-Reviewer: Yingyi Bu 
Gerrit-HasComments: No

[jira] [Commented] (ASTERIXDB-1635) Overlap-bins does not start at the correct bin for dates

2016-09-09 Thread ASF subversion and git services (JIRA)


[ 
https://issues.apache.org/jira/browse/ASTERIXDB-1635?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15477531#comment-15477531
 ] 

ASF subversion and git services commented on ASTERIXDB-1635:


Commit 2a73f411264b282aefed51fa35322187f892d707 in asterixdb's branch 
refs/heads/master from [~prestonc]
[ https://git-wip-us.apache.org/repos/asf?p=asterixdb.git;h=2a73f41 ]

ASTERIXDB-1635 Fix for overlap-bins start for dates.

The fix involves two code changes and several sonar fixes.
The code changes are the following:
 - DurationArithmeticOperations line 75:
When the month was zero, an index out of bound error occured in line 88 or 
92.
The month value should be between 1 and 12.
 - OverlapBinsDescriptor line 170:
The Gregorian Calendar is expecting a value in ms. When a date value comes 
in,
AsterixDB represents the value as the number of days from epoc. So the year
for a date basically allways translated to 1970. In lines 121, a condition
was added to check if the interval was a date, if so, convert the date to
ms.

Change-Id: I24122a84ef9edda4b05260af881c430177f1dc86
Reviewed-on: https://asterix-gerrit.ics.uci.edu/1151
Tested-by: Jenkins 
Integration-Tests: Jenkins 
Reviewed-by: Steven Jacobs 


> Overlap-bins does not start at the correct bin for dates
> 
>
> Key: ASTERIXDB-1635
> URL: https://issues.apache.org/jira/browse/ASTERIXDB-1635
> Project: Apache AsterixDB
>  Issue Type: Bug
>Reporter: Preston Carman
>Assignee: Preston Carman
>Priority: Minor
>
> Using the example on the documentation, I changed the date overlap-bins to 
> use 10 years. The change now produces the wrong result. The result starts 
> from 1970 instead of the correct year. 
> The issue is because the days are not converted to ms when picking the 
> starting bin.
> Sample query:
> {noformat}
> let $itv1 := interval(time("17:23:37"), time("18:30:21"))
> let $itv2 := interval(date("1984-03-17"), date("2013-08-22"))
> let $itv3 := interval(datetime("1800-01-01T23:59:48.938"), 
> datetime("2015-07-26T13:28:30.218"))
> return { "timebins": overlap-bins($itv1, time("00:00:00"), 
> day-time-duration("PT30M")),
>   "datebins": overlap-bins($itv2, date("1990-01-01"), 
> year-month-duration("P10Y")),
>   "datetimebins": overlap-bins($itv3, datetime("1900-01-01T00:00:00.000"), 
> year-month-duration("P100Y")) }
> {noformat}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Change in asterixdb[master]: ASTERIXDB-1487: fix the wrong plan for inverted fuzzyjoin.

2016-09-09 Thread Taewoo Kim (Code Review)

Taewoo Kim has posted comments on this change.

Change subject: ASTERIXDB-1487: fix the wrong plan for inverted fuzzyjoin.
..


Patch Set 10:

(1 comment)

https://asterix-gerrit.ics.uci.edu/#/c/1119/10/asterixdb/asterix-algebra/src/main/java/org/apache/asterix/optimizer/rules/RemoveUnusedOneToOneEquiJoinRule.java
File 
asterixdb/asterix-algebra/src/main/java/org/apache/asterix/optimizer/rules/RemoveUnusedOneToOneEquiJoinRule.java:

Line 208: || 
op.getOperatorTag().equals(LogicalOperatorTag.LEFT_OUTER_UNNEST_MAP)) {
Two if conditions can be the same check - either equals or ==. Please unify 
them.


-- 
To view, visit https://asterix-gerrit.ics.uci.edu/1119
To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings

Gerrit-MessageType: comment
Gerrit-Change-Id: I1aef69a2278853fd9f8020da6639331b367ed5ad
Gerrit-PatchSet: 10
Gerrit-Project: asterixdb
Gerrit-Branch: master
Gerrit-Owner: Wenhai Li 
Gerrit-Reviewer: Chen Li 
Gerrit-Reviewer: Jenkins 
Gerrit-Reviewer: Jianfeng Jia 
Gerrit-Reviewer: Taewoo Kim 
Gerrit-Reviewer: Till Westmann 
Gerrit-Reviewer: Wenhai Li 
Gerrit-Reviewer: Yingyi Bu 
Gerrit-Reviewer: Yingyi Bu 
Gerrit-HasComments: Yes

Change in asterixdb[master]: ASTERIXDB-1608, ASTERIXDB-1617 Match user query for nonpure ...

2016-09-09 Thread Yingyi Bu (Code Review)

Yingyi Bu has posted comments on this change.

Change subject: ASTERIXDB-1608, ASTERIXDB-1617 Match user query for nonpure 
function calls
..


Patch Set 7:

(7 comments)

https://asterix-gerrit.ics.uci.edu/#/c/1057/7/asterixdb/asterix-algebra/src/main/java/org/apache/asterix/optimizer/rules/PushFieldAccessRule.java
File 
asterixdb/asterix-algebra/src/main/java/org/apache/asterix/optimizer/rules/PushFieldAccessRule.java:

Line 187: Object annotation = op2.getAnnotations().get("isMovable");
call OperatorPropertiesUtil.isMovable(op2) instead?


https://asterix-gerrit.ics.uci.edu/#/c/1057/7/asterixdb/asterix-algebra/src/main/java/org/apache/asterix/optimizer/rules/am/AccessMethodUtils.java
File 
asterixdb/asterix-algebra/src/main/java/org/apache/asterix/optimizer/rules/am/AccessMethodUtils.java:

Line 314: if (optFuncExpr.getNumConstantExpr() == 0) {
Can you explain a bit in the comments, why getNumConstantExpr() == 0 means a 
non-pure function.


Line 370: return new Pair(optFuncExpr.getConstantExpr(0), false);
> MAJOR SonarQube violation:
please address this.


https://asterix-gerrit.ics.uci.edu/#/c/1057/7/asterixdb/asterix-algebra/src/main/java/org/apache/asterix/optimizer/rules/am/BTreeAccessMethod.java
File 
asterixdb/asterix-algebra/src/main/java/org/apache/asterix/optimizer/rules/am/BTreeAccessMethod.java:

Line 728: if (optFuncExpr.getFieldType(0) == null || 
optFuncExpr.getFieldType(1) == null) {
Comment why this is the non-pure case? I still couldn't understand the 
condition.
Again, this condition has to be 100% accurate -- no false positives and no 
false dismissals. Otherwise it might cause new bugs for other queries.


https://asterix-gerrit.ics.uci.edu/#/c/1057/7/asterixdb/asterix-algebra/src/main/java/org/apache/asterix/optimizer/rules/am/OptimizableOperatorSubTree.java
File 
asterixdb/asterix-algebra/src/main/java/org/apache/asterix/optimizer/rules/am/OptimizableOperatorSubTree.java:

Line 112: while ((subTreeOp.getOperatorTag() == 
LogicalOperatorTag.ASSIGN
> MAJOR SonarQube violation:
pls address those.


https://asterix-gerrit.ics.uci.edu/#/c/1057/7/asterixdb/asterix-app/src/test/resources/optimizerts/queries/nonpure/maintain-nonpure-location-in-join-cannot-index.aql
File 
asterixdb/asterix-app/src/test/resources/optimizerts/queries/nonpure/maintain-nonpure-location-in-join-cannot-index.aql:

Line 39: return {
Why this one cannot use index?
Would it use the index of User2 if you say /*+ indexnl */ ?


https://asterix-gerrit.ics.uci.edu/#/c/1057/7/asterixdb/asterix-app/src/test/resources/optimizerts/results/query_issue849.plan
File 
asterixdb/asterix-app/src/test/resources/optimizerts/results/query_issue849.plan:

Line 28:   -- UNNEST  |UNPARTITIONED|
ASTERIXDB-1368 is still open. But it seems your queries are able to use index 
joins even without hints.  Did you fix ASTERIXDB-1368 as well?


-- 
To view, visit https://asterix-gerrit.ics.uci.edu/1057
To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings

Gerrit-MessageType: comment
Gerrit-Change-Id: I2dec322b30835625430c06acd7626d902bada137
Gerrit-PatchSet: 7
Gerrit-Project: asterixdb
Gerrit-Branch: master
Gerrit-Owner: Steven Jacobs 
Gerrit-Reviewer: Jenkins 
Gerrit-Reviewer: Michael Blow 
Gerrit-Reviewer: Preston Carman 
Gerrit-Reviewer: Steven Jacobs 
Gerrit-Reviewer: Yingyi Bu 
Gerrit-HasComments: Yes

Change in asterixdb[master]: AsterixDB Schema Inferencer

2016-09-09 Thread Jenkins (Code Review)

Jenkins has posted comments on this change.

Change subject: AsterixDB Schema Inferencer
..


Patch Set 6:

Integration Tests Started 
https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-integration-tests/604/

-- 
To view, visit https://asterix-gerrit.ics.uci.edu/1003
To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings

Gerrit-MessageType: comment
Gerrit-Change-Id: Ia6077216ba457a182e8034ed47536fc5f4dcb639
Gerrit-PatchSet: 6
Gerrit-Project: asterixdb
Gerrit-Branch: master
Gerrit-Owner: Wail Alkowaileet 
Gerrit-Reviewer: Jenkins 
Gerrit-HasComments: No

Change in asterixdb[master]: ASTERIXDB-1635 Fix for overlap-bins start for dates.

2016-09-09 Thread Steven Jacobs (Code Review)

Steven Jacobs has posted comments on this change.

Change subject: ASTERIXDB-1635 Fix for overlap-bins start for dates.
..


Patch Set 2: Code-Review+2

-- 
To view, visit https://asterix-gerrit.ics.uci.edu/1151
To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings

Gerrit-MessageType: comment
Gerrit-Change-Id: I24122a84ef9edda4b05260af881c430177f1dc86
Gerrit-PatchSet: 2
Gerrit-Project: asterixdb
Gerrit-Branch: master
Gerrit-Owner: Preston Carman 
Gerrit-Reviewer: Jenkins 
Gerrit-Reviewer: Steven Jacobs 
Gerrit-Reviewer: Till Westmann 
Gerrit-HasComments: No

Change in asterixdb[master]: AsterixDB Schema Inferencer

2016-09-09 Thread Jenkins (Code Review)

Jenkins has posted comments on this change.

Change subject: AsterixDB Schema Inferencer
..


Patch Set 6:

Build Started 
https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-notopic/2577/

-- 
To view, visit https://asterix-gerrit.ics.uci.edu/1003
To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings

Gerrit-MessageType: comment
Gerrit-Change-Id: Ia6077216ba457a182e8034ed47536fc5f4dcb639
Gerrit-PatchSet: 6
Gerrit-Project: asterixdb
Gerrit-Branch: master
Gerrit-Owner: Wail Alkowaileet 
Gerrit-Reviewer: Jenkins 
Gerrit-HasComments: No

Change in asterixdb[master]: ASTERIXDB-1572 and ASTERIXDB-1591: fix and regression tests.

2016-09-09 Thread Jenkins (Code Review)

Jenkins has posted comments on this change.

Change subject: ASTERIXDB-1572 and ASTERIXDB-1591: fix and regression tests.
..


Patch Set 2: Integration-Tests+1

Integration Tests Successful

https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-integration-tests/603/ : 
SUCCESS

-- 
To view, visit https://asterix-gerrit.ics.uci.edu/1158
To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings

Gerrit-MessageType: comment
Gerrit-Change-Id: Ie38c51ab25e313f9dca3312c33b92e3bdb187420
Gerrit-PatchSet: 2
Gerrit-Project: asterixdb
Gerrit-Branch: master
Gerrit-Owner: Yingyi Bu 
Gerrit-Reviewer: Jenkins 
Gerrit-HasComments: No

Change in asterixdb[master]: Add HTTP API to Collect Threaddumps From NCs

2016-09-09 Thread Jenkins (Code Review)

Jenkins has posted comments on this change.

Change subject: Add HTTP API to Collect Threaddumps From NCs
..


Patch Set 2: Integration-Tests+1

Integration Tests Successful

https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-integration-tests/602/ : 
SUCCESS

-- 
To view, visit https://asterix-gerrit.ics.uci.edu/1159
To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings

Gerrit-MessageType: comment
Gerrit-Change-Id: I536606a1fbc394c6c70bb8ce14791cc411691617
Gerrit-PatchSet: 2
Gerrit-Project: asterixdb
Gerrit-Branch: master
Gerrit-Owner: Michael Blow 
Gerrit-Reviewer: Jenkins 
Gerrit-Reviewer: Till Westmann 
Gerrit-HasComments: No

Change in asterixdb[master]: ASTERIXDB-1572 and ASTERIXDB-1591: fix and regression tests.

2016-09-09 Thread Jenkins (Code Review)

Jenkins has posted comments on this change.

Change subject: ASTERIXDB-1572 and ASTERIXDB-1591: fix and regression tests.
..


Patch Set 2:

Integration Tests Started 
https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-integration-tests/603/

-- 
To view, visit https://asterix-gerrit.ics.uci.edu/1158
To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings

Gerrit-MessageType: comment
Gerrit-Change-Id: Ie38c51ab25e313f9dca3312c33b92e3bdb187420
Gerrit-PatchSet: 2
Gerrit-Project: asterixdb
Gerrit-Branch: master
Gerrit-Owner: Yingyi Bu 
Gerrit-Reviewer: Jenkins 
Gerrit-HasComments: No

[jira] [Closed] (ASTERIXDB-1628) The number of partitions in External Hash-Groupby is calculated improperly for smaller data size.

2016-09-09 Thread Taewoo Kim (JIRA)


 [ 
https://issues.apache.org/jira/browse/ASTERIXDB-1628?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Taewoo Kim closed ASTERIXDB-1628.
-
Resolution: Fixed

> The number of partitions in External Hash-Groupby is calculated improperly 
> for smaller data size.
> -
>
> Key: ASTERIXDB-1628
> URL: https://issues.apache.org/jira/browse/ASTERIXDB-1628
> Project: Apache AsterixDB
>  Issue Type: Bug
>Reporter: Taewoo Kim
>Assignee: Taewoo Kim
>  Labels: soon
>
> If the number of frames required for a data (e.g., external file), say A,  is 
> slightly larger than the number of available frames (= memory budget), say B, 
> then the number of partitions may be calculated as 1 and it will cause the 
> infinite cycles during the merge phase.
> If the number of partition is 1, the current code assumes that there is no 
> spilling due to the out of memory budget and the output of the build phase is 
> directly generated as the final output. 
> But, if A > B, then a spill would happen and once a partition is spilled to 
> the disk, it can't be generated as the final output. So, the merge process 
> goes to the next round that just creates only one partition again and tries 
> to generate some as final output. But, it can't. Thus, an infinite cycle 
> begins.
> The resolution is that if A > B, we should not set the number of partition as 
> one.   



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (ASTERIXDB-1616) NPE when printing record inside open type with unicode fields

2016-09-09 Thread Ian Maxon (JIRA)


[ 
https://issues.apache.org/jira/browse/ASTERIXDB-1616?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15476208#comment-15476208
 ] 

Ian Maxon commented on ASTERIXDB-1616:
--

I have where it should be happening in ADMDataParser isolated now, but I am 
still digging. Nothing is seeming obviously wrong with how the record is 
written just yet. There is more than one tweet ID that will cause this, but I 
am looking at 662781883844030464. 

> NPE when printing record inside open type with unicode fields
> -
>
> Key: ASTERIXDB-1616
> URL: https://issues.apache.org/jira/browse/ASTERIXDB-1616
> Project: Apache AsterixDB
>  Issue Type: Bug
>Reporter: Ian Maxon
>Assignee: Ian Maxon
>
> DDL: 
> https://github.com/kevincoakley/asterixdb_tests/blob/master/notebooks/asterixdb-spark/Count%20one_percent%20Tweets%20Spark%20Single.ipynb
> Data: 
> https://object.cloud.sdsc.edu/v1/AUTH_kcoakley/asterixdblogs/2015_11_07_00_onepercent.txt
> Basically just a scan+limit on the one_percent dataset will give 
> IndexOutOfBounds. 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (ASTERIXDB-1628) The number of partitions in External Hash-Groupby is calculated improperly for smaller data size.

2016-09-09 Thread ASF subversion and git services (JIRA)


[ 
https://issues.apache.org/jira/browse/ASTERIXDB-1628?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15476210#comment-15476210
 ] 

ASF subversion and git services commented on ASTERIXDB-1628:


Commit b0dc27e8dfb8a0cc909874fe1bbaaffa97ddfc29 in asterixdb's branch 
refs/heads/master from [~wangsaeu]
[ https://git-wip-us.apache.org/repos/asf?p=asterixdb.git;h=b0dc27e ]

ASTERIXDB-1628: Fixed an issue in External Hash Group by

 - The number of partitions in External Hash Group By is now
   properly calculated by considering a corner case.

Change-Id: I8901d2b64659fb0d2b97d73f45a9fe113232e860
Reviewed-on: https://asterix-gerrit.ics.uci.edu/1144
Tested-by: Jenkins 
Integration-Tests: Jenkins 
Reviewed-by: Taewoo Kim 


> The number of partitions in External Hash-Groupby is calculated improperly 
> for smaller data size.
> -
>
> Key: ASTERIXDB-1628
> URL: https://issues.apache.org/jira/browse/ASTERIXDB-1628
> Project: Apache AsterixDB
>  Issue Type: Bug
>Reporter: Taewoo Kim
>Assignee: Taewoo Kim
>  Labels: soon
>
> If the number of frames required for a data (e.g., external file), say A,  is 
> slightly larger than the number of available frames (= memory budget), say B, 
> then the number of partitions may be calculated as 1 and it will cause the 
> infinite cycles during the merge phase.
> If the number of partition is 1, the current code assumes that there is no 
> spilling due to the out of memory budget and the output of the build phase is 
> directly generated as the final output. 
> But, if A > B, then a spill would happen and once a partition is spilled to 
> the disk, it can't be generated as the final output. So, the merge process 
> goes to the next round that just creates only one partition again and tries 
> to generate some as final output. But, it can't. Thus, an infinite cycle 
> begins.
> The resolution is that if A > B, we should not set the number of partition as 
> one.   



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Change in asterixdb[master]: ASTERIXDB-1628: Fixed an issue in External Hash Group by

2016-09-09 Thread Taewoo Kim (Code Review)

Taewoo Kim has posted comments on this change.

Change subject: ASTERIXDB-1628: Fixed an issue in External Hash Group by
..


Patch Set 6: Code-Review+2

Forwarding Jianfeng's +2 (Rebased)

-- 
To view, visit https://asterix-gerrit.ics.uci.edu/1144
To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings

Gerrit-MessageType: comment
Gerrit-Change-Id: I8901d2b64659fb0d2b97d73f45a9fe113232e860
Gerrit-PatchSet: 6
Gerrit-Project: asterixdb
Gerrit-Branch: master
Gerrit-Owner: Taewoo Kim 
Gerrit-Reviewer: Jenkins 
Gerrit-Reviewer: Jianfeng Jia 
Gerrit-Reviewer: Taewoo Kim 
Gerrit-HasComments: No

Change in asterixdb[master]: ASTERIXDB-1628: Fixed an issue in External Hash Group by

2016-09-09 Thread Jenkins (Code Review)

Jenkins has posted comments on this change.

Change subject: ASTERIXDB-1628: Fixed an issue in External Hash Group by
..


Patch Set 6: Integration-Tests+1

Integration Tests Successful

https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-integration-tests/600/ : 
SUCCESS

-- 
To view, visit https://asterix-gerrit.ics.uci.edu/1144
To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings

Gerrit-MessageType: comment
Gerrit-Change-Id: I8901d2b64659fb0d2b97d73f45a9fe113232e860
Gerrit-PatchSet: 6
Gerrit-Project: asterixdb
Gerrit-Branch: master
Gerrit-Owner: Taewoo Kim 
Gerrit-Reviewer: Jenkins 
Gerrit-Reviewer: Jianfeng Jia 
Gerrit-Reviewer: Taewoo Kim 
Gerrit-HasComments: No

Change in asterixdb[master]: ASTERIXDB-1572 and ASTERIXDB-1591: fix and regression tests.

2016-09-09 Thread Jenkins (Code Review)

Jenkins has posted comments on this change.

Change subject: ASTERIXDB-1572 and ASTERIXDB-1591: fix and regression tests.
..


Patch Set 2:

WARNING: THIS CHANGE CONTAINS CROSS-PRODUCT CHANGES IN:
* asterixdb
* hyracks-fullstack

PLEASE REVIEW CAREFULLY AND LOOK FOR API CHANGES!

-- 
To view, visit https://asterix-gerrit.ics.uci.edu/1158
To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings

Gerrit-MessageType: comment
Gerrit-Change-Id: Ie38c51ab25e313f9dca3312c33b92e3bdb187420
Gerrit-PatchSet: 2
Gerrit-Project: asterixdb
Gerrit-Branch: master
Gerrit-Owner: Yingyi Bu 
Gerrit-Reviewer: Jenkins 
Gerrit-HasComments: No

Change in asterixdb[master]: ASTERIXDB-1572 and ASTERIXDB-1591: fix and regression tests.

2016-09-09 Thread Yingyi Bu (Code Review)

Hello Jenkins,

I'd like you to reexamine a change.  Please visit

https://asterix-gerrit.ics.uci.edu/1158

to look at the new patch set (#2).

Change subject: ASTERIXDB-1572 and ASTERIXDB-1591: fix and regression tests.
..

ASTERIXDB-1572 and ASTERIXDB-1591: fix and regression tests.

- push aggregates into subplans;
- fix recursive variable mapping in subquery decorrelation.

Change-Id: Ie38c51ab25e313f9dca3312c33b92e3bdb187420
---
M 
asterixdb/asterix-algebra/src/main/java/org/apache/asterix/optimizer/base/RuleCollections.java
R 
asterixdb/asterix-algebra/src/main/java/org/apache/asterix/optimizer/rules/PushAggregateIntoNestedSubplanRule.java
M 
asterixdb/asterix-algebra/src/main/java/org/apache/asterix/optimizer/rules/subplan/InlineSubplanInputForNestedTupleSourceRule.java
M asterixdb/asterix-app/data/tpcds/catalog_sales.csv
M asterixdb/asterix-app/data/tpcds/date_dim.csv
M asterixdb/asterix-app/data/tpcds/store_sales.csv
A 
asterixdb/asterix-app/src/test/resources/optimizerts/queries/subquery/query-ASTERIXDB-1572.sqlpp
A 
asterixdb/asterix-app/src/test/resources/optimizerts/queries/tpcds/query-ASTERIXDB-1591.sqlpp
M 
asterixdb/asterix-app/src/test/resources/optimizerts/results/inverted-index-join/issue741.plan
M 
asterixdb/asterix-app/src/test/resources/optimizerts/results/query-ASTERIXDB-159-3.plan
M 
asterixdb/asterix-app/src/test/resources/optimizerts/results/query-issue562.plan
M 
asterixdb/asterix-app/src/test/resources/optimizerts/results/subquery/exists.plan
M 
asterixdb/asterix-app/src/test/resources/optimizerts/results/subquery/not_exists.plan
A 
asterixdb/asterix-app/src/test/resources/optimizerts/results/subquery/query-ASTERIXDB-1572.plan
M 
asterixdb/asterix-app/src/test/resources/optimizerts/results/tpcds/query-ASTERIXDB-1581-correlated.plan
M 
asterixdb/asterix-app/src/test/resources/optimizerts/results/tpcds/query-ASTERIXDB-1581.plan
A 
asterixdb/asterix-app/src/test/resources/optimizerts/results/tpcds/query-ASTERIXDB-1591.plan
M 
asterixdb/asterix-app/src/test/resources/optimizerts/results/udfs/query-ASTERIXDB-1020.plan
M 
asterixdb/asterix-app/src/test/resources/optimizerts/results/udfs/query-ASTERIXDB-1308-1.plan
A 
asterixdb/asterix-app/src/test/resources/runtimets/queries_sqlpp/subquery/query-ASTERIXDB-1572/query-ASTERIXDB-1572.1.ddl.sqlpp
A 
asterixdb/asterix-app/src/test/resources/runtimets/queries_sqlpp/subquery/query-ASTERIXDB-1572/query-ASTERIXDB-1572.2.update.sqlpp
A 
asterixdb/asterix-app/src/test/resources/runtimets/queries_sqlpp/subquery/query-ASTERIXDB-1572/query-ASTERIXDB-1572.3.query.sqlpp
A 
asterixdb/asterix-app/src/test/resources/runtimets/queries_sqlpp/tpcds/query-ASTERIXDB-1591/query-ASTERIXDB-1591.1.ddl.sqlpp
A 
asterixdb/asterix-app/src/test/resources/runtimets/queries_sqlpp/tpcds/query-ASTERIXDB-1591/query-ASTERIXDB-1591.2.update.sqlpp
A 
asterixdb/asterix-app/src/test/resources/runtimets/queries_sqlpp/tpcds/query-ASTERIXDB-1591/query-ASTERIXDB-1591.3.query.sqlpp
A 
asterixdb/asterix-app/src/test/resources/runtimets/results/subquery/query-ASTERIXDB-1572/query-ASTERIXDB-1572.1.adm
A 
asterixdb/asterix-app/src/test/resources/runtimets/results/tpcds/query-ASTERIXDB-1591/query-ASTERIXDB-1591.1.adm
M 
asterixdb/asterix-app/src/test/resources/runtimets/results/tpcds/query-ASTERIXDB-1596/query-ASTERIXDB-1596.1.adm
M asterixdb/asterix-app/src/test/resources/runtimets/testsuite_sqlpp.xml
M 
hyracks-fullstack/algebricks/algebricks-core/src/main/java/org/apache/hyracks/algebricks/core/algebra/util/OperatorManipulationUtil.java
M 
hyracks-fullstack/algebricks/algebricks-rewriter/src/main/java/org/apache/hyracks/algebricks/rewriter/rules/RemoveUnusedAssignAndAggregateRule.java
M 
hyracks-fullstack/algebricks/algebricks-rewriter/src/main/java/org/apache/hyracks/algebricks/rewriter/rules/SetExecutionModeRule.java
32 files changed, 1,434 insertions(+), 397 deletions(-)


  git pull ssh://asterix-gerrit.ics.uci.edu:29418/asterixdb 
refs/changes/58/1158/2
-- 
To view, visit https://asterix-gerrit.ics.uci.edu/1158
To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings

Gerrit-MessageType: newpatchset
Gerrit-Change-Id: Ie38c51ab25e313f9dca3312c33b92e3bdb187420
Gerrit-PatchSet: 2
Gerrit-Project: asterixdb
Gerrit-Branch: master
Gerrit-Owner: Yingyi Bu 
Gerrit-Reviewer: Jenkins

Change in asterixdb[master]: ASTERIXDB-1572 and ASTERIXDB-1591: fix and regression tests.

2016-09-09 Thread Jenkins (Code Review)

Jenkins has posted comments on this change.

Change subject: ASTERIXDB-1572 and ASTERIXDB-1591: fix and regression tests.
..


Patch Set 2:

Build Started 
https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-notopic/2576/

-- 
To view, visit https://asterix-gerrit.ics.uci.edu/1158
To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings

Gerrit-MessageType: comment
Gerrit-Change-Id: Ie38c51ab25e313f9dca3312c33b92e3bdb187420
Gerrit-PatchSet: 2
Gerrit-Project: asterixdb
Gerrit-Branch: master
Gerrit-Owner: Yingyi Bu 
Gerrit-Reviewer: Jenkins 
Gerrit-HasComments: No

Change in asterixdb[master]: Add HTTP API to Collect Threaddumps From NCs

2016-09-09 Thread Jenkins (Code Review)

Jenkins has posted comments on this change.

Change subject: Add HTTP API to Collect Threaddumps From NCs
..


Patch Set 2:

Integration Tests Started 
https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-integration-tests/602/

-- 
To view, visit https://asterix-gerrit.ics.uci.edu/1159
To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings

Gerrit-MessageType: comment
Gerrit-Change-Id: I536606a1fbc394c6c70bb8ce14791cc411691617
Gerrit-PatchSet: 2
Gerrit-Project: asterixdb
Gerrit-Branch: master
Gerrit-Owner: Michael Blow 
Gerrit-Reviewer: Jenkins 
Gerrit-Reviewer: Till Westmann 
Gerrit-HasComments: No

Change in asterixdb[master]: Applied the multiway fuzzyjoin based on the prefix-based joi...

2016-09-09 Thread Jenkins (Code Review)

Jenkins has posted comments on this change.

Change subject: Applied the multiway fuzzyjoin based on the prefix-based join 
and the selectFuzzyJoin testCases.
..


Patch Set 8: Integration-Tests+1

Integration Tests Successful

https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-integration-tests/599/ : 
SUCCESS

-- 
To view, visit https://asterix-gerrit.ics.uci.edu/1076
To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings

Gerrit-MessageType: comment
Gerrit-Change-Id: I8736f104905eeda763d39709e002c2b9629278cc
Gerrit-PatchSet: 8
Gerrit-Project: asterixdb
Gerrit-Branch: master
Gerrit-Owner: Wenhai Li 
Gerrit-Reviewer: Chen Li 
Gerrit-Reviewer: Jenkins 
Gerrit-Reviewer: Taewoo Kim 
Gerrit-Reviewer: Wenhai Li 
Gerrit-HasComments: No

84 matches

Mail list logo