[jira] [Created] (ASTERIXDB-1501) Add units for executionTime and elapsedTime in query service results

2016-06-24 Thread Yingyi Bu (JIRA) 
Yingyi Bu created ASTERIXDB-1501:


 Summary: Add units for executionTime and elapsedTime in query 
service results
 Key: ASTERIXDB-1501
 URL: https://issues.apache.org/jira/browse/ASTERIXDB-1501
 Project: Apache AsterixDB
  Issue Type: Improvement
  Components: HTTP API
Reporter: Yingyi Bu
Assignee: Till Westmann


Currently there is no unit associated with elapsedTime and executionTime in a 
returned result:

"metrics": {
"elapsedTime": "966791",
"executionTime": "966378",
"resultCount": "1",
"resultSize": "28"
}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Created] (ASTERIXDB-1500) Inject filters to eliminate null/missing join keys for equality joins

2016-06-24 Thread Yingyi Bu (JIRA) 
Yingyi Bu created ASTERIXDB-1500:


 Summary: Inject filters to eliminate null/missing join keys for 
equality joins
 Key: ASTERIXDB-1500
 URL: https://issues.apache.org/jira/browse/ASTERIXDB-1500
 Project: Apache AsterixDB
  Issue Type: Improvement
  Components: Optimizer
Reporter: Yingyi Bu
Assignee: Yingyi Bu


For the following query, there could be many tweets that has the field 
in_reply_to_status_id being null/missing. Therefore, that would skewness of for 
the hash join.  Since this is an inner join and missing/null join keys anyway 
could not produce qualified join results, the optimizer should inject 
null/missing filters before the join.

{noformat}
FROM Tweets t2 JOIN Tweets t1 ON t2.in_reply_to_status_id = t1.id
WHERE not(`is-unknown`(t2.in_reply_to_status_id))
GROUP BY t1.id AS id, t1.user.name AS name, t1.text AS text
SELECT id, name, text, COUNT(t2) AS num_retweets
ORDER BY num_retweets DESC
LIMIT 5;
{noformat}




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Change in asterixdb[master]: ASTERIXDB-1482: Added NCServiceExecutionIT, HyracksVirtualCl...

2016-06-24 Thread Chris Hillery (Code Review) 
Chris Hillery has submitted this change and it was merged.

Change subject: ASTERIXDB-1482: Added NCServiceExecutionIT, 
HyracksVirtualCluster.
..


ASTERIXDB-1482: Added NCServiceExecutionIT, HyracksVirtualCluster.

NCServiceExecutionIT runs all execution tests against a local cluster
managed by the NCService deployment framework.

HyracksVirtualCluster offers programmatic NCService deployment
control along with improved HyracksNCProcess/HyracksCCProcess.

Further fixes and improvements:

1. Fix handling of iodevices/storagedir (ASTERIXDB-1482)
2. Proper handling of [nc] default section in all cases
3. Ensure asterixnc, etc. scripts are executable
4. Consolidate Ini handling
5. Pruned some dead code, including VirtualClusterDriver
6. A bit of refactoring and extended commenting

Change-Id: If3eb450782a595cf85d04a2c2e9cc732564e65e6
Reviewed-on: https://asterix-gerrit.ics.uci.edu/958
Tested-by: Jenkins 
Reviewed-by: Ian Maxon 
---
M 
asterixdb/asterix-common/src/main/java/org/apache/asterix/common/config/AsterixMetadataProperties.java
M 
asterixdb/asterix-common/src/main/java/org/apache/asterix/common/config/AsterixPropertiesAccessor.java
M asterixdb/asterix-server/pom.xml
A 
asterixdb/asterix-server/src/test/java/org/apache/asterix/server/test/NCServiceExecutionIT.java
A asterixdb/asterix-server/src/test/resources/NCServiceExecutionIT/cc.conf
A 
asterixdb/asterix-server/src/test/resources/NCServiceExecutionIT/ncservice1.conf
A 
asterixdb/asterix-server/src/test/resources/NCServiceExecutionIT/ncservice2.conf
M 
hyracks-fullstack/hyracks/hyracks-control/hyracks-control-cc/src/main/java/org/apache/hyracks/control/cc/ClusterControllerService.java
M 
hyracks-fullstack/hyracks/hyracks-control/hyracks-control-cc/src/main/java/org/apache/hyracks/control/cc/work/TriggerNCWork.java
M 
hyracks-fullstack/hyracks/hyracks-control/hyracks-control-common/src/main/java/org/apache/hyracks/control/common/application/IniApplicationConfig.java
M 
hyracks-fullstack/hyracks/hyracks-control/hyracks-control-common/src/main/java/org/apache/hyracks/control/common/controllers/CCConfig.java
M 
hyracks-fullstack/hyracks/hyracks-control/hyracks-control-common/src/main/java/org/apache/hyracks/control/common/controllers/IniUtils.java
M 
hyracks-fullstack/hyracks/hyracks-control/hyracks-control-common/src/main/java/org/apache/hyracks/control/common/controllers/NCConfig.java
M 
hyracks-fullstack/hyracks/hyracks-control/hyracks-nc-service/src/main/java/org/apache/hyracks/control/nc/service/NCService.java
M hyracks-fullstack/hyracks/hyracks-server/pom.xml
D 
hyracks-fullstack/hyracks/hyracks-server/src/main/java/org/apache/hyracks/server/drivers/VirtualClusterDriver.java
M 
hyracks-fullstack/hyracks/hyracks-server/src/main/java/org/apache/hyracks/server/process/HyracksCCProcess.java
M 
hyracks-fullstack/hyracks/hyracks-server/src/main/java/org/apache/hyracks/server/process/HyracksNCProcess.java
M 
hyracks-fullstack/hyracks/hyracks-server/src/main/java/org/apache/hyracks/server/process/HyracksServerProcess.java
A 
hyracks-fullstack/hyracks/hyracks-server/src/main/java/org/apache/hyracks/server/process/HyracksVirtualCluster.java
M 
hyracks-fullstack/hyracks/hyracks-server/src/test/java/org/apache/hyracks/server/test/NCServiceIT.java
M hyracks-fullstack/hyracks/hyracks-server/src/test/resources/logging.properties
22 files changed, 536 insertions(+), 369 deletions(-)

Approvals:
  Ian Maxon: Looks good to me, approved
  Jenkins: Verified



diff --git 
a/asterixdb/asterix-common/src/main/java/org/apache/asterix/common/config/AsterixMetadataProperties.java
 
b/asterixdb/asterix-common/src/main/java/org/apache/asterix/common/config/AsterixMetadataProperties.java
index 9a8fba4..677fc78 100644
--- 
a/asterixdb/asterix-common/src/main/java/org/apache/asterix/common/config/AsterixMetadataProperties.java
+++ 
b/asterixdb/asterix-common/src/main/java/org/apache/asterix/common/config/AsterixMetadataProperties.java
@@ -39,7 +39,7 @@
 }
 
 public ClusterPartition getMetadataPartition() {
-return accessor.getMetadataPartiton();
+return accessor.getMetadataPartition();
 }
 
 public Map getStores() {
diff --git 
a/asterixdb/asterix-common/src/main/java/org/apache/asterix/common/config/AsterixPropertiesAccessor.java
 
b/asterixdb/asterix-common/src/main/java/org/apache/asterix/common/config/AsterixPropertiesAccessor.java
index 507a393..7309f0c 100644
--- 
a/asterixdb/asterix-common/src/main/java/org/apache/asterix/common/config/AsterixPropertiesAccessor.java
+++ 
b/asterixdb/asterix-common/src/main/java/org/apache/asterix/common/config/AsterixPropertiesAccessor.java
@@ -18,6 +18,7 @@
  */
 package org.apache.asterix.common.config;
 
+import java.io.File;
 import java.io.FileInputStream;
 import java.io.FileNotFoundException;
 import java.io.IOException;
@@ -53,10

Change in asterixdb[master]: ASTERIXDB-1482: Added NCServiceExecutionIT, HyracksVirtualCl...

2016-06-24 Thread Ian Maxon (Code Review) 
Ian Maxon has posted comments on this change.

Change subject: ASTERIXDB-1482: Added NCServiceExecutionIT, 
HyracksVirtualCluster.
..


Patch Set 3: Code-Review+2

-- 
To view, visit https://asterix-gerrit.ics.uci.edu/958
To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings

Gerrit-MessageType: comment
Gerrit-Change-Id: If3eb450782a595cf85d04a2c2e9cc732564e65e6
Gerrit-PatchSet: 3
Gerrit-Project: asterixdb
Gerrit-Branch: master
Gerrit-Owner: Chris Hillery 
Gerrit-Reviewer: Chris Hillery 
Gerrit-Reviewer: Ian Maxon 
Gerrit-Reviewer: Jenkins 
Gerrit-Reviewer: Till Westmann 
Gerrit-HasComments: No

Change in asterixdb[master]: ASTERIXDB-1375 - New Query UI implementation

2016-06-24 Thread Till Westmann (Code Review) 
Till Westmann has posted comments on this change.

Change subject: ASTERIXDB-1375 - New Query UI implementation
..


Patch Set 7:

(1 comment)

Just a few comments so far:

I think that would should find a more descriptive name than "newui". 
"Newui"will get old soon and then we're stuck with a strange name. Is there a 
more technical name for the package?

Since we've got potentially new outside code here (Angular, Bootstrap, ...) we 
need to find out what needs to be added to the LICENSE and NOTICE for it.

https://asterix-gerrit.ics.uci.edu/#/c/935/7/asterixdb/asterix-app/src/main/java/org/apache/asterix/api/http/servlet/QueryWebInterfaceServlet.java
File 
asterixdb/asterix-app/src/main/java/org/apache/asterix/api/http/servlet/QueryWebInterfaceServlet.java:

Line 42: public class QueryWebInterfaceServlet extends HttpServlet {
I think that this Servlet only serves static resources. Is that right? If so, 
could we call it something like "StaticResourceServlet"? I think that this 
would make it clearer what it does. Also it seems that the functionality might 
be useful to support other interfaces than the query web interface and a 
generic name could help to express that.


-- 
To view, visit https://asterix-gerrit.ics.uci.edu/935
To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings

Gerrit-MessageType: comment
Gerrit-Change-Id: Id9aa6fb0a6bebaaa58f288e621dbfe76a604c689
Gerrit-PatchSet: 7
Gerrit-Project: asterixdb
Gerrit-Branch: master
Gerrit-Owner: Kaveen Rodrigo 
Gerrit-Reviewer: Ian Maxon 
Gerrit-Reviewer: Jenkins 
Gerrit-Reviewer: Michael Blow 
Gerrit-Reviewer: Till Westmann 
Gerrit-HasComments: Yes

Change in asterixdb[master]: ASTERIXDB-1482: Added NCServiceExecutionIT, HyracksVirtualCl...

2016-06-24 Thread Chris Hillery (Code Review) 
Chris Hillery has posted comments on this change.

Change subject: ASTERIXDB-1482: Added NCServiceExecutionIT, 
HyracksVirtualCluster.
..


Patch Set 3:

(3 comments)

https://asterix-gerrit.ics.uci.edu/#/c/958/3/asterixdb/asterix-server/pom.xml
File asterixdb/asterix-server/pom.xml:

Line 127:   
> What's this plugin about?
I copied these plugin settings from hyracks-server, where it's doing the same 
thing: making sure that the appassembler-generated .sh scripts are executable.


https://asterix-gerrit.ics.uci.edu/#/c/958/3/asterixdb/asterix-server/src/test/java/org/apache/asterix/server/test/NCServiceExecutionIT.java
File 
asterixdb/asterix-server/src/test/java/org/apache/asterix/server/test/NCServiceExecutionIT.java:

Line 135: LOGGER.info("Sleeping while cluster comes online...");
> Is there a better way to do this? Maybe trying to fetch against some port o
I'm not sure.. I suppose it could poll the rest/nodes Hyracks endpoint until 
the expected number of NCs are connected?


https://asterix-gerrit.ics.uci.edu/#/c/958/3/hyracks-fullstack/hyracks/hyracks-control/hyracks-control-common/src/main/java/org/apache/hyracks/control/common/controllers/CCConfig.java
File 
hyracks-fullstack/hyracks/hyracks-control/hyracks-control-common/src/main/java/org/apache/hyracks/control/common/controllers/CCConfig.java:

Line 155
> Why remove this?
Because it no longer serves any purpose, with VirtualClusterDriver removed. It 
was always an ugly hack that risked being out of sync, and with the NCService 
model I'm trying to minimize the use of command-line arguments anyway.


-- 
To view, visit https://asterix-gerrit.ics.uci.edu/958
To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings

Gerrit-MessageType: comment
Gerrit-Change-Id: If3eb450782a595cf85d04a2c2e9cc732564e65e6
Gerrit-PatchSet: 3
Gerrit-Project: asterixdb
Gerrit-Branch: master
Gerrit-Owner: Chris Hillery 
Gerrit-Reviewer: Chris Hillery 
Gerrit-Reviewer: Ian Maxon 
Gerrit-Reviewer: Jenkins 
Gerrit-Reviewer: Till Westmann 
Gerrit-HasComments: Yes

Change in asterixdb[master]: ASTERIXDB-1482: Added NCServiceExecutionIT, HyracksVirtualCl...

2016-06-24 Thread Ian Maxon (Code Review) 
Ian Maxon has posted comments on this change.

Change subject: ASTERIXDB-1482: Added NCServiceExecutionIT, 
HyracksVirtualCluster.
..


Patch Set 3: Code-Review+1

(3 comments)

A few thoughts/questions

https://asterix-gerrit.ics.uci.edu/#/c/958/3/asterixdb/asterix-server/pom.xml
File asterixdb/asterix-server/pom.xml:

Line 127:   
What's this plugin about?


https://asterix-gerrit.ics.uci.edu/#/c/958/3/asterixdb/asterix-server/src/test/java/org/apache/asterix/server/test/NCServiceExecutionIT.java
File 
asterixdb/asterix-server/src/test/java/org/apache/asterix/server/test/NCServiceExecutionIT.java:

Line 135: LOGGER.info("Sleeping while cluster comes online...");
Is there a better way to do this? Maybe trying to fetch against some port on 
the CC until it returns or a number of retries is reached?


https://asterix-gerrit.ics.uci.edu/#/c/958/3/hyracks-fullstack/hyracks/hyracks-control/hyracks-control-common/src/main/java/org/apache/hyracks/control/common/controllers/CCConfig.java
File 
hyracks-fullstack/hyracks/hyracks-control/hyracks-control-common/src/main/java/org/apache/hyracks/control/common/controllers/CCConfig.java:

Line 155
Why remove this?


-- 
To view, visit https://asterix-gerrit.ics.uci.edu/958
To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings

Gerrit-MessageType: comment
Gerrit-Change-Id: If3eb450782a595cf85d04a2c2e9cc732564e65e6
Gerrit-PatchSet: 3
Gerrit-Project: asterixdb
Gerrit-Branch: master
Gerrit-Owner: Chris Hillery 
Gerrit-Reviewer: Chris Hillery 
Gerrit-Reviewer: Ian Maxon 
Gerrit-Reviewer: Jenkins 
Gerrit-Reviewer: Till Westmann 
Gerrit-HasComments: Yes

Change in asterixdb[master]: WORK IN PROGRESS

2016-06-24 Thread Jenkins (Code Review) 
Jenkins has posted comments on this change.

Change subject: WORK IN PROGRESS
..


Patch Set 10:

Build Started 
https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-notopic/1740/

-- 
To view, visit https://asterix-gerrit.ics.uci.edu/694
To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings

Gerrit-MessageType: comment
Gerrit-Change-Id: I774dd40113f5fa4fee94dde72f4ec6a1891c6b6e
Gerrit-PatchSet: 10
Gerrit-Project: asterixdb
Gerrit-Branch: master
Gerrit-Owner: Till Westmann 
Gerrit-Reviewer: Jenkins 
Gerrit-HasComments: No

Change in asterixdb[master]: WORK IN PROGRESS

2016-06-24 Thread Till Westmann (Code Review) 
Hello Jenkins,

I'd like you to reexamine a change.  Please visit

https://asterix-gerrit.ics.uci.edu/694

to look at the new patch set (#10).

Change subject: WORK IN PROGRESS
..

WORK IN PROGRESS

symbolic constants in lock manager

Change-Id: I774dd40113f5fa4fee94dde72f4ec6a1891c6b6e
---
M 
asterixdb/asterix-transactions/src/main/java/org/apache/asterix/transaction/management/service/locking/ConcurrentLockManager.java
1 file changed, 4 insertions(+), 4 deletions(-)


  git pull ssh://asterix-gerrit.ics.uci.edu:29418/asterixdb 
refs/changes/94/694/10
-- 
To view, visit https://asterix-gerrit.ics.uci.edu/694
To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings

Gerrit-MessageType: newpatchset
Gerrit-Change-Id: I774dd40113f5fa4fee94dde72f4ec6a1891c6b6e
Gerrit-PatchSet: 10
Gerrit-Project: asterixdb
Gerrit-Branch: master
Gerrit-Owner: Till Westmann 
Gerrit-Reviewer: Jenkins

Change in asterixdb[master]: some code reduction/cleanup

2016-06-24 Thread Jenkins (Code Review) 
Jenkins has posted comments on this change.

Change subject: some code reduction/cleanup
..


Patch Set 7:

Build Started 
https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-notopic/1739/

-- 
To view, visit https://asterix-gerrit.ics.uci.edu/916
To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings

Gerrit-MessageType: comment
Gerrit-Change-Id: I179a16fc183bd50d5d58cc12321234df1615abfd
Gerrit-PatchSet: 7
Gerrit-Project: asterixdb
Gerrit-Branch: master
Gerrit-Owner: Till Westmann 
Gerrit-Reviewer: Jenkins 
Gerrit-Reviewer: Michael Blow 
Gerrit-HasComments: No

Change in asterixdb[master]: some graduation and branding fixes

2016-06-24 Thread Till Westmann (Code Review) 
Till Westmann has uploaded a new patch set (#2).

Change subject: some graduation and branding fixes
..

some graduation and branding fixes

Change-Id: Idc1a81a611c032fa39ec624800380df83f513578
---
M README.md
M asterixdb/asterix-doc/pom.xml
M asterixdb/asterix-doc/src/site/markdown/aql/primer-sql-like.md
M asterixdb/asterix-doc/src/site/markdown/aql/primer.md
M asterixdb/asterix-doc/src/site/markdown/index.md
M asterixdb/asterix-doc/src/site/markdown/overview.md
M asterixdb/asterix-doc/src/site/markdown/udf.md
M asterixdb/asterix-doc/src/site/markdown/yarn.md
8 files changed, 11 insertions(+), 21 deletions(-)


  git pull ssh://asterix-gerrit.ics.uci.edu:29418/asterixdb 
refs/changes/59/959/2
-- 
To view, visit https://asterix-gerrit.ics.uci.edu/959
To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings

Gerrit-MessageType: newpatchset
Gerrit-Change-Id: Idc1a81a611c032fa39ec624800380df83f513578
Gerrit-PatchSet: 2
Gerrit-Project: asterixdb
Gerrit-Branch: master
Gerrit-Owner: Till Westmann 
Gerrit-Reviewer: Jenkins

Change in asterixdb[master]: some graduation and branding fixes

2016-06-24 Thread Jenkins (Code Review) 
Jenkins has posted comments on this change.

Change subject: some graduation and branding fixes
..


Patch Set 2:

Build Started 
https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-notopic/1738/

-- 
To view, visit https://asterix-gerrit.ics.uci.edu/959
To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings

Gerrit-MessageType: comment
Gerrit-Change-Id: Idc1a81a611c032fa39ec624800380df83f513578
Gerrit-PatchSet: 2
Gerrit-Project: asterixdb
Gerrit-Branch: master
Gerrit-Owner: Till Westmann 
Gerrit-Reviewer: Jenkins 
Gerrit-HasComments: No

Change in asterixdb[master]: some graduation and branding fixes

2016-06-24 Thread Jenkins (Code Review) 
Jenkins has posted comments on this change.

Change subject: some graduation and branding fixes
..


Patch Set 1:

Build Started 
https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-notopic/1737/

-- 
To view, visit https://asterix-gerrit.ics.uci.edu/959
To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings

Gerrit-MessageType: comment
Gerrit-Change-Id: Idc1a81a611c032fa39ec624800380df83f513578
Gerrit-PatchSet: 1
Gerrit-Project: asterixdb
Gerrit-Branch: master
Gerrit-Owner: Till Westmann 
Gerrit-Reviewer: Jenkins 
Gerrit-HasComments: No

Change in asterixdb[master]: some graduation and branding fixes

2016-06-24 Thread Till Westmann (Code Review) 
Till Westmann has uploaded a new change for review.

  https://asterix-gerrit.ics.uci.edu/959

Change subject: some graduation and branding fixes
..

some graduation and branding fixes

Change-Id: Idc1a81a611c032fa39ec624800380df83f513578
---
M README.md
M asterixdb/asterix-doc/pom.xml
M asterixdb/asterix-doc/src/site/markdown/aql/primer-sql-like.md
M asterixdb/asterix-doc/src/site/markdown/aql/primer.md
M asterixdb/asterix-doc/src/site/markdown/index.md
M asterixdb/asterix-doc/src/site/markdown/overview.md
M asterixdb/asterix-doc/src/site/markdown/udf.md
M asterixdb/asterix-doc/src/site/markdown/yarn.md
8 files changed, 11 insertions(+), 21 deletions(-)


  git pull ssh://asterix-gerrit.ics.uci.edu:29418/asterixdb 
refs/changes/59/959/1

diff --git a/README.md b/README.md
index cb76fd9..f522fc6 100644
--- a/README.md
+++ b/README.md
@@ -22,7 +22,7 @@
 
  * A semistructured NoSQL style data model (ADM) resulting from extending JSON 
with object database ideas
  * An expressive and declarative query language (AQL) that supports a broad 
range of queries and analysis over semistructured data
- * A parallel runtime query execution engine, Hyracks, that has been 
scale-tested on up to 1000+ cores and 500+ disks
+ * A parallel runtime query execution engine, Apache Hyracks, that has been 
scale-tested on up to 1000+ cores and 500+ disks
  * Partitioned LSM-based data storage and indexing to support efficient 
ingestion and management of semistructured data
  * Support for query access to externally stored data (e.g., data in HDFS) as 
well as to data stored natively by AsterixDB
  * A rich set of primitive data types, including spatial and temporal data in 
addition to integer, floating point, and textual data
@@ -52,7 +52,7 @@
 
 * Build AsterixDB master:
 
-$cd incubator-asterixdb
+$cd asterixdb
 $mvn clean package -DskipTests
 
 
diff --git a/asterixdb/asterix-doc/pom.xml b/asterixdb/asterix-doc/pom.xml
index 43dba09..5b18c79 100644
--- a/asterixdb/asterix-doc/pom.xml
+++ b/asterixdb/asterix-doc/pom.xml
@@ -24,7 +24,7 @@
 0.8.9-SNAPSHOT
   
 
-  http://asterixdb.incubator.apache.org/
+  http://asterixdb.apache.org/
 
   
 
@@ -72,7 +72,7 @@
 
   site
   site
-  file:../../../../site/incubator-asterixdb-site
+  file:../../../../site/asterixdb-site
 
   
 
diff --git a/asterixdb/asterix-doc/src/site/markdown/aql/primer-sql-like.md 
b/asterixdb/asterix-doc/src/site/markdown/aql/primer-sql-like.md
index 6bff861..397140f 100644
--- a/asterixdb/asterix-doc/src/site/markdown/aql/primer-sql-like.md
+++ b/asterixdb/asterix-doc/src/site/markdown/aql/primer-sql-like.md
@@ -903,5 +903,5 @@
 AsterixDB is powerful, so use it wisely, and remember: "With great power comes 
great responsibility..." :-)
 
 Please e-mail the AsterixDB user group
-(users (at) asterixdb.incubator.apache.org)
+(users (at) asterixdb.apache.org)
 if you run into any problems or simply have further questions about the 
AsterixDB system, its features, or their proper use.
diff --git a/asterixdb/asterix-doc/src/site/markdown/aql/primer.md 
b/asterixdb/asterix-doc/src/site/markdown/aql/primer.md
index d99ba6d..f56eb93 100644
--- a/asterixdb/asterix-doc/src/site/markdown/aql/primer.md
+++ b/asterixdb/asterix-doc/src/site/markdown/aql/primer.md
@@ -961,5 +961,5 @@
 AsterixDB is powerful, so use it wisely, and remember: "With great power comes 
great responsibility..." :-)
 
 Please e-mail the AsterixDB user group
-(users (at) asterixdb.incubator.apache.org)
+(users (at) asterixdb.apache.org)
 if you run into any problems or simply have further questions about the 
AsterixDB system, its features, or their proper use.
diff --git a/asterixdb/asterix-doc/src/site/markdown/index.md 
b/asterixdb/asterix-doc/src/site/markdown/index.md
index bb74f1b..f117d93 100644
--- a/asterixdb/asterix-doc/src/site/markdown/index.md
+++ b/asterixdb/asterix-doc/src/site/markdown/index.md
@@ -28,7 +28,7 @@
with object database ideas
  * An expressive and declarative query language (AQL) that supports a broad
range of queries and analysis over semistructured data
- * A parallel runtime query execution engine, Hyracks, that has been
+ * A parallel runtime query execution engine, Apache Hyracks, that has been
scale-tested on up to 1000+ cores and 500+ disks
  * Partitioned LSM-based data storage and indexing to support efficient
ingestion and management of semistructured data
@@ -42,13 +42,3 @@
parametric queries
  * Basic transactional (concurrency and recovery) capabilities akin to those of
a NoSQL store
-
-### Disclaimer ###
-Apache AsterixDB is an effort undergoing incubation at The Apache Software
-Foundation (ASF), sponsored by the Apache incubator.
-Incubation is required of all newly accepted projects until a further review
-indicates that the infrastructure, communications, and decision making process
-have stabilized in a

Change in asterixdb[master]: Cleanup Large Page Logic

2016-06-24 Thread abdullah alamoudi (Code Review) 
abdullah alamoudi has posted comments on this change.

Change subject: Cleanup Large Page Logic
..


Patch Set 2: Code-Review+2

-- 
To view, visit https://asterix-gerrit.ics.uci.edu/955
To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings

Gerrit-MessageType: comment
Gerrit-Change-Id: I26f9a8e4530edfda1b5f78114a5c8038bf8a27f4
Gerrit-PatchSet: 2
Gerrit-Project: asterixdb
Gerrit-Branch: master
Gerrit-Owner: Michael Blow 
Gerrit-Reviewer: Jenkins 
Gerrit-Reviewer: abdullah alamoudi 
Gerrit-HasComments: No

Change in asterixdb[master]: Cleanup Large Page Logic

2016-06-24 Thread Michael Blow (Code Review) 
Hello abdullah alamoudi, Jenkins,

I'd like you to reexamine a change.  Please visit

https://asterix-gerrit.ics.uci.edu/955

to look at the new patch set (#2).

Change subject: Cleanup Large Page Logic
..

Cleanup Large Page Logic

Change-Id: I26f9a8e4530edfda1b5f78114a5c8038bf8a27f4
---
M 
hyracks-fullstack/hyracks/hyracks-storage-am-btree/src/main/java/org/apache/hyracks/storage/am/btree/frames/BTreeNSMLeafFrame.java
M 
hyracks-fullstack/hyracks/hyracks-storage-am-lsm-common/src/main/java/org/apache/hyracks/storage/am/lsm/common/impls/VirtualBufferCache.java
M 
hyracks-fullstack/hyracks/hyracks-storage-common/src/main/java/org/apache/hyracks/storage/common/buffercache/CachedPage.java
M 
hyracks-fullstack/hyracks/hyracks-storage-common/src/main/java/org/apache/hyracks/storage/common/buffercache/ICachedPage.java
4 files changed, 27 insertions(+), 16 deletions(-)


  git pull ssh://asterix-gerrit.ics.uci.edu:29418/asterixdb 
refs/changes/55/955/2
-- 
To view, visit https://asterix-gerrit.ics.uci.edu/955
To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings

Gerrit-MessageType: newpatchset
Gerrit-Change-Id: I26f9a8e4530edfda1b5f78114a5c8038bf8a27f4
Gerrit-PatchSet: 2
Gerrit-Project: asterixdb
Gerrit-Branch: master
Gerrit-Owner: Michael Blow 
Gerrit-Reviewer: Jenkins 
Gerrit-Reviewer: abdullah alamoudi

Change in asterixdb[master]: Update adm.grammar and printers for double/float

2016-06-24 Thread Till Westmann (Code Review) 
Till Westmann has posted comments on this change.

Change subject: Update adm.grammar and printers for double/float
..


Patch Set 7: Code-Review+2

-- 
To view, visit https://asterix-gerrit.ics.uci.edu/932
To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings

Gerrit-MessageType: comment
Gerrit-Change-Id: I6164d74f6c286fa160a30cff9ad47e97a30e0770
Gerrit-PatchSet: 7
Gerrit-Project: asterixdb
Gerrit-Branch: master
Gerrit-Owner: Ian Maxon 
Gerrit-Reviewer: Ian Maxon 
Gerrit-Reviewer: Jenkins 
Gerrit-Reviewer: Michael Blow 
Gerrit-Reviewer: Till Westmann 
Gerrit-HasComments: No

Change in asterixdb[master]: ASTERIXDB-1286 Add User Documentation for Upsert

2016-06-24 Thread Till Westmann (Code Review) 
Till Westmann has submitted this change and it was merged.

Change subject: ASTERIXDB-1286 Add User Documentation for Upsert
..


ASTERIXDB-1286 Add User Documentation for Upsert

Documentation for upsert has been added. It includes multiple examples:
1. Example with a single record upsert.
2. Example with a query based upsert.
3. Example of an upsert with self query.
The documentation explains the transaction properties of upserts as well.

Change-Id: I677dbeb5cbc7e8a83aa50db0c3cd59f91f6a2e69
Reviewed-on: https://asterix-gerrit.ics.uci.edu/640
Reviewed-by: Jenkins 
Tested-by: Jenkins 
Reviewed-by: Till Westmann 
---
M asterixdb/asterix-doc/src/site/markdown/aql/manual.md
M asterixdb/asterix-doc/src/site/markdown/aql/primer.md
2 files changed, 72 insertions(+), 1 deletion(-)

Approvals:
  Till Westmann: Looks good to me, approved
  Jenkins: Looks good to me, but someone else must approve; Verified



diff --git a/asterixdb/asterix-doc/src/site/markdown/aql/manual.md 
b/asterixdb/asterix-doc/src/site/markdown/aql/manual.md
index a7d1669..510bc83 100644
--- a/asterixdb/asterix-doc/src/site/markdown/aql/manual.md
+++ b/asterixdb/asterix-doc/src/site/markdown/aql/manual.md
@@ -480,11 +480,12 @@
   | SetStatement
   | InsertStatement
   | DeleteStatement
+  | UpsertStatement
   | Query
 
 In addition to expresssions for queries, AQL supports a variety of statements 
for data
 definition and manipulation purposes as well as controlling the context to be 
used in
-evaluating AQL expressions. AQL supports record-level ACID transactions that 
begin and terminate implicitly for each record inserted, deleted, or searched 
while a given AQL statement is being executed.
+evaluating AQL expressions. AQL supports record-level ACID transactions that 
begin and terminate implicitly for each record inserted, deleted, upserted, or 
searched while a given AQL statement is being executed.
 
 This section details the statements supported in the AQL language.
 
@@ -861,6 +862,27 @@
 
 delete $user from dataset FacebookUsers where $user.id = 8;
 
+ Upsert
+
+UpsertStatement ::= "upsert" "into" "dataset" QualifiedName Query
+
+The AQL upsert statement is used to couple delete (if found) with insert data 
into a dataset.
+The data to be upserted comes from an AQL query expression.
+The expression can be as simple as a constant expression, or in general it can 
be any legal AQL query.
+Upserts in AsterixDB are processed transactionally, with the scope of each 
upsert transaction
+being the upsertion (deletion if found + insertion) of a single object plus 
its affiliated
+secondary index entries (if any).
+If the query part of an upsert returns a single object, then the upsert 
statement itself will
+be a single, atomic transaction.
+If the query part returns multiple objects, then each object upserted will be 
handled independently
+as a tranaction.
+
+The following example illustrates a query-based upsertion.
+
+# Example
+
+upsert into dataset Users (for $user in dataset FacebookUsers return $user)
+
 We close this guide to AQL with one final example of a query expression.
 
 # Example
diff --git a/asterixdb/asterix-doc/src/site/markdown/aql/primer.md 
b/asterixdb/asterix-doc/src/site/markdown/aql/primer.md
index b1ffec7..d99ba6d 100644
--- a/asterixdb/asterix-doc/src/site/markdown/aql/primer.md
+++ b/asterixdb/asterix-doc/src/site/markdown/aql/primer.md
@@ -900,6 +900,55 @@
 dataset where it resides, and another to insert the new replacement record 
(with the same primary key but with
 different field values for some of the associated data content).
 
+### Upserting Data  ###
+In addition to loading, querying, inserting, and deleting data, AsterixDB 
supports upserting
+records using the AQL _upsert_ statement.
+
+The following example deletes the tweet with the tweetid = 20 (if exists) and 
inserts the
+new tweet with tweetid=20 and the user "SwanSmitty" to the TweetMessages 
dataset. The two
+operations (delete if found and insert) are performed as an atomic operation 
that is either
+performed completely or not at all.
+
+use dataverse TinySocial;
+upsert into dataset TweetMessages
+(
+   {"tweetid":"20",
+"user":
+{"screen-name":"SwanSmitty",
+ "lang":"en",
+ "friends_count":91345,
+ "statuses_count":4079,
+ "name":"Swanson Smith",
+ "followers_count":50420
+},
+"sender-location":point("47.44,80.65"),
+"send-time":datetime("2008-04-26T10:10:35"),
+"referred-topics":{{"football"}},
+"message-text":"football is the best sport, period.!"
+   }

Change in asterixdb[master]: ASTERIXDB-1286 Add User Documentation for Upsert

2016-06-24 Thread Till Westmann (Code Review) 
Till Westmann has posted comments on this change.

Change subject: ASTERIXDB-1286 Add User Documentation for Upsert
..


Patch Set 3: Code-Review+2

-- 
To view, visit https://asterix-gerrit.ics.uci.edu/640
To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings

Gerrit-MessageType: comment
Gerrit-Change-Id: I677dbeb5cbc7e8a83aa50db0c3cd59f91f6a2e69
Gerrit-PatchSet: 3
Gerrit-Project: asterixdb
Gerrit-Branch: master
Gerrit-Owner: abdullah alamoudi 
Gerrit-Reviewer: Jenkins 
Gerrit-Reviewer: Michael Carey 
Gerrit-Reviewer: Till Westmann 
Gerrit-Reviewer: abdullah alamoudi 
Gerrit-HasComments: No

Change in asterixdb[master]: Reduce object creation in Unnest.

2016-06-24 Thread Till Westmann (Code Review) 
Till Westmann has posted comments on this change.

Change subject: Reduce object creation in Unnest.
..


Patch Set 1: Code-Review+2

-- 
To view, visit https://asterix-gerrit.ics.uci.edu/957
To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings

Gerrit-MessageType: comment
Gerrit-Change-Id: I5b2d1f281dca0655c212aad328fb737d5fec9c71
Gerrit-PatchSet: 1
Gerrit-Project: asterixdb
Gerrit-Branch: master
Gerrit-Owner: Yingyi Bu 
Gerrit-Reviewer: Jenkins 
Gerrit-Reviewer: Till Westmann 
Gerrit-HasComments: No

Change in asterixdb[master]: Reduce object creation in Unnest.

2016-06-24 Thread Till Westmann (Code Review) 
Till Westmann has submitted this change and it was merged.

Change subject: Reduce object creation in Unnest.
..


Reduce object creation in Unnest.

If an Unnest is run in a Subplan operator, open/close need to be
called many times.

Change-Id: I5b2d1f281dca0655c212aad328fb737d5fec9c71
Reviewed-on: https://asterix-gerrit.ics.uci.edu/957
Reviewed-by: Jenkins 
Tested-by: Jenkins 
Reviewed-by: Till Westmann 
---
M 
hyracks-fullstack/algebricks/algebricks-runtime/src/main/java/org/apache/hyracks/algebricks/runtime/operators/std/UnnestRuntimeFactory.java
1 file changed, 4 insertions(+), 3 deletions(-)

Approvals:
  Till Westmann: Looks good to me, approved
  Jenkins: Looks good to me, but someone else must approve; Verified



diff --git 
a/hyracks-fullstack/algebricks/algebricks-runtime/src/main/java/org/apache/hyracks/algebricks/runtime/operators/std/UnnestRuntimeFactory.java
 
b/hyracks-fullstack/algebricks/algebricks-runtime/src/main/java/org/apache/hyracks/algebricks/runtime/operators/std/UnnestRuntimeFactory.java
index 3afa808..300be34 100644
--- 
a/hyracks-fullstack/algebricks/algebricks-runtime/src/main/java/org/apache/hyracks/algebricks/runtime/operators/std/UnnestRuntimeFactory.java
+++ 
b/hyracks-fullstack/algebricks/algebricks-runtime/src/main/java/org/apache/hyracks/algebricks/runtime/operators/std/UnnestRuntimeFactory.java
@@ -94,14 +94,15 @@
 int missingBytesLen = bos.size();
 return new AbstractOneInputOneOutputOneFramePushRuntime() {
 private IPointable p = VoidPointable.FACTORY.createPointable();
-private ArrayTupleBuilder tupleBuilder;
+private ArrayTupleBuilder tupleBuilder = new 
ArrayTupleBuilder(projectionList.length);
 private IUnnestingEvaluator unnest = 
unnestingFactory.createUnnestingEvaluator(ctx);
 
 @Override
 public void open() throws HyracksDataException {
 writer.open();
-initAccessAppendRef(ctx);
-tupleBuilder = new ArrayTupleBuilder(projectionList.length);
+if (tRef == null) {
+initAccessAppendRef(ctx);
+}
 }
 
 @Override

-- 
To view, visit https://asterix-gerrit.ics.uci.edu/957
To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings

Gerrit-MessageType: merged
Gerrit-Change-Id: I5b2d1f281dca0655c212aad328fb737d5fec9c71
Gerrit-PatchSet: 2
Gerrit-Project: asterixdb
Gerrit-Branch: master
Gerrit-Owner: Yingyi Bu 
Gerrit-Reviewer: Jenkins 
Gerrit-Reviewer: Till Westmann

Change in asterixdb[master]: ASTERIXDB-1482: Added NCServiceExecutionIT, HyracksVirtualCl...

2016-06-24 Thread Jenkins (Code Review) 
Jenkins has posted comments on this change.

Change subject: ASTERIXDB-1482: Added NCServiceExecutionIT, 
HyracksVirtualCluster.
..


Patch Set 3:

Build Started 
https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-notopic/1735/

-- 
To view, visit https://asterix-gerrit.ics.uci.edu/958
To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings

Gerrit-MessageType: comment
Gerrit-Change-Id: If3eb450782a595cf85d04a2c2e9cc732564e65e6
Gerrit-PatchSet: 3
Gerrit-Project: asterixdb
Gerrit-Branch: master
Gerrit-Owner: Chris Hillery 
Gerrit-Reviewer: Chris Hillery 
Gerrit-Reviewer: Jenkins 
Gerrit-HasComments: No

Change in asterixdb[master]: ASTERIXDB-1482: Added NCServiceExecutionIT, HyracksVirtualCl...

2016-06-24 Thread Chris Hillery (Code Review) 
Hello Jenkins,

I'd like you to reexamine a change.  Please visit

https://asterix-gerrit.ics.uci.edu/958

to look at the new patch set (#3).

Change subject: ASTERIXDB-1482: Added NCServiceExecutionIT, 
HyracksVirtualCluster.
..

ASTERIXDB-1482: Added NCServiceExecutionIT, HyracksVirtualCluster.

NCServiceExecutionIT runs all execution tests against a local cluster
managed by the NCService deployment framework.

HyracksVirtualCluster offers programmatic NCService deployment
control along with improved HyracksNCProcess/HyracksCCProcess.

Further fixes and improvements:

1. Fix handling of iodevices/storagedir (ASTERIXDB-1482)
2. Proper handling of [nc] default section in all cases
3. Ensure asterixnc, etc. scripts are executable
4. Consolidate Ini handling
5. Pruned some dead code, including VirtualClusterDriver
6. A bit of refactoring and extended commenting

Change-Id: If3eb450782a595cf85d04a2c2e9cc732564e65e6
---
M 
asterixdb/asterix-common/src/main/java/org/apache/asterix/common/config/AsterixMetadataProperties.java
M 
asterixdb/asterix-common/src/main/java/org/apache/asterix/common/config/AsterixPropertiesAccessor.java
M asterixdb/asterix-server/pom.xml
A 
asterixdb/asterix-server/src/test/java/org/apache/asterix/server/test/NCServiceExecutionIT.java
A asterixdb/asterix-server/src/test/resources/NCServiceExecutionIT/cc.conf
A 
asterixdb/asterix-server/src/test/resources/NCServiceExecutionIT/ncservice1.conf
A 
asterixdb/asterix-server/src/test/resources/NCServiceExecutionIT/ncservice2.conf
M 
hyracks-fullstack/hyracks/hyracks-control/hyracks-control-cc/src/main/java/org/apache/hyracks/control/cc/ClusterControllerService.java
M 
hyracks-fullstack/hyracks/hyracks-control/hyracks-control-cc/src/main/java/org/apache/hyracks/control/cc/work/TriggerNCWork.java
M 
hyracks-fullstack/hyracks/hyracks-control/hyracks-control-common/src/main/java/org/apache/hyracks/control/common/application/IniApplicationConfig.java
M 
hyracks-fullstack/hyracks/hyracks-control/hyracks-control-common/src/main/java/org/apache/hyracks/control/common/controllers/CCConfig.java
M 
hyracks-fullstack/hyracks/hyracks-control/hyracks-control-common/src/main/java/org/apache/hyracks/control/common/controllers/IniUtils.java
M 
hyracks-fullstack/hyracks/hyracks-control/hyracks-control-common/src/main/java/org/apache/hyracks/control/common/controllers/NCConfig.java
M 
hyracks-fullstack/hyracks/hyracks-control/hyracks-nc-service/src/main/java/org/apache/hyracks/control/nc/service/NCService.java
M hyracks-fullstack/hyracks/hyracks-server/pom.xml
D 
hyracks-fullstack/hyracks/hyracks-server/src/main/java/org/apache/hyracks/server/drivers/VirtualClusterDriver.java
M 
hyracks-fullstack/hyracks/hyracks-server/src/main/java/org/apache/hyracks/server/process/HyracksCCProcess.java
M 
hyracks-fullstack/hyracks/hyracks-server/src/main/java/org/apache/hyracks/server/process/HyracksNCProcess.java
M 
hyracks-fullstack/hyracks/hyracks-server/src/main/java/org/apache/hyracks/server/process/HyracksServerProcess.java
A 
hyracks-fullstack/hyracks/hyracks-server/src/main/java/org/apache/hyracks/server/process/HyracksVirtualCluster.java
M 
hyracks-fullstack/hyracks/hyracks-server/src/test/java/org/apache/hyracks/server/test/NCServiceIT.java
M hyracks-fullstack/hyracks/hyracks-server/src/test/resources/logging.properties
22 files changed, 536 insertions(+), 369 deletions(-)


  git pull ssh://asterix-gerrit.ics.uci.edu:29418/asterixdb 
refs/changes/58/958/3
-- 
To view, visit https://asterix-gerrit.ics.uci.edu/958
To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings

Gerrit-MessageType: newpatchset
Gerrit-Change-Id: If3eb450782a595cf85d04a2c2e9cc732564e65e6
Gerrit-PatchSet: 3
Gerrit-Project: asterixdb
Gerrit-Branch: master
Gerrit-Owner: Chris Hillery 
Gerrit-Reviewer: Chris Hillery 
Gerrit-Reviewer: Jenkins

Change in asterixdb[master]: Added NCServiceExecutionIT and programmatic NCService deploy...

2016-06-24 Thread Jenkins (Code Review) 
Jenkins has posted comments on this change.

Change subject: Added NCServiceExecutionIT and programmatic NCService 
deployment control.
..


Patch Set 2:

WARNING: THIS CHANGE CONTAINS CROSS-PRODUCT CHANGES IN:
* asterixdb
* hyracks-fullstack

PLEASE REVIEW CAREFULLY AND LOOK FOR API CHANGES!

-- 
To view, visit https://asterix-gerrit.ics.uci.edu/958
To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings

Gerrit-MessageType: comment
Gerrit-Change-Id: If3eb450782a595cf85d04a2c2e9cc732564e65e6
Gerrit-PatchSet: 2
Gerrit-Project: asterixdb
Gerrit-Branch: master
Gerrit-Owner: Chris Hillery 
Gerrit-Reviewer: Chris Hillery 
Gerrit-Reviewer: Jenkins 
Gerrit-HasComments: No

Change in asterixdb[master]: Added NCServiceExecutionIT and programmatic NCService deploy...

2016-06-24 Thread Chris Hillery (Code Review) 
Chris Hillery has posted comments on this change.

Change subject: Added NCServiceExecutionIT and programmatic NCService 
deployment control.
..


Patch Set 2:

I do not believe the cross-project changes here are dangerous. Largely I 
deleted VirtualClusterDriver which was unused by Asterix or VXQuery. I also 
deleted the now-unused toCommandLine() methods on CCConfig and NCConfig. There 
are API changes in HyracksCCProcess and HyracksNCProcess, but those classes 
were unused outside of VirtualClusterDriver.

-- 
To view, visit https://asterix-gerrit.ics.uci.edu/958
To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings

Gerrit-MessageType: comment
Gerrit-Change-Id: If3eb450782a595cf85d04a2c2e9cc732564e65e6
Gerrit-PatchSet: 2
Gerrit-Project: asterixdb
Gerrit-Branch: master
Gerrit-Owner: Chris Hillery 
Gerrit-Reviewer: Chris Hillery 
Gerrit-Reviewer: Jenkins 
Gerrit-HasComments: No

Change in asterixdb[master]: Added NCServiceExecutionIT and programmatic NCService deploy...

2016-06-24 Thread Chris Hillery (Code Review) 
Chris Hillery has uploaded a new patch set (#2).

Change subject: Added NCServiceExecutionIT and programmatic NCService 
deployment control.
..

Added NCServiceExecutionIT and programmatic NCService deployment control.

NCServiceExecutionIT runs all execution tests against a local cluster
managed by the NCService deployment framework.

Programmatic NCService control comprises new HyracksVirtualCluster class
and improved HyracksNCProcess/HyracksCCProcess.

Further fixes and improvements:

1. Fix handling of iodevices/storagedir
2. Proper handling of [nc] default section in all cases
3. Ensure asterixnc, etc. scripts are executable
4. Consolidate Ini handling
5. Pruned some dead code, including VirtualClusterDriver
6. A bit of refactoring and extended commenting

Change-Id: If3eb450782a595cf85d04a2c2e9cc732564e65e6
---
M 
asterixdb/asterix-common/src/main/java/org/apache/asterix/common/config/AsterixMetadataProperties.java
M 
asterixdb/asterix-common/src/main/java/org/apache/asterix/common/config/AsterixPropertiesAccessor.java
M asterixdb/asterix-server/pom.xml
A 
asterixdb/asterix-server/src/test/java/org/apache/asterix/server/test/NCServiceExecutionIT.java
A asterixdb/asterix-server/src/test/resources/NCServiceExecutionIT/cc.conf
A 
asterixdb/asterix-server/src/test/resources/NCServiceExecutionIT/ncservice1.conf
A 
asterixdb/asterix-server/src/test/resources/NCServiceExecutionIT/ncservice2.conf
M 
hyracks-fullstack/hyracks/hyracks-control/hyracks-control-cc/src/main/java/org/apache/hyracks/control/cc/ClusterControllerService.java
M 
hyracks-fullstack/hyracks/hyracks-control/hyracks-control-cc/src/main/java/org/apache/hyracks/control/cc/work/TriggerNCWork.java
M 
hyracks-fullstack/hyracks/hyracks-control/hyracks-control-common/src/main/java/org/apache/hyracks/control/common/application/IniApplicationConfig.java
M 
hyracks-fullstack/hyracks/hyracks-control/hyracks-control-common/src/main/java/org/apache/hyracks/control/common/controllers/CCConfig.java
M 
hyracks-fullstack/hyracks/hyracks-control/hyracks-control-common/src/main/java/org/apache/hyracks/control/common/controllers/IniUtils.java
M 
hyracks-fullstack/hyracks/hyracks-control/hyracks-control-common/src/main/java/org/apache/hyracks/control/common/controllers/NCConfig.java
M 
hyracks-fullstack/hyracks/hyracks-control/hyracks-nc-service/src/main/java/org/apache/hyracks/control/nc/service/NCService.java
M hyracks-fullstack/hyracks/hyracks-server/pom.xml
D 
hyracks-fullstack/hyracks/hyracks-server/src/main/java/org/apache/hyracks/server/drivers/VirtualClusterDriver.java
M 
hyracks-fullstack/hyracks/hyracks-server/src/main/java/org/apache/hyracks/server/process/HyracksCCProcess.java
M 
hyracks-fullstack/hyracks/hyracks-server/src/main/java/org/apache/hyracks/server/process/HyracksNCProcess.java
M 
hyracks-fullstack/hyracks/hyracks-server/src/main/java/org/apache/hyracks/server/process/HyracksServerProcess.java
A 
hyracks-fullstack/hyracks/hyracks-server/src/main/java/org/apache/hyracks/server/process/HyracksVirtualCluster.java
M 
hyracks-fullstack/hyracks/hyracks-server/src/test/java/org/apache/hyracks/server/test/NCServiceIT.java
M hyracks-fullstack/hyracks/hyracks-server/src/test/resources/logging.properties
22 files changed, 536 insertions(+), 369 deletions(-)


  git pull ssh://asterix-gerrit.ics.uci.edu:29418/asterixdb 
refs/changes/58/958/2
-- 
To view, visit https://asterix-gerrit.ics.uci.edu/958
To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings

Gerrit-MessageType: newpatchset
Gerrit-Change-Id: If3eb450782a595cf85d04a2c2e9cc732564e65e6
Gerrit-PatchSet: 2
Gerrit-Project: asterixdb
Gerrit-Branch: master
Gerrit-Owner: Chris Hillery 
Gerrit-Reviewer: Jenkins

Change in asterixdb[master]: Added NCServiceExecutionIT and implemented several fixes.

2016-06-24 Thread Jenkins (Code Review) 
Jenkins has posted comments on this change.

Change subject: Added NCServiceExecutionIT and implemented several fixes.
..


Patch Set 1:

WARNING: THIS CHANGE CONTAINS CROSS-PRODUCT CHANGES IN:
* asterixdb
* hyracks-fullstack

PLEASE REVIEW CAREFULLY AND LOOK FOR API CHANGES!

-- 
To view, visit https://asterix-gerrit.ics.uci.edu/958
To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings

Gerrit-MessageType: comment
Gerrit-Change-Id: If3eb450782a595cf85d04a2c2e9cc732564e65e6
Gerrit-PatchSet: 1
Gerrit-Project: asterixdb
Gerrit-Branch: master
Gerrit-Owner: Chris Hillery 
Gerrit-Reviewer: Jenkins 
Gerrit-HasComments: No

Change in asterixdb[master]: Added NCServiceExecutionIT and implemented several fixes.

2016-06-24 Thread Jenkins (Code Review) 
Jenkins has posted comments on this change.

Change subject: Added NCServiceExecutionIT and implemented several fixes.
..


Patch Set 1:

Build Started 
https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-notopic/1733/

-- 
To view, visit https://asterix-gerrit.ics.uci.edu/958
To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings

Gerrit-MessageType: comment
Gerrit-Change-Id: If3eb450782a595cf85d04a2c2e9cc732564e65e6
Gerrit-PatchSet: 1
Gerrit-Project: asterixdb
Gerrit-Branch: master
Gerrit-Owner: Chris Hillery 
Gerrit-Reviewer: Jenkins 
Gerrit-HasComments: No

Change in asterixdb[master]: Added NCServiceExecutionIT and implemented several fixes.

2016-06-24 Thread Chris Hillery (Code Review) 
Chris Hillery has uploaded a new change for review.

  https://asterix-gerrit.ics.uci.edu/958

Change subject: Added NCServiceExecutionIT and implemented several fixes.
..

Added NCServiceExecutionIT and implemented several fixes.

1. Fix handling of iodevices/storagedir
2. Proper handling of [nc] default section in all cases
3. Consolidate Ini handling
4. Pruned some dead code, and a bit of refactoring

Change-Id: If3eb450782a595cf85d04a2c2e9cc732564e65e6
---
M 
asterixdb/asterix-common/src/main/java/org/apache/asterix/common/config/AsterixMetadataProperties.java
M 
asterixdb/asterix-common/src/main/java/org/apache/asterix/common/config/AsterixPropertiesAccessor.java
M asterixdb/asterix-server/pom.xml
A 
asterixdb/asterix-server/src/test/java/org/apache/asterix/server/test/NCServiceExecutionIT.java
A asterixdb/asterix-server/src/test/resources/NCServiceExecutionIT/cc.conf
A 
asterixdb/asterix-server/src/test/resources/NCServiceExecutionIT/ncservice1.conf
A 
asterixdb/asterix-server/src/test/resources/NCServiceExecutionIT/ncservice2.conf
M 
hyracks-fullstack/hyracks/hyracks-control/hyracks-control-cc/src/main/java/org/apache/hyracks/control/cc/ClusterControllerService.java
M 
hyracks-fullstack/hyracks/hyracks-control/hyracks-control-cc/src/main/java/org/apache/hyracks/control/cc/work/TriggerNCWork.java
M 
hyracks-fullstack/hyracks/hyracks-control/hyracks-control-common/src/main/java/org/apache/hyracks/control/common/application/IniApplicationConfig.java
M 
hyracks-fullstack/hyracks/hyracks-control/hyracks-control-common/src/main/java/org/apache/hyracks/control/common/controllers/CCConfig.java
M 
hyracks-fullstack/hyracks/hyracks-control/hyracks-control-common/src/main/java/org/apache/hyracks/control/common/controllers/IniUtils.java
M 
hyracks-fullstack/hyracks/hyracks-control/hyracks-control-common/src/main/java/org/apache/hyracks/control/common/controllers/NCConfig.java
M 
hyracks-fullstack/hyracks/hyracks-control/hyracks-nc-service/src/main/java/org/apache/hyracks/control/nc/service/NCService.java
M hyracks-fullstack/hyracks/hyracks-server/pom.xml
D 
hyracks-fullstack/hyracks/hyracks-server/src/main/java/org/apache/hyracks/server/drivers/VirtualClusterDriver.java
M 
hyracks-fullstack/hyracks/hyracks-server/src/main/java/org/apache/hyracks/server/process/HyracksCCProcess.java
M 
hyracks-fullstack/hyracks/hyracks-server/src/main/java/org/apache/hyracks/server/process/HyracksNCProcess.java
M 
hyracks-fullstack/hyracks/hyracks-server/src/main/java/org/apache/hyracks/server/process/HyracksServerProcess.java
A 
hyracks-fullstack/hyracks/hyracks-server/src/main/java/org/apache/hyracks/server/process/HyracksVirtualCluster.java
M 
hyracks-fullstack/hyracks/hyracks-server/src/test/java/org/apache/hyracks/server/test/NCServiceIT.java
M hyracks-fullstack/hyracks/hyracks-server/src/test/resources/logging.properties
22 files changed, 536 insertions(+), 369 deletions(-)


  git pull ssh://asterix-gerrit.ics.uci.edu:29418/asterixdb 
refs/changes/58/958/1

diff --git 
a/asterixdb/asterix-common/src/main/java/org/apache/asterix/common/config/AsterixMetadataProperties.java
 
b/asterixdb/asterix-common/src/main/java/org/apache/asterix/common/config/AsterixMetadataProperties.java
index 9a8fba4..677fc78 100644
--- 
a/asterixdb/asterix-common/src/main/java/org/apache/asterix/common/config/AsterixMetadataProperties.java
+++ 
b/asterixdb/asterix-common/src/main/java/org/apache/asterix/common/config/AsterixMetadataProperties.java
@@ -39,7 +39,7 @@
 }
 
 public ClusterPartition getMetadataPartition() {
-return accessor.getMetadataPartiton();
+return accessor.getMetadataPartition();
 }
 
 public Map getStores() {
diff --git 
a/asterixdb/asterix-common/src/main/java/org/apache/asterix/common/config/AsterixPropertiesAccessor.java
 
b/asterixdb/asterix-common/src/main/java/org/apache/asterix/common/config/AsterixPropertiesAccessor.java
index 507a393..7309f0c 100644
--- 
a/asterixdb/asterix-common/src/main/java/org/apache/asterix/common/config/AsterixPropertiesAccessor.java
+++ 
b/asterixdb/asterix-common/src/main/java/org/apache/asterix/common/config/AsterixPropertiesAccessor.java
@@ -18,6 +18,7 @@
  */
 package org.apache.asterix.common.config;
 
+import java.io.File;
 import java.io.FileInputStream;
 import java.io.FileNotFoundException;
 import java.io.IOException;
@@ -53,10 +54,12 @@
 private final List nodeNames = new ArrayList<>();;
 private final Map stores = new HashMap<>();;
 private final Map coredumpConfig = new HashMap<>();
+
+// This can be removed when asterix-configuration.xml is no longer 
required.
 private final Map asterixConfigurationParams;
 private final IApplicationConfig cfg;
 private final Map transactionLogDirs = new HashMap<>();
-private final Map

[jira] [Commented] (ASTERIXDB-1498) Failed to open index with resource ID after a failed query

2016-06-24 Thread Yingyi Bu (JIRA) 

[ 
https://issues.apache.org/jira/browse/ASTERIXDB-1498?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15347868#comment-15347868
 ] 

Yingyi Bu commented on ASTERIXDB-1498:
--

A too many open file exception can also trigger this.

> Failed to open index with resource ID after a failed query
> --
>
> Key: ASTERIXDB-1498
> URL: https://issues.apache.org/jira/browse/ASTERIXDB-1498
> Project: Apache AsterixDB
>  Issue Type: Bug
>  Components: Metadata
>Reporter: Yingyi Bu
>Assignee: Murtadha Hubail
>
> There is a read query failed and then I run into the following exception:
> {noformat}
> Caused by: org.apache.hyracks.api.exceptions.HyracksDataException: Failed to 
> open index with resource ID 7 since it does not exist.
> at 
> org.apache.asterix.common.context.DatasetLifecycleManager.open(DatasetLifecycleManager.java:191)
> at 
> org.apache.asterix.metadata.MetadataNode.searchIndex(MetadataNode.java:1021)
> at 
> org.apache.asterix.metadata.MetadataNode.getFunction(MetadataNode.java:879)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at 
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
> at 
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> at java.lang.reflect.Method.invoke(Method.java:498)
> at sun.rmi.server.UnicastServerRef.dispatch(UnicastServerRef.java:324)
> at sun.rmi.transport.Transport$1.run(Transport.java:200)
> at sun.rmi.transport.Transport$1.run(Transport.java:197)
> at java.security.AccessController.doPrivileged(Native Method)
> at sun.rmi.transport.Transport.serviceCall(Transport.java:196)
> at 
> sun.rmi.transport.tcp.TCPTransport.handleMessages(TCPTransport.java:568)
> at 
> sun.rmi.transport.tcp.TCPTransport$ConnectionHandler.run0(TCPTransport.java:826)
> at 
> sun.rmi.transport.tcp.TCPTransport$ConnectionHandler.lambda$run$0(TCPTransport.java:683)
> at java.security.AccessController.doPrivileged(Native Method)
> at 
> sun.rmi.transport.tcp.TCPTransport$ConnectionHandler.run(TCPTransport.java:682)
> at 
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
> at 
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
> ... 1 more
> {noformat}
> What could be possible reasons leading to this?



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)