Apache-Phoenix | Master | Hadoop1 | Build Successful

2014-08-05 Thread Apache Jenkins Server 
Master branch build status Successful
Source repository https://git-wip-us.apache.org/repos/asf/incubator-phoenix.git

Last Successful Compiled Artifacts https://builds.apache.org/job/Phoenix-master-hadoop1/lastSuccessfulBuild/artifact/

Last Complete Test Report https://builds.apache.org/job/Phoenix-master-hadoop1/lastCompletedBuild/testReport/

Changes
[jtaylor] Lower log level of static tracing initialization failure to warning

[jtaylor] PHOENIX-1137 SkipScanFilter.intersect not called for aggregate queries (Lars Hofhansl)

Apache-Phoenix | 4.0 | Hadoop1 | Build Successful

2014-08-05 Thread Apache Jenkins Server 
4.0 branch build status Successful

Source repository https://git-wip-us.apache.org/repos/asf/incubator-phoenix.git

Compiled Artifacts https://builds.apache.org/job/Phoenix-4.0-hadoop1/lastSuccessfulBuild/artifact/

Test Report https://builds.apache.org/job/Phoenix-4.0-hadoop1/lastCompletedBuild/testReport/

Changes
[jtaylor] Lower log level of static tracing initialization failure to warning

[jtaylor] PHOENIX-1137 SkipScanFilter.intersect not called for aggregate queries (Lars Hofhansl)

Apache-Phoenix | 3.0 | Hadoop1 | Build Successful

2014-08-05 Thread Apache Jenkins Server 
3.0 branch build status Successful
Source repository https://git-wip-us.apache.org/repos/asf/phoenix.git

Last Successful Compiled Artifacts https://builds.apache.org/job/Phoenix-3.0-hadoop1/lastSuccessfulBuild/artifact/

Last Complete Test Report https://builds.apache.org/job/Phoenix-3.0-hadoop1/lastCompletedBuild/testReport/

Changes
[jtaylor] Removing unused imports and tagging methods with override

[jtaylor] PHOENIX-1137 SkipScanFilter.intersect not called for aggregate queries (Lars Hofhansl)

git commit: PHOENIX-1136 Add Integration Tests to verify the fix for PHOENIX-1133 (Kyle Buzsaki)

2014-08-05 Thread jamestaylor 
Repository: phoenix
Updated Branches:
  refs/heads/3.0 defbd3477 -> b951f85bd


PHOENIX-1136 Add Integration Tests to verify the fix for PHOENIX-1133 (Kyle 
Buzsaki)


Project: http://git-wip-us.apache.org/repos/asf/phoenix/repo
Commit: http://git-wip-us.apache.org/repos/asf/phoenix/commit/b951f85b
Tree: http://git-wip-us.apache.org/repos/asf/phoenix/tree/b951f85b
Diff: http://git-wip-us.apache.org/repos/asf/phoenix/diff/b951f85b

Branch: refs/heads/3.0
Commit: b951f85bd63d19118c5f2232e010bc9ba1b61c6c
Parents: defbd34
Author: James Taylor 
Authored: Tue Aug 5 08:42:36 2014 -0700
Committer: James Taylor 
Committed: Tue Aug 5 08:42:36 2014 -0700

--
 .../end2end/SkipScanAfterManualSplitIT.java | 250 +++
 1 file changed, 199 insertions(+), 51 deletions(-)
--


http://git-wip-us.apache.org/repos/asf/phoenix/blob/b951f85b/phoenix-core/src/it/java/org/apache/phoenix/end2end/SkipScanAfterManualSplitIT.java
--
diff --git 
a/phoenix-core/src/it/java/org/apache/phoenix/end2end/SkipScanAfterManualSplitIT.java
 
b/phoenix-core/src/it/java/org/apache/phoenix/end2end/SkipScanAfterManualSplitIT.java
index 71fa620..764d1e2 100644
--- 
a/phoenix-core/src/it/java/org/apache/phoenix/end2end/SkipScanAfterManualSplitIT.java
+++ 
b/phoenix-core/src/it/java/org/apache/phoenix/end2end/SkipScanAfterManualSplitIT.java
@@ -18,13 +18,16 @@
 package org.apache.phoenix.end2end;
 
 import static org.junit.Assert.assertEquals;
+import static org.junit.Assert.assertFalse;
 import static org.junit.Assert.assertNotEquals;
 import static org.junit.Assert.assertTrue;
 
+import java.nio.ByteBuffer;
 import java.sql.Connection;
 import java.sql.DriverManager;
 import java.sql.PreparedStatement;
 import java.sql.ResultSet;
+import java.sql.SQLException;
 import java.util.List;
 import java.util.Map;
 
@@ -67,7 +70,10 @@ public class SkipScanAfterManualSplitIT extends 
BaseHBaseManagedTimeIT {
 @Shadower(classBeingShadowed = BaseHBaseManagedTimeIT.class)
 public static void doSetup() throws Exception {
 Map props = Maps.newHashMapWithExpectedSize(2);
-props.put(QueryServices.THREAD_POOL_SIZE_ATTRIB, Integer.toString(32));
+// needed for 64 region parallelization due to splitting
+props.put(QueryServices.THREAD_POOL_SIZE_ATTRIB, Integer.toString(64));
+// enables manual splitting on salted tables
+props.put(QueryServices.ROW_KEY_ORDER_SALTED_TABLE_ATTRIB, 
Boolean.toString(false));
 props.put(QueryServices.QUEUE_SIZE_ATTRIB, Integer.toString(1000));
 setUpTestDriver(getUrl(), new 
ReadOnlyProps(props.entrySet().iterator()));
 }
@@ -155,61 +161,203 @@ public class SkipScanAfterManualSplitIT extends 
BaseHBaseManagedTimeIT {
 }
 
 }
+
 
-/* HBase-level repro of above issue. I believe the two scans need
- * to be issued in parallel to repro (that's the only difference
- * with the above tests).
+/**
+ * The length of the row keys used for this test. Needed to create split 
points.
+ */
+private static final int REGION_BOUND_LENGTH_BYTES = 54;
+
+/**
+ * Takes the given byteArrays and concatenates them in a buffer of length 
+ * #REGION_BOUND_LENGTH_BYTES. if the byte arrays have a combined length 
of less than 
+ * #REGION_BOUND_LENGTH_BYTES, pads with zeros. if they have a combined 
length of greater
+ * than the limit, throws a BufferOverflowException.
+ * @param byteArrays  the byte arrays to concatenate in the row key buffer
+ * @return  the final resulting row key. 
+ */
+private static byte[] bytesToRowKey(byte[]... byteArrays) {
+ByteBuffer buffer = ByteBuffer.allocate(REGION_BOUND_LENGTH_BYTES);
+
+for(byte[] byteArray : byteArrays) {
+buffer.put(byteArray);
+}
+
+return buffer.array();
+}
+
+/**
+ * Creates a region boundary at the given row key values. Follows the 
schema used in
+ * #testSkipScanIntersectStateReset().
+ * @param salt  this region's salt byte
+ * @param orgId  the first row key value, a string of length 15
+ * @param parentId  the second row key value, a string of length 15
+ * @param invertedDate  the long timestamp of a date value, with the sign 
bit flipped
+ * @param entityId  the final row key value, a string of length 15
+ * @return  the region boundary found at these row key values
+ */
+private static byte[] getRegionBoundary(int salt, String orgId, String 
parentId, long invertedDate, String entityId) {
+return bytesToRowKey(new byte[] {(byte)salt}, Bytes.toBytes(orgId), 
Bytes.toBytes(parentId), Bytes.toBytes(invertedDate), Bytes.toBytes(entityId));
+}
+
+/**
+ * Creates a region boundary at the given sa

git commit: PHOENIX-1136 Add Integration Tests to verify the fix for PHOENIX-1133 (Kyle Buzsaki)

2014-08-05 Thread jamestaylor 
Repository: phoenix
Updated Branches:
  refs/heads/4.0 ee4725385 -> e33155eae


PHOENIX-1136 Add Integration Tests to verify the fix for PHOENIX-1133 (Kyle 
Buzsaki)

Conflicts:

phoenix-core/src/it/java/org/apache/phoenix/end2end/SkipScanAfterManualSplitIT.java


Project: http://git-wip-us.apache.org/repos/asf/phoenix/repo
Commit: http://git-wip-us.apache.org/repos/asf/phoenix/commit/e33155ea
Tree: http://git-wip-us.apache.org/repos/asf/phoenix/tree/e33155ea
Diff: http://git-wip-us.apache.org/repos/asf/phoenix/diff/e33155ea

Branch: refs/heads/4.0
Commit: e33155eae1b2ae034a3eb611bf7cbaa471d7f46c
Parents: ee47253
Author: James Taylor 
Authored: Tue Aug 5 08:42:36 2014 -0700
Committer: James Taylor 
Committed: Tue Aug 5 08:49:25 2014 -0700

--
 .../end2end/SkipScanAfterManualSplitIT.java | 363 +++
 1 file changed, 363 insertions(+)
--


http://git-wip-us.apache.org/repos/asf/phoenix/blob/e33155ea/phoenix-core/src/it/java/org/apache/phoenix/end2end/SkipScanAfterManualSplitIT.java
--
diff --git 
a/phoenix-core/src/it/java/org/apache/phoenix/end2end/SkipScanAfterManualSplitIT.java
 
b/phoenix-core/src/it/java/org/apache/phoenix/end2end/SkipScanAfterManualSplitIT.java
new file mode 100644
index 000..764d1e2
--- /dev/null
+++ 
b/phoenix-core/src/it/java/org/apache/phoenix/end2end/SkipScanAfterManualSplitIT.java
@@ -0,0 +1,363 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements.  See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership.  The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * "License"); you may not use this file except in compliance
+ * with the License.  You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+package org.apache.phoenix.end2end;
+
+import static org.junit.Assert.assertEquals;
+import static org.junit.Assert.assertFalse;
+import static org.junit.Assert.assertNotEquals;
+import static org.junit.Assert.assertTrue;
+
+import java.nio.ByteBuffer;
+import java.sql.Connection;
+import java.sql.DriverManager;
+import java.sql.PreparedStatement;
+import java.sql.ResultSet;
+import java.sql.SQLException;
+import java.util.List;
+import java.util.Map;
+
+import org.apache.hadoop.hbase.HRegionLocation;
+import org.apache.hadoop.hbase.HTableDescriptor;
+import org.apache.hadoop.hbase.client.HBaseAdmin;
+import org.apache.hadoop.hbase.util.Bytes;
+import org.apache.phoenix.jdbc.PhoenixConnection;
+import org.apache.phoenix.query.ConnectionQueryServices;
+import org.apache.phoenix.query.QueryServices;
+import org.apache.phoenix.util.ReadOnlyProps;
+import org.junit.BeforeClass;
+import org.junit.Ignore;
+import org.junit.Test;
+import org.junit.experimental.categories.Category;
+
+import com.google.common.collect.Lists;
+import com.google.common.collect.Maps;
+
+@Category(HBaseManagedTimeTest.class)
+public class SkipScanAfterManualSplitIT extends BaseHBaseManagedTimeIT {
+
+private static final int BATCH_SIZE = 25;
+private static final int MAX_FILESIZE = 1024 * 10;
+private static final int PAYLOAD_SIZE = 1024;
+private static final String PAYLOAD;
+static {
+StringBuilder buf = new StringBuilder();
+for (int i = 0; i < PAYLOAD_SIZE; i++) {
+buf.append('a');
+}
+PAYLOAD = buf.toString();
+}
+private static final String TABLE_NAME = "S";
+private static final byte[] TABLE_NAME_BYTES = Bytes.toBytes(TABLE_NAME);
+private static final int MIN_CHAR = 'a';
+private static final int MAX_CHAR = 'z';
+
+@BeforeClass
+@Shadower(classBeingShadowed = BaseHBaseManagedTimeIT.class)
+public static void doSetup() throws Exception {
+Map props = Maps.newHashMapWithExpectedSize(2);
+// needed for 64 region parallelization due to splitting
+props.put(QueryServices.THREAD_POOL_SIZE_ATTRIB, Integer.toString(64));
+// enables manual splitting on salted tables
+props.put(QueryServices.ROW_KEY_ORDER_SALTED_TABLE_ATTRIB, 
Boolean.toString(false));
+props.put(QueryServices.QUEUE_SIZE_ATTRIB, Integer.toString(1000));
+setUpTestDriver(getUrl(), new 
ReadOnlyProps(props.entrySet().iterator()));
+}
+
+private static void initTable() throws Exception {
+Connection conn = DriverManager.getConnection(getUrl());
+

git commit: PHOENIX-1136 Add Integration Tests to verify the fix for PHOENIX-1133 (Kyle Buzsaki)

2014-08-05 Thread jamestaylor 
Repository: phoenix
Updated Branches:
  refs/heads/master 4493b9c0a -> b2fb7b41f


PHOENIX-1136 Add Integration Tests to verify the fix for PHOENIX-1133 (Kyle 
Buzsaki)

Conflicts:

phoenix-core/src/it/java/org/apache/phoenix/end2end/SkipScanAfterManualSplitIT.java


Project: http://git-wip-us.apache.org/repos/asf/phoenix/repo
Commit: http://git-wip-us.apache.org/repos/asf/phoenix/commit/b2fb7b41
Tree: http://git-wip-us.apache.org/repos/asf/phoenix/tree/b2fb7b41
Diff: http://git-wip-us.apache.org/repos/asf/phoenix/diff/b2fb7b41

Branch: refs/heads/master
Commit: b2fb7b41f98641410b43f702940bb6ff192a7986
Parents: 4493b9c
Author: James Taylor 
Authored: Tue Aug 5 08:42:36 2014 -0700
Committer: James Taylor 
Committed: Tue Aug 5 08:52:57 2014 -0700

--
 .../end2end/SkipScanAfterManualSplitIT.java | 363 +++
 1 file changed, 363 insertions(+)
--


http://git-wip-us.apache.org/repos/asf/phoenix/blob/b2fb7b41/phoenix-core/src/it/java/org/apache/phoenix/end2end/SkipScanAfterManualSplitIT.java
--
diff --git 
a/phoenix-core/src/it/java/org/apache/phoenix/end2end/SkipScanAfterManualSplitIT.java
 
b/phoenix-core/src/it/java/org/apache/phoenix/end2end/SkipScanAfterManualSplitIT.java
new file mode 100644
index 000..764d1e2
--- /dev/null
+++ 
b/phoenix-core/src/it/java/org/apache/phoenix/end2end/SkipScanAfterManualSplitIT.java
@@ -0,0 +1,363 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements.  See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership.  The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * "License"); you may not use this file except in compliance
+ * with the License.  You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+package org.apache.phoenix.end2end;
+
+import static org.junit.Assert.assertEquals;
+import static org.junit.Assert.assertFalse;
+import static org.junit.Assert.assertNotEquals;
+import static org.junit.Assert.assertTrue;
+
+import java.nio.ByteBuffer;
+import java.sql.Connection;
+import java.sql.DriverManager;
+import java.sql.PreparedStatement;
+import java.sql.ResultSet;
+import java.sql.SQLException;
+import java.util.List;
+import java.util.Map;
+
+import org.apache.hadoop.hbase.HRegionLocation;
+import org.apache.hadoop.hbase.HTableDescriptor;
+import org.apache.hadoop.hbase.client.HBaseAdmin;
+import org.apache.hadoop.hbase.util.Bytes;
+import org.apache.phoenix.jdbc.PhoenixConnection;
+import org.apache.phoenix.query.ConnectionQueryServices;
+import org.apache.phoenix.query.QueryServices;
+import org.apache.phoenix.util.ReadOnlyProps;
+import org.junit.BeforeClass;
+import org.junit.Ignore;
+import org.junit.Test;
+import org.junit.experimental.categories.Category;
+
+import com.google.common.collect.Lists;
+import com.google.common.collect.Maps;
+
+@Category(HBaseManagedTimeTest.class)
+public class SkipScanAfterManualSplitIT extends BaseHBaseManagedTimeIT {
+
+private static final int BATCH_SIZE = 25;
+private static final int MAX_FILESIZE = 1024 * 10;
+private static final int PAYLOAD_SIZE = 1024;
+private static final String PAYLOAD;
+static {
+StringBuilder buf = new StringBuilder();
+for (int i = 0; i < PAYLOAD_SIZE; i++) {
+buf.append('a');
+}
+PAYLOAD = buf.toString();
+}
+private static final String TABLE_NAME = "S";
+private static final byte[] TABLE_NAME_BYTES = Bytes.toBytes(TABLE_NAME);
+private static final int MIN_CHAR = 'a';
+private static final int MAX_CHAR = 'z';
+
+@BeforeClass
+@Shadower(classBeingShadowed = BaseHBaseManagedTimeIT.class)
+public static void doSetup() throws Exception {
+Map props = Maps.newHashMapWithExpectedSize(2);
+// needed for 64 region parallelization due to splitting
+props.put(QueryServices.THREAD_POOL_SIZE_ATTRIB, Integer.toString(64));
+// enables manual splitting on salted tables
+props.put(QueryServices.ROW_KEY_ORDER_SALTED_TABLE_ATTRIB, 
Boolean.toString(false));
+props.put(QueryServices.QUEUE_SIZE_ATTRIB, Integer.toString(1000));
+setUpTestDriver(getUrl(), new 
ReadOnlyProps(props.entrySet().iterator()));
+}
+
+private static void initTable() throws Exception {
+Connection conn = DriverManager.getConnection(getUrl());

Apache-Phoenix | 3.0 | Hadoop1 | Build Successful

2014-08-05 Thread Apache Jenkins Server 
3.0 branch build status Successful
Source repository https://git-wip-us.apache.org/repos/asf/phoenix.git

Last Successful Compiled Artifacts https://builds.apache.org/job/Phoenix-3.0-hadoop1/lastSuccessfulBuild/artifact/

Last Complete Test Report https://builds.apache.org/job/Phoenix-3.0-hadoop1/lastCompletedBuild/testReport/

Changes
[jtaylor] PHOENIX-1136 Add Integration Tests to verify the fix for PHOENIX-1133 (Kyle Buzsaki)

Jenkins build became unstable: Phoenix | Master | Hadoop1 #316

2014-08-05 Thread Apache Jenkins Server 
See

Apache-Phoenix | 4.0 | Hadoop1 | Build Successful

2014-08-05 Thread Apache Jenkins Server 
4.0 branch build status Successful

Source repository https://git-wip-us.apache.org/repos/asf/incubator-phoenix.git

Compiled Artifacts https://builds.apache.org/job/Phoenix-4.0-hadoop1/lastSuccessfulBuild/artifact/

Test Report https://builds.apache.org/job/Phoenix-4.0-hadoop1/lastCompletedBuild/testReport/

Changes
[jtaylor] PHOENIX-1136 Add Integration Tests to verify the fix for PHOENIX-1133 (Kyle Buzsaki)

svn commit: r1616086 - in /phoenix/site: publish/language/index.html publish/secondary_indexing.html source/src/site/markdown/secondary_indexing.md

2014-08-05 Thread rajeshbabu 
Author: rajeshbabu
Date: Wed Aug  6 03:54:07 2014
New Revision: 1616086

URL: http://svn.apache.org/r1616086
Log:
PHOENIX-1086 Document local indexes(Rajesh)

Modified:
phoenix/site/publish/language/index.html
phoenix/site/publish/secondary_indexing.html
phoenix/site/source/src/site/markdown/secondary_indexing.md

Modified: phoenix/site/publish/language/index.html
URL: 
http://svn.apache.org/viewvc/phoenix/site/publish/language/index.html?rev=1616086&r1=1616085&r2=1616086&view=diff
==
--- phoenix/site/publish/language/index.html (original)
+++ phoenix/site/publish/language/index.html Wed Aug  6 03:54:07 2014
@@ -650,7 +650,7 @@ ON tableR
 [indexOptions] [ SPLIT ON ( splitPoint [,...] ) ]
 
 
-CREATE INDEX IF NOT EXISTSindexNameON tableRef ( columnRef ASCDESC , ...) INCLUDE ( columnRef , ...) indexOptions SPLIT ON ( splitPoint , 
...)
+CREATE INDEX LOCAL IF NOT EXISTSindexNameON tableRef ( columnRef ASCDESC , ...) INCLUDE ( columnRef , ...) indexOptions SPLIT ON ( splitPoint , ...)
 
 
 
 Creates a new secondary index on a table or view. The index will be 
automatically kept in sync with the table as the data changes. At query time, 
the optimizer will use the index if it contains all columns referenced in the 
query and produces the most efficient execution plan. If a table has rows that 
are write-once and append-only, then the table may set the 
IMMUTABLE_ROWS property to true (either up-front in the 
CREATE TABLE statement or afterwards in an ALTER 
TABLE statement). This reduces the overhead at write time to maintain 
the index. Otherwise, if this property is not set on the table, then 
incremental index maintenance will be performed on the server side when the 
data changes.
 Example:
 
-CREATE INDEX my_idx ON sales.opportunity(last_updated_date DESC)CREATE 
INDEX my_idx ON log.event(created_date DESC) INCLUDE (name, payload) 
SALT_BUCKETS=10CREATE INDEX IF NOT EXISTS my_comp_idx ON server_metrics ( 
gc_time DESC, created_date DESC )DATA_BLOCK_ENCODING='NONE',VERSIONS=?,MAX_FILESIZE=200
 split on (?, ?, ?)
+CREATE INDEX my_idx ON sales.opportunity(last_updated_date DESC)CREATE 
LOCAL INDEX my_idx ON sales.opportunity(last_updated_date DESC)CREATE 
INDEX my_idx ON log.event(created_date DESC) INCLUDE (name, payload) 
SALT_BUCKETS=10CREATE INDEX IF NOT EXISTS my_comp_idx ON server_metrics ( 
gc_time DESC, created_date DESC )DATA_BLOCK_ENCODING='NONE',VERSIONS=?,MAX_FILESIZE=200
 split on (?, ?, ?)
 
 DROP INDEX
 

Modified: phoenix/site/publish/secondary_indexing.html
URL: 
http://svn.apache.org/viewvc/phoenix/site/publish/secondary_indexing.html?rev=1616086&r1=1616085&r2=1616086&view=diff
==
--- phoenix/site/publish/secondary_indexing.html (original)
+++ phoenix/site/publish/secondary_indexing.html Wed Aug  6 03:54:07 2014
@@ -1,7 +1,7 @@
 
 
 
 
@@ -61,14 +61,14 @@
Source Repository
Issue Tracking
Download
-   
+   
http://www.apache.org/licenses/"; title="License" 
class="externalLink">License
http://www.apache.org/foundation/sponsorship.html"; title="Sponsorship" 
class="externalLink">Sponsorship
http://www.apache.org/foundation/thanks.html"; title="Thanks" 
class="externalLink">Thanks
http://www.apache.org/security/"; title="Security" 
class="externalLink">Security


-   
+   
Using 

F.A.Q.
@@ -76,7 +76,7 @@
Building
Tuning
Upgrade from 2.2
-   
+   
Secondary I