[jira] [Commented] (PHOENIX-6059) Adding more pagination tests

2020-08-12 Thread Hudson (Jira)


[ 
https://issues.apache.org/jira/browse/PHOENIX-6059?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17176532#comment-17176532
 ] 

Hudson commented on PHOENIX-6059:
-

FAILURE: Integrated in Jenkins build PreCommit-PHOENIX-Build #4092 (See 
[https://builds.apache.org/job/PreCommit-PHOENIX-Build/4092/])
PHOENIX-6059 Adding more pagination tests (yanxinyi: rev 
8e34b2bf14e5b6c45c7212104768792390cf0d06)
* (add) 
phoenix-core/src/it/java/org/apache/phoenix/end2end/RowValueConstructorOffsetOptionalIT.java


> Adding more pagination tests
> 
>
> Key: PHOENIX-6059
> URL: https://issues.apache.org/jira/browse/PHOENIX-6059
> Project: Phoenix
>  Issue Type: Improvement
>Reporter: Xinyi Yan
>Assignee: Xinyi Yan
>Priority: Minor
> Attachments: PHOENIX-6059.patch
>
>  Time Spent: 40m
>  Remaining Estimate: 0h
>
> Adding more tests for the pagination. Such as single/multiple columns, 
> combination of data types, etc.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (PHOENIX-5958) Diverged view created via an older client still sees dropped column data

2020-08-06 Thread Hudson (Jira)


[ 
https://issues.apache.org/jira/browse/PHOENIX-5958?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17172350#comment-17172350
 ] 

Hudson commented on PHOENIX-5958:
-

FAILURE: Integrated in Jenkins build PreCommit-PHOENIX-Build #4088 (See 
[https://builds.apache.org/job/PreCommit-PHOENIX-Build/4088/])
PHOENIX-5958: Diverged view created via an older client still sees 
(chinmayskulkarni: rev ffeddf55328ac69dac6ee565abec34e1f7002d13)
* (add) phoenix-core/src/it/resources/sql_files/query_add_data.sql
* (add) phoenix-core/src/it/resources/sql_files/create_diverged_view.sql
* (edit) 
phoenix-core/src/main/java/org/apache/phoenix/schema/MetaDataClient.java
* (edit) phoenix-core/src/main/java/org/apache/phoenix/util/ViewUtil.java
* (edit) 
phoenix-core/src/main/java/org/apache/phoenix/coprocessor/ColumnMutator.java
* (edit) phoenix-core/src/main/java/org/apache/phoenix/schema/PTableImpl.java
* (edit) 
phoenix-core/src/main/java/org/apache/phoenix/coprocessor/DropColumnMutator.java
* (add) phoenix-core/src/it/resources/sql_files/query_create_diverged_view.sql
* (delete) phoenix-core/src/it/resources/sql_files/query_more.sql
* (edit) 
phoenix-core/src/main/java/org/apache/phoenix/coprocessor/AddColumnMutator.java
* (delete) phoenix-core/src/it/resources/sql_files/query.sql
* (add) phoenix-core/src/it/resources/sql_files/query_create_add.sql
* (edit) 
phoenix-core/src/it/java/org/apache/phoenix/end2end/BackwardCompatibilityIT.java
* (add) 
phoenix-core/src/it/resources/gold_files/gold_query_create_diverged_view.txt
* (edit) 
phoenix-core/src/main/java/org/apache/phoenix/coprocessor/MetaDataEndpointImpl.java


> Diverged view created via an older client still sees dropped column data
> 
>
> Key: PHOENIX-5958
> URL: https://issues.apache.org/jira/browse/PHOENIX-5958
> Project: Phoenix
>  Issue Type: Bug
>Affects Versions: 5.0.0, 4.15.0
>Reporter: Chinmay Kulkarni
>Assignee: Chinmay Kulkarni
>Priority: Blocker
> Fix For: 5.1.0, 4.16.0
>
> Attachments: PHOENIX-5958-4.x-v2.patch, PHOENIX-5958-4.x-v3.patch
>
>  Time Spent: 40m
>  Remaining Estimate: 0h
>
> By "diverged view" I mean creating a view and then dropping one of the 
> inherited columns from the view. Steps to reproduce:
> Start a 4.x server and connect with a pre-4.15 (I tried a 4.14.3) client
> {code:sql}
> CREATE TABLE IF NOT EXISTS S.T (A INTEGER PRIMARY KEY, B INTEGER);
> CREATE VIEW IF NOT EXISTS S.V (new_col INTEGER) AS SELECT * FROM S.T;
> UPSERT INTO S.T VALUES(1,2);
> ALTER VIEW S.V DROP COLUMN B;
> SELECT * FROM S.T; 
> ++--+
> | A  |  B   |
> ++--+
> | 1  |  2   |
> ++--+
> SELECT * FROM S.V; gives:
> ++--+--+
> | B  |  A   |  NEW_COL |
> ++--+--+
> | 2  |  1   |  null|
> ++--+--+
> {code}
> Though the column 'B' has been dropped from the view. This is a problem for 
> both when phoenix.allow.system.catalog.rollback=true or false. This exact bug 
> does not happen for a 4.x client, though PHOENIX-6030 and PHOENIX-6032 
> highlight other issues related to this code path for 4.x clients. 
>  The problem is mostly due to changes introduced by 
> [PHOENIX-4893|https://issues.apache.org/jira/browse/PHOENIX-4893]



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (PHOENIX-6022) RVC Offset does not handle trailing nulls properly

2020-07-30 Thread Hudson (Jira)


[ 
https://issues.apache.org/jira/browse/PHOENIX-6022?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17167816#comment-17167816
 ] 

Hudson commented on PHOENIX-6022:
-

SUCCESS: Integrated in Jenkins build PreCommit-PHOENIX-Build #4087 (See 
[https://builds.apache.org/job/PreCommit-PHOENIX-Build/4087/])
PHOENIX-6022 RVC Offset does not handle trailing nulls properly (yanxinyi: rev 
ce0de92029efecbfe3be2bd47dfc57e1da7cf6a0)
* (edit) 
phoenix-core/src/it/java/org/apache/phoenix/end2end/RowValueConstructorOffsetIT.java
* (edit) 
phoenix-core/src/main/java/org/apache/phoenix/compile/RVCOffsetCompiler.java
* (edit) 
phoenix-core/src/test/java/org/apache/phoenix/compile/RVCOffsetCompilerTest.java


> RVC Offset does not handle trailing nulls properly
> --
>
> Key: PHOENIX-6022
> URL: https://issues.apache.org/jira/browse/PHOENIX-6022
> Project: Phoenix
>  Issue Type: Bug
>Affects Versions: 4.15.0, 4.16.0
>Reporter: Daniel Wong
>Assignee: Daniel Wong
>Priority: Major
> Fix For: 4.16.0
>
> Attachments: PHOENIX-6022-4.x.patch, PHOENIX-6022-master.patch
>
>  Time Spent: 40m
>  Remaining Estimate: 0h
>
> While working on PHOENIX-5924 found that if there was a trailing null the 
> Phoenix Optimizer during resolution of the miniwhere does not generate a 
> point get due to how we write/handle trailing nulls in the rowkey.  The 
> sanity check that it is a point get therefore fails.  This causes an 
> exception to be returned to the user.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (PHOENIX-6045) Delete that should qualify for index path does not use index when multiple indexes are available.

2020-07-29 Thread Hudson (Jira)


[ 
https://issues.apache.org/jira/browse/PHOENIX-6045?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17167558#comment-17167558
 ] 

Hudson commented on PHOENIX-6045:
-

FAILURE: Integrated in Jenkins build PreCommit-PHOENIX-Build #4085 (See 
[https://builds.apache.org/job/PreCommit-PHOENIX-Build/4085/])
PHOENIX-6045 Delete that should qualify for index path does not use (kozdemir: 
rev bb936d1fee64dc36281c48591e672da671a5878c)
* (edit) 
phoenix-core/src/main/java/org/apache/phoenix/compile/DeleteCompiler.java
* (edit) phoenix-core/src/it/java/org/apache/phoenix/end2end/DeleteIT.java


> Delete that should qualify for index path does not use index when multiple 
> indexes are available.
> -
>
> Key: PHOENIX-6045
> URL: https://issues.apache.org/jira/browse/PHOENIX-6045
> Project: Phoenix
>  Issue Type: Bug
>Affects Versions: 5.0.0, 4.15.0, 4.14.3
>Reporter: Daniel Wong
>Assignee: Kadir OZDEMIR
>Priority: Major
> Fix For: 5.1.0, 4.16.0
>
> Attachments: MultipleDeleteReproIT.java, PHOENIX-6045.4.x.001.patch, 
> PHOENIX-6045.4.x.002.patch
>
>  Time Spent: 50m
>  Remaining Estimate: 0h
>
> Delete that should qualify for index path does not use index when multiple 
> indexes are available.  Test case to reproduce will be below.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (PHOENIX-5986) DropTableWithViewsIT.testDropTableWithChildViews is flapping again

2020-07-25 Thread Hudson (Jira)


[ 
https://issues.apache.org/jira/browse/PHOENIX-5986?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17164940#comment-17164940
 ] 

Hudson commented on PHOENIX-5986:
-

FAILURE: Integrated in Jenkins build PreCommit-PHOENIX-Build #4078 (See 
[https://builds.apache.org/job/PreCommit-PHOENIX-Build/4078/])
PHOENIX-5986 Fix flapping test (giskender: rev 
d17eb0a96ca2467be6791783eb314f90740fa94c)
* (edit) phoenix-core/src/main/java/org/apache/phoenix/schema/task/Task.java
* (edit) 
phoenix-core/src/it/java/org/apache/phoenix/end2end/DropTableWithViewsIT.java
* (edit) 
phoenix-core/src/it/java/org/apache/phoenix/end2end/IndexRebuildTaskIT.java
* (edit) 
phoenix-core/src/it/java/org/apache/phoenix/end2end/SplitSystemCatalogIT.java


> DropTableWithViewsIT.testDropTableWithChildViews is flapping again
> --
>
> Key: PHOENIX-5986
> URL: https://issues.apache.org/jira/browse/PHOENIX-5986
> Project: Phoenix
>  Issue Type: Bug
>Affects Versions: 4.15.0
>Reporter: Chinmay Kulkarni
>Assignee: Gokcen Iskender
>Priority: Major
>  Labels: phoenix-hardening, quality-improvement
> Fix For: 4.16.0
>
> Attachments: PHOENIX-5986.4.x.001.patch, PHOENIX-5986.4.x.002.patch, 
> PHOENIX-5986.4.x.003.patch, PHOENIX-5986.4.x.004.patch, 
> PHOENIX-5986.master.001.patch, PHOENIX-5986.master.002.patch, 
> PHOENIX-5986.master.003.patch, PHOENIX-5986.master.004.patch, 
> PHOENIX-5986.master.005.patch, build-4022-full-console-log.txt, 
> build-4023-full-console-log.txt
>
>  Time Spent: 1.5h
>  Remaining Estimate: 0h
>
> DropTableWithViewsIT.testDropTableWithChildViews is flapping again. I see 
> [PHOENIX-5074|https://issues.apache.org/jira/browse/PHOENIX-5074] fixed this 
> test so that the task is run immediately, but somehow this test is still 
> intermittently failing.
> This has caused recent preCommit failures for PHOENIX-5981 (build 
> [4010|https://builds.apache.org/job/PreCommit-PHOENIX-Build/4010//testReport/])
>  and 
>  PHOENIX-5984 (build 
> [4011|https://builds.apache.org/job/PreCommit-PHOENIX-Build/4011//testReport/]).
> When I run this test locally, it passes sometimes and fails sometimes. This 
> is the relevant stack trace:
> {code:java}
> java.lang.AssertionError
>   at org.junit.Assert.fail(Assert.java:87)
>   at org.junit.Assert.assertTrue(Assert.java:42)
>   at org.junit.Assert.assertFalse(Assert.java:65)
>   at org.junit.Assert.assertFalse(Assert.java:75)
>   at 
> org.apache.phoenix.end2end.DropTableWithViewsIT.testDropTableWithChildViews(DropTableWithViewsIT.java:158)
> {code}
> Failure is observed in [this 
> assertion|https://github.com/apache/phoenix/blob/f5ebf2aaa337d0b4b935f10917cee3d99d621c98/phoenix-core/src/it/java/org/apache/phoenix/end2end/DropTableWithViewsIT.java#L158].
>  I also see that the test sometimes fails because it expects task status to 
> be COMPLETED, but sees status to be STARTED instead.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (PHOENIX-6044) Precommit script over-zealous zombie check may clobber parallel Phoenix test

2020-07-25 Thread Hudson (Jira)


[ 
https://issues.apache.org/jira/browse/PHOENIX-6044?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17164941#comment-17164941
 ] 

Hudson commented on PHOENIX-6044:
-

FAILURE: Integrated in Jenkins build PreCommit-PHOENIX-Build #4078 (See 
[https://builds.apache.org/job/PreCommit-PHOENIX-Build/4078/])
PHOENIX-6044 Precommit script over-zealous zombie check may clobber (stoty: rev 
ce83d74050a8cc1637068f3fb8980e14f9bde611)
* (edit) dev/test-patch.sh


> Precommit script over-zealous zombie check may clobber parallel Phoenix test
> 
>
> Key: PHOENIX-6044
> URL: https://issues.apache.org/jira/browse/PHOENIX-6044
> Project: Phoenix
>  Issue Type: Bug
>Reporter: Istvan Toth
>Assignee: Istvan Toth
>Priority: Major
>  Labels: phoenix-hardening, quality-improvement
> Fix For: 5.1.0
>
>  Time Spent: 20m
>  Remaining Estimate: 0h
>
> The precommit script has a zombie check, that does not take into account the 
> fact that there may be multiple Phoenix "mvn verify" checks running on the 
> same Jenkins worker.
> When the mvn verify of the precommit script finishes, it checks if there are 
> still mvn verify jobs running for Phoenix - finds the processes for the 
> second job - , flags those as Zombies, and kills their processes.
> test-patch.sh 899-922 lines
>  



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (PHOENIX-6013) RVC Offset does not handle coerced literal nulls properly.

2020-07-25 Thread Hudson (Jira)


[ 
https://issues.apache.org/jira/browse/PHOENIX-6013?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17164939#comment-17164939
 ] 

Hudson commented on PHOENIX-6013:
-

FAILURE: Integrated in Jenkins build PreCommit-PHOENIX-Build #4078 (See 
[https://builds.apache.org/job/PreCommit-PHOENIX-Build/4078/])
PHOENIX-6013 RVC Offset does not handle coerced literal nulls properly 
(yanxinyi: rev 66f20fdd5aae30ad36f2772dff1b768e3ef96ab8)
* (edit) 
phoenix-core/src/it/java/org/apache/phoenix/end2end/RowValueConstructorOffsetIT.java
* (edit) 
phoenix-core/src/main/java/org/apache/phoenix/compile/RVCOffsetCompiler.java
* (edit) 
phoenix-core/src/test/java/org/apache/phoenix/compile/RVCOffsetCompilerTest.java


> RVC Offset does not handle coerced literal nulls properly.
> --
>
> Key: PHOENIX-6013
> URL: https://issues.apache.org/jira/browse/PHOENIX-6013
> Project: Phoenix
>  Issue Type: Bug
>Affects Versions: 4.15.0, 4.14.3
>Reporter: Daniel Wong
>Assignee: Daniel Wong
>Priority: Major
> Fix For: 4.16.0
>
> Attachments: PHOENIX-6013-4.x.patch
>
>  Time Spent: 1h 50m
>  Remaining Estimate: 0h
>
> As part of query rewrite paths the offset may go through the A=null gets 
> rewritten to A IS NULL, the code sanity checks against an equality comparison 
> op which is not the case on this rewrite.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (PHOENIX-6023) Wrong result when issuing query for an immutable table with multiple column families

2020-07-25 Thread Hudson (Jira)


[ 
https://issues.apache.org/jira/browse/PHOENIX-6023?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17164938#comment-17164938
 ] 

Hudson commented on PHOENIX-6023:
-

FAILURE: Integrated in Jenkins build PreCommit-PHOENIX-Build #4078 (See 
[https://builds.apache.org/job/PreCommit-PHOENIX-Build/4078/])
PHOENIX-6023 Wrong result when issuing query for an immutable table with 
(stoty: rev 9f10fd0ba156d5a33d9a0e97870328cc667d2627)
* (edit) 
phoenix-core/src/main/java/org/apache/phoenix/compile/WhereCompiler.java


> Wrong result when issuing query for an immutable table with multiple column 
> families
> 
>
> Key: PHOENIX-6023
> URL: https://issues.apache.org/jira/browse/PHOENIX-6023
> Project: Phoenix
>  Issue Type: Bug
>Reporter: Toshihiro Suzuki
>Assignee: Toshihiro Suzuki
>Priority: Major
> Fix For: 5.1.0, 4.16.0
>
> Attachments: PHOENIX-6023-addendum.master.v1.patch, 
> PHOENIX-6023.addendum.master.v2.patch, PHOENIX-6023.master.v3.patch
>
>  Time Spent: 40m
>  Remaining Estimate: 0h
>
> Steps to reproduce are as follows:
> 1. Create an immutable table with multiple column families:
> {code}
> 0: jdbc:phoenix:> CREATE TABLE TEST (
> . . . . . . . . >   ID VARCHAR PRIMARY KEY,
> . . . . . . . . >   A.COL1 VARCHAR,
> . . . . . . . . >   B.COL2 VARCHAR
> . . . . . . . . > ) IMMUTABLE_ROWS = TRUE;
> No rows affected (1.182 seconds)
> {code}
> 2. Upsert some rows:
> {code}
> 0: jdbc:phoenix:> UPSERT INTO TEST VALUES ('id0', '0', 'a');
> 1 row affected (0.138 seconds)
> 0: jdbc:phoenix:> UPSERT INTO TEST VALUES ('id1', '1', NULL);
> 1 row affected (0.009 seconds)
> 0: jdbc:phoenix:> UPSERT INTO TEST VALUES ('id2', '2', 'b');
> 1 row affected (0.011 seconds)
> 0: jdbc:phoenix:> UPSERT INTO TEST VALUES ('id3', '3', NULL);
> 1 row affected (0.007 seconds)
> 0: jdbc:phoenix:> UPSERT INTO TEST VALUES ('id4', '4', 'c');
> 1 row affected (0.006 seconds)
> 0: jdbc:phoenix:> UPSERT INTO TEST VALUES ('id5', '5', NULL);
> 1 row affected (0.007 seconds)
> 0: jdbc:phoenix:> UPSERT INTO TEST VALUES ('id6', '6', 'd');
> 1 row affected (0.007 seconds)
> 0: jdbc:phoenix:> UPSERT INTO TEST VALUES ('id7', '7', NULL);
> 1 row affected (0.007 seconds)
> 0: jdbc:phoenix:> UPSERT INTO TEST VALUES ('id8', '8', 'e');
> 1 row affected (0.007 seconds)
> 0: jdbc:phoenix:> UPSERT INTO TEST VALUES ('id9', '9', NULL);
> 1 row affected (0.009 seconds)
> {code}
> 3. Count query is okay:
> {code}
> 0: jdbc:phoenix:> SELECT COUNT(COL1) FROM TEST WHERE COL2 IS NOT NULL;
> ++
> | COUNT(A.COL1)  |
> ++
> | 5  |
> ++
> 1 row selected (0.1 seconds)
> {code}
> 4. However, the following select query returns wrong result (it should return 
> 5 records):
> {code}
> 0: jdbc:phoenix:> SELECT COL1 FROM TEST WHERE COL2 IS NOT NULL;
> +---+
> | COL1  |
> +---+
> | 0 |
> | 1 |
> | 2 |
> | 3 |
> | 4 |
> | 5 |
> | 6 |
> | 7 |
> | 8 |
> | 9 |
> +---+
> 10 rows selected (0.058 seconds)
> {code}



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (PHOENIX-6016) Support HBase 2.3.0

2020-07-23 Thread Hudson (Jira)


[ 
https://issues.apache.org/jira/browse/PHOENIX-6016?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17163466#comment-17163466
 ] 

Hudson commented on PHOENIX-6016:
-

FAILURE: Integrated in Jenkins build PreCommit-PHOENIX-Build #4072 (See 
[https://builds.apache.org/job/PreCommit-PHOENIX-Build/4072/])
PHOENIX-6016 Support HBase 2.3.0 (stoty: rev 
a8d6ba036bc15eb66004a99e88a5d8a4fd1cab4c)
* (edit) 
phoenix-core/src/it/java/org/apache/phoenix/end2end/index/LocalIndexIT.java
* (edit) 
phoenix-hbase-compat-2.2.1/src/main/java/org/apache/phoenix/compat/hbase/CompatPhoenixRpcScheduler.java
* (edit) 
phoenix-hbase-compat-2.2.1/src/main/java/org/apache/phoenix/compat/hbase/CompatUtil.java
* (edit) 
phoenix-core/src/it/java/org/apache/hadoop/hbase/regionserver/wal/WALReplayWithIndexWritesAndCompressedWALIT.java
* (edit) 
phoenix-core/src/main/java/org/apache/phoenix/mapreduce/MultiHfileOutputFormat.java
* (add) 
phoenix-hbase-compat-2.3.0/src/main/java/org/apache/phoenix/compat/hbase/CompatDelegateHTable.java
* (edit) 
phoenix-core/src/it/java/org/apache/phoenix/end2end/PermissionsCacheIT.java
* (edit) 
phoenix-hbase-compat-2.1.6/src/main/java/org/apache/phoenix/compat/hbase/CompatUtil.java
* (edit) 
phoenix-core/src/main/java/org/apache/phoenix/iterate/TableSnapshotResultIterator.java
* (edit) phoenix-core/src/it/resources/compatible_client_versions.json
* (edit) 
phoenix-core/src/main/java/org/apache/phoenix/execute/DelegateHTable.java
* (add) 
phoenix-hbase-compat-2.3.0/src/main/java/org/apache/phoenix/compat/hbase/CompatStoreFileReader.java
* (edit) 
phoenix-core/src/main/java/org/apache/phoenix/transaction/OmidTransactionTable.java
* (add) 
phoenix-hbase-compat-2.3.0/src/main/java/org/apache/phoenix/compat/hbase/CompatPermissionUtil.java
* (edit) 
phoenix-core/src/it/java/org/apache/phoenix/end2end/BackwardCompatibilityIT.java
* (edit) 
phoenix-core/src/main/java/org/apache/phoenix/coprocessor/PhoenixAccessController.java
* (edit) 
phoenix-core/src/main/java/org/apache/hadoop/hbase/regionserver/IndexHalfStoreFileReaderGenerator.java
* (edit) pom.xml
* (add) phoenix-hbase-compat-2.3.0/pom.xml
* (edit) 
phoenix-core/src/main/java/org/apache/phoenix/mapreduce/index/IndexTool.java
* (add) 
phoenix-hbase-compat-2.3.0/src/main/java/org/apache/phoenix/compat/hbase/CompatPhoenixRpcScheduler.java
* (edit) phoenix-core/pom.xml
* (add) 
phoenix-hbase-compat-2.3.0/src/main/java/org/apache/phoenix/compat/hbase/CompatOmidTransactionTable.java
* (edit) 
phoenix-core/src/test/java/org/apache/phoenix/jdbc/PhoenixEmbeddedDriverTest.java
* (edit) 
phoenix-hbase-compat-2.1.6/src/main/java/org/apache/phoenix/compat/hbase/CompatPhoenixRpcScheduler.java
* (add) 
phoenix-hbase-compat-2.2.1/src/main/java/org/apache/phoenix/compat/hbase/CompatOmidTransactionTable.java
* (edit) 
phoenix-core/src/main/java/org/apache/phoenix/mapreduce/index/IndexScrutinyTool.java
* (add) 
phoenix-hbase-compat-2.1.6/src/main/java/org/apache/phoenix/compat/hbase/CompatOmidTransactionTable.java
* (add) 
phoenix-hbase-compat-2.1.6/src/main/java/org/apache/phoenix/compat/hbase/CompatStoreFileReader.java
* (edit) 
phoenix-hbase-compat-2.1.6/src/main/java/org/apache/phoenix/compat/hbase/CompatPermissionUtil.java
* (add) 
phoenix-hbase-compat-2.2.1/src/main/java/org/apache/phoenix/compat/hbase/CompatDelegateHTable.java
* (add) 
phoenix-hbase-compat-2.3.0/src/main/java/org/apache/phoenix/compat/hbase/OffsetCell.java
* (add) 
phoenix-hbase-compat-2.1.6/src/main/java/org/apache/phoenix/compat/hbase/CompatDelegateHTable.java
* (add) 
phoenix-hbase-compat-2.3.0/src/main/java/org/apache/phoenix/compat/hbase/CompatUtil.java
* (edit) 
phoenix-core/src/test/java/org/apache/phoenix/hbase/index/write/recovery/TestPerRegionIndexWriteCache.java
* (add) 
phoenix-hbase-compat-2.2.1/src/main/java/org/apache/phoenix/compat/hbase/CompatStoreFileReader.java
* (edit) 
phoenix-hbase-compat-2.2.1/src/main/java/org/apache/phoenix/compat/hbase/CompatPermissionUtil.java
* (edit) 
phoenix-core/src/main/java/org/apache/hadoop/hbase/regionserver/IndexHalfStoreFileReader.java
* (add) 
phoenix-hbase-compat-2.3.0/src/main/java/org/apache/phoenix/compat/hbase/test/DelegateCell.java


> Support HBase 2.3.0
> ---
>
> Key: PHOENIX-6016
> URL: https://issues.apache.org/jira/browse/PHOENIX-6016
> Project: Phoenix
>  Issue Type: Improvement
>Reporter: Istvan Toth
>Assignee: Istvan Toth
>Priority: Major
> Fix For: 5.1.0
>
> Attachments: PHOENIX-6016.master.v1.patch, 
> PHOENIX-6016.master.v2.patch, PHOENIX-6016.master.v3.patch, 
> PHOENIX-6016.master.v4.patch, PHOENIX-6016.master.v5.patch
>
>  Time Spent: 1h 50m
>  Remaining Estimate: 0h
>
> Hbase 2.3.0 has been released.
> Make sure Phoenix works with it.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (PHOENIX-6026) Fix BackwardCompatibilityIT so it can run locally

2020-07-21 Thread Hudson (Jira)


[ 
https://issues.apache.org/jira/browse/PHOENIX-6026?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17162365#comment-17162365
 ] 

Hudson commented on PHOENIX-6026:
-

FAILURE: Integrated in Jenkins build PreCommit-PHOENIX-Build #4066 (See 
[https://builds.apache.org/job/PreCommit-PHOENIX-Build/4066/])
PHOENIX-6026: Fix BackwardCompatibilityIT so it can run locally 
(chinmayskulkarni: rev 218a71c07259a6ac4660335bf3636325e1ee138d)
* (add) phoenix-core/src/it/resources/scripts/execute_query.sh
* (delete) phoenix-core/src/it/scripts/execute_query.sh
* (edit) 
phoenix-core/src/it/java/org/apache/phoenix/end2end/BackwardCompatibilityIT.java


> Fix BackwardCompatibilityIT so it can run locally
> -
>
> Key: PHOENIX-6026
> URL: https://issues.apache.org/jira/browse/PHOENIX-6026
> Project: Phoenix
>  Issue Type: Bug
>Affects Versions: 4.15.0
> Environment: Branch: 4.x
> OS: MacOS 10.13.6
> java runtime version: 1.8.0_181
> mvn version: 3.5.2
>Reporter: Chinmay Kulkarni
>Assignee: Chinmay Kulkarni
>Priority: Major
>  Labels: phoenix-hardening, quality-improvement
> Fix For: 5.1.0, 4.16.0
>
> Attachments: PHOENIX-6026-4.x-v1.patch, PHOENIX-6026-4.x-v2.patch
>
>  Time Spent: 1h
>  Remaining Estimate: 0h
>
> When you try running BackwardCompatibilityIT on 4.x locally it fails with the 
> following exception:
> {code:java}
> java.io.FileNotFoundException: 
> src/it/resources/compatible_client_versions.json (No such file or directory)
> {code}



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (PHOENIX-6023) Wrong result when issuing query for an immutable table with multiple column families

2020-07-21 Thread Hudson (Jira)


[ 
https://issues.apache.org/jira/browse/PHOENIX-6023?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17162364#comment-17162364
 ] 

Hudson commented on PHOENIX-6023:
-

FAILURE: Integrated in Jenkins build PreCommit-PHOENIX-Build #4066 (See 
[https://builds.apache.org/job/PreCommit-PHOENIX-Build/4066/])
PHOENIX-6023 Wrong result when issuing query for an immutable table with 
(github: rev 59044045189f275c75938d441e7a7d74e7670005)
* (add) 
phoenix-core/src/it/java/org/apache/phoenix/end2end/ImmutableTableIT.java
* (edit) 
phoenix-core/src/main/java/org/apache/phoenix/compile/WhereCompiler.java


> Wrong result when issuing query for an immutable table with multiple column 
> families
> 
>
> Key: PHOENIX-6023
> URL: https://issues.apache.org/jira/browse/PHOENIX-6023
> Project: Phoenix
>  Issue Type: Bug
>Reporter: Toshihiro Suzuki
>Assignee: Toshihiro Suzuki
>Priority: Major
> Fix For: 5.1.0, 4.16.0
>
>  Time Spent: 20m
>  Remaining Estimate: 0h
>
> Steps to reproduce are as follows:
> 1. Create an immutable table with multiple column families:
> {code}
> 0: jdbc:phoenix:> CREATE TABLE TEST (
> . . . . . . . . >   ID VARCHAR PRIMARY KEY,
> . . . . . . . . >   A.COL1 VARCHAR,
> . . . . . . . . >   B.COL2 VARCHAR
> . . . . . . . . > ) IMMUTABLE_ROWS = TRUE;
> No rows affected (1.182 seconds)
> {code}
> 2. Upsert some rows:
> {code}
> 0: jdbc:phoenix:> UPSERT INTO TEST VALUES ('id0', '0', 'a');
> 1 row affected (0.138 seconds)
> 0: jdbc:phoenix:> UPSERT INTO TEST VALUES ('id1', '1', NULL);
> 1 row affected (0.009 seconds)
> 0: jdbc:phoenix:> UPSERT INTO TEST VALUES ('id2', '2', 'b');
> 1 row affected (0.011 seconds)
> 0: jdbc:phoenix:> UPSERT INTO TEST VALUES ('id3', '3', NULL);
> 1 row affected (0.007 seconds)
> 0: jdbc:phoenix:> UPSERT INTO TEST VALUES ('id4', '4', 'c');
> 1 row affected (0.006 seconds)
> 0: jdbc:phoenix:> UPSERT INTO TEST VALUES ('id5', '5', NULL);
> 1 row affected (0.007 seconds)
> 0: jdbc:phoenix:> UPSERT INTO TEST VALUES ('id6', '6', 'd');
> 1 row affected (0.007 seconds)
> 0: jdbc:phoenix:> UPSERT INTO TEST VALUES ('id7', '7', NULL);
> 1 row affected (0.007 seconds)
> 0: jdbc:phoenix:> UPSERT INTO TEST VALUES ('id8', '8', 'e');
> 1 row affected (0.007 seconds)
> 0: jdbc:phoenix:> UPSERT INTO TEST VALUES ('id9', '9', NULL);
> 1 row affected (0.009 seconds)
> {code}
> 3. Count query is okay:
> {code}
> 0: jdbc:phoenix:> SELECT COUNT(COL1) FROM TEST WHERE COL2 IS NOT NULL;
> ++
> | COUNT(A.COL1)  |
> ++
> | 5  |
> ++
> 1 row selected (0.1 seconds)
> {code}
> 4. However, the following select query returns wrong result (it should return 
> 5 records):
> {code}
> 0: jdbc:phoenix:> SELECT COL1 FROM TEST WHERE COL2 IS NOT NULL;
> +---+
> | COL1  |
> +---+
> | 0 |
> | 1 |
> | 2 |
> | 3 |
> | 4 |
> | 5 |
> | 6 |
> | 7 |
> | 8 |
> | 9 |
> +---+
> 10 rows selected (0.058 seconds)
> {code}



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (PHOENIX-5976) Cannot drop a column when the index view is involved

2020-07-20 Thread Hudson (Jira)


[ 
https://issues.apache.org/jira/browse/PHOENIX-5976?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17161467#comment-17161467
 ] 

Hudson commented on PHOENIX-5976:
-

FAILURE: Integrated in Jenkins build PreCommit-PHOENIX-Build #4063 (See 
[https://builds.apache.org/job/PreCommit-PHOENIX-Build/4063/])
PHOENIX-5976 Cannot drop a column when the index view is involved (yanxinyi: 
rev 4c03f087f2c3b562459f5c09814d7eeafc727b11)
* (edit) 
phoenix-core/src/main/java/org/apache/phoenix/coprocessor/DropColumnMutator.java
* (edit) 
phoenix-core/src/it/java/org/apache/phoenix/end2end/index/DropColumnIT.java


> Cannot drop a column when the index view is involved 
> -
>
> Key: PHOENIX-5976
> URL: https://issues.apache.org/jira/browse/PHOENIX-5976
> Project: Phoenix
>  Issue Type: Bug
>Affects Versions: 4.15.0, 4.16.0
>Reporter: Xinyi Yan
>Assignee: Xinyi Yan
>Priority: Blocker
> Fix For: 4.16.0
>
> Attachments: PHOENIX-5976.4.x.patch, PHOENIX-5976.4.x.v2.patch
>
>
> This is how to reproduce it on the 4.x branch:
> {code:java}
> // create table
> stmt.execute("CREATE TABLE IF NOT EXISTS DUMMY (ID CHAR(10) NOT 
> NULL,KEY_PREFIX CHAR(3) NOT NULL," +
> " CONSTRAINT PK PRIMARY KEY (ID,KEY_PREFIX))");
> // create view
> stmt.execute(
> "CREATE VIEW IF NOT EXISTS DUMMY_VIEW  (PK1 DATE NOT NULL,PK2 
> CHAR(15) NOT NULL," +
> "NON_PK1 CHAR(15),NON_PK2 CHAR(15) CONSTRAINT PKVIEW PRIMARY 
> KEY (PK1,PK2)) " +
> "AS SELECT * FROM DUMMY WHERE KEY_PREFIX = '123'");
> // create index
> stmt.execute("CREATE INDEX DUMMY_INDEX ON DUMMY_VIEW (PK2, PK1) INCLUDE 
> (NON_PK1, NON_PK2)");
> // drop column
> stmt.execute("ALTER VIEW DUMMY_VIEW DROP COLUMN IF EXISTS NON_PK1");
> {code}
> {code:java}
> org.apache.hadoop.hbase.DoNotRetryIOException: ERROR 504 (42703): ERROR 504 
> (42703): Undefined column. columnName=0:NON_PK2 
> DUMMY_VIEWorg.apache.hadoop.hbase.DoNotRetryIOException: ERROR 504 (42703): 
> ERROR 504 (42703): Undefined column. columnName=0:NON_PK2 DUMMY_VIEW at 
> org.apache.phoenix.util.ServerUtil.createIOException(ServerUtil.java:114) at 
> org.apache.phoenix.util.ServerUtil.throwIOException(ServerUtil.java:88) at 
> org.apache.phoenix.coprocessor.MetaDataEndpointImpl.mutateColumn(MetaDataEndpointImpl.java:2823)
>  at 
> org.apache.phoenix.coprocessor.MetaDataEndpointImpl.dropColumn(MetaDataEndpointImpl.java:3026)
>  at 
> org.apache.phoenix.coprocessor.generated.MetaDataProtos$MetaDataService.callMethod(MetaDataProtos.java:17253)
>  at 
> org.apache.hadoop.hbase.regionserver.HRegion.execService(HRegion.java:8523) 
> at 
> org.apache.hadoop.hbase.regionserver.RSRpcServices.execServiceOnRegion(RSRpcServices.java:2282)
>  at 
> org.apache.hadoop.hbase.regionserver.RSRpcServices.execService(RSRpcServices.java:2264)
>  at 
> org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:36808)
>  at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2399) at 
> org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:124) at 
> org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:311) at 
> org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:291)Caused
>  by: org.apache.phoenix.schema.ColumnNotFoundException: ERROR 504 (42703): 
> Undefined column. columnName=0:NON_PK2 at 
> org.apache.phoenix.schema.PColumnFamilyImpl.getPColumnForColumnNameBytes(PColumnFamilyImpl.java:86)
>  at org.apache.phoenix.util.MetaDataUtil.getColumn(MetaDataUtil.java:982) at 
> org.apache.phoenix.coprocessor.DropColumnMutator.validateAndAddMetadata(DropColumnMutator.java:184)
>  at 
> org.apache.phoenix.coprocessor.MetaDataEndpointImpl.mutateColumn(MetaDataEndpointImpl.java:2719)
>  ... 10 more
> {code}
>  



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (PHOENIX-6011) ServerCacheClient throw NullPointerException

2020-07-19 Thread Hudson (Jira)


[ 
https://issues.apache.org/jira/browse/PHOENIX-6011?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17160840#comment-17160840
 ] 

Hudson commented on PHOENIX-6011:
-

FAILURE: Integrated in Jenkins build PreCommit-PHOENIX-Build #4059 (See 
[https://builds.apache.org/job/PreCommit-PHOENIX-Build/4059/])
PHOENIX-6011:ServerCacheClient throw NullPointerException (#836) (github: rev 
6a293496ba0bb264964ea9d124bc624c14db32ce)
* (add) 
phoenix-core/src/test/java/org/apache/phoenix/cache/ServerCacheClientTest.java
* (edit) 
phoenix-core/src/main/java/org/apache/phoenix/cache/ServerCacheClient.java


> ServerCacheClient throw NullPointerException
> 
>
> Key: PHOENIX-6011
> URL: https://issues.apache.org/jira/browse/PHOENIX-6011
> Project: Phoenix
>  Issue Type: Bug
>Affects Versions: 4.13.1
>Reporter: Chao Wang
>Assignee: Chao Wang
>Priority: Major
> Fix For: 4.x, master
>
> Attachments: 1.png, PHOENIX-6011-v1.patch, PHOENIX-6011-v2.patch
>
>  Time Spent: 40m
>  Remaining Estimate: 0h
>
> Throw NullPointerException in my product Environment now,  As shown in the 
> following image. 
> !1.png!



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (PHOENIX-6017) Hadoop QA Precommit build keeps failing with release audit warning for phoenix-server/dependency-reduced-pom.xml

2020-07-18 Thread Hudson (Jira)


[ 
https://issues.apache.org/jira/browse/PHOENIX-6017?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17160426#comment-17160426
 ] 

Hudson commented on PHOENIX-6017:
-

FAILURE: Integrated in Jenkins build PreCommit-PHOENIX-Build #4058 (See 
[https://builds.apache.org/job/PreCommit-PHOENIX-Build/4058/])
PHOENIX-6017: Hadoop QA Precommit build keeps failing with release audit 
(chinmayskulkarni: rev a79368664f04f460fdc1bbf41b223c984b5c257d)
* (edit) phoenix-server/pom.xml


> Hadoop QA Precommit build keeps failing with release audit warning for 
> phoenix-server/dependency-reduced-pom.xml
> 
>
> Key: PHOENIX-6017
> URL: https://issues.apache.org/jira/browse/PHOENIX-6017
> Project: Phoenix
>  Issue Type: Bug
>Affects Versions: 5.0.0, 4.15.0
>Reporter: Chinmay Kulkarni
>Assignee: Chinmay Kulkarni
>Priority: Major
>  Labels: beginner, newbie, phoenix-hardening, quality-improvement
> Fix For: 5.1.0, 4.16.0
>
> Attachments: PHOENIX-6017-4.x-v1.patch, PHOENIX-6017-4.x-v2.patch, 
> PHOENIX-6017-4.x-v3.patch
>
>
> I believe this is introduced by some changes related to the maven-shaded 
> plugin. We create a dependency-reduced-pom.xml which is considered during the 
> license header check, thus always causing preCommit to fail on this step. We 
> should prevent its creation perhaps via something like 
> [this|https://stackoverflow.com/questions/11314182/maven-shade-plugin-adding-dependency-reduced-pom-xml-to-base-directory].
>  Example of a failing build's error:
> {code:java}
> 1 Unknown Licenses
> *
> Files with unapproved licenses:
>   
> /home/jenkins/jenkins-slave/workspace/PreCommit-PHOENIX-Build/phoenix-server/dependency-reduced-pom.xml
> *
> {code}



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (PHOENIX-6017) Hadoop QA Precommit build keeps failing with release audit warning for phoenix-server/dependency-reduced-pom.xml

2020-07-18 Thread Hudson (Jira)


[ 
https://issues.apache.org/jira/browse/PHOENIX-6017?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17160419#comment-17160419
 ] 

Hudson commented on PHOENIX-6017:
-

FAILURE: Integrated in Jenkins build PreCommit-PHOENIX-Build #4057 (See 
[https://builds.apache.org/job/PreCommit-PHOENIX-Build/4057/])
PHOENIX-6017: Hadoop QA Precommit build keeps failing with release audit 
(chinmayskulkarni: rev a79368664f04f460fdc1bbf41b223c984b5c257d)
* (edit) phoenix-server/pom.xml


> Hadoop QA Precommit build keeps failing with release audit warning for 
> phoenix-server/dependency-reduced-pom.xml
> 
>
> Key: PHOENIX-6017
> URL: https://issues.apache.org/jira/browse/PHOENIX-6017
> Project: Phoenix
>  Issue Type: Bug
>Affects Versions: 5.0.0, 4.15.0
>Reporter: Chinmay Kulkarni
>Assignee: Chinmay Kulkarni
>Priority: Major
>  Labels: beginner, newbie, phoenix-hardening, quality-improvement
> Fix For: 5.1.0, 4.16.0
>
> Attachments: PHOENIX-6017-4.x-v1.patch, PHOENIX-6017-4.x-v2.patch, 
> PHOENIX-6017-4.x-v3.patch
>
>
> I believe this is introduced by some changes related to the maven-shaded 
> plugin. We create a dependency-reduced-pom.xml which is considered during the 
> license header check, thus always causing preCommit to fail on this step. We 
> should prevent its creation perhaps via something like 
> [this|https://stackoverflow.com/questions/11314182/maven-shade-plugin-adding-dependency-reduced-pom-xml-to-base-directory].
>  Example of a failing build's error:
> {code:java}
> 1 Unknown Licenses
> *
> Files with unapproved licenses:
>   
> /home/jenkins/jenkins-slave/workspace/PreCommit-PHOENIX-Build/phoenix-server/dependency-reduced-pom.xml
> *
> {code}



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (PHOENIX-5924) RVC Offset does not handle variable length fields exclusive scan boundary correctly

2020-07-17 Thread Hudson (Jira)


[ 
https://issues.apache.org/jira/browse/PHOENIX-5924?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17160270#comment-17160270
 ] 

Hudson commented on PHOENIX-5924:
-

FAILURE: Integrated in Jenkins build PreCommit-PHOENIX-Build #4053 (See 
[https://builds.apache.org/job/PreCommit-PHOENIX-Build/4053/])
PHOENIX-5924 RVC Offset does not handle variable length fields exclusive (xyan: 
rev 28eb6980a668dc3d98d387692aedf7bec863b6c7)
* (edit) 
phoenix-core/src/it/java/org/apache/phoenix/end2end/RowValueConstructorOffsetIT.java
* (edit) 
phoenix-core/src/main/java/org/apache/phoenix/compile/RVCOffsetCompiler.java


> RVC Offset does not handle variable length fields exclusive scan boundary 
> correctly
> ---
>
> Key: PHOENIX-5924
> URL: https://issues.apache.org/jira/browse/PHOENIX-5924
> Project: Phoenix
>  Issue Type: Bug
>Affects Versions: 5.0.0, 4.15.0, 4.14.3
>Reporter: Daniel Wong
>Assignee: Daniel Wong
>Priority: Major
> Fix For: 5.1.0, 4.16.0
>
> Attachments: PHOENIX-5924-4.x.patch, PHOENIX-5924-master.patch
>
>  Time Spent: 0.5h
>  Remaining Estimate: 0h
>
> The way exclusive boundary was handled by incrementing the key for variable 
> length fields is incorrect in the scan boundary.
>  
> In the following case we incrementing incorrectly from 0x490049 -> 0x490050 
> ('1','1' -> '1','2')
> We should increment from 0x490049 -> 0x49004900 ('1','1' -> '1','1'\x00) 
> @Test
> public void testScenario() throws Exception \{
> String TEST_DDL = "CREATE TABLE IF NOT EXISTS TEST_SCHEMA (\n"
> + "ORGANIZATION_ID VARCHAR(15), \n" + "TEST_ID 
> VARCHAR(15), \n"
> + "CREATED_DATE DATE, \n" + "LAST_UPDATE DATE\n"
> + "CONSTRAINT TEST_SCHEMA_PK PRIMARY KEY (ORGANIZATION_ID, 
> TEST_ID) \n" + ")";
> try (Statement statement = conn.createStatement()) {
> statement.execute(TEST_DDL);
> }
> //setup
> List upserts = new ArrayList<>();
> upserts.add("UPSERT INTO TEST_SCHEMA(ORGANIZATION_ID,TEST_ID) VALUES 
> ('1','1')");
> upserts.add("UPSERT INTO TEST_SCHEMA(ORGANIZATION_ID,TEST_ID) VALUES 
> ('1','10')");
> upserts.add("UPSERT INTO TEST_SCHEMA(ORGANIZATION_ID,TEST_ID) VALUES 
> ('2','2')");
> for(String sql : upserts) \{
> try (Statement statement = conn.createStatement()) {
> statement.execute(sql);
> }
> }
> conn.commit();
> String query1 = "SELECT * FROM TEST_SCHEMA";
> String query2 = "SELECT * FROM TEST_SCHEMA OFFSET 
> (ORGANIZATION_ID,TEST_ID) = ('1','1')";
> try (Statement statement = conn.createStatement() ; ResultSet rs1 = 
> statement.executeQuery(query1) ) \{
> TestUtil.printResultSet(rs1);
> }
> try (Statement statement = conn.createStatement() ; ResultSet rs2 = 
> statement.executeQuery(query2) ) \{
> TestUtil.printResultSet(rs2);
> }
> }
>  



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (PHOENIX-5933) Rename VIEW_TTL property to be PHOENIX_TTL

2020-07-17 Thread Hudson (Jira)


[ 
https://issues.apache.org/jira/browse/PHOENIX-5933?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17160269#comment-17160269
 ] 

Hudson commented on PHOENIX-5933:
-

FAILURE: Integrated in Jenkins build PreCommit-PHOENIX-Build #4053 (See 
[https://builds.apache.org/job/PreCommit-PHOENIX-Build/4053/])
PHOENIX-5933 Rename VIEW_TTL property to be PHOENIX_TTL (xyan: rev 
8f9ee5015f013de173a26161f34a270d68a9d2f9)
* (edit) 
phoenix-core/src/main/java/org/apache/phoenix/coprocessor/generated/PTableProtos.java
* (edit) 
phoenix-core/src/main/java/org/apache/phoenix/schema/MetaDataClient.java
* (edit) 
phoenix-core/src/main/java/org/apache/phoenix/jdbc/PhoenixDatabaseMetaData.java
* (edit) phoenix-core/src/main/java/org/apache/phoenix/query/QueryConstants.java
* (edit) phoenix-core/src/main/java/org/apache/phoenix/schema/PTable.java
* (edit) phoenix-core/src/main/java/org/apache/phoenix/schema/DelegateTable.java
* (edit) phoenix-protocol/src/main/PTable.proto
* (edit) phoenix-core/src/main/java/org/apache/phoenix/schema/TableProperty.java
* (edit) phoenix-core/src/it/java/org/apache/phoenix/end2end/ViewTTLIT.java
* (edit) phoenix-core/src/main/java/org/apache/phoenix/util/ViewUtil.java
* (edit) phoenix-core/src/main/java/org/apache/phoenix/schema/PTableImpl.java
* (edit) 
phoenix-core/src/main/java/org/apache/phoenix/coprocessor/MetaDataEndpointImpl.java
* (edit) 
phoenix-core/src/main/java/org/apache/phoenix/query/ConnectionQueryServicesImpl.java
* (edit) 
phoenix-core/src/main/java/org/apache/phoenix/exception/SQLExceptionCode.java


> Rename VIEW_TTL property to be PHOENIX_TTL
> --
>
> Key: PHOENIX-5933
> URL: https://issues.apache.org/jira/browse/PHOENIX-5933
> Project: Phoenix
>  Issue Type: Sub-task
>Reporter: Jacob Isaac
>Assignee: Jacob Isaac
>Priority: Major
> Fix For: 4.16.0
>
> Attachments: PHOENIX-5933.4.x.001.patch, PHOENIX-5933.master.001.patch
>
>  Time Spent: 2.5h
>  Remaining Estimate: 0h
>
> As there is more interest in extending the TTL feature to all Phoenix 
> entities (tables and views)
> More specifically separate the usage of Phoenix application-level TTL 
> (row-based) and HBase level TTL (Store/Column Family-based).
> It makes sense to rename the Phoenix Table property to be PHOENIX_TTL



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (PHOENIX-5981) Wrong multiple counting of resultSetTimeMs and wallclockTimeMs in OverallQueryMetrics

2020-07-16 Thread Hudson (Jira)


[ 
https://issues.apache.org/jira/browse/PHOENIX-5981?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17159532#comment-17159532
 ] 

Hudson commented on PHOENIX-5981:
-

FAILURE: Integrated in Jenkins build PreCommit-PHOENIX-Build #4047 (See 
[https://builds.apache.org/job/PreCommit-PHOENIX-Build/4047/])
PHOENIX-5981: Wrong multiple counting of resultSetTimeMs and (chinmayskulkarni: 
rev 07f1fea40804a9c65e04e336afbeecab534372e0)
* (add) 
phoenix-core/src/test/java/org/apache/phoenix/monitoring/OverAllQueryMetricsTest.java
* (edit) 
phoenix-core/src/main/java/org/apache/phoenix/monitoring/OverAllQueryMetrics.java
* (edit) 
phoenix-core/src/main/java/org/apache/phoenix/monitoring/MetricsStopWatch.java


> Wrong multiple counting of resultSetTimeMs and wallclockTimeMs in 
> OverallQueryMetrics
> -
>
> Key: PHOENIX-5981
> URL: https://issues.apache.org/jira/browse/PHOENIX-5981
> Project: Phoenix
>  Issue Type: Bug
>Affects Versions: 5.0.0, 4.15.0
>Reporter: Chinmay Kulkarni
>Assignee: Chinmay Kulkarni
>Priority: Major
>  Labels: metrics, phoenix-hardening, quality-improvement
> Fix For: 5.1.0, 4.16.0
>
> Attachments: PHOENIX-5981-4.x-v1.patch, PHOENIX-5981-4.x-v2.patch, 
> PHOENIX-5981-4.x-v3.patch, PHOENIX-5981-4.x-v4.patch, 
> PHOENIX-5981-master-v1.patch
>
>  Time Spent: 40m
>  Remaining Estimate: 0h
>
> We update wallClockTimeMS and resultSetTimeMS when we reach the last row in 
> our ResultSet iterations (see 
> [this|https://github.com/apache/phoenix/blob/dcc88af8acc2ba8df10d2e9d498ab3646fdf0a78/phoenix-core/src/main/java/org/apache/phoenix/jdbc/PhoenixResultSet.java#L878-L881]).
>  However, this is also called inside PhoenixResultSet.close(), see 
> [this|https://github.com/apache/phoenix/blob/dcc88af8acc2ba8df10d2e9d498ab3646fdf0a78/phoenix-core/src/main/java/org/apache/phoenix/jdbc/PhoenixResultSet.java#L214-L215].
> The problem is, these calls in-turn add elapsedTime again 
> ([endQuery|https://github.com/apache/phoenix/blob/dcc88af8acc2ba8df10d2e9d498ab3646fdf0a78/phoenix-core/src/main/java/org/apache/phoenix/monitoring/OverAllQueryMetrics.java#L86]
>  and 
> [stopResultsetWatch|https://github.com/apache/phoenix/blob/dcc88af8acc2ba8df10d2e9d498ab3646fdf0a78/phoenix-core/src/main/java/org/apache/phoenix/monitoring/OverAllQueryMetrics.java#L95])
>  and so these metrics get 2X the value they should. Ideally we should change 
> the metrics only if the stopWatch was running before calling stopWatch.stop 
> or else we will count it multiple times.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (PHOENIX-6000) Client side DELETEs should use local indexes for filtering

2020-07-16 Thread Hudson (Jira)


[ 
https://issues.apache.org/jira/browse/PHOENIX-6000?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17159531#comment-17159531
 ] 

Hudson commented on PHOENIX-6000:
-

FAILURE: Integrated in Jenkins build PreCommit-PHOENIX-Build #4047 (See 
[https://builds.apache.org/job/PreCommit-PHOENIX-Build/4047/])
PHOENIX-6000 Client side DELETEs should use local indexes for filtering. (Lars: 
rev 02c9d5d15be727efaba8ce922857b4ba8d6f129b)
* (edit) 
phoenix-core/src/main/java/org/apache/phoenix/compile/DeleteCompiler.java
* (add) 
phoenix-core/src/main/java/org/apache/phoenix/compile/DeleteCompiler.java.orig
* (edit) 
phoenix-core/src/it/java/org/apache/phoenix/end2end/index/GlobalIndexOptimizationIT.java


> Client side DELETEs should use local indexes for filtering
> --
>
> Key: PHOENIX-6000
> URL: https://issues.apache.org/jira/browse/PHOENIX-6000
> Project: Phoenix
>  Issue Type: Bug
>Affects Versions: 5.0.0, 4.15.0
>Reporter: Lars Hofhansl
>Assignee: Lars Hofhansl
>Priority: Major
> Fix For: 5.0.1, 4.16.0
>
> Attachments: 6000-4.x-HBase-1.5-v2.txt, 6000-4.x-HBase-1.5.txt, 
> 6000-4.x-v3.txt, 6000-4.x-v4.txt
>
>
> I just noticed that client side DELETEs do not use local indexes for 
> filtering if they do not cover all keys of all other indexes.
> Unless I am missing something this is not necessary, for local indexes we 
> have the data available in the region and can fill back the uncovered column 
> (just like we do for SELECTs)



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (PHOENIX-5981) Wrong multiple counting of resultSetTimeMs and wallclockTimeMs in OverallQueryMetrics

2020-07-16 Thread Hudson (Jira)


[ 
https://issues.apache.org/jira/browse/PHOENIX-5981?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17159513#comment-17159513
 ] 

Hudson commented on PHOENIX-5981:
-

FAILURE: Integrated in Jenkins build PreCommit-PHOENIX-Build #4048 (See 
[https://builds.apache.org/job/PreCommit-PHOENIX-Build/4048/])
PHOENIX-5981: Wrong multiple counting of resultSetTimeMs and (chinmayskulkarni: 
rev 07f1fea40804a9c65e04e336afbeecab534372e0)
* (edit) 
phoenix-core/src/main/java/org/apache/phoenix/monitoring/OverAllQueryMetrics.java
* (add) 
phoenix-core/src/test/java/org/apache/phoenix/monitoring/OverAllQueryMetricsTest.java
* (edit) 
phoenix-core/src/main/java/org/apache/phoenix/monitoring/MetricsStopWatch.java


> Wrong multiple counting of resultSetTimeMs and wallclockTimeMs in 
> OverallQueryMetrics
> -
>
> Key: PHOENIX-5981
> URL: https://issues.apache.org/jira/browse/PHOENIX-5981
> Project: Phoenix
>  Issue Type: Bug
>Affects Versions: 5.0.0, 4.15.0
>Reporter: Chinmay Kulkarni
>Assignee: Chinmay Kulkarni
>Priority: Major
>  Labels: metrics, phoenix-hardening, quality-improvement
> Fix For: 5.1.0, 4.16.0
>
> Attachments: PHOENIX-5981-4.x-v1.patch, PHOENIX-5981-4.x-v2.patch, 
> PHOENIX-5981-4.x-v3.patch, PHOENIX-5981-4.x-v4.patch, 
> PHOENIX-5981-master-v1.patch
>
>  Time Spent: 40m
>  Remaining Estimate: 0h
>
> We update wallClockTimeMS and resultSetTimeMS when we reach the last row in 
> our ResultSet iterations (see 
> [this|https://github.com/apache/phoenix/blob/dcc88af8acc2ba8df10d2e9d498ab3646fdf0a78/phoenix-core/src/main/java/org/apache/phoenix/jdbc/PhoenixResultSet.java#L878-L881]).
>  However, this is also called inside PhoenixResultSet.close(), see 
> [this|https://github.com/apache/phoenix/blob/dcc88af8acc2ba8df10d2e9d498ab3646fdf0a78/phoenix-core/src/main/java/org/apache/phoenix/jdbc/PhoenixResultSet.java#L214-L215].
> The problem is, these calls in-turn add elapsedTime again 
> ([endQuery|https://github.com/apache/phoenix/blob/dcc88af8acc2ba8df10d2e9d498ab3646fdf0a78/phoenix-core/src/main/java/org/apache/phoenix/monitoring/OverAllQueryMetrics.java#L86]
>  and 
> [stopResultsetWatch|https://github.com/apache/phoenix/blob/dcc88af8acc2ba8df10d2e9d498ab3646fdf0a78/phoenix-core/src/main/java/org/apache/phoenix/monitoring/OverAllQueryMetrics.java#L95])
>  and so these metrics get 2X the value they should. Ideally we should change 
> the metrics only if the stopWatch was running before calling stopWatch.stop 
> or else we will count it multiple times.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (PHOENIX-6000) Client side DELETEs should use local indexes for filtering

2020-07-16 Thread Hudson (Jira)


[ 
https://issues.apache.org/jira/browse/PHOENIX-6000?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17159512#comment-17159512
 ] 

Hudson commented on PHOENIX-6000:
-

FAILURE: Integrated in Jenkins build PreCommit-PHOENIX-Build #4048 (See 
[https://builds.apache.org/job/PreCommit-PHOENIX-Build/4048/])
PHOENIX-6000 Client side DELETEs should use local indexes for filtering. (Lars: 
rev 02c9d5d15be727efaba8ce922857b4ba8d6f129b)
* (add) 
phoenix-core/src/main/java/org/apache/phoenix/compile/DeleteCompiler.java.orig
* (edit) 
phoenix-core/src/it/java/org/apache/phoenix/end2end/index/GlobalIndexOptimizationIT.java
* (edit) 
phoenix-core/src/main/java/org/apache/phoenix/compile/DeleteCompiler.java


> Client side DELETEs should use local indexes for filtering
> --
>
> Key: PHOENIX-6000
> URL: https://issues.apache.org/jira/browse/PHOENIX-6000
> Project: Phoenix
>  Issue Type: Bug
>Affects Versions: 5.0.0, 4.15.0
>Reporter: Lars Hofhansl
>Assignee: Lars Hofhansl
>Priority: Major
> Fix For: 5.0.1, 4.16.0
>
> Attachments: 6000-4.x-HBase-1.5-v2.txt, 6000-4.x-HBase-1.5.txt, 
> 6000-4.x-v3.txt, 6000-4.x-v4.txt
>
>
> I just noticed that client side DELETEs do not use local indexes for 
> filtering if they do not cover all keys of all other indexes.
> Unless I am missing something this is not necessary, for local indexes we 
> have the data available in the region and can fill back the uncovered column 
> (just like we do for SELECTs)



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (PHOENIX-5935) Select with non primary keys and PHOENIX_ROW_TIMESTAMP() in where clause fails

2020-07-15 Thread Hudson (Jira)


[ 
https://issues.apache.org/jira/browse/PHOENIX-5935?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17158720#comment-17158720
 ] 

Hudson commented on PHOENIX-5935:
-

FAILURE: Integrated in Jenkins build PreCommit-PHOENIX-Build #4037 (See 
[https://builds.apache.org/job/PreCommit-PHOENIX-Build/4037/])
PHOENIX-5935 Select with non primary keys and PHOENIX_ROW_TIMESTAMP() in 
(yanxinyi: rev 22a46f7233c4169ff4bb815cf3cdb1c44ca6b100)
* (edit) 
phoenix-core/src/it/java/org/apache/phoenix/end2end/PhoenixRowTimestampFunctionIT.java
* (edit) 
phoenix-core/src/main/java/org/apache/phoenix/expression/function/PhoenixRowTimestampFunction.java


> Select with non primary keys and PHOENIX_ROW_TIMESTAMP() in where clause fails
> --
>
> Key: PHOENIX-5935
> URL: https://issues.apache.org/jira/browse/PHOENIX-5935
> Project: Phoenix
>  Issue Type: Bug
>Reporter: Jacob Isaac
>Assignee: Jacob Isaac
>Priority: Major
> Fix For: 4.x
>
> Attachments: PHOENIX-5935.4.x.003.patch
>
>
> This fails when COLUMN_ENCODED_BYTES != NON_ENCODED_QUALIFIERS
> Steps to reproduce:-
> CREATE TABLE IF NOT EXISTS N01 (PK1 INTEGER NOT NULL, PK2 DATE NOT NULL, 
> KV1 VARCHAR, KV2 VARCHAR CONSTRAINT PK PRIMARY KEY(PK1, PK2)) 
> COLUMN_ENCODED_BYTES = 1,IMMUTABLE_STORAGE_SCHEME = ONE_CELL_PER_COLUMN
>  
> SELECT COUNT(*) FROM N01 WHERE PHOENIX_ROW_TIMESTAMP() > PK2 AND KV1 = 
> 'KV1_1'";
>  
> Fails with the following exception -
> Caused by: java.util.NoSuchElementExceptionCaused by: 
> java.util.NoSuchElementException at 
> org.apache.phoenix.filter.MultiEncodedCQKeyValueComparisonFilter$FilteredKeyValueHolder.getCellAtIndex(MultiEncodedCQKeyValueComparisonFilter.java:151)
>  at 
> org.apache.phoenix.filter.MultiEncodedCQKeyValueComparisonFilter$EncodedCQIncrementalResultTuple.getValue(MultiEncodedCQKeyValueComparisonFilter.java:311)
>  at 
> org.apache.phoenix.expression.function.PhoenixRowTimestampFunction.evaluate(PhoenixRowTimestampFunction.java:98)
>  at 
> org.apache.phoenix.expression.ComparisonExpression.evaluate(ComparisonExpression.java:330)
>  at 
> org.apache.phoenix.expression.AndOrExpression.evaluate(AndOrExpression.java:75)
>  at 
> org.apache.phoenix.filter.BooleanExpressionFilter.evaluate(BooleanExpressionFilter.java:93)
>  at 
> org.apache.phoenix.filter.MultiEncodedCQKeyValueComparisonFilter.filterKeyValue(MultiEncodedCQKeyValueComparisonFilter.java:233)
>  at 
> org.apache.hadoop.hbase.regionserver.querymatcher.UserScanQueryMatcher.matchColumn(UserScanQueryMatcher.java:122)



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (PHOENIX-5967) phoenix-client transitively pulling in phoenix-core

2020-07-14 Thread Hudson (Jira)


[ 
https://issues.apache.org/jira/browse/PHOENIX-5967?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17157615#comment-17157615
 ] 

Hudson commented on PHOENIX-5967:
-

FAILURE: Integrated in Jenkins build PreCommit-PHOENIX-Build #4035 (See 
[https://builds.apache.org/job/PreCommit-PHOENIX-Build/4035/])
PHOENIX-5967 phoenix-client transitively pulling in phoenix-core (stoty: rev 
fc9027fb01898397373e62830d859f0d30e5a9b9)
* (edit) phoenix-assembly/pom.xml
* (edit) phoenix-client/pom.xml
* (edit) phoenix-assembly/src/build/components/all-common-dependencies.xml
* (edit) phoenix-assembly/src/build/components/all-common-jars.xml
* (edit) pom.xml
* (edit) phoenix-server/pom.xml


> phoenix-client transitively pulling in phoenix-core
> ---
>
> Key: PHOENIX-5967
> URL: https://issues.apache.org/jira/browse/PHOENIX-5967
> Project: Phoenix
>  Issue Type: Bug
>Reporter: Josh Elser
>Assignee: Istvan Toth
>Priority: Critical
> Fix For: 5.1.0, 4.16.0
>
>
> Looks like something happened in master where phoenix-client is now 
> transitively pulling in phoenix-core, even though all of phoenix-core and its 
> dependencies are included in the phoenix-client shaded artifact.
> 4.15.0 looks OK, so maybe something inadvertent with the hbase version 
> classifier stuff, [~stoty]?



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (PHOENIX-5996) IndexRebuildRegionScanner.prepareIndexMutationsForRebuild may incorrectly delete index row when a delete and put mutation with the same timestamp

2020-07-13 Thread Hudson (Jira)


[ 
https://issues.apache.org/jira/browse/PHOENIX-5996?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17157104#comment-17157104
 ] 

Hudson commented on PHOENIX-5996:
-

FAILURE: Integrated in Jenkins build PreCommit-PHOENIX-Build #4034 (See 
[https://builds.apache.org/job/PreCommit-PHOENIX-Build/4034/])
PHOENIX-5996 IndexRebuildRegionScanner.prepareIndexMutationsForRebuild 
(chenglei: rev 29fe870ecc908ee053c7821e39bab14e7c68703c)
* (edit) 
phoenix-core/src/main/java/org/apache/phoenix/coprocessor/IndexRebuildRegionScanner.java
* (edit) 
phoenix-core/src/test/java/org/apache/phoenix/index/PrepareIndexMutationsForRebuildTest.java


> IndexRebuildRegionScanner.prepareIndexMutationsForRebuild may incorrectly 
> delete index row when a delete and put mutation with the same timestamp
> -
>
> Key: PHOENIX-5996
> URL: https://issues.apache.org/jira/browse/PHOENIX-5996
> Project: Phoenix
>  Issue Type: Bug
>Affects Versions: 5.1.0, 4.16.0
>Reporter: chenglei
>Assignee: chenglei
>Priority: Major
> Fix For: 5.1.0, 4.16.0
>
>  Time Spent: 20m
>  Remaining Estimate: 0h
>
> With PHOENIX-5748, 
> {{IndexRebuildRegionScanner.prepareIndexMutationsForRebuild}} is responsible 
> for generating index table mutations for rebuild.
> In the processing of data table mutations list, there can be a delete and put 
> mutation with the same timestamp.   If so, the delete and put are processed 
> together in one iteration. First, the delete mutation is applied on the put 
> mutation and current row state, and then the modified put mutation is 
> processed.
> But when the {{modified put mutation}} is empty , even the current row state 
> is not empty after the delete mutation is applied, the whole index row is  
> deleted, just as following line 1191 in 
> {{IndexRebuildRegionScanner.prepareIndexMutationsForRebuild}}:
> {code:java}
> 1189  } else {
> 1190if (currentDataRowState != null) {
> 1191Mutation del = 
> indexMaintainer.buildRowDeleteMutation(indexRowKeyForCurrentDataRow,
> 1192IndexMaintainer.DeleteType.ALL_VERSIONS, 
> ts);
> 1193indexMutations.add(del);
> 1194// For the next iteration of the for loop
> 1195currentDataRowState = null;
> 1196indexRowKeyForCurrentDataRow = null;
> 1197}
> 1198  }
> {code} 
> I think above logical is wrong, when the current row state is not empty after 
> the delete mutation is applied, we can not  delete the whole index row, but 
> instead we should reuse the logical of applying a delete mutation on current 
> row state.  I wrote a unit test in {{PrepareIndexMutationsForRebuildTest}} to 
> produce the case:
> {code:java}
> @Test
> public void testPutDeleteOnSameTimeStampAndPutNullifiedByDelete() throws 
> Exception {
> SetupInfo info = setup(
> TABLE_NAME,
> INDEX_NAME,
> "ROW_KEY VARCHAR, CF1.C1 VARCHAR, CF2.C2 VARCHAR",
> "CF2.C2",
> "ROW_KEY",
> "");
> Put dataPut = new Put(Bytes.toBytes(ROW_KEY));
> addCellToPutMutation(
> dataPut,
> Bytes.toBytes("CF2"),
> Bytes.toBytes("C2"),
> 1,
> Bytes.toBytes("v2"));
> addEmptyColumnToDataPutMutation(dataPut, info.pDataTable, 1);
> 
> addCellToPutMutation(
> dataPut,
> Bytes.toBytes("CF1"),
> Bytes.toBytes("C1"),
> 2,
> Bytes.toBytes("v1"));
> addEmptyColumnToDataPutMutation(dataPut, info.pDataTable, 2);
> Delete dataDel = new Delete(Bytes.toBytes(ROW_KEY));
> addCellToDelMutation(
> dataDel,
> Bytes.toBytes("CF1"),
> null,
> 2,
> KeyValue.Type.DeleteFamily);
> List actualIndexMutations = 
> IndexRebuildRegionScanner.prepareIndexMutationsForRebuild(
> info.indexMaintainer,
> dataPut,
> dataDel);
> List expectedIndexMutations = new ArrayList<>();
> byte[] idxKeyBytes = generateIndexRowKey("v2");
> 
> Put idxPut1 = new Put(idxKeyBytes);
> addEmptyColumnToIndexPutMutation(idxPut1, info.indexMaintainer, 1);
> expectedIndexMutations.add(idxPut1);
> 
> Put idxPut2 = new Put(idxKeyBytes);
> addEmptyColumnToIndexPutMutation(idxPut2, info.indexMaintainer, 2);
> 

[jira] [Commented] (PHOENIX-5983) Set Hadoop dependencies as provided in phoenix-server

2020-07-13 Thread Hudson (Jira)


[ 
https://issues.apache.org/jira/browse/PHOENIX-5983?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17157105#comment-17157105
 ] 

Hudson commented on PHOENIX-5983:
-

FAILURE: Integrated in Jenkins build PreCommit-PHOENIX-Build #4034 (See 
[https://builds.apache.org/job/PreCommit-PHOENIX-Build/4034/])
PHOENIX-5983 Set Hadoop dependencies as provided in phoenix-server (stoty: rev 
0979d7be731d6455c84226b7672dd53efc19832e)
* (edit) phoenix-server/pom.xml
* (edit) pom.xml


> Set Hadoop dependencies as provided in phoenix-server
> -
>
> Key: PHOENIX-5983
> URL: https://issues.apache.org/jira/browse/PHOENIX-5983
> Project: Phoenix
>  Issue Type: Improvement
>  Components: core
>Affects Versions: 5.1.0
>Reporter: Istvan Toth
>Assignee: Istvan Toth
>Priority: Major
> Fix For: 5.1.0
>
> Attachments: PHOENIX-5983.master.v1, PHOENIX-5983.master.v2.patch
>
>  Time Spent: 20m
>  Remaining Estimate: 0h
>
> There are some Hadoop dependencies that are shaded into phoenix-server. 
> Mark these as provided.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (PHOENIX-6001) Incremental rebuild/verification can result in missing rows and false positives

2020-07-12 Thread Hudson (Jira)


[ 
https://issues.apache.org/jira/browse/PHOENIX-6001?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17156476#comment-17156476
 ] 

Hudson commented on PHOENIX-6001:
-

FAILURE: Integrated in Jenkins build PreCommit-PHOENIX-Build #4030 (See 
[https://builds.apache.org/job/PreCommit-PHOENIX-Build/4030/])
PHOENIX-6001 Incremental rebuild/verification can result in missing rows 
(achouhan: rev aafc4810bec9a9176410e463aca79f46fa59f409)
* (edit) 
phoenix-core/src/main/java/org/apache/phoenix/coprocessor/IndexRebuildRegionScanner.java
* (edit) 
phoenix-core/src/it/java/org/apache/phoenix/end2end/IndexToolForNonTxGlobalIndexIT.java


> Incremental rebuild/verification can result in missing rows and false 
> positives 
> 
>
> Key: PHOENIX-6001
> URL: https://issues.apache.org/jira/browse/PHOENIX-6001
> Project: Phoenix
>  Issue Type: Bug
>Affects Versions: 4.16.0
>Reporter: Abhishek Singh Chouhan
>Assignee: Abhishek Singh Chouhan
>Priority: Critical
> Fix For: 5.1.0, 4.16.0
>
> Attachments: PHOENIX-6001-4.x.patch, PHOENIX-6001-master.patch
>
>  Time Spent: 10m
>  Remaining Estimate: 0h
>
> In case of incremental rebuild/verify we prepare a skip scan using page size 
> constraints first and then use it for rebuild, however when using this skip 
> scan we constraint the number of indexmutations we're going to build/verify 
> also on the page size. In the case where we have multiple index mutations for 
> single dataTableRow, we can return back to the client without scanning all 
> the rows of the skip scan filter, when the client does next, we resume 
> incorrectly from the row after the last of the previous skip scan when infact 
> we hadn't exhausted it fully.   



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (PHOENIX-5997) Phoenix Explain Plan for Deletes does not clearly differentiate between server side and client side paths.

2020-07-12 Thread Hudson (Jira)


[ 
https://issues.apache.org/jira/browse/PHOENIX-5997?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17156475#comment-17156475
 ] 

Hudson commented on PHOENIX-5997:
-

FAILURE: Integrated in Jenkins build PreCommit-PHOENIX-Build #4030 (See 
[https://builds.apache.org/job/PreCommit-PHOENIX-Build/4030/])
PHOENIX-5997 Phoenix Explain Plan for Deletes does not clearly (yanxinyi: rev 
3ea9558d2be3f85e41dd829691667e667e20be34)
* (add) 
phoenix-core/src/test/java/org/apache/phoenix/query/ExplainPlanTextTest.java
* (edit) 
phoenix-core/src/it/java/org/apache/phoenix/end2end/CostBasedDecisionIT.java
* (edit) 
phoenix-core/src/main/java/org/apache/phoenix/compile/DeleteCompiler.java


> Phoenix Explain Plan for Deletes does not clearly differentiate between 
> server side and client side paths.
> --
>
> Key: PHOENIX-5997
> URL: https://issues.apache.org/jira/browse/PHOENIX-5997
> Project: Phoenix
>  Issue Type: Bug
>Affects Versions: 4.15.0, 4.16.0
>Reporter: Daniel Wong
>Assignee: Daniel Wong
>Priority: Minor
> Fix For: 4.16.0
>
> Attachments: PHOENIX-5997-v2-4.x.patch
>
>  Time Spent: 50m
>  Remaining Estimate: 0h
>
> Phoenix Explain Plan for Deletes does not clearly differentiate between 
> server side and client side paths.  
> Currently a server side and client side delete explain plans look like:



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (PHOENIX-5995) Index Rebuild page size is not honored in case of point deletes

2020-07-10 Thread Hudson (Jira)


[ 
https://issues.apache.org/jira/browse/PHOENIX-5995?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17155729#comment-17155729
 ] 

Hudson commented on PHOENIX-5995:
-

FAILURE: Integrated in Jenkins build PreCommit-PHOENIX-Build #4025 (See 
[https://builds.apache.org/job/PreCommit-PHOENIX-Build/4025/])
PHOENIX-5995 Index Rebuild page size is not honored in case of point (achouhan: 
rev e75e2f9e959036f6ea602c3c085f7c850c14fb84)
* (edit) 
phoenix-core/src/it/java/org/apache/phoenix/end2end/IndexToolForNonTxGlobalIndexIT.java


> Index Rebuild page size is not honored in case of point deletes
> ---
>
> Key: PHOENIX-5995
> URL: https://issues.apache.org/jira/browse/PHOENIX-5995
> Project: Phoenix
>  Issue Type: Bug
>Affects Versions: 4.15.0
>Reporter: Abhishek Singh Chouhan
>Assignee: Abhishek Singh Chouhan
>Priority: Major
> Fix For: 5.1.0, 4.16.0
>
> Attachments: PHOENIX-5995-4.x.patch
>
>




--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (PHOENIX-5988) Bump HBase and Hadoop versions to latest working patch level on master

2020-07-09 Thread Hudson (Jira)


[ 
https://issues.apache.org/jira/browse/PHOENIX-5988?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17154261#comment-17154261
 ] 

Hudson commented on PHOENIX-5988:
-

FAILURE: Integrated in Jenkins build PreCommit-PHOENIX-Build #4021 (See 
[https://builds.apache.org/job/PreCommit-PHOENIX-Build/4021/])
PHOENIX-5988 Bump HBase and Hadoop versions to latest working patch (stoty: rev 
f5ebf2aaa337d0b4b935f10917cee3d99d621c98)
* (edit) pom.xml


> Bump HBase and Hadoop versions to latest working patch level on master
> --
>
> Key: PHOENIX-5988
> URL: https://issues.apache.org/jira/browse/PHOENIX-5988
> Project: Phoenix
>  Issue Type: Improvement
>  Components: core
>Affects Versions: 5.1.0
>Reporter: Istvan Toth
>Assignee: Istvan Toth
>Priority: Major
> Fix For: 5.1.0
>
> Attachments: PHOENIX-5988.master.v1.patch
>
>  Time Spent: 50m
>  Remaining Estimate: 0h
>
> We should keep up-to-date with the new HBase and Hadoop patch releases.
> We should update to HBase 2.1.9 and 2.2.5 (or whatever is the latest when 
> making the commit)
> I believe that we should also update the Hadoop version to at least 3.0.3.
> According to the HBase compatibility matrix, even 3.0.3 is unsupported with 
> HBase 2.2, so we may want to update to Hadoop 3.1.3 instead.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (PHOENIX-5973) IndexToolForNonTxGlobalIndexIT - Stabilize and speed up

2020-07-09 Thread Hudson (Jira)


[ 
https://issues.apache.org/jira/browse/PHOENIX-5973?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17154260#comment-17154260
 ] 

Hudson commented on PHOENIX-5973:
-

FAILURE: Integrated in Jenkins build PreCommit-PHOENIX-Build #4021 (See 
[https://builds.apache.org/job/PreCommit-PHOENIX-Build/4021/])
PHOENIX-5973 - Stabilize and speed up IndexToolForNonTxGlobalIndexIT … (github: 
rev 02da811ba9c31a8d1dcae3af7f89a3084f4b201e)
* (edit) 
phoenix-core/src/it/java/org/apache/phoenix/end2end/IndexToolForNonTxGlobalIndexIT.java
* (edit) 
phoenix-core/src/main/java/org/apache/phoenix/mapreduce/index/IndexVerificationOutputRepository.java
* (edit) 
phoenix-core/src/main/java/org/apache/phoenix/mapreduce/index/IndexVerificationResultRepository.java
* (edit) 
phoenix-core/src/it/java/org/apache/phoenix/end2end/index/IndexVerificationResultRepositoryIT.java
* (edit) 
phoenix-core/src/main/java/org/apache/phoenix/mapreduce/index/PhoenixIndexImportDirectReducer.java
* (edit) phoenix-core/src/test/java/org/apache/phoenix/util/TestUtil.java


> IndexToolForNonTxGlobalIndexIT - Stabilize and speed up
> ---
>
> Key: PHOENIX-5973
> URL: https://issues.apache.org/jira/browse/PHOENIX-5973
> Project: Phoenix
>  Issue Type: Test
>Reporter: Geoffrey Jacoby
>Assignee: Geoffrey Jacoby
>Priority: Major
> Fix For: 5.1.0, 4.16.0
>
> Attachments: PHOENIX-5973-4.x.v1.patch, 
> PHOENIX-5973-addendum-4.x.v1.patch, PHOENIX-5973.v1.patch
>
>  Time Spent: 2h 20m
>  Remaining Estimate: 0h
>
> The many IndexTool test suites have clearly had some bad performance 
> regressions recently, which is a part of why the overall Phoenix pre commit 
> builds are timing out. We should investigate why and fix. 



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (PHOENIX-5716) Remove or update HBase 2.0 support

2020-07-06 Thread Hudson (Jira)


[ 
https://issues.apache.org/jira/browse/PHOENIX-5716?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17152384#comment-17152384
 ] 

Hudson commented on PHOENIX-5716:
-

FAILURE: Integrated in Jenkins build PreCommit-PHOENIX-Build #4016 (See 
[https://builds.apache.org/job/PreCommit-PHOENIX-Build/4016/])
PHOENIX-5716 Remove HBase 2.0 support (stoty: rev 
339d51ceba252fcd4277308c0a144f02f5d589ce)
* (delete) 
phoenix-hbase-compat-2.0.1/src/main/java/org/apache/phoenix/compat/hbase/CompatPhoenixRpcScheduler.java
* (delete) 
phoenix-hbase-compat-2.0.1/src/main/java/org/apache/phoenix/compat/hbase/CompatUtil.java
* (delete) phoenix-hbase-compat-2.0.1/pom.xml
* (delete) 
phoenix-hbase-compat-2.0.1/src/main/java/org/apache/phoenix/compat/hbase/CompatPermissionUtil.java
* (edit) pom.xml
* (delete) 
phoenix-hbase-compat-2.0.1/src/main/java/org/apache/phoenix/compat/hbase/test/DelegateCell.java
* (delete) 
phoenix-hbase-compat-2.0.1/src/main/java/org/apache/phoenix/compat/hbase/OffsetCell.java


> Remove or update HBase 2.0 support
> --
>
> Key: PHOENIX-5716
> URL: https://issues.apache.org/jira/browse/PHOENIX-5716
> Project: Phoenix
>  Issue Type: Task
>Affects Versions: 5.1.0
>Reporter: Istvan Toth
>Assignee: Istvan Toth
>Priority: Major
> Fix For: 5.1.0
>
> Attachments: PHOENIX-5716.master.v1.patch
>
>  Time Spent: 10m
>  Remaining Estimate: 0h
>
> Since HBase 2.0 is EOM, we could remove support for it from master.
> If we are not ready to do that, we could update it to work with 2.0.6 release.
>  



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (PHOENIX-5779) SplitSystemCatalogIT tests fail with Multiple Regions error

2020-07-06 Thread Hudson (Jira)


[ 
https://issues.apache.org/jira/browse/PHOENIX-5779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17152385#comment-17152385
 ] 

Hudson commented on PHOENIX-5779:
-

FAILURE: Integrated in Jenkins build PreCommit-PHOENIX-Build #4016 (See 
[https://builds.apache.org/job/PreCommit-PHOENIX-Build/4016/])
PHOENIX-5779 SplitSystemCatalogIT tests fail with Multiple Regions error 
(stoty: rev 837cf4f1cc119c6f86be9f3518e774e48faaa049)
* (edit) phoenix-core/src/it/java/org/apache/phoenix/end2end/ViewMetadataIT.java
* (edit) phoenix-core/src/it/java/org/apache/phoenix/end2end/ViewIT.java
* (edit) phoenix-core/src/test/java/org/apache/phoenix/query/BaseTest.java
* (edit) 
phoenix-core/src/it/java/org/apache/phoenix/end2end/SplitSystemCatalogIT.java


> SplitSystemCatalogIT tests fail with Multiple Regions error
> ---
>
> Key: PHOENIX-5779
> URL: https://issues.apache.org/jira/browse/PHOENIX-5779
> Project: Phoenix
>  Issue Type: Bug
>Affects Versions: 5.1.0
>Reporter: Sandeep Guggilam
>Assignee: Richard Antal
>Priority: Major
> Fix For: 5.1.0, 4.16.0
>
> Attachments: PHOENIX-5779-addendum.master.v1.patch, 
> PHOENIX-5779-addendum.master.v2.patch, PHOENIX-5779.addendum.master.v3.patch, 
> PHOENIX-5779.addendum.master.v4.patch, PHOENIX-5779.master.v1.patch
>
>
> I see the SplitSystemCatalogIT tests failing on master branch complaining 
> with the error " Multiple regions on server" when it tries to split the 
> system catalog.
>  
> Sample builds where it failed:
> [https://builds.apache.org/job/PreCommit-PHOENIX-Build/3560//testReport/]
> [https://builds.apache.org/job/PreCommit-PHOENIX-Build/3571//testReport/]
>  



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (PHOENIX-5779) SplitSystemCatalogIT tests fail with Multiple Regions error

2020-07-01 Thread Hudson (Jira)


[ 
https://issues.apache.org/jira/browse/PHOENIX-5779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17149372#comment-17149372
 ] 

Hudson commented on PHOENIX-5779:
-

FAILURE: Integrated in Jenkins build PreCommit-PHOENIX-Build #4009 (See 
[https://builds.apache.org/job/PreCommit-PHOENIX-Build/4009/])
PHOENIX-5779 SplitSystemCatalogIT tests fail with Multiple Regions error 
(stoty: rev 713c8d953596f7a002502b7298a393414766a87e)
* (edit) phoenix-core/src/test/java/org/apache/phoenix/query/BaseTest.java


> SplitSystemCatalogIT tests fail with Multiple Regions error
> ---
>
> Key: PHOENIX-5779
> URL: https://issues.apache.org/jira/browse/PHOENIX-5779
> Project: Phoenix
>  Issue Type: Bug
>Affects Versions: 5.1.0
>Reporter: Sandeep Guggilam
>Assignee: Richard Antal
>Priority: Major
> Fix For: 5.1.0, 4.16.0
>
> Attachments: PHOENIX-5779.master.v1.patch
>
>
> I see the SplitSystemCatalogIT tests failing on master branch complaining 
> with the error " Multiple regions on server" when it tries to split the 
> system catalog.
>  
> Sample builds where it failed:
> [https://builds.apache.org/job/PreCommit-PHOENIX-Build/3560//testReport/]
> [https://builds.apache.org/job/PreCommit-PHOENIX-Build/3571//testReport/]
>  



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (PHOENIX-5975) Index rebuild/verification page size should be configurable from IndexTool

2020-07-01 Thread Hudson (Jira)


[ 
https://issues.apache.org/jira/browse/PHOENIX-5975?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17149204#comment-17149204
 ] 

Hudson commented on PHOENIX-5975:
-

FAILURE: Integrated in Jenkins build PreCommit-PHOENIX-Build #4008 (See 
[https://builds.apache.org/job/PreCommit-PHOENIX-Build/4008/])
PHOENIX-5975 Index rebuild/verification page size should be configurable 
(achouhan: rev 81e9a1927a6cf7cf171f6d0544d657509aa8a867)
* (edit) 
phoenix-core/src/main/java/org/apache/phoenix/mapreduce/PhoenixServerBuildIndexInputFormat.java
* (edit) phoenix-core/src/it/java/org/apache/phoenix/end2end/IndexToolIT.java
* (edit) 
phoenix-core/src/main/java/org/apache/phoenix/compile/ServerBuildIndexCompiler.java
* (edit) 
phoenix-core/src/main/java/org/apache/phoenix/coprocessor/GlobalIndexRegionScanner.java
* (edit) 
phoenix-core/src/it/java/org/apache/phoenix/end2end/IndexToolForNonTxGlobalIndexIT.java
* (edit) 
phoenix-core/src/main/java/org/apache/phoenix/mapreduce/index/PhoenixServerBuildIndexMapper.java
* (edit) 
phoenix-core/src/main/java/org/apache/phoenix/coprocessor/BaseScannerRegionObserver.java


> Index rebuild/verification page size should be configurable from IndexTool
> --
>
> Key: PHOENIX-5975
> URL: https://issues.apache.org/jira/browse/PHOENIX-5975
> Project: Phoenix
>  Issue Type: Improvement
>Reporter: Abhishek Singh Chouhan
>Assignee: Abhishek Singh Chouhan
>Priority: Major
> Fix For: 5.1.0, 4.16.0
>
> Attachments: PHOENIX-5975-4.x.001.patch, PHOENIX-5975-4.x.002.patch, 
> PHOENIX-5975-4.x.patch, PHOENIX-5975-master.patch
>
>  Time Spent: 0.5h
>  Remaining Estimate: 0h
>




--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (PHOENIX-5937) Order by on nullable column sometimes filters rows

2020-06-29 Thread Hudson (Jira)


[ 
https://issues.apache.org/jira/browse/PHOENIX-5937?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17147820#comment-17147820
 ] 

Hudson commented on PHOENIX-5937:
-

FAILURE: Integrated in Jenkins build PreCommit-PHOENIX-Build #4002 (See 
[https://builds.apache.org/job/PreCommit-PHOENIX-Build/4002/])
PHOENIX-5937 Order by on nullable column sometimes filters rows (stoty: rev 
0bbe2faddce0b9b550a8efd558536bb03cfb133f)
* (edit) phoenix-core/src/it/java/org/apache/phoenix/end2end/BaseOrderByIT.java
* (edit) 
phoenix-core/src/main/java/org/apache/phoenix/iterate/BaseResultIterators.java


> Order by on nullable column sometimes filters rows
> --
>
> Key: PHOENIX-5937
> URL: https://issues.apache.org/jira/browse/PHOENIX-5937
> Project: Phoenix
>  Issue Type: Bug
>  Components: core
>Affects Versions: 4.x, master
>Reporter: Istvan Toth
>Assignee: Richard Antal
>Priority: Major
> Fix For: 5.1.0, 4.16.0
>
> Attachments: PHOENIX-5937.master.v1.patch, 
> PHOENIX-5937.master.v2.patch, PHOENIX-5937.master.v3.patch, 
> PHOENIX-5937.master.v4.patch
>
>
> When selecting using order by on a nullable column, the rows where the order 
> column is null are sometimes not returned.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (PHOENIX-5898) Phoenix function CURRENT_TIME() returns wrong result when view indexes are used.

2020-06-26 Thread Hudson (Jira)


[ 
https://issues.apache.org/jira/browse/PHOENIX-5898?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17146777#comment-17146777
 ] 

Hudson commented on PHOENIX-5898:
-

FAILURE: Integrated in Jenkins build PreCommit-PHOENIX-Build #3996 (See 
[https://builds.apache.org/job/PreCommit-PHOENIX-Build/3996/])
PHOENIX-5898 Phoenix function CURRENT_TIME() returns wrong result when 
(yanxinyi: rev e6fc80cf706518214c36a92189ab1c5dbb24a9ba)
* (edit) 
phoenix-core/src/main/java/org/apache/phoenix/schema/MetaDataClient.java
* (edit) 
phoenix-core/src/it/java/org/apache/phoenix/end2end/TenantSpecificViewIndexIT.java


> Phoenix function CURRENT_TIME() returns wrong result when view indexes are 
> used.
> 
>
> Key: PHOENIX-5898
> URL: https://issues.apache.org/jira/browse/PHOENIX-5898
> Project: Phoenix
>  Issue Type: Bug
>Affects Versions: 5.0.0, 4.15.0
>Reporter: Jacob Isaac
>Assignee: Jacob Isaac
>Priority: Major
> Fix For: 5.1.0, 4.16.0, 4.x
>
> Attachments: PHOENIX-5898.4.x.002.patch, SampleTest.java
>
>
> Here is a sample test.
> [^SampleTest.java]



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (PHOENIX-5910) IndexTool verification-only runs should have counters for unverified rows

2020-06-25 Thread Hudson (Jira)


[ 
https://issues.apache.org/jira/browse/PHOENIX-5910?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17145823#comment-17145823
 ] 

Hudson commented on PHOENIX-5910:
-

SUCCESS: Integrated in Jenkins build PreCommit-PHOENIX-Build #3989 (See 
[https://builds.apache.org/job/PreCommit-PHOENIX-Build/3989/])
PHOENIX-5910 IndexTool verification-only runs should have counters for 
(kozdemir: rev ae227bcb7f06a10d08eec06ec216c5756dd160a4)
* (edit) 
phoenix-core/src/main/java/org/apache/phoenix/mapreduce/index/PhoenixIndexImportDirectReducer.java
* (edit) 
phoenix-core/src/it/java/org/apache/phoenix/end2end/IndexToolForNonTxGlobalIndexIT.java
* (edit) 
phoenix-core/src/main/java/org/apache/phoenix/coprocessor/IndexRebuildRegionScanner.java
* (edit) 
phoenix-core/src/main/java/org/apache/phoenix/coprocessor/IndexToolVerificationResult.java
* (edit) 
phoenix-core/src/main/java/org/apache/phoenix/mapreduce/index/PhoenixIndexToolJobCounters.java
* (edit) 
phoenix-core/src/main/java/org/apache/phoenix/mapreduce/index/IndexVerificationResultRepository.java
* (edit) 
phoenix-core/src/it/java/org/apache/phoenix/end2end/index/GlobalIndexCheckerIT.java
PHOENIX-5910 Addendum (kozdemir: rev cea5200e94187f8c8e49ef9d17af07c088c6000e)
* (edit) 
phoenix-core/src/main/java/org/apache/phoenix/coprocessor/IndexRebuildRegionScanner.java


> IndexTool verification-only runs should have counters for unverified rows
> -
>
> Key: PHOENIX-5910
> URL: https://issues.apache.org/jira/browse/PHOENIX-5910
> Project: Phoenix
>  Issue Type: Improvement
>Affects Versions: 5.0.0, 4.14.3
>Reporter: Kadir OZDEMIR
>Assignee: Kadir OZDEMIR
>Priority: Major
> Attachments: PHOENIX-5910.4.x.001.patch, PHOENIX-5910.4.x.002.patch
>
>  Time Spent: 2h
>  Remaining Estimate: 0h
>
> An index row is considered unverified if the empty column value does not 
> exist or has a value other than "verified". Although an unverified index row 
> can be repaired and if so, it is considered a valid row, it is desirable to 
> have counters for the unverified rows and report them during IndexTool 
> only-verification runs.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (PHOENIX-5897) SingleKeyValueTuple.toString() returns unexpected result

2020-06-23 Thread Hudson (Jira)


[ 
https://issues.apache.org/jira/browse/PHOENIX-5897?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17142881#comment-17142881
 ] 

Hudson commented on PHOENIX-5897:
-

ABORTED: Integrated in Jenkins build PreCommit-PHOENIX-Build #3984 (See 
[https://builds.apache.org/job/PreCommit-PHOENIX-Build/3984/])
PHOENIX-5897 SingleKeyValueTuple.toString() returns unexpected result. 
(chenglei: rev 4d6a67d5ef30bf73a5ac4feddf09969c884e226a)
* (edit) 
phoenix-core/src/main/java/org/apache/phoenix/schema/tuple/SingleKeyValueTuple.java
* (add) 
phoenix-core/src/test/java/org/apache/phoenix/schema/tuple/SingleKeyValueTupleTest.java


> SingleKeyValueTuple.toString() returns unexpected result
> 
>
> Key: PHOENIX-5897
> URL: https://issues.apache.org/jira/browse/PHOENIX-5897
> Project: Phoenix
>  Issue Type: Improvement
>Affects Versions: 5.0.0-alpha
>Reporter: Chen Feng
>Assignee: Chen Feng
>Priority: Minor
> Fix For: 5.1.0, 4.16.0
>
> Attachments: PHOENIX-5897-v1.patch, PHOENIX-5897_v1-4.x.patch
>
>
> In SingleKeyValueTuple.toString(), the code is shown as follows.
> return "SingleKeyValueTuple[" + cell == null ? keyPtr.get() == 
> UNITIALIZED_KEY_BUFFER ? "null" : 
> Bytes.toStringBinary(keyPtr.get(),keyPtr.getOffset(),keyPtr.getLength()) : 
> cell.toString() + "]";
> actually, the code runs in the following order.
> ("SingleKeyValueTuple[" + cell) == null ? keyPtr.get() == 
> UNITIALIZED_KEY_BUFFER ? "null" : Bytes.toStringBinary() : (cell.toString() + 
> "]");
> Therefore the result is weird.
> BTW, value = condition1 ? condition2 ? X : Y : Z is also confusing, using if 
> can be more clear.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (PHOENIX-5970) ViewUtil.dropChildViews may cause HConnection leak which may cause ITtests hange

2020-06-23 Thread Hudson (Jira)


[ 
https://issues.apache.org/jira/browse/PHOENIX-5970?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17142882#comment-17142882
 ] 

Hudson commented on PHOENIX-5970:
-

ABORTED: Integrated in Jenkins build PreCommit-PHOENIX-Build #3984 (See 
[https://builds.apache.org/job/PreCommit-PHOENIX-Build/3984/])
PHOENIX-5970 ViewUtil.dropChildViews may cause HConnection leak (chenglei: rev 
658464545971c6c7d051c1f8046928725e1aed12)
* (edit) phoenix-core/src/main/java/org/apache/phoenix/util/ViewUtil.java


> ViewUtil.dropChildViews may cause HConnection leak which may cause ITtests 
> hange
> 
>
> Key: PHOENIX-5970
> URL: https://issues.apache.org/jira/browse/PHOENIX-5970
> Project: Phoenix
>  Issue Type: Bug
>Affects Versions: 4.15.0
>Reporter: chenglei
>Assignee: chenglei
>Priority: Major
> Fix For: 5.1.0, 4.16.0
>
> Attachments: PHOENIX-5970_v1-4.x.patch
>
>
> After PHOENIX-5962, the ITtests still hange , I noticed the RegionServer is 
> blocked as follows : (by 4.x branch and HBase1.4.10) :
> {code:java}
> Thread 31512: (state = BLOCKED)
>  - java.lang.Thread.sleep(long) @bci=0 (Compiled frame; information may be 
> imprecise)
>  - java.lang.Thread.sleep(long, int) @bci=57, line=340 (Compiled frame)
>  - java.util.concurrent.TimeUnit.sleep(long) @bci=23, line=386 (Compiled 
> frame)
>  - org.apache.hadoop.hbase.util.RetryCounter.sleepUntilNextRetry() @bci=110, 
> line=158 (Compiled frame)
>  - 
> org.apache.hadoop.hbase.zookeeper.RecoverableZooKeeper.getData(java.lang.String,
>  org.apache.zookeeper.Watcher, org.apache.zookeeper.data.Stat) @bci=180, 
> line=367 (Compiled frame)
>  - 
> org.apache.hadoop.hbase.zookeeper.ZKUtil.getData(org.apache.hadoop.hbase.zookeeper.ZooKeeperWatcher,
>  java.lang.String) @bci=11, line=629 (Compiled frame)
>  - 
> org.apache.hadoop.hbase.zookeeper.MetaTableLocator.getMetaRegionState(org.apache.hadoop.hbase.zookeeper.ZooKeeperWatcher,
>  int) @bci=23, line=487 (Compiled frame)
>  - 
> org.apache.hadoop.hbase.zookeeper.MetaTableLocator.getMetaRegionLocation(org.apache.hadoop.hbase.zookeeper.ZooKeeperWatcher,
>  int) @bci=6, line=168 (Compiled frame)
>  - 
> org.apache.hadoop.hbase.zookeeper.MetaTableLocator.blockUntilAvailable(org.apache.hadoop.hbase.zookeeper.ZooKeeperWatcher,
>  int, long) @bci=63, line=607 (Compiled frame)
>  - 
> org.apache.hadoop.hbase.zookeeper.MetaTableLocator.blockUntilAvailable(org.apache.hadoop.hbase.zookeeper.ZooKeeperWatcher,
>  long) @bci=9, line=588 (Compiled frame)
>  - 
> org.apache.hadoop.hbase.zookeeper.MetaTableLocator.blockUntilAvailable(org.apache.hadoop.hbase.zookeeper.ZooKeeperWatcher,
>  long, org.apache.hadoop.conf.Configuration) @bci=34, line=561 (Compiled 
> frame)
>  - org.apache.hadoop.hbase.client.ZooKeeperRegistry.getMetaRegionLocation() 
> @bci=94, line=61 (Compiled frame)
>  - 
> org.apache.hadoop.hbase.client.ConnectionManager$HConnectionImplementation.locateMeta(org.apache.hadoop.hbase.TableName,
>  boolean, int) @bci=205, line=1266 (Compiled frame)
>  - 
> org.apache.hadoop.hbase.client.ConnectionManager$HConnectionImplementation.locateRegion(org.apache.hadoop.hbase.TableName,
>  byte[], boolean, boolean, int) @bci=119, line=1227 (Compiled frame)
>  - 
> org.apache.hadoop.hbase.client.CoprocessorHConnection.locateRegion(org.apache.hadoop.hbase.TableName,
>  byte[], boolean, boolean, int) @bci=13, line=41 (Compiled frame)
>  - 
> org.apache.hadoop.hbase.client.ConnectionManager$HConnectionImplementation.relocateRegion(org.apache.hadoop.hbase.TableName,
>  byte[], int) @bci=93, line=1201 (Interpreted frame)
>  - 
> org.apache.hadoop.hbase.client.CoprocessorHConnection.relocateRegion(org.apache.hadoop.hbase.TableName,
>  byte[], int) @bci=9, line=41 (Interpreted frame)
>  - 
> org.apache.hadoop.hbase.client.ConnectionManager$HConnectionImplementation.locateRegionInMeta(org.apache.hadoop.hbase.TableName,
>  byte[], boolean, boolean, int) @bci=1668, line=1419 (Compiled frame)
>  - 
> org.apache.hadoop.hbase.client.ConnectionManager$HConnectionImplementation.locateRegion(org.apache.hadoop.hbase.TableName,
>  byte[], boolean, boolean, int) @bci=138, line=1230 (Compiled frame)
>  - 
> org.apache.hadoop.hbase.client.CoprocessorHConnection.locateRegion(org.apache.hadoop.hbase.TableName,
>  byte[], boolean, boolean, int) @bci=13, line=41 (Compiled frame)
>  - 
> org.apache.hadoop.hbase.client.RpcRetryingCallerWithReadReplicas.getRegionLocations(boolean,
>  int, org.apache.hadoop.hbase.client.ClusterConnection, 
> org.apache.hadoop.hbase.TableName, byte[]) @bci=22, line=356 (Compiled frame)
>  - org.apache.hadoop.hbase.client.ScannerCallableWithReplicas.call(int) 
> @bci=164, line=153 (Compiled frame)
>  - org.apache.hadoop.hbase.client.ScannerCallableWithReplicas.call(int) 
> @bci=6, 

[jira] [Commented] (PHOENIX-5968) Undeclared org.apache.commons.lang dependency

2020-06-20 Thread Hudson (Jira)


[ 
https://issues.apache.org/jira/browse/PHOENIX-5968?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17141209#comment-17141209
 ] 

Hudson commented on PHOENIX-5968:
-

ABORTED: Integrated in Jenkins build PreCommit-PHOENIX-Build #3982 (See 
[https://builds.apache.org/job/PreCommit-PHOENIX-Build/3982/])
PHOENIX-5968 Undeclared org.apache.commons.lang dependency (#807) (github: rev 
e41fc51507ea17c73b519e3d5b574f97c4f567f0)
* (edit) 
phoenix-core/src/it/java/org/apache/phoenix/end2end/ParameterizedIndexUpgradeToolIT.java


> Undeclared org.apache.commons.lang dependency
> -
>
> Key: PHOENIX-5968
> URL: https://issues.apache.org/jira/browse/PHOENIX-5968
> Project: Phoenix
>  Issue Type: Bug
>  Components: core
>Affects Versions: 5.1.0
>Reporter: Istvan Toth
>Assignee: Istvan Toth
>Priority: Major
> Attachments: PHOENIX-5968.master.v1.patch
>
>  Time Spent: 20m
>  Remaining Estimate: 0h
>
> mvn verify/install fails because of org.apache.commons.lang being used.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (PHOENIX-5793) Support parallel init and fast null return for SortMergeJoinPlan.

2020-06-20 Thread Hudson (Jira)


[ 
https://issues.apache.org/jira/browse/PHOENIX-5793?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17141208#comment-17141208
 ] 

Hudson commented on PHOENIX-5793:
-

ABORTED: Integrated in Jenkins build PreCommit-PHOENIX-Build #3982 (See 
[https://builds.apache.org/job/PreCommit-PHOENIX-Build/3982/])
PHOENIX-5793 Support parallel init and fast null return for (chenglei: rev 
d48e3624d71427707759928830b42e1bd42cea90)
* (edit) 
phoenix-core/src/test/java/org/apache/phoenix/execute/SortMergeJoinTest.java
* (edit) 
phoenix-core/src/it/java/org/apache/phoenix/end2end/SortMergeJoinMoreIT.java
* (edit) 
phoenix-core/src/main/java/org/apache/phoenix/execute/SortMergeJoinPlan.java


> Support parallel init and fast null return for SortMergeJoinPlan.
> -
>
> Key: PHOENIX-5793
> URL: https://issues.apache.org/jira/browse/PHOENIX-5793
> Project: Phoenix
>  Issue Type: Improvement
>Affects Versions: 5.0.0
>Reporter: Chen Feng
>Assignee: Chen Feng
>Priority: Minor
> Fix For: 5.1.0, 4.16.0
>
> Attachments: PHOENIX-5793-v2.patch, PHOENIX-5793-v3.patch, 
> PHOENIX-5793-v4.patch, PHOENIX-5793-v5.patch, PHOENIX-5793_v1-4.x.patch
>
>
> For a join sql like A join B. The implementation of SortMergeJoinPlan 
> currently inits the two iterators A and B one by one.
> By initializing A and B in parallel, we can improve performance in two 
> aspects.
> 1) By overlapping the time in initializing.
> 2) If one child query is null, the other child query can be canceled since 
> the final result must be null.
>  



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (PHOENIX-5962) Stabilize builds

2020-06-19 Thread Hudson (Jira)


[ 
https://issues.apache.org/jira/browse/PHOENIX-5962?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17140973#comment-17140973
 ] 

Hudson commented on PHOENIX-5962:
-

ABORTED: Integrated in Jenkins build PreCommit-PHOENIX-Build #3979 (See 
[https://builds.apache.org/job/PreCommit-PHOENIX-Build/3979/])
PHOENIX-5962 Stabilize builds (stoty: rev 
82241d4e152023d87bf4cd400942d1c0c2df6562)
* (edit) 
phoenix-core/src/it/java/org/apache/phoenix/end2end/IndexBuildTimestampIT.java
* (edit) 
phoenix-core/src/main/java/org/apache/phoenix/util/EnvironmentEdgeManager.java
* (edit) 
phoenix-core/src/it/java/org/apache/phoenix/end2end/NonParameterizedIndexScrutinyToolIT.java
* (edit) 
phoenix-core/src/it/java/org/apache/phoenix/end2end/index/IndexVerificationOutputRepositoryIT.java
* (edit) 
phoenix-core/src/it/java/org/apache/phoenix/end2end/IndexToolTimeRangeIT.java
* (edit) 
phoenix-core/src/it/java/org/apache/phoenix/end2end/IndexVerificationOldDesignIT.java
* (edit) 
phoenix-core/src/test/java/org/apache/phoenix/index/VerifySingleIndexRowTest.java
* (edit) 
phoenix-pherf/src/test/java/org/apache/phoenix/pherf/workload/MultiThreadedRunnerTest.java


> Stabilize builds
> 
>
> Key: PHOENIX-5962
> URL: https://issues.apache.org/jira/browse/PHOENIX-5962
> Project: Phoenix
>  Issue Type: Task
>Reporter: Richard Antal
>Assignee: Richard Antal
>Priority: Major
> Fix For: 5.1.0, 4.16.0
>
> Attachments: PHOENIX-5962.4.x.v1.patch, PHOENIX-5962.master.v1.patch, 
> PHOENIX-5962.master.v2.patch, PHOENIX-5962.master.v3.patch, 
> PHOENIX-5962.master.v4.patch, PHOENIX-5962.master.v5.patch, 
> PHOENIX-5962.master.v6.patch
>
>
> Last 2 build was aborted because Build timed out (after 360 minutes).
>  Search the possible cause of the problem and try to fix it.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (PHOENIX-5905) Reset user to hbase by changing rpc context before getting user permissions on access controller service

2020-06-18 Thread Hudson (Jira)


[ 
https://issues.apache.org/jira/browse/PHOENIX-5905?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17139331#comment-17139331
 ] 

Hudson commented on PHOENIX-5905:
-

ABORTED: Integrated in Jenkins build PreCommit-PHOENIX-Build #3975 (See 
[https://builds.apache.org/job/PreCommit-PHOENIX-Build/3975/])
PHOENIX-5905 Reset user to hbase by changing rpc context before getting 
(rajeshbabu chintaguntla: rev b15468e6784a0626bd140ed0c95b317d96efd052)
* (edit) 
phoenix-core/src/it/java/org/apache/phoenix/end2end/BasePermissionsIT.java


> Reset user to hbase by changing rpc context before getting user permissions 
> on access controller service 
> -
>
> Key: PHOENIX-5905
> URL: https://issues.apache.org/jira/browse/PHOENIX-5905
> Project: Phoenix
>  Issue Type: Bug
>Reporter: Rajeshbabu Chintaguntla
>Assignee: Rajeshbabu Chintaguntla
>Priority: Major
> Fix For: 5.1.0, 4.16.0
>
> Attachments: PHOENIX-5905.4.x.patch, 
> PHOENIX-5905.master.addendum2.patch, PHOENIX-5905.master.addendum3.patch, 
> PHOENIX-5905.patch, PHOENIX-5905_addendum.patch, PHOENIX-5905_addendum2.patch
>
>
> Currently we are calling getUserPermissions with hbase user directly on 
> access controller service which is not a rpc call. If we don't reset user 
> system user will be considered and might expect extra privileges  to return 
> the user  permissions.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (PHOENIX-5956) Optimize LeftSemiJoin For SortMergeJoin

2020-06-18 Thread Hudson (Jira)


[ 
https://issues.apache.org/jira/browse/PHOENIX-5956?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17139286#comment-17139286
 ] 

Hudson commented on PHOENIX-5956:
-

FAILURE: Integrated in Jenkins build PreCommit-PHOENIX-Build #3976 (See 
[https://builds.apache.org/job/PreCommit-PHOENIX-Build/3976/])
PHOENIX-5956 Optimize LeftSemiJoin For SortMergeJoin (chenglei: rev 
11c24925ec29f91970c36322cf3d7a00a32efc40)
* (edit) 
phoenix-core/src/main/java/org/apache/phoenix/execute/SortMergeJoinPlan.java
* (add) 
phoenix-core/src/test/java/org/apache/phoenix/execute/SortMergeJoinTest.java
* (edit) 
phoenix-core/src/it/java/org/apache/phoenix/end2end/SortMergeJoinMoreIT.java


> Optimize LeftSemiJoin For SortMergeJoin 
> 
>
> Key: PHOENIX-5956
> URL: https://issues.apache.org/jira/browse/PHOENIX-5956
> Project: Phoenix
>  Issue Type: Improvement
>Affects Versions: 4.15.0
>Reporter: chenglei
>Assignee: chenglei
>Priority: Major
> Fix For: 5.1.0, 4.16.0
>
> Attachments: PHOENIX-5956_v1-4.x.patch
>
>
> When LHS left semi join RHS through {{SortMergeJoinPlan}}, if RHS is end and 
> returns null, then the left semi join could end early, but for 
> {{SortMergeJoinPlan.SemiAntiJoinIterator}} , it would continue until LHS is 
> exhausted even if RHS returns null, which is unnecessary.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (PHOENIX-5783) Implement starttime in IndexTool for rebuild and verification

2020-06-17 Thread Hudson (Jira)


[ 
https://issues.apache.org/jira/browse/PHOENIX-5783?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17138917#comment-17138917
 ] 

Hudson commented on PHOENIX-5783:
-

FAILURE: Integrated in Jenkins build PreCommit-PHOENIX-Build #3974 (See 
[https://builds.apache.org/job/PreCommit-PHOENIX-Build/3974/])
PHOENIX-5783: Implement starttime in IndexTool for rebuild and (github: rev 
6393462ced536efe1d88fda03421dc470ffb0990)
* (edit) 
phoenix-core/src/main/java/org/apache/phoenix/mapreduce/PhoenixServerBuildIndexInputFormat.java
* (edit) 
phoenix-core/src/it/java/org/apache/phoenix/end2end/IndexToolTimeRangeIT.java
* (edit) 
phoenix-core/src/it/java/org/apache/phoenix/end2end/IndexToolForNonTxGlobalIndexIT.java
* (edit) 
phoenix-core/src/main/java/org/apache/phoenix/coprocessor/IndexRebuildRegionScanner.java


> Implement starttime in IndexTool for rebuild and verification
> -
>
> Key: PHOENIX-5783
> URL: https://issues.apache.org/jira/browse/PHOENIX-5783
> Project: Phoenix
>  Issue Type: Bug
>Reporter: Swaroopa Kadam
>Assignee: Swaroopa Kadam
>Priority: Major
> Attachments: PHOENIX-5783.4.x.001.patch, PHOENIX-5783.4.x.010.patch, 
> PHOENIX-5783.4.x.011.patch, PHOENIX-5783.4.x.100.patch, 
> PHOENIX-5783.4.x.v1.patch, PHOENIX-5783.4.x.v2.patch, 
> PHOENIX-5783.4.x.v3.patch, PHOENIX-5783.v1.patch
>
>  Time Spent: 2h
>  Remaining Estimate: 0h
>
> IndexTool's inline verification and rebuild should be able to perform the 
> logic for a specified time range given by starttime parameters. 
>  
> This feature is only for indexes on non-transactional tables
> .



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (PHOENIX-5875) Optional logging for IndexTool verification

2020-06-14 Thread Hudson (Jira)


[ 
https://issues.apache.org/jira/browse/PHOENIX-5875?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17135068#comment-17135068
 ] 

Hudson commented on PHOENIX-5875:
-

FAILURE: Integrated in Jenkins build PreCommit-PHOENIX-Build #3961 (See 
[https://builds.apache.org/job/PreCommit-PHOENIX-Build/3961/])
PHOENIX-5875 - Optional logging for IndexTool verification (gjacoby: rev 
2b9404c2d7dd3d6b5a4bddfa76a38f7a57baf738)
* (edit) 
phoenix-core/src/main/java/org/apache/phoenix/mapreduce/PhoenixServerBuildIndexInputFormat.java
* (edit) phoenix-core/src/test/java/org/apache/phoenix/util/TestUtil.java
* (edit) 
phoenix-core/src/it/java/org/apache/phoenix/end2end/index/IndexVerificationOutputRepositoryIT.java
* (edit) 
phoenix-core/src/main/java/org/apache/phoenix/mapreduce/index/IndexVerificationOutputRepository.java
* (edit) phoenix-core/src/it/java/org/apache/phoenix/end2end/IndexToolIT.java
* (edit) 
phoenix-core/src/it/java/org/apache/phoenix/end2end/IndexToolForNonTxGlobalIndexIT.java
* (edit) 
phoenix-core/src/main/java/org/apache/phoenix/coprocessor/IndexRebuildRegionScanner.java
* (edit) 
phoenix-core/src/main/java/org/apache/phoenix/mapreduce/index/IndexVerificationResultRepository.java
* (edit) 
phoenix-core/src/main/java/org/apache/phoenix/mapreduce/index/IndexTool.java
* (edit) 
phoenix-core/src/main/java/org/apache/phoenix/coprocessor/BaseScannerRegionObserver.java
* (edit) 
phoenix-core/src/main/java/org/apache/phoenix/mapreduce/util/PhoenixConfigurationUtil.java
* (edit) phoenix-core/src/test/java/org/apache/phoenix/index/IndexToolTest.java


> Optional logging for IndexTool verification
> ---
>
> Key: PHOENIX-5875
> URL: https://issues.apache.org/jira/browse/PHOENIX-5875
> Project: Phoenix
>  Issue Type: Improvement
>Affects Versions: 5.0.0, 4.14.3
>Reporter: Kadir OZDEMIR
>Assignee: Geoffrey Jacoby
>Priority: Major
> Fix For: 5.1.0, 4.16.0
>
> Attachments: PHOENIX-5875-4.x.v1.patch, PHOENIX-5875-4.x.v2.patch, 
> PHOENIX-5875-4.x.v3.patch, PHOENIX-5875.v1.patch
>
>  Time Spent: 1h 40m
>  Remaining Estimate: 0h
>
> IndexTool logs information about each row that has a verification failure. 
> The amount of logging can be excessive for large index tables. Also for some 
> runs, we may want to just do incremental repair, i.e., repair only the rows 
> that are broken, using -v BOTH or -v BEFORE, but not interested in the 
> details of how they are broken. Thus, IndexTool should have an option to 
> disable logging, something like, -dl (--disable-logging) BEFORE | AFTER | 
> BOTH where BEFORE, AFTER and BOTH indicate at the which phase (before or 
> after index repair or a both phases ) logging is disabled.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (PHOENIX-5884) Join query return empty result when filters for both the tables are present

2020-06-14 Thread Hudson (Jira)


[ 
https://issues.apache.org/jira/browse/PHOENIX-5884?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17135069#comment-17135069
 ] 

Hudson commented on PHOENIX-5884:
-

FAILURE: Integrated in Jenkins build PreCommit-PHOENIX-Build #3961 (See 
[https://builds.apache.org/job/PreCommit-PHOENIX-Build/3961/])
PHOENIX-5884 Join query return empty result when filters for both the (ankit: 
rev 7e955ecbcf967e74fbb37e5d0c9c5556ebac5898)
* (edit) 
phoenix-core/src/it/java/org/apache/phoenix/end2end/join/WhereOptimizerForJoinFiltersIT.java


> Join query return empty result when filters for both the tables are present
> ---
>
> Key: PHOENIX-5884
> URL: https://issues.apache.org/jira/browse/PHOENIX-5884
> Project: Phoenix
>  Issue Type: Bug
>Affects Versions: 4.14.0
>Reporter: Ankit Singhal
>Assignee: Ankit Singhal
>Priority: Major
> Fix For: 5.1.0, 4.16.0
>
> Attachments: PHOENIX-5884.master.v2.patch, 
> PHOENIX-5884.master.v3.patch, PHOENIX-5884.master.v4.patch, 
> PHOENIX-5884.master.v5.patch, PHOENIX-5884_v1.patch
>
>
> Let's assume DDL to be same for both the tables involved in a join
> {code}
> CREATE TABLE LeftTable (id1 CHAR(6) NOT NULL,id2 VARCHAR(22) NOT 
> NULL,id3 VARCHAR(12) NOT NULL,id4 CHAR(2) NOT NULL,id5 CHAR(6) 
> NOT NULL, id6 VARCHAR(200) NOT NULL,id7 VARCHAR(50) NOT NULL,ts 
> TIMESTAMP ,CONSTRAINT PK_JOIN_AND_INTERSECTION_TABLE PRIMARY 
> KEY(id1,id2,id3,id4,id5,id6,id7))
> {code}
> Following query return right results
> {code}
> SELECT m.*,r.* FROM LEFT_TABLE m join RIGHT_TABLE r  on m.id3 = r.id3 and 
> m.id2 = r.id2  and m.id4 = r.id4  and m.id5 = r.id5  and m.id1 = r.id1  and 
> m.ts = r.ts  where  r.id1 IN ('201904','201905')  and r.id2 = 'ID2_VAL'  and 
> r.id3 IN ('ID3_VAL','ID3_VAL2') 
> {code}
> but When to optimize the query, filters for the left table are also added , 
> query returned empty result . Though the filters are based on join condition 
> so semantically above query and below query should be same.
> {code}
> SELECT m.*,r.* FROM LEFT_TABLE m join RIGHT_TABLE r  on m.id3 = r.id3  and 
> m.id2 = r.id2  and m.id4 = r.id4 and m.id5 = r.id5  and m.id1 = r.id1 and 
> m.ts = r.ts  where m.id1 IN ('201904','201905')  and r.id1 IN 
> ('201904','201905') and r.id2 = 'ID2_VAL' and m.id3 IN 
> ('ID3_VAL','ID3_VAL2')  and r.id3 IN ('ID3_VAL','ID3_VAL2') 
> {code}



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (PHOENIX-5932) View Index rebuild results in surplus rows from other view indexes

2020-06-11 Thread Hudson (Jira)


[ 
https://issues.apache.org/jira/browse/PHOENIX-5932?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17133501#comment-17133501
 ] 

Hudson commented on PHOENIX-5932:
-

FAILURE: Integrated in Jenkins build PreCommit-PHOENIX-Build #3954 (See 
[https://builds.apache.org/job/PreCommit-PHOENIX-Build/3954/])
PHOENIX-5932 View Index rebuild results in surplus rows from other view 
(achouhan: rev 3a8234659e38902177d08f5f9efee1214c0e74a9)
* (add) phoenix-core/src/main/java/org/apache/phoenix/filter/DelegateFilter.java
* (add) 
phoenix-core/src/main/java/org/apache/phoenix/filter/AllVersionsIndexRebuildFilter.java
* (edit) 
phoenix-core/src/it/java/org/apache/phoenix/end2end/IndexToolForNonTxGlobalIndexIT.java
* (edit) 
phoenix-core/src/main/java/org/apache/phoenix/coprocessor/UngroupedAggregateRegionObserver.java


> View Index rebuild results in surplus rows from other view indexes
> --
>
> Key: PHOENIX-5932
> URL: https://issues.apache.org/jira/browse/PHOENIX-5932
> Project: Phoenix
>  Issue Type: Bug
>Affects Versions: 4.16.0
>Reporter: Abhishek Singh Chouhan
>Assignee: Abhishek Singh Chouhan
>Priority: Major
> Fix For: 5.1.0, 4.16.0
>
> Attachments: PHOENIX-5932-4.x.001.patch, PHOENIX-5932-4.x.001.patch, 
> PHOENIX-5932-4.x.patch, PHOENIX-5932-master.patch, 
> PHOENIX-5932-wip-4.x.001.patch, PHOENIX-5932-wip-4.x.patch, 
> PHOENIX-5932-wip-master.001.patch, PHOENIX-5932-wip-master.patch
>
>  Time Spent: 2.5h
>  Remaining Estimate: 0h
>
> Steps to reproduce
>  # Create a table with PK as COL1, COL2
>  # Create 2 views with different view constants on COL2. Also add other 
> columns
>  # Upsert rows into the views
>  # Create indexes on the views. Rebuild will result in each view index having 
> rows from other view also
> This is because we set the filter on scan to null during rebuild 
> [here|[https://github.com/apache/phoenix/blob/4.x/phoenix-core/src/main/java/org/apache/phoenix/coprocessor/UngroupedAggregateRegionObserver.java#L1084]]



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (PHOENIX-5942) ParameterizedIndexUpgradeIT is too slow

2020-06-11 Thread Hudson (Jira)


[ 
https://issues.apache.org/jira/browse/PHOENIX-5942?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17133503#comment-17133503
 ] 

Hudson commented on PHOENIX-5942:
-

FAILURE: Integrated in Jenkins build PreCommit-PHOENIX-Build #3954 (See 
[https://builds.apache.org/job/PreCommit-PHOENIX-Build/3954/])
PHOENIX-5942 - ParameterizedIndexUpgradeToolIT is too slow (#798) (gjacoby: rev 
1080422e626c2451556dc4c3f66c6c0e1010693a)
* (edit) 
phoenix-core/src/it/java/org/apache/phoenix/end2end/ParameterizedIndexUpgradeToolIT.java


> ParameterizedIndexUpgradeIT is too slow
> ---
>
> Key: PHOENIX-5942
> URL: https://issues.apache.org/jira/browse/PHOENIX-5942
> Project: Phoenix
>  Issue Type: Bug
>Reporter: Geoffrey Jacoby
>Assignee: Geoffrey Jacoby
>Priority: Minor
> Fix For: 5.1.0, 4.16.0
>
> Attachments: PHOENIX-5942-4.x.v1.patch
>
>  Time Spent: 1h
>  Remaining Estimate: 0h
>
> The test creates the same tables and views for each test case, drops them 
> between, and recreates them. In addition each test case is doing index 
> upgrades / downgrades which requires disabling tables and rebuilding them. 
> Plus there are a lot of test cases, because of the cross-product of the 
> parameters. 
> According to [~achouhan], this is causing some builds to fail with timeouts, 
> and taking 20-30 min for me locally the last time I needed to add a test 
> case. Looks like it's time to refactor this test so it goes faster.  
> I suspect just having each test case create its own test-specific tables (so 
> no more dropping) would help, but that may not be enough. 



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (PHOENIX-5903) Mark more hbase dependency's scope as provided for phoenix-server

2020-06-11 Thread Hudson (Jira)


[ 
https://issues.apache.org/jira/browse/PHOENIX-5903?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17133502#comment-17133502
 ] 

Hudson commented on PHOENIX-5903:
-

FAILURE: Integrated in Jenkins build PreCommit-PHOENIX-Build #3954 (See 
[https://builds.apache.org/job/PreCommit-PHOENIX-Build/3954/])
PHOENIX-5903 Mark more hbase dependency's scope as provided for (stoty: rev 
1d515374ceec07a79e166bee0f995e3d2215a977)
* (edit) phoenix-server/pom.xml
* (edit) pom.xml


> Mark more hbase dependency's scope as provided for phoenix-server
> -
>
> Key: PHOENIX-5903
> URL: https://issues.apache.org/jira/browse/PHOENIX-5903
> Project: Phoenix
>  Issue Type: Improvement
>Affects Versions: 5.1.0
>Reporter: Guanghao Zhang
>Assignee: Guanghao Zhang
>Priority: Major
> Fix For: 5.1.0
>
> Attachments: PHOENIX-5903.master.001.patch
>
>
> The new phoenix-server-*.jar seems bigger than before. It include many hbase 
> classes from hbase dependency.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (PHOENIX-5896) Implement incremental rebuild along the failed regions in IndexTool

2020-06-09 Thread Hudson (Jira)


[ 
https://issues.apache.org/jira/browse/PHOENIX-5896?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17129858#comment-17129858
 ] 

Hudson commented on PHOENIX-5896:
-

ABORTED: Integrated in Jenkins build PreCommit-PHOENIX-Build #3949 (See 
[https://builds.apache.org/job/PreCommit-PHOENIX-Build/3949/])
PHOENIX-5896: Implement incremental rebuild along the failed regions in 
(s.kadam: rev 1c2a23190069d10a25537c7ee6ed0ed1733fafc9)
* (edit) 
phoenix-core/src/main/java/org/apache/phoenix/mapreduce/PhoenixServerBuildIndexInputFormat.java
* (edit) 
phoenix-core/src/main/java/org/apache/phoenix/coprocessor/GlobalIndexRegionScanner.java
* (edit) 
phoenix-core/src/test/java/org/apache/phoenix/mapreduce/util/PhoenixConfigurationUtilTest.java
* (edit) 
phoenix-core/src/main/java/org/apache/phoenix/mapreduce/util/PhoenixConfigurationUtil.java
* (edit) 
phoenix-core/src/main/java/org/apache/phoenix/mapreduce/index/IndexVerificationResultRepository.java
* (edit) phoenix-core/src/it/java/org/apache/phoenix/end2end/IndexToolIT.java
* (edit) 
phoenix-core/src/it/java/org/apache/phoenix/end2end/IndexToolForNonTxGlobalIndexIT.java
* (edit) 
phoenix-core/src/main/java/org/apache/phoenix/mapreduce/index/IndexTool.java
* (edit) 
phoenix-core/src/it/java/org/apache/phoenix/end2end/IndexToolTimeRangeIT.java
* (edit) 
phoenix-core/src/main/java/org/apache/phoenix/coprocessor/BaseScannerRegionObserver.java
* (edit) 
phoenix-core/src/main/java/org/apache/phoenix/coprocessor/IndexRebuildRegionScanner.java
* (edit) 
phoenix-core/src/main/java/org/apache/phoenix/coprocessor/IndexerRegionScanner.java
* (edit) phoenix-core/src/test/java/org/apache/phoenix/index/IndexToolTest.java
* (edit) 
phoenix-core/src/test/java/org/apache/phoenix/index/IndexUpgradeToolTest.java
* (add) 
phoenix-core/src/test/java/org/apache/phoenix/index/ShouldVerifyTest.java
* (edit) 
phoenix-core/src/main/java/org/apache/phoenix/mapreduce/index/IndexVerificationOutputRepository.java


> Implement incremental rebuild along the failed regions in IndexTool
> ---
>
> Key: PHOENIX-5896
> URL: https://issues.apache.org/jira/browse/PHOENIX-5896
> Project: Phoenix
>  Issue Type: Improvement
>Reporter: Swaroopa Kadam
>Assignee: Swaroopa Kadam
>Priority: Major
> Attachments: PHOENIX-5896.4.x.add0.patch, PHOENIX-5896.4.x.v1.patch, 
> PHOENIX-5896.4.x.v2.patch, PHOENIX-5896.4.x.v3.patch, 
> PHOENIX-5896.4.x.v4.patch, PHOENIX-5896.v1.patch
>
>  Time Spent: 2h 50m
>  Remaining Estimate: 0h
>
> As we run the index tool on indexes to be rebuilt after the upgrade, it 
> spends some time in rescanning successful regions from the last rebuild. We 
> want to make the index tool a little smarter to not rebuild rows from the 
> regions that were found in the PIT_result table from the last rebuild. 
> PIT_result logs region info if it was successfully rebuilt in the last run.   



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (PHOENIX-5876) IndexTool updates the index state when it runs with ONLY option

2020-06-08 Thread Hudson (Jira)


[ 
https://issues.apache.org/jira/browse/PHOENIX-5876?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17128872#comment-17128872
 ] 

Hudson commented on PHOENIX-5876:
-

ABORTED: Integrated in Jenkins build PreCommit-PHOENIX-Build #3944 (See 
[https://builds.apache.org/job/PreCommit-PHOENIX-Build/3944/])
PHOENIX-5876 Let indexTool running with ONLY option not change index (s.kadam: 
rev 28525790a2c0851be201c8432c82044f1a1a614e)
* (edit) 
phoenix-core/src/main/java/org/apache/phoenix/mapreduce/index/PhoenixIndexImportDirectReducer.java
* (edit) 
phoenix-core/src/it/java/org/apache/phoenix/end2end/IndexToolForNonTxGlobalIndexIT.java


> IndexTool updates the index state when it runs with ONLY option
> ---
>
> Key: PHOENIX-5876
> URL: https://issues.apache.org/jira/browse/PHOENIX-5876
> Project: Phoenix
>  Issue Type: Bug
>Reporter: Weiming Wang
>Assignee: Weiming Wang
>Priority: Minor
> Fix For: 4.16.0
>
> Attachments: PHOENIX-5876.4.x.001.patch, PHOENIX-5876.4.x.001.patch, 
> PHOENIX-5876.4.x.001.patch
>
>
> When IndexTool runs with ONLY option, it is NOT supposed to update the index 
> state, since it never rebuild the index. However current code is working the 
> opposite way.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (PHOENIX-5876) IndexTool updates the index state when it runs with ONLY option

2020-06-08 Thread Hudson (Jira)


[ 
https://issues.apache.org/jira/browse/PHOENIX-5876?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17128871#comment-17128871
 ] 

Hudson commented on PHOENIX-5876:
-

ABORTED: Integrated in Jenkins build PreCommit-PHOENIX-Build #3943 (See 
[https://builds.apache.org/job/PreCommit-PHOENIX-Build/3943/])
PHOENIX-5876 Let indexTool running with ONLY option not change index (s.kadam: 
rev 28525790a2c0851be201c8432c82044f1a1a614e)
* (edit) 
phoenix-core/src/main/java/org/apache/phoenix/mapreduce/index/PhoenixIndexImportDirectReducer.java
* (edit) 
phoenix-core/src/it/java/org/apache/phoenix/end2end/IndexToolForNonTxGlobalIndexIT.java


> IndexTool updates the index state when it runs with ONLY option
> ---
>
> Key: PHOENIX-5876
> URL: https://issues.apache.org/jira/browse/PHOENIX-5876
> Project: Phoenix
>  Issue Type: Bug
>Reporter: Weiming Wang
>Assignee: Weiming Wang
>Priority: Minor
> Fix For: 4.16.0
>
> Attachments: PHOENIX-5876.4.x.001.patch, PHOENIX-5876.4.x.001.patch, 
> PHOENIX-5876.4.x.001.patch
>
>
> When IndexTool runs with ONLY option, it is NOT supposed to update the index 
> state, since it never rebuild the index. However current code is working the 
> opposite way.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (PHOENIX-5876) IndexTool updates the index state when it runs with ONLY option

2020-06-08 Thread Hudson (Jira)


[ 
https://issues.apache.org/jira/browse/PHOENIX-5876?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17128864#comment-17128864
 ] 

Hudson commented on PHOENIX-5876:
-

FAILURE: Integrated in Jenkins build PreCommit-PHOENIX-Build #3945 (See 
[https://builds.apache.org/job/PreCommit-PHOENIX-Build/3945/])
PHOENIX-5876 Let indexTool running with ONLY option not change index (s.kadam: 
rev 28525790a2c0851be201c8432c82044f1a1a614e)
* (edit) 
phoenix-core/src/it/java/org/apache/phoenix/end2end/IndexToolForNonTxGlobalIndexIT.java
* (edit) 
phoenix-core/src/main/java/org/apache/phoenix/mapreduce/index/PhoenixIndexImportDirectReducer.java


> IndexTool updates the index state when it runs with ONLY option
> ---
>
> Key: PHOENIX-5876
> URL: https://issues.apache.org/jira/browse/PHOENIX-5876
> Project: Phoenix
>  Issue Type: Bug
>Reporter: Weiming Wang
>Assignee: Weiming Wang
>Priority: Minor
> Fix For: 4.16.0
>
> Attachments: PHOENIX-5876.4.x.001.patch, PHOENIX-5876.4.x.001.patch, 
> PHOENIX-5876.4.x.001.patch
>
>
> When IndexTool runs with ONLY option, it is NOT supposed to update the index 
> state, since it never rebuild the index. However current code is working the 
> opposite way.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (PHOENIX-5931) PhoenixIndexFailurePolicy throws NPE if cause of IOE is null

2020-06-04 Thread Hudson (Jira)


[ 
https://issues.apache.org/jira/browse/PHOENIX-5931?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17126410#comment-17126410
 ] 

Hudson commented on PHOENIX-5931:
-

ABORTED: Integrated in Jenkins build PreCommit-PHOENIX-Build #3937 (See 
[https://builds.apache.org/job/PreCommit-PHOENIX-Build/3937/])
PHOENIX-5931 PhoenixIndexFailurePolicy throws NPE if cause of IOE is (achouhan: 
rev 77c6cb32fce04b912b7c502dc170d86af8293fe6)
* (edit) 
phoenix-core/src/main/java/org/apache/phoenix/index/PhoenixIndexFailurePolicy.java
* (edit) 
phoenix-core/src/main/java/org/apache/phoenix/coprocessor/IndexRebuildRegionScanner.java


> PhoenixIndexFailurePolicy throws NPE if cause of IOE is null
> 
>
> Key: PHOENIX-5931
> URL: https://issues.apache.org/jira/browse/PHOENIX-5931
> Project: Phoenix
>  Issue Type: Improvement
>Affects Versions: 4.16.0
>Reporter: Abhishek Singh Chouhan
>Assignee: Abhishek Singh Chouhan
>Priority: Minor
> Fix For: 5.1.0, 4.16.0
>
> Attachments: PHOENIX-5931-4.x.001.patch, PHOENIX-5931-4.x.patch, 
> PHOENIX-5931-master.patch
>
>




--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (PHOENIX-5905) Reset user to hbase by changing rpc context before getting user permissions on access controller service

2020-06-04 Thread Hudson (Jira)


[ 
https://issues.apache.org/jira/browse/PHOENIX-5905?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17126306#comment-17126306
 ] 

Hudson commented on PHOENIX-5905:
-

ABORTED: Integrated in Jenkins build PreCommit-PHOENIX-Build #3933 (See 
[https://builds.apache.org/job/PreCommit-PHOENIX-Build/3933/])
PHOENIX-5905 Reset user to hbase by changing rpc context before getting 
(rajeshbabu chintaguntla: rev 73277b153e80ab0b187055ac8bf82e24f3baa770)
* (add) 
phoenix-core/src/it/java/org/apache/phoenix/end2end/PermissionNSDisabledWithCustomAccessControllerIT.java
* (edit) 
phoenix-core/src/it/java/org/apache/phoenix/end2end/BasePermissionsIT.java
* (edit) 
phoenix-core/src/main/java/org/apache/phoenix/coprocessor/PhoenixAccessController.java
* (add) 
phoenix-core/src/it/java/org/apache/phoenix/end2end/PermissionNSEnabledWithCustomAccessControllerIT.java


> Reset user to hbase by changing rpc context before getting user permissions 
> on access controller service 
> -
>
> Key: PHOENIX-5905
> URL: https://issues.apache.org/jira/browse/PHOENIX-5905
> Project: Phoenix
>  Issue Type: Bug
>Reporter: Rajeshbabu Chintaguntla
>Assignee: Rajeshbabu Chintaguntla
>Priority: Major
> Fix For: 5.1.0, 4.16.0
>
> Attachments: PHOENIX-5905.master.addendum2.patch, PHOENIX-5905.patch, 
> PHOENIX-5905_addendum.patch, PHOENIX-5905_addendum2.patch
>
>
> Currently we are calling getUserPermissions with hbase user directly on 
> access controller service which is not a rpc call. If we don't reset user 
> system user will be considered and might expect extra privileges  to return 
> the user  permissions.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (PHOENIX-5884) Join query return empty result when filters for both the tables are present

2020-06-02 Thread Hudson (Jira)


[ 
https://issues.apache.org/jira/browse/PHOENIX-5884?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17123913#comment-17123913
 ] 

Hudson commented on PHOENIX-5884:
-

FAILURE: Integrated in Jenkins build PreCommit-PHOENIX-Build #3919 (See 
[https://builds.apache.org/job/PreCommit-PHOENIX-Build/3919/])
PHOENIX-5884 Join query return empty result when filters for both the (stoty: 
rev 02047c0a25e9375b43679c690d45d51a4ba8ba2d)
* (edit) 
phoenix-core/src/main/java/org/apache/phoenix/compile/WhereOptimizer.java
* (add) 
phoenix-core/src/it/java/org/apache/phoenix/end2end/join/WhereOptimizerForJoinFiltersIT.java
* (edit) phoenix-core/src/it/java/org/apache/phoenix/end2end/InListIT.java


> Join query return empty result when filters for both the tables are present
> ---
>
> Key: PHOENIX-5884
> URL: https://issues.apache.org/jira/browse/PHOENIX-5884
> Project: Phoenix
>  Issue Type: Bug
>Affects Versions: 4.14.0
>Reporter: Ankit Singhal
>Assignee: Ankit Singhal
>Priority: Major
> Fix For: 5.1.0, 4.16.0
>
> Attachments: PHOENIX-5884.master.v2.patch, 
> PHOENIX-5884.master.v3.patch, PHOENIX-5884.master.v4.patch, 
> PHOENIX-5884.master.v5.patch, PHOENIX-5884_v1.patch
>
>
> Let's assume DDL to be same for both the tables involved in a join
> {code}
> CREATE TABLE LeftTable (id1 CHAR(6) NOT NULL,id2 VARCHAR(22) NOT 
> NULL,id3 VARCHAR(12) NOT NULL,id4 CHAR(2) NOT NULL,id5 CHAR(6) 
> NOT NULL, id6 VARCHAR(200) NOT NULL,id7 VARCHAR(50) NOT NULL,ts 
> TIMESTAMP ,CONSTRAINT PK_JOIN_AND_INTERSECTION_TABLE PRIMARY 
> KEY(id1,id2,id3,id4,id5,id6,id7))
> {code}
> Following query return right results
> {code}
> SELECT m.*,r.* FROM LEFT_TABLE m join RIGHT_TABLE r  on m.id3 = r.id3 and 
> m.id2 = r.id2  and m.id4 = r.id4  and m.id5 = r.id5  and m.id1 = r.id1  and 
> m.ts = r.ts  where  r.id1 IN ('201904','201905')  and r.id2 = 'ID2_VAL'  and 
> r.id3 IN ('ID3_VAL','ID3_VAL2') 
> {code}
> but When to optimize the query, filters for the left table are also added , 
> query returned empty result . Though the filters are based on join condition 
> so semantically above query and below query should be same.
> {code}
> SELECT m.*,r.* FROM LEFT_TABLE m join RIGHT_TABLE r  on m.id3 = r.id3  and 
> m.id2 = r.id2  and m.id4 = r.id4 and m.id5 = r.id5  and m.id1 = r.id1 and 
> m.ts = r.ts  where m.id1 IN ('201904','201905')  and r.id1 IN 
> ('201904','201905') and r.id2 = 'ID2_VAL' and m.id3 IN 
> ('ID3_VAL','ID3_VAL2')  and r.id3 IN ('ID3_VAL','ID3_VAL2') 
> {code}



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (PHOENIX-5922) IndexUpgradeTool should always re-enable tables on failure

2020-05-29 Thread Hudson (Jira)


[ 
https://issues.apache.org/jira/browse/PHOENIX-5922?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17120040#comment-17120040
 ] 

Hudson commented on PHOENIX-5922:
-

FAILURE: Integrated in Jenkins build PreCommit-PHOENIX-Build #3904 (See 
[https://builds.apache.org/job/PreCommit-PHOENIX-Build/3904/])
PHOENIX-5922 - IndexUpgradeTool should always re-enable tables on (gjacoby: rev 
1c6d2afb72c1f39f376b4ac11734964ade30dee1)
* (edit) 
phoenix-core/src/main/java/org/apache/phoenix/mapreduce/index/IndexUpgradeTool.java
* (edit) 
phoenix-core/src/it/java/org/apache/phoenix/end2end/ParameterizedIndexUpgradeToolIT.java


> IndexUpgradeTool should always re-enable tables on failure
> --
>
> Key: PHOENIX-5922
> URL: https://issues.apache.org/jira/browse/PHOENIX-5922
> Project: Phoenix
>  Issue Type: Bug
>Reporter: Geoffrey Jacoby
>Assignee: Geoffrey Jacoby
>Priority: Major
> Fix For: 5.1.0, 4.16.0
>
> Attachments: PHOENIX-5922-4.x.v1.patch, PHOENIX-5922.v1.patch
>
>  Time Spent: 50m
>  Remaining Estimate: 0h
>
> If an error occurs while doing an index upgrade, the IndexUpgradeTool will 
> try to rollback the upgrade operations to leave the cluster in its initial 
> state. However, if the rollback fails, it will give up. This can leave tables 
> disabled for long periods until operators manually re-enable them.
> If rollback fails, the IndexUpgradeTool should always re-enable the affected 
> tables at the HBase level.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (PHOENIX-5922) IndexUpgradeTool should always re-enable tables on failure

2020-05-29 Thread Hudson (Jira)


[ 
https://issues.apache.org/jira/browse/PHOENIX-5922?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17119312#comment-17119312
 ] 

Hudson commented on PHOENIX-5922:
-

FAILURE: Integrated in Jenkins build PreCommit-PHOENIX-Build #3902 (See 
[https://builds.apache.org/job/PreCommit-PHOENIX-Build/3902/])
Revert "PHOENIX-5922 - IndexUpgradeTool should always re-enable tables (elserj: 
rev 18b219d7d270d546d7be29164229161531bd9330)
* (edit) 
phoenix-core/src/it/java/org/apache/phoenix/end2end/ParameterizedIndexUpgradeToolIT.java
* (edit) 
phoenix-core/src/main/java/org/apache/phoenix/mapreduce/index/IndexUpgradeTool.java


> IndexUpgradeTool should always re-enable tables on failure
> --
>
> Key: PHOENIX-5922
> URL: https://issues.apache.org/jira/browse/PHOENIX-5922
> Project: Phoenix
>  Issue Type: Bug
>Reporter: Geoffrey Jacoby
>Assignee: Geoffrey Jacoby
>Priority: Major
> Fix For: 5.1.0, 4.16.0
>
> Attachments: PHOENIX-5922-4.x.v1.patch, PHOENIX-5922.v1.patch
>
>  Time Spent: 50m
>  Remaining Estimate: 0h
>
> If an error occurs while doing an index upgrade, the IndexUpgradeTool will 
> try to rollback the upgrade operations to leave the cluster in its initial 
> state. However, if the rollback fails, it will give up. This can leave tables 
> disabled for long periods until operators manually re-enable them.
> If rollback fails, the IndexUpgradeTool should always re-enable the affected 
> tables at the HBase level.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (PHOENIX-5921) Phoenix Index verification logging Exception with huge huge row

2020-05-28 Thread Hudson (Jira)


[ 
https://issues.apache.org/jira/browse/PHOENIX-5921?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17119109#comment-17119109
 ] 

Hudson commented on PHOENIX-5921:
-

ABORTED: Integrated in Jenkins build PreCommit-PHOENIX-Build #3900 (See 
[https://builds.apache.org/job/PreCommit-PHOENIX-Build/3900/])
PHOENIX-5921 Shorten verification phase fail log line and add a metric 
(giskender: rev dcc88af8acc2ba8df10d2e9d498ab3646fdf0a78)
* (edit) 
phoenix-core/src/main/java/org/apache/phoenix/execute/MutationState.java
* (edit) 
phoenix-core/src/main/java/org/apache/phoenix/monitoring/MutationMetricQueue.java
* (edit) 
phoenix-core/src/it/java/org/apache/phoenix/monitoring/PhoenixMetricsIT.java
* (edit) 
phoenix-core/src/main/java/org/apache/phoenix/monitoring/GlobalClientMetrics.java
* (edit) 
phoenix-core/src/it/java/org/apache/phoenix/monitoring/BasePhoenixMetricsIT.java
* (edit) 
phoenix-core/src/main/java/org/apache/phoenix/monitoring/MetricType.java


> Phoenix Index verification logging Exception with huge huge row
> ---
>
> Key: PHOENIX-5921
> URL: https://issues.apache.org/jira/browse/PHOENIX-5921
> Project: Phoenix
>  Issue Type: Bug
>Reporter: Gokcen Iskender
>Assignee: Gokcen Iskender
>Priority: Minor
> Attachments: PHOENIX-5921.4.x.001.patch, PHOENIX-5921.master.001.patch
>
>  Time Spent: 40m
>  Remaining Estimate: 0h
>
> 3ppnx`20200523045831.177``4142`0`0``4aeb16f3f1064824`0```fT:020`224.22.5```Ignoring
>  exception that happened during setting index verified value to verified=TRUE 
> {org.apache.phoenix.execute.MutationState$TableInfo
>  
> This logging line is huge



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (PHOENIX-5922) IndexUpgradeTool should always re-enable tables on failure

2020-05-28 Thread Hudson (Jira)


[ 
https://issues.apache.org/jira/browse/PHOENIX-5922?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17119110#comment-17119110
 ] 

Hudson commented on PHOENIX-5922:
-

ABORTED: Integrated in Jenkins build PreCommit-PHOENIX-Build #3900 (See 
[https://builds.apache.org/job/PreCommit-PHOENIX-Build/3900/])
PHOENIX-5922 - IndexUpgradeTool should always re-enable tables on (gjacoby: rev 
45929b5a74feddb647571c7d7c057142973b45b0)
* (edit) 
phoenix-core/src/it/java/org/apache/phoenix/end2end/ParameterizedIndexUpgradeToolIT.java
* (edit) 
phoenix-core/src/main/java/org/apache/phoenix/mapreduce/index/IndexUpgradeTool.java


> IndexUpgradeTool should always re-enable tables on failure
> --
>
> Key: PHOENIX-5922
> URL: https://issues.apache.org/jira/browse/PHOENIX-5922
> Project: Phoenix
>  Issue Type: Bug
>Reporter: Geoffrey Jacoby
>Assignee: Geoffrey Jacoby
>Priority: Major
> Fix For: 5.1.0, 4.16.0
>
> Attachments: PHOENIX-5922-4.x.v1.patch
>
>  Time Spent: 50m
>  Remaining Estimate: 0h
>
> If an error occurs while doing an index upgrade, the IndexUpgradeTool will 
> try to rollback the upgrade operations to leave the cluster in its initial 
> state. However, if the rollback fails, it will give up. This can leave tables 
> disabled for long periods until operators manually re-enable them.
> If rollback fails, the IndexUpgradeTool should always re-enable the affected 
> tables at the HBase level.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (PHOENIX-5804) Implement strong verification with -v ONLY option for old design of secondary indexes

2020-05-27 Thread Hudson (Jira)


[ 
https://issues.apache.org/jira/browse/PHOENIX-5804?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17118264#comment-17118264
 ] 

Hudson commented on PHOENIX-5804:
-

FAILURE: Integrated in Jenkins build PreCommit-PHOENIX-Build #3899 (See 
[https://builds.apache.org/job/PreCommit-PHOENIX-Build/3899/])
PHOENIX-5804: Implement strong verification with -v ONLY option for old 
(s.kadam: rev 85724aae4bbe1420333a3301861668549a772c83)
* (edit) 
phoenix-core/src/main/java/org/apache/phoenix/hbase/index/IndexRegionObserver.java
* (add) 
phoenix-core/src/main/java/org/apache/phoenix/coprocessor/IndexerRegionScanner.java
* (add) 
phoenix-core/src/it/java/org/apache/phoenix/end2end/IndexVerificationOldDesignIT.java
* (edit) 
phoenix-core/src/main/java/org/apache/phoenix/coprocessor/IndexRebuildRegionScanner.java
* (add) 
phoenix-core/src/it/java/org/apache/phoenix/end2end/IndexToolForNonTxGlobalIndexIT.java
* (edit) phoenix-core/src/it/java/org/apache/phoenix/end2end/IndexToolIT.java
* (edit) 
phoenix-core/src/main/java/org/apache/phoenix/coprocessor/UngroupedAggregateRegionObserver.java
* (edit) 
phoenix-core/src/test/java/org/apache/phoenix/index/VerifySingleIndexRowTest.java
* (add) 
phoenix-core/src/main/java/org/apache/phoenix/coprocessor/GlobalIndexRegionScanner.java
* (add) 
phoenix-core/src/main/java/org/apache/phoenix/util/ManualEnvironmentEdge.java


> Implement strong verification with -v ONLY option for old design of secondary 
> indexes
> -
>
> Key: PHOENIX-5804
> URL: https://issues.apache.org/jira/browse/PHOENIX-5804
> Project: Phoenix
>  Issue Type: Improvement
>Reporter: Swaroopa Kadam
>Assignee: Swaroopa Kadam
>Priority: Major
> Attachments: PHOENIX-5804.4.x.v1.patch, PHOENIX-5804.4.x.v2.patch, 
> PHOENIX-5804.4.x.v3.patch, PHOENIX-5804.4.x.v4.patch, 
> PHOENIX-5804.4.x.v5.patch, PHOENIX-5804.v1.patch, PHOENIX-5804.v2.patch
>
>  Time Spent: 2h 40m
>  Remaining Estimate: 0h
>
> Currently, with -v ONLY option we get weak verification i.e. we find out if 
> index row is present or not. It does not provide information on if the values 
> have mismatch when executed with old design.
> We attempt to provide scrutiny like implementation but way faster. The 
> verification will be done only one the latest version of the row.  
> This will help us in quantifying the success of new self-consistent secondary 
> indexes design. 



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (PHOENIX-5890) Port PHOENIX-5799 to master

2020-05-26 Thread Hudson (Jira)


[ 
https://issues.apache.org/jira/browse/PHOENIX-5890?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17117343#comment-17117343
 ] 

Hudson commented on PHOENIX-5890:
-

FAILURE: Integrated in Jenkins build PreCommit-PHOENIX-Build #3894 (See 
[https://builds.apache.org/job/PreCommit-PHOENIX-Build/3894/])
PHOENIX-5890: Port Phoenix-5799 to master (#787) (github: rev 
5a9ec5552fb63fdf640e0c9adbb81eb6eec0ccae)
* (add) 
phoenix-core/src/main/java/org/apache/phoenix/mapreduce/index/IndexVerificationOutputRepository.java
* (add) 
phoenix-core/src/main/java/org/apache/phoenix/mapreduce/index/IndexVerificationOutputRow.java
* (edit) 
phoenix-core/src/main/java/org/apache/phoenix/coprocessor/IndexToolVerificationResult.java
* (edit) 
phoenix-core/src/main/java/org/apache/phoenix/mapreduce/index/PhoenixIndexImportDirectReducer.java
* (add) 
phoenix-core/src/main/java/org/apache/phoenix/mapreduce/index/IndexVerificationResultRepository.java
* (edit) phoenix-core/src/it/java/org/apache/phoenix/end2end/IndexToolIT.java
* (add) 
phoenix-core/src/it/java/org/apache/phoenix/end2end/index/IndexVerificationOutputRepositoryIT.java
* (add) 
phoenix-core/src/it/java/org/apache/phoenix/end2end/index/IndexVerificationResultRepositoryIT.java
* (edit) 
phoenix-core/src/main/java/org/apache/phoenix/coprocessor/IndexRebuildRegionScanner.java
* (edit) phoenix-core/src/main/java/org/apache/phoenix/util/ByteUtil.java
* (edit) 
phoenix-core/src/main/java/org/apache/phoenix/mapreduce/index/IndexTool.java


> Port PHOENIX-5799 to master
> ---
>
> Key: PHOENIX-5890
> URL: https://issues.apache.org/jira/browse/PHOENIX-5890
> Project: Phoenix
>  Issue Type: Improvement
>Reporter: Geoffrey Jacoby
>Assignee: Swaroopa Kadam
>Priority: Major
> Attachments: PHOENIX-5890.v1.patch
>
>  Time Spent: 40m
>  Remaining Estimate: 0h
>




--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (PHOENIX-5799) Inline Index Verification Output API

2020-05-26 Thread Hudson (Jira)


[ 
https://issues.apache.org/jira/browse/PHOENIX-5799?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17117344#comment-17117344
 ] 

Hudson commented on PHOENIX-5799:
-

FAILURE: Integrated in Jenkins build PreCommit-PHOENIX-Build #3894 (See 
[https://builds.apache.org/job/PreCommit-PHOENIX-Build/3894/])
PHOENIX-5890: Port Phoenix-5799 to master (#787) (github: rev 
5a9ec5552fb63fdf640e0c9adbb81eb6eec0ccae)
* (add) 
phoenix-core/src/main/java/org/apache/phoenix/mapreduce/index/IndexVerificationOutputRepository.java
* (add) 
phoenix-core/src/main/java/org/apache/phoenix/mapreduce/index/IndexVerificationOutputRow.java
* (edit) 
phoenix-core/src/main/java/org/apache/phoenix/coprocessor/IndexToolVerificationResult.java
* (edit) 
phoenix-core/src/main/java/org/apache/phoenix/mapreduce/index/PhoenixIndexImportDirectReducer.java
* (add) 
phoenix-core/src/main/java/org/apache/phoenix/mapreduce/index/IndexVerificationResultRepository.java
* (edit) phoenix-core/src/it/java/org/apache/phoenix/end2end/IndexToolIT.java
* (add) 
phoenix-core/src/it/java/org/apache/phoenix/end2end/index/IndexVerificationOutputRepositoryIT.java
* (add) 
phoenix-core/src/it/java/org/apache/phoenix/end2end/index/IndexVerificationResultRepositoryIT.java
* (edit) 
phoenix-core/src/main/java/org/apache/phoenix/coprocessor/IndexRebuildRegionScanner.java
* (edit) phoenix-core/src/main/java/org/apache/phoenix/util/ByteUtil.java
* (edit) 
phoenix-core/src/main/java/org/apache/phoenix/mapreduce/index/IndexTool.java


> Inline Index Verification Output API
> 
>
> Key: PHOENIX-5799
> URL: https://issues.apache.org/jira/browse/PHOENIX-5799
> Project: Phoenix
>  Issue Type: Bug
>Reporter: Geoffrey Jacoby
>Assignee: Geoffrey Jacoby
>Priority: Major
> Fix For: 4.16.0
>
> Attachments: PHOENIX-5799-4.x.v1.patch
>
>  Time Spent: 2h 50m
>  Remaining Estimate: 0h
>
> Followup from PHOENIX-5773 -- split out the logic in 
> IndexRebuildRegionScanner that writes to the output table into its own class, 
> plus add read methods and tests. 



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (PHOENIX-5892) Add code coverage steps in build documentation

2020-05-14 Thread Hudson (Jira)


[ 
https://issues.apache.org/jira/browse/PHOENIX-5892?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17107498#comment-17107498
 ] 

Hudson commented on PHOENIX-5892:
-

FAILURE: Integrated in Jenkins build PreCommit-PHOENIX-Build #3854 (See 
[https://builds.apache.org/job/PreCommit-PHOENIX-Build/3854/])
PHOENIX-5892 Add code coverage steps in build documentation (chinmayskulkarni: 
rev 49599fd89b6cfa9cab9d7d3f6dcf4bdc5428915a)
* (edit) BUILDING.md


> Add code coverage steps in build documentation
> --
>
> Key: PHOENIX-5892
> URL: https://issues.apache.org/jira/browse/PHOENIX-5892
> Project: Phoenix
>  Issue Type: Improvement
>Affects Versions: 5.0.0, 4.15.0
>Reporter: Sandeep Guggilam
>Assignee: Sandeep Guggilam
>Priority: Major
>  Labels: quality-improvement
> Fix For: 5.1.0, 4.16.0
>
> Attachments: PHOENIX-5892.4.x.v1.patch, PHOENIX-5892.master.v1.patch
>
>
> We need to add the steps for code coverage feature as part of build 
> documentation. The feature is introduced as part of PHOENIX-5842



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (PHOENIX-5891) Ensure that code coverage does not drop with subsequent commits

2020-05-14 Thread Hudson (Jira)


[ 
https://issues.apache.org/jira/browse/PHOENIX-5891?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17107497#comment-17107497
 ] 

Hudson commented on PHOENIX-5891:
-

FAILURE: Integrated in Jenkins build PreCommit-PHOENIX-Build #3854 (See 
[https://builds.apache.org/job/PreCommit-PHOENIX-Build/3854/])
PHOENIX-5891: Ensure that code coverage does not drop with subsequent 
(chinmayskulkarni: rev c5be82757930b4c256c95947b11487b7a686212b)
* (edit) pom.xml
* (edit) phoenix-pherf/pom.xml


> Ensure that code coverage does not drop with subsequent commits
> ---
>
> Key: PHOENIX-5891
> URL: https://issues.apache.org/jira/browse/PHOENIX-5891
> Project: Phoenix
>  Issue Type: Improvement
>Affects Versions: 5.0.0, 4.15.0, 4.14.3
>Reporter: Chinmay Kulkarni
>Assignee: Chinmay Kulkarni
>Priority: Major
>  Labels: quality-improvement
> Fix For: 5.1.0, 4.16.0
>
> Attachments: PHOENIX-5891-master-v1.patch
>
>
> With [PHOENIX-5842|https://issues.apache.org/jira/browse/PHOENIX-5842], we 
> added Jacoco code coverage to Hadoop QA precommit runs. We should add a check 
> to test-patch.sh to ensure that the code coverage numbers do not drop when 
> applying a new patch. 
> This can also check that overall code coverage is above a fixed threshold as 
> well.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (PHOENIX-5842) Code Coverage tool for Phoenix

2020-05-13 Thread Hudson (Jira)


[ 
https://issues.apache.org/jira/browse/PHOENIX-5842?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17106828#comment-17106828
 ] 

Hudson commented on PHOENIX-5842:
-

SUCCESS: Integrated in Jenkins build PreCommit-PHOENIX-Build #3853 (See 
[https://builds.apache.org/job/PreCommit-PHOENIX-Build/3853/])
(Addendum) PHOENIX-5842 Check for absence of system property to 
(chinmayskulkarni: rev 753895fda79da19cd35e098e63abcab7310ca204)
* (edit) pom.xml


> Code Coverage tool for Phoenix
> --
>
> Key: PHOENIX-5842
> URL: https://issues.apache.org/jira/browse/PHOENIX-5842
> Project: Phoenix
>  Issue Type: Improvement
>Affects Versions: 5.0.0, 4.15.0, 4.14.3
>Reporter: Sandeep Guggilam
>Assignee: Sandeep Guggilam
>Priority: Major
>  Labels: quality-improvement
> Fix For: 5.1.0, 4.16.0
>
> Attachments: PHOENIX-5842.4.x.v1.patch, PHOENIX-5842.4.x.v2.patch, 
> PHOENIX-5842.master.v1.patch, PHOENIX-5842_addendum.4.x.patch, 
> PHOENIX-5842_addendum.patch
>
>
> Currently we don't have any code coverage tool for Phoenix. This is required 
> for us to measure the test coverage and helps us in improving the test suite 
> further till we reach may be 80% coverage
> The test coverage results can also be integrated into the Hadoop QA run of 
> the precommit build such that the reviewers could take a look at the report 
> and see if the added code doesn't have enough coverage



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (PHOENIX-4753) Remove the need for users to have Write access to the Phoenix SYSTEM STATS TABLE to drop tables

2020-05-12 Thread Hudson (Jira)


[ 
https://issues.apache.org/jira/browse/PHOENIX-4753?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17105125#comment-17105125
 ] 

Hudson commented on PHOENIX-4753:
-

FAILURE: Integrated in Jenkins build PreCommit-PHOENIX-Build #3842 (See 
[https://builds.apache.org/job/PreCommit-PHOENIX-Build/3842/])
PHOENIX-4753 Remove the need for users to have Write access to the (rajeshbabu 
chintaguntla: rev 1740409a56a621452b32771ca80d16b61f25c4a7)
* (edit) 
phoenix-core/src/it/java/org/apache/phoenix/end2end/BasePermissionsIT.java
* (edit) 
phoenix-core/src/main/java/org/apache/phoenix/coprocessor/PhoenixAccessController.java
* (edit) 
phoenix-core/src/main/java/org/apache/phoenix/schema/MetaDataClient.java
* (edit) phoenix-core/src/main/java/org/apache/phoenix/util/MetaDataUtil.java
* (edit) 
phoenix-core/src/main/java/org/apache/phoenix/coprocessor/MetaDataEndpointImpl.java
* (edit) 
phoenix-core/src/main/java/org/apache/phoenix/coprocessor/MetaDataProtocol.java


> Remove the need for users to have Write access to the Phoenix SYSTEM STATS 
> TABLE to drop tables
> ---
>
> Key: PHOENIX-4753
> URL: https://issues.apache.org/jira/browse/PHOENIX-4753
> Project: Phoenix
>  Issue Type: Bug
>Reporter: Saumil Mayani
>Assignee: Rajeshbabu Chintaguntla
>Priority: Major
>  Labels: SFDC, namespaces, security
> Fix For: 5.1.0, 4.16.0
>
> Attachments: PHOENIX-4753.patch, PHOENIX-4753_v2.patch, 
> PHOENIX-4753_v3.patch
>
>
> Problem statement:-
> With [PHOENIX-4198|https://issues.apache.org/jira/browse/PHOENIX-4198] a user 
> only needs RX permissions for SYSTEM CATALOG Table, however, it required to 
> have a write permission to SYSTEM STATS Table when performing drop operation 
> on a table. This is a security concern as they can create/alter/drop/corrupt 
> STATS data of any other table without proper access to the corresponding 
> physical tables.
> STEPS TO REPRODUCE:
> 1. Set the following properties in hbase-site.xml:
>  
> {code:java}
> # File: hbase-site.xml
>  
> # Properties=value
> hbase.security.authorization=true
> hbase.coprocessor.master.classes=org.apache.hadoop.hbase.security.access.AccessController
> hbase.coprocessor.region.classes=org.apache.hadoop.hbase.security.access.AccessController,
> org.apache.hadoop.hbase.security.token.TokenProvider,
> org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint
> hbase.coprocessor.regionserver.classes=org.apache.hadoop.hbase.security.access.AccessController
> phoenix.acls.enabled=true
> phoenix.schema.isNamespaceMappingEnabled=true
> phoenix.schema.mapSystemTablesToNamespace=true
> {code}
>  
> 2.  Grant READ permission on SYSTEM Namespace and RWXCA on the user 
> Namespace, to the user:
>  
> {code:java}
> # Example: user01t01 belong to tenant01
>  
> # Grant a user read permission to "SYSTEM" Namespace
> > grant 'user01t01', 'RX' , '@SYSTEM'
>  
> # Grant respective 'RWXCA' [READ('R'), WRITE('W'), EXEC('X'),
> CREATE('C'), ADMIN('A')] permissions on user namespace
> > grant 'user01t01', 'RWXCA' , '@TENANT01'
> {code}
>  
> 3. Login as 'user01t01' and perform the operations. to create table, add data 
> , update statistics and drop table.
>  
> {code:java}
> # Login as the user 'user01t01'
> kinit user01t01
> # create table under namespace / schema tenant01
> create table tenant01.test (mykey integer not null primary key, mycolumn 
> varchar);
> # Insert some data
> upsert into tenant01.test values (1,'Hello');
> upsert into tenant01.test values (2,'World!');
> # select / read back the data inserted.
> select * from tenant01.test;
> # check if the STATS table has information for "tenant01.test"
> select * from SYSTEM.STATS where PHYSICAL_NAME='TENANT01:TEST';
> # If no record in SYSTEM.STATS, update stats.
> update statistics tenant01.test;
> # Drop the table
> drop table tenant01.test;
> {code}
>  
>  
> Following Error gets reported, although the Table is dropped from 
> SYSTEM:CATALOG Table, but the record exist in SYSTEM:STATS Table.
>  
> {code:java}
> Error: org.apache.phoenix.exception.PhoenixIOException: 
> org.apache.hadoop.hbase.security.AccessDeniedException: Insufficient 
> permissions (user=user01...@example.com, scope=SYSTEM:STATS, family=0:, 
> params=[table=SYSTEM:STATS,family=0:],action=WRITE)
> at 
> org.apache.hadoop.hbase.security.access.AccessController.preDelete(AccessController.java:1701)
> at 
> org.apache.hadoop.hbase.regionserver.RegionCoprocessorHost$33.call(RegionCoprocessorHost.java:941)
> at 
> org.apache.hadoop.hbase.regionserver.RegionCoprocessorHost$RegionOperation.call(RegionCoprocessorHost.java:1660)
> at 
> org.apache.hadoop.hbase.regionserver.RegionCoprocessorHost.execOperation(RegionCoprocessorHost.java:1734)
> at 
> 

[jira] [Commented] (PHOENIX-5842) Code Coverage tool for Phoenix

2020-05-12 Thread Hudson (Jira)


[ 
https://issues.apache.org/jira/browse/PHOENIX-5842?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17105126#comment-17105126
 ] 

Hudson commented on PHOENIX-5842:
-

FAILURE: Integrated in Jenkins build PreCommit-PHOENIX-Build #3842 (See 
[https://builds.apache.org/job/PreCommit-PHOENIX-Build/3842/])
PHOENIX-5842 Code Coverage tool for Phoenix (chinmayskulkarni: rev 
8fd11783cd132817604f9e84a4e4b8d716042e0e)
* (edit) dev/test-patch.sh
* (edit) pom.xml


> Code Coverage tool for Phoenix
> --
>
> Key: PHOENIX-5842
> URL: https://issues.apache.org/jira/browse/PHOENIX-5842
> Project: Phoenix
>  Issue Type: Improvement
>Affects Versions: 5.0.0, 4.15.0, 4.14.3
>Reporter: Sandeep Guggilam
>Assignee: Sandeep Guggilam
>Priority: Major
>  Labels: quality-improvement
> Fix For: 5.1.0, 4.16.0
>
> Attachments: PHOENIX-5842.4.x.v1.patch, PHOENIX-5842.4.x.v2.patch, 
> PHOENIX-5842.master.v1.patch, PHOENIX-5842_addendum.patch
>
>
> Currently we don't have any code coverage tool for Phoenix. This is required 
> for us to measure the test coverage and helps us in improving the test suite 
> further till we reach may be 80% coverage
> The test coverage results can also be integrated into the Hadoop QA run of 
> the precommit build such that the reviewers could take a look at the report 
> and see if the added code doesn't have enough coverage



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (PHOENIX-5543) Implement show schemas / show tables SQL commands

2020-05-07 Thread Hudson (Jira)


[ 
https://issues.apache.org/jira/browse/PHOENIX-5543?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17102269#comment-17102269
 ] 

Hudson commented on PHOENIX-5543:
-

FAILURE: Integrated in Jenkins build PreCommit-PHOENIX-Build #3841 (See 
[https://builds.apache.org/job/PreCommit-PHOENIX-Build/3841/])
PHOENIX-5543: Implement SHOW TABLES/SCHEMAS sql commands (gjacoby: rev 
116b9bd667b0cf0e22a45c42e878e97c20c1fc58)
* (edit) 
phoenix-pherf/src/main/java/org/apache/phoenix/pherf/util/PhoenixUtil.java
* (add) phoenix-core/src/main/java/org/apache/phoenix/parse/ShowStatement.java
* (edit) 
phoenix-core/src/it/java/org/apache/phoenix/end2end/TenantSpecificTablesDDLIT.java
* (edit) phoenix-core/src/main/antlr3/PhoenixSQL.g
* (edit) 
phoenix-core/src/main/java/org/apache/phoenix/parse/ParseNodeFactory.java
* (add) 
phoenix-core/src/main/java/org/apache/phoenix/parse/ShowTablesStatement.java
* (add) 
phoenix-core/src/main/java/org/apache/phoenix/parse/ShowSchemasStatement.java
* (edit) 
phoenix-core/src/it/java/org/apache/phoenix/end2end/QueryDatabaseMetaDataIT.java
* (edit) 
phoenix-core/src/main/java/org/apache/phoenix/jdbc/PhoenixDatabaseMetaData.java
* (edit) 
phoenix-core/src/main/java/org/apache/phoenix/jdbc/PhoenixStatement.java
* (edit) phoenix-core/src/main/java/org/apache/phoenix/util/QueryUtil.java
* (edit) 
phoenix-core/src/test/java/org/apache/phoenix/parse/QueryParserTest.java


> Implement show schemas / show tables SQL commands
> -
>
> Key: PHOENIX-5543
> URL: https://issues.apache.org/jira/browse/PHOENIX-5543
> Project: Phoenix
>  Issue Type: Improvement
>Affects Versions: 4.15.0, 5.1.0
>Reporter: Bharath Vissapragada
>Assignee: Bharath Vissapragada
>Priority: Minor
> Fix For: 5.1.0, 4.16.0
>
> Attachments: PHOENIX-5543-4.x.v1.patch, PHOENIX-5543.master.v1.patch, 
> PHOENIX-5543.master.v2.patch, PHOENIX-5543.master.v3.patch
>
>  Time Spent: 3h 40m
>  Remaining Estimate: 0h
>
> Currently users rely on {{!tables}} and {{!schemas}} commands provided by 
> sqlline which pulls the information using the standard JDBC metadata calls 
> like {{getTables()}} and {{getSchemas()}}.
> Most other databases (like mysql[1,2]) implement these as first class SQL 
> commands that gives the user more flexibility in querying by adding necessary 
> filters and looking up for table information in specific schemas. The ask 
> here is to implement the following SQL commands.
> {noformat}
> SHOW SCHEMAS [LIKE '']
> SHOW TABLES [IN ] [LIKE '']
> {noformat}
> [1] https://dev.mysql.com/doc/refman/8.0/en/show-tables.html
> [2] https://dev.mysql.com/doc/refman/8.0/en/show-databases.html



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (PHOENIX-5580) Wrong values seen when updating a view for a table that has an index

2020-05-05 Thread Hudson (Jira)


[ 
https://issues.apache.org/jira/browse/PHOENIX-5580?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17100305#comment-17100305
 ] 

Hudson commented on PHOENIX-5580:
-

FAILURE: Integrated in Jenkins build PreCommit-PHOENIX-Build #3811 (See 
[https://builds.apache.org/job/PreCommit-PHOENIX-Build/3811/])
PHOENIX-5580 Wrong values seen when updating a view for a table that has 
(achouhan: rev 364b62c34547a3a4e4b5496e1e50eee1d6daa514)
* (edit) phoenix-protocol/src/main/ServerCachingService.proto
* (edit) 
phoenix-core/src/main/java/org/apache/phoenix/index/IndexMaintainer.java
* (edit) 
phoenix-core/src/it/java/org/apache/phoenix/end2end/index/MutableIndexIT.java
* (edit) 
phoenix-core/src/main/java/org/apache/phoenix/coprocessor/generated/ServerCachingProtos.java


> Wrong values seen when updating a view for a table that has an index
> 
>
> Key: PHOENIX-5580
> URL: https://issues.apache.org/jira/browse/PHOENIX-5580
> Project: Phoenix
>  Issue Type: Bug
>Affects Versions: 4.15.0, 4.14.1, 4.14.3
>Reporter: Swaroopa Kadam
>Assignee: Sandeep Guggilam
>Priority: Major
>  Labels: indexing, phoenix-hardening
> Fix For: 5.1.0, 4.16.0
>
> Attachments: PHOENIX-5580.4.x.v1.patch, PHOENIX-5580.4.x.v2.patch, 
> PHOENIX-5580.4.x.v3.patch, PHOENIX-5580.master.v1.patch
>
>  Time Spent: 2.5h
>  Remaining Estimate: 0h
>
> {code:sql}
> CREATE TABLE IF NOT EXISTS TEST (ID INTEGER NOT NULL PRIMARY KEY, HOST 
> VARCHAR(10));
> CREATE INDEX I ON TEST(HOST);
> -- create updatable view (equality condition in where clause)
>  CREATE VIEW V1 (col1 INTEGER) AS SELECT * FROM TEST WHERE ID=15;
>  UPSERT INTO V1(ID, HOST, col1) VALUES (15, 'this', 7);
> SELECT * FROM TEST;
> -- Wrong results, but correct results when using the NO_INDEX hint
> {code}



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (PHOENIX-5808) Improve shaded artifact naming convetions

2020-04-27 Thread Hudson (Jira)


[ 
https://issues.apache.org/jira/browse/PHOENIX-5808?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17093683#comment-17093683
 ] 

Hudson commented on PHOENIX-5808:
-

FAILURE: Integrated in Jenkins build PreCommit-PHOENIX-Build #3792 (See 
[https://builds.apache.org/job/PreCommit-PHOENIX-Build/3792/])
PHOENIX-5808 Improve shaded artifact naming convetions (stoty: rev 
490c18d7fe59b2199d4d3aacf350c8c2e393c258)
* (edit) phoenix-assembly/pom.xml
* (edit) phoenix-server/pom.xml
* (edit) phoenix-assembly/src/build/components/all-common-jars.xml
* (edit) phoenix-client/pom.xml
* (edit) bin/phoenix_utils.py
* (edit) pom.xml


> Improve shaded artifact naming convetions
> -
>
> Key: PHOENIX-5808
> URL: https://issues.apache.org/jira/browse/PHOENIX-5808
> Project: Phoenix
>  Issue Type: Improvement
>  Components: core
>Affects Versions: 5.1.0, 4.x
>Reporter: Istvan Toth
>Assignee: Istvan Toth
>Priority: Major
> Fix For: 5.1.0, 4.16.0
>
> Attachments: PHOENIX-5808.master.v1.patch
>
>  Time Spent: 0.5h
>  Remaining Estimate: 0h
>
> As suggested by [~elserj] in the dev list, there is room for improvment in 
> the naming of the shaded phoenix artifacts:
>  * We are creating useless unshaded client and server artifacts, which should 
> be removed
>  * This would free up the filenames for adding unversioned symlinks to the 
> shaded client and server JARS in the assembly named (where xx is _client_ or 
> _server_, and version is the phoenix version):
>  ** phoenix-xx-version.jar
>  ** phoenix-xx.jar
>  * We should consider removing the legacy phoenix-verson-xx.jar symlinks to 
> the same



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (PHOENIX-5789) try to standardize on a JSON library

2020-04-27 Thread Hudson (Jira)


[ 
https://issues.apache.org/jira/browse/PHOENIX-5789?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17093357#comment-17093357
 ] 

Hudson commented on PHOENIX-5789:
-

FAILURE: Integrated in Jenkins build PreCommit-PHOENIX-Build #3791 (See 
[https://builds.apache.org/job/PreCommit-PHOENIX-Build/3791/])
PHOENIX-5789 try to standardize on a JSON library (addendum: use single (stoty: 
rev 07bd1c5a1df0b7cded9fd2ff0177afd792a714b2)
* (edit) 
phoenix-core/src/main/java/org/apache/phoenix/mapreduce/bulkload/TargetTableRefFunctions.java
* (edit) 
phoenix-core/src/main/java/org/apache/phoenix/coprocessor/tasks/IndexRebuildTask.java
* (add) phoenix-core/src/main/java/org/apache/phoenix/util/JacksonUtil.java
* (edit) 
phoenix-tracing-webapp/src/main/java/org/apache/phoenix/tracingwebapp/http/TraceServlet.java
* (edit) 
phoenix-core/src/main/java/org/apache/phoenix/mapreduce/index/automation/PhoenixMRJobSubmitter.java
* (edit) 
phoenix-core/src/main/java/org/apache/phoenix/coprocessor/TaskRegionObserver.java
* (edit) 
phoenix-core/src/main/java/org/apache/phoenix/mapreduce/JsonToKeyValueMapper.java
* (edit) 
phoenix-core/src/main/java/org/apache/phoenix/schema/MetaDataClient.java


> try to standardize on a JSON library
> 
>
> Key: PHOENIX-5789
> URL: https://issues.apache.org/jira/browse/PHOENIX-5789
> Project: Phoenix
>  Issue Type: Improvement
>  Components: core
>Reporter: Istvan Toth
>Assignee: Richard Antal
>Priority: Minor
> Fix For: 5.1.0, 4.16.0
>
> Attachments: PHOENIX-5789.4.x.v1.patch, PHOENIX-5789.4.x.v3.patch, 
> PHOENIX-5789.4.x.v4.patch, PHOENIX-5789.4.x.v5.patch, 
> PHOENIX-5789.4.x.v6.patch, PHOENIX-5789.4.x.v7.patch, 
> PHOENIX-5789.master.addendum.patch, PHOENIX-5789.master.addendum.v2.patch, 
> PHOENIX-5789.master.addendum.v3.patch, PHOENIX-5789.master.v1.patch, 
> PHOENIX-5789.master.v2.patch, PHOENIX-5789.master.v3.patch, 
> PHOENIX-5789.master.v4.patch
>
>
> Phoenix uses at least the following JSON libraries:
>  * gson
>  * jackson
>  * jettison
> Of these, only the jackson usage is performance critical, as it is used 
> during bulk loading. 
> Try to standardize on a single one to reduce dependency hell.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (PHOENIX-5864) RuleGeneratorTest unit test seem to be failing

2020-04-27 Thread Hudson (Jira)


[ 
https://issues.apache.org/jira/browse/PHOENIX-5864?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17093356#comment-17093356
 ] 

Hudson commented on PHOENIX-5864:
-

FAILURE: Integrated in Jenkins build PreCommit-PHOENIX-Build #3791 (See 
[https://builds.apache.org/job/PreCommit-PHOENIX-Build/3791/])
PHOENIX-5864: RuleGeneratorTest unit test seem to be failing (chinmayskulkarni: 
rev b29d201581bbfff3765c2e6bd17f514a4c46ec20)
* (edit) phoenix-pherf/src/it/java/org/apache/phoenix/pherf/PherfMainIT.java
* (delete) phoenix-pherf/src/test/resources/scenario/timeout_test_scenario.xml
* (add) 
phoenix-pherf/src/test/resources/scenario/scenario_with_query_timeouts.xml
* (edit) 
phoenix-pherf/src/test/java/org/apache/phoenix/pherf/RuleGeneratorTest.java
* (edit) 
phoenix-pherf/src/test/java/org/apache/phoenix/pherf/workload/MultiThreadedRunnerTest.java


> RuleGeneratorTest unit test seem to be failing
> --
>
> Key: PHOENIX-5864
> URL: https://issues.apache.org/jira/browse/PHOENIX-5864
> Project: Phoenix
>  Issue Type: Bug
>Affects Versions: 5.0.0, 4.15.0
>Reporter: Sandeep Guggilam
>Assignee: Chinmay Kulkarni
>Priority: Major
>  Labels: pherf
> Fix For: 5.1.0, 4.16.0
>
> Attachments: PHOENIX-5864-v1.patch
>
>
> Looks to be related to this commit : 
> [https://github.com/apache/phoenix/commit/8ee78e2be4858f3ed230dff2328269ebe67e1f03]



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (PHOENIX-5841) When data columns get TTLed, we need inline index validation to publish a metric for this

2020-04-23 Thread Hudson (Jira)


[ 
https://issues.apache.org/jira/browse/PHOENIX-5841?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17091043#comment-17091043
 ] 

Hudson commented on PHOENIX-5841:
-

FAILURE: Integrated in Jenkins build PreCommit-PHOENIX-Build #3785 (See 
[https://builds.apache.org/job/PreCommit-PHOENIX-Build/3785/])
PHOENIX-5841 add a counter for mismatching num of columns (giskender: rev 
0b3c8a378a2ebb7cbbb6bcc3e6b308c37da1e358)
* (edit) phoenix-core/src/it/java/org/apache/phoenix/end2end/IndexToolIT.java
* (edit) 
phoenix-core/src/main/java/org/apache/phoenix/coprocessor/IndexRebuildRegionScanner.java
* (edit) 
phoenix-core/src/main/java/org/apache/phoenix/coprocessor/IndexToolVerificationResult.java
* (edit) 
phoenix-core/src/main/java/org/apache/phoenix/mapreduce/index/IndexTool.java
* (edit) 
phoenix-core/src/main/java/org/apache/phoenix/mapreduce/index/PhoenixIndexImportDirectReducer.java
* (edit) 
phoenix-core/src/test/java/org/apache/phoenix/index/VerifySingleIndexRowTest.java
* (edit) 
phoenix-core/src/main/java/org/apache/phoenix/mapreduce/index/PhoenixIndexToolJobCounters.java


> When data columns get TTLed, we need inline index validation to publish a 
> metric for this
> -
>
> Key: PHOENIX-5841
> URL: https://issues.apache.org/jira/browse/PHOENIX-5841
> Project: Phoenix
>  Issue Type: Improvement
>Reporter: Gokcen Iskender
>Priority: Major
> Attachments: PHOENIX-5841.4.x.001.patch, PHOENIX-5841.4.x.002.patch, 
> PHOENIX-5841.4.x.003.patch, PHOENIX-5841.master.001.patch, 
> PHOENIX-5841.master.002.patch, PHOENIX-5841.master.003.patch
>
>  Time Spent: 2.5h
>  Remaining Estimate: 0h
>
> We do index writes as full row writes. This means all columns keep get 
> re-written to index and they have a current timestamp.
> However, if there is a column that did not get updated for a long time (like 
> Created_By type of columns that don't change) index inline validation marks 
> these as "Index has extra columns". We need to publish an extra metric to 
> distinguish these cases since they are expected to be not matching rows.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (PHOENIX-4521) Allow Pherf scenario to define per query max allowed query execution duration after which thread is interrupted

2020-04-21 Thread Hudson (Jira)


[ 
https://issues.apache.org/jira/browse/PHOENIX-4521?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17088588#comment-17088588
 ] 

Hudson commented on PHOENIX-4521:
-

FAILURE: Integrated in Jenkins build PreCommit-PHOENIX-Build #3774 (See 
[https://builds.apache.org/job/PreCommit-PHOENIX-Build/3774/])
PHOENIX-4521: Allow Pherf scenario to define per query max allowed query 
(chinmayskulkarni: rev dccc260413591a7ab3133f8040b8547b8e993750)
* (add) 
phoenix-pherf/src/test/java/org/apache/phoenix/pherf/workload/MultiThreadedRunnerTest.java
* (edit) 
phoenix-pherf/src/main/java/org/apache/phoenix/pherf/configuration/Query.java
* (edit) phoenix-pherf/pom.xml
* (edit) 
phoenix-pherf/src/main/java/org/apache/phoenix/pherf/workload/MultithreadedDiffer.java
* (edit) 
phoenix-pherf/src/main/java/org/apache/phoenix/pherf/result/QueryResult.java
* (edit) 
phoenix-pherf/src/main/java/org/apache/phoenix/pherf/result/ThreadTime.java
* (add) phoenix-pherf/src/test/resources/datamodel/timeout_test_schema.sql
* (edit) phoenix-pherf/src/it/java/org/apache/phoenix/pherf/PherfMainIT.java
* (add) phoenix-pherf/src/test/resources/scenario/timeout_test_scenario.xml
* (edit) 
phoenix-pherf/src/main/java/org/apache/phoenix/pherf/result/RunTime.java
* (edit) 
phoenix-pherf/src/main/java/org/apache/phoenix/pherf/result/file/Header.java
* (edit) phoenix-pherf/src/test/java/org/apache/phoenix/pherf/ResultTest.java
* (edit) 
phoenix-pherf/src/main/java/org/apache/phoenix/pherf/workload/MultiThreadedRunner.java


> Allow Pherf scenario to define per query max allowed query execution duration 
> after which thread is interrupted
> ---
>
> Key: PHOENIX-4521
> URL: https://issues.apache.org/jira/browse/PHOENIX-4521
> Project: Phoenix
>  Issue Type: Improvement
>Affects Versions: 5.0.0, 4.15.0, 4.14.3
>Reporter: James R. Taylor
>Assignee: Christine Feng
>Priority: Major
>  Labels: phoenix-hardening
> Fix For: 5.1.0, 4.16.0
>
> Attachments: PHOENIX-4521.4.x.v1.patch, PHOENIX-4521.4.x.v2.patch, 
> PHOENIX-4521.master.v1.patch, PHOENIX-4521.master.v2.patch, 
> PHOENIX-4521.master.v2.patch, PHOENIX-4521.master.v3.patch, 
> PHOENIX-4521.master.v4.patch, PHOENIX-4521.master.v5.patch, 
> PHOENIX-4521.master.v6.patch, PHOENIX-4521.master.v7.patch
>
>  Time Spent: 12h 50m
>  Remaining Estimate: 0h
>
> Some clients interrupt the client thread if it doesn't complete in a required 
> amount of time. It would be good if Pherf supported setting this up so we 
> mimic client behavior more closely, as we're theorizing this may be causing 
> some issues.
>  
> PLAN
>  # Make necessary changes so new timeoutDuration property is recognized and 
> parsed correctly from the scenario .xml file (completed)
>  # Implement a per-query, per-iteration timeout
>  # Write ITs and UTs



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (PHOENIX-4521) Allow Pherf scenario to define per query max allowed query execution duration after which thread is interrupted

2020-04-21 Thread Hudson (Jira)


[ 
https://issues.apache.org/jira/browse/PHOENIX-4521?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17088589#comment-17088589
 ] 

Hudson commented on PHOENIX-4521:
-

FAILURE: Integrated in Jenkins build PreCommit-PHOENIX-Build #3773 (See 
[https://builds.apache.org/job/PreCommit-PHOENIX-Build/3773/])
PHOENIX-4521: Allow Pherf scenario to define per query max allowed query 
(chinmayskulkarni: rev dccc260413591a7ab3133f8040b8547b8e993750)
* (add) phoenix-pherf/src/test/resources/scenario/timeout_test_scenario.xml
* (add) phoenix-pherf/src/test/resources/datamodel/timeout_test_schema.sql
* (edit) 
phoenix-pherf/src/main/java/org/apache/phoenix/pherf/configuration/Query.java
* (edit) phoenix-pherf/src/it/java/org/apache/phoenix/pherf/PherfMainIT.java
* (edit) phoenix-pherf/src/test/java/org/apache/phoenix/pherf/ResultTest.java
* (edit) 
phoenix-pherf/src/main/java/org/apache/phoenix/pherf/workload/MultithreadedDiffer.java
* (add) 
phoenix-pherf/src/test/java/org/apache/phoenix/pherf/workload/MultiThreadedRunnerTest.java
* (edit) 
phoenix-pherf/src/main/java/org/apache/phoenix/pherf/result/ThreadTime.java
* (edit) 
phoenix-pherf/src/main/java/org/apache/phoenix/pherf/result/QueryResult.java
* (edit) 
phoenix-pherf/src/main/java/org/apache/phoenix/pherf/result/RunTime.java
* (edit) 
phoenix-pherf/src/main/java/org/apache/phoenix/pherf/result/file/Header.java
* (edit) phoenix-pherf/pom.xml
* (edit) 
phoenix-pherf/src/main/java/org/apache/phoenix/pherf/workload/MultiThreadedRunner.java


> Allow Pherf scenario to define per query max allowed query execution duration 
> after which thread is interrupted
> ---
>
> Key: PHOENIX-4521
> URL: https://issues.apache.org/jira/browse/PHOENIX-4521
> Project: Phoenix
>  Issue Type: Improvement
>Affects Versions: 5.0.0, 4.15.0, 4.14.3
>Reporter: James R. Taylor
>Assignee: Christine Feng
>Priority: Major
>  Labels: phoenix-hardening
> Fix For: 5.1.0, 4.16.0
>
> Attachments: PHOENIX-4521.4.x.v1.patch, PHOENIX-4521.4.x.v2.patch, 
> PHOENIX-4521.master.v1.patch, PHOENIX-4521.master.v2.patch, 
> PHOENIX-4521.master.v2.patch, PHOENIX-4521.master.v3.patch, 
> PHOENIX-4521.master.v4.patch, PHOENIX-4521.master.v5.patch, 
> PHOENIX-4521.master.v6.patch, PHOENIX-4521.master.v7.patch
>
>  Time Spent: 12h 50m
>  Remaining Estimate: 0h
>
> Some clients interrupt the client thread if it doesn't complete in a required 
> amount of time. It would be good if Pherf supported setting this up so we 
> mimic client behavior more closely, as we're theorizing this may be causing 
> some issues.
>  
> PLAN
>  # Make necessary changes so new timeoutDuration property is recognized and 
> parsed correctly from the scenario .xml file (completed)
>  # Implement a per-query, per-iteration timeout
>  # Write ITs and UTs



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (PHOENIX-5496) Ensure that we handle all server-side mutation codes on the client

2020-04-18 Thread Hudson (Jira)


[ 
https://issues.apache.org/jira/browse/PHOENIX-5496?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17086373#comment-17086373
 ] 

Hudson commented on PHOENIX-5496:
-

FAILURE: Integrated in Jenkins build PreCommit-PHOENIX-Build #3768 (See 
[https://builds.apache.org/job/PreCommit-PHOENIX-Build/3768/])
PHOENIX-5496 Ensure that we handle all server-side mutation codes on the 
(s.kadam: rev c627f94b50802bde493bfef1a2a090d9568eff6f)
* (edit) 
phoenix-core/src/main/java/org/apache/phoenix/exception/SQLExceptionCode.java
* (edit) 
phoenix-core/src/main/java/org/apache/phoenix/schema/MetaDataClient.java
* (add) 
phoenix-core/src/test/java/org/apache/phoenix/schema/MetaDataClientTest.java


> Ensure that we handle all server-side mutation codes on the client
> --
>
> Key: PHOENIX-5496
> URL: https://issues.apache.org/jira/browse/PHOENIX-5496
> Project: Phoenix
>  Issue Type: Bug
>Affects Versions: 4.15.0, 5.1.0
>Reporter: Chinmay Kulkarni
>Assignee: Neha Gupta
>Priority: Major
> Fix For: 4.15.1, 5.1.1
>
> Attachments: PHOENIX-5496.4.x.patch, PHOENIX-5496.master.patch
>
>  Time Spent: 4h 20m
>  Remaining Estimate: 0h
>
> There are many instances throughout wherein we set a certain error mutation 
> code in the RPC callback, however we do not handle these mutation codes on 
> the client.
> For example: 
> If the metadata rows for a tableKey are no longer in that SYSCAT region, 
> checkTableKeyInRegion() fails, the metadata for this table is not written to 
> SYSCAT and [the TABLE_NOT_IN_REGION mutation code is 
> set|https://github.com/apache/phoenix/blob/11997d48d1957cf613526f01c5ccbe2812cf095d/phoenix-core/src/main/java/org/apache/phoenix/coprocessor/MetaDataEndpointImpl.java#L1785-L1790].
> This is handled for 1 retry inside 
> [CQSI.metaDataCoprocessorExec|https://github.com/apache/phoenix/blob/11997d48d1957cf613526f01c5ccbe2812cf095d/phoenix-core/src/main/java/org/apache/phoenix/query/ConnectionQueryServicesImpl.java#L1568-L1570],
>  but if this happens again, it is returned back to the client where it goes 
> to the default case and succeeds.
> Apart from the fact that partial metadata updates are possible leading to 
> orphan metadata rows in system tables, this also wrongly returns success for 
> clients even though there is no record of that table/view being created 
> inside Phoenix's system tables.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (PHOENIX-5840) IndexTool inline verification should not fail with -v ONLY option

2020-04-16 Thread Hudson (Jira)


[ 
https://issues.apache.org/jira/browse/PHOENIX-5840?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17085204#comment-17085204
 ] 

Hudson commented on PHOENIX-5840:
-

FAILURE: Integrated in Jenkins build PreCommit-PHOENIX-Build #3760 (See 
[https://builds.apache.org/job/PreCommit-PHOENIX-Build/3760/])
PHOENIX-5840: IndexTool inline verification should not fail with -v ONLY 
(github: rev 7b4db73b37d8a67fb0238e405abcf4e5f160a103)
* (edit) 
phoenix-core/src/main/java/org/apache/phoenix/coprocessor/IndexToolVerificationResult.java
* (edit) 
phoenix-core/src/test/java/org/apache/phoenix/parse/PhoenixRowTimestampFunctionTest.java
* (edit) 
phoenix-core/src/main/java/org/apache/phoenix/mapreduce/index/PhoenixIndexImportDirectReducer.java
* (edit) phoenix-core/src/it/java/org/apache/phoenix/end2end/IndexToolIT.java


> IndexTool inline verification should not fail with -v ONLY option
> -
>
> Key: PHOENIX-5840
> URL: https://issues.apache.org/jira/browse/PHOENIX-5840
> Project: Phoenix
>  Issue Type: Improvement
>Reporter: Swaroopa Kadam
>Assignee: Swaroopa Kadam
>Priority: Major
> Attachments: PHOENIX-5840.4.x.patch, PHOENIX-5840.4.x.v1.patch, 
> PHOENIX-5840.4.x.v2.patch, PHOENIX-5840.master.patch
>
>  Time Spent: 1h
>  Remaining Estimate: 0h
>
> IndexTool inline verification should not fail with -v ONLY option even if 
> verification fails. 



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (PHOENIX-578) Cut a 2.0.2 release

2020-04-14 Thread Hudson (Jira)


[ 
https://issues.apache.org/jira/browse/PHOENIX-578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17083322#comment-17083322
 ] 

Hudson commented on PHOENIX-578:


FAILURE: Integrated in Jenkins build PreCommit-PHOENIX-Build #3748 (See 
[https://builds.apache.org/job/PreCommit-PHOENIX-Build/3748/])
PHOENIX-578 try to standardize on a JSON library (stoty: rev 
dec131d8a4de666c06dabc332383fd7e75c2d3aa)
* (edit) 
phoenix-core/src/it/java/org/apache/phoenix/end2end/IndexRebuildTaskIT.java
* (edit) phoenix-core/src/it/resources/compatible_client_versions.json
* (edit) 
phoenix-core/src/main/java/org/apache/phoenix/mapreduce/index/automation/PhoenixMRJobSubmitter.java
* (edit) 
phoenix-core/src/main/java/org/apache/phoenix/coprocessor/TaskRegionObserver.java
* (edit) 
phoenix-core/src/main/java/org/apache/phoenix/util/PhoenixMRJobUtil.java
* (edit) 
phoenix-core/src/it/java/org/apache/phoenix/end2end/BackwardCompatibilityIT.java
* (edit) pom.xml
* (edit) 
phoenix-core/src/main/java/org/apache/phoenix/coprocessor/tasks/IndexRebuildTask.java
* (edit) phoenix-core/pom.xml
* (edit) 
phoenix-core/src/main/java/org/apache/phoenix/schema/MetaDataClient.java


> Cut a 2.0.2 release
> ---
>
> Key: PHOENIX-578
> URL: https://issues.apache.org/jira/browse/PHOENIX-578
> Project: Phoenix
>  Issue Type: Task
>Reporter: Andrew Kyle Purtell
>Assignee: Mujtaba Chohan
>
> It looks like [BIGTOP-993](https://issues.apache.org/jira/browse/BIGTOP-993) 
> might be committed soon. 
> I propose to create a new branch '2.0.2' which is the '2.0.1' branch plus the 
> fix committed somewhere to 'master' for this compilation problem against 
> recent HBase 0.94 versions:
> [ERROR] 
> /usr/src/Hadoop/bigtop/output/phoenix/phoenix-2.0.1/src/main/java/com/salesforce/phoenix/query/ConnectionQueryServicesImpl.java:[137,39]
>  
> allTableRegions(org.apache.hadoop.conf.Configuration,org.apache.hadoop.hbase.client.HConnection,byte[],boolean)
>  in org.apache.hadoop.hbase.client.MetaScanner cannot be applied to 
> (org.apache.hadoop.conf.Configuration,byte[],boolean)
> [ERROR] 
> /usr/src/Hadoop/bigtop/output/phoenix/phoenix-2.0.1/src/main/java/com/salesforce/phoenix/query/ConnectionQueryServicesImpl.java:[716,78]
>  
> allTableRegions(org.apache.hadoop.conf.Configuration,org.apache.hadoop.hbase.client.HConnection,byte[],boolean)
>  in org.apache.hadoop.hbase.client.MetaScanner cannot be applied to 
> (org.apache.hadoop.conf.Configuration,byte[],boolean)
> What do you think?



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (PHOENIX-5629) Phoenix Function to Return HBase row timestamp

2020-04-13 Thread Hudson (Jira)


[ 
https://issues.apache.org/jira/browse/PHOENIX-5629?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17082844#comment-17082844
 ] 

Hudson commented on PHOENIX-5629:
-

FAILURE: Integrated in Jenkins build PreCommit-PHOENIX-Build #3746 (See 
[https://builds.apache.org/job/PreCommit-PHOENIX-Build/3746/])
PHOENIX-5629 Phoenix Function to Return HBase row timestamp (yanxinyi: rev 
ed0ca183fe6e54aa83ad826e4cf3e77267a0b306)
* (edit) 
phoenix-core/src/main/java/org/apache/phoenix/expression/ExpressionType.java
* (edit) 
phoenix-core/src/main/java/org/apache/phoenix/compile/ProjectionCompiler.java
* (add) 
phoenix-core/src/it/java/org/apache/phoenix/end2end/PhoenixRowTimestampFunctionIT.java
* (add) 
phoenix-core/src/main/java/org/apache/phoenix/expression/function/PhoenixRowTimestampFunction.java
* (add) 
phoenix-core/src/main/java/org/apache/phoenix/parse/PhoenixRowTimestampParseNode.java
* (edit) 
phoenix-core/src/main/java/org/apache/phoenix/execute/TupleProjector.java
* (add) 
phoenix-core/src/test/java/org/apache/phoenix/parse/PhoenixRowTimestampFunctionTest.java
* (delete) 
phoenix-core/src/it/java/org/apache/phoenix/end2end/RowTimestampStringFunctionIT.java
* (delete) 
phoenix-core/src/main/java/org/apache/phoenix/expression/function/RowTimestampStringFunction.java


> Phoenix Function to Return HBase row timestamp
> --
>
> Key: PHOENIX-5629
> URL: https://issues.apache.org/jira/browse/PHOENIX-5629
> Project: Phoenix
>  Issue Type: New Feature
>Reporter: Geoffrey Jacoby
>Assignee: Jacob Isaac
>Priority: Major
> Fix For: 5.1.0, 4.16.0
>
> Attachments: PHOENIX-5629-addendum.4.x-HBase-1.3.002.patch, 
> PHOENIX-5629.4.x-HBase-1.3.v1.patch, PHOENIX-5629.4.x-HBase-1.3.v2.patch, 
> PHOENIX-5629.master.v1.patch, PHOENIX-5629.master.v2.patch
>
>  Time Spent: 8.5h
>  Remaining Estimate: 0h
>
> t's occasionally useful when diagnosing an issue with Phoenix to be able to 
> easily look up the HBase timestamp of the HBase Cell returned by a Phoenix 
> query. 
> For example:
> SELECT ROW_TIMESTAMP(Column1) FROM Table1 WHERE Column1 = 'SomeValue'



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (PHOENIX-5811) Synchronise Phoenix dependencies to match Hbase dependency versions

2020-04-09 Thread Hudson (Jira)


[ 
https://issues.apache.org/jira/browse/PHOENIX-5811?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17079433#comment-17079433
 ] 

Hudson commented on PHOENIX-5811:
-

FAILURE: Integrated in Jenkins build PreCommit-PHOENIX-Build #3735 (See 
[https://builds.apache.org/job/PreCommit-PHOENIX-Build/3735/])
PHOENIX-5811 Synchronise Phoenix dependencies to match Hbase dependency (stoty: 
rev 39a34b8fae743c63f634ef0366c2de130a621bbe)
* (edit) pom.xml


> Synchronise Phoenix dependencies to match Hbase dependency versions
> ---
>
> Key: PHOENIX-5811
> URL: https://issues.apache.org/jira/browse/PHOENIX-5811
> Project: Phoenix
>  Issue Type: Task
>Reporter: Richard Antal
>Assignee: Richard Antal
>Priority: Major
> Fix For: 5.1.0
>
> Attachments: PHOENIX-5811.master.v1.patch, 
> PHOENIX-5811.master.v2.patch, PHOENIX-5811.master.v3.patch, 
> PHOENIX-5811.master.v4.patch
>
>
> Phoenix uses an older version of some dependencies.
> We could reduce the number of dependencies by using the same versions as 
> Hbase.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (PHOENIX-5825) Remove PhoenixCanaryTool and CanaryTestResult from phoenix repo

2020-04-09 Thread Hudson (Jira)


[ 
https://issues.apache.org/jira/browse/PHOENIX-5825?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17079308#comment-17079308
 ] 

Hudson commented on PHOENIX-5825:
-

FAILURE: Integrated in Jenkins build PreCommit-PHOENIX-Build #3734 (See 
[https://builds.apache.org/job/PreCommit-PHOENIX-Build/3734/])
PHOENIX-5825 Remove PhoenixCanaryTool and CanaryTestResult from phoenix (stoty: 
rev 95dab00ed285927d4d00fb3c6b31dc376eb40db9)
* (delete) 
phoenix-core/src/main/java/org/apache/phoenix/tool/PhoenixCanaryTool.java
* (delete) 
phoenix-core/src/test/java/org/apache/phoenix/tool/ParameterizedPhoenixCanaryToolIT.java
* (delete) 
phoenix-core/src/main/java/org/apache/phoenix/tool/CanaryTestResult.java
* (edit) phoenix-core/pom.xml
* (delete) 
phoenix-core/src/test/java/org/apache/phoenix/tool/PhoenixCanaryToolTest.java
* (edit) pom.xml


> Remove PhoenixCanaryTool and CanaryTestResult from phoenix repo
> ---
>
> Key: PHOENIX-5825
> URL: https://issues.apache.org/jira/browse/PHOENIX-5825
> Project: Phoenix
>  Issue Type: Task
>  Components: core, queryserver
>Affects Versions: 5.1.0, queryserver-1.0.0, 4.16.0
>Reporter: Istvan Toth
>Assignee: Istvan Toth
>Priority: Major
> Fix For: 5.1.0, 4.16.0
>
> Attachments: PHOENIX-5825.master.v1.patch
>
>  Time Spent: 20m
>  Remaining Estimate: 0h
>
> In Phoenix-5824 I move these classes to queryserver-orchestrator, as they are 
> not used anywhere else.
> Once that is committed, these files are redundant in the main repo.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (PHOENIX-5810) PhoenixMRJobSubmitter is not working on a cluster with a single yarn RM

2020-04-07 Thread Hudson (Jira)


[ 
https://issues.apache.org/jira/browse/PHOENIX-5810?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17077100#comment-17077100
 ] 

Hudson commented on PHOENIX-5810:
-

FAILURE: Integrated in Jenkins build PreCommit-PHOENIX-Build #3728 (See 
[https://builds.apache.org/job/PreCommit-PHOENIX-Build/3728/])
PHOENIX-5810 PhoenixMRJobSubmitter is not working on a cluster with a (stoty: 
rev e10642686314804030ffa4c151155f5483e97db4)
* (edit) 
phoenix-core/src/main/java/org/apache/phoenix/util/PhoenixMRJobUtil.java
* (add) 
phoenix-core/src/test/java/org/apache/phoenix/util/PhoenixMRJobUtilTest.java
* (edit) 
phoenix-core/src/main/java/org/apache/phoenix/mapreduce/index/automation/PhoenixMRJobSubmitter.java


> PhoenixMRJobSubmitter is not working on a cluster with a single yarn RM
> ---
>
> Key: PHOENIX-5810
> URL: https://issues.apache.org/jira/browse/PHOENIX-5810
> Project: Phoenix
>  Issue Type: Bug
>Reporter: Richard Antal
>Assignee: Richard Antal
>Priority: Major
> Fix For: 5.1.0, 4.16.0
>
> Attachments: PHOENIX-5810.master.v1.patch, 
> PHOENIX-5810.master.v2.patch, PHOENIX-5810.master.v3.patch, 
> PHOENIX-5810.master.v4.patch, PHOENIX-5810.master.v5.patch
>
>
> {code:java}
> Exception in thread "main" 
> org.apache.zookeeper.KeeperException$NoNodeException: KeeperErrorCode = 
> NoNode for /yarn-leader-election{code}
> The error happens when we want to run scheduleIndexBuilds. In 
> getSubmittedYarnApps, getActiveResourceManagerHost uses zookeeper to 
> determine the active Resource Manager.
>  But /yarn-leader-election only exists if yarn is in HA mode.
> I think this function should work well when we have single yarn RM and read 
> its address from the config.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (PHOENIX-5798) IndexUpgrade tool command line improvements

2020-04-06 Thread Hudson (Jira)


[ 
https://issues.apache.org/jira/browse/PHOENIX-5798?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17076773#comment-17076773
 ] 

Hudson commented on PHOENIX-5798:
-

FAILURE: Integrated in Jenkins build PreCommit-PHOENIX-Build #3725 (See 
[https://builds.apache.org/job/PreCommit-PHOENIX-Build/3725/])
PHOENIX-5798 IndexUpgrade tool command line improvements (s.kadam: rev 
bb1db520d0be1a19f1c62c2a0fb78aaad1d30ac4)
* (edit) 
phoenix-core/src/it/java/org/apache/phoenix/end2end/ParameterizedIndexUpgradeToolIT.java
* (edit) 
phoenix-core/src/main/java/org/apache/phoenix/mapreduce/index/IndexUpgradeTool.java
* (edit) 
phoenix-core/src/test/java/org/apache/phoenix/index/IndexUpgradeToolTest.java


> IndexUpgrade tool command line improvements
> ---
>
> Key: PHOENIX-5798
> URL: https://issues.apache.org/jira/browse/PHOENIX-5798
> Project: Phoenix
>  Issue Type: Improvement
>Reporter: Tanuj Khurana
>Assignee: Tanuj Khurana
>Priority: Minor
> Attachments: PHOENIX-5798.4.x.v1.patch, PHOENIX-5798.4.x.v2.patch, 
> PHOENIX-5798.master.v1.patch, PHOENIX-5798.master.v2.patch
>
>  Time Spent: 3h 50m
>  Remaining Estimate: 0h
>
> * IndexUpgrade tool should optionally rebuild indexes. By default, rebuilding 
> index should be skipped.
>  * Add a placeholder option to index upgrade tool to passthrough the option 
> value to the index tool



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (PHOENIX-5794) Create a threshold for non async index creation, that can be modified in configs

2020-04-06 Thread Hudson (Jira)


[ 
https://issues.apache.org/jira/browse/PHOENIX-5794?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17076774#comment-17076774
 ] 

Hudson commented on PHOENIX-5794:
-

FAILURE: Integrated in Jenkins build PreCommit-PHOENIX-Build #3725 (See 
[https://builds.apache.org/job/PreCommit-PHOENIX-Build/3725/])
PHOENIX-5794 Create a threshold for non async index creation, that can 
(rajeshbabu: rev b3497876a404828c6486ffc1e2e1957a007abeb6)
* (edit) 
phoenix-core/src/main/java/org/apache/phoenix/query/QueryServicesOptions.java
* (edit) phoenix-core/src/main/java/org/apache/phoenix/query/QueryServices.java
* (edit) 
phoenix-core/src/main/java/org/apache/phoenix/schema/MetaDataClient.java
* (edit) 
phoenix-core/src/main/java/org/apache/phoenix/exception/SQLExceptionCode.java
* (edit) pom.xml
* (add) 
phoenix-core/src/it/java/org/apache/phoenix/end2end/index/IndexAsyncThresholdIT.java


> Create a threshold for non async index creation, that can be modified in 
> configs
> 
>
> Key: PHOENIX-5794
> URL: https://issues.apache.org/jira/browse/PHOENIX-5794
> Project: Phoenix
>  Issue Type: Improvement
>Reporter: Richard Antal
>Assignee: Richard Antal
>Priority: Major
> Attachments: PHOENIX-5794.master.v1.patch, 
> PHOENIX-5794.master.v10.patch, PHOENIX-5794.master.v2.patch, 
> PHOENIX-5794.master.v3.patch, PHOENIX-5794.master.v4.patch, 
> PHOENIX-5794.master.v5.patch, PHOENIX-5794.master.v6.patch, 
> PHOENIX-5794.master.v7.patch, PHOENIX-5794.master.v8.patch, 
> PHOENIX-5794.master.v9.patch
>
>
> Issue:
> When user try to create an index on a huge phoenix table the region servers 
> crashed which led to multiple regions going in RIT state. 
>  
> Solution:
> If the expected byte read size is higher than the limit we raise an exception 
> to notify the user that the index should be created asynchronously.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (PHOENIX-5780) Add mvn dependency:analyze to build process

2020-04-06 Thread Hudson (Jira)


[ 
https://issues.apache.org/jira/browse/PHOENIX-5780?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17076722#comment-17076722
 ] 

Hudson commented on PHOENIX-5780:
-

SUCCESS: Integrated in Jenkins build PreCommit-PHOENIX-Build #3722 (See 
[https://builds.apache.org/job/PreCommit-PHOENIX-Build/3722/])
PHOENIX-5780 Add mvn dependency:analyze to build process (stoty: rev 
bd736137354b5e60ad7678e9c53f2f503a106b0f)
* (edit) 
phoenix-core/src/it/java/org/apache/phoenix/end2end/index/GlobalIndexCheckerIT.java
* (edit) 
phoenix-core/src/main/java/org/apache/phoenix/parse/UpdateStatisticsStatement.java
* (edit) 
phoenix-core/src/main/java/org/apache/phoenix/hbase/index/IndexRegionObserver.java
* (edit) phoenix-pherf/pom.xml
* (edit) phoenix-hbase-compat-2.2.1/pom.xml
* (edit) phoenix-core/src/main/java/org/apache/phoenix/util/QueryBuilder.java
* (edit) phoenix-tracing-webapp/pom.xml
* (edit) 
phoenix-core/src/main/java/org/apache/phoenix/iterate/BaseResultIterators.java
* (edit) phoenix-core/src/main/java/org/apache/phoenix/util/JDBCUtil.java
* (edit) phoenix-server/pom.xml
* (edit) phoenix-client/pom.xml
* (edit) 
phoenix-core/src/it/java/org/apache/phoenix/end2end/index/MutableIndexExtendedIT.java
* (edit) phoenix-hbase-compat-2.0.1/pom.xml
* (edit) 
phoenix-core/src/it/java/org/apache/phoenix/end2end/salted/SaltedTableVarLengthRowKeyIT.java
* (edit) 
phoenix-core/src/main/java/org/apache/phoenix/index/GlobalIndexChecker.java
* (edit) phoenix-core/src/main/java/org/apache/phoenix/log/QueryLogger.java
* (edit) phoenix-core/src/main/java/org/apache/phoenix/trace/util/Tracing.java
* (edit) 
phoenix-core/src/main/java/org/apache/phoenix/hbase/index/write/LazyParallelWriterIndexCommitter.java
* (edit) 
phoenix-pherf/src/main/java/org/apache/phoenix/pherf/result/ResultUtil.java
* (edit) phoenix-core/src/main/java/org/apache/phoenix/util/DateUtil.java
* (edit) 
phoenix-core/src/main/java/org/apache/phoenix/compile/RVCOffsetCompiler.java
* (edit) phoenix-hbase-compat-2.1.6/pom.xml
* (edit) pom.xml
* (edit) 
phoenix-core/src/main/java/org/apache/phoenix/compile/DeleteCompiler.java
* (edit) 
phoenix-core/src/main/java/org/apache/phoenix/hbase/index/write/AbstractParallelWriterIndexCommitter.java
* (edit) 
phoenix-core/src/main/java/org/apache/phoenix/jdbc/PhoenixResultSet.java
* (edit) BUILDING.md
* (edit) 
phoenix-core/src/main/java/org/apache/phoenix/mapreduce/OrphanViewTool.java
* (edit) 
phoenix-pherf/src/main/java/org/apache/phoenix/pherf/workload/WorkloadExecutor.java
* (edit) 
phoenix-core/src/it/java/org/apache/phoenix/end2end/BackwardCompatibilityIT.java
* (edit) 
phoenix-core/src/it/java/org/apache/phoenix/end2end/ParallelStatsDisabledIT.java
* (edit) phoenix-core/pom.xml


> Add mvn dependency:analyze to build process
> ---
>
> Key: PHOENIX-5780
> URL: https://issues.apache.org/jira/browse/PHOENIX-5780
> Project: Phoenix
>  Issue Type: Task
>  Components: core
>Reporter: Istvan Toth
>Assignee: Istvan Toth
>Priority: Major
> Fix For: 5.1.0
>
> Attachments: PHOENIX-5780.master.v1.patch, 
> PHOENIX-5780.master.v2.patch, PHOENIX-5780.master.v3.patch, 
> PHOENIX-5780.master.v4.patch, PHOENIX-5780.master.v5.patch
>
>  Time Spent: 1.5h
>  Remaining Estimate: 0h
>
> mvn dependency:analyze has shown that the dependency definitions in Phoenix 
> are in a bad shape.
> Include it in the build process, so that we can keep the dependencies true 
> and up to date.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (PHOENIX-5780) Add mvn dependency:analyze to build process

2020-04-06 Thread Hudson (Jira)


[ 
https://issues.apache.org/jira/browse/PHOENIX-5780?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17076486#comment-17076486
 ] 

Hudson commented on PHOENIX-5780:
-

FAILURE: Integrated in Jenkins build PreCommit-PHOENIX-Build #3721 (See 
[https://builds.apache.org/job/PreCommit-PHOENIX-Build/3721/])
PHOENIX-5780 Add mvn dependency:analyze to build process (stoty: rev 
bd736137354b5e60ad7678e9c53f2f503a106b0f)
* (edit) 
phoenix-core/src/it/java/org/apache/phoenix/end2end/index/GlobalIndexCheckerIT.java
* (edit) phoenix-core/src/main/java/org/apache/phoenix/trace/util/Tracing.java
* (edit) phoenix-core/src/main/java/org/apache/phoenix/util/DateUtil.java
* (edit) phoenix-pherf/pom.xml
* (edit) 
phoenix-core/src/it/java/org/apache/phoenix/end2end/BackwardCompatibilityIT.java
* (edit) phoenix-core/src/main/java/org/apache/phoenix/util/JDBCUtil.java
* (edit) 
phoenix-core/src/it/java/org/apache/phoenix/end2end/index/MutableIndexExtendedIT.java
* (edit) 
phoenix-core/src/main/java/org/apache/phoenix/iterate/BaseResultIterators.java
* (edit) 
phoenix-core/src/main/java/org/apache/phoenix/mapreduce/OrphanViewTool.java
* (edit) phoenix-core/src/main/java/org/apache/phoenix/util/QueryBuilder.java
* (edit) BUILDING.md
* (edit) phoenix-core/pom.xml
* (edit) phoenix-client/pom.xml
* (edit) 
phoenix-core/src/main/java/org/apache/phoenix/compile/DeleteCompiler.java
* (edit) phoenix-hbase-compat-2.1.6/pom.xml
* (edit) phoenix-hbase-compat-2.2.1/pom.xml
* (edit) 
phoenix-pherf/src/main/java/org/apache/phoenix/pherf/result/ResultUtil.java
* (edit) phoenix-tracing-webapp/pom.xml
* (edit) phoenix-server/pom.xml
* (edit) 
phoenix-core/src/main/java/org/apache/phoenix/hbase/index/write/LazyParallelWriterIndexCommitter.java
* (edit) 
phoenix-core/src/main/java/org/apache/phoenix/compile/RVCOffsetCompiler.java
* (edit) 
phoenix-pherf/src/main/java/org/apache/phoenix/pherf/workload/WorkloadExecutor.java
* (edit) 
phoenix-core/src/main/java/org/apache/phoenix/hbase/index/IndexRegionObserver.java
* (edit) 
phoenix-core/src/main/java/org/apache/phoenix/parse/UpdateStatisticsStatement.java
* (edit) pom.xml
* (edit) 
phoenix-core/src/main/java/org/apache/phoenix/jdbc/PhoenixResultSet.java
* (edit) 
phoenix-core/src/it/java/org/apache/phoenix/end2end/ParallelStatsDisabledIT.java
* (edit) phoenix-core/src/main/java/org/apache/phoenix/log/QueryLogger.java
* (edit) 
phoenix-core/src/main/java/org/apache/phoenix/hbase/index/write/AbstractParallelWriterIndexCommitter.java
* (edit) 
phoenix-core/src/main/java/org/apache/phoenix/index/GlobalIndexChecker.java
* (edit) phoenix-hbase-compat-2.0.1/pom.xml
* (edit) 
phoenix-core/src/it/java/org/apache/phoenix/end2end/salted/SaltedTableVarLengthRowKeyIT.java


> Add mvn dependency:analyze to build process
> ---
>
> Key: PHOENIX-5780
> URL: https://issues.apache.org/jira/browse/PHOENIX-5780
> Project: Phoenix
>  Issue Type: Task
>  Components: core
>Reporter: Istvan Toth
>Assignee: Istvan Toth
>Priority: Major
> Fix For: 5.1.0
>
> Attachments: PHOENIX-5780.master.v1.patch, 
> PHOENIX-5780.master.v2.patch, PHOENIX-5780.master.v3.patch, 
> PHOENIX-5780.master.v4.patch, PHOENIX-5780.master.v5.patch
>
>  Time Spent: 1.5h
>  Remaining Estimate: 0h
>
> mvn dependency:analyze has shown that the dependency definitions in Phoenix 
> are in a bad shape.
> Include it in the build process, so that we can keep the dependencies true 
> and up to date.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (PHOENIX-5719) testIndexRebuildTask test is failing on pre-commit and master build

2020-04-03 Thread Hudson (Jira)


[ 
https://issues.apache.org/jira/browse/PHOENIX-5719?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17075013#comment-17075013
 ] 

Hudson commented on PHOENIX-5719:
-

SUCCESS: Integrated in Jenkins build PreCommit-PHOENIX-Build #3719 (See 
[https://builds.apache.org/job/PreCommit-PHOENIX-Build/3719/])
PHOENIX-5719 IndexRebuildTaskIT sometimes fails (giskender: rev 
6bad8b4a6653f9fa78bd5fcbb3787408fae989f6)
* (edit) 
phoenix-core/src/it/java/org/apache/phoenix/end2end/IndexRebuildTaskIT.java
* (edit) 
phoenix-core/src/main/java/org/apache/phoenix/coprocessor/TaskRegionObserver.java


> testIndexRebuildTask test is failing on pre-commit and master build
> ---
>
> Key: PHOENIX-5719
> URL: https://issues.apache.org/jira/browse/PHOENIX-5719
> Project: Phoenix
>  Issue Type: Test
>Reporter: Xinyi Yan
>Assignee: Gokcen Iskender
>Priority: Major
> Attachments: PHOENIX-5719.4.x-HBase-1.4.001.patch, 
> PHOENIX-5719.master.001.patch, PHOENIX-5719.master.002.patch, 
> PHOENIX-5719.master.003.patch, PHOENIX-5719.master.004.patch
>
>  Time Spent: 10m
>  Remaining Estimate: 0h
>
> testIndexRebuildTask has been failing for a few days on PreCommit build, as 
> well as master build(first failing on Jan 31).
> [https://builds.apache.org/job/PreCommit-PHOENIX-Build/3401/testReport/]
> [https://builds.apache.org/job/PreCommit-PHOENIX-Build/3393/]
> [https://builds.apache.org/job/PreCommit-PHOENIX-Build/3400/]
> [https://builds.apache.org/view/M-R/view/Phoenix/job/Phoenix-master/2638/]
> [https://builds.apache.org/view/M-R/view/Phoenix/job/Phoenix-master/2639/testReport/]
> Can someone take a look at this flapper test, thanks
> [~kadir] [~gjacoby] [~swaroopa]



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (PHOENIX-5817) Prepatch script is a psycho killer

2020-04-03 Thread Hudson (Jira)


[ 
https://issues.apache.org/jira/browse/PHOENIX-5817?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17075012#comment-17075012
 ] 

Hudson commented on PHOENIX-5817:
-

SUCCESS: Integrated in Jenkins build PreCommit-PHOENIX-Build #3719 (See 
[https://builds.apache.org/job/PreCommit-PHOENIX-Build/3719/])
PHOENIX-5817 Prepatch script is a psycho killer (stoty: rev 
a61248556d5f143f7c56dffdfb962d73409c7807)
* (edit) dev/test-patch.sh


> Prepatch script is a psycho killer
> --
>
> Key: PHOENIX-5817
> URL: https://issues.apache.org/jira/browse/PHOENIX-5817
> Project: Phoenix
>  Issue Type: Bug
>Reporter: Istvan Toth
>Assignee: Istvan Toth
>Priority: Blocker
> Fix For: 5.1.0
>
> Attachments: PHOENIX-5817.master.v1.patch
>
>  Time Spent: 0.5h
>  Remaining Estimate: 0h
>
> The prepatch script assumes that it is the only test on a machine, and kills 
> other copies of itself, as well as unrelated maven tests runs.
> Looking at the times, it's obvious that 
> https://builds.apache.org/job/PreCommit-PHOENIX-Build/3712/ 
> was killed by 
> https://builds.apache.org/job/PreCommit-PHOENIX-Build/3713/ 
> What's worse, it also kills ANY maven surefire/failsafe process, so not only 
> does it sabotage other copies of itself, it also sabotages other projects' 
> tests that share the ASF infrastructure.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (PHOENIX-5814) disable trimStackTrace

2020-04-02 Thread Hudson (Jira)


[ 
https://issues.apache.org/jira/browse/PHOENIX-5814?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17074121#comment-17074121
 ] 

Hudson commented on PHOENIX-5814:
-

FAILURE: Integrated in Jenkins build PreCommit-PHOENIX-Build #3706 (See 
[https://builds.apache.org/job/PreCommit-PHOENIX-Build/3706/])
PHOENIX-5814 disable trimStackTrace (stoty: rev 
40bcc0184d3f7257ba2ce98b045d6e8a41f58a00)
* (edit) pom.xml


> disable trimStackTrace
> --
>
> Key: PHOENIX-5814
> URL: https://issues.apache.org/jira/browse/PHOENIX-5814
> Project: Phoenix
>  Issue Type: Improvement
>  Components: connectors, core, omid, queryserver, tephra
>Reporter: Istvan Toth
>Assignee: Istvan Toth
>Priority: Major
>  Time Spent: 1h 20m
>  Remaining Estimate: 0h
>
> The default trimStackTrace=true maven setting is quite effective at making 
> test output useless for all but the trivial failures.
> I propose setting it to false everywhere (i.e all five repos) 



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (PHOENIX-5816) IndexToolTimeRangeIT hangs forever

2020-04-02 Thread Hudson (Jira)


[ 
https://issues.apache.org/jira/browse/PHOENIX-5816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17073802#comment-17073802
 ] 

Hudson commented on PHOENIX-5816:
-

SUCCESS: Integrated in Jenkins build PreCommit-PHOENIX-Build #3704 (See 
[https://builds.apache.org/job/PreCommit-PHOENIX-Build/3704/])
PHOENIX-5816 IndexToolTimeRangeIT hangs forever (stoty: rev 
b9985d9bb63baf339b8699842e6c2df851291eea)
* (edit) 
phoenix-core/src/it/java/org/apache/phoenix/end2end/IndexToolTimeRangeIT.java


> IndexToolTimeRangeIT hangs forever
> --
>
> Key: PHOENIX-5816
> URL: https://issues.apache.org/jira/browse/PHOENIX-5816
> Project: Phoenix
>  Issue Type: Bug
>  Components: core
>Affects Versions: 5.1.0
>Reporter: Istvan Toth
>Assignee: Istvan Toth
>Priority: Blocker
> Fix For: 5.1.0, 4.x
>
> Attachments: PHOENIX-5816.4.x.v1.patch, PHOENIX-5816.4.x.v2.patch, 
> PHOENIX-5816.master.v1.patch, PHOENIX-5816.master.v2.patch
>
>  Time Spent: 20m
>  Remaining Estimate: 0h
>
> IndexToolTimeRangeIT hangs when executing.
> This makes all mvn verify runs to time out as well, including all Jenkins 
> jobs.
> I have identified two problems:
> * The indextool CLI argument name is off
> * The environmentEdgeManager used for the completely hoses HBase ( at least 
> 2.2)



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (PHOENIX-5807) Index rows without empty column should be treated as unverified

2020-03-30 Thread Hudson (Jira)


[ 
https://issues.apache.org/jira/browse/PHOENIX-5807?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17071451#comment-17071451
 ] 

Hudson commented on PHOENIX-5807:
-

ABORTED: Integrated in Jenkins build PreCommit-PHOENIX-Build #3683 (See 
[https://builds.apache.org/job/PreCommit-PHOENIX-Build/3683/])
PHOENIX-5807 Index rows without empty column should be treated as (kadir: rev 
54f2c93176ce57a077769a6f9740345c1da3ac45)
* (edit) 
phoenix-core/src/it/java/org/apache/phoenix/end2end/index/GlobalIndexCheckerIT.java
* (edit) 
phoenix-core/src/main/java/org/apache/phoenix/index/GlobalIndexChecker.java
* (edit) 
phoenix-core/src/main/java/org/apache/phoenix/coprocessor/IndexRebuildRegionScanner.java


> Index rows without empty column should be treated as unverified
> ---
>
> Key: PHOENIX-5807
> URL: https://issues.apache.org/jira/browse/PHOENIX-5807
> Project: Phoenix
>  Issue Type: Bug
>Affects Versions: 5.0.0, 4.14.3
>Reporter: Kadir OZDEMIR
>Assignee: Kadir OZDEMIR
>Priority: Major
> Attachments: PHOENIX-5807.4.x.001.patch
>
>  Time Spent: 1h
>  Remaining Estimate: 0h
>
> In the new index design, an index row is composed of cells with the same 
> timestamp and the empty column cell holds the verify status of the row. 
> However, it is possible that the empty column of an index row can be 
> compacted away if the row is made unverified due to a failed data table 
> overwrite. This failed overwrite will make the existing verified row index 
> row unverified by overwriting the existing row with the empty column cell 
> with the unverified status. If this row is not scanned before the next major 
> compaction, the empty column cell of the overwritten index row can be removed 
> by the compaction since there will be more than one version of it. If this 
> row is retrieved via an SCN connection, then the returned row will not 
> include the empty column cell. Not having empty column is treated as an 
> exception currently. Instead, the row without an empty column should be 
> treated as an unverified row and it should be repaired. 



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (PHOENIX-5748) Simplify index update generation code for consistent global indexes

2020-03-28 Thread Hudson (Jira)


[ 
https://issues.apache.org/jira/browse/PHOENIX-5748?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17070198#comment-17070198
 ] 

Hudson commented on PHOENIX-5748:
-

SUCCESS: Integrated in Jenkins build PreCommit-PHOENIX-Build #3678 (See 
[https://builds.apache.org/job/PreCommit-PHOENIX-Build/3678/])
PHOENIX-5748 Simplify index update generation code for consistent global 
(kadir: rev 9dd7d9d8a720c1f98bbe1564f5cfee16b8c5d507)
* (edit) 
phoenix-core/src/main/java/org/apache/phoenix/compile/ServerBuildIndexCompiler.java
* (edit) 
phoenix-core/src/it/java/org/apache/phoenix/end2end/ConcurrentMutationsExtendedIT.java
* (edit) 
phoenix-core/src/main/java/org/apache/phoenix/coprocessor/IndexRebuildRegionScanner.java
* (edit) 
phoenix-core/src/main/java/org/apache/phoenix/coprocessor/UngroupedAggregateRegionObserver.java
* (edit) 
phoenix-core/src/main/java/org/apache/phoenix/hbase/index/IndexRegionObserver.java
* (add) 
phoenix-core/src/test/java/org/apache/phoenix/index/PrepareIndexMutationsForRebuildTest.java
* (edit) 
phoenix-core/src/main/java/org/apache/phoenix/mapreduce/index/PhoenixIndexImportDirectReducer.java
* (edit) 
phoenix-core/src/it/java/org/apache/phoenix/end2end/ConcurrentMutationsIT.java
* (add) 
phoenix-core/src/main/java/org/apache/phoenix/coprocessor/IndexToolVerificationResult.java
* (edit) 
phoenix-core/src/main/java/org/apache/phoenix/index/IndexMaintainer.java
* (edit) 
phoenix-core/src/it/java/org/apache/phoenix/end2end/index/GlobalIndexCheckerIT.java
* (add) 
phoenix-core/src/test/java/org/apache/phoenix/index/VerifySingleIndexRowTest.java
* (edit) phoenix-core/src/it/java/org/apache/phoenix/end2end/IndexToolIT.java


> Simplify index update generation code for consistent global indexes   
> 
>
> Key: PHOENIX-5748
> URL: https://issues.apache.org/jira/browse/PHOENIX-5748
> Project: Phoenix
>  Issue Type: Improvement
>Reporter: Kadir OZDEMIR
>Assignee: Kadir OZDEMIR
>Priority: Major
> Fix For: 5.1.1, 4.14.4, 4.16.0
>
> Attachments: PHOENIX-5748-4.x-HBase-1.5.001.patch, 
> PHOENIX-5748-4.x.001.patch, PHOENIX-5748.master.001.patch
>
>
> The implementation of the new global index design by PHOENIX-5156 essentially 
> introduced two coprocessors, IndexRegionObserver and GlobalIndexChecker. 
> IndexRegionObserver is the counterpart of the existing Indexer coprocessor 
> that the previous global indexing feature uses. It implements the indexing 
> write path. GlobalIndexChecker implements the read verification and read 
> repair that happens on the read path. One of the main objectives of the 
> design behind new global indexing was to leverage as much existing indexing 
> code as possible. This objective has been achieved greatly as the entire 
> index table update generation code implemented by various classes (including 
> PhoenixIndexBuilder, CachedLocalTable, NonTxIndexBuilder, IndexUpdateManager, 
>  LocalTableState, ScannerBuilder, IndexMemStore and PhoenixIndexCodec) is 
> leveraged as it is mainly. This objective has served us well to deliver the 
> new indexing feature quickly. The leveraged code is very complex, over 
> engineered, and inefficient, and is not bug free. It is very hard to 
> maintain. It is time to replace the complex set of classes with something 
> drastically simpler and more efficient for the new design.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (PHOENIX-5802) Connection leaks in UPSERT SELECT/DELETE paths due to MutatingParallelIteratorFactory iterator not being closed

2020-03-28 Thread Hudson (Jira)


[ 
https://issues.apache.org/jira/browse/PHOENIX-5802?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17069392#comment-17069392
 ] 

Hudson commented on PHOENIX-5802:
-

FAILURE: Integrated in Jenkins build PreCommit-PHOENIX-Build #3674 (See 
[https://builds.apache.org/job/PreCommit-PHOENIX-Build/3674/])
PHOENIX-5802: Connection leaks in UPSERT SELECT/DELETE paths due to 
(chinmayskulkarni: rev affa9e889efcc2ad7dac009a0d294b09447d281e)
* (edit) 
phoenix-core/src/main/java/org/apache/phoenix/compile/MutatingParallelIteratorFactory.java
* (edit) phoenix-core/src/it/java/org/apache/phoenix/end2end/UpsertSelectIT.java
* (edit) 
phoenix-core/src/main/java/org/apache/phoenix/compile/UpsertCompiler.java
* (edit) 
phoenix-core/src/main/java/org/apache/phoenix/iterate/BaseResultIterators.java


> Connection leaks in UPSERT SELECT/DELETE paths due to 
> MutatingParallelIteratorFactory iterator not being closed
> ---
>
> Key: PHOENIX-5802
> URL: https://issues.apache.org/jira/browse/PHOENIX-5802
> Project: Phoenix
>  Issue Type: Bug
>Affects Versions: 5.0.0, 4.15.0
>Reporter: Chinmay Kulkarni
>Assignee: Chinmay Kulkarni
>Priority: Major
>  Labels: phoenix-hardening
> Fix For: 5.1.0, 4.16.0
>
> Attachments: PHOENIX-5802-4.x-v1.patch, PHOENIX-5802-4.x-v2.patch
>
>  Time Spent: 3h 10m
>  Remaining Estimate: 0h
>
> During an UPSERT SELECT query or client-side DELETE, we clone the existing 
> Phoenix connection and call 
> [mutate|https://github.com/apache/phoenix/blob/73a86be9b588353457cd2c9de41239211330e7a7/phoenix-core/src/main/java/org/apache/phoenix/compile/MutatingParallelIteratorFactory.java#L59]
>  which eventually calls either 
> [upsertSelect|https://github.com/apache/phoenix/blob/73a86be9b588353457cd2c9de41239211330e7a7/phoenix-core/src/main/java/org/apache/phoenix/compile/UpsertCompiler.java#L178]
>  or 
> [deleteRows|https://github.com/apache/phoenix/blob/73a86be9b588353457cd2c9de41239211330e7a7/phoenix-core/src/main/java/org/apache/phoenix/compile/DeleteCompiler.java#L126].
> When getting iterators, if we encounter any exception, then on calling 
> [close|https://github.com/apache/phoenix/blob/73a86be9b588353457cd2c9de41239211330e7a7/phoenix-core/src/main/java/org/apache/phoenix/iterate/BaseResultIterators.java#L1377],
>  we attempt to cancel any queued work, while [accumulating already-started 
> task 
> futures|https://github.com/apache/phoenix/blob/73a86be9b588353457cd2c9de41239211330e7a7/phoenix-core/src/main/java/org/apache/phoenix/iterate/BaseResultIterators.java#L1453].
>  
>  Later we attempt to block on getting the result (iterator) of 
> already-started tasks and [close each 
> iterator|https://github.com/apache/phoenix/blob/73a86be9b588353457cd2c9de41239211330e7a7/phoenix-core/src/main/java/org/apache/phoenix/iterate/BaseResultIterators.java#L1464-L1465].
> Here however, if any of the upsert-select or client-side delete tasks had 
> thrown an exception _E_, we wouldn't be able to close the underlying iterator 
> (which in-turn would've [closed the cloned 
> connection|https://github.com/apache/phoenix/blob/73a86be9b588353457cd2c9de41239211330e7a7/phoenix-core/src/main/java/org/apache/phoenix/compile/MutatingParallelIteratorFactory.java#L101]).
>  This manifests as [these 
> logs|https://github.com/apache/phoenix/blob/73a86be9b588353457cd2c9de41239211330e7a7/phoenix-core/src/main/java/org/apache/phoenix/iterate/BaseResultIterators.java#L1470]:
> {code:java}
> "Failed to execute task during cancel", 
> {code}
> This is leading to a connection leak. Because we use CQSI to create the 
> Phoenix Connection here, it also gets accounted for during open Phoenix 
> connection throttling, thus leaving the client application with less 
> connections that can be opened.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (PHOENIX-5801) Connection leak when creating a view with a where condition

2020-03-27 Thread Hudson (Jira)


[ 
https://issues.apache.org/jira/browse/PHOENIX-5801?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17069182#comment-17069182
 ] 

Hudson commented on PHOENIX-5801:
-

FAILURE: Integrated in Jenkins build PreCommit-PHOENIX-Build #3670 (See 
[https://builds.apache.org/job/PreCommit-PHOENIX-Build/3670/])
PHOENIX-5801: Connection leak when creating a view with a where 
(chinmayskulkarni: rev 8247029ea8e415d82610c55b9ab3515c3f176ac2)
* (edit) 
phoenix-core/src/it/java/org/apache/phoenix/monitoring/PhoenixMetricsIT.java
* (edit) 
phoenix-core/src/main/java/org/apache/phoenix/coprocessor/WhereConstantParser.java


> Connection leak when creating a view with a where condition
> ---
>
> Key: PHOENIX-5801
> URL: https://issues.apache.org/jira/browse/PHOENIX-5801
> Project: Phoenix
>  Issue Type: Bug
>Affects Versions: 5.0.0, 4.15.0
>Reporter: Chinmay Kulkarni
>Assignee: Chinmay Kulkarni
>Priority: Major
> Fix For: 5.1.0, 4.16.0
>
> Attachments: PHOENIX-5801-4.x-v1.patch, PHOENIX-5801-4.x-v2.patch
>
>  Time Spent: 1h 40m
>  Remaining Estimate: 0h
>
> When you create a view with a where condition, we open a connection-less 
> Phoenix connection, which is never closed. This is a connection leak and also 
> unnecessarily contributes to the GLOBAL_OPEN_PHOENIX_CONNECTIONS metric 
> (which is incremented on opening any PhoenixConnection).



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (PHOENIX-5776) Phoenix pherf unit tests failing

2020-03-26 Thread Hudson (Jira)


[ 
https://issues.apache.org/jira/browse/PHOENIX-5776?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17068268#comment-17068268
 ] 

Hudson commented on PHOENIX-5776:
-

FAILURE: Integrated in Jenkins build PreCommit-PHOENIX-Build #3663 (See 
[https://builds.apache.org/job/PreCommit-PHOENIX-Build/3663/])
PHOENIX-5776 Phoenix pherf unit tests failing (chinmayskulkarni: rev 
d04ba4eb945ba502652888220097ebca44f4a4dd)
* (edit) 
phoenix-pherf/src/main/java/org/apache/phoenix/pherf/util/ResourceList.java


> Phoenix pherf unit tests failing
> 
>
> Key: PHOENIX-5776
> URL: https://issues.apache.org/jira/browse/PHOENIX-5776
> Project: Phoenix
>  Issue Type: Bug
>Affects Versions: 5.1.0, 4.16.0
>Reporter: Sandeep Guggilam
>Assignee: Sandeep Guggilam
>Priority: Major
> Fix For: 5.1.0, 4.16.0
>
> Attachments: PHOENIX-5776.master.v1.patch
>
>
> Phoenix Pherf unit tests ResourceTest and PherfTest are failing with "could 
> not load resources /datamodel/query_more.sql"



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (PHOENIX-5698) Phoenix Query with RVC IN list expression generates wrong scan with non-pk ordered pks

2020-03-25 Thread Hudson (Jira)


[ 
https://issues.apache.org/jira/browse/PHOENIX-5698?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17067268#comment-17067268
 ] 

Hudson commented on PHOENIX-5698:
-

FAILURE: Integrated in Jenkins build PreCommit-PHOENIX-Build #3660 (See 
[https://builds.apache.org/job/PreCommit-PHOENIX-Build/3660/])
PHOENIX-5698 Phoenix Query with RVC IN list expression generates wrong 
(yanxinyi: rev 14a17d8f9b23089bea4c2a910430a73c669bc0fb)
* (edit) phoenix-core/src/main/java/org/apache/phoenix/iterate/ExplainTable.java
* (edit) 
phoenix-core/src/main/java/org/apache/phoenix/expression/InListExpression.java
* (edit) phoenix-core/src/it/java/org/apache/phoenix/end2end/InListIT.java
* (edit) 
phoenix-core/src/test/java/org/apache/phoenix/expression/InListExpressionTest.java


> Phoenix Query with RVC IN list expression generates wrong scan with non-pk 
> ordered pks
> --
>
> Key: PHOENIX-5698
> URL: https://issues.apache.org/jira/browse/PHOENIX-5698
> Project: Phoenix
>  Issue Type: Bug
>Affects Versions: 4.15.0, 4.14.3
>Reporter: Daniel Wong
>Assignee: Xinyi Yan
>Priority: Major
>  Labels: DESC
> Attachments: PHOENIX-5698-4.14-HBase-1.3.patch, 
> PHOENIX-5698-4.x-HBase-1.3.patch, PHOENIX-5698-4.x.patch, 
> PHOENIX-5698-4.x.v3.patch, PHOENIX-5698-4.x.v4.patch, 
> PHOENIX-5698-4.x.v5.patch, PHOENIX-5698-4.x.v6.patch, 
> PHOENIX-5698-master.v2.patch, PHOENIX-5698.patch
>
>  Time Spent: 8h
>  Remaining Estimate: 0h
>
> In the code below ideally we'd expect a SINGLE ROW DELETE plan client side. 
> However, this generates an incorrect scan with range ['tenant1
> 0CY005xx01Sv6o'). If the order of the RVCs is changed to row key order 
> Phoenix correctly generates a SINGLE ROW SCAN.  As we provide the full PK 
> this we expect a either tightly bounded range scan or a client side delete.  
> Instead we get a range scan on composite leading edge 
> TENANT_ID,KEY_PREFIX,ID1.
>  
> {code:java}
> @Test
>  public void testInListExpressionWithDescAgain() throws Exception {
>  String fullTableName = generateUniqueName();
>  String fullViewName = generateUniqueName();
>  String tenantView = generateUniqueName();
>  // create base table and global view using global connection
>  try (Connection conn = DriverManager.getConnection(getUrl()))
> { conn.setAutoCommit(true); Statement stmt = conn.createStatement(); 
> stmt.execute("CREATE TABLE " + fullTableName + "(\n" + " TENANT_ID CHAR(15) 
> NOT NULL,\n" + " KEY_PREFIX CHAR(3) NOT NULL,\n" + " CONSTRAINT PK PRIMARY 
> KEY (\n" + " TENANT_ID," + " KEY_PREFIX" + ")) MULTI_TENANT=TRUE"); 
> stmt.execute("CREATE VIEW " + fullViewName + "(\n" + " ID1 VARCHAR NOT 
> NULL,\n" + " ID2 VARCHAR NOT NULL,\n" + " EVENT_DATE DATE NOT NULL,\n" + " 
> CONSTRAINT PKVIEW PRIMARY KEY\n" + " (\n" + " ID1, ID2 DESC, EVENT_DATE 
> DESC\n" + ")) AS SELECT * FROM " + fullTableName + " WHERE KEY_PREFIX = 
> '0CY'"); }
> // create and use a tenant specific view to write data
>  try (Connection viewConn = DriverManager.getConnection(TENANT_SPECIFIC_URL1) 
> ) {
>  viewConn.setAutoCommit(true); //need autocommit for serverside deletion
>  Statement stmt = viewConn.createStatement();
>  stmt.execute("CREATE VIEW IF NOT EXISTS " + tenantView + " AS SELECT * FROM 
> " + fullViewName );
>  viewConn.createStatement().execute("UPSERT INTO " + tenantView + "(ID1, ID2, 
> EVENT_DATE) VALUES ('005xx01Sv6o', '300', 153245823)");
>  viewConn.createStatement().execute("UPSERT INTO " + tenantView + "(ID1, ID2, 
> EVENT_DATE) VALUES ('005xx01Sv6o', '400', 153245824)");
>  viewConn.createStatement().execute("UPSERT INTO " + tenantView + "(ID1, ID2, 
> EVENT_DATE) VALUES ('005xx01Sv6o', '500', 153245825)");
>  viewConn.commit();
> ResultSet rs = stmt.executeQuery("SELECT ID1, ID2, EVENT_DATE FROM " + 
> tenantView );
>  printResultSet(rs);
> System.out.println("Delete Start");
> rs = stmt.executeQuery("EXPLAIN DELETE FROM " + tenantView + " WHERE (ID1, 
> EVENT_DATE, ID2) IN (('005xx01Sv6o', 153245824, 
> '400'),('005xx01Sv6o', 153245823, '300'))");
>  printResultSet(rs); // THIS SHOULD BE A SINGLE ROW SCAN
> stmt.execute("DELETE FROM " + tenantView + " WHERE (ID1, EVENT_DATE, ID2) IN 
> (('005xx01Sv6o', 153245824, '400'),('005xx01Sv6o', 
> 153245823, '300'))");
>  viewConn.commit();
>  System.out.println("Delete End");
> rs = stmt.executeQuery("SELECT ID1, ID2, EVENT_DATE FROM " + tenantView );
>  printResultSet(rs);
> }
>  }
> private void printResultSet(ResultSet rs) throws SQLException {
>  StringBuilder builder = new StringBuilder();
>  while(rs.next()) {
>  for(int i = 0; i < rs.getMetaData().getColumnCount(); i++) {

[jira] [Commented] (PHOENIX-5797) RVC Offset does not work with tenant views on global indexes

2020-03-25 Thread Hudson (Jira)


[ 
https://issues.apache.org/jira/browse/PHOENIX-5797?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17066596#comment-17066596
 ] 

Hudson commented on PHOENIX-5797:
-

FAILURE: Integrated in Jenkins build PreCommit-PHOENIX-Build #3651 (See 
[https://builds.apache.org/job/PreCommit-PHOENIX-Build/3651/])
PHOENIX-5797 RVC Offset does not work with tenant views on global (yanxinyi: 
rev 61589a903f8c5176ce46e5af0a83729f4f4c90ec)
* (edit) 
phoenix-core/src/main/java/org/apache/phoenix/compile/RVCOffsetCompiler.java
* (edit) 
phoenix-core/src/it/java/org/apache/phoenix/end2end/RowValueConstructorOffsetIT.java


> RVC Offset does not work with tenant views on global indexes
> 
>
> Key: PHOENIX-5797
> URL: https://issues.apache.org/jira/browse/PHOENIX-5797
> Project: Phoenix
>  Issue Type: Bug
>Affects Versions: 4.16.0
>Reporter: Daniel Wong
>Assignee: Daniel Wong
>Priority: Minor
> Attachments: PHOENIX-5797_4.x.patch
>
>
> Found this during use of RVC Offset in Phoenix-4845.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (PHOENIX-5751) Remove redundant IndexUtil#isGlobalIndexCheckEnabled() calls for immutable data tables

2020-03-25 Thread Hudson (Jira)


[ 
https://issues.apache.org/jira/browse/PHOENIX-5751?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17066418#comment-17066418
 ] 

Hudson commented on PHOENIX-5751:
-

FAILURE: Integrated in Jenkins build PreCommit-PHOENIX-Build #3650 (See 
[https://builds.apache.org/job/PreCommit-PHOENIX-Build/3650/])
PHOENIX-5751 Remove redundant IndexUtil#isGlobalIndexCheckEnabled() (achouhan: 
rev 0f9ed7aa13d1d2b195ab1c315265ccebce037b80)
* (edit) 
phoenix-core/src/it/java/org/apache/phoenix/end2end/BasePermissionsIT.java
* (edit) 
phoenix-core/src/main/java/org/apache/phoenix/execute/MutationState.java


> Remove redundant IndexUtil#isGlobalIndexCheckEnabled() calls for immutable 
> data tables
> --
>
> Key: PHOENIX-5751
> URL: https://issues.apache.org/jira/browse/PHOENIX-5751
> Project: Phoenix
>  Issue Type: Improvement
>Affects Versions: 4.15.0, 4.14.3
>Reporter: Swaroopa Kadam
>Assignee: Abhishek Singh Chouhan
>Priority: Major
> Fix For: 5.1.0, 4.16.0
>
> Attachments: PHOENIX-5751-4.14-HBase-1.3.patch, 
> PHOENIX-5751-4.14-HBase-1.3.patch, PHOENIX-5751-master.001.patch, 
> PHOENIX-5751-master.001.patch, PHOENIX-5751-master.patch
>
>
> We don't need to add and check if globalIndexChecker is enabled on data table.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


  1   2   3   4   5   6   7   8   9   10   >