[jira] [Updated] (PHOENIX-5156) Consistent Mutable Global Indexes for Non-Transactional Tables

2019-03-28 Thread Kadir OZDEMIR (JIRA)


 [ 
https://issues.apache.org/jira/browse/PHOENIX-5156?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Kadir OZDEMIR updated PHOENIX-5156:
---
Attachment: PHOENIX-5156.master.005.patch

> Consistent Mutable Global Indexes for Non-Transactional Tables
> --
>
> Key: PHOENIX-5156
> URL: https://issues.apache.org/jira/browse/PHOENIX-5156
> Project: Phoenix
>  Issue Type: Bug
>Affects Versions: 4.13.0, 4.14.0, 5.0.0, 4.14.1
>Reporter: Kadir OZDEMIR
>Assignee: Kadir OZDEMIR
>Priority: Major
> Attachments: PHOENIX-5156.master.001.patch, 
> PHOENIX-5156.master.002.patch, PHOENIX-5156.master.003.patch, 
> PHOENIX-5156.master.004.patch, PHOENIX-5156.master.005.patch
>
>  Time Spent: 5h 40m
>  Remaining Estimate: 0h
>
> Without transactional tables, the mutable global indexes can get easily out 
> of sync with their data tables in Phoenix. Transactional tables require a 
> separate transaction manager, have some restrictions and performance 
> penalties. This issue is to have consistent mutable global indexes without 
> the need for using transactional tables.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Updated] (PHOENIX-5219) Fix ConcurrentMutationsIT testLockUntilMVCCAdvanced and testRowLockDuringPreBatchMutateWhenIndexed failures on the master branch

2019-03-28 Thread Thomas D'Silva (JIRA)


 [ 
https://issues.apache.org/jira/browse/PHOENIX-5219?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Thomas D'Silva updated PHOENIX-5219:

Description: 
These tests are failing because when we set the timestamp in 
{{Indexer.preBatchMutateWithExceptions}} we call 
{{KeyValueUtil.ensureKeyValues}} on the list of cells and then call 
{{KeyValue.getTimestampOffset}}

Pre 2.0 the cells objects are NoTagsKeyValue (which extend KeyValue). In 2.0 
they are NoTagsByteBufferKeyValue (which doesn't extend KeyValue) so 
{{KeyValueUtil.ensureKeyValues}} returns a new list of objects on which we set 
the timestamp. 
The fix us to use  {{CellUtil.setTimestamp}} to the set the timestamp directly 
on the cell. 

  was:
These tests are failing because when we set the timestamp in 
{{Indexer.preBatchMutateWithExceptions}} we call 
{{KeyValueUtil.ensureKeyValues}} on the list of cells and then call 
{{KeyValue.getTimestampOffset}}

Pre 2.0 the cells objects are NoTagsKeyValue (which extend KeyValue). In 2.0 
they are NoTagsByteBufferKeyValue (which doesn't extend KeyValue) so 
{{KeyValueUtil.ensureKeyValues}} returns a new list of objects on which we set 
the timestamp. 
The fix us to use a method in CellUtil that allows you to the set the timestamp 
directly on the cell


> Fix ConcurrentMutationsIT testLockUntilMVCCAdvanced and 
> testRowLockDuringPreBatchMutateWhenIndexed failures on the master branch
> 
>
> Key: PHOENIX-5219
> URL: https://issues.apache.org/jira/browse/PHOENIX-5219
> Project: Phoenix
>  Issue Type: Test
>Reporter: Thomas D'Silva
>Assignee: Thomas D'Silva
>Priority: Major
> Fix For: 5.1.0
>
> Attachments: PHOENIX-5219.patch
>
>
> These tests are failing because when we set the timestamp in 
> {{Indexer.preBatchMutateWithExceptions}} we call 
> {{KeyValueUtil.ensureKeyValues}} on the list of cells and then call 
> {{KeyValue.getTimestampOffset}}
> Pre 2.0 the cells objects are NoTagsKeyValue (which extend KeyValue). In 2.0 
> they are NoTagsByteBufferKeyValue (which doesn't extend KeyValue) so 
> {{KeyValueUtil.ensureKeyValues}} returns a new list of objects on which we 
> set the timestamp. 
> The fix us to use  {{CellUtil.setTimestamp}} to the set the timestamp 
> directly on the cell. 



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Updated] (PHOENIX-5219) Fix ConcurrentMutationsIT testLockUntilMVCCAdvanced and testRowLockDuringPreBatchMutateWhenIndexed failures on the master branch

2019-03-28 Thread Thomas D'Silva (JIRA)


 [ 
https://issues.apache.org/jira/browse/PHOENIX-5219?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Thomas D'Silva updated PHOENIX-5219:

Description: 
These tests are failing because when we set the timestamp in 
{{Indexer.preBatchMutateWithExceptions}} we call 
{{KeyValueUtil.ensureKeyValues}} on the list of cells and then call 
{{KeyValue.getTimestampOffset}}

Pre 2.0 the cells objects are NoTagsKeyValue (which extend KeyValue). In 2.0 
they are NoTagsByteBufferKeyValue (which doesn't extend KeyValue) so 
{{KeyValueUtil.ensureKeyValues}} returns a new list of objects on which we set 
the timestamp. 
The fix us to use a method in CellUtil that allows you to the set the timestamp 
directly on the cell

> Fix ConcurrentMutationsIT testLockUntilMVCCAdvanced and 
> testRowLockDuringPreBatchMutateWhenIndexed failures on the master branch
> 
>
> Key: PHOENIX-5219
> URL: https://issues.apache.org/jira/browse/PHOENIX-5219
> Project: Phoenix
>  Issue Type: Test
>Reporter: Thomas D'Silva
>Assignee: Thomas D'Silva
>Priority: Major
> Fix For: 5.1.0
>
> Attachments: PHOENIX-5219.patch
>
>
> These tests are failing because when we set the timestamp in 
> {{Indexer.preBatchMutateWithExceptions}} we call 
> {{KeyValueUtil.ensureKeyValues}} on the list of cells and then call 
> {{KeyValue.getTimestampOffset}}
> Pre 2.0 the cells objects are NoTagsKeyValue (which extend KeyValue). In 2.0 
> they are NoTagsByteBufferKeyValue (which doesn't extend KeyValue) so 
> {{KeyValueUtil.ensureKeyValues}} returns a new list of objects on which we 
> set the timestamp. 
> The fix us to use a method in CellUtil that allows you to the set the 
> timestamp directly on the cell



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Updated] (PHOENIX-5219) Fix ConcurrentMutationsIT testLockUntilMVCCAdvanced and testRowLockDuringPreBatchMutateWhenIndexed failures on the master branch

2019-03-28 Thread Thomas D'Silva (JIRA)


 [ 
https://issues.apache.org/jira/browse/PHOENIX-5219?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Thomas D'Silva updated PHOENIX-5219:

Attachment: PHOENIX-5219.patch

> Fix ConcurrentMutationsIT testLockUntilMVCCAdvanced and 
> testRowLockDuringPreBatchMutateWhenIndexed failures on the master branch
> 
>
> Key: PHOENIX-5219
> URL: https://issues.apache.org/jira/browse/PHOENIX-5219
> Project: Phoenix
>  Issue Type: Test
>Reporter: Thomas D'Silva
>Assignee: Thomas D'Silva
>Priority: Major
> Fix For: 5.1.0
>
> Attachments: PHOENIX-5219.patch
>
>




--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Created] (PHOENIX-5219) Fix ConcurrentMutationsIT testLockUntilMVCCAdvanced and testRowLockDuringPreBatchMutateWhenIndexed failures on the master branch

2019-03-28 Thread Thomas D'Silva (JIRA)
Thomas D'Silva created PHOENIX-5219:
---

 Summary: Fix ConcurrentMutationsIT testLockUntilMVCCAdvanced and 
testRowLockDuringPreBatchMutateWhenIndexed failures on the master branch
 Key: PHOENIX-5219
 URL: https://issues.apache.org/jira/browse/PHOENIX-5219
 Project: Phoenix
  Issue Type: Test
Reporter: Thomas D'Silva
Assignee: Thomas D'Silva
 Fix For: 5.1.0






--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Updated] (PHOENIX-5218) When INDEX_FAILURE_HANDLING_REBUILD_PERIOD is set, Phoenix Client can still transition Index from INACTIVE to ACTIVE

2019-03-28 Thread Monani Mihir (JIRA)


 [ 
https://issues.apache.org/jira/browse/PHOENIX-5218?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Monani Mihir updated PHOENIX-5218:
--
Description: 
With PHOENIX-5094, we were handling index transition from INACTIVE to ACTIVE 
state

While debugging test cases failures for PHOENIX-5194 for 
PartialIndexRebuilderIT, two test cases 1) testIndexWriteFailureDisablingIndex 
2) testIndexWriteFailureLeavingIndexActive fails.

For this IT, INDEX_FAILURE_HANDLING_REBUILD_PERIOD is set to 50sec and in above 
mentioned test cases round robin Partial Index rebuilder is being used instead 
of building entire index from INDEX_DISABLE_TIMESTAMP. 

  was:
While debugging test cases failures for PHOENIX-5194 for 
PartialIndexRebuilderIT, two test cases 1) testIndexWriteFailureDisablingIndex 
2) testIndexWriteFailureLeavingIndexActive fails.

For this IT, INDEX_FAILURE_HANDLING_REBUILD_PERIOD is set to 50sec and in above 
mentioned test cases round robin Partial Index rebuilder is being used instead 
of building entire index from INDEX_DISABLE_TIMESTAMP. 


> When INDEX_FAILURE_HANDLING_REBUILD_PERIOD is set, Phoenix Client can still 
> transition Index from INACTIVE to ACTIVE
> 
>
> Key: PHOENIX-5218
> URL: https://issues.apache.org/jira/browse/PHOENIX-5218
> Project: Phoenix
>  Issue Type: Bug
>Affects Versions: 4.15.0, 4.14.1, 5.1.0
>Reporter: Monani Mihir
>Assignee: Monani Mihir
>Priority: Critical
> Attachments: PHOENIX-5218-4.x-HBase-1.3.01.patch
>
>
> With PHOENIX-5094, we were handling index transition from INACTIVE to ACTIVE 
> state
> While debugging test cases failures for PHOENIX-5194 for 
> PartialIndexRebuilderIT, two test cases 1) 
> testIndexWriteFailureDisablingIndex 2) 
> testIndexWriteFailureLeavingIndexActive fails.
> For this IT, INDEX_FAILURE_HANDLING_REBUILD_PERIOD is set to 50sec and in 
> above mentioned test cases round robin Partial Index rebuilder is being used 
> instead of building entire index from INDEX_DISABLE_TIMESTAMP. 



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Updated] (PHOENIX-5218) When INDEX_FAILURE_HANDLING_REBUILD_PERIOD is set, Phoenix Client can still transition Index from INACTIVE to ACTIVE

2019-03-28 Thread Monani Mihir (JIRA)


 [ 
https://issues.apache.org/jira/browse/PHOENIX-5218?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Monani Mihir updated PHOENIX-5218:
--
Issue Type: Bug  (was: Sub-task)
Parent: (was: PHOENIX-5094)

> When INDEX_FAILURE_HANDLING_REBUILD_PERIOD is set, Phoenix Client can still 
> transition Index from INACTIVE to ACTIVE
> 
>
> Key: PHOENIX-5218
> URL: https://issues.apache.org/jira/browse/PHOENIX-5218
> Project: Phoenix
>  Issue Type: Bug
>Affects Versions: 4.15.0, 4.14.1, 5.1.0
>Reporter: Monani Mihir
>Assignee: Monani Mihir
>Priority: Critical
> Attachments: PHOENIX-5218-4.x-HBase-1.3.01.patch
>
>
> While debugging test cases failures for PHOENIX-5194 for 
> PartialIndexRebuilderIT, two test cases 1) 
> testIndexWriteFailureDisablingIndex 2) 
> testIndexWriteFailureLeavingIndexActive fails.
> For this IT, INDEX_FAILURE_HANDLING_REBUILD_PERIOD is set to 50sec and in 
> above mentioned test cases round robin Partial Index rebuilder is being used 
> instead of building entire index from INDEX_DISABLE_TIMESTAMP. 



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Updated] (PHOENIX-5218) When INDEX_FAILURE_HANDLING_REBUILD_PERIOD is set, Phoenix Client can still transition Index from INACTIVE to ACTIVE

2019-03-28 Thread Monani Mihir (JIRA)


 [ 
https://issues.apache.org/jira/browse/PHOENIX-5218?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Monani Mihir updated PHOENIX-5218:
--
Attachment: PHOENIX-5218-4.x-HBase-1.3.01.patch

> When INDEX_FAILURE_HANDLING_REBUILD_PERIOD is set, Phoenix Client can still 
> transition Index from INACTIVE to ACTIVE
> 
>
> Key: PHOENIX-5218
> URL: https://issues.apache.org/jira/browse/PHOENIX-5218
> Project: Phoenix
>  Issue Type: Sub-task
>Affects Versions: 4.15.0, 4.14.1, 5.1.0
>Reporter: Monani Mihir
>Assignee: Monani Mihir
>Priority: Critical
> Attachments: PHOENIX-5218-4.x-HBase-1.3.01.patch
>
>
> While debugging test cases failures for PHOENIX-5194 for 
> PartialIndexRebuilderIT, two test cases 1) 
> testIndexWriteFailureDisablingIndex 2) 
> testIndexWriteFailureLeavingIndexActive fails.
> For this IT, INDEX_FAILURE_HANDLING_REBUILD_PERIOD is set to 50sec and in 
> above mentioned test cases round robin Partial Index rebuilder is being used 
> instead of building entire index from INDEX_DISABLE_TIMESTAMP. 



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Created] (PHOENIX-5218) When INDEX_FAILURE_HANDLING_REBUILD_PERIOD is set, Phoenix Client can still transition Index from INACTIVE to ACTIVE

2019-03-28 Thread Monani Mihir (JIRA)
Monani Mihir created PHOENIX-5218:
-

 Summary: When INDEX_FAILURE_HANDLING_REBUILD_PERIOD is set, 
Phoenix Client can still transition Index from INACTIVE to ACTIVE
 Key: PHOENIX-5218
 URL: https://issues.apache.org/jira/browse/PHOENIX-5218
 Project: Phoenix
  Issue Type: Sub-task
Affects Versions: 4.14.1, 4.15.0, 5.1.0
Reporter: Monani Mihir
Assignee: Monani Mihir


While debugging test cases failures for PHOENIX-5194 for 
PartialIndexRebuilderIT, two test cases 1) testIndexWriteFailureDisablingIndex 
2) testIndexWriteFailureLeavingIndexActive fails.

For this IT, INDEX_FAILURE_HANDLING_REBUILD_PERIOD is set to 50sec and in above 
mentioned test cases round robin Partial Index rebuilder is being used instead 
of building entire index from INDEX_DISABLE_TIMESTAMP. 



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Updated] (PHOENIX-5217) Incorrect result for COUNT DISTINCT ... limit ...

2019-03-28 Thread Chen Feng (JIRA)


 [ 
https://issues.apache.org/jira/browse/PHOENIX-5217?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Chen Feng updated PHOENIX-5217:
---
Description: 
For table t1(pk1, col1, CONSTRAINT(pk1))

upsert into "t1" values (1, 1);
 upsert into "t1" values (2, 2);

sql A: select count("pk1") from "t1" limit 1, return 2 [correct]

sql B: select count(disctinct("pk1")) from "t1" limit 1, return 1 [incorrect]

  was:
For table t1(pk1, col1, CONSTRAINT(pk1))

upsert into "t1" values (1, 1);
 upsert into "t1" values (2, 2);

sql1: select count("pk1") from "t1" limit 1, return 2 [correct]

sql2: select count(disctinct("pk1")) from "t1" limit 1, return 1 [incorrect]


> Incorrect result for COUNT DISTINCT ... limit ...
> -
>
> Key: PHOENIX-5217
> URL: https://issues.apache.org/jira/browse/PHOENIX-5217
> Project: Phoenix
>  Issue Type: Bug
>Affects Versions: 4.14.1
> Environment: 4.14.1: incorrect
> 4.6: correct.
>  
>Reporter: Chen Feng
>Priority: Critical
>
> For table t1(pk1, col1, CONSTRAINT(pk1))
> upsert into "t1" values (1, 1);
>  upsert into "t1" values (2, 2);
> sql A: select count("pk1") from "t1" limit 1, return 2 [correct]
> sql B: select count(disctinct("pk1")) from "t1" limit 1, return 1 [incorrect]



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Updated] (PHOENIX-5217) Incorrect result for COUNT DISTINCT ... limit ...

2019-03-28 Thread Chen Feng (JIRA)


 [ 
https://issues.apache.org/jira/browse/PHOENIX-5217?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Chen Feng updated PHOENIX-5217:
---
Environment: 
4.14.1: incorrect

4.6: correct.

 

  was:
Phoenix 4.14.1 returns the incorrect answer.

Phoenix 4.6 is correct.

No other version is tested.

 


> Incorrect result for COUNT DISTINCT ... limit ...
> -
>
> Key: PHOENIX-5217
> URL: https://issues.apache.org/jira/browse/PHOENIX-5217
> Project: Phoenix
>  Issue Type: Bug
>Affects Versions: 4.14.1
> Environment: 4.14.1: incorrect
> 4.6: correct.
>  
>Reporter: Chen Feng
>Priority: Critical
>
> For table t1(pk1, col1, CONSTRAINT(pk1))
> upsert into "t1" values (1, 1);
>  upsert into "t1" values (2, 2);
> sql1: select count("pk1") from "t1" limit 1, return 2 [correct]
> sql2: select count(disctinct("pk1")) from "t1" limit 1, return 1 [incorrect]



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Created] (PHOENIX-5217) Incorrect result for COUNT DISTINCT ... limit ...

2019-03-28 Thread Chen Feng (JIRA)
Chen Feng created PHOENIX-5217:
--

 Summary: Incorrect result for COUNT DISTINCT ... limit ...
 Key: PHOENIX-5217
 URL: https://issues.apache.org/jira/browse/PHOENIX-5217
 Project: Phoenix
  Issue Type: Bug
Affects Versions: 4.14.1
 Environment: Phoenix 4.14.1 returns the incorrect answer.

Phoenix 4.6 is correct.

No other version is tested.

 
Reporter: Chen Feng


For table t1(pk1, col1, CONSTRAINT(pk1))

upsert into "t1" values (1, 1);
 upsert into "t1" values (2, 2);

sql1: select count("pk1") from "t1" limit 1, return 2 [correct]

sql2: select count(disctinct("pk1")) from "t1" limit 1, return 1 [incorrect]



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)