Re: Prepared Statement Performance Improvement

Yes, that'd be great if you submitted a patch on PHOENIX-1711. If you think it's different enough, then feel free to create a new JIRA. Thanks, James On Mon, Jan 29, 2018 at 1:56 PM, Ben Gilbert wrote: > Hi James, > Thanks for the quick reply. No I hadn't tried using the

[jira] [Commented] (PHOENIX-4130) Avoid server retries for mutable indexes

[ https://issues.apache.org/jira/browse/PHOENIX-4130?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16344173#comment-16344173 ] Vincent Poon commented on PHOENIX-4130: --- Thanks [~jamestaylor].  Updated with v5 which * removes

[jira] [Updated] (PHOENIX-4130) Avoid server retries for mutable indexes

[ https://issues.apache.org/jira/browse/PHOENIX-4130?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vincent Poon updated PHOENIX-4130: -- Attachment: PHOENIX-4130.v5.master.patch > Avoid server retries for mutable indexes >

[jira] [Commented] (PHOENIX-4130) Avoid server retries for mutable indexes

[ https://issues.apache.org/jira/browse/PHOENIX-4130?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16344103#comment-16344103 ] ASF GitHub Bot commented on PHOENIX-4130: - Github user JamesRTaylor commented on a diff in the

[GitHub] phoenix pull request #290: PHOENIX-4130 Avoid server retries for mutable ind...

Github user JamesRTaylor commented on a diff in the pull request: https://github.com/apache/phoenix/pull/290#discussion_r164581120 --- Diff: phoenix-core/src/main/java/org/apache/phoenix/optimize/QueryOptimizer.java --- @@ -312,6 +317,16 @@ private static QueryPlan

[jira] [Updated] (PHOENIX-4561) Temporarily disable transactional tests

[ https://issues.apache.org/jira/browse/PHOENIX-4561?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Elser updated PHOENIX-4561: Attachment: PHOENIX-4561.001.patch > Temporarily disable transactional tests >

[GitHub] phoenix pull request #290: PHOENIX-4130 Avoid server retries for mutable ind...

Github user vincentpoon commented on a diff in the pull request: https://github.com/apache/phoenix/pull/290#discussion_r164577121 --- Diff: phoenix-core/src/main/java/org/apache/phoenix/optimize/QueryOptimizer.java --- @@ -312,6 +317,16 @@ private static QueryPlan

[jira] [Commented] (PHOENIX-4130) Avoid server retries for mutable indexes

[ https://issues.apache.org/jira/browse/PHOENIX-4130?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16344077#comment-16344077 ] ASF GitHub Bot commented on PHOENIX-4130: - Github user vincentpoon commented on a diff in the

Re: Prepared Statement Performance Improvement

Hi James, Thanks for the quick reply. No I hadn't tried using the small query hint but I will try that tomorrow. I have taken a look at PHOENIX-1267 and PHOENIX-1711. If the query hint makes a big difference I will look into 1267 but I would really like to remove my hacky PreparedStatementCache

[jira] [Comment Edited] (PHOENIX-4533) Phoenix Query Server should not use SPNEGO principal to proxy user requests

[ https://issues.apache.org/jira/browse/PHOENIX-4533?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16343844#comment-16343844 ] Lev Bronshtein edited comment on PHOENIX-4533 at 1/29/18 7:15 PM: --

[GitHub] phoenix pull request #290: PHOENIX-4130 Avoid server retries for mutable ind...

Github user vincentpoon commented on a diff in the pull request: https://github.com/apache/phoenix/pull/290#discussion_r164537544 --- Diff: phoenix-core/src/main/java/org/apache/phoenix/optimize/QueryOptimizer.java --- @@ -312,6 +317,16 @@ private static QueryPlan

[jira] [Commented] (PHOENIX-4130) Avoid server retries for mutable indexes

[ https://issues.apache.org/jira/browse/PHOENIX-4130?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16343861#comment-16343861 ] ASF GitHub Bot commented on PHOENIX-4130: - Github user vincentpoon commented on a diff in the

[jira] [Commented] (PHOENIX-4533) Phoenix Query Server should not use SPNEGO principal to proxy user requests

[ https://issues.apache.org/jira/browse/PHOENIX-4533?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16343844#comment-16343844 ] Lev Bronshtein commented on PHOENIX-4533: - First par is done, two days later kinit as my user

[jira] [Commented] (PHOENIX-4130) Avoid server retries for mutable indexes

[ https://issues.apache.org/jira/browse/PHOENIX-4130?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16343951#comment-16343951 ] ASF GitHub Bot commented on PHOENIX-4130: - Github user JamesRTaylor commented on a diff in the

[jira] [Commented] (PHOENIX-4482) Fix WALReplayWithIndexWritesAndCompressedWALIT failing with ClassCastException

[ https://issues.apache.org/jira/browse/PHOENIX-4482?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16344205#comment-16344205 ] Josh Elser commented on PHOENIX-4482: - This isn't a straightforward one to address. We will either

[jira] [Created] (PHOENIX-4565) IndexScrutinyToolIT is failing

Josh Elser created PHOENIX-4565: --- Summary: IndexScrutinyToolIT is failing Key: PHOENIX-4565 URL: https://issues.apache.org/jira/browse/PHOENIX-4565 Project: Phoenix Issue Type: Bug

[jira] [Updated] (PHOENIX-4130) Avoid server retries for mutable indexes

[ https://issues.apache.org/jira/browse/PHOENIX-4130?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vincent Poon updated PHOENIX-4130: -- Attachment: PHOENIX-4130.v6.master.patch > Avoid server retries for mutable indexes >

[jira] [Created] (PHOENIX-4564) AVG function always returns BigDecimal

Vladimir Prus created PHOENIX-4564: -- Summary: AVG function always returns BigDecimal Key: PHOENIX-4564 URL: https://issues.apache.org/jira/browse/PHOENIX-4564 Project: Phoenix Issue Type:

Prepared Statement Performance Improvement

While testing locally I have spotted some areas I would like to change for what could be significant performance improvements. One of our use cases is bulk fetching many rows (10_000) by rowkey with 'select x where rowkey in (:ids)' statements. (The ids from an external source). When doing this

[GitHub] phoenix pull request #291: [PHOENIX-4278] Implement pure client side transac...

GitHub user ohadshacham opened a pull request: https://github.com/apache/phoenix/pull/291 [PHOENIX-4278] Implement pure client side transactional index mainten… …ance. Moving the index update from a coprocessor to the client side. This is done only for transactions

[jira] [Commented] (PHOENIX-4278) Implement pure client side transactional index maintenance

[ https://issues.apache.org/jira/browse/PHOENIX-4278?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16343537#comment-16343537 ] ASF GitHub Bot commented on PHOENIX-4278: - GitHub user ohadshacham opened a pull request:

[jira] [Commented] (PHOENIX-4278) Implement pure client side transactional index maintenance

[ https://issues.apache.org/jira/browse/PHOENIX-4278?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16343550#comment-16343550 ] Ohad Shacham commented on PHOENIX-4278: --- As the bot stated, I uploaded a pull request for this

Re: precommit broken

Sorry, haven't been working through my inbox and I left a half-hearted comment on a JIRA at James' ping. My understanding is that the recent JIRA update that infra executed broke our "old" PreCommit by changing some of the API that it was using. Yetus 0.7.0 was just released which was

[jira] [Closed] (PHOENIX-4064) Why the group by the index field will execute scan over table.

[ https://issues.apache.org/jira/browse/PHOENIX-4064?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jifei_yang closed PHOENIX-4064. --- This problem can be avoided in the new version. > Why the group by the index field will execute scan

[jira] [Commented] (PHOENIX-4565) IndexScrutinyToolIT is failing

[ https://issues.apache.org/jira/browse/PHOENIX-4565?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16344232#comment-16344232 ] Vincent Poon commented on PHOENIX-4565: --- I believe this needs PHOENIX-4378 to pass with HBase 2.0.

[jira] [Commented] (PHOENIX-4130) Avoid server retries for mutable indexes

[ https://issues.apache.org/jira/browse/PHOENIX-4130?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16344274#comment-16344274 ] Vincent Poon commented on PHOENIX-4130: --- > if an index is PENDING_DISABLE and elapsedSinceDisable

[jira] [Commented] (PHOENIX-4130) Avoid server retries for mutable indexes

[ https://issues.apache.org/jira/browse/PHOENIX-4130?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16344312#comment-16344312 ] James Taylor commented on PHOENIX-4130: --- I guess there may be a race condition between the client

[jira] [Updated] (PHOENIX-4494) Fix PhoenixTracingEndToEndIT

[ https://issues.apache.org/jira/browse/PHOENIX-4494?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Elser updated PHOENIX-4494: Attachment: PHEONXI-4494.001.patch > Fix PhoenixTracingEndToEndIT >

[jira] [Commented] (PHOENIX-4130) Avoid server retries for mutable indexes

[ https://issues.apache.org/jira/browse/PHOENIX-4130?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16344249#comment-16344249 ] James Taylor commented on PHOENIX-4130: --- For MetaDataRegionObserver, given that an index may enter

[jira] [Closed] (PHOENIX-4284) Phoenix connection is not closed.

[ https://issues.apache.org/jira/browse/PHOENIX-4284?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jifei_yang closed PHOENIX-4284. --- Already have the same problem! > Phoenix connection is not closed. > -

[jira] [Updated] (PHOENIX-4130) Avoid server retries for mutable indexes

[ https://issues.apache.org/jira/browse/PHOENIX-4130?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vincent Poon updated PHOENIX-4130: -- Attachment: (was: PHOENIX-4130.v6.master.patch) > Avoid server retries for mutable

[jira] [Updated] (PHOENIX-4130) Avoid server retries for mutable indexes

[ https://issues.apache.org/jira/browse/PHOENIX-4130?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vincent Poon updated PHOENIX-4130: -- Attachment: PHOENIX-4130.v6.master.patch > Avoid server retries for mutable indexes >

[jira] [Commented] (PHOENIX-4130) Avoid server retries for mutable indexes

[ https://issues.apache.org/jira/browse/PHOENIX-4130?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16344378#comment-16344378 ] Vincent Poon commented on PHOENIX-4130: --- v6 moves the PENDING_DISABLE check in

[jira] [Commented] (PHOENIX-4130) Avoid server retries for mutable indexes

[ https://issues.apache.org/jira/browse/PHOENIX-4130?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16344436#comment-16344436 ] James Taylor commented on PHOENIX-4130: --- Looks good, with one minor nit. Just remove the extra

[jira] [Commented] (PHOENIX-4565) IndexScrutinyToolIT is failing

[ https://issues.apache.org/jira/browse/PHOENIX-4565?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16344437#comment-16344437 ] Josh Elser commented on PHOENIX-4565: - Oh, sweet. Thanks, [~vincentpoon]! I really appreciate the

[jira] [Commented] (PHOENIX-4546) Projected table cannot be read through ProjectedColumnExpression

[ https://issues.apache.org/jira/browse/PHOENIX-4546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16344462#comment-16344462 ] Sergey Soldatov commented on PHOENIX-4546: -- one more: {noformat} [ERROR]

[jira] [Commented] (PHOENIX-4482) Fix WALReplayWithIndexWritesAndCompressedWALIT failing with ClassCastException

[ https://issues.apache.org/jira/browse/PHOENIX-4482?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16344469#comment-16344469 ] Sergey Soldatov commented on PHOENIX-4482: -- We are using FSHLog only to set retry count. So it

[jira] [Commented] (PHOENIX-4546) Projected table cannot be read through ProjectedColumnExpression

[ https://issues.apache.org/jira/browse/PHOENIX-4546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16344454#comment-16344454 ] Sergey Soldatov commented on PHOENIX-4546: -- [~an...@apache.org] I see some failures with patch

[jira] [Assigned] (PHOENIX-1267) Set scan.setSmall(true) when appropriate

[ https://issues.apache.org/jira/browse/PHOENIX-1267?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Taylor reassigned PHOENIX-1267: - Assignee: (was: Chinmay Kulkarni) > Set scan.setSmall(true) when appropriate >

Re: Prepared Statement Performance Improvement

Hi Ben, Have you tried using the SMALL hint in your queries: SELECT /*+ SMALL */ ...? This is reported to improve point lookups quite a bit. FYI, we also have PHOENIX-1267 which would be a good newbie JIRA to implement. I also have a patch over on PHOENIX-1711 that caches the MutationPlan

[jira] [Assigned] (PHOENIX-3079) Run point queries serially if the row count is below a configurable threshold

[ https://issues.apache.org/jira/browse/PHOENIX-3079?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Taylor reassigned PHOENIX-3079: - Assignee: (was: Chinmay Kulkarni) > Run point queries serially if the row count is

[jira] [Reopened] (PHOENIX-1711) Improve performance of CSV loader

[ https://issues.apache.org/jira/browse/PHOENIX-1711?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Taylor reopened PHOENIX-1711: --- > Improve performance of CSV loader > - > >

[jira] [Updated] (PHOENIX-1267) Set scan.setSmall(true) when appropriate

[ https://issues.apache.org/jira/browse/PHOENIX-1267?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Taylor updated PHOENIX-1267: -- Labels: SFDC newbie (was: SFDC) > Set scan.setSmall(true) when appropriate >

Re: [DISCUSS] 5.0.0-beta release before month's end?

Time is running short for that "end of month", but here's some progress. I've been able to run through most of the ITs on a linux box. Yay! * There are known local index issues PHOENIX-4440. I saw LocalIndexIT, LocalIndexSplitMergeIT, and MutableRollbackIT all fail. Are you tracking PHOENIX-4440

[jira] [Comment Edited] (PHOENIX-4565) IndexScrutinyToolIT is failing

[ https://issues.apache.org/jira/browse/PHOENIX-4565?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16344232#comment-16344232 ] Vincent Poon edited comment on PHOENIX-4565 at 1/30/18 12:10 AM: - I

[jira] [Commented] (PHOENIX-4064) Why the group by the index field will execute scan over table.

[ https://issues.apache.org/jira/browse/PHOENIX-4064?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16344336#comment-16344336 ] jifei_yang commented on PHOENIX-4064: - [~jamestaylor] Thanks . > Why the group by the index field

[jira] [Created] (PHOENIX-4566) Add the minimum possible value to start range for not null columns

James Taylor created PHOENIX-4566: - Summary: Add the minimum possible value to start range for not null columns Key: PHOENIX-4566 URL: https://issues.apache.org/jira/browse/PHOENIX-4566 Project:

[jira] [Commented] (PHOENIX-4540) Client side evaluation of group by Expression in projection gives erroneous result

[ https://issues.apache.org/jira/browse/PHOENIX-4540?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16344599#comment-16344599 ] James Taylor commented on PHOENIX-4540: --- So it fails if the GROUP BY contains part of the aliased

[GitHub] phoenix pull request #290: PHOENIX-4130 Avoid server retries for mutable ind...

Github user JamesRTaylor commented on a diff in the pull request: https://github.com/apache/phoenix/pull/290#discussion_r164551154 --- Diff: phoenix-core/src/main/java/org/apache/phoenix/optimize/QueryOptimizer.java --- @@ -312,6 +317,16 @@ private static QueryPlan