[jira] [Commented] (PHOENIX-3853) Local Index - Writes to local index are twice as slow as global and get exponentially slower with PHOENIX-3827_v2 patch

2017-05-23 Thread Mujtaba Chohan (JIRA)
[ https://issues.apache.org/jira/browse/PHOENIX-3853?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16022019#comment-16022019 ] Mujtaba Chohan commented on PHOENIX-3853: - Verified exponential performance degradation with

[jira] [Commented] (PHOENIX-3853) Local Index - Writes to local index are twice as slow as global and get exponentially slower with PHOENIX-3827_v2 patch

2017-05-23 Thread Lars Hofhansl (JIRA)
[ https://issues.apache.org/jira/browse/PHOENIX-3853?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16021933#comment-16021933 ] Lars Hofhansl commented on PHOENIX-3853: Then again... Increment already has this hole anyway :)

[jira] [Commented] (PHOENIX-3853) Local Index - Writes to local index are twice as slow as global and get exponentially slower with PHOENIX-3827_v2 patch

2017-05-23 Thread Lars Hofhansl (JIRA)
[ https://issues.apache.org/jira/browse/PHOENIX-3853?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16021923#comment-16021923 ] Lars Hofhansl commented on PHOENIX-3853: There's always the risk that an internal HBase

[jira] [Commented] (PHOENIX-3853) Local Index - Writes to local index are twice as slow as global and get exponentially slower with PHOENIX-3827_v2 patch

2017-05-23 Thread Mujtaba Chohan (JIRA)
[ https://issues.apache.org/jira/browse/PHOENIX-3853?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16021856#comment-16021856 ] Mujtaba Chohan commented on PHOENIX-3853: - Thanks [~rajeshbabu]. I'll try out

[jira] [Commented] (PHOENIX-3853) Local Index - Writes to local index are twice as slow as global and get exponentially slower with PHOENIX-3827_v2 patch

2017-05-23 Thread James Taylor (JIRA)
[ https://issues.apache.org/jira/browse/PHOENIX-3853?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16021779#comment-16021779 ] James Taylor commented on PHOENIX-3853: --- Nice work, [~rajeshbabu]. I don't think we need the

[jira] [Commented] (PHOENIX-3853) Local Index - Writes to local index are twice as slow as global and get exponentially slower with PHOENIX-3827_v2 patch

2017-05-23 Thread Lars Hofhansl (JIRA)
[ https://issues.apache.org/jira/browse/PHOENIX-3853?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16021777#comment-16021777 ] Lars Hofhansl commented on PHOENIX-3853: Looking at the postPut/postDelete code it actually

[jira] [Commented] (PHOENIX-3853) Local Index - Writes to local index are twice as slow as global and get exponentially slower with PHOENIX-3827_v2 patch

2017-05-23 Thread Rajeshbabu Chintaguntla (JIRA)
[ https://issues.apache.org/jira/browse/PHOENIX-3853?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16021758#comment-16021758 ] Rajeshbabu Chintaguntla commented on PHOENIX-3853: -- [~mujtabachohan] can you try

[jira] [Commented] (PHOENIX-3853) Local Index - Writes to local index are twice as slow as global and get exponentially slower with PHOENIX-3827_v2 patch

2017-05-23 Thread Lars Hofhansl (JIRA)
[ https://issues.apache.org/jira/browse/PHOENIX-3853?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16021757#comment-16021757 ] Lars Hofhansl commented on PHOENIX-3853: [~rajeshbabu] Nice! Theoretically we do not need the

[jira] [Commented] (PHOENIX-3853) Local Index - Writes to local index are twice as slow as global and get exponentially slower with PHOENIX-3827_v2 patch

2017-05-23 Thread Rajeshbabu Chintaguntla (JIRA)
[ https://issues.apache.org/jira/browse/PHOENIX-3853?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16021748#comment-16021748 ] Rajeshbabu Chintaguntla commented on PHOENIX-3853: -- One big thing I have observed is

[jira] [Commented] (PHOENIX-3853) Local Index - Writes to local index are twice as slow as global and get exponentially slower with PHOENIX-3827_v2 patch

2017-05-23 Thread Lars Hofhansl (JIRA)
[ https://issues.apache.org/jira/browse/PHOENIX-3853?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16021740#comment-16021740 ] Lars Hofhansl commented on PHOENIX-3853: [~mujtabachohan], do you have this easily reproducible

[jira] [Commented] (PHOENIX-3853) Local Index - Writes to local index are twice as slow as global and get exponentially slower with PHOENIX-3827_v2 patch

2017-05-23 Thread Lars Hofhansl (JIRA)
[ https://issues.apache.org/jira/browse/PHOENIX-3853?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16021733#comment-16021733 ] Lars Hofhansl commented on PHOENIX-3853: I think the slope of the line is still concerning. Cool

[jira] [Commented] (PHOENIX-3853) Local Index - Writes to local index are twice as slow as global and get exponentially slower with PHOENIX-3827_v2 patch

2017-05-22 Thread James Taylor (JIRA)
[ https://issues.apache.org/jira/browse/PHOENIX-3853?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16020010#comment-16020010 ] James Taylor commented on PHOENIX-3853: --- [~lhofhansl] - see the very nice graph that Mujtaba put

[jira] [Commented] (PHOENIX-3853) Local Index - Writes to local index are twice as slow as global and get exponentially slower with PHOENIX-3827_v2 patch

2017-05-22 Thread Mujtaba Chohan (JIRA)
[ https://issues.apache.org/jira/browse/PHOENIX-3853?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16019927#comment-16019927 ] Mujtaba Chohan commented on PHOENIX-3853: - [~lhofhansl] Only issue remains is the perf.

[jira] [Commented] (PHOENIX-3853) Local Index - Writes to local index are twice as slow as global and get exponentially slower with PHOENIX-3827_v2 patch

2017-05-20 Thread Lars Hofhansl (JIRA)
[ https://issues.apache.org/jira/browse/PHOENIX-3853?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16018687#comment-16018687 ] Lars Hofhansl commented on PHOENIX-3853: Thanks [~jamestaylor] and [~mujtabachohan]. Can we

[jira] [Commented] (PHOENIX-3853) Local Index - Writes to local index are twice as slow as global and get exponentially slower with PHOENIX-3827_v2 patch

2017-05-18 Thread Mujtaba Chohan (JIRA)
[ https://issues.apache.org/jira/browse/PHOENIX-3853?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16016647#comment-16016647 ] Mujtaba Chohan commented on PHOENIX-3853: - Talked offline with [~jamestaylor]. There was no 2x

[jira] [Commented] (PHOENIX-3853) Local Index - Writes to local index are twice as slow as global and get exponentially slower with PHOENIX-3827_v2 patch

2017-05-18 Thread James Taylor (JIRA)
[ https://issues.apache.org/jira/browse/PHOENIX-3853?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16016562#comment-16016562 ] James Taylor commented on PHOENIX-3853: --- [~lhofhansl] - we don't use the thread pool for local

[jira] [Commented] (PHOENIX-3853) Local Index - Writes to local index are twice as slow as global and get exponentially slower with PHOENIX-3827_v2 patch

2017-05-18 Thread Lars Hofhansl (JIRA)
[ https://issues.apache.org/jira/browse/PHOENIX-3853?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16016532#comment-16016532 ] Lars Hofhansl commented on PHOENIX-3853: bq. Here the tests performed in single node Ah yes.

[jira] [Commented] (PHOENIX-3853) Local Index - Writes to local index are twice as slow as global and get exponentially slower with PHOENIX-3827_v2 patch

2017-05-18 Thread Mujtaba Chohan (JIRA)
[ https://issues.apache.org/jira/browse/PHOENIX-3853?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16016468#comment-16016468 ] Mujtaba Chohan commented on PHOENIX-3853: - 2X performance degradation for local immutable index

[jira] [Commented] (PHOENIX-3853) Local Index - Writes to local index are twice as slow as global and get exponentially slower with PHOENIX-3827_v2 patch

2017-05-18 Thread Mujtaba Chohan (JIRA)
[ https://issues.apache.org/jira/browse/PHOENIX-3853?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16016090#comment-16016090 ] Mujtaba Chohan commented on PHOENIX-3853: - [~jamestaylor] After initial tests I'll get numbers

[jira] [Commented] (PHOENIX-3853) Local Index - Writes to local index are twice as slow as global and get exponentially slower with PHOENIX-3827_v2 patch

2017-05-18 Thread James Taylor (JIRA)
[ https://issues.apache.org/jira/browse/PHOENIX-3853?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16015907#comment-16015907 ] James Taylor commented on PHOENIX-3853: --- Might the cause be that the writes are parallelized

[jira] [Commented] (PHOENIX-3853) Local Index - Writes to local index are twice as slow as global and get exponentially slower with PHOENIX-3827_v2 patch

2017-05-18 Thread Rajeshbabu Chintaguntla (JIRA)
[ https://issues.apache.org/jira/browse/PHOENIX-3853?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16015260#comment-16015260 ] Rajeshbabu Chintaguntla commented on PHOENIX-3853: -- [~lhofhansl] Here the tests

[jira] [Commented] (PHOENIX-3853) Local Index - Writes to local index are twice as slow as global and get exponentially slower with PHOENIX-3827_v2 patch

2017-05-18 Thread Lars Hofhansl (JIRA)
[ https://issues.apache.org/jira/browse/PHOENIX-3853?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16015256#comment-16015256 ] Lars Hofhansl commented on PHOENIX-3853: The good part is that LOCAL indexes perform almost

[jira] [Commented] (PHOENIX-3853) Local Index - Writes to local index are twice as slow as global and get exponentially slower with PHOENIX-3827_v2 patch

2017-05-17 Thread Mujtaba Chohan (JIRA)
[ https://issues.apache.org/jira/browse/PHOENIX-3853?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16014642#comment-16014642 ] Mujtaba Chohan commented on PHOENIX-3853: - Performance for *mutable* local index. Again this is

[jira] [Commented] (PHOENIX-3853) Local Index - Writes to local index are twice as slow as global and get exponentially slower with PHOENIX-3827_v2 patch

2017-05-16 Thread James Taylor (JIRA)
[ https://issues.apache.org/jira/browse/PHOENIX-3853?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16013051#comment-16013051 ] James Taylor commented on PHOENIX-3853: --- Let me work up a new patch for PHOENIX-3827. It looks to

[jira] [Commented] (PHOENIX-3853) Local Index - Writes to local index are twice as slow as global and get exponentially slower with PHOENIX-3827_v2 patch

2017-05-15 Thread Lars Hofhansl (JIRA)
[ https://issues.apache.org/jira/browse/PHOENIX-3853?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16011446#comment-16011446 ] Lars Hofhansl commented on PHOENIX-3853: Hmm... So PHOENIX-3827 introduces a new super-linear