[jira] [Commented] (HBASE-20188) [TESTING] Performance

2018-07-31 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20188?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16563885#comment-16563885 ] Eshcar Hillel commented on HBASE-20188: --- Hi, [~stack] I noticed you posted some additional

[jira] [Commented] (HBASE-20188) [TESTING] Performance

2018-07-29 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20188?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16561446#comment-16561446 ] stack commented on HBASE-20188: --- Profiling log link:

[jira] [Commented] (HBASE-20188) [TESTING] Performance

2018-06-22 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20188?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16520473#comment-16520473 ] stack commented on HBASE-20188: --- bq. Please note new patch and benchmarks results are available in

[jira] [Commented] (HBASE-20188) [TESTING] Performance

2018-06-22 Thread Duo Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20188?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16520197#comment-16520197 ] Duo Zhang commented on HBASE-20188: --- So what should I do here before releasing 2.1.0? Compare the

[jira] [Commented] (HBASE-20188) [TESTING] Performance

2018-06-18 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20188?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16516256#comment-16516256 ] Eshcar Hillel commented on HBASE-20188: --- Please note new patch and benchmarks results are

[jira] [Commented] (HBASE-20188) [TESTING] Performance

2018-06-09 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20188?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16507045#comment-16507045 ] stack commented on HBASE-20188: --- Update. Have been working on perf in background focused on writes. Writes

[jira] [Commented] (HBASE-20188) [TESTING] Performance

2018-06-09 Thread huaxiang sun (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20188?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16507016#comment-16507016 ] huaxiang sun commented on HBASE-20188: -- A minor issue found by cpu profiling during PE randomWrite

[jira] [Commented] (HBASE-20188) [TESTING] Performance

2018-05-08 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20188?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16467480#comment-16467480 ] stack commented on HBASE-20188: --- Good one [~eshcar] Makes sense. > [TESTING] Performance >

[jira] [Commented] (HBASE-20188) [TESTING] Performance

2018-05-08 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20188?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16467272#comment-16467272 ] Eshcar Hillel commented on HBASE-20188: --- Thanks Anoop (: Meanwhile I have opened HBASE-20542 to

[jira] [Commented] (HBASE-20188) [TESTING] Performance

2018-05-08 Thread Anoop Sam John (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20188?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16467239#comment-16467239 ] Anoop Sam John commented on HBASE-20188: [~eshcar] That is excellent observation. Ya we can

[jira] [Commented] (HBASE-20188) [TESTING] Performance

2018-05-08 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20188?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16467229#comment-16467229 ] Eshcar Hillel commented on HBASE-20188: --- Hi, wanted to share some interesting insights and

[jira] [Commented] (HBASE-20188) [TESTING] Performance

2018-04-23 Thread Sean Busbey (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20188?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16448883#comment-16448883 ] Sean Busbey commented on HBASE-20188: - there's a ton of great discussion included in this jira. Could

[jira] [Commented] (HBASE-20188) [TESTING] Performance

2018-04-20 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20188?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16446069#comment-16446069 ] stack commented on HBASE-20188: --- Patch on HBASE-20411 removes it. > [TESTING] Performance >

[jira] [Commented] (HBASE-20188) [TESTING] Performance

2018-04-20 Thread Anoop Sam John (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20188?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16446063#comment-16446063 ] Anoop Sam John commented on HBASE-20188: See this one Stack {code} public void

[jira] [Commented] (HBASE-20188) [TESTING] Performance

2018-04-20 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20188?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16446041#comment-16446041 ] stack commented on HBASE-20188: --- [~anoop.hbase] There is HBASE-20411 for the Segment lock. Is that what you

[jira] [Commented] (HBASE-20188) [TESTING] Performance

2018-04-20 Thread Anoop Sam John (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20188?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16446035#comment-16446035 ] Anoop Sam John commented on HBASE-20188: We can have sub tasks for write perf issue and read perf

[jira] [Commented] (HBASE-20188) [TESTING] Performance

2018-04-19 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20188?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16444317#comment-16444317 ] stack commented on HBASE-20188: --- Make a subissue [~ram_krish] and [~Apache9]? (Thanks for the great digging

[jira] [Commented] (HBASE-20188) [TESTING] Performance

2018-04-19 Thread Dave Latham (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20188?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16444172#comment-16444172 ] Dave Latham commented on HBASE-20188: - Bravo, [~ram_krish] and [~Apache9]!  Fun to follow along with

[jira] [Commented] (HBASE-20188) [TESTING] Performance

2018-04-19 Thread Duo Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20188?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16443861#comment-16443861 ] Duo Zhang commented on HBASE-20188: --- OK, checked the code again, the condition we use is the size

[jira] [Commented] (HBASE-20188) [TESTING] Performance

2018-04-19 Thread ramkrishna.s.vasudevan (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20188?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16443856#comment-16443856 ] ramkrishna.s.vasudevan commented on HBASE-20188: Exactly. this could happen in other

[jira] [Commented] (HBASE-20188) [TESTING] Performance

2018-04-19 Thread Duo Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20188?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16443854#comment-16443854 ] Duo Zhang commented on HBASE-20188: --- {quote} I did get some more info on the tests. Since my full table

[jira] [Commented] (HBASE-20188) [TESTING] Performance

2018-04-19 Thread ramkrishna.s.vasudevan (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20188?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16443760#comment-16443760 ] ramkrishna.s.vasudevan commented on HBASE-20188: [~Apache9] I did get some more info on

[jira] [Commented] (HBASE-20188) [TESTING] Performance

2018-04-18 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20188?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16443082#comment-16443082 ] stack commented on HBASE-20188: --- For [~ram_krish], on fastpath scheduler vs no fastpath scheduler. I did a

[jira] [Commented] (HBASE-20188) [TESTING] Performance

2018-04-18 Thread Duo Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20188?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16442452#comment-16442452 ] Duo Zhang commented on HBASE-20188: --- {quote} True. As I said give me some time will be back here.

[jira] [Commented] (HBASE-20188) [TESTING] Performance

2018-04-18 Thread ramkrishna.s.vasudevan (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20188?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16442450#comment-16442450 ] ramkrishna.s.vasudevan commented on HBASE-20188: bq.So this is a bug we need to fix, not

[jira] [Commented] (HBASE-20188) [TESTING] Performance

2018-04-18 Thread Duo Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20188?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16442451#comment-16442451 ] Duo Zhang commented on HBASE-20188: --- {quote} For 2.0 comparison between STREAM and PREAD it is 30 secs

[jira] [Commented] (HBASE-20188) [TESTING] Performance

2018-04-18 Thread Duo Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20188?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16442447#comment-16442447 ] Duo Zhang commented on HBASE-20188: --- And what I want to say is, by design the switch will not impact

[jira] [Commented] (HBASE-20188) [TESTING] Performance

2018-04-18 Thread Duo Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20188?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16442446#comment-16442446 ] Duo Zhang commented on HBASE-20188: --- {quote} For 2.0 comparison between STREAM and PREAD it is 30 secs

[jira] [Commented] (HBASE-20188) [TESTING] Performance

2018-04-18 Thread ramkrishna.s.vasudevan (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20188?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16442439#comment-16442439 ] ramkrishna.s.vasudevan commented on HBASE-20188: I am not before system now.  For 2.0

[jira] [Commented] (HBASE-20188) [TESTING] Performance

2018-04-18 Thread Duo Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20188?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16442420#comment-16442420 ] Duo Zhang commented on HBASE-20188: --- And in HBASE-17917, the result shows that the performance is the

[jira] [Commented] (HBASE-20188) [TESTING] Performance

2018-04-18 Thread Duo Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20188?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16442407#comment-16442407 ] Duo Zhang commented on HBASE-20188: --- {quote} But one thing is sure that this pread / stream change

[jira] [Commented] (HBASE-20188) [TESTING] Performance

2018-04-18 Thread ramkrishna.s.vasudevan (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20188?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16442258#comment-16442258 ] ramkrishna.s.vasudevan commented on HBASE-20188: I did that setMaxResultSize(2MB). It did

[jira] [Commented] (HBASE-20188) [TESTING] Performance

2018-04-18 Thread Duo Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20188?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16442226#comment-16442226 ] Duo Zhang commented on HBASE-20188: --- {quote} In this case there is no offheap cache. It is just simple

[jira] [Commented] (HBASE-20188) [TESTING] Performance

2018-04-18 Thread ramkrishna.s.vasudevan (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20188?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16442213#comment-16442213 ] ramkrishna.s.vasudevan commented on HBASE-20188: In this case there is no offheap cache.

[jira] [Commented] (HBASE-20188) [TESTING] Performance

2018-04-18 Thread Duo Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20188?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16442206#comment-16442206 ] Duo Zhang commented on HBASE-20188: --- One possible reason for the slow down I can imagine is that, since

[jira] [Commented] (HBASE-20188) [TESTING] Performance

2018-04-18 Thread Duo Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20188?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16442189#comment-16442189 ] Duo Zhang commented on HBASE-20188: --- {quote} A simple full table scan with 10G data takes 97 to

[jira] [Commented] (HBASE-20188) [TESTING] Performance

2018-04-18 Thread ramkrishna.s.vasudevan (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20188?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16442184#comment-16442184 ] ramkrishna.s.vasudevan commented on HBASE-20188: Just noting down based on offline

[jira] [Commented] (HBASE-20188) [TESTING] Performance

2018-04-18 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20188?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16442031#comment-16442031 ] stack commented on HBASE-20188: --- I added a few graphs of flush time by size up on

[jira] [Commented] (HBASE-20188) [TESTING] Performance

2018-04-18 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20188?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16441995#comment-16441995 ] stack commented on HBASE-20188: --- [~anoop.hbase] Then I should be able to see the 'slower flushing' by

[jira] [Commented] (HBASE-20188) [TESTING] Performance

2018-04-18 Thread Anoop Sam John (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20188?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16441981#comment-16441981 ] Anoop Sam John commented on HBASE-20188: This flush change is visible in 2.0.0 not only

[jira] [Commented] (HBASE-20188) [TESTING] Performance

2018-04-18 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20188?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16441945#comment-16441945 ] stack commented on HBASE-20188: --- Report comparing flush histories of 1.2.7 vs 2.0.0 with client batching

[jira] [Commented] (HBASE-20188) [TESTING] Performance

2018-04-17 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20188?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16441683#comment-16441683 ] stack commented on HBASE-20188: --- I tried enabling YCSB clientSideBuffering, see

[jira] [Commented] (HBASE-20188) [TESTING] Performance

2018-04-17 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20188?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16441396#comment-16441396 ] stack commented on HBASE-20188: --- I added another sheet to the report (Truncate 04/17). It provides detail

[jira] [Commented] (HBASE-20188) [TESTING] Performance

2018-04-17 Thread Anoop Sam John (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20188?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16440606#comment-16440606 ] Anoop Sam John commented on HBASE-20188: PE command hbase

[jira] [Commented] (HBASE-20188) [TESTING] Performance

2018-04-17 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20188?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16440582#comment-16440582 ] Eshcar Hillel commented on HBASE-20188: --- [~anoop.hbase] can you share the exact command line you

[jira] [Commented] (HBASE-20188) [TESTING] Performance

2018-04-17 Thread Anoop Sam John (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20188?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16440561#comment-16440561 ] Anoop Sam John commented on HBASE-20188: With PE (batched writes) , 2.0.0 write only case is way

[jira] [Commented] (HBASE-20188) [TESTING] Performance

2018-04-17 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20188?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16440550#comment-16440550 ] stack commented on HBASE-20188: --- Chatting with [~ram_krish] and [~anoop.hbase] they remind me that I need

[jira] [Commented] (HBASE-20188) [TESTING] Performance

2018-04-17 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20188?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16440510#comment-16440510 ] stack commented on HBASE-20188: --- Been distracted (HBASE-20411 and it seems like we do more allocation in

[jira] [Commented] (HBASE-20188) [TESTING] Performance

2018-04-14 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20188?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16438530#comment-16438530 ] stack commented on HBASE-20188: --- In my YCSB runs, comparing 1.2.7 to 2.0.0 loads, I see that we carry more

[jira] [Commented] (HBASE-20188) [TESTING] Performance

2018-04-13 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20188?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16437794#comment-16437794 ] Eshcar Hillel commented on HBASE-20188: --- [~anoop.hbase] can you post the command line or script +

[jira] [Commented] (HBASE-20188) [TESTING] Performance

2018-04-12 Thread Anoop Sam John (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20188?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16435998#comment-16435998 ] Anoop Sam John commented on HBASE-20188: I tried to test the write perf using PE RandomWrite

[jira] [Commented] (HBASE-20188) [TESTING] Performance

2018-04-12 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20188?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16435236#comment-16435236 ] Eshcar Hillel commented on HBASE-20188: --- We also ran the same experiments in HDD machines and

[jira] [Commented] (HBASE-20188) [TESTING] Performance

2018-04-11 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20188?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16434384#comment-16434384 ] Eshcar Hillel commented on HBASE-20188: --- vq. I should add workloadx to the suite of tests I'm

[jira] [Commented] (HBASE-20188) [TESTING] Performance

2018-04-11 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20188?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16434227#comment-16434227 ] stack commented on HBASE-20188: --- [~eshcar] I should add workloadx to the suite of tests I'm trying? If

[jira] [Commented] (HBASE-20188) [TESTING] Performance

2018-04-11 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20188?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16433710#comment-16433710 ] Eshcar Hillel commented on HBASE-20188: --- And another thing, might be just a distraction but we

[jira] [Commented] (HBASE-20188) [TESTING] Performance

2018-04-11 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20188?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16433704#comment-16433704 ] Eshcar Hillel commented on HBASE-20188: --- re-attaching [^workloadx] from the most recent experiment

[jira] [Commented] (HBASE-20188) [TESTING] Performance

2018-04-11 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20188?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16433700#comment-16433700 ] Eshcar Hillel commented on HBASE-20188: --- Just to summarize the results again -- We see that in

[jira] [Commented] (HBASE-20188) [TESTING] Performance

2018-04-11 Thread ramkrishna.s.vasudevan (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20188?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16433458#comment-16433458 ] ramkrishna.s.vasudevan commented on HBASE-20188: bq.If it is a long scan then we will

[jira] [Commented] (HBASE-20188) [TESTING] Performance

2018-04-11 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20188?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16433452#comment-16433452 ] stack commented on HBASE-20188: --- I see this transition happening in tests, from pread to streaming. >

[jira] [Commented] (HBASE-20188) [TESTING] Performance

2018-04-10 Thread Duo Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20188?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16433379#comment-16433379 ] Duo Zhang commented on HBASE-20188: --- {quote} Scans in 2.0 are slower because scans are also like preads

[jira] [Commented] (HBASE-20188) [TESTING] Performance

2018-04-10 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20188?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16432783#comment-16432783 ] Eshcar Hillel commented on HBASE-20188: --- Attaching additional benchmark results where we update and

[jira] [Commented] (HBASE-20188) [TESTING] Performance

2018-04-09 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20188?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16431148#comment-16431148 ] Eshcar Hillel commented on HBASE-20188: --- I attached the results of some additional experiments we

[jira] [Commented] (HBASE-20188) [TESTING] Performance

2018-04-05 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20188?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16427119#comment-16427119 ] stack commented on HBASE-20188: --- bq. The latest results with 8G cache are also with short circuit reads ON?

[jira] [Commented] (HBASE-20188) [TESTING] Performance

2018-04-05 Thread Anastasia Braginsky (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20188?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16426793#comment-16426793 ] Anastasia Braginsky commented on HBASE-20188: - [~stack], what tool do you use in order to

[jira] [Commented] (HBASE-20188) [TESTING] Performance

2018-04-05 Thread Edward Bortnikov (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20188?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16426569#comment-16426569 ] Edward Bortnikov commented on HBASE-20188: -- Michael, thanks for all the diligence, apparently

[jira] [Commented] (HBASE-20188) [TESTING] Performance

2018-04-04 Thread ramkrishna.s.vasudevan (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20188?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16426488#comment-16426488 ] ramkrishna.s.vasudevan commented on HBASE-20188: The latest results with 8G cache are

[jira] [Commented] (HBASE-20188) [TESTING] Performance

2018-04-04 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20188?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16426469#comment-16426469 ] stack commented on HBASE-20188: --- Added a 5th sheet to our doc. I ran compare of 1.2.7 to 2.0.0 and 2.0.0

[jira] [Commented] (HBASE-20188) [TESTING] Performance

2018-04-04 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20188?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16426262#comment-16426262 ] stack commented on HBASE-20188: --- [~eshcar] I tried it here and seems to run. I don't get your complaint.

[jira] [Commented] (HBASE-20188) [TESTING] Performance

2018-04-04 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20188?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16426168#comment-16426168 ] Eshcar Hillel commented on HBASE-20188: --- I am running hbase12 client This is the code of the client

[jira] [Commented] (HBASE-20188) [TESTING] Performance

2018-04-04 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20188?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16426154#comment-16426154 ] stack commented on HBASE-20188: --- Try hbase12 client instead of hbase10 [~eshcar]? > [TESTING] Performance

[jira] [Commented] (HBASE-20188) [TESTING] Performance

2018-04-04 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20188?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16426134#comment-16426134 ] Eshcar Hillel commented on HBASE-20188: --- This is the code that initiates {{bufferedMutator}} in

[jira] [Commented] (HBASE-20188) [TESTING] Performance

2018-04-04 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20188?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16426130#comment-16426130 ] Eshcar Hillel commented on HBASE-20188: --- I am trying to write a new workload that applies client

[jira] [Commented] (HBASE-20188) [TESTING] Performance

2018-04-04 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20188?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16425880#comment-16425880 ] stack commented on HBASE-20188: --- [~ebortnik] Thanks for the question. I fixed the description. It uses the

[jira] [Commented] (HBASE-20188) [TESTING] Performance

2018-04-04 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20188?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16425868#comment-16425868 ] stack commented on HBASE-20188: --- [~ram_krish] dfs.client.read.shortcircuit.skip.checksum helps. Let me try

[jira] [Commented] (HBASE-20188) [TESTING] Performance

2018-04-04 Thread Edward Bortnikov (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20188?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16425861#comment-16425861 ] Edward Bortnikov commented on HBASE-20188: -- [~stack] just making sure we're on the same page ..

[jira] [Commented] (HBASE-20188) [TESTING] Performance

2018-04-04 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20188?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16425818#comment-16425818 ] stack commented on HBASE-20188: --- [~anastas] bq. If you are running again can you please also add to this

[jira] [Commented] (HBASE-20188) [TESTING] Performance

2018-04-04 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20188?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16425806#comment-16425806 ] stack commented on HBASE-20188: --- I attached my hbase-site.xml, the script I'm using to drive YCSB (See

[jira] [Commented] (HBASE-20188) [TESTING] Performance

2018-04-04 Thread Edward Bortnikov (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20188?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16425804#comment-16425804 ] Edward Bortnikov commented on HBASE-20188: -- [~eshcar] could you please post your YCSB 100%W

[jira] [Commented] (HBASE-20188) [TESTING] Performance

2018-04-04 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20188?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16425792#comment-16425792 ] stack commented on HBASE-20188: --- [~anastas] and [~eshcar] I tried 0.02. I put the numbers up on the third

[jira] [Commented] (HBASE-20188) [TESTING] Performance

2018-04-04 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20188?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16425146#comment-16425146 ] Eshcar Hillel commented on HBASE-20188: --- bq. can you please share how can we switch on

[jira] [Commented] (HBASE-20188) [TESTING] Performance

2018-04-04 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20188?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16425142#comment-16425142 ] Eshcar Hillel commented on HBASE-20188: --- {quote}Did you use hbase defaults or did you change

[jira] [Commented] (HBASE-20188) [TESTING] Performance

2018-04-04 Thread Anastasia Braginsky (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20188?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16425138#comment-16425138 ] Anastasia Braginsky commented on HBASE-20188: - Thanks [~stack]! If you are running again can

[jira] [Commented] (HBASE-20188) [TESTING] Performance

2018-04-04 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20188?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16425130#comment-16425130 ] stack commented on HBASE-20188: --- Let me try a run with 0.02 then [~anastas]. If good, will open issue to

[jira] [Commented] (HBASE-20188) [TESTING] Performance

2018-04-04 Thread Anastasia Braginsky (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20188?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16425123#comment-16425123 ] Anastasia Braginsky commented on HBASE-20188: - [~stack], Great to hear that you found the

[jira] [Commented] (HBASE-20188) [TESTING] Performance

2018-04-04 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20188?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16425075#comment-16425075 ] stack commented on HBASE-20188: --- [~eshcar] Did you use hbase defaults or did you change segment count or

[jira] [Commented] (HBASE-20188) [TESTING] Performance

2018-04-04 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20188?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16425066#comment-16425066 ] stack commented on HBASE-20188: --- I added a third sheet name "Short Circuit Reads 25M Run" at [1] with

[jira] [Commented] (HBASE-20188) [TESTING] Performance

2018-04-03 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20188?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16425019#comment-16425019 ] stack commented on HBASE-20188: --- [~ram_krish] Setting this on the client-side dfs.domain.socket.path

[jira] [Commented] (HBASE-20188) [TESTING] Performance

2018-04-03 Thread ramkrishna.s.vasudevan (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20188?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16424993#comment-16424993 ] ramkrishna.s.vasudevan commented on HBASE-20188: What was the config that was missing for

[jira] [Commented] (HBASE-20188) [TESTING] Performance

2018-04-03 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20188?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16424894#comment-16424894 ] stack commented on HBASE-20188: --- Fixing short-circuit reads config made a big difference to hbase2 read

[jira] [Commented] (HBASE-20188) [TESTING] Performance

2018-04-03 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20188?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16424884#comment-16424884 ] stack commented on HBASE-20188: --- Fixing short-circuit reads config made a big difference to hbase2 read

[jira] [Commented] (HBASE-20188) [TESTING] Performance

2018-04-03 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20188?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16424632#comment-16424632 ] stack commented on HBASE-20188: --- Thanks [~eshcar]. Short-circuit reads were not enabled properly for the

[jira] [Commented] (HBASE-20188) [TESTING] Performance

2018-04-03 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20188?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16424604#comment-16424604 ] Eshcar Hillel commented on HBASE-20188: --- Attached are the results of evaluations over *SSD*

[jira] [Commented] (HBASE-20188) [TESTING] Performance

2018-04-03 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20188?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16424243#comment-16424243 ] stack commented on HBASE-20188: --- Thanks [~ram_krish] It helps to have independent observation. I'm doing

[jira] [Commented] (HBASE-20188) [TESTING] Performance

2018-04-03 Thread ramkrishna.s.vasudevan (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20188?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16423788#comment-16423788 ] ramkrishna.s.vasudevan commented on HBASE-20188: The previous results were not apple to

[jira] [Commented] (HBASE-20188) [TESTING] Performance

2018-04-03 Thread ramkrishna.s.vasudevan (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20188?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16423585#comment-16423585 ] ramkrishna.s.vasudevan commented on HBASE-20188: I just reran the experiment with loading

[jira] [Commented] (HBASE-20188) [TESTING] Performance

2018-04-03 Thread ramkrishna.s.vasudevan (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20188?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16423581#comment-16423581 ] ramkrishna.s.vasudevan commented on HBASE-20188: bq.None really. Tried with data cached

[jira] [Commented] (HBASE-20188) [TESTING] Performance

2018-04-02 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20188?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16423307#comment-16423307 ] stack commented on HBASE-20188: --- Thanks for taking a look [~huaxiang] Be aware that the 9.1 is the

[jira] [Commented] (HBASE-20188) [TESTING] Performance

2018-04-02 Thread huaxiang sun (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20188?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16423279#comment-16423279 ] huaxiang sun commented on HBASE-20188: -- Hi [~stack], I was looking at tree.txt. The following

[jira] [Commented] (HBASE-20188) [TESTING] Performance

2018-04-02 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20188?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16423224#comment-16423224 ] stack commented on HBASE-20188: --- I tried enabling FSHLog, the old WAL writer, in place of AsyncFSWAL. The

[jira] [Commented] (HBASE-20188) [TESTING] Performance

2018-04-02 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20188?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16422735#comment-16422735 ] stack commented on HBASE-20188: --- bq. Any news with the directions you suggested Stack? None really. Tried

  1   2   >