[jira] [Commented] (HBASE-7845) optimize hfile index key

2013-03-20 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-7845?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13607566#comment-13607566 ] Liang Xie commented on HBASE-7845: -- About HFilePerformanceEvaluation, i ran three times

[jira] [Commented] (HBASE-8163) MemStoreChunkPool: An improvement for JAVA GC when using MSLAB

2013-03-20 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-8163?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13608577#comment-13608577 ] Liang Xie commented on HBASE-8163: -- nice staff, cl~

[jira] [Commented] (HBASE-7845) optimize hfile index key

2013-03-20 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-7845?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13608631#comment-13608631 ] Liang Xie commented on HBASE-7845: -- [~jmspaggi], thanks for your help. I just appended

[jira] [Commented] (HBASE-8143) HBase on Hadoop 2 with local short circuit reads (ssr) causes OOM

2013-03-19 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-8143?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13607260#comment-13607260 ] Liang Xie commented on HBASE-8143: -- if buffer size goes smaller, then the FileChannel's

[jira] [Commented] (HBASE-8143) HBase on Hadoop 2 with local short circuit reads (ssr) causes OOM

2013-03-19 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-8143?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13607273#comment-13607273 ] Liang Xie commented on HBASE-8143: -- btw, indeed there's a comment bug in above jdk7

[jira] [Commented] (HBASE-8143) HBase on Hadoop 2 with local short circuit reads (ssr) causes OOM

2013-03-19 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-8143?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13607314#comment-13607314 ] Liang Xie commented on HBASE-8143: -- yes, you could find the following code in hotspot

[jira] [Commented] (HBASE-8143) HBase on Hadoop 2 with local short circuit reads (ssr) causes OOM

2013-03-18 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-8143?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13605993#comment-13605993 ] Liang Xie commented on HBASE-8143: -- I submitted a trivial patch in HDFS-4530, both i and

[jira] [Commented] (HBASE-8143) HBase on Hadoop 2 with local short circuit reads (ssr) causes OOM

2013-03-18 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-8143?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13606018#comment-13606018 ] Liang Xie commented on HBASE-8143: -- to be honest, i am not sure which one is more

[jira] [Commented] (HBASE-8143) HBase on Hadoop 2 with local short circuit reads (ssr) causes OOM

2013-03-18 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-8143?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13606086#comment-13606086 ] Liang Xie commented on HBASE-8143: -- if you did not set MaxDirectMemorySize option

[jira] [Created] (HBASE-8134) delete qualified tombstones during minor compaction

2013-03-17 Thread Liang Xie (JIRA)
Liang Xie created HBASE-8134: Summary: delete qualified tombstones during minor compaction Key: HBASE-8134 URL: https://issues.apache.org/jira/browse/HBASE-8134 Project: HBase Issue Type:

[jira] [Commented] (HBASE-4811) Support reverse Scan

2013-03-17 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-4811?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13604860#comment-13604860 ] Liang Xie commented on HBASE-4811: -- Here is the perf number from leveldb's site:

[jira] [Commented] (HBASE-4811) Support reverse Scan

2013-03-17 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-4811?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13604880#comment-13604880 ] Liang Xie commented on HBASE-4811: -- seems reverse scan degrades read perf about 30%~40%,

[jira] [Updated] (HBASE-8063) Filter HFiles based on first/last key

2013-03-12 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-8063?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liang Xie updated HBASE-8063: - Attachment: HBASE-8063-v3.txt changed per chunhui's comments Filter HFiles based on

[jira] [Updated] (HBASE-7845) optimize hfile index key

2013-03-12 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-7845?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liang Xie updated HBASE-7845: - Attachment: HBASE-7845-v6.txt v6 tries to support data block encoding scenario:)

[jira] [Commented] (HBASE-7845) optimize hfile index key

2013-03-12 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-7845?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13599955#comment-13599955 ] Liang Xie commented on HBASE-7845: -- and fixed the above style problems per Ted's comments

[jira] [Updated] (HBASE-8063) Filter HFiles based on first/last key

2013-03-12 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-8063?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liang Xie updated HBASE-8063: - Attachment: HBASE-8063-v4.txt The latest v4 patch should address the above style problem:)

[jira] [Updated] (HBASE-8063) Filter HFiles based on first/last key

2013-03-12 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-8063?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liang Xie updated HBASE-8063: - Attachment: (was: HBASE-8063-v4.txt) Filter HFiles based on first/last key

[jira] [Updated] (HBASE-8063) Filter HFiles based on first/last key

2013-03-12 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-8063?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liang Xie updated HBASE-8063: - Attachment: HBASE-8063-v4.txt Filter HFiles based on first/last key

[jira] [Commented] (HBASE-7845) optimize hfile index key

2013-03-12 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-7845?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13600773#comment-13600773 ] Liang Xie commented on HBASE-7845: -- bq. Is -1 no longer returned ? it still returns. -2

[jira] [Commented] (HBASE-8063) Filter HFiles based on first/last key

2013-03-11 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-8063?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13598602#comment-13598602 ] Liang Xie commented on HBASE-8063: -- thanks for confirming:) Filter

[jira] [Updated] (HBASE-8063) Filter HFiles based on first/last key

2013-03-11 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-8063?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liang Xie updated HBASE-8063: - Status: Patch Available (was: Open) Filter HFiles based on first/last key

[jira] [Updated] (HBASE-8063) Filter HFiles based on first/last key

2013-03-11 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-8063?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liang Xie updated HBASE-8063: - Attachment: HBASE-8063.txt let's see QA robot Filter HFiles based on first/last key

[jira] [Commented] (HBASE-8063) Filter HFiles based on first/last key

2013-03-11 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-8063?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13599589#comment-13599589 ] Liang Xie commented on HBASE-8063: -- [~ted_yu], if you change to =, then you have to

[jira] [Commented] (HBASE-8063) Filter HFiles based on first/last key

2013-03-11 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-8063?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13599591#comment-13599591 ] Liang Xie commented on HBASE-8063: -- [~zjushch], the StoreFile#Reader#getComparator()

[jira] [Commented] (HBASE-8063) Filter HFiles based on first/last key

2013-03-11 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-8063?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13599661#comment-13599661 ] Liang Xie commented on HBASE-8063: -- O, seems there's a trouble here, my two thoughts #

[jira] [Updated] (HBASE-8063) Filter HFiles based on first/last key

2013-03-11 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-8063?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liang Xie updated HBASE-8063: - Attachment: HBASE-8063-v2.txt addressed compile error Filter HFiles based on

[jira] [Created] (HBASE-8063) Filter HFiles based on first/last key

2013-03-10 Thread Liang Xie (JIRA)
Liang Xie created HBASE-8063: Summary: Filter HFiles based on first/last key Key: HBASE-8063 URL: https://issues.apache.org/jira/browse/HBASE-8063 Project: HBase Issue Type: Improvement

[jira] [Commented] (HBASE-7845) optimize hfile index key

2013-03-10 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-7845?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13598504#comment-13598504 ] Liang Xie commented on HBASE-7845: -- just a quick update: i'll try to understand data

[jira] [Commented] (HBASE-8063) Filter HFiles based on first/last key

2013-03-10 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-8063?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13598560#comment-13598560 ] Liang Xie commented on HBASE-8063: -- good point. but per my understanding, seems

[jira] [Updated] (HBASE-7845) optimize hfile index key

2013-03-07 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-7845?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liang Xie updated HBASE-7845: - Attachment: HBASE-7845-v4.txt v4 fixed the javadoc warnings, and avoid an unnecessary byte array new.

[jira] [Updated] (HBASE-7845) optimize hfile index key

2013-03-07 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-7845?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liang Xie updated HBASE-7845: - Attachment: HBASE-7845-v5.txt Addressed Ted's comments. 1) rename variable 2) err log and fallback 3)

[jira] [Updated] (HBASE-7845) optimize hfile index key

2013-03-06 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-7845?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liang Xie updated HBASE-7845: - Attachment: HBASE-7845-v3.txt I'd done a workable version on our internal 0.94.3 codebase. Attached v3

[jira] [Commented] (HBASE-7845) optimize hfile index key

2013-03-06 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-7845?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13595445#comment-13595445 ] Liang Xie commented on HBASE-7845: -- Please refer to TestBlocksRead case in v3, it's easy

[jira] [Commented] (HBASE-7845) optimize hfile index key

2013-03-02 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-7845?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13591646#comment-13591646 ] Liang Xie commented on HBASE-7845: -- Diving into the failed cases, it somehow really funny

[jira] [Commented] (HBASE-7845) optimize hfile index key

2013-03-02 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-7845?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13591648#comment-13591648 ] Liang Xie commented on HBASE-7845: -- seem i could not modify the old comments in place...

[jira] [Commented] (HBASE-7845) optimize hfile index key

2013-03-02 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-7845?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13591650#comment-13591650 ] Liang Xie commented on HBASE-7845: -- And, one thing need to note is, it'll have a conflict

[jira] [Commented] (HBASE-7845) optimize hfile index key

2013-03-02 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-7845?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13591655#comment-13591655 ] Liang Xie commented on HBASE-7845: -- yes, you are correct, per my current knowledge

[jira] [Created] (HBASE-7960) cleanup TestDir in TestHalfStoreFileReader

2013-02-27 Thread Liang Xie (JIRA)
Liang Xie created HBASE-7960: Summary: cleanup TestDir in TestHalfStoreFileReader Key: HBASE-7960 URL: https://issues.apache.org/jira/browse/HBASE-7960 Project: HBase Issue Type: Test

[jira] [Updated] (HBASE-7960) cleanup TestDir in TestHalfStoreFileReader

2013-02-27 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-7960?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liang Xie updated HBASE-7960: - Status: Patch Available (was: Open) cleanup TestDir in TestHalfStoreFileReader

[jira] [Updated] (HBASE-7960) cleanup TestDir in TestHalfStoreFileReader

2013-02-27 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-7960?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liang Xie updated HBASE-7960: - Attachment: HBASE-7960.txt cleanup TestDir in TestHalfStoreFileReader

[jira] [Commented] (HBASE-7960) cleanup TestDir in TestHalfStoreFileReader

2013-02-27 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-7960?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13589179#comment-13589179 ] Liang Xie commented on HBASE-7960: -- I'm debugging TestHalfStoreFileReader for another

[jira] [Commented] (HBASE-7960) cleanup TestDir in TestHalfStoreFileReader

2013-02-27 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-7960?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13589217#comment-13589217 ] Liang Xie commented on HBASE-7960: -- probably we should file another issue to checkrepair

[jira] [Updated] (HBASE-7845) optimize hfile index key

2013-02-26 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-7845?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liang Xie updated HBASE-7845: - Attachment: HBASE-7845-v2.txt optimize hfile index key

[jira] [Updated] (HBASE-7845) optimize hfile index key

2013-02-26 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-7845?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liang Xie updated HBASE-7845: - Attachment: (was: HBASE-7845.txt) optimize hfile index key

[jira] [Updated] (HBASE-7845) optimize hfile index key

2013-02-26 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-7845?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liang Xie updated HBASE-7845: - Attachment: (was: HBASE-7845-v2.txt) optimize hfile index key

[jira] [Updated] (HBASE-7845) optimize hfile index key

2013-02-26 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-7845?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liang Xie updated HBASE-7845: - Attachment: HBASE-7845.txt Fixed a findbugs warning optimize hfile index key

[jira] [Commented] (HBASE-7845) optimize hfile index key

2013-02-26 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-7845?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13587031#comment-13587031 ] Liang Xie commented on HBASE-7845: -- Here is a simple test result, loaded data with YCSB:

[jira] [Updated] (HBASE-7845) optimize hfile index key

2013-02-26 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-7845?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liang Xie updated HBASE-7845: - Attachment: HBASE-7845-v2.txt re-upload patch to kick off QA robot optimize hfile

[jira] [Commented] (HBASE-7845) optimize hfile index key

2013-02-26 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-7845?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13587959#comment-13587959 ] Liang Xie commented on HBASE-7845: -- There is no impact on existing read path at all, just

[jira] [Commented] (HBASE-7845) optimize hfile index key

2013-02-26 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-7845?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13588026#comment-13588026 ] Liang Xie commented on HBASE-7845: -- Thanks:) It's just a proto right now, i am looking

[jira] [Updated] (HBASE-7845) optimize hfile index key

2013-02-25 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-7845?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liang Xie updated HBASE-7845: - Summary: optimize hfile index key (was: optimize hfile index size like leveldb's

[jira] [Updated] (HBASE-7845) optimize hfile index key

2013-02-25 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-7845?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liang Xie updated HBASE-7845: - Attachment: HBASE-7845.txt optimize hfile index key

[jira] [Updated] (HBASE-7845) optimize hfile index key

2013-02-25 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-7845?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liang Xie updated HBASE-7845: - Status: Patch Available (was: Open) optimize hfile index key

[jira] [Commented] (HBASE-7495) parallel seek in StoreScanner

2013-02-20 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-7495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13582955#comment-13582955 ] Liang Xie commented on HBASE-7495: -- Sounds a good news, [~lhofhansl] yes, my expected

[jira] [Commented] (HBASE-7495) parallel seek in StoreScanner

2013-02-19 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-7495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13581107#comment-13581107 ] Liang Xie commented on HBASE-7495: -- Thanks for review, [~lhofhansl] i am OK with for

[jira] [Created] (HBASE-7875) introduce a compaction switch in HBase Shell

2013-02-18 Thread Liang Xie (JIRA)
Liang Xie created HBASE-7875: Summary: introduce a compaction switch in HBase Shell Key: HBASE-7875 URL: https://issues.apache.org/jira/browse/HBASE-7875 Project: HBase Issue Type: New Feature

[jira] [Updated] (HBASE-7875) introduce a compaction switch in HBase Shell

2013-02-18 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-7875?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liang Xie updated HBASE-7875: - Attachment: HBASE-7875.txt introduce a compaction switch in HBase Shell

[jira] [Updated] (HBASE-7875) introduce a compaction switch in HBase Shell

2013-02-18 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-7875?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liang Xie updated HBASE-7875: - Status: Patch Available (was: Open) introduce a compaction switch in HBase Shell

[jira] [Commented] (HBASE-7495) parallel seek in StoreScanner

2013-02-18 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-7495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13581011#comment-13581011 ] Liang Xie commented on HBASE-7495: -- [~zjusch], yeh, good idea, i can't agree more. but

[jira] [Commented] (HBASE-7495) parallel seek in StoreScanner

2013-02-18 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-7495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13581013#comment-13581013 ] Liang Xie commented on HBASE-7495: -- Yes, the parallel-seeking feature is disabled by

[jira] [Updated] (HBASE-7845) optimize hfile index size like leveldb's ByteWiseComparatorImpl::FindShortestSeparator() style

2013-02-18 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-7845?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liang Xie updated HBASE-7845: - Assignee: Liang Xie optimize hfile index size like leveldb's

[jira] [Commented] (HBASE-7845) optimize hfile index size like leveldb's ByteWiseComparatorImpl::FindShortestSeparator() style

2013-02-18 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-7845?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13581048#comment-13581048 ] Liang Xie commented on HBASE-7845: -- After a further investigation, i know: 1)For leveldb,

[jira] [Commented] (HBASE-7845) optimize hfile index size like leveldb's ByteWiseComparatorImpl::FindShortestSeparator() style

2013-02-18 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-7845?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13581060#comment-13581060 ] Liang Xie commented on HBASE-7845: -- Hi [~mcorgan], thanks for your comments, i haven't

[jira] [Commented] (HBASE-7495) parallel seek in StoreScanner

2013-02-15 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-7495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13579735#comment-13579735 ] Liang Xie commented on HBASE-7495: -- Here is a test report with different thread num. Test

[jira] [Created] (HBASE-7845) optimize hfile index size like leveldb's ByteWiseComparatorImpl::FindShortestSeparator() style

2013-02-13 Thread Liang Xie (JIRA)
Liang Xie created HBASE-7845: Summary: optimize hfile index size like leveldb's ByteWiseComparatorImpl::FindShortestSeparator() style Key: HBASE-7845 URL: https://issues.apache.org/jira/browse/HBASE-7845

[jira] [Updated] (HBASE-7495) parallel seek in StoreScanner

2013-02-04 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-7495?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liang Xie updated HBASE-7495: - Attachment: HBASE-7495-v11.txt v11 patch integrated into HBase's ExecutorService

[jira] [Updated] (HBASE-7495) parallel seek in StoreScanner

2013-02-04 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-7495?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liang Xie updated HBASE-7495: - Attachment: (was: HBASE-7495-v11.txt) parallel seek in StoreScanner

[jira] [Updated] (HBASE-7495) parallel seek in StoreScanner

2013-02-04 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-7495?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liang Xie updated HBASE-7495: - Attachment: HBASE-7495-v11.txt parallel seek in StoreScanner -

[jira] [Commented] (HBASE-7495) parallel seek in StoreScanner

2013-02-04 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-7495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13570114#comment-13570114 ] Liang Xie commented on HBASE-7495: -- I reran TestHLog with latest v11 patch on my box,

[jira] [Commented] (HBASE-7495) parallel seek in StoreScanner

2013-02-04 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-7495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13570142#comment-13570142 ] Liang Xie commented on HBASE-7495: -- the line which size longer than 100 is old code:

[jira] [Updated] (HBASE-7495) parallel seek in StoreScanner

2013-02-02 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-7495?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liang Xie updated HBASE-7495: - Attachment: HBASE-7495-v10.txt v10 adds a method in RegionServerServices per Ted's comments

[jira] [Updated] (HBASE-7495) parallel seek in StoreScanner

2013-02-02 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-7495?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liang Xie updated HBASE-7495: - Attachment: HBASE-7495-0.94.txt parallel seek in StoreScanner -

[jira] [Commented] (HBASE-7495) parallel seek in StoreScanner

2013-02-02 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-7495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13569482#comment-13569482 ] Liang Xie commented on HBASE-7495: -- [~zjushch], I've uploaded a patch for 0.94, please go

[jira] [Updated] (HBASE-7495) parallel seek in StoreScanner

2013-02-01 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-7495?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liang Xie updated HBASE-7495: - Attachment: HBASE-7495-v8.txt Move executor to HRegionService now in v8 parallel seek

[jira] [Updated] (HBASE-7495) parallel seek in StoreScanner

2013-02-01 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-7495?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liang Xie updated HBASE-7495: - Attachment: (was: HBASE-7495-v8.txt) parallel seek in StoreScanner

[jira] [Updated] (HBASE-7495) parallel seek in StoreScanner

2013-02-01 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-7495?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liang Xie updated HBASE-7495: - Attachment: HBASE-7495-v8.txt parallel seek in StoreScanner -

[jira] [Commented] (HBASE-7495) parallel seek in StoreScanner

2013-02-01 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-7495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13568620#comment-13568620 ] Liang Xie commented on HBASE-7495: -- The failed case seems not related with this patch,

[jira] [Commented] (HBASE-7495) parallel seek in StoreScanner

2013-02-01 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-7495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13568630#comment-13568630 ] Liang Xie commented on HBASE-7495: -- And i want to clarify again: if we have only one

[jira] [Updated] (HBASE-7495) parallel seek in StoreScanner

2013-02-01 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-7495?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liang Xie updated HBASE-7495: - Attachment: HBASE-7495-v9.txt addressed above coments. about thread number, IMHO, it's not very

[jira] [Updated] (HBASE-7495) parallel seek in StoreScanner

2013-01-31 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-7495?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liang Xie updated HBASE-7495: - Attachment: HBASE-7495-v6.txt parallel seek in StoreScanner -

[jira] [Updated] (HBASE-7495) parallel seek in StoreScanner

2013-01-31 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-7495?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liang Xie updated HBASE-7495: - Attachment: (was: HBASE-7495-v6.txt) parallel seek in StoreScanner

[jira] [Updated] (HBASE-7495) parallel seek in StoreScanner

2013-01-31 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-7495?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liang Xie updated HBASE-7495: - Attachment: HBASE-7495-v6.txt parallel seek in StoreScanner -

[jira] [Commented] (HBASE-7495) parallel seek in StoreScanner

2013-01-31 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-7495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13567508#comment-13567508 ] Liang Xie commented on HBASE-7495: -- Uploaded patch v6, move the MVCC setThreadReadPoint

[jira] [Commented] (HBASE-7495) parallel seek in StoreScanner

2013-01-31 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-7495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13567511#comment-13567511 ] Liang Xie commented on HBASE-7495: -- Thanks my colleague [~fenghh] for the MVCC code

[jira] [Commented] (HBASE-7495) parallel seek in StoreScanner

2013-01-31 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-7495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13567539#comment-13567539 ] Liang Xie commented on HBASE-7495: -- [~anoopsamjohn], good point, it's a trash code came

[jira] [Updated] (HBASE-7495) parallel seek in StoreScanner

2013-01-31 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-7495?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liang Xie updated HBASE-7495: - Attachment: HBASE-7495-v6.txt parallel seek in StoreScanner -

[jira] [Updated] (HBASE-7495) parallel seek in StoreScanner

2013-01-31 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-7495?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liang Xie updated HBASE-7495: - Attachment: (was: HBASE-7495-v6.txt) parallel seek in StoreScanner

[jira] [Updated] (HBASE-7495) parallel seek in StoreScanner

2013-01-31 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-7495?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liang Xie updated HBASE-7495: - Attachment: HBASE-7495-v7.txt parallel seek in StoreScanner -

[jira] [Commented] (HBASE-7495) parallel seek in StoreScanner

2013-01-31 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-7495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13568371#comment-13568371 ] Liang Xie commented on HBASE-7495: -- Hi [~yuzhih...@gmail.com], i ran the

[jira] [Updated] (HBASE-7495) parallel seek in StoreScanner

2013-01-30 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-7495?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liang Xie updated HBASE-7495: - Attachment: HBASE-7495-v5.txt parallel seek in StoreScanner -

[jira] [Commented] (HBASE-7495) parallel seek in StoreScanner

2013-01-30 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-7495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13566435#comment-13566435 ] Liang Xie commented on HBASE-7495: -- Attached v5 patch introduced a config key to

[jira] [Updated] (HBASE-7495) parallel seek in StoreScanner

2013-01-29 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-7495?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liang Xie updated HBASE-7495: - Attachment: HBASE-7495-v4.txt parallel seek in StoreScanner -

[jira] [Commented] (HBASE-7495) parallel seek in StoreScanner

2013-01-29 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-7495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13565306#comment-13565306 ] Liang Xie commented on HBASE-7495: -- The previous v4 patch is not right, i've uploaded

[jira] [Updated] (HBASE-7495) parallel seek in StoreScanner

2013-01-28 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-7495?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liang Xie updated HBASE-7495: - Attachment: HBASE-7495-v2.txt parallel seek in StoreScanner -

[jira] [Commented] (HBASE-7495) parallel seek in StoreScanner

2013-01-28 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-7495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13564135#comment-13564135 ] Liang Xie commented on HBASE-7495: -- The latest patch fixed a MVCC related problem

[jira] [Updated] (HBASE-7495) parallel seek in StoreScanner

2013-01-28 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-7495?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liang Xie updated HBASE-7495: - Attachment: HBASE-7495-v3.txt parallel seek in StoreScanner -

[jira] [Updated] (HBASE-7495) parallel seek in StoreScanner

2013-01-28 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-7495?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liang Xie updated HBASE-7495: - Attachment: HBASE-7495-v4.txt parallel seek in StoreScanner -

[jira] [Commented] (HBASE-7495) parallel seek in StoreScanner

2013-01-28 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-7495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13565161#comment-13565161 ] Liang Xie commented on HBASE-7495: -- Thanks [~sershe] for looking into it, attached v4

[jira] [Updated] (HBASE-7495) parallel seek in StoreScanner

2013-01-24 Thread liang xie (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-7495?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liang xie updated HBASE-7495: - Attachment: HBASE-7495.txt parallel seek in StoreScanner -

[jira] [Created] (HBASE-7653) scan CF in parallel

2013-01-24 Thread liang xie (JIRA)
liang xie created HBASE-7653: Summary: scan CF in parallel Key: HBASE-7653 URL: https://issues.apache.org/jira/browse/HBASE-7653 Project: HBase Issue Type: Improvement Components:

<    1   2   3   4   5   6   7   8   >