[jira] [Commented] (HBASE-10244) store mvcc in store files per KV for longer time, discard during compactions based on scanner timeout
[ https://issues.apache.org/jira/browse/HBASE-10244?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13863526#comment-13863526 ] Enis Soztutar commented on HBASE-10244: --- Yes, we are storing mvcc numbers in hfiles, but since the mvcc numbers lifecycle , and a region scanner's lifecycle is bound by the RS lifetime we are just using the lowest mvcc read number of all the open scanners to manage the low watermark. I agree that we can implement a timeout based low watermark tracking. The client-side open scanners will receive the mvcc number. They would have to connect to the next region in an absolute time-bound (like 30 min), otherwise they will fail the scan completely. The RS then can manage a time window for mvcc numbers to expire the mvcc read numbers since any scanner not connecting for the last 30 min will be rejected. store mvcc in store files per KV for longer time, discard during compactions based on scanner timeout - Key: HBASE-10244 URL: https://issues.apache.org/jira/browse/HBASE-10244 Project: HBase Issue Type: Sub-task Components: Compaction, regionserver Reporter: Sergey Shelukhin Priority: Minor -Initially, we can store via KV tag. For perf reasons, it might make sense to make it a first-class member of KV, but that would require HFileV4- -- This message was sent by Atlassian JIRA (v6.1.5#6160)
[jira] [Commented] (HBASE-10244) store mvcc in store files per KV for longer time, discard during compactions based on scanner timeout
[ https://issues.apache.org/jira/browse/HBASE-10244?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13863534#comment-13863534 ] Sergey Shelukhin commented on HBASE-10244: -- that is what the design doc in the parent JIRA says :P store mvcc in store files per KV for longer time, discard during compactions based on scanner timeout - Key: HBASE-10244 URL: https://issues.apache.org/jira/browse/HBASE-10244 Project: HBase Issue Type: Sub-task Components: Compaction, regionserver Reporter: Sergey Shelukhin Priority: Minor -Initially, we can store via KV tag. For perf reasons, it might make sense to make it a first-class member of KV, but that would require HFileV4- -- This message was sent by Atlassian JIRA (v6.1.5#6160)
[jira] [Commented] (HBASE-10244) store mvcc in store files per KV for longer time, discard during compactions based on scanner timeout
[ https://issues.apache.org/jira/browse/HBASE-10244?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13857029#comment-13857029 ] Lars Hofhansl commented on HBASE-10244: --- Came here to say that. The memstoreTS is already stored in the HFiles and removed as soon as possible during a compaction (see HBASE-8166). store mvcc in store files per KV for longer time, discard during compactions based on scanner timeout - Key: HBASE-10244 URL: https://issues.apache.org/jira/browse/HBASE-10244 Project: HBase Issue Type: Sub-task Components: Compaction, regionserver Reporter: Sergey Shelukhin -Initially, we can store via KV tag. For perf reasons, it might make sense to make it a first-class member of KV, but that would require HFileV4- -- This message was sent by Atlassian JIRA (v6.1.5#6160)
