[jira] [Updated] (HBASE-15665) Support using different StoreFileComparators for different CompactionPolicies
[ https://issues.apache.org/jira/browse/HBASE-15665?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dave Latham updated HBASE-15665: Fix Version/s: (was: 1.4.0) > Support using different StoreFileComparators for different CompactionPolicies > - > > Key: HBASE-15665 > URL: https://issues.apache.org/jira/browse/HBASE-15665 > Project: HBase > Issue Type: Sub-task > Components: Compaction >Affects Versions: 2.0.0, 1.3.0, 0.98.19, 1.4.0 >Reporter: Duo Zhang >Assignee: Duo Zhang > Fix For: 2.0.0, 1.3.0, 0.98.19 > > Attachments: HBASE-15665-0.98.patch, HBASE-15665-branch-1.patch, > HBASE-15665.patch > > > Now for DateTieredCompactionPolicy, if we output multiple files when > compaction, we will use the same max sequence id for all the output files(see > HBASE-15389 for more details). So we need to sort the store files by > timestamp if they have the same max sequence id which is different from the > original store file comparator. -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Updated] (HBASE-15665) Support using different StoreFileComparators for different CompactionPolicies
[ https://issues.apache.org/jira/browse/HBASE-15665?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Duo Zhang updated HBASE-15665: -- Resolution: Fixed Hadoop Flags: Reviewed Status: Resolved (was: Patch Available) Pushed to branch-1.3+ and 0.98. Thanks all for reviewing. > Support using different StoreFileComparators for different CompactionPolicies > - > > Key: HBASE-15665 > URL: https://issues.apache.org/jira/browse/HBASE-15665 > Project: HBase > Issue Type: Sub-task > Components: Compaction >Affects Versions: 2.0.0, 1.3.0, 0.98.19, 1.4.0 >Reporter: Duo Zhang >Assignee: Duo Zhang > Fix For: 2.0.0, 1.3.0, 0.98.19, 1.4.0 > > Attachments: HBASE-15665-0.98.patch, HBASE-15665-branch-1.patch, > HBASE-15665.patch > > > Now for DateTieredCompactionPolicy, if we output multiple files when > compaction, we will use the same max sequence id for all the output files(see > HBASE-15389 for more details). So we need to sort the store files by > timestamp if they have the same max sequence id which is different from the > original store file comparator. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HBASE-15665) Support using different StoreFileComparators for different CompactionPolicies
[ https://issues.apache.org/jira/browse/HBASE-15665?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Duo Zhang updated HBASE-15665: -- Attachment: (was: HBASE-15665-branch-1.patch) > Support using different StoreFileComparators for different CompactionPolicies > - > > Key: HBASE-15665 > URL: https://issues.apache.org/jira/browse/HBASE-15665 > Project: HBase > Issue Type: Sub-task > Components: Compaction >Affects Versions: 2.0.0, 1.3.0, 0.98.19, 1.4.0 >Reporter: Duo Zhang >Assignee: Duo Zhang > Fix For: 2.0.0, 1.3.0, 0.98.19, 1.4.0 > > Attachments: HBASE-15665-0.98.patch, HBASE-15665-branch-1.patch, > HBASE-15665.patch > > > Now for DateTieredCompactionPolicy, if we output multiple files when > compaction, we will use the same max sequence id for all the output files(see > HBASE-15389 for more details). So we need to sort the store files by > timestamp if they have the same max sequence id which is different from the > original store file comparator. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HBASE-15665) Support using different StoreFileComparators for different CompactionPolicies
[ https://issues.apache.org/jira/browse/HBASE-15665?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Duo Zhang updated HBASE-15665: -- Attachment: HBASE-15665-branch-1.patch Retry. The negativeForMajor tests is flakey, see HBASE-15634 > Support using different StoreFileComparators for different CompactionPolicies > - > > Key: HBASE-15665 > URL: https://issues.apache.org/jira/browse/HBASE-15665 > Project: HBase > Issue Type: Sub-task > Components: Compaction >Affects Versions: 2.0.0, 1.3.0, 0.98.19, 1.4.0 >Reporter: Duo Zhang >Assignee: Duo Zhang > Fix For: 2.0.0, 1.3.0, 0.98.19, 1.4.0 > > Attachments: HBASE-15665-0.98.patch, HBASE-15665-branch-1.patch, > HBASE-15665.patch > > > Now for DateTieredCompactionPolicy, if we output multiple files when > compaction, we will use the same max sequence id for all the output files(see > HBASE-15389 for more details). So we need to sort the store files by > timestamp if they have the same max sequence id which is different from the > original store file comparator. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HBASE-15665) Support using different StoreFileComparators for different CompactionPolicies
[ https://issues.apache.org/jira/browse/HBASE-15665?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Duo Zhang updated HBASE-15665: -- Attachment: HBASE-15665-branch-1.patch Seems pre commit has ignored our branch-1 patch... Retry > Support using different StoreFileComparators for different CompactionPolicies > - > > Key: HBASE-15665 > URL: https://issues.apache.org/jira/browse/HBASE-15665 > Project: HBase > Issue Type: Sub-task > Components: Compaction >Affects Versions: 2.0.0, 1.3.0, 0.98.19, 1.4.0 >Reporter: Duo Zhang >Assignee: Duo Zhang > Fix For: 2.0.0, 1.3.0, 0.98.19, 1.4.0 > > Attachments: HBASE-15665-0.98.patch, HBASE-15665-branch-1.patch, > HBASE-15665.patch > > > Now for DateTieredCompactionPolicy, if we output multiple files when > compaction, we will use the same max sequence id for all the output files(see > HBASE-15389 for more details). So we need to sort the store files by > timestamp if they have the same max sequence id which is different from the > original store file comparator. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HBASE-15665) Support using different StoreFileComparators for different CompactionPolicies
[ https://issues.apache.org/jira/browse/HBASE-15665?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Duo Zhang updated HBASE-15665: -- Attachment: (was: HBASE-15665-branch-1.patch) > Support using different StoreFileComparators for different CompactionPolicies > - > > Key: HBASE-15665 > URL: https://issues.apache.org/jira/browse/HBASE-15665 > Project: HBase > Issue Type: Sub-task > Components: Compaction >Affects Versions: 2.0.0, 1.3.0, 0.98.19, 1.4.0 >Reporter: Duo Zhang >Assignee: Duo Zhang > Fix For: 2.0.0, 1.3.0, 0.98.19, 1.4.0 > > Attachments: HBASE-15665-0.98.patch, HBASE-15665.patch > > > Now for DateTieredCompactionPolicy, if we output multiple files when > compaction, we will use the same max sequence id for all the output files(see > HBASE-15389 for more details). So we need to sort the store files by > timestamp if they have the same max sequence id which is different from the > original store file comparator. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HBASE-15665) Support using different StoreFileComparators for different CompactionPolicies
[ https://issues.apache.org/jira/browse/HBASE-15665?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Duo Zhang updated HBASE-15665: -- Attachment: HBASE-15665-0.98.patch Patch for 0.98. > Support using different StoreFileComparators for different CompactionPolicies > - > > Key: HBASE-15665 > URL: https://issues.apache.org/jira/browse/HBASE-15665 > Project: HBase > Issue Type: Sub-task > Components: Compaction >Affects Versions: 2.0.0, 1.3.0, 0.98.19, 1.4.0 >Reporter: Duo Zhang >Assignee: Duo Zhang > Fix For: 2.0.0, 1.3.0, 0.98.19, 1.4.0 > > Attachments: HBASE-15665-0.98.patch, HBASE-15665-branch-1.patch, > HBASE-15665.patch > > > Now for DateTieredCompactionPolicy, if we output multiple files when > compaction, we will use the same max sequence id for all the output files(see > HBASE-15389 for more details). So we need to sort the store files by > timestamp if they have the same max sequence id which is different from the > original store file comparator. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HBASE-15665) Support using different StoreFileComparators for different CompactionPolicies
[ https://issues.apache.org/jira/browse/HBASE-15665?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Duo Zhang updated HBASE-15665: -- Attachment: HBASE-15665-branch-1.patch Patch for branch-1. > Support using different StoreFileComparators for different CompactionPolicies > - > > Key: HBASE-15665 > URL: https://issues.apache.org/jira/browse/HBASE-15665 > Project: HBase > Issue Type: Sub-task > Components: Compaction >Affects Versions: 2.0.0, 1.3.0, 0.98.19, 1.4.0 >Reporter: Duo Zhang >Assignee: Duo Zhang > Fix For: 2.0.0, 1.3.0, 0.98.19, 1.4.0 > > Attachments: HBASE-15665-branch-1.patch, HBASE-15665.patch > > > Now for DateTieredCompactionPolicy, if we output multiple files when > compaction, we will use the same max sequence id for all the output files(see > HBASE-15389 for more details). So we need to sort the store files by > timestamp if they have the same max sequence id which is different from the > original store file comparator. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HBASE-15665) Support using different StoreFileComparators for different CompactionPolicies
[ https://issues.apache.org/jira/browse/HBASE-15665?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Duo Zhang updated HBASE-15665: -- Affects Version/s: 1.4.0 0.98.19 1.3.0 2.0.0 Fix Version/s: 1.4.0 0.98.19 1.3.0 2.0.0 > Support using different StoreFileComparators for different CompactionPolicies > - > > Key: HBASE-15665 > URL: https://issues.apache.org/jira/browse/HBASE-15665 > Project: HBase > Issue Type: Sub-task > Components: Compaction >Affects Versions: 2.0.0, 1.3.0, 0.98.19, 1.4.0 >Reporter: Duo Zhang >Assignee: Duo Zhang > Fix For: 2.0.0, 1.3.0, 0.98.19, 1.4.0 > > Attachments: HBASE-15665.patch > > > Now for DateTieredCompactionPolicy, if we output multiple files when > compaction, we will use the same max sequence id for all the output files(see > HBASE-15389 for more details). So we need to sort the store files by > timestamp if they have the same max sequence id which is different from the > original store file comparator. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HBASE-15665) Support using different StoreFileComparators for different CompactionPolicies
[ https://issues.apache.org/jira/browse/HBASE-15665?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Duo Zhang updated HBASE-15665: -- Status: Patch Available (was: Open) > Support using different StoreFileComparators for different CompactionPolicies > - > > Key: HBASE-15665 > URL: https://issues.apache.org/jira/browse/HBASE-15665 > Project: HBase > Issue Type: Sub-task > Components: Compaction >Reporter: Duo Zhang >Assignee: Duo Zhang > Attachments: HBASE-15665.patch > > > Now for DateTieredCompactionPolicy, if we output multiple files when > compaction, we will use the same max sequence id for all the output files(see > HBASE-15389 for more details). So we need to sort the store files by > timestamp if they have the same max sequence id which is different from the > original store file comparator. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HBASE-15665) Support using different StoreFileComparators for different CompactionPolicies
[
https://issues.apache.org/jira/browse/HBASE-15665?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Duo Zhang updated HBASE-15665:
--
Attachment: HBASE-15665.patch
Add a {{getStoreFileComparator}} method to {{StoreFileManager}}.
> Support using different StoreFileComparators for different CompactionPolicies
> -
>
> Key: HBASE-15665
> URL: https://issues.apache.org/jira/browse/HBASE-15665
> Project: HBase
> Issue Type: Sub-task
> Components: Compaction
>Reporter: Duo Zhang
>Assignee: Duo Zhang
> Attachments: HBASE-15665.patch
>
>
> Now for DateTieredCompactionPolicy, if we output multiple files when
> compaction, we will use the same max sequence id for all the output files(see
> HBASE-15389 for more details). So we need to sort the store files by
> timestamp if they have the same max sequence id which is different from the
> original store file comparator.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
