[
https://issues.apache.org/jira/browse/HBASE-23705?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17024081#comment-17024081
]
Michael Stack commented on HBASE-23705:
---------------------------------------
On build 2025, these two patches went in and ever after, we have the below test
failures.... The 'periodic dependency bump' does not see to be the cause having
tried reverting it and having the test failures still happen. Let me try this
one:
HBASE-23705 Add CellComparator to HFileContext (#1062) (detail)
HBASE-23069 periodic dependency bump for Sep 2019 (#1082) (detail)
branch-2
Test Result (9 failures / +1)
health checks / yetus jdk8 hadoop3 checks /
org.apache.hadoop.hbase.procedure2.store.region.TestHFileProcedurePrettyPrinter.test
health checks / yetus jdk8 hadoop3 checks /
org.apache.hadoop.hbase.procedure2.store.region.TestRegionProcedureStore.testLoad
health checks / yetus jdk8 hadoop3 checks /
org.apache.hadoop.hbase.procedure2.store.region.TestRegionProcedureStore.testCleanup
health checks / yetus jdk8 hadoop3 checks /
org.apache.hadoop.hbase.procedure2.store.region.TestRegionProcedureStoreCompaction.test
health checks / yetus jdk8 hadoop3 checks /
org.apache.hadoop.hbase.procedure2.store.region.TestRegionProcedureStoreMigration.testMigrateWithUnsupportedProcedures
health checks / yetus jdk8 hadoop3 checks /
org.apache.hadoop.hbase.procedure2.store.region.TestRegionProcedureStoreMigration.test
health checks / yetus jdk8 hadoop3 checks /
org.apache.hadoop.hbase.procedure2.store.region.TestRegionProcedureStoreWALCleaner.test
health checks / yetus jdk8 hadoop3 checks /
org.apache.hadoop.hbase.procedure2.store.region.TestWALProcedurePrettyPrinter.test
health checks / yetus jdk8 hadoop2 checks /
org.apache.hadoop.hbase.snapshot.TestExportSnapshotNoCluster.testSnapshotWithRefsExportFileSystemState
> Add CellComparator to HFileContext
> ----------------------------------
>
> Key: HBASE-23705
> URL: https://issues.apache.org/jira/browse/HBASE-23705
> Project: HBase
> Issue Type: Sub-task
> Components: io
> Reporter: Michael Stack
> Assignee: Michael Stack
> Priority: Major
> Fix For: 3.0.0, 2.3.0
>
>
> The HFileContext is present when reading and writing files. It is populated
> at read time using HFile trailer content and file metadata. At write time, we
> create it up front.
> Interesting is that though CellComparator is written to the HFile trailer,
> and parse of the Trailer creates an HFileInfo which builds the HFileContext
> at read time, the HFileContext does not expose what CellComparator to use
> decoding and seeking. Around the codebase there are various compensations
> made for this lack with decoders that actually have a decoding context (with
> a reference to the hfilecontext), hard-coding use of the default
> CellComparator. StoreFileInfo will use default if not passed a comparator
> (even though we'd just read the trailer and even though it has reference to
> filecontext) and HFile does similar. What CellComparator to use in a given
> context is confused.
> Let me fix this situation removing ambiguity. It will also fix bugs in parent
> issue where UTs are failing because wrong CellComparator is being used.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
