[jira] [Resolved] (HBASE-26625) ExportSnapshot tool failed to copy data files for tables with merge region
[
https://issues.apache.org/jira/browse/HBASE-26625?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Bryan Beaudreault resolved HBASE-26625.
---
Resolution: Fixed
I've merged the backport to branch-2.5 and added the next unreleased 2.5.x
version to fixVersions
> ExportSnapshot tool failed to copy data files for tables with merge region
> --
>
> Key: HBASE-26625
> URL: https://issues.apache.org/jira/browse/HBASE-26625
> Project: HBase
> Issue Type: Bug
>Reporter: Yi Mei
>Assignee: Yi Mei
>Priority: Minor
> Labels: pull-request-available
> Fix For: 2.6.0, 2.5.9, 2.4.10, 3.0.0-alpha-3
>
>
> When export snapshot for a table with merge regions, we found following
> exceptions:
> {code:java}
> 2021-12-24 17:14:41,563 INFO [main] snapshot.ExportSnapshot: Finalize the
> Snapshot Export
> 2021-12-24 17:14:41,589 INFO [main] snapshot.ExportSnapshot: Verify snapshot
> integrity
> 2021-12-24 17:14:41,683 ERROR [main] snapshot.ExportSnapshot: Snapshot export
> failed
> org.apache.hadoop.hbase.snapshot.CorruptedSnapshotException: Missing parent
> hfile for: 043a9fe8aa7c469d8324956a57849db5.8e935527eb39a2cf9bf0f596754b5853
> path=A/a=t42=8e935527eb39a2cf9bf0f596754b5853-043a9fe8aa7c469d8324956a57849db5
> at
> org.apache.hadoop.hbase.snapshot.SnapshotReferenceUtil.concurrentVisitReferencedFiles(SnapshotReferenceUtil.java:232)
> at
> org.apache.hadoop.hbase.snapshot.SnapshotReferenceUtil.concurrentVisitReferencedFiles(SnapshotReferenceUtil.java:195)
> at
> org.apache.hadoop.hbase.snapshot.SnapshotReferenceUtil.verifySnapshot(SnapshotReferenceUtil.java:172)
> at
> org.apache.hadoop.hbase.snapshot.SnapshotReferenceUtil.verifySnapshot(SnapshotReferenceUtil.java:156)
> at
> org.apache.hadoop.hbase.snapshot.ExportSnapshot.verifySnapshot(ExportSnapshot.java:851)
> at
> org.apache.hadoop.hbase.snapshot.ExportSnapshot.doWork(ExportSnapshot.java:1096)
> at
> org.apache.hadoop.hbase.util.AbstractHBaseTool.run(AbstractHBaseTool.java:154)
> at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
> at
> org.apache.hadoop.hbase.util.AbstractHBaseTool.doStaticMain(AbstractHBaseTool.java:280)
> at
> org.apache.hadoop.hbase.snapshot.ExportSnapshot.main(ExportSnapshot.java:1144)
> {code}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
[jira] [Created] (HBASE-28599) RowTooBigException is thrown when duplicate increment RPC call is attempted
Robin Infant A created HBASE-28599: -- Summary: RowTooBigException is thrown when duplicate increment RPC call is attempted Key: HBASE-28599 URL: https://issues.apache.org/jira/browse/HBASE-28599 Project: HBase Issue Type: Bug Components: regionserver Affects Versions: 2.5.8, 2.5.7, 2.5.6, 2.5.5 Reporter: Robin Infant A Attachments: RowTooBig_trace.txt *Issue:* `RowTooBigException` is thrown when a duplicate increment RPC call is attempted. *Expected Behavior:* 1. The initial RPC increment call should time out for some reason. 2. The duplicate RPC call should be converted to a GET request and fetch the result that I am trying to increment. 3. The result should contain only the qualifier that I am attempting to increment. *Actual Behavior:* 1. The initial RPC increment call timed out, which is expected. 2. The duplicate RPC call is converted to a GET request but fails to clone the qualifier into the GET request. 3. Hence, the GET request attempts to retrieve all qualifiers for the given row and columnfamily, resulting in a `RowTooBigException`. *Steps to Reproduce:* 1. Ensure a row with a total value size exceeding `hbase.table.max.rowsize` (default = 1073741824) exists. 2. Nonce property should be enabled `hbase.client.nonces.enabled` which is actually defaulted to true. 3. Attempt to increment a qualifier against the same row. 4. In my case, I am using a postIncrement co-processor which may cause a delay (longer than the RPC timeout property). 5. A duplicate increment call should be triggered, which tries to get the value rather than increment it. 6. The GET request actually tries to retrieve all the qualifiers for the row, resulting in a `RowTooBigException`. *Insights:* Upon further debugging, I found that qualifiers are not cloned into the GET instance due to incorrect usage of [CellScanner.advance|https://github.com/apache/hbase/blob/7ebd4381261fefd78fc2acf258a95184f4147cee/hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HRegion.java#L3833] *Fix Suggestion:* Removing the `!` operation from `while (!CellScanner.advance)` may resolve the issue. Attached Exception Stack Trace for reference. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Resolved] (HBASE-28553) SSLContext not used for Kerberos auth negotiation in rest client
[ https://issues.apache.org/jira/browse/HBASE-28553?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Istvan Toth resolved HBASE-28553. - Resolution: Duplicate Fix included in HBASE-28501 > SSLContext not used for Kerberos auth negotiation in rest client > > > Key: HBASE-28553 > URL: https://issues.apache.org/jira/browse/HBASE-28553 > Project: HBase > Issue Type: Bug > Components: REST >Reporter: Istvan Toth >Assignee: Istvan Toth >Priority: Major > > The included REST client now supports specifying a Trust store for SSL > connections. > However, the configured SSL library is not used when the Kerberos negotation > is performed by the Hadoop library, which uses its own client. > We need to set up the Hadoop auth process to use the same SSLContext. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (HBASE-28598) NPE for writer object access in AsyncFSWAL#closeWriter
Vineet Kumar Maheshwari created HBASE-28598: --- Summary: NPE for writer object access in AsyncFSWAL#closeWriter Key: HBASE-28598 URL: https://issues.apache.org/jira/browse/HBASE-28598 Project: HBase Issue Type: Bug Components: wal Affects Versions: 2.6.0, 2.4.18, 2.5.9 Reporter: Vineet Kumar Maheshwari Observed NPE during execution of some of the UT cases. Exception is happening in AbstractFSWAL#closeWriter when trying to put null writer object in inflightWALClosures map. Need to add null check for writer object in AsyncFSWAL#doShutdown function before its usage. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (HBASE-28597) Support native Cell format for protobuf in REST server and client
Istvan Toth created HBASE-28597: --- Summary: Support native Cell format for protobuf in REST server and client Key: HBASE-28597 URL: https://issues.apache.org/jira/browse/HBASE-28597 Project: HBase Issue Type: Wish Components: REST Reporter: Istvan Toth REST currently uses its own (outdated) CellSetModel format for transferring cells. This is fine for XML and JSON, which are slow anyway and even slower handling byte arrays, and is expected to be used in cases where a simple client code which does not depend on the hbase java libraries is more important than raw performance. However, we perform the same marshalling and unmarshalling when we are using protobuf, which doesn't really add value, but eats up resources. We could add a new encoding for Results which uses the native cell format in protobuf, by simply dumping the binary cell bytestreams into the REST response body. This should save a lot of resources on the server side, and would be either faster, or the same speed on the client. As an additional advantage, the resulting Cells would be of native HBase Cell type instead of the REST Cell type. -- This message was sent by Atlassian Jira (v8.20.10#820010)
