deepakpanda93 commented on issue #8507: URL: https://github.com/apache/hudi/issues/8507#issuecomment-4844584899
This is resolved in Hudi 1.1.0+. Root cause: the error is a static-initializer failure of the shaded HBase HFile class (Could not initialize class org.apache.hudi.org.apache.hadoop.hbase.io.hfile.HFile) when reading metadata-table HFiles, triggered by Hadoop 3.3.4+ (incompatibility with the bundled HBase 2.4.x) — consistent with @jfrylings-twilio's note that Hadoop 3.3.1/3.3.3 work but 3.3.4 doesn't. Fix: Hudi replaced the HBase-based HFile reader/writer with a native implementation (HUDI-7170 [#10241](https://github.com/apache/hudi/pull/10241), HUDI-9012 [#12866](https://github.com/apache/hudi/pull/12866)) and then removed the HBase dependency from the repo entirely in HUDI-9020 ([#12964](https://github.com/apache/hudi/pull/12964)). With HBase gone, the failing shaded class no longer exists. This is present in 1.1.0, 1.1.1, 1.2.0 — but not in 0.14.x or 1.0.x (which is why @MaitreyaManohar still saw it on 1.0.2). The resolution is to upgrade to 1.1.0 or later. If you're stuck on an older release, the interim workaround is to run with Hadoop 3.3.3 (the HBase/Hadoop incompatibility appears at 3.3.4+). Closing as fixed in 1.1.0. If anyone reproduces this on 1.1.0+, please reopen with the Hudi/Hadoop versions and the full stack trace. Thanks all! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
