szlta commented on a change in pull request #2613:
URL: https://github.com/apache/iceberg/pull/2613#discussion_r636072594
##########
File path:
mr/src/main/java/org/apache/iceberg/mr/mapreduce/IcebergInputFormat.java
##########
@@ -166,14 +168,32 @@ private static void checkResiduals(CombinedScanTask task)
{
}
private static final class IcebergRecordReader<T> extends RecordReader<Void,
T> {
+
+ private static final String HIVE_VECTORIZED_READER_CLASS =
"org.apache.iceberg.mr.hive.vector.HiveVectorizedReader";
+ private static final DynMethods.StaticMethod
HIVE_VECTORIZED_READER_BUILDER;
+
+ static {
+ if (MetastoreUtil.hive3PresentOnClasspath()) {
+ HIVE_VECTORIZED_READER_BUILDER = DynMethods.builder("reader")
Review comment:
This is the HiveVectorizedReader utility class that belongs to Iceberg
codebase, it is located in iceberg-hive3 module. Vectorization for Hive is only
supported in iceberg-hive3 module, so here in the MR module we need to
dynamically load this class (IcebergInputFormat is reused in iceberg-hive3 too)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
