liubo1022126 removed a comment on pull request #2614: URL: https://github.com/apache/iceberg/pull/2614#issuecomment-845008728
@pvary : Yes, it only reset `hive.io.file.readNestedColumn.paths` from class variable [conf](https://github.com/apache/hive/blob/branch-2.3/ql/src/java/org/apache/hadoop/hive/ql/exec/Operator.java#L184) So as what I mentioned in Solution 2 in this Pr, we can get needColumns from [conf](https://github.com/apache/hive/blob/branch-2.3/ql/src/java/org/apache/hadoop/hive/ql/exec/Operator.java#L184) and then get it as a property in iceberg > And I found that there is another way to fix these problem, and I think this way is the best. But we also need to code hive. > >With hive, in class org.apache.hadoop.hive.ql.exec.MapOperator, we can get need columns from ((TableScanOperator) conf.getAliasToWork().get(alias)).getConf().getNeededColumns(), and set it in hconf public void setChildren(Configuration hconf) use a property px. > >Then in class org.apache.iceberg.mr.hive.HiveIcebergSerDe in iceberg, we can get need columns from property px correctly. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
