jonvex commented on code in PR #14120:
URL: https://github.com/apache/hudi/pull/14120#discussion_r2446162665
##########
hudi-client/hudi-spark-client/src/main/scala/org/apache/spark/sql/execution/datasources/parquet/HoodieParquetFileFormatHelper.scala:
##########
@@ -127,6 +146,49 @@ object HoodieParquetFileFormatHelper {
})
}
+ def recursivelyApplyMultiplication(expr: Expression, columnPath: String,
dataType: DataType): Expression = {
Review Comment:
Yes I was able to do so and it will infact incur less overhead. My original
approach was to spoof the schema read from the parquet footer, but I thought it
was too deep into the parquet-java hadoop stuff to work. But after trying it
out, it seems like that readsupport requested schema is all that needs to
change for it to work
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
