voonhous commented on code in PR #19236:
URL: https://github.com/apache/hudi/pull/19236#discussion_r3557383070
##########
hudi-client/hudi-spark-client/src/main/java/org/apache/hudi/client/common/SparkReaderContextFactory.java:
##########
@@ -89,6 +90,10 @@ public SparkReaderContextFactory(HoodieSparkEngineContext
hoodieSparkEngineConte
// Broadcast: Configuration.
Configuration configs = getHadoopConfiguration(jsc.hadoopConfiguration());
schemaEvolutionConfigs.forEach(configs::set);
+ // Internal write-side reads (compaction, clustering, merge) must
materialize INLINE blob bytes
+ // so they can be rewritten into the new base file. DESCRIPTOR is a
query-only optimization; if
+ // it leaked onto this path the rewrite would persist null blob data and
silently drop the bytes.
+ configs.set(HoodieReaderConfig.BLOB_INLINE_READ_MODE.key(),
HoodieReaderConfig.BLOB_INLINE_READ_MODE_CONTENT);
Review Comment:
Added the assert on the captured Configuration in
testGetSchemaEvolutionConfigurations.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
