onlywangyh commented on issue #7298: URL: https://github.com/apache/hudi/issues/7298#issuecomment-1330233193
> In hive mapper will check the input file is changed or not, and get nominal path return. In this case mapper inputdir is "hdfs://dw/hive/warehouse/dm/dm_kafka_rdmp_dw/fvp_core_fact_route_op_hudi_op_new/inc_day=20221120/opcode=50" and reader a path like hdfs://dw/hive/warehouse/dm/dm_kafka_rdmp_dw/fvp_core_fact_route_op_hudi_op_new/inc_day=20221120/opcode=501. In this way mapper think input file is changed and try to get nominal path. We can't get the nominal path throw a IllegalStateException "Invalid input path ". In hudi getPartitionPath function should exclude the unnecessary partiton paths -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
