zhangbutao commented on PR #5391: URL: https://github.com/apache/hive/pull/5391#issuecomment-2437100002
@Aggarwal-Raghav I did some codes debug. Found that the Tez Application Master has already initialize the `OrcTail` when creating orc splits. I want to know if we can pass the `OrcTail` from Tez AM to Tez Task? If ok, we can solve this issue by the way. Here i provided some related codes, maybe we can try to do some code debug to explore a better way to fix the issue? - Tez AM related codes: **create orc split with the orctail** https://github.com/apache/hive/blob/13dfae1c0a7d4540f4bc5edc50bc922f0cfc83e8/ql/src/java/org/apache/hadoop/hive/ql/io/orc/OrcInputFormat.java#L1672-L1673 https://github.com/apache/hive/blob/13dfae1c0a7d4540f4bc5edc50bc922f0cfc83e8/ql/src/java/org/apache/hadoop/hive/ql/io/orc/OrcInputFormat.java#L1497-L1498 - Tez Task related code: **get orc split**(But it can not get the orctail now, we can think about how to get it here?) https://github.com/apache/hive/blob/13dfae1c0a7d4540f4bc5edc50bc922f0cfc83e8/ql/src/java/org/apache/hadoop/hive/ql/io/HiveInputFormat.java#L216-L223 https://github.com/apache/hive/blob/13dfae1c0a7d4540f4bc5edc50bc922f0cfc83e8/ql/src/java/org/apache/hadoop/hive/ql/io/orc/OrcSplit.java#L204-L205 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: gitbox-unsubscr...@hive.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: gitbox-unsubscr...@hive.apache.org For additional commands, e-mail: gitbox-h...@hive.apache.org
