[ https://issues.apache.org/jira/browse/HIVE-19139?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Sergey Shelukhin resolved HIVE-19139. ------------------------------------- Resolution: Not A Problem This should be fixed as part of actually adding multi statement txns :) > Hive.getValidPartitionsInPath() issue > ------------------------------------- > > Key: HIVE-19139 > URL: https://issues.apache.org/jira/browse/HIVE-19139 > Project: Hive > Issue Type: Sub-task > Components: Transactions > Reporter: Eugene Koifman > Priority: Major > > this method looks like this. This will not work for multi-stmt txns since > each statement uses the same writeId but different statementId. > {noformat} > // The non-MM path only finds new partitions, as it is looking at the temp > path. > // To produce the same effect, we will find all the partitions affected by > this txn ID. > // Note: we ignore the statement ID here, because it's currently irrelevant > for MoveTask > // where this is used; we always want to load everything; also the only case > where > // we have multiple statements anyway is union. > Utilities.FILE_OP_LOGGER.trace( > "Looking for dynamic partitions in {} ({} levels)", loadPath, numDP); > Path[] leafStatus = Utilities.getMmDirectoryCandidates( > fs, loadPath, numDP, numLB, null, writeId, -1, conf, isInsertOverwrite); > {noformat} -- This message was sent by Atlassian JIRA (v7.6.3#76005)