Eugene Koifman created HIVE-19139: ------------------------------------- Summary: Hive.getValidPartitionsInPath() issue Key: HIVE-19139 URL: https://issues.apache.org/jira/browse/HIVE-19139 Project: Hive Issue Type: Sub-task Components: Transactions Reporter: Eugene Koifman
this method looks like this. This will not work for multi-stmt txns since each statement uses the same writeId but different statementId. {noformat} // The non-MM path only finds new partitions, as it is looking at the temp path. // To produce the same effect, we will find all the partitions affected by this txn ID. // Note: we ignore the statement ID here, because it's currently irrelevant for MoveTask // where this is used; we always want to load everything; also the only case where // we have multiple statements anyway is union. Utilities.FILE_OP_LOGGER.trace( "Looking for dynamic partitions in {} ({} levels)", loadPath, numDP); Path[] leafStatus = Utilities.getMmDirectoryCandidates( fs, loadPath, numDP, numLB, null, writeId, -1, conf, isInsertOverwrite); {noformat} -- This message was sent by Atlassian JIRA (v7.6.3#76005)