Eugene Koifman created HIVE-19139:

             Summary: Hive.getValidPartitionsInPath() issue
                 Key: HIVE-19139
             Project: Hive
          Issue Type: Sub-task
          Components: Transactions
            Reporter: Eugene Koifman

this method looks like this.  This will not work for multi-stmt txns since each 
statement uses the same writeId but different statementId.
// The non-MM path only finds new partitions, as it is looking at the temp path.
// To produce the same effect, we will find all the partitions affected by this 
txn ID.
// Note: we ignore the statement ID here, because it's currently irrelevant for 
// where this is used; we always want to load everything; also the only case 
// we have multiple statements anyway is union.
 "Looking for dynamic partitions in {} ({} levels)", loadPath, numDP);
Path[] leafStatus = Utilities.getMmDirectoryCandidates(
 fs, loadPath, numDP, numLB, null, writeId, -1, conf, isInsertOverwrite); 

This message was sent by Atlassian JIRA

Reply via email to