Rohini Palaniswamy created OOZIE-1167:
-----------------------------------------

             Summary: Fix and rework PartitionDependency Management
                 Key: OOZIE-1167
                 URL: https://issues.apache.org/jira/browse/OOZIE-1167
             Project: Oozie
          Issue Type: Sub-task
            Reporter: Rohini Palaniswamy
            Assignee: Rohini Palaniswamy


Currently the PDMService only works if the hcat dependency URI partitions match 
exactly with all the partitions in the notification. This is mostly not the 
case as there will be lot of sub-partitions in a table, but only the date 
partition will be specified for dependency check. So need to do a subset match. 
  Also need to extract out the dependency cache and make an interface, so that 
a cache which spills to disk can later be substituted. Spillable cache is 
required for scale when number of pending dependencies will be high. 

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Reply via email to