Anoop Sharma created TRAFODION-2263:
---------------------------------------

             Summary: Move Similarity check for hive tables to master executor 
root operator
                 Key: TRAFODION-2263
                 URL: https://issues.apache.org/jira/browse/TRAFODION-2263
             Project: Apache Trafodion
          Issue Type: Improvement
            Reporter: Anoop Sharma
            Assignee: Anoop Sharma
            Priority: Minor



Query plans for hive tables include location of data directories/files
and the plan depends on it.
If data changes in a hive file/dir after a query has been compiled and
before it is executed, then that change is detected at runtime by
comparing compile time and runtime dir timestamps.
A mismatch causes that query to recompile using AQR and a new
plan is generated with latest dir location.

This detection is currently being done at leaf operators (scan, insert) when
that operator is executed.

This jira is to move that check (called Similarity Check) to the root 
operator before starting query execution. That way plan consistency
checks will be done before running the query and will not depend
on the actual operator being executed. It will also result in checks not
being done at various processes and operators like an ESP process.

All checks will be done at one place in master executor and code will not
be spread across multiple operators as it is now.


 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to