Chao Sun created HIVE-15441:
-------------------------------

             Summary: Provide a config to timeout long compiling queries
                 Key: HIVE-15441
                 URL: https://issues.apache.org/jira/browse/HIVE-15441
             Project: Hive
          Issue Type: Improvement
          Components: Query Planning
            Reporter: Chao Sun
            Assignee: Chao Sun


Sometimes Hive users have long compiling queries which may need to scan 
thousands or even more partitions (perhaps by accident). The compilation 
process may take a very long time, especially in {{getInputSummary}} where it 
need to make NN calls to get info about each input path.

This is bad because it may block many other queries. Parallel compilation may 
be useful but still {{getInputSummary}} has a global lock. In this case, it 
makes sense to provide Hive admin with a config to put a timeout limit for 
compilation, so that these "bad" queries can be blocked.

Note https://issues.apache.org/jira/browse/HIVE-12431 also tries to address 
similar issue. However it cancels those queries that are waiting for the 
compile lock, which I think is not so useful for our case since the *query 
under compile is the one to be blamed.*



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to