[ https://issues.apache.org/jira/browse/HIVE-18552?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16344366#comment-16344366 ]
Sahil Takiar commented on HIVE-18552: ------------------------------------- [~sershe] sounds reasonable. Didn't realize there was an existing config to control the max # of partitions to scan. Will post a patch that splits {{hive.strict.checks.large.query}} and keeps both the new ones false by default. > Split hive.strict.checks.large.query into two configs, enable partition > filter check by default > ----------------------------------------------------------------------------------------------- > > Key: HIVE-18552 > URL: https://issues.apache.org/jira/browse/HIVE-18552 > Project: Hive > Issue Type: Improvement > Components: Hive > Reporter: Sahil Takiar > Assignee: Sahil Takiar > Priority: Major > > {{hive.strict.checks.large.query}} controls the strict checks for restricting > order bys with no limits, and scans of a partitioned table without a filter > on the partition table. > While both checks prevent "large" queries from being run, they both control > very different behavior. It would be better if users could control these > restrictions separately. > Furthermore, many users make the mistake of abusing partitioned tables and > often end up in a situation where they are running queries that are doing > full-table scans of partitioned tables. This can lead to lots of issues for > Hive - e.g. OOM issues because so many partitions are loaded in memory. So it > would be good if we enabled this restriction by default. -- This message was sent by Atlassian JIRA (v7.6.3#76005)