[GitHub] [spark] manbuyun commented on pull request #30225: [SPARK-33187][SQL] Add a check on the number of returned partitions in the HiveShim#getPartitionsByFilter method

Tue, 10 Nov 2020 18:33:55 -0800 


manbuyun commented on pull request #30225:
URL: https://github.com/apache/spark/pull/30225#issuecomment-725089848


   > Could you add tests? btw, does hive have a similar config?
   
   I'll think about adding a test. 
   HiveMetaStore#get_partitions_by_filter also call method 
checkLimitNumberOfPartitionsByFilter，and 
HiveConf#METASTORE_LIMIT_PARTITION_REQUEST default value is -1.
   
![image](https://user-images.githubusercontent.com/29940618/98758124-fb563000-2408-11eb-9f39-a8e5084de501.png)
   
![image](https://user-images.githubusercontent.com/29940618/98758154-0b6e0f80-2409-11eb-8b4b-665f5d8b804d.png)
   


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
[email protected]



---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to