guichaoxian created SPARK-23506: ----------------------------------- Summary: Add refreshByPath in HiveMetastoreCatalog and invalidByPath in FileStatusCache Key: SPARK-23506 URL: https://issues.apache.org/jira/browse/SPARK-23506 Project: Spark Issue Type: New Feature Components: SQL Affects Versions: 2.1.0 Reporter: guichaoxian
As far as I know HiveMetastoreCatalog only have a method called refreshTable,this method will remove all meta of a table cached in memory. In some situation, I only change files of a partition. use refreshTable to invalid all file status is Inefficient. I think we can add a method called invalidByPath in FileStatusCache and a method refreshByPath in HiveMetastoreCatalog. -- This message was sent by Atlassian JIRA (v7.6.3#76005) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org