GitHub user ericl opened a pull request:

    [SPARK-17980] [SQL] Fix refreshByPath for converted Hive tables

    ## What changes were proposed in this pull request?
    There was a bug introduced in 
which broke refreshByPath with converted hive tables (though, it turns out it 
was very difficult to refresh converted hive tables anyways, since you had to 
specify the exact path of one of the partitions).
    This changes refreshByPath to invalidate by prefix instead of exact match, 
and fixes the issue.
    cc @sameeragarwal for refreshByPath changes
    ## How was this patch tested?
    Extended unit test.

You can merge this pull request into a Git repository by running:

    $ git pull fix-caching

Alternatively you can review and apply these changes as the patch at:

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

    This closes #15521
commit 74156663514001d4ab7d6aca6a356284cc2bc019
Author: Eric Liang <>
Date:   2016-10-17T22:00:03Z

    Mon Oct 17 15:00:03 PDT 2016


If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at or file a JIRA ticket
with INFRA.

To unsubscribe, e-mail:
For additional commands, e-mail:

Reply via email to