Prakash Chockalingam created SPARK-8714:
-------------------------------------------
Summary: Refresh table not working with non-default databases
Key: SPARK-8714
URL: https://issues.apache.org/jira/browse/SPARK-8714
Project: Spark
Issue Type: Sub-task
Reporter: Prakash Chockalingam
I created an external table with sqlContext.createExternalTable from parquet
data in S3. After that, I placed a new partition (directory with some parquet
files) in S3. Then I did a sql refresh table. It worked great.
I created a separate cluster and changed the database from default to my
database. I repeated the above process for the new database. Now the
createExternalTable works fine but the refresh table doesn't work. The first
time I got an exception stack trace but the next time I don't see any error but
when I do a count on the # of rows, the new data is not reflected.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
