Hi folks, wanted to get a sanity check before opening a JIRA. I am trying to do the following:
create a HiveContext, then from different threads: 1. Create a DataFrame 2. Name said df via registerTempTable 3. do a simple query via sql and dropTempTable My understanding is that since HiveContext is thread safe this should work fine. But I get into a state where step 3 cannot find the table: org.apache.spark.sql.AnalysisException: no such table I put the full code and error observed here: https://gist.github.com/yanakad/7faea20ca980e8085234 I don't think the parquet file itself is relevant but I can provide it if I'm wrong. I can reproduce this in about 1 in 5 runs... Thanks!
