Re: Using HiveContext.set in multipul threads

2016-05-24 Thread Silvio Fiorito
, 2016 at 7:01 AM To: "user@spark.apache.org" Subject: Using HiveContext.set in multipul threads Hi, I have a DataFrame I compute from a long chain of transformations. I cache it, and then perform two additional transformations on it. I use two Futures - each Future will insert the content

Using HiveContext.set in multipul threads

2016-05-24 Thread Amir Gershman
Hi, I have a DataFrame I compute from a long chain of transformations. I cache it, and then perform two additional transformations on it. I use two Futures - each Future will insert the content of one of the above Dataframe to a different hive table. One Future must SET hive.exec.dynamic.partitio