Join two dataframe - Timeout after 5 minutes

I am trying to join two tables using dataframes using python 3.4 and I am getting the following error I ran it on my localhost machine with 2 workers, spark 1.5 I always get timeout if the job takes more than 5 minutes. at

Re: Join two dataframe - Timeout after 5 minutes

You can change "spark.sql.broadcastTimeout" to increase the timeout. The default value is 300 seconds. Best Regards, Shixiong Zhu 2015-09-24 15:16 GMT+08:00 Eyad Sibai : > I am trying to join two tables using dataframes using python 3.4 and I am > getting the following