Hi Misha, What is the schema for both the DataFrames? And what is the expected schema of the resulting DataFrame?
Mohammed Author: Big Data Analytics with Spark<http://www.amazon.com/Big-Data-Analytics-Spark-Practitioners/dp/1484209656/> From: Natu Lauchande [mailto:nlaucha...@gmail.com] Sent: Wednesday, June 15, 2016 2:07 PM To: spR Cc: user Subject: Re: concat spark dataframes Hi, You can select the common collumns and use DataFrame.union all . Regards, Natu On Wed, Jun 15, 2016 at 8:57 PM, spR <data.smar...@gmail.com<mailto:data.smar...@gmail.com>> wrote: hi, how to concatenate spark dataframes? I have 2 frames with certain columns. I want to get a dataframe with columns from both the other frames. Regards, Misha
