Spark 2.0 is EOL. Can you try 2.3 or 2.4? On Thu, Mar 21, 2019 at 10:23 AM asma zgolli <zgollia...@gmail.com> wrote:
> Hello , > > I need to cross my data and i'm executing a cross join on two dataframes . > > C = A.crossJoin(B) > A has 50 records > B has 5 records > > the result im getting with spark 2.0 is a dataframe C having 50 records. > > only the first row from B was added to C. > > Is that a bug in Spark? > > Asma ZGOLLI > > PhD student in data engineering - computer science > >
