Hi You are looking for the explode method (in Dataframe API starting 1.3 I believe) https://github.com/apache/spark/blob/master/sql/core/src/main/scala/org/apache/spark/sql/DataFrame.scala#L1002
Ram On Sun, Jun 7, 2015 at 9:22 PM, Dimp Bhat <[email protected]> wrote: > Hi, > I'm trying to write a custom transformer in Spark ML and since that uses > DataFrames, am trying to use flatMap function in DataFrame class in Java. > Can you share a simple example of how to use the flatMap function to do > word count on single column of the DataFrame. Thanks > > > Dimple >
