set is currently not supported. you can use kryo encoder. there is no other work around that i know of.
import org.apache.spark.sql.{ Encoder, Encoders } implicit def setEncoder[X]: Encoder[Set[X]] = Encoders.kryo[Set[X]] On Tue, Jan 31, 2017 at 7:33 PM, Jerry Lam <chiling...@gmail.com> wrote: > Hi guys, > > I got an exception like the following, when I tried to implement a user > defined aggregation function. > > Exception in thread "main" java.lang.UnsupportedOperationException: No > Encoder found for Set[(scala.Long, scala.Long)] > > The Set[(Long, Long)] is a field in the case class which is the output > type for the aggregation. > > Is there a workaround for this? > > Best Regards, > > Jerry >