Re: [VOTE] Apache Spark 2.2.0 (RC4)

2017-06-18 Thread Hyukjin Kwon
Is this a regression BTW? I am just curious. On 19 Jun 2017 1:18 pm, "Liang-Chi Hsieh" wrote: -1. When using kyro serializer and partition number is greater than 2000. There seems a NPE issue needed to fix. SPARK-21133

Re: [VOTE] Apache Spark 2.2.0 (RC4)

2017-06-18 Thread Liang-Chi Hsieh
-1. When using kyro serializer and partition number is greater than 2000. There seems a NPE issue needed to fix. SPARK-21133 - Liang-Chi Hsieh | @viirya Spark Technology Center http://www.spark.tc/ -- View this message in context:

the scheme in stream reader

2017-06-18 Thread ??????????
Hi all, L set the scheme for DataStreamReader but when I print the scheme.It just printed: root |--value:string (nullable=true) My code is val line = ss.readStream.format("socket") .option("ip",xxx) .option("port",xxx) .scheme(StructField("name",StringType??::(StructField("age",