I mean it is not a bug has been fixed before this feature added. Of course kryo serializer with 2000+ partitions are working before this feature.
Koert Kuipers wrote > If a feature added recently breaks using kryo serializer with 2000+ > partitions then how can it not be a regression? I mean I use kryo with > more > than 2000 partitions all the time, and it worked before. Or was I simply > not hitting this bug because there are other conditions that also need to > be satisfied besides kryo and 2000+ partitions? > > On Jun 19, 2017 2:20 AM, "Liang-Chi Hsieh" < > viirya@ > > wrote: > > > I think it's not. This is a feature added recently. > > > Hyukjin Kwon wrote >> Is this a regression BTW? I am just curious. >> >> On 19 Jun 2017 1:18 pm, "Liang-Chi Hsieh" < > >> viirya@ > >> > wrote: >> >> -1. When using kyro serializer and partition number is greater than 2000. >> There seems a NPE issue needed to fix. >> >> SPARK-21133 <https://issues.apache.org/jira/browse/SPARK-21133> >> >> >> >> >> ----- >> Liang-Chi Hsieh | @viirya >> Spark Technology Center >> http://www.spark.tc/ >> -- >> View this message in context: http://apache-spark- >> developers-list.1001551.n3.nabble.com/VOTE-Apache-Spark- >> 2-2-0-RC4-tp21677p21784.html >> Sent from the Apache Spark Developers List mailing list archive at >> Nabble.com. >> >> --------------------------------------------------------------------- >> To unsubscribe e-mail: > >> dev-unsubscribe@.apache > > > > > > ----- > Liang-Chi Hsieh | @viirya > Spark Technology Center > http://www.spark.tc/ > -- > View this message in context: http://apache-spark- > developers-list.1001551.n3.nabble.com/VOTE-Apache-Spark- > 2-2-0-RC4-tp21677p21786.html > Sent from the Apache Spark Developers List mailing list archive at > Nabble.com. > > --------------------------------------------------------------------- > To unsubscribe e-mail: > dev-unsubscribe@.apache ----- Liang-Chi Hsieh | @viirya Spark Technology Center http://www.spark.tc/ -- View this message in context: http://apache-spark-developers-list.1001551.n3.nabble.com/VOTE-Apache-Spark-2-2-0-RC4-tp21677p21790.html Sent from the Apache Spark Developers List mailing list archive at Nabble.com. --------------------------------------------------------------------- To unsubscribe e-mail: dev-unsubscr...@spark.apache.org
