t;
> -- Original --
> From: "Cheng Lian [via Apache Spark Developers
> List]";ml-node+s1001551n21069...@n3.nabble.com;
> Send time: Friday, Feb 24, 2017 2:28 AM
> To: "Stan Zhai"m...@zhaishidan.cn;
>
> Subject: Re: The driver hangs at DataFram
driver hangs at DataFrame.rdd in Spark 2.1.0 when the DataFrame(SQL)
> is complex, Following thread dump of my driver:
>
>
> org.apache.spark.sql.catalyst.expressions.AttributeReference.equals(namedExpressions.scala:230)
> org.apache.spark.sql.catalyst.expressions.IsNotNull.equal
.
-- Original --
From: "Cheng Lian [via Apache Spark Developers
List]";<ml-node+s1001551n21069...@n3.nabble.com>;
Send time: Friday, Feb 24, 2017 2:28 AM
To: "Stan Zhai"<m...@zhaishidan.cn>;
Subject: Re: The driver hangs
?
-- Original --
*From: * "Cheng Lian-3 [via Apache Spark Developers List]";<[hidden
email] >;
*Send time:* Thursday, Feb 23, 2017 9:43 AM
*To:* "Stan Zhai"<[hidden email]
>;
*Subject: * Re: The driver hangs at DataFrame.rdd in Spark 2.1.0
Just from the th
o: "Stan Zhai"<m...@zhaishidan.cn>;
Subject: Re: The driver hangs at DataFrame.rdd in Spark 2.1.0
Just from the thread dump you provided, it seems that this particular
query plan jams our optimizer. However, it's also possible that the
dr
Hi all,
The driver hangs at DataFrame.rdd in Spark 2.1.0 when the DataFrame(SQL) is
complex, Following thread dump of my driver:
org.apache.spark.sql.catalyst.expressions.AttributeReference.equals(namedExpressions.scala:230)
org.apache.spark.sql.catalyst.expressions.IsNotNull.equals
