Github user NarineK commented on the issue:
https://github.com/apache/spark/pull/12836
Hi @sun-rui, hi @shivaram,
I've overwritten the stringArgs - I've pushed my changes in the following
branch. I haven't created a jira yet.
https://github.com/apache/spark/commit/939dbd5a17e63171ef2c18d5b23874daa75dbfcc
This is how the output looks like after my modification. Do you think this
is good enough ?
== Parsed Logical Plan ==
'SerializeFromObject [if (assertnotnull(input[0, org.apache.spark.sql.Row,
true], top level row object).isNullAt) null else
validateexternaltype(getexternalrowfield(assertnotnull(input[0,
org.apache.spark.sql.Row, true], top level row object), 0, a), IntegerType) AS
a#13504, if (assertnotnull(input[0, org.apache.spark.sql.Row, true], top level
row object).isNullAt) null else
validateexternaltype(getexternalrowfield(assertnotnull(input[0,
org.apache.spark.sql.Row, true], top level row object), 1, b), DoubleType) AS
b#13505, if (assertnotnull(input[0, org.apache.spark.sql.Row, true], top level
row object).isNullAt) null else staticinvoke(class
org.apache.spark.unsafe.types.UTF8String, StringType, fromString,
validateexternaltype(getexternalrowfield(assertnotnull(input[0,
org.apache.spark.sql.Row, true], top level row object), 2, c), StringType),
true) AS c#13506]
+- 'MapPartitionsInR [StructField(a,IntegerType,true),
StructField(b,DoubleType,true), StructField(c,StringType,true)],
[StructField(a,IntegerType,true), StructField(b,DoubleType,true),
StructField(c,StringType,true)], obj#13500: org.apache.spark.sql.Row
+- 'DeserializeToObject
unresolveddeserializer(createexternalrow(getcolumnbyordinal(0, IntegerType),
getcolumnbyordinal(1, DoubleType), getcolumnbyordinal(2, StringType).toString,
StructField(a,IntegerType,true), StructField(b,DoubleType,true),
StructField(c,StringType,true))), obj#13496: org.apache.spark.sql.Row
+- LogicalRDD [a#13485, b#13486, c#13487]
...
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
