Github user viirya commented on a diff in the pull request:
https://github.com/apache/spark/pull/22785#discussion_r227310290
--- Diff:
sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/encoders/RowEncoderSuite.scala
---
@@ -273,6 +273,16 @@ class RowEncoderSuite extends
CodegenInterpretedPlanTest {
assert(e4.getMessage.contains("java.lang.String is not a valid
external type"))
}
+ test("SPARK-25791: Datatype of serializers should be accessible") {
+ val udtSQLType = new StructType().add("a", IntegerType)
+ val pythonUDT = new PythonUserDefinedType(udtSQLType, "pyUDT",
"serializedPyClass")
--- End diff --
For normal UDT, we create an `Invoke` with the original udt type. So it
won't cause such problem.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
