Asif created SPARK-49727:
----------------------------
Summary: A Bean class with a serializable POJO field looses data
when converted back from dataframe, as dataset
Key: SPARK-49727
URL: https://issues.apache.org/jira/browse/SPARK-49727
Project: Spark
Issue Type: Bug
Components: SQL
Affects Versions: 3.5.2, 4.0.0
Reporter: Asif
If a Bean class contains a serializable POJO ( without any getter/setter)
property, the encoder does not convert it into Binary Type, and looses the
information.
Using that encoder , we can convert the Dataset of Bean to dataframe.
But When the dataframe is converted back to dataset, the serializable Pojo
field in the bean remains null.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
