[
https://issues.apache.org/jira/browse/SPARK-36069?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17378888#comment-17378888
]
geekyouth commented on SPARK-36069:
-----------------------------------
I also want to merge this feature into version 2.4.3.
Now my company has used this new merged version 2.4.3.1 in prodcution ENV .
Because it is very usefual and easily to find error data.
Do you think is it needed??? [~apachespark]
> spark function from_json should output field name, field type and field value
> when FAILFAST mode throw exception
> ----------------------------------------------------------------------------------------------------------------
>
> Key: SPARK-36069
> URL: https://issues.apache.org/jira/browse/SPARK-36069
> Project: Spark
> Issue Type: Improvement
> Components: SQL
> Affects Versions: 3.0.0
> Reporter: geekyouth
> Priority: Major
>
> spark function from_json outputs error message when FAILFAST mode throw
> exception.
>
> But the message does not contain important info exemaple: field name, field
> vlue , field type...
>
> This infoormation is very important for devlops to find where error input
> data is located.
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
