cloud-fan commented on issue #23325: [SPARK-26376][SQL] Skip inputs without tokens by JSON datasource URL: https://github.com/apache/spark/pull/23325#issuecomment-447708971 ah this is a good point. I think PERMISSIVE mode doesn't make sense for array/map as we can't have a special column to put the original token. Now we have several things to consider together to decide the behavior: 1. it's `from_json` or json data source 2. the result is row or array/map (when it's `from_json`) 3. the parse mode 4. the token is valid or not @MaxGekk can you describe the behavior you proposed?
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
