Github user gatorsmile commented on the issue:
https://github.com/apache/spark/pull/18865
Parsing all the columns is another option when users just select the
`_corrupt_record`. However, users might not need all the columns, especially
for the semi-structured formats (CSV and JSON). Thus, we should let users
decide which columns need to be parsed, instead of making a decision for them.
Actually, this is more conservative.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
