Github user marmbrus commented on the pull request:
https://github.com/apache/spark/pull/4346#issuecomment-73161509
Yeah, I think that should work (assuming you are okay with picking a random
value in the case a record has two different fields that collapse into the same
lower case name, which is what I think your version does too). I'll make sure
we add `coalesce` to the DSL before the 1.3 release.
I'd even consider adding this as a method to dataframe if enough users have
this need, but you are the first as far as I know. Either way I think doing it
with a projection is probably better than changing the JSON library.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
