cloud-fan commented on pull request #35290: URL: https://github.com/apache/spark/pull/35290#issuecomment-1036198728
> Spark will check if the name could be mapped to multiple attr ids, if not(like our cases: a#1, a#1), it won't fail because Spark thinks that two columns are totally the same, not ambiguous. I see. But this is hackable as well. We can make it fail if we see 2 attributes with the same id but have the special metadata property I mentioned before. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
