GitHub user marmbrus opened a pull request:
https://github.com/apache/spark/pull/8215
[SPARK-9634][SPARK-9323][SQL] cleanup unnecessary Aliases in LogicalPlan at
the end of analysis
Also alias the ExtractValue instead of wrapping it with UnresolvedAlias
when resolve attribute in LogicalPlan, as this alias will be trimmed if it's
unnecessary.
Based on #7957 without the changes to mllib, but instead maintaining
earlier behavior when using `withColumn` on expressions that already have
metadata.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/marmbrus/spark pr/7957
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/8215.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #8215
----
commit 73f84c0d4bdc9623871a83b665c461924511f83c
Author: Wenchen Fan <[email protected]>
Date: 2015-08-11T17:43:42Z
cleanup unnecessary Aliases in LogicalPlan at the end of analysis
commit 4cd4fad384f013b71a92b490fa93ec9c63e5231c
Author: Wenchen Fan <[email protected]>
Date: 2015-08-11T18:12:26Z
enhance test
commit 36c5b8b6ba3227465138b4e1a695536b6e5e9498
Author: Wenchen Fan <[email protected]>
Date: 2015-08-13T03:28:56Z
fix mllib
commit 4aa631d001832cdb10d49ee31cb380e9d534ecf6
Author: Wenchen Fan <[email protected]>
Date: 2015-08-13T13:32:00Z
fix window function
commit 0f6b5b86064f41ac5c930b354d9127648d456cf4
Author: Michael Armbrust <[email protected]>
Date: 2015-08-14T20:31:29Z
rollback unneeded changes
commit 7a132c79b633055e8c3c29d0c985600a2042b804
Author: Michael Armbrust <[email protected]>
Date: 2015-08-14T20:31:53Z
propagate column metadata with as
commit 8fa53742c97f974b63ad5c19c5d741253696b211
Author: Michael Armbrust <[email protected]>
Date: 2015-08-14T20:49:40Z
add test for metadata
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
