cloud-fan commented on pull request #31569:
URL: https://github.com/apache/spark/pull/31569#issuecomment-822179478
I think there are 2 topics here:
1. Public Spark APIs that use Symbols. We can't change them as they are
public APIs. We are fine if Scala won't remove the `Symbol` class. I assume
these public APIs will be less popular over time, as they are hard to use
without the symbol literal syntax. `$"col_name"` is better.
2. Internal Spark APIs that use Symbols, especially the testing DSL. I'd
prefer to not use Symbol anymore, as it becomes hard to use without the symbol
literal syntax. e.g. `LocalRelation('a.int)` looks good, but
`LocalRelation(Symbol("a").int)` looks cumbersome. We can create a new DSL
syntax to make it easier to write tests in Spark. (see #31601)
What do you think?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
