ShuffleExchange#nodeName...a duplication...perhaps?!

Hi, While reviewing ShuffleExchange physical operator [1] I found the following: override def nodeName: String = { val extraInfo = coordinator match { case Some(exchangeCoordinator) if exchangeCoordinator.isEstimated => s"(coordinator id: ${System.identityHashCode(coordinator)

does The Design of spark consider the scala parallelize collections?

Hi devs: According to scala doc, we can see the scala has parallelize collections, according to my experient, surely, parallelize collections can accelerate the operation,such as(map). so i want to know does spark has used the scala parallelize collections and even will spark consider thant? tha

Component naming in the PR title

Hi all, First of all, this might be minor but I just have been curious of different PR titles in particular component part. So, I looked through Spark wiki again and I found the description not quite the same with the PRs. It seems, it is said, Pull Request ... 1. The PR title should

Re: Handling questions in the mailing lists

Hey Reynold, Looks like we all of the proposed changes into Proposed Community Mailing Lists / StackOverflow Changes . Anything else we can do to update the Spark Community page / welcome e