Github user aarondav commented on the pull request: https://github.com/apache/incubator-spark/pull/611#discussion_r9815286 Let's not have a default value for this and throw an error if it's not defined. (I know that wasn't the original behavior, but I think this behavior was sorta an unintentional side-effect of the SparkConf changes.)
--- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. To do so, please top-post your response. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---