Github user jyotiska commented on the pull request: https://github.com/apache/incubator-spark/pull/626#issuecomment-35704511 I think it is a good idea to add an extra flag for overwriting. If the flag is not present, Spark should throw an exception. I will see if the bug is also present in PySpark.
--- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. To do so, please top-post your response. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---