[jira] [Commented] (SPARK-21023) Ignore to load default properties file is not a good choice from the perspective of system

[ https://issues.apache.org/jira/browse/SPARK-21023?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16045495#comment-16045495 ] Lantao Jin commented on SPARK-21023: [~cloud_fan], I come to see what you mean. Maybe add a

[jira] [Commented] (SPARK-21023) Ignore to load default properties file is not a good choice from the perspective of system

[ https://issues.apache.org/jira/browse/SPARK-21023?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16045483#comment-16045483 ] Lantao Jin commented on SPARK-21023: [~cloud_fan] {{--properties-file}} and

[jira] [Commented] (SPARK-21023) Ignore to load default properties file is not a good choice from the perspective of system

[ https://issues.apache.org/jira/browse/SPARK-21023?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16045472#comment-16045472 ] Wenchen Fan commented on SPARK-21023: - can't we just introduce something like

[jira] [Commented] (SPARK-21023) Ignore to load default properties file is not a good choice from the perspective of system

[ https://issues.apache.org/jira/browse/SPARK-21023?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16045452#comment-16045452 ] Lantao Jin commented on SPARK-21023: If current behavior should be keep. I can add an environment

[jira] [Commented] (SPARK-21023) Ignore to load default properties file is not a good choice from the perspective of system

[ https://issues.apache.org/jira/browse/SPARK-21023?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16045441#comment-16045441 ] Lantao Jin commented on SPARK-21023: I modify the description with adding two tables to illustrate

[jira] [Commented] (SPARK-21023) Ignore to load default properties file is not a good choice from the perspective of system

[ https://issues.apache.org/jira/browse/SPARK-21023?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16043209#comment-16043209 ] Marcelo Vanzin commented on SPARK-21023: Then your best bet is a new command line option that

[jira] [Commented] (SPARK-21023) Ignore to load default properties file is not a good choice from the perspective of system

[ https://issues.apache.org/jira/browse/SPARK-21023?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16043191#comment-16043191 ] Lantao Jin commented on SPARK-21023: I think {{--conf}} couldn't help this. Because from the view of

[jira] [Commented] (SPARK-21023) Ignore to load default properties file is not a good choice from the perspective of system

[ https://issues.apache.org/jira/browse/SPARK-21023?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16043179#comment-16043179 ] Lantao Jin commented on SPARK-21023: {quote} it may break existing applications {quote} I really know

[jira] [Commented] (SPARK-21023) Ignore to load default properties file is not a good choice from the perspective of system

[ https://issues.apache.org/jira/browse/SPARK-21023?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16043176#comment-16043176 ] Marcelo Vanzin commented on SPARK-21023: bq. When and where the new config option be set?

[jira] [Commented] (SPARK-21023) Ignore to load default properties file is not a good choice from the perspective of system

[ https://issues.apache.org/jira/browse/SPARK-21023?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16043172#comment-16043172 ] Lantao Jin commented on SPARK-21023: {quote} Another option is to have a config option {quote} Oh,

[jira] [Commented] (SPARK-21023) Ignore to load default properties file is not a good choice from the perspective of system

[ https://issues.apache.org/jira/browse/SPARK-21023?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16043168#comment-16043168 ] Marcelo Vanzin commented on SPARK-21023: bq. The purpose is making the default configuration

[jira] [Commented] (SPARK-21023) Ignore to load default properties file is not a good choice from the perspective of system

[ https://issues.apache.org/jira/browse/SPARK-21023?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16043164#comment-16043164 ] Lantao Jin commented on SPARK-21023: {quote} Another option is to have a config option {quote} LGTM

[jira] [Commented] (SPARK-21023) Ignore to load default properties file is not a good choice from the perspective of system

[ https://issues.apache.org/jira/browse/SPARK-21023?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16043160#comment-16043160 ] Lantao Jin commented on SPARK-21023: *The purpose is making the default configuration loaded

[jira] [Commented] (SPARK-21023) Ignore to load default properties file is not a good choice from the perspective of system

[ https://issues.apache.org/jira/browse/SPARK-21023?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16043132#comment-16043132 ] Marcelo Vanzin commented on SPARK-21023: Another option is to have a config option that controls

[jira] [Commented] (SPARK-21023) Ignore to load default properties file is not a good choice from the perspective of system

[ https://issues.apache.org/jira/browse/SPARK-21023?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16043131#comment-16043131 ] Marcelo Vanzin commented on SPARK-21023: bq. I suggest to change the current behavior Yes, and

[jira] [Commented] (SPARK-21023) Ignore to load default properties file is not a good choice from the perspective of system

[ https://issues.apache.org/jira/browse/SPARK-21023?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16043124#comment-16043124 ] Lantao Jin commented on SPARK-21023: [~vanzin] I suggest to change the current behavior and offer a

[jira] [Commented] (SPARK-21023) Ignore to load default properties file is not a good choice from the perspective of system

[ https://issues.apache.org/jira/browse/SPARK-21023?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16043097#comment-16043097 ] Apache Spark commented on SPARK-21023: -- User 'LantaoJin' has created a pull request for this issue:

[jira] [Commented] (SPARK-21023) Ignore to load default properties file is not a good choice from the perspective of system

[ https://issues.apache.org/jira/browse/SPARK-21023?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16043053#comment-16043053 ] Marcelo Vanzin commented on SPARK-21023: I thought we have an issue for adding a user-specific

[jira] [Commented] (SPARK-21023) Ignore to load default properties file is not a good choice from the perspective of system

[ https://issues.apache.org/jira/browse/SPARK-21023?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16043036#comment-16043036 ] Sean Owen commented on SPARK-21023: --- Maybe, but it would be a behavior change now. There are equal