[jira] [Updated] (OOZIE-2811) Add support for filtering out properties from SparkConfigurationService

2017-12-08 Thread Satish Subhashrao Saley (JIRA) 

 [ 
https://issues.apache.org/jira/browse/OOZIE-2811?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Satish Subhashrao Saley updated OOZIE-2811:
---

Cherry-picked from master to branch-4.3.


> Add support for filtering out properties from SparkConfigurationService
> ---
>
> Key: OOZIE-2811
> URL: https://issues.apache.org/jira/browse/OOZIE-2811
> Project: Oozie
>  Issue Type: Bug
>Reporter: Peter Cseh
>Assignee: Peter Cseh
> Fix For: 5.0.0b1, 4.3.1
>
> Attachments: OOZIE-2811-001.patch, OOZIE-2811-002.patch, 
> OOZIE-2811-003.patch, OOZIE-2811-004.patch, OOZIE-2811-005.patch, 
> OOZIE-2811-amend.patch
>
>
> There is support for filtering out 
> [spark.yarn.jar|https://github.com/apache/oozie/blob/master/core/src/main/java/org/apache/oozie/service/SparkConfigurationService.java#L89],
>  but it's changed to spark.yarn.jars in Spark2. 
> We should add a general blacklist of properties instead of the current 
> boolean of {{spark.configurations.ignore.spark.yarn.jar}}



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

[jira] [Updated] (OOZIE-2811) Add support for filtering out properties from SparkConfigurationService

2017-03-22 Thread Peter Cseh (JIRA) 

 [ 
https://issues.apache.org/jira/browse/OOZIE-2811?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Peter Cseh updated OOZIE-2811:
--
Attachment: OOZIE-2811-amend.patch

My patch messed up the license header in TestSparkConfigurationService.java. 
This patch fixes that.
[~rkanter], please review this.

> Add support for filtering out properties from SparkConfigurationService
> ---
>
> Key: OOZIE-2811
> URL: https://issues.apache.org/jira/browse/OOZIE-2811
> Project: Oozie
>  Issue Type: Bug
>Reporter: Peter Cseh
>Assignee: Peter Cseh
> Fix For: 5.0.0
>
> Attachments: OOZIE-2811-001.patch, OOZIE-2811-002.patch, 
> OOZIE-2811-003.patch, OOZIE-2811-004.patch, OOZIE-2811-005.patch, 
> OOZIE-2811-amend.patch
>
>
> There is support for filtering out 
> [spark.yarn.jar|https://github.com/apache/oozie/blob/master/core/src/main/java/org/apache/oozie/service/SparkConfigurationService.java#L89],
>  but it's changed to spark.yarn.jars in Spark2. 
> We should add a general blacklist of properties instead of the current 
> boolean of {{spark.configurations.ignore.spark.yarn.jar}}



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

[jira] [Updated] (OOZIE-2811) Add support for filtering out properties from SparkConfigurationService

2017-03-07 Thread Peter Cseh (JIRA) 

 [ 
https://issues.apache.org/jira/browse/OOZIE-2811?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Peter Cseh updated OOZIE-2811:
--
Attachment: OOZIE-2811-005.patch

Set default encoding for reading the properties files.

> Add support for filtering out properties from SparkConfigurationService
> ---
>
> Key: OOZIE-2811
> URL: https://issues.apache.org/jira/browse/OOZIE-2811
> Project: Oozie
>  Issue Type: Bug
>Reporter: Peter Cseh
>Assignee: Peter Cseh
> Attachments: OOZIE-2811-001.patch, OOZIE-2811-002.patch, 
> OOZIE-2811-003.patch, OOZIE-2811-004.patch, OOZIE-2811-005.patch
>
>
> There is support for filtering out 
> [spark.yarn.jar|https://github.com/apache/oozie/blob/master/core/src/main/java/org/apache/oozie/service/SparkConfigurationService.java#L89],
>  but it's changed to spark.yarn.jars in Spark2. 
> We should add a general blacklist of properties instead of the current 
> boolean of {{spark.configurations.ignore.spark.yarn.jar}}



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

[jira] [Updated] (OOZIE-2811) Add support for filtering out properties from SparkConfigurationService

2017-03-07 Thread Peter Cseh (JIRA) 

 [ 
https://issues.apache.org/jira/browse/OOZIE-2811?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Peter Cseh updated OOZIE-2811:
--
Attachment: OOZIE-2811-004.patch

RB reviews nr2

> Add support for filtering out properties from SparkConfigurationService
> ---
>
> Key: OOZIE-2811
> URL: https://issues.apache.org/jira/browse/OOZIE-2811
> Project: Oozie
>  Issue Type: Bug
>Reporter: Peter Cseh
>Assignee: Peter Cseh
> Attachments: OOZIE-2811-001.patch, OOZIE-2811-002.patch, 
> OOZIE-2811-003.patch, OOZIE-2811-004.patch
>
>
> There is support for filtering out 
> [spark.yarn.jar|https://github.com/apache/oozie/blob/master/core/src/main/java/org/apache/oozie/service/SparkConfigurationService.java#L89],
>  but it's changed to spark.yarn.jars in Spark2. 
> We should add a general blacklist of properties instead of the current 
> boolean of {{spark.configurations.ignore.spark.yarn.jar}}



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

[jira] [Updated] (OOZIE-2811) Add support for filtering out properties from SparkConfigurationService

2017-03-05 Thread Peter Cseh (JIRA) 

 [ 
https://issues.apache.org/jira/browse/OOZIE-2811?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Peter Cseh updated OOZIE-2811:
--
Attachment: OOZIE-2811-002.patch

> Add support for filtering out properties from SparkConfigurationService
> ---
>
> Key: OOZIE-2811
> URL: https://issues.apache.org/jira/browse/OOZIE-2811
> Project: Oozie
>  Issue Type: Bug
>Reporter: Peter Cseh
>Assignee: Peter Cseh
> Attachments: OOZIE-2811-001.patch, OOZIE-2811-002.patch, 
> OOZIE-2811-003.patch
>
>
> There is support for filtering out 
> [spark.yarn.jar|https://github.com/apache/oozie/blob/master/core/src/main/java/org/apache/oozie/service/SparkConfigurationService.java#L89],
>  but it's changed to spark.yarn.jars in Spark2. 
> We should add a general blacklist of properties instead of the current 
> boolean of {{spark.configurations.ignore.spark.yarn.jar}}



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

[jira] [Updated] (OOZIE-2811) Add support for filtering out properties from SparkConfigurationService

2017-03-05 Thread Peter Cseh (JIRA) 

 [ 
https://issues.apache.org/jira/browse/OOZIE-2811?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Peter Cseh updated OOZIE-2811:
--
Attachment: OOZIE-2811-003.patch

Addressing RB comments.

> Add support for filtering out properties from SparkConfigurationService
> ---
>
> Key: OOZIE-2811
> URL: https://issues.apache.org/jira/browse/OOZIE-2811
> Project: Oozie
>  Issue Type: Bug
>Reporter: Peter Cseh
>Assignee: Peter Cseh
> Attachments: OOZIE-2811-001.patch, OOZIE-2811-002.patch, 
> OOZIE-2811-003.patch
>
>
> There is support for filtering out 
> [spark.yarn.jar|https://github.com/apache/oozie/blob/master/core/src/main/java/org/apache/oozie/service/SparkConfigurationService.java#L89],
>  but it's changed to spark.yarn.jars in Spark2. 
> We should add a general blacklist of properties instead of the current 
> boolean of {{spark.configurations.ignore.spark.yarn.jar}}



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

[jira] [Updated] (OOZIE-2811) Add support for filtering out properties from SparkConfigurationService

2017-03-03 Thread Peter Cseh (JIRA) 

 [ 
https://issues.apache.org/jira/browse/OOZIE-2811?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Peter Cseh updated OOZIE-2811:
--
Attachment: OOZIE-2811-001.patch

> Add support for filtering out properties from SparkConfigurationService
> ---
>
> Key: OOZIE-2811
> URL: https://issues.apache.org/jira/browse/OOZIE-2811
> Project: Oozie
>  Issue Type: Bug
>Reporter: Peter Cseh
>Assignee: Peter Cseh
> Attachments: OOZIE-2811-001.patch
>
>
> There is support for filtering out 
> [spark.yarn.jar|https://github.com/apache/oozie/blob/master/core/src/main/java/org/apache/oozie/service/SparkConfigurationService.java#L89],
>  but it's changed to spark.yarn.jars in Spark2. 
> We should add a general blacklist of properties instead of the current 
> boolean of {{spark.configurations.ignore.spark.yarn.jar}}



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)