[jira] Subscription: Oozie Patch Available
Issue Subscription Filter: Oozie Patch Available (97 issues) Subscriber: ooziedaily Key Summary OOZIE-3507 Upgrade to Dozer 6 https://issues.apache.org/jira/browse/OOZIE-3507 OOZIE-3506 Flaky test TestOozieRollingPolicy https://issues.apache.org/jira/browse/OOZIE-3506 OOZIE-3505 [Java 11] Fix TestDBLoadDump https://issues.apache.org/jira/browse/OOZIE-3505 OOZIE-3495 Upgrade hive version to 1.2.2 https://issues.apache.org/jira/browse/OOZIE-3495 OOZIE-3486 duplicate code in ControlNodeHandler https://issues.apache.org/jira/browse/OOZIE-3486 OOZIE-3482 Fix bug in CoordSubmitXCommand#validateCoordinatorJob https://issues.apache.org/jira/browse/OOZIE-3482 OOZIE-3480 Add windowactionstatus metrics in DBLiteWorkflowStoreService https://issues.apache.org/jira/browse/OOZIE-3480 OOZIE-3476 Migrate several classes to JUnit4 https://issues.apache.org/jira/browse/OOZIE-3476 OOZIE-3468 Use modernizer plugin https://issues.apache.org/jira/browse/OOZIE-3468 OOZIE-3461 CoordMaterializeTriggerService code cleanup https://issues.apache.org/jira/browse/OOZIE-3461 OOZIE-3449 Make spark-2 as the default profile https://issues.apache.org/jira/browse/OOZIE-3449 OOZIE-3447 Run test case in local : It shows oozie-hsqldb-orm.xml exception https://issues.apache.org/jira/browse/OOZIE-3447 OOZIE-3418 Upgrade to Guava 27 https://issues.apache.org/jira/browse/OOZIE-3418 OOZIE-3404 The env variable of SPARK_HOME needs to be set when running pySpark https://issues.apache.org/jira/browse/OOZIE-3404 OOZIE-3375 Can't use empty in coordinator https://issues.apache.org/jira/browse/OOZIE-3375 OOZIE-3367 Using && in EL expressions in oozie bundle.xml files generates parse errors https://issues.apache.org/jira/browse/OOZIE-3367 OOZIE-3366 Update workflow status and subworkflow status on suspend command https://issues.apache.org/jira/browse/OOZIE-3366 OOZIE-3364 Rerunning Oozie bundle jobs starts the coordinators in indeterminate order https://issues.apache.org/jira/browse/OOZIE-3364 OOZIE-3362 When killed, SSH action should kill the spawned processes on target host https://issues.apache.org/jira/browse/OOZIE-3362 OOZIE-3335 Cleanup parseFilter methods https://issues.apache.org/jira/browse/OOZIE-3335 OOZIE-3328 Create Hive compatibility action executor to run hive actions using beeline https://issues.apache.org/jira/browse/OOZIE-3328 OOZIE-3320 Oozie ShellAction should support absolute bash file path https://issues.apache.org/jira/browse/OOZIE-3320 OOZIE-3319 Log SSH action callback error output https://issues.apache.org/jira/browse/OOZIE-3319 OOZIE-3301 Update NOTICE file https://issues.apache.org/jira/browse/OOZIE-3301 OOZIE-3274 Remove slf4j https://issues.apache.org/jira/browse/OOZIE-3274 OOZIE-3266 Coord action rerun support RERUN_SKIP_NODES option https://issues.apache.org/jira/browse/OOZIE-3266 OOZIE-3265 properties RERUN_FAIL_NODES and RERUN_SKIP_NODES should be able to appear together https://issues.apache.org/jira/browse/OOZIE-3265 OOZIE-3256 refactor OozieCLI class https://issues.apache.org/jira/browse/OOZIE-3256 OOZIE-3199 Let system property restriction configurable https://issues.apache.org/jira/browse/OOZIE-3199 OOZIE-3196 Authorization: restrict world readability by user https://issues.apache.org/jira/browse/OOZIE-3196 OOZIE-3179 Adding a configurable config-default.xml location to a workflow https://issues.apache.org/jira/browse/OOZIE-3179 OOZIE-3170 Oozie Diagnostic Bundle tool fails with NPE due to missing service class https://issues.apache.org/jira/browse/OOZIE-3170 OOZIE-3137 Add support for log4j2 in HiveMain https://issues.apache.org/jira/browse/OOZIE-3137 OOZIE-3135 Configure log4j2 in SqoopMain https://issues.apache.org/jira/browse/OOZIE-3135 OOZIE-3091 Oozie Sqoop Avro Import fails with "java.lang.NoClassDefFoundError: org/apache/avro/mapred/AvroWrapper" https://issues.apache.org/jira/browse/OOZIE-3091 OOZIE-3071 Oozie 4.3 Spark sharelib ueses a different version of commons-lang3 than Spark 2.2.0 https://issues.apache.org/jira/browse/OOZIE-3071 OOZIE-3063 Sanitizing variables that are part of openjpa.ConnectionProperties https://issues.apache.org/jira/browse/OOZIE-3063 OOZIE-3062 Set HADOOP_CONF_DIR for spark action https://issues.apache.org/jira/browse/OOZIE-3062 OOZIE-2952 Fix Findbugs warnings in oozie-sharelib-oozie https://issues.apache.org/jira/browse/OOZIE-2952 OOZIE-2907 Delete PrepareActionsDriver from oozie-sharelib https://issues.apache.org/jira/browse/OOZIE-2907 OOZIE-2834 Paramet
[jira] [Commented] (OOZIE-3507) Upgrade to Dozer 6
[ https://issues.apache.org/jira/browse/OOZIE-3507?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16856633#comment-16856633 ] Julia Kinga Marton commented on OOZIE-3507: --- The patch does compile with JDK11 as well. > Upgrade to Dozer 6 > -- > > Key: OOZIE-3507 > URL: https://issues.apache.org/jira/browse/OOZIE-3507 > Project: Oozie > Issue Type: Bug >Affects Versions: trunk >Reporter: Andras Salamon >Assignee: Andras Salamon >Priority: Major > Attachments: OOZIE-3507-01-wip.patch > > > Oozie uses [Dozer|http://dozer.sourceforge.net/] library. We use the [latest > version|https://mvnrepository.com/artifact/net.sf.dozer/dozer] (5.5.1) which > was released in 2014. > The project has been revived, which should check the new 6.x version ( > https://github.com/DozerMapper/dozer ) and switch to it. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (OOZIE-3510) TestProxyUserService.testInvalidGroup fails if executed by nobody
[
https://issues.apache.org/jira/browse/OOZIE-3510?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16856578#comment-16856578
]
Julia Kinga Marton commented on OOZIE-3510:
---
Thank you [~asalamon74] for the contribution! +1, committed to master
> TestProxyUserService.testInvalidGroup fails if executed by nobody
> -
>
> Key: OOZIE-3510
> URL: https://issues.apache.org/jira/browse/OOZIE-3510
> Project: Oozie
> Issue Type: Bug
>Reporter: Andras Salamon
>Assignee: Andras Salamon
>Priority: Major
> Attachments: OOZIE-3510-01.patch
>
>
> TestProxyUserService.testInvalidGroup fails if executed by nobody with the
> following error message:
> {noformat}junit.framework.AssertionFailedError
> at junit.framework.Assert.fail(Assert.java:55)
> at junit.framework.Assert.fail(Assert.java:64)
> at junit.framework.TestCase.fail(TestCase.java:235)
> at
> org.apache.oozie.service.TestProxyUserService.testInvalidGroup(TestProxyUserService.java:261)
> ...
> {noformat}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Commented] (OOZIE-3480) Add windowactionstatus metrics in DBLiteWorkflowStoreService
[
https://issues.apache.org/jira/browse/OOZIE-3480?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16856574#comment-16856574
]
Andras Salamon commented on OOZIE-3480:
---
Thanks [~zuston] this will be really useful metric.
* Oozie already stores {{jobstatus}} and {{windowjobstatus}} info for each
action like this:
{noformat}
"jobstatus.FAILED" : {
"value" : 10
},
"jobstatus.KILLED" : {
"value" : 279
},
"jobstatus.PREP" : {
"value" : 0
},
"jobstatus.RUNNING" : {
"value" : 4
},
...
"windowjobstatus.FAILED" : {
"value" : 0
},
"windowjobstatus.KILLED" : {
"value" : 0
},
"windowjobstatus.PREP" : {
"value" : 0
},
{noformat}
I think we should use a more similar format for the
{{windowactionstatus}} instead of the format like {{ssh#ERROR}}
* You introduced a new metric called {{windowactionstatus}} similar to
{{windowjobstatus}}. What about also introducing a metric like {{actionstatus}}
similar to {{jobstatus}}?
* Could you please also add some unit tests (just like you added in OOZIE-3393)
Please also upload the next patch to ReviewBoard.
> Add windowactionstatus metrics in DBLiteWorkflowStoreService
>
>
> Key: OOZIE-3480
> URL: https://issues.apache.org/jira/browse/OOZIE-3480
> Project: Oozie
> Issue Type: Improvement
> Components: core
>Reporter: Junfan Zhang
>Assignee: Junfan Zhang
>Priority: Major
> Attachments: oozie-3480-1.patch, oozie-instrumentation.log
>
>
> The {{windowjobstatus}} metric is useful when you need to monitor task
> execution. However, when there are more action types of online tasks, it is
> necessary to monitor the execution of each action. At this time, the
> {{windowactionstatus}} metrics is necessary. The associated snippet of
> instrumentation.log is in attachments.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
