[jira] [Commented] (OOZIE-3355) Regex based search option for searching workflows in the WFM-View of Ambari
[ https://issues.apache.org/jira/browse/OOZIE-3355?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16639866#comment-16639866 ] Mate Juhasz commented on OOZIE-3355: As I see, the wfm executes a request like this for getting the jobs in _org/apache/oozie/ambari/view/OozieDelegate.java#readFromOozie_: {code:java} Proxy request for url: [GET] http://ctr-e138-1518143905142-496852-01-03.hwx.site:11000/oozie/v2/jobs?filter=name=sparkcompare=1=1=wf {code} Then Oozie handles it in _org/apache/oozie/servlet/V0JobsServlet.java#getJobs,_ and the actual query is done in _org/apache/oozie/executor/jpa/WorkflowsJobGetJPAExecutor.java#execute_ WorkflowsJobGetJPAExecutor is a bit heavy, but if we can agree on a solution I am happy to do it. > Regex based search option for searching workflows in the WFM-View of Ambari > --- > > Key: OOZIE-3355 > URL: https://issues.apache.org/jira/browse/OOZIE-3355 > Project: Oozie > Issue Type: New Feature > Components: bundle, coordinator, core, tools, ui, workflow >Affects Versions: 4.2.0 >Reporter: Krishnadevan Purushothaman >Priority: Critical > > *Challenge faced :* > _{color:#d04437}In the WFM view of ambari, there is no Filter option > available to search for the Workflows. In order to search for the desired > workflow, one has to type the full name of workflow,coordinator,bundles else > it does not return anything which becomes a time-consuming job.{color}_ > *Feature description:* > _{color:#14892c}There is a need for Regex based filter option in order to > search the workflows without the need of entering the complete name of the > workflow,coordinator,bundles rather by just typing the first three letters of > the work post which it should populate suggestions based on the first three > letters of the workflow,coordinator,bundles through which we can refine and > optimize the searching mechanism.{color}_ -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (OOZIE-3277) [build] Check for star imports
[ https://issues.apache.org/jira/browse/OOZIE-3277?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16639815#comment-16639815 ] Andras Piros commented on OOZIE-3277: - Committed to {{master}}. > [build] Check for star imports > -- > > Key: OOZIE-3277 > URL: https://issues.apache.org/jira/browse/OOZIE-3277 > Project: Oozie > Issue Type: Improvement > Components: build >Reporter: Peter Cseh >Assignee: Julia Kinga Marton >Priority: Minor > Labels: newbie > Fix For: 5.2.0 > > Attachments: OOZIE-3277-001.patch, OOZIE-3277-002.patch > > > We don't like to have star imports like {{import java.util.*;}} in our > codebase yet there is no automatic check for it in the pre-commit hook. > We should add one. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (OOZIE-3277) [build] Check for star imports
[ https://issues.apache.org/jira/browse/OOZIE-3277?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16639813#comment-16639813 ] Andras Piros commented on OOZIE-3277: - Thanks for the explanation [~kmarton]! +1 > [build] Check for star imports > -- > > Key: OOZIE-3277 > URL: https://issues.apache.org/jira/browse/OOZIE-3277 > Project: Oozie > Issue Type: Improvement > Components: build >Reporter: Peter Cseh >Assignee: Julia Kinga Marton >Priority: Minor > Labels: newbie > Fix For: 5.2.0 > > Attachments: OOZIE-3277-001.patch, OOZIE-3277-002.patch > > > We don't like to have star imports like {{import java.util.*;}} in our > codebase yet there is no automatic check for it in the pre-commit hook. > We should add one. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (OOZIE-3277) [build] Check for star imports
[ https://issues.apache.org/jira/browse/OOZIE-3277?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andras Piros updated OOZIE-3277: Summary: [build] Check for star imports (was: [build] Check for star imports in patches in pre-commit) > [build] Check for star imports > -- > > Key: OOZIE-3277 > URL: https://issues.apache.org/jira/browse/OOZIE-3277 > Project: Oozie > Issue Type: Improvement > Components: build >Reporter: Peter Cseh >Assignee: Julia Kinga Marton >Priority: Minor > Labels: newbie > Attachments: OOZIE-3277-001.patch, OOZIE-3277-002.patch > > > We don't like to have star imports like {{import java.util.*;}} in our > codebase yet there is no automatic check for it in the pre-commit hook. > We should add one. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (OOZIE-3277) [build] Check for star imports in patches in pre-commit
[ https://issues.apache.org/jira/browse/OOZIE-3277?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16639759#comment-16639759 ] Julia Kinga Marton commented on OOZIE-3277: --- [~andras.piros], the long line is the following one: {code:java} longLines=$(grep "^+" "${PATCHFILE}" | grep -v "^+++" | awk 'BEGIN{count=0}{if ( length > 133 ) { count=count+1} }END{ print count}'){code} This line is an old one, I have addressed a shell check issue, this is why is reported. However, I prefer to have it a little longer than splitted, because I consider it more readable this way. > [build] Check for star imports in patches in pre-commit > --- > > Key: OOZIE-3277 > URL: https://issues.apache.org/jira/browse/OOZIE-3277 > Project: Oozie > Issue Type: Improvement > Components: build >Reporter: Peter Cseh >Assignee: Julia Kinga Marton >Priority: Minor > Labels: newbie > Attachments: OOZIE-3277-001.patch, OOZIE-3277-002.patch > > > We don't like to have star imports like {{import java.util.*;}} in our > codebase yet there is no automatic check for it in the pre-commit hook. > We should add one. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (OOZIE-3355) Regex based search option for searching workflows in the WFM-View of Ambari
[ https://issues.apache.org/jira/browse/OOZIE-3355?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16639515#comment-16639515 ] Denes Bodo commented on OOZIE-3355: --- [~andras.piros] I have never seen Workflow Manager code, but with [~matijhs] we will take a look what can be done. > Regex based search option for searching workflows in the WFM-View of Ambari > --- > > Key: OOZIE-3355 > URL: https://issues.apache.org/jira/browse/OOZIE-3355 > Project: Oozie > Issue Type: New Feature > Components: bundle, coordinator, core, tools, ui, workflow >Affects Versions: 4.2.0 >Reporter: Krishnadevan Purushothaman >Priority: Critical > > *Challenge faced :* > _{color:#d04437}In the WFM view of ambari, there is no Filter option > available to search for the Workflows. In order to search for the desired > workflow, one has to type the full name of workflow,coordinator,bundles else > it does not return anything which becomes a time-consuming job.{color}_ > *Feature description:* > _{color:#14892c}There is a need for Regex based filter option in order to > search the workflows without the need of entering the complete name of the > workflow,coordinator,bundles rather by just typing the first three letters of > the work post which it should populate suggestions based on the first three > letters of the workflow,coordinator,bundles through which we can refine and > optimize the searching mechanism.{color}_ -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Created] (OOZIE-3359) Check for Process#waitFor() usage and fix it in order to avoid indefinite waiting
Julia Kinga Marton created OOZIE-3359: - Summary: Check for Process#waitFor() usage and fix it in order to avoid indefinite waiting Key: OOZIE-3359 URL: https://issues.apache.org/jira/browse/OOZIE-3359 Project: Oozie Issue Type: Improvement Affects Versions: trunk Reporter: Julia Kinga Marton Assignee: Julia Kinga Marton Fix For: 5.2.0 {{Process#waitFor()}} will block until the process finishes. There are situations where this will wait indefinitely. A similar case was in SshActionExecutor, fixed in OOZIE-3354. Let's check the code for other usages, and fix it. Maybe we should check if we can use somehow the Process#waitFor(long timeout, TimeUnit timeUnit) instead of it. The tricky part is that this method is available only in Java 8. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] Subscription: Oozie Patch Available
Issue Subscription Filter: Oozie Patch Available (90 issues) Subscriber: ooziedaily Key Summary OOZIE-3338 Remove SVN references https://issues.apache.org/jira/browse/OOZIE-3338 OOZIE-3326 Sqoop Action should support tez delegation tokens for hive-import https://issues.apache.org/jira/browse/OOZIE-3326 OOZIE-3320 Oozie ShellAction should support absolute bash file path https://issues.apache.org/jira/browse/OOZIE-3320 OOZIE-3319 Log SSH action callback error output https://issues.apache.org/jira/browse/OOZIE-3319 OOZIE-3301 Update NOTICE file https://issues.apache.org/jira/browse/OOZIE-3301 OOZIE-3277 [build] Check for star imports in patches in pre-commit https://issues.apache.org/jira/browse/OOZIE-3277 OOZIE-3274 Remove slf4j https://issues.apache.org/jira/browse/OOZIE-3274 OOZIE-3266 Coord action rerun support RERUN_SKIP_NODES option https://issues.apache.org/jira/browse/OOZIE-3266 OOZIE-3265 properties RERUN_FAIL_NODES and RERUN_SKIP_NODES should be able to appear together https://issues.apache.org/jira/browse/OOZIE-3265 OOZIE-3256 refactor OozieCLI class https://issues.apache.org/jira/browse/OOZIE-3256 OOZIE-3249 [tools] Instrumentation log parser https://issues.apache.org/jira/browse/OOZIE-3249 OOZIE-3218 Oozie Sqoop action with command splits the select clause into multiple parts due to delimiter being space https://issues.apache.org/jira/browse/OOZIE-3218 OOZIE-3199 Let system property restriction configurable https://issues.apache.org/jira/browse/OOZIE-3199 OOZIE-3196 Authorization: restrict world readability by user https://issues.apache.org/jira/browse/OOZIE-3196 OOZIE-3194 Oozie should set proper permissions to sharelib after upload https://issues.apache.org/jira/browse/OOZIE-3194 OOZIE-3186 Oozie is unable to use configuration linked using jceks://file/... https://issues.apache.org/jira/browse/OOZIE-3186 OOZIE-3179 Adding a configurable config-default.xml location to a workflow https://issues.apache.org/jira/browse/OOZIE-3179 OOZIE-3170 Oozie Diagnostic Bundle tool fails with NPE due to missing service class https://issues.apache.org/jira/browse/OOZIE-3170 OOZIE-3135 Configure log4j2 in SqoopMain https://issues.apache.org/jira/browse/OOZIE-3135 OOZIE-3120 maven-assembly-plugin fails when bumped from 2.2.1 https://issues.apache.org/jira/browse/OOZIE-3120 OOZIE-3091 Oozie Sqoop Avro Import fails with "java.lang.NoClassDefFoundError: org/apache/avro/mapred/AvroWrapper" https://issues.apache.org/jira/browse/OOZIE-3091 OOZIE-3071 Oozie 4.3 Spark sharelib ueses a different version of commons-lang3 than Spark 2.2.0 https://issues.apache.org/jira/browse/OOZIE-3071 OOZIE-3063 Sanitizing variables that are part of openjpa.ConnectionProperties https://issues.apache.org/jira/browse/OOZIE-3063 OOZIE-3062 Set HADOOP_CONF_DIR for spark action https://issues.apache.org/jira/browse/OOZIE-3062 OOZIE-2952 Fix Findbugs warnings in oozie-sharelib-oozie https://issues.apache.org/jira/browse/OOZIE-2952 OOZIE-2949 Escape quotes whitespaces in Sqoop field https://issues.apache.org/jira/browse/OOZIE-2949 OOZIE-2927 Append new line character for Hive2 query using query tag https://issues.apache.org/jira/browse/OOZIE-2927 OOZIE-2834 ParameterVerifier logging non-useful warning for workflow definition https://issues.apache.org/jira/browse/OOZIE-2834 OOZIE-2833 when using uber mode the regex pattern used in the extractHeapSizeMB method does not allow heap sizes specified in bytes. https://issues.apache.org/jira/browse/OOZIE-2833 OOZIE-2812 SparkConfigurationService should support loading configurations from multiple Spark versions https://issues.apache.org/jira/browse/OOZIE-2812 OOZIE-2795 Create lib directory or symlink for Oozie CLI during packaging https://issues.apache.org/jira/browse/OOZIE-2795 OOZIE-2784 Include WEEK as a parameter in the Coordinator Expression Language Evaulator https://issues.apache.org/jira/browse/OOZIE-2784 OOZIE-2779 Mask Hive2 action Beeline JDBC password https://issues.apache.org/jira/browse/OOZIE-2779 OOZIE-2736 Reduce the number of threads during test execution https://issues.apache.org/jira/browse/OOZIE-2736 OOZIE-2714 Detect conflicting resources during class loading https://issues.apache.org/jira/browse/OOZIE-2714 OOZIE-2694 Add logging for FsActionExecutor https://issues.apache.org/jira/browse/OOZIE-2694 OOZIE-2693 SimpleHCatDependencyCache.removeMissingDependency can throw NPE https://issues.apache.org/jira/browse/OOZIE-2693 OOZIE-2692 Oozie job submit doesn't report error message to user if