[jira] [Commented] (OOZIE-3355) Regex based search option for searching workflows in the WFM-View of Ambari

2018-10-05 Thread Mate Juhasz (JIRA)


[ 
https://issues.apache.org/jira/browse/OOZIE-3355?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16639866#comment-16639866
 ] 

Mate Juhasz commented on OOZIE-3355:


As I see, the wfm executes a request like this for getting the jobs in 
_org/apache/oozie/ambari/view/OozieDelegate.java#readFromOozie_:
{code:java}
Proxy request for url: [GET] 
http://ctr-e138-1518143905142-496852-01-03.hwx.site:11000/oozie/v2/jobs?filter=name=sparkcompare=1=1=wf
 {code}
Then Oozie handles it in _org/apache/oozie/servlet/V0JobsServlet.java#getJobs,_ 
and the actual query is done in 
_org/apache/oozie/executor/jpa/WorkflowsJobGetJPAExecutor.java#execute_

WorkflowsJobGetJPAExecutor is a bit heavy, but if we can agree on a solution I 
am happy to do it.

> Regex based search option for searching workflows in the WFM-View of Ambari
> ---
>
> Key: OOZIE-3355
> URL: https://issues.apache.org/jira/browse/OOZIE-3355
> Project: Oozie
>  Issue Type: New Feature
>  Components: bundle, coordinator, core, tools, ui, workflow
>Affects Versions: 4.2.0
>Reporter: Krishnadevan Purushothaman
>Priority: Critical
>
> *Challenge faced :*
> _{color:#d04437}In the WFM view of ambari, there is no Filter option 
> available to search for the Workflows. In order to search for the desired 
> workflow, one has to type the full name of workflow,coordinator,bundles else 
> it does not return anything which becomes a time-consuming job.{color}_
> *Feature description:*
> _{color:#14892c}There is a need for Regex based filter option in order to 
> search the workflows without the need of entering the complete name of the 
> workflow,coordinator,bundles rather by just typing the first three letters of 
> the work post which it should populate suggestions based on the first three 
> letters of the workflow,coordinator,bundles through which we can refine and 
> optimize the searching mechanism.{color}_



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Commented] (OOZIE-3277) [build] Check for star imports

2018-10-05 Thread Andras Piros (JIRA)


[ 
https://issues.apache.org/jira/browse/OOZIE-3277?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16639815#comment-16639815
 ] 

Andras Piros commented on OOZIE-3277:
-

Committed to {{master}}.

> [build] Check for star imports
> --
>
> Key: OOZIE-3277
> URL: https://issues.apache.org/jira/browse/OOZIE-3277
> Project: Oozie
>  Issue Type: Improvement
>  Components: build
>Reporter: Peter Cseh
>Assignee: Julia Kinga Marton
>Priority: Minor
>  Labels: newbie
> Fix For: 5.2.0
>
> Attachments: OOZIE-3277-001.patch, OOZIE-3277-002.patch
>
>
> We don't like to have star imports like {{import java.util.*;}} in our 
> codebase yet there is no automatic check for it in the pre-commit hook. 
> We should add one.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Commented] (OOZIE-3277) [build] Check for star imports

2018-10-05 Thread Andras Piros (JIRA)


[ 
https://issues.apache.org/jira/browse/OOZIE-3277?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16639813#comment-16639813
 ] 

Andras Piros commented on OOZIE-3277:
-

Thanks for the explanation [~kmarton]! +1

> [build] Check for star imports
> --
>
> Key: OOZIE-3277
> URL: https://issues.apache.org/jira/browse/OOZIE-3277
> Project: Oozie
>  Issue Type: Improvement
>  Components: build
>Reporter: Peter Cseh
>Assignee: Julia Kinga Marton
>Priority: Minor
>  Labels: newbie
> Fix For: 5.2.0
>
> Attachments: OOZIE-3277-001.patch, OOZIE-3277-002.patch
>
>
> We don't like to have star imports like {{import java.util.*;}} in our 
> codebase yet there is no automatic check for it in the pre-commit hook. 
> We should add one.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Updated] (OOZIE-3277) [build] Check for star imports

2018-10-05 Thread Andras Piros (JIRA)


 [ 
https://issues.apache.org/jira/browse/OOZIE-3277?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Andras Piros updated OOZIE-3277:

Summary: [build] Check for star imports  (was: [build] Check for star 
imports in patches in pre-commit)

> [build] Check for star imports
> --
>
> Key: OOZIE-3277
> URL: https://issues.apache.org/jira/browse/OOZIE-3277
> Project: Oozie
>  Issue Type: Improvement
>  Components: build
>Reporter: Peter Cseh
>Assignee: Julia Kinga Marton
>Priority: Minor
>  Labels: newbie
> Attachments: OOZIE-3277-001.patch, OOZIE-3277-002.patch
>
>
> We don't like to have star imports like {{import java.util.*;}} in our 
> codebase yet there is no automatic check for it in the pre-commit hook. 
> We should add one.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Commented] (OOZIE-3277) [build] Check for star imports in patches in pre-commit

2018-10-05 Thread Julia Kinga Marton (JIRA)


[ 
https://issues.apache.org/jira/browse/OOZIE-3277?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16639759#comment-16639759
 ] 

Julia Kinga Marton commented on OOZIE-3277:
---

[~andras.piros], the long line is the following one: 
{code:java}
longLines=$(grep "^+" "${PATCHFILE}" | grep -v "^+++" | awk 'BEGIN{count=0}{if 
( length > 133 ) { count=count+1} }END{ print count}'){code}
This line is an old one, I have addressed a shell check issue, this is why is 
reported. However, I prefer to have it a little longer than splitted, because I 
consider it more readable this way.

> [build] Check for star imports in patches in pre-commit
> ---
>
> Key: OOZIE-3277
> URL: https://issues.apache.org/jira/browse/OOZIE-3277
> Project: Oozie
>  Issue Type: Improvement
>  Components: build
>Reporter: Peter Cseh
>Assignee: Julia Kinga Marton
>Priority: Minor
>  Labels: newbie
> Attachments: OOZIE-3277-001.patch, OOZIE-3277-002.patch
>
>
> We don't like to have star imports like {{import java.util.*;}} in our 
> codebase yet there is no automatic check for it in the pre-commit hook. 
> We should add one.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Commented] (OOZIE-3355) Regex based search option for searching workflows in the WFM-View of Ambari

2018-10-05 Thread Denes Bodo (JIRA)


[ 
https://issues.apache.org/jira/browse/OOZIE-3355?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16639515#comment-16639515
 ] 

Denes Bodo commented on OOZIE-3355:
---

[~andras.piros] I have never seen Workflow Manager code, but with [~matijhs] we 
will take a look what can be done.

> Regex based search option for searching workflows in the WFM-View of Ambari
> ---
>
> Key: OOZIE-3355
> URL: https://issues.apache.org/jira/browse/OOZIE-3355
> Project: Oozie
>  Issue Type: New Feature
>  Components: bundle, coordinator, core, tools, ui, workflow
>Affects Versions: 4.2.0
>Reporter: Krishnadevan Purushothaman
>Priority: Critical
>
> *Challenge faced :*
> _{color:#d04437}In the WFM view of ambari, there is no Filter option 
> available to search for the Workflows. In order to search for the desired 
> workflow, one has to type the full name of workflow,coordinator,bundles else 
> it does not return anything which becomes a time-consuming job.{color}_
> *Feature description:*
> _{color:#14892c}There is a need for Regex based filter option in order to 
> search the workflows without the need of entering the complete name of the 
> workflow,coordinator,bundles rather by just typing the first three letters of 
> the work post which it should populate suggestions based on the first three 
> letters of the workflow,coordinator,bundles through which we can refine and 
> optimize the searching mechanism.{color}_



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Created] (OOZIE-3359) Check for Process#waitFor() usage and fix it in order to avoid indefinite waiting

2018-10-05 Thread Julia Kinga Marton (JIRA)
Julia Kinga Marton created OOZIE-3359:
-

 Summary: Check for Process#waitFor() usage and fix it in order to 
avoid indefinite waiting
 Key: OOZIE-3359
 URL: https://issues.apache.org/jira/browse/OOZIE-3359
 Project: Oozie
  Issue Type: Improvement
Affects Versions: trunk
Reporter: Julia Kinga Marton
Assignee: Julia Kinga Marton
 Fix For: 5.2.0


{{Process#waitFor()}} will block until the process finishes. There are 
situations where this will wait indefinitely. A similar case was in 
SshActionExecutor, fixed in OOZIE-3354.

Let's check the code for other usages, and fix it.

Maybe we should check if we can use somehow the Process#waitFor(long timeout, 
TimeUnit timeUnit) instead of it. The tricky part is that this method is 
available only in Java 8. 



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] Subscription: Oozie Patch Available

2018-10-05 Thread jira
Issue Subscription
Filter: Oozie Patch Available (90 issues)

Subscriber: ooziedaily

Key Summary
OOZIE-3338  Remove SVN references
https://issues.apache.org/jira/browse/OOZIE-3338
OOZIE-3326  Sqoop Action should support tez delegation tokens for hive-import
https://issues.apache.org/jira/browse/OOZIE-3326
OOZIE-3320  Oozie ShellAction should support absolute bash file path
https://issues.apache.org/jira/browse/OOZIE-3320
OOZIE-3319  Log SSH action callback error output
https://issues.apache.org/jira/browse/OOZIE-3319
OOZIE-3301  Update NOTICE file
https://issues.apache.org/jira/browse/OOZIE-3301
OOZIE-3277  [build] Check for star imports in patches in pre-commit
https://issues.apache.org/jira/browse/OOZIE-3277
OOZIE-3274  Remove slf4j
https://issues.apache.org/jira/browse/OOZIE-3274
OOZIE-3266  Coord action rerun support RERUN_SKIP_NODES option
https://issues.apache.org/jira/browse/OOZIE-3266
OOZIE-3265  properties RERUN_FAIL_NODES and RERUN_SKIP_NODES should be able to 
appear together
https://issues.apache.org/jira/browse/OOZIE-3265
OOZIE-3256  refactor OozieCLI class
https://issues.apache.org/jira/browse/OOZIE-3256
OOZIE-3249  [tools] Instrumentation log parser
https://issues.apache.org/jira/browse/OOZIE-3249
OOZIE-3218  Oozie Sqoop action with command splits the select clause into 
multiple parts due to delimiter being space
https://issues.apache.org/jira/browse/OOZIE-3218
OOZIE-3199  Let system property restriction configurable
https://issues.apache.org/jira/browse/OOZIE-3199
OOZIE-3196  Authorization: restrict world readability by user
https://issues.apache.org/jira/browse/OOZIE-3196
OOZIE-3194  Oozie should set proper permissions to sharelib after upload
https://issues.apache.org/jira/browse/OOZIE-3194
OOZIE-3186  Oozie is unable to use configuration linked using jceks://file/...
https://issues.apache.org/jira/browse/OOZIE-3186
OOZIE-3179  Adding a configurable config-default.xml location to a workflow
https://issues.apache.org/jira/browse/OOZIE-3179
OOZIE-3170  Oozie Diagnostic Bundle tool fails with NPE due to missing service 
class
https://issues.apache.org/jira/browse/OOZIE-3170
OOZIE-3135  Configure log4j2 in SqoopMain
https://issues.apache.org/jira/browse/OOZIE-3135
OOZIE-3120  maven-assembly-plugin fails when bumped from 2.2.1
https://issues.apache.org/jira/browse/OOZIE-3120
OOZIE-3091  Oozie Sqoop Avro Import fails with "java.lang.NoClassDefFoundError: 
org/apache/avro/mapred/AvroWrapper"
https://issues.apache.org/jira/browse/OOZIE-3091
OOZIE-3071  Oozie 4.3 Spark sharelib ueses a different version of commons-lang3 
than Spark 2.2.0
https://issues.apache.org/jira/browse/OOZIE-3071
OOZIE-3063  Sanitizing variables that are part of openjpa.ConnectionProperties
https://issues.apache.org/jira/browse/OOZIE-3063
OOZIE-3062  Set HADOOP_CONF_DIR for spark action
https://issues.apache.org/jira/browse/OOZIE-3062
OOZIE-2952  Fix Findbugs warnings in oozie-sharelib-oozie
https://issues.apache.org/jira/browse/OOZIE-2952
OOZIE-2949  Escape quotes whitespaces in Sqoop  field
https://issues.apache.org/jira/browse/OOZIE-2949
OOZIE-2927  Append new line character for Hive2 query using query tag
https://issues.apache.org/jira/browse/OOZIE-2927
OOZIE-2834  ParameterVerifier logging non-useful warning for workflow definition
https://issues.apache.org/jira/browse/OOZIE-2834
OOZIE-2833  when using uber mode the regex pattern used in the 
extractHeapSizeMB method does not allow heap sizes specified in bytes.
https://issues.apache.org/jira/browse/OOZIE-2833
OOZIE-2812  SparkConfigurationService should support loading configurations 
from multiple Spark versions
https://issues.apache.org/jira/browse/OOZIE-2812
OOZIE-2795  Create lib directory or symlink for Oozie CLI during packaging
https://issues.apache.org/jira/browse/OOZIE-2795
OOZIE-2784  Include WEEK as a parameter in the Coordinator Expression Language 
Evaulator
https://issues.apache.org/jira/browse/OOZIE-2784
OOZIE-2779  Mask Hive2 action Beeline JDBC password
https://issues.apache.org/jira/browse/OOZIE-2779
OOZIE-2736  Reduce the number of threads during test execution
https://issues.apache.org/jira/browse/OOZIE-2736
OOZIE-2714  Detect conflicting resources during class loading
https://issues.apache.org/jira/browse/OOZIE-2714
OOZIE-2694  Add logging for FsActionExecutor 
https://issues.apache.org/jira/browse/OOZIE-2694
OOZIE-2693  SimpleHCatDependencyCache.removeMissingDependency can throw NPE
https://issues.apache.org/jira/browse/OOZIE-2693
OOZIE-2692  Oozie job submit doesn't report error message to user if