[jira] [Commented] (OOZIE-3578) MapReduce counters cannot be used over 120

2020-01-08 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/OOZIE-3578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17010531#comment-17010531 ] Peter Bacsko commented on OOZIE-3578: - Thanks [~dionusos] IMO the patch is good. Just a couple

[jira] [Commented] (OOZIE-3561) Forkjoin validation is slow when there are many actions in chain

2019-11-27 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/OOZIE-3561?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16983414#comment-16983414 ] Peter Bacsko commented on OOZIE-3561: - Good to hear. [~asalamon74] please review patch v3 and commit

[jira] [Updated] (OOZIE-3561) Forkjoin validation is slow when there are many actions in chain

2019-11-26 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/OOZIE-3561?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated OOZIE-3561: Attachment: (was: OOZIE-3561-004.patch) > Forkjoin validation is slow when there are m

[jira] [Updated] (OOZIE-3561) Forkjoin validation is slow when there are many actions in chain

2019-11-26 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/OOZIE-3561?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated OOZIE-3561: Attachment: OOZIE-3561-003.patch > Forkjoin validation is slow when there are many acti

[jira] [Commented] (OOZIE-3561) Forkjoin validation is slow when there are many actions in chain

2019-11-25 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/OOZIE-3561?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16981480#comment-16981480 ] Peter Bacsko commented on OOZIE-3561: - _"Just store the {{NodeDef}} object in the set, not a s

[jira] [Updated] (OOZIE-3561) Forkjoin validation is slow when there are many actions in chain

2019-11-25 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/OOZIE-3561?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated OOZIE-3561: Attachment: OOZIE-3561-002.patch > Forkjoin validation is slow when there are many acti

Re: [VOTE] Release Oozie 5.2.0 (candidate 0)

2019-11-25 Thread Peter Bacsko
Hi all, I did the following: 1. Downloaded the package 2. Built the distro with tests (didn't see failures) under Ubuntu 18.04, JDK8 3. Integrated Oozie with 3-node Hadoop cluster running version 2.9.2 4. Run the MapReduce example I didn't have much time to do anything else. I'm giving a +1

[jira] [Commented] (OOZIE-3561) Forkjoin validation is slow when there are many actions in chain

2019-11-22 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/OOZIE-3561?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16980123#comment-16980123 ] Peter Bacsko commented on OOZIE-3561: - [~dionusos] thanks for the patch, I believe

[jira] [Comment Edited] (OOZIE-3561) Forkjoin validation is slow when there are many actions in chain

2019-11-21 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/OOZIE-3561?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16979310#comment-16979310 ] Peter Bacsko edited comment on OOZIE-3561 at 11/22/19 6:59 AM: --- I

[jira] [Commented] (OOZIE-3561) Forkjoin validation is slow when there are many actions in chain

2019-11-21 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/OOZIE-3561?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16979354#comment-16979354 ] Peter Bacsko commented on OOZIE-3561: - So, as we discussed in private, the problem is that the "

[jira] [Commented] (OOZIE-3561) Forkjoin validation is slow when there are many actions in chain

2019-11-21 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/OOZIE-3561?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16979310#comment-16979310 ] Peter Bacsko commented on OOZIE-3561: - I refactored the validator 3 years ago, so I had to check

[jira] [Commented] (OOZIE-3561) Forkjoin validation is slow when there are many actions in chain

2019-11-21 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/OOZIE-3561?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16979305#comment-16979305 ] Peter Bacsko commented on OOZIE-3561: - [~dionusos] I don't exactly understand the theory. In your

[jira] [Updated] (OOZIE-2586) Eliminate Thread.sleep() calls from TestCoordPushDependencyCheckXCommand

2019-09-12 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/OOZIE-2586?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated OOZIE-2586: Parent: OOZIE-3111 Issue Type: Sub-task (was: Bug) > Eliminate Thread.sleep() calls f

[jira] [Comment Edited] (OOZIE-3512) Flaky test TestActionStartXCommand.testActionWithEscapedStringAndCDATA

2019-07-22 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/OOZIE-3512?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16890154#comment-16890154 ] Peter Bacsko edited comment on OOZIE-3512 at 7/22/19 3:37 PM: -- Usually

[jira] [Commented] (OOZIE-2566) TestCoordActionInputCheckXCommand.testCoordActionInputCheckXCommandUniqueness() is flaky

2019-07-22 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/OOZIE-2566?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16890156#comment-16890156 ] Peter Bacsko commented on OOZIE-2566: - [~asalamon74] I don't have a definite answer

[jira] [Commented] (OOZIE-3512) Flaky test TestActionStartXCommand.testActionWithEscapedStringAndCDATA

2019-07-22 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/OOZIE-3512?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16890154#comment-16890154 ] Peter Bacsko commented on OOZIE-3512: - Usually an application stays in ACCEPTED state

[jira] [Commented] (OOZIE-2566) TestCoordActionInputCheckXCommand.testCoordActionInputCheckXCommandUniqueness() is flaky

2019-07-22 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/OOZIE-2566?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16890073#comment-16890073 ] Peter Bacsko commented on OOZIE-2566: - [~asalamon74] can't you replace this 200ms delay with some

[jira] [Commented] (OOZIE-3478) Oozie needs execute permission on the submitting users home directory

2019-05-06 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/OOZIE-3478?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16833978#comment-16833978 ] Peter Bacsko commented on OOZIE-3478: - +1 LGTM > Oozie needs execute permission on the submitt

[jira] [Commented] (OOZIE-3478) Oozie needs execute permission on the submitting users home directory

2019-05-03 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/OOZIE-3478?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16832552#comment-16832552 ] Peter Bacsko commented on OOZIE-3478: - I suggest using {{UserGroupInformationService.getProxyUser

Re: Review Request 68317: Sqoop Action should support tez delegation tokens for hive-import

2019-02-19 Thread Peter Bacsko via Review Board
> On febr. 18, 2019, 8:43 du, Peter Bacsko wrote: > > sharelib/oozie/src/main/java/org/apache/oozie/action/hadoop/LauncherAM.java > > Lines 94-96 (patched) > > <https://reviews.apache.org/r/68317/diff/6/?file=2125751#file2125751line94> > > > > I th

Re: Review Request 68317: Sqoop Action should support tez delegation tokens for hive-import

2019-02-18 Thread Peter Bacsko via Review Board
lib/oozie/src/main/java/org/apache/oozie/action/hadoop/SystemEnvironment.java Lines 25 (patched) <https://reviews.apache.org/r/68317/#comment298786> See my comment at LauncherAM.java - this can be eliminated. - Peter Bacsko On febr. 15, 2019, 11:33 de, D

[jira] [Comment Edited] (OOZIE-3350) Forkjoin validation does not fail if a node is reachable from two different forks

2018-12-17 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/OOZIE-3350?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16723087#comment-16723087 ] Peter Bacsko edited comment on OOZIE-3350 at 12/17/18 3:37 PM

[jira] [Commented] (OOZIE-3350) Forkjoin validation does not fail if a node is reachable from two different forks

2018-12-17 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/OOZIE-3350?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16723087#comment-16723087 ] Peter Bacsko commented on OOZIE-3350: - [~andras.piros] basically the idea is what I outlined above

Re: [VOTE] Release Oozie 5.1.0 (candidate 2)

2018-12-12 Thread Peter Bacsko
+1 (binding, conditional) - verified hash - verified signature - built distro & ran all tests - created Hadoop pseudo dist cluster, executed sample Java workflow Things I observed: 1. TestPyspark constantly fails locally, but passes in Jenkins. Please investigate that it's a test failure and

[jira] [Commented] (OOZIE-3252) Flaky test TestPurgeXCommand#testPurgeBundleWithCoordChildWithWFChild1

2018-12-04 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/OOZIE-3252?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16709304#comment-16709304 ] Peter Bacsko commented on OOZIE-3252: - [~asalamon74] I saw this during a test execution maybe only

[jira] [Commented] (OOZIE-3350) Forkjoin validation does not fail if a node is reachable from two different forks

2018-11-29 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/OOZIE-3350?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16703142#comment-16703142 ] Peter Bacsko commented on OOZIE-3350: - [~andras.piros] we talked about this with Kinga weeks ago

[jira] [Comment Edited] (OOZIE-3380) TestCoordMaterializeTransitionXCommand failure after DST change date

2018-11-12 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/OOZIE-3380?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16684016#comment-16684016 ] Peter Bacsko edited comment on OOZIE-3380 at 11/12/18 4:15 PM: --- {noformat

[jira] [Commented] (OOZIE-3380) TestCoordMaterializeTransitionXCommand failure after DST change date

2018-11-12 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/OOZIE-3380?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16684016#comment-16684016 ] Peter Bacsko commented on OOZIE-3380: - {noformat} private static final int TIME_IN_MIN = 60

[jira] [Commented] (OOZIE-3379) Auth token cache file name should include Oozie URL

2018-11-09 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/OOZIE-3379?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16681400#comment-16681400 ] Peter Bacsko commented on OOZIE-3379: - [~zuston] can you create a ReviewBoard review for this patch

[jira] [Commented] (OOZIE-3377) [docs] Remaining 5.1.0 documentation changes

2018-11-05 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/OOZIE-3377?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16675030#comment-16675030 ] Peter Bacsko commented on OOZIE-3377: - +1 > [docs] Remaining 5.1.0 documentation chan

Re: Review Request 69251: OOZIE-3377 [docs] Remaining 5.1.0 documentation changes

2018-11-05 Thread Peter Bacsko via Review Board
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/69251/#review210321 --- Ship it! Ship It! - Peter Bacsko On nov. 5, 2018, dél

[jira] [Comment Edited] (OOZIE-3350) Forkjoin validation does not fail if a node is reachable from two different forks

2018-10-31 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/OOZIE-3350?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16670061#comment-16670061 ] Peter Bacsko edited comment on OOZIE-3350 at 10/31/18 1:05 PM: --- This looks

[jira] [Updated] (OOZIE-3350) Forkjoin validation does not fail if a node is reachable from two different forks

2018-10-31 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/OOZIE-3350?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated OOZIE-3350: Summary: Forkjoin validation does not fail if a node is reachable from two different forks

[jira] [Commented] (OOZIE-3350) Forkjoin validation does not fail if a node is reachable from two different forks

2018-10-31 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/OOZIE-3350?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16670074#comment-16670074 ] Peter Bacsko commented on OOZIE-3350: - Changed the title of the JIRA to be more accurate. > Forkj

[jira] [Commented] (OOZIE-3350) forkjoin validation error when "multiple ok to same node" under decision node

2018-10-31 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/OOZIE-3350?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16670069#comment-16670069 ] Peter Bacsko commented on OOZIE-3350: - [~andras.piros] please join the discussion and share your

[jira] [Commented] (OOZIE-3350) forkjoin validation error when "multiple ok to same node" under decision node

2018-10-31 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/OOZIE-3350?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16670061#comment-16670061 ] Peter Bacsko commented on OOZIE-3350: - This looks like a valid problem. It's true that we only store

[jira] [Commented] (OOZIE-3371) TestSubWorkflowActionExecutor#testSubWorkflowRerun() is flaky

2018-10-25 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/OOZIE-3371?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16663521#comment-16663521 ] Peter Bacsko commented on OOZIE-3371: - Looks fairly trivial, +1 > TestSubWorkflowActionExecu

[jira] [Commented] (OOZIE-3369) [core] Upgrade guru.nidi:graphviz-java to 0.7.0

2018-10-15 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/OOZIE-3369?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16650435#comment-16650435 ] Peter Bacsko commented on OOZIE-3369: - +1 > [core] Upgrade guru.nidi:graphviz-java to 0.

[jira] [Updated] (OOZIE-3137) Add support for log4j2 in HiveMain

2018-10-10 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/OOZIE-3137?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated OOZIE-3137: Attachment: OOZIE-3137-001.patch > Add support for log4j2 in HiveM

[jira] [Assigned] (OOZIE-3137) Add support for log4j2 in HiveMain

2018-10-10 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/OOZIE-3137?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko reassigned OOZIE-3137: --- Assignee: Peter Bacsko (was: Julia Kinga Marton) > Add support for log4j2 in HiveM

[jira] [Comment Edited] (OOZIE-3136) Upgrade from Log4j 1.x to 2.x

2018-10-10 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/OOZIE-3136?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16644531#comment-16644531 ] Peter Bacsko edited comment on OOZIE-3136 at 10/10/18 6:56 AM: --- So looks

[jira] [Comment Edited] (OOZIE-3136) Upgrade from Log4j 1.x to 2.x

2018-10-10 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/OOZIE-3136?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16644531#comment-16644531 ] Peter Bacsko edited comment on OOZIE-3136 at 10/10/18 6:55 AM: --- So looks

[jira] [Commented] (OOZIE-3136) Upgrade from Log4j 1.x to 2.x

2018-10-10 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/OOZIE-3136?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16644531#comment-16644531 ] Peter Bacsko commented on OOZIE-3136: - So looks like the plan is # Add log4j-api12 dependency

[jira] [Commented] (OOZIE-3136) Upgrade from Log4j 1.x to 2.x

2018-10-09 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/OOZIE-3136?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16643106#comment-16643106 ] Peter Bacsko commented on OOZIE-3136: - Well, yeah, we do access log4j directly: https://github.com

[jira] [Comment Edited] (OOZIE-3136) Upgrade from Log4j 1.x to 2.x

2018-10-09 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/OOZIE-3136?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16643098#comment-16643098 ] Peter Bacsko edited comment on OOZIE-3136 at 10/9/18 10:29 AM: --- Regarding

[jira] [Commented] (OOZIE-3136) Upgrade from Log4j 1.x to 2.x

2018-10-09 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/OOZIE-3136?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16643098#comment-16643098 ] Peter Bacsko commented on OOZIE-3136: - Regarding the bridge, check this out: https

[jira] [Commented] (OOZIE-3136) Upgrade from Log4j 1.x to 2.x

2018-10-09 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/OOZIE-3136?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16643051#comment-16643051 ] Peter Bacsko commented on OOZIE-3136: - I do agree that we don't have to upgrade right now. That would

[jira] [Commented] (OOZIE-3135) Configure log4j2 in SqoopMain

2018-10-08 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/OOZIE-3135?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16641937#comment-16641937 ] Peter Bacsko commented on OOZIE-3135: - Ya, I missed that. I thought we haven't filed a JIRA

[jira] [Commented] (OOZIE-3136) Upgrade from Log4j 1.x to 2.x

2018-10-08 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/OOZIE-3136?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16641930#comment-16641930 ] Peter Bacsko commented on OOZIE-3136: - HADOOP-12956 proposed a complete migration to Log4j2. I think

[jira] [Commented] (OOZIE-3135) Configure log4j2 in SqoopMain

2018-10-08 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/OOZIE-3135?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16641915#comment-16641915 ] Peter Bacsko commented on OOZIE-3135: - This is exactly what we have to do for Hive as well. They also

[jira] [Commented] (OOZIE-3160) PriorityDelayQueue put()/take() can cause significant CPU load due to busy waiting

2018-10-03 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/OOZIE-3160?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16636705#comment-16636705 ] Peter Bacsko commented on OOZIE-3160: - Please create a new JIRA about investigating why tasks get

[jira] [Commented] (OOZIE-3160) PriorityDelayQueue put()/take() can cause significant CPU load due to busy waiting

2018-10-03 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/OOZIE-3160?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16636702#comment-16636702 ] Peter Bacsko commented on OOZIE-3160: - +1 to the latest amend patch if Jenkins build passes

Re: Review Request 68909: amend OOZIE-3160 PriorityDelayQueue put()/take() can cause significant CPU load due to busy waiting

2018-10-03 Thread Peter Bacsko via Review Board
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/68909/#review209182 --- Ship it! Ship It! - Peter Bacsko On okt. 3, 2018, 9:43 de

[jira] [Commented] (OOZIE-3354) [core] [SSH action] SSH action gets hung

2018-09-28 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/OOZIE-3354?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16631842#comment-16631842 ] Peter Bacsko commented on OOZIE-3354: - +1 > [core] [SSH action] SSH action gets h

[jira] [Commented] (OOZIE-3354) [core] [SSH action] SSH action gets hung

2018-09-28 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/OOZIE-3354?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16631681#comment-16631681 ] Peter Bacsko commented on OOZIE-3354: - Ok, this one looks good. Let's wait for Jenkins then I'll +1

[jira] [Commented] (OOZIE-3354) [core] [SSH action] SSH action gets hung

2018-09-28 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/OOZIE-3354?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16631675#comment-16631675 ] Peter Bacsko commented on OOZIE-3354: - Thoughts from me: 1. Add a short comment that the current

[jira] [Comment Edited] (OOZIE-3353) Add support for WebHDFS token provider

2018-09-27 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/OOZIE-3353?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16628566#comment-16628566 ] Peter Bacsko edited comment on OOZIE-3353 at 9/27/18 2:23 PM: -- I'll add

[jira] [Commented] (OOZIE-3353) Add support for WebHDFS token provider

2018-09-26 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/OOZIE-3353?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16628566#comment-16628566 ] Peter Bacsko commented on OOZIE-3353: - I'll add an example later. But for example, using DistCp

[jira] [Created] (OOZIE-3353) Add support for WebHDFS token provider

2018-09-26 Thread Peter Bacsko (JIRA)
Peter Bacsko created OOZIE-3353: --- Summary: Add support for WebHDFS token provider Key: OOZIE-3353 URL: https://issues.apache.org/jira/browse/OOZIE-3353 Project: Oozie Issue Type: New Feature

[jira] [Commented] (OOZIE-3340) [fluent-job] Create error handler ACTION only if needed

2018-09-25 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/OOZIE-3340?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16627126#comment-16627126 ] Peter Bacsko commented on OOZIE-3340: - +1 LGTM if Jenkins build passes. > [fluent-job] Create er

[jira] [Comment Edited] (OOZIE-3307) [core][oya] Limit heap usage of LauncherAM

2018-09-25 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/OOZIE-3307?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16627053#comment-16627053 ] Peter Bacsko edited comment on OOZIE-3307 at 9/25/18 9:53 AM: -- Test failures

[jira] [Commented] (OOZIE-3307) [core][oya] Limit heap usage of LauncherAM

2018-09-25 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/OOZIE-3307?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16627053#comment-16627053 ] Peter Bacsko commented on OOZIE-3307: - Test failure are unrelated, +1 for this. > [core][oya] Li

Re: Review Request 68737: OOZIE-3307 [core][oya] Limit heap usage of LauncherAM

2018-09-24 Thread Peter Bacsko via Review Board
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/68737/#review208948 --- Ship it! Ship It! - Peter Bacsko On szept. 24, 2018, 3:17

[jira] [Updated] (OOZIE-3352) TestCallableQueueService#testPriorityExecutionOrder() is failing with ConcurrentModification

2018-09-24 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/OOZIE-3352?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated OOZIE-3352: Attachment: OOZIE-3352-002.patch > TestCallableQueueService#testPriorityExecutionOr

[jira] [Updated] (OOZIE-3352) TestCallableQueueService#testPriorityExecutionOrder() is failing with ConcurrentModification

2018-09-24 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/OOZIE-3352?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated OOZIE-3352: Attachment: OOZIE-3352-001.patch > TestCallableQueueService#testPriorityExecutionOr

[jira] [Assigned] (OOZIE-3352) TestCallableQueueService#testPriorityExecutionOrder() is failing with ConcurrentModification

2018-09-24 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/OOZIE-3352?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko reassigned OOZIE-3352: --- Assignee: Peter Bacsko > TestCallableQueueService#testPriorityExecutionOrder() is fail

[jira] [Commented] (OOZIE-3352) TestCallableQueueService#testPriorityExecutionOrder() is failing with ConcurrentModification

2018-09-24 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/OOZIE-3352?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16625745#comment-16625745 ] Peter Bacsko commented on OOZIE-3352: - I'm converting this to a unit test - will upload patch soon

[jira] [Commented] (OOZIE-3352) TestCallableQueueService#testPriorityExecutionOrder() is failing with ConcurrentModification

2018-09-24 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/OOZIE-3352?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16625713#comment-16625713 ] Peter Bacsko commented on OOZIE-3352: - This is probably another test which should be a pure unit test

[jira] [Assigned] (OOZIE-3351) Flaky test TestMemoryLocks#testWriteLockSameThreadNoWait()

2018-09-21 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/OOZIE-3351?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko reassigned OOZIE-3351: --- Assignee: Peter Bacsko > Flaky test TestMemoryLocks#testWriteLockSameThreadNoW

[jira] [Updated] (OOZIE-3351) Flaky test TestMemoryLocks#testWriteLockSameThreadNoWait()

2018-09-21 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/OOZIE-3351?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated OOZIE-3351: Attachment: OOZIE-3351-001.patch > Flaky test TestMemoryLocks#testWriteLockSameThreadNoW

[jira] [Commented] (OOZIE-3351) Flaky test TestMemoryLocks#testWriteLockSameThreadNoWait()

2018-09-21 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/OOZIE-3351?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16623506#comment-16623506 ] Peter Bacsko commented on OOZIE-3351: - This must be an ordering problem in {{SameThreadWriteLocker

[jira] [Commented] (OOZIE-3160) PriorityDelayQueue put()/take() can cause significant CPU load due to busy waiting

2018-09-21 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/OOZIE-3160?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16623360#comment-16623360 ] Peter Bacsko commented on OOZIE-3160: - {{TestCallableQueueService

Re: Review Request 68737: OOZIE-3307 [core][oya] Limit heap usage of LauncherAM

2018-09-20 Thread Peter Bacsko via Review Board
r message. In general, we might better off just check the presence of -Xmx and -Xms and just simply print a general warning to the user, pointing out how heap settings might affect YARN. If it's too much code to parse/calculate simple things, just leave these alone. - Pet

[jira] [Commented] (OOZIE-3349) Test cases in oozie fail with java.net.ConnectException

2018-09-20 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/OOZIE-3349?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16621826#comment-16621826 ] Peter Bacsko commented on OOZIE-3349: - Alright, thanks. > Test cases in oozie f

[jira] [Comment Edited] (OOZIE-3349) Test cases in oozie fail with java.net.ConnectException

2018-09-20 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/OOZIE-3349?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16621713#comment-16621713 ] Peter Bacsko edited comment on OOZIE-3349 at 9/20/18 9:18 AM

[jira] [Commented] (OOZIE-3349) Test cases in oozie fail with java.net.ConnectException

2018-09-20 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/OOZIE-3349?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16621713#comment-16621713 ] Peter Bacsko commented on OOZIE-3349: - [~andras.piros] but we still have to figure out why false

[jira] [Comment Edited] (OOZIE-3349) Test cases in oozie fail with java.net.ConnectException

2018-09-19 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/OOZIE-3349?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16621185#comment-16621185 ] Peter Bacsko edited comment on OOZIE-3349 at 9/19/18 8:49 PM: -- I can't

[jira] [Commented] (OOZIE-3349) Test cases in oozie fail with java.net.ConnectException

2018-09-19 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/OOZIE-3349?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16621185#comment-16621185 ] Peter Bacsko commented on OOZIE-3349: - I can't fathom how that commit could possibly cause

Re: Review Request 68737: OOZIE-3307 [core][oya] Limit heap usage of LauncherAM

2018-09-19 Thread Peter Bacsko via Review Board
yte[] arr = new byte[1_048_576]; arrays.add(arr); } - Peter Bacsko On szept. 18, 2018, 1:06 du, András Piros wrote: > > --- > This is an automatically generated e-mail. To reply, visit: > https:/

Re: Review Request 68737: OOZIE-3307 [core][oya] Limit heap usage of LauncherAM

2018-09-18 Thread Peter Bacsko via Review Board
es 175 (patched) <https://reviews.apache.org/r/68737/#comment292864> Does this really work? ByteBuffer.allocate() returns a HeapByteBuffer instance. However, you don't save its reference, so when it's GC-time, it will be simply collected. In general this allocator co

[jira] [Commented] (OOZIE-3298) OYA: external ID is not filled properly and failing MR job is treated as SUCCEEDED

2018-09-10 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/OOZIE-3298?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16609366#comment-16609366 ] Peter Bacsko commented on OOZIE-3298: - +1 from me, just take care of that Findbugs error. >

Re: Review Request 68237: OOZIE-3298 OYA: external ID is not filled properly and failing MR job is treated as SUCCEEDED

2018-09-10 Thread Peter Bacsko via Review Board
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/68237/#review208483 --- Ship it! Ship It! - Peter Bacsko On szept. 7, 2018, 8:08 de

[jira] [Updated] (OOZIE-3307) Limit heap usage of LauncherAM

2018-09-07 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/OOZIE-3307?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated OOZIE-3307: Component/s: core > Limit heap usage of Launche

Re: Review Request 68237: OOZIE-3298 OYA: external ID is not filled properly and failing MR job is treated as SUCCEEDED

2018-09-06 Thread Peter Bacsko via Review Board
plicationIdFinder.java Lines 43 (patched) <https://reviews.apache.org/r/68237/#comment292337> Interesting... don't you need to add @RunWith(MockitoJunitRunner.class)? Does JUnit4 automatically handle @Mock members? - Peter Bacsko

[jira] [Commented] (OOZIE-3160) PriorityDelayQueue put()/take() can cause significant CPU load due to busy waiting

2018-09-06 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/OOZIE-3160?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16605731#comment-16605731 ] Peter Bacsko commented on OOZIE-3160: - The stability test on a 4-node cluster has passed. I think

Re: Review Request 67885: OOZIE-3160 PriorityDelayQueue put()/take() can cause significant CPU load due to busy waiting

2018-09-05 Thread Peter Bacsko via Review Board
for ASyncXCommandExecutor. 3. Tried it on a 3-node cluster Thanks, Peter Bacsko

Re: Review Request 67885: OOZIE-3160 PriorityDelayQueue put()/take() can cause significant CPU load due to busy waiting

2018-09-05 Thread Peter Bacsko via Review Board
TestCallableQueueService which passed completely. 2. New unit tests for ASyncXCommandExecutor. 3. Tried it on a 3-node cluster Thanks, Peter Bacsko

[jira] [Commented] (OOZIE-3160) PriorityDelayQueue put()/take() can cause significant CPU load due to busy waiting

2018-09-05 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/OOZIE-3160?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16604272#comment-16604272 ] Peter Bacsko commented on OOZIE-3160: - Uploaded patch v7 because accidentally I removed some Findbugs

[jira] [Updated] (OOZIE-3160) PriorityDelayQueue put()/take() can cause significant CPU load due to busy waiting

2018-09-05 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/OOZIE-3160?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated OOZIE-3160: Attachment: OOZIE-3160-007.patch > PriorityDelayQueue put()/take() can cause significant CPU l

Re: Review Request 67885: POC: OOZIE-3160 PriorityDelayQueue put()/take() can cause significant CPU load due to busy waiting

2018-09-04 Thread Peter Bacsko via Review Board
. Tried it on a 3-node cluster Thanks, Peter Bacsko

Re: Review Request 67885: POC: OOZIE-3160 PriorityDelayQueue put()/take() can cause significant CPU load due to busy waiting

2018-09-04 Thread Peter Bacsko via Review Board
/TestCallableQueueService.java 9c2a11d6f Diff: https://reviews.apache.org/r/67885/diff/9/ Testing --- 1. Executed TestCallableQueueService which passed completely. 2. New unit tests for ASyncXCommandExecutor. 3. Tried it on a 3-node cluster Thanks, Peter Bacsko

[jira] [Updated] (OOZIE-3160) PriorityDelayQueue put()/take() can cause significant CPU load due to busy waiting

2018-09-04 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/OOZIE-3160?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated OOZIE-3160: Attachment: OOZIE-3160-006.patch > PriorityDelayQueue put()/take() can cause significant CPU l

[jira] [Commented] (OOZIE-2877) Oozie Git Action

2018-09-04 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/OOZIE-2877?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16603000#comment-16603000 ] Peter Bacsko commented on OOZIE-2877: - +1 for the latest patch.    I think in the current state

Re: Review Request 68505: OOZIE-2877 Git action

2018-09-04 Thread Peter Bacsko via Review Board
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/68505/#review208306 --- Ship it! Ship It! - Peter Bacsko On aug. 31, 2018, 9:50 de

Re: Review Request 67885: POC: OOZIE-3160 PriorityDelayQueue put()/take() can cause significant CPU load due to busy waiting

2018-09-04 Thread Peter Bacsko via Review Board
for ASyncXCommandExecutor. 3. Tried it on a 3-node cluster Thanks, Peter Bacsko

[jira] [Commented] (OOZIE-3160) PriorityDelayQueue put()/take() can cause significant CPU load due to busy waiting

2018-09-04 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/OOZIE-3160?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16602944#comment-16602944 ] Peter Bacsko commented on OOZIE-3160: - Uploaded patch v5 which contains some minor cleanup

[jira] [Updated] (OOZIE-3160) PriorityDelayQueue put()/take() can cause significant CPU load due to busy waiting

2018-09-04 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/OOZIE-3160?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated OOZIE-3160: Attachment: OOZIE-3160-005.patch > PriorityDelayQueue put()/take() can cause significant CPU l

[jira] [Comment Edited] (OOZIE-3307) oozie workflow gets failed throwing error virtual memory limits

2018-09-04 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/OOZIE-3307?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16602855#comment-16602855 ] Peter Bacsko edited comment on OOZIE-3307 at 9/4/18 10:17 AM

[jira] [Comment Edited] (OOZIE-3307) oozie workflow gets failed throwing error virtual memory limits

2018-09-04 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/OOZIE-3307?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16602855#comment-16602855 ] Peter Bacsko edited comment on OOZIE-3307 at 9/4/18 10:16 AM

[jira] [Commented] (OOZIE-3307) oozie workflow gets failed throwing error virtual memory limits

2018-09-04 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/OOZIE-3307?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16602855#comment-16602855 ] Peter Bacsko commented on OOZIE-3307: - [~andras.piros] could you take care of this? # Set {{-Xmx

  1   2   3   4   5   6   7   8   9   10   >