[jira] Subscription: Oozie Patch Available

2017-01-23 Thread jira
Issue Subscription
Filter: Oozie Patch Available (86 issues)

Subscriber: ooziedaily

Key Summary
OOZIE-2619  Make  Hive action defaults to match hive defaults when running from 
command line
https://issues-test.apache.org/jira/browse/OOZIE-2619
OOZIE-2618  Include hive-common in hive-beeline as compile component for 
hive-server2 (hive2 action)
https://issues-test.apache.org/jira/browse/OOZIE-2618
OOZIE-2617  Read properties files in action configurations
https://issues-test.apache.org/jira/browse/OOZIE-2617
OOZIE-2616  Add Tez profile for Hive and Pig sharelibs
https://issues-test.apache.org/jira/browse/OOZIE-2616
OOZIE-2606  Set spark.yarn.jars to fix Spark 2.0 with Oozie
https://issues-test.apache.org/jira/browse/OOZIE-2606
OOZIE-2589  CompletedActionXCommand priority param is of no effect
https://issues-test.apache.org/jira/browse/OOZIE-2589
OOZIE-2588  Support getting credentials for same cluster hcat when credentials 
config is empty
https://issues-test.apache.org/jira/browse/OOZIE-2588
OOZIE-2585  Disable or remove test case 
TestPartitionDependencyManagerEhcache.testMemoryUsageAndSpeedOverflowToDisk and 
testMemoryUsageAndSpeed
https://issues-test.apache.org/jira/browse/OOZIE-2585
OOZIE-2584  Eliminate Thread.sleep() calls in TestMemoryLocks
https://issues-test.apache.org/jira/browse/OOZIE-2584
OOZIE-2583  oozie throws EL Exception when reference variable name containing 
dot
https://issues-test.apache.org/jira/browse/OOZIE-2583
OOZIE-2582  Populating external child Ids for action failures
https://issues-test.apache.org/jira/browse/OOZIE-2582
OOZIE-2573  dataset url  which contains spaces can not be handled rightly
https://issues-test.apache.org/jira/browse/OOZIE-2573
OOZIE-2572  SLA DURATION miss not shown when job is running for longer than 
expected time
https://issues-test.apache.org/jira/browse/OOZIE-2572
OOZIE-2571  Add scala.binary.version Maven property so that Scala 2.11 can be 
used
https://issues-test.apache.org/jira/browse/OOZIE-2571
OOZIE-2569  Adding yarn-site, core-site, hdfs-site and mapred-site into spark 
launcher 
https://issues-test.apache.org/jira/browse/OOZIE-2569
OOZIE-2568  SSH  action pretends to retry automaticly when it failed
https://issues-test.apache.org/jira/browse/OOZIE-2568
OOZIE-2564  Create new log4j config for unit tests so that logged messages 
contain threads
https://issues-test.apache.org/jira/browse/OOZIE-2564
OOZIE-2552  Update ActiveMQ version for security and other fixes
https://issues-test.apache.org/jira/browse/OOZIE-2552
OOZIE-2538  Update HttpClient versions to close security vulnerabilities
https://issues-test.apache.org/jira/browse/OOZIE-2538
OOZIE-2534  Versioned action libs (similar to how SharedLibs works)
https://issues-test.apache.org/jira/browse/OOZIE-2534
OOZIE-2530  Remove jline from parent and sharelib pig pom
https://issues-test.apache.org/jira/browse/OOZIE-2530
OOZIE-2528  Print out environment variables in LauncherMapper
https://issues-test.apache.org/jira/browse/OOZIE-2528
OOZIE-2521  Filter options are case sensitive for jobtye=bundle
https://issues-test.apache.org/jira/browse/OOZIE-2521
OOZIE-2518  Oozie is creating many files and directories in /tmp per day
https://issues-test.apache.org/jira/browse/OOZIE-2518
OOZIE-2517  Add support for startCreatedTime and endCreatedTime filters for 
coord and bundles
https://issues-test.apache.org/jira/browse/OOZIE-2517
OOZIE-2513  log.scan.duration should not be used for error and audit logs
https://issues-test.apache.org/jira/browse/OOZIE-2513
OOZIE-2512  ShareLibservice returns incorrect path for jar
https://issues-test.apache.org/jira/browse/OOZIE-2512
OOZIE-2508  Documentation change for Coord action rerun [OOZIE-1735]
https://issues-test.apache.org/jira/browse/OOZIE-2508
OOZIE-2501  ZK reentrant lock doesn't work for few cases
https://issues-test.apache.org/jira/browse/OOZIE-2501
OOZIE-2500  -DtestJarSimple option mentioned in minioozie doc does not work
https://issues-test.apache.org/jira/browse/OOZIE-2500
OOZIE-2499  map-reduce launcher does not need distributed files, archives 
except  jar of input/outputformat class
https://issues-test.apache.org/jira/browse/OOZIE-2499
OOZIE-2498  Oozie CallerId configuration for downstream components 
https://issues-test.apache.org/jira/browse/OOZIE-2498
OOZIE-2495  change action status from  ErrorType.NON_TRANSIENT to TRANSIENT 
when SSH action occurs AUTH_FAILED occasionally
https://issues-test.apache.org/jira/browse/OOZIE-2495
OOZIE-2491  oozie acl cannot specify group,it does`t work
https://issues-test.apache.org/jira/browse/OOZIE-2491

Build failed in Jenkins: oozie-trunk-precommit-build #3575

2017-01-23 Thread Apache Jenkins Server
See 

--
Started by user puru
[EnvInject] - Loading node environment variables.
Building remotely on H7 (Hadoop) in workspace 

 > git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
 > git config remote.origin.url 
 > https://git-wip-us.apache.org/repos/asf/oozie.git # timeout=10
Fetching upstream changes from https://git-wip-us.apache.org/repos/asf/oozie.git
 > git --version # timeout=10
 > git -c core.askpass=true fetch --tags --progress 
 > https://git-wip-us.apache.org/repos/asf/oozie.git 
 > +refs/heads/*:refs/remotes/origin/*
 > git rev-parse refs/remotes/origin/master^{commit} # timeout=10
 > git rev-parse refs/remotes/origin/origin/master^{commit} # timeout=10
Checking out Revision 2712526de886647a262c2f9ae94b27805fb14d5e 
(refs/remotes/origin/master)
 > git config core.sparsecheckout # timeout=10
 > git checkout -f 2712526de886647a262c2f9ae94b27805fb14d5e
 > git rev-list 2712526de886647a262c2f9ae94b27805fb14d5e # timeout=10
[oozie-trunk-precommit-build] $ /bin/bash /tmp/hudson7969446759135912981.sh
rm: cannot remove 'distro/downloads/*': No such file or directory
rm: invalid option -- '.'
Try 'rm --help' for more information.

Testing JIRA OOZIE-2770

  % Total% Received % Xferd  Average Speed   TimeTime Time  Current
 Dload  Upload   Total   SpentLeft  Speed

  0 00 00 0  0  0 --:--:-- --:--:-- --:--:-- 0
  0 00 00 0  0  0 --:--:-- --:--:-- --:--:-- 0
100 613190 613190 0  55432  0 --:--:--  0:00:01 --:--:-- 55442
OOZIE-2770 is not "Patch Available".  Exiting.

Adding comment to JIRA
Comment added.

test-patch exit code: 1

Build step 'Execute shell' marked build as failure
Archiving artifacts
Recording test results
ERROR: Step ?Publish JUnit test result report? failed: Test reports were found 
but none of them are new. Did tests run? 
For example, 

 is 7 hr 8 min old




Build failed in Jenkins: oozie-trunk-precommit-build #3574

2017-01-23 Thread Apache Jenkins Server
See 

--
Started by user puru
[EnvInject] - Loading node environment variables.
Building remotely on H5 (Hadoop) in workspace 

 > git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
 > git config remote.origin.url 
 > https://git-wip-us.apache.org/repos/asf/oozie.git # timeout=10
Fetching upstream changes from https://git-wip-us.apache.org/repos/asf/oozie.git
 > git --version # timeout=10
 > git -c core.askpass=true fetch --tags --progress 
 > https://git-wip-us.apache.org/repos/asf/oozie.git 
 > +refs/heads/*:refs/remotes/origin/*
 > git rev-parse refs/remotes/origin/master^{commit} # timeout=10
 > git rev-parse refs/remotes/origin/origin/master^{commit} # timeout=10
Checking out Revision 2712526de886647a262c2f9ae94b27805fb14d5e 
(refs/remotes/origin/master)
 > git config core.sparsecheckout # timeout=10
 > git checkout -f 2712526de886647a262c2f9ae94b27805fb14d5e
 > git rev-list 2712526de886647a262c2f9ae94b27805fb14d5e # timeout=10
[oozie-trunk-precommit-build] $ /bin/bash /tmp/hudson5197476242808106447.sh
rm: cannot remove 'distro/downloads/*': No such file or directory
rm: invalid option -- '.'
Try 'rm --help' for more information.

Testing JIRA OOZIE-2770

  % Total% Received % Xferd  Average Speed   TimeTime Time  Current
 Dload  Upload   Total   SpentLeft  Speed

  0 00 00 0  0  0 --:--:-- --:--:-- --:--:-- 0
100 584120 584120 0  86978  0 --:--:-- --:--:-- --:--:-- 87052
OOZIE-2770 is not "Patch Available".  Exiting.

Adding comment to JIRA
Comment added.

test-patch exit code: 1

Build step 'Execute shell' marked build as failure
Archiving artifacts
Recording test results
ERROR: Step ?Publish JUnit test result report? failed: No test report files 
were found. Configuration error?



Re: Review Request 55214: OOZIE-2770 Show missing dependencies for coord actions

2017-01-23 Thread Rohini Palaniswamy

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/55214/#review162727
---


Ship it!




Ship It!

- Rohini Palaniswamy


On Jan. 23, 2017, 10:11 p.m., Purshotam Shah wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/55214/
> ---
> 
> (Updated Jan. 23, 2017, 10:11 p.m.)
> 
> 
> Review request for oozie.
> 
> 
> Bugs: OOZIE-2770
> https://issues.apache.org/jira/browse/OOZIE-2770
> 
> 
> Repository: oozie-git
> 
> 
> Description
> ---
> 
> OOZIE-2770 Show missing dependencies for coord actions
> 
> 
> Diffs
> -
> 
>   client/src/main/java/org/apache/oozie/cli/OozieCLI.java 6e30d7e 
>   client/src/main/java/org/apache/oozie/client/OozieClient.java a107c4a 
>   client/src/main/java/org/apache/oozie/client/rest/JsonTags.java d670142 
>   client/src/main/java/org/apache/oozie/client/rest/RestConstants.java 
> 9a3be97 
>   core/src/main/java/org/apache/oozie/CoordinatorEngine.java 91fe5a1 
>   core/src/main/java/org/apache/oozie/ErrorCode.java 9a843bd 
>   
> core/src/main/java/org/apache/oozie/command/coord/CoordActionMissingDependenciesXCommand.java
>  PRE-CREATION 
>   core/src/main/java/org/apache/oozie/command/coord/CoordCommandUtils.java 
> 0af7edc 
>   
> core/src/main/java/org/apache/oozie/command/coord/CoordSLAAlertsXCommand.java 
> b8affd6 
>   core/src/main/java/org/apache/oozie/coord/CoordUtils.java 82f9bed 
>   
> core/src/main/java/org/apache/oozie/coord/input/dependency/AbstractCoordInputDependency.java
>  0da60ec 
>   
> core/src/main/java/org/apache/oozie/coord/input/dependency/CoordInputDependency.java
>  504bc3d 
>   
> core/src/main/java/org/apache/oozie/coord/input/dependency/CoordOldInputDependency.java
>  aabd2bf 
>   
> core/src/main/java/org/apache/oozie/coord/input/dependency/CoordPullInputDependency.java
>  f20dcae 
>   core/src/main/java/org/apache/oozie/dependency/ActionDependency.java 
> fe7a327 
>   
> core/src/main/java/org/apache/oozie/executor/jpa/CoordActionQueryExecutor.java
>  c0e6c19 
>   core/src/main/java/org/apache/oozie/servlet/BaseJobServlet.java 87a2b42 
>   core/src/main/java/org/apache/oozie/servlet/V0JobServlet.java 0c42128 
>   core/src/main/java/org/apache/oozie/servlet/V1JobServlet.java 95dcca6 
>   core/src/main/java/org/apache/oozie/servlet/V2JobServlet.java 3a0ffb0 
>   core/src/test/java/org/apache/oozie/client/TestOozieCLI.java 8ec38e4 
>   
> core/src/test/java/org/apache/oozie/command/coord/TestCoordActionMissingDependenciesXCommand.java
>  PRE-CREATION 
>   
> core/src/test/java/org/apache/oozie/coord/input/logic/TestCoordInputLogicPush.java
>  6684a1f 
>   
> core/src/test/java/org/apache/oozie/servlet/MockCoordinatorEngineService.java 
> 0e74f2d 
>   core/src/test/resources/coord-multiple-output-instance5.xml PRE-CREATION 
>   docs/src/site/twiki/DG_CommandLineTool.twiki 2dbbd4c 
>   docs/src/site/twiki/WebServicesAPI.twiki 8406da6 
>   webapp/src/main/webapp/oozie-console.js 7b20e91 
> 
> Diff: https://reviews.apache.org/r/55214/diff/
> 
> 
> Testing
> ---
> 
> 
> Thanks,
> 
> Purshotam Shah
> 
>



Re: Review Request 55214: OOZIE-2770 Show missing dependencies for coord actions

2017-01-23 Thread Purshotam Shah

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/55214/
---

(Updated Jan. 23, 2017, 10:11 p.m.)


Review request for oozie.


Bugs: OOZIE-2770
https://issues.apache.org/jira/browse/OOZIE-2770


Repository: oozie-git


Description
---

OOZIE-2770 Show missing dependencies for coord actions


Diffs (updated)
-

  client/src/main/java/org/apache/oozie/cli/OozieCLI.java 6e30d7e 
  client/src/main/java/org/apache/oozie/client/OozieClient.java a107c4a 
  client/src/main/java/org/apache/oozie/client/rest/JsonTags.java d670142 
  client/src/main/java/org/apache/oozie/client/rest/RestConstants.java 9a3be97 
  core/src/main/java/org/apache/oozie/CoordinatorEngine.java 91fe5a1 
  core/src/main/java/org/apache/oozie/ErrorCode.java 9a843bd 
  
core/src/main/java/org/apache/oozie/command/coord/CoordActionMissingDependenciesXCommand.java
 PRE-CREATION 
  core/src/main/java/org/apache/oozie/command/coord/CoordCommandUtils.java 
0af7edc 
  core/src/main/java/org/apache/oozie/command/coord/CoordSLAAlertsXCommand.java 
b8affd6 
  core/src/main/java/org/apache/oozie/coord/CoordUtils.java 82f9bed 
  
core/src/main/java/org/apache/oozie/coord/input/dependency/AbstractCoordInputDependency.java
 0da60ec 
  
core/src/main/java/org/apache/oozie/coord/input/dependency/CoordInputDependency.java
 504bc3d 
  
core/src/main/java/org/apache/oozie/coord/input/dependency/CoordOldInputDependency.java
 aabd2bf 
  
core/src/main/java/org/apache/oozie/coord/input/dependency/CoordPullInputDependency.java
 f20dcae 
  core/src/main/java/org/apache/oozie/dependency/ActionDependency.java fe7a327 
  
core/src/main/java/org/apache/oozie/executor/jpa/CoordActionQueryExecutor.java 
c0e6c19 
  core/src/main/java/org/apache/oozie/servlet/BaseJobServlet.java 87a2b42 
  core/src/main/java/org/apache/oozie/servlet/V0JobServlet.java 0c42128 
  core/src/main/java/org/apache/oozie/servlet/V1JobServlet.java 95dcca6 
  core/src/main/java/org/apache/oozie/servlet/V2JobServlet.java 3a0ffb0 
  core/src/test/java/org/apache/oozie/client/TestOozieCLI.java 8ec38e4 
  
core/src/test/java/org/apache/oozie/command/coord/TestCoordActionMissingDependenciesXCommand.java
 PRE-CREATION 
  
core/src/test/java/org/apache/oozie/coord/input/logic/TestCoordInputLogicPush.java
 6684a1f 
  core/src/test/java/org/apache/oozie/servlet/MockCoordinatorEngineService.java 
0e74f2d 
  core/src/test/resources/coord-multiple-output-instance5.xml PRE-CREATION 
  docs/src/site/twiki/DG_CommandLineTool.twiki 2dbbd4c 
  docs/src/site/twiki/WebServicesAPI.twiki 8406da6 
  webapp/src/main/webapp/oozie-console.js 7b20e91 

Diff: https://reviews.apache.org/r/55214/diff/


Testing
---


Thanks,

Purshotam Shah



Re: Review Request 55214: OOZIE-2770 Show missing dependencies for coord actions

2017-01-23 Thread Purshotam Shah


> On Jan. 23, 2017, 5:48 p.m., Rohini Palaniswamy wrote:
> > core/src/main/java/org/apache/oozie/servlet/V0JobServlet.java, line 231
> > 
> >
> > Accidental revert?

Yes, will fix it.


- Purshotam


---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/55214/#review162661
---


On Jan. 23, 2017, 9:05 a.m., Purshotam Shah wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/55214/
> ---
> 
> (Updated Jan. 23, 2017, 9:05 a.m.)
> 
> 
> Review request for oozie.
> 
> 
> Bugs: OOZIE-2770
> https://issues.apache.org/jira/browse/OOZIE-2770
> 
> 
> Repository: oozie-git
> 
> 
> Description
> ---
> 
> OOZIE-2770 Show missing dependencies for coord actions
> 
> 
> Diffs
> -
> 
>   client/src/main/java/org/apache/oozie/cli/OozieCLI.java 
> 6e30d7eb667fe74440281fab3ca06c9f4df7bcf7 
>   client/src/main/java/org/apache/oozie/client/OozieClient.java 
> a107c4a3224dba76a59b9eb7c1903c0022d553a4 
>   client/src/main/java/org/apache/oozie/client/rest/JsonTags.java 
> d670142f446798f39fbb1cd8c3aed738a0897b18 
>   client/src/main/java/org/apache/oozie/client/rest/RestConstants.java 
> 9a3be979e1acf6fce8dc13ccdf985ce47215cf49 
>   core/src/main/java/org/apache/oozie/CoordinatorEngine.java 
> 91fe5a1d709ba1a90e493d301030465aa35ca790 
>   core/src/main/java/org/apache/oozie/ErrorCode.java 
> 9a843bd0f60ef3b946748adcd45563863c291a60 
>   
> core/src/main/java/org/apache/oozie/command/coord/CoordActionMissingDependenciesXCommand.java
>  e69de29bb2d1d6434b8b29ae775ad8c2e48c5391 
>   core/src/main/java/org/apache/oozie/command/coord/CoordCommandUtils.java 
> 0af7edc9094aaf24a6636ccebea17493e457fcce 
>   
> core/src/main/java/org/apache/oozie/command/coord/CoordSLAAlertsXCommand.java 
> b8affd67a412fac7d4ec452d7e2efa02c62ce25a 
>   core/src/main/java/org/apache/oozie/coord/CoordUtils.java 
> 82f9bede0878b361ffb47d865036573b15448c68 
>   
> core/src/main/java/org/apache/oozie/coord/input/dependency/AbstractCoordInputDependency.java
>  0da60ec70373399414a637c22753da7e2a7e6618 
>   
> core/src/main/java/org/apache/oozie/coord/input/dependency/CoordInputDependency.java
>  504bc3d5f8c48676736cb461462677ddac400d17 
>   
> core/src/main/java/org/apache/oozie/coord/input/dependency/CoordOldInputDependency.java
>  aabd2bf25c99710ce0b025b6b66ae0fd0bb00abf 
>   
> core/src/main/java/org/apache/oozie/coord/input/dependency/CoordPullInputDependency.java
>  f20dcae0ff44d745ffbcb22bce2653d042a65122 
>   core/src/main/java/org/apache/oozie/dependency/ActionDependency.java 
> fe7a3272190718f21aa594188013fadfa9b58646 
>   
> core/src/main/java/org/apache/oozie/executor/jpa/CoordActionQueryExecutor.java
>  c0e6c198f4978744016f35dd8940db345a71f92c 
>   core/src/main/java/org/apache/oozie/servlet/BaseJobServlet.java 
> 87a2b426ad3f5eeb08e76e1be473fdcdf387d293 
>   core/src/main/java/org/apache/oozie/servlet/V0JobServlet.java 
> 0c4212877f3051ef85ca04bb8d2e075b5f9c4c72 
>   core/src/main/java/org/apache/oozie/servlet/V1JobServlet.java 
> 95dcca63c459475b8d41a85e0db11ca2a530a2e4 
>   core/src/main/java/org/apache/oozie/servlet/V2JobServlet.java 
> 3a0ffb0181a0feec31d9aceeea2df5aba0681ae9 
>   core/src/test/java/org/apache/oozie/client/TestOozieCLI.java 
> 8ec38e498f31bb69923125e34cda5abfc8e72aa9 
>   
> core/src/test/java/org/apache/oozie/command/coord/TestCoordActionMissingDependenciesXCommand.java
>  e69de29bb2d1d6434b8b29ae775ad8c2e48c5391 
>   
> core/src/test/java/org/apache/oozie/coord/input/logic/TestCoordInputLogicPush.java
>  6684a1fc7e8d1ed85b9e309cd163ae92f005f281 
>   
> core/src/test/java/org/apache/oozie/servlet/MockCoordinatorEngineService.java 
> 0e74f2d1df67dd5d4aaccbdb66a3829f5894e751 
>   core/src/test/resources/coord-multiple-output-instance5.xml 
> e69de29bb2d1d6434b8b29ae775ad8c2e48c5391 
>   docs/src/site/twiki/DG_CommandLineTool.twiki 
> 2dbbd4c820b9d8e11a51fdfe84185f5a1b3e6707 
>   docs/src/site/twiki/WebServicesAPI.twiki 
> 8406da6ab3bec859a9ef2b889e558f6c9ad1d652 
>   webapp/src/main/webapp/oozie-console.js 
> 7b20e9196cc6129b53fc610d34f6090311474eae 
> 
> Diff: https://reviews.apache.org/r/55214/diff/
> 
> 
> Testing
> ---
> 
> 
> Thanks,
> 
> Purshotam Shah
> 
>



Build failed in Jenkins: oozie-trunk-precommit-build #3572

2017-01-23 Thread Apache Jenkins Server
See 

Changes:

[saley] OOZIE-2776 Log message is repeated twice for hive actions (satishsaley)

--
[...truncated 14729 lines...]
[WARNING] Entry: 
oozie-4.4.0-SNAPSHOT/embedded-oozie-server/webapp/docs/core/apidocs/src-html/org/apache/oozie/sla/listener/SLAJobEventListener.html
 longer than 100 characters.
[WARNING] Entry: 
oozie-4.4.0-SNAPSHOT/embedded-oozie-server/webapp/docs/core/apidocs/src-html/org/apache/oozie/sla/listener/SLAEventListener.html
 longer than 100 characters.
[WARNING] Entry: 
oozie-4.4.0-SNAPSHOT/embedded-oozie-server/webapp/docs/core/apidocs/src-html/org/apache/oozie/sla/listener/SLAEmailEventListener.EmailField.html
 longer than 100 characters.
[WARNING] Entry: 
oozie-4.4.0-SNAPSHOT/embedded-oozie-server/webapp/docs/core/apidocs/src-html/org/apache/oozie/sla/listener/SLAEmailEventListener.html
 longer than 100 characters.
[WARNING] Entry: 
oozie-4.4.0-SNAPSHOT/embedded-oozie-server/webapp/docs/core/apidocs/src-html/org/apache/oozie/sla/SLACalcStatus.html
 longer than 100 characters.
[WARNING] Entry: 
oozie-4.4.0-SNAPSHOT/embedded-oozie-server/webapp/docs/core/apidocs/src-html/org/apache/oozie/sla/SLASummaryBean.html
 longer than 100 characters.
[WARNING] Entry: 
oozie-4.4.0-SNAPSHOT/embedded-oozie-server/webapp/docs/core/apidocs/src-html/org/apache/oozie/sla/SLAOperations.html
 longer than 100 characters.
[WARNING] Entry: 
oozie-4.4.0-SNAPSHOT/embedded-oozie-server/webapp/docs/core/apidocs/src-html/org/apache/oozie/sla/SLARegistrationBean.html
 longer than 100 characters.
[WARNING] Entry: 
oozie-4.4.0-SNAPSHOT/embedded-oozie-server/webapp/docs/core/apidocs/src-html/org/apache/oozie/sla/SLACalculatorMemory.HistoryPurgeWorker.html
 longer than 100 characters.
[WARNING] Entry: 
oozie-4.4.0-SNAPSHOT/embedded-oozie-server/webapp/docs/core/apidocs/src-html/org/apache/oozie/CoordinatorJobInfo.html
 longer than 100 characters.
[WARNING] Entry: 
oozie-4.4.0-SNAPSHOT/embedded-oozie-server/webapp/docs/core/apidocs/src-html/org/apache/oozie/CoordinatorActionInfo.html
 longer than 100 characters.
[WARNING] Entry: 
oozie-4.4.0-SNAPSHOT/embedded-oozie-server/webapp/docs/core/apidocs/src-html/org/apache/oozie/CoordinatorEngine.FILTER_COMPARATORS.html
 longer than 100 characters.
[WARNING] Entry: 
oozie-4.4.0-SNAPSHOT/embedded-oozie-server/webapp/docs/core/apidocs/src-html/org/apache/oozie/BinaryBlob.html
 longer than 100 characters.
[WARNING] Entry: 
oozie-4.4.0-SNAPSHOT/embedded-oozie-server/webapp/docs/core/apidocs/src-html/org/apache/oozie/BundleJobInfo.html
 longer than 100 characters.
[WARNING] Entry: 
oozie-4.4.0-SNAPSHOT/embedded-oozie-server/webapp/docs/core/apidocs/src-html/org/apache/oozie/CoordinatorEngine.html
 longer than 100 characters.
[WARNING] Entry: 
oozie-4.4.0-SNAPSHOT/embedded-oozie-server/webapp/docs/core/apidocs/src-html/org/apache/oozie/BulkResponseInfo.html
 longer than 100 characters.
[WARNING] Entry: 
oozie-4.4.0-SNAPSHOT/embedded-oozie-server/webapp/docs/core/apidocs/src-html/org/apache/oozie/BaseEngine.html
 longer than 100 characters.
[WARNING] Entry: 
oozie-4.4.0-SNAPSHOT/embedded-oozie-server/webapp/docs/core/apidocs/src-html/org/apache/oozie/lock/LockToken.html
 longer than 100 characters.
[WARNING] Entry: 
oozie-4.4.0-SNAPSHOT/embedded-oozie-server/webapp/docs/core/apidocs/src-html/org/apache/oozie/lock/MemoryLocks.html
 longer than 100 characters.
[WARNING] Entry: 
oozie-4.4.0-SNAPSHOT/embedded-oozie-server/webapp/docs/core/apidocs/src-html/org/apache/oozie/StringBlob.html
 longer than 100 characters.
[WARNING] Entry: 
oozie-4.4.0-SNAPSHOT/embedded-oozie-server/webapp/console/sla/css/images/ui-icons_22_256x240.png
 longer than 100 characters.
[WARNING] Entry: 
oozie-4.4.0-SNAPSHOT/embedded-oozie-server/webapp/console/sla/css/images/ui-bg_flat_100_DEECFD_40x100.png
 longer than 100 characters.
[WARNING] Entry: 
oozie-4.4.0-SNAPSHOT/embedded-oozie-server/webapp/console/sla/css/images/ui-bg_highlight-soft_100_ee_1x100.png
 longer than 100 characters.
[WARNING] Entry: 
oozie-4.4.0-SNAPSHOT/embedded-oozie-server/webapp/console/sla/css/images/ui-bg_glass_100_f6f6f6_1x400.png
 longer than 100 characters.
[WARNING] Entry: 
oozie-4.4.0-SNAPSHOT/embedded-oozie-server/webapp/console/sla/css/images/ui-bg_glass_65_ff_1x400.png
 longer than 100 characters.
[WARNING] Entry: 
oozie-4.4.0-SNAPSHOT/embedded-oozie-server/webapp/console/sla/js/table/jquery-ui-1.10.3.custom.min.js
 longer than 100 characters.
[WARNING] Entry: 
oozie-4.4.0-SNAPSHOT/embedded-oozie-server/webapp/console/sla/js/table/jquery-ui-timepicker-addon.js
 longer than 100 characters.
[WARNING] Entry: 
oozie-4.4.0-SNAPSHOT/embedded-oozie-server/webapp/WEB-INF/lib/oozie-sharelib-oozie-4.4.0-SNAPSHOT.jar
 longer than 100 characters.
[WARNING] Entry: 
oozie-4.4.0-SNAPSHOT/embedded-oozie-server/webapp/WEB-INF/lib/oozie-sharelib-hive-4.4.0-SNAPSHOT.jar
 longer than 100 characters.
[WARNING] Entry: 

Build failed in Jenkins: oozie-trunk-precommit-build #3573

2017-01-23 Thread Apache Jenkins Server
See 

--
[...truncated 14701 lines...]
[WARNING] Entry: 
oozie-4.4.0-SNAPSHOT/embedded-oozie-server/webapp/docs/core/apidocs/src-html/org/apache/oozie/action/hadoop/HCatCredentialHelper.html
 longer than 100 characters.
[WARNING] Entry: 
oozie-4.4.0-SNAPSHOT/embedded-oozie-server/webapp/docs/core/apidocs/src-html/org/apache/oozie/action/hadoop/LauncherMapperHelper.html
 longer than 100 characters.
[WARNING] Entry: 
oozie-4.4.0-SNAPSHOT/embedded-oozie-server/webapp/docs/core/apidocs/src-html/org/apache/oozie/action/hadoop/ShellActionExecutor.html
 longer than 100 characters.
[WARNING] Entry: 
oozie-4.4.0-SNAPSHOT/embedded-oozie-server/webapp/docs/core/apidocs/src-html/org/apache/oozie/action/hadoop/CredentialsProviderFactory.html
 longer than 100 characters.
[WARNING] Entry: 
oozie-4.4.0-SNAPSHOT/embedded-oozie-server/webapp/docs/core/apidocs/src-html/org/apache/oozie/action/hadoop/ScriptLanguageActionExecutor.html
 longer than 100 characters.
[WARNING] Entry: 
oozie-4.4.0-SNAPSHOT/embedded-oozie-server/webapp/docs/core/apidocs/src-html/org/apache/oozie/action/hadoop/PigActionExecutor.html
 longer than 100 characters.
[WARNING] Entry: 
oozie-4.4.0-SNAPSHOT/embedded-oozie-server/webapp/docs/core/apidocs/src-html/org/apache/oozie/action/hadoop/HCatCredentials.html
 longer than 100 characters.
[WARNING] Entry: 
oozie-4.4.0-SNAPSHOT/embedded-oozie-server/webapp/docs/core/apidocs/src-html/org/apache/oozie/action/hadoop/JavaActionExecutor.html
 longer than 100 characters.
[WARNING] Entry: 
oozie-4.4.0-SNAPSHOT/embedded-oozie-server/webapp/docs/core/apidocs/src-html/org/apache/oozie/action/hadoop/CredentialException.html
 longer than 100 characters.
[WARNING] Entry: 
oozie-4.4.0-SNAPSHOT/embedded-oozie-server/webapp/docs/core/apidocs/src-html/org/apache/oozie/action/hadoop/FsELFunctions.html
 longer than 100 characters.
[WARNING] Entry: 
oozie-4.4.0-SNAPSHOT/embedded-oozie-server/webapp/docs/core/apidocs/src-html/org/apache/oozie/action/hadoop/DistcpActionExecutor.html
 longer than 100 characters.
[WARNING] Entry: 
oozie-4.4.0-SNAPSHOT/embedded-oozie-server/webapp/docs/core/apidocs/src-html/org/apache/oozie/action/hadoop/HadoopELFunctions.html
 longer than 100 characters.
[WARNING] Entry: 
oozie-4.4.0-SNAPSHOT/embedded-oozie-server/webapp/docs/core/apidocs/src-html/org/apache/oozie/action/hadoop/CredentialsProperties.html
 longer than 100 characters.
[WARNING] Entry: 
oozie-4.4.0-SNAPSHOT/embedded-oozie-server/webapp/docs/core/apidocs/src-html/org/apache/oozie/action/hadoop/MapReduceActionExecutor.html
 longer than 100 characters.
[WARNING] Entry: 
oozie-4.4.0-SNAPSHOT/embedded-oozie-server/webapp/docs/core/apidocs/src-html/org/apache/oozie/action/hadoop/CredentialsProvider.html
 longer than 100 characters.
[WARNING] Entry: 
oozie-4.4.0-SNAPSHOT/embedded-oozie-server/webapp/docs/core/apidocs/src-html/org/apache/oozie/action/hadoop/HbaseCredentials.html
 longer than 100 characters.
[WARNING] Entry: 
oozie-4.4.0-SNAPSHOT/embedded-oozie-server/webapp/docs/core/apidocs/src-html/org/apache/oozie/action/hadoop/FsActionExecutor.html
 longer than 100 characters.
[WARNING] Entry: 
oozie-4.4.0-SNAPSHOT/embedded-oozie-server/webapp/docs/core/apidocs/src-html/org/apache/oozie/action/hadoop/Hive2ActionExecutor.html
 longer than 100 characters.
[WARNING] Entry: 
oozie-4.4.0-SNAPSHOT/embedded-oozie-server/webapp/docs/core/apidocs/src-html/org/apache/oozie/action/hadoop/SparkActionExecutor.html
 longer than 100 characters.
[WARNING] Entry: 
oozie-4.4.0-SNAPSHOT/embedded-oozie-server/webapp/docs/core/apidocs/src-html/org/apache/oozie/action/hadoop/HiveActionExecutor.html
 longer than 100 characters.
[WARNING] Entry: 
oozie-4.4.0-SNAPSHOT/embedded-oozie-server/webapp/docs/core/apidocs/src-html/org/apache/oozie/action/hadoop/OozieJobInfo.html
 longer than 100 characters.
[WARNING] Entry: 
oozie-4.4.0-SNAPSHOT/embedded-oozie-server/webapp/docs/core/apidocs/src-html/org/apache/oozie/action/ActionExecutor.Context.html
 longer than 100 characters.
[WARNING] Entry: 
oozie-4.4.0-SNAPSHOT/embedded-oozie-server/webapp/docs/core/apidocs/src-html/org/apache/oozie/CoordinatorEngine.html
 longer than 100 characters.
[WARNING] Entry: 
oozie-4.4.0-SNAPSHOT/embedded-oozie-server/webapp/docs/core/apidocs/src-html/org/apache/oozie/jms/MessageReceiver.html
 longer than 100 characters.
[WARNING] Entry: 
oozie-4.4.0-SNAPSHOT/embedded-oozie-server/webapp/docs/core/apidocs/src-html/org/apache/oozie/jms/DefaultConnectionContext.html
 longer than 100 characters.
[WARNING] Entry: 
oozie-4.4.0-SNAPSHOT/embedded-oozie-server/webapp/docs/core/apidocs/src-html/org/apache/oozie/jms/ConnectionContext.html
 longer than 100 characters.
[WARNING] Entry: 
oozie-4.4.0-SNAPSHOT/embedded-oozie-server/webapp/docs/core/apidocs/src-html/org/apache/oozie/jms/JMSExceptionListener.html
 longer than 100 characters.
[WARNING] Entry: 

Re: Review Request 51029: OOZIE 2630 Oozie Coordinator EL Functions to get first day of the week/month

2017-01-23 Thread AndrĂ¡s Piros

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/51029/#review162674
---




core/src/main/java/org/apache/oozie/command/coord/CoordCommandUtils.java (line 
283)


Please use `DAY_OF_MONTH` instead and externalize `1` to 
`FIRST_WEEK_OF_MONTH` for better readability.



core/src/main/java/org/apache/oozie/command/coord/CoordCommandUtils.java (line 
302)


Calendars like European ones do not necessarily have Monday as the last day 
of week - use `calendar.getFirstDayOfWeek()` instead.



core/src/main/java/org/apache/oozie/command/coord/CoordSubmitXCommand.java 
(line 747)


Are you sure each and every month consists of exactly 30 days? I think it's 
a bug - I know not in the lines of code you touched, but indeed, maybe worth 
fixing it.



core/src/main/java/org/apache/oozie/util/DateUtils.java (line 307)


Calendars like European ones do not necessarily have Monday as the last day 
of week - use `calendar.getFirstDayOfWeek()` instead.



core/src/test/java/org/apache/oozie/command/coord/TestCoordCommandUtils.java 
(line 521)


You perform too much testing in one single test method.

I'd have as many methods as testing use cases with appropriate naming 
strategy like 
http://osherove.com/blog/2005/4/3/naming-standards-for-unit-tests.html so that 
for every unit test we exactly know what it's testing and what is the expected 
behavior without needing to read the code, just reading the `Exception` logs.



core/src/test/java/org/apache/oozie/command/coord/TestCoordCommandUtils.java 
(line 532)


Extract `DateUtils.parseDateOozieTZ("2009-08-20T01:00Z")` to a well-named 
variable.



core/src/test/java/org/apache/oozie/command/coord/TestCoordCommandUtils.java 
(line 543)


Extract `DateUtils.parseDateOozieTZ("2009-08-01T01:00Z")` to a well-named 
variable.



core/src/test/java/org/apache/oozie/command/coord/TestCoordCommandUtils.java 
(line 549)


Extract `DateUtils.parseDateOozieTZ("2009-08-01T01:00Z")` to a well-named 
variable.



core/src/test/java/org/apache/oozie/command/coord/TestCoordCommandUtils.java 
(line 557)


Extract `DateUtils.parseDateOozieTZ("2009-08-01T01:00Z")` to a well-named 
variable.



core/src/test/java/org/apache/oozie/command/coord/TestCoordCommandUtils.java 
(line 566)


Extract `DateUtils.parseDateOozieTZ("2009-07-01T01:00Z")` to a well-named 
variable.



core/src/test/java/org/apache/oozie/command/coord/TestCoordCommandUtils.java 
(line 575)


Extract `DateUtils.parseDateOozieTZ()` to a well-named variable.



core/src/test/java/org/apache/oozie/command/coord/TestCoordCommandUtils.java 
(lines 580 - 583)


Use JUnit's `ExpectedException` instead:

https://github.com/junit-team/junit4/wiki/exception-testing



core/src/test/java/org/apache/oozie/command/coord/TestCoordCommandUtils.java 
(lines 596 - 599)


Use JUnit's `ExpectedException` instead:

https://github.com/junit-team/junit4/wiki/exception-testing



core/src/test/java/org/apache/oozie/command/coord/TestCoordCommandUtils.java 
(lines 613 - 617)


Use JUnit's `ExpectedException` instead:

https://github.com/junit-team/junit4/wiki/exception-testing



core/src/test/java/org/apache/oozie/command/coord/TestCoordCommandUtils.java 
(lines 679 - 682)


Use JUnit's `ExpectedException` instead:

https://github.com/junit-team/junit4/wiki/exception-testing



core/src/test/java/org/apache/oozie/command/coord/TestCoordCommandUtils.java 
(lines 695 - 698)


Use JUnit's `ExpectedException` instead:

https://github.com/junit-team/junit4/wiki/exception-testing



core/src/test/java/org/apache/oozie/command/coord/TestCoordCommandUtils.java 
(line 710)


Use JUnit's `ExpectedException` instead:

https://github.com/junit-team/junit4/wiki/exception-testing



core/src/test/java/org/apache/oozie/command/coord/TestCoordCommandUtils.java 
(lines 712 - 715)


Use 

Build failed in Jenkins: oozie-trunk-precommit-build #3570

2017-01-23 Thread Apache Jenkins Server
See 

--
[...truncated 14710 lines...]
[WARNING] Entry: 
oozie-4.4.0-SNAPSHOT/embedded-oozie-server/webapp/WEB-INF/lib/oozie-sharelib-spark-4.4.0-SNAPSHOT.jar
 longer than 100 characters.
[WARNING] Entry: 
oozie-4.4.0-SNAPSHOT/embedded-oozie-server/webapp/WEB-INF/lib/hadoop-yarn-server-resourcemanager-2.6.0.jar
 longer than 100 characters.
[WARNING] Entry: 
oozie-4.4.0-SNAPSHOT/embedded-oozie-server/webapp/WEB-INF/lib/oozie-sharelib-streaming-4.4.0-SNAPSHOT.jar
 longer than 100 characters.
[WARNING] Entry: 
oozie-4.4.0-SNAPSHOT/embedded-oozie-server/webapp/WEB-INF/lib/oozie-sharelib-distcp-4.4.0-SNAPSHOT.jar
 longer than 100 characters.
[WARNING] Entry: 
oozie-4.4.0-SNAPSHOT/embedded-oozie-server/webapp/WEB-INF/lib/oozie-sharelib-hive-4.4.0-SNAPSHOT.jar
 longer than 100 characters.
[WARNING] Entry: 
oozie-4.4.0-SNAPSHOT/embedded-oozie-server/webapp/WEB-INF/lib/hadoop-yarn-server-web-proxy-2.6.0.jar
 longer than 100 characters.
[WARNING] Entry: 
oozie-4.4.0-SNAPSHOT/embedded-oozie-server/webapp/WEB-INF/lib/oozie-sharelib-hcatalog-4.4.0-SNAPSHOT.jar
 longer than 100 characters.
[WARNING] Entry: 
oozie-4.4.0-SNAPSHOT/embedded-oozie-server/webapp/WEB-INF/lib/hadoop-yarn-server-applicationhistoryservice-2.6.0.jar
 longer than 100 characters.
[INFO] 
[INFO] 
[INFO] Building Apache Oozie ZooKeeper Security Tests 4.4.0-SNAPSHOT
[INFO] 
[INFO] 
[INFO] --- maven-remote-resources-plugin:1.5:process (default) @ 
oozie-zookeeper-security-tests ---
[INFO] 
[INFO] --- maven-resources-plugin:2.5:resources (default-resources) @ 
oozie-zookeeper-security-tests ---
[debug] execute contextualize
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] skip non existing resourceDirectory 

[INFO] Copying 3 resources
[INFO] 
[INFO] --- maven-compiler-plugin:2.3.2:compile (default-compile) @ 
oozie-zookeeper-security-tests ---
[INFO] No sources to compile
[INFO] 
[INFO] --- maven-resources-plugin:2.5:testResources (default-testResources) @ 
oozie-zookeeper-security-tests ---
[debug] execute contextualize
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] skip non existing resourceDirectory 

[INFO] Copying 3 resources
[INFO] 
[INFO] --- maven-compiler-plugin:2.3.2:testCompile (default-testCompile) @ 
oozie-zookeeper-security-tests ---
[INFO] Nothing to compile - all classes are up to date
[INFO] 
[INFO] --- maven-surefire-plugin:2.12.2:test (default-test) @ 
oozie-zookeeper-security-tests ---
[INFO] Tests are skipped.
[INFO] 
[INFO] --- maven-jar-plugin:2.3.1:jar (default-jar) @ 
oozie-zookeeper-security-tests ---
[INFO] Building jar: 

[INFO] 
[INFO] --- maven-site-plugin:2.0-beta-6:attach-descriptor (attach-descriptor) @ 
oozie-zookeeper-security-tests ---
[INFO] 
[INFO] --- maven-assembly-plugin:2.2.1:single (default-cli) @ 
oozie-zookeeper-security-tests ---
[INFO] Reading assembly descriptor: src/main/assemblies/empty.xml
[INFO] 
[INFO] Reactor Summary:
[INFO] 
[INFO] Apache Oozie Main .. SUCCESS [  1.719 s]
[INFO] Apache Oozie Hadoop Utils hadoop-2-4.4.0-SNAPSHOT .. SUCCESS [  2.468 s]
[INFO] Apache Oozie Hadoop Distcp hadoop-2-4.4.0-SNAPSHOT . SUCCESS [  0.180 s]
[INFO] Apache Oozie Hadoop Auth hadoop-2-4.4.0-SNAPSHOT Test SUCCESS [  0.316 s]
[INFO] Apache Oozie Hadoop Libs ... SUCCESS [  0.029 s]
[INFO] Apache Oozie Client  SUCCESS [ 26.462 s]
[INFO] Apache Oozie Share Lib Oozie ... SUCCESS [  1.931 s]
[INFO] Apache Oozie Share Lib HCatalog  SUCCESS [  2.106 s]
[INFO] Apache Oozie Share Lib Distcp .. SUCCESS [  0.397 s]
[INFO] Apache Oozie Core .. SUCCESS [ 45.931 s]
[INFO] Apache Oozie Share Lib Streaming ... SUCCESS [  3.015 s]
[INFO] Apache Oozie Share Lib Pig . SUCCESS [  2.744 s]
[INFO] Apache Oozie Share Lib Hive  SUCCESS [  4.962 s]
[INFO] Apache Oozie Share Lib Hive 2 .. SUCCESS [  3.919 s]
[INFO] Apache Oozie Share Lib Sqoop ... SUCCESS [  0.601 s]
[INFO] Apache Oozie Examples .. SUCCESS [  2.348 s]
[INFO] Apache Oozie Share Lib Spark 

Build failed in Jenkins: oozie-trunk-precommit-build #3571

2017-01-23 Thread Apache Jenkins Server
See 

--
[...truncated 14734 lines...]
[WARNING] Entry: 
oozie-4.4.0-SNAPSHOT/embedded-oozie-server/webapp/docs/client/apidocs/org/apache/oozie/client/CoordinatorJob.html
 longer than 100 characters.
[WARNING] Entry: 
oozie-4.4.0-SNAPSHOT/embedded-oozie-server/webapp/docs/client/apidocs/org/apache/oozie/client/SLAEvent.SlaAppType.html
 longer than 100 characters.
[WARNING] Entry: 
oozie-4.4.0-SNAPSHOT/embedded-oozie-server/webapp/docs/client/apidocs/org/apache/oozie/client/package-use.html
 longer than 100 characters.
[WARNING] Entry: 
oozie-4.4.0-SNAPSHOT/embedded-oozie-server/webapp/docs/client/apidocs/org/apache/oozie/client/BulkResponse.html
 longer than 100 characters.
[WARNING] Entry: 
oozie-4.4.0-SNAPSHOT/embedded-oozie-server/webapp/docs/client/apidocs/org/apache/oozie/client/rest/JsonToBean.html
 longer than 100 characters.
[WARNING] Entry: 
oozie-4.4.0-SNAPSHOT/embedded-oozie-server/webapp/docs/client/apidocs/org/apache/oozie/client/rest/package-tree.html
 longer than 100 characters.
[WARNING] Entry: 
oozie-4.4.0-SNAPSHOT/embedded-oozie-server/webapp/docs/client/apidocs/org/apache/oozie/client/rest/RestConstants.html
 longer than 100 characters.
[WARNING] Entry: 
oozie-4.4.0-SNAPSHOT/embedded-oozie-server/webapp/docs/client/apidocs/org/apache/oozie/client/rest/package-summary.html
 longer than 100 characters.
[WARNING] Entry: 
oozie-4.4.0-SNAPSHOT/embedded-oozie-server/webapp/docs/client/apidocs/org/apache/oozie/client/rest/JsonTags.html
 longer than 100 characters.
[WARNING] Entry: 
oozie-4.4.0-SNAPSHOT/embedded-oozie-server/webapp/docs/client/apidocs/org/apache/oozie/client/rest/JsonUtils.html
 longer than 100 characters.
[WARNING] Entry: 
oozie-4.4.0-SNAPSHOT/embedded-oozie-server/webapp/docs/client/apidocs/org/apache/oozie/client/rest/class-use/JsonToBean.html
 longer than 100 characters.
[WARNING] Entry: 
oozie-4.4.0-SNAPSHOT/embedded-oozie-server/webapp/docs/client/apidocs/org/apache/oozie/client/rest/class-use/RestConstants.html
 longer than 100 characters.
[WARNING] Entry: 
oozie-4.4.0-SNAPSHOT/embedded-oozie-server/webapp/docs/client/apidocs/org/apache/oozie/client/rest/class-use/JsonTags.html
 longer than 100 characters.
[WARNING] Entry: 
oozie-4.4.0-SNAPSHOT/embedded-oozie-server/webapp/docs/client/apidocs/org/apache/oozie/client/rest/class-use/JsonUtils.html
 longer than 100 characters.
[WARNING] Entry: 
oozie-4.4.0-SNAPSHOT/embedded-oozie-server/webapp/docs/client/apidocs/org/apache/oozie/client/rest/package-frame.html
 longer than 100 characters.
[WARNING] Entry: 
oozie-4.4.0-SNAPSHOT/embedded-oozie-server/webapp/docs/client/apidocs/org/apache/oozie/client/rest/package-use.html
 longer than 100 characters.
[WARNING] Entry: 
oozie-4.4.0-SNAPSHOT/embedded-oozie-server/webapp/docs/client/apidocs/org/apache/oozie/client/JMSConnectionInfo.html
 longer than 100 characters.
[WARNING] Entry: 
oozie-4.4.0-SNAPSHOT/embedded-oozie-server/webapp/docs/client/apidocs/org/apache/oozie/package-frame.html
 longer than 100 characters.
[WARNING] Entry: 
oozie-4.4.0-SNAPSHOT/embedded-oozie-server/webapp/docs/client/apidocs/org/apache/oozie/package-use.html
 longer than 100 characters.
[WARNING] Entry: 
oozie-4.4.0-SNAPSHOT/embedded-oozie-server/webapp/docs/client/apidocs/org/apache/oozie/cli/package-tree.html
 longer than 100 characters.
[WARNING] Entry: 
oozie-4.4.0-SNAPSHOT/embedded-oozie-server/webapp/docs/client/apidocs/org/apache/oozie/cli/OozieCLIException.html
 longer than 100 characters.
[WARNING] Entry: 
oozie-4.4.0-SNAPSHOT/embedded-oozie-server/webapp/docs/client/apidocs/org/apache/oozie/cli/CLIParser.Command.html
 longer than 100 characters.
[WARNING] Entry: 
oozie-4.4.0-SNAPSHOT/embedded-oozie-server/webapp/docs/client/apidocs/org/apache/oozie/cli/package-summary.html
 longer than 100 characters.
[WARNING] Entry: 
oozie-4.4.0-SNAPSHOT/embedded-oozie-server/webapp/docs/client/apidocs/org/apache/oozie/cli/class-use/OozieCLIException.html
 longer than 100 characters.
[WARNING] Entry: 
oozie-4.4.0-SNAPSHOT/embedded-oozie-server/webapp/docs/client/apidocs/org/apache/oozie/cli/class-use/CLIParser.Command.html
 longer than 100 characters.
[WARNING] Entry: 
oozie-4.4.0-SNAPSHOT/embedded-oozie-server/webapp/docs/client/apidocs/org/apache/oozie/cli/class-use/CLIParser.html
 longer than 100 characters.
[WARNING] Entry: 
oozie-4.4.0-SNAPSHOT/embedded-oozie-server/webapp/docs/client/apidocs/org/apache/oozie/cli/class-use/ValidationUtil.html
 longer than 100 characters.
[WARNING] Entry: 
oozie-4.4.0-SNAPSHOT/embedded-oozie-server/webapp/docs/client/apidocs/org/apache/oozie/cli/class-use/OozieCLI.html
 longer than 100 characters.
[WARNING] Entry: 
oozie-4.4.0-SNAPSHOT/embedded-oozie-server/webapp/docs/client/apidocs/org/apache/oozie/cli/package-frame.html
 longer than 100 characters.
[WARNING] Entry: 

Build failed in Jenkins: oozie-trunk-precommit-build #3569

2017-01-23 Thread Apache Jenkins Server
See 

--
[...truncated 14663 lines...]
[WARNING] Entry: 
oozie-4.4.0-SNAPSHOT/embedded-oozie-server/webapp/docs/client/apidocs/org/apache/oozie/client/CoordinatorAction.Status.html
 longer than 100 characters.
[WARNING] Entry: 
oozie-4.4.0-SNAPSHOT/embedded-oozie-server/webapp/docs/client/apidocs/org/apache/oozie/client/retry/ConnectionRetriableClient.html
 longer than 100 characters.
[WARNING] Entry: 
oozie-4.4.0-SNAPSHOT/embedded-oozie-server/webapp/docs/client/apidocs/org/apache/oozie/client/retry/package-tree.html
 longer than 100 characters.
[WARNING] Entry: 
oozie-4.4.0-SNAPSHOT/embedded-oozie-server/webapp/docs/client/apidocs/org/apache/oozie/client/retry/package-summary.html
 longer than 100 characters.
[WARNING] Entry: 
oozie-4.4.0-SNAPSHOT/embedded-oozie-server/webapp/docs/client/apidocs/org/apache/oozie/client/retry/class-use/ConnectionRetriableClient.html
 longer than 100 characters.
[WARNING] Entry: 
oozie-4.4.0-SNAPSHOT/embedded-oozie-server/webapp/docs/client/apidocs/org/apache/oozie/client/retry/package-frame.html
 longer than 100 characters.
[WARNING] Entry: 
oozie-4.4.0-SNAPSHOT/embedded-oozie-server/webapp/docs/client/apidocs/org/apache/oozie/client/retry/package-use.html
 longer than 100 characters.
[WARNING] Entry: 
oozie-4.4.0-SNAPSHOT/embedded-oozie-server/webapp/docs/client/apidocs/org/apache/oozie/client/CoordinatorJob.Timeunit.html
 longer than 100 characters.
[WARNING] Entry: 
oozie-4.4.0-SNAPSHOT/embedded-oozie-server/webapp/docs/client/apidocs/org/apache/oozie/client/OozieClient.SORT_BY.html
 longer than 100 characters.
[WARNING] Entry: 
oozie-4.4.0-SNAPSHOT/embedded-oozie-server/webapp/docs/client/apidocs/org/apache/oozie/client/OozieClient.html
 longer than 100 characters.
[WARNING] Entry: 
oozie-4.4.0-SNAPSHOT/embedded-oozie-server/webapp/docs/client/apidocs/org/apache/oozie/client/WorkflowJob.Status.html
 longer than 100 characters.
[WARNING] Entry: 
oozie-4.4.0-SNAPSHOT/embedded-oozie-server/webapp/docs/client/apidocs/org/apache/oozie/client/CoordinatorJob.html
 longer than 100 characters.
[WARNING] Entry: 
oozie-4.4.0-SNAPSHOT/embedded-oozie-server/webapp/docs/client/apidocs/org/apache/oozie/client/SLAEvent.SlaAppType.html
 longer than 100 characters.
[WARNING] Entry: 
oozie-4.4.0-SNAPSHOT/embedded-oozie-server/webapp/docs/client/apidocs/org/apache/oozie/client/package-use.html
 longer than 100 characters.
[WARNING] Entry: 
oozie-4.4.0-SNAPSHOT/embedded-oozie-server/webapp/docs/client/apidocs/org/apache/oozie/client/BulkResponse.html
 longer than 100 characters.
[WARNING] Entry: 
oozie-4.4.0-SNAPSHOT/embedded-oozie-server/webapp/docs/client/apidocs/org/apache/oozie/client/rest/JsonToBean.html
 longer than 100 characters.
[WARNING] Entry: 
oozie-4.4.0-SNAPSHOT/embedded-oozie-server/webapp/docs/client/apidocs/org/apache/oozie/client/rest/package-tree.html
 longer than 100 characters.
[WARNING] Entry: 
oozie-4.4.0-SNAPSHOT/embedded-oozie-server/webapp/docs/client/apidocs/org/apache/oozie/client/rest/RestConstants.html
 longer than 100 characters.
[WARNING] Entry: 
oozie-4.4.0-SNAPSHOT/embedded-oozie-server/webapp/docs/client/apidocs/org/apache/oozie/client/rest/package-summary.html
 longer than 100 characters.
[WARNING] Entry: 
oozie-4.4.0-SNAPSHOT/embedded-oozie-server/webapp/docs/client/apidocs/org/apache/oozie/client/rest/JsonTags.html
 longer than 100 characters.
[WARNING] Entry: 
oozie-4.4.0-SNAPSHOT/embedded-oozie-server/webapp/docs/client/apidocs/org/apache/oozie/client/rest/JsonUtils.html
 longer than 100 characters.
[WARNING] Entry: 
oozie-4.4.0-SNAPSHOT/embedded-oozie-server/webapp/docs/client/apidocs/org/apache/oozie/client/rest/class-use/JsonToBean.html
 longer than 100 characters.
[WARNING] Entry: 
oozie-4.4.0-SNAPSHOT/embedded-oozie-server/webapp/docs/client/apidocs/org/apache/oozie/client/rest/class-use/RestConstants.html
 longer than 100 characters.
[WARNING] Entry: 
oozie-4.4.0-SNAPSHOT/embedded-oozie-server/webapp/docs/client/apidocs/org/apache/oozie/client/rest/class-use/JsonTags.html
 longer than 100 characters.
[WARNING] Entry: 
oozie-4.4.0-SNAPSHOT/embedded-oozie-server/webapp/docs/client/apidocs/org/apache/oozie/client/rest/class-use/JsonUtils.html
 longer than 100 characters.
[WARNING] Entry: 
oozie-4.4.0-SNAPSHOT/embedded-oozie-server/webapp/docs/client/apidocs/org/apache/oozie/client/rest/package-frame.html
 longer than 100 characters.
[WARNING] Entry: 
oozie-4.4.0-SNAPSHOT/embedded-oozie-server/webapp/docs/client/apidocs/org/apache/oozie/client/rest/package-use.html
 longer than 100 characters.
[WARNING] Entry: 
oozie-4.4.0-SNAPSHOT/embedded-oozie-server/webapp/docs/client/apidocs/org/apache/oozie/client/JMSConnectionInfo.html
 longer than 100 characters.
[WARNING] Entry: 
oozie-4.4.0-SNAPSHOT/embedded-oozie-server/webapp/docs/client/apidocs/org/apache/oozie/package-frame.html
 longer than 100 characters.
[WARNING] Entry: 

Re: Review Request 55214: OOZIE-2770 Show missing dependencies for coord actions

2017-01-23 Thread Rohini Palaniswamy

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/55214/#review162661
---




core/src/main/java/org/apache/oozie/servlet/V0JobServlet.java (line 231)


Accidental revert?


- Rohini Palaniswamy


On Jan. 23, 2017, 9:05 a.m., Purshotam Shah wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/55214/
> ---
> 
> (Updated Jan. 23, 2017, 9:05 a.m.)
> 
> 
> Review request for oozie.
> 
> 
> Bugs: OOZIE-2770
> https://issues.apache.org/jira/browse/OOZIE-2770
> 
> 
> Repository: oozie-git
> 
> 
> Description
> ---
> 
> OOZIE-2770 Show missing dependencies for coord actions
> 
> 
> Diffs
> -
> 
>   client/src/main/java/org/apache/oozie/cli/OozieCLI.java 
> 6e30d7eb667fe74440281fab3ca06c9f4df7bcf7 
>   client/src/main/java/org/apache/oozie/client/OozieClient.java 
> a107c4a3224dba76a59b9eb7c1903c0022d553a4 
>   client/src/main/java/org/apache/oozie/client/rest/JsonTags.java 
> d670142f446798f39fbb1cd8c3aed738a0897b18 
>   client/src/main/java/org/apache/oozie/client/rest/RestConstants.java 
> 9a3be979e1acf6fce8dc13ccdf985ce47215cf49 
>   core/src/main/java/org/apache/oozie/CoordinatorEngine.java 
> 91fe5a1d709ba1a90e493d301030465aa35ca790 
>   core/src/main/java/org/apache/oozie/ErrorCode.java 
> 9a843bd0f60ef3b946748adcd45563863c291a60 
>   
> core/src/main/java/org/apache/oozie/command/coord/CoordActionMissingDependenciesXCommand.java
>  e69de29bb2d1d6434b8b29ae775ad8c2e48c5391 
>   core/src/main/java/org/apache/oozie/command/coord/CoordCommandUtils.java 
> 0af7edc9094aaf24a6636ccebea17493e457fcce 
>   
> core/src/main/java/org/apache/oozie/command/coord/CoordSLAAlertsXCommand.java 
> b8affd67a412fac7d4ec452d7e2efa02c62ce25a 
>   core/src/main/java/org/apache/oozie/coord/CoordUtils.java 
> 82f9bede0878b361ffb47d865036573b15448c68 
>   
> core/src/main/java/org/apache/oozie/coord/input/dependency/AbstractCoordInputDependency.java
>  0da60ec70373399414a637c22753da7e2a7e6618 
>   
> core/src/main/java/org/apache/oozie/coord/input/dependency/CoordInputDependency.java
>  504bc3d5f8c48676736cb461462677ddac400d17 
>   
> core/src/main/java/org/apache/oozie/coord/input/dependency/CoordOldInputDependency.java
>  aabd2bf25c99710ce0b025b6b66ae0fd0bb00abf 
>   
> core/src/main/java/org/apache/oozie/coord/input/dependency/CoordPullInputDependency.java
>  f20dcae0ff44d745ffbcb22bce2653d042a65122 
>   core/src/main/java/org/apache/oozie/dependency/ActionDependency.java 
> fe7a3272190718f21aa594188013fadfa9b58646 
>   
> core/src/main/java/org/apache/oozie/executor/jpa/CoordActionQueryExecutor.java
>  c0e6c198f4978744016f35dd8940db345a71f92c 
>   core/src/main/java/org/apache/oozie/servlet/BaseJobServlet.java 
> 87a2b426ad3f5eeb08e76e1be473fdcdf387d293 
>   core/src/main/java/org/apache/oozie/servlet/V0JobServlet.java 
> 0c4212877f3051ef85ca04bb8d2e075b5f9c4c72 
>   core/src/main/java/org/apache/oozie/servlet/V1JobServlet.java 
> 95dcca63c459475b8d41a85e0db11ca2a530a2e4 
>   core/src/main/java/org/apache/oozie/servlet/V2JobServlet.java 
> 3a0ffb0181a0feec31d9aceeea2df5aba0681ae9 
>   core/src/test/java/org/apache/oozie/client/TestOozieCLI.java 
> 8ec38e498f31bb69923125e34cda5abfc8e72aa9 
>   
> core/src/test/java/org/apache/oozie/command/coord/TestCoordActionMissingDependenciesXCommand.java
>  e69de29bb2d1d6434b8b29ae775ad8c2e48c5391 
>   
> core/src/test/java/org/apache/oozie/coord/input/logic/TestCoordInputLogicPush.java
>  6684a1fc7e8d1ed85b9e309cd163ae92f005f281 
>   
> core/src/test/java/org/apache/oozie/servlet/MockCoordinatorEngineService.java 
> 0e74f2d1df67dd5d4aaccbdb66a3829f5894e751 
>   core/src/test/resources/coord-multiple-output-instance5.xml 
> e69de29bb2d1d6434b8b29ae775ad8c2e48c5391 
>   docs/src/site/twiki/DG_CommandLineTool.twiki 
> 2dbbd4c820b9d8e11a51fdfe84185f5a1b3e6707 
>   docs/src/site/twiki/WebServicesAPI.twiki 
> 8406da6ab3bec859a9ef2b889e558f6c9ad1d652 
>   webapp/src/main/webapp/oozie-console.js 
> 7b20e9196cc6129b53fc610d34f6090311474eae 
> 
> Diff: https://reviews.apache.org/r/55214/diff/
> 
> 
> Testing
> ---
> 
> 
> Thanks,
> 
> Purshotam Shah
> 
>



Re: Review Request 51029: OOZIE 2630 Oozie Coordinator EL Functions to get first day of the week/month

2017-01-23 Thread Satish Saley

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/51029/
---

(Updated Jan. 23, 2017, 9:22 a.m.)


Review request for oozie.


Changes
---

I have added more EL functions in this patch. Now the patch contains following 
- endOfWeeks EL function for mentioning frequency. 
- endOfDays, endOfWeeks, endOfMonths EL functions for mentioning sync dataset


Bugs: OOZIE-2630
https://issues.apache.org/jira/browse/OOZIE-2630


Repository: oozie-git


Description
---

Oozie Coordinator EL Functions to get first day of the week/month


Diffs (updated)
-

  core/src/main/java/org/apache/oozie/command/coord/CoordCommandUtils.java 
0af7edc 
  core/src/main/java/org/apache/oozie/command/coord/CoordSubmitXCommand.java 
969336d 
  core/src/main/java/org/apache/oozie/coord/CoordELFunctions.java 925a7aa 
  core/src/main/java/org/apache/oozie/coord/TimeUnit.java 5b37639 
  core/src/main/java/org/apache/oozie/util/DateUtils.java 3caf0a2 
  core/src/main/resources/oozie-default.xml ad10386 
  core/src/test/java/org/apache/oozie/command/coord/TestCoordCommandUtils.java 
7062e69 
  
core/src/test/java/org/apache/oozie/command/coord/TestCoordMaterializeTransitionXCommand.java
 29e7ca1 
  core/src/test/java/org/apache/oozie/coord/TestCoordELFunctions.java be60133 
  core/src/test/resources/coord-dataset-endOfDays.xml PRE-CREATION 
  core/src/test/resources/coord-dataset-endOfMonths.xml PRE-CREATION 
  core/src/test/resources/coord-dataset-endOfWeeks.xml PRE-CREATION 
  docs/src/site/twiki/CoordinatorFunctionalSpec.twiki e3ac514 

Diff: https://reviews.apache.org/r/51029/diff/


Testing
---

Tested locally


Thanks,

Satish Saley



Build failed in Jenkins: oozie-trunk-precommit-build #3568

2017-01-23 Thread Apache Jenkins Server
See 

--
[...truncated 14684 lines...]
[WARNING] Entry: 
oozie-4.4.0-SNAPSHOT/embedded-oozie-server/webapp/docs/core/apidocs/src-html/org/apache/oozie/action/hadoop/CredentialsProvider.html
 longer than 100 characters.
[WARNING] Entry: 
oozie-4.4.0-SNAPSHOT/embedded-oozie-server/webapp/docs/core/apidocs/src-html/org/apache/oozie/action/hadoop/HbaseCredentials.html
 longer than 100 characters.
[WARNING] Entry: 
oozie-4.4.0-SNAPSHOT/embedded-oozie-server/webapp/docs/core/apidocs/src-html/org/apache/oozie/action/hadoop/FsActionExecutor.html
 longer than 100 characters.
[WARNING] Entry: 
oozie-4.4.0-SNAPSHOT/embedded-oozie-server/webapp/docs/core/apidocs/src-html/org/apache/oozie/action/hadoop/Hive2ActionExecutor.html
 longer than 100 characters.
[WARNING] Entry: 
oozie-4.4.0-SNAPSHOT/embedded-oozie-server/webapp/docs/core/apidocs/src-html/org/apache/oozie/action/hadoop/SparkActionExecutor.html
 longer than 100 characters.
[WARNING] Entry: 
oozie-4.4.0-SNAPSHOT/embedded-oozie-server/webapp/docs/core/apidocs/src-html/org/apache/oozie/action/hadoop/HiveActionExecutor.html
 longer than 100 characters.
[WARNING] Entry: 
oozie-4.4.0-SNAPSHOT/embedded-oozie-server/webapp/docs/core/apidocs/src-html/org/apache/oozie/action/hadoop/OozieJobInfo.html
 longer than 100 characters.
[WARNING] Entry: 
oozie-4.4.0-SNAPSHOT/embedded-oozie-server/webapp/docs/core/apidocs/src-html/org/apache/oozie/action/ActionExecutor.Context.html
 longer than 100 characters.
[WARNING] Entry: 
oozie-4.4.0-SNAPSHOT/embedded-oozie-server/webapp/docs/core/apidocs/src-html/org/apache/oozie/CoordinatorEngine.html
 longer than 100 characters.
[WARNING] Entry: 
oozie-4.4.0-SNAPSHOT/embedded-oozie-server/webapp/docs/core/apidocs/src-html/org/apache/oozie/jms/MessageReceiver.html
 longer than 100 characters.
[WARNING] Entry: 
oozie-4.4.0-SNAPSHOT/embedded-oozie-server/webapp/docs/core/apidocs/src-html/org/apache/oozie/jms/DefaultConnectionContext.html
 longer than 100 characters.
[WARNING] Entry: 
oozie-4.4.0-SNAPSHOT/embedded-oozie-server/webapp/docs/core/apidocs/src-html/org/apache/oozie/jms/ConnectionContext.html
 longer than 100 characters.
[WARNING] Entry: 
oozie-4.4.0-SNAPSHOT/embedded-oozie-server/webapp/docs/core/apidocs/src-html/org/apache/oozie/jms/JMSExceptionListener.html
 longer than 100 characters.
[WARNING] Entry: 
oozie-4.4.0-SNAPSHOT/embedded-oozie-server/webapp/docs/core/apidocs/src-html/org/apache/oozie/jms/JMSConnectionInfo.html
 longer than 100 characters.
[WARNING] Entry: 
oozie-4.4.0-SNAPSHOT/embedded-oozie-server/webapp/docs/core/apidocs/src-html/org/apache/oozie/jms/JMSJobEventListener.html
 longer than 100 characters.
[WARNING] Entry: 
oozie-4.4.0-SNAPSHOT/embedded-oozie-server/webapp/docs/core/apidocs/src-html/org/apache/oozie/jms/MessageHandler.html
 longer than 100 characters.
[WARNING] Entry: 
oozie-4.4.0-SNAPSHOT/embedded-oozie-server/webapp/docs/core/apidocs/src-html/org/apache/oozie/jms/JMSSLAEventListener.html
 longer than 100 characters.
[WARNING] Entry: 
oozie-4.4.0-SNAPSHOT/embedded-oozie-server/webapp/docs/core/apidocs/src-html/org/apache/oozie/dependency/URIHandlerException.html
 longer than 100 characters.
[WARNING] Entry: 
oozie-4.4.0-SNAPSHOT/embedded-oozie-server/webapp/docs/core/apidocs/src-html/org/apache/oozie/dependency/URIHandler.html
 longer than 100 characters.
[WARNING] Entry: 
oozie-4.4.0-SNAPSHOT/embedded-oozie-server/webapp/docs/core/apidocs/src-html/org/apache/oozie/dependency/DependencyChecker.html
 longer than 100 characters.
[WARNING] Entry: 
oozie-4.4.0-SNAPSHOT/embedded-oozie-server/webapp/docs/core/apidocs/src-html/org/apache/oozie/dependency/hcat/WaitingActions.html
 longer than 100 characters.
[WARNING] Entry: 
oozie-4.4.0-SNAPSHOT/embedded-oozie-server/webapp/docs/core/apidocs/src-html/org/apache/oozie/dependency/hcat/SimpleHCatDependencyCache.html
 longer than 100 characters.
[WARNING] Entry: 
oozie-4.4.0-SNAPSHOT/embedded-oozie-server/webapp/docs/core/apidocs/src-html/org/apache/oozie/dependency/hcat/EhcacheHCatDependencyCache.html
 longer than 100 characters.
[WARNING] Entry: 
oozie-4.4.0-SNAPSHOT/embedded-oozie-server/webapp/docs/core/apidocs/src-html/org/apache/oozie/dependency/hcat/HCatDependencyCache.html
 longer than 100 characters.
[WARNING] Entry: 
oozie-4.4.0-SNAPSHOT/embedded-oozie-server/webapp/docs/core/apidocs/src-html/org/apache/oozie/dependency/hcat/HCatMessageHandler.html
 longer than 100 characters.
[WARNING] Entry: 
oozie-4.4.0-SNAPSHOT/embedded-oozie-server/webapp/docs/core/apidocs/src-html/org/apache/oozie/dependency/hcat/WaitingAction.html
 longer than 100 characters.
[WARNING] Entry: 
oozie-4.4.0-SNAPSHOT/embedded-oozie-server/webapp/docs/core/apidocs/src-html/org/apache/oozie/dependency/ActionDependency.html
 longer than 100 characters.
[WARNING] Entry: 

Build failed in Jenkins: oozie-trunk-precommit-build #3567

2017-01-23 Thread Apache Jenkins Server
See 

--
[...truncated 14654 lines...]
[WARNING] Entry: 
oozie-4.4.0-SNAPSHOT/embedded-oozie-server/webapp/docs/core/apidocs/src-html/org/apache/oozie/action/hadoop/CredentialException.html
 longer than 100 characters.
[WARNING] Entry: 
oozie-4.4.0-SNAPSHOT/embedded-oozie-server/webapp/docs/core/apidocs/src-html/org/apache/oozie/action/hadoop/FsELFunctions.html
 longer than 100 characters.
[WARNING] Entry: 
oozie-4.4.0-SNAPSHOT/embedded-oozie-server/webapp/docs/core/apidocs/src-html/org/apache/oozie/action/hadoop/DistcpActionExecutor.html
 longer than 100 characters.
[WARNING] Entry: 
oozie-4.4.0-SNAPSHOT/embedded-oozie-server/webapp/docs/core/apidocs/src-html/org/apache/oozie/action/hadoop/HadoopELFunctions.html
 longer than 100 characters.
[WARNING] Entry: 
oozie-4.4.0-SNAPSHOT/embedded-oozie-server/webapp/docs/core/apidocs/src-html/org/apache/oozie/action/hadoop/CredentialsProperties.html
 longer than 100 characters.
[WARNING] Entry: 
oozie-4.4.0-SNAPSHOT/embedded-oozie-server/webapp/docs/core/apidocs/src-html/org/apache/oozie/action/hadoop/MapReduceActionExecutor.html
 longer than 100 characters.
[WARNING] Entry: 
oozie-4.4.0-SNAPSHOT/embedded-oozie-server/webapp/docs/core/apidocs/src-html/org/apache/oozie/action/hadoop/CredentialsProvider.html
 longer than 100 characters.
[WARNING] Entry: 
oozie-4.4.0-SNAPSHOT/embedded-oozie-server/webapp/docs/core/apidocs/src-html/org/apache/oozie/action/hadoop/HbaseCredentials.html
 longer than 100 characters.
[WARNING] Entry: 
oozie-4.4.0-SNAPSHOT/embedded-oozie-server/webapp/docs/core/apidocs/src-html/org/apache/oozie/action/hadoop/FsActionExecutor.html
 longer than 100 characters.
[WARNING] Entry: 
oozie-4.4.0-SNAPSHOT/embedded-oozie-server/webapp/docs/core/apidocs/src-html/org/apache/oozie/action/hadoop/Hive2ActionExecutor.html
 longer than 100 characters.
[WARNING] Entry: 
oozie-4.4.0-SNAPSHOT/embedded-oozie-server/webapp/docs/core/apidocs/src-html/org/apache/oozie/action/hadoop/SparkActionExecutor.html
 longer than 100 characters.
[WARNING] Entry: 
oozie-4.4.0-SNAPSHOT/embedded-oozie-server/webapp/docs/core/apidocs/src-html/org/apache/oozie/action/hadoop/HiveActionExecutor.html
 longer than 100 characters.
[WARNING] Entry: 
oozie-4.4.0-SNAPSHOT/embedded-oozie-server/webapp/docs/core/apidocs/src-html/org/apache/oozie/action/hadoop/OozieJobInfo.html
 longer than 100 characters.
[WARNING] Entry: 
oozie-4.4.0-SNAPSHOT/embedded-oozie-server/webapp/docs/core/apidocs/src-html/org/apache/oozie/action/ActionExecutor.Context.html
 longer than 100 characters.
[WARNING] Entry: 
oozie-4.4.0-SNAPSHOT/embedded-oozie-server/webapp/docs/core/apidocs/src-html/org/apache/oozie/CoordinatorEngine.html
 longer than 100 characters.
[WARNING] Entry: 
oozie-4.4.0-SNAPSHOT/embedded-oozie-server/webapp/docs/core/apidocs/src-html/org/apache/oozie/jms/MessageReceiver.html
 longer than 100 characters.
[WARNING] Entry: 
oozie-4.4.0-SNAPSHOT/embedded-oozie-server/webapp/docs/core/apidocs/src-html/org/apache/oozie/jms/DefaultConnectionContext.html
 longer than 100 characters.
[WARNING] Entry: 
oozie-4.4.0-SNAPSHOT/embedded-oozie-server/webapp/docs/core/apidocs/src-html/org/apache/oozie/jms/ConnectionContext.html
 longer than 100 characters.
[WARNING] Entry: 
oozie-4.4.0-SNAPSHOT/embedded-oozie-server/webapp/docs/core/apidocs/src-html/org/apache/oozie/jms/JMSExceptionListener.html
 longer than 100 characters.
[WARNING] Entry: 
oozie-4.4.0-SNAPSHOT/embedded-oozie-server/webapp/docs/core/apidocs/src-html/org/apache/oozie/jms/JMSConnectionInfo.html
 longer than 100 characters.
[WARNING] Entry: 
oozie-4.4.0-SNAPSHOT/embedded-oozie-server/webapp/docs/core/apidocs/src-html/org/apache/oozie/jms/JMSJobEventListener.html
 longer than 100 characters.
[WARNING] Entry: 
oozie-4.4.0-SNAPSHOT/embedded-oozie-server/webapp/docs/core/apidocs/src-html/org/apache/oozie/jms/MessageHandler.html
 longer than 100 characters.
[WARNING] Entry: 
oozie-4.4.0-SNAPSHOT/embedded-oozie-server/webapp/docs/core/apidocs/src-html/org/apache/oozie/jms/JMSSLAEventListener.html
 longer than 100 characters.
[WARNING] Entry: 
oozie-4.4.0-SNAPSHOT/embedded-oozie-server/webapp/docs/core/apidocs/src-html/org/apache/oozie/dependency/URIHandlerException.html
 longer than 100 characters.
[WARNING] Entry: 
oozie-4.4.0-SNAPSHOT/embedded-oozie-server/webapp/docs/core/apidocs/src-html/org/apache/oozie/dependency/URIHandler.html
 longer than 100 characters.
[WARNING] Entry: 
oozie-4.4.0-SNAPSHOT/embedded-oozie-server/webapp/docs/core/apidocs/src-html/org/apache/oozie/dependency/DependencyChecker.html
 longer than 100 characters.
[WARNING] Entry: 
oozie-4.4.0-SNAPSHOT/embedded-oozie-server/webapp/docs/core/apidocs/src-html/org/apache/oozie/dependency/hcat/WaitingActions.html
 longer than 100 characters.
[WARNING] Entry: 

[jira] [Comment Edited] (OOZIE-2041) Add an admin command to run the PurgeXCommand

2017-01-23 Thread Abhishek Bafna (JIRA)

[ 
https://issues.apache.org/jira/browse/OOZIE-2041?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15834696#comment-15834696
 ] 

Abhishek Bafna edited comment on OOZIE-2041 at 1/23/17 3:43 PM:


Thanks [~asasvari] for looking into the patch.

For the typo, It should be {{"bundle records (bundle=7) older than 7 days."}}, 
which was correct in earlier patches I think.
For the validation, I will create a ValidationUtil class into oozie-client 
module, oozie-core have access to it and then will reuse the same. This class 
can be used in future for adding more validation checks.

Thanks.


was (Author: abhishekbafna):
Thanks [~asasvari] for looking into the patch.

For the typo, It should be {{"bundle records (bundle=6) older than 7 days."}}, 
which was correct in earlier patches I think.
For the validation, I will create a ValidationUtil class into oozie-client 
module, oozie-core have access to it and then will reuse the same. This class 
can be used in future for adding more validation checks.

Thanks.

> Add an admin command to run the PurgeXCommand
> -
>
> Key: OOZIE-2041
> URL: https://issues.apache.org/jira/browse/OOZIE-2041
> Project: Oozie
>  Issue Type: New Feature
>  Components: core
>Affects Versions: trunk
>Reporter: Robert Kanter
>Assignee: Abhishek Bafna
> Fix For: 5.0.0
>
> Attachments: OOZIE-2041-00.patch, OOZIE-2041-01.patch, 
> OOZIE-2041-02.patch, OOZIE-2041-03.patch, OOZIE-2041-04.patch, 
> OOZIE-2041-05.patch, OOZIE-2041-06.patch, OOZIE-2041-07.patch
>
>
> Some users may find it useful to be able to run the PurgeXCommand on-demand.  
> We can add a new admin command to run this.  e.g.
> {noformat}
> oozie admin -purge
> {noformat}
> With no args, it can use the "older than" values from oozie-site, but we 
> could have it take some arguments to override those for the command.
> Another thing to worry about is making sure that we don't run this if either 
> it's already running (i.e. the user sent it twice) or if the scheduled 
> PurgeService is already running it.  On top of that, we may need extra 
> consideration for HA setups where we currently only run it on the leader.  
> We should probably also have a to not schedule the PurgeService in ooize-site 
> for users who only want to run it manually.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (OOZIE-2041) Add an admin command to run the PurgeXCommand

2017-01-23 Thread Abhishek Bafna (JIRA)

[ 
https://issues.apache.org/jira/browse/OOZIE-2041?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15834775#comment-15834775
 ] 

Abhishek Bafna commented on OOZIE-2041:
---

[~gezapeti] :) I got your point and typo. Thanks a lot.

> Add an admin command to run the PurgeXCommand
> -
>
> Key: OOZIE-2041
> URL: https://issues.apache.org/jira/browse/OOZIE-2041
> Project: Oozie
>  Issue Type: New Feature
>  Components: core
>Affects Versions: trunk
>Reporter: Robert Kanter
>Assignee: Abhishek Bafna
> Fix For: 5.0.0
>
> Attachments: OOZIE-2041-00.patch, OOZIE-2041-01.patch, 
> OOZIE-2041-02.patch, OOZIE-2041-03.patch, OOZIE-2041-04.patch, 
> OOZIE-2041-05.patch, OOZIE-2041-06.patch, OOZIE-2041-07.patch
>
>
> Some users may find it useful to be able to run the PurgeXCommand on-demand.  
> We can add a new admin command to run this.  e.g.
> {noformat}
> oozie admin -purge
> {noformat}
> With no args, it can use the "older than" values from oozie-site, but we 
> could have it take some arguments to override those for the command.
> Another thing to worry about is making sure that we don't run this if either 
> it's already running (i.e. the user sent it twice) or if the scheduled 
> PurgeService is already running it.  On top of that, we may need extra 
> consideration for HA setups where we currently only run it on the leader.  
> We should probably also have a to not schedule the PurgeService in ooize-site 
> for users who only want to run it manually.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (OOZIE-2041) Add an admin command to run the PurgeXCommand

2017-01-23 Thread Peter Cseh (JIRA)

[ 
https://issues.apache.org/jira/browse/OOZIE-2041?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15834705#comment-15834705
 ] 

Peter Cseh commented on OOZIE-2041:
---

I think I don't understand the documentation.
If I want to purge all my wfs, coord jobs and bundles older that 7 days, which 
one of the following commands is the correct?
#{{oozie admin purge wf=7,bundle=7,coord=7 }} 
#{{oozie admin purge wf=7,bundle=6,coord=7 }} 

1 or 2?

> Add an admin command to run the PurgeXCommand
> -
>
> Key: OOZIE-2041
> URL: https://issues.apache.org/jira/browse/OOZIE-2041
> Project: Oozie
>  Issue Type: New Feature
>  Components: core
>Affects Versions: trunk
>Reporter: Robert Kanter
>Assignee: Abhishek Bafna
> Fix For: 5.0.0
>
> Attachments: OOZIE-2041-00.patch, OOZIE-2041-01.patch, 
> OOZIE-2041-02.patch, OOZIE-2041-03.patch, OOZIE-2041-04.patch, 
> OOZIE-2041-05.patch, OOZIE-2041-06.patch, OOZIE-2041-07.patch
>
>
> Some users may find it useful to be able to run the PurgeXCommand on-demand.  
> We can add a new admin command to run this.  e.g.
> {noformat}
> oozie admin -purge
> {noformat}
> With no args, it can use the "older than" values from oozie-site, but we 
> could have it take some arguments to override those for the command.
> Another thing to worry about is making sure that we don't run this if either 
> it's already running (i.e. the user sent it twice) or if the scheduled 
> PurgeService is already running it.  On top of that, we may need extra 
> consideration for HA setups where we currently only run it on the leader.  
> We should probably also have a to not schedule the PurgeService in ooize-site 
> for users who only want to run it manually.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Comment Edited] (OOZIE-2041) Add an admin command to run the PurgeXCommand

2017-01-23 Thread Peter Cseh (JIRA)

[ 
https://issues.apache.org/jira/browse/OOZIE-2041?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15834705#comment-15834705
 ] 

Peter Cseh edited comment on OOZIE-2041 at 1/23/17 3:02 PM:


I think I don't understand the documentation.
If I want to purge all my wfs, coord jobs and bundles older that 7 days, which 
one of the following commands is the correct?
# {{oozie admin purge wf=7,bundle=7,coord=7 }} 
# {{oozie admin purge wf=7,bundle=6,coord=7 }} 

1 or 2?


was (Author: gezapeti):
I think I don't understand the documentation.
If I want to purge all my wfs, coord jobs and bundles older that 7 days, which 
one of the following commands is the correct?
#{{oozie admin purge wf=7,bundle=7,coord=7 }} 
#{{oozie admin purge wf=7,bundle=6,coord=7 }} 

1 or 2?

> Add an admin command to run the PurgeXCommand
> -
>
> Key: OOZIE-2041
> URL: https://issues.apache.org/jira/browse/OOZIE-2041
> Project: Oozie
>  Issue Type: New Feature
>  Components: core
>Affects Versions: trunk
>Reporter: Robert Kanter
>Assignee: Abhishek Bafna
> Fix For: 5.0.0
>
> Attachments: OOZIE-2041-00.patch, OOZIE-2041-01.patch, 
> OOZIE-2041-02.patch, OOZIE-2041-03.patch, OOZIE-2041-04.patch, 
> OOZIE-2041-05.patch, OOZIE-2041-06.patch, OOZIE-2041-07.patch
>
>
> Some users may find it useful to be able to run the PurgeXCommand on-demand.  
> We can add a new admin command to run this.  e.g.
> {noformat}
> oozie admin -purge
> {noformat}
> With no args, it can use the "older than" values from oozie-site, but we 
> could have it take some arguments to override those for the command.
> Another thing to worry about is making sure that we don't run this if either 
> it's already running (i.e. the user sent it twice) or if the scheduled 
> PurgeService is already running it.  On top of that, we may need extra 
> consideration for HA setups where we currently only run it on the leader.  
> We should probably also have a to not schedule the PurgeService in ooize-site 
> for users who only want to run it manually.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (OOZIE-2041) Add an admin command to run the PurgeXCommand

2017-01-23 Thread Abhishek Bafna (JIRA)

[ 
https://issues.apache.org/jira/browse/OOZIE-2041?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15834696#comment-15834696
 ] 

Abhishek Bafna commented on OOZIE-2041:
---

Thanks [~asasvari] for looking into the patch.

For the typo, It should be {{"bundle records (bundle=6) older than 7 days."}}, 
which was correct in earlier patches I think.
For the validation, I will create a ValidationUtil class into oozie-client 
module, oozie-core have access to it and then will reuse the same. This class 
can be used in future for adding more validation checks.

Thanks.

> Add an admin command to run the PurgeXCommand
> -
>
> Key: OOZIE-2041
> URL: https://issues.apache.org/jira/browse/OOZIE-2041
> Project: Oozie
>  Issue Type: New Feature
>  Components: core
>Affects Versions: trunk
>Reporter: Robert Kanter
>Assignee: Abhishek Bafna
> Fix For: 5.0.0
>
> Attachments: OOZIE-2041-00.patch, OOZIE-2041-01.patch, 
> OOZIE-2041-02.patch, OOZIE-2041-03.patch, OOZIE-2041-04.patch, 
> OOZIE-2041-05.patch, OOZIE-2041-06.patch, OOZIE-2041-07.patch
>
>
> Some users may find it useful to be able to run the PurgeXCommand on-demand.  
> We can add a new admin command to run this.  e.g.
> {noformat}
> oozie admin -purge
> {noformat}
> With no args, it can use the "older than" values from oozie-site, but we 
> could have it take some arguments to override those for the command.
> Another thing to worry about is making sure that we don't run this if either 
> it's already running (i.e. the user sent it twice) or if the scheduled 
> PurgeService is already running it.  On top of that, we may need extra 
> consideration for HA setups where we currently only run it on the leader.  
> We should probably also have a to not schedule the PurgeService in ooize-site 
> for users who only want to run it manually.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (OOZIE-2041) Add an admin command to run the PurgeXCommand

2017-01-23 Thread Attila Sasvari (JIRA)

[ 
https://issues.apache.org/jira/browse/OOZIE-2041?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15834672#comment-15834672
 ] 

Attila Sasvari commented on OOZIE-2041:
---

[~abhishekbafna] thanks for reuploading the patch

Regarding the typo
{quote}
Purge command will delete the workflow records (wf=30) older than 30 days, 
coordinator records (coord=7) older than 7 days and
bundle records (bundle=6) older then 7 days. The limit (limit=10) defines, 
number of records to be fetch at a time. Turn
(oldCoordAction=true/false) =on/off= coordinator action record purging for long 
running coordinators. If any of the parameter is
{quote}

Look at the description
* "workflow records (wf=30) older than 30 days" , 
* "(coord=7) older than 7 days", 
* "(bundle=6) older then 7 days"

The last two are not consistent. That's why I think you wanted to write 
"(bundle=*7*) older then 7 days"

Regarding validation 
* in my opinion, doing the validation at the client side (using CLI) would 
provide faster feedback to the user and put less pressure on the server (i.e. 
it is not needed to send over the request to the server in case of an invalid 
input). Sure, the request is validated on server side, but I only see 
advantages to do this validation redundantly. Anyway, it is just a suggestion, 
we can create a follow up jira or something.   

Regarding CLI - I did not face issues.


> Add an admin command to run the PurgeXCommand
> -
>
> Key: OOZIE-2041
> URL: https://issues.apache.org/jira/browse/OOZIE-2041
> Project: Oozie
>  Issue Type: New Feature
>  Components: core
>Affects Versions: trunk
>Reporter: Robert Kanter
>Assignee: Abhishek Bafna
> Fix For: 5.0.0
>
> Attachments: OOZIE-2041-00.patch, OOZIE-2041-01.patch, 
> OOZIE-2041-02.patch, OOZIE-2041-03.patch, OOZIE-2041-04.patch, 
> OOZIE-2041-05.patch, OOZIE-2041-06.patch, OOZIE-2041-07.patch
>
>
> Some users may find it useful to be able to run the PurgeXCommand on-demand.  
> We can add a new admin command to run this.  e.g.
> {noformat}
> oozie admin -purge
> {noformat}
> With no args, it can use the "older than" values from oozie-site, but we 
> could have it take some arguments to override those for the command.
> Another thing to worry about is making sure that we don't run this if either 
> it's already running (i.e. the user sent it twice) or if the scheduled 
> PurgeService is already running it.  On top of that, we may need extra 
> consideration for HA setups where we currently only run it on the leader.  
> We should probably also have a to not schedule the PurgeService in ooize-site 
> for users who only want to run it manually.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (OOZIE-2779) Mask Hive2 action Beeline JDBC password

2017-01-23 Thread Abhishek Bafna (JIRA)

 [ 
https://issues.apache.org/jira/browse/OOZIE-2779?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Abhishek Bafna updated OOZIE-2779:
--
Attachment: OOZIE-2779-00.patch

> Mask Hive2 action Beeline JDBC password
> ---
>
> Key: OOZIE-2779
> URL: https://issues.apache.org/jira/browse/OOZIE-2779
> Project: Oozie
>  Issue Type: Bug
>  Components: action
>Reporter: Abhishek Bafna
>Assignee: Abhishek Bafna
>  Labels: security
> Fix For: 5.0.0
>
> Attachments: OOZIE-2779-00.patch
>
>
> Hive2 Oozie launcher job prints the JDBC password into launcher stdout logs.
> {noformat}
> Beeline command arguments :
>  -u
>  jdbc:hive2://source-1:1/default
>  -n
>  ambari-qa
>  -p
>  DUMMY
>  -d
>  org.apache.hive.jdbc.HiveDriver
> {noformat}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Created] (OOZIE-2779) Mask Hive2 action Beeline JDBC password

2017-01-23 Thread Abhishek Bafna (JIRA)
Abhishek Bafna created OOZIE-2779:
-

 Summary: Mask Hive2 action Beeline JDBC password
 Key: OOZIE-2779
 URL: https://issues.apache.org/jira/browse/OOZIE-2779
 Project: Oozie
  Issue Type: Bug
  Components: action
Reporter: Abhishek Bafna
Assignee: Abhishek Bafna
 Fix For: 5.0.0


Hive2 Oozie launcher job prints the JDBC password into launcher stdout logs.

{noformat}
Beeline command arguments :
 -u
 jdbc:hive2://source-1:1/default
 -n
 ambari-qa
 -p
 DUMMY
 -d
 org.apache.hive.jdbc.HiveDriver
{noformat}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (OOZIE-2778) Copy only jetty.version related server dependencies to distro

2017-01-23 Thread Attila Sasvari (JIRA)

 [ 
https://issues.apache.org/jira/browse/OOZIE-2778?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Attila Sasvari updated OOZIE-2778:
--
Attachment: (was: OOZIE-2778-01.patch)

> Copy only jetty.version related server dependencies to distro 
> --
>
> Key: OOZIE-2778
> URL: https://issues.apache.org/jira/browse/OOZIE-2778
> Project: Oozie
>  Issue Type: Bug
>Reporter: Attila Sasvari
> Attachments: OOZIE-2778-01.patch
>
>
> To compile JSP, org.eclipse.jdt.core is used (see 
> http://www.eclipse.org/jetty/documentation/9.2.20.v20161216/configuring-jsp.html#compiling-jsps).
> However, additional currently jasper libraries are copied to 
> embedded-oozie-server/dependency/ in the distro directory. It can cause 
> problems (e.g. NoSuchMethodException at runtime) if classes are loaded from 
> that jars. 
> Furthermore, transitive dependencies can pull in old jetty libraries (such as 
> jetty-util 6) that can cause runtime issues (at server startup).
> We can make sure with the maven assembly plugin that only jetty.version 
> related dependencies are copied to distro.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (OOZIE-2778) Copy only jetty.version related server dependencies to distro

2017-01-23 Thread Attila Sasvari (JIRA)

 [ 
https://issues.apache.org/jira/browse/OOZIE-2778?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Attila Sasvari updated OOZIE-2778:
--
Attachment: OOZIE-2778-01.patch
OOZIE-2778-01.patch

> Copy only jetty.version related server dependencies to distro 
> --
>
> Key: OOZIE-2778
> URL: https://issues.apache.org/jira/browse/OOZIE-2778
> Project: Oozie
>  Issue Type: Bug
>Reporter: Attila Sasvari
> Attachments: OOZIE-2778-01.patch, OOZIE-2778-01.patch
>
>
> To compile JSP, org.eclipse.jdt.core is used (see 
> http://www.eclipse.org/jetty/documentation/9.2.20.v20161216/configuring-jsp.html#compiling-jsps).
> However, additional currently jasper libraries are copied to 
> embedded-oozie-server/dependency/ in the distro directory. It can cause 
> problems (e.g. NoSuchMethodException at runtime) if classes are loaded from 
> that jars. 
> Furthermore, transitive dependencies can pull in old jetty libraries (such as 
> jetty-util 6) that can cause runtime issues (at server startup).
> We can make sure with the maven assembly plugin that only jetty.version 
> related dependencies are copied to distro.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (OOZIE-1770) Create Oozie Application Master for YARN

2017-01-23 Thread Hadoop QA (JIRA)

[ 
https://issues.apache.org/jira/browse/OOZIE-1770?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15834582#comment-15834582
 ] 

Hadoop QA commented on OOZIE-1770:
--

Testing JIRA OOZIE-1770

Cleaning local git workspace



{color:green}+1 PATCH_APPLIES{color}
{color:green}+1 CLEAN{color}
{color:red}-1 RAW_PATCH_ANALYSIS{color}
.{color:green}+1{color} the patch does not introduce any @author tags
.{color:green}+1{color} the patch does not introduce any tabs
.{color:green}+1{color} the patch does not introduce any trailing spaces
.{color:red}-1{color} the patch contains 5 line(s) longer than 132 
characters
.{color:green}+1{color} the patch does adds/modifies 48 testcase(s)
{color:green}+1 RAT{color}
.{color:green}+1{color} the patch does not seem to introduce new RAT 
warnings
{color:red}-1 JAVADOC{color}
.{color:red}-1{color} the patch seems to introduce 2 new Javadoc warning(s)
{color:green}+1 COMPILE{color}
.{color:green}+1{color} HEAD compiles
.{color:green}+1{color} patch compiles
.{color:green}+1{color} the patch does not seem to introduce new javac 
warnings
{color:red}-1{color} There are [1] new bugs found below threshold in total that 
must be fixed.
.{color:green}+1{color} There are no new bugs found in [server].
.{color:green}+1{color} There are no new bugs found in [client].
.{color:red}-1{color} There are [1] new bugs found below threshold in 
[core] that must be fixed.
.You can find the FindBugs diff here (look for the red and orange ones): 
core/findbugs-new.html
.The most important FindBugs errors are:
.At CredentialsProviderFactory.java:[lines 95-100]: The method name 
org.apache.oozie.action.hadoop.CredentialsProviderFactory.Trim(String) doesn't 
start with a lower case letter
.{color:green}+1{color} There are no new bugs found in [docs].
.{color:green}+1{color} There are no new bugs found in 
[hadooplibs/hadoop-utils-2].
.{color:orange}0{color} There are [1] new bugs found in [tools] that would 
be nice to have fixed.
.You can find the FindBugs diff here: tools/findbugs-new.html
.{color:green}+1{color} There are no new bugs found in [examples].
.{color:green}+1{color} There are no new bugs found in [sharelib/streaming].
.{color:green}+1{color} There are no new bugs found in [sharelib/sqoop].
.{color:green}+1{color} There are no new bugs found in [sharelib/distcp].
.{color:orange}0{color} There are [5] new bugs found in [sharelib/oozie] 
that would be nice to have fixed.
.You can find the FindBugs diff here: sharelib/oozie/findbugs-new.html
.{color:green}+1{color} There are no new bugs found in [sharelib/hcatalog].
.{color:green}+1{color} There are no new bugs found in [sharelib/hive].
.{color:green}+1{color} There are no new bugs found in [sharelib/hive2].
.{color:green}+1{color} There are no new bugs found in [sharelib/pig].
.{color:green}+1{color} There are no new bugs found in [sharelib/spark].
{color:red}-1 BACKWARDS_COMPATIBILITY{color}
.{color:green}+1{color} the patch does not change any JPA 
Entity/Colum/Basic/Lob/Transient annotations
.{color:red}-1{color} the patch modifies 1 JPA file(s), persistence.xml or 
*-orm.xml
{color:red}-1 TESTS{color} - patch does not compile, cannot run testcases
{color:green}+1 DISTRO{color}
.{color:green}+1{color} distro tarball builds with the patch 


{color:red}*-1 Overall result, please check the reported -1(s)*{color}


The full output of the test-patch run is available at

.   https://builds.apache.org/job/oozie-trunk-precommit-build/3566/

> Create Oozie Application Master for YARN
> 
>
> Key: OOZIE-1770
> URL: https://issues.apache.org/jira/browse/OOZIE-1770
> Project: Oozie
>  Issue Type: New Feature
>Reporter: Bowen Zhang
>Assignee: Peter Cseh
> Attachments: OOZIE-1770-001.patch, OOZIE-1770-002.patch, 
> OOZIE-1770-003.patch, OOZIE-1770-004.patch, OOZIE-1770-005.patch, 
> OOZIE-1770-006.patch, OOZIE-1770-007.patch, OOZIE-1770-008.patch, 
> OozieYarnAM.pdf, oya.patch, oya-rm-screenshot.jpg, OYA Scoping Doc 001.pdf, 
> Prelim OYA Scoping Doc 001.pdf, Prelim OYA Scoping Doc 002.pdf, Prelim OYA 
> Scoping Doc 003.pdf
>
>
> After the first release of oozie on hadoop 2, it will be good if users can 
> set execution engine in oozie conf, be it YARN AM or traditional MR. We can 
> target this for post oozie 4.1 release.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


Build failed in Jenkins: oozie-trunk-precommit-build #3566

2017-01-23 Thread Apache Jenkins Server
See 

--
[...truncated 13774 lines...]
[WARNING] Entry: 
oozie-4.4.0-SNAPSHOT/embedded-oozie-server/webapp/docs/core/apidocs/src-html/org/apache/oozie/action/hadoop/LauncherMapperHelper.html
 longer than 100 characters.
[WARNING] Entry: 
oozie-4.4.0-SNAPSHOT/embedded-oozie-server/webapp/docs/core/apidocs/src-html/org/apache/oozie/action/hadoop/ShellActionExecutor.html
 longer than 100 characters.
[WARNING] Entry: 
oozie-4.4.0-SNAPSHOT/embedded-oozie-server/webapp/docs/core/apidocs/src-html/org/apache/oozie/action/hadoop/CredentialsProviderFactory.html
 longer than 100 characters.
[WARNING] Entry: 
oozie-4.4.0-SNAPSHOT/embedded-oozie-server/webapp/docs/core/apidocs/src-html/org/apache/oozie/action/hadoop/ScriptLanguageActionExecutor.html
 longer than 100 characters.
[WARNING] Entry: 
oozie-4.4.0-SNAPSHOT/embedded-oozie-server/webapp/docs/core/apidocs/src-html/org/apache/oozie/action/hadoop/PigActionExecutor.html
 longer than 100 characters.
[WARNING] Entry: 
oozie-4.4.0-SNAPSHOT/embedded-oozie-server/webapp/docs/core/apidocs/src-html/org/apache/oozie/action/hadoop/HCatCredentials.html
 longer than 100 characters.
[WARNING] Entry: 
oozie-4.4.0-SNAPSHOT/embedded-oozie-server/webapp/docs/core/apidocs/src-html/org/apache/oozie/action/hadoop/JavaActionExecutor.html
 longer than 100 characters.
[WARNING] Entry: 
oozie-4.4.0-SNAPSHOT/embedded-oozie-server/webapp/docs/core/apidocs/src-html/org/apache/oozie/action/hadoop/CredentialException.html
 longer than 100 characters.
[WARNING] Entry: 
oozie-4.4.0-SNAPSHOT/embedded-oozie-server/webapp/docs/core/apidocs/src-html/org/apache/oozie/action/hadoop/FsELFunctions.html
 longer than 100 characters.
[WARNING] Entry: 
oozie-4.4.0-SNAPSHOT/embedded-oozie-server/webapp/docs/core/apidocs/src-html/org/apache/oozie/action/hadoop/DistcpActionExecutor.html
 longer than 100 characters.
[WARNING] Entry: 
oozie-4.4.0-SNAPSHOT/embedded-oozie-server/webapp/docs/core/apidocs/src-html/org/apache/oozie/action/hadoop/HadoopELFunctions.html
 longer than 100 characters.
[WARNING] Entry: 
oozie-4.4.0-SNAPSHOT/embedded-oozie-server/webapp/docs/core/apidocs/src-html/org/apache/oozie/action/hadoop/CredentialsProperties.html
 longer than 100 characters.
[WARNING] Entry: 
oozie-4.4.0-SNAPSHOT/embedded-oozie-server/webapp/docs/core/apidocs/src-html/org/apache/oozie/action/hadoop/MapReduceActionExecutor.html
 longer than 100 characters.
[WARNING] Entry: 
oozie-4.4.0-SNAPSHOT/embedded-oozie-server/webapp/docs/core/apidocs/src-html/org/apache/oozie/action/hadoop/CredentialsProvider.html
 longer than 100 characters.
[WARNING] Entry: 
oozie-4.4.0-SNAPSHOT/embedded-oozie-server/webapp/docs/core/apidocs/src-html/org/apache/oozie/action/hadoop/HbaseCredentials.html
 longer than 100 characters.
[WARNING] Entry: 
oozie-4.4.0-SNAPSHOT/embedded-oozie-server/webapp/docs/core/apidocs/src-html/org/apache/oozie/action/hadoop/FsActionExecutor.html
 longer than 100 characters.
[WARNING] Entry: 
oozie-4.4.0-SNAPSHOT/embedded-oozie-server/webapp/docs/core/apidocs/src-html/org/apache/oozie/action/hadoop/Hive2ActionExecutor.html
 longer than 100 characters.
[WARNING] Entry: 
oozie-4.4.0-SNAPSHOT/embedded-oozie-server/webapp/docs/core/apidocs/src-html/org/apache/oozie/action/hadoop/SparkActionExecutor.html
 longer than 100 characters.
[WARNING] Entry: 
oozie-4.4.0-SNAPSHOT/embedded-oozie-server/webapp/docs/core/apidocs/src-html/org/apache/oozie/action/hadoop/HiveActionExecutor.html
 longer than 100 characters.
[WARNING] Entry: 
oozie-4.4.0-SNAPSHOT/embedded-oozie-server/webapp/docs/core/apidocs/src-html/org/apache/oozie/action/hadoop/OozieJobInfo.html
 longer than 100 characters.
[WARNING] Entry: 
oozie-4.4.0-SNAPSHOT/embedded-oozie-server/webapp/docs/core/apidocs/src-html/org/apache/oozie/action/ActionExecutor.Context.html
 longer than 100 characters.
[WARNING] Entry: 
oozie-4.4.0-SNAPSHOT/embedded-oozie-server/webapp/docs/core/apidocs/src-html/org/apache/oozie/CoordinatorEngine.html
 longer than 100 characters.
[WARNING] Entry: 
oozie-4.4.0-SNAPSHOT/embedded-oozie-server/webapp/docs/core/apidocs/src-html/org/apache/oozie/jms/MessageReceiver.html
 longer than 100 characters.
[WARNING] Entry: 
oozie-4.4.0-SNAPSHOT/embedded-oozie-server/webapp/docs/core/apidocs/src-html/org/apache/oozie/jms/DefaultConnectionContext.html
 longer than 100 characters.
[WARNING] Entry: 
oozie-4.4.0-SNAPSHOT/embedded-oozie-server/webapp/docs/core/apidocs/src-html/org/apache/oozie/jms/ConnectionContext.html
 longer than 100 characters.
[WARNING] Entry: 
oozie-4.4.0-SNAPSHOT/embedded-oozie-server/webapp/docs/core/apidocs/src-html/org/apache/oozie/jms/JMSExceptionListener.html
 longer than 100 characters.
[WARNING] Entry: 
oozie-4.4.0-SNAPSHOT/embedded-oozie-server/webapp/docs/core/apidocs/src-html/org/apache/oozie/jms/JMSConnectionInfo.html
 longer than 100 characters.
[WARNING] Entry: 

[jira] [Created] (OOZIE-2778) Copy only jetty.version related server dependencies to distro

2017-01-23 Thread Attila Sasvari (JIRA)
Attila Sasvari created OOZIE-2778:
-

 Summary: Copy only jetty.version related server dependencies to 
distro 
 Key: OOZIE-2778
 URL: https://issues.apache.org/jira/browse/OOZIE-2778
 Project: Oozie
  Issue Type: Bug
Reporter: Attila Sasvari


To compile JSP, org.eclipse.jdt.core is used (see 
http://www.eclipse.org/jetty/documentation/9.2.20.v20161216/configuring-jsp.html#compiling-jsps).

However, additional currently jasper libraries are copied to 
embedded-oozie-server/dependency/ in the distro directory. It can cause 
problems (e.g. NoSuchMethodException at runtime) if classes are loaded from 
that jars. 

Furthermore, transitive dependencies can pull in old jetty libraries (such as 
jetty-util 6) that can cause runtime issues (at server startup).

We can make sure with the maven assembly plugin that only jetty.version related 
dependencies are copied to distro.




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


Re: Review Request 54705: OOZIE-1770: Create Oozie Application Master for YARN

2017-01-23 Thread Peter Cseh


> On Jan. 6, 2017, 7:19 a.m., Robert Kanter wrote:
> > core/src/main/java/org/apache/oozie/action/hadoop/SparkActionExecutor.java, 
> > lines 160-162
> > 
> >
> > We shouldn't need the MR jars in the Spark Action :)

Oozie's SparkExample needs MR jars on the classpath.


- Peter


---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/54705/#review160656
---


On Jan. 23, 2017, 11:43 a.m., Peter Cseh wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/54705/
> ---
> 
> (Updated Jan. 23, 2017, 11:43 a.m.)
> 
> 
> Review request for oozie, Purshotam Shah, Robert Kanter, and Rohini 
> Palaniswamy.
> 
> 
> Repository: oozie-git
> 
> 
> Description
> ---
> 
> Replacing the launcher MR job with a launcher AM
> 
> 
> Diffs
> -
> 
>   client/pom.xml f99366c90887a5a45f3942291c90e1cdbfd84b3f 
>   client/src/main/java/org/apache/oozie/cli/OozieCLI.java 
> 6e30d7eb667fe74440281fab3ca06c9f4df7bcf7 
>   client/src/main/java/org/apache/oozie/client/XOozieClient.java 
> 8538ec7c742cc013f7c18eaff3ecf61c2835cc8a 
>   core/pom.xml 1dd104581ccab7976d788b674d2200e48a70c27f 
>   core/src/main/java/org/apache/oozie/WorkflowJobBean.java 
> 55d79a5d5e5e4efab9eb832e9341a16bcf8959cc 
>   core/src/main/java/org/apache/oozie/action/ActionExecutor.java 
> 1d6456b236bf9e27c0f55d9f9e3b4bd94517c797 
>   core/src/main/java/org/apache/oozie/action/hadoop/Credentials.java 
> eadb47b07d157f45f086517ab41c4b9826f003f0 
>   core/src/main/java/org/apache/oozie/action/hadoop/CredentialsProvider.java 
> 6fe22fbd2fca5d873d58ece60f20d0f131371475 
>   
> core/src/main/java/org/apache/oozie/action/hadoop/CredentialsProviderFactory.java
>  PRE-CREATION 
>   core/src/main/java/org/apache/oozie/action/hadoop/DistcpActionExecutor.java 
> 78cd257a836707c1efeac13566d6285d42970545 
>   core/src/main/java/org/apache/oozie/action/hadoop/FsActionExecutor.java 
> 27654741101d2056b25626fbbe345183eafd612d 
>   core/src/main/java/org/apache/oozie/action/hadoop/FsELFunctions.java 
> 801bfe6eb212b549888f0e9fb7df7b65bcf59393 
>   core/src/main/java/org/apache/oozie/action/hadoop/HCatCredentialHelper.java 
> 36ad1df727e869b8051481ad969771e91bc6ae07 
>   core/src/main/java/org/apache/oozie/action/hadoop/HCatCredentials.java 
> d7689a924059e553abaeed374eed4072933292cb 
>   core/src/main/java/org/apache/oozie/action/hadoop/HadoopELFunctions.java 
> ad2a71d641caa71efc098ad00bfbab3cec4d9506 
>   core/src/main/java/org/apache/oozie/action/hadoop/HbaseCredentials.java 
> 307f565786ad77f5a35b5790bd5b052b04c6eac8 
>   core/src/main/java/org/apache/oozie/action/hadoop/Hive2ActionExecutor.java 
> 2aed936af75da38c433be5d202bdc01c2f612c76 
>   core/src/main/java/org/apache/oozie/action/hadoop/Hive2Credentials.java 
> bd2f1f768c5b04bef4a33613baede9202144c747 
>   core/src/main/java/org/apache/oozie/action/hadoop/HiveActionExecutor.java 
> 8e2453ef4f78f4a5f1f95b1ca2793f5d7e07ad81 
>   core/src/main/java/org/apache/oozie/action/hadoop/JavaActionExecutor.java 
> 4beeb965a461e246479c3e8ad88f92ecafca13c1 
>   core/src/main/java/org/apache/oozie/action/hadoop/LauncherMapperHelper.java 
> 9609fdc2f3440fb176b659ef16c2a23451724cf9 
>   
> core/src/main/java/org/apache/oozie/action/hadoop/MapReduceActionExecutor.java
>  55c937249ac35e14bd63dd0c1fa962ea636afa3a 
>   core/src/main/java/org/apache/oozie/action/hadoop/OozieJobInfo.java 
> 581d3b3219eff882f961c8e495611e873c6a5a52 
>   core/src/main/java/org/apache/oozie/action/hadoop/PigActionExecutor.java 
> 8b2dc16db80ad602911f1f64e60cfad41b198922 
>   
> core/src/main/java/org/apache/oozie/action/hadoop/ScriptLanguageActionExecutor.java
>  f2541265ca71fb7f3b053c59775ef5e23d0d8f94 
>   core/src/main/java/org/apache/oozie/action/hadoop/ShellActionExecutor.java 
> b9ffa7ab7ec87db8a76a3653c74974d296c8cd17 
>   core/src/main/java/org/apache/oozie/action/hadoop/SparkActionExecutor.java 
> 8e8d7d308b294efd91e3057e0d88ee06643ab2d4 
>   core/src/main/java/org/apache/oozie/action/hadoop/SqoopActionExecutor.java 
> 6cee32aa8f5b8b36c9c7a98bb738f50b18b64624 
>   core/src/main/java/org/apache/oozie/client/rest/BulkResponseImpl.java 
> fb021bd022d199f93fc5674843514abf45ae12a5 
>   core/src/main/java/org/apache/oozie/command/XCommand.java 
> bdf13f65ea25e8e0f5125e2798568a2c03fffe81 
>   core/src/main/java/org/apache/oozie/command/wf/SubmitHttpXCommand.java 
> d2a2742ae418070a1cd0a889f14194224bc944a6 
>   core/src/main/java/org/apache/oozie/command/wf/SubmitMRXCommand.java 
> cc61d3de813c75c7f1cf4d405fc043253e3ca4ea 
>   
> core/src/main/java/org/apache/oozie/command/wf/SubmitScriptLanguageXCommand.java
>  9d413059e99bc676feb63e02a2f704048eb4a355 
>   

Re: Review Request 54705: OOZIE-1770: Create Oozie Application Master for YARN

2017-01-23 Thread Peter Cseh

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/54705/
---

(Updated Jan. 23, 2017, 11:43 a.m.)


Review request for oozie, Purshotam Shah, Robert Kanter, and Rohini Palaniswamy.


Repository: oozie-git


Description
---

Replacing the launcher MR job with a launcher AM


Diffs (updated)
-

  client/pom.xml f99366c90887a5a45f3942291c90e1cdbfd84b3f 
  client/src/main/java/org/apache/oozie/cli/OozieCLI.java 
6e30d7eb667fe74440281fab3ca06c9f4df7bcf7 
  client/src/main/java/org/apache/oozie/client/XOozieClient.java 
8538ec7c742cc013f7c18eaff3ecf61c2835cc8a 
  core/pom.xml 1dd104581ccab7976d788b674d2200e48a70c27f 
  core/src/main/java/org/apache/oozie/WorkflowJobBean.java 
55d79a5d5e5e4efab9eb832e9341a16bcf8959cc 
  core/src/main/java/org/apache/oozie/action/ActionExecutor.java 
1d6456b236bf9e27c0f55d9f9e3b4bd94517c797 
  core/src/main/java/org/apache/oozie/action/hadoop/Credentials.java 
eadb47b07d157f45f086517ab41c4b9826f003f0 
  core/src/main/java/org/apache/oozie/action/hadoop/CredentialsProvider.java 
6fe22fbd2fca5d873d58ece60f20d0f131371475 
  
core/src/main/java/org/apache/oozie/action/hadoop/CredentialsProviderFactory.java
 PRE-CREATION 
  core/src/main/java/org/apache/oozie/action/hadoop/DistcpActionExecutor.java 
78cd257a836707c1efeac13566d6285d42970545 
  core/src/main/java/org/apache/oozie/action/hadoop/FsActionExecutor.java 
27654741101d2056b25626fbbe345183eafd612d 
  core/src/main/java/org/apache/oozie/action/hadoop/FsELFunctions.java 
801bfe6eb212b549888f0e9fb7df7b65bcf59393 
  core/src/main/java/org/apache/oozie/action/hadoop/HCatCredentialHelper.java 
36ad1df727e869b8051481ad969771e91bc6ae07 
  core/src/main/java/org/apache/oozie/action/hadoop/HCatCredentials.java 
d7689a924059e553abaeed374eed4072933292cb 
  core/src/main/java/org/apache/oozie/action/hadoop/HadoopELFunctions.java 
ad2a71d641caa71efc098ad00bfbab3cec4d9506 
  core/src/main/java/org/apache/oozie/action/hadoop/HbaseCredentials.java 
307f565786ad77f5a35b5790bd5b052b04c6eac8 
  core/src/main/java/org/apache/oozie/action/hadoop/Hive2ActionExecutor.java 
2aed936af75da38c433be5d202bdc01c2f612c76 
  core/src/main/java/org/apache/oozie/action/hadoop/Hive2Credentials.java 
bd2f1f768c5b04bef4a33613baede9202144c747 
  core/src/main/java/org/apache/oozie/action/hadoop/HiveActionExecutor.java 
8e2453ef4f78f4a5f1f95b1ca2793f5d7e07ad81 
  core/src/main/java/org/apache/oozie/action/hadoop/JavaActionExecutor.java 
4beeb965a461e246479c3e8ad88f92ecafca13c1 
  core/src/main/java/org/apache/oozie/action/hadoop/LauncherMapperHelper.java 
9609fdc2f3440fb176b659ef16c2a23451724cf9 
  
core/src/main/java/org/apache/oozie/action/hadoop/MapReduceActionExecutor.java 
55c937249ac35e14bd63dd0c1fa962ea636afa3a 
  core/src/main/java/org/apache/oozie/action/hadoop/OozieJobInfo.java 
581d3b3219eff882f961c8e495611e873c6a5a52 
  core/src/main/java/org/apache/oozie/action/hadoop/PigActionExecutor.java 
8b2dc16db80ad602911f1f64e60cfad41b198922 
  
core/src/main/java/org/apache/oozie/action/hadoop/ScriptLanguageActionExecutor.java
 f2541265ca71fb7f3b053c59775ef5e23d0d8f94 
  core/src/main/java/org/apache/oozie/action/hadoop/ShellActionExecutor.java 
b9ffa7ab7ec87db8a76a3653c74974d296c8cd17 
  core/src/main/java/org/apache/oozie/action/hadoop/SparkActionExecutor.java 
8e8d7d308b294efd91e3057e0d88ee06643ab2d4 
  core/src/main/java/org/apache/oozie/action/hadoop/SqoopActionExecutor.java 
6cee32aa8f5b8b36c9c7a98bb738f50b18b64624 
  core/src/main/java/org/apache/oozie/client/rest/BulkResponseImpl.java 
fb021bd022d199f93fc5674843514abf45ae12a5 
  core/src/main/java/org/apache/oozie/command/XCommand.java 
bdf13f65ea25e8e0f5125e2798568a2c03fffe81 
  core/src/main/java/org/apache/oozie/command/wf/SubmitHttpXCommand.java 
d2a2742ae418070a1cd0a889f14194224bc944a6 
  core/src/main/java/org/apache/oozie/command/wf/SubmitMRXCommand.java 
cc61d3de813c75c7f1cf4d405fc043253e3ca4ea 
  
core/src/main/java/org/apache/oozie/command/wf/SubmitScriptLanguageXCommand.java
 9d413059e99bc676feb63e02a2f704048eb4a355 
  core/src/main/java/org/apache/oozie/command/wf/SubmitSqoopXCommand.java 
51b739e21c802e09f4110b740138f4ff5c341fe4 
  
core/src/main/java/org/apache/oozie/coord/input/dependency/AbstractCoordInputDependency.java
 0da60ec70373399414a637c22753da7e2a7e6618 
  
core/src/main/java/org/apache/oozie/dependency/hcat/EhcacheHCatDependencyCache.java
 3bc467535202e13387b1d29ac678573f4154c522 
  core/src/main/java/org/apache/oozie/service/CallableQueueService.java 
a86a8d0889138cd1564ca9253e5b319ea52e55cc 
  core/src/main/java/org/apache/oozie/service/EventHandlerService.java 
22c6fb0965f45c5cf2322c251d4a8aa77d263458 
  core/src/main/java/org/apache/oozie/service/HadoopAccessorService.java 
5377127736cf189bcf4aa3d62bbbeab6b3a29d52 
  core/src/main/java/org/apache/oozie/service/Services.java 
829d5f5cd90c86e6cba9854dc0b4b7df570b8900 

[jira] [Updated] (OOZIE-1770) Create Oozie Application Master for YARN

2017-01-23 Thread Peter Bacsko (JIRA)

 [ 
https://issues.apache.org/jira/browse/OOZIE-1770?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Peter Bacsko updated OOZIE-1770:

Attachment: OOZIE-1770-008.patch

> Create Oozie Application Master for YARN
> 
>
> Key: OOZIE-1770
> URL: https://issues.apache.org/jira/browse/OOZIE-1770
> Project: Oozie
>  Issue Type: New Feature
>Reporter: Bowen Zhang
>Assignee: Peter Cseh
> Attachments: OOZIE-1770-001.patch, OOZIE-1770-002.patch, 
> OOZIE-1770-003.patch, OOZIE-1770-004.patch, OOZIE-1770-005.patch, 
> OOZIE-1770-006.patch, OOZIE-1770-007.patch, OOZIE-1770-008.patch, 
> OozieYarnAM.pdf, oya.patch, oya-rm-screenshot.jpg, OYA Scoping Doc 001.pdf, 
> Prelim OYA Scoping Doc 001.pdf, Prelim OYA Scoping Doc 002.pdf, Prelim OYA 
> Scoping Doc 003.pdf
>
>
> After the first release of oozie on hadoop 2, it will be good if users can 
> set execution engine in oozie conf, be it YARN AM or traditional MR. We can 
> target this for post oozie 4.1 release.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (OOZIE-2777) Config-default.xml longer than 64k results in java.io.UTFDataFormatException

2017-01-23 Thread Hadoop QA (JIRA)

[ 
https://issues.apache.org/jira/browse/OOZIE-2777?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15834274#comment-15834274
 ] 

Hadoop QA commented on OOZIE-2777:
--

Testing JIRA OOZIE-2777

Cleaning local git workspace



{color:green}+1 PATCH_APPLIES{color}
{color:green}+1 CLEAN{color}
{color:green}+1 RAW_PATCH_ANALYSIS{color}
.{color:green}+1{color} the patch does not introduce any @author tags
.{color:green}+1{color} the patch does not introduce any tabs
.{color:green}+1{color} the patch does not introduce any trailing spaces
.{color:green}+1{color} the patch does not introduce any line longer than 
132
.{color:green}+1{color} the patch does adds/modifies 1 testcase(s)
{color:green}+1 RAT{color}
.{color:green}+1{color} the patch does not seem to introduce new RAT 
warnings
{color:green}+1 JAVADOC{color}
.{color:green}+1{color} the patch does not seem to introduce new Javadoc 
warnings
{color:green}+1 COMPILE{color}
.{color:green}+1{color} HEAD compiles
.{color:green}+1{color} patch compiles
.{color:green}+1{color} the patch does not seem to introduce new javac 
warnings
{color:green}+1{color} There are no new bugs found in total.
.{color:green}+1{color} There are no new bugs found in [server].
.{color:green}+1{color} There are no new bugs found in [client].
.{color:green}+1{color} There are no new bugs found in [core].
.{color:green}+1{color} There are no new bugs found in [docs].
.{color:green}+1{color} There are no new bugs found in 
[hadooplibs/hadoop-utils-2].
.{color:green}+1{color} There are no new bugs found in [tools].
.{color:green}+1{color} There are no new bugs found in [examples].
.{color:green}+1{color} There are no new bugs found in [sharelib/streaming].
.{color:green}+1{color} There are no new bugs found in [sharelib/sqoop].
.{color:green}+1{color} There are no new bugs found in [sharelib/distcp].
.{color:green}+1{color} There are no new bugs found in [sharelib/oozie].
.{color:green}+1{color} There are no new bugs found in [sharelib/hcatalog].
.{color:green}+1{color} There are no new bugs found in [sharelib/hive].
.{color:green}+1{color} There are no new bugs found in [sharelib/hive2].
.{color:green}+1{color} There are no new bugs found in [sharelib/pig].
.{color:green}+1{color} There are no new bugs found in [sharelib/spark].
{color:green}+1 BACKWARDS_COMPATIBILITY{color}
.{color:green}+1{color} the patch does not change any JPA 
Entity/Colum/Basic/Lob/Transient annotations
.{color:green}+1{color} the patch does not modify JPA files
{color:green}+1 TESTS{color}
.Tests run: 1841
{color:green}+1 DISTRO{color}
.{color:green}+1{color} distro tarball builds with the patch 


{color:green}*+1 Overall result, good!, no -1s*{color}


The full output of the test-patch run is available at

.   https://builds.apache.org/job/oozie-trunk-precommit-build/3565/

> Config-default.xml longer than 64k results in  java.io.UTFDataFormatException
> -
>
> Key: OOZIE-2777
> URL: https://issues.apache.org/jira/browse/OOZIE-2777
> Project: Oozie
>  Issue Type: Bug
>Reporter: Peter Cseh
>Assignee: Peter Cseh
> Attachments: OOZIE-2777-1.patch, OOZIE-2777-2.patch
>
>
> OOZIE-1642 introduced a workaround for DataOutputStream's 64k limit for 
> Strings.
> We've encountered the same error when a config-default.xml is larger than the 
> limit.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


Jenkins build is back to normal : oozie-trunk-precommit-build #3565

2017-01-23 Thread Apache Jenkins Server
See 



[jira] [Comment Edited] (OOZIE-2777) Config-default.xml longer than 64k results in java.io.UTFDataFormatException

2017-01-23 Thread Peter Bacsko (JIRA)

[ 
https://issues.apache.org/jira/browse/OOZIE-2777?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15834237#comment-15834237
 ] 

Peter Bacsko edited comment on OOZIE-2777 at 1/23/17 10:48 AM:
---

Minor:

1. Extract "UTF-8" constant in DataIOUtil
2. Perhaps StringSerializationUtil is a better name
3. Make DataIOUtil final + add private constructor
4. testSubmitLongXml -- don't catch the exception if it's not expected
5. {{dataOutput.writeInt(-1);}} -- {{-1}} is a magic number, pls extract it to 
a constant

Do we have tests for the following cases?
1. LiteWorkflowApp -- read back string that was serialized as lists (defList > 
-1, ensure backward compatibility)
2. LiteWorkflowApp -- read back string that was serialized with DataIOUtil
3. DataIOUtil -- string is less than 60k, write + read it back
4. DataIOUtil -- string is more than 60k, write + read it back


was (Author: pbacsko):
Minor:

1. Extract "UTF-8" constant in DataIOUtil
2. Perhaps StringSerializationUtil is a better name
3. Make DataIOUtil final + add private constructor
4. testSubmitLongXml -- don't catch the exception if it's not expected
5. {{dataOutput.writeInt(-1);}} -- {{-1}} is a magic number, pls extract it to 
a constant

Do we have tests for the following cases?
1. LiteWorkflowApp -- read back string when defList was serialized as lists 
(ensure backward compatibility)
2. LiteWorkflowApp -- read back string that was serialized with DataIOUtil
3. DataIOUtil -- string is less than 60k, write + read it back
4. DataIOUtil -- string is more than 60k, write + read it back

> Config-default.xml longer than 64k results in  java.io.UTFDataFormatException
> -
>
> Key: OOZIE-2777
> URL: https://issues.apache.org/jira/browse/OOZIE-2777
> Project: Oozie
>  Issue Type: Bug
>Reporter: Peter Cseh
>Assignee: Peter Cseh
> Attachments: OOZIE-2777-1.patch, OOZIE-2777-2.patch
>
>
> OOZIE-1642 introduced a workaround for DataOutputStream's 64k limit for 
> Strings.
> We've encountered the same error when a config-default.xml is larger than the 
> limit.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Comment Edited] (OOZIE-2777) Config-default.xml longer than 64k results in java.io.UTFDataFormatException

2017-01-23 Thread Peter Bacsko (JIRA)

[ 
https://issues.apache.org/jira/browse/OOZIE-2777?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15834237#comment-15834237
 ] 

Peter Bacsko edited comment on OOZIE-2777 at 1/23/17 10:35 AM:
---

Minor:

1. Extract "UTF-8" constant in DataIOUtil
2. Perhaps StringSerializationUtil is a better name
3. Make DataIOUtil final + add private constructor
4. testSubmitLongXml -- don't catch the exception if it's not expected
5. {{dataOutput.writeInt(-1);}} -- {{-1}} is a magic number, pls extract it to 
a constant

Do we have tests for the following cases?
1. LiteWorkflowApp -- read back string when defList was serialized as lists 
(ensure backward compatibility)
2. LiteWorkflowApp -- read back string that was serialized with DataIOUtil
3. DataIOUtil -- string is less than 60k, write + read it back
4. DataIOUtil -- string is more than 60k, write + read it back


was (Author: pbacsko):
Minor:

1. Extract "UTF-8" constant in DataIOUtil
2. Perhaps StringSerializationUtil is a better name
3. Make DataIOUtil final + add private constructor
4. testSubmitLongXml - don't catch the exception if it's not expected
5. {{dataOutput.writeInt(-1);}} - "-1" is a magic number, pls extract it to a 
constant

Do we have tests for the following cases?
1. LiteWorkflowApp -- read back string when defList was serialized as lists 
(ensure backward compatibility)
2. LiteWorkflowApp -- read back string that was serialized with DataIOUtil
3. DataIOUtil - string is less than 60k, write + read it back
4. DataIOUtil - string is more than 60k, write + read it back

> Config-default.xml longer than 64k results in  java.io.UTFDataFormatException
> -
>
> Key: OOZIE-2777
> URL: https://issues.apache.org/jira/browse/OOZIE-2777
> Project: Oozie
>  Issue Type: Bug
>Reporter: Peter Cseh
>Assignee: Peter Cseh
> Attachments: OOZIE-2777-1.patch, OOZIE-2777-2.patch
>
>
> OOZIE-1642 introduced a workaround for DataOutputStream's 64k limit for 
> Strings.
> We've encountered the same error when a config-default.xml is larger than the 
> limit.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (OOZIE-2777) Config-default.xml longer than 64k results in java.io.UTFDataFormatException

2017-01-23 Thread Peter Bacsko (JIRA)

[ 
https://issues.apache.org/jira/browse/OOZIE-2777?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15834237#comment-15834237
 ] 

Peter Bacsko commented on OOZIE-2777:
-

Minor:

1. Extract "UTF-8" constant in DataIOUtil
2. Perhaps StringSerializationUtil is a better name
3. Make DataIOUtil final + add private constructor
4. testSubmitLongXml - don't catch the exception if it's not expected
5. {{dataOutput.writeInt(-1);}} - "-1" is a magic number, pls extract it to a 
constant

Do we have tests for the following cases?
1. LiteWorkflowApp -- read back string when defList was serialized as lists 
(ensure backward compatibility)
2. LiteWorkflowApp -- read back string that was serialized with DataIOUtil
3. DataIOUtil - string is less than 60k, write + read it back
4. DataIOUtil - string is more than 60k, write + read it back

> Config-default.xml longer than 64k results in  java.io.UTFDataFormatException
> -
>
> Key: OOZIE-2777
> URL: https://issues.apache.org/jira/browse/OOZIE-2777
> Project: Oozie
>  Issue Type: Bug
>Reporter: Peter Cseh
>Assignee: Peter Cseh
> Attachments: OOZIE-2777-1.patch, OOZIE-2777-2.patch
>
>
> OOZIE-1642 introduced a workaround for DataOutputStream's 64k limit for 
> Strings.
> We've encountered the same error when a config-default.xml is larger than the 
> limit.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


Re: Review Request 55214: OOZIE-2770 Show missing dependencies for coord actions

2017-01-23 Thread Purshotam Shah


> On Jan. 19, 2017, 8:46 p.m., Rohini Palaniswamy wrote:
> > client/src/main/java/org/apache/oozie/cli/OozieCLI.java, line 182
> > 
> >
> > missingdeps instead of missingDependencies. Too long and we don't use 
> > camel case for command line options.

Agree.


> On Jan. 19, 2017, 8:46 p.m., Rohini Palaniswamy wrote:
> > client/src/main/java/org/apache/oozie/client/rest/JsonTags.java, lines 
> > 248-249
> > 
> >
> > Indentation does not look right.

it's correct.


> On Jan. 19, 2017, 8:46 p.m., Rohini Palaniswamy wrote:
> > core/src/main/java/org/apache/oozie/coord/input/dependency/AbstractCoordInputDependency.java,
> >  lines 325-327
> > 
> >
> > I don't see CoordPushInputDependency implementing this method. How does 
> > it work for that?

For input-logic first missing dependencies is always null ( and it doesn't get 
displayed in CLI/UI), because it difficult to find first since we don execute 
expression


> On Jan. 19, 2017, 8:46 p.m., Rohini Palaniswamy wrote:
> > core/src/main/java/org/apache/oozie/executor/jpa/CoordActionQueryExecutor.java,
> >  line 66
> > 
> >
> > GET_COORD_ACTION_DEPENDENCIES

This is already being used by CoordActionInputCheckXCommand.


- Purshotam


---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/55214/#review162319
---


On Jan. 23, 2017, 9:05 a.m., Purshotam Shah wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/55214/
> ---
> 
> (Updated Jan. 23, 2017, 9:05 a.m.)
> 
> 
> Review request for oozie.
> 
> 
> Bugs: OOZIE-2770
> https://issues.apache.org/jira/browse/OOZIE-2770
> 
> 
> Repository: oozie-git
> 
> 
> Description
> ---
> 
> OOZIE-2770 Show missing dependencies for coord actions
> 
> 
> Diffs
> -
> 
>   client/src/main/java/org/apache/oozie/cli/OozieCLI.java 
> 6e30d7eb667fe74440281fab3ca06c9f4df7bcf7 
>   client/src/main/java/org/apache/oozie/client/OozieClient.java 
> a107c4a3224dba76a59b9eb7c1903c0022d553a4 
>   client/src/main/java/org/apache/oozie/client/rest/JsonTags.java 
> d670142f446798f39fbb1cd8c3aed738a0897b18 
>   client/src/main/java/org/apache/oozie/client/rest/RestConstants.java 
> 9a3be979e1acf6fce8dc13ccdf985ce47215cf49 
>   core/src/main/java/org/apache/oozie/CoordinatorEngine.java 
> 91fe5a1d709ba1a90e493d301030465aa35ca790 
>   core/src/main/java/org/apache/oozie/ErrorCode.java 
> 9a843bd0f60ef3b946748adcd45563863c291a60 
>   
> core/src/main/java/org/apache/oozie/command/coord/CoordActionMissingDependenciesXCommand.java
>  e69de29bb2d1d6434b8b29ae775ad8c2e48c5391 
>   core/src/main/java/org/apache/oozie/command/coord/CoordCommandUtils.java 
> 0af7edc9094aaf24a6636ccebea17493e457fcce 
>   
> core/src/main/java/org/apache/oozie/command/coord/CoordSLAAlertsXCommand.java 
> b8affd67a412fac7d4ec452d7e2efa02c62ce25a 
>   core/src/main/java/org/apache/oozie/coord/CoordUtils.java 
> 82f9bede0878b361ffb47d865036573b15448c68 
>   
> core/src/main/java/org/apache/oozie/coord/input/dependency/AbstractCoordInputDependency.java
>  0da60ec70373399414a637c22753da7e2a7e6618 
>   
> core/src/main/java/org/apache/oozie/coord/input/dependency/CoordInputDependency.java
>  504bc3d5f8c48676736cb461462677ddac400d17 
>   
> core/src/main/java/org/apache/oozie/coord/input/dependency/CoordOldInputDependency.java
>  aabd2bf25c99710ce0b025b6b66ae0fd0bb00abf 
>   
> core/src/main/java/org/apache/oozie/coord/input/dependency/CoordPullInputDependency.java
>  f20dcae0ff44d745ffbcb22bce2653d042a65122 
>   core/src/main/java/org/apache/oozie/dependency/ActionDependency.java 
> fe7a3272190718f21aa594188013fadfa9b58646 
>   
> core/src/main/java/org/apache/oozie/executor/jpa/CoordActionQueryExecutor.java
>  c0e6c198f4978744016f35dd8940db345a71f92c 
>   core/src/main/java/org/apache/oozie/servlet/BaseJobServlet.java 
> 87a2b426ad3f5eeb08e76e1be473fdcdf387d293 
>   core/src/main/java/org/apache/oozie/servlet/V0JobServlet.java 
> 0c4212877f3051ef85ca04bb8d2e075b5f9c4c72 
>   core/src/main/java/org/apache/oozie/servlet/V1JobServlet.java 
> 95dcca63c459475b8d41a85e0db11ca2a530a2e4 
>   core/src/main/java/org/apache/oozie/servlet/V2JobServlet.java 
> 3a0ffb0181a0feec31d9aceeea2df5aba0681ae9 
>   core/src/test/java/org/apache/oozie/client/TestOozieCLI.java 
> 8ec38e498f31bb69923125e34cda5abfc8e72aa9 
>   
> core/src/test/java/org/apache/oozie/command/coord/TestCoordActionMissingDependenciesXCommand.java
>  

Re: Review Request 55214: OOZIE-2770 Show missing dependencies for coord actions

2017-01-23 Thread Purshotam Shah

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/55214/
---

(Updated Jan. 23, 2017, 9:05 a.m.)


Review request for oozie.


Bugs: OOZIE-2770
https://issues.apache.org/jira/browse/OOZIE-2770


Repository: oozie-git


Description
---

OOZIE-2770 Show missing dependencies for coord actions


Diffs (updated)
-

  client/src/main/java/org/apache/oozie/cli/OozieCLI.java 
6e30d7eb667fe74440281fab3ca06c9f4df7bcf7 
  client/src/main/java/org/apache/oozie/client/OozieClient.java 
a107c4a3224dba76a59b9eb7c1903c0022d553a4 
  client/src/main/java/org/apache/oozie/client/rest/JsonTags.java 
d670142f446798f39fbb1cd8c3aed738a0897b18 
  client/src/main/java/org/apache/oozie/client/rest/RestConstants.java 
9a3be979e1acf6fce8dc13ccdf985ce47215cf49 
  core/src/main/java/org/apache/oozie/CoordinatorEngine.java 
91fe5a1d709ba1a90e493d301030465aa35ca790 
  core/src/main/java/org/apache/oozie/ErrorCode.java 
9a843bd0f60ef3b946748adcd45563863c291a60 
  
core/src/main/java/org/apache/oozie/command/coord/CoordActionMissingDependenciesXCommand.java
 e69de29bb2d1d6434b8b29ae775ad8c2e48c5391 
  core/src/main/java/org/apache/oozie/command/coord/CoordCommandUtils.java 
0af7edc9094aaf24a6636ccebea17493e457fcce 
  core/src/main/java/org/apache/oozie/command/coord/CoordSLAAlertsXCommand.java 
b8affd67a412fac7d4ec452d7e2efa02c62ce25a 
  core/src/main/java/org/apache/oozie/coord/CoordUtils.java 
82f9bede0878b361ffb47d865036573b15448c68 
  
core/src/main/java/org/apache/oozie/coord/input/dependency/AbstractCoordInputDependency.java
 0da60ec70373399414a637c22753da7e2a7e6618 
  
core/src/main/java/org/apache/oozie/coord/input/dependency/CoordInputDependency.java
 504bc3d5f8c48676736cb461462677ddac400d17 
  
core/src/main/java/org/apache/oozie/coord/input/dependency/CoordOldInputDependency.java
 aabd2bf25c99710ce0b025b6b66ae0fd0bb00abf 
  
core/src/main/java/org/apache/oozie/coord/input/dependency/CoordPullInputDependency.java
 f20dcae0ff44d745ffbcb22bce2653d042a65122 
  core/src/main/java/org/apache/oozie/dependency/ActionDependency.java 
fe7a3272190718f21aa594188013fadfa9b58646 
  
core/src/main/java/org/apache/oozie/executor/jpa/CoordActionQueryExecutor.java 
c0e6c198f4978744016f35dd8940db345a71f92c 
  core/src/main/java/org/apache/oozie/servlet/BaseJobServlet.java 
87a2b426ad3f5eeb08e76e1be473fdcdf387d293 
  core/src/main/java/org/apache/oozie/servlet/V0JobServlet.java 
0c4212877f3051ef85ca04bb8d2e075b5f9c4c72 
  core/src/main/java/org/apache/oozie/servlet/V1JobServlet.java 
95dcca63c459475b8d41a85e0db11ca2a530a2e4 
  core/src/main/java/org/apache/oozie/servlet/V2JobServlet.java 
3a0ffb0181a0feec31d9aceeea2df5aba0681ae9 
  core/src/test/java/org/apache/oozie/client/TestOozieCLI.java 
8ec38e498f31bb69923125e34cda5abfc8e72aa9 
  
core/src/test/java/org/apache/oozie/command/coord/TestCoordActionMissingDependenciesXCommand.java
 e69de29bb2d1d6434b8b29ae775ad8c2e48c5391 
  
core/src/test/java/org/apache/oozie/coord/input/logic/TestCoordInputLogicPush.java
 6684a1fc7e8d1ed85b9e309cd163ae92f005f281 
  core/src/test/java/org/apache/oozie/servlet/MockCoordinatorEngineService.java 
0e74f2d1df67dd5d4aaccbdb66a3829f5894e751 
  core/src/test/resources/coord-multiple-output-instance5.xml 
e69de29bb2d1d6434b8b29ae775ad8c2e48c5391 
  docs/src/site/twiki/DG_CommandLineTool.twiki 
2dbbd4c820b9d8e11a51fdfe84185f5a1b3e6707 
  docs/src/site/twiki/WebServicesAPI.twiki 
8406da6ab3bec859a9ef2b889e558f6c9ad1d652 
  webapp/src/main/webapp/oozie-console.js 
7b20e9196cc6129b53fc610d34f6090311474eae 

Diff: https://reviews.apache.org/r/55214/diff/


Testing
---


Thanks,

Purshotam Shah



[jira] [Updated] (OOZIE-2777) Config-default.xml longer than 64k results in java.io.UTFDataFormatException

2017-01-23 Thread Peter Cseh (JIRA)

 [ 
https://issues.apache.org/jira/browse/OOZIE-2777?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Peter Cseh updated OOZIE-2777:
--
Attachment: OOZIE-2777-2.patch

Added license header to the new file.
The findbugs report seems odd, most of the issues are in classes (and 
subprojects) I've not touched.

> Config-default.xml longer than 64k results in  java.io.UTFDataFormatException
> -
>
> Key: OOZIE-2777
> URL: https://issues.apache.org/jira/browse/OOZIE-2777
> Project: Oozie
>  Issue Type: Bug
>Reporter: Peter Cseh
>Assignee: Peter Cseh
> Attachments: OOZIE-2777-1.patch, OOZIE-2777-2.patch
>
>
> OOZIE-1642 introduced a workaround for DataOutputStream's 64k limit for 
> Strings.
> We've encountered the same error when a config-default.xml is larger than the 
> limit.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)