date:20170809

Jenkins build is back to normal : oozie-trunk-find-patches-available #166815

2017-08-09 Thread Apache Jenkins Server

See

Jenkins build is back to normal : oozie-trunk-find-patches-available #166808

2017-08-09 Thread Apache Jenkins Server

See

Jenkins build is back to normal : oozie-trunk-find-patches-available #166794

2017-08-09 Thread Apache Jenkins Server

See

[jira] [Commented] (OOZIE-2670) Upgrade Hbase to 1.2

2017-08-09 Thread Hadoop QA (JIRA)


[ 
https://issues.apache.org/jira/browse/OOZIE-2670?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16120744#comment-16120744
 ] 

Hadoop QA commented on OOZIE-2670:
--

Testing JIRA OOZIE-2670

Cleaning local git workspace



{color:green}+1 PATCH_APPLIES{color}
{color:green}+1 CLEAN{color}
{color:red}-1 RAW_PATCH_ANALYSIS{color}
.{color:green}+1{color} the patch does not introduce any @author tags
.{color:green}+1{color} the patch does not introduce any tabs
.{color:green}+1{color} the patch does not introduce any trailing spaces
.{color:green}+1{color} the patch does not introduce any line longer than 
132
.{color:red}-1{color} the patch does not add/modify any testcase
{color:green}+1 RAT{color}
.{color:green}+1{color} the patch does not seem to introduce new RAT 
warnings
{color:green}+1 JAVADOC{color}
.{color:green}+1{color} the patch does not seem to introduce new Javadoc 
warnings
.{color:red}WARNING{color}: the current HEAD has 77 Javadoc warning(s)
{color:green}+1 COMPILE{color}
.{color:green}+1{color} HEAD compiles
.{color:green}+1{color} patch compiles
.{color:green}+1{color} the patch does not seem to introduce new javac 
warnings
{color:green}+1{color} There are no new bugs found in total.
. {color:green}+1{color} There are no new bugs found in [client].
. {color:green}+1{color} There are no new bugs found in [sharelib/hive].
. {color:green}+1{color} There are no new bugs found in [sharelib/sqoop].
. {color:green}+1{color} There are no new bugs found in [sharelib/spark].
. {color:green}+1{color} There are no new bugs found in [sharelib/streaming].
. {color:green}+1{color} There are no new bugs found in [sharelib/hive2].
. {color:green}+1{color} There are no new bugs found in [sharelib/oozie].
. {color:green}+1{color} There are no new bugs found in [sharelib/hcatalog].
. {color:green}+1{color} There are no new bugs found in [sharelib/pig].
. {color:green}+1{color} There are no new bugs found in [sharelib/distcp].
. {color:green}+1{color} There are no new bugs found in [docs].
. {color:green}+1{color} There are no new bugs found in [server].
. {color:green}+1{color} There are no new bugs found in [core].
. {color:green}+1{color} There are no new bugs found in [examples].
. {color:green}+1{color} There are no new bugs found in [tools].
{color:green}+1 BACKWARDS_COMPATIBILITY{color}
.{color:green}+1{color} the patch does not change any JPA 
Entity/Colum/Basic/Lob/Transient annotations
.{color:green}+1{color} the patch does not modify JPA files
{color:green}+1 TESTS{color}
.Tests run: 2009
.Tests rerun: 15
.Tests failed at first run: org.apache.oozie.jms.TestJMSJobEventListener,
{color:green}+1 DISTRO{color}
.{color:green}+1{color} distro tarball builds with the patch 


{color:red}*-1 Overall result, please check the reported -1(s)*{color}

{color:red}. There is at least one warning, please check{color}

The full output of the test-patch run is available at

. https://builds.apache.org/job/oozie-trunk-precommit-build/4029/

> Upgrade Hbase to 1.2
> 
>
> Key: OOZIE-2670
> URL: https://issues.apache.org/jira/browse/OOZIE-2670
> Project: Oozie
>  Issue Type: Bug
>Reporter: Peter Cseh
>Assignee: Peter Cseh
> Attachments: OOZIE-2670.001.patch, OOZIE-2670.002.patch, 
> OOZIE-2670.003.patch, OOZIE-2670.004.patch, OOZIE-2670.005.patch
>
>
> We should upgrade Hbase to a newer version, say 1.2



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

Build failed in Jenkins: oozie-trunk-precommit-build #4029

2017-08-09 Thread Apache Jenkins Server

See 


--
[...truncated 1.58 MB...]
[INFO] Copying junit-4.11.jar to 

[INFO] Copying metrics-graphite-3.1.2.jar to 

[INFO] Copying hadoop-auth-2.6.0.jar to 

[INFO] Copying hive-webhcat-java-client-1.2.0.jar to 

[INFO] Copying javax.annotation-api-1.2.jar to 

[INFO] Copying slf4j-log4j12-1.6.6.jar to 

[INFO] Copying jackson-core-2.4.2.jar to 

[INFO] Copying postgresql-9.0-801.jdbc4.jar to 

[INFO] Copying datanucleus-rdbms-3.2.9.jar to 

[INFO] Copying jettison-1.1.jar to 

[INFO] Copying guice-servlet-3.0.jar to 

[INFO] Copying ant-launcher-1.9.1.jar to 

[INFO] Copying jpam-1.1.jar to 

[INFO] Copying hive-service-1.2.0.jar to 

[INFO] Copying hive-hcatalog-server-extensions-1.2.0.jar to 

[INFO] Copying hadoop-mapreduce-client-core-2.6.0.jar to 

[INFO] Copying json-20090211.jar to 

[INFO] Copying avro-1.7.4.jar to 

[INFO] Copying jetty-util-9.2.19.v20160908.jar to 

[INFO] Copying apache-curator-2.6.0.pom to 

[INFO] 
[INFO] --- maven-assembly-plugin:2.2.1:single (default-cli) @ oozie-server ---
[INFO] Reading assembly descriptor: ../src/main/assemblies/empty.xml
[INFO] 
[INFO] 
[INFO] Building Apache Oozie Distro 5.0.0-SNAPSHOT
[INFO] 
[INFO] 
[INFO] --- maven-remote-resources-plugin:1.5:process (default) @ oozie-distro 
---
[INFO] 
[INFO] --- maven-resources-plugin:2.5:resources (default-resources) @ 
oozie-distro ---
[debug] execute contextualize
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] skip non existing resourceDirectory 

[INFO] Copying 3 resources
[INFO] 
[INFO] --- maven-compiler-plugin:2.3.2:compile (default-compile) @ oozie-distro 
---
[INFO] No sources to compile
[INFO] 
[INFO] --- maven-resources-plugin:2.5:testResources (default-testResources) @ 
oozie-distro ---
[debug] execute contextualize
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] skip non existing resourceDirectory 

[INFO] Copying 3 resources
[INFO] 
[INFO] --- maven-compiler-plugin:2.3.2:testCompile (default-testCompile) @ 
oozie-distro ---
[INFO] No sources to compile
[INFO] 
[INFO] --- maven-surefire-plugin:2.12.2:test (default-test) @ oozie-distro ---
[INFO] Tests are skipped.
[INFO] 
[INFO] --- maven-jar-plugin:2.3.1:jar (default-jar) @ oozie-distro ---
[INFO] Building jar:

Build failed in Jenkins: oozie-trunk-find-patches-available #166793

2017-08-09 Thread Apache Jenkins Server

See 


--
Started by timer
[EnvInject] - Loading node environment variables.
Building remotely on H1 (Hadoop) in workspace 

 > git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
 > git config remote.origin.url 
 > https://git-wip-us.apache.org/repos/asf/oozie.git # timeout=10
Fetching upstream changes from https://git-wip-us.apache.org/repos/asf/oozie.git
 > git --version # timeout=10
 > git fetch --tags --progress 
 > https://git-wip-us.apache.org/repos/asf/oozie.git 
 > +refs/heads/*:refs/remotes/origin/*
 > git rev-parse refs/remotes/origin/master^{commit} # timeout=10
 > git rev-parse refs/remotes/origin/origin/master^{commit} # timeout=10
Checking out Revision ebf38e8fda10d1b580f66169da7e770dc93b7075 
(refs/remotes/origin/master)
Commit message: "OOZIE-2999 minioozie can't compile (Artem Ervits via gezapeti)"
 > git config core.sparsecheckout # timeout=10
 > git checkout -f ebf38e8fda10d1b580f66169da7e770dc93b7075
 > git rev-list ebf38e8fda10d1b580f66169da7e770dc93b7075 # timeout=10
[oozie-trunk-find-patches-available] $ /bin/bash 
/tmp/jenkins6993846692291529006.sh
mkdir: cannot create directory 
':
 File exists
  % Total% Received % Xferd  Average Speed   TimeTime Time  Current
 Dload  Upload   Total   SpentLeft  Speed
  0 00 00 0  0  0 --:--:-- --:--:-- --:--:-- 0  
0 00 00 0  0  0 --:--:--  0:00:01 --:--:-- 0100 
 207k0  207k0 0   114k  0 --:--:--  0:00:01 --:--:--  114k100  
471k0  471k0 0   166k  0 --:--:--  0:00:02 --:--:--  166k100  
767k0  767k0 0   201k  0 --:--:--  0:00:03 --:--:--  201k100  
983k0  983k0 0   202k  0 --:--:--  0:00:04 --:--:--  202k100 
1415k0 1415k0 0   245k  0 --:--:--  0:00:05 --:--:--  296k100 
1671k0 1671k0 0   244k  0 --:--:--  0:00:06 --:--:--  291k100 
1807k0 1807k0 0   231k  0 --:--:--  0:00:07 --:--:--  269k100 
1807k0 1807k0 0   231k  0 --:--:--  0:00:07 --:--:--  261k
curl: (18) transfer closed with outstanding read data remaining
Could not retrieve available patches from JIRA
Build step 'Execute shell' marked build as failure

[jira] [Commented] (OOZIE-3009) Number of Oozie tests executed dropped after OOZIE-2854

2017-08-09 Thread Hadoop QA (JIRA)


[ 
https://issues.apache.org/jira/browse/OOZIE-3009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16120216#comment-16120216
 ] 

Hadoop QA commented on OOZIE-3009:
--

Testing JIRA OOZIE-3009

Cleaning local git workspace



{color:green}+1 PATCH_APPLIES{color}
{color:green}+1 CLEAN{color}
{color:green}+1 RAW_PATCH_ANALYSIS{color}
.{color:green}+1{color} the patch does not introduce any @author tags
.{color:green}+1{color} the patch does not introduce any tabs
.{color:green}+1{color} the patch does not introduce any trailing spaces
.{color:green}+1{color} the patch does not introduce any line longer than 
132
.{color:green}+1{color} the patch does adds/modifies 1 testcase(s)
{color:green}+1 RAT{color}
.{color:green}+1{color} the patch does not seem to introduce new RAT 
warnings
{color:green}+1 JAVADOC{color}
.{color:green}+1{color} the patch does not seem to introduce new Javadoc 
warnings
.{color:red}WARNING{color}: the current HEAD has 77 Javadoc warning(s)
{color:green}+1 COMPILE{color}
.{color:green}+1{color} HEAD compiles
.{color:green}+1{color} patch compiles
.{color:green}+1{color} the patch does not seem to introduce new javac 
warnings
{color:green}+1{color} There are no new bugs found in total.
. {color:green}+1{color} There are no new bugs found in [client].
. {color:green}+1{color} There are no new bugs found in [sharelib/hive].
. {color:green}+1{color} There are no new bugs found in [sharelib/sqoop].
. {color:green}+1{color} There are no new bugs found in [sharelib/spark].
. {color:green}+1{color} There are no new bugs found in [sharelib/streaming].
. {color:green}+1{color} There are no new bugs found in [sharelib/hive2].
. {color:green}+1{color} There are no new bugs found in [sharelib/oozie].
. {color:green}+1{color} There are no new bugs found in [sharelib/hcatalog].
. {color:green}+1{color} There are no new bugs found in [sharelib/pig].
. {color:green}+1{color} There are no new bugs found in [sharelib/distcp].
. {color:green}+1{color} There are no new bugs found in [docs].
. {color:green}+1{color} There are no new bugs found in [server].
. {color:green}+1{color} There are no new bugs found in [core].
. {color:green}+1{color} There are no new bugs found in [examples].
. {color:green}+1{color} There are no new bugs found in [tools].
{color:green}+1 BACKWARDS_COMPATIBILITY{color}
.{color:green}+1{color} the patch does not change any JPA 
Entity/Colum/Basic/Lob/Transient annotations
.{color:green}+1{color} the patch does not modify JPA files
{color:green}+1 TESTS{color}
.Tests run: 2009
.Tests rerun: 15
.Tests failed at first run: org.apache.oozie.jms.TestJMSJobEventListener,
{color:green}+1 DISTRO{color}
.{color:green}+1{color} distro tarball builds with the patch 


{color:green}*+1 Overall result, good!, no -1s*{color}

{color:red}. There is at least one warning, please check{color}

The full output of the test-patch run is available at

. https://builds.apache.org/job/oozie-trunk-precommit-build/4028/

> Number of Oozie tests executed dropped after OOZIE-2854
> ---
>
> Key: OOZIE-3009
> URL: https://issues.apache.org/jira/browse/OOZIE-3009
> Project: Oozie
>  Issue Type: Bug
>Reporter: Attila Sasvari
>Assignee: Andras Piros
>Priority: Blocker
> Fix For: 5.0.0
>
> Attachments: OOZIE-3009.001.patch, OOZIE-3009.002.patch, 
> OOZIE-3009.amend.001.patch
>
>
> I noticed that the number of executed tests has been significantly dropped 
> after OOZIE-2854.
> - Tests run: *1080* https://issues.apache.org/jira/browse/OOZIE-2854
> Previous tests:
> - OOZIE-2371 - Tests run: *1965* 
> https://issues.apache.org/jira/browse/OOZIE-2371?focusedCommentId=16076996=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-16076996
> - OOZIE-2911 - Tests run: *1966* 
> https://issues.apache.org/jira/browse/OOZIE-2911?focusedCommentId=16078078=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-16078078
> In OOZIE-2854, we can also see that the number of test cases vary from patch 
> to patch.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

Jenkins build is back to normal : oozie-trunk-precommit-build #4028

2017-08-09 Thread Apache Jenkins Server

See

[jira] [Assigned] (OOZIE-2687) Create XML schema for launcher configurations

2017-08-09 Thread Attila Sasvari (JIRA)


 [ 
https://issues.apache.org/jira/browse/OOZIE-2687?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Attila Sasvari reassigned OOZIE-2687:
-

Assignee: Attila Sasvari  (was: Peter Bacsko)

> Create XML schema for launcher configurations
> -
>
> Key: OOZIE-2687
> URL: https://issues.apache.org/jira/browse/OOZIE-2687
> Project: Oozie
>  Issue Type: Sub-task
>Reporter: Peter Cseh
>Assignee: Attila Sasvari
> Attachments: OOZIE-2687-001.patch
>
>
> It was possible to manipulate the MapperLauncher's environment through 
> properties like:
> # mapreduce.map.memory.mb 
> # mapreduce.map.cpu.vcores
> # mapred.child.env
> # mapred.child.java.opts  
> # mapred.job.queue.name  - ability to set launcher queue
> E.g. We were using mapred.child.env to pass SPARK_HOME to the LauncherMapper 
> and make PySpark work. 
> Fixing OOZIE-2596 added a hack. We should decide how we support or break 
> compatibility and how we allow the manipulation of the Launcher environment.
> Verify if the new launcher section in global applies to actions in 
> sub-workflows as well. It did not use to work before and was only fixed in 
> OOZIE-2030. It would be good to have that testcase 
> (TestSubWorkflowActionExecutor. testParentGlobalConf) updated with the new 
> launcher section as well.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

[jira] [Updated] (OOZIE-2687) Create XML schema for launcher configurations

2017-08-09 Thread Attila Sasvari (JIRA)


 [ 
https://issues.apache.org/jira/browse/OOZIE-2687?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Attila Sasvari updated OOZIE-2687:
--
Attachment: OOZIE-2687-001.patch

I had to make some modifications in [~pbacsko] wip

Tested
- TestJavaActionExecutor, TestLiteWorkflowAppParser tests passed
- java-main example on pseudo hadoop succeeded, modified workflow xml so that 
verbose class loading information is printed out of stdout of the launcher job
{code}




${jobTracker}
${nameNode}

  -verbose:class



mapred.job.queue.name
${queueName}


org.apache.oozie.example.DemoJavaMain
Hello
Oozie!





Java failed, error 
message[${wf:errorMessage(wf:lastErrorNode())}]



{code} 

Logs:
{code}
head -3 
/Users/asasvari/workspace/pseudo/hadoop-2.6.0/logs/userlogs/application_1502291380639_0001/container_1502291380639_0001_01_01/stdout
[Opened 
/Library/Java/JavaVirtualMachines/jdk1.8.0_121.jdk/Contents/Home/jre/lib/rt.jar]
[Loaded java.lang.Object from 
/Library/Java/JavaVirtualMachines/jdk1.8.0_121.jdk/Contents/Home/jre/lib/rt.jar]
[Loaded java.io.Serializable from 
/Library/Java/JavaVirtualMachines/jdk1.8.0_121.jdk/Contents/Home/jre/lib/rt.jar]
{code}

> Create XML schema for launcher configurations
> -
>
> Key: OOZIE-2687
> URL: https://issues.apache.org/jira/browse/OOZIE-2687
> Project: Oozie
>  Issue Type: Sub-task
>Reporter: Peter Cseh
>Assignee: Peter Bacsko
> Attachments: OOZIE-2687-001.patch
>
>
> It was possible to manipulate the MapperLauncher's environment through 
> properties like:
> # mapreduce.map.memory.mb 
> # mapreduce.map.cpu.vcores
> # mapred.child.env
> # mapred.child.java.opts  
> # mapred.job.queue.name  - ability to set launcher queue
> E.g. We were using mapred.child.env to pass SPARK_HOME to the LauncherMapper 
> and make PySpark work. 
> Fixing OOZIE-2596 added a hack. We should decide how we support or break 
> compatibility and how we allow the manipulation of the Launcher environment.
> Verify if the new launcher section in global applies to actions in 
> sub-workflows as well. It did not use to work before and was only fixed in 
> OOZIE-2030. It would be good to have that testcase 
> (TestSubWorkflowActionExecutor. testParentGlobalConf) updated with the new 
> launcher section as well.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

[jira] [Commented] (OOZIE-2687) Create XML schema for launcher configurations

2017-08-09 Thread Attila Sasvari (JIRA)


[ 
https://issues.apache.org/jira/browse/OOZIE-2687?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16120062#comment-16120062
 ] 

Attila Sasvari commented on OOZIE-2687:
---

[~pbacsko] many thanks for the initial patch, do you mind if I take this task 
over?

> Create XML schema for launcher configurations
> -
>
> Key: OOZIE-2687
> URL: https://issues.apache.org/jira/browse/OOZIE-2687
> Project: Oozie
>  Issue Type: Sub-task
>Reporter: Peter Cseh
>Assignee: Peter Bacsko
>
> It was possible to manipulate the MapperLauncher's environment through 
> properties like:
> # mapreduce.map.memory.mb 
> # mapreduce.map.cpu.vcores
> # mapred.child.env
> # mapred.child.java.opts  
> # mapred.job.queue.name  - ability to set launcher queue
> E.g. We were using mapred.child.env to pass SPARK_HOME to the LauncherMapper 
> and make PySpark work. 
> Fixing OOZIE-2596 added a hack. We should decide how we support or break 
> compatibility and how we allow the manipulation of the Launcher environment.
> Verify if the new launcher section in global applies to actions in 
> sub-workflows as well. It did not use to work before and was only fixed in 
> OOZIE-2030. It would be good to have that testcase 
> (TestSubWorkflowActionExecutor. testParentGlobalConf) updated with the new 
> launcher section as well.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

[jira] [Assigned] (OOZIE-2909) LauncherAM: rewrite UGI calls

2017-08-09 Thread Peter Cseh (JIRA)


 [ 
https://issues.apache.org/jira/browse/OOZIE-2909?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Peter Cseh reassigned OOZIE-2909:
-

Assignee: Peter Cseh

> LauncherAM: rewrite UGI calls
> -
>
> Key: OOZIE-2909
> URL: https://issues.apache.org/jira/browse/OOZIE-2909
> Project: Oozie
>  Issue Type: Sub-task
>Reporter: Peter Bacsko
>Assignee: Peter Cseh
>
> There are two problems in LauncherAM:
> 1) In a kerberized cluster, we have to use {{UGI.getLoginUser()}} even though 
> a call to {{createRemoteUser()}} should be enough, just like in 
> {{MRAppMaster.java}}. Reference code:
> https://github.com/apache/hadoop/blob/3ed3062fe3979ff55a411b730a8eee2b2c96d6b3/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/MRAppMaster.java#L1718-L1726
> 2) It's enough if we wrap the whole LauncherAM logic in a single {{doAs()}} 
> call. No need for multiple {{doAs()}}, just makes the whole thing more 
> complicated.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

[jira] [Assigned] (OOZIE-2896) Ensure compatibility for existing LauncherMapper settings

2017-08-09 Thread Peter Cseh (JIRA)


 [ 
https://issues.apache.org/jira/browse/OOZIE-2896?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Peter Cseh reassigned OOZIE-2896:
-

Assignee: Peter Cseh

> Ensure compatibility for existing LauncherMapper settings
> -
>
> Key: OOZIE-2896
> URL: https://issues.apache.org/jira/browse/OOZIE-2896
> Project: Oozie
>  Issue Type: Sub-task
>Reporter: Peter Bacsko
>Assignee: Peter Cseh
>
> There are a couple of LauncherMapper settings that we should support for 
> backward compatibility reasons.
> For example, {{oozie.launcher.mapreduce.map.memory.mb}}, 
> {{mapred.child.env}}, {{mapred.map.env}}, etc.
> We also have to discuss the list of properties we're going to support, since 
> there are many of them.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

[jira] [Updated] (OOZIE-3009) Number of Oozie tests executed dropped after OOZIE-2854

2017-08-09 Thread Andras Piros (JIRA)


 [ 
https://issues.apache.org/jira/browse/OOZIE-3009?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Andras Piros updated OOZIE-3009:

Attachment: OOZIE-3009.amend.001.patch

Enabling {{TestWorkflow}} after {{TestWorkflowRetries}} not to retry - not 
injecting database retries.

> Number of Oozie tests executed dropped after OOZIE-2854
> ---
>
> Key: OOZIE-3009
> URL: https://issues.apache.org/jira/browse/OOZIE-3009
> Project: Oozie
>  Issue Type: Bug
>Reporter: Attila Sasvari
>Assignee: Andras Piros
>Priority: Blocker
> Fix For: 5.0.0
>
> Attachments: OOZIE-3009.001.patch, OOZIE-3009.002.patch, 
> OOZIE-3009.amend.001.patch
>
>
> I noticed that the number of executed tests has been significantly dropped 
> after OOZIE-2854.
> - Tests run: *1080* https://issues.apache.org/jira/browse/OOZIE-2854
> Previous tests:
> - OOZIE-2371 - Tests run: *1965* 
> https://issues.apache.org/jira/browse/OOZIE-2371?focusedCommentId=16076996=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-16076996
> - OOZIE-2911 - Tests run: *1966* 
> https://issues.apache.org/jira/browse/OOZIE-2911?focusedCommentId=16078078=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-16078078
> In OOZIE-2854, we can also see that the number of test cases vary from patch 
> to patch.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

[jira] [Reopened] (OOZIE-3009) Number of Oozie tests executed dropped after OOZIE-2854

2017-08-09 Thread Andras Piros (JIRA)


 [ 
https://issues.apache.org/jira/browse/OOZIE-3009?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Andras Piros reopened OOZIE-3009:
-

If {{TestWorkflowRetries}} run happens before {{TestWorkflow}}, the latter will 
also retry on database errors, causing timeout on some of the clusters.

> Number of Oozie tests executed dropped after OOZIE-2854
> ---
>
> Key: OOZIE-3009
> URL: https://issues.apache.org/jira/browse/OOZIE-3009
> Project: Oozie
>  Issue Type: Bug
>Reporter: Attila Sasvari
>Assignee: Andras Piros
>Priority: Blocker
> Fix For: 5.0.0
>
> Attachments: OOZIE-3009.001.patch, OOZIE-3009.002.patch
>
>
> I noticed that the number of executed tests has been significantly dropped 
> after OOZIE-2854.
> - Tests run: *1080* https://issues.apache.org/jira/browse/OOZIE-2854
> Previous tests:
> - OOZIE-2371 - Tests run: *1965* 
> https://issues.apache.org/jira/browse/OOZIE-2371?focusedCommentId=16076996=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-16076996
> - OOZIE-2911 - Tests run: *1966* 
> https://issues.apache.org/jira/browse/OOZIE-2911?focusedCommentId=16078078=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-16078078
> In OOZIE-2854, we can also see that the number of test cases vary from patch 
> to patch.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

Build failed in Jenkins: oozie-trunk-precommit-build #4027

2017-08-09 Thread Apache Jenkins Server

See 


Changes:

[gezapeti] OOZIE-2999 minioozie can't compile (Artem Ervits via gezapeti)

--
[...truncated 1.58 MB...]
[INFO] Copying commons-beanutils-1.7.0.jar to 

[INFO] Copying junit-4.11.jar to 

[INFO] Copying metrics-graphite-3.1.2.jar to 

[INFO] Copying hadoop-auth-2.6.0.jar to 

[INFO] Copying hive-webhcat-java-client-1.2.0.jar to 

[INFO] Copying javax.annotation-api-1.2.jar to 

[INFO] Copying slf4j-log4j12-1.6.6.jar to 

[INFO] Copying jackson-core-2.4.2.jar to 

[INFO] Copying postgresql-9.0-801.jdbc4.jar to 

[INFO] Copying datanucleus-rdbms-3.2.9.jar to 

[INFO] Copying jettison-1.1.jar to 

[INFO] Copying guice-servlet-3.0.jar to 

[INFO] Copying ant-launcher-1.9.1.jar to 

[INFO] Copying jpam-1.1.jar to 

[INFO] Copying hive-service-1.2.0.jar to 

[INFO] Copying hive-hcatalog-server-extensions-1.2.0.jar to 

[INFO] Copying hadoop-mapreduce-client-core-2.6.0.jar to 

[INFO] Copying json-20090211.jar to 

[INFO] Copying avro-1.7.4.jar to 

[INFO] Copying jetty-util-9.2.19.v20160908.jar to 

[INFO] Copying apache-curator-2.6.0.pom to 

[INFO] 
[INFO] --- maven-assembly-plugin:2.2.1:single (default-cli) @ oozie-server ---
[INFO] Reading assembly descriptor: ../src/main/assemblies/empty.xml
[INFO] 
[INFO] 
[INFO] Building Apache Oozie Distro 5.0.0-SNAPSHOT
[INFO] 
[INFO] 
[INFO] --- maven-remote-resources-plugin:1.5:process (default) @ oozie-distro 
---
[INFO] 
[INFO] --- maven-resources-plugin:2.5:resources (default-resources) @ 
oozie-distro ---
[debug] execute contextualize
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] skip non existing resourceDirectory 

[INFO] Copying 3 resources
[INFO] 
[INFO] --- maven-compiler-plugin:2.3.2:compile (default-compile) @ oozie-distro 
---
[INFO] No sources to compile
[INFO] 
[INFO] --- maven-resources-plugin:2.5:testResources (default-testResources) @ 
oozie-distro ---
[debug] execute contextualize
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] skip non existing resourceDirectory 

[INFO] Copying 3 resources
[INFO] 
[INFO] --- maven-compiler-plugin:2.3.2:testCompile (default-testCompile) @ 
oozie-distro ---
[INFO] No sources to compile
[INFO] 
[INFO] ---

[jira] [Commented] (OOZIE-2608) Comma in oozie.service.JPAService.jdbc.password value results in authentication error

2017-08-09 Thread Hadoop QA (JIRA)


[ 
https://issues.apache.org/jira/browse/OOZIE-2608?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16119958#comment-16119958
 ] 

Hadoop QA commented on OOZIE-2608:
--

Testing JIRA OOZIE-2608

Cleaning local git workspace



{color:green}+1 PATCH_APPLIES{color}
{color:green}+1 CLEAN{color}
{color:red}-1 RAW_PATCH_ANALYSIS{color}
.{color:green}+1{color} the patch does not introduce any @author tags
.{color:green}+1{color} the patch does not introduce any tabs
.{color:green}+1{color} the patch does not introduce any trailing spaces
.{color:green}+1{color} the patch does not introduce any line longer than 
132
.{color:red}-1{color} the patch does not add/modify any testcase
{color:green}+1 RAT{color}
.{color:green}+1{color} the patch does not seem to introduce new RAT 
warnings
{color:green}+1 JAVADOC{color}
.{color:green}+1{color} the patch does not seem to introduce new Javadoc 
warnings
.{color:red}WARNING{color}: the current HEAD has 77 Javadoc warning(s)
{color:green}+1 COMPILE{color}
.{color:green}+1{color} HEAD compiles
.{color:green}+1{color} patch compiles
.{color:green}+1{color} the patch does not seem to introduce new javac 
warnings
{color:green}+1{color} There are no new bugs found in total.
. {color:green}+1{color} There are no new bugs found in [client].
. {color:green}+1{color} There are no new bugs found in [sharelib/hive].
. {color:green}+1{color} There are no new bugs found in [sharelib/sqoop].
. {color:green}+1{color} There are no new bugs found in [sharelib/spark].
. {color:green}+1{color} There are no new bugs found in [sharelib/streaming].
. {color:green}+1{color} There are no new bugs found in [sharelib/hive2].
. {color:green}+1{color} There are no new bugs found in [sharelib/oozie].
. {color:green}+1{color} There are no new bugs found in [sharelib/hcatalog].
. {color:green}+1{color} There are no new bugs found in [sharelib/pig].
. {color:green}+1{color} There are no new bugs found in [sharelib/distcp].
. {color:green}+1{color} There are no new bugs found in [docs].
. {color:green}+1{color} There are no new bugs found in [server].
. {color:green}+1{color} There are no new bugs found in [core].
. {color:green}+1{color} There are no new bugs found in [examples].
. {color:green}+1{color} There are no new bugs found in [tools].
{color:green}+1 BACKWARDS_COMPATIBILITY{color}
.{color:green}+1{color} the patch does not change any JPA 
Entity/Colum/Basic/Lob/Transient annotations
.{color:green}+1{color} the patch does not modify JPA files
{color:green}+1 TESTS{color}
.Tests run: 2009
.Tests rerun: 17
.Tests failed at first run: 
org.apache.oozie.command.wf.TestWorkflowActionRetryInfoXCommand,org.apache.oozie.jms.TestJMSJobEventListener,
{color:green}+1 DISTRO{color}
.{color:green}+1{color} distro tarball builds with the patch 


{color:red}*-1 Overall result, please check the reported -1(s)*{color}

{color:red}. There is at least one warning, please check{color}

The full output of the test-patch run is available at

. https://builds.apache.org/job/oozie-trunk-precommit-build/4027/

> Comma in oozie.service.JPAService.jdbc.password value results in 
> authentication error
> -
>
> Key: OOZIE-2608
> URL: https://issues.apache.org/jira/browse/OOZIE-2608
> Project: Oozie
>  Issue Type: Bug
>  Components: core
>Affects Versions: 4.2.0
> Environment: HDP 2.4 latest, Oozie 4.2.0.2.4.2.0-258
>Reporter: Nikolai Grigoriev
>Assignee: Peter Cseh
>Priority: Minor
> Attachments: OOZIE-2608-001.patch, OOZIE-2608-002.patch, 
> OOZIE-2608-003.patch
>
>
> I have attempted to install Oozie with Postgres db backend via HDP 2.4. I was 
> able to test DB connection via Ambari, everything was correct. However, the 
> server failed to start with this error:
> {code}
> 2016-07-15 11:46:39,580  INFO URIHandlerService:520 - 
> SERVER[hadoop-master01.production.sociablelabs.net] Loaded default urihandler 
> org.apache.oozie.dependency.FSURIHandler
> 2016-07-15 11:46:40,323  INFO HadoopAccessorService:520 - 
> SERVER[hadoop-master01.production.sociablelabs.net] password key is 
> oozie.service.JPAService.jdbc.password
> 2016-07-15 11:46:40,331  INFO HadoopAccessorService:520 - 
> SERVER[hadoop-master01.production.sociablelabs.net] credential provider path 
> is null
> 2016-07-15 11:46:40,337  INFO HadoopAccessorService:520 - 
> SERVER[hadoop-master01.production.sociablelabs.net] password is null
> 2016-07-15 11:46:41,176 FATAL Services:514 - 
> SERVER[hadoop-master01.production.sociablelabs.net] Runtime Exception during 
> Services Load. Check your list of 'oozie.services' or 'o
> ozie.services.ext'
> 2016-07-15 11:46:41,194 FATAL Services:514

[jira] [Commented] (OOZIE-3028) Oozie Pig Action fails with no python dependencies

2017-08-09 Thread Artem Ervits (JIRA)


[ 
https://issues.apache.org/jira/browse/OOZIE-3028?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16119817#comment-16119817
 ] 

Artem Ervits commented on OOZIE-3028:
-

failing tests are unrelated, pass locally.

> Oozie Pig Action fails with no python dependencies
> --
>
> Key: OOZIE-3028
> URL: https://issues.apache.org/jira/browse/OOZIE-3028
> Project: Oozie
>  Issue Type: Bug
>  Components: build
>Affects Versions: 4.3.0
>Reporter: Prabhu Joseph
>Assignee: Artem Ervits
>  Labels: pig
> Fix For: 5.0.0
>
> Attachments: OOZIE-3028-0.patch
>
>
> Oozie Pig Action with Python script fails with below as the pig sharelib 
> jython-2.5.3.jar does not have python dependencies. We should include 
> jython-standalone jar into pig sharelib which has the right dependencies.
> {code}
> Caused by: java.lang.NoSuchFieldError: __code__
> at 
> org.apache.pig.scripting.jython.JythonFunction.(JythonFunction.java:57)
> ... 51 more
> {code}
> # /usr/hdp/current/oozie-server/bin/oozie admin -shareliblist pig |grep 
> jython 
>   
> hdfs://mycluster/user/oozie/share/lib/lib_20170106054154/pig/jython-2.5.3.jar



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

[jira] [Updated] (OOZIE-3005) Cover all workflow action types and workflow / action SLA with JAXB

2017-08-09 Thread Andras Piros (JIRA)


 [ 
https://issues.apache.org/jira/browse/OOZIE-3005?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Andras Piros updated OOZIE-3005:

Summary: Cover all workflow action types and workflow / action SLA with 
JAXB  (was: Cover all workflow action types with JAXB)

> Cover all workflow action types and workflow / action SLA with JAXB
> ---
>
> Key: OOZIE-3005
> URL: https://issues.apache.org/jira/browse/OOZIE-3005
> Project: Oozie
>  Issue Type: Sub-task
>  Components: client
>Reporter: Daniel Becker
>Assignee: Andras Piros
>
> All the Oozie workflow actions have to be covered, not only MapReduce ones, 
> considering following:
> * no XSD change should be performed
> * XJB mapping file has to be extended to incorporate all the workflow action 
> types, also the ones inside 
> {{//xs:complexType[@name='ACTION']/xs:sequence/xs:choice/xs:any[@namespace='##other']}}
> * XJB mapping file has to be extended to incorporate SLA related stuff inside 
> {{//xs:complexType[@name='ACTION']/xs:sequence/xs:any[@namespace='uri:oozie:sla:0.1
>  uri:oozie:sla:0.2']}}
> * autogenerate sources from different XSDs to different packages, resolve 
> namespace clashes that way. Note that it's not a goal to have all namespace 
> clashes resolve within XSDs
> * extend {{TestJAXBWorkflow}} to handle all those different action types, and 
> SLA, as well



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

[jira] [Updated] (OOZIE-3005) Cover all workflow action types with JAXB

2017-08-09 Thread Andras Piros (JIRA)


 [ 
https://issues.apache.org/jira/browse/OOZIE-3005?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Andras Piros updated OOZIE-3005:

Description: 
All the Oozie workflow actions have to be covered, not only MapReduce ones, 
considering following:
* no XSD change should be performed
* XJB mapping file has to be extended to incorporate all the workflow action 
types, also the ones inside 
{{//xs:complexType[@name='ACTION']/xs:sequence/xs:choice/xs:any[@namespace='##other']}}
* XJB mapping file has to be extended to incorporate SLA related stuff inside 
{{//xs:complexType[@name='ACTION']/xs:sequence/xs:any[@namespace='uri:oozie:sla:0.1
 uri:oozie:sla:0.2']}}
* autogenerate sources from different XSDs to different packages, resolve 
namespace clashes that way. Note that it's not a goal to have all namespace 
clashes resolve within XSDs
* extend {{TestJAXBWorkflow}} to handle all those different action types, and 
SLA, as well

  was:
All the Oozie workflow actions have to be covered, not only MapReduce ones, 
considering following:
* no XSD change should be performed
* XJB mapping file has to be extended to incorporate all the workflow action 
types, also the ones inside {{//action/@any}}


> Cover all workflow action types with JAXB
> -
>
> Key: OOZIE-3005
> URL: https://issues.apache.org/jira/browse/OOZIE-3005
> Project: Oozie
>  Issue Type: Sub-task
>  Components: client
>Reporter: Daniel Becker
>Assignee: Andras Piros
>
> All the Oozie workflow actions have to be covered, not only MapReduce ones, 
> considering following:
> * no XSD change should be performed
> * XJB mapping file has to be extended to incorporate all the workflow action 
> types, also the ones inside 
> {{//xs:complexType[@name='ACTION']/xs:sequence/xs:choice/xs:any[@namespace='##other']}}
> * XJB mapping file has to be extended to incorporate SLA related stuff inside 
> {{//xs:complexType[@name='ACTION']/xs:sequence/xs:any[@namespace='uri:oozie:sla:0.1
>  uri:oozie:sla:0.2']}}
> * autogenerate sources from different XSDs to different packages, resolve 
> namespace clashes that way. Note that it's not a goal to have all namespace 
> clashes resolve within XSDs
> * extend {{TestJAXBWorkflow}} to handle all those different action types, and 
> SLA, as well



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

[jira] [Commented] (OOZIE-2061) Remove CoordJobDeleteJPAExecutor

2017-08-09 Thread Peter Cseh (JIRA)


[ 
https://issues.apache.org/jira/browse/OOZIE-2061?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16119601#comment-16119601
 ] 

Peter Cseh commented on OOZIE-2061:
---

I've triggered a pre-commit job for this

> Remove CoordJobDeleteJPAExecutor
> 
>
> Key: OOZIE-2061
> URL: https://issues.apache.org/jira/browse/OOZIE-2061
> Project: Oozie
>  Issue Type: Task
>Affects Versions: 4.3.0
>Reporter: Shwetha G S
>Assignee: Artem Ervits
>Priority: Trivial
> Fix For: trunk, 5.0.0
>
> Attachments: OOZIE-2061-0.patch
>
>
> Looks like CoordJobDeleteJPAExecutor is not used anywhere. Remove if not 
> required



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

[jira] [Commented] (OOZIE-2999) minioozie can't compile

2017-08-09 Thread Peter Cseh (JIRA)


[ 
https://issues.apache.org/jira/browse/OOZIE-2999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16119597#comment-16119597
 ] 

Peter Cseh commented on OOZIE-2999:
---

+1

> minioozie can't compile
> ---
>
> Key: OOZIE-2999
> URL: https://issues.apache.org/jira/browse/OOZIE-2999
> Project: Oozie
>  Issue Type: Bug
>  Components: tests
>Affects Versions: 4.3.0
> Environment: OSX 10.12.5
> JDK 1.8.0_131
> Maven 3.5.0
> latest commit: 18694b616f419ed958230cedb2dc0431a9f9cb5d
>Reporter: Artem Ervits
>Assignee: Artem Ervits
>  Labels: test
> Fix For: 5.0.0
>
> Attachments: OOZIE-2999-0.patch
>
>
> trying to follow directions in 
> http://oozie.apache.org/docs/4.3.0/ENG_MiniOozie.html and fails on the step
> {noformat}
> mvn clean install -DskipTests -DtestJarSimple
> {noformat}
> getting
> {noformat}
> es
> [INFO] -
> [ERROR] COMPILATION ERROR :
> [INFO] -
> [ERROR] 
> /Users/aervits/NetBeansProjects/minioozie/oozie/sharelib/streaming/src/test/java/org/apache/oozie/action/hadoop/TestMapReduceActionExecutor.java:[480,40]
>  error: cannot find symbol
> [INFO] 1 error
> [INFO] -
> [INFO] 
> 
> [INFO] Reactor Summary:
> [INFO]
> [INFO] Apache Oozie Main .. SUCCESS [  2.476 
> s]
> [INFO] Apache Oozie Client  SUCCESS [ 15.607 
> s]
> [INFO] Apache Oozie Share Lib Oozie ... SUCCESS [ 12.454 
> s]
> [INFO] Apache Oozie Share Lib HCatalog  SUCCESS [  6.437 
> s]
> [INFO] Apache Oozie Share Lib Distcp .. SUCCESS [  5.319 
> s]
> [INFO] Apache Oozie Core .. SUCCESS [01:18 
> min]
> [INFO] Apache Oozie Share Lib Streaming ... FAILURE [  5.515 
> s]
> [INFO] Apache Oozie Share Lib Pig . SKIPPED
> [INFO] Apache Oozie Share Lib Hive  SKIPPED
> [INFO] Apache Oozie Share Lib Hive 2 .. SKIPPED
> [INFO] Apache Oozie Share Lib Sqoop ... SKIPPED
> [INFO] Apache Oozie Examples .. SKIPPED
> [INFO] Apache Oozie Share Lib Spark ... SKIPPED
> [INFO] Apache Oozie Share Lib . SKIPPED
> [INFO] Apache Oozie Docs .. SKIPPED
> [INFO] Apache Oozie WebApp  SKIPPED
> [INFO] Apache Oozie Tools . SKIPPED
> [INFO] Apache Oozie MiniOozie . SKIPPED
> [INFO] Apache Oozie Server  SKIPPED
> [INFO] Apache Oozie Distro  SKIPPED
> [INFO] Apache Oozie ZooKeeper Security Tests .. SKIPPED
> [INFO] 
> 
> [INFO] BUILD FAILURE
> [INFO] 
> 
> [INFO] Total time: 02:07 min
> [INFO] Finished at: 2017-07-19T08:39:47-04:00
> [INFO] Final Memory: 248M/493M
> [INFO] 
> 
> [ERROR] Failed to execute goal 
> org.apache.maven.plugins:maven-compiler-plugin:2.3.2:testCompile 
> (default-testCompile) on project oozie-sharelib-streaming: Compilation failure
> [ERROR] 
> /Users/aervits/NetBeansProjects/minioozie/oozie/sharelib/streaming/src/test/java/org/apache/oozie/action/hadoop/TestMapReduceActionExecutor.java:[480,40]
>  error: cannot find symbol
> [ERROR]
> [ERROR] -> [Help 1]
> [ERROR]
> [ERROR] To see the full stack trace of the errors, re-run Maven with the -e 
> switch.
> [ERROR] Re-run Maven using the -X switch to enable full debug logging.
> [ERROR]
> [ERROR] For more information about the errors and possible solutions, please 
> read the following articles:
> [ERROR] [Help 1] 
> http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException
> [ERROR]
> [ERROR] After correcting the problems, you can resume the build with the 
> command
> [ERROR]   mvn  -rf :oozie-sharelib-streaming
> {noformat}



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

[jira] [Updated] (OOZIE-2608) Comma in oozie.service.JPAService.jdbc.password value results in authentication error

2017-08-09 Thread Peter Cseh (JIRA)


 [ 
https://issues.apache.org/jira/browse/OOZIE-2608?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Peter Cseh updated OOZIE-2608:
--
Attachment: OOZIE-2608-003.patch

Putting back url into the basic connection props as it breaks things.

> Comma in oozie.service.JPAService.jdbc.password value results in 
> authentication error
> -
>
> Key: OOZIE-2608
> URL: https://issues.apache.org/jira/browse/OOZIE-2608
> Project: Oozie
>  Issue Type: Bug
>  Components: core
>Affects Versions: 4.2.0
> Environment: HDP 2.4 latest, Oozie 4.2.0.2.4.2.0-258
>Reporter: Nikolai Grigoriev
>Assignee: Peter Cseh
>Priority: Minor
> Attachments: OOZIE-2608-001.patch, OOZIE-2608-002.patch, 
> OOZIE-2608-003.patch
>
>
> I have attempted to install Oozie with Postgres db backend via HDP 2.4. I was 
> able to test DB connection via Ambari, everything was correct. However, the 
> server failed to start with this error:
> {code}
> 2016-07-15 11:46:39,580  INFO URIHandlerService:520 - 
> SERVER[hadoop-master01.production.sociablelabs.net] Loaded default urihandler 
> org.apache.oozie.dependency.FSURIHandler
> 2016-07-15 11:46:40,323  INFO HadoopAccessorService:520 - 
> SERVER[hadoop-master01.production.sociablelabs.net] password key is 
> oozie.service.JPAService.jdbc.password
> 2016-07-15 11:46:40,331  INFO HadoopAccessorService:520 - 
> SERVER[hadoop-master01.production.sociablelabs.net] credential provider path 
> is null
> 2016-07-15 11:46:40,337  INFO HadoopAccessorService:520 - 
> SERVER[hadoop-master01.production.sociablelabs.net] password is null
> 2016-07-15 11:46:41,176 FATAL Services:514 - 
> SERVER[hadoop-master01.production.sociablelabs.net] Runtime Exception during 
> Services Load. Check your list of 'oozie.services' or 'o
> ozie.services.ext'
> 2016-07-15 11:46:41,194 FATAL Services:514 - 
> SERVER[hadoop-master01.production.sociablelabs.net] E0103: Could not load 
> service classes, Cannot create PoolableConnectionFactory (F
> ATAL: password authentication failed for user "oozie")
> org.apache.oozie.service.ServiceException: E0103: Could not load service 
> classes, Cannot create PoolableConnectionFactory (FATAL: password 
> authentication failed for user "oozie")
> at org.apache.oozie.service.Services.loadServices(Services.java:309)
> at org.apache.oozie.service.Services.init(Services.java:213)
> 
> Caused by: org.postgresql.util.PSQLException: FATAL: password authentication 
> failed for user "oozie"
> at 
> org.postgresql.core.v3.ConnectionFactoryImpl.doAuthentication(ConnectionFactoryImpl.java:291)
> at 
> org.postgresql.core.v3.ConnectionFactoryImpl.openConnectionImpl(ConnectionFactoryImpl.java:108)
> at 
> org.postgresql.core.ConnectionFactory.openConnection(ConnectionFactory.java:66)
> ...
> {code}
> Schema verification at startup worked fine and I could not find any bugs 
> related to it. So, I started getting suspicious about my password value, 
> which was like "pO,e43DpjK" (not exactly but it was a bunch of letters, 
> number and one comma). I suspected that the comma was probably interpreted as 
> a value list separator so I have changed the password removing the comma. 
> Server started flawlessly.
> I am not 100% sure if it is Ambari that should be escaping (or validating?) 
> the value or Oozie that fails to read the value as single string.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

[jira] [Updated] (OOZIE-3005) Cover all workflow action types with JAXB

2017-08-09 Thread Andras Piros (JIRA)


 [ 
https://issues.apache.org/jira/browse/OOZIE-3005?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Andras Piros updated OOZIE-3005:

Description: 
All the Oozie workflow actions have to be covered, not only MapReduce ones, 
considering following:
* no XSD change should be performed
* XJB mapping file has to be extended to incorporate all the workflow action 
types, also the ones inside {{//action/@any}}

  was:+


> Cover all workflow action types with JAXB
> -
>
> Key: OOZIE-3005
> URL: https://issues.apache.org/jira/browse/OOZIE-3005
> Project: Oozie
>  Issue Type: Sub-task
>  Components: client
>Reporter: Daniel Becker
>Assignee: Andras Piros
>
> All the Oozie workflow actions have to be covered, not only MapReduce ones, 
> considering following:
> * no XSD change should be performed
> * XJB mapping file has to be extended to incorporate all the workflow action 
> types, also the ones inside {{//action/@any}}



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

[jira] [Created] (OOZIE-3030) Oozie Mail action - is causing issues with formatting

2017-08-09 Thread Peter Cseh (JIRA)

Peter Cseh created OOZIE-3030:
-

 Summary: Oozie Mail action - is causing issues with 
 formatting
 Key: OOZIE-3030
 URL: https://issues.apache.org/jira/browse/OOZIE-3030
 Project: Oozie
  Issue Type: Bug
Reporter: Peter Cseh


When you define a email action in Oozie with , then the text in 
 is not formatted.
Email Action:
{code}


f...@bar.com
Test-HTML-Text



text/html
${nameNode}/user/admin/shell_output.txt





{code}



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

[jira] [Updated] (OOZIE-3005) Cover all workflow action types with JAXB

2017-08-09 Thread Andras Piros (JIRA)


 [ 
https://issues.apache.org/jira/browse/OOZIE-3005?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Andras Piros updated OOZIE-3005:

Description: +

> Cover all workflow action types with JAXB
> -
>
> Key: OOZIE-3005
> URL: https://issues.apache.org/jira/browse/OOZIE-3005
> Project: Oozie
>  Issue Type: Sub-task
>  Components: client
>Reporter: Daniel Becker
>Assignee: Andras Piros
>
> +



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

[jira] [Updated] (OOZIE-3005) Cover all workflow action types with JAXB

2017-08-09 Thread Andras Piros (JIRA)


 [ 
https://issues.apache.org/jira/browse/OOZIE-3005?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Andras Piros updated OOZIE-3005:

Summary: Cover all workflow action types with JAXB  (was: Refactor the 
latest oozie-workflow.xsd so that it uses xs:include on XSDs for actions that 
have their own, so JAXB can find these)

> Cover all workflow action types with JAXB
> -
>
> Key: OOZIE-3005
> URL: https://issues.apache.org/jira/browse/OOZIE-3005
> Project: Oozie
>  Issue Type: Sub-task
>  Components: client
>Reporter: Daniel Becker
>Assignee: Andras Piros
>




--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

[jira] [Commented] (OOZIE-2608) Comma in oozie.service.JPAService.jdbc.password value results in authentication error

2017-08-09 Thread Peter Cseh (JIRA)


[ 
https://issues.apache.org/jira/browse/OOZIE-2608?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16119525#comment-16119525
 ] 

Peter Cseh commented on OOZIE-2608:
---

It looks like there are some errors with this patch:
{code}
-1 TESTS
Tests run: 2009
Tests failed: 0
Tests errors: 1769

The patch failed the following testcases:
{code}

It can't report to Jira bacuase the list is too long:
{code}
bin/test-patch: line 126: 
/home/jenkins/jenkins-slave/workspace/oozie-trunk-precommit-build/test-patch/tools/jira-cli/jira.sh:
 Argument list too long
{code}

> Comma in oozie.service.JPAService.jdbc.password value results in 
> authentication error
> -
>
> Key: OOZIE-2608
> URL: https://issues.apache.org/jira/browse/OOZIE-2608
> Project: Oozie
>  Issue Type: Bug
>  Components: core
>Affects Versions: 4.2.0
> Environment: HDP 2.4 latest, Oozie 4.2.0.2.4.2.0-258
>Reporter: Nikolai Grigoriev
>Assignee: Peter Cseh
>Priority: Minor
> Attachments: OOZIE-2608-001.patch, OOZIE-2608-002.patch
>
>
> I have attempted to install Oozie with Postgres db backend via HDP 2.4. I was 
> able to test DB connection via Ambari, everything was correct. However, the 
> server failed to start with this error:
> {code}
> 2016-07-15 11:46:39,580  INFO URIHandlerService:520 - 
> SERVER[hadoop-master01.production.sociablelabs.net] Loaded default urihandler 
> org.apache.oozie.dependency.FSURIHandler
> 2016-07-15 11:46:40,323  INFO HadoopAccessorService:520 - 
> SERVER[hadoop-master01.production.sociablelabs.net] password key is 
> oozie.service.JPAService.jdbc.password
> 2016-07-15 11:46:40,331  INFO HadoopAccessorService:520 - 
> SERVER[hadoop-master01.production.sociablelabs.net] credential provider path 
> is null
> 2016-07-15 11:46:40,337  INFO HadoopAccessorService:520 - 
> SERVER[hadoop-master01.production.sociablelabs.net] password is null
> 2016-07-15 11:46:41,176 FATAL Services:514 - 
> SERVER[hadoop-master01.production.sociablelabs.net] Runtime Exception during 
> Services Load. Check your list of 'oozie.services' or 'o
> ozie.services.ext'
> 2016-07-15 11:46:41,194 FATAL Services:514 - 
> SERVER[hadoop-master01.production.sociablelabs.net] E0103: Could not load 
> service classes, Cannot create PoolableConnectionFactory (F
> ATAL: password authentication failed for user "oozie")
> org.apache.oozie.service.ServiceException: E0103: Could not load service 
> classes, Cannot create PoolableConnectionFactory (FATAL: password 
> authentication failed for user "oozie")
> at org.apache.oozie.service.Services.loadServices(Services.java:309)
> at org.apache.oozie.service.Services.init(Services.java:213)
> 
> Caused by: org.postgresql.util.PSQLException: FATAL: password authentication 
> failed for user "oozie"
> at 
> org.postgresql.core.v3.ConnectionFactoryImpl.doAuthentication(ConnectionFactoryImpl.java:291)
> at 
> org.postgresql.core.v3.ConnectionFactoryImpl.openConnectionImpl(ConnectionFactoryImpl.java:108)
> at 
> org.postgresql.core.ConnectionFactory.openConnection(ConnectionFactory.java:66)
> ...
> {code}
> Schema verification at startup worked fine and I could not find any bugs 
> related to it. So, I started getting suspicious about my password value, 
> which was like "pO,e43DpjK" (not exactly but it was a bunch of letters, 
> number and one comma). I suspected that the comma was probably interpreted as 
> a value list separator so I have changed the password removing the comma. 
> Server started flawlessly.
> I am not 100% sure if it is Ambari that should be escaping (or validating?) 
> the value or Oozie that fails to read the value as single string.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

[jira] Subscription: Oozie Patch Available

2017-08-09 Thread jira

Issue Subscription
Filter: Oozie Patch Available (110 issues)

Subscriber: ooziedaily

Key Summary
OOZIE-3028  Oozie Pig Action fails with no python dependencies
https://issues.apache.org/jira/browse/OOZIE-3028
OOZIE-3026  fix openjpa enhancer stage during build for logging
https://issues.apache.org/jira/browse/OOZIE-3026
OOZIE-3022  fix for warning has no file and won't be listed in dependency files 
details
https://issues.apache.org/jira/browse/OOZIE-3022
OOZIE-3002  address findbugs errors in client lib
https://issues.apache.org/jira/browse/OOZIE-3002
OOZIE-3001  core library has many instances of warnings with trailing spaces 
and lines longer than 132 chars
https://issues.apache.org/jira/browse/OOZIE-3001
OOZIE-2999  minioozie can't compile
https://issues.apache.org/jira/browse/OOZIE-2999
OOZIE-2997  files contain trailing white spaces in client lib
https://issues.apache.org/jira/browse/OOZIE-2997
OOZIE-2996  add option for -UseGCOverheadLimit to maven opts as sometimes local 
testing fails
https://issues.apache.org/jira/browse/OOZIE-2996
OOZIE-2980  JAXB Proof of Concept
https://issues.apache.org/jira/browse/OOZIE-2980
OOZIE-2978  Remove code that handles Pig versions before 0.8 
https://issues.apache.org/jira/browse/OOZIE-2978
OOZIE-2975  code clean up in pig sharelib, replace Exception with more 
explicit, add try with resources, StringBuilder instead of StringBuffer
https://issues.apache.org/jira/browse/OOZIE-2975
OOZIE-2969  Drop support for Java 1.7
https://issues.apache.org/jira/browse/OOZIE-2969
OOZIE-2964  Add -Xdoclint:none to javadoc opts to avoid warnings
https://issues.apache.org/jira/browse/OOZIE-2964
OOZIE-2963  getting error in build ArtifactNotFoundException: Could not find 
artifact org.pentaho:pentaho-aggdesigner-algorithm:jar:5.1.5-jhyde
https://issues.apache.org/jira/browse/OOZIE-2963
OOZIE-2962  bump maven-javadoc-plugin to 2.10.4
https://issues.apache.org/jira/browse/OOZIE-2962
OOZIE-2957  Documentation states that starting a coordinator is possible
https://issues.apache.org/jira/browse/OOZIE-2957
OOZIE-2956  Fix Findbugs warnings related to reliance on default encoding in 
oozie-core
https://issues.apache.org/jira/browse/OOZIE-2956
OOZIE-2955  Fix Findbugs warnings related to reliance on default encoding in 
oozie-client
https://issues.apache.org/jira/browse/OOZIE-2955
OOZIE-2954  Fix Checkstyle issues in oozie-client
https://issues.apache.org/jira/browse/OOZIE-2954
OOZIE-2953  Fix Checkstyle issues in oozie-tools
https://issues.apache.org/jira/browse/OOZIE-2953
OOZIE-2952  Fix Findbugs warnings in oozie-sharelib-oozie
https://issues.apache.org/jira/browse/OOZIE-2952
OOZIE-2949  Escape quotes whitespaces in Sqoop  field
https://issues.apache.org/jira/browse/OOZIE-2949
OOZIE-2942  Fix Findbugs warnings in oozie-examples
https://issues.apache.org/jira/browse/OOZIE-2942
OOZIE-2937  Remove redundant groupId from the child pom's
https://issues.apache.org/jira/browse/OOZIE-2937
OOZIE-2934  Fix "Exceptional return value of java.io.File.mkdirs() ignored" 
Findbugs error in oozie-sharelib-spark
https://issues.apache.org/jira/browse/OOZIE-2934
OOZIE-2927  Append new line character for Hive2 query using query tag
https://issues.apache.org/jira/browse/OOZIE-2927
OOZIE-2916  Set a job name for the MR Action's child job
https://issues.apache.org/jira/browse/OOZIE-2916
OOZIE-2914  Consolidate Trim 
https://issues.apache.org/jira/browse/OOZIE-2914
OOZIE-2883  OOZIE throw the error "Missing 
[oozie.service.ProxyUserService.proxyuser.oozie.service.ProxyUserService.proxyuser.mr.groups]
 property"
https://issues.apache.org/jira/browse/OOZIE-2883
OOZIE-2877  Oozie Git Action
https://issues.apache.org/jira/browse/OOZIE-2877
OOZIE-2867  Timezone handling for Coordinators: emphasize "Continent/City" 
format
https://issues.apache.org/jira/browse/OOZIE-2867
OOZIE-2858  HiveMain, ShellMain and SparkMain should not overwrite properties 
and config files locally
https://issues.apache.org/jira/browse/OOZIE-2858
OOZIE-2834  ParameterVerifier logging non-useful warning for workflow definition
https://issues.apache.org/jira/browse/OOZIE-2834
OOZIE-2833  when using uber mode the regex pattern used in the 
extractHeapSizeMB method does not allow heap sizes specified in bytes.
https://issues.apache.org/jira/browse/OOZIE-2833
OOZIE-2829  Improve sharelib upload to accept multiple source folders
https://issues.apache.org/jira/browse/OOZIE-2829
OOZIE-2826  Falcon feed fails to aws s3; Oozie joda time version does not meet 
required jar version 2.2 or later

[jira] Subscription: Oozie Patch Available

2017-08-09 Thread jira

Issue Subscription
Filter: Oozie Patch Available (110 issues)

Subscriber: ooziedaily

Key Summary
OOZIE-2987  Coord action missing dependencies should show URI template with 
unresolved dependencies
https://issues-test.apache.org/jira/browse/OOZIE-2987
OOZIE-2980  JAXB Proof of Concept
https://issues-test.apache.org/jira/browse/OOZIE-2980
OOZIE-2978  Remove code that handles Pig versions before 0.8 
https://issues-test.apache.org/jira/browse/OOZIE-2978
OOZIE-2977  error: self-closing element not allowed
https://issues-test.apache.org/jira/browse/OOZIE-2977
OOZIE-2975  code clean up in pig sharelib, replace Exception with more 
explicit, add try with resources, StringBuilder instead of StringBuffer
https://issues-test.apache.org/jira/browse/OOZIE-2975
OOZIE-2974  Change TestLiteWorkflowAppParser so that it works with Hadoop 3
https://issues-test.apache.org/jira/browse/OOZIE-2974
OOZIE-2969  Drop support for Java 1.7
https://issues-test.apache.org/jira/browse/OOZIE-2969
OOZIE-2964  getting at 
org.apache.maven.plugin.javadoc.AbstractJavadocMojo.executeJavadocCommandLine(AbstractJavadocMojo.java:5163)
https://issues-test.apache.org/jira/browse/OOZIE-2964
OOZIE-2963  getting error in build ArtifactNotFoundException: Could not find 
artifact org.pentaho:pentaho-aggdesigner-algorithm:jar:5.1.5-jhyde
https://issues-test.apache.org/jira/browse/OOZIE-2963
OOZIE-2962  bump maven-javadoc-plugin to 2.10.4
https://issues-test.apache.org/jira/browse/OOZIE-2962
OOZIE-2961  build contains multiple warnings for is not a parameter name
https://issues-test.apache.org/jira/browse/OOZIE-2961
OOZIE-2960  many warnings for @return tag has no arguments
https://issues-test.apache.org/jira/browse/OOZIE-2960
OOZIE-2957  Documentation states that starting a coordinator is possible
https://issues-test.apache.org/jira/browse/OOZIE-2957
OOZIE-2956  Fix Findbugs warnings related to reliance on default encoding in 
oozie-core
https://issues-test.apache.org/jira/browse/OOZIE-2956
OOZIE-2955  Fix Findbugs warnings related to reliance on default encoding in 
oozie-client
https://issues-test.apache.org/jira/browse/OOZIE-2955
OOZIE-2954  Fix Checkstyle issues in oozie-client
https://issues-test.apache.org/jira/browse/OOZIE-2954
OOZIE-2953  Fix Checkstyle issues in oozie-tools
https://issues-test.apache.org/jira/browse/OOZIE-2953
OOZIE-2952  Fix Findbugs warnings in oozie-sharelib-oozie
https://issues-test.apache.org/jira/browse/OOZIE-2952
OOZIE-2949  Escape quotes whitespaces in Sqoop  field
https://issues-test.apache.org/jira/browse/OOZIE-2949
OOZIE-2942  Fix Findbugs warnings in oozie-examples
https://issues-test.apache.org/jira/browse/OOZIE-2942
OOZIE-2937  Remove redundant groupId from the child pom's
https://issues-test.apache.org/jira/browse/OOZIE-2937
OOZIE-2934  Fix "Exceptional return value of java.io.File.mkdirs() ignored" 
Findbugs error in oozie-sharelib-spark
https://issues-test.apache.org/jira/browse/OOZIE-2934
OOZIE-2931  multiple warnings during build for "no @param for"
https://issues-test.apache.org/jira/browse/OOZIE-2931
OOZIE-2927  Append new line character for Hive2 query using query tag
https://issues-test.apache.org/jira/browse/OOZIE-2927
OOZIE-2916  Set a job name for the MR Action's child job
https://issues-test.apache.org/jira/browse/OOZIE-2916
OOZIE-2914  Consolidate Trim 
https://issues-test.apache.org/jira/browse/OOZIE-2914
OOZIE-2883  OOZIE throw the error "Missing 
[oozie.service.ProxyUserService.proxyuser.oozie.service.ProxyUserService.proxyuser.mr.groups]
 property"
https://issues-test.apache.org/jira/browse/OOZIE-2883
OOZIE-2877  Oozie Git Action
https://issues-test.apache.org/jira/browse/OOZIE-2877
OOZIE-2867  Timezone handling for Coordinators: emphasize "Continent/City" 
format
https://issues-test.apache.org/jira/browse/OOZIE-2867
OOZIE-2834  ParameterVerifier logging non-useful warning for workflow definition
https://issues-test.apache.org/jira/browse/OOZIE-2834
OOZIE-2833  when using uber mode the regex pattern used in the 
extractHeapSizeMB method does not allow heap sizes specified in bytes.
https://issues-test.apache.org/jira/browse/OOZIE-2833
OOZIE-2829  Improve sharelib upload to accept multiple source folders
https://issues-test.apache.org/jira/browse/OOZIE-2829
OOZIE-2826  Falcon feed fails to aws s3; Oozie joda time version does not meet 
required jar version 2.2 or later
https://issues-test.apache.org/jira/browse/OOZIE-2826
OOZIE-2812  SparkConfigurationService should support loading configurations 
from multiple Spark versions
https://issues-test.apache.org/jira/browse/OOZIE-2812

Jenkins build is back to normal : oozie-trunk-find-patches-available #166815

Jenkins build is back to normal : oozie-trunk-find-patches-available #166808

Jenkins build is back to normal : oozie-trunk-find-patches-available #166794

[jira] [Commented] (OOZIE-2670) Upgrade Hbase to 1.2

Build failed in Jenkins: oozie-trunk-precommit-build #4029

Build failed in Jenkins: oozie-trunk-find-patches-available #166793

[jira] [Commented] (OOZIE-3009) Number of Oozie tests executed dropped after OOZIE-2854

Jenkins build is back to normal : oozie-trunk-precommit-build #4028

[jira] [Assigned] (OOZIE-2687) Create XML schema for launcher configurations

[jira] [Updated] (OOZIE-2687) Create XML schema for launcher configurations

[jira] [Commented] (OOZIE-2687) Create XML schema for launcher configurations

[jira] [Assigned] (OOZIE-2909) LauncherAM: rewrite UGI calls

[jira] [Assigned] (OOZIE-2896) Ensure compatibility for existing LauncherMapper settings

[jira] [Updated] (OOZIE-3009) Number of Oozie tests executed dropped after OOZIE-2854

[jira] [Reopened] (OOZIE-3009) Number of Oozie tests executed dropped after OOZIE-2854

Build failed in Jenkins: oozie-trunk-precommit-build #4027

[jira] [Commented] (OOZIE-2608) Comma in oozie.service.JPAService.jdbc.password value results in authentication error

[jira] [Commented] (OOZIE-3028) Oozie Pig Action fails with no python dependencies

[jira] [Updated] (OOZIE-3005) Cover all workflow action types and workflow / action SLA with JAXB

[jira] [Updated] (OOZIE-3005) Cover all workflow action types with JAXB

[jira] [Commented] (OOZIE-2061) Remove CoordJobDeleteJPAExecutor

[jira] [Commented] (OOZIE-2999) minioozie can't compile

[jira] [Updated] (OOZIE-2608) Comma in oozie.service.JPAService.jdbc.password value results in authentication error

[jira] [Updated] (OOZIE-3005) Cover all workflow action types with JAXB

[jira] [Created] (OOZIE-3030) Oozie Mail action - is causing issues with formatting

[jira] [Updated] (OOZIE-3005) Cover all workflow action types with JAXB

[jira] [Updated] (OOZIE-3005) Cover all workflow action types with JAXB

[jira] [Commented] (OOZIE-2608) Comma in oozie.service.JPAService.jdbc.password value results in authentication error

[jira] Subscription: Oozie Patch Available

[jira] Subscription: Oozie Patch Available

30 matches

Site Navigation

Mail list logo

Footer information