[jira] [Commented] (OOZIE-1586) upgrade oozie to hive 13.1 (including hcatalog)
[ https://issues.apache.org/jira/browse/OOZIE-1586?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14206817#comment-14206817 ] Robert Kanter commented on OOZIE-1586: -- This patch was targeted for Oozie-4.1.0, not Oozie-4.0.1. And given that this had a lot of pom file changes, the versions (and likely some dependencies) are different, so it's not going to apply cleanly. If you want to apply this to Oozie-4.0.1, you'll need to "massage" the patch a bit. I don't think there's a specific precursor patch, but keep in mind that Oozie-4.1.0 has many patches on top of Oozie-4.0.1, so you'll may need some subset of that. > upgrade oozie to hive 13.1 (including hcatalog) > --- > > Key: OOZIE-1586 > URL: https://issues.apache.org/jira/browse/OOZIE-1586 > Project: Oozie > Issue Type: Improvement >Reporter: Bowen Zhang >Assignee: Ravi Prakash > Fix For: 4.1.0 > > Attachments: OOZIE-1586.1.patch, OOZIE-1586.2.patch, > OOZIE-1586.3.patch, OOZIE-1586.4.patch, OOZIE-1586.5.patch, OOZIE-1586.patch > > -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (OOZIE-1586) upgrade oozie to hive 13.1 (including hcatalog)
[ https://issues.apache.org/jira/browse/OOZIE-1586?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14206530#comment-14206530 ] Peeyush Bishnoi commented on OOZIE-1586: I am trying to apply the OOZIE-1586.4.patch patch but it is not getting applied cleanly on Oozie-4.0.1 . Do I need to put extra patch before applying this patch. I have already created OOZIE-2059 to address this. > upgrade oozie to hive 13.1 (including hcatalog) > --- > > Key: OOZIE-1586 > URL: https://issues.apache.org/jira/browse/OOZIE-1586 > Project: Oozie > Issue Type: Improvement >Reporter: Bowen Zhang >Assignee: Ravi Prakash > Fix For: 4.1.0 > > Attachments: OOZIE-1586.1.patch, OOZIE-1586.2.patch, > OOZIE-1586.3.patch, OOZIE-1586.4.patch, OOZIE-1586.5.patch, OOZIE-1586.patch > > -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (OOZIE-1586) upgrade oozie to hive 13.1 (including hcatalog)
[ https://issues.apache.org/jira/browse/OOZIE-1586?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14065884#comment-14065884 ] Ravi Prakash commented on OOZIE-1586: - Thanks Robert! > upgrade oozie to hive 13.1 (including hcatalog) > --- > > Key: OOZIE-1586 > URL: https://issues.apache.org/jira/browse/OOZIE-1586 > Project: Oozie > Issue Type: Improvement >Reporter: Bowen Zhang >Assignee: Ravi Prakash > Fix For: trunk > > Attachments: OOZIE-1586.1.patch, OOZIE-1586.2.patch, > OOZIE-1586.3.patch, OOZIE-1586.4.patch, OOZIE-1586.5.patch, OOZIE-1586.patch > > -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (OOZIE-1586) upgrade oozie to hive 13.1 (including hcatalog)
[ https://issues.apache.org/jira/browse/OOZIE-1586?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14063187#comment-14063187 ] Shwetha G S commented on OOZIE-1586: Yes, lets leave it as is. +1 for OOZIE-1586.4.patch > upgrade oozie to hive 13.1 (including hcatalog) > --- > > Key: OOZIE-1586 > URL: https://issues.apache.org/jira/browse/OOZIE-1586 > Project: Oozie > Issue Type: Improvement >Reporter: Bowen Zhang >Assignee: Ravi Prakash > Attachments: OOZIE-1586.1.patch, OOZIE-1586.2.patch, > OOZIE-1586.3.patch, OOZIE-1586.4.patch, OOZIE-1586.5.patch, OOZIE-1586.patch > > -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (OOZIE-1586) upgrade oozie to hive 13.1 (including hcatalog)
[ https://issues.apache.org/jira/browse/OOZIE-1586?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14062304#comment-14062304 ] Robert Kanter commented on OOZIE-1586: -- Ok, then let's leave this for now. We can commit the v4 patch, which simply updates the Hive/HCat version to 13.1 and does not include the jars with oozie-core. [~shwethags], do you agree? +1 pending [~shwethags] > upgrade oozie to hive 13.1 (including hcatalog) > --- > > Key: OOZIE-1586 > URL: https://issues.apache.org/jira/browse/OOZIE-1586 > Project: Oozie > Issue Type: Improvement >Reporter: Bowen Zhang >Assignee: Ravi Prakash > Attachments: OOZIE-1586.1.patch, OOZIE-1586.2.patch, > OOZIE-1586.3.patch, OOZIE-1586.4.patch, OOZIE-1586.5.patch, OOZIE-1586.patch > > -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (OOZIE-1586) upgrade oozie to hive 13.1 (including hcatalog)
[ https://issues.apache.org/jira/browse/OOZIE-1586?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14061656#comment-14061656 ] Shwetha G S commented on OOZIE-1586: During upgrades, different prod clusters will have different hadoop/hive versions. But we use the same oozie package. So, during oozie-setup, we pick the hadoop/hive versions from the cluster where we are installing. This is useful even for developer/QA testing as they can setup with any hadoop version and use the same oozie package. > upgrade oozie to hive 13.1 (including hcatalog) > --- > > Key: OOZIE-1586 > URL: https://issues.apache.org/jira/browse/OOZIE-1586 > Project: Oozie > Issue Type: Improvement >Reporter: Bowen Zhang >Assignee: Ravi Prakash > Attachments: OOZIE-1586.1.patch, OOZIE-1586.2.patch, > OOZIE-1586.3.patch, OOZIE-1586.4.patch, OOZIE-1586.5.patch, OOZIE-1586.patch > > -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (OOZIE-1586) upgrade oozie to hive 13.1 (including hcatalog)
[ https://issues.apache.org/jira/browse/OOZIE-1586?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14060926#comment-14060926 ] Robert Kanter commented on OOZIE-1586: -- You don't modify the hcatalog and hive sharelib poms to pull that version in instead of 13.1? That's what we do in CDH; in fact, we edit all of the versions to pull in the CDH versions of each component so that the sharelib, jars in the war file, etc are all our versions of the components. > upgrade oozie to hive 13.1 (including hcatalog) > --- > > Key: OOZIE-1586 > URL: https://issues.apache.org/jira/browse/OOZIE-1586 > Project: Oozie > Issue Type: Improvement >Reporter: Bowen Zhang >Assignee: Ravi Prakash > Attachments: OOZIE-1586.1.patch, OOZIE-1586.2.patch, > OOZIE-1586.3.patch, OOZIE-1586.4.patch, OOZIE-1586.5.patch, OOZIE-1586.patch > > -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (OOZIE-1586) upgrade oozie to hive 13.1 (including hcatalog)
[
https://issues.apache.org/jira/browse/OOZIE-1586?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14060350#comment-14060350
]
Shwetha G S commented on OOZIE-1586:
{quote}
do you feel strongly that we should leave it as is?
{quote}
Yes, I would like to leave it as is(it becomes difficult to separate out hive
jars if bundled with oozie war). At Inmobi, we use a custom hive version. 13.1
hcat client should be compatible with this hive, but oozie should give an
option to customise hcat version.
I don't know if we are already bundling the default version of hcat jars as a
separate directory in the oozie package. We should do it so that users have a
default libraries to work with.
> upgrade oozie to hive 13.1 (including hcatalog)
> ---
>
> Key: OOZIE-1586
> URL: https://issues.apache.org/jira/browse/OOZIE-1586
> Project: Oozie
> Issue Type: Improvement
>Reporter: Bowen Zhang
>Assignee: Ravi Prakash
> Attachments: OOZIE-1586.1.patch, OOZIE-1586.2.patch,
> OOZIE-1586.3.patch, OOZIE-1586.4.patch, OOZIE-1586.5.patch, OOZIE-1586.patch
>
>
--
This message was sent by Atlassian JIRA
(v6.2#6252)
[jira] [Commented] (OOZIE-1586) upgrade oozie to hive 13.1 (including hcatalog)
[
https://issues.apache.org/jira/browse/OOZIE-1586?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14059166#comment-14059166
]
Robert Kanter commented on OOZIE-1586:
--
One thing to keep in mind is that Oozie is more tightly coupled to the
Hive/HCat version than it is to the other components. The others (e.g. Pig,
Sqoop, etc) are relatively easy to change versions assuming their clients are
backwards compatible. But because Oozie is now integrated with Hive/HCat, it
may become difficult to allow the user to use whatever version they want. I
suppose we could leave this as is, though it's an inconvenience for packaged
distros of Hadoop (Bigtop (BIGTOP-1349), CDH, HDP?) and users using Hive 13.1,
but I suppose the workaround is pretty easy, so I'm okay with leaving it as is
if you feel strongly about it. [~shwethags], do you feel strongly that we
should leave it as is?
{quote}Is separate oozie-setup command used? Why can't it be part of
oozie-start itself? If oozie-setup and oozie-start were one command, we could
bundle default hcat jars as separate directory in oozie package, and
oozie-start can check if hcat jars are available in libext, else include
default hcat jars(also print hcat version the oozie is started with). That
could work?{quote}
While this may work, it sounds very brittle. But I think this would be a
separate JIRA if we do this.
> upgrade oozie to hive 13.1 (including hcatalog)
> ---
>
> Key: OOZIE-1586
> URL: https://issues.apache.org/jira/browse/OOZIE-1586
> Project: Oozie
> Issue Type: Improvement
>Reporter: Bowen Zhang
>Assignee: Ravi Prakash
> Attachments: OOZIE-1586.1.patch, OOZIE-1586.2.patch,
> OOZIE-1586.3.patch, OOZIE-1586.4.patch, OOZIE-1586.5.patch, OOZIE-1586.patch
>
>
--
This message was sent by Atlassian JIRA
(v6.2#6252)
[jira] [Commented] (OOZIE-1586) upgrade oozie to hive 13.1 (including hcatalog)
[ https://issues.apache.org/jira/browse/OOZIE-1586?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14058441#comment-14058441 ] Shwetha G S commented on OOZIE-1586: [~rkanter], I understand that bundling hcat jars makes the oozie installation simpler. My concern is that in future, with new versions of hive, what if the bundled hive jars are not compatible with the installed hive version(thats a possibility)? How will the user inject custom versioned hive jars with the new approach? Is separate oozie-setup command used? Why can't it be part of oozie-start itself? If oozie-setup and oozie-start were one command, we could bundle default hcat jars as separate directory in oozie package, and oozie-start can check if hcat jars are available in libext, else include default hcat jars(also print hcat version the oozie is started with). That could work? > upgrade oozie to hive 13.1 (including hcatalog) > --- > > Key: OOZIE-1586 > URL: https://issues.apache.org/jira/browse/OOZIE-1586 > Project: Oozie > Issue Type: Improvement >Reporter: Bowen Zhang >Assignee: Ravi Prakash > Attachments: OOZIE-1586.1.patch, OOZIE-1586.2.patch, > OOZIE-1586.3.patch, OOZIE-1586.4.patch, OOZIE-1586.5.patch, OOZIE-1586.patch > > -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (OOZIE-1586) upgrade oozie to hive 13.1 (including hcatalog)
[
https://issues.apache.org/jira/browse/OOZIE-1586?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14058012#comment-14058012
]
Hadoop QA commented on OOZIE-1586:
--
Testing JIRA OOZIE-1586
Cleaning local git workspace
{color:green}+1 PATCH_APPLIES{color}
{color:green}+1 CLEAN{color}
{color:red}-1 RAW_PATCH_ANALYSIS{color}
.{color:green}+1{color} the patch does not introduce any @author tags
.{color:green}+1{color} the patch does not introduce any tabs
.{color:green}+1{color} the patch does not introduce any trailing spaces
.{color:green}+1{color} the patch does not introduce any line longer than
132
.{color:red}-1{color} the patch does not add/modify any testcase
{color:green}+1 RAT{color}
.{color:green}+1{color} the patch does not seem to introduce new RAT
warnings
{color:green}+1 JAVADOC{color}
.{color:green}+1{color} the patch does not seem to introduce new Javadoc
warnings
{color:red}-1 COMPILE{color}
.{color:green}+1{color} HEAD compiles
.{color:green}+1{color} patch compiles
.{color:red}-1{color} the patch seems to introduce 57 new javac warning(s)
{color:green}+1 BACKWARDS_COMPATIBILITY{color}
.{color:green}+1{color} the patch does not change any JPA
Entity/Colum/Basic/Lob/Transient annotations
.{color:green}+1{color} the patch does not modify JPA files
{color:red}-1 TESTS{color}
.Tests run: 1503
.Tests failed: 4
.Tests errors: 1
.The patch failed the following testcases:
.
testActionInputCheckLatestActionCreationTime(org.apache.oozie.command.coord.TestCoordActionInputCheckXCommand)
.
testCoordActionInputCheckXCommandUniqueness(org.apache.oozie.command.coord.TestCoordActionInputCheckXCommandNonUTC)
.
testActionInputCheckLatestActionCreationTime(org.apache.oozie.command.coord.TestCoordActionInputCheckXCommandNonUTC)
.
testCoordinatorActionCommandsSubmitAndStart(org.apache.oozie.sla.TestSLAEventGeneration)
{color:green}+1 DISTRO{color}
.{color:green}+1{color} distro tarball builds with the patch
{color:red}*-1 Overall result, please check the reported -1(s)*{color}
The full output of the test-patch run is available at
. https://builds.apache.org/job/oozie-trunk-precommit-build/1351/
> upgrade oozie to hive 13.1 (including hcatalog)
> ---
>
> Key: OOZIE-1586
> URL: https://issues.apache.org/jira/browse/OOZIE-1586
> Project: Oozie
> Issue Type: Improvement
>Reporter: Bowen Zhang
>Assignee: Ravi Prakash
> Attachments: OOZIE-1586.1.patch, OOZIE-1586.2.patch,
> OOZIE-1586.3.patch, OOZIE-1586.4.patch, OOZIE-1586.5.patch, OOZIE-1586.patch
>
>
--
This message was sent by Atlassian JIRA
(v6.2#6252)
[jira] [Commented] (OOZIE-1586) upgrade oozie to hive 13.1 (including hcatalog)
[ https://issues.apache.org/jira/browse/OOZIE-1586?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14057888#comment-14057888 ] Robert Kanter commented on OOZIE-1586: -- +1 pending Jenkins [~shwethags], does my last comment make sense? > upgrade oozie to hive 13.1 (including hcatalog) > --- > > Key: OOZIE-1586 > URL: https://issues.apache.org/jira/browse/OOZIE-1586 > Project: Oozie > Issue Type: Improvement >Reporter: Bowen Zhang >Assignee: Ravi Prakash > Attachments: OOZIE-1586.1.patch, OOZIE-1586.2.patch, > OOZIE-1586.3.patch, OOZIE-1586.4.patch, OOZIE-1586.5.patch, OOZIE-1586.patch > > -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (OOZIE-1586) upgrade oozie to hive 13.1 (including hcatalog)
[ https://issues.apache.org/jira/browse/OOZIE-1586?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14057784#comment-14057784 ] Robert Kanter commented on OOZIE-1586: -- There's just one version of hcat now (as of this patch) because it's tied to the Hive version now, which we only have one version of. From a user's perspective, it would be easier if HCat integration worked out of the box without having to copy jars; especially if you decide to add this later, and have to re-run oozie-setup.sh to add the hcat jars. > upgrade oozie to hive 13.1 (including hcatalog) > --- > > Key: OOZIE-1586 > URL: https://issues.apache.org/jira/browse/OOZIE-1586 > Project: Oozie > Issue Type: Improvement >Reporter: Bowen Zhang >Assignee: Ravi Prakash > Attachments: OOZIE-1586.1.patch, OOZIE-1586.2.patch, > OOZIE-1586.3.patch, OOZIE-1586.4.patch, OOZIE-1586.5.patch, OOZIE-1586.patch > > -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (OOZIE-1586) upgrade oozie to hive 13.1 (including hcatalog)
[
https://issues.apache.org/jira/browse/OOZIE-1586?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14057138#comment-14057138
]
Shwetha G S commented on OOZIE-1586:
{quote}
Also, I think now that there'll be one version of HCat, we can include the HCat
jars in oozie-core so that the user doesn't have to add them to the classpath
and it works more "out-of-the-box".
{quote}
Why would there be just one version of hcat now? There can be multiple versions
of hive and they can be incompatible, right?
> upgrade oozie to hive 13.1 (including hcatalog)
> ---
>
> Key: OOZIE-1586
> URL: https://issues.apache.org/jira/browse/OOZIE-1586
> Project: Oozie
> Issue Type: Improvement
>Reporter: Bowen Zhang
>Assignee: Ravi Prakash
> Attachments: OOZIE-1586.1.patch, OOZIE-1586.2.patch,
> OOZIE-1586.3.patch, OOZIE-1586.4.patch, OOZIE-1586.5.patch, OOZIE-1586.patch
>
>
--
This message was sent by Atlassian JIRA
(v6.2#6252)
[jira] [Commented] (OOZIE-1586) upgrade oozie to hive 13.1 (including hcatalog)
[
https://issues.apache.org/jira/browse/OOZIE-1586?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14054277#comment-14054277
]
Hadoop QA commented on OOZIE-1586:
--
Testing JIRA OOZIE-1586
Cleaning local git workspace
{color:green}+1 PATCH_APPLIES{color}
{color:green}+1 CLEAN{color}
{color:red}-1 RAW_PATCH_ANALYSIS{color}
.{color:green}+1{color} the patch does not introduce any @author tags
.{color:green}+1{color} the patch does not introduce any tabs
.{color:green}+1{color} the patch does not introduce any trailing spaces
.{color:green}+1{color} the patch does not introduce any line longer than
132
.{color:red}-1{color} the patch does not add/modify any testcase
{color:green}+1 RAT{color}
.{color:green}+1{color} the patch does not seem to introduce new RAT
warnings
{color:green}+1 JAVADOC{color}
.{color:green}+1{color} the patch does not seem to introduce new Javadoc
warnings
{color:red}-1 COMPILE{color}
.{color:green}+1{color} HEAD compiles
.{color:green}+1{color} patch compiles
.{color:red}-1{color} the patch seems to introduce 60 new javac warning(s)
{color:green}+1 BACKWARDS_COMPATIBILITY{color}
.{color:green}+1{color} the patch does not change any JPA
Entity/Colum/Basic/Lob/Transient annotations
.{color:green}+1{color} the patch does not modify JPA files
{color:red}-1 TESTS{color}
.Tests run: 1503
.Tests failed: 2
.Tests errors: 1
.The patch failed the following testcases:
.
testBundleEngineResume(org.apache.oozie.servlet.TestV1JobServletBundleEngine)
.
testBundleEngineSuspend(org.apache.oozie.servlet.TestV1JobServletBundleEngine)
{color:green}+1 DISTRO{color}
.{color:green}+1{color} distro tarball builds with the patch
{color:red}*-1 Overall result, please check the reported -1(s)*{color}
The full output of the test-patch run is available at
. https://builds.apache.org/job/oozie-trunk-precommit-build/1349/
> upgrade oozie to hive 13.1 (including hcatalog)
> ---
>
> Key: OOZIE-1586
> URL: https://issues.apache.org/jira/browse/OOZIE-1586
> Project: Oozie
> Issue Type: Improvement
>Reporter: Bowen Zhang
>Assignee: Ravi Prakash
> Attachments: OOZIE-1586.1.patch, OOZIE-1586.2.patch,
> OOZIE-1586.3.patch, OOZIE-1586.4.patch, OOZIE-1586.patch
>
>
--
This message was sent by Atlassian JIRA
(v6.2#6252)
[jira] [Commented] (OOZIE-1586) upgrade oozie to hive 13.1 (including hcatalog)
[ https://issues.apache.org/jira/browse/OOZIE-1586?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14053890#comment-14053890 ] Robert Kanter commented on OOZIE-1586: -- Also, I think now that there'll be one version of HCat, we can include the HCat jars in oozie-core so that the user doesn't have to add them to the classpath and it works more "out-of-the-box". Please change oozie-core's dependency on oozie-hcatalog from "provided" to "compile" and update the documentation (the equivalent of here: https://oozie.apache.org/docs/4.0.1/AG_Install.html#HCatalog_Configuration) by deleting the stuff about adding the hcat jars to the classpath. This would be in the AG_Install.twiki file. This will be helpful for Bigtop (BIGTOP-1349) and users. > upgrade oozie to hive 13.1 (including hcatalog) > --- > > Key: OOZIE-1586 > URL: https://issues.apache.org/jira/browse/OOZIE-1586 > Project: Oozie > Issue Type: Improvement >Reporter: Bowen Zhang >Assignee: Ravi Prakash > Attachments: OOZIE-1586.1.patch, OOZIE-1586.2.patch, > OOZIE-1586.3.patch, OOZIE-1586.patch > > -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (OOZIE-1586) upgrade oozie to hive 13.1 (including hcatalog)
[ https://issues.apache.org/jira/browse/OOZIE-1586?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14028456#comment-14028456 ] Robert Kanter commented on OOZIE-1586: -- Ravi, can you look into the test failures and the new javac warnings? I took a quick look and most of the failed tests are from some kind of Thrift error with the Hive Metastore. > upgrade oozie to hive 13.1 (including hcatalog) > --- > > Key: OOZIE-1586 > URL: https://issues.apache.org/jira/browse/OOZIE-1586 > Project: Oozie > Issue Type: Improvement >Reporter: Bowen Zhang >Assignee: Ravi Prakash > Attachments: OOZIE-1586.1.patch, OOZIE-1586.2.patch, > OOZIE-1586.3.patch, OOZIE-1586.patch > > -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (OOZIE-1586) upgrade oozie to hive 13.1 (including hcatalog)
[
https://issues.apache.org/jira/browse/OOZIE-1586?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14026051#comment-14026051
]
Hadoop QA commented on OOZIE-1586:
--
Testing JIRA OOZIE-1586
Cleaning local git workspace
{color:green}+1 PATCH_APPLIES{color}
{color:green}+1 CLEAN{color}
{color:red}-1 RAW_PATCH_ANALYSIS{color}
.{color:green}+1{color} the patch does not introduce any @author tags
.{color:green}+1{color} the patch does not introduce any tabs
.{color:green}+1{color} the patch does not introduce any trailing spaces
.{color:green}+1{color} the patch does not introduce any line longer than
132
.{color:red}-1{color} the patch does not add/modify any testcase
{color:green}+1 RAT{color}
.{color:green}+1{color} the patch does not seem to introduce new RAT
warnings
{color:green}+1 JAVADOC{color}
.{color:green}+1{color} the patch does not seem to introduce new Javadoc
warnings
.{color:red}WARNING{color}: the current HEAD has 1 Javadoc warning(s)
{color:red}-1 COMPILE{color}
.{color:green}+1{color} HEAD compiles
.{color:green}+1{color} patch compiles
.{color:red}-1{color} the patch seems to introduce 59 new javac warning(s)
{color:green}+1 BACKWARDS_COMPATIBILITY{color}
.{color:green}+1{color} the patch does not change any JPA
Entity/Colum/Basic/Lob/Transient annotations
.{color:green}+1{color} the patch does not modify JPA files
{color:red}-1 TESTS{color}
.Tests run: 1462
.Tests failed: 8
.Tests errors: 15
.The patch failed the following testcases:
.
testBundleEngineChange(org.apache.oozie.servlet.TestV1JobServletBundleEngine)
.
testBundleEngineResume(org.apache.oozie.servlet.TestV1JobServletBundleEngine)
.
testBundleEngineSuspend(org.apache.oozie.servlet.TestV1JobServletBundleEngine)
.
testDryRunPushDependencies(org.apache.oozie.command.coord.TestCoordCommandUtils)
.
testDryRunPullAndPushDeps(org.apache.oozie.command.coord.TestCoordCommandUtils)
.
testCoordActionRecoveryServiceForWaitingRegisterPartition(org.apache.oozie.service.TestRecoveryService)
.
testTimeOutWithException1(org.apache.oozie.command.coord.TestCoordPushDependencyCheckXCommand)
.
testRequeueOnException(org.apache.oozie.command.coord.TestCoordPushDependencyCheckXCommand)
{color:green}+1 DISTRO{color}
.{color:green}+1{color} distro tarball builds with the patch
{color:red}*-1 Overall result, please check the reported -1(s)*{color}
{color:red}. There is at least one warning, please check{color}
The full output of the test-patch run is available at
. https://builds.apache.org/job/oozie-trunk-precommit-build/1295/
> upgrade oozie to hive 13.1 (including hcatalog)
> ---
>
> Key: OOZIE-1586
> URL: https://issues.apache.org/jira/browse/OOZIE-1586
> Project: Oozie
> Issue Type: Improvement
>Reporter: Bowen Zhang
>Assignee: Ravi Prakash
> Attachments: OOZIE-1586.1.patch, OOZIE-1586.2.patch,
> OOZIE-1586.3.patch, OOZIE-1586.patch
>
>
--
This message was sent by Atlassian JIRA
(v6.2#6252)
[jira] [Commented] (OOZIE-1586) upgrade oozie to hive 13.1 (including hcatalog)
[ https://issues.apache.org/jira/browse/OOZIE-1586?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14025805#comment-14025805 ] Robert Kanter commented on OOZIE-1586: -- Looks like Hive 0.13.1 was released a few days ago. I've kicked off a Jenkins build, but it will be a while (there's a few other patches queued before it). +1 pending Jenkins > upgrade oozie to hive 13.1 (including hcatalog) > --- > > Key: OOZIE-1586 > URL: https://issues.apache.org/jira/browse/OOZIE-1586 > Project: Oozie > Issue Type: Improvement >Reporter: Bowen Zhang >Assignee: Ravi Prakash > Attachments: OOZIE-1586.1.patch, OOZIE-1586.2.patch, > OOZIE-1586.3.patch, OOZIE-1586.patch > > -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (OOZIE-1586) upgrade oozie to hive 13.1 (including hcatalog)
[ https://issues.apache.org/jira/browse/OOZIE-1586?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14018377#comment-14018377 ] Robert Kanter commented on OOZIE-1586: -- LGTM, now we just need to wait for Hive 0.13.1 to be released so Jenkins can run it > upgrade oozie to hive 13.1 (including hcatalog) > --- > > Key: OOZIE-1586 > URL: https://issues.apache.org/jira/browse/OOZIE-1586 > Project: Oozie > Issue Type: Improvement >Reporter: Bowen Zhang >Assignee: Ravi Prakash > Attachments: OOZIE-1586.1.patch, OOZIE-1586.2.patch, > OOZIE-1586.3.patch, OOZIE-1586.patch > > -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (OOZIE-1586) upgrade oozie to hive 13.1 (including hcatalog)
[
https://issues.apache.org/jira/browse/OOZIE-1586?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14016087#comment-14016087
]
Hadoop QA commented on OOZIE-1586:
--
Testing JIRA OOZIE-1586
Cleaning local git workspace
{color:green}+1 PATCH_APPLIES{color}
{color:green}+1 CLEAN{color}
{color:red}-1 RAW_PATCH_ANALYSIS{color}
.{color:green}+1{color} the patch does not introduce any @author tags
.{color:green}+1{color} the patch does not introduce any tabs
.{color:green}+1{color} the patch does not introduce any trailing spaces
.{color:green}+1{color} the patch does not introduce any line longer than
132
.{color:red}-1{color} the patch does not add/modify any testcase
{color:green}+1 RAT{color}
.{color:green}+1{color} the patch does not seem to introduce new RAT
warnings
{color:green}+1 JAVADOC{color}
.{color:green}+1{color} the patch does not seem to introduce new Javadoc
warnings
{color:red}-1 COMPILE{color}
.{color:green}+1{color} HEAD compiles
.{color:red}-1{color} patch does not compile
.{color:green}+1{color} the patch does not seem to introduce new javac
warnings
{color:green}+1 BACKWARDS_COMPATIBILITY{color}
.{color:green}+1{color} the patch does not change any JPA
Entity/Colum/Basic/Lob/Transient annotations
.{color:green}+1{color} the patch does not modify JPA files
{color:red}-1 TESTS{color} - patch does not compile, cannot run testcases
{color:red}-1 DISTRO{color}
.{color:red}-1{color} distro tarball fails with the patch
{color:red}*-1 Overall result, please check the reported -1(s)*{color}
The full output of the test-patch run is available at
. https://builds.apache.org/job/oozie-trunk-precommit-build/1289/
> upgrade oozie to hive 13.1 (including hcatalog)
> ---
>
> Key: OOZIE-1586
> URL: https://issues.apache.org/jira/browse/OOZIE-1586
> Project: Oozie
> Issue Type: Improvement
>Reporter: Bowen Zhang
>Assignee: Ravi Prakash
> Attachments: OOZIE-1586.1.patch, OOZIE-1586.2.patch,
> OOZIE-1586.3.patch, OOZIE-1586.patch
>
>
--
This message was sent by Atlassian JIRA
(v6.2#6252)
[jira] [Commented] (OOZIE-1586) upgrade oozie to hive 13.1 (including hcatalog)
[
https://issues.apache.org/jira/browse/OOZIE-1586?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14008069#comment-14008069
]
Hadoop QA commented on OOZIE-1586:
--
Testing JIRA OOZIE-1586
Cleaning local git workspace
{color:red}-1{color} Patch failed to apply to head of branch
> upgrade oozie to hive 13.1 (including hcatalog)
> ---
>
> Key: OOZIE-1586
> URL: https://issues.apache.org/jira/browse/OOZIE-1586
> Project: Oozie
> Issue Type: Improvement
>Reporter: Bowen Zhang
>Assignee: Ravi Prakash
> Attachments: OOZIE-1586.1.patch, OOZIE-1586.2.patch, OOZIE-1586.patch
>
>
--
This message was sent by Atlassian JIRA
(v6.2#6252)
[jira] [Commented] (OOZIE-1586) upgrade oozie to hive 13.1 (including hcatalog)
[
https://issues.apache.org/jira/browse/OOZIE-1586?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14005299#comment-14005299
]
Robert Kanter commented on OOZIE-1586:
--
Can you rebase it on trunk (the "master" branch in git)? This is probably
something we'd want to put in Oozie 4.1.0.
Also, I tried patching Oozie 4.0.1 and building ({{mvn clean package
assembly:single -DskipTests}}) but got this error:
{noformat}
[INFO] Reactor Summary:
[INFO]
[INFO] Apache Oozie Main . SUCCESS [1.294s]
[INFO] Apache Oozie Client ... SUCCESS [8.501s]
[INFO] Apache Oozie Hadoop 1.1.1.oozie-4.0.1 . SUCCESS [3.101s]
[INFO] Apache Oozie Hadoop Distcp 1.1.1.oozie-4.0.1 .. SUCCESS [0.113s]
[INFO] Apache Oozie Hadoop 1.1.1.oozie-4.0.1 Test SUCCESS [0.694s]
[INFO] Apache Oozie Hadoop 2.3.0.oozie-4.0.1 . SUCCESS [5.689s]
[INFO] Apache Oozie Hadoop 2.3.0.oozie-4.0.1 Test SUCCESS [0.258s]
[INFO] Apache Oozie Hadoop Distcp 2.3.0.oozie-4.0.1 .. SUCCESS [0.128s]
[INFO] Apache Oozie Hadoop 0.23.5.oozie-4.0.1 SUCCESS [4.355s]
[INFO] Apache Oozie Hadoop 0.23.5.oozie-4.0.1 Test ... SUCCESS [0.301s]
[INFO] Apache Oozie Hadoop Distcp 0.23.5.oozie-4.0.1 . SUCCESS [0.112s]
[INFO] Apache Oozie Hadoop Libs .. SUCCESS [3.933s]
[INFO] Apache Oozie Hbase 0.94.2.oozie-4.0.1 . SUCCESS [0.621s]
[INFO] Apache Oozie Hbase Libs ... SUCCESS [0.708s]
[INFO] Apache Oozie HCatalog 0.13.0.oozie-4.0.1 .. SUCCESS [19.313s]
[INFO] Apache Oozie HCatalog Libs FAILURE [0.042s]
[INFO] Apache Oozie Share Lib Oozie .. SKIPPED
[INFO] Apache Oozie Share Lib HCatalog ... SKIPPED
[INFO] Apache Oozie Core . SKIPPED
[INFO] Apache Oozie Docs . SKIPPED
[INFO] Apache Oozie Share Lib Pig SKIPPED
[INFO] Apache Oozie Share Lib Hive ... SKIPPED
[INFO] Apache Oozie Share Lib Sqoop .. SKIPPED
[INFO] Apache Oozie Share Lib Streaming .. SKIPPED
[INFO] Apache Oozie Share Lib Distcp . SKIPPED
[INFO] Apache Oozie WebApp ... SKIPPED
[INFO] Apache Oozie Examples . SKIPPED
[INFO] Apache Oozie Share Lib SKIPPED
[INFO] Apache Oozie Tools SKIPPED
[INFO] Apache Oozie MiniOozie SKIPPED
[INFO] Apache Oozie Distro ... SKIPPED
[INFO]
[INFO] BUILD FAILURE
[INFO]
[INFO] Total time: 50.046s
[INFO] Finished at: Wed May 21 15:00:25 PDT 2014
[INFO] Final Memory: 30M/81M
[INFO]
[ERROR] Failed to execute goal
org.apache.maven.plugins:maven-assembly-plugin:2.2.1:single (default-cli) on
project oozie-hcataloglibs: Failed to create assembly: Error creating assembly
archive hcataloglibs: You must set at least one file. -> [Help 1]
{noformat}
> upgrade oozie to hive 13.1 (including hcatalog)
> ---
>
> Key: OOZIE-1586
> URL: https://issues.apache.org/jira/browse/OOZIE-1586
> Project: Oozie
> Issue Type: Improvement
>Reporter: Bowen Zhang
>Assignee: Ravi Prakash
> Attachments: OOZIE-1586.1.patch, OOZIE-1586.2.patch, OOZIE-1586.patch
>
>
--
This message was sent by Atlassian JIRA
(v6.2#6252)
[jira] [Commented] (OOZIE-1586) upgrade oozie to hive 13.1 (including hcatalog)
[ https://issues.apache.org/jira/browse/OOZIE-1586?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14003949#comment-14003949 ] Rohini Palaniswamy commented on OOZIE-1586: --- bq. I'm afraid I have no background on how the Oozie community decides what the minimum common denominator is. Please let me know if I should get rid of hcatalog-0.5 When we did hcat integration, hcat was still a separate incubator project. And 0.5 was the released version and 0.6.0-snapshot was the work in progress version. Should be ok to get rid of them now and use the hive version. > upgrade oozie to hive 13.1 (including hcatalog) > --- > > Key: OOZIE-1586 > URL: https://issues.apache.org/jira/browse/OOZIE-1586 > Project: Oozie > Issue Type: Improvement >Reporter: Bowen Zhang >Assignee: Ravi Prakash > Attachments: OOZIE-1586.1.patch, OOZIE-1586.patch > > -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (OOZIE-1586) upgrade oozie to hive 13.1 (including hcatalog)
[
https://issues.apache.org/jira/browse/OOZIE-1586?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14003934#comment-14003934
]
Robert Kanter commented on OOZIE-1586:
--
{quote}Done. I am indeed building 0.13.1 locally. The RC0 was published but
voting was suspended midway.{quote}
That's fine for now while the patch is worked on, but we'll have to wait until
it's actually released before pushing this in, or Oozie won't compile (without
first downloading and building Hive first). Any idea when the vote will get
passed/resumed?
{quote}We've run basic Hive 0.13.0 on Hadoop 2.2, so I'm guessing even 2.3 is
not needed. I too am fine with updating the JIRA summary if Bowen is fine with
it.{quote}
In that case, let's leave Hadoop at 2.3.0. If we want to update to 2.4.0, we
should do that as a separate JIRA to keep things cleaner. Can you update the
patch to not change the Hadoop version?
{quote}I'm afraid I have no background on how the Oozie community decides what
the minimum common denominator is. Please let me know if I should get rid of
hcatalog-0.5{quote}
[~rohini], [~chitnis], [~egashira], can you answer this? Why do we currently
have two versions of hcatalog anyway?
{quote}We have run some basic tests with Hive actions and hcat on a Hadoop
2.4.0 cluster. Yes.{quote}
Great! I'm glad this worked out-of-the-box. I've been wanting to add a Hive
Server 2 action (OOZIE-1457) for a while now but thought that updating Hive
would be tricky and break things.
> upgrade oozie to hive 13.1 (including hcatalog)
> ---
>
> Key: OOZIE-1586
> URL: https://issues.apache.org/jira/browse/OOZIE-1586
> Project: Oozie
> Issue Type: Improvement
>Reporter: Bowen Zhang
>Assignee: Bowen Zhang
> Attachments: OOZIE-1586.1.patch, OOZIE-1586.patch
>
>
--
This message was sent by Atlassian JIRA
(v6.2#6252)
[jira] [Commented] (OOZIE-1586) upgrade oozie to hive 13.1 (including hcatalog)
[
https://issues.apache.org/jira/browse/OOZIE-1586?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14000174#comment-14000174
]
Robert Kanter commented on OOZIE-1586:
--
Ravi, thanks for putting up a patch for this. A few points:
- It doesn't look like Hive 0.13.1 has been released yet and I don't see it at
the
[maven.org|http://search.maven.org/#search%7Cga%7C1%7Cg%3A%22org.apache.hive%22];
are you building 13.1 locally and installing in your maven cache?
- Does Hive 0.13.1 require Hadoop 2.4.0 instead of 2.3.0? Though I suppose
it's good to upgrade Hadoop anyway; but we should probably update the name of
this JIRA then
- Should we also get rid of hcatalog-0.5?
- We've already defined version 3.4 for antlr in the root pom, so you can
simply remove the version for the antlr dependency in the hive sharelib to make
it use 3.4
- For all of the hive dependency versions in hive-hcatalog-0.13.1's pom, I
think we should hardcode the version to {{0.13.1}} instead of {{hive.version}}
as it will mix jars if the user changes {{hive.version}}
- Have you done any testing?
-- Hive action
-- HCat integration
-- Hadoop 2.4.0
> upgrade oozie to hive 13.1 (including hcatalog)
> ---
>
> Key: OOZIE-1586
> URL: https://issues.apache.org/jira/browse/OOZIE-1586
> Project: Oozie
> Issue Type: Improvement
>Reporter: Bowen Zhang
>Assignee: Bowen Zhang
> Attachments: OOZIE-1586.patch
>
>
--
This message was sent by Atlassian JIRA
(v6.2#6252)
[jira] [Commented] (OOZIE-1586) upgrade oozie to hive 13.1 (including hcatalog)
[ https://issues.apache.org/jira/browse/OOZIE-1586?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=1440#comment-1440 ] Ravi Prakash commented on OOZIE-1586: - These would be applied on top of release-4.0.1 > upgrade oozie to hive 13.1 (including hcatalog) > --- > > Key: OOZIE-1586 > URL: https://issues.apache.org/jira/browse/OOZIE-1586 > Project: Oozie > Issue Type: Improvement >Reporter: Bowen Zhang >Assignee: Bowen Zhang > Attachments: OOZIE-1586.patch > > -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (OOZIE-1586) upgrade oozie to hive 13.1 (including hcatalog)
[ https://issues.apache.org/jira/browse/OOZIE-1586?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13979172#comment-13979172 ] Bowen Zhang commented on OOZIE-1586: hive 13.1 will be released as a more stable version in a couple of weeks. We will upgrade to hive 13.1. > upgrade oozie to hive 13.1 (including hcatalog) > --- > > Key: OOZIE-1586 > URL: https://issues.apache.org/jira/browse/OOZIE-1586 > Project: Oozie > Issue Type: Improvement >Reporter: Bowen Zhang >Assignee: Bowen Zhang > -- This message was sent by Atlassian JIRA (v6.2#6252)
