Re: [ANNOUNCE] Apache Oozie 5.0.0-beta1 released

[Robert Kanter]

Thanks Attila and everyone!  It's good to see Oozie 5 moving forward.


- Robert

On Fri, Jan 26, 2018 at 8:14 AM, Peter Cseh <gezap...@cloudera.com> wrote:

> Thanks everybody who has been working on this release! Special thanks for
> Attila for putting the release together!
>
> Gp
>
>
>
> On Jan 25, 2018 21:33, "Attila Sasvári" <asasv...@apache.org> wrote:
>
> > Hello Oozie Community,
> >
> > The Apache Oozie team is pleased to announce the release of Oozie
> > 5.0.0-beta1.
> > Oozie 5.0.0-beta1 includes new features, bug fixes and minor
> improvements.
> >
> > The details of the release and download location can be found at
> > http://oozie.apache.org/
> >
> > The full release notes can be found at the download location, but some of
> > the highlights of the release include:
> >
> > - Migrated Oozie Launcher from MapReduce to YARN AM for significant
> > performance improvements and simplicity
> > - Dropped support for Hadoop 1.x
> > - Added new 1.0 workflow schemas
> > - Switched from Tomcat to embedded Jetty for easier management and better
> > security
> > - Completely rewritten Job DAG renderer to support SVG and DOT formats as
> > well as better performance
> > - Better resiliency to transient database outages
> > - Requires Java 8
> >
> > Many thanks to all the developers, QA's, users and committers for making
> > this release happen.
> >
> > Regards,
> > - Attila
> >
>

Re: [ANNOUNCE] Apache Oozie 5.0.0-beta1 released

[Peter Cseh]

Thanks everybody who has been working on this release! Special thanks for
Attila for putting the release together!

Gp



On Jan 25, 2018 21:33, "Attila Sasvári" <asasv...@apache.org> wrote:

> Hello Oozie Community,
>
> The Apache Oozie team is pleased to announce the release of Oozie
> 5.0.0-beta1.
> Oozie 5.0.0-beta1 includes new features, bug fixes and minor improvements.
>
> The details of the release and download location can be found at
> http://oozie.apache.org/
>
> The full release notes can be found at the download location, but some of
> the highlights of the release include:
>
> - Migrated Oozie Launcher from MapReduce to YARN AM for significant
> performance improvements and simplicity
> - Dropped support for Hadoop 1.x
> - Added new 1.0 workflow schemas
> - Switched from Tomcat to embedded Jetty for easier management and better
> security
> - Completely rewritten Job DAG renderer to support SVG and DOT formats as
> well as better performance
> - Better resiliency to transient database outages
> - Requires Java 8
>
> Many thanks to all the developers, QA's, users and committers for making
> this release happen.
>
> Regards,
> - Attila
>

[ANNOUNCE] Apache Oozie 5.0.0-beta1 released

[Attila Sasvári]

Hello Oozie Community,

The Apache Oozie team is pleased to announce the release of Oozie
5.0.0-beta1.
Oozie 5.0.0-beta1 includes new features, bug fixes and minor improvements.

The details of the release and download location can be found at
http://oozie.apache.org/

The full release notes can be found at the download location, but some of
the highlights of the release include:

- Migrated Oozie Launcher from MapReduce to YARN AM for significant
performance improvements and simplicity
- Dropped support for Hadoop 1.x
- Added new 1.0 workflow schemas
- Switched from Tomcat to embedded Jetty for easier management and better
security
- Completely rewritten Job DAG renderer to support SVG and DOT formats as
well as better performance
- Better resiliency to transient database outages
- Requires Java 8

Many thanks to all the developers, QA's, users and committers for making
this release happen.

Regards,
- Attila

Re: [VOTE] Release Oozie 5.0.0-beta1 (candidate 2)

[satish saley]

- Built Oozie with hadoop-2 and spark-1 profile. Deployed with hadoop-2.6.3 and 
spark 1.6.1. Tested Spark and Py Spark action with yarn-client, yarn-cluster, 
local mode. - Built Oozie with hadoop-2 and spark-2 profile. Deployed with 
hadoop-2.6.3 and spark 2.1.0. Tested Spark and Py Spark action with 
yarn-client, yarn-cluster, local mode. - Checked the Dag images- Checked 
status, error logs for failed workflow.
+1 (binding) 

On Sunday, January 21, 2018 3:48 PM, Robert Kanter <rkan...@cloudera.com> 
wrote:
 

 Here's what I did:
- Verified md5
- Verified signature (gpg)
- Looked at rat report
- Looked at release log
- Built Oozie against Hadoop 2.7.2
- Ran a few of the examples, clicked around the UI, tried various CLI
commands, looked at the REST output, launcher log output, etc

+1 (binding)

On Thu, Jan 18, 2018 at 3:58 AM, Harsh J <ha...@cloudera.com> wrote:

> +1 (binding)
>
> - Verified the md5 and sig (asc) against the tar
> - Executed a build with tests
>
> On Wed, 17 Jan 2018, 21:15 Attila Sasvári, <asasv...@apache.org> wrote:
>
> > Hi,
> >
> > I have created a build for Oozie 5.0.0-beta1, release candidate 2.
> >
> > This release introduces major changes:
> > - moving launcher from MapReduce AM to Oozie AM,
> > - dropped support for Hadoop 1.x,
> > - added new 1.0 workflow schemas,
> > - switching from Tomcat to embedded Jetty,
> > - completely rewritten graph generator,
> > - local sharelib,
> > - JDK 8 support.
> >
> > It also includes OOZIE-3083, OOZIE-3159 (beta1 blockers).
> >
> > Keys to verify the signature of the release artifact are available at
> >
> >  http://www.apache.org/dist/oozie/KEYS
> >
> > Please download, test, and try it out:
> >
> >  http://people.apache.org/~asasvari/oozie-5.0.0-beta1-rc2/
> >
> > The release, md5 signature, gpg signature, and rat report can all be
> found
> > at the above address.
> >
> > The vote is open until Tuesday, January 23, 2018 at 9:00 CEST.
> >
> > Thanks,
> > Attila Sasvari
> >
>

   

Re: [VOTE] Release Oozie 5.0.0-beta1 (candidate 2)

[Robert Kanter]

Here's what I did:
- Verified md5
- Verified signature (gpg)
- Looked at rat report
- Looked at release log
- Built Oozie against Hadoop 2.7.2
- Ran a few of the examples, clicked around the UI, tried various CLI
commands, looked at the REST output, launcher log output, etc

+1 (binding)

On Thu, Jan 18, 2018 at 3:58 AM, Harsh J <ha...@cloudera.com> wrote:

> +1 (binding)
>
> - Verified the md5 and sig (asc) against the tar
> - Executed a build with tests
>
> On Wed, 17 Jan 2018, 21:15 Attila Sasvári, <asasv...@apache.org> wrote:
>
> > Hi,
> >
> > I have created a build for Oozie 5.0.0-beta1, release candidate 2.
> >
> > This release introduces major changes:
> > - moving launcher from MapReduce AM to Oozie AM,
> > - dropped support for Hadoop 1.x,
> > - added new 1.0 workflow schemas,
> > - switching from Tomcat to embedded Jetty,
> > - completely rewritten graph generator,
> > - local sharelib,
> > - JDK 8 support.
> >
> > It also includes OOZIE-3083, OOZIE-3159 (beta1 blockers).
> >
> > Keys to verify the signature of the release artifact are available at
> >
> >  http://www.apache.org/dist/oozie/KEYS
> >
> > Please download, test, and try it out:
> >
> >   http://people.apache.org/~asasvari/oozie-5.0.0-beta1-rc2/
> >
> > The release, md5 signature, gpg signature, and rat report can all be
> found
> > at the above address.
> >
> > The vote is open until Tuesday, January 23, 2018 at 9:00 CEST.
> >
> > Thanks,
> > Attila Sasvari
> >
>

Re: [VOTE] Release Oozie 5.0.0-beta1 (candidate 2)

[Harsh J]

+1 (binding)

- Verified the md5 and sig (asc) against the tar
- Executed a build with tests

On Wed, 17 Jan 2018, 21:15 Attila Sasvári, <asasv...@apache.org> wrote:

> Hi,
>
> I have created a build for Oozie 5.0.0-beta1, release candidate 2.
>
> This release introduces major changes:
> - moving launcher from MapReduce AM to Oozie AM,
> - dropped support for Hadoop 1.x,
> - added new 1.0 workflow schemas,
> - switching from Tomcat to embedded Jetty,
> - completely rewritten graph generator,
> - local sharelib,
> - JDK 8 support.
>
> It also includes OOZIE-3083, OOZIE-3159 (beta1 blockers).
>
> Keys to verify the signature of the release artifact are available at
>
>  http://www.apache.org/dist/oozie/KEYS
>
> Please download, test, and try it out:
>
>   http://people.apache.org/~asasvari/oozie-5.0.0-beta1-rc2/
>
> The release, md5 signature, gpg signature, and rat report can all be found
> at the above address.
>
> The vote is open until Tuesday, January 23, 2018 at 9:00 CEST.
>
> Thanks,
> Attila Sasvari
>

[VOTE] Release Oozie 5.0.0-beta1 (candidate 2)

[Attila Sasvári]

Hi,

I have created a build for Oozie 5.0.0-beta1, release candidate 2.

This release introduces major changes:
- moving launcher from MapReduce AM to Oozie AM,
- dropped support for Hadoop 1.x,
- added new 1.0 workflow schemas,
- switching from Tomcat to embedded Jetty,
- completely rewritten graph generator,
- local sharelib,
- JDK 8 support.

It also includes OOZIE-3083, OOZIE-3159 (beta1 blockers).

Keys to verify the signature of the release artifact are available at

 http://www.apache.org/dist/oozie/KEYS

Please download, test, and try it out:

  http://people.apache.org/~asasvari/oozie-5.0.0-beta1-rc2/

The release, md5 signature, gpg signature, and rat report can all be found
at the above address.

The vote is open until Tuesday, January 23, 2018 at 9:00 CEST.

Thanks,
Attila Sasvari

Re: [VOTE] Release Oozie 5.0.0-beta1 (candidate 1)

[Attila Sasvari]

Kinga, Robert, Peter, Andras, Harsh: many thanks for reviewing release
candidate 1. I would like to give some more time for the Oozie community to
review the release.

The vote is extended to Tuesday, 01/16/2018 11:59 AM CEST.

Thanks,
Attila Sasvari


On Fri, Jan 12, 2018 at 7:43 AM, Harsh J <ha...@cloudera.com> wrote:

> +1 (binding)
>
> - Verified the md5 and sig (asc) against the tar
> - Executed a build with tests
>
> On Fri, Jan 12, 2018 at 12:09 AM Andras Piros <andras.pi...@cloudera.com>
> wrote:
>
> > Hi Attila,
> >
> > thanks for building the new RC1 and caring about the process.
> >
> > I've built Oozie against Hadoop 2.6.5 and tried some examples out, graph
> > generation, log streaming etc.
> >
> > +1 (non-binding).
> >
> > Andras
> >
> > On Thu, Jan 11, 2018 at 5:01 PM, Peter Cseh <gezap...@cloudera.com>
> wrote:
> >
> > > Thanks Attila for building the RC1!
> > >
> > > 1) md5, gpg and rat report checks out.
> > > 2) distro builds fine
> > > 3) ran some examples, verified they are working as they should
> > >
> > > I'll try to verify the rc1 against a secure cluster soon, but +1
> > > (non-binding) in the meantime
> > >
> > > gp
> > >
> > > On Tue, Jan 9, 2018 at 5:53 PM, Attila Sasvári <at.sasv...@gmail.com>
> > > wrote:
> > >
> > > > It is release candidate 1.
> > > >
> > > > On Tue, Jan 9, 2018 at 5:50 PM, Attila Sasvári <at.sasv...@gmail.com
> >
> > > > wrote:
> > > >
> > > > > Hi,
> > > > >
> > > > > I have created a build for Oozie 5.0.0-beta1, release candidate 0.
> > > > >
> > > > > This release introduces major changes:
> > > > > - moving launcher from MapReduce AM to Oozie AM,
> > > > > - dropped support for Hadoop 1.x,
> > > > > - added new 1.0 workflow schemas,
> > > > > - switching from Tomcat to embedded Jetty,
> > > > > - completely rewritten graph generator,
> > > > > - local sharelib,
> > > > > - JDK 8 support.
> > > > >
> > > > > It also includes OOZIE-3083.
> > > > >
> > > > > Keys to verify the signature of the release artifact are available
> at
> > > > >
> > > > >  http://www.apache.org/dist/oozie/KEYS
> > > > >
> > > > > Please download, test, and try it out:
> > > > >
> > > > >   http://people.apache.org/~asasvari/oozie-5.0.0-beta1-rc1/
> > > > >
> > > > > The release, md5 signature, gpg signature, and rat report can all
> be
> > > > found
> > > > > at the above address.
> > > > >
> > > > > The vote is open until Friday, January 12, 2018 at 18:00 CEST.
> > > > >
> > > > > Thanks,
> > > > > Attila Sasvari
> > > > >
> > > >
> > >
> > >
> > >
> > > --
> > > Peter Cseh
> > > Software Engineer
> > > <http://www.cloudera.com>
> > >
> >
>



-- 
-- 
Attila Sasvari
Software Engineer
<http://www.cloudera.com/>

Re: [VOTE] Release Oozie 5.0.0-beta1 (candidate 1)

[Harsh J]

+1 (binding)

- Verified the md5 and sig (asc) against the tar
- Executed a build with tests

On Fri, Jan 12, 2018 at 12:09 AM Andras Piros <andras.pi...@cloudera.com>
wrote:

> Hi Attila,
>
> thanks for building the new RC1 and caring about the process.
>
> I've built Oozie against Hadoop 2.6.5 and tried some examples out, graph
> generation, log streaming etc.
>
> +1 (non-binding).
>
> Andras
>
> On Thu, Jan 11, 2018 at 5:01 PM, Peter Cseh <gezap...@cloudera.com> wrote:
>
> > Thanks Attila for building the RC1!
> >
> > 1) md5, gpg and rat report checks out.
> > 2) distro builds fine
> > 3) ran some examples, verified they are working as they should
> >
> > I'll try to verify the rc1 against a secure cluster soon, but +1
> > (non-binding) in the meantime
> >
> > gp
> >
> > On Tue, Jan 9, 2018 at 5:53 PM, Attila Sasvári <at.sasv...@gmail.com>
> > wrote:
> >
> > > It is release candidate 1.
> > >
> > > On Tue, Jan 9, 2018 at 5:50 PM, Attila Sasvári <at.sasv...@gmail.com>
> > > wrote:
> > >
> > > > Hi,
> > > >
> > > > I have created a build for Oozie 5.0.0-beta1, release candidate 0.
> > > >
> > > > This release introduces major changes:
> > > > - moving launcher from MapReduce AM to Oozie AM,
> > > > - dropped support for Hadoop 1.x,
> > > > - added new 1.0 workflow schemas,
> > > > - switching from Tomcat to embedded Jetty,
> > > > - completely rewritten graph generator,
> > > > - local sharelib,
> > > > - JDK 8 support.
> > > >
> > > > It also includes OOZIE-3083.
> > > >
> > > > Keys to verify the signature of the release artifact are available at
> > > >
> > > >  http://www.apache.org/dist/oozie/KEYS
> > > >
> > > > Please download, test, and try it out:
> > > >
> > > >   http://people.apache.org/~asasvari/oozie-5.0.0-beta1-rc1/
> > > >
> > > > The release, md5 signature, gpg signature, and rat report can all be
> > > found
> > > > at the above address.
> > > >
> > > > The vote is open until Friday, January 12, 2018 at 18:00 CEST.
> > > >
> > > > Thanks,
> > > > Attila Sasvari
> > > >
> > >
> >
> >
> >
> > --
> > Peter Cseh
> > Software Engineer
> > <http://www.cloudera.com>
> >
>

Re: [VOTE] Release Oozie 5.0.0-beta1 (candidate 1)

[Andras Piros]

Hi Attila,

thanks for building the new RC1 and caring about the process.

I've built Oozie against Hadoop 2.6.5 and tried some examples out, graph
generation, log streaming etc.

+1 (non-binding).

Andras

On Thu, Jan 11, 2018 at 5:01 PM, Peter Cseh <gezap...@cloudera.com> wrote:

> Thanks Attila for building the RC1!
>
> 1) md5, gpg and rat report checks out.
> 2) distro builds fine
> 3) ran some examples, verified they are working as they should
>
> I'll try to verify the rc1 against a secure cluster soon, but +1
> (non-binding) in the meantime
>
> gp
>
> On Tue, Jan 9, 2018 at 5:53 PM, Attila Sasvári <at.sasv...@gmail.com>
> wrote:
>
> > It is release candidate 1.
> >
> > On Tue, Jan 9, 2018 at 5:50 PM, Attila Sasvári <at.sasv...@gmail.com>
> > wrote:
> >
> > > Hi,
> > >
> > > I have created a build for Oozie 5.0.0-beta1, release candidate 0.
> > >
> > > This release introduces major changes:
> > > - moving launcher from MapReduce AM to Oozie AM,
> > > - dropped support for Hadoop 1.x,
> > > - added new 1.0 workflow schemas,
> > > - switching from Tomcat to embedded Jetty,
> > > - completely rewritten graph generator,
> > > - local sharelib,
> > > - JDK 8 support.
> > >
> > > It also includes OOZIE-3083.
> > >
> > > Keys to verify the signature of the release artifact are available at
> > >
> > >  http://www.apache.org/dist/oozie/KEYS
> > >
> > > Please download, test, and try it out:
> > >
> > >   http://people.apache.org/~asasvari/oozie-5.0.0-beta1-rc1/
> > >
> > > The release, md5 signature, gpg signature, and rat report can all be
> > found
> > > at the above address.
> > >
> > > The vote is open until Friday, January 12, 2018 at 18:00 CEST.
> > >
> > > Thanks,
> > > Attila Sasvari
> > >
> >
>
>
>
> --
> Peter Cseh
> Software Engineer
> <http://www.cloudera.com>
>

Re: [VOTE] Release Oozie 5.0.0-beta1 (candidate 1)

[Peter Cseh]

Thanks Attila for building the RC1!

1) md5, gpg and rat report checks out.
2) distro builds fine
3) ran some examples, verified they are working as they should

I'll try to verify the rc1 against a secure cluster soon, but +1
(non-binding) in the meantime

gp

On Tue, Jan 9, 2018 at 5:53 PM, Attila Sasvári <at.sasv...@gmail.com> wrote:

> It is release candidate 1.
>
> On Tue, Jan 9, 2018 at 5:50 PM, Attila Sasvári <at.sasv...@gmail.com>
> wrote:
>
> > Hi,
> >
> > I have created a build for Oozie 5.0.0-beta1, release candidate 0.
> >
> > This release introduces major changes:
> > - moving launcher from MapReduce AM to Oozie AM,
> > - dropped support for Hadoop 1.x,
> > - added new 1.0 workflow schemas,
> > - switching from Tomcat to embedded Jetty,
> > - completely rewritten graph generator,
> > - local sharelib,
> > - JDK 8 support.
> >
> > It also includes OOZIE-3083.
> >
> > Keys to verify the signature of the release artifact are available at
> >
> >  http://www.apache.org/dist/oozie/KEYS
> >
> > Please download, test, and try it out:
> >
> >   http://people.apache.org/~asasvari/oozie-5.0.0-beta1-rc1/
> >
> > The release, md5 signature, gpg signature, and rat report can all be
> found
> > at the above address.
> >
> > The vote is open until Friday, January 12, 2018 at 18:00 CEST.
> >
> > Thanks,
> > Attila Sasvari
> >
>



-- 
Peter Cseh
Software Engineer
<http://www.cloudera.com>

Re: [VOTE] Release Oozie 5.0.0-beta1 (candidate 1)

[Robert Kanter]

Here's what I did:
- Verified md5
- Verified signature (gpg)
- Built Oozie against Hadoop 2.7.2
- Ran a few of the examples, clicked around the UI, tried various CLI
commands, looked at the REST output
- Verified that OOZIE-3083 is fixed
- I also saw the issue Kinga found in OOZIE-3155, and I agree that's not a
blocker for the beta, but I've made it "critical" for GA as that would be
good to fix

+1 (binding)

thanks
- Robert


On Wed, Jan 10, 2018 at 9:06 AM, Julia Kinga Marton <kmar...@cloudera.com>
wrote:

> Hi,
>
> I made some testing on the RC, and it seems OK.
>
> What I checked:
> - md5
> - gpg signature
> - rat report
> - built Oozie against Hadoop-2.6.0
> - ran a few examples (wf and coordinator), clicked the Web UI, ran some CLI
> commands
>
> I found a small issue related the Job DAG (OOZIE-3155
> <https://issues.apache.org/jira/browse/OOZIE-3155>), but I don`t consider
> it a blocker.
>
> +1 from my side (non-binding)
>
> Best regards,
> Kinga
>
> On Tue, Jan 9, 2018 at 5:53 PM, Attila Sasvári <at.sasv...@gmail.com>
> wrote:
>
> > It is release candidate 1.
> >
> > On Tue, Jan 9, 2018 at 5:50 PM, Attila Sasvári <at.sasv...@gmail.com>
> > wrote:
> >
> > > Hi,
> > >
> > > I have created a build for Oozie 5.0.0-beta1, release candidate 0.
> > >
> > > This release introduces major changes:
> > > - moving launcher from MapReduce AM to Oozie AM,
> > > - dropped support for Hadoop 1.x,
> > > - added new 1.0 workflow schemas,
> > > - switching from Tomcat to embedded Jetty,
> > > - completely rewritten graph generator,
> > > - local sharelib,
> > > - JDK 8 support.
> > >
> > > It also includes OOZIE-3083.
> > >
> > > Keys to verify the signature of the release artifact are available at
> > >
> > >  http://www.apache.org/dist/oozie/KEYS
> > >
> > > Please download, test, and try it out:
> > >
> > >   http://people.apache.org/~asasvari/oozie-5.0.0-beta1-rc1/
> > >
> > > The release, md5 signature, gpg signature, and rat report can all be
> > found
> > > at the above address.
> > >
> > > The vote is open until Friday, January 12, 2018 at 18:00 CEST.
> > >
> > > Thanks,
> > > Attila Sasvari
> > >
> >
>

Re: [VOTE] Release Oozie 5.0.0-beta1 (candidate 1)

[Julia Kinga Marton]

Hi,

I made some testing on the RC, and it seems OK.

What I checked:
- md5
- gpg signature
- rat report
- built Oozie against Hadoop-2.6.0
- ran a few examples (wf and coordinator), clicked the Web UI, ran some CLI
commands

I found a small issue related the Job DAG (OOZIE-3155
<https://issues.apache.org/jira/browse/OOZIE-3155>), but I don`t consider
it a blocker.

+1 from my side (non-binding)

Best regards,
Kinga

On Tue, Jan 9, 2018 at 5:53 PM, Attila Sasvári <at.sasv...@gmail.com> wrote:

> It is release candidate 1.
>
> On Tue, Jan 9, 2018 at 5:50 PM, Attila Sasvári <at.sasv...@gmail.com>
> wrote:
>
> > Hi,
> >
> > I have created a build for Oozie 5.0.0-beta1, release candidate 0.
> >
> > This release introduces major changes:
> > - moving launcher from MapReduce AM to Oozie AM,
> > - dropped support for Hadoop 1.x,
> > - added new 1.0 workflow schemas,
> > - switching from Tomcat to embedded Jetty,
> > - completely rewritten graph generator,
> > - local sharelib,
> > - JDK 8 support.
> >
> > It also includes OOZIE-3083.
> >
> > Keys to verify the signature of the release artifact are available at
> >
> >  http://www.apache.org/dist/oozie/KEYS
> >
> > Please download, test, and try it out:
> >
> >   http://people.apache.org/~asasvari/oozie-5.0.0-beta1-rc1/
> >
> > The release, md5 signature, gpg signature, and rat report can all be
> found
> > at the above address.
> >
> > The vote is open until Friday, January 12, 2018 at 18:00 CEST.
> >
> > Thanks,
> > Attila Sasvari
> >
>

Re: [VOTE] Release Oozie 5.0.0-beta1 (candidate 1)

[Attila Sasvári]

It is release candidate 1.

On Tue, Jan 9, 2018 at 5:50 PM, Attila Sasvári <at.sasv...@gmail.com> wrote:

> Hi,
>
> I have created a build for Oozie 5.0.0-beta1, release candidate 0.
>
> This release introduces major changes:
> - moving launcher from MapReduce AM to Oozie AM,
> - dropped support for Hadoop 1.x,
> - added new 1.0 workflow schemas,
> - switching from Tomcat to embedded Jetty,
> - completely rewritten graph generator,
> - local sharelib,
> - JDK 8 support.
>
> It also includes OOZIE-3083.
>
> Keys to verify the signature of the release artifact are available at
>
>  http://www.apache.org/dist/oozie/KEYS
>
> Please download, test, and try it out:
>
>   http://people.apache.org/~asasvari/oozie-5.0.0-beta1-rc1/
>
> The release, md5 signature, gpg signature, and rat report can all be found
> at the above address.
>
> The vote is open until Friday, January 12, 2018 at 18:00 CEST.
>
> Thanks,
> Attila Sasvari
>

[VOTE] Release Oozie 5.0.0-beta1 (candidate 1)

[Attila Sasvári]

Hi,

I have created a build for Oozie 5.0.0-beta1, release candidate 0.

This release introduces major changes:
- moving launcher from MapReduce AM to Oozie AM,
- dropped support for Hadoop 1.x,
- added new 1.0 workflow schemas,
- switching from Tomcat to embedded Jetty,
- completely rewritten graph generator,
- local sharelib,
- JDK 8 support.

It also includes OOZIE-3083.

Keys to verify the signature of the release artifact are available at

 http://www.apache.org/dist/oozie/KEYS

Please download, test, and try it out:

  http://people.apache.org/~asasvari/oozie-5.0.0-beta1-rc1/

The release, md5 signature, gpg signature, and rat report can all be found
at the above address.

The vote is open until Friday, January 12, 2018 at 18:00 CEST.

Thanks,
Attila Sasvari

Re: [VOTE] Release Oozie 5.0.0-beta1 (candidate 0)

[Attila Sasvari]

Andras, Satish many thanks for the reviews. I will create a new release
candidate once OOZIE-3152 has been fixed.

On Thu, Jan 4, 2018 at 7:07 PM, Satish Saley <satishsa...@apache.org> wrote:

> I have made OOZIE-3152 as blocker since Oozie version should be viewable
> on UI.
>
> Rest of the things I checked :
> - Verified md5
> - Built Oozie
> - Ran job on hadoop 2.8.1 and checked the graph
>
> On Wednesday, January 3, 2018, 1:15:52 PM PST, Attila Sasvari <
> asasv...@cloudera.com> wrote:
>
>
> Many thanks Robert for highlighting those changes, reviewing Oozie
> 5.0.0-beta1 release candidate 0 and filing follow-up JIRAs. I totally agree
> that OOZIE-2814 and OOZIE-3150 are blockers.
>
> Please let me know if you run into any other issues.
>
> /* The vote is open until Thursday, January 04, 2018 at 12:00 CEST. */
>
> On Fri, Dec 29, 2017 at 11:59 PM, Robert Kanter <rkan...@cloudera.com>
> wrote:
>
> > Thanks for putting this together.
> >
> > Another important thing to note in the highlights that as part of moving
> > the launcher, we also dropped support for Hadoop 1.x and we added new 1.0
> > schemas.
> >
> > +1
> >
> > Here's what I did:
> > - Verified md5
> > - Verified signature (gpg)
> > - Built Oozie against Hadoop 2.7.2
> > - Ran a few of the examples, clicked around the UI and tried various CLI
> > commands
> >
> > Here's some issues I ran into; none are blockers for 5b1:
> > - Filed OOZIE-3149 to delete work.log, which is really old (not a
> blocker)
> > - Filed OOZIE-3150 to update NOTICE.txt (I made this a blocker for 5.0.0)
> > - The examples are still the older schemas, which is fine for the beta,
> but
> > I made OOZIE-2814 a blocker for 5.0.0 because it will encourage users to
> > use the new schemas
> >
> > - Robert
> >
> >
> > On Thu, Dec 28, 2017 at 1:23 PM, Peter Cseh <gezap...@cloudera.com>
> wrote:
> >
> > > Hi Attila!
> > >
> > > It looks like I've messed up the extraction of the tar.gz and I was
> > looking
> > > at empty folders :)
> > > Will validate the release tomorrow.
> > >
> > > Sorry for causing confusion!
> > > gp
> > >
> > > On Thu, Dec 28, 2017 at 2:08 PM, Attila Sasvari <asasv...@cloudera.com
> >
> > > wrote:
> > >
> > > > @Andras: many thanks. Please let me know if you notice anything
> strange
> > > > with hashes or run into other problems.
> > > >
> > > > @gp: thanks a lot. This is actually what the
> > bin/create-release-artifact
> > > > script has generated. Comparing it with previous release candidate
> > (4.3.0
> > > > rc1), file size of oozie-5.0.0-beta1.tar.gz looks correct to me
> > > >
> > > >  $ wget
> > > > https://dist.apache.org/repos/dist/dev/oozie/oozie-4.3.0-
> > > > rc1/oozie-4.3.0.tar.gz
> > > >  $ wget
> > > > http://people.apache.org/\~asasvari/oozie-5.0.0-beta1-
> > > > rc0/oozie-5.0.0-beta1.tar.gz
> > > >
> > > >  $ ls -lrt oozie-*tar.gz
> > > >  -rw-r--r--  1 asasvari  staff  2392205 Oct 25  2016
> > oozie-4.3.0.tar.gz
> > > >  -rw-r--r--  1 asasvari  staff  2539718 Dec 28 00:12
> > > > oozie-5.0.0-beta1.tar.gz
> > > >
> > > > oozie-5.0.0-beta1.tar.gz contains much more files (it contains all
> the
> > > > sources):
> > > >
> > > >  $  tar tvf oozie-5.0.0-beta1.tar.gz | grep "\.java" | head -5
> > > >  -rw-r--r--  0 asasvari wheel  10328 Dec 28 00:02
> > > > oozie-5.0.0-beta1/zookeeper-security-tests/src/test/java/
> > > > org/apache/oozie/util/TestZKUtilsWithSecurity.java
> > > >  -rw-r--r--  0 asasvari wheel7357 Dec 28 00:02
> > > > oozie-5.0.0-beta1/zookeeper-security-tests/src/test/java/
> > > > org/apache/oozie/test/ZKXTestCaseWithSecurity.java
> > > >  -rw-r--r--  0 asasvari wheel  32589 Dec 28 00:02
> > > > oozie-5.0.0-beta1/tools/src/test/java/org/apache/oozie/
> > > > tools/FakeConnection.java
> > > >  -rw-r--r--  0 asasvari wheel1921 Dec 28 00:02
> > > > oozie-5.0.0-beta1/tools/src/test/java/org/apache/oozie/
> > > > tools/FakeDriver.java
> > > >  -rw-r--r--  0 asasvari wheel2230 Dec 28 00:02
> > > > oozie-5.0.0-beta1/tools/src/test/java/org/apache/oozie/
> > > > tools/LauncherSecurityManager.java
> > > >
> > > > If you download the tarball

Re: [VOTE] Release Oozie 5.0.0-beta1 (candidate 0)

[Satish Saley]

I have made OOZIE-3152 as blocker since Oozie version should be viewable on
UI.

Rest of the things I checked :
- Verified md5
- Built Oozie
- Ran job on hadoop 2.8.1 and checked the graph

On Wednesday, January 3, 2018, 1:15:52 PM PST, Attila Sasvari <
asasv...@cloudera.com> wrote:


Many thanks Robert for highlighting those changes, reviewing Oozie
5.0.0-beta1 release candidate 0 and filing follow-up JIRAs. I totally agree
that OOZIE-2814 and OOZIE-3150 are blockers.

Please let me know if you run into any other issues.

/* The vote is open until Thursday, January 04, 2018 at 12:00 CEST. */

On Fri, Dec 29, 2017 at 11:59 PM, Robert Kanter <rkan...@cloudera.com>
wrote:

> Thanks for putting this together.
>
> Another important thing to note in the highlights that as part of moving
> the launcher, we also dropped support for Hadoop 1.x and we added new 1.0
> schemas.
>
> +1
>
> Here's what I did:
> - Verified md5
> - Verified signature (gpg)
> - Built Oozie against Hadoop 2.7.2
> - Ran a few of the examples, clicked around the UI and tried various CLI
> commands
>
> Here's some issues I ran into; none are blockers for 5b1:
> - Filed OOZIE-3149 to delete work.log, which is really old (not a blocker)
> - Filed OOZIE-3150 to update NOTICE.txt (I made this a blocker for 5.0.0)
> - The examples are still the older schemas, which is fine for the beta,
but
> I made OOZIE-2814 a blocker for 5.0.0 because it will encourage users to
> use the new schemas
>
> - Robert
>
>
> On Thu, Dec 28, 2017 at 1:23 PM, Peter Cseh <gezap...@cloudera.com> wrote:
>
> > Hi Attila!
> >
> > It looks like I've messed up the extraction of the tar.gz and I was
> looking
> > at empty folders :)
> > Will validate the release tomorrow.
> >
> > Sorry for causing confusion!
> > gp
> >
> > On Thu, Dec 28, 2017 at 2:08 PM, Attila Sasvari <asasv...@cloudera.com>
> > wrote:
> >
> > > @Andras: many thanks. Please let me know if you notice anything
strange
> > > with hashes or run into other problems.
> > >
> > > @gp: thanks a lot. This is actually what the
> bin/create-release-artifact
> > > script has generated. Comparing it with previous release candidate
> (4.3.0
> > > rc1), file size of oozie-5.0.0-beta1.tar.gz looks correct to me
> > >
> > >  $ wget
> > > https://dist.apache.org/repos/dist/dev/oozie/oozie-4.3.0-
> > > rc1/oozie-4.3.0.tar.gz
> > >  $ wget
> > > http://people.apache.org/\~asasvari/oozie-5.0.0-beta1-
> > > rc0/oozie-5.0.0-beta1.tar.gz
> > >
> > >  $ ls -lrt oozie-*tar.gz
> > >  -rw-r--r--  1 asasvari  staff  2392205 Oct 25  2016
> oozie-4.3.0.tar.gz
> > >  -rw-r--r--  1 asasvari  staff  2539718 Dec 28 00:12
> > > oozie-5.0.0-beta1.tar.gz
> > >
> > > oozie-5.0.0-beta1.tar.gz contains much more files (it contains all the
> > > sources):
> > >
> > >  $  tar tvf oozie-5.0.0-beta1.tar.gz | grep "\.java" | head -5
> > >  -rw-r--r--  0 asasvari wheel  10328 Dec 28 00:02
> > > oozie-5.0.0-beta1/zookeeper-security-tests/src/test/java/
> > > org/apache/oozie/util/TestZKUtilsWithSecurity.java
> > >  -rw-r--r--  0 asasvari wheel7357 Dec 28 00:02
> > > oozie-5.0.0-beta1/zookeeper-security-tests/src/test/java/
> > > org/apache/oozie/test/ZKXTestCaseWithSecurity.java
> > >  -rw-r--r--  0 asasvari wheel  32589 Dec 28 00:02
> > > oozie-5.0.0-beta1/tools/src/test/java/org/apache/oozie/
> > > tools/FakeConnection.java
> > >  -rw-r--r--  0 asasvari wheel1921 Dec 28 00:02
> > > oozie-5.0.0-beta1/tools/src/test/java/org/apache/oozie/
> > > tools/FakeDriver.java
> > >  -rw-r--r--  0 asasvari wheel2230 Dec 28 00:02
> > > oozie-5.0.0-beta1/tools/src/test/java/org/apache/oozie/
> > > tools/LauncherSecurityManager.java
> > >
> > > If you download the tarball and run bin/mkdistro.sh, it will probably
> > fail
> > > due to known flaky tests. Running tests with bin/mkdistro.sh
> > > -Dsurefire.rerunFailingTestsCount=2, they shall pass (printing things
> > > like [WARNING] Tests run: 1841, Failures: 0, Errors: 0, Skipped: 2,
> > Flakes:
> > > 2 ).
> > >
> > > - Attila
> > >
> > > On Thu, Dec 28, 2017 at 10:57 AM, Peter Cseh <gezap...@cloudera.com>
> > > wrote:
> > >
> > > > Thanks Attila!
> > > > The tar.gz does not contain the release, it only contains the pom
> > files.
> > > > The whole thing is 2.4 Mb, an Oozie was bigger the last time I've
> &

Re: [VOTE] Release Oozie 5.0.0-beta1 (candidate 0)

[Andras Piros]

Hi Attila,

compiled against Hadoop 2.6.5 and tested locally on a pseudo-distributed
cluster all the examples and all passing except for Pig, Spark, Sqoop, and
Hive related ones - all for reasons outside Oozie.

Green light from my side as well.

*+1 (non-binding).*

Regards,

Andras

On Wed, Jan 3, 2018 at 10:15 PM, Attila Sasvari <asasv...@cloudera.com>
wrote:

> Many thanks Robert for highlighting those changes, reviewing Oozie
> 5.0.0-beta1 release candidate 0 and filing follow-up JIRAs. I totally agree
> that OOZIE-2814 and OOZIE-3150 are blockers.
>
> Please let me know if you run into any other issues.
>
> /* The vote is open until Thursday, January 04, 2018 at 12:00 CEST. */
>
> On Fri, Dec 29, 2017 at 11:59 PM, Robert Kanter <rkan...@cloudera.com>
> wrote:
>
> > Thanks for putting this together.
> >
> > Another important thing to note in the highlights that as part of moving
> > the launcher, we also dropped support for Hadoop 1.x and we added new 1.0
> > schemas.
> >
> > +1
> >
> > Here's what I did:
> > - Verified md5
> > - Verified signature (gpg)
> > - Built Oozie against Hadoop 2.7.2
> > - Ran a few of the examples, clicked around the UI and tried various CLI
> > commands
> >
> > Here's some issues I ran into; none are blockers for 5b1:
> > - Filed OOZIE-3149 to delete work.log, which is really old (not a
> blocker)
> > - Filed OOZIE-3150 to update NOTICE.txt (I made this a blocker for 5.0.0)
> > - The examples are still the older schemas, which is fine for the beta,
> but
> > I made OOZIE-2814 a blocker for 5.0.0 because it will encourage users to
> > use the new schemas
> >
> > - Robert
> >
> >
> > On Thu, Dec 28, 2017 at 1:23 PM, Peter Cseh <gezap...@cloudera.com>
> wrote:
> >
> > > Hi Attila!
> > >
> > > It looks like I've messed up the extraction of the tar.gz and I was
> > looking
> > > at empty folders :)
> > > Will validate the release tomorrow.
> > >
> > > Sorry for causing confusion!
> > > gp
> > >
> > > On Thu, Dec 28, 2017 at 2:08 PM, Attila Sasvari <asasv...@cloudera.com
> >
> > > wrote:
> > >
> > > > @Andras: many thanks. Please let me know if you notice anything
> strange
> > > > with hashes or run into other problems.
> > > >
> > > > @gp: thanks a lot. This is actually what the
> > bin/create-release-artifact
> > > > script has generated. Comparing it with previous release candidate
> > (4.3.0
> > > > rc1), file size of oozie-5.0.0-beta1.tar.gz looks correct to me
> > > >
> > > >   $ wget
> > > > https://dist.apache.org/repos/dist/dev/oozie/oozie-4.3.0-
> > > > rc1/oozie-4.3.0.tar.gz
> > > >   $ wget
> > > > http://people.apache.org/\~asasvari/oozie-5.0.0-beta1-
> > > > rc0/oozie-5.0.0-beta1.tar.gz
> > > >
> > > >   $ ls -lrt oozie-*tar.gz
> > > >   -rw-r--r--  1 asasvari  staff  2392205 Oct 25  2016
> > oozie-4.3.0.tar.gz
> > > >   -rw-r--r--  1 asasvari  staff  2539718 Dec 28 00:12
> > > > oozie-5.0.0-beta1.tar.gz
> > > >
> > > > oozie-5.0.0-beta1.tar.gz contains much more files (it contains all
> the
> > > > sources):
> > > >
> > > >   $  tar tvf oozie-5.0.0-beta1.tar.gz | grep "\.java" | head -5
> > > >   -rw-r--r--  0 asasvari wheel   10328 Dec 28 00:02
> > > > oozie-5.0.0-beta1/zookeeper-security-tests/src/test/java/
> > > > org/apache/oozie/util/TestZKUtilsWithSecurity.java
> > > >   -rw-r--r--  0 asasvari wheel7357 Dec 28 00:02
> > > > oozie-5.0.0-beta1/zookeeper-security-tests/src/test/java/
> > > > org/apache/oozie/test/ZKXTestCaseWithSecurity.java
> > > >   -rw-r--r--  0 asasvari wheel   32589 Dec 28 00:02
> > > > oozie-5.0.0-beta1/tools/src/test/java/org/apache/oozie/
> > > > tools/FakeConnection.java
> > > >   -rw-r--r--  0 asasvari wheel1921 Dec 28 00:02
> > > > oozie-5.0.0-beta1/tools/src/test/java/org/apache/oozie/
> > > > tools/FakeDriver.java
> > > >   -rw-r--r--  0 asasvari wheel2230 Dec 28 00:02
> > > > oozie-5.0.0-beta1/tools/src/test/java/org/apache/oozie/
> > > > tools/LauncherSecurityManager.java
> > > >
> > > > If you download the tarball and run bin/mkdistro.sh, it will probably
> > > fail
> > > > due to known flaky tests. Running tests with bin/mkdistro.sh
> > &

Re: [VOTE] Release Oozie 5.0.0-beta1 (candidate 0)

[Attila Sasvari]

Many thanks Robert for highlighting those changes, reviewing Oozie
5.0.0-beta1 release candidate 0 and filing follow-up JIRAs. I totally agree
that OOZIE-2814 and OOZIE-3150 are blockers.

Please let me know if you run into any other issues.

/* The vote is open until Thursday, January 04, 2018 at 12:00 CEST. */

On Fri, Dec 29, 2017 at 11:59 PM, Robert Kanter <rkan...@cloudera.com>
wrote:

> Thanks for putting this together.
>
> Another important thing to note in the highlights that as part of moving
> the launcher, we also dropped support for Hadoop 1.x and we added new 1.0
> schemas.
>
> +1
>
> Here's what I did:
> - Verified md5
> - Verified signature (gpg)
> - Built Oozie against Hadoop 2.7.2
> - Ran a few of the examples, clicked around the UI and tried various CLI
> commands
>
> Here's some issues I ran into; none are blockers for 5b1:
> - Filed OOZIE-3149 to delete work.log, which is really old (not a blocker)
> - Filed OOZIE-3150 to update NOTICE.txt (I made this a blocker for 5.0.0)
> - The examples are still the older schemas, which is fine for the beta, but
> I made OOZIE-2814 a blocker for 5.0.0 because it will encourage users to
> use the new schemas
>
> - Robert
>
>
> On Thu, Dec 28, 2017 at 1:23 PM, Peter Cseh <gezap...@cloudera.com> wrote:
>
> > Hi Attila!
> >
> > It looks like I've messed up the extraction of the tar.gz and I was
> looking
> > at empty folders :)
> > Will validate the release tomorrow.
> >
> > Sorry for causing confusion!
> > gp
> >
> > On Thu, Dec 28, 2017 at 2:08 PM, Attila Sasvari <asasv...@cloudera.com>
> > wrote:
> >
> > > @Andras: many thanks. Please let me know if you notice anything strange
> > > with hashes or run into other problems.
> > >
> > > @gp: thanks a lot. This is actually what the
> bin/create-release-artifact
> > > script has generated. Comparing it with previous release candidate
> (4.3.0
> > > rc1), file size of oozie-5.0.0-beta1.tar.gz looks correct to me
> > >
> > >   $ wget
> > > https://dist.apache.org/repos/dist/dev/oozie/oozie-4.3.0-
> > > rc1/oozie-4.3.0.tar.gz
> > >   $ wget
> > > http://people.apache.org/\~asasvari/oozie-5.0.0-beta1-
> > > rc0/oozie-5.0.0-beta1.tar.gz
> > >
> > >   $ ls -lrt oozie-*tar.gz
> > >   -rw-r--r--  1 asasvari  staff  2392205 Oct 25  2016
> oozie-4.3.0.tar.gz
> > >   -rw-r--r--  1 asasvari  staff  2539718 Dec 28 00:12
> > > oozie-5.0.0-beta1.tar.gz
> > >
> > > oozie-5.0.0-beta1.tar.gz contains much more files (it contains all the
> > > sources):
> > >
> > >   $  tar tvf oozie-5.0.0-beta1.tar.gz | grep "\.java" | head -5
> > >   -rw-r--r--  0 asasvari wheel   10328 Dec 28 00:02
> > > oozie-5.0.0-beta1/zookeeper-security-tests/src/test/java/
> > > org/apache/oozie/util/TestZKUtilsWithSecurity.java
> > >   -rw-r--r--  0 asasvari wheel7357 Dec 28 00:02
> > > oozie-5.0.0-beta1/zookeeper-security-tests/src/test/java/
> > > org/apache/oozie/test/ZKXTestCaseWithSecurity.java
> > >   -rw-r--r--  0 asasvari wheel   32589 Dec 28 00:02
> > > oozie-5.0.0-beta1/tools/src/test/java/org/apache/oozie/
> > > tools/FakeConnection.java
> > >   -rw-r--r--  0 asasvari wheel1921 Dec 28 00:02
> > > oozie-5.0.0-beta1/tools/src/test/java/org/apache/oozie/
> > > tools/FakeDriver.java
> > >   -rw-r--r--  0 asasvari wheel2230 Dec 28 00:02
> > > oozie-5.0.0-beta1/tools/src/test/java/org/apache/oozie/
> > > tools/LauncherSecurityManager.java
> > >
> > > If you download the tarball and run bin/mkdistro.sh, it will probably
> > fail
> > > due to known flaky tests. Running tests with bin/mkdistro.sh
> > > -Dsurefire.rerunFailingTestsCount=2, they shall pass (printing things
> > > like [WARNING] Tests run: 1841, Failures: 0, Errors: 0, Skipped: 2,
> > Flakes:
> > > 2 ).
> > >
> > > - Attila
> > >
> > > On Thu, Dec 28, 2017 at 10:57 AM, Peter Cseh <gezap...@cloudera.com>
> > > wrote:
> > >
> > > > Thanks Attila!
> > > > The tar.gz does not contain the release, it only contains the pom
> > files.
> > > > The whole thing is 2.4 Mb, an Oozie was bigger the last time I've
> > checked
> > > > :)
> > > >
> > > > gp
> > > >
> > > > On Thu, Dec 28, 2017 at 12:53 AM, Attila Sasvári <
> asasv...@apache.org>
> > > > wrote:
> > > >
> &

Re: [VOTE] Release Oozie 5.0.0-beta1 (candidate 0)

[Robert Kanter]

Thanks for putting this together.

Another important thing to note in the highlights that as part of moving
the launcher, we also dropped support for Hadoop 1.x and we added new 1.0
schemas.

+1

Here's what I did:
- Verified md5
- Verified signature (gpg)
- Built Oozie against Hadoop 2.7.2
- Ran a few of the examples, clicked around the UI and tried various CLI
commands

Here's some issues I ran into; none are blockers for 5b1:
- Filed OOZIE-3149 to delete work.log, which is really old (not a blocker)
- Filed OOZIE-3150 to update NOTICE.txt (I made this a blocker for 5.0.0)
- The examples are still the older schemas, which is fine for the beta, but
I made OOZIE-2814 a blocker for 5.0.0 because it will encourage users to
use the new schemas

- Robert


On Thu, Dec 28, 2017 at 1:23 PM, Peter Cseh <gezap...@cloudera.com> wrote:

> Hi Attila!
>
> It looks like I've messed up the extraction of the tar.gz and I was looking
> at empty folders :)
> Will validate the release tomorrow.
>
> Sorry for causing confusion!
> gp
>
> On Thu, Dec 28, 2017 at 2:08 PM, Attila Sasvari <asasv...@cloudera.com>
> wrote:
>
> > @Andras: many thanks. Please let me know if you notice anything strange
> > with hashes or run into other problems.
> >
> > @gp: thanks a lot. This is actually what the bin/create-release-artifact
> > script has generated. Comparing it with previous release candidate (4.3.0
> > rc1), file size of oozie-5.0.0-beta1.tar.gz looks correct to me
> >
> >   $ wget
> > https://dist.apache.org/repos/dist/dev/oozie/oozie-4.3.0-
> > rc1/oozie-4.3.0.tar.gz
> >   $ wget
> > http://people.apache.org/\~asasvari/oozie-5.0.0-beta1-
> > rc0/oozie-5.0.0-beta1.tar.gz
> >
> >   $ ls -lrt oozie-*tar.gz
> >   -rw-r--r--  1 asasvari  staff  2392205 Oct 25  2016 oozie-4.3.0.tar.gz
> >   -rw-r--r--  1 asasvari  staff  2539718 Dec 28 00:12
> > oozie-5.0.0-beta1.tar.gz
> >
> > oozie-5.0.0-beta1.tar.gz contains much more files (it contains all the
> > sources):
> >
> >   $  tar tvf oozie-5.0.0-beta1.tar.gz | grep "\.java" | head -5
> >   -rw-r--r--  0 asasvari wheel   10328 Dec 28 00:02
> > oozie-5.0.0-beta1/zookeeper-security-tests/src/test/java/
> > org/apache/oozie/util/TestZKUtilsWithSecurity.java
> >   -rw-r--r--  0 asasvari wheel7357 Dec 28 00:02
> > oozie-5.0.0-beta1/zookeeper-security-tests/src/test/java/
> > org/apache/oozie/test/ZKXTestCaseWithSecurity.java
> >   -rw-r--r--  0 asasvari wheel   32589 Dec 28 00:02
> > oozie-5.0.0-beta1/tools/src/test/java/org/apache/oozie/
> > tools/FakeConnection.java
> >   -rw-r--r--  0 asasvari wheel1921 Dec 28 00:02
> > oozie-5.0.0-beta1/tools/src/test/java/org/apache/oozie/
> > tools/FakeDriver.java
> >   -rw-r--r--  0 asasvari wheel2230 Dec 28 00:02
> > oozie-5.0.0-beta1/tools/src/test/java/org/apache/oozie/
> > tools/LauncherSecurityManager.java
> >
> > If you download the tarball and run bin/mkdistro.sh, it will probably
> fail
> > due to known flaky tests. Running tests with bin/mkdistro.sh
> > -Dsurefire.rerunFailingTestsCount=2, they shall pass (printing things
> > like [WARNING] Tests run: 1841, Failures: 0, Errors: 0, Skipped: 2,
> Flakes:
> > 2 ).
> >
> > - Attila
> >
> > On Thu, Dec 28, 2017 at 10:57 AM, Peter Cseh <gezap...@cloudera.com>
> > wrote:
> >
> > > Thanks Attila!
> > > The tar.gz does not contain the release, it only contains the pom
> files.
> > > The whole thing is 2.4 Mb, an Oozie was bigger the last time I've
> checked
> > > :)
> > >
> > > gp
> > >
> > > On Thu, Dec 28, 2017 at 12:53 AM, Attila Sasvári <asasv...@apache.org>
> > > wrote:
> > >
> > > > Hi there,
> > > >
> > > > I have created a build for Oozie 5.0.0-beta1, release candidate 0.
> > > >
> > > > This release introduces major changes:
> > > > - moving launcher from MapReduce AM to Oozie AM,
> > > > - switching from Tomcat to embedded Jetty,
> > > > - completely rewritten graph generator,
> > > > - local sharelib,
> > > > - JDK 8 support.
> > > >
> > > > Keys to verify the signature of the release artifact are available at
> > > >
> > > >  http://www.apache.org/dist/oozie/KEYS
> > > >
> > > > Please download, test, and try it out:
> > > >
> > > >   http://people.apache.org/~asasvari/oozie-5.0.0-beta1-rc0/
> > > >
> > > > The release, md5 signature, gpg signature, and rat report can all be
> > > found
> > > > at the above address.
> > > >
> > > > The vote is open until Thursday, January 04, 2018 at 12:00 CEST.
> > > >
> > > > Thanks,
> > > > Attila Sasvari
> > > >
> > >
> > >
> > >
> > > --
> > > Peter Cseh
> > > Software Engineer
> > > <http://www.cloudera.com>
> > >
> >
> >
> >
> > --
> > --
> > Attila Sasvari
> > Software Engineer
> > <http://www.cloudera.com/>
> >
>
>
>
> --
> Peter Cseh
> Software Engineer
> <http://www.cloudera.com>
>

Re: [VOTE] Release Oozie 5.0.0-beta1 (candidate 0)

[Peter Cseh]

Hi Attila!

It looks like I've messed up the extraction of the tar.gz and I was looking
at empty folders :)
Will validate the release tomorrow.

Sorry for causing confusion!
gp

On Thu, Dec 28, 2017 at 2:08 PM, Attila Sasvari <asasv...@cloudera.com>
wrote:

> @Andras: many thanks. Please let me know if you notice anything strange
> with hashes or run into other problems.
>
> @gp: thanks a lot. This is actually what the bin/create-release-artifact
> script has generated. Comparing it with previous release candidate (4.3.0
> rc1), file size of oozie-5.0.0-beta1.tar.gz looks correct to me
>
>   $ wget
> https://dist.apache.org/repos/dist/dev/oozie/oozie-4.3.0-
> rc1/oozie-4.3.0.tar.gz
>   $ wget
> http://people.apache.org/\~asasvari/oozie-5.0.0-beta1-
> rc0/oozie-5.0.0-beta1.tar.gz
>
>   $ ls -lrt oozie-*tar.gz
>   -rw-r--r--  1 asasvari  staff  2392205 Oct 25  2016 oozie-4.3.0.tar.gz
>   -rw-r--r--  1 asasvari  staff  2539718 Dec 28 00:12
> oozie-5.0.0-beta1.tar.gz
>
> oozie-5.0.0-beta1.tar.gz contains much more files (it contains all the
> sources):
>
>   $  tar tvf oozie-5.0.0-beta1.tar.gz | grep "\.java" | head -5
>   -rw-r--r--  0 asasvari wheel   10328 Dec 28 00:02
> oozie-5.0.0-beta1/zookeeper-security-tests/src/test/java/
> org/apache/oozie/util/TestZKUtilsWithSecurity.java
>   -rw-r--r--  0 asasvari wheel7357 Dec 28 00:02
> oozie-5.0.0-beta1/zookeeper-security-tests/src/test/java/
> org/apache/oozie/test/ZKXTestCaseWithSecurity.java
>   -rw-r--r--  0 asasvari wheel   32589 Dec 28 00:02
> oozie-5.0.0-beta1/tools/src/test/java/org/apache/oozie/
> tools/FakeConnection.java
>   -rw-r--r--  0 asasvari wheel1921 Dec 28 00:02
> oozie-5.0.0-beta1/tools/src/test/java/org/apache/oozie/
> tools/FakeDriver.java
>   -rw-r--r--  0 asasvari wheel2230 Dec 28 00:02
> oozie-5.0.0-beta1/tools/src/test/java/org/apache/oozie/
> tools/LauncherSecurityManager.java
>
> If you download the tarball and run bin/mkdistro.sh, it will probably fail
> due to known flaky tests. Running tests with bin/mkdistro.sh
> -Dsurefire.rerunFailingTestsCount=2, they shall pass (printing things
> like [WARNING] Tests run: 1841, Failures: 0, Errors: 0, Skipped: 2, Flakes:
> 2 ).
>
> - Attila
>
> On Thu, Dec 28, 2017 at 10:57 AM, Peter Cseh <gezap...@cloudera.com>
> wrote:
>
> > Thanks Attila!
> > The tar.gz does not contain the release, it only contains the pom files.
> > The whole thing is 2.4 Mb, an Oozie was bigger the last time I've checked
> > :)
> >
> > gp
> >
> > On Thu, Dec 28, 2017 at 12:53 AM, Attila Sasvári <asasv...@apache.org>
> > wrote:
> >
> > > Hi there,
> > >
> > > I have created a build for Oozie 5.0.0-beta1, release candidate 0.
> > >
> > > This release introduces major changes:
> > > - moving launcher from MapReduce AM to Oozie AM,
> > > - switching from Tomcat to embedded Jetty,
> > > - completely rewritten graph generator,
> > > - local sharelib,
> > > - JDK 8 support.
> > >
> > > Keys to verify the signature of the release artifact are available at
> > >
> > >  http://www.apache.org/dist/oozie/KEYS
> > >
> > > Please download, test, and try it out:
> > >
> > >   http://people.apache.org/~asasvari/oozie-5.0.0-beta1-rc0/
> > >
> > > The release, md5 signature, gpg signature, and rat report can all be
> > found
> > > at the above address.
> > >
> > > The vote is open until Thursday, January 04, 2018 at 12:00 CEST.
> > >
> > > Thanks,
> > > Attila Sasvari
> > >
> >
> >
> >
> > --
> > Peter Cseh
> > Software Engineer
> > <http://www.cloudera.com>
> >
>
>
>
> --
> --
> Attila Sasvari
> Software Engineer
> <http://www.cloudera.com/>
>



-- 
Peter Cseh
Software Engineer
<http://www.cloudera.com>

Re: [VOTE] Release Oozie 5.0.0-beta1 (candidate 0)

[Attila Sasvari]

@Andras: many thanks. Please let me know if you notice anything strange
with hashes or run into other problems.

@gp: thanks a lot. This is actually what the bin/create-release-artifact
script has generated. Comparing it with previous release candidate (4.3.0
rc1), file size of oozie-5.0.0-beta1.tar.gz looks correct to me

  $ wget
https://dist.apache.org/repos/dist/dev/oozie/oozie-4.3.0-rc1/oozie-4.3.0.tar.gz
  $ wget
http://people.apache.org/\~asasvari/oozie-5.0.0-beta1-rc0/oozie-5.0.0-beta1.tar.gz

  $ ls -lrt oozie-*tar.gz
  -rw-r--r--  1 asasvari  staff  2392205 Oct 25  2016 oozie-4.3.0.tar.gz
  -rw-r--r--  1 asasvari  staff  2539718 Dec 28 00:12
oozie-5.0.0-beta1.tar.gz

oozie-5.0.0-beta1.tar.gz contains much more files (it contains all the
sources):

  $  tar tvf oozie-5.0.0-beta1.tar.gz | grep "\.java" | head -5
  -rw-r--r--  0 asasvari wheel   10328 Dec 28 00:02
oozie-5.0.0-beta1/zookeeper-security-tests/src/test/java/org/apache/oozie/util/TestZKUtilsWithSecurity.java
  -rw-r--r--  0 asasvari wheel7357 Dec 28 00:02
oozie-5.0.0-beta1/zookeeper-security-tests/src/test/java/org/apache/oozie/test/ZKXTestCaseWithSecurity.java
  -rw-r--r--  0 asasvari wheel   32589 Dec 28 00:02
oozie-5.0.0-beta1/tools/src/test/java/org/apache/oozie/tools/FakeConnection.java
  -rw-r--r--  0 asasvari wheel1921 Dec 28 00:02
oozie-5.0.0-beta1/tools/src/test/java/org/apache/oozie/tools/FakeDriver.java
  -rw-r--r--  0 asasvari wheel2230 Dec 28 00:02
oozie-5.0.0-beta1/tools/src/test/java/org/apache/oozie/tools/LauncherSecurityManager.java

If you download the tarball and run bin/mkdistro.sh, it will probably fail
due to known flaky tests. Running tests with bin/mkdistro.sh
-Dsurefire.rerunFailingTestsCount=2, they shall pass (printing things
like [WARNING] Tests run: 1841, Failures: 0, Errors: 0, Skipped: 2, Flakes:
2 ).

- Attila

On Thu, Dec 28, 2017 at 10:57 AM, Peter Cseh <gezap...@cloudera.com> wrote:

> Thanks Attila!
> The tar.gz does not contain the release, it only contains the pom files.
> The whole thing is 2.4 Mb, an Oozie was bigger the last time I've checked
> :)
>
> gp
>
> On Thu, Dec 28, 2017 at 12:53 AM, Attila Sasvári <asasv...@apache.org>
> wrote:
>
> > Hi there,
> >
> > I have created a build for Oozie 5.0.0-beta1, release candidate 0.
> >
> > This release introduces major changes:
> > - moving launcher from MapReduce AM to Oozie AM,
> > - switching from Tomcat to embedded Jetty,
> > - completely rewritten graph generator,
> > - local sharelib,
> > - JDK 8 support.
> >
> > Keys to verify the signature of the release artifact are available at
> >
> >  http://www.apache.org/dist/oozie/KEYS
> >
> > Please download, test, and try it out:
> >
> >   http://people.apache.org/~asasvari/oozie-5.0.0-beta1-rc0/
> >
> > The release, md5 signature, gpg signature, and rat report can all be
> found
> > at the above address.
> >
> > The vote is open until Thursday, January 04, 2018 at 12:00 CEST.
> >
> > Thanks,
> > Attila Sasvari
> >
>
>
>
> --
> Peter Cseh
> Software Engineer
> <http://www.cloudera.com>
>



-- 
-- 
Attila Sasvari
Software Engineer
<http://www.cloudera.com/>

Re: [VOTE] Release Oozie 5.0.0-beta1 (candidate 0)

[Peter Cseh]

Thanks Attila!
The tar.gz does not contain the release, it only contains the pom files.
The whole thing is 2.4 Mb, an Oozie was bigger the last time I've checked :)

gp

On Thu, Dec 28, 2017 at 12:53 AM, Attila Sasvári <asasv...@apache.org>
wrote:

> Hi there,
>
> I have created a build for Oozie 5.0.0-beta1, release candidate 0.
>
> This release introduces major changes:
> - moving launcher from MapReduce AM to Oozie AM,
> - switching from Tomcat to embedded Jetty,
> - completely rewritten graph generator,
> - local sharelib,
> - JDK 8 support.
>
> Keys to verify the signature of the release artifact are available at
>
>  http://www.apache.org/dist/oozie/KEYS
>
> Please download, test, and try it out:
>
>   http://people.apache.org/~asasvari/oozie-5.0.0-beta1-rc0/
>
> The release, md5 signature, gpg signature, and rat report can all be found
> at the above address.
>
> The vote is open until Thursday, January 04, 2018 at 12:00 CEST.
>
> Thanks,
> Attila Sasvari
>



-- 
Peter Cseh
Software Engineer
<http://www.cloudera.com>

Re: [VOTE] Release Oozie 5.0.0-beta1 (candidate 0)

[Andras Piros]

Thanks Attila,

will download and test the RC till then.

Regards,

Andras

Attila Sasvári <asasv...@apache.org> (időpont: 2017. dec. 28., Cs, 0:53)
ezt írta:

> Hi there,
>
> I have created a build for Oozie 5.0.0-beta1, release candidate 0.
>
> This release introduces major changes:
> - moving launcher from MapReduce AM to Oozie AM,
> - switching from Tomcat to embedded Jetty,
> - completely rewritten graph generator,
> - local sharelib,
> - JDK 8 support.
>
> Keys to verify the signature of the release artifact are available at
>
>  http://www.apache.org/dist/oozie/KEYS
>
> Please download, test, and try it out:
>
>   http://people.apache.org/~asasvari/oozie-5.0.0-beta1-rc0/
>
> The release, md5 signature, gpg signature, and rat report can all be found
> at the above address.
>
> The vote is open until Thursday, January 04, 2018 at 12:00 CEST.
>
> Thanks,
> Attila Sasvari
>

Re: [VOTE] Release Oozie 5.0.0-beta1 (candidate 0)

[Andras Piros]

Yaaay :)

Kiraly!!!

Andris

Ps.: MapReduce mapper to YARN AM sztem

Attila Sasvári <asasv...@apache.org> (időpont: 2017. dec. 28., Cs, 0:53)
ezt írta:

> Hi there,
>
> I have created a build for Oozie 5.0.0-beta1, release candidate 0.
>
> This release introduces major changes:
> - moving launcher from MapReduce AM to Oozie AM,
> - switching from Tomcat to embedded Jetty,
> - completely rewritten graph generator,
> - local sharelib,
> - JDK 8 support.
>
> Keys to verify the signature of the release artifact are available at
>
>  http://www.apache.org/dist/oozie/KEYS
>
> Please download, test, and try it out:
>
>   http://people.apache.org/~asasvari/oozie-5.0.0-beta1-rc0/
>
> The release, md5 signature, gpg signature, and rat report can all be found
> at the above address.
>
> The vote is open until Thursday, January 04, 2018 at 12:00 CEST.
>
> Thanks,
> Attila Sasvari
>

[VOTE] Release Oozie 5.0.0-beta1 (candidate 0)

[Attila Sasvári]

Hi there,

I have created a build for Oozie 5.0.0-beta1, release candidate 0.

This release introduces major changes:
- moving launcher from MapReduce AM to Oozie AM,
- switching from Tomcat to embedded Jetty,
- completely rewritten graph generator,
- local sharelib,
- JDK 8 support.

Keys to verify the signature of the release artifact are available at

 http://www.apache.org/dist/oozie/KEYS

Please download, test, and try it out:

  http://people.apache.org/~asasvari/oozie-5.0.0-beta1-rc0/

The release, md5 signature, gpg signature, and rat report can all be found
at the above address.

The vote is open until Thursday, January 04, 2018 at 12:00 CEST.

Thanks,
Attila Sasvari

Re: Oozie 5.0.0-beta1

[Robert Kanter]

 a number of
> > tests that do things like this too.
> >
> >
> > - Robert
> >
> >
> >
> > On Thu, Dec 21, 2017 at 12:40 PM, Attila Sasvari <asasv...@cloudera.com>
> > wrote:
> >
> > >  Update:
> > > - bin/mkdistro.sh fails because there are test failures.
> > > [ERROR] Failures:
> > >
> > >
> > > [ERROR]
> > > TestCoordActionsKillXCommand.testActionKillCommandActionNumbers:96
> > > expected: but was:
> > >
> > >
> > > [ERROR] Errors:
> > >
> > >
> > > [ERROR]
> > > TestJavaActionExecutor.testCredentialsSkip:1006->_
> > testCredentialsSkip:1106
> > > ? ActionExecutor
> > >
> > > [ERROR]   TestJMSAccessorService.testConnectionRetryExceptionLi
> > stener:211
> > > ?
> > > InstanceAlreadyExists
> > >
> > >
> > > - if I run the tests separately, they pass. Looking at the latest
> > precommit
> > > builds (https://builds.apache.org/job/PreCommit-OOZIE-Build), it turns
> > out
> > > that a lot of tests had to be re-executed to get a +1 for the TESTS
> part.
> > > Problem is that the Oozie tests have impact on each other, and it looks
> > > like the execution order matters too.
> > > - uploaded work in progress (SNAPSHOT)  artifacts here:
> > > http://people.apache.org/~asasvari/oozie-5.0.0-beta1-SNAPSHOT/
> > > - I plan to update the "How To Release" page as it contains some errors
> > > (e.g sftp shall be used to upload artifacts)
> > > - agreed with Artem that OOZIE-2231 will slip to 5.0.0
> > >
> > > Regards,
> > > - Attila
> > >
> > > On Mon, Dec 18, 2017 at 11:47 PM, Attila Sasvari <
> asasv...@cloudera.com>
> > > wrote:
> > >
> > > > Hi everyone,
> > > >
> > > > branch-5.0.0-beta1 has been created.
> > > >
> > > > Regards,
> > > > Attila
> > > >
> > > > On Mon, Dec 18, 2017 at 7:25 PM, Attila Sasvari <
> asasv...@cloudera.com
> > >
> > > > wrote:
> > > >
> > > >> Thanks gp. I will follow the steps described on
> > > >> https://cwiki.apache.org/confluence/display/OOZIE/How+To+Release
> > during
> > > >> the process.
> > > >>
> > > >> Next steps:
> > > >> - A new branch is about to be created from master.
> > > >>
> > > >> Artem, many thanks. I will review and commit that patch if
> everything
> > is
> > > >> okay. I don't see any problem with including it in 5.0.0-beta1.
> > > >>
> > > >> On Mon, Dec 18, 2017 at 4:32 PM, Artem Ervits <
> artemerv...@gmail.com>
> > > >> wrote:
> > > >>
> > > >>> just uploaded patch for OOZIE-2231.
> > > >>>
> > > >>> On Mon, Dec 18, 2017 at 10:04 AM, Peter Cseh <
> gezap...@cloudera.com>
> > > >>> wrote:
> > > >>>
> > > >>> > Hey Attila,
> > > >>> >
> > > >>> > I won't be able to work on the release for a couple weeks now.
> > > >>> > Thanks for getting the release rolling!
> > > >>> >
> > > >>> > Cheers,
> > > >>> > gp
> > > >>> >
> > > >>> >
> > > >>> > On Mon, Dec 18, 2017 at 4:00 PM, Attila Sasvari <
> > > asasv...@cloudera.com
> > > >>> >
> > > >>> > wrote:
> > > >>> >
> > > >>> > > Hi everyone,
> > > >>> > >
> > > >>> > > I would like to create the release branch, branch-5.0.0-beta1
> > > >>> (following
> > > >>> > > Hadoop release versioning), earlier.
> > > >>> > >
> > > >>> > > Looking at https://issues.apache.org/
> > jira/projects/OOZIE/versions/
> > > >>> > 12342048
> > > >>> > > there are 3 issues in progress (OOZIE-2231, OOZIE-2942,
> > OOZIE-2974)
> > > >>> and 3
> > > >>> > > issues to do (OOZIE-2600, OOZIE-3093, OOZIE-1987). I will push
> > > those
> > > >>> out
> > > >>> > to
> > > >>> > > 5.0.0 if there are no objections.
> > > >>> > >
> > > >>> > 

Re: Oozie 5.0.0-beta1

[Attila Sasvari]

> > - if I run the tests separately, they pass. Looking at the latest
> precommit
> > builds (https://builds.apache.org/job/PreCommit-OOZIE-Build), it turns
> out
> > that a lot of tests had to be re-executed to get a +1 for the TESTS part.
> > Problem is that the Oozie tests have impact on each other, and it looks
> > like the execution order matters too.
> > - uploaded work in progress (SNAPSHOT)  artifacts here:
> > http://people.apache.org/~asasvari/oozie-5.0.0-beta1-SNAPSHOT/
> > - I plan to update the "How To Release" page as it contains some errors
> > (e.g sftp shall be used to upload artifacts)
> > - agreed with Artem that OOZIE-2231 will slip to 5.0.0
> >
> > Regards,
> > - Attila
> >
> > On Mon, Dec 18, 2017 at 11:47 PM, Attila Sasvari <asasv...@cloudera.com>
> > wrote:
> >
> > > Hi everyone,
> > >
> > > branch-5.0.0-beta1 has been created.
> > >
> > > Regards,
> > > Attila
> > >
> > > On Mon, Dec 18, 2017 at 7:25 PM, Attila Sasvari <asasv...@cloudera.com
> >
> > > wrote:
> > >
> > >> Thanks gp. I will follow the steps described on
> > >> https://cwiki.apache.org/confluence/display/OOZIE/How+To+Release
> during
> > >> the process.
> > >>
> > >> Next steps:
> > >> - A new branch is about to be created from master.
> > >>
> > >> Artem, many thanks. I will review and commit that patch if everything
> is
> > >> okay. I don't see any problem with including it in 5.0.0-beta1.
> > >>
> > >> On Mon, Dec 18, 2017 at 4:32 PM, Artem Ervits <artemerv...@gmail.com>
> > >> wrote:
> > >>
> > >>> just uploaded patch for OOZIE-2231.
> > >>>
> > >>> On Mon, Dec 18, 2017 at 10:04 AM, Peter Cseh <gezap...@cloudera.com>
> > >>> wrote:
> > >>>
> > >>> > Hey Attila,
> > >>> >
> > >>> > I won't be able to work on the release for a couple weeks now.
> > >>> > Thanks for getting the release rolling!
> > >>> >
> > >>> > Cheers,
> > >>> > gp
> > >>> >
> > >>> >
> > >>> > On Mon, Dec 18, 2017 at 4:00 PM, Attila Sasvari <
> > asasv...@cloudera.com
> > >>> >
> > >>> > wrote:
> > >>> >
> > >>> > > Hi everyone,
> > >>> > >
> > >>> > > I would like to create the release branch, branch-5.0.0-beta1
> > >>> (following
> > >>> > > Hadoop release versioning), earlier.
> > >>> > >
> > >>> > > Looking at https://issues.apache.org/
> jira/projects/OOZIE/versions/
> > >>> > 12342048
> > >>> > > there are 3 issues in progress (OOZIE-2231, OOZIE-2942,
> OOZIE-2974)
> > >>> and 3
> > >>> > > issues to do (OOZIE-2600, OOZIE-3093, OOZIE-1987). I will push
> > those
> > >>> out
> > >>> > to
> > >>> > > 5.0.0 if there are no objections.
> > >>> > >
> > >>> > > At the same time, I am volunteering to be the release manager if
> > >>> Peter
> > >>> > Cseh
> > >>> > > does not mind.
> > >>> > >
> > >>> > > Regards,
> > >>> > > Attila
> > >>> > >
> > >>> > > On Wed, Dec 6, 2017 at 8:28 PM, Robert Kanter <
> > rkan...@cloudera.com>
> > >>> > > wrote:
> > >>> > >
> > >>> > > > Sounds good to me!
> > >>> > > >
> > >>> > > > On Wed, Dec 6, 2017 at 5:17 AM, Andras Piros <
> > >>> > andras.pi...@cloudera.com>
> > >>> > > > wrote:
> > >>> > > >
> > >>> > > > > Good idea Gezapeti!
> > >>> > > > >
> > >>> > > > > Time to wrap things up towards a stable 5.0.0 - a release
> > >>> candidate
> > >>> > on
> > >>> > > > > 5.0.0b1 is a good first step.
> > >>> > > > >
> > >>> > > > > Since other components that Oozie uses like Pig and Hive do
> not
> > >>> > (fully)
> > >>

Re: Oozie 5.0.0-beta1

[Robert Kanter]

I took a look at the latest PreCommit job
<https://builds.apache.org/job/PreCommit-OOZIE-Build/288/consoleFull> and
it reported 55 rerun tests.
Tests rerun: 55
Tests failed at first run:
org.apache.oozie.action.hadoop.TestJavaActionExecutor,

However, looking through the actual output, I only see 1 test that failed
(and was rerun): TestJavaActionExecutor. testCredentialsSkip.

[INFO] Running org.apache.oozie.action.hadoop.TestJavaActionExecutor
[ERROR] Tests run: 55, Failures: 0, Errors: 1, Skipped: 0, Time
elapsed: 126.213 s <<< FAILURE! - in
org.apache.oozie.action.hadoop.TestJavaActionExecutor
[ERROR] 
testCredentialsSkip(org.apache.oozie.action.hadoop.TestJavaActionExecutor)
 Time elapsed: 0.532 s  <<< ERROR!
org.apache.oozie.action.ActionExecutorException: JA020: Could not load
credentials of type [abc] with name [abcname]]; perhaps it was not
defined in oozie-site.xml?
at 
org.apache.oozie.action.hadoop.TestJavaActionExecutor._testCredentialsSkip(TestJavaActionExecutor.java:1106)
at 
org.apache.oozie.action.hadoop.TestJavaActionExecutor.testCredentialsSkip(TestJavaActionExecutor.java:1006)


In fact, the report only lists the one test class, not 55 of them.  So I
think there's something wrong with our reporting here.

Anyway, typically, when we see test that succeed on their own but fail when
run all together, that means that (likely some other) test is not cleaning
up properly.  This is unfortunately tricky to debug because it's hard to
figure out what the other test is.  A long time ago, a big example of this
problem was not properly shutting down the Services singleton, so we'd have
duplicates and other issues.

For these specific issues, some hints:
# RUNNINGWITHERROR: This problem means that a yarn job in the mini cluster
has failed.  To find out why, you should be able to dig out the app id from
the test output, and then find it's yarn logs somewhere (there's a
minicluster logs dir, but I forget where).  That'll hopefully make it
obvious what's going on.
# Credentials: There's probably an oozie-site or Configuration class
leaking from somewhere or not properly cleaned up by a previous test or
setup by this test.  The Credentials class is missing.
# TestJMSAccessorService: Sounds like something didn't get cleaned up.

One way that might be easier to fix this is to have the setUp methods
ensure that things are clean just in case.  We actually have a number of
tests that do things like this too.


- Robert



On Thu, Dec 21, 2017 at 12:40 PM, Attila Sasvari <asasv...@cloudera.com>
wrote:

>  Update:
> - bin/mkdistro.sh fails because there are test failures.
> [ERROR] Failures:
>
>
> [ERROR]
> TestCoordActionsKillXCommand.testActionKillCommandActionNumbers:96
> expected: but was:
>
>
> [ERROR] Errors:
>
>
> [ERROR]
> TestJavaActionExecutor.testCredentialsSkip:1006->_testCredentialsSkip:1106
> ? ActionExecutor
>
> [ERROR]   TestJMSAccessorService.testConnectionRetryExceptionListener:211
> ?
> InstanceAlreadyExists
>
>
> - if I run the tests separately, they pass. Looking at the latest precommit
> builds (https://builds.apache.org/job/PreCommit-OOZIE-Build), it turns out
> that a lot of tests had to be re-executed to get a +1 for the TESTS part.
> Problem is that the Oozie tests have impact on each other, and it looks
> like the execution order matters too.
> - uploaded work in progress (SNAPSHOT)  artifacts here:
> http://people.apache.org/~asasvari/oozie-5.0.0-beta1-SNAPSHOT/
> - I plan to update the "How To Release" page as it contains some errors
> (e.g sftp shall be used to upload artifacts)
> - agreed with Artem that OOZIE-2231 will slip to 5.0.0
>
> Regards,
> - Attila
>
> On Mon, Dec 18, 2017 at 11:47 PM, Attila Sasvari <asasv...@cloudera.com>
> wrote:
>
> > Hi everyone,
> >
> > branch-5.0.0-beta1 has been created.
> >
> > Regards,
> > Attila
> >
> > On Mon, Dec 18, 2017 at 7:25 PM, Attila Sasvari <asasv...@cloudera.com>
> > wrote:
> >
> >> Thanks gp. I will follow the steps described on
> >> https://cwiki.apache.org/confluence/display/OOZIE/How+To+Release during
> >> the process.
> >>
> >> Next steps:
> >> - A new branch is about to be created from master.
> >>
> >> Artem, many thanks. I will review and commit that patch if everything is
> >> okay. I don't see any problem with including it in 5.0.0-beta1.
> >>
> >> On Mon, Dec 18, 2017 at 4:32 PM, Artem Ervits <artemerv...@gmail.com>
> >> wrote:
> >>
> >>> just uploaded patch for OOZIE-2231.
> >>>
> >>> On Mon, Dec 18, 2017 at 10:04 AM, Peter Cseh <gezap...@cloudera.com>
> >>> wrote:
> >>>
> >&g

Re: Oozie 5.0.0-beta1

[Attila Sasvari]

Hi everyone,

branch-5.0.0-beta1 has been created.

Regards,
Attila

On Mon, Dec 18, 2017 at 7:25 PM, Attila Sasvari 
wrote:

> Thanks gp. I will follow the steps described on
> https://cwiki.apache.org/confluence/display/OOZIE/How+To+Release during
> the process.
>
> Next steps:
> - A new branch is about to be created from master.
>
> Artem, many thanks. I will review and commit that patch if everything is
> okay. I don't see any problem with including it in 5.0.0-beta1.
>
> On Mon, Dec 18, 2017 at 4:32 PM, Artem Ervits 
> wrote:
>
>> just uploaded patch for OOZIE-2231.
>>
>> On Mon, Dec 18, 2017 at 10:04 AM, Peter Cseh 
>> wrote:
>>
>> > Hey Attila,
>> >
>> > I won't be able to work on the release for a couple weeks now.
>> > Thanks for getting the release rolling!
>> >
>> > Cheers,
>> > gp
>> >
>> >
>> > On Mon, Dec 18, 2017 at 4:00 PM, Attila Sasvari 
>> > wrote:
>> >
>> > > Hi everyone,
>> > >
>> > > I would like to create the release branch, branch-5.0.0-beta1
>> (following
>> > > Hadoop release versioning), earlier.
>> > >
>> > > Looking at https://issues.apache.org/jira/projects/OOZIE/versions/
>> > 12342048
>> > > there are 3 issues in progress (OOZIE-2231, OOZIE-2942, OOZIE-2974)
>> and 3
>> > > issues to do (OOZIE-2600, OOZIE-3093, OOZIE-1987). I will push those
>> out
>> > to
>> > > 5.0.0 if there are no objections.
>> > >
>> > > At the same time, I am volunteering to be the release manager if Peter
>> > Cseh
>> > > does not mind.
>> > >
>> > > Regards,
>> > > Attila
>> > >
>> > > On Wed, Dec 6, 2017 at 8:28 PM, Robert Kanter 
>> > > wrote:
>> > >
>> > > > Sounds good to me!
>> > > >
>> > > > On Wed, Dec 6, 2017 at 5:17 AM, Andras Piros <
>> > andras.pi...@cloudera.com>
>> > > > wrote:
>> > > >
>> > > > > Good idea Gezapeti!
>> > > > >
>> > > > > Time to wrap things up towards a stable 5.0.0 - a release
>> candidate
>> > on
>> > > > > 5.0.0b1 is a good first step.
>> > > > >
>> > > > > Since other components that Oozie uses like Pig and Hive do not
>> > (fully)
>> > > > > support Hadoop 3, we have to wait with OOZIE-2973
>> > > > > .
>> > > > >
>> > > > > Thanks,
>> > > > >
>> > > > > Andras
>> > > > >
>> > > > > On Wed, Dec 6, 2017 at 1:50 PM, Peter Cseh > >
>> > > > wrote:
>> > > > >
>> > > > > > Hi everyone!
>> > > > > >
>> > > > > > Now that OOZIE-2969 > > > jira/browse/OOZIE-2969>
>> > > > > is
>> > > > > > committed I'd like to start the process of creating the branch
>> for
>> > > > > 5.0.0b1
>> > > > > > and building a release from there.
>> > > > > > It's unfortunate that we won't be able to support Hadoop 3 in
>> the
>> > > beta
>> > > > > for
>> > > > > > reasons described in OOZIE-2973
>> > > > > > 
>> > > > > > I don't see any more blockers for the beta1 and I hope we won't
>> > find
>> > > > > > hard-to-fix major issues so we can release Oozie 5.0.0 in early
>> > 2018.
>> > > > > > Please let me know if you have any suggestions.
>> > > > > > Thanks
>> > > > > > gp
>> > > > > >
>> > > > > > --
>> > > > > > Peter Cseh
>> > > > > > Software Engineer
>> > > > > > 
>> > > > > >
>> > > > >
>> > > >
>> > >
>> > >
>> > >
>> > > --
>> > > --
>> > > Attila Sasvari
>> > > Software Engineer
>> > > 
>> > >
>> >
>> >
>> >
>> > --
>> > Peter Cseh
>> > Software Engineer
>> > 
>> >
>>
>
>
>
> --
> --
> Attila Sasvari
> Software Engineer
> 
>



-- 
-- 
Attila Sasvari
Software Engineer

Re: Oozie 5.0.0-beta1

[Attila Sasvari]

Thanks gp. I will follow the steps described on
https://cwiki.apache.org/confluence/display/OOZIE/How+To+Release during the
process.

Next steps:
- A new branch is about to be created from master.

Artem, many thanks. I will review and commit that patch if everything is
okay. I don't see any problem with including it in 5.0.0-beta1.

On Mon, Dec 18, 2017 at 4:32 PM, Artem Ervits  wrote:

> just uploaded patch for OOZIE-2231.
>
> On Mon, Dec 18, 2017 at 10:04 AM, Peter Cseh 
> wrote:
>
> > Hey Attila,
> >
> > I won't be able to work on the release for a couple weeks now.
> > Thanks for getting the release rolling!
> >
> > Cheers,
> > gp
> >
> >
> > On Mon, Dec 18, 2017 at 4:00 PM, Attila Sasvari 
> > wrote:
> >
> > > Hi everyone,
> > >
> > > I would like to create the release branch, branch-5.0.0-beta1
> (following
> > > Hadoop release versioning), earlier.
> > >
> > > Looking at https://issues.apache.org/jira/projects/OOZIE/versions/
> > 12342048
> > > there are 3 issues in progress (OOZIE-2231, OOZIE-2942, OOZIE-2974)
> and 3
> > > issues to do (OOZIE-2600, OOZIE-3093, OOZIE-1987). I will push those
> out
> > to
> > > 5.0.0 if there are no objections.
> > >
> > > At the same time, I am volunteering to be the release manager if Peter
> > Cseh
> > > does not mind.
> > >
> > > Regards,
> > > Attila
> > >
> > > On Wed, Dec 6, 2017 at 8:28 PM, Robert Kanter 
> > > wrote:
> > >
> > > > Sounds good to me!
> > > >
> > > > On Wed, Dec 6, 2017 at 5:17 AM, Andras Piros <
> > andras.pi...@cloudera.com>
> > > > wrote:
> > > >
> > > > > Good idea Gezapeti!
> > > > >
> > > > > Time to wrap things up towards a stable 5.0.0 - a release candidate
> > on
> > > > > 5.0.0b1 is a good first step.
> > > > >
> > > > > Since other components that Oozie uses like Pig and Hive do not
> > (fully)
> > > > > support Hadoop 3, we have to wait with OOZIE-2973
> > > > > .
> > > > >
> > > > > Thanks,
> > > > >
> > > > > Andras
> > > > >
> > > > > On Wed, Dec 6, 2017 at 1:50 PM, Peter Cseh 
> > > > wrote:
> > > > >
> > > > > > Hi everyone!
> > > > > >
> > > > > > Now that OOZIE-2969  > > jira/browse/OOZIE-2969>
> > > > > is
> > > > > > committed I'd like to start the process of creating the branch
> for
> > > > > 5.0.0b1
> > > > > > and building a release from there.
> > > > > > It's unfortunate that we won't be able to support Hadoop 3 in the
> > > beta
> > > > > for
> > > > > > reasons described in OOZIE-2973
> > > > > > 
> > > > > > I don't see any more blockers for the beta1 and I hope we won't
> > find
> > > > > > hard-to-fix major issues so we can release Oozie 5.0.0 in early
> > 2018.
> > > > > > Please let me know if you have any suggestions.
> > > > > > Thanks
> > > > > > gp
> > > > > >
> > > > > > --
> > > > > > Peter Cseh
> > > > > > Software Engineer
> > > > > > 
> > > > > >
> > > > >
> > > >
> > >
> > >
> > >
> > > --
> > > --
> > > Attila Sasvari
> > > Software Engineer
> > > 
> > >
> >
> >
> >
> > --
> > Peter Cseh
> > Software Engineer
> > 
> >
>



-- 
-- 
Attila Sasvari
Software Engineer

Re: Oozie 5.0.0-beta1

[Artem Ervits]

just uploaded patch for OOZIE-2231.

On Mon, Dec 18, 2017 at 10:04 AM, Peter Cseh  wrote:

> Hey Attila,
>
> I won't be able to work on the release for a couple weeks now.
> Thanks for getting the release rolling!
>
> Cheers,
> gp
>
>
> On Mon, Dec 18, 2017 at 4:00 PM, Attila Sasvari 
> wrote:
>
> > Hi everyone,
> >
> > I would like to create the release branch, branch-5.0.0-beta1 (following
> > Hadoop release versioning), earlier.
> >
> > Looking at https://issues.apache.org/jira/projects/OOZIE/versions/
> 12342048
> > there are 3 issues in progress (OOZIE-2231, OOZIE-2942, OOZIE-2974) and 3
> > issues to do (OOZIE-2600, OOZIE-3093, OOZIE-1987). I will push those out
> to
> > 5.0.0 if there are no objections.
> >
> > At the same time, I am volunteering to be the release manager if Peter
> Cseh
> > does not mind.
> >
> > Regards,
> > Attila
> >
> > On Wed, Dec 6, 2017 at 8:28 PM, Robert Kanter 
> > wrote:
> >
> > > Sounds good to me!
> > >
> > > On Wed, Dec 6, 2017 at 5:17 AM, Andras Piros <
> andras.pi...@cloudera.com>
> > > wrote:
> > >
> > > > Good idea Gezapeti!
> > > >
> > > > Time to wrap things up towards a stable 5.0.0 - a release candidate
> on
> > > > 5.0.0b1 is a good first step.
> > > >
> > > > Since other components that Oozie uses like Pig and Hive do not
> (fully)
> > > > support Hadoop 3, we have to wait with OOZIE-2973
> > > > .
> > > >
> > > > Thanks,
> > > >
> > > > Andras
> > > >
> > > > On Wed, Dec 6, 2017 at 1:50 PM, Peter Cseh 
> > > wrote:
> > > >
> > > > > Hi everyone!
> > > > >
> > > > > Now that OOZIE-2969  > jira/browse/OOZIE-2969>
> > > > is
> > > > > committed I'd like to start the process of creating the branch for
> > > > 5.0.0b1
> > > > > and building a release from there.
> > > > > It's unfortunate that we won't be able to support Hadoop 3 in the
> > beta
> > > > for
> > > > > reasons described in OOZIE-2973
> > > > > 
> > > > > I don't see any more blockers for the beta1 and I hope we won't
> find
> > > > > hard-to-fix major issues so we can release Oozie 5.0.0 in early
> 2018.
> > > > > Please let me know if you have any suggestions.
> > > > > Thanks
> > > > > gp
> > > > >
> > > > > --
> > > > > Peter Cseh
> > > > > Software Engineer
> > > > > 
> > > > >
> > > >
> > >
> >
> >
> >
> > --
> > --
> > Attila Sasvari
> > Software Engineer
> > 
> >
>
>
>
> --
> Peter Cseh
> Software Engineer
> 
>

Re: Oozie 5.0.0-beta1

[Peter Cseh]

Hey Attila,

I won't be able to work on the release for a couple weeks now.
Thanks for getting the release rolling!

Cheers,
gp


On Mon, Dec 18, 2017 at 4:00 PM, Attila Sasvari 
wrote:

> Hi everyone,
>
> I would like to create the release branch, branch-5.0.0-beta1 (following
> Hadoop release versioning), earlier.
>
> Looking at https://issues.apache.org/jira/projects/OOZIE/versions/12342048
> there are 3 issues in progress (OOZIE-2231, OOZIE-2942, OOZIE-2974) and 3
> issues to do (OOZIE-2600, OOZIE-3093, OOZIE-1987). I will push those out to
> 5.0.0 if there are no objections.
>
> At the same time, I am volunteering to be the release manager if Peter Cseh
> does not mind.
>
> Regards,
> Attila
>
> On Wed, Dec 6, 2017 at 8:28 PM, Robert Kanter 
> wrote:
>
> > Sounds good to me!
> >
> > On Wed, Dec 6, 2017 at 5:17 AM, Andras Piros 
> > wrote:
> >
> > > Good idea Gezapeti!
> > >
> > > Time to wrap things up towards a stable 5.0.0 - a release candidate on
> > > 5.0.0b1 is a good first step.
> > >
> > > Since other components that Oozie uses like Pig and Hive do not (fully)
> > > support Hadoop 3, we have to wait with OOZIE-2973
> > > .
> > >
> > > Thanks,
> > >
> > > Andras
> > >
> > > On Wed, Dec 6, 2017 at 1:50 PM, Peter Cseh 
> > wrote:
> > >
> > > > Hi everyone!
> > > >
> > > > Now that OOZIE-2969  jira/browse/OOZIE-2969>
> > > is
> > > > committed I'd like to start the process of creating the branch for
> > > 5.0.0b1
> > > > and building a release from there.
> > > > It's unfortunate that we won't be able to support Hadoop 3 in the
> beta
> > > for
> > > > reasons described in OOZIE-2973
> > > > 
> > > > I don't see any more blockers for the beta1 and I hope we won't find
> > > > hard-to-fix major issues so we can release Oozie 5.0.0 in early 2018.
> > > > Please let me know if you have any suggestions.
> > > > Thanks
> > > > gp
> > > >
> > > > --
> > > > Peter Cseh
> > > > Software Engineer
> > > > 
> > > >
> > >
> >
>
>
>
> --
> --
> Attila Sasvari
> Software Engineer
> 
>



-- 
Peter Cseh
Software Engineer

Re: Oozie 5.0.0-beta1

[Attila Sasvari]

Hi everyone,

I would like to create the release branch, branch-5.0.0-beta1 (following
Hadoop release versioning), earlier.

Looking at https://issues.apache.org/jira/projects/OOZIE/versions/12342048
there are 3 issues in progress (OOZIE-2231, OOZIE-2942, OOZIE-2974) and 3
issues to do (OOZIE-2600, OOZIE-3093, OOZIE-1987). I will push those out to
5.0.0 if there are no objections.

At the same time, I am volunteering to be the release manager if Peter Cseh
does not mind.

Regards,
Attila

On Wed, Dec 6, 2017 at 8:28 PM, Robert Kanter  wrote:

> Sounds good to me!
>
> On Wed, Dec 6, 2017 at 5:17 AM, Andras Piros 
> wrote:
>
> > Good idea Gezapeti!
> >
> > Time to wrap things up towards a stable 5.0.0 - a release candidate on
> > 5.0.0b1 is a good first step.
> >
> > Since other components that Oozie uses like Pig and Hive do not (fully)
> > support Hadoop 3, we have to wait with OOZIE-2973
> > .
> >
> > Thanks,
> >
> > Andras
> >
> > On Wed, Dec 6, 2017 at 1:50 PM, Peter Cseh 
> wrote:
> >
> > > Hi everyone!
> > >
> > > Now that OOZIE-2969 
> > is
> > > committed I'd like to start the process of creating the branch for
> > 5.0.0b1
> > > and building a release from there.
> > > It's unfortunate that we won't be able to support Hadoop 3 in the beta
> > for
> > > reasons described in OOZIE-2973
> > > 
> > > I don't see any more blockers for the beta1 and I hope we won't find
> > > hard-to-fix major issues so we can release Oozie 5.0.0 in early 2018.
> > > Please let me know if you have any suggestions.
> > > Thanks
> > > gp
> > >
> > > --
> > > Peter Cseh
> > > Software Engineer
> > > 
> > >
> >
>



-- 
-- 
Attila Sasvari
Software Engineer

Re: Oozie 5.0.0-beta1

[Robert Kanter]

Sounds good to me!

On Wed, Dec 6, 2017 at 5:17 AM, Andras Piros 
wrote:

> Good idea Gezapeti!
>
> Time to wrap things up towards a stable 5.0.0 - a release candidate on
> 5.0.0b1 is a good first step.
>
> Since other components that Oozie uses like Pig and Hive do not (fully)
> support Hadoop 3, we have to wait with OOZIE-2973
> .
>
> Thanks,
>
> Andras
>
> On Wed, Dec 6, 2017 at 1:50 PM, Peter Cseh  wrote:
>
> > Hi everyone!
> >
> > Now that OOZIE-2969 
> is
> > committed I'd like to start the process of creating the branch for
> 5.0.0b1
> > and building a release from there.
> > It's unfortunate that we won't be able to support Hadoop 3 in the beta
> for
> > reasons described in OOZIE-2973
> > 
> > I don't see any more blockers for the beta1 and I hope we won't find
> > hard-to-fix major issues so we can release Oozie 5.0.0 in early 2018.
> > Please let me know if you have any suggestions.
> > Thanks
> > gp
> >
> > --
> > Peter Cseh
> > Software Engineer
> > 
> >
>

Re: Oozie 5.0.0-beta1

[Andras Piros]

Good idea Gezapeti!

Time to wrap things up towards a stable 5.0.0 - a release candidate on
5.0.0b1 is a good first step.

Since other components that Oozie uses like Pig and Hive do not (fully)
support Hadoop 3, we have to wait with OOZIE-2973
.

Thanks,

Andras

On Wed, Dec 6, 2017 at 1:50 PM, Peter Cseh  wrote:

> Hi everyone!
>
> Now that OOZIE-2969  is
> committed I'd like to start the process of creating the branch for 5.0.0b1
> and building a release from there.
> It's unfortunate that we won't be able to support Hadoop 3 in the beta for
> reasons described in OOZIE-2973
> 
> I don't see any more blockers for the beta1 and I hope we won't find
> hard-to-fix major issues so we can release Oozie 5.0.0 in early 2018.
> Please let me know if you have any suggestions.
> Thanks
> gp
>
> --
> Peter Cseh
> Software Engineer
> 
>

Oozie 5.0.0-beta1

[Peter Cseh]

Hi everyone!

Now that OOZIE-2969  is
committed I'd like to start the process of creating the branch for 5.0.0b1
and building a release from there.
It's unfortunate that we won't be able to support Hadoop 3 in the beta for
reasons described in OOZIE-2973

I don't see any more blockers for the beta1 and I hope we won't find
hard-to-fix major issues so we can release Oozie 5.0.0 in early 2018.
Please let me know if you have any suggestions.
Thanks
gp

-- 
Peter Cseh
Software Engineer