The vote for rc-3 has been extended till 02/02/2018 11:59 PST as some devs
have asked for more time.

On Wed, Jan 31, 2018 at 8:16 AM, Artem Ervits <artemerv...@gmail.com> wrote:

> @Rohini, yes Oozie-2888 fixed the issue what I meant was to replace commons
> lib with java.nio just like the Hadoop jira he had referenced. The
> Oozie-2888 bumps commons lib to latest only, it doesn't use built-in libs.
>
> On Jan 31, 2018 9:41 AM, "Rohini Palaniswamy" <roh...@apache.org> wrote:
>
> > >for 4.3.1 it's probably a non-issue but for 5.0 perhaps we'd like to
> > tackle
> > it
> > Attila mentioned that OOZIE-2888 already fixed the problem in 5.0.
> >
> >
> > On Wed, Jan 31, 2018 at 6:34 AM, Artem Ervits <artemerv...@gmail.com>
> > wrote:
> >
> > > @Attila, would you like me to open jira for:
> > >
> > > -  HADOOP-13444 replaced org.apache.commons.io.Charsets with
> > > java.nio.charset.StandardCharsets so it shall not be a problem on
> hadoop
> > > 2.8+
> > >
> > > for 4.3.1 it's probably a non-issue but for 5.0 perhaps we'd like to
> > tackle
> > > it? I'm happy to dedicate some cycles to it.
> > >
> > > On Tue, Jan 30, 2018 at 11:52 PM, Attila Sasvari <
> asasv...@cloudera.com>
> > > wrote:
> > >
> > > > - I could not reproduce the NoClassDefFoundError Artem reported with
> > > hadoop
> > > > 2.6.0. I changed  bin/oozie-setup.sh so that it prints loaded classes
> > > > (passed -verbose:class to the JVM). Interestingly,
> > org/apache/commons/io/
> > > > Charsets was not even loaded.
> > > >
> > > > However, when I tried again with hadoop.version *2.7.5* , it resulted
> > in
> > > > the error mentioned:
> > > >
> > > > java.lang.NoClassDefFoundError: org/apache/commons/io/Charsets
> > > > at org.apache.hadoop.security.Credentials.<clinit>(
> > Credentials.java:222)
> > > > at org.apache.hadoop.mapred.JobConf.<init>(JobConf.java:334)
> > > > at org.apache.oozie.service.HadoopAccessorService.createJobConf(
> > > > HadoopAccessorService.java:349)
> > > > at org.apache.oozie.tools.OozieSharelibCLI.run(
> > > OozieSharelibCLI.java:171)
> > > > at org.apache.oozie.tools.OozieSharelibCLI.main(
> > > OozieSharelibCLI.java:67)
> > > > Caused by: java.lang.ClassNotFoundException:
> > > > org.apache.commons.io.Charsets
> > > >
> > > > It looks like https://issues.apache.org/jira/browse/OOZIE-2396
> > > >
> > > > Some more info:
> > > > - ./lib/commons-io-2.1.jar does not contain org/apache/commons/io/
> > > > Charsets.
> > > >
> > > > - related hadoop 2.7.0 jira:
> > > > https://issues.apache.org/jira/browse/HADOOP-11389
> > > > - related hadoop code:
> > > > https://github.com/apache/hadoop/blame/branch-2.7.0/
> > > > hadoop-common-project/hadoop-common/src/main/java/org/
> > > > apache/hadoop/security/Credentials.java#L36
> > > > -  HADOOP-13444 replaced org.apache.commons.io.Charsets with
> > > > java.nio.charset.StandardCharsets so it shall not be a problem on
> > hadoop
> > > > 2.8+
> > > >
> > > > Note: Oozie 5.0.0-beta1 includes OOZIE-2888 that add updated
> commons-io
> > > to
> > > > 2.4. That is why it is not a problem there.
> > > >
> > > > On Wed, Jan 31, 2018 at 1:18 AM, Satish Saley <
> satishsa...@apache.org>
> > > > wrote:
> > > >
> > > > > 1. However, json2.js is referenced by webapp/index.html and it
> > > > > is not found (not a blocker in my opinion).
> > > > >
> > > > > -> It will show only in firebug/developer tools. Not on UI.
> > > > >
> > > > > 2. [WARNING] Unable to process class com/sun/tools/jdi/
> > > > ClassTypeImpl.class
> > > > > in
> > > > > JarAnalyzer File
> > > > >
> > > > > -> We can ignore the warning as build is going through
> > > > >
> > > > > 3. /user/oozie/share/lib/lib_20180130164518
> > > > > Exception in thread "main" java.lang.NoClassDefFoundError:
> > > > >
> > > > > I am not able to reproduce this.
> > > > >
> > > > > saley@easyfamily-lm on Tue Jan 30 at 11:44 AM
> > > > > ~/src/oozie-4.3.1/distro/target/oozie-4.3.1-distro/oozie-4.3.1
> > > > > $ bin/oozie-setup.sh sharelib create -fs hdfs://localhost
> > -concurrency
> > > 8
> > > > > -locallib oozie-sharelib-4.3.1.tar.gz
> > > > >   setting CATALINA_OPTS="$CATALINA_OPTS -Xmx1024m"
> > > > > log4j:WARN No appenders could be found for logger
> > > > > (org.apache.hadoop.util.Shell).
> > > > > log4j:WARN Please initialize the log4j system properly.
> > > > > log4j:WARN See http://logging.apache.org/
> log4j/1.2/faq.html#noconfig
> > > for
> > > > > more info.
> > > > > SLF4J: Class path contains multiple SLF4J bindings.
> > > > > SLF4J: Found binding in
> > > > > [jar:file:/Users/saley/src/oozie-4.3.1/distro/target/
> > > > > oozie-4.3.1-distro/oozie-4.3.1/lib/slf4j-log4j12-1.6.6.jar!
> > > > > /org/slf4j/impl/StaticLoggerBinder.class]
> > > > > SLF4J: Found binding in
> > > > > [jar:file:/Users/saley/src/oozie-4.3.1/distro/target/
> > > > > oozie-4.3.1-distro/oozie-4.3.1/lib/slf4j-simple-1.6.6.jar!/
> > > > org/slf4j/impl/
> > > > > StaticLoggerBinder.class]
> > > > > SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for
> an
> > > > > explanation.
> > > > > SLF4J: Actual binding is of type [org.slf4j.impl.
> Log4jLoggerFactory]
> > > > > the destination path for sharelib is:
> > > > > /user/saley/share/lib/lib_20180130114509
> > > > > Running 410 copy tasks on 8 threads
> > > > >
> > > > >
> > > > > saley@easyfamily-lm on Tue Jan 30 at 11:45 AM
> > > > > ~/src/oozie-4.3.1/distro/target/oozie-4.3.1-distro/oozie-4.3.1
> > > > > $ hdfs dfs -ls
> > > > > SLF4J: Class path contains multiple SLF4J bindings.
> > > > > SLF4J: Found binding in
> > > > > [jar:file:/Users/saley/hadoop-2.6.3/share/hadoop/common/lib/
> > > > > slf4j-log4j12-1.7.5.jar!/org/slf4j/impl/StaticLoggerBinder.class]
> > > > > SLF4J: Found binding in
> > > > > [jar:file:/Users/saley/src/tez/tez-dist/target/tez-0.8.5-
> > > > > minimal/lib/slf4j-log4j12-1.7.10.jar!/org/slf4j/impl/
> > > > > StaticLoggerBinder.class]
> > > > > SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for
> an
> > > > > explanation.
> > > > > SLF4J: Actual binding is of type [org.slf4j.impl.
> Log4jLoggerFactory]
> > > > > 18/01/30 11:45:27 WARN util.NativeCodeLoader: Unable to load
> > > > native-hadoop
> > > > > library for your platform... using builtin-java classes where
> > > applicable
> > > > > Found 1 items
> > > > > drwxr-xr-x   - saley supergroup          0 2018-01-30 11:45 share
> > > > >
> > > > >
> > > > >
> > > > >
> > > > > On Tue, Jan 30, 2018 at 8:52 AM, Artem Ervits <
> artemerv...@gmail.com
> > >
> > > > > wrote:
> > > > >
> > > > > > yes I realized that after hitting send, I encountered the
> following
> > > > > issues
> > > > > > but it may just be me
> > > > > >
> > > > > > hitting https://issues.apache.org/jira/browse/BCEL-173 when
> > > compiling
> > > > > with
> > > > > >
> > > > > > bin/mkdistro.sh -Phadoop-2 -DskipTests -Puber
> > > -DtargetJavaVersion=1.8
> > > > > > -DjavaVersion=1.8    -Dhadoop.version=2.7.5
> > > > > >
> > > > > > [WARNING] Unable to process class com/sun/tools/jdi/
> > > > ClassTypeImpl.class
> > > > > in
> > > > > > JarAnalyzer File
> > > > > > /usr/lib/jvm/java-1.8.0-openjdk-1.8.0.161-0.b14.el7_4.
> > > > > > x86_64/jre/../lib/tools.jar
> > > > > > org.apache.bcel.classfile.ClassFormatException: Invalid byte tag
> > in
> > > > > > constant pool: 18
> > > > > > at org.apache.bcel.classfile.Constant.readConstant(
> > > Constant.java:146)
> > > > > > at org.apache.bcel.classfile.ConstantPool.<init>(
> > > ConstantPool.java:67)
> > > > > > at
> > > > > > org.apache.bcel.classfile.ClassParser.readConstantPool(
> > > > > > ClassParser.java:222)
> > > > > > at org.apache.bcel.classfile.ClassParser.parse(ClassParser.
> > java:136)
> > > > > > at
> > > > > > org.apache.maven.shared.jar.classes.JarClassesAnalysis.
> > > > > > analyze(JarClassesAnalysis.java:92)
> > > > > > at
> > > > > > org.apache.maven.report.projectinfo.dependencies.Dependencies.
> > > > > > getJarDependencyDetails(Dependencies.java:276)
> > > > > > at
> > > > > > org.apache.maven.report.projectinfo.dependencies.
> > > > > > renderer.DependenciesRenderer.hasSealed(
> DependenciesRenderer.java:
> > > > 1374)
> > > > > > at
> > > > > > org.apache.maven.report.projectinfo.dependencies.
> > > > > > renderer.DependenciesRenderer.renderSectionDependencyFileDet
> > > > > > ails(DependenciesRenderer.java:544)
> > > > > > at
> > > > > > org.apache.maven.report.projectinfo.dependencies.
> > > > > > renderer.DependenciesRenderer.renderBody(
> > > > DependenciesRenderer.java:271)
> > > > > > at
> > > > > > org.apache.maven.reporting.AbstractMavenReportRenderer.render(
> > > > > > AbstractMavenReportRenderer.java:79)
> > > > > > at
> > > > > > org.apache.maven.report.projectinfo.DependenciesReport.
> > > executeReport(
> > > > > > DependenciesReport.java:206)
> > > > > > at
> > > > > > org.apache.maven.reporting.AbstractMavenReport.generate(
> > > > > > AbstractMavenReport.java:190)
> > > > > > at
> > > > > > org.apache.maven.report.projectinfo.AbstractProjectInfoReport.
> > > execute(
> > > > > > AbstractProjectInfoReport.java:202)
> > > > > > at
> > > > > > org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo(
> > > > > > DefaultBuildPluginManager.java:101)
> > > > > > at
> > > > > > org.apache.maven.lifecycle.internal.MojoExecutor.execute(
> > > > > > MojoExecutor.java:209)
> > > > > > at
> > > > > > org.apache.maven.lifecycle.internal.MojoExecutor.execute(
> > > > > > MojoExecutor.java:153)
> > > > > > at
> > > > > > org.apache.maven.lifecycle.internal.MojoExecutor.execute(
> > > > > > MojoExecutor.java:145)
> > > > > > at
> > > > > > org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.
> > > > buildProject(
> > > > > > LifecycleModuleBuilder.java:84)
> > > > > > at
> > > > > > org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.
> > > > buildProject(
> > > > > > LifecycleModuleBuilder.java:59)
> > > > > > at
> > > > > > org.apache.maven.lifecycle.internal.LifecycleStarter.
> > > > > singleThreadedBuild(
> > > > > > LifecycleStarter.java:183)
> > > > > > at
> > > > > > org.apache.maven.lifecycle.internal.LifecycleStarter.
> > > > > > execute(LifecycleStarter.java:161)
> > > > > > at org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:
> 320)
> > > > > > at org.apache.maven.DefaultMaven.execute(DefaultMaven.java:156)
> > > > > > at org.apache.maven.cli.MavenCli.execute(MavenCli.java:537)
> > > > > > at org.apache.maven.cli.MavenCli.doMain(MavenCli.java:196)
> > > > > > at org.apache.maven.cli.MavenCli.main(MavenCli.java:141)
> > > > > > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> > > > > > at
> > > > > > sun.reflect.NativeMethodAccessorImpl.invoke(
> > > > > NativeMethodAccessorImpl.java:
> > > > > > 62)
> > > > > > at
> > > > > > sun.reflect.DelegatingMethodAccessorImpl.invoke(
> > > > > > DelegatingMethodAccessorImpl.java:43)
> > > > > > at java.lang.reflect.Method.invoke(Method.java:498)
> > > > > > at
> > > > > > org.codehaus.plexus.classworlds.launcher.Launcher.
> > > > > > launchEnhanced(Launcher.java:290)
> > > > > > at
> > > > > > org.codehaus.plexus.classworlds.launcher.Launcher.
> > > > > > launch(Launcher.java:230)
> > > > > > at
> > > > > > org.codehaus.plexus.classworlds.launcher.Launcher.
> > > > > > mainWithExitCode(Launcher.java:414)
> > > > > > at org.codehaus.plexus.classworlds.launcher.Launcher.
> > > > > > main(Launcher.java:357)
> > > > > >
> > > > > > Then after a successful build getting the following version
> string
> > > > > >
> > > > > > Oozie distro created, DATE[2018.01.30-16:22:57GMT]
> > > VC-REV[unavailable],
> > > > > > available at [/tmp/oozie-4.3.1/distro/target]
> > > > > >
> > > > > > we can now pull VC-REV with https://issues.apache.org/
> > > > > > jira/browse/OOZIE-3152
> > > > > >
> > > > > > finally saw the following
> > > > > >
> > > > > > [oozie@hadoop oozie-4.3.1]$ bin/oozie-setup.sh sharelib create
> -fs
> > > > > > hdfs://localhost:9000 -concurrency 8 -locallib
> > > > > oozie-sharelib-4.3.1.tar.gz
> > > > > >   setting CATALINA_OPTS="$CATALINA_OPTS -Xmx1024m"
> > > > > > log4j:WARN No appenders could be found for logger
> > > > > > (org.apache.hadoop.util.Shell).
> > > > > > log4j:WARN Please initialize the log4j system properly.
> > > > > > log4j:WARN See http://logging.apache.org/
> > log4j/1.2/faq.html#noconfig
> > > > for
> > > > > > more info.
> > > > > > SLF4J: Class path contains multiple SLF4J bindings.
> > > > > > SLF4J: Found binding in
> > > > > > [jar:file:/opt/oozie/oozie-4.3.1/distro/target/oozie-4.3.1-
> > > > > > distro/oozie-4.3.1/lib/slf4j-log4j12-1.6.6.jar!/org/slf4j/
> > > > > > impl/StaticLoggerBinder.class]
> > > > > > SLF4J: Found binding in
> > > > > > [jar:file:/opt/oozie/oozie-4.3.1/distro/target/oozie-4.3.1-
> > > > > > distro/oozie-4.3.1/lib/slf4j-simple-1.6.6.jar!/org/slf4j/
> > > > > > impl/StaticLoggerBinder.class]
> > > > > > SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for
> > an
> > > > > > explanation.
> > > > > > SLF4J: Actual binding is of type [org.slf4j.impl.
> > Log4jLoggerFactory]
> > > > > > the destination path for sharelib is:
> > > > > > /user/oozie/share/lib/lib_20180130164518
> > > > > > Exception in thread "main" java.lang.NoClassDefFoundError:
> > > > > > org/apache/commons/io/Charsets
> > > > > > at org.apache.hadoop.security.Credentials.<clinit>(
> > > > Credentials.java:222)
> > > > > > at org.apache.hadoop.mapred.JobConf.<init>(JobConf.java:334)
> > > > > > at
> > > > > > org.apache.oozie.service.HadoopAccessorService.createJobConf(
> > > > > > HadoopAccessorService.java:349)
> > > > > > at org.apache.oozie.tools.OozieSharelibCLI.run(
> > > > > OozieSharelibCLI.java:171)
> > > > > > at org.apache.oozie.tools.OozieSharelibCLI.main(
> > > > > OozieSharelibCLI.java:67)
> > > > > > Caused by: java.lang.ClassNotFoundException:
> > > > > > org.apache.commons.io.Charsets
> > > > > > at java.net.URLClassLoader.findClass(URLClassLoader.java:381)
> > > > > > at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
> > > > > > at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:338)
> > > > > > at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
> > > > > > ... 5 more
> > > > > >
> > > > > > none were blockers as I was able to get the following output
> > > > > >
> > > > > > $ curl http://localhost:11000/oozie/v2/admin/status
> > > > > > {"systemMode":"NORMAL"}
> > > > > >
> > > > > >
> > > > > > On Tue, Jan 30, 2018 at 10:45 AM, Rohini Palaniswamy <
> > > > roh...@apache.org>
> > > > > > wrote:
> > > > > >
> > > > > > > > the server directory is missing altogether now.
> > > > > > >  That is as expected. It is supposed to be only in 5.0
> > > > > > >
> > > > > > > On Mon, Jan 29, 2018 at 12:47 PM, Artem Ervits <
> > > > artemerv...@gmail.com>
> > > > > > > wrote:
> > > > > > >
> > > > > > > > the server directory is missing altogether now.
> > > > > > > >
> > > > > > > > On Mon, Jan 29, 2018 at 6:59 AM, Attila Sasvari <
> > > > > asasv...@cloudera.com
> > > > > > >
> > > > > > > > wrote:
> > > > > > > >
> > > > > > > > > +1 (non-binding)
> > > > > > > > >
> > > > > > > > > - Verified hash, signature files, rat report
> > > > > > > > > - Built Oozie distro with hadoop.version set to 2.6.0 using
> > the
> > > > > uber,
> > > > > > > > > hadoop-2, spark-1 profiles
> > > > > > > > > - Submitted example workflows/coordinators/bundles (except
> > hive
> > > > > > related
> > > > > > > > > ones) on a hadoop 2.6.0 in pseudo distributed mode
> > > > > > > > > - Verified Tomcat version was 6.0.53
> > > > > > > > > - Clicked through the web UI, log retrieval worked, job
> DAG-s
> > > > were
> > > > > > > > > rendered, version was correct.
> > > > > > > > > - Verified instrumentation, SLA pages; they are now HTML
> > based
> > > as
> > > > > > > > expected
> > > > > > > > > (OOZIE-2533). However, json2.js is referenced by
> > > > webapp/index.html
> > > > > > and
> > > > > > > it
> > > > > > > > > is not found (not a blocker in my opinion).
> > > > > > > > > - Enabled SLA, re-submitted sla coordinator example, and
> > > > retrieved
> > > > > > SLA
> > > > > > > > > details for the "one-op-wf" application, graph was
> displayed
> > > > > > properly.
> > > > > > > > >
> > > > > > > > > I used JDK 1.8.0_121
> > > > > > > > >
> > > > > > > > > On Sun, Jan 28, 2018 at 7:09 AM, Satish Saley <
> > > > > > satishsa...@apache.org>
> > > > > > > > > wrote:
> > > > > > > > >
> > > > > > > > > > Hi,
> > > > > > > > > >
> > > > > > > > > > I have created a build for Oozie 4.3.1, candidate 3.
> > > > > > > > > >
> > > > > > > > > > It includes all the changes decided earlier except
> > > OOZIE-3018,
> > > > > > > > OOZIE-2771
> > > > > > > > > > and
> > > > > > > > > > OOZIE-3072. OOZIE-3018 makes changes to
> > SchemaCheckerService
> > > > > which
> > > > > > we
> > > > > > > > are
> > > > > > > > > > not picking.
> > > > > > > > > > OOZIE-2771 makes changes to file created in OOZIE-2666.
> > > > > > > > > > OOZIE-3072 makes changes to files created in OOZIE-1770.
> > > > > > > > > >
> > > > > > > > > >
> > > > > > > > > > Keys to verify the signature of the release artifact are
> > > > > available
> > > > > > at
> > > > > > > > > >   http://www.apache.org/dist/oozie/KEYS
> > > > > > > > > >
> > > > > > > > > > Please download, test, and try it out:
> > > > > > > > > >
> > > > > > > > > > http://people.apache.org/~satishsaley/oozie-4.3.1-rc3/
> > > > > > > > > >
> > > > > > > > > >
> > > > > > > > > > The release, md5 signature, gpg signature, and rat report
> > can
> > > > be
> > > > > > > found
> > > > > > > > at
> > > > > > > > > > the above address.
> > > > > > > > > >
> > > > > > > > > > Vote closes on 01/31/2018 11:59 PM PT.
> > > > > > > > > >
> > > > > > > > >
> > > > > > > > >
> > > > > > > > >
> > > > > > > > > --
> > > > > > > > > --
> > > > > > > > > Attila Sasvari
> > > > > > > > > Software Engineer
> > > > > > > > > <http://www.cloudera.com/>
> > > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > > >
> > > >
> > > > --
> > > > --
> > > > Attila Sasvari
> > > > Software Engineer
> > > > <http://www.cloudera.com/>
> > > >
> > >
> >
>

Reply via email to