[jira] [Created] (HADOOP-15514) NoClassDefFoundError of TimelineCollectorManager when starting MiniCluster
Jeff Zhang created HADOOP-15514:
---
Summary: NoClassDefFoundError of TimelineCollectorManager when
starting MiniCluster
Key: HADOOP-15514
URL: https://issues.apache.org/jira/browse/HADOOP-15514
Project: Hadoop Common
Issue Type: Bug
Reporter: Jeff Zhang
{code:java}
org.apache.hadoop.yarn.exceptions.YarnRuntimeException:
java.lang.NoClassDefFoundError:
org/apache/hadoop/yarn/server/timelineservice/collector/TimelineCollectorManager
at java.net.URLClassLoader.findClass(URLClassLoader.java:381)
at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:349)
at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
at java.lang.ClassLoader.defineClass1(Native Method)
at java.lang.ClassLoader.defineClass(ClassLoader.java:763)
at java.security.SecureClassLoader.defineClass(SecureClassLoader.java:142)
at java.net.URLClassLoader.defineClass(URLClassLoader.java:467)
at java.net.URLClassLoader.access$100(URLClassLoader.java:73)
at java.net.URLClassLoader$1.run(URLClassLoader.java:368)
at java.net.URLClassLoader$1.run(URLClassLoader.java:362)
at java.security.AccessController.doPrivileged(Native Method)
at java.net.URLClassLoader.findClass(URLClassLoader.java:361)
at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:349)
at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
at java.lang.Class.getDeclaredMethods0(Native Method)
at java.lang.Class.privateGetDeclaredMethods(Class.java:2701)
at java.lang.Class.getDeclaredMethods(Class.java:1975){code}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
-
To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-dev-h...@hadoop.apache.org
[jira] [Created] (HADOOP-15513) Add additional test cases to over corner cases for FileUtil#symlink
Giovanni Matteo Fumarola created HADOOP-15513: - Summary: Add additional test cases to over corner cases for FileUtil#symlink Key: HADOOP-15513 URL: https://issues.apache.org/jira/browse/HADOOP-15513 Project: Hadoop Common Issue Type: Sub-task Reporter: Giovanni Matteo Fumarola Assignee: Giovanni Matteo Fumarola -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-dev-h...@hadoop.apache.org
Re: [VOTE] Release Apache Hadoop 3.0.3 (RC0)
Thanks Yongjun for all the hard work on this release. - Verified signatures and checksums - Tested both the binary and also built from source on a pseudo distributed cluster - Verified filesystem shell commands - Verified admin commands - Tested snapshot feature - Sanity check of NN and DN UI - Verified site documentation The following links in site documentation are broken - Changelog and Release Notes - Unix Shell API - core-default.xml - hdfs-default.xml - hdfs-rbf-default.xml - mapred-default.xml - yarn-default.xml Site documentation was generated using the below steps - mvn site:site - mkdir -p /tmp/site && mvn site:stage -DstagingDirectory=/tmp/site - Browse to file:///tmp/site/hadoop-project/index.html. Thanks, Nanda On 6/3/18, 8:55 AM, "Yongjun Zhang" wrote: Hi Gabor, I got the git tag in, it's release-3.0.3-RC0. Would you please give it a try? It should correspond to commit 37fd7d752db73d984dc31e0cdfd590d252f5e075 Author: Yongjun Zhang Date: Wed May 30 00:07:33 2018 -0700 Update version to 3.0.3 to prepare for 3.0.3 release Thanks, --Yongjun On Fri, Jun 1, 2018 at 4:17 AM, Gabor Bota wrote: > Hi Yongjun, > > Thank you for working on this release. Is there a git tag in the upstream > repo which can be checked out? I'd like to build the release from source. > > Regards, > Gabor > > On Fri, Jun 1, 2018 at 7:57 AM Shashikant Banerjee < > sbaner...@hortonworks.com> wrote: > >> Looks like the link with the filter seems to be private. I can't see the >> blocker list. >> https://issues.apache.org/jira/issues/?filter=12343997 >> >> Meanwhile , I will be working on testing the release. >> >> Thanks >> Shashi >> On 6/1/18, 11:18 AM, "Yongjun Zhang" wrote: >> >> Greetings all, >> >> I've created the first release candidate (RC0) for Apache Hadoop >> 3.0.3. This is our next maintenance release to follow up 3.0.2. It >> includes >> about 249 >> important fixes and improvements, among which there are 8 blockers. >> See >> https://issues.apache.org/jira/issues/?filter=12343997 >> >> The RC artifacts are available at: >> https://dist.apache.org/repos/dist/dev/hadoop/3.0.3-RC0/ >> >> The maven artifacts are available via >> https://repository.apache.org/content/repositories/ >> orgapachehadoop-1126 >> >> Please try the release and vote; the vote will run for the usual 5 >> working >> days, ending on 06/07/2018 PST time. Would really appreciate your >> participation here. >> >> I bumped into quite some issues along the way, many thanks to quite a >> few >> people who helped, especially Sammi Chen, Andrew Wang, Junping Du, >> Eddy Xu. >> >> Thanks, >> >> --Yongjun >> >> >> - To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-dev-h...@hadoop.apache.org
[jira] [Created] (HADOOP-15512) clean up Shell from JDK7 workarounds
Steve Loughran created HADOOP-15512:
---
Summary: clean up Shell from JDK7 workarounds
Key: HADOOP-15512
URL: https://issues.apache.org/jira/browse/HADOOP-15512
Project: Hadoop Common
Issue Type: Improvement
Components: common
Affects Versions: 3.1.0
Reporter: Steve Loughran
there's some comments in {{Shell}} about JDK7 specific issues (especially
{{runCommand()}}. These workarounds don't matter, so can be purged
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
-
To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-dev-h...@hadoop.apache.org
[jira] [Resolved] (HADOOP-15511) ITestS3GuardListConsistency#testRollingRenames bad parameters passed to doTestRenameSequence
[
https://issues.apache.org/jira/browse/HADOOP-15511?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Gabor Bota resolved HADOOP-15511.
-
Resolution: Not A Problem
Sorry for the noise on this, as it turns out the test is working as expected.
The following happens:
* Tests a circular sequence of renames to verify that overwriting recently
* deleted files and reading recently created files from rename operations
* works as expected.
The first check of the directory (the first doTestRenameSequence) won't check
anything, but the followups are working as expected.
> ITestS3GuardListConsistency#testRollingRenames bad parameters passed to
> doTestRenameSequence
>
>
> Key: HADOOP-15511
> URL: https://issues.apache.org/jira/browse/HADOOP-15511
> Project: Hadoop Common
> Issue Type: Sub-task
>Affects Versions: 3.1.0
>Reporter: Gabor Bota
>Assignee: Gabor Bota
>Priority: Major
>
> Bumped into this while working on HADOOP-15423.
> Currently the parameters passed to doTestRenameSequence are the following:
> {noformat}
> mkdirs: s3a://cloudera-dev-gabor-ireland/test/rolling/2
> srcdirs: s3a://cloudera-dev-gabor-ireland/test/rolling/2
> dstdirs: s3a://cloudera-dev-gabor-ireland/test/rolling/3
> yesdirs: s3a://cloudera-dev-gabor-ireland/test/rolling/3
> nodirs: s3a://cloudera-dev-gabor-ireland/test/rolling/1
> mkdirs: {}
> srcdirs: s3a://cloudera-dev-gabor-ireland/test/rolling/3
> dstdirs: s3a://cloudera-dev-gabor-ireland/test/rolling/1
> yesdirs: s3a://cloudera-dev-gabor-ireland/test/rolling/1
> nodirs: s3a://cloudera-dev-gabor-ireland/test/rolling/2
> mkdirs: {}
> srcdirs: s3a://cloudera-dev-gabor-ireland/test/rolling/1
> dstdirs: s3a://cloudera-dev-gabor-ireland/test/rolling/2
> yesdirs: s3a://cloudera-dev-gabor-ireland/test/rolling/2
> nodirs: s3a://cloudera-dev-gabor-ireland/test/rolling/3
> mkdirs: {}
> srcdirs: s3a://cloudera-dev-gabor-ireland/test/rolling/2
> dstdirs: s3a://cloudera-dev-gabor-ireland/test/rolling/3
> yesdirs: s3a://cloudera-dev-gabor-ireland/test/rolling/3
> nodirs: s3a://cloudera-dev-gabor-ireland/test/rolling/1
> mkdirs: {}
> srcdirs: s3a://cloudera-dev-gabor-ireland/test/rolling/3
> dstdirs: s3a://cloudera-dev-gabor-ireland/test/rolling/1
> yesdirs: s3a://cloudera-dev-gabor-ireland/test/rolling/1
> nodirs: s3a://cloudera-dev-gabor-ireland/test/rolling/2
> mkdirs: {}
> srcdirs: s3a://cloudera-dev-gabor-ireland/test/rolling/1
> dstdirs: s3a://cloudera-dev-gabor-ireland/test/rolling/2
> yesdirs: s3a://cloudera-dev-gabor-ireland/test/rolling/2
> nodirs: s3a://cloudera-dev-gabor-ireland/test/rolling/3
> {noformat}
> The problem is that we should check that the srcdir is moved to dstdirs, so
> it should be check in nodirs. Right now nodirs parameter checks for
> directories which are completely unrelated to the cases, so this part of the
> test should be fixed to check for dirs that are related to the cases.
> Basically the nodirs should be equal to srcdirs in this case.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
-
To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-dev-h...@hadoop.apache.org
Apache Hadoop qbt Report: trunk+JDK8 on Linux/x86
For more details, see https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/801/ [Jun 3, 2018 3:12:35 AM] (inigoiri) HDFS-13651. TestReencryptionHandler fails on Windows. Contributed by [Jun 3, 2018 3:19:59 AM] (inigoiri) HDFS-13648. Fix TestGetConf#testGetJournalNodes on Windows due to a [Jun 3, 2018 3:25:42 AM] (inigoiri) MAPREDUCE-7102. Fix TestJavaSerialization for Windows due a mismatch [Jun 3, 2018 6:38:26 PM] (sunilg) YARN-8276. [UI2] After version field became mandatory, form-based -1 overall The following subsystems voted -1: asflicense findbugs pathlen unit xml The following subsystems voted -1 but were configured to be filtered/ignored: cc checkstyle javac javadoc pylint shellcheck shelldocs whitespace The following subsystems are considered long running: (runtime bigger than 1h 0m 0s) unit Specific tests: FindBugs : module:hadoop-hdds/common Found reliance on default encoding in org.apache.hadoop.utils.MetadataKeyFilters$KeyPrefixFilter.filterKey(byte[], byte[], byte[]):in org.apache.hadoop.utils.MetadataKeyFilters$KeyPrefixFilter.filterKey(byte[], byte[], byte[]): String.getBytes() At MetadataKeyFilters.java:[line 97] Failed junit tests : hadoop.hdfs.web.TestWebHdfsTimeouts hadoop.yarn.client.api.impl.TestAMRMProxy hadoop.yarn.server.timelineservice.storage.TestHBaseTimelineStorageEntities hadoop.yarn.server.timelineservice.reader.TestTimelineReaderWebServicesHBaseStorage hadoop.yarn.server.timelineservice.storage.TestHBaseTimelineStorageDomain hadoop.yarn.server.timelineservice.storage.flow.TestHBaseStorageFlowRunCompaction hadoop.yarn.server.timelineservice.storage.TestHBaseTimelineStorageSchema hadoop.yarn.server.timelineservice.storage.flow.TestHBaseStorageFlowRun hadoop.yarn.server.timelineservice.storage.TestHBaseTimelineStorageApps hadoop.yarn.server.timelineservice.storage.flow.TestHBaseStorageFlowActivity hadoop.yarn.applications.distributedshell.TestDistributedShell cc: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/801/artifact/out/diff-compile-cc-root.txt [4.0K] javac: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/801/artifact/out/diff-compile-javac-root.txt [336K] checkstyle: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/801/artifact/out/diff-checkstyle-root.txt [17M] pathlen: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/801/artifact/out/pathlen.txt [12K] pylint: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/801/artifact/out/diff-patch-pylint.txt [24K] shellcheck: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/801/artifact/out/diff-patch-shellcheck.txt [20K] shelldocs: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/801/artifact/out/diff-patch-shelldocs.txt [16K] whitespace: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/801/artifact/out/whitespace-eol.txt [9.4M] https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/801/artifact/out/whitespace-tabs.txt [1.1M] xml: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/801/artifact/out/xml.txt [4.0K] findbugs: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/801/artifact/out/branch-findbugs-hadoop-hdds_client.txt [56K] https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/801/artifact/out/branch-findbugs-hadoop-hdds_common-warnings.html [8.0K] https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/801/artifact/out/branch-findbugs-hadoop-hdds_container-service.txt [52K] https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/801/artifact/out/branch-findbugs-hadoop-hdds_server-scm.txt [56K] https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/801/artifact/out/branch-findbugs-hadoop-hdds_tools.txt [12K] https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/801/artifact/out/branch-findbugs-hadoop-ozone_client.txt [4.0K] https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/801/artifact/out/branch-findbugs-hadoop-ozone_common.txt [24K] https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/801/artifact/out/branch-findbugs-hadoop-ozone_objectstore-service.txt [4.0K] https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/801/artifact/out/branch-findbugs-hadoop-ozone_ozone-manager.txt [4.0K] https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/801/artifact/out/branch-findbugs-hadoop-ozone_tools.txt [4.0K] https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/801/artifact/out/branch-findbugs-hadoop-tools_hadoop-ozone.txt [8.0K] javadoc:
[jira] [Created] (HADOOP-15511) ITestS3GuardListConsistency#testRollingRenames bad parameters passed to doTestRenameSequence doTestRenameSequence
Gabor Bota created HADOOP-15511:
---
Summary: ITestS3GuardListConsistency#testRollingRenames bad
parameters passed to doTestRenameSequence doTestRenameSequence
Key: HADOOP-15511
URL: https://issues.apache.org/jira/browse/HADOOP-15511
Project: Hadoop Common
Issue Type: Sub-task
Reporter: Gabor Bota
Assignee: Gabor Bota
Bumped into this while working on HADOOP-15423.
Currently the parameters passed to doTestRenameSequence are the following:
{noformat}
mkdirs: s3a://cloudera-dev-gabor-ireland/test/rolling/2
srcdirs: s3a://cloudera-dev-gabor-ireland/test/rolling/2
dstdirs: s3a://cloudera-dev-gabor-ireland/test/rolling/3
yesdirs: s3a://cloudera-dev-gabor-ireland/test/rolling/3
nodirs: s3a://cloudera-dev-gabor-ireland/test/rolling/1
mkdirs: {}
srcdirs: s3a://cloudera-dev-gabor-ireland/test/rolling/3
dstdirs: s3a://cloudera-dev-gabor-ireland/test/rolling/1
yesdirs: s3a://cloudera-dev-gabor-ireland/test/rolling/1
nodirs: s3a://cloudera-dev-gabor-ireland/test/rolling/2
mkdirs: {}
srcdirs: s3a://cloudera-dev-gabor-ireland/test/rolling/1
dstdirs: s3a://cloudera-dev-gabor-ireland/test/rolling/2
yesdirs: s3a://cloudera-dev-gabor-ireland/test/rolling/2
nodirs: s3a://cloudera-dev-gabor-ireland/test/rolling/3
mkdirs: {}
srcdirs: s3a://cloudera-dev-gabor-ireland/test/rolling/2
dstdirs: s3a://cloudera-dev-gabor-ireland/test/rolling/3
yesdirs: s3a://cloudera-dev-gabor-ireland/test/rolling/3
nodirs: s3a://cloudera-dev-gabor-ireland/test/rolling/1
mkdirs: {}
srcdirs: s3a://cloudera-dev-gabor-ireland/test/rolling/3
dstdirs: s3a://cloudera-dev-gabor-ireland/test/rolling/1
yesdirs: s3a://cloudera-dev-gabor-ireland/test/rolling/1
nodirs: s3a://cloudera-dev-gabor-ireland/test/rolling/2
mkdirs: {}
srcdirs: s3a://cloudera-dev-gabor-ireland/test/rolling/1
dstdirs: s3a://cloudera-dev-gabor-ireland/test/rolling/2
yesdirs: s3a://cloudera-dev-gabor-ireland/test/rolling/2
nodirs: s3a://cloudera-dev-gabor-ireland/test/rolling/3
{noformat}
The problem is that we should check that the srcdir is moved to dstdirs, so it
should be check in nodirs. Right now nodirs parameter checks for directories
which are completely unrelated to the cases, so this part of the test should be
fixed to check for dirs that are related to the cases. Basically the nodirs
should be equal to srcdirs in this case.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
-
To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-dev-h...@hadoop.apache.org
