date:20210611

Apache Hadoop qbt Report: trunk+JDK11 on Linux/x86_64

2021-06-11 Thread Apache Jenkins Server

For more details, see 
https://ci-hadoop.apache.org/job/hadoop-qbt-trunk-java11-linux-x86_64/183/

[Jun 9, 2021 5:24:10 AM] (noreply) HADOOP-17715 ABFS: Append blob tests with 
non HNS accounts fail (#3028)
[Jun 9, 2021 6:12:48 AM] (noreply) HDFS-16054. Replace Guava Lists usage by 
Hadoop's own Lists in hadoop-hdfs-project (#3073)
[Jun 9, 2021 6:15:47 AM] (noreply) YARN-10805. Replace Guava Lists usage by 
Hadoop's own Lists in hadoop-yarn-project (#3075)
[Jun 9, 2021 6:32:07 AM] (noreply) HADOOP-17750. Fix asf license errors in 
newly added files by HADOOP-17727. (#3083)
[Jun 10, 2021 5:29:47 AM] (noreply) YARN-10803. [JDK 11] 
TestRMFailoverProxyProvider and TestNoHaRMFailoverProxyProvider fails by 
ClassCastException. (#3068)
[Jun 11, 2021 3:15:52 AM] (noreply) HADOOP-17753. Keep 
restrict-imports-enforcer-rule for Guava Lists in top level hadoop-main pom 
(#3087)




-1 overall


The following subsystems voted -1:
blanks mvnsite pathlen spotbugs unit xml


The following subsystems voted -1 but
were configured to be filtered/ignored:
cc checkstyle javac javadoc pylint shellcheck


The following subsystems are considered long running:
(runtime bigger than 1h  0m  0s)
unit


Specific tests:

XML :

   Parsing Error(s): 
   
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/test/resources/nvidia-smi-output-excerpt.xml
 
   
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/test/resources/nvidia-smi-output-missing-tags.xml
 
   
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/test/resources/nvidia-smi-output-missing-tags2.xml
 
   
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/test/resources/nvidia-smi-sample-output.xml
 
   
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/resources/fair-scheduler-invalid.xml
 
   
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/resources/yarn-site-with-invalid-allocation-file-ref.xml
 

spotbugs :

   module:hadoop-hdfs-project/hadoop-hdfs 
   Redundant nullcheck of oldLock, which is known to be non-null in 
org.apache.hadoop.hdfs.server.datanode.DataStorage.isPreUpgradableLayout(Storage$StorageDirectory)
 Redundant null check at DataStorage.java:is known to be non-null in 
org.apache.hadoop.hdfs.server.datanode.DataStorage.isPreUpgradableLayout(Storage$StorageDirectory)
 Redundant null check at DataStorage.java:[line 695] 
   
org.apache.hadoop.hdfs.server.namenode.top.window.RollingWindowManager$UserCounts
 doesn't override java.util.ArrayList.equals(Object) At 
RollingWindowManager.java:At RollingWindowManager.java:[line 1] 

spotbugs :

   module:hadoop-yarn-project/hadoop-yarn 
   Redundant nullcheck of it, which is known to be non-null in 
org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService.recoverTrackerResources(LocalResourcesTracker,
 NMStateStoreService$LocalResourceTrackerState) Redundant null check at 
ResourceLocalizationService.java:is known to be non-null in 
org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService.recoverTrackerResources(LocalResourcesTracker,
 NMStateStoreService$LocalResourceTrackerState) Redundant null check at 
ResourceLocalizationService.java:[line 343] 
   Redundant nullcheck of it, which is known to be non-null in 
org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService.recoverTrackerResources(LocalResourcesTracker,
 NMStateStoreService$LocalResourceTrackerState) Redundant null check at 
ResourceLocalizationService.java:is known to be non-null in 
org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService.recoverTrackerResources(LocalResourcesTracker,
 NMStateStoreService$LocalResourceTrackerState) Redundant null check at 
ResourceLocalizationService.java:[line 356] 
   Boxed value is unboxed and then immediately reboxed in 
org.apache.hadoop.yarn.server.timelineservice.storage.common.ColumnRWHelper.readResultsWithTimestamps(Result,
 byte[], byte[], KeyConverter, ValueConverter, boolean) At 
ColumnRWHelper.java:then immediately reboxed in 
org.apache.hadoop.yarn.server.timelineservice.storage.common.ColumnRWHelper.readResultsWithTimestamps(Result,
 byte[], byte[], KeyConverter, ValueConverter, boolean) At 
ColumnRWHelper.java:[line 333] 

spotbugs :

   module:hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server 
   Redundant nullcheck of it, which is known to be non-null in 
org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService.recoverTrackerResources(LocalResourcesTracker,
 NMStateStoreService$LocalResourceTrackerState) Redundant null check at 
ResourceLocalizationService.java:is known to be

Apache Hadoop qbt Report: branch-2.10+JDK7 on Linux/x86_64

2021-06-11 Thread Apache Jenkins Server

For more details, see 
https://ci-hadoop.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86_64/327/

No changes


ERROR: File 'out/email-report.txt' does not exist

-
To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-dev-h...@hadoop.apache.org

Apache Hadoop qbt Report: trunk+JDK8 on Linux/x86_64

2021-06-11 Thread Apache Jenkins Server

For more details, see 
https://ci-hadoop.apache.org/job/hadoop-qbt-trunk-java8-linux-x86_64/535/

[Jun 10, 2021 5:29:47 AM] (noreply) YARN-10803. [JDK 11] 
TestRMFailoverProxyProvider and TestNoHaRMFailoverProxyProvider fails by 
ClassCastException. (#3068)




-1 overall


The following subsystems voted -1:
blanks pathlen unit xml


The following subsystems voted -1 but
were configured to be filtered/ignored:
cc checkstyle javac javadoc pylint shellcheck


The following subsystems are considered long running:
(runtime bigger than 1h  0m  0s)
unit


Specific tests:

XML :

   Parsing Error(s): 
   
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/test/resources/nvidia-smi-output-excerpt.xml
 
   
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/test/resources/nvidia-smi-output-missing-tags.xml
 
   
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/test/resources/nvidia-smi-output-missing-tags2.xml
 
   
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/test/resources/nvidia-smi-sample-output.xml
 
   
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/resources/fair-scheduler-invalid.xml
 
   
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/resources/yarn-site-with-invalid-allocation-file-ref.xml
 

Failed junit tests :

   hadoop.yarn.csi.client.TestCsiClient 
   hadoop.tools.dynamometer.TestDynamometerInfra 
   hadoop.tools.dynamometer.TestDynamometerInfra 
  

   cc:

  
https://ci-hadoop.apache.org/job/hadoop-qbt-trunk-java8-linux-x86_64/535/artifact/out/results-compile-cc-root.txt
 [96K]

   javac:

  
https://ci-hadoop.apache.org/job/hadoop-qbt-trunk-java8-linux-x86_64/535/artifact/out/results-compile-javac-root.txt
 [376K]

   blanks:

  
https://ci-hadoop.apache.org/job/hadoop-qbt-trunk-java8-linux-x86_64/535/artifact/out/blanks-eol.txt
 [13M]
  
https://ci-hadoop.apache.org/job/hadoop-qbt-trunk-java8-linux-x86_64/535/artifact/out/blanks-tabs.txt
 [2.0M]

   checkstyle:

  
https://ci-hadoop.apache.org/job/hadoop-qbt-trunk-java8-linux-x86_64/535/artifact/out/results-checkstyle-root.txt
 [16M]

   pathlen:

  
https://ci-hadoop.apache.org/job/hadoop-qbt-trunk-java8-linux-x86_64/535/artifact/out/results-pathlen.txt
 [16K]

   pylint:

  
https://ci-hadoop.apache.org/job/hadoop-qbt-trunk-java8-linux-x86_64/535/artifact/out/results-pylint.txt
 [20K]

   shellcheck:

  
https://ci-hadoop.apache.org/job/hadoop-qbt-trunk-java8-linux-x86_64/535/artifact/out/results-shellcheck.txt
 [28K]

   xml:

  
https://ci-hadoop.apache.org/job/hadoop-qbt-trunk-java8-linux-x86_64/535/artifact/out/xml.txt
 [24K]

   javadoc:

  
https://ci-hadoop.apache.org/job/hadoop-qbt-trunk-java8-linux-x86_64/535/artifact/out/results-javadoc-javadoc-root.txt
 [408K]

   unit:

  
https://ci-hadoop.apache.org/job/hadoop-qbt-trunk-java8-linux-x86_64/535/artifact/out/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-csi.txt
 [20K]
  
https://ci-hadoop.apache.org/job/hadoop-qbt-trunk-java8-linux-x86_64/535/artifact/out/patch-unit-hadoop-tools_hadoop-dynamometer_hadoop-dynamometer-infra.txt
 [12K]
  
https://ci-hadoop.apache.org/job/hadoop-qbt-trunk-java8-linux-x86_64/535/artifact/out/patch-unit-hadoop-tools_hadoop-dynamometer.txt
 [24K]

Powered by Apache Yetus 0.14.0-SNAPSHOT   https://yetus.apache.org

-
To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-dev-h...@hadoop.apache.org

Re: [VOTE] Release Apache Hadoop 3.3.1 RC3

2021-06-11 Thread epa...@apache.org

+1 (binding)
Eric


   On Tuesday, June 1, 2021, 5:29:49 AM CDT, Wei-Chiu Chuang 
 wrote:  
 
 Hi community,

This is the release candidate RC3 of Apache Hadoop 3.3.1 line. All blocker
issues have been resolved [1] again.

There are 2 additional issues resolved for RC3:
* Revert "MAPREDUCE-7303. Fix TestJobResourceUploader failures after
HADOOP-16878
* Revert "HADOOP-16878. FileUtil.copy() to throw IOException if the source
and destination are the same

There are 4 issues resolved for RC2:
* HADOOP-17666. Update LICENSE for 3.3.1
* MAPREDUCE-7348. TestFrameworkUploader#testNativeIO fails. (#3053)
* Revert "HADOOP-17563. Update Bouncy Castle to 1.68. (#2740)" (#3055)
* HADOOP-17739. Use hadoop-thirdparty 1.1.1. (#3064)

The Hadoop-thirdparty 1.1.1, as previously mentioned, contains two extra
fixes compared to hadoop-thirdparty 1.1.0:
* HADOOP-17707. Remove jaeger document from site index.
* HADOOP-17730. Add back error_prone

*RC tag is release-3.3.1-RC3
https://github.com/apache/hadoop/releases/tag/release-3.3.1-RC3

*The RC3 artifacts are at*:
https://home.apache.org/~weichiu/hadoop-3.3.1-RC3/
ARM artifacts: https://home.apache.org/~weichiu/hadoop-3.3.1-RC3-arm/

*The maven artifacts are hosted here:*
https://repository.apache.org/content/repositories/orgapachehadoop-1320/

*My public key is available here:*
https://dist.apache.org/repos/dist/release/hadoop/common/KEYS


Things I've verified:
* all blocker issues targeting 3.3.1 have been resolved.
* stable/evolving API changes between 3.3.0 and 3.3.1 are compatible.
* LICENSE and NOTICE files checked
* RELEASENOTES and CHANGELOG
* rat check passed.
* Built HBase master branch on top of Hadoop 3.3.1 RC2, ran unit tests.
* Built Ozone master on top fo Hadoop 3.3.1 RC2, ran unit tests.
* Extra: built 50 other open source projects on top of Hadoop 3.3.1 RC2.
Had to patch some of them due to commons-lang migration (Hadoop 3.2.0) and
dependency divergence. Issues are being identified but so far nothing
blocker for Hadoop itself.

Please try the release and vote. The vote will run for 5 days.

My +1 to start,

[1] https://issues.apache.org/jira/issues/?filter=12350491
[2]
https://github.com/apache/hadoop/compare/release-3.3.1-RC1...release-3.3.1-RC3

Re: Building 3.2.2 -- hadoop-client-check-test-invariants failing on edu.umd.cs.findbugs

2021-06-11 Thread Bryan Beaudreault

Actually now that you mention it, I see someone already created such an
issue in 2019. https://issues.apache.org/jira/browse/ZOOKEEPER-3367. I'm
guessing it's gotten no attention because 3.4 is EOL. Not sure if this
persists in later versions.

I actually would like to update the zookeeper version beyond 3.4, but
unfortunately there are compile time issues that came into play when i
tried that. That's probably a convo for a different thread though. For now
I think I'm ok compiling against 3.4.13.

Thanks!

On Fri, Jun 11, 2021 at 1:54 PM Sean Busbey  wrote:

> If you want to update to that zookeeper version then you should update the
> build files to exclude those classes from getting included transitively
> from it.
>
> Would you mind filing a bug against zookeeper as well?
> spotbugs-annotations 3.1.9 is LGPL, so they should not be exposing it as a
> downstream transitive dependency.
>
>
>
> > On Jun 11, 2021, at 12:47 PM, Bryan Beaudreault
>  wrote:
> >
> > Ok sorry, false alarm. I figured this out by cleaning out my .m2
> > repository, re-building just hadoop-client-minicluster, and then
> iterating
> > all resulting jars in the .m2 using jar -tf with grep to find which jar
> was
> > providing these classes. Turns out it was
> > com.github.spotbugs:spotbugs-annotations:jar:3.1.9, which I could then
> see
> > in dependency:tree as coming from zookeeper 3.4.14. My build environment
> > was setting the zookeeper.version property to 3.4.14, and it seems like
> > this was a new dependency added between the hadoop-default version of
> > 3.4.13 and 14.
> >
> > The build works with 3.4.13, so now I can decide whether to use that
> > version or update the invariant check accordingly.
> >
> > On Fri, Jun 11, 2021 at 1:23 PM Bryan Beaudreault <
> bbeaudrea...@hubspot.com>
> > wrote:
> >
> >> Hey all,
> >>
> >> I'm trying to build hadoop from source. I've checked out the
> >> rel/release-3.2.2 tag from github.com/apache/hadoop
> .
> The maven build gets
> >> most of the way through, but fails on
> hadoop-client-check-test-invariants
> >> with the following error:
> >>
> >> [ERROR] Found artifact with unexpected contents:
> >>
> '/hadoop/rpm/scratch/BUILD/hadoop-3.2.2-src/hadoop-client-modules/hadoop-client-minicluster/target/hadoop-client-minicluster-3.2.2.jar'
> >> Please check the following and either correct the build or update
> >> the allowed list with reasoning.
> >>
> >> edu/
> >> edu/umd/
> >> edu/umd/cs/
> >> edu/umd/cs/findbugs/
> >> edu/umd/cs/findbugs/annotations/
> >> edu/umd/cs/findbugs/annotations/NonNull.class
> >> ... snip (there's more classes in this package) ...
> >>
> >> I know I could modify the shell script to allow this, or I could try to
> >> modify the pom to exclude it. But it seems weird that I'm hitting this
> at
> >> all. I have not made any changes to the source yet.
> >>
> >> Has anyone else hit this or have any idea why it's happening? I can't
> find
> >> any reference to "edu/umd" or "edu.umd" in the source. I'm guessing it's
> >> coming from a transitive dependency, but I tried running mvn
> >> dependency:tree and did not see any mention of this version of findbugs.
> >>
> >> Thanks!
> >>
>
>

Re: Building 3.2.2 -- hadoop-client-check-test-invariants failing on edu.umd.cs.findbugs

2021-06-11 Thread Sean Busbey

If you want to update to that zookeeper version then you should update the 
build files to exclude those classes from getting included transitively from it.

Would you mind filing a bug against zookeeper as well? spotbugs-annotations 
3.1.9 is LGPL, so they should not be exposing it as a downstream transitive 
dependency.



> On Jun 11, 2021, at 12:47 PM, Bryan Beaudreault 
>  wrote:
> 
> Ok sorry, false alarm. I figured this out by cleaning out my .m2
> repository, re-building just hadoop-client-minicluster, and then iterating
> all resulting jars in the .m2 using jar -tf with grep to find which jar was
> providing these classes. Turns out it was
> com.github.spotbugs:spotbugs-annotations:jar:3.1.9, which I could then see
> in dependency:tree as coming from zookeeper 3.4.14. My build environment
> was setting the zookeeper.version property to 3.4.14, and it seems like
> this was a new dependency added between the hadoop-default version of
> 3.4.13 and 14.
> 
> The build works with 3.4.13, so now I can decide whether to use that
> version or update the invariant check accordingly.
> 
> On Fri, Jun 11, 2021 at 1:23 PM Bryan Beaudreault 
> wrote:
> 
>> Hey all,
>> 
>> I'm trying to build hadoop from source. I've checked out the
>> rel/release-3.2.2 tag from github.com/apache/hadoop. The maven build gets
>> most of the way through, but fails on hadoop-client-check-test-invariants
>> with the following error:
>> 
>> [ERROR] Found artifact with unexpected contents:
>> '/hadoop/rpm/scratch/BUILD/hadoop-3.2.2-src/hadoop-client-modules/hadoop-client-minicluster/target/hadoop-client-minicluster-3.2.2.jar'
>>   Please check the following and either correct the build or update
>>   the allowed list with reasoning.
>> 
>>   edu/
>>   edu/umd/
>>   edu/umd/cs/
>>   edu/umd/cs/findbugs/
>>   edu/umd/cs/findbugs/annotations/
>>   edu/umd/cs/findbugs/annotations/NonNull.class
>>   ... snip (there's more classes in this package) ...
>> 
>> I know I could modify the shell script to allow this, or I could try to
>> modify the pom to exclude it. But it seems weird that I'm hitting this at
>> all. I have not made any changes to the source yet.
>> 
>> Has anyone else hit this or have any idea why it's happening? I can't find
>> any reference to "edu/umd" or "edu.umd" in the source. I'm guessing it's
>> coming from a transitive dependency, but I tried running mvn
>> dependency:tree and did not see any mention of this version of findbugs.
>> 
>> Thanks!
>> 



-
To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-dev-h...@hadoop.apache.org

Re: Building 3.2.2 -- hadoop-client-check-test-invariants failing on edu.umd.cs.findbugs

2021-06-11 Thread Bryan Beaudreault

Ok sorry, false alarm. I figured this out by cleaning out my .m2
repository, re-building just hadoop-client-minicluster, and then iterating
all resulting jars in the .m2 using jar -tf with grep to find which jar was
providing these classes. Turns out it was
com.github.spotbugs:spotbugs-annotations:jar:3.1.9, which I could then see
in dependency:tree as coming from zookeeper 3.4.14. My build environment
was setting the zookeeper.version property to 3.4.14, and it seems like
this was a new dependency added between the hadoop-default version of
3.4.13 and 14.

The build works with 3.4.13, so now I can decide whether to use that
version or update the invariant check accordingly.

On Fri, Jun 11, 2021 at 1:23 PM Bryan Beaudreault 
wrote:

> Hey all,
>
> I'm trying to build hadoop from source. I've checked out the
> rel/release-3.2.2 tag from github.com/apache/hadoop. The maven build gets
> most of the way through, but fails on hadoop-client-check-test-invariants
> with the following error:
>
> [ERROR] Found artifact with unexpected contents:
> '/hadoop/rpm/scratch/BUILD/hadoop-3.2.2-src/hadoop-client-modules/hadoop-client-minicluster/target/hadoop-client-minicluster-3.2.2.jar'
> Please check the following and either correct the build or update
> the allowed list with reasoning.
>
> edu/
> edu/umd/
> edu/umd/cs/
> edu/umd/cs/findbugs/
> edu/umd/cs/findbugs/annotations/
> edu/umd/cs/findbugs/annotations/NonNull.class
> ... snip (there's more classes in this package) ...
>
> I know I could modify the shell script to allow this, or I could try to
> modify the pom to exclude it. But it seems weird that I'm hitting this at
> all. I have not made any changes to the source yet.
>
> Has anyone else hit this or have any idea why it's happening? I can't find
> any reference to "edu/umd" or "edu.umd" in the source. I'm guessing it's
> coming from a transitive dependency, but I tried running mvn
> dependency:tree and did not see any mention of this version of findbugs.
>
> Thanks!
>

Building 3.2.2 -- hadoop-client-check-test-invariants failing on edu.umd.cs.findbugs

2021-06-11 Thread Bryan Beaudreault

Hey all,

I'm trying to build hadoop from source. I've checked out the
rel/release-3.2.2 tag from github.com/apache/hadoop. The maven build gets
most of the way through, but fails on hadoop-client-check-test-invariants
with the following error:

[ERROR] Found artifact with unexpected contents:
'/hadoop/rpm/scratch/BUILD/hadoop-3.2.2-src/hadoop-client-modules/hadoop-client-minicluster/target/hadoop-client-minicluster-3.2.2.jar'
Please check the following and either correct the build or update
the allowed list with reasoning.

edu/
edu/umd/
edu/umd/cs/
edu/umd/cs/findbugs/
edu/umd/cs/findbugs/annotations/
edu/umd/cs/findbugs/annotations/NonNull.class
... snip (there's more classes in this package) ...

I know I could modify the shell script to allow this, or I could try to
modify the pom to exclude it. But it seems weird that I'm hitting this at
all. I have not made any changes to the source yet.

Has anyone else hit this or have any idea why it's happening? I can't find
any reference to "edu/umd" or "edu.umd" in the source. I'm guessing it's
coming from a transitive dependency, but I tried running mvn
dependency:tree and did not see any mention of this version of findbugs.

Thanks!

Apache Hadoop qbt Report: branch-2.10+JDK7 on Linux/x86_64

2021-06-11 Thread Apache Jenkins Server

For more details, see 
https://ci-hadoop.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86_64/326/

No changes




-1 overall


The following subsystems voted -1:
asflicense hadolint mvnsite pathlen unit


The following subsystems voted -1 but
were configured to be filtered/ignored:
cc checkstyle javac javadoc pylint shellcheck shelldocs whitespace


The following subsystems are considered long running:
(runtime bigger than 1h  0m  0s)
unit


Specific tests:

Failed junit tests :

   hadoop.fs.TestFileUtil 
   hadoop.crypto.key.kms.server.TestKMS 
   hadoop.hdfs.qjournal.server.TestJournalNodeRespectsBindHostKeys 
   hadoop.hdfs.server.namenode.ha.TestRetryCacheWithHA 
   hadoop.hdfs.server.datanode.TestBlockRecovery 
   
hadoop.hdfs.server.blockmanagement.TestReplicationPolicyWithUpgradeDomain 
   hadoop.contrib.bkjournal.TestBookKeeperHACheckpoints 
   hadoop.contrib.bkjournal.TestBookKeeperHACheckpoints 
   hadoop.hdfs.server.federation.router.TestRouterQuota 
   hadoop.hdfs.server.federation.router.TestRouterNamenodeHeartbeat 
   hadoop.hdfs.server.federation.resolver.order.TestLocalResolver 
   hadoop.hdfs.server.federation.resolver.TestMultipleDestinationResolver 
   
hadoop.yarn.server.resourcemanager.monitor.invariants.TestMetricsInvariantChecker
 
   hadoop.yarn.server.resourcemanager.TestClientRMService 
   hadoop.mapreduce.jobhistory.TestHistoryViewerPrinter 
   hadoop.tools.TestDistCpSystem 
   hadoop.yarn.sls.TestSLSRunner 
   hadoop.resourceestimator.service.TestResourceEstimatorService 
   hadoop.resourceestimator.solver.impl.TestLpSolver 
  

   cc:

   
https://ci-hadoop.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86_64/326/artifact/out/diff-compile-cc-root.txt
  [4.0K]

   javac:

   
https://ci-hadoop.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86_64/326/artifact/out/diff-compile-javac-root.txt
  [496K]

   checkstyle:

   
https://ci-hadoop.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86_64/326/artifact/out/diff-checkstyle-root.txt
  [16M]

   hadolint:

   
https://ci-hadoop.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86_64/326/artifact/out/diff-patch-hadolint.txt
  [4.0K]

   mvnsite:

   
https://ci-hadoop.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86_64/326/artifact/out/patch-mvnsite-root.txt
  [584K]

   pathlen:

   
https://ci-hadoop.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86_64/326/artifact/out/pathlen.txt
  [12K]

   pylint:

   
https://ci-hadoop.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86_64/326/artifact/out/diff-patch-pylint.txt
  [48K]

   shellcheck:

   
https://ci-hadoop.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86_64/326/artifact/out/diff-patch-shellcheck.txt
  [56K]

   shelldocs:

   
https://ci-hadoop.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86_64/326/artifact/out/diff-patch-shelldocs.txt
  [48K]

   whitespace:

   
https://ci-hadoop.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86_64/326/artifact/out/whitespace-eol.txt
  [12M]
   
https://ci-hadoop.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86_64/326/artifact/out/whitespace-tabs.txt
  [1.3M]

   javadoc:

   
https://ci-hadoop.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86_64/326/artifact/out/diff-javadoc-javadoc-root.txt
  [20K]

   unit:

   
https://ci-hadoop.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86_64/326/artifact/out/patch-unit-hadoop-common-project_hadoop-common.txt
  [232K]
   
https://ci-hadoop.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86_64/326/artifact/out/patch-unit-hadoop-common-project_hadoop-kms.txt
  [48K]
   
https://ci-hadoop.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86_64/326/artifact/out/patch-unit-hadoop-hdfs-project_hadoop-hdfs.txt
  [556K]
   
https://ci-hadoop.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86_64/326/artifact/out/patch-unit-hadoop-hdfs-project_hadoop-hdfs_src_contrib_bkjournal.txt
  [12K]
   
https://ci-hadoop.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86_64/326/artifact/out/patch-unit-hadoop-hdfs-project_hadoop-hdfs-rbf.txt
  [40K]
   
https://ci-hadoop.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86_64/326/artifact/out/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-resourcemanager.txt
  [112K]
   
https://ci-hadoop.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86_64/326/artifact/out/patch-unit-hadoop-mapreduce-project_hadoop-mapreduce-client_hadoop-mapreduce-client-core.txt
  [96K]
   
https://ci-hadoop.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86_64/326/artifact/out/patch-unit-hadoop-mapreduce-project_hadoop-mapreduce-client_hadoop-mapreduce-client-jobclient.txt
  [104K]

[jira] [Created] (HADOOP-17760) Delete hadoop.ssl.enabled and dfs.https.enable from docs and core-default.xml

2021-06-11 Thread Takanobu Asanuma (Jira)

Takanobu Asanuma created HADOOP-17760:
-

 Summary: Delete hadoop.ssl.enabled and dfs.https.enable from docs 
and core-default.xml
 Key: HADOOP-17760
 URL: https://issues.apache.org/jira/browse/HADOOP-17760
 Project: Hadoop Common
  Issue Type: Bug
  Components: documentation
Reporter: Takanobu Asanuma
Assignee: Takanobu Asanuma


{{hadoop.ssl.enabled}} and {{dfs.https.enable}} were removed from hadoop-3 by 
HADOOP-10348. They are not deprecated.
https://github.com/apache/hadoop/commit/8b196816d8de638aaab0294249e560303fd92b7a

Let's remove them from docs and core-default.xml.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

-
To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-dev-h...@hadoop.apache.org

[jira] [Reopened] (HADOOP-17728) Deadlock in FileSystem StatisticsDataReferenceCleaner cleanUp

2021-06-11 Thread Mingliang Liu (Jira)



 [ 
https://issues.apache.org/jira/browse/HADOOP-17728?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Mingliang Liu reopened HADOOP-17728:


> Deadlock in FileSystem StatisticsDataReferenceCleaner cleanUp
> -
>
> Key: HADOOP-17728
> URL: https://issues.apache.org/jira/browse/HADOOP-17728
> Project: Hadoop Common
>  Issue Type: Bug
>  Components: fs
>Affects Versions: 3.2.1
>Reporter: yikf
>Assignee: yikf
>Priority: Minor
>  Labels: pull-request-available, reverted
>  Time Spent: 5h 10m
>  Remaining Estimate: 0h
>
> Cleaner thread will be blocked if we remove reference from ReferenceQueue 
> unless the `queue.enqueue` called.
> 
>     As shown below, We call ReferenceQueue.remove() now while cleanUp, Call 
> chain as follow：
>                          *StatisticsDataReferenceCleaner#queue.remove()  ->  
> ReferenceQueue.remove(0)  -> lock.wait(0)*
>     But, lock.notifyAll is called when queue.enqueue only, so Cleaner thread 
> will be blocked.
>  
> ThreadDump:
> {code:java}
> "Reference Handler" #2 daemon prio=10 os_prio=0 tid=0x7f7afc088800 
> nid=0x2119 in Object.wait() [0x7f7b0023]
>java.lang.Thread.State: WAITING (on object monitor)
> at java.lang.Object.wait(Native Method)
> - waiting on <0xc00c2f58> (a java.lang.ref.Reference$Lock)
> at java.lang.Object.wait(Object.java:502)
> at java.lang.ref.Reference.tryHandlePending(Reference.java:191)
> - locked <0xc00c2f58> (a java.lang.ref.Reference$Lock)
> at 
> java.lang.ref.Reference$ReferenceHandler.run(Reference.java:153){code}



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

-
To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-dev-h...@hadoop.apache.org

Apache Hadoop qbt Report: trunk+JDK11 on Linux/x86_64

Apache Hadoop qbt Report: branch-2.10+JDK7 on Linux/x86_64

Apache Hadoop qbt Report: trunk+JDK8 on Linux/x86_64

Re: [VOTE] Release Apache Hadoop 3.3.1 RC3

Re: Building 3.2.2 -- hadoop-client-check-test-invariants failing on edu.umd.cs.findbugs

Re: Building 3.2.2 -- hadoop-client-check-test-invariants failing on edu.umd.cs.findbugs

Re: Building 3.2.2 -- hadoop-client-check-test-invariants failing on edu.umd.cs.findbugs

Building 3.2.2 -- hadoop-client-check-test-invariants failing on edu.umd.cs.findbugs

Apache Hadoop qbt Report: branch-2.10+JDK7 on Linux/x86_64

[jira] [Created] (HADOOP-17760) Delete hadoop.ssl.enabled and dfs.https.enable from docs and core-default.xml

[jira] [Reopened] (HADOOP-17728) Deadlock in FileSystem StatisticsDataReferenceCleaner cleanUp

11 matches

Site Navigation

Mail list logo

Footer information