[jira] [Created] (HADOOP-16803) Upgrade jackson-databind to 2.9.10.2

Akira Ajisaka created HADOOP-16803: -- Summary: Upgrade jackson-databind to 2.9.10.2 Key: HADOOP-16803 URL: https://issues.apache.org/jira/browse/HADOOP-16803 Project: Hadoop Common Issue

Re: [DISCUSS] Removal of old hamlet package in 3.3+ or 3.4+

Hi folks, Now I have a strong reason to remove the old hamlet package. There are 1000+ javadoc warnings in the package and they fill the output of the precommit javadoc module. That's why the new warnings and errors are ignored and sometimes they cause build errors. Now I'm investigating why

[jira] [Created] (HADOOP-16802) Javadoc errors are always ignored in the precommit jobs

Akira Ajisaka created HADOOP-16802: -- Summary: Javadoc errors are always ignored in the precommit jobs Key: HADOOP-16802 URL: https://issues.apache.org/jira/browse/HADOOP-16802 Project: Hadoop Common

Apache Hadoop qbt Report: trunk+JDK8 on Linux/x86

For more details, see https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/1381/ [Jan 13, 2020 5:10:29 AM] (github) HADOOP-16797. Add Dockerfile for ARM builds. Contributed by Vinayakumar [Jan 13, 2020 3:50:07 PM] (snemeth) YARN-9989. Typo in CapacityScheduler documentation: Runtime

Re: [DISCUSS] Hadoop 2019 Release Planning

I'm curious about the fate of branch-2.8 and branch-2.9. 2.9.2 is over a year old (released on 11/19/2018) 2.8.5 is over a year old too (released on 9/10/2018) It appears to me most of the development in 2.x is focusing on stabilizing 2.10 and I wonder if there are people still on 2.8/2.9.

Re: Needs support to add more entropy to improve cryptographic randomness on Linux VMs

For testing, it is important to be able to use Random instead of SecureRandom. We should never be using the OS entropy for unit tests. .. Owen On Tue, Jan 14, 2020 at 1:05 PM Ahmed Hussein wrote: > I tried setting JVM option "-Djava.security.egd=file:///dev/./urandom" > from the command line

Re: Needs support to add more entropy to improve cryptographic randomness on Linux VMs

I tried setting JVM option "-Djava.security.egd=file:///dev/./urandom" from the command line but it did not work for me. In my case, I assume the JVM ignores "java.security.egd" because it is considered a security thing. On Tue, Jan 14, 2020 at 1:27 PM István Fajth wrote: > Hi, > > based on

[jira] [Created] (HADOOP-16801) S3Guard queries S3 with recursive file listings

Mustafa Iman created HADOOP-16801: - Summary: S3Guard queries S3 with recursive file listings Key: HADOOP-16801 URL: https://issues.apache.org/jira/browse/HADOOP-16801 Project: Hadoop Common

Re: Needs support to add more entropy to improve cryptographic randomness on Linux VMs

Hi, based on this article, we might not need infra to do this, but we can specify the /dev/urandom as a random source directly to the JVM for test runs with the option: -Djava.security.egd=file:///dev/urandom.

Re: Needs support to add more entropy to improve cryptographic randomness on Linux VMs

You should file an INFRA jira asking about this. They can get in touch with the folks who maintain the Hadoop labeled nodes. On Tue, Jan 14, 2020 at 12:42 PM Ahmed Hussein wrote: > > Hi, > > I was investigating a JUnit test > (MAPREDUCE-7079:TestMRIntermediateDataEncryption > is failing in

Re: Needs support to add more entropy to improve cryptographic randomness on Linux VMs

Thanks for flagging this Ahmed. urandom is a perfectly acceptable option. I am not sure who maintains the pre-commit machines these days. > On Jan 14, 2020, at 10:42 AM, Ahmed Hussein wrote: > > Hi, > > I was investigating a JUnit test > (MAPREDUCE-7079:TestMRIntermediateDataEncryption >

Needs support to add more entropy to improve cryptographic randomness on Linux VMs

Hi, I was investigating a JUnit test (MAPREDUCE-7079:TestMRIntermediateDataEncryption is failing in precommit builds ) that was consistently hanging on Linux VMs and failing Mapreduce pre-builds. I found that the test hangs slows or hangs

[jira] [Created] (HADOOP-16800) ITestDynamoDBMetadataStore.testTableVersioning failure -DDB deleteItem consistency?

Steve Loughran created HADOOP-16800: --- Summary: ITestDynamoDBMetadataStore.testTableVersioning failure -DDB deleteItem consistency? Key: HADOOP-16800 URL: https://issues.apache.org/jira/browse/HADOOP-16800