Re: Needs support to add more entropy to improve cryptographic randomness on Linux VMs

2020-01-22 Thread Ahmed Hussein
It turned out that INFRA was not the right place to file. I created another one HADOOP-16810 suggesting a quick fix for docker. Basically, it requires passing "-v /dev/urandom:/dev/random" to the docker that runs the pre-commit tests. Any idea

Re: Needs support to add more entropy to improve cryptographic randomness on Linux VMs

2020-01-15 Thread Ahmed Hussein
I filed a new Jira INFRA-19730 On Wed, Jan 15, 2020 at 10:58 AM Ahmed Hussein wrote: > > For testing, it is important to be able to use Random instead of >> SecureRandom. We should never be using the OS entropy for unit tests. >> > > Is this

Re: Needs support to add more entropy to improve cryptographic randomness on Linux VMs

2020-01-15 Thread Ahmed Hussein
> For testing, it is important to be able to use Random instead of > SecureRandom. We should never be using the OS entropy for unit tests. > Is this feasible to do? I assume that going that road implies scanning through all objects and classes and override the methods to consume

Re: Needs support to add more entropy to improve cryptographic randomness on Linux VMs

2020-01-14 Thread Owen O'Malley
For testing, it is important to be able to use Random instead of SecureRandom. We should never be using the OS entropy for unit tests. .. Owen On Tue, Jan 14, 2020 at 1:05 PM Ahmed Hussein wrote: > I tried setting JVM option "-Djava.security.egd=file:///dev/./urandom" > from the command line

Re: Needs support to add more entropy to improve cryptographic randomness on Linux VMs

2020-01-14 Thread Ahmed Hussein
I tried setting JVM option "-Djava.security.egd=file:///dev/./urandom" from the command line but it did not work for me. In my case, I assume the JVM ignores "java.security.egd" because it is considered a security thing. On Tue, Jan 14, 2020 at 1:27 PM István Fajth wrote: > Hi, > > based on

Re: Needs support to add more entropy to improve cryptographic randomness on Linux VMs

2020-01-14 Thread István Fajth
Hi, based on this article, we might not need infra to do this, but we can specify the /dev/urandom as a random source directly to the JVM for test runs with the option: -Djava.security.egd=file:///dev/urandom.

Re: Needs support to add more entropy to improve cryptographic randomness on Linux VMs

2020-01-14 Thread Sean Busbey
You should file an INFRA jira asking about this. They can get in touch with the folks who maintain the Hadoop labeled nodes. On Tue, Jan 14, 2020 at 12:42 PM Ahmed Hussein wrote: > > Hi, > > I was investigating a JUnit test > (MAPREDUCE-7079:TestMRIntermediateDataEncryption > is failing in

Re: Needs support to add more entropy to improve cryptographic randomness on Linux VMs

2020-01-14 Thread Arpit Agarwal
Thanks for flagging this Ahmed. urandom is a perfectly acceptable option. I am not sure who maintains the pre-commit machines these days. > On Jan 14, 2020, at 10:42 AM, Ahmed Hussein wrote: > > Hi, > > I was investigating a JUnit test > (MAPREDUCE-7079:TestMRIntermediateDataEncryption >