Since the RC0 does not yet get enough attention,
I'm going to cut RC1 tomorrow in order to add HDFS-14630.
While the log message is practically harmless,
it give an impression that the release is not well baked.
Let me know if you find fix which should be contained in 3.2.3 RC1.
Thanks,
Masatake Iwasaki
On 2022/03/18 10:56, Masatake Iwasaki wrote:
I found that INFO level log message is emitted on every CLI invocation.
$ bin/hdfs dfs -mkdir /tmp
2022-03-17 23:38:55,141 INFO Configuration.deprecation: No unit for
dfs.client.datanode-restart.timeout(30) assuming SECONDS
The time unit was intentionally removed from hdfs-default.xml by DFS-12920,
There seems to be no quick fix though it is noisy.
HDFS-14630 is the fix for this.
I will backport this to branch-3.2.3 if I need to cut RC1.
On 2022/03/18 0:54, Masatake Iwasaki wrote:
+1 from myself.
* built the source tarball on CentOS 7 (x86_64) and OpenJDK 8 by `mvn install
-DskipTests -Pnative -Pdist`.
* launched pseudo distributed cluster.
* ran some MR example jobs.
* launched `spark-shell --master yarn` with spark-3.2.1-bin-without-hadoop
and ran some tutorial code.
* launched pseudo distributed cluster with Kerberos security enabled.
* launched KMS and created encryption zone.
* ran sample MR wordcount job over encryption zone.
* launched HA enabled 3-nodes docker cluster and ran sample MR jobs.
* built site documentation by `mvn site site:stage` and skimmed the contents.
* built HBase 2.4.8, Hive 3.1.2 and Spark 3.1.2 against Hadoop 3.2.3 RC0
on Rocky Linux 8 (x86_64) by using Bigtop and ran smoke-tests.
https://issues.apache.org/jira/browse/BIGTOP-3606
I found that INFO level log message is emitted on every CLI invocation.
$ bin/hdfs dfs -mkdir /tmp
2022-03-17 23:38:55,141 INFO Configuration.deprecation: No unit for
dfs.client.datanode-restart.timeout(30) assuming SECONDS
The time unit was intentionally removed from hdfs-default.xml by DFS-12920,
There seems to be no quick fix though it is noisy.
Masatake Iwasaki
On 2022/03/16 18:36, Viraj Jasani wrote:
+1 (non-binding)
Using hadoop-vote.sh
* Signature: ok
* Checksum : ok
* Rat check (1.8.0_301): ok
- mvn clean apache-rat:check
* Built from source (1.8.0_301): ok
- mvn clean install -DskipTests
* Built tar from source (1.8.0_301): ok
- mvn clean package -Pdist -DskipTests -Dtar -Dmaven.javadoc.skip=true
Tested HDFS on pseudo-distributed mode with HBase 2.4 pseudo-distributed
cluster (1M rows ingested), all good.
Test PR to run full build and track UT failures
https://github.com/apache/hadoop/pull/4073
<https://github.com/apache/hadoop/pull/4073>, few tests are flaky but they are
passing locally.
On Mon, Mar 14, 2022 at 12:45 PM Masatake Iwasaki <iwasak...@oss.nttdata.co.jp
<mailto:iwasak...@oss.nttdata.co.jp>> wrote:
Hi all,
Here's Hadoop 3.2.3 release candidate #0:
The RC is available at:
https://home.apache.org/~iwasakims/hadoop-3.2.3-RC0/
<https://home.apache.org/~iwasakims/hadoop-3.2.3-RC0/>
The RC tag is at:
https://github.com/apache/hadoop/releases/tag/release-3.2.3-RC0
<https://github.com/apache/hadoop/releases/tag/release-3.2.3-RC0>
The Maven artifacts are staged at:
https://repository.apache.org/content/repositories/orgapachehadoop-1339
<https://repository.apache.org/content/repositories/orgapachehadoop-1339>
You can find my public key at:
https://downloads.apache.org/hadoop/common/KEYS
<https://downloads.apache.org/hadoop/common/KEYS>
Please evaluate the RC and vote.
Thanks,
Masatake Iwasaki
---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org
<mailto:hdfs-dev-unsubscr...@hadoop.apache.org>
For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
<mailto:hdfs-dev-h...@hadoop.apache.org>
---------------------------------------------------------------------
To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-dev-h...@hadoop.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-dev-h...@hadoop.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-dev-h...@hadoop.apache.org
