[jira] [Resolved] (HDFS-16484) [SPS]: Fix an infinite loop bug in SPSPathIdProcessor thread

2022-04-12 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16484?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma resolved HDFS-16484. - Fix Version/s: 3.4.0 3.2.4 3.3.4 Resolution:

Re: Institutions running kerberized Hadoop clusters

2022-04-12 Thread Santosh Marella
Thanks Wei-Chiu. Was looking mainly to get to know the institutions. At Twitter, we have been working on kerberizing our clusters and wanted to see who out there has already done it, any insights/best-practices that we can leverage than reinventing the wheel (especially when dealing with things at

Re: Institutions running kerberized Hadoop clusters

2022-04-12 Thread Wei-Chiu Chuang
Last time I checked (~2 years ago), there were thousands of Kerberized clusters among Cloudera customers. The largest ones had a few thousand nodes. What are you looking for? On Wed, Apr 13, 2022 at 7:22 AM Santosh Marella wrote: > Hey folks, > > Just curious if we have a list of

Institutions running kerberized Hadoop clusters

2022-04-12 Thread Santosh Marella
Hey folks, Just curious if we have a list of institutions that are running *kerberized* Hadoop clusters? I noticed we have a PoweredBy Hadoop page that lists all the institutions running Hadoop, but couldn't find something similar

Apache Hadoop qbt Report: trunk+JDK8 on Linux/x86_64

2022-04-12 Thread Apache Jenkins Server
For more details, see https://ci-hadoop.apache.org/job/hadoop-qbt-trunk-java8-linux-x86_64/837/ [Apr 11, 2022 7:54:00 AM] (noreply) HDFS-16516. Fix Fsshell wrong params (#4090). Contributed by GuoPhilipse. -1 overall The following subsystems voted -1: blanks pathlen xml The

[jira] [Resolved] (HDFS-16474) Make HDFS tail tool cross platform

2022-04-12 Thread Gautham Banasandra (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16474?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gautham Banasandra resolved HDFS-16474. --- Fix Version/s: 3.4.0 Resolution: Fixed Merged PR

[ANNOUNCE] branch-3.3.3 created off 3.3.2; branch-3.3 hadoop.version is now 3.3.4-SNAPSHOT

2022-04-12 Thread Steve Loughran
There is now a branch-3.3.3 in the repo; this is forked off 3.3.2, *not* branch-3.3 branch-3.3 has its hadoop version now set to 3.3.4 I've renamed the release version 3.3.3 in JIRA to 3.3.4, so all fixed/target/affects references have been automatically updated. text references in JIRAs and PRs

[jira] [Reopened] (HDFS-16355) Improve the description of dfs.block.scanner.volume.bytes.per.second

2022-04-12 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16355?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran reopened HDFS-16355: --- > Improve the description of dfs.block.scanner.volume.bytes.per.second >

[jira] [Reopened] (HDFS-16501) Print the exception when reporting a bad block

2022-04-12 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16501?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran reopened HDFS-16501: --- > Print the exception when reporting a bad block >

[jira] [Reopened] (HDFS-11041) Unable to unregister FsDatasetState MBean if DataNode is shutdown twice

2022-04-12 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HDFS-11041?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran reopened HDFS-11041: --- > Unable to unregister FsDatasetState MBean if DataNode is shutdown twice >

[jira] [Reopened] (HDFS-16428) Source path with storagePolicy cause wrong typeConsumed while rename

2022-04-12 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16428?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran reopened HDFS-16428: --- > Source path with storagePolicy cause wrong typeConsumed while rename >

[jira] [Reopened] (HDFS-16507) [SBN read] Avoid purging edit log which is in progress

2022-04-12 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16507?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran reopened HDFS-16507: --- > [SBN read] Avoid purging edit log which is in progress >

[jira] [Reopened] (HDFS-16437) ReverseXML processor doesn't accept XML files without the SnapshotDiffSection.

2022-04-12 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16437?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran reopened HDFS-16437: --- > ReverseXML processor doesn't accept XML files without the SnapshotDiffSection. >

[jira] [Reopened] (HDFS-16422) Fix thread safety of EC decoding during concurrent preads

2022-04-12 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16422?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran reopened HDFS-16422: --- > Fix thread safety of EC decoding during concurrent preads >

Re: HADOOP-18198. Release Hadoop 3.3.3: hadoop-3.3.2 with CVE fixes

2022-04-12 Thread Steve Loughran
I should add that the CVEs in question are minor, unless you are running Hadoop on windows. given you have to compile the native binaries yourself for that, that is not something we know anyone actually does in production. The reload4j fix means that we can get out of the classpath the log4j

Apache Hadoop qbt Report: branch-2.10+JDK7 on Linux/x86_64

2022-04-12 Thread Apache Jenkins Server
For more details, see https://ci-hadoop.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86_64/629/ [Apr 11, 2022 6:20:43 AM] (Takanobu Asanuma) HADOOP-17116. Skip Retry INFO logging on first failover from a proxy [Apr 11, 2022 6:24:51 AM] (Takanobu Asanuma) HADOOP-18191. Log retry count