Re: Possibility of using ci-hadoop.a.o for Nutch integration tests

2022-01-05 Thread lewis john mcgibbney
Thank you for the information. I agree with you. I totally misunderstood what ci-hadoop.a.o was. Sorry for the noise. lewismc On Wed, Jan 5, 2022 at 21:56 Akira Ajisaka wrote: > (Adding builds@) > > Hi Lewis, > > Nutch is already using ci-builds.apache.org, so I think Nutch can > continue using

Re: Next Mandarin Hadoop Online Meetup Jan 6th.

2022-01-05 Thread Wei-Chiu Chuang
Just a gentle reminder this is happening now. On Mon, Jan 3, 2022 at 5:39 PM Wei-Chiu Chuang wrote: > Hello community, > > This week we'll going to have Tao Li (tomscut) speaking about the > experience of operating HDFS at BIGO. See you on Thursday! > > 题目:《HDFS在BIGO的实践》 >

Re: Possibility of using ci-hadoop.a.o for Nutch integration tests

2022-01-05 Thread Akira Ajisaka
(Adding builds@) Hi Lewis, Nutch is already using ci-builds.apache.org, so I think Nutch can continue using it. ci-hadoop.apache.org provides almost the same functionality as ci-builds.apache.org and there is no non-production Hadoop cluster running there. Therefore moving to ci-hadoop does not

Re: Possibility of using ci-hadoop.a.o for Nutch integration tests

2022-01-05 Thread lewis john mcgibbney
Thank you for the response and for directing the conversation to the correct places. I may have misunderstood what ci-hadoop.apache.org actually is. We are looking for a non-production Hadoop cluster which we can use to simulate Nutch jobs. I am not sure if this is what ci-hadoop.apache.org

Re: Possibility of using ci-hadoop.a.o for Nutch integration tests

2022-01-05 Thread Lewis John Mcgibbney
Thank you for the response and for directing the conversation to the correct places. I may have misunderstood what ci-hadoop.apache.org actually is. We are looking for a non-production Hadoop cluster which we can use to simulate Nutch jobs. I am not sure if this is what ci-hadoop.apache.org

Re: Possibility of using ci-hadoop.a.o for Nutch integration tests

2022-01-05 Thread Ayush Saxena
Moved to Dev lists. Not sure about this though: when a PR is submitted to Nutch project it will run some MR job in Hadoop CI. Whatever that PR requires should run as part of Nutch Infra. Why in Hadoop CI? Our CI is already loaded with our own workloads. If by any chance the above assertion gets

Apache Hadoop qbt Report: trunk+JDK11 on Linux/x86_64

2022-01-05 Thread Apache Jenkins Server
For more details, see https://ci-hadoop.apache.org/job/hadoop-qbt-trunk-java11-linux-x86_64/238/ [Jan 4, 2022 2:18:03 AM] (noreply) HADOOP-18061. Update the year to 2022. (#3845). Contributed by Ayush Saxena. [Jan 4, 2022 2:20:01 AM] (noreply) HDFS-16393. RBF: Fix

[jira] [Resolved] (HDFS-16371) Exclude slow disks when choosing volume

2022-01-05 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16371?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma resolved HDFS-16371. - Fix Version/s: 3.4.0 Resolution: Fixed > Exclude slow disks when choosing volume

Apache Hadoop qbt Report: trunk+JDK8 on Linux/x86_64

2022-01-05 Thread Apache Jenkins Server
For more details, see https://ci-hadoop.apache.org/job/hadoop-qbt-trunk-java8-linux-x86_64/741/ [Jan 4, 2022 2:18:03 AM] (noreply) HADOOP-18061. Update the year to 2022. (#3845). Contributed by Ayush Saxena. [Jan 4, 2022 2:20:01 AM] (noreply) HDFS-16393. RBF: Fix

[jira] [Resolved] (HDFS-16410) Insecure Xml parsing in OfflineEditsXmlLoader

2022-01-05 Thread Chao Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun resolved HDFS-16410. - Fix Version/s: 3.4.0 3.3.2 Resolution: Fixed > Insecure Xml parsing in

[jira] [Resolved] (HDFS-16408) Ensure LeaseRecheckIntervalMs is greater than zero

2022-01-05 Thread Stephen O'Donnell (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16408?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen O'Donnell resolved HDFS-16408. -- Resolution: Fixed > Ensure LeaseRecheckIntervalMs is greater than zero >

[jira] [Created] (HDFS-16413) Reconfig dfs usage parameters for datanode

2022-01-05 Thread tomscut (Jira)
tomscut created HDFS-16413: -- Summary: Reconfig dfs usage parameters for datanode Key: HDFS-16413 URL: https://issues.apache.org/jira/browse/HDFS-16413 Project: Hadoop HDFS Issue Type: New Feature

Apache Hadoop qbt Report: branch-2.10+JDK7 on Linux/x86_64

2022-01-05 Thread Apache Jenkins Server
For more details, see https://ci-hadoop.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86_64/533/ [Jan 4, 2022 2:36:27 AM] (Ayush Saxena) HADOOP-18061. Update the year to 2022. (#3845). Contributed by Ayush Saxena. -1 overall The following subsystems voted -1: asflicense compile

[jira] [Created] (HDFS-16412) Add metrics to support obtaining file size distribution

2022-01-05 Thread Xiangyi Zhu (Jira)
Xiangyi Zhu created HDFS-16412: -- Summary: Add metrics to support obtaining file size distribution Key: HDFS-16412 URL: https://issues.apache.org/jira/browse/HDFS-16412 Project: Hadoop HDFS