Hadoop storage online sync (Mandarin) happening in 2 hours

2019-10-09 Thread Wei-Chiu Chuang
I would like to talk about Erasure Coding development this time around. But feel free to join and chime in. Join via Zoom: https://docs.google.com/document/d/1XkrcyVil_ORV1UP-JhosGzK8qWGXXX3wuplo4RtC7u0/edit Past meeting minutes:

[jira] [Created] (HDDS-2279) S3 commands not working on HA cluster

2019-10-09 Thread Bharat Viswanadham (Jira)
Bharat Viswanadham created HDDS-2279: Summary: S3 commands not working on HA cluster Key: HDDS-2279 URL: https://issues.apache.org/jira/browse/HDDS-2279 Project: Hadoop Distributed Data Store

[jira] [Created] (HDDS-2278) Run S3 test suite on OM HA cluster

2019-10-09 Thread Bharat Viswanadham (Jira)
Bharat Viswanadham created HDDS-2278: Summary: Run S3 test suite on OM HA cluster Key: HDDS-2278 URL: https://issues.apache.org/jira/browse/HDDS-2278 Project: Hadoop Distributed Data Store

[jira] [Resolved] (HDDS-2191) Handle bucket create request in OzoneNativeAuthorizer

2019-10-09 Thread Bharat Viswanadham (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2191?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bharat Viswanadham resolved HDDS-2191. -- Resolution: Fixed > Handle bucket create request in OzoneNativeAuthorizer >

Re: [DISCUSS] About creation of Hadoop Thirdparty repository for shaded artifacts

2019-10-09 Thread Wei-Chiu Chuang
Hi I am late to this but I am keen to understand more. To be exact, how can we better use the thirdparty repo? Looking at HBase as an example, it looks like everything that are known to break a lot after an update get shaded into the hbase-thirdparty artifact: guava, netty, ... etc. Is it the

Re: [DISCUSS] About creation of Hadoop Thirdparty repository for shaded artifacts

2019-10-09 Thread Vinayakumar B
Hi All, I have updated the PR as per @Owen O'Malley 's suggestions. i. Renamed the module to 'hadoop-shaded-protobuf37' ii. Kept the shaded package to 'o.a.h.thirdparty.protobuf37' Please review!! Thanks, -Vinay On Sat, Sep 28, 2019 at 10:29 AM 张铎(Duo Zhang) wrote: > For HBase we

Re: Please cherry pick commits to lower branches

2019-10-09 Thread Steve Loughran
created https://issues.apache.org/jira/browse/HADOOP-16646 for the s3a stuff. branch-3.2 doesn't build right now, someone needs to fix that first; I'll start running the full ITest suites off a commit which does build... On Wed, Oct 9, 2019 at 1:51 PM Steve Loughran wrote: > > abfs stuff has

Apache Hadoop qbt Report: trunk+JDK8 on Linux/x86

2019-10-09 Thread Apache Jenkins Server
For more details, see https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/1284/ [Oct 8, 2019 8:31:44 AM] (ayushsaxena) HDFS-14814. RBF: RouterQuotaUpdateService supports inherited rule. [Oct 8, 2019 8:44:14 AM] (ayushsaxena) HDFS-14859. Prevent unnecessary evaluation of costly

Re: Please cherry pick commits to lower branches

2019-10-09 Thread Steve Loughran
abfs stuff has gone in to 3.2 -credit Thomas Marquardt and Da Zhou there. I'll do the same for S3A, including SDK updates And I'd like to pull back two changes to the FS APIs HADOOP-15691 PathCapabilities. Lets apps probes for FS instances having specific features/semantics HADOOP-15229 Add

Apache Hadoop qbt Report: branch2+JDK7 on Linux/x86

2019-10-09 Thread Apache Jenkins Server
For more details, see https://builds.apache.org/job/hadoop-qbt-branch2-java7-linux-x86/469/ [Oct 8, 2019 8:00:30 AM] (ayushsaxena) HDFS-14655. [SBN Read] Namenode crashes if one of The JN is down. [Oct 8, 2019 6:19:39 PM] (jhung) YARN-9760. Support configuring application priorities on a

[jira] [Created] (HDDS-2277) Consider allowing maintenance end time to be specified in human readable format

2019-10-09 Thread Stephen O'Donnell (Jira)
Stephen O'Donnell created HDDS-2277: --- Summary: Consider allowing maintenance end time to be specified in human readable format Key: HDDS-2277 URL: https://issues.apache.org/jira/browse/HDDS-2277

[jira] [Created] (HDDS-2276) Allow users to pass hostnames or IP when decommissioning nodes

2019-10-09 Thread Stephen O'Donnell (Jira)
Stephen O'Donnell created HDDS-2276: --- Summary: Allow users to pass hostnames or IP when decommissioning nodes Key: HDDS-2276 URL: https://issues.apache.org/jira/browse/HDDS-2276 Project: Hadoop

[jira] [Created] (HDDS-2275) In BatchOperation.SingleOperation, do not clone byte[]

2019-10-09 Thread Tsz-wo Sze (Jira)
Tsz-wo Sze created HDDS-2275: Summary: In BatchOperation.SingleOperation, do not clone byte[] Key: HDDS-2275 URL: https://issues.apache.org/jira/browse/HDDS-2275 Project: Hadoop Distributed Data Store

[jira] [Resolved] (HDDS-2261) Change readChunk methods to return ByteBuffer

2019-10-09 Thread Shashikant Banerjee (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2261?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shashikant Banerjee resolved HDDS-2261. --- Resolution: Fixed > Change readChunk methods to return ByteBuffer >

[jira] [Resolved] (HDFS-14488) libhdfs SIGSEGV during shutdown of Java

2019-10-09 Thread Kotomi (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14488?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kotomi resolved HDFS-14488. --- Resolution: Cannot Reproduce > libhdfs SIGSEGV during shutdown of Java >

[jira] [Created] (HDDS-2274) Avoid buffer copying in Codec

2019-10-09 Thread Tsz-wo Sze (Jira)
Tsz-wo Sze created HDDS-2274: Summary: Avoid buffer copying in Codec Key: HDDS-2274 URL: https://issues.apache.org/jira/browse/HDDS-2274 Project: Hadoop Distributed Data Store Issue Type:

[jira] [Created] (HDDS-2273) Avoid buffer copying in GrpcReplicationService

2019-10-09 Thread Tsz-wo Sze (Jira)
Tsz-wo Sze created HDDS-2273: Summary: Avoid buffer copying in GrpcReplicationService Key: HDDS-2273 URL: https://issues.apache.org/jira/browse/HDDS-2273 Project: Hadoop Distributed Data Store

[jira] [Created] (HDDS-2272) Avoid buffer copying in GrpcReplicationClient

2019-10-09 Thread Tsz-wo Sze (Jira)
Tsz-wo Sze created HDDS-2272: Summary: Avoid buffer copying in GrpcReplicationClient Key: HDDS-2272 URL: https://issues.apache.org/jira/browse/HDDS-2272 Project: Hadoop Distributed Data Store

[jira] [Created] (HDDS-2271) Avoid buffer copying in KeyValueHandler

2019-10-09 Thread Tsz-wo Sze (Jira)
Tsz-wo Sze created HDDS-2271: Summary: Avoid buffer copying in KeyValueHandler Key: HDDS-2271 URL: https://issues.apache.org/jira/browse/HDDS-2271 Project: Hadoop Distributed Data Store Issue

[jira] [Resolved] (HDDS-2233) Remove ByteStringHelper and refactor the code to the place where it used

2019-10-09 Thread Shashikant Banerjee (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2233?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shashikant Banerjee resolved HDDS-2233. --- Fix Version/s: 0.5.0 Resolution: Fixed > Remove ByteStringHelper and refactor