[jira] [Created] (HADOOP-16918) Dependency update for Hadoop 2.10

2020-03-10 Thread Wei-Chiu Chuang (Jira)
Wei-Chiu Chuang created HADOOP-16918: Summary: Dependency update for Hadoop 2.10 Key: HADOOP-16918 URL: https://issues.apache.org/jira/browse/HADOOP-16918 Project: Hadoop Common Issue

[jira] [Created] (HADOOP-16917) Update dependency in branch-3.1

2020-03-10 Thread Wei-Chiu Chuang (Jira)
Wei-Chiu Chuang created HADOOP-16917: Summary: Update dependency in branch-3.1 Key: HADOOP-16917 URL: https://issues.apache.org/jira/browse/HADOOP-16917 Project: Hadoop Common Issue

[jira] [Created] (HADOOP-16916) ABFS: Delegation SAS generator for integration with Ranger

2020-03-10 Thread Thomas Marqardt (Jira)
Thomas Marqardt created HADOOP-16916: Summary: ABFS: Delegation SAS generator for integration with Ranger Key: HADOOP-16916 URL: https://issues.apache.org/jira/browse/HADOOP-16916 Project: Hadoop

This week's APAC Hadoop storage community online sync

2020-03-10 Thread Wei-Chiu Chuang
Hi! Gentle reminder: Tomorrow's the APAC Hadoop storage community online sync. Date/time: March 12th 1PM (China) / 2PM (Japan) / 10:30AM (India) March 11th 10PM (US West Coast) Zoom link: https://cloudera.zoom.us/j/880548968 Past meeting minutes:

Re: Hadoop File API v.s. Commons VFS

2020-03-10 Thread David Mollitor
And by "wow" I mean to say, "your input was awesome and generous," not "wow that's a lot of work." On Tue, Mar 10, 2020, 9:24 PM David Mollitor wrote: > Wow. Thanks for that started point. > > On Tue, Mar 10, 2020, 8:48 PM Owen O'Malley > wrote: > >> It would be a lot of work. Of course there

Re: Hadoop File API v.s. Commons VFS

2020-03-10 Thread David Mollitor
Wow. Thanks for that started point. On Tue, Mar 10, 2020, 8:48 PM Owen O'Malley wrote: > It would be a lot of work. Of course there is a lot of overlap, but they > have different use cases, so there are significant differences. From the > big data side, there are a lot of blockers. > >1.

Re: Hadoop File API v.s. Commons VFS

2020-03-10 Thread Owen O'Malley
It would be a lot of work. Of course there is a lot of overlap, but they have different use cases, so there are significant differences. From the big data side, there are a lot of blockers. 1. CVFS does not have the concept of replication, so there is no way to get or set a file's

Re: Hadoop File API v.s. Commons VFS

2020-03-10 Thread David Mollitor
I just see a lot of overlap and doubling of effort here. Would be nice if we can all be working in tandem. On Tue, Mar 10, 2020, 6:36 PM Aaron Fabbri wrote: > It is a good question. I'm not familiar with Apache commons VFS (which I > assume you are talking about, versus the BSD/Unix VFS

[NOTICE] branch HADOOP-15566-OpenTracing created

2020-03-10 Thread Wei-Chiu Chuang
Hi devs, I forked a branch HADOOP-15566-OpenTracing from trunk. This branch is used to develop HADOOP-15566 (OpenTracing support in Hadoop)

Re: Hadoop File API v.s. Commons VFS

2020-03-10 Thread Aaron Fabbri
It is a good question. I'm not familiar with Apache commons VFS (which I assume you are talking about, versus the BSD/Unix VFS layer). There no doubt will be semantic differences between Hadoop FS interface and VFS. It would be an interesting exercise to implement a connector that bridges the gap,

Re: [DISCUSS] Accelerate Hadoop dependency updates

2020-03-10 Thread Wei-Chiu Chuang
I'm not hearing any feedback so far, but I want to suggest: use hadoop-thirdparty repository to host any dependencies that are known to break compatibility. Candidate #1 guava Candidate #2 Netty Candidate #3 Jetty in fact, HBase shades these dependencies for the exact same reason. As an

Apache Hadoop qbt Report: trunk+JDK8 on Linux/x86

2020-03-10 Thread Apache Jenkins Server
For more details, see https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/1434/ [Mar 9, 2020 4:01:34 AM] (wwei) HADOOP-16840. AliyunOSS: getFileStatus throws FileNotFoundException in [Mar 9, 2020 1:51:58 PM] (brahma) HADOOP-16871. Upgrade Netty version to 4.1.45.Final to handle [Mar

[jira] [Resolved] (HADOOP-16907) Update Netty to 4.1.46Final

2020-03-10 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16907?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang resolved HADOOP-16907. -- Resolution: Duplicate HADOOP-16871 updated to 4.1.45 so that resolves the CVE issue.

Apache Hadoop qbt Report: branch2.10+JDK7 on Linux/x86

2020-03-10 Thread Apache Jenkins Server
For more details, see https://builds.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86/620/ [Mar 9, 2020 5:03:32 AM] (wwei) HADOOP-16840. AliyunOSS: getFileStatus throws FileNotFoundException in -1 overall The following subsystems voted -1: asflicense findbugs hadolint pathlen