Re: Branch for HDFS-1073 and related work

Doing this work on a branch makes sense. +1. However, the patches that have been committed so far required extensive review and revision, and in one case, an addendum patch. Additionally, the patches in related JIRAs such as HDFS-1557 and HDFS-1572 have required multiple revisions and

Re: VOTE: Committing HADOOP-6949 to 0.22 branch

+1 n.b. that the vote lost hdfs and common dev at some point. I've added them back. On Tue, Mar 29, 2011 at 9:18 AM, Amit Sangroya sangroyaa...@gmail.com wrote: +1 On Tue, Mar 29, 2011 at 6:04 PM, Stephen Boesch java...@gmail.com wrote: +1 2011/3/29 Doug Cutting cutt...@apache.org +1 I

Please join me in welcoming Matt Foley as the newest Apache Hadoop HDFS committer

On behalf of the PMC, I am pleased to announce that Matt Foley has been elected a committer in the Apache Hadoop HDFS project. Please join me in congratulating Matt and thanking him for his sustained, substantial contributions thus far. Matt is a great addition to our community! Jakob Apache

Re: [VOTE] Change by-laws on release votes: 5 days instead of 7

+1 (binding) On Tue, Jun 24, 2014 at 10:33 AM, Zhijie Shen zs...@hortonworks.com wrote: +1 (non-binding) On Wed, Jun 25, 2014 at 1:26 AM, Aaron T. Myers a...@cloudera.com wrote: +1 (binding) -- Aaron T. Myers Software Engineer, Cloudera On Tue, Jun 24, 2014 at 1:53 AM, Arun

Re: [VOTE] Merge HDDS (HDFS-7240) *code* into trunk

+1 On 16 April 2018 at 16:49, Anu Engineer wrote: > +1 > --Anu > > On 4/16/18, 4:49 PM, "Jitendra Pandey" wrote: > > Hi All, > >The community unanimously voted (https://s.apache.org/HDDSMergeResult) > to adopt > HDDS/Ozone as

Re: [VOTE] Adopt HDSL as a new Hadoop subproject

+1 (binding) On 21 March 2018 at 20:12, Shashikant Banerjee wrote: > +1(non-binding) > > On 3/21/18, 10:13 AM, "Jitendra Pandey" wrote: > > +1 (binding) > > On 3/20/18, 8:39 PM, "Weiwei Yang" wrote: > >

[jira] Created: (HDFS-500) Fix lingering and new javac warnings

Fix lingering and new javac warnings Key: HDFS-500 URL: https://issues.apache.org/jira/browse/HDFS-500 Project: Hadoop HDFS Issue Type: Bug Reporter: Jakob Homan Assignee: Jakob

[jira] Created: (HDFS-515) test-patch doesn't work on git checkouts

test-patch doesn't work on git checkouts Key: HDFS-515 URL: https://issues.apache.org/jira/browse/HDFS-515 Project: Hadoop HDFS Issue Type: Bug Components: test Reporter: Jakob

[jira] Created: (HDFS-906) Remove MapReduce jars from raid lib directory

Reporter: Jakob Homan Currently copies of snapshots of the mapred and mapred-test jars are stored in the raid/lib directory, which creates a nasty circular dependency between the projects. These are needed for one unit test. Either the unit test should be refactored to not need mapreduce

[jira] Resolved: (HDFS-906) Remove MapReduce jars from raid lib directory

[ https://issues.apache.org/jira/browse/HDFS-906?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jakob Homan resolved HDFS-906. -- Resolution: Duplicate Dhruba- Yep, different symptoms, but same cause. Closing as duplicate. Remove

[jira] Created: (HDFS-954) There are two security packages in hdfs, should be one

There are two security packages in hdfs, should be one -- Key: HDFS-954 URL: https://issues.apache.org/jira/browse/HDFS-954 Project: Hadoop HDFS Issue Type: Bug Reporter: Jakob

[jira] Reopened: (HDFS-830) change build.xml to look at lib's jars before ivy, to allow overwriting ivy's libraries.

[ https://issues.apache.org/jira/browse/HDFS-830?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jakob Homan reopened HDFS-830: -- I'm going to go ahead and re-open this: we've been using the resolvers:internal method for a while

[jira] Created: (HDFS-1004) Update NN to support Kerberized SSL from HADOOP-6584

: name-node Reporter: Jakob Homan Assignee: Jakob Homan Namenode needs to be tweaked to use the new kerberized-back ssl connector. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.

[jira] Created: (HDFS-1018) JspHeler.getUGI assumes user is KerbSSL'ed authed, which may not be true

Type: Bug Reporter: Jakob Homan As identified in HDFS-1017, the UGI helper function defaults to Kerberos SSL as the final possible authentication method for an authenticated user. However, this may not be true if another filter is used to authenticate users, which is provided

[jira] Created: (HDFS-1081) Performance regression in DistributedFileSystem::getFileBlockLocations in secure systems

Project: Hadoop HDFS Issue Type: Improvement Components: security Reporter: Jakob Homan Assignee: Jakob Homan We've seen a significant decrease in the performance of DistributedFileSystem::getFileBlockLocations() with security turned on Y20. This JIRA

[jira] Resolved: (HDFS-760) fs -put fails if dfs.umask is set to 63

[ https://issues.apache.org/jira/browse/HDFS-760?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jakob Homan resolved HDFS-760. -- Resolution: Fixed This was fixed by HADOOP-6521. fs -put fails if dfs.umask is set to 63

[jira] Resolved: (HDFS-1198) Resolving cross-realm principals

[ https://issues.apache.org/jira/browse/HDFS-1198?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jakob Homan resolved HDFS-1198. --- Fix Version/s: 0.22.0 Resolution: Fixed I've committed this. Thanks, Jitendra. Resolving

[jira] Resolved: (HDFS-558) Provide build target to run just those tests not in ten-minute-test set

[ https://issues.apache.org/jira/browse/HDFS-558?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jakob Homan resolved HDFS-558. -- Resolution: Duplicate This has been essentially done via HDFS-1199. Resolving as duplicate. Provide

[jira] Created: (HDFS-1283) ant eclipse-files has drifted again

Reporter: Jakob Homan Assignee: Jakob Homan Fix For: 0.22.0 Library versions specified by ant eclipse-files have drifted from those used by ivy again. Until HDFS-1035 meanders into the code, we need to make sure we keep these updated, otherwise bedlam breaks loose

[jira] Created: (HDFS-1319) Fix location of re-login for secondary namenode from HDFS-999

Components: name-node Affects Versions: 0.22.0 Reporter: Jakob Homan Assignee: Jakob Homan Fix For: 0.22.0 A bugfix to the original patch (HDFS-999) hasn't been applied to trunk yet, causing the 2nn to not be logged in at the correct time when it makes

[jira] Reopened: (HDFS-1296) using delegation token over hftp for long running clients (spawn from hdfs-1007).

[ https://issues.apache.org/jira/browse/HDFS-1296?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jakob Homan reopened HDFS-1296: --- Assignee: Boris Shkolnik I've reverted this commit; it was breaking the build: {noformat} compile

[jira] Created: (HDFS-1326) Provide pluggable mechanism for securing datanodes

: security Reporter: Jakob Homan Assignee: Jakob Homan As discussed in HDFS-1150, it would be good to allow datanodes to use other methods than jsvc to secure their ports. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment

[jira] Created: (HDFS-1328) ant eclipse-files doesn't load all library necessary to make eclipse happy

Issue Type: Bug Components: tools Affects Versions: 0.22.0 Reporter: Jakob Homan Fix For: 0.22.0 Currently ant-eclipse files alone is not sufficient to get a fully building system in Eclipse. I end up calling compile-contrib and test to get all the jars

[jira] Resolved: (HDFS-1296) using delegation token over hftp for long running clients (spawn from hdfs-1007).

[ https://issues.apache.org/jira/browse/HDFS-1296?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jakob Homan resolved HDFS-1296. --- Fix Version/s: 0.22.0 Resolution: Fixed The problem was that Hudson was down and had

[jira] Resolved: (HDFS-1020) The canceller and renewer for delegation tokens should be long names.

[ https://issues.apache.org/jira/browse/HDFS-1020?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jakob Homan resolved HDFS-1020. --- Resolution: Fixed This was incorporated into HDFS-1201. Resolving. The canceller and renewer

[jira] Resolved: (HDFS-320) Namenode should return lease recovery request with other requests

[ https://issues.apache.org/jira/browse/HDFS-320?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jakob Homan resolved HDFS-320. -- Resolution: Won't Fix Resolving as Won't Fix. Namenode should return lease recovery request with other

[jira] Created: (HDFS-1353) Optimize number of block access tokens returned by getBlockLocations

: Improvement Components: name-node Affects Versions: 0.22.0 Reporter: Jakob Homan Assignee: Jakob Homan Fix For: 0.22.0 HDFS-1081 optimized the number of block access tokens (BATs) created in a single call to getBlockLocations

[jira] Created: (HDFS-1381) MiniDFSCluster documentation refers to out-of-date configuration parameters

Issue Type: Bug Components: test Affects Versions: 0.20.1 Reporter: Jakob Homan Fix For: 0.22.0 The javadoc for MiniDFSCluster makes repeated references to setting dfs.name.dir and dfs.data.dir. These should be replaced with references to DFSConfigKeys

[jira] Created: (HDFS-1430) Don't print entire stack trace to NN log when denying file access

: Improvement Components: name-node Affects Versions: 0.21.0 Reporter: Jakob Homan Fix For: 0.22.0 Currently when a user attempts to access a file/directory he/she doesn't have access to, we include the entire stack trace from the exception that is generated

[jira] Resolved: (HDFS-855) namenode can save images in parallel to all directories in fs.name.dir

[ https://issues.apache.org/jira/browse/HDFS-855?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jakob Homan resolved HDFS-855. -- Resolution: Duplicate namenode can save images in parallel to all directories in fs.name.dir

[jira] Created: (HDFS-1452) ant compile-contrib is broken

Reporter: Jakob Homan Fix For: 0.22.0 ant compile-contrib is broken, looks like commit a0a62d971fb35de7f021ecbd6ceb8d08ef923ed5 HDFS-1444 -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.

[jira] Created: (HDFS-1456) Provide builder for constructing instances of MiniDFSCluster

Components: test Affects Versions: 0.22.0 Reporter: Jakob Homan Assignee: Jakob Homan Fix For: 0.22.0 Time to fix a broken window. Of the 293 occurences of new MiniDFSCluster(... most look something like: {noformat}cluster = new MiniDFSCluster(0

[jira] Resolved: (HDFS-1456) Provide builder for constructing instances of MiniDFSCluster

[ https://issues.apache.org/jira/browse/HDFS-1456?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jakob Homan resolved HDFS-1456. --- Resolution: Fixed Hadoop Flags: [Reviewed] The commented-out calls were in the original code

[jira] Resolved: (HDFS-312) FSEditLog dump/restore tool

[ https://issues.apache.org/jira/browse/HDFS-312?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jakob Homan resolved HDFS-312. -- Resolution: Duplicate Progress is being made on this feature in HDFS-1448. Closing this one

[jira] Resolved: (HDFS-1545) Repeat commonly viewed statistics at the end of dfsadmin -report

[ https://issues.apache.org/jira/browse/HDFS-1545?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jakob Homan resolved HDFS-1545. --- Resolution: Won't Fix Resolving as won't fix. Repeat commonly viewed statistics at the end

[jira] Resolved: (HDFS-1511) 98 Release Audit warnings on trunk and branch-0.22

[ https://issues.apache.org/jira/browse/HDFS-1511?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jakob Homan resolved HDFS-1511. --- Resolution: Fixed Assignee: Jakob Homan Hadoop Flags: [Reviewed] I've committed

[jira] Resolved: (HDFS-743) file size is fluctuating although file is closed

[ https://issues.apache.org/jira/browse/HDFS-743?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jakob Homan resolved HDFS-743. -- Resolution: Won't Fix We can't set the version since 17 isn't even listed anymore. Since it's

[jira] Resolved: (HDFS-650) Namenode in infinite loop for removing/recovering lease.

[ https://issues.apache.org/jira/browse/HDFS-650?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jakob Homan resolved HDFS-650. -- Resolution: Not A Problem Resolved. Namenode in infinite loop for removing/recovering lease

[jira] Created: (HDFS-1576) TestWriteConfigurationToDFS is timing out on trunk

Affects Versions: 0.22.0, 0.23.0 Environment: OSX 10.6 Reporter: Jakob Homan Fix For: 0.22.0, 0.23.0 On a fresh checkout, TestWriteConfigurationToDFS, runs, errors out and then never returns, blocking all subsequent tests. This is reproducible

[jira] Resolved: (HDFS-1576) TestWriteConfigurationToDFS is timing out on trunk

[ https://issues.apache.org/jira/browse/HDFS-1576?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jakob Homan resolved HDFS-1576. --- Resolution: Not A Problem A new version of the commons jar has been pushed to Ivy. This has resolved

[jira] Reopened: (HDFS-1589) In secure mode, Datanodes should shutdown if they come up on non-privileged ports

[ https://issues.apache.org/jira/browse/HDFS-1589?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jakob Homan reopened HDFS-1589: --- In secure mode, Datanodes should shutdown if they come up on non-privileged ports

[jira] Resolved: (HDFS-1589) In secure mode, Datanodes should shutdown if they come up on non-privileged ports

[ https://issues.apache.org/jira/browse/HDFS-1589?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jakob Homan resolved HDFS-1589. --- Resolution: Invalid In secure mode, Datanodes should shutdown if they come up on non-privileged

[jira] Resolved: (HDFS-1589) In secure mode, Datanodes should shutdown if they come up on non-privileged ports

[ https://issues.apache.org/jira/browse/HDFS-1589?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jakob Homan resolved HDFS-1589. --- Resolution: Fixed The SecureDataNode starter won't come up with non-privileged ports: {code:title

[jira] [Resolved] (HDFS-1410) The doCheckpoint() method should be invoked every hour

[ https://issues.apache.org/jira/browse/HDFS-1410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jakob Homan resolved HDFS-1410. --- Resolution: Duplicate This was fixed in HDFS-1572. Resolving. The doCheckpoint() method should

[jira] [Resolved] (HDFS-2151) restartDFS causing a hang when running on Windows. Makes other test cases fail.

[ https://issues.apache.org/jira/browse/HDFS-2151?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jakob Homan resolved HDFS-2151. --- Resolution: Not A Problem restartDFS causing a hang when running on Windows. Makes other test cases

[jira] [Created] (HDFS-2215) Add toString to FileStatus

Add toString to FileStatus -- Key: HDFS-2215 URL: https://issues.apache.org/jira/browse/HDFS-2215 Project: Hadoop HDFS Issue Type: Improvement Reporter: Jakob Homan Priority: Minor It would

[jira] [Created] (HDFS-2617) Replaced Kerberized SSL for image transfer and fsck with SPNEGO-based solution

Issue Type: Improvement Reporter: Jakob Homan The current approach to secure and authenticate nn web services is based on Kerberized SSL and was developed when a SPNEGO solution wasn't available. Now that we have one, we can get rid of the non-standard KSSL and use SPNEGO

[jira] [Created] (HDFS-3367) WebHDFS doesn't use the logged in user when opening connections

Jakob Homan created HDFS-3367: - Summary: WebHDFS doesn't use the logged in user when opening connections Key: HDFS-3367 URL: https://issues.apache.org/jira/browse/HDFS-3367 Project: Hadoop HDFS

[jira] [Created] (HDFS-3768) Exception in TestJettyHelper is incorrect

Jakob Homan created HDFS-3768: - Summary: Exception in TestJettyHelper is incorrect Key: HDFS-3768 URL: https://issues.apache.org/jira/browse/HDFS-3768 Project: Hadoop HDFS Issue Type

[jira] [Created] (HDFS-7590) Stabilize and document getBlockLocation API in WebHDFS

Jakob Homan created HDFS-7590: - Summary: Stabilize and document getBlockLocation API in WebHDFS Key: HDFS-7590 URL: https://issues.apache.org/jira/browse/HDFS-7590 Project: Hadoop HDFS Issue

[jira] [Created] (HDFS-8154) Extract WebHDFS protocol out as a specification to allow easier clients and servers

Jakob Homan created HDFS-8154: - Summary: Extract WebHDFS protocol out as a specification to allow easier clients and servers Key: HDFS-8154 URL: https://issues.apache.org/jira/browse/HDFS-8154 Project

[jira] [Created] (HDFS-8542) WebHDFS getHomeDirectory behavior does not match specification

Jakob Homan created HDFS-8542: - Summary: WebHDFS getHomeDirectory behavior does not match specification Key: HDFS-8542 URL: https://issues.apache.org/jira/browse/HDFS-8542 Project: Hadoop HDFS

[jira] [Resolved] (HDFS-3620) WebHdfsFileSystem getHomeDirectory() should not resolve locally

[ https://issues.apache.org/jira/browse/HDFS-3620?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jakob Homan resolved HDFS-3620. --- Resolution: Duplicate This issue was duplicated and dealt with in HDFS-8542. WebHdfsFileSystem

[jira] [Created] (HDFS-8490) Typo in trace enabled log in WebHDFS exception handler

Jakob Homan created HDFS-8490: - Summary: Typo in trace enabled log in WebHDFS exception handler Key: HDFS-8490 URL: https://issues.apache.org/jira/browse/HDFS-8490 Project: Hadoop HDFS Issue

[jira] [Created] (HDFS-8939) Test(S)WebHdfsFileContextMainOperations failing on branch-2

Jakob Homan created HDFS-8939: - Summary: Test(S)WebHdfsFileContextMainOperations failing on branch-2 Key: HDFS-8939 URL: https://issues.apache.org/jira/browse/HDFS-8939 Project: Hadoop HDFS

[jira] [Created] (HDFS-8866) Typo in docs: Rumtime - Runtime

Jakob Homan created HDFS-8866: - Summary: Typo in docs: Rumtime - Runtime Key: HDFS-8866 URL: https://issues.apache.org/jira/browse/HDFS-8866 Project: Hadoop HDFS Issue Type: Bug

[jira] [Reopened] (HDFS-8943) Read apis in ByteRangeInputStream does not read all the bytes specified when chunked transfer-encoding is used in the server

[ https://issues.apache.org/jira/browse/HDFS-8943?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jakob Homan reopened HDFS-8943: --- We need a fix for this, let's not close it until we've reached one. Read apis in ByteRangeInputStream