Re: [Vote] Merge The HDFS XAttrs Feature Branch (HDFS-2006) to Trunk

I think you're alluding to the recent WebHDFS+ACLs compat JIRA here, No. My comments was unrelated. but I don't think xattrs will hit the same issues. The xattr functionality is wholly contained within new RPC calls, and AFAIK didn't modify any existing client calls. You have to

Re: hadoop-2.5 - June end?

We should also include extended attributes feature for HDFS from HDFS-2006 for release 2.5. On Mon, Jun 9, 2014 at 9:39 AM, Arun C Murthy a...@hortonworks.com wrote: Folks, As you can see from the Roadmap wiki, it looks like several items are still a bit away from being ready. I think

Re: [VOTE] Merge fs-encryption branch to trunk

+1 (binding) This is a very important feature. I have gone through the design in detail. I have also discussed the details of design and needed as follow up with the team (I will post the details in the jira). The follow up items should not hold up merging this feature to trunk and can be done

Re: Updates on migration to git

Karthik, I would like to see detailed information on how this migration will be done, how it will affect the existing project and commit process. This should be done in a document that can be reviewed instead of in an email thread on an ad-hoc basis. Was there any voting on this in PMC and should

Re: Updates on migration to git

, Suresh Srinivas sur...@hortonworks.com wrote: Karthik, I would like to see detailed information on how this migration will be done, how it will affect the existing project and commit process. This should be done in a document that can be reviewed instead of in an email thread on an ad-hoc

Re: Thinking ahead to hadoop-2.6

I actually would like to see both archival storage and single replica memory writes to be in 2.6 release. Archival storage is in the final stages of getting ready for branch-2 merge as Nicholas has already indicated on the dev mailing list. Hopefully HDFS-6581 gets ready sooner. Both of these

Re: Thinking ahead to hadoop-2.6

to be merged to branch-2. Regards, Tsz-Wo On Wednesday, September 24, 2014 7:00 AM, Suresh Srinivas sur...@hortonworks.com wrote: I actually would like to see both archival storage and single replica memory writes to be in 2.6 release. Archival storage is in the final stages

Re: [VOTE] Merge HDFS-6581 to trunk - Writing to replicas in memory.

On Wed, Sep 24, 2014 at 2:19 PM, Colin McCabe cmcc...@alumni.cmu.edu wrote: On Wed, Sep 24, 2014 at 11:12 AM, Suresh Srinivas sur...@hortonworks.com wrote: Features are done in a separate branch for two reasons: 1) During a feature development the branch may be not functional 2) The high

Re: [DISCUSS] Resolving the divergences for web-related code between branch-2 and trunk

, I plan to merge the related jiras from trunk to branch-2 in the coming days. ~Haohui On Wed, Oct 1, 2014 at 2:35 PM, Suresh Srinivas sur...@hortonworks.com wrote: Sorry for responding very late. I am +1 on removing the JSP UI in branch-2 for the following reasons: 1. The new web UI

Re: [VOTE] Release Apache Hadoop 2.6.0

Tsuyoshi, thanks for bringing up HDFS-6833. However, given it is a boundary condition (and should not cause issues when for files with replication factor 3), we should perhaps target this into 2.6.1 and not block this release. Thoughts? On Mon, Nov 17, 2014 at 4:17 AM, Tsuyoshi OZAWA

Re: [VOTE] Release Apache Hadoop 2.6.0

+1 (binding) Verified the signatures and hashes for both src and binary tars. Built from the source, the binary distribution and the documentation. Started a single node cluster and tested the following: - Started HDFS cluster, verified the hdfs CLI commands such ls, copying data back and forth,

Re: [VOTE] Merging branch HDFS-7240 to trunk

Anu, Jing, Nicholas, Sanjay, Jitendra and many others, thank you for staying focused on this effort. It has been almost 3.5 years since HDFS-7240 was created and all of the work has happened over the years in the open in the feature branch. Storage layer improvements from HDFS-7240 is important

Re: [VOTE] Adopt HDSL as a new Hadoop subproject

+1 (Binding) Regards, Suresh On Tue, Mar 20, 2018 at 11:20 AM, Owen O'Malley wrote: > All, > > Following our discussions on the previous thread (Merging branch HDFS-7240 > to trunk), I'd like to propose the following: > > * HDSL become a subproject of Hadoop. > * HDSL

[jira] Created: (HDFS-463) CreateEditsLog utility broken due to FSImage URL scheme check

Components: tools Affects Versions: 0.21.0 Reporter: Suresh Srinivas Assignee: Suresh Srinivas Fix For: 0.21.0 CreateEditsLog creates editslog using FSImage class. With new URI scheme test added, the utility fails. -- This message is automatically

[jira] Created: (HDFS-677) Rename failure due to quota results in deletion of src directory

Components: name-node Affects Versions: 0.20.1, 0.20.2, 0.21.0, 0.22.0 Reporter: Suresh Srinivas Assignee: Suresh Srinivas Priority: Critical Fix For: 0.20.2, 0.21.0, 0.22.0, 0.20.1 Renaming src to destination where src has exceeded the quota

[jira] Created: (HDFS-709) TestDFSShell failure

TestDFSShell failure Key: HDFS-709 URL: https://issues.apache.org/jira/browse/HDFS-709 Project: Hadoop HDFS Issue Type: Bug Affects Versions: 0.21.0 Reporter: Suresh Srinivas Assignee: Suresh

[jira] Resolved: (HDFS-709) TestDFSShell failure

[ https://issues.apache.org/jira/browse/HDFS-709?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suresh Srinivas resolved HDFS-709. -- Resolution: Fixed Committed this change to both 21 and trunk. TestDFSShell failure

[jira] Resolved: (HDFS-750) TestRename build failure

[ https://issues.apache.org/jira/browse/HDFS-750?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suresh Srinivas resolved HDFS-750. -- Resolution: Fixed Fix Version/s: 0.22.0 Hadoop Flags: [Reviewed] Committed the patch

[jira] Created: (HDFS-750) Build failure

Build failure - Key: HDFS-750 URL: https://issues.apache.org/jira/browse/HDFS-750 Project: Hadoop HDFS Issue Type: Bug Components: build Affects Versions: 0.22.0 Reporter: Suresh Srinivas

[jira] Resolved: (HDFS-540) TestNameNodeMetrics fails intermittently

[ https://issues.apache.org/jira/browse/HDFS-540?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suresh Srinivas resolved HDFS-540. -- Resolution: Cannot Reproduce This test has not been failing for a long time. Will create a new

[jira] Created: (HDFS-897) ReplicasMap remove has a bug in generation stamp comparison

Components: data-node Affects Versions: 0.21.0, 0.22.0 Reporter: Suresh Srinivas Assignee: Suresh Srinivas Fix For: 0.21.0, 0.22.0 In {{ReplicasMap.remove(block)}}, instead of comparing generation stamp of the entry in the map to that of the given block

[jira] Resolved: (HDFS-913) TestRename won't run automatically from 'run-test-hdfs-faul-inject' target

[ https://issues.apache.org/jira/browse/HDFS-913?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suresh Srinivas resolved HDFS-913. -- Resolution: Fixed Release Note: HDFS-913. Rename fault injection test TestRename.java

[jira] Created: (HDFS-1052) HDFS scalability with multiple namenodes

Versions: 0.22.0 Reporter: Suresh Srinivas Assignee: Suresh Srinivas HDFS currently uses a single namenode that limits scalability of the cluster. This jira proposes an architecture to scale the nameservice horizontally using multiple namenodes. -- This message

[jira] Created: (HDFS-1079) HDFS implementation should throw exceptions defined in AbstractFileSystem

Issue Type: New Feature Components: name-node Reporter: Suresh Srinivas Assignee: Suresh Srinivas Fix For: 0.22.0 HDFS implementation Hdfs.java should throw exceptions as defined in AbstractFileSystem. To facilitate this, ClientProtocol should

[jira] Created: (HDFS-1083) Update TestHDFSCLI to not to expect exception class name in the error messages

Issue Type: Improvement Components: test Reporter: Suresh Srinivas Assignee: Suresh Srinivas Priority: Minor Fix For: 0.22.0 With the change from HADOOP-6686, the error messages from FsShell no longer includes redundant exception

[jira] Created: (HDFS-1099) Add test for umask backward compatibility

Reporter: Suresh Srinivas Assignee: Suresh Srinivas Fix For: 0.21.0, 0.22.0 Add tests for changes introduced in HADOOP-6521. -- This message is automatically generated by JIRA. - If you think it was sent incorrectly contact one of the administrators: https

[jira] Resolved: (HDFS-1083) Update TestHDFSCLI to not to expect exception class name in the error messages

[ https://issues.apache.org/jira/browse/HDFS-1083?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suresh Srinivas resolved HDFS-1083. --- Hadoop Flags: [Reviewed] Resolution: Fixed This change cannot be tested until change

[jira] Created: (HDFS-1110) Namenode heap optimization - reuse objects for commonly used file names

Type: Improvement Reporter: Suresh Srinivas Assignee: Suresh Srinivas Fix For: 0.22.0 There are a lot of common file names used in HDFS, mainly created by mapreduce, such as file names starting with part. Reusing byte[] corresponding to these recurring file

[jira] Created: (HDFS-1124) Replace IOException thrown in HDFS implementation to more specific exceptions

Issue Type: Improvement Reporter: Suresh Srinivas Assignee: Suresh Srinivas Fix For: 0.22.0 In HDFS, at several place IOException is thrown. This should be replaced by more specific exception. -- This message is automatically generated by JIRA. - You

[jira] Created: (HDFS-1151) HDFS should throw HadoopIllegalArgumentException instead of IllegalArgumentException

: Hadoop HDFS Issue Type: Bug Affects Versions: 0.22.0 Reporter: Suresh Srinivas Assignee: Suresh Srinivas Fix For: 0.22.0 HDFS should throw HadoopIllegalArgumentException instead of IllegalArgumentException as described in HADOOP-6537

[jira] Created: (HDFS-1250) Namenode accepts block report from dead datanodes

Affects Versions: 0.20.2, 0.22.0 Reporter: Suresh Srinivas Assignee: Suresh Srinivas When a datanode heartbeat times out namenode marks it dead. The subsequent heartbeat from the datanode is rejected with a command to datanode to re-register. However namenode accepts

[jira] Created: (HDFS-1298) Add support in HDFS to update statistics that tracks number of file system operations in FileSystem

-1298 Project: Hadoop HDFS Issue Type: Improvement Affects Versions: 0.22.0 Reporter: Suresh Srinivas Assignee: Suresh Srinivas Fix For: 0.22.0 See HADOOP-6859 for the new statistics. -- This message is automatically generated

[jira] Resolved: (HDFS-974) FileSystem.Statistics should include NN accesses from the clients

[ https://issues.apache.org/jira/browse/HDFS-974?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suresh Srinivas resolved HDFS-974. -- Assignee: Suresh Srinivas (was: Sanjay Radia) Resolution: Duplicate Duplicate of HDFS

[jira] Created: (HDFS-1307) Add start time, end time and total time taken for FSCK to FSCK report

: Improvement Components: name-node, tools Affects Versions: 0.22.0 Reporter: Suresh Srinivas Assignee: Suresh Srinivas FSCK is a long running operation and makes namenode very busy when it runs. Adding information such as start time, end time and time taken

[jira] Created: (HDFS-1315) Remove access log entries generated when FSCK calls listStatus and open methods

Issue Type: Improvement Components: name-node, tools Affects Versions: 0.22.0 Reporter: Suresh Srinivas Assignee: Suresh Srinivas In Yahoo production cluster access logs more than 50% of entries comes from FSCK. FSCK makes same {{Namenode}} method

[jira] Created: (HDFS-1316) Need access log entry to indicate FSCK operation

Need access log entry to indicate FSCK operation Key: HDFS-1316 URL: https://issues.apache.org/jira/browse/HDFS-1316 Project: Hadoop HDFS Issue Type: Improvement Reporter: Suresh

[jira] Created: (HDFS-1318) HDFS Namenode and Datanode WebUI information needs to be accessible programmatically for scripts

Project: Hadoop HDFS Issue Type: New Feature Reporter: Suresh Srinivas Currently Namenode and Datanode web page needs to be scraped by scripts to get this information. Having an interface where this structured information is provided, will help building scripts

[jira] Created: (HDFS-1359) HDFS federation: Add BlockPoolID to block

HDFS federation: Add BlockPoolID to block - Key: HDFS-1359 URL: https://issues.apache.org/jira/browse/HDFS-1359 Project: Hadoop HDFS Issue Type: Sub-task Reporter: Suresh Srinivas

[jira] Resolved: (HDFS-1359) HDFS federation: Add BlockPoolID to block

[ https://issues.apache.org/jira/browse/HDFS-1359?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suresh Srinivas resolved HDFS-1359. --- Resolution: Fixed I committed the patch. HDFS federation: Add BlockPoolID to block

[jira] Created: (HDFS-1395) Add @Override annotation to FSDataset methods that implement FSDatasetInterface

Issue Type: Improvement Reporter: Suresh Srinivas Assignee: Suresh Srinivas Fix For: 0.22.0 @Override annotations are inconsistently added to methods implementing the interface. -- This message is automatically generated by JIRA. - You can reply

[jira] Created: (HDFS-1400) HDFS federation: Introduced block pool ID into DataTransferProtocol

Feature Affects Versions: Federation Branch Reporter: Suresh Srinivas Assignee: Suresh Srinivas Fix For: Federation Branch Block Pool ID needs to be introduced in to DataTransferProtocol -- This message is automatically generated by JIRA. - You can reply

[jira] Created: (HDFS-1433) Fix test failures - TestPread and TestFileLimit

Environment: These test failures were introduced by HDFS-1417 due to removal default contructor in SimulatedFsDataSet. Reporter: Suresh Srinivas Assignee: Suresh Srinivas Fix For: 0.22.0 Attachments: HDFS-1433.patch -- This message is automatically

[jira] Created: (HDFS-1434) Refactor Datanode#startDataNode method

Versions: 0.22.0 Reporter: Suresh Srinivas Assignee: Suresh Srinivas Fix For: 0.22.0 Attachments: HDFS-1434.patch This method is very long, approximately 190 lines. Splitting this method into smaller methods. This also helps in federation where some

[jira] Resolved: (HDFS-1433) Fix test failures - TestPread and TestFileLimit

[ https://issues.apache.org/jira/browse/HDFS-1433?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suresh Srinivas resolved HDFS-1433. --- Resolution: Fixed Fix test failures - TestPread and TestFileLimit

[jira] Resolved: (HDFS-1439) Fix compilation error in TestFiHftp

[ https://issues.apache.org/jira/browse/HDFS-1439?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suresh Srinivas resolved HDFS-1439. --- Resolution: Fixed Hadoop Flags: [Reviewed] Boris, thanks for the review. I committed

[jira] Created: (HDFS-1547) Improve decommission mechanism

Reporter: Suresh Srinivas Assignee: Suresh Srinivas Fix For: 0.23.0 Current decommission mechanism driven using exclude file has several issues. This bug proposes some changes in the mechanism for better manageability. See the proposal in the next comment

[jira] Resolved: (HDFS-1586) Add InterfaceAudience annotation to MiniDFSCluster

[ https://issues.apache.org/jira/browse/HDFS-1586?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suresh Srinivas resolved HDFS-1586. --- Resolution: Fixed I committed the patch. Add InterfaceAudience annotation to MiniDFSCluster

[jira] Resolved: (HDFS-1588) Add dfs.hosts.exclude to DFSConfigKeys and use constant in stead of hardcoded string

[ https://issues.apache.org/jira/browse/HDFS-1588?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suresh Srinivas resolved HDFS-1588. --- Resolution: Fixed Hadoop Flags: [Reviewed] I committed the patch. Thank you Erik. Add

[jira] Resolved: (HDFS-1450) HDFS federation: Introduce block pool ID into FSDatasetInterface

[ https://issues.apache.org/jira/browse/HDFS-1450?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suresh Srinivas resolved HDFS-1450. --- Resolution: Fixed Hadoop Flags: [Reviewed] I committed the patch. HDFS federation

[jira] Resolved: (HDFS-1632) HDFS Federation: data node storage structure changes and introduce block pool storage for Federation.

[ https://issues.apache.org/jira/browse/HDFS-1632?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suresh Srinivas resolved HDFS-1632. --- Resolution: Fixed Hadoop Flags: [Reviewed] I committed the patch. Thank you Tanping

[jira] Created: (HDFS-1645) DatanodeCommand Finalize sent from namenode to datanode must include block pool ID

: Hadoop HDFS Issue Type: Sub-task Components: data-node, name-node Affects Versions: Federation Branch Reporter: Suresh Srinivas Assignee: Suresh Srinivas Fix For: Federation Branch With federation, a namenode finalizes a block pool

[jira] Created: (HDFS-1646) MiniDFSCluster#waitActive() waits for ever in federation

Components: test Affects Versions: Federation Branch Reporter: Suresh Srinivas Assignee: Suresh Srinivas Fix For: Federation Branch Tests where datanodes are expected to fail, hang in federation. -- This message is automatically generated by JIRA. - For more

[jira] Resolved: (HDFS-1645) DatanodeCommand Finalize sent from namenode to datanode must include block pool ID

[ https://issues.apache.org/jira/browse/HDFS-1645?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suresh Srinivas resolved HDFS-1645. --- Resolution: Fixed Hadoop Flags: [Reviewed] I committed the patch DatanodeCommand

[jira] Created: (HDFS-1654) Fix TestDFSUpgrade? and TestDFSRollback? failures.

Affects Versions: Federation Branch Reporter: Suresh Srinivas Assignee: Suresh Srinivas Fix For: 0.21.1, Federation Branch TestDFSUpgrade, TestDFSUpgradeFromImage and TestDFSRollback fail -- This message is automatically generated by JIRA. - For more

[jira] Resolved: (HDFS-1648) Federation: Only DataStorage must be locked using in_use.lock and no locks must be associated with BlockPoolStorage

[ https://issues.apache.org/jira/browse/HDFS-1648?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suresh Srinivas resolved HDFS-1648. --- Resolution: Fixed Hadoop Flags: [Reviewed] I committed the patch. Thank you Tanping

[jira] Created: (HDFS-1657) Tests that corrupt block files fail due to changed block pool file path in federation

: Hadoop HDFS Issue Type: Sub-task Components: test Affects Versions: Federation Branch Reporter: Suresh Srinivas Assignee: Suresh Srinivas Fix For: Federation Branch Previously block files were stored under stroage directory/current

[jira] Resolved: (HDFS-1657) HDFS Federation: Tests that corrupt block files fail due to changed block pool file path in federation

[ https://issues.apache.org/jira/browse/HDFS-1657?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suresh Srinivas resolved HDFS-1657. --- Resolution: Fixed Hadoop Flags: [Reviewed] I committed the patch. HDFS Federation

[jira] Resolved: (HDFS-1651) Tests fail due to null pointer exception in Datanode#shutdown()

[ https://issues.apache.org/jira/browse/HDFS-1651?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suresh Srinivas resolved HDFS-1651. --- Resolution: Fixed Hadoop Flags: [Reviewed] I committed the patch. Thank you Tanping

[jira] Created: (HDFS-1669) Datanode servlets need information about the namenode to service the request

Issue Type: Sub-task Components: data-node, name-node Affects Versions: Federation Branch Reporter: Suresh Srinivas Assignee: Suresh Srinivas Fix For: Federation Branch Prior to federation datanode had only one namenode. In servlets hosted

[jira] Created: (HDFS-1673) Datanode changes to track block token secret per namenode.

Components: data-node, name-node Affects Versions: Federation Branch Reporter: Suresh Srinivas Assignee: Suresh Srinivas Fix For: Federation Branch Datanode currently keeps track of a single block token secret. Given datanode talks to multiple namenodes

[jira] Resolved: (HDFS-1646) HDFS Federation: MiniDFSCluster#waitActive() waits for ever in federation

[ https://issues.apache.org/jira/browse/HDFS-1646?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suresh Srinivas resolved HDFS-1646. --- Resolution: Fixed Hadoop Flags: [Reviewed] I committed the patch. HDFS Federation

[jira] Resolved: (HDFS-1659) HDFS Federation: BPOfferService exits after the first iteration of the loop

[ https://issues.apache.org/jira/browse/HDFS-1659?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suresh Srinivas resolved HDFS-1659. --- Resolution: Fixed Hadoop Flags: [Reviewed] I committed the patch. HDFS Federation

[jira] Resolved: (HDFS-1654) HDFS Federation: Fix TestDFSUpgrade and TestDFSRollback failures.

[ https://issues.apache.org/jira/browse/HDFS-1654?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suresh Srinivas resolved HDFS-1654. --- Resolution: Fixed Hadoop Flags: [Reviewed] I committed the patch. HDFS Federation

[jira] Resolved: (HDFS-1668) Federation: Datanode needs to send block pool usage information in registration

[ https://issues.apache.org/jira/browse/HDFS-1668?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suresh Srinivas resolved HDFS-1668. --- Resolution: Fixed Hadoop Flags: [Reviewed] I committed the patch. Federation

[jira] Resolved: (HDFS-1669) Federation: Datanode servlets need information about the namenode to service the request

[ https://issues.apache.org/jira/browse/HDFS-1669?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suresh Srinivas resolved HDFS-1669. --- Resolution: Fixed Hadoop Flags: [Reviewed] I committed the change. Federation

[jira] Resolved: (HDFS-1652) HDFS-Federation: Add support for multiple namenodes in MiniDFSCluster

[ https://issues.apache.org/jira/browse/HDFS-1652?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suresh Srinivas resolved HDFS-1652. --- Resolution: Fixed Hadoop Flags: [Reviewed] I committed the patch. HDFS-Federation

[jira] Resolved: (HDFS-1674) HDFS Federation: Rename BlockPool class to BlockPoolSlice

[ https://issues.apache.org/jira/browse/HDFS-1674?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suresh Srinivas resolved HDFS-1674. --- Resolution: Fixed Hadoop Flags: [Reviewed] I committed the patch. Thank you Jakob

[jira] Resolved: (HDFS-1677) HDF federation: Fix TestFsck and TestListCorruptFileBlocks failures

[ https://issues.apache.org/jira/browse/HDFS-1677?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suresh Srinivas resolved HDFS-1677. --- Resolution: Fixed Hadoop Flags: [Reviewed] I committed the patch. Thank you Tanping

[jira] Created: (HDFS-1693) TestDFSStorageStateRecovery fails

Branch Reporter: Suresh Srinivas Assignee: Suresh Srinivas Fix For: Federation Branch The test tests recovery of a datanode by setting up different combination of directories under storage directory - current, previous, previous.tmp, removed.tmp etc

[jira] Resolved: (HDFS-1699) HDFS Federation: fix failure of TestBlockReport

[ https://issues.apache.org/jira/browse/HDFS-1699?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suresh Srinivas resolved HDFS-1699. --- Resolution: Fixed Hadoop Flags: [Reviewed] I committed the patch. HDFS Federation

[jira] Resolved: (HDFS-1664) HDFS federation :Add new
 column
s of Block
Pool
Used 
and
 Block
Pool
Used
%
 into JSP

[ https://issues.apache.org/jira/browse/HDFS-1664?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suresh Srinivas resolved HDFS-1664. --- Resolution: Fixed Hadoop Flags: [Reviewed] I committed the patch. Thank you Tanping

[jira] Created: (HDFS-1704) Add a tool that lists namenodes, secondary and backup nodes from the configuration file

Project: Hadoop HDFS Issue Type: Sub-task Components: tools Affects Versions: Federation Branch Reporter: Suresh Srinivas Assignee: Suresh Srinivas Fix For: Federation Branch Image of Suresh Srinivas In federation, a tool is needed to list

[jira] Resolved: (HDFS-1702) HDFS federation : Fix TestBackupNode and TestRefreshNamenodes test failure.

[ https://issues.apache.org/jira/browse/HDFS-1702?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suresh Srinivas resolved HDFS-1702. --- Resolution: Fixed Hadoop Flags: [Reviewed] I committed the patch. HDFS federation

[jira] Resolved: (HDFS-1704) Federation: Add a tool that lists namenodes, secondary and backup nodes from the configuration file

[ https://issues.apache.org/jira/browse/HDFS-1704?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suresh Srinivas resolved HDFS-1704. --- Resolution: Fixed Hadoop Flags: [Reviewed] I committed the patch Federation: Add

[jira] Created: (HDFS-1716) Federation: Add decommission tests for federated namenodes

Components: test Affects Versions: Federation Branch Reporter: Suresh Srinivas Assignee: Suresh Srinivas Fix For: Federation Branch Need a tests for decommissioning that uses a cluster with multiple federated namenodes. -- This message is automatically

[jira] Created: (HDFS-1718) HDFS Federation: MiniDFSCluster#waitActive() bug causes some tests to fail

Issue Type: Sub-task Components: test Affects Versions: Federation Branch Reporter: Suresh Srinivas Assignee: Suresh Srinivas Fix For: Federation Branch MiniDFSCluster#shouldWait() method waits for all the datanodes to come up and register

[jira] Created: (HDFS-1719) Federation: TestDFSRemove fails intermittently

Affects Versions: Federation Branch Reporter: Suresh Srinivas Assignee: Suresh Srinivas Fix For: Federation Branch This failure is due to Datanode#datanodeId being seen as null by another thread. Datanode#datanodeId access is not synchronized. It has many

[jira] Created: (HDFS-1720) Federation: FSVolumeSet volumes is not synchronized correctly

Components: data-node Affects Versions: Federation Branch Reporter: Suresh Srinivas Assignee: Suresh Srinivas Fix For: Federation Branch Attachments: HDFS-1720.patch Currently FSVolumeSet#volumes is package private and is exposed to outside

[jira] Resolved: (HDFS-1717) Federation: FSDataset volumeMap access is not correctly synchronized

[ https://issues.apache.org/jira/browse/HDFS-1717?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suresh Srinivas resolved HDFS-1717. --- Resolution: Fixed Hadoop Flags: [Reviewed] I committed the patch. Federation

[jira] Resolved: (HDFS-1722) HDFS Federation: Add flag to MiniDFSCluster to differentiate between two different modes-Federation and not.

[ https://issues.apache.org/jira/browse/HDFS-1722?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suresh Srinivas resolved HDFS-1722. --- Resolution: Fixed Hadoop Flags: [Reviewed] I committed the patch. Thank you Boris

[jira] Resolved: (HDFS-1718) HDFS Federation: MiniDFSCluster#waitActive() bug causes some tests to fail

[ https://issues.apache.org/jira/browse/HDFS-1718?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suresh Srinivas resolved HDFS-1718. --- Resolution: Fixed Hadoop Flags: [Reviewed] I committed the patch. HDFS Federation

[jira] Resolved: (HDFS-1700) Federation: fsck needs to work with federation configuration

[ https://issues.apache.org/jira/browse/HDFS-1700?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suresh Srinivas resolved HDFS-1700. --- Resolution: Fixed Hadoop Flags: [Reviewed] +1 for the change. I committed the patch

[jira] Resolved: (HDFS-1635) Federation: Bump up LAYOUT_VERSION in FSConstants.java for Federation before committing to trunk

[ https://issues.apache.org/jira/browse/HDFS-1635?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suresh Srinivas resolved HDFS-1635. --- Resolution: Duplicate duplicate of HDFS-1737. Federation: Bump up LAYOUT_VERSION

[jira] Resolved: (HDFS-1737) Federation: Update the layout version for federation changes

[ https://issues.apache.org/jira/browse/HDFS-1737?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suresh Srinivas resolved HDFS-1737. --- Resolution: Fixed Hadoop Flags: [Reviewed] I committed the patch. Federation: Update

[jira] Resolved: (HDFS-1662) HDFS federation: fix unit test case, TestCheckpoint and TestDataNodeMXBean

[ https://issues.apache.org/jira/browse/HDFS-1662?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suresh Srinivas resolved HDFS-1662. --- Resolution: Fixed Hadoop Flags: [Reviewed] This issue is resolved. Thank you Tanping

[jira] Resolved: (HDFS-1694) Federation: SimulatedFSDataset changes to work with federation and multiple block pools

[ https://issues.apache.org/jira/browse/HDFS-1694?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suresh Srinivas resolved HDFS-1694. --- Resolution: Fixed Hadoop Flags: [Reviewed] I committed the patch. Federation

[jira] Resolved: (HDFS-1719) Federation: TestDFSRemove fails intermittently

[ https://issues.apache.org/jira/browse/HDFS-1719?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suresh Srinivas resolved HDFS-1719. --- Resolution: Fixed Hadoop Flags: [Reviewed] I committed the patch. Federation

[jira] Resolved: (HDFS-1716) Federation: Add decommission tests for federated namenodes

[ https://issues.apache.org/jira/browse/HDFS-1716?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suresh Srinivas resolved HDFS-1716. --- Resolution: Fixed Hadoop Flags: [Reviewed] I committed the patch. Federation: Add

[jira] Resolved: (HDFS-1720) Federation: FSVolumeSet volumes is not synchronized correctly

[ https://issues.apache.org/jira/browse/HDFS-1720?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suresh Srinivas resolved HDFS-1720. --- Resolution: Fixed Hadoop Flags: [Reviewed] I committed this patch. Federation

[jira] Resolved: (HDFS-1688) Federation: Fix failures in fault injection tests, TestDiskError, TestDatanodeRestart and TestDFSTartupVersions.

[ https://issues.apache.org/jira/browse/HDFS-1688?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suresh Srinivas resolved HDFS-1688. --- Resolution: Fixed Hadoop Flags: [Reviewed] I have committed this patch. Federation

[jira] Created: (HDFS-1745) Federation: fix fault injection test build failure

-node, test Affects Versions: Federation Branch Reporter: Suresh Srinivas Assignee: Suresh Srinivas Fix For: Federation Branch -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] Resolved: (HDFS-1744) Federation: Add new layout version to offline image/edits viewer

[ https://issues.apache.org/jira/browse/HDFS-1744?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suresh Srinivas resolved HDFS-1744. --- Resolution: Fixed Hadoop Flags: [Reviewed] I committed the patch. Federation: Add new

[jira] Resolved: (HDFS-1745) Federation: fix fault injection test build failure

[ https://issues.apache.org/jira/browse/HDFS-1745?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suresh Srinivas resolved HDFS-1745. --- Resolution: Fixed Release Note: (was: HDFS-1719 removed Datanode#datanodeID

[jira] Resolved: (HDFS-1703) HDFS federation: Improve start/stop scripts and add script to decommission datanodes

[ https://issues.apache.org/jira/browse/HDFS-1703?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suresh Srinivas resolved HDFS-1703. --- Resolution: Fixed Hadoop Flags: [Reviewed] Committed the patch. Thank you Tanping

[jira] [Resolved] (HDFS-1758) Web UI JSP pages thread safety issue

[ https://issues.apache.org/jira/browse/HDFS-1758?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suresh Srinivas resolved HDFS-1758. --- Resolution: Fixed I committed the patch. Thank you Tanping. Web UI JSP pages thread safety

[jira] [Resolved] (HDFS-1822) Editlog opcodes overlap between 20 security and later releases

[ https://issues.apache.org/jira/browse/HDFS-1822?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suresh Srinivas resolved HDFS-1822. --- Resolution: Won't Fix Editlog opcodes overlap between 20 security and later releases

[jira] [Created] (HDFS-1831) FileContext createFlag combinations during create are not clearly defined

Issue Type: Improvement Components: name-node Affects Versions: 0.22.0, 0.23.0 Reporter: Suresh Srinivas Assignee: Suresh Srinivas Fix For: 0.23.0 During file creation with FileContext, the expected behavior is not clearly defined for combination

[jira] [Created] (HDFS-1832) FSNamesystem#startFileInternal unnecessarily traverses the directory multiple times

: Hadoop HDFS Issue Type: Improvement Components: name-node Affects Versions: 0.22.0, 0.23.0 Reporter: Suresh Srinivas Assignee: Suresh Srinivas Fix For: 0.23.0 FSNamesystem#startFileIntrnal looks up Inode for a given path multiple times

[jira] [Resolved] (HDFS-1842) Cannot upgrade 0.20.203 to 0.21 with an editslog present

[ https://issues.apache.org/jira/browse/HDFS-1842?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suresh Srinivas resolved HDFS-1842. --- Resolution: Fixed Release Note: I committed the patch. Konstantin, I wanted to commit

[jira] [Resolved] (HDFS-1397) HDFS federation: Storage directory of VERSION(/ID) file

[ https://issues.apache.org/jira/browse/HDFS-1397?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suresh Srinivas resolved HDFS-1397. --- Resolution: Fixed This has been addressed by other subtasks in HDFS-1052. HDFS federation

<    1   2   3   4   5   >