[jira] [Created] (HDFS-6699) Secure Windows DFS read when client co-located on nodes with data (short-circuit reads)

Remus Rusanu created HDFS-6699: -- Summary: Secure Windows DFS read when client co-located on nodes with data (short-circuit reads) Key: HDFS-6699 URL: https://issues.apache.org/jira/browse/HDFS-6699

[jira] [Created] (HDFS-6700) BlockPlacementPolicy shoud choose storage but not datanode for deletion

Tsz Wo Nicholas Sze created HDFS-6700: - Summary: BlockPlacementPolicy shoud choose storage but not datanode for deletion Key: HDFS-6700 URL: https://issues.apache.org/jira/browse/HDFS-6700

[jira] [Resolved] (HDFS-6671) Archival Storage: Consider block storage policy in replicaiton

[ https://issues.apache.org/jira/browse/HDFS-6671?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze resolved HDFS-6671. --- Resolution: Fixed Fix Version/s: Archival Storage (HDFS-6584) Hadoop

Build failed in Jenkins: Hadoop-Hdfs-trunk #1807

See https://builds.apache.org/job/Hadoop-Hdfs-trunk/1807/changes Changes: [cnauroth] HADOOP-10840. Fix OutOfMemoryError caused by metrics system in Azure File System. Contributed by Shanyu Zhao. [jianhe] YARN-2219. Addendum patch for YARN-2219 [wang] HADOOP-10816. KeyShell returns -1 on error

Hadoop-Hdfs-trunk - Build # 1807 - Still Failing

See https://builds.apache.org/job/Hadoop-Hdfs-trunk/1807/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 13874 lines...] [INFO] [INFO] ---

[jira] [Resolved] (HDFS-6611) secure components have the wrong pid in their files

[ https://issues.apache.org/jira/browse/HDFS-6611?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HDFS-6611. Resolution: Duplicate I've provided a workaround in HADOOP-9902. secure components have

[jira] [Resolved] (HDFS-315) Allow simplified versioning for namenode and datanode metadata.

[ https://issues.apache.org/jira/browse/HDFS-315?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HDFS-315. --- Resolution: Fixed I'm going to resolve this since FSimage and buddies have been version-ed for

[jira] [Resolved] (HDFS-188) DFS web UI does should have TAIL this block option

[ https://issues.apache.org/jira/browse/HDFS-188?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HDFS-188. --- Resolution: Won't Fix I'm going to close this as Won't Fix. Tailing a file provides a

[jira] [Resolved] (HDFS-318) Building Hadoop results in a lot of warnings

[ https://issues.apache.org/jira/browse/HDFS-318?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HDFS-318. --- Resolution: Incomplete I'm going to close this out as stale. A new jira should be re-opened

[jira] [Resolved] (HDFS-25) The FSDirectory should not have waitForReady

[ https://issues.apache.org/jira/browse/HDFS-25?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HDFS-25. -- Resolution: Incomplete I'm going to close this out as stale. I suspect this is no longer an

[jira] [Resolved] (HDFS-149) TestDFSUpgrade fails once in a while

[ https://issues.apache.org/jira/browse/HDFS-149?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HDFS-149. --- Resolution: Fixed I'm going to close this out as stale. I suspect this is no longer an issue.

[jira] [Resolved] (HDFS-68) TestDFSUpgrade fails sporadically in nightly and patch builds

[ https://issues.apache.org/jira/browse/HDFS-68?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HDFS-68. -- Resolution: Incomplete Stale. Closing TestDFSUpgrade fails sporadically in nightly and patch

[jira] [Resolved] (HDFS-242) Improve debugabillity

[ https://issues.apache.org/jira/browse/HDFS-242?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HDFS-242. --- Resolution: Incomplete I'm going to close this as stale. Many more metrics are now pumped up

[jira] [Resolved] (HDFS-180) namenode -format does not reset version

[ https://issues.apache.org/jira/browse/HDFS-180?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HDFS-180. --- Resolution: Fixed Fairly confident this has been fixed. namenode -format does not reset

[jira] [Resolved] (HDFS-295) Update the how to configure HDFS documentation to include new features

[ https://issues.apache.org/jira/browse/HDFS-295?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HDFS-295. --- Resolution: Fixed ... and in 7 years, no one has been able to configure this stuff. ;)

[jira] [Resolved] (HDFS-261) Side classes should be moved to separate files

[ https://issues.apache.org/jira/browse/HDFS-261?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HDFS-261. --- Resolution: Incomplete Given the number of changes in source code layout, the switch to maven,

[jira] [Resolved] (HDFS-390) Hadoop daemons should support generic command-line options by implementing the Tool interface

[ https://issues.apache.org/jira/browse/HDFS-390?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HDFS-390. --- Resolution: Fixed This was done a long time ago. Hadoop daemons should support generic

[jira] [Resolved] (HDFS-354) Data node process consumes 180% cpu

[ https://issues.apache.org/jira/browse/HDFS-354?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HDFS-354. --- Resolution: Fixed I'm going to close this out as stale. There has been a lot of reworking of

[jira] [Resolved] (HDFS-170) TestCrcCorruption sometimes fails

[ https://issues.apache.org/jira/browse/HDFS-170?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HDFS-170. --- Resolution: Fixed I'm going to close this as stale. TestCrcCorruption sometimes fails

[jira] [Resolved] (HDFS-150) Replication should be decoupled from heartbeat

[ https://issues.apache.org/jira/browse/HDFS-150?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HDFS-150. --- Resolution: Fixed Closing as fixed then! Replication should be decoupled from heartbeat

[jira] [Resolved] (HDFS-270) DFS Upgrade should process dfs.data.dirs in parallel

[ https://issues.apache.org/jira/browse/HDFS-270?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth resolved HDFS-270. Resolution: Won't Fix I agree with resolving this. I'm resolving this as won't fix, but others can

[jira] [Resolved] (HDFS-281) Explore usage of the sendfile api via java.nio.channels.FileChannel.transfer{To|From} for i/o in datanodes

[ https://issues.apache.org/jira/browse/HDFS-281?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HDFS-281. --- Resolution: Won't Fix I'm going to close this as a duplicate of HDFS-2246. While the path

[jira] [Resolved] (HDFS-383) Modify datanode configs to specify minimum JVM heapsize

[ https://issues.apache.org/jira/browse/HDFS-383?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HDFS-383. --- Resolution: Fixed This was fixed with the introduction of HADOOP_DATANODE_OPTS and related env

[jira] [Resolved] (HDFS-356) Short -metasave option

[ https://issues.apache.org/jira/browse/HDFS-356?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HDFS-356. --- Resolution: Fixed I'm going to close out given that a lot/most/all of this information is

[jira] [Resolved] (HDFS-32) testFilePermissions in TestDFSShell should shut down the mini dfs cluster when there is an error

[ https://issues.apache.org/jira/browse/HDFS-32?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HDFS-32. -- Resolution: Fixed Likely a stale issue and fixed long ago. testFilePermissions in TestDFSShell

[jira] [Resolved] (HDFS-54) datanode not failing when read-only filesystem

[ https://issues.apache.org/jira/browse/HDFS-54?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HDFS-54. -- Resolution: Fixed Fairly confident this has been fixed. datanode not failing when read-only

[jira] [Resolved] (HDFS-24) FSDataOutputStream should flush last partial CRC chunk

[ https://issues.apache.org/jira/browse/HDFS-24?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HDFS-24. -- Resolution: Fixed I'd be greatly surprised if this wasn't fixed by now. FSDataOutputStream

[jira] [Resolved] (HDFS-363) list of dead nodes with time information

[ https://issues.apache.org/jira/browse/HDFS-363?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HDFS-363. --- Resolution: Duplicate Closing as a dupe, then. list of dead nodes with time information

[jira] [Resolved] (HDFS-137) DataNode should clean up temporary files when writeBlock fails.

[ https://issues.apache.org/jira/browse/HDFS-137?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HDFS-137. --- Resolution: Fixed This has likely been fixed by now. DataNode should clean up temporary

[jira] [Resolved] (HDFS-374) HDFS needs to support a very large number of open files.

[ https://issues.apache.org/jira/browse/HDFS-374?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HDFS-374. --- Resolution: Fixed I'm going to resolve this as stale. There is a good chance this issue might

[jira] [Resolved] (HDFS-306) FSNamesystem.shutdown() should be a part of FSNamesystem.close()

[ https://issues.apache.org/jira/browse/HDFS-306?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HDFS-306. --- Resolution: Fixed I'm sure is this is fixed by now. FSNamesystem.shutdown() should be a part

[jira] [Resolved] (HDFS-337) Name collision for AccessControlException.

[ https://issues.apache.org/jira/browse/HDFS-337?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HDFS-337. --- Resolution: Won't Fix Closing as won't fix, assuming we haven't already. Name collision for

[jira] [Resolved] (HDFS-296) Serial streaming performance should be Math.min(ideal client performance, ideal serial hdfs performance)

[ https://issues.apache.org/jira/browse/HDFS-296?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HDFS-296. --- Resolution: Incomplete I'm going to close this as stale given how many changes have happened

[jira] [Created] (HDFS-6701) Make seed optional NetworkTopology#sortByDistance

Ashwin Shankar created HDFS-6701: Summary: Make seed optional NetworkTopology#sortByDistance Key: HDFS-6701 URL: https://issues.apache.org/jira/browse/HDFS-6701 Project: Hadoop HDFS Issue

[jira] [Created] (HDFS-6702) DFSClient should create blocks using StorageType

Tsz Wo Nicholas Sze created HDFS-6702: - Summary: DFSClient should create blocks using StorageType Key: HDFS-6702 URL: https://issues.apache.org/jira/browse/HDFS-6702 Project: Hadoop HDFS

[jira] [Created] (HDFS-6703) NFS: Files can be deleted from a read-only mount

Abhiraj Butala created HDFS-6703: Summary: NFS: Files can be deleted from a read-only mount Key: HDFS-6703 URL: https://issues.apache.org/jira/browse/HDFS-6703 Project: Hadoop HDFS Issue

[jira] [Created] (HDFS-6704) Fix the command to launch JournalNode in HDFS-HA document

Akira AJISAKA created HDFS-6704: --- Summary: Fix the command to launch JournalNode in HDFS-HA document Key: HDFS-6704 URL: https://issues.apache.org/jira/browse/HDFS-6704 Project: Hadoop HDFS

[jira] [Resolved] (HDFS-250) Save (sync) journal (fsimage) to alternate/secondary/read-only name node

[ https://issues.apache.org/jira/browse/HDFS-250?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HDFS-250. --- Resolution: Fixed This has been fixed a few different ways, most recently with the QJM. Save

[jira] [Resolved] (HDFS-134) premature end-of-decommission of datanodes

[ https://issues.apache.org/jira/browse/HDFS-134?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HDFS-134. --- Resolution: Fixed This has probably been fixed. Gonna close this as stale. premature

[jira] [Resolved] (HDFS-80) Rename of a directory with many opened files blocks name-node for a long time. changeLease() to blame.

[ https://issues.apache.org/jira/browse/HDFS-80?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HDFS-80. -- Resolution: Incomplete Closing this as stale. Rename of a directory with many opened files

[jira] [Resolved] (HDFS-370) Bad block reports should include the cause

[ https://issues.apache.org/jira/browse/HDFS-370?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HDFS-370. --- Resolution: Fixed Closing this as stale. Bad block reports should include the cause

[jira] [Resolved] (HDFS-305) Namenode couldn't execute when the user name contains a space

[ https://issues.apache.org/jira/browse/HDFS-305?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HDFS-305. --- Resolution: Incomplete Closing this as stale. Namenode couldn't execute when the user name

[jira] [Resolved] (HDFS-2255) Improve NameNode metrics to distinguish between InodeDirectory and InodeFiles

[ https://issues.apache.org/jira/browse/HDFS-2255?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HDFS-2255. Resolution: Incomplete Closing as stale. Improve NameNode metrics to distinguish between

[jira] [Resolved] (HDFS-171) Redundant error logging in FSNamesystem.

[ https://issues.apache.org/jira/browse/HDFS-171?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HDFS-171. --- Resolution: Incomplete Closing this as stale. Redundant error logging in FSNamesystem.

[jira] [Resolved] (HDFS-293) Remove code related to conversion of name-node and data-node storage directories to the format introduced in hadoop 0.13

[ https://issues.apache.org/jira/browse/HDFS-293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HDFS-293. --- Resolution: Won't Fix Anyone still using 0.13 and earlier is probably living in a cave.