[jira] [Commented] (HDFS-4940) namenode OOMs under Bigtop's TestCLI

[ https://issues.apache.org/jira/browse/HDFS-4940?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13701800#comment-13701800 ] Roman Shaposhnik commented on HDFS-4940: [~sureshms] Suresh, sorry for the belated

[jira] [Commented] (HDFS-4278) The DFS_BLOCK_ACCESS_TOKEN_ENABLE config should be automatically turned on when security is enabled.

[ https://issues.apache.org/jira/browse/HDFS-4278?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13701835#comment-13701835 ] Harsh J commented on HDFS-4278: --- Suresh - Given the security won't work without it, why log

[jira] [Commented] (HDFS-353) DFSClient could throw a FileNotFound exception when a file could not be opened

[ https://issues.apache.org/jira/browse/HDFS-353?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13701909#comment-13701909 ] Steve Loughran commented on HDFS-353: - Its the specific case of: metadata exists, but

[jira] [Commented] (HDFS-4645) Move from randomly generated block ID to sequentially generated block ID

[ https://issues.apache.org/jira/browse/HDFS-4645?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13701927#comment-13701927 ] Hudson commented on HDFS-4645: -- Integrated in Hadoop-Yarn-trunk #264 (See

[jira] [Commented] (HDFS-4645) Move from randomly generated block ID to sequentially generated block ID

[ https://issues.apache.org/jira/browse/HDFS-4645?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13701986#comment-13701986 ] Hudson commented on HDFS-4645: -- Integrated in Hadoop-Hdfs-trunk #1454 (See

[jira] [Commented] (HDFS-4645) Move from randomly generated block ID to sequentially generated block ID

[ https://issues.apache.org/jira/browse/HDFS-4645?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13701991#comment-13701991 ] Hudson commented on HDFS-4645: -- Integrated in Hadoop-Mapreduce-trunk #1481 (See

[jira] [Created] (HDFS-4962) Use enum for nfs constants

Tsz Wo (Nicholas), SZE created HDFS-4962: Summary: Use enum for nfs constants Key: HDFS-4962 URL: https://issues.apache.org/jira/browse/HDFS-4962 Project: Hadoop HDFS Issue Type:

[jira] [Updated] (HDFS-4943) WebHdfsFileSystem does not work when original file path has encoded chars

[ https://issues.apache.org/jira/browse/HDFS-4943?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Parker updated HDFS-4943: Attachment: HDFS-4943-b023.patch Patch for branch-0.23 WebHdfsFileSystem does not

[jira] [Commented] (HDFS-4278) The DFS_BLOCK_ACCESS_TOKEN_ENABLE config should be automatically turned on when security is enabled.

[ https://issues.apache.org/jira/browse/HDFS-4278?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13702089#comment-13702089 ] Suresh Srinivas commented on HDFS-4278: --- bq. Suresh - Given the security won't work

[jira] [Resolved] (HDFS-3182) Add class to manage JournalList

[ https://issues.apache.org/jira/browse/HDFS-3182?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon resolved HDFS-3182. --- Resolution: Won't Fix This was obsoleted by other work in HDFS-3077 Add class to

[jira] [Commented] (HDFS-3092) Enable journal protocol based editlog streaming for standby namenode

[ https://issues.apache.org/jira/browse/HDFS-3092?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13702147#comment-13702147 ] Todd Lipcon commented on HDFS-3092: --- Hey folks. Is anyone still working on this given

[jira] [Updated] (HDFS-4879) Add blocked ArrayList collection to avoid CMS full GCs

[ https://issues.apache.org/jira/browse/HDFS-4879?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon updated HDFS-4879: -- Attachment: hdfs-4879.txt New patch changes ChunkedArrayList to extend AbstractList, which just throws

[jira] [Updated] (HDFS-4879) Add blocked ArrayList collection to avoid CMS full GCs

[ https://issues.apache.org/jira/browse/HDFS-4879?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon updated HDFS-4879: -- Status: Patch Available (was: Open) Add blocked ArrayList collection to avoid CMS full GCs

[jira] [Resolved] (HDFS-3092) Enable journal protocol based editlog streaming for standby namenode

[ https://issues.apache.org/jira/browse/HDFS-3092?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suresh Srinivas resolved HDFS-3092. --- Resolution: Won't Fix Enable journal protocol based editlog streaming for standby

[jira] [Commented] (HDFS-3092) Enable journal protocol based editlog streaming for standby namenode

[ https://issues.apache.org/jira/browse/HDFS-3092?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13702260#comment-13702260 ] Suresh Srinivas commented on HDFS-3092: --- Lets close this. If any work is needed, we

[jira] [Updated] (HDFS-4905) Add appendToFile command to hdfs dfs

[ https://issues.apache.org/jira/browse/HDFS-4905?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-4905: Attachment: HDFS-4905.003.patch Fix findbugs warning. Add appendToFile command to

[jira] [Commented] (HDFS-4879) Add blocked ArrayList collection to avoid CMS full GCs

[ https://issues.apache.org/jira/browse/HDFS-4879?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13702372#comment-13702372 ] Hadoop QA commented on HDFS-4879: - {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-4817) make HDFS advisory caching configurable on a per-file basis

[ https://issues.apache.org/jira/browse/HDFS-4817?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13702417#comment-13702417 ] Colin Patrick McCabe commented on HDFS-4817: 1,2,4: fixed 3: I think

[jira] [Commented] (HDFS-4905) Add appendToFile command to hdfs dfs

[ https://issues.apache.org/jira/browse/HDFS-4905?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13702430#comment-13702430 ] Hadoop QA commented on HDFS-4905: - {color:green}+1 overall{color}. Here are the results of

[jira] [Updated] (HDFS-4841) FsShell commands using secure webhfds fail ClientFinalizer shutdown hook

[ https://issues.apache.org/jira/browse/HDFS-4841?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Kanter updated HDFS-4841: Attachment: HDFS-4841.patch The problem was basically that in the shutdown hook, we'd try to get

[jira] [Updated] (HDFS-4841) FsShell commands using secure webhfds fail ClientFinalizer shutdown hook

[ https://issues.apache.org/jira/browse/HDFS-4841?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Kanter updated HDFS-4841: Status: Patch Available (was: Open) FsShell commands using secure webhfds fail

[jira] [Commented] (HDFS-4841) FsShell commands using secure webhfds fail ClientFinalizer shutdown hook

[ https://issues.apache.org/jira/browse/HDFS-4841?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13702472#comment-13702472 ] Robert Kanter commented on HDFS-4841: - With Stephen's help, we manually verified that

[jira] [Created] (HDFS-4963) Improve multihoming support in namenode

Arpit Agarwal created HDFS-4963: --- Summary: Improve multihoming support in namenode Key: HDFS-4963 URL: https://issues.apache.org/jira/browse/HDFS-4963 Project: Hadoop HDFS Issue Type: Bug

[jira] [Commented] (HDFS-4841) FsShell commands using secure webhfds fail ClientFinalizer shutdown hook

[ https://issues.apache.org/jira/browse/HDFS-4841?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13702521#comment-13702521 ] Hadoop QA commented on HDFS-4841: - {color:red}-1 overall{color}. Here are the results of

[jira] [Updated] (HDFS-4372) Track NameNode startup progress

[ https://issues.apache.org/jira/browse/HDFS-4372?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-4372: Attachment: HDFS-4372.4.rebase.patch Thanks Chris! The latest patch looks pretty good to me. It only

[jira] [Commented] (HDFS-4956) DistributedFileSystem does not handle CreateFlag.APPEND in create call

[ https://issues.apache.org/jira/browse/HDFS-4956?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13702551#comment-13702551 ] Suresh Srinivas commented on HDFS-4956: --- bq. yes, It seems only fix in

[jira] [Created] (HDFS-4964) Enable multiple QOP for NameNode

Benoy Antony created HDFS-4964: -- Summary: Enable multiple QOP for NameNode Key: HDFS-4964 URL: https://issues.apache.org/jira/browse/HDFS-4964 Project: Hadoop HDFS Issue Type: Improvement

[jira] [Updated] (HDFS-4964) Enable multiple QOP for NameNode

[ https://issues.apache.org/jira/browse/HDFS-4964?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Benoy Antony updated HDFS-4964: --- Attachment: hdfs-4964.patch I'll add the testcases once the approach is reviewed.

[jira] [Commented] (HDFS-4841) FsShell commands using secure webhfds fail ClientFinalizer shutdown hook

[ https://issues.apache.org/jira/browse/HDFS-4841?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13702564#comment-13702564 ] Aaron T. Myers commented on HDFS-4841: -- +1, the patch looks good to me.

[jira] [Updated] (HDFS-4965) Make datanodes support multiple QOP for RPC and streaming protocols

[ https://issues.apache.org/jira/browse/HDFS-4965?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Benoy Antony updated HDFS-4965: --- Attachment: HDFS-4965.patch I'll add the testcase once the approach is removed.

[jira] [Created] (HDFS-4965) Make datanodes support multiple QOP for RPC and streaming protocols

Benoy Antony created HDFS-4965: -- Summary: Make datanodes support multiple QOP for RPC and streaming protocols Key: HDFS-4965 URL: https://issues.apache.org/jira/browse/HDFS-4965 Project: Hadoop HDFS

[jira] [Updated] (HDFS-4965) Make datanodes support multiple QOP for RPC and streaming protocols

[ https://issues.apache.org/jira/browse/HDFS-4965?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Benoy Antony updated HDFS-4965: --- Description: Currently datanode supports only single QOP. The feature makes data node listen on two

[jira] [Commented] (HDFS-4841) FsShell commands using secure webhfds fail ClientFinalizer shutdown hook

[ https://issues.apache.org/jira/browse/HDFS-4841?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13702588#comment-13702588 ] Alejandro Abdelnur commented on HDFS-4841: -- +1, committing to

[jira] [Updated] (HDFS-4841) FsShell commands using secure webhfds fail ClientFinalizer shutdown hook

[ https://issues.apache.org/jira/browse/HDFS-4841?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alejandro Abdelnur updated HDFS-4841: - Resolution: Fixed Fix Version/s: 2.1.0-beta Hadoop Flags: Reviewed

[jira] [Commented] (HDFS-4841) FsShell commands using secure webhfds fail ClientFinalizer shutdown hook

[ https://issues.apache.org/jira/browse/HDFS-4841?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13702603#comment-13702603 ] Hudson commented on HDFS-4841: -- Integrated in Hadoop-trunk-Commit #4052 (See

[jira] [Updated] (HDFS-4817) make HDFS advisory caching configurable on a per-file basis

[ https://issues.apache.org/jira/browse/HDFS-4817?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-4817: --- Attachment: HDFS-4817.006.patch besides the above, this patch includes: *

[jira] [Updated] (HDFS-4951) FsShell commands using secure httpfs throw exceptions due to missing TokenRenewer

[ https://issues.apache.org/jira/browse/HDFS-4951?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Kanter updated HDFS-4951: Attachment: HDFS-4951.patch Instead of essentially redoing the delegation token renewer (and

[jira] [Updated] (HDFS-4951) FsShell commands using secure httpfs throw exceptions due to missing TokenRenewer

[ https://issues.apache.org/jira/browse/HDFS-4951?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Kanter updated HDFS-4951: Status: Patch Available (was: Open) FsShell commands using secure httpfs throw exceptions due

[jira] [Commented] (HDFS-4373) Add HTTP API for querying NameNode startup progress

[ https://issues.apache.org/jira/browse/HDFS-4373?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13702655#comment-13702655 ] Jing Zhao commented on HDFS-4373: - The patch looks good to me. Some minors: 1. Based on

[jira] [Commented] (HDFS-4372) Track NameNode startup progress

[ https://issues.apache.org/jira/browse/HDFS-4372?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13702712#comment-13702712 ] Hadoop QA commented on HDFS-4372: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-4951) FsShell commands using secure httpfs throw exceptions due to missing TokenRenewer

[ https://issues.apache.org/jira/browse/HDFS-4951?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13702711#comment-13702711 ] Hadoop QA commented on HDFS-4951: - {color:red}-1 overall{color}. Here are the results of

[jira] [Created] (HDFS-4966) implement advisory caching for RawLocalFilesystem

Colin Patrick McCabe created HDFS-4966: -- Summary: implement advisory caching for RawLocalFilesystem Key: HDFS-4966 URL: https://issues.apache.org/jira/browse/HDFS-4966 Project: Hadoop HDFS

[jira] [Updated] (HDFS-4817) make HDFS advisory caching configurable on a per-file basis

[ https://issues.apache.org/jira/browse/HDFS-4817?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-4817: --- Attachment: HDFS-4817.007.patch * Remove unnecessary changes to TestStreamFile.java

[jira] [Commented] (HDFS-4817) make HDFS advisory caching configurable on a per-file basis

[ https://issues.apache.org/jira/browse/HDFS-4817?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13702727#comment-13702727 ] Colin Patrick McCabe commented on HDFS-4817: bq. What's the reason for having

[jira] [Commented] (HDFS-4817) make HDFS advisory caching configurable on a per-file basis

[ https://issues.apache.org/jira/browse/HDFS-4817?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13702761#comment-13702761 ] Hadoop QA commented on HDFS-4817: - {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-4960) Unnecessary .meta seeks even when skip checksum is true

[ https://issues.apache.org/jira/browse/HDFS-4960?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13702787#comment-13702787 ] Colin Patrick McCabe commented on HDFS-4960: This change seems problematic.

[jira] [Commented] (HDFS-4960) Unnecessary .meta seeks even when skip checksum is true

[ https://issues.apache.org/jira/browse/HDFS-4960?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13702832#comment-13702832 ] Varun Sharma commented on HDFS-4960: I don't know about the future plans of .meta -

[jira] [Created] (HDFS-4967) Generate block ID sequentially cannot work with QJM HA

Fengdong Yu created HDFS-4967: - Summary: Generate block ID sequentially cannot work with QJM HA Key: HDFS-4967 URL: https://issues.apache.org/jira/browse/HDFS-4967 Project: Hadoop HDFS Issue

[jira] [Updated] (HDFS-4967) Generate block ID sequentially cannot work with QJM HA

[ https://issues.apache.org/jira/browse/HDFS-4967?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fengdong Yu updated HDFS-4967: -- Description: After HDFS-4645 committed in the trunk, then the following error showed during name node

[jira] [Updated] (HDFS-4967) Generate block ID sequentially cannot work with QJM HA

[ https://issues.apache.org/jira/browse/HDFS-4967?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fengdong Yu updated HDFS-4967: -- Description: There are two name nodes, one is active, another acts as standby name node. QJM Ha

[jira] [Updated] (HDFS-4967) Generate block ID sequentially cannot work with QJM HA

[ https://issues.apache.org/jira/browse/HDFS-4967?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fengdong Yu updated HDFS-4967: -- Description: After HDFS-4645 committed in the trunk, then the following error showed during name node

[jira] [Commented] (HDFS-4817) make HDFS advisory caching configurable on a per-file basis

[ https://issues.apache.org/jira/browse/HDFS-4817?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13702852#comment-13702852 ] Hadoop QA commented on HDFS-4817: - {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-4967) Generate block ID sequentially cannot work with QJM HA

[ https://issues.apache.org/jira/browse/HDFS-4967?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13702864#comment-13702864 ] Suresh Srinivas commented on HDFS-4967: --- Thanks for reporting this issue.

[jira] [Updated] (HDFS-4967) Generate block ID sequentially cannot work with QJM HA

[ https://issues.apache.org/jira/browse/HDFS-4967?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suresh Srinivas updated HDFS-4967: -- Assignee: Arpit Agarwal Generate block ID sequentially cannot work with QJM HA

[jira] [Commented] (HDFS-4960) Unnecessary .meta seeks even when skip checksum is true

[ https://issues.apache.org/jira/browse/HDFS-4960?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13702877#comment-13702877 ] stack commented on HDFS-4960: - bq. The .meta header exists so that we can check the version of

[jira] [Commented] (HDFS-4967) Generate block ID sequentially cannot work with QJM HA

[ https://issues.apache.org/jira/browse/HDFS-4967?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13702921#comment-13702921 ] Arpit Agarwal commented on HDFS-4967: - Thanks for reporting Fengdong! I am taking a

[jira] [Created] (HDFS-4968) Provide configuration option for FileSystem symlink resolution

Andrew Wang created HDFS-4968: - Summary: Provide configuration option for FileSystem symlink resolution Key: HDFS-4968 URL: https://issues.apache.org/jira/browse/HDFS-4968 Project: Hadoop HDFS

[jira] [Commented] (HDFS-4967) Generate block ID sequentially cannot work with QJM HA

[ https://issues.apache.org/jira/browse/HDFS-4967?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13702937#comment-13702937 ] Arpit Agarwal commented on HDFS-4967: - [~azuryy] Was this an upgrade or a freshly

[jira] [Commented] (HDFS-4967) Generate block ID sequentially cannot work with QJM HA

[ https://issues.apache.org/jira/browse/HDFS-4967?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13702952#comment-13702952 ] Fengdong Yu commented on HDFS-4967: --- Hi Arpit, I will add some reprduce steps here