[jira] [Commented] (HDFS-13035) Owner should be allowed to set xattr if not already set.

2018-01-23 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13035?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16337089#comment-16337089 ] Xiao Chen commented on HDFS-13035: -- [~andrew.wang] obviously has more weight to comment. The proposed

[jira] [Commented] (HDFS-10285) Storage Policy Satisfier in Namenode

2018-01-23 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10285?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16337079#comment-16337079 ] Rakesh R commented on HDFS-10285: - Thank you all contributors in making this feature. I have rebased 

[jira] [Commented] (HDFS-12974) Exception information can not be returned when I create transparent encryption zone.

2018-01-23 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12974?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16337071#comment-16337071 ] Xiao Chen commented on HDFS-12974: -- Sorry for the late response, I was on PTO for 2 weeks and have been

[jira] [Updated] (HDFS-10285) Storage Policy Satisfier in Namenode

2018-01-23 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10285?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-10285: Attachment: HDFS-10285-consolidated-merge-patch-04.patch > Storage Policy Satisfier in Namenode >

[jira] [Updated] (HDFS-13051) dead lock occurs when rolleditlog rpc call happen and editPendingQ is full

2018-01-23 Thread zhangwei (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13051?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhangwei updated HDFS-13051: Target Version/s: 3.0.0, 2.7.5, 2.8.2, 2.8.1 (was: 2.8.1, 2.8.2, 2.7.5, 3.0.0) Description: When

[jira] [Commented] (HDFS-13048) LowRedundancyReplicatedBlocks metric can be negative

2018-01-23 Thread Takanobu Asanuma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13048?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16337047#comment-16337047 ] Takanobu Asanuma commented on HDFS-13048: - +1(non-binding), pending Jenkins. >

[jira] [Comment Edited] (HDFS-13046) consider load of datanodes when read blocks of file

2018-01-23 Thread hu xiaodong (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13046?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16337003#comment-16337003 ] hu xiaodong edited comment on HDFS-13046 at 1/24/18 6:56 AM: - Or we can

[jira] [Updated] (HDFS-13046) consider load of datanodes when read blocks of file

2018-01-23 Thread hu xiaodong (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13046?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] hu xiaodong updated HDFS-13046: --- Attachment: HDFS-13046-considerLoadAfterSortBydistance-001-sample.patch > consider load of datanodes

[jira] [Updated] (HDFS-13046) consider load of datanodes when read blocks of file

2018-01-23 Thread hu xiaodong (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13046?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] hu xiaodong updated HDFS-13046: --- Attachment: (was: HDFS-13046-considerLoadAfterSortBydistance-001.patch) > consider load of

[jira] [Comment Edited] (HDFS-13046) consider load of datanodes when read blocks of file

2018-01-23 Thread hu xiaodong (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13046?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16337003#comment-16337003 ] hu xiaodong edited comment on HDFS-13046 at 1/24/18 6:43 AM: - Or we can

[jira] [Comment Edited] (HDFS-13046) consider load of datanodes when read blocks of file

2018-01-23 Thread hu xiaodong (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13046?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16337003#comment-16337003 ] hu xiaodong edited comment on HDFS-13046 at 1/24/18 6:42 AM: - Or we can

[jira] [Updated] (HDFS-13048) LowRedundancyReplicatedBlocks metric can be negative

2018-01-23 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13048?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka updated HDFS-13048: - Target Version/s: 3.1.0, 3.0.1 Status: Patch Available (was: Open) The calculation

[jira] [Updated] (HDFS-13046) consider load of datanodes when read blocks of file

2018-01-23 Thread hu xiaodong (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13046?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] hu xiaodong updated HDFS-13046: --- Attachment: HDFS-13046-considerLoadAfterSortBydistance-001.patch > consider load of datanodes when

[jira] [Updated] (HDFS-13048) LowRedundancyReplicatedBlocks metric can be negative

2018-01-23 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13048?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka updated HDFS-13048: - Attachment: HDFS-13048.001.patch > LowRedundancyReplicatedBlocks metric can be negative >

[jira] [Commented] (HDFS-13046) consider load of datanodes when read blocks of file

2018-01-23 Thread hu xiaodong (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13046?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16337003#comment-16337003 ] hu xiaodong commented on HDFS-13046: Or we can consider the load after sorting by distance.  After

[jira] [Commented] (HDFS-13042) RBF: Heartbeat Router State

2018-01-23 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13042?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16336978#comment-16336978 ] genericqa commented on HDFS-13042: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12522) Ozone: Remove the Priority Queues used in the Container State Manager

2018-01-23 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12522?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16336935#comment-16336935 ] genericqa commented on HDFS-12522: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10419) Building HDFS on top of Ozone's storage containers

2018-01-23 Thread Sanjay Radia (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10419?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16336903#comment-16336903 ] Sanjay Radia commented on HDFS-10419: - {quote}As a side note, I didn't understand why you used 50MB

[jira] [Updated] (HDFS-12528) Short-circuit reads unnecessarily disabled for a long time

2018-01-23 Thread Xiao Chen (JIRA)
ce >Affects Versions: 2.6.0 >Reporter: Andre Araujo >Assignee: Xiao Chen >Priority: Major > Attachments: HDFS-12528.000.patch, blocks_16_12_chars-20180123.png > > > We have scenarios where data ingestion makes use of the -appen

[jira] [Updated] (HDFS-12528) Short-circuit reads unnecessarily disabled for a long time

2018-01-23 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12528?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-12528: - Attachment: blocks_16_12_chars-20180123.png > Short-circuit reads unnecessarily disabled for a long t

[jira] [Commented] (HDFS-12528) Short-circuit reads unnecessarily disabled for a long time

2018-01-23 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12528?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16336895#comment-16336895 ] Xiao Chen commented on HDFS-12528: -- Attaching a patch to do just #1, with enhanced unit tests from John

[jira] [Commented] (HDFS-13056) Expose file-level composite CRCs in HDFS which are comparable across different instances/layouts

2018-01-23 Thread Dennis Huo (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13056?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16336852#comment-16336852 ] Dennis Huo commented on HDFS-13056: --- Attached a quick and dirty poc patch which just hard-codes using

[jira] [Updated] (HDFS-13056) Expose file-level composite CRCs in HDFS which are comparable across different instances/layouts

2018-01-23 Thread Dennis Huo (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13056?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dennis Huo updated HDFS-13056: -- Attachment: HDFS-13056-branch-2.8.poc1.patch > Expose file-level composite CRCs in HDFS which are

[jira] [Commented] (HDFS-12772) RBF: Federation Router State State Store internal API

2018-01-23 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12772?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16336840#comment-16336840 ] Hudson commented on HDFS-12772: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #13543 (See

[jira] [Commented] (HDFS-12772) RBF: Federation Router State State Store internal API

2018-01-23 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-12772?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16336830#comment-16336830 ] Íñigo Goiri commented on HDFS-12772: Committed to trunk, branch-3.0, branch-2, and branch-2.9. Thanks

[jira] [Updated] (HDFS-12772) RBF: Federation Router State State Store internal API

2018-01-23 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-12772?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Íñigo Goiri updated HDFS-12772: --- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.1 2.9.1

[jira] [Updated] (HDFS-13042) RBF: Heartbeat Router State

2018-01-23 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-13042?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Íñigo Goiri updated HDFS-13042: --- Attachment: HDFS-13042.001.patch > RBF: Heartbeat Router State > --- > >

[jira] [Commented] (HDFS-12963) Error log level in ShortCircuitRegistry#removeShm

2018-01-23 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12963?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16336825#comment-16336825 ] Hudson commented on HDFS-12963: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #13542 (See

[jira] [Commented] (HDFS-12963) Error log level in ShortCircuitRegistry#removeShm

2018-01-23 Thread hu xiaodong (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12963?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16336800#comment-16336800 ] hu xiaodong commented on HDFS-12963: thank you, [~linyiqun] > Error log level in

[jira] [Updated] (HDFS-12963) error log level in ShortCircuitRegistry#removeShm

2018-01-23 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12963?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-12963: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.1.0 Target Version/s:

[jira] [Updated] (HDFS-12963) Error log level in ShortCircuitRegistry#removeShm

2018-01-23 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12963?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-12963: - Summary: Error log level in ShortCircuitRegistry#removeShm (was: error log level in

[jira] [Commented] (HDFS-12963) error log level in ShortCircuitRegistry#removeShm

2018-01-23 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12963?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16336786#comment-16336786 ] Yiqun Lin commented on HDFS-12963: -- +1, will commit this shortly. > error log level in

[jira] [Commented] (HDFS-12051) Reimplement NameCache in NameNode: Intern duplicate byte[] arrays (mainly those denoting file/directory names) to save memory

2018-01-23 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16336782#comment-16336782 ] Yongjun Zhang commented on HDFS-12051: -- Hi [~mi...@cloudera.com], Thanks for the updated patch, my

[jira] [Commented] (HDFS-12772) RBF: Federation Router State State Store internal API

2018-01-23 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12772?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16336779#comment-16336779 ] Yiqun Lin commented on HDFS-12772: -- LGTM, +1. > RBF: Federation Router State State Store internal API >

[jira] [Updated] (HDFS-12051) Reimplement NameCache in NameNode: Intern duplicate byte[] arrays (mainly those denoting file/directory names) to save memory

2018-01-23 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12051?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-12051: - Hadoop Flags: Incompatible change > Reimplement NameCache in NameNode: Intern duplicate byte[]

[jira] [Updated] (HDFS-13055) Aggregate usage statistics from datanodes

2018-01-23 Thread Ajay Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13055?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ajay Kumar updated HDFS-13055: -- Attachment: HDFS-13055.001.patch > Aggregate usage statistics from datanodes >

[jira] [Commented] (HDFS-13055) Aggregate usage statistics from datanodes

2018-01-23 Thread Ajay Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13055?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16336760#comment-16336760 ] Ajay Kumar commented on HDFS-13055: --- Attaching initial patch for review. Will add test case soon. >

[jira] [Commented] (HDFS-10419) Building HDFS on top of Ozone's storage containers

2018-01-23 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10419?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16336759#comment-16336759 ] Konstantin Shvachko commented on HDFS-10419: Read the document, but did not get enough

[jira] [Updated] (HDFS-13055) Aggregate usage statistics from datanodes

2018-01-23 Thread Ajay Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13055?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ajay Kumar updated HDFS-13055: -- Attachment: (was: HDFS-13055.001.patch) > Aggregate usage statistics from datanodes >

[jira] [Updated] (HDFS-13055) Aggregate usage statistics from datanodes

2018-01-23 Thread Ajay Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13055?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ajay Kumar updated HDFS-13055: -- Attachment: HDFS-13055.001.patch > Aggregate usage statistics from datanodes >

[jira] [Comment Edited] (HDFS-12963) error log level in ShortCircuitRegistry#removeShm

2018-01-23 Thread hu xiaodong (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12963?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16336749#comment-16336749 ] hu xiaodong edited comment on HDFS-12963 at 1/24/18 2:00 AM: - hello,

[jira] [Commented] (HDFS-12963) error log level in ShortCircuitRegistry#removeShm

2018-01-23 Thread hu xiaodong (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12963?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16336749#comment-16336749 ] hu xiaodong commented on HDFS-12963: hello, [~ajisakaa],can you commit this? than you very much. >

[jira] [Commented] (HDFS-12522) Ozone: Remove the Priority Queues used in the Container State Manager

2018-01-23 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12522?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16336723#comment-16336723 ] Anu Engineer commented on HDFS-12522: - [~xyao] and [~nandakumar131] thanks for the review comments. I

[jira] [Updated] (HDFS-12522) Ozone: Remove the Priority Queues used in the Container State Manager

2018-01-23 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12522?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-12522: Attachment: HDFS-12522-HDFS-7240.002.patch > Ozone: Remove the Priority Queues used in the

[jira] [Updated] (HDFS-13056) Expose file-level composite CRCs in HDFS which are comparable across different instances/layouts

2018-01-23 Thread Dennis Huo (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13056?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dennis Huo updated HDFS-13056: -- Attachment: hdfs-file-composite-crc32-v1.pdf > Expose file-level composite CRCs in HDFS which are

[jira] [Created] (HDFS-13056) Expose file-level composite CRCs in HDFS which are comparable across different instances/layouts

2018-01-23 Thread Dennis Huo (JIRA)
Dennis Huo created HDFS-13056: - Summary: Expose file-level composite CRCs in HDFS which are comparable across different instances/layouts Key: HDFS-13056 URL: https://issues.apache.org/jira/browse/HDFS-13056

[jira] [Commented] (HDFS-13018) Block Storage: make the iscsi target addres configurable for discovery

2018-01-23 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13018?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16336641#comment-16336641 ] genericqa commented on HDFS-13018: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-13042) RBF: Heartbeat Router State

2018-01-23 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13042?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16336635#comment-16336635 ] genericqa commented on HDFS-13042: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-13033) [SPS]: Implement a mechanism to do file block movements for external SPS

2018-01-23 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13033?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16336622#comment-16336622 ] Uma Maheswara Rao G commented on HDFS-13033: +1 on the latest patch. Test failures unrelated

[jira] [Updated] (HDFS-13033) [SPS]: Implement a mechanism to do file block movements for external SPS

2018-01-23 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13033?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uma Maheswara Rao G updated HDFS-13033: --- Resolution: Fixed Fix Version/s: HDFS-10285 Status: Resolved (was:

[jira] [Commented] (HDFS-13054) Handling PathIsNotEmptyDirectoryException in DFSClient delete call

2018-01-23 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13054?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16336585#comment-16336585 ] genericqa commented on HDFS-13054: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-13054) Handling PathIsNotEmptyDirectoryException in DFSClient delete call

2018-01-23 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13054?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16336582#comment-16336582 ] genericqa commented on HDFS-13054: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-8921) Add an option to Balancer for specifying the k-most over-utilized DNs or all over-utilized DNs as sources.

2018-01-23 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8921?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16336577#comment-16336577 ] Konstantin Shvachko commented on HDFS-8921: --- What's the status here? > Add an option to Balancer

[jira] [Commented] (HDFS-13054) Handling PathIsNotEmptyDirectoryException in DFSClient delete call

2018-01-23 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13054?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16336557#comment-16336557 ] genericqa commented on HDFS-13054: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12051) Reimplement NameCache in NameNode: Intern duplicate byte[] arrays (mainly those denoting file/directory names) to save memory

2018-01-23 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16336551#comment-16336551 ] genericqa commented on HDFS-12051: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-13017) Block Storage: implement simple iscsi discovery in jscsi server

2018-01-23 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13017?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16336540#comment-16336540 ] genericqa commented on HDFS-13017: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-13033) [SPS]: Implement a mechanism to do file block movements for external SPS

2018-01-23 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13033?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16336537#comment-16336537 ] genericqa commented on HDFS-13033: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Created] (HDFS-13055) Aggregate usage statistics from datanodes

2018-01-23 Thread Ajay Kumar (JIRA)
Ajay Kumar created HDFS-13055: - Summary: Aggregate usage statistics from datanodes Key: HDFS-13055 URL: https://issues.apache.org/jira/browse/HDFS-13055 Project: Hadoop HDFS Issue Type: Bug

[jira] [Updated] (HDFS-13042) RBF: Heartbeat Router State

2018-01-23 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-13042?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Íñigo Goiri updated HDFS-13042: --- Status: Patch Available (was: Open) > RBF: Heartbeat Router State > --- > >

[jira] [Updated] (HDFS-12051) Reimplement NameCache in NameNode: Intern duplicate byte[] arrays (mainly those denoting file/directory names) to save memory

2018-01-23 Thread Misha Dmitriev (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12051?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Misha Dmitriev updated HDFS-12051: -- Status: Patch Available (was: In Progress) > Reimplement NameCache in NameNode: Intern

[jira] [Commented] (HDFS-12051) Reimplement NameCache in NameNode: Intern duplicate byte[] arrays (mainly those denoting file/directory names) to save memory

2018-01-23 Thread Misha Dmitriev (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16336416#comment-16336416 ] Misha Dmitriev commented on HDFS-12051: --- Thank you [~yzhangal], I've addressed your comment and

[jira] [Updated] (HDFS-12051) Reimplement NameCache in NameNode: Intern duplicate byte[] arrays (mainly those denoting file/directory names) to save memory

2018-01-23 Thread Misha Dmitriev (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12051?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Misha Dmitriev updated HDFS-12051: -- Status: In Progress (was: Patch Available) > Reimplement NameCache in NameNode: Intern

[jira] [Updated] (HDFS-12051) Reimplement NameCache in NameNode: Intern duplicate byte[] arrays (mainly those denoting file/directory names) to save memory

2018-01-23 Thread Misha Dmitriev (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12051?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Misha Dmitriev updated HDFS-12051: -- Attachment: HDFS-12051.07.patch > Reimplement NameCache in NameNode: Intern duplicate byte[]

[jira] [Commented] (HDFS-12772) RBF: Federation Router State State Store internal API

2018-01-23 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-12772?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16336408#comment-16336408 ] Íñigo Goiri commented on HDFS-12772: The unit tests are unrelated and the javac issue seems unrelated.

[jira] [Commented] (HDFS-13053) Track time to process packet in Datanode

2018-01-23 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-13053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16336407#comment-16336407 ] Íñigo Goiri commented on HDFS-13053: Thanks [~hanishakoneru], it looks like HDFS-10917 pretty much

[jira] [Comment Edited] (HDFS-12051) Reimplement NameCache in NameNode: Intern duplicate byte[] arrays (mainly those denoting file/directory names) to save memory

2018-01-23 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16336383#comment-16336383 ] Yongjun Zhang edited comment on HDFS-12051 at 1/23/18 9:32 PM: --- Thanks for

[jira] [Commented] (HDFS-12654) APPEND API call is different in HTTPFS and NameNode REST

2018-01-23 Thread Andras Czesznak (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12654?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16336386#comment-16336386 ] Andras Czesznak commented on HDFS-12654: Hello [~iwasakims] San, the issue occurred with the

[jira] [Commented] (HDFS-12051) Reimplement NameCache in NameNode: Intern duplicate byte[] arrays (mainly those denoting file/directory names) to save memory

2018-01-23 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16336383#comment-16336383 ] Yongjun Zhang commented on HDFS-12051: -- Thanks for your comments [~szetszwo]. I thought you had

[jira] [Commented] (HDFS-13018) Block Storage: make the iscsi target addres configurable for discovery

2018-01-23 Thread Elek, Marton (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13018?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16336358#comment-16336358 ] Elek, Marton commented on HDFS-13018: - Thanks to [Sebastian Graf|http://example.com/], the jscsi

[jira] [Updated] (HDFS-13018) Block Storage: make the iscsi target addres configurable for discovery

2018-01-23 Thread Elek, Marton (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13018?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Elek, Marton updated HDFS-13018: Status: Patch Available (was: Open) > Block Storage: make the iscsi target addres configurable for

[jira] [Updated] (HDFS-13018) Block Storage: make the iscsi target addres configurable for discovery

2018-01-23 Thread Elek, Marton (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13018?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Elek, Marton updated HDFS-13018: Attachment: HDFS-13018-HDFS-7240.002.patch > Block Storage: make the iscsi target addres

[jira] [Commented] (HDFS-13054) Handling PathIsNotEmptyDirectoryException in DFSClient delete call

2018-01-23 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13054?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16336350#comment-16336350 ] Arpit Agarwal commented on HDFS-13054: -- Thanks [~nandakumar131]. +1 pending Jenkins run. > Handling

[jira] [Commented] (HDFS-13054) Handling PathIsNotEmptyDirectoryException in DFSClient delete call

2018-01-23 Thread Nanda kumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13054?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16336347#comment-16336347 ] Nanda kumar commented on HDFS-13054: Thanks for the suggestion, yeah it is good to have Assert if the

[jira] [Commented] (HDFS-13053) Track time to process packet in Datanode

2018-01-23 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16336346#comment-16336346 ] genericqa commented on HDFS-13053: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-13054) Handling PathIsNotEmptyDirectoryException in DFSClient delete call

2018-01-23 Thread Nanda kumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13054?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nanda kumar updated HDFS-13054: --- Attachment: HDFS-13054.002.patch > Handling PathIsNotEmptyDirectoryException in DFSClient delete call

[jira] [Commented] (HDFS-13054) Handling PathIsNotEmptyDirectoryException in DFSClient delete call

2018-01-23 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13054?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16336335#comment-16336335 ] Arpit Agarwal commented on HDFS-13054: -- One more suggestion, you can add a fail(...) call immediately

[jira] [Commented] (HDFS-13054) Handling PathIsNotEmptyDirectoryException in DFSClient delete call

2018-01-23 Thread Nanda kumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13054?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16336331#comment-16336331 ] Nanda kumar commented on HDFS-13054: Thanks for the review [~arpitagarwal], fixed the same in patch

[jira] [Updated] (HDFS-13054) Handling PathIsNotEmptyDirectoryException in DFSClient delete call

2018-01-23 Thread Nanda kumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13054?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nanda kumar updated HDFS-13054: --- Attachment: HDFS-13054.001.patch > Handling PathIsNotEmptyDirectoryException in DFSClient delete call

[jira] [Updated] (HDFS-13017) Block Storage: implement simple iscsi discovery in jscsi server

2018-01-23 Thread Elek, Marton (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13017?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Elek, Marton updated HDFS-13017: Attachment: HDFS-13017-HDFS-7240.004.patch > Block Storage: implement simple iscsi discovery in

[jira] [Commented] (HDFS-13054) Handling PathIsNotEmptyDirectoryException in DFSClient delete call

2018-01-23 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13054?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16336327#comment-16336327 ] Arpit Agarwal commented on HDFS-13054: -- Thanks for this improvement [~nandakumar131]. Minor comment

[jira] [Comment Edited] (HDFS-13054) Handling PathIsNotEmptyDirectoryException in DFSClient delete call

2018-01-23 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13054?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16336327#comment-16336327 ] Arpit Agarwal edited comment on HDFS-13054 at 1/23/18 8:20 PM: --- Thanks for

[jira] [Commented] (HDFS-13033) [SPS]: Implement a mechanism to do file block movements for external SPS

2018-01-23 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13033?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16336321#comment-16336321 ] Rakesh R commented on HDFS-13033: - Uploaded another patch fixing checkstyle and findbug warnings. >

[jira] [Updated] (HDFS-13033) [SPS]: Implement a mechanism to do file block movements for external SPS

2018-01-23 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13033?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-13033: Attachment: (was: HDFS-13033-HDFS-10285-04.patch) > [SPS]: Implement a mechanism to do file block

[jira] [Updated] (HDFS-13033) [SPS]: Implement a mechanism to do file block movements for external SPS

2018-01-23 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13033?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-13033: Attachment: HDFS-13033-HDFS-10285-04.patch > [SPS]: Implement a mechanism to do file block movements for

[jira] [Updated] (HDFS-13054) Handling PathIsNotEmptyDirectoryException in DFSClient delete call

2018-01-23 Thread Nanda kumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13054?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nanda kumar updated HDFS-13054: --- Status: Patch Available (was: Open) > Handling PathIsNotEmptyDirectoryException in DFSClient delete

[jira] [Updated] (HDFS-13054) Handling PathIsNotEmptyDirectoryException in DFSClient delete call

2018-01-23 Thread Nanda kumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13054?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nanda kumar updated HDFS-13054: --- Attachment: HDFS-13054.000.patch > Handling PathIsNotEmptyDirectoryException in DFSClient delete call

[jira] [Updated] (HDFS-13033) [SPS]: Implement a mechanism to do file block movements for external SPS

2018-01-23 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13033?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-13033: Attachment: HDFS-13033-HDFS-10285-04.patch > [SPS]: Implement a mechanism to do file block movements for

[jira] [Commented] (HDFS-12772) RBF: Federation Router State State Store internal API

2018-01-23 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12772?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16336303#comment-16336303 ] genericqa commented on HDFS-12772: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-13053) Track time to process packet in Datanode

2018-01-23 Thread Hanisha Koneru (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16336299#comment-16336299 ] Hanisha Koneru commented on HDFS-13053: --- Hi [~elgoiri] and [~pulkitmisra], Similar work was done

[jira] [Created] (HDFS-13054) Handling PathIsNotEmptyDirectoryException in DFSClient delete call

2018-01-23 Thread Nanda kumar (JIRA)
Nanda kumar created HDFS-13054: -- Summary: Handling PathIsNotEmptyDirectoryException in DFSClient delete call Key: HDFS-13054 URL: https://issues.apache.org/jira/browse/HDFS-13054 Project: Hadoop HDFS

[jira] [Assigned] (HDFS-13053) Track time to process packet in Datanode

2018-01-23 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-13053?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Íñigo Goiri reassigned HDFS-13053: -- Assignee: Pulkit Misra > Track time to process packet in Datanode >

[jira] [Updated] (HDFS-13053) Track time to process packet in Datanode

2018-01-23 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-13053?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Íñigo Goiri updated HDFS-13053: --- Status: Patch Available (was: Open) > Track time to process packet in Datanode >

[jira] [Commented] (HDFS-13053) Track time to process packet in Datanode

2018-01-23 Thread Pulkit Misra (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16336279#comment-16336279 ] Pulkit Misra commented on HDFS-13053: - Added a patch. > Track time to process packet in Datanode >

[jira] [Updated] (HDFS-13053) Track time to process packet in Datanode

2018-01-23 Thread Pulkit Misra (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13053?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pulkit Misra updated HDFS-13053: Attachment: HDFS-13053.000.patch > Track time to process packet in Datanode >

[jira] [Commented] (HDFS-12950) [oiv] ls will fail in secure cluster

2018-01-23 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12950?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16336276#comment-16336276 ] Wei-Chiu Chuang commented on HDFS-12950: Trying to chime in here. I feel like implementing a

[jira] [Commented] (HDFS-12997) Move logging to slf4j in BlockPoolSliceStorage and Storage

2018-01-23 Thread Ajay Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12997?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16336267#comment-16336267 ] Ajay Kumar commented on HDFS-12997: --- patch v3 to address checkstyle issues. > Move logging to slf4j in

[jira] [Updated] (HDFS-12997) Move logging to slf4j in BlockPoolSliceStorage and Storage

2018-01-23 Thread Ajay Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12997?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ajay Kumar updated HDFS-12997: -- Attachment: HDFS-12997.003.patch > Move logging to slf4j in BlockPoolSliceStorage and Storage >

[jira] [Commented] (HDFS-13053) Track time to process packet in Datanode

2018-01-23 Thread Pulkit Misra (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16336256#comment-16336256 ] Pulkit Misra commented on HDFS-13053: - Yes, I can take this. I have a patch as well, but I am unable

[jira] [Commented] (HDFS-13053) Track time to process packet in Datanode

2018-01-23 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-13053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16336229#comment-16336229 ] Íñigo Goiri commented on HDFS-13053: [~pulkitmisra], you had something already. Do you mind taking

[jira] [Issue Comment Deleted] (HDFS-13053) Track time to process packet in Datanode

2018-01-23 Thread Pulkit Misra (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13053?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pulkit Misra updated HDFS-13053: Comment: was deleted (was: A patch for the issue.) > Track time to process packet in Datanode >

  1   2   >