[jira] [Created] (HDFS-12213) Ozone: Corona: Support for online mode

2017-07-28 Thread Nandakumar (JIRA)
Nandakumar created HDFS-12213: - Summary: Ozone: Corona: Support for online mode Key: HDFS-12213 URL: https://issues.apache.org/jira/browse/HDFS-12213 Project: Hadoop HDFS Issue Type: Sub-task

[jira] [Commented] (HDFS-11984) Ozone: Ensures listKey lists all required key fields

2017-07-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11984?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16104803#comment-16104803 ] Hadoop QA commented on HDFS-11984: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12179) Ozone: Corona: Adding corona as part of hdfs command

2017-07-28 Thread Mukul Kumar Singh (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12179?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16104845#comment-16104845 ] Mukul Kumar Singh commented on HDFS-12179: -- [~nandakumar131], the patch looks good to me.

[jira] [Commented] (HDFS-12212) Options.Rename.To_TRASH is considered even when Options.Rename.NONE is specified

2017-07-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12212?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16104864#comment-16104864 ] Hadoop QA commented on HDFS-12212: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12178) Ozone: OzoneClient: Handling SCM container creationFlag at client side

2017-07-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12178?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16104862#comment-16104862 ] Hadoop QA commented on HDFS-12178: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-12212) Options.Rename.To_TRASH is considered even when Options.Rename.NONE is specified

2017-07-28 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12212?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinayakumar B updated HDFS-12212: - Attachment: HDFS-12212-01.patch attached a simple 1-line fix. > Options.Rename.To_TRASH is

[jira] [Commented] (HDFS-12179) Ozone: Corona: Adding corona as part of hdfs command

2017-07-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12179?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16104786#comment-16104786 ] Hadoop QA commented on HDFS-12179: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12157) Do fsyncDirectory(..) outside of FSDataset lock

2017-07-28 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12157?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16104867#comment-16104867 ] Brahma Reddy Battula commented on HDFS-12157: - +1, looks jenkins didn't run on {{branch-2.7}}

[jira] [Updated] (HDFS-12183) Ozone: KSM : Use proper defaults for block client address

2017-07-28 Thread Lokesh Jain (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12183?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lokesh Jain updated HDFS-12183: --- Attachment: HDFS-12183.001.patch The patch enables the use of ozone.scm.client.address if

[jira] [Updated] (HDFS-12213) Ozone: Corona: Support for online mode

2017-07-28 Thread Nandakumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12213?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nandakumar updated HDFS-12213: -- Labels: tool (was: ) > Ozone: Corona: Support for online mode > --

[jira] [Updated] (HDFS-12183) Ozone: KSM : Use proper defaults for block client address

2017-07-28 Thread Lokesh Jain (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12183?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lokesh Jain updated HDFS-12183: --- Attachment: (was: HDFS-12183.001.patch) > Ozone: KSM : Use proper defaults for block client

[jira] [Assigned] (HDFS-11610) sun.net.spi.nameservice.NameService has moved to a new location

2017-07-28 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11610?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka reassigned HDFS-11610: Assignee: Akira Ajisaka > sun.net.spi.nameservice.NameService has moved to a new location

[jira] [Updated] (HDFS-11610) sun.net.spi.nameservice.NameService has moved to a new location

2017-07-28 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11610?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka updated HDFS-11610: - Status: Patch Available (was: Open) > sun.net.spi.nameservice.NameService has moved to a new

[jira] [Updated] (HDFS-11610) sun.net.spi.nameservice.NameService has moved to a new location

2017-07-28 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11610?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka updated HDFS-11610: - Attachment: HDFS-11610.001.patch Attaching a patch to skip compiling TestDFSClientFailover if the

[jira] [Commented] (HDFS-12071) Ozone: Corona: Implementation of Corona

2017-07-28 Thread Nandakumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12071?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16104772#comment-16104772 ] Nandakumar commented on HDFS-12071: --- [~cheersyang], HDFS-12179 adds support in {{bin/hdfs}} to run

[jira] [Commented] (HDFS-12183) Ozone: KSM : Use proper defaults for block client address

2017-07-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12183?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16104774#comment-16104774 ] Hadoop QA commented on HDFS-12183: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11896) Non-dfsUsed will be doubled on dead node re-registration

2017-07-28 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11896?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16104872#comment-16104872 ] Brahma Reddy Battula commented on HDFS-11896: - [~shv] thanks a lot for continous review and

[jira] [Commented] (HDFS-12179) Ozone: Corona: Adding corona as part of hdfs command

2017-07-28 Thread Nandakumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12179?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16104895#comment-16104895 ] Nandakumar commented on HDFS-12179: --- Thanks for the review [~msingh]. "run ozone data generator"

[jira] [Updated] (HDFS-12212) Options.Rename.To_TRASH is considered even when Options.Rename.NONE is specified

2017-07-28 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12212?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinayakumar B updated HDFS-12212: - Assignee: Vinayakumar B Status: Patch Available (was: Open) > Options.Rename.To_TRASH is

[jira] [Updated] (HDFS-12183) Ozone: KSM : Use proper defaults for block client address

2017-07-28 Thread Lokesh Jain (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12183?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lokesh Jain updated HDFS-12183: --- Status: Patch Available (was: Open) > Ozone: KSM : Use proper defaults for block client address >

[jira] [Commented] (HDFS-12034) Ozone: Web interface for KSM

2017-07-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12034?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16104879#comment-16104879 ] Hadoop QA commented on HDFS-12034: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-12179) Ozone: Corona: Adding corona as part of hdfs command

2017-07-28 Thread Nandakumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12179?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nandakumar updated HDFS-12179: -- Status: Patch Available (was: Open) > Ozone: Corona: Adding corona as part of hdfs command >

[jira] [Updated] (HDFS-12179) Ozone: Corona: Adding corona as part of hdfs command

2017-07-28 Thread Nandakumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12179?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nandakumar updated HDFS-12179: -- Attachment: HDFS-12179-HDFS-7240.000.patch > Ozone: Corona: Adding corona as part of hdfs command >

[jira] [Updated] (HDFS-12183) Ozone: KSM : Use proper defaults for block client address

2017-07-28 Thread Lokesh Jain (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12183?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lokesh Jain updated HDFS-12183: --- Attachment: HDFS-12183-HDFS-7240.001.patch > Ozone: KSM : Use proper defaults for block client

[jira] [Comment Edited] (HDFS-11896) Non-dfsUsed will be doubled on dead node re-registration

2017-07-28 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11896?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16104872#comment-16104872 ] Brahma Reddy Battula edited comment on HDFS-11896 at 7/28/17 12:21 PM:

[jira] [Commented] (HDFS-12183) Ozone: KSM : Use proper defaults for block client address

2017-07-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12183?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16104912#comment-16104912 ] Hadoop QA commented on HDFS-12183: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-12214) [SPS]: Rename configuration property 'dfs.storage.policy.satisfier.activate' to 'dfs.storage.policy.satisfier.enabled'

2017-07-28 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12214?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-12214: Status: Patch Available (was: Open) > [SPS]: Rename configuration property

[jira] [Created] (HDFS-12214) Rename configuration property 'dfs.storage.policy.satisfier.activate' to 'dfs.storage.policy.satisfier.enable'

2017-07-28 Thread Rakesh R (JIRA)
Rakesh R created HDFS-12214: --- Summary: Rename configuration property 'dfs.storage.policy.satisfier.activate' to 'dfs.storage.policy.satisfier.enable' Key: HDFS-12214 URL:

[jira] [Updated] (HDFS-12214) [SPS]: Rename configuration property 'dfs.storage.policy.satisfier.activate' to 'dfs.storage.policy.satisfier.enabled'

2017-07-28 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12214?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-12214: Summary: [SPS]: Rename configuration property 'dfs.storage.policy.satisfier.activate' to

[jira] [Updated] (HDFS-12196) Ozone: DeleteKey-2: Implement container recycling service to delete stale blocks at background

2017-07-28 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12196?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated HDFS-12196: --- Attachment: HDFS-12196-HDFS-7240.001.patch > Ozone: DeleteKey-2: Implement container recycling

[jira] [Commented] (HDFS-11886) Ozone : Optimize putKey operation to be async and consensus

2017-07-28 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11886?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16105292#comment-16105292 ] Weiwei Yang commented on HDFS-11886: For the record, since HDFS-11984 is resolved. We will need to

[jira] [Commented] (HDFS-12196) Ozone: DeleteKey-2: Implement container recycling service to delete stale blocks at background

2017-07-28 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12196?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16105257#comment-16105257 ] Weiwei Yang commented on HDFS-12196: Uploaded v1 patch, added a {{ContainerRecyclingService}} It run

[jira] [Updated] (HDFS-12196) Ozone: DeleteKey-2: Implement container recycling service to delete stale blocks at background

2017-07-28 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12196?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated HDFS-12196: --- Status: Patch Available (was: In Progress) > Ozone: DeleteKey-2: Implement container recycling

[jira] [Commented] (HDFS-12206) Rename the split EC / replicated block metrics

2017-07-28 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16105266#comment-16105266 ] Manoj Govindassamy commented on HDFS-12206: --- The reason why I chose "stat" suffix earlier was to

[jira] [Updated] (HDFS-12151) Hadoop 2 clients cannot writeBlock to Hadoop 3 DataNodes

2017-07-28 Thread Sean Mackrory (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12151?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Mackrory updated HDFS-12151: - Attachment: HDFS-12151.005.patch > Hadoop 2 clients cannot writeBlock to Hadoop 3 DataNodes >

[jira] [Commented] (HDFS-11984) Ozone: Ensures listKey lists all required key fields

2017-07-28 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11984?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16105286#comment-16105286 ] Weiwei Yang commented on HDFS-11984: Looks good, I am +1 once the checkstyle issue is fixed. Thanks

[jira] [Updated] (HDFS-12196) Ozone: DeleteKey-2: Implement container recycling service to delete stale blocks at background

2017-07-28 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12196?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated HDFS-12196: --- Attachment: (was: HDFS-12196-HDFS-7240.001.patch) > Ozone: DeleteKey-2: Implement container

[jira] [Assigned] (HDFS-12183) Ozone: KSM : Use proper defaults for block client address

2017-07-28 Thread Mukul Kumar Singh (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12183?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukul Kumar Singh reassigned HDFS-12183: Assignee: Lokesh Jain (was: Nandakumar) > Ozone: KSM : Use proper defaults for

[jira] [Commented] (HDFS-12036) Add audit log for getErasureCodingPolicy, getErasureCodingPolicies, getErasureCodingCodecs

2017-07-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12036?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16104530#comment-16104530 ] Hadoop QA commented on HDFS-12036: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12062) removeErasureCodingPolicy needs super user permission

2017-07-28 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12062?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16104588#comment-16104588 ] Wei-Chiu Chuang commented on HDFS-12062: Committing the rev 002 patch shortly (without Eddy's

[jira] [Created] (HDFS-12209) VolumeScanner scan cursor not save periodic

2017-07-28 Thread fatkun (JIRA)
fatkun created HDFS-12209: - Summary: VolumeScanner scan cursor not save periodic Key: HDFS-12209 URL: https://issues.apache.org/jira/browse/HDFS-12209 Project: Hadoop HDFS Issue Type: Bug

[jira] [Updated] (HDFS-12062) removeErasureCodingPolicy needs super user permission

2017-07-28 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12062?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-12062: --- Resolution: Fixed Fix Version/s: 3.0.0-beta1 Status: Resolved (was: Patch

[jira] [Commented] (HDFS-12062) removeErasureCodingPolicy needs super user permission

2017-07-28 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12062?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16104628#comment-16104628 ] Hudson commented on HDFS-12062: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #12065 (See

[jira] [Commented] (HDFS-12034) Ozone: Web interface for KSM

2017-07-28 Thread Elek, Marton (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12034?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16104636#comment-16104636 ] Elek, Marton commented on HDFS-12034: - FTR: Angular (+route), Angular nvd3 is under MIT. I added the

[jira] [Commented] (HDFS-12034) Ozone: Web interface for KSM

2017-07-28 Thread Elek, Marton (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12034?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16104675#comment-16104675 ] Elek, Marton commented on HDFS-12034: - The previous build is a little bit suspicious: It contains a

[jira] [Updated] (HDFS-11984) Ozone: Ensures listKey lists all required key fields

2017-07-28 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11984?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-11984: - Attachment: HDFS-11984-HDFS-7240.001.patch Attach the initial patch. Current patch adds necessary filed

[jira] [Updated] (HDFS-11984) Ozone: Ensures listKey lists all required key fields

2017-07-28 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11984?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-11984: - Status: Patch Available (was: Open) > Ozone: Ensures listKey lists all required key fields >

[jira] [Comment Edited] (HDFS-11984) Ozone: Ensures listKey lists all required key fields

2017-07-28 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11984?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16104709#comment-16104709 ] Yiqun Lin edited comment on HDFS-11984 at 7/28/17 9:26 AM: --- Attach the initial

[jira] [Commented] (HDFS-10285) Storage Policy Satisfier in Namenode

2017-07-28 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10285?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16104722#comment-16104722 ] Rakesh R commented on HDFS-10285: - Thanks a lot [~andrew.wang] for the reviews. bq. Should

[jira] [Created] (HDFS-12210) Block Storage: volume creation times out while creating 3TB volume because of too many containers

2017-07-28 Thread Mukul Kumar Singh (JIRA)
Mukul Kumar Singh created HDFS-12210: Summary: Block Storage: volume creation times out while creating 3TB volume because of too many containers Key: HDFS-12210 URL:

[jira] [Comment Edited] (HDFS-10285) Storage Policy Satisfier in Namenode

2017-07-28 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10285?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16104722#comment-16104722 ] Rakesh R edited comment on HDFS-10285 at 7/28/17 9:44 AM: -- Thanks a lot

[jira] [Created] (HDFS-12211) Block Storage: Add start-cblock.sh to quickly start cblock.

2017-07-28 Thread Mukul Kumar Singh (JIRA)
Mukul Kumar Singh created HDFS-12211: Summary: Block Storage: Add start-cblock.sh to quickly start cblock. Key: HDFS-12211 URL: https://issues.apache.org/jira/browse/HDFS-12211 Project: Hadoop

[jira] [Created] (HDFS-12212) Options.Rename.To_TRASH is considered even when Options.Rename.NONE is specified

2017-07-28 Thread Vinayakumar B (JIRA)
Vinayakumar B created HDFS-12212: Summary: Options.Rename.To_TRASH is considered even when Options.Rename.NONE is specified Key: HDFS-12212 URL: https://issues.apache.org/jira/browse/HDFS-12212

[jira] [Updated] (HDFS-12178) Ozone: OzoneClient: Handling SCM container creationFlag at client side

2017-07-28 Thread Nandakumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12178?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nandakumar updated HDFS-12178: -- Attachment: HDFS-12178-HDFS-7240.003.patch > Ozone: OzoneClient: Handling SCM container creationFlag at

[jira] [Commented] (HDFS-12178) Ozone: OzoneClient: Handling SCM container creationFlag at client side

2017-07-28 Thread Nandakumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12178?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16104743#comment-16104743 ] Nandakumar commented on HDFS-12178: --- Thanks [~vagarychen] for the review. Patch v03 addresses the review

[jira] [Updated] (HDFS-12209) VolumeScanner scan cursor not save periodic

2017-07-28 Thread fatkun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12209?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] fatkun updated HDFS-12209: -- Description: The bug introduce from HDFS-7430 , the time is not same, one is monotonicMs and other is clock

[jira] [Updated] (HDFS-12034) Ozone: Web interface for KSM

2017-07-28 Thread Elek, Marton (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12034?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Elek, Marton updated HDFS-12034: Attachment: HDFS-12034-HDFS-7240.002.patch > Ozone: Web interface for KSM >

[jira] [Updated] (HDFS-12214) [SPS]: Rename configuration property 'dfs.storage.policy.satisfier.activate' to 'dfs.storage.policy.satisfier.enabled'

2017-07-28 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12214?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-12214: Attachment: HDFS-12214-HDFS-10285-00.patch Attached patch by renaming the config. > [SPS]: Rename

[jira] [Updated] (HDFS-12196) Ozone: DeleteKey-2: Implement container recycling service to delete stale blocks at background

2017-07-28 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12196?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated HDFS-12196: --- Attachment: HDFS-12196-HDFS-7240.001.patch > Ozone: DeleteKey-2: Implement container recycling

[jira] [Updated] (HDFS-12217) HDFS snapshots doesn't capture all open files when one of the open files is deleted

2017-07-28 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12217?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manoj Govindassamy updated HDFS-12217: -- Status: Patch Available (was: Open) > HDFS snapshots doesn't capture all open files

[jira] [Created] (HDFS-12222) Add EC information to BlockLocations

2017-07-28 Thread Andrew Wang (JIRA)
Andrew Wang created HDFS-1: -- Summary: Add EC information to BlockLocations Key: HDFS-1 URL: https://issues.apache.org/jira/browse/HDFS-1 Project: Hadoop HDFS Issue Type: Bug

[jira] [Updated] (HDFS-12222) Add EC information to BlockLocation

2017-07-28 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-1: --- Summary: Add EC information to BlockLocation (was: Add EC information to BlockLocations) > Add EC

[jira] [Commented] (HDFS-12222) Add EC information to BlockLocation

2017-07-28 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16105720#comment-16105720 ] Andrew Wang commented on HDFS-1: Ping [~rkanter] since we discussed this offline. Also, I see

[jira] [Commented] (HDFS-12131) Add some of the FSNamesystem JMX values as metrics

2017-07-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12131?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16105740#comment-16105740 ] Hadoop QA commented on HDFS-12131: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12131) Add some of the FSNamesystem JMX values as metrics

2017-07-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12131?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16105756#comment-16105756 ] Hadoop QA commented on HDFS-12131: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-10687) Federation Membership State Store internal API

2017-07-28 Thread Inigo Goiri (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10687?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Inigo Goiri updated HDFS-10687: --- Attachment: HDFS-10687-HDFS-10467-007.patch Tackling [~chris.douglas] comments. > Federation

[jira] [Commented] (HDFS-12217) HDFS snapshots doesn't capture all open files when one of the open files is deleted

2017-07-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12217?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16105788#comment-16105788 ] Hadoop QA commented on HDFS-12217: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10687) Federation Membership State Store internal API

2017-07-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10687?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16105805#comment-16105805 ] Hadoop QA commented on HDFS-10687: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-12151) Hadoop 2 clients cannot writeBlock to Hadoop 3 DataNodes

2017-07-28 Thread Sean Mackrory (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12151?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Mackrory updated HDFS-12151: - Attachment: HDFS-12151.006.patch So the problem was that it couldn't connect to a socket on the

[jira] [Updated] (HDFS-11786) Add support to make copyFromLocal multi threaded

2017-07-28 Thread Andras Bokor (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11786?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andras Bokor updated HDFS-11786: Issue Type: Improvement (was: Bug) > Add support to make copyFromLocal multi threaded >

[jira] [Commented] (HDFS-11786) Add support to make copyFromLocal multi threaded

2017-07-28 Thread Andras Bokor (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11786?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16105754#comment-16105754 ] Andras Bokor commented on HDFS-11786: - [~anu], [~msingh], Is there any reason why not to apply this

[jira] [Commented] (HDFS-11786) Add support to make copyFromLocal multi threaded

2017-07-28 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11786?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16105804#comment-16105804 ] Anu Engineer commented on HDFS-11786: - [~boky01] This feature request case from a customer

[jira] [Commented] (HDFS-12214) [SPS]: Rename configuration property 'dfs.storage.policy.satisfier.activate' to 'dfs.storage.policy.satisfier.enabled'

2017-07-28 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12214?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16105320#comment-16105320 ] Andrew Wang commented on HDFS-12214: Hi Rakesh, thanks for working on this. I suggest also renaming

[jira] [Commented] (HDFS-12196) Ozone: DeleteKey-2: Implement container recycling service to delete stale blocks at background

2017-07-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12196?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16105438#comment-16105438 ] Hadoop QA commented on HDFS-12196: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10880) Federation Mount Table State Store internal API

2017-07-28 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10880?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16105436#comment-16105436 ] Chris Douglas commented on HDFS-10880: -- * {{MountTableResolver}} doesn't have a consistent locking

[jira] [Commented] (HDFS-12216) Ozone: TestKeys and TestKeysRatis are failing consistently

2017-07-28 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12216?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16105447#comment-16105447 ] Chen Liang commented on HDFS-12216: --- Thanks [~msingh] for filing this! I was also just about to this :).

[jira] [Commented] (HDFS-12206) Rename the split EC / replicated block metrics

2017-07-28 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16105451#comment-16105451 ] Andrew Wang commented on HDFS-12206: I filed HDFS-12218 as a follow-on, might need more than that to

[jira] [Commented] (HDFS-12216) Ozone: TestKeys and TestKeysRatis are failing consistently

2017-07-28 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12216?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16105459#comment-16105459 ] Tsz Wo Nicholas Sze commented on HDFS-12216: Both tests were working fine previously. Do you

[jira] [Commented] (HDFS-12034) Ozone: Web interface for KSM

2017-07-28 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12034?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16105467#comment-16105467 ] Allen Wittenauer commented on HDFS-12034: - bq. 0m 30s Much better. bq. I didn't find any

[jira] [Commented] (HDFS-12131) Add some of the FSNamesystem JMX values as metrics

2017-07-28 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12131?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16105500#comment-16105500 ] Erik Krogen commented on HDFS-12131: Ah, nice! Looks like you already got the reviews you needed there

[jira] [Updated] (HDFS-12131) Add some of the FSNamesystem JMX values as metrics

2017-07-28 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12131?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen updated HDFS-12131: --- Attachment: HDFS-12131.004.patch > Add some of the FSNamesystem JMX values as metrics >

[jira] [Commented] (HDFS-11920) Ozone : add key partition

2017-07-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11920?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16105553#comment-16105553 ] Hadoop QA commented on HDFS-11920: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12132) Both two NameNodes become Standby because the ZKFC exception

2017-07-28 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12132?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16105604#comment-16105604 ] Arpit Agarwal commented on HDFS-12132: -- Surendra was right. Reformatting the zkfc is the correct

[jira] [Created] (HDFS-12221) Replace xcerces in XmlEditsVisitor

2017-07-28 Thread Lei (Eddy) Xu (JIRA)
Lei (Eddy) Xu created HDFS-12221: Summary: Replace xcerces in XmlEditsVisitor Key: HDFS-12221 URL: https://issues.apache.org/jira/browse/HDFS-12221 Project: Hadoop HDFS Issue Type:

[jira] [Updated] (HDFS-12219) Javadoc for FSNamesystem#getMaxObjects is incorrect

2017-07-28 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12219?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen updated HDFS-12219: --- Attachment: HDFS-12219.000.patch Seems fine to just remove the Javadoc given that it's just

[jira] [Updated] (HDFS-12219) Javadoc for FSNamesystem#getMaxObjects is incorrect

2017-07-28 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12219?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen updated HDFS-12219: --- Status: Patch Available (was: Open) > Javadoc for FSNamesystem#getMaxObjects is incorrect >

[jira] [Commented] (HDFS-12131) Add some of the FSNamesystem JMX values as metrics

2017-07-28 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12131?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16105527#comment-16105527 ] Erik Krogen commented on HDFS-12131: Okay, that seems fair. Should we have a separate JIRA for fixing

[jira] [Updated] (HDFS-12217) HDFS snapshots doesn't capture all open files when one of the open files is deleted

2017-07-28 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12217?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manoj Govindassamy updated HDFS-12217: -- Attachment: HDFS-12217.01.patch Attached v01 patch to address the following 1.

[jira] [Commented] (HDFS-12131) Add some of the FSNamesystem JMX values as metrics

2017-07-28 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12131?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16105513#comment-16105513 ] Erik Krogen commented on HDFS-12131: Actually, I realized that the Javadoc on MaxObjects is wrong, it

[jira] [Created] (HDFS-12219) Javadoc for FSNamesystem#getMaxObjects is incorrect

2017-07-28 Thread Erik Krogen (JIRA)
Erik Krogen created HDFS-12219: -- Summary: Javadoc for FSNamesystem#getMaxObjects is incorrect Key: HDFS-12219 URL: https://issues.apache.org/jira/browse/HDFS-12219 Project: Hadoop HDFS Issue

[jira] [Commented] (HDFS-12131) Add some of the FSNamesystem JMX values as metrics

2017-07-28 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12131?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16105520#comment-16105520 ] Andrew Wang commented on HDFS-12131: The prior example I have of deprecation+removal is HDFS-9024 and

[jira] [Commented] (HDFS-10899) Add functionality to re-encrypt EDEKs

2017-07-28 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10899?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16105525#comment-16105525 ] Wei-Chiu Chuang commented on HDFS-10899: Hi [~xiaochen] nice to see real perf number! One high

[jira] [Created] (HDFS-12220) hdfs' parallel tests don't work for Windows

2017-07-28 Thread Allen Wittenauer (JIRA)
Allen Wittenauer created HDFS-12220: --- Summary: hdfs' parallel tests don't work for Windows Key: HDFS-12220 URL: https://issues.apache.org/jira/browse/HDFS-12220 Project: Hadoop HDFS Issue

[jira] [Commented] (HDFS-12179) Ozone: Corona: Adding corona as part of hdfs command

2017-07-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12179?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16105389#comment-16105389 ] Hadoop QA commented on HDFS-12179: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-12217) HDFS snapshots doesn't capture all open files when one of the open files is deleted

2017-07-28 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12217?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manoj Govindassamy updated HDFS-12217: -- Summary: HDFS snapshots doesn't capture all open files when one of the open files is

[jira] [Commented] (HDFS-10285) Storage Policy Satisfier in Namenode

2017-07-28 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10285?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16105412#comment-16105412 ] Andrew Wang commented on HDFS-10285: Looking at the design doc a little more, a few more questions: *

[jira] [Updated] (HDFS-12131) Add some of the FSNamesystem JMX values as metrics

2017-07-28 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12131?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen updated HDFS-12131: --- Attachment: HDFS-12131.003.patch > Add some of the FSNamesystem JMX values as metrics >

[jira] [Commented] (HDFS-12195) Ozone: DeleteKey-1: KSM replies delete key request asynchronously

2017-07-28 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12195?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16105303#comment-16105303 ] Weiwei Yang commented on HDFS-12195: Hi [~yuanbo] Some more comments *OzoneConsts.java* Can we

[jira] [Commented] (HDFS-12179) Ozone: Corona: Adding corona as part of hdfs command

2017-07-28 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12179?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16105312#comment-16105312 ] Weiwei Yang commented on HDFS-12179: Hi [~nandakumar131] I think the naming needs to respect how it

[jira] [Created] (HDFS-12216) Ozone: TestKeys and TestKeysRatis are failing consistently

2017-07-28 Thread Mukul Kumar Singh (JIRA)
Mukul Kumar Singh created HDFS-12216: Summary: Ozone: TestKeys and TestKeysRatis are failing consistently Key: HDFS-12216 URL: https://issues.apache.org/jira/browse/HDFS-12216 Project: Hadoop HDFS

  1   2   >