[jira] [Updated] (HDFS-12618) fsck -includeSnapshots reports wrong amount of total blocks

2017-10-20 Thread Wellington Chevreuil (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12618?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wellington Chevreuil updated HDFS-12618: Attachment: HDFS-12618.001.patch Attaching a new patch with checkstyle issues

[jira] [Updated] (HDFS-12692) Ozone: fix javadoc/unit test for calling MetadataStore.getRangeKVs with non existing key

2017-10-20 Thread Elek, Marton (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12692?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Elek, Marton updated HDFS-12692: Status: Patch Available (was: Open) > Ozone: fix javadoc/unit test for calling

[jira] [Assigned] (HDFS-12692) Ozone: fix javadoc/unit test for calling MetadataStore.getRangeKVs with non existing key

2017-10-20 Thread Elek, Marton (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12692?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Elek, Marton reassigned HDFS-12692: --- Assignee: Elek, Marton > Ozone: fix javadoc/unit test for calling MetadataStore.getRangeKVs

[jira] [Created] (HDFS-12692) Ozone: fix javadoc/unit test for calling MetadataStore.getRangeKVs with non existing key

2017-10-20 Thread Elek, Marton (JIRA)
Elek, Marton created HDFS-12692: --- Summary: Ozone: fix javadoc/unit test for calling MetadataStore.getRangeKVs with non existing key Key: HDFS-12692 URL: https://issues.apache.org/jira/browse/HDFS-12692

[jira] [Updated] (HDFS-12692) Ozone: fix javadoc/unit test for calling MetadataStore.getRangeKVs with non existing key

2017-10-20 Thread Elek, Marton (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12692?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Elek, Marton updated HDFS-12692: Attachment: HDFS-12692-HDFS-7240.001.patch > Ozone: fix javadoc/unit test for calling

[jira] [Updated] (HDFS-12497) Re-enable TestDFSStripedOutputStreamWithFailure tests

2017-10-20 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12497?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-12497: --- Resolution: Fixed Fix Version/s: 3.0.0 Status: Resolved (was: Patch Available)

[jira] [Updated] (HDFS-12686) Erasure coding system policy state is not correctly saved and loaded during real cluster restart

2017-10-20 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12686?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-12686: --- Priority: Blocker (was: Critical) > Erasure coding system policy state is not correctly saved and

[jira] [Updated] (HDFS-11467) Support ErasureCoding section in OIV XML/ReverseXML

2017-10-20 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11467?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-11467: --- Priority: Blocker (was: Major) > Support ErasureCoding section in OIV XML/ReverseXML >

[jira] [Updated] (HDFS-12396) Webhdfs file system should get delegation token from kms provider.

2017-10-20 Thread Rushabh S Shah (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12396?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rushabh S Shah updated HDFS-12396: -- Attachment: HDFS-12396.002.patch Attached a new patch. bq. In KMSUtil, I'm not fond of

[jira] [Commented] (HDFS-12518) Re-encryption should handle task cancellation and progress better

2017-10-20 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12518?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16213577#comment-16213577 ] Hudson commented on HDFS-12518: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #13120 (See

[jira] [Updated] (HDFS-11902) [READ] Merge BlockFormatProvider and FileRegionProvider.

2017-10-20 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11902?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HDFS-11902: -- Attachment: (was: HDFS-11902-HDFS-9806.009.patch) > [READ] Merge

[jira] [Updated] (HDFS-12518) Re-encryption should handle task cancellation and progress better

2017-10-20 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12518?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-12518: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.0 Status: Resolved

[jira] [Updated] (HDFS-12653) Implement toArray() and subArray() for ReadOnlyList

2017-10-20 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12653?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manoj Govindassamy updated HDFS-12653: -- Attachment: HDFS-12653.01.patch Attached v01 patch to address the following 1.

[jira] [Updated] (HDFS-7878) API - expose an unique file identifier

2017-10-20 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7878?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas updated HDFS-7878: Attachment: HDFS-7878.16.patch > API - expose an unique file identifier >

[jira] [Commented] (HDFS-12681) Fold HdfsLocatedFileStatus into HdfsFileStatus

2017-10-20 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12681?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16213581#comment-16213581 ] Chris Douglas commented on HDFS-12681: -- This adds a builder pattern for {{HdfsFileStatus}}.

[jira] [Commented] (HDFS-11902) [READ] Merge BlockFormatProvider and FileRegionProvider.

2017-10-20 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11902?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16213620#comment-16213620 ] Hadoop QA commented on HDFS-11902: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11467) Support ErasureCoding section in OIV XML/ReverseXML

2017-10-20 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11467?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16213677#comment-16213677 ] Xiao Chen commented on HDFS-11467: -- Thanks for working on this [~HuafengWang], and others for reviewing.

[jira] [Commented] (HDFS-12683) DFSZKFailOverController re-order logic for logging Exception

2017-10-20 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12683?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16213506#comment-16213506 ] Bharat Viswanadham commented on HDFS-12683: --- Updated the patch. Attached patch v8 to fix

[jira] [Updated] (HDFS-12683) DFSZKFailOverController re-order logic for logging Exception

2017-10-20 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12683?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bharat Viswanadham updated HDFS-12683: -- Attachment: HDFS-12683.08.patch > DFSZKFailOverController re-order logic for logging

[jira] [Updated] (HDFS-12681) Fold HdfsLocatedFileStatus into HdfsFileStatus

2017-10-20 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas updated HDFS-12681: - Attachment: HDFS-12681.01.patch > Fold HdfsLocatedFileStatus into HdfsFileStatus >

[jira] [Commented] (HDFS-7878) API - expose an unique file identifier

2017-10-20 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7878?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16213510#comment-16213510 ] Hadoop QA commented on HDFS-7878: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Comment Edited] (HDFS-12683) DFSZKFailOverController re-order logic for logging Exception

2017-10-20 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12683?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16213506#comment-16213506 ] Bharat Viswanadham edited comment on HDFS-12683 at 10/20/17 11:47 PM: --

[jira] [Commented] (HDFS-12683) DFSZKFailOverController re-order logic for logging Exception

2017-10-20 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12683?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16213532#comment-16213532 ] Bharat Viswanadham commented on HDFS-12683: --- Updated patch v09 to fix review comments. >

[jira] [Updated] (HDFS-11902) [READ] Merge BlockFormatProvider and FileRegionProvider.

2017-10-20 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11902?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HDFS-11902: -- Attachment: HDFS-11902-HDFS-9806.009.patch > [READ] Merge BlockFormatProvider and

[jira] [Updated] (HDFS-11902) [READ] Merge BlockFormatProvider and FileRegionProvider.

2017-10-20 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11902?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HDFS-11902: -- Status: Patch Available (was: Open) > [READ] Merge BlockFormatProvider and

[jira] [Updated] (HDFS-11902) [READ] Merge BlockFormatProvider and FileRegionProvider.

2017-10-20 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11902?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HDFS-11902: -- Status: Open (was: Patch Available) > [READ] Merge BlockFormatProvider and

[jira] [Commented] (HDFS-12665) [AliasMap] Create a version of the AliasMap that runs in memory in the Namenode (leveldb)

2017-10-20 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12665?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16213639#comment-16213639 ] Virajith Jalaparti commented on HDFS-12665: --- Thanks for posting this [~ehiggs]. A few

[jira] [Commented] (HDFS-11902) [READ] Merge BlockFormatProvider and FileRegionProvider.

2017-10-20 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11902?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16213502#comment-16213502 ] Hadoop QA commented on HDFS-11902: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-12683) DFSZKFailOverController re-order logic for logging Exception

2017-10-20 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12683?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bharat Viswanadham updated HDFS-12683: -- Attachment: HDFS-12683.09.patch > DFSZKFailOverController re-order logic for logging

[jira] [Commented] (HDFS-7878) API - expose an unique file identifier

2017-10-20 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7878?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16213707#comment-16213707 ] Hadoop QA commented on HDFS-7878: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12310) [SPS]: Provide an option to track the status of in progress requests

2017-10-20 Thread Surendra Singh Lilhore (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12310?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16213734#comment-16213734 ] Surendra Singh Lilhore commented on HDFS-12310: --- Thanks [~eddyxu] for review.. I will update

[jira] [Commented] (HDFS-12683) DFSZKFailOverController re-order logic for logging Exception

2017-10-20 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12683?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16213696#comment-16213696 ] Hadoop QA commented on HDFS-12683: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12681) Fold HdfsLocatedFileStatus into HdfsFileStatus

2017-10-20 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12681?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16213721#comment-16213721 ] Hadoop QA commented on HDFS-12681: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-12681) Fold HdfsLocatedFileStatus into HdfsFileStatus

2017-10-20 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas updated HDFS-12681: - Status: Patch Available (was: Open) > Fold HdfsLocatedFileStatus into HdfsFileStatus >

[jira] [Commented] (HDFS-11096) Support rolling upgrade between 2.x and 3.x

2017-10-20 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11096?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16213176#comment-16213176 ] Andrew Wang commented on HDFS-11096: Folks, is this going to be committed by the end of the month?

[jira] [Commented] (HDFS-12518) Re-encryption should handle task cancellation and progress better

2017-10-20 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12518?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16213323#comment-16213323 ] Hadoop QA commented on HDFS-12518: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11467) Support ErasureCoding section in OIV XML/ReverseXML

2017-10-20 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11467?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16213420#comment-16213420 ] Lei (Eddy) Xu commented on HDFS-11467: -- LGTM. Would bring in [~xiaochen] for reviews, as he is

[jira] [Commented] (HDFS-12683) DFSZKFailOverController re-order logic for logging Exception

2017-10-20 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12683?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16213418#comment-16213418 ] Hadoop QA commented on HDFS-12683: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12618) fsck -includeSnapshots reports wrong amount of total blocks

2017-10-20 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12618?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16213269#comment-16213269 ] Xiao Chen commented on HDFS-12618: -- Thanks for reporting and working on this [~wchevreuil]! I agree this

[jira] [Updated] (HDFS-11902) [READ] Merge BlockFormatProvider and FileRegionProvider.

2017-10-20 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11902?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HDFS-11902: -- Attachment: (was: HDFS-11902-HDFS-9806.009.patch) > [READ] Merge

[jira] [Updated] (HDFS-11902) [READ] Merge BlockFormatProvider and FileRegionProvider.

2017-10-20 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11902?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HDFS-11902: -- Status: Patch Available (was: Open) > [READ] Merge BlockFormatProvider and

[jira] [Updated] (HDFS-11902) [READ] Merge BlockFormatProvider and FileRegionProvider.

2017-10-20 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11902?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HDFS-11902: -- Attachment: HDFS-11902-HDFS-9806.009.patch > [READ] Merge BlockFormatProvider and

[jira] [Updated] (HDFS-11902) [READ] Merge BlockFormatProvider and FileRegionProvider.

2017-10-20 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11902?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HDFS-11902: -- Status: Open (was: Patch Available) > [READ] Merge BlockFormatProvider and

[jira] [Updated] (HDFS-12681) Fold HdfsLocatedFileStatus into HdfsFileStatus

2017-10-20 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas updated HDFS-12681: - Attachment: HDFS-12681.00.patch > Fold HdfsLocatedFileStatus into HdfsFileStatus >

[jira] [Commented] (HDFS-11096) Support rolling upgrade between 2.x and 3.x

2017-10-20 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11096?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16213441#comment-16213441 ] Hadoop QA commented on HDFS-11096: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-11096) Support rolling upgrade between 2.x and 3.x

2017-10-20 Thread Sean Mackrory (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11096?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Mackrory updated HDFS-11096: - Attachment: HDFS-11096.006.patch It's possible, but will be tough. I worked with [~rchiang] to

[jira] [Commented] (HDFS-12497) Re-enable TestDFSStripedOutputStreamWithFailure tests

2017-10-20 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12497?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16213318#comment-16213318 ] Hudson commented on HDFS-12497: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #13119 (See

[jira] [Updated] (HDFS-12396) Webhdfs file system should get delegation token from kms provider.

2017-10-20 Thread Rushabh S Shah (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12396?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rushabh S Shah updated HDFS-12396: -- Status: Open (was: Patch Available) Thanks Daryn for review. Canceling patch to address

[jira] [Updated] (HDFS-12665) [AliasMap] Create a version of the AliasMap that runs in memory in the Namenode (leveldb)

2017-10-20 Thread Ewan Higgs (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12665?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewan Higgs updated HDFS-12665: -- Attachment: HDFS-12665-HDFS-9806.002.patch Attaching an updated version using {{LevelDB}} (instead of

[jira] [Updated] (HDFS-12690) Ozone: generate swagger descriptor for the Ozone REST Api

2017-10-20 Thread Elek, Marton (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12690?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Elek, Marton updated HDFS-12690: Component/s: ozone > Ozone: generate swagger descriptor for the Ozone REST Api >

[jira] [Commented] (HDFS-7060) Avoid taking locks when sending heartbeats from the DataNode

2017-10-20 Thread Jiandan Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7060?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16212333#comment-16212333 ] Jiandan Yang commented on HDFS-7060: - [~xinwei] [~brahmareddy] [~jojochuang] We encountered the same

[jira] [Updated] (HDFS-12690) Ozone: generate swagger descriptor for the Ozone REST Api

2017-10-20 Thread Elek, Marton (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12690?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Elek, Marton updated HDFS-12690: Attachment: HDFS-12690-HDFS-7240.001.patch To test: do a full build: The swagger file is at:

[jira] [Updated] (HDFS-12690) Ozone: generate swagger descriptor for the Ozone REST Api

2017-10-20 Thread Elek, Marton (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12690?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Elek, Marton updated HDFS-12690: Status: Patch Available (was: Open) > Ozone: generate swagger descriptor for the Ozone REST Api >

[jira] [Created] (HDFS-12690) Ozone: generate swagger descriptor for the Ozone REST Api

2017-10-20 Thread Elek, Marton (JIRA)
Elek, Marton created HDFS-12690: --- Summary: Ozone: generate swagger descriptor for the Ozone REST Api Key: HDFS-12690 URL: https://issues.apache.org/jira/browse/HDFS-12690 Project: Hadoop HDFS

[jira] [Assigned] (HDFS-12690) Ozone: generate swagger descriptor for the Ozone REST Api

2017-10-20 Thread Elek, Marton (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12690?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Elek, Marton reassigned HDFS-12690: --- Assignee: Elek, Marton > Ozone: generate swagger descriptor for the Ozone REST Api >

[jira] [Updated] (HDFS-12690) Ozone: generate swagger descriptor for the Ozone REST Api

2017-10-20 Thread Elek, Marton (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12690?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Elek, Marton updated HDFS-12690: Affects Version/s: HDFS-7240 > Ozone: generate swagger descriptor for the Ozone REST Api >

[jira] [Updated] (HDFS-12691) Ozone: Decrease interval time of SCMBlockDeletingService for improving the efficiency

2017-10-20 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12691?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-12691: - Description: After logging elapsed time of each block deletion task, found some places we can make some

[jira] [Created] (HDFS-12691) Ozone: Decrease interval time of SCMBlockDeletingService for improving the efficiency

2017-10-20 Thread Yiqun Lin (JIRA)
Yiqun Lin created HDFS-12691: Summary: Ozone: Decrease interval time of SCMBlockDeletingService for improving the efficiency Key: HDFS-12691 URL: https://issues.apache.org/jira/browse/HDFS-12691 Project:

[jira] [Commented] (HDFS-12691) Ozone: Decrease interval time of SCMBlockDeletingService for improving the efficiency

2017-10-20 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12691?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16212500#comment-16212500 ] Yiqun Lin commented on HDFS-12691: -- Softly pinging [~cheersyang], you may be interested in this, :). >

[jira] [Commented] (HDFS-12621) Inconsistency/confusion around ViewFileSystem.getDelagation

2017-10-20 Thread Mohammad Kamrul Islam (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12621?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16212240#comment-16212240 ] Mohammad Kamrul Islam commented on HDFS-12621: -- Thanks [~xkrogen] So we agree option #2 is

[jira] [Commented] (HDFS-9810) Allow support for more than one block replica per datanode

2017-10-20 Thread Ewan Higgs (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9810?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16212300#comment-16212300 ] Ewan Higgs commented on HDFS-9810: -- This should be fixed by HDFS-12685. > Allow support for more than one

[jira] [Updated] (HDFS-12588) Use GenericOptionsParser for scm and ksm daemon

2017-10-20 Thread Elek, Marton (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12588?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Elek, Marton updated HDFS-12588: Attachment: HDFS-12588-HDFS-7240.004.patch Thx [~cheersyang] the feedback. 1. You are right, I

[jira] [Commented] (HDFS-12692) Ozone: fix javadoc/unit test for calling MetadataStore.getRangeKVs with non existing key

2017-10-20 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12692?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16212724#comment-16212724 ] Hadoop QA commented on HDFS-12692: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-7060) Avoid taking locks when sending heartbeats from the DataNode

2017-10-20 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7060?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16212722#comment-16212722 ] Hadoop QA commented on HDFS-7060: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12665) [AliasMap] Create a version of the AliasMap that runs in memory in the Namenode (leveldb)

2017-10-20 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12665?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16212727#comment-16212727 ] Hadoop QA commented on HDFS-12665: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12690) Ozone: generate swagger descriptor for the Ozone REST Api

2017-10-20 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12690?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16212728#comment-16212728 ] Hadoop QA commented on HDFS-12690: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12591) [READ] Implement LevelDBFileRegionFormat

2017-10-20 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12591?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16212735#comment-16212735 ] Hadoop QA commented on HDFS-12591: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12591) [READ] Implement LevelDBFileRegionFormat

2017-10-20 Thread Ewan Higgs (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12591?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16212698#comment-16212698 ] Ewan Higgs commented on HDFS-12591: --- This now depends on HDFS-12665 since it uses the same code for

[jira] [Commented] (HDFS-12691) Ozone: Decrease interval time of SCMBlockDeletingService for improving the efficiency

2017-10-20 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12691?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16212652#comment-16212652 ] Weiwei Yang commented on HDFS-12691: Hi [~linyiqun] Thanks for filing this. Well I agree this is

[jira] [Commented] (HDFS-12688) HDFS File Not Removed Despite Successful "Moved to .Trash" Message

2017-10-20 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12688?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16212654#comment-16212654 ] Jason Lowe commented on HDFS-12688: --- Then there is very likely some other job or async behavior that is

[jira] [Updated] (HDFS-12591) [READ] Implement LevelDBFileRegionFormat

2017-10-20 Thread Ewan Higgs (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12591?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewan Higgs updated HDFS-12591: -- Attachment: HDFS-12591-HDFS-9806.003.patch Attaching a patch rebased on HDFS-12665 so the two LevelDB

[jira] [Commented] (HDFS-12588) Use GenericOptionsParser for scm and ksm daemon

2017-10-20 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12588?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16212732#comment-16212732 ] Hadoop QA commented on HDFS-12588: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12621) Inconsistency/confusion around ViewFileSystem.getDelagation

2017-10-20 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12621?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16212782#comment-16212782 ] Erik Krogen commented on HDFS-12621: Hm... There is some reference in the design document for

[jira] [Commented] (HDFS-12692) Ozone: fix javadoc/unit test for calling MetadataStore.getRangeKVs with non existing key

2017-10-20 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12692?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16212818#comment-16212818 ] Xiaoyu Yao commented on HDFS-12692: --- Thanks [~elek] for fixing this. Patch looks good to me, +1 pending

[jira] [Commented] (HDFS-12688) HDFS File Not Removed Despite Successful "Moved to .Trash" Message

2017-10-20 Thread Shriya Gupta (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12688?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16212839#comment-16212839 ] Shriya Gupta commented on HDFS-12688: - You are right! There was another job that was writing to the

[jira] [Updated] (HDFS-12618) fsck -includeSnapshots reports wrong amount of total blocks

2017-10-20 Thread Wellington Chevreuil (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12618?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wellington Chevreuil updated HDFS-12618: Attachment: (was: HDFS-121618.001.patch) > fsck -includeSnapshots reports wrong

[jira] [Resolved] (HDFS-12688) HDFS File Not Removed Despite Successful "Moved to .Trash" Message

2017-10-20 Thread Shriya Gupta (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12688?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shriya Gupta resolved HDFS-12688. - Resolution: Not A Bug Another job was recreating the file that the user suspected wasn't being

[jira] [Commented] (HDFS-12618) fsck -includeSnapshots reports wrong amount of total blocks

2017-10-20 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12618?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16212858#comment-16212858 ] Hadoop QA commented on HDFS-12618: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-12620) Backporting HDFS-10467 to branch-2

2017-10-20 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-12620?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Íñigo Goiri updated HDFS-12620: --- Description: When backporting HDFS-10467, there are a few things that changed: * {{bin\hdfs}} * New

[jira] [Updated] (HDFS-12620) Backporting HDFS-10467 to branch-2

2017-10-20 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-12620?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Íñigo Goiri updated HDFS-12620: --- Description: When backporting HDFS-10467, there are a few things that changed: * {{bin\hdfs}} *

[jira] [Updated] (HDFS-7878) API - expose an unique file identifier

2017-10-20 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7878?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas updated HDFS-7878: Attachment: HDFS-7878.15.patch > API - expose an unique file identifier >

[jira] [Updated] (HDFS-12683) DFSZKFailOverController re-order logic for logging Exception

2017-10-20 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12683?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bharat Viswanadham updated HDFS-12683: -- Attachment: HDFS-12683.06.patch > DFSZKFailOverController re-order logic for logging

[jira] [Updated] (HDFS-12683) DFSZKFailOverController re-order logic for logging Exception

2017-10-20 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12683?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bharat Viswanadham updated HDFS-12683: -- Attachment: HDFS-12683.07.patch > DFSZKFailOverController re-order logic for logging

[jira] [Commented] (HDFS-12607) [READ] Even one dead datanode with PROVIDED storage results in ProvidedStorageInfo being marked as FAILED

2017-10-20 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-12607?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16213001#comment-16213001 ] Íñigo Goiri commented on HDFS-12607: * In {{ProvidedStorageMap}}, can we use the {{Logger}} format? *

[jira] [Commented] (HDFS-12683) DFSZKFailOverController re-order logic for logging Exception

2017-10-20 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12683?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16213036#comment-16213036 ] Arpit Agarwal commented on HDFS-12683: -- +1 pending Jenkins, via reviewboard.

[jira] [Comment Edited] (HDFS-12683) DFSZKFailOverController re-order logic for logging Exception

2017-10-20 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12683?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16213036#comment-16213036 ] Arpit Agarwal edited comment on HDFS-12683 at 10/20/17 6:43 PM: +1 pending

[jira] [Updated] (HDFS-12683) DFSZKFailOverController re-order logic for logging Exception

2017-10-20 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12683?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bharat Viswanadham updated HDFS-12683: -- Status: In Progress (was: Patch Available) > DFSZKFailOverController re-order logic

[jira] [Updated] (HDFS-12683) DFSZKFailOverController re-order logic for logging Exception

2017-10-20 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12683?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bharat Viswanadham updated HDFS-12683: -- Status: Patch Available (was: In Progress) > DFSZKFailOverController re-order logic

[jira] [Updated] (HDFS-12683) DFSZKFailOverController re-order logic for logging Exception

2017-10-20 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12683?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bharat Viswanadham updated HDFS-12683: -- Attachment: HDFS-12683.05.patch > DFSZKFailOverController re-order logic for logging

[jira] [Updated] (HDFS-12498) Journal Syncer is not started in Federated + HA cluster

2017-10-20 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bharat Viswanadham updated HDFS-12498: -- Attachment: HDFS-12498.03.patch > Journal Syncer is not started in Federated + HA

[jira] [Updated] (HDFS-12498) Journal Syncer is not started in Federated + HA cluster

2017-10-20 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bharat Viswanadham updated HDFS-12498: -- Status: Patch Available (was: In Progress) > Journal Syncer is not started in

[jira] [Updated] (HDFS-12518) Re-encryption should handle task cancellation and progress better

2017-10-20 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12518?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-12518: - Attachment: HDFS-12518.03.patch patch 3 to fix checkstyle > Re-encryption should handle task

[jira] [Commented] (HDFS-12518) Re-encryption should handle task cancellation and progress better

2017-10-20 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12518?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16213079#comment-16213079 ] Wei-Chiu Chuang commented on HDFS-12518: +1. LGTM > Re-encryption should handle task cancellation

[jira] [Commented] (HDFS-12249) dfsadmin -metaSave to output maintenance mode blocks

2017-10-20 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12249?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16213100#comment-16213100 ] Wei-Chiu Chuang commented on HDFS-12249: +1 > dfsadmin -metaSave to output maintenance mode