[jira] [Commented] (HDFS-11156) Webhdfs rest api GET_BLOCK_LOCATIONS output doesn't comply with FileSystem API

2016-11-28 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11156?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15704573#comment-15704573 ] Andrew Wang commented on HDFS-11156: Hi folks, I'm -1 on this change. Our users rely on WebHDFS in

[jira] [Commented] (HDFS-11181) Fuse wrapper has a typo

2016-11-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11181?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15704561#comment-15704561 ] Hadoop QA commented on HDFS-11181: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11149) Support for parallel checking of FsVolumes

2016-11-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11149?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15704550#comment-15704550 ] Hadoop QA commented on HDFS-11149: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-11172) Support an erasure coding policy RS-DEFAULT-10-4-64k in HDFS

2016-11-28 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11172?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-11172: --- Affects Version/s: 3.0.0-alpha1 Target Version/s: 3.0.0-alpha2 Component/s:

[jira] [Updated] (HDFS-11172) Support an erasure coding policy RS-DEFAULT-10-4-64k in HDFS

2016-11-28 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11172?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen updated HDFS-11172: - Assignee: Wei Zhou (was: SammiChen) > Support an erasure coding policy RS-DEFAULT-10-4-64k in HDFS >

[jira] [Updated] (HDFS-11072) Add ability to unset and change directory EC policy

2016-11-28 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11072?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen updated HDFS-11072: - Attachment: HDFS-11072-v3.patch 1. fix style issues reported 2. add erasurecode CLI test case 3. add

[jira] [Commented] (HDFS-11181) Fuse wrapper has a typo

2016-11-28 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11181?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15704503#comment-15704503 ] Andrew Wang commented on HDFS-11181: +1 thanks Wei-Chiu > Fuse wrapper has a typo >

[jira] [Updated] (HDFS-11181) Fuse wrapper has a typo

2016-11-28 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11181?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-11181: --- Status: Patch Available (was: Open) > Fuse wrapper has a typo > --- > >

[jira] [Created] (HDFS-11186) [SPS]: Daemon thread of SPS starts only in Active NN

2016-11-28 Thread Wei Zhou (JIRA)
Wei Zhou created HDFS-11186: --- Summary: [SPS]: Daemon thread of SPS starts only in Active NN Key: HDFS-11186 URL: https://issues.apache.org/jira/browse/HDFS-11186 Project: Hadoop HDFS Issue Type:

[jira] [Commented] (HDFS-10675) Datanode support to read from external stores.

2016-11-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10675?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15704464#comment-15704464 ] Hadoop QA commented on HDFS-10675: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11072) Add ability to unset and change directory EC policy

2016-11-28 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11072?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15704460#comment-15704460 ] SammiChen commented on HDFS-11072: -- Hi Rakesh, sorry, I don't know you created HDFS-11082 for

[jira] [Updated] (HDFS-11184) Ozone: SCM: Make SCM use container protocol

2016-11-28 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11184?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-11184: Status: Patch Available (was: Open) > Ozone: SCM: Make SCM use container protocol >

[jira] [Updated] (HDFS-11184) Ozone: SCM: Make SCM use container protocol

2016-11-28 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11184?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-11184: Attachment: HDFS-11184-HDFS-7240.001.patch > Ozone: SCM: Make SCM use container protocol >

[jira] [Updated] (HDFS-11156) Webhdfs rest api GET_BLOCK_LOCATIONS output doesn't comply with FileSystem API

2016-11-28 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11156?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated HDFS-11156: --- Attachment: HDFS-11156.04.patch > Webhdfs rest api GET_BLOCK_LOCATIONS output doesn't comply with

[jira] [Commented] (HDFS-11184) Ozone: SCM: Make SCM use container protocol

2016-11-28 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11184?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15704440#comment-15704440 ] Anu Engineer commented on HDFS-11184: - Filed HDFS-11185 to track tests for ozone. > Ozone: SCM: Make

[jira] [Created] (HDFS-11185) Ozone: Fix disabled tests

2016-11-28 Thread Anu Engineer (JIRA)
Anu Engineer created HDFS-11185: --- Summary: Ozone: Fix disabled tests Key: HDFS-11185 URL: https://issues.apache.org/jira/browse/HDFS-11185 Project: Hadoop HDFS Issue Type: Sub-task

[jira] [Created] (HDFS-11184) Ozone: SCM: Make SCM use container protocol

2016-11-28 Thread Anu Engineer (JIRA)
Anu Engineer created HDFS-11184: --- Summary: Ozone: SCM: Make SCM use container protocol Key: HDFS-11184 URL: https://issues.apache.org/jira/browse/HDFS-11184 Project: Hadoop HDFS Issue Type:

[jira] [Comment Edited] (HDFS-11072) Add ability to unset and change directory EC policy

2016-11-28 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11072?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15704419#comment-15704419 ] Rakesh R edited comment on HDFS-11072 at 11/29/16 6:49 AM: --- Thanks [~Sammi] for

[jira] [Commented] (HDFS-11072) Add ability to unset and change directory EC policy

2016-11-28 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11072?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15704419#comment-15704419 ] Rakesh R commented on HDFS-11072: - Thanks [~Sammi] for the patch. Sometime back I had created HDFS-11082

[jira] [Commented] (HDFS-10206) getBlockLocations might not sort datanodes properly by distance

2016-11-28 Thread Nandakumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15704378#comment-15704378 ] Nandakumar commented on HDFS-10206: --- bq. NetworkTopology can be used by HDFS, YARN and MAPREDUCE. It is

[jira] [Updated] (HDFS-11164) Mover should avoid unnecessary retries if the block is pinned

2016-11-28 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11164?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-11164: Attachment: HDFS-11164-03.patch > Mover should avoid unnecessary retries if the block is pinned >

[jira] [Updated] (HDFS-11149) Support for parallel checking of FsVolumes

2016-11-28 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11149?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-11149: - Attachment: HDFS-11149.10.patch > Support for parallel checking of FsVolumes >

[jira] [Commented] (HDFS-10885) [SPS]: Mover tool should not be allowed to run when Storage Policy Satisfier is on

2016-11-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10885?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15704298#comment-15704298 ] Hadoop QA commented on HDFS-10885: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11179) LightWeightHashSet can't remove blocks correctly which have a large number blockId

2016-11-28 Thread Takanobu Asanuma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11179?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15704280#comment-15704280 ] Takanobu Asanuma commented on HDFS-11179: - I'm sorry but my assumption that LightWeightHashSet has

[jira] [Updated] (HDFS-11179) LightWeightHashSet can't remove blocks correctly which have a large number blockId

2016-11-28 Thread Takanobu Asanuma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11179?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma updated HDFS-11179: Priority: Major (was: Blocker) > LightWeightHashSet can't remove blocks correctly which

[jira] [Commented] (HDFS-11179) LightWeightHashSet can't remove blocks correctly which have a large number blockId

2016-11-28 Thread Takanobu Asanuma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11179?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15704276#comment-15704276 ] Takanobu Asanuma commented on HDFS-11179: - Thanks for the comments, [~jojochuang], [~djp]. That's

[jira] [Commented] (HDFS-11149) Support for parallel checking of FsVolumes

2016-11-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11149?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15704231#comment-15704231 ] Hadoop QA commented on HDFS-11149: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-10675) Datanode support to read from external stores.

2016-11-28 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10675?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HDFS-10675: -- Status: Patch Available (was: Open) > Datanode support to read from external stores.

[jira] [Updated] (HDFS-10675) Datanode support to read from external stores.

2016-11-28 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10675?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HDFS-10675: -- Attachment: HDFS-10675-HDFS-9806.003.patch Updated patch to fix failing test cases, and

[jira] [Commented] (HDFS-11149) Support for parallel checking of FsVolumes

2016-11-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11149?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15704110#comment-15704110 ] Hadoop QA commented on HDFS-11149: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-10885) [SPS]: Mover tool should not be allowed to run when Storage Policy Satisfier is on

2016-11-28 Thread Wei Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10885?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei Zhou updated HDFS-10885: Attachment: HDFS-10885-HDFS-10285.09.patch Thanks [~rakeshr] for the suggestions! The failures reported are

[jira] [Commented] (HDFS-11182) Update DataNode to use DatasetVolumeChecker

2016-11-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11182?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15704052#comment-15704052 ] Hadoop QA commented on HDFS-11182: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-11149) Support for parallel checking of FsVolumes

2016-11-28 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11149?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-11149: - Attachment: HDFS-11149.09.patch > Support for parallel checking of FsVolumes >

[jira] [Commented] (HDFS-11149) Support for parallel checking of FsVolumes

2016-11-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11149?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15703974#comment-15703974 ] Hadoop QA commented on HDFS-11149: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11183) Document XOR policy XOR-2-1-64k support in HDFS

2016-11-28 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11183?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15703966#comment-15703966 ] SammiChen commented on HDFS-11183: -- Thanks Andrew, I will fill the affects and targets versions later If

[jira] [Commented] (HDFS-11106) libhdfs++: Some refactoring to better organize files

2016-11-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11106?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15703964#comment-15703964 ] Hadoop QA commented on HDFS-11106: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-11149) Support for parallel checking of FsVolumes

2016-11-28 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11149?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-11149: - Attachment: HDFS-11149.08.patch The v08 patch adds throttling and a few more unit tests. This is

[jira] [Updated] (HDFS-11183) Document XOR policy XOR-2-1-64k support in HDFS

2016-11-28 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11183?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-11183: --- Affects Version/s: 3.0.0-alpha2 Target Version/s: 3.0.0-alpha2 Thanks for filing this Sammi,

[jira] [Work started] (HDFS-10860) Switch HttpFS to from Tomcat to Jetty

2016-11-28 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10860?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDFS-10860 started by John Zhuge. - > Switch HttpFS to from Tomcat to Jetty > - > >

[jira] [Updated] (HDFS-10860) Switch HttpFS to from Tomcat to Jetty

2016-11-28 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10860?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated HDFS-10860: -- Summary: Switch HttpFS to from Tomcat to Jetty (was: Switch HttpFS to use Jetty) > Switch HttpFS to

[jira] [Updated] (HDFS-10860) Switch HttpFS to use Jetty

2016-11-28 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10860?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated HDFS-10860: -- Hadoop Flags: Incompatible change > Switch HttpFS to use Jetty > -- > >

[jira] [Comment Edited] (HDFS-11094) Send back HAState along with NamespaceInfo during a versionRequest as an optional parameter

2016-11-28 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11094?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15703890#comment-15703890 ] Mingliang Liu edited comment on HDFS-11094 at 11/29/16 2:18 AM: Hi

[jira] [Issue Comment Deleted] (HDFS-11072) Add ability to unset and change directory EC policy

2016-11-28 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11072?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen updated HDFS-11072: - Comment: was deleted (was: 1. fix style issues 2. add more test case 3. solve failed test case) > Add

[jira] [Commented] (HDFS-10994) Support an XOR policy XOR-2-1-64k in HDFS

2016-11-28 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10994?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15703898#comment-15703898 ] SammiChen commented on HDFS-10994: -- Thanks Andrew for the remider! I created JIRA HDFS-11183 to track it.

[jira] [Created] (HDFS-11183) Document XOR policy XOR-2-1-64k support in HDFS

2016-11-28 Thread SammiChen (JIRA)
SammiChen created HDFS-11183: Summary: Document XOR policy XOR-2-1-64k support in HDFS Key: HDFS-11183 URL: https://issues.apache.org/jira/browse/HDFS-11183 Project: Hadoop HDFS Issue Type: Task

[jira] [Commented] (HDFS-11094) Send back HAState along with NamespaceInfo during a versionRequest as an optional parameter

2016-11-28 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11094?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15703890#comment-15703890 ] Mingliang Liu commented on HDFS-11094: -- Hi [~ebadger], thanks for updating the patch. Sorry for

[jira] [Commented] (HDFS-9668) Optimize the locking in FsDatasetImpl

2016-11-28 Thread Jingcheng Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15703882#comment-15703882 ] Jingcheng Du commented on HDFS-9668: Hi [~arpitagarwal], would you mind reviewing the patch V25? thanks

[jira] [Updated] (HDFS-11182) Update DataNode to use DatasetVolumeChecker

2016-11-28 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11182?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-11182: - Status: Open (was: Patch Available) > Update DataNode to use DatasetVolumeChecker >

[jira] [Updated] (HDFS-11182) Update DataNode to use DatasetVolumeChecker

2016-11-28 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11182?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-11182: - Attachment: (was: HDFS-11182.01.patch) > Update DataNode to use DatasetVolumeChecker >

[jira] [Commented] (HDFS-10930) Refactor: Wrap Datanode IO related operations

2016-11-28 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10930?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15703819#comment-15703819 ] Arpit Agarwal commented on HDFS-10930: -- +1 for the v07 patch pending Jenkins. Thanks [~xyao]! Looks

[jira] [Commented] (HDFS-11180) Intermittent deadlock in NameNode when failover happens.

2016-11-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11180?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15703810#comment-15703810 ] Hadoop QA commented on HDFS-11180: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-11182) Update DataNode to use DatasetVolumeChecker

2016-11-28 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11182?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-11182: - Attachment: HDFS-11182.01.patch v01 patch for Jenkins run. > Update DataNode to use

[jira] [Updated] (HDFS-11182) Update DataNode to use DatasetVolumeChecker

2016-11-28 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11182?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-11182: - Status: Patch Available (was: Open) > Update DataNode to use DatasetVolumeChecker >

[jira] [Commented] (HDFS-11182) Update DataNode to use DatasetVolumeChecker

2016-11-28 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11182?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15703804#comment-15703804 ] ASF GitHub Bot commented on HDFS-11182: --- GitHub user arp7 opened a pull request:

[jira] [Updated] (HDFS-11106) libhdfs++: Some refactoring to better organize files

2016-11-28 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11106?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Clampffer updated HDFS-11106: --- Status: Patch Available (was: Open) > libhdfs++: Some refactoring to better organize files >

[jira] [Commented] (HDFS-11181) Fuse wrapper has a typo

2016-11-28 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11181?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15703778#comment-15703778 ] Yiqun Lin commented on HDFS-11181: -- +1 for the fix, you forget to click the "submit patch",

[jira] [Updated] (HDFS-11149) Support for parallel checking of FsVolumes

2016-11-28 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11149?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-11149: - Attachment: HDFS-11149.07.patch v07 patch adds a new test case (testCheckingClosedVolume). >

[jira] [Commented] (HDFS-11178) TestAddStripedBlockInFBR#testAddBlockInFullBlockReport fails frequently in trunk

2016-11-28 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11178?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15703765#comment-15703765 ] Yiqun Lin commented on HDFS-11178: -- Thanks [~liuml07] for taking a look. {quote} Is

[jira] [Commented] (HDFS-10930) Refactor: Wrap Datanode IO related operations

2016-11-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10930?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15703763#comment-15703763 ] Hadoop QA commented on HDFS-10930: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11149) Support for parallel checking of FsVolumes

2016-11-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11149?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15703701#comment-15703701 ] Hadoop QA commented on HDFS-11149: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11149) Support for parallel checking of FsVolumes

2016-11-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11149?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15703661#comment-15703661 ] Hadoop QA commented on HDFS-11149: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Updated] (HDFS-11106) libhdfs++: Some refactoring to better organize files

2016-11-28 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11106?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Clampffer updated HDFS-11106: --- Attachment: HDFS-11106.HDFS-8707.000.patch First pass, added a few comments but otherwise

[jira] [Commented] (HDFS-11178) TestAddStripedBlockInFBR#testAddBlockInFullBlockReport fails frequently in trunk

2016-11-28 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11178?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15703492#comment-15703492 ] Mingliang Liu commented on HDFS-11178: -- Is {{MiniDFSCluster#triggerBlockReports()}} blocking call? If

[jira] [Commented] (HDFS-11179) LightWeightHashSet can't remove blocks correctly which have a large number blockId

2016-11-28 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11179?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15703429#comment-15703429 ] Junping Du commented on HDFS-11179: --- Agree with [~jojochuang]. Especially, this EC staff doesn't show up

[jira] [Updated] (HDFS-11179) LightWeightHashSet can't remove blocks correctly which have a large number blockId

2016-11-28 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11179?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-11179: -- Target Version/s: 3.0.0-alpha2 (was: 2.8.0, 3.0.0-alpha2) > LightWeightHashSet can't remove blocks

[jira] [Updated] (HDFS-11149) Support for parallel checking of FsVolumes

2016-11-28 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11149?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-11149: - Attachment: (was: HDFS-11149.06.patch) > Support for parallel checking of FsVolumes >

[jira] [Updated] (HDFS-11149) Support for parallel checking of FsVolumes

2016-11-28 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11149?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-11149: - Attachment: HDFS-11149.06.patch > Support for parallel checking of FsVolumes >

[jira] [Commented] (HDFS-8678) Bring back the feature to view chunks of files in the HDFS file browser

2016-11-28 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8678?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15703425#comment-15703425 ] Allen Wittenauer commented on HDFS-8678: We should probably move the block information to the

[jira] [Updated] (HDFS-11149) Support for parallel checking of FsVolumes

2016-11-28 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11149?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-11149: - Attachment: HDFS-11149.06.patch > Support for parallel checking of FsVolumes >

[jira] [Updated] (HDFS-11149) Support for parallel checking of FsVolumes

2016-11-28 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11149?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-11149: - Attachment: (was: HDFS-11149.06.patch) > Support for parallel checking of FsVolumes >

[jira] [Updated] (HDFS-11149) Support for parallel checking of FsVolumes

2016-11-28 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11149?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-11149: - Attachment: HDFS-11149.06.patch > Support for parallel checking of FsVolumes >

[jira] [Updated] (HDFS-11149) Support for parallel checking of FsVolumes

2016-11-28 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11149?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-11149: - Attachment: (was: HDFS-11149.06.patch) > Support for parallel checking of FsVolumes >

[jira] [Updated] (HDFS-11180) Intermittent deadlock in NameNode when failover happens.

2016-11-28 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11180?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka updated HDFS-11180: - Attachment: HDFS-11180.03.patch 03 patch: * Added a regression test * Updated FSEditLog and some

[jira] [Updated] (HDFS-11149) Support for parallel checking of FsVolumes

2016-11-28 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11149?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-11149: - Attachment: HDFS-11149.06.patch > Support for parallel checking of FsVolumes >

[jira] [Commented] (HDFS-5517) Lower the default maximum number of blocks per file

2016-11-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5517?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15703397#comment-15703397 ] Hadoop QA commented on HDFS-5517: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-10930) Refactor: Wrap Datanode IO related operations

2016-11-28 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10930?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-10930: -- Attachment: HDFS-10930.07.patch Thanks [~arpitagarwal] for the review. I've updated the patch based on

[jira] [Commented] (HDFS-11149) Support for parallel checking of FsVolumes

2016-11-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11149?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15703372#comment-15703372 ] Hadoop QA commented on HDFS-11149: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11152) Start erasure coding policy ID number from 1 instead of 0 to void potential unexpected errors

2016-11-28 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11152?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15703291#comment-15703291 ] Andrew Wang commented on HDFS-11152: Hi Sammi, thanks for the patch. Looks good overall, but are there

[jira] [Commented] (HDFS-11180) Intermittent deadlock in NameNode when failover happens.

2016-11-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11180?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15703280#comment-15703280 ] Hadoop QA commented on HDFS-11180: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11180) Intermittent deadlock in NameNode when failover happens.

2016-11-28 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11180?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15703262#comment-15703262 ] Akira Ajisaka commented on HDFS-11180: -- Cancelling patch because we need to create unsynchronized

[jira] [Created] (HDFS-11182) Update DataNode to use DatasetVolumeChecker

2016-11-28 Thread Arpit Agarwal (JIRA)
Arpit Agarwal created HDFS-11182: Summary: Update DataNode to use DatasetVolumeChecker Key: HDFS-11182 URL: https://issues.apache.org/jira/browse/HDFS-11182 Project: Hadoop HDFS Issue Type:

[jira] [Commented] (HDFS-11179) LightWeightHashSet can't remove blocks correctly which have a large number blockId

2016-11-28 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11179?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15703169#comment-15703169 ] Wei-Chiu Chuang commented on HDFS-11179: [~tasanuma0829] thanks for filing the bug report. While I

[jira] [Updated] (HDFS-5517) Lower the default maximum number of blocks per file

2016-11-28 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5517?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-5517: -- Attachment: HDFS-5517.002.patch I did the trival rebase for this change, patch attached. > Lower the

[jira] [Commented] (HDFS-11156) Webhdfs rest api GET_BLOCK_LOCATIONS output doesn't comply with FileSystem API

2016-11-28 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11156?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15703132#comment-15703132 ] Mingliang Liu commented on HDFS-11156: -- The patch looks good to me overall. +1 I have several minor

[jira] [Updated] (HDFS-11149) Support for parallel checking of FsVolumes

2016-11-28 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11149?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-11149: - Attachment: HDFS-11149.05.patch v05 patch fixes checkstyle issues. > Support for parallel

[jira] [Updated] (HDFS-6984) In Hadoop 3, make FileStatus serialize itself via protobuf

2016-11-28 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6984?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-6984: -- Target Version/s: 3.0.0-alpha2 (was: ) Setting target version for tracking. > In Hadoop 3, make

[jira] [Commented] (HDFS-11149) Support for parallel checking of FsVolumes

2016-11-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11149?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15703055#comment-15703055 ] Hadoop QA commented on HDFS-11149: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (HDFS-10206) getBlockLocations might not sort datanodes properly by distance

2016-11-28 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15702984#comment-15702984 ] Ming Ma commented on HDFS-10206: * NetworkTopology can be used by HDFS, YARN and MAPREDUCE. It is better

[jira] [Updated] (HDFS-11180) Intermittent deadlock in NameNode when failover happens.

2016-11-28 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11180?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka updated HDFS-11180: - Priority: Blocker (was: Major) > Intermittent deadlock in NameNode when failover happens. >

[jira] [Updated] (HDFS-11180) Intermittent deadlock in NameNode when failover happens.

2016-11-28 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11180?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka updated HDFS-11180: - Assignee: Akira Ajisaka Target Version/s: 2.8.0, 2.7.4, 3.0.0-alpha2, 2.6.6

[jira] [Commented] (HDFS-11149) Support for parallel checking of FsVolumes

2016-11-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11149?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15702928#comment-15702928 ] Hadoop QA commented on HDFS-11149: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10994) Support an XOR policy XOR-2-1-64k in HDFS

2016-11-28 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10994?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15702884#comment-15702884 ] Andrew Wang commented on HDFS-10994: Nice work here Sammi! Do we also need a follow on for a

[jira] [Updated] (HDFS-11149) Support for parallel checking of FsVolumes

2016-11-28 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11149?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-11149: - Attachment: HDFS-11149.04.patch v04 patch adds a test case for disk check hang. > Support for

[jira] [Commented] (HDFS-10885) [SPS]: Mover tool should not be allowed to run when Storage Policy Satisfier is on

2016-11-28 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10885?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15702726#comment-15702726 ] Rakesh R commented on HDFS-10885: - Thanks [~zhouwei] for the good work. I'm +1 for the latest patch after

[jira] [Updated] (HDFS-11149) Support for parallel checking of FsVolumes

2016-11-28 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11149?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-11149: - Attachment: HDFS-11149.03.patch Fix issues flagged by Jenkins. > Support for parallel checking

[jira] [Updated] (HDFS-11171) add metric to report client shortcircuit reads

2016-11-28 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11171?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-11171: - Status: Open (was: Patch Available) > add metric to report client shortcircuit reads >

[jira] [Commented] (HDFS-11072) Add ability to unset and change directory EC policy

2016-11-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11072?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15702598#comment-15702598 ] Hadoop QA commented on HDFS-11072: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-9483) Documentation does not cover use of "swebhdfs" as URL scheme for SSL-secured WebHDFS.

2016-11-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9483?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15702577#comment-15702577 ] Hadoop QA commented on HDFS-9483: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Comment Edited] (HDFS-9483) Documentation does not cover use of "swebhdfs" as URL scheme for SSL-secured WebHDFS.

2016-11-28 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9483?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15702541#comment-15702541 ] Brahma Reddy Battula edited comment on HDFS-9483 at 11/28/16 5:19 PM: --

[jira] [Commented] (HDFS-9483) Documentation does not cover use of "swebhdfs" as URL scheme for SSL-secured WebHDFS.

2016-11-28 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9483?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15702541#comment-15702541 ] Brahma Reddy Battula commented on HDFS-9483: [~surendrasingh] thanks for updating the patch.

  1   2   >