[jira] [Commented] (HDFS-11293) FsDatasetImpl throws ReplicaAlreadyExistsException in a wrong situation

2017-01-04 Thread Yuanbo Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15800624#comment-15800624 ] Yuanbo Liu commented on HDFS-11293: --- [~umamaheswararao] / [~rakeshr] I tag you here because this

[jira] [Created] (HDFS-11293) FsDatasetImpl throws ReplicaAlreadyExistsException in a wrong situation

2017-01-04 Thread Yuanbo Liu (JIRA)
Yuanbo Liu created HDFS-11293: - Summary: FsDatasetImpl throws ReplicaAlreadyExistsException in a wrong situation Key: HDFS-11293 URL: https://issues.apache.org/jira/browse/HDFS-11293 Project: Hadoop HDFS

[jira] [Commented] (HDFS-9391) Update webUI/JMX to display maintenance state info

2017-01-04 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9391?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15800575#comment-15800575 ] Ming Ma commented on HDFS-9391: --- Sure let us keep what you have in patch 02. Just to make sure, can you

[jira] [Commented] (HDFS-11280) Allow WebHDFS to reuse HTTP connections to NN

2017-01-04 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11280?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15800550#comment-15800550 ] Haohui Mai commented on HDFS-11280: --- Committed all the way down to branch-2.7. Many thanks everyone for

[jira] [Updated] (HDFS-11280) Allow WebHDFS to reuse HTTP connections to NN

2017-01-04 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11280?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-11280: -- Resolution: Fixed Fix Version/s: 3.0.0-alpha2 2.7.4 2.8.0

[jira] [Commented] (HDFS-9935) Remove LEASE_{SOFTLIMIT,HARDLIMIT}_PERIOD constants from HdfsServerConstants

2017-01-04 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9935?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15800463#comment-15800463 ] Hadoop QA commented on HDFS-9935: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11280) Allow WebHDFS to reuse HTTP connections to NN

2017-01-04 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11280?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15800394#comment-15800394 ] Hudson commented on HDFS-11280: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #11074 (See

[jira] [Commented] (HDFS-11280) Allow WebHDFS to reuse HTTP connections to NN

2017-01-04 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11280?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15800337#comment-15800337 ] Haohui Mai commented on HDFS-11280: --- Validate that the the latest patch passes the unit tests mentioned

[jira] [Commented] (HDFS-9935) Remove LEASE_{SOFTLIMIT,HARDLIMIT}_PERIOD constants from HdfsServerConstants

2017-01-04 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9935?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15800276#comment-15800276 ] Brahma Reddy Battula commented on HDFS-9935: I feel, this can be removed as these are not used

[jira] [Commented] (HDFS-11285) Dead DataNodes keep a long time in (Dead, DECOMMISSION_INPROGRESS), and never transition to (Dead, DECOMMISSIONED)

2017-01-04 Thread Lantao Jin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11285?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15800224#comment-15800224 ] Lantao Jin commented on HDFS-11285: --- Thanks [~andrew.wang], I'm not sure whether or not our case is a

[jira] [Commented] (HDFS-11193) [SPS]: Erasure coded files should be considered for satisfying storage policy

2017-01-04 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11193?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15800153#comment-15800153 ] Uma Maheswara Rao G commented on HDFS-11193: [~rakeshr] There is a check style error reported

[jira] [Commented] (HDFS-9483) Documentation does not cover use of "swebhdfs" as URL scheme for SSL-secured WebHDFS.

2017-01-04 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9483?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15800155#comment-15800155 ] Brahma Reddy Battula commented on HDFS-9483: [~cnauroth] thanks your reply..Agreed with you.Me

[jira] [Updated] (HDFS-11292) log lastWrittenTxId etc info in logSyncAll

2017-01-04 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11292?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-11292: - Summary: log lastWrittenTxId etc info in logSyncAll (was: log lastWrittenTxId in logSyncAll) >

[jira] [Commented] (HDFS-9391) Update webUI/JMX to display maintenance state info

2017-01-04 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9391?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15800144#comment-15800144 ] Manoj Govindassamy commented on HDFS-9391: -- Yes, in the example you gave both

[jira] [Commented] (HDFS-11291) Avoid unnecessary edit log for setStoragePolicy() and setReplication()

2017-01-04 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11291?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15800087#comment-15800087 ] Yiqun Lin commented on HDFS-11291: -- Thanks [~surendrasingh] for the work on this. Yes, it will avoid

[jira] [Updated] (HDFS-5180) Output the processing time of slow RPC request to node's log

2017-01-04 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5180?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-5180: - Fix Version/s: (was: 2.8.0) > Output the processing time of slow RPC request to node's log >

[jira] [Updated] (HDFS-8061) Create an Offline FSImage Viewer tool

2017-01-04 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8061?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-8061: - Fix Version/s: (was: 2.8.0) > Create an Offline FSImage Viewer tool >

[jira] [Updated] (HDFS-8306) Outputs Xattr in OIV XML format

2017-01-04 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8306?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-8306: - Fix Version/s: (was: 2.8.0) > Outputs Xattr in OIV XML format > --- > >

[jira] [Updated] (HDFS-8872) Reporting of missing blocks is different in fsck and namenode ui/metasave

2017-01-04 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8872?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-8872: - Fix Version/s: (was: 2.8.0) > Reporting of missing blocks is different in fsck and namenode

[jira] [Updated] (HDFS-9310) TestDataNodeHotSwapVolumes fails occasionally

2017-01-04 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9310?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-9310: - Fix Version/s: (was: 2.8.0) > TestDataNodeHotSwapVolumes fails occasionally >

[jira] [Commented] (HDFS-9940) Balancer should not use property dfs.datanode.balance.max.concurrent.moves

2017-01-04 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9940?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15799935#comment-15799935 ] Junping Du commented on HDFS-9940: -- The patch is not get in, so we should set target version instead of

[jira] [Updated] (HDFS-9287) Block placement completely fails if too many nodes are decommissioning

2017-01-04 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9287?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-9287: - Fix Version/s: (was: 2.8.0) > Block placement completely fails if too many nodes are decommissioning >

[jira] [Updated] (HDFS-9940) Balancer should not use property dfs.datanode.balance.max.concurrent.moves

2017-01-04 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9940?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-9940: - Fix Version/s: (was: 2.8.0) > Balancer should not use property

[jira] [Updated] (HDFS-9940) Balancer should not use property dfs.datanode.balance.max.concurrent.moves

2017-01-04 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9940?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-9940: - Target Version/s: 2.9.0 (was: 2.8.0) > Balancer should not use property

[jira] [Updated] (HDFS-10171) Balancer should log config values

2017-01-04 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10171?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-10171: -- Fix Version/s: (was: 2.8.0) > Balancer should log config values > -

[jira] [Updated] (HDFS-10198) File browser web UI should split to pages when files/dirs are too many

2017-01-04 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10198?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-10198: -- Fix Version/s: (was: 2.8.0) > File browser web UI should split to pages when files/dirs are too

[jira] [Commented] (HDFS-10608) Include event for AddBlock in Inotify Event Stream

2017-01-04 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10608?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15799932#comment-15799932 ] Arpit Agarwal commented on HDFS-10608: -- Hi [~churromorales], I am sorry you didn't get a timely

[jira] [Updated] (HDFS-10315) Fix TestRetryCacheWithHA and TestNamenodeRetryCache failures

2017-01-04 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10315?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-10315: -- Fix Version/s: (was: 2.8.0) > Fix TestRetryCacheWithHA and TestNamenodeRetryCache failures >

[jira] [Commented] (HDFS-10716) In Balancer, the target task should be removed when its size < 0.

2017-01-04 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10716?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15799925#comment-15799925 ] Junping Du commented on HDFS-10716: --- Sound like we were missing jira number in commit log. {noformat}

[jira] [Updated] (HDFS-10888) dfshealth.html#tab-datanode

2017-01-04 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10888?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-10888: -- Fix Version/s: (was: 2.8.0) > dfshealth.html#tab-datanode > --- > >

[jira] [Commented] (HDFS-11160) VolumeScanner reports write-in-progress replicas as corrupt incorrectly

2017-01-04 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11160?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15799919#comment-15799919 ] Junping Du commented on HDFS-11160: --- >From commit log, it indicate the commit only land in branch-2 but

[jira] [Updated] (HDFS-11160) VolumeScanner reports write-in-progress replicas as corrupt incorrectly

2017-01-04 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11160?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-11160: -- Fix Version/s: (was: 2.8.0) 2.9.0 > VolumeScanner reports write-in-progress

[jira] [Commented] (HDFS-9391) Update webUI/JMX to display maintenance state info

2017-01-04 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9391?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15799905#comment-15799905 ] Ming Ma commented on HDFS-9391: --- Good point. Actually it seems maintenanceOnlyReplicas is the same as

[jira] [Commented] (HDFS-11170) Add create API in filesystem public class to support assign parameter through builder

2017-01-04 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11170?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15799870#comment-15799870 ] Hadoop QA commented on HDFS-11170: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11292) log lastWrittenTxId in logSyncAll

2017-01-04 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11292?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15799806#comment-15799806 ] Hadoop QA commented on HDFS-11292: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11096) Support rolling upgrade between 2.x and 3.x

2017-01-04 Thread Sean Mackrory (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11096?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15799802#comment-15799802 ] Sean Mackrory commented on HDFS-11096: -- I've been doing a lot of testing. I've posted some automation

[jira] [Commented] (HDFS-11292) log lastWrittenTxId in logSyncAll

2017-01-04 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11292?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15799783#comment-15799783 ] Hadoop QA commented on HDFS-11292: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-11273) Move TransferFsImage#doGetUrl function to a Util class

2017-01-04 Thread Hanisha Koneru (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11273?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hanisha Koneru updated HDFS-11273: -- Attachment: HDFS-11273.002.patch Thank you [~jingzhao]. I have uploaded patch v02 with the new

[jira] [Commented] (HDFS-11072) Add ability to unset and change directory EC policy

2017-01-04 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11072?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15799712#comment-15799712 ] Andrew Wang commented on HDFS-11072: Thanks for the rev Sammi, looks like we're getting close. Agree

[jira] [Updated] (HDFS-11292) log lastWrittenTxId in logSyncAll

2017-01-04 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11292?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-11292: - Attachment: HDFS-11292.002.patch > log lastWrittenTxId in logSyncAll >

[jira] [Updated] (HDFS-11156) Add new op GETFILEBLOCKLOCATIONS to WebHDFS REST API

2017-01-04 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11156?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-11156: --- Resolution: Fixed Fix Version/s: 2.9.0 Status: Resolved (was: Patch Available) I

[jira] [Commented] (HDFS-9483) Documentation does not cover use of "swebhdfs" as URL scheme for SSL-secured WebHDFS.

2017-01-04 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9483?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15799645#comment-15799645 ] Chris Nauroth commented on HDFS-9483: - I'm +1 for patch 002. [~brahmareddy], you had suggested perhaps

[jira] [Updated] (HDFS-11292) log lastWrittenTxId in logSyncAll

2017-01-04 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11292?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-11292: - Attachment: (was: HDFS-11292.002.patch) > log lastWrittenTxId in logSyncAll >

[jira] [Commented] (HDFS-11193) [SPS]: Erasure coded files should be considered for satisfying storage policy

2017-01-04 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11193?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15799571#comment-15799571 ] Hadoop QA commented on HDFS-11193: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10759) Change fsimage bool isStriped from boolean to an enum

2017-01-04 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10759?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15799545#comment-15799545 ] Andrew Wang commented on HDFS-10759: Hi [~ehiggs], I think you accidentally attached a patch for

[jira] [Updated] (HDFS-11292) log lastWrittenTxId in logSyncAll

2017-01-04 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11292?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-11292: - Attachment: HDFS-11292.002.patch > log lastWrittenTxId in logSyncAll >

[jira] [Updated] (HDFS-7967) Reduce the performance impact of the balancer

2017-01-04 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7967?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daryn Sharp updated HDFS-7967: -- Attachment: HDFS-7967-branch-2.8.patch It wasn't as stale as I thought, I was mostly thrown off by

[jira] [Commented] (HDFS-11156) Add new op GETFILEBLOCKLOCATIONS to WebHDFS REST API

2017-01-04 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11156?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15799519#comment-15799519 ] Hadoop QA commented on HDFS-11156: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11273) Move TransferFsImage#doGetUrl function to a Util class

2017-01-04 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11273?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15799513#comment-15799513 ] Jing Zhao commented on HDFS-11273: -- Thanks for updating the patch, [~hkoneru]! The updated patch is

[jira] [Updated] (HDFS-11292) log lastWrittenTxId in logSyncAll

2017-01-04 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11292?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-11292: - Attachment: HDFS-11292.001.patch > log lastWrittenTxId in logSyncAll >

[jira] [Updated] (HDFS-11292) log lastWrittenTxId in logSyncAll

2017-01-04 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11292?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-11292: - Attachment: (was: HDFS-11292.001.patch) > log lastWrittenTxId in logSyncAll >

[jira] [Updated] (HDFS-11292) log lastWrittenTxId in logSyncAll

2017-01-04 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11292?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-11292: - Status: Patch Available (was: Open) > log lastWrittenTxId in logSyncAll >

[jira] [Updated] (HDFS-11292) log lastWrittenTxId in logSyncAll

2017-01-04 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11292?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-11292: - Attachment: HDFS-11292.001.patch > log lastWrittenTxId in logSyncAll >

[jira] [Commented] (HDFS-11170) Add create API in filesystem public class to support assign parameter through builder

2017-01-04 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11170?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15799505#comment-15799505 ] Andrew Wang commented on HDFS-11170: I also retriggered the precommit build manually, somehow it

[jira] [Commented] (HDFS-11170) Add create API in filesystem public class to support assign parameter through builder

2017-01-04 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11170?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15799493#comment-15799493 ] Andrew Wang commented on HDFS-11170: Thanks for working on this [~zhouwei], looks great overall :) A

[jira] [Updated] (HDFS-11290) TestFSNameSystemMBean should wait until the cache is cleared

2017-01-04 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11290?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen updated HDFS-11290: --- Attachment: HDFS-11290.000.patch Attaching a patch which uses a {{Thread.sleep(1000)}} to force the

[jira] [Updated] (HDFS-11290) TestFSNameSystemMBean should wait until the cache is cleared

2017-01-04 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11290?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen updated HDFS-11290: --- Status: Patch Available (was: Open) > TestFSNameSystemMBean should wait until the cache is cleared >

[jira] [Commented] (HDFS-11273) Move TransferFsImage#doGetUrl function to a Util class

2017-01-04 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11273?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15799420#comment-15799420 ] Hadoop QA commented on HDFS-11273: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-7967) Reduce the performance impact of the balancer

2017-01-04 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7967?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15799394#comment-15799394 ] Daryn Sharp commented on HDFS-7967: --- Removing stale 2.8 patch (based on earlier version), will repost

[jira] [Updated] (HDFS-7967) Reduce the performance impact of the balancer

2017-01-04 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7967?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daryn Sharp updated HDFS-7967: -- Attachment: (was: HDFS-7967-branch-2.8.patch) > Reduce the performance impact of the balancer >

[jira] [Updated] (HDFS-7967) Reduce the performance impact of the balancer

2017-01-04 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7967?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daryn Sharp updated HDFS-7967: -- Priority: Critical (was: Major) I'm inclined to make this a blocker since the balancer is virtually

[jira] [Updated] (HDFS-7967) Reduce the performance impact of the balancer

2017-01-04 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7967?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daryn Sharp updated HDFS-7967: -- Attachment: HDFS-7967-branch-2.patch HDFS-7967-branch-2.8.patch We’ve been using a

[jira] [Commented] (HDFS-11193) [SPS]: Erasure coded files should be considered for satisfying storage policy

2017-01-04 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11193?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15799327#comment-15799327 ] Uma Maheswara Rao G commented on HDFS-11193: Latest patch looks good to me. +1 pending jenkins

[jira] [Updated] (HDFS-11259) Update fsck to display maintenance state info

2017-01-04 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11259?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manoj Govindassamy updated HDFS-11259: -- Affects Version/s: 3.0.0-alpha1 Target Version/s: 3.0.0-alpha2

[jira] [Updated] (HDFS-11259) Update fsck to display maintenance state info

2017-01-04 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11259?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manoj Govindassamy updated HDFS-11259: -- Attachment: HDFS-11259.01.patch Attached v01 patch to address the following: 1. Made

[jira] [Commented] (HDFS-11288) Manually allow block replication/deletion in Safe Mode

2017-01-04 Thread Lukas Majercak (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15799253#comment-15799253 ] Lukas Majercak commented on HDFS-11288: --- Attached a patch. [~esteban], I don't understand what you

[jira] [Updated] (HDFS-11288) Manually allow block replication/deletion in Safe Mode

2017-01-04 Thread Lukas Majercak (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11288?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lukas Majercak updated HDFS-11288: -- Attachment: HDFS-11288.001.patch > Manually allow block replication/deletion in Safe Mode >

[jira] [Assigned] (HDFS-11290) TestFSNameSystemMBean should wait until the cache is cleared

2017-01-04 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11290?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen reassigned HDFS-11290: -- Assignee: Erik Krogen > TestFSNameSystemMBean should wait until the cache is cleared >

[jira] [Updated] (HDFS-11273) Move TransferFsImage#doGetUrl function to a Util class

2017-01-04 Thread Hanisha Koneru (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11273?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hanisha Koneru updated HDFS-11273: -- Attachment: HDFS-11273.001.patch Thank you [~jingzhao] for reviewing the patch. I have

[jira] [Updated] (HDFS-11273) Move TransferFsImage#doGetUrl function to a Util class

2017-01-04 Thread Hanisha Koneru (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11273?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hanisha Koneru updated HDFS-11273: -- Description: TransferFsImage#doGetUrl downloads files from the specified url and stores them

[jira] [Updated] (HDFS-11258) File mtime change could not save to editlog

2017-01-04 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11258?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-11258: --- Fix Version/s: (was: 3.0.0-alpha1) 3.0.0-alpha2 > File mtime change could not

[jira] [Updated] (HDFS-10608) Include event for AddBlock in Inotify Event Stream

2017-01-04 Thread churro morales (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10608?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] churro morales updated HDFS-10608: -- Status: Open (was: Patch Available) > Include event for AddBlock in Inotify Event Stream >

[jira] [Resolved] (HDFS-10608) Include event for AddBlock in Inotify Event Stream

2017-01-04 Thread churro morales (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10608?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] churro morales resolved HDFS-10608. --- Resolution: Won't Fix looks like nobody is interested in this patch, so ill just close this

[jira] [Updated] (HDFS-11156) Add new op GETFILEBLOCKLOCATIONS to WebHDFS REST API

2017-01-04 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11156?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-11156: --- Status: Patch Available (was: Reopened) > Add new op GETFILEBLOCKLOCATIONS to WebHDFS REST API >

[jira] [Commented] (HDFS-11291) Avoid unnecessary edit log for setStoragePolicy() and setReplication()

2017-01-04 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11291?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15799120#comment-15799120 ] Hadoop QA commented on HDFS-11291: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-11156) Add new op GETFILEBLOCKLOCATIONS to WebHDFS REST API

2017-01-04 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11156?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-11156: --- Fix Version/s: (was: 2.9.0) > Add new op GETFILEBLOCKLOCATIONS to WebHDFS REST API >

[jira] [Reopened] (HDFS-11156) Add new op GETFILEBLOCKLOCATIONS to WebHDFS REST API

2017-01-04 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11156?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang reopened HDFS-11156: Reopening for precommit run. > Add new op GETFILEBLOCKLOCATIONS to WebHDFS REST API >

[jira] [Updated] (HDFS-11028) libhdfs++: FileHandleImpl::CancelOperations needs to be able to cancel pending connections

2017-01-04 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11028?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Clampffer updated HDFS-11028: --- Attachment: HDFS-11028.HDFS-8707.002.patch New patch, should be ready to review. -Added C

[jira] [Commented] (HDFS-10943) rollEditLog expects empty EditsDoubleBuffer.bufCurrent which is not guaranteed

2017-01-04 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10943?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15799075#comment-15799075 ] Yongjun Zhang commented on HDFS-10943: -- The issue remains even after HDFS-7964 is included.

[jira] [Assigned] (HDFS-11292) log lastWrittenTxId in logSyncAll

2017-01-04 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11292?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang reassigned HDFS-11292: Assignee: Yongjun Zhang > log lastWrittenTxId in logSyncAll >

[jira] [Created] (HDFS-11292) log lastWrittenTxId in logSyncAll

2017-01-04 Thread Yongjun Zhang (JIRA)
Yongjun Zhang created HDFS-11292: Summary: log lastWrittenTxId in logSyncAll Key: HDFS-11292 URL: https://issues.apache.org/jira/browse/HDFS-11292 Project: Hadoop HDFS Issue Type:

[jira] [Commented] (HDFS-11096) Support rolling upgrade between 2.x and 3.x

2017-01-04 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11096?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15799057#comment-15799057 ] Andrew Wang commented on HDFS-11096: Thanks for the very thorough analysis here Sean! Do you think we

[jira] [Commented] (HDFS-11279) Cleanup unused DataNode#checkDiskErrorAsync()

2017-01-04 Thread Hanisha Koneru (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11279?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15799036#comment-15799036 ] Hanisha Koneru commented on HDFS-11279: --- Thank you [~xyao] for committing the patch. > Cleanup

[jira] [Commented] (HDFS-11180) Intermittent deadlock in NameNode when failover happens.

2017-01-04 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11180?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15799032#comment-15799032 ] Erik Krogen commented on HDFS-11180: Thanks [~ajisakaa]! I will do a little investigation and see if I

[jira] [Commented] (HDFS-11028) libhdfs++: FileHandleImpl::CancelOperations needs to be able to cancel pending connections

2017-01-04 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11028?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15798799#comment-15798799 ] Hadoop QA commented on HDFS-11028: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-11291) Avoid unnecessary edit log for setStoragePolicy() and setReplication()

2017-01-04 Thread Surendra Singh Lilhore (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11291?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Surendra Singh Lilhore updated HDFS-11291: -- Status: Patch Available (was: Open) > Avoid unnecessary edit log for

[jira] [Updated] (HDFS-11291) Avoid unnecessary edit log for setStoragePolicy() and setReplication()

2017-01-04 Thread Surendra Singh Lilhore (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11291?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Surendra Singh Lilhore updated HDFS-11291: -- Attachment: HDFS-11291.001.patch Attached patch.. Please review.. > Avoid

[jira] [Updated] (HDFS-11028) libhdfs++: FileHandleImpl::CancelOperations needs to be able to cancel pending connections

2017-01-04 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11028?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Clampffer updated HDFS-11028: --- Attachment: HDFS-11028.HDFS-8707.001.patch Updated patch: -Isolated the connection cancel

[jira] [Created] (HDFS-11291) Avoid unnecessary edit log for setStoragePolicy() and setReplication()

2017-01-04 Thread Surendra Singh Lilhore (JIRA)
Surendra Singh Lilhore created HDFS-11291: - Summary: Avoid unnecessary edit log for setStoragePolicy() and setReplication() Key: HDFS-11291 URL: https://issues.apache.org/jira/browse/HDFS-11291

[jira] [Commented] (HDFS-11282) Document the missing metrics of DataNode Volume IO operations

2017-01-04 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15798224#comment-15798224 ] Hadoop QA commented on HDFS-11282: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Updated] (HDFS-11282) Document the missing metrics of DataNode Volume IO operations

2017-01-04 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11282?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-11282: - Attachment: HDFS-11282.003.patch > Document the missing metrics of DataNode Volume IO operations >

[jira] [Updated] (HDFS-11282) Document the missing metrics of DataNode Volume IO operations

2017-01-04 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11282?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-11282: - Attachment: (was: HDFS-11282.003.patch) > Document the missing metrics of DataNode Volume IO

[jira] [Commented] (HDFS-11191) Datanode Capacity is misleading if the dfs.datanode.data.dir is configured with two directories from the same file system.

2017-01-04 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11191?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15798133#comment-15798133 ] Hadoop QA commented on HDFS-11191: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-11282) Document the missing metrics of DataNode Volume IO operations

2017-01-04 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11282?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-11282: - Attachment: HDFS-11282.003.patch Thanks for the patient review, [~arpitagarwal]. {quote} The description

[jira] [Updated] (HDFS-11191) Datanode Capacity is misleading if the dfs.datanode.data.dir is configured with two directories from the same file system.

2017-01-04 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11191?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated HDFS-11191: --- Attachment: HDFS-11191.05.patch > Datanode Capacity is misleading if the dfs.datanode.data.dir is

[jira] [Updated] (HDFS-6874) Add GETFILEBLOCKLOCATIONS operation to HttpFS

2017-01-04 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6874?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated HDFS-6874: -- Status: Patch Available (was: In Progress) > Add GETFILEBLOCKLOCATIONS operation to HttpFS >

[jira] [Updated] (HDFS-6874) Add GETFILEBLOCKLOCATIONS operation to HttpFS

2017-01-04 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6874?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated HDFS-6874: -- Attachment: HDFS-6874.04.patch > Add GETFILEBLOCKLOCATIONS operation to HttpFS >