[jira] [Commented] (HDFS-10735) Distcp using webhdfs on secure HA clusters fails with StandbyException

2016-10-12 Thread Benoy Antony (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10735?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15570939#comment-15570939 ] Benoy Antony commented on HDFS-10735: - [~arpitagarwal], Thanks for the review. Since the issue happens

[jira] [Commented] (HDFS-11002) Fix broken attr/getfattr/setfattr links in ExtendedAttributes.md

2016-10-12 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11002?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15570918#comment-15570918 ] Mingliang Liu commented on HDFS-11002: -- Thank you for your review and commit! > Fix broken

[jira] [Updated] (HDFS-11002) Fix broken attr/getfattr/setfattr links in ExtendedAttributes.md

2016-10-12 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11002?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka updated HDFS-11002: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.0-alpha2

[jira] [Commented] (HDFS-11002) Fix broken attr/getfattr/setfattr links in ExtendedAttributes.md

2016-10-12 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11002?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15570801#comment-15570801 ] Akira Ajisaka commented on HDFS-11002: -- LGTM, +1. > Fix broken attr/getfattr/setfattr links in

[jira] [Commented] (HDFS-11002) Fix broken attr/getfattr/setfattr links in ExtendedAttributes.md

2016-10-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11002?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15570661#comment-15570661 ] Hadoop QA commented on HDFS-11002: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Updated] (HDFS-11002) Fix broken attr/getfattr/setfattr links in ExtendedAttributes.md

2016-10-12 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11002?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-11002: - Attachment: HDFS-11002.001.patch Thank you [~ajisakaa] for your prompt review! {quote} Recently

[jira] [Commented] (HDFS-11002) Fix broken attr/getfattr/setfattr links in ExtendedAttributes.md

2016-10-12 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11002?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15570573#comment-15570573 ] Akira Ajisaka commented on HDFS-11002: -- Thanks [~liuml07] for reporting this and providing a patch!

[jira] [Commented] (HDFS-11002) Fix broken attr/getfattr/setfattr links in ExtendedAttributes.md

2016-10-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11002?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15570542#comment-15570542 ] Hadoop QA commented on HDFS-11002: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Updated] (HDFS-11001) Ozone:SCM: Add support for registerNode in SCM

2016-10-12 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11001?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-11001: Attachment: HDFS-11001-HDFS-7240.001.patch Attaching a patch for early code review. This patch

[jira] [Updated] (HDFS-10903) Replace config key literal strings with config key names II: hadoop hdfs

2016-10-12 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10903?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-10903: - Resolution: Fixed Hadoop Flags: Reviewed Status: Resolved (was: Patch Available)

[jira] [Updated] (HDFS-11002) Fix broken attr/getfattr/setfattr links in ExtendedAttributes.md

2016-10-12 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11002?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-11002: - Status: Patch Available (was: Open) > Fix broken attr/getfattr/setfattr links in

[jira] [Updated] (HDFS-11002) Fix broken attr/getfattr/setfattr links in ExtendedAttributes.md

2016-10-12 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11002?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-11002: - Attachment: HDFS-11002.000.patch Kindly review. > Fix broken attr/getfattr/setfattr links in

[jira] [Updated] (HDFS-11002) Fix broken attr/getfattr/setfattr links in ExtendedAttributes.md

2016-10-12 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11002?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-11002: - Summary: Fix broken attr/getfattr/setfattr links in ExtendedAttributes.md (was: Fix broken

[jira] [Created] (HDFS-11002) Fix broken attr(5) link in ExtendedAttributes.md

2016-10-12 Thread Mingliang Liu (JIRA)
Mingliang Liu created HDFS-11002: Summary: Fix broken attr(5) link in ExtendedAttributes.md Key: HDFS-11002 URL: https://issues.apache.org/jira/browse/HDFS-11002 Project: Hadoop HDFS Issue

[jira] [Commented] (HDFS-10912) Ozone:SCM: Add chill mode support to NodeManager.

2016-10-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10912?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15570488#comment-15570488 ] Hadoop QA commented on HDFS-10912: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-10429) DataStreamer interrupted warning always appears when using CLI upload file

2016-10-12 Thread Zhiyuan Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10429?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhiyuan Yang updated HDFS-10429: Assignee: Wei-Chiu Chuang (was: Zhiyuan Yang) > DataStreamer interrupted warning always appears

[jira] [Commented] (HDFS-10903) Replace config key literal strings with config key names II: hadoop hdfs

2016-10-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10903?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15570410#comment-15570410 ] Hadoop QA commented on HDFS-10903: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Updated] (HDFS-10995) Ozone : move ozone XceiverClient to hdfs-client

2016-10-12 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10995?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-10995: Resolution: Fixed Hadoop Flags: Reviewed Status: Resolved (was: Patch Available)

[jira] [Commented] (HDFS-10995) Ozone : move ozone XceiverClient to hdfs-client

2016-10-12 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10995?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15570351#comment-15570351 ] Anu Engineer commented on HDFS-10995: - +1, Thanks for the patch [~vagarychen]. I will commit this

[jira] [Commented] (HDFS-10995) Ozone : move ozone XceiverClient to hdfs-client

2016-10-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10995?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15570337#comment-15570337 ] Hadoop QA commented on HDFS-10995: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-8630) WebHDFS : Support get/set/unset StoragePolicy

2016-10-12 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8630?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-8630: -- Component/s: webhdfs > WebHDFS : Support get/set/unset StoragePolicy >

[jira] [Commented] (HDFS-8630) WebHDFS : Support get/set/unset StoragePolicy

2016-10-12 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15570330#comment-15570330 ] Andrew Wang commented on HDFS-8630: --- Hi Surendra, thanks for working on this. Overall looks great! The

[jira] [Commented] (HDFS-10906) Add unit tests for Trash with HDFS encryption zones

2016-10-12 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10906?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15570278#comment-15570278 ] Xiaoyu Yao commented on HDFS-10906: --- Thanks [~hanishakoneru] for working on this to improve the unit

[jira] [Updated] (HDFS-10912) Ozone:SCM: Add chill mode support to NodeManager.

2016-10-12 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10912?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-10912: Attachment: HDFS-10912-HDFS-7240.005.patch Removed Safe mode references from test code too. >

[jira] [Commented] (HDFS-11000) webhdfs PUT does not work if requests are routed to call queue.

2016-10-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11000?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15570171#comment-15570171 ] Hadoop QA commented on HDFS-11000: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10912) Ozone:SCM: Add chill mode support to NodeManager.

2016-10-12 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10912?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15570142#comment-15570142 ] Xiaoyu Yao commented on HDFS-10912: --- Thanks [~anu] for the update. Can we also clean up the "safe mode"

[jira] [Created] (HDFS-11001) Ozone:SCM: Add support for registerNode in SCM

2016-10-12 Thread Anu Engineer (JIRA)
Anu Engineer created HDFS-11001: --- Summary: Ozone:SCM: Add support for registerNode in SCM Key: HDFS-11001 URL: https://issues.apache.org/jira/browse/HDFS-11001 Project: Hadoop HDFS Issue Type:

[jira] [Commented] (HDFS-10938) Ozone: SCM: Add datanode protocol

2016-10-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10938?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15570118#comment-15570118 ] Hadoop QA commented on HDFS-10938: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-10995) Ozone : move ozone XceiverClient to hdfs-client

2016-10-12 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10995?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-10995: -- Attachment: HDFS-10995-HDFS-7240.005.patch The failed worked fine locally, exception for

[jira] [Updated] (HDFS-10903) Replace config key literal strings with config key names II: hadoop hdfs

2016-10-12 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10903?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-10903: -- Attachment: HDFS-10903-branch-2.005.patch fix rebase issue in v005 patch > Replace config key literal

[jira] [Commented] (HDFS-10995) Ozone : move ozone XceiverClient to hdfs-client

2016-10-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10995?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15570014#comment-15570014 ] Hadoop QA commented on HDFS-10995: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10903) Replace config key literal strings with config key names II: hadoop hdfs

2016-10-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10903?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15569982#comment-15569982 ] Hadoop QA commented on HDFS-10903: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-10903) Replace config key literal strings with config key names II: hadoop hdfs

2016-10-12 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10903?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-10903: -- Attachment: HDFS-10903-branch-2.004.patch Uploaded v004 patch for branch-2. > Replace config key

[jira] [Commented] (HDFS-10789) Route webhdfs through the RPC call queue

2016-10-12 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10789?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15569954#comment-15569954 ] Kihwal Lee commented on HDFS-10789: --- I remember we had to fix one bug after this feature. Filed

[jira] [Updated] (HDFS-11000) webhdfs PUT does not work if requests are routed to call queue.

2016-10-12 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11000?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-11000: -- Target Version/s: 2.8.0 > webhdfs PUT does not work if requests are routed to call queue. >

[jira] [Commented] (HDFS-11000) webhdfs PUT does not work if requests are routed to call queue.

2016-10-12 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11000?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15569951#comment-15569951 ] Kihwal Lee commented on HDFS-11000: --- We have been using this fix since last year in production. >

[jira] [Updated] (HDFS-11000) webhdfs PUT does not work if requests are routed to call queue.

2016-10-12 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11000?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-11000: -- Description: If webhdfs calls are routed to ipc call queue, PUT does not work. I think this is what we

[jira] [Commented] (HDFS-11000) webhdfs PUT does not work if requests are routed to call queue.

2016-10-12 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11000?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15569937#comment-15569937 ] Kihwal Lee commented on HDFS-11000: --- [~daryn], you know what it is. > webhdfs PUT does not work if

[jira] [Updated] (HDFS-11000) webhdfs PUT does not work if requests are routed to call queue.

2016-10-12 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11000?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-11000: -- Status: Patch Available (was: Open) > webhdfs PUT does not work if requests are routed to call queue.

[jira] [Updated] (HDFS-11000) webhdfs PUT does not work if requests are routed to call queue.

2016-10-12 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11000?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-11000: -- Attachment: HDFS-11000.patch > webhdfs PUT does not work if requests are routed to call queue. >

[jira] [Assigned] (HDFS-11000) webhdfs PUT does not work if requests are routed to call queue.

2016-10-12 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11000?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee reassigned HDFS-11000: - Assignee: Kihwal Lee > webhdfs PUT does not work if requests are routed to call queue. >

[jira] [Created] (HDFS-11000) webhdfs PUT does not work if requests are routed to call queue.

2016-10-12 Thread Kihwal Lee (JIRA)
Kihwal Lee created HDFS-11000: - Summary: webhdfs PUT does not work if requests are routed to call queue. Key: HDFS-11000 URL: https://issues.apache.org/jira/browse/HDFS-11000 Project: Hadoop HDFS

[jira] [Issue Comment Deleted] (HDFS-10789) Route webhdfs through the RPC call queue

2016-10-12 Thread Rushabh S Shah (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10789?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rushabh S Shah updated HDFS-10789: -- Comment: was deleted (was: Thanks [~kihwal] for the reviews and commit.) > Route webhdfs

[jira] [Commented] (HDFS-10789) Route webhdfs through the RPC call queue

2016-10-12 Thread Rushabh S Shah (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10789?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15569821#comment-15569821 ] Rushabh S Shah commented on HDFS-10789: --- Thanks Kihwal Lee for the reviews and commit. > Route

[jira] [Commented] (HDFS-10789) Route webhdfs through the RPC call queue

2016-10-12 Thread Rushabh S Shah (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10789?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15569820#comment-15569820 ] Rushabh S Shah commented on HDFS-10789: --- Thanks [~kihwal] for the reviews and commit. > Route

[jira] [Updated] (HDFS-10789) Route webhdfs through the RPC call queue

2016-10-12 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10789?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-10789: -- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.0-alpha2

[jira] [Commented] (HDFS-10789) Route webhdfs through the RPC call queue

2016-10-12 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10789?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15569815#comment-15569815 ] Hudson commented on HDFS-10789: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #10597 (See

[jira] [Updated] (HDFS-10938) Ozone: SCM: Add datanode protocol

2016-10-12 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10938?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-10938: Attachment: HDFS-10938-HDFS-7240.002.patch Thank you for the comments. I have added the comment and

[jira] [Commented] (HDFS-10912) Ozone:SCM: Add chill mode support to NodeManager.

2016-10-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10912?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15569752#comment-15569752 ] Hadoop QA commented on HDFS-10912: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10789) Route webhdfs through the RPC call queue

2016-10-12 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10789?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15569729#comment-15569729 ] Kihwal Lee commented on HDFS-10789: --- +1 looks good. We have been running this internally for quite some

[jira] [Updated] (HDFS-10995) Ozone : move ozone XceiverClient to hdfs-client

2016-10-12 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10995?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-10995: -- Attachment: HDFS-10995-HDFS-7240.004.patch v004 patch included the protocol move for mvn build. note

[jira] [Commented] (HDFS-10995) Ozone : move ozone XceiverClient to hdfs-client

2016-10-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10995?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15569664#comment-15569664 ] Hadoop QA commented on HDFS-10995: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-10995) Ozone : move ozone XceiverClient to hdfs-client

2016-10-12 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10995?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-10995: -- Attachment: HDFS-10995-HDFS-7240.003.patch Minimize to only moving XceiverClient classes and Pipeline

[jira] [Commented] (HDFS-10301) BlockReport retransmissions may lead to storages falsely being declared zombie if storage report processing happens out of order

2016-10-12 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15569580#comment-15569580 ] Konstantin Shvachko commented on HDFS-10301: ??I don't think the lastBlockReportId code needs

[jira] [Updated] (HDFS-10899) Add functionality to re-encrypt EDEKs.

2016-10-12 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10899?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-10899: - Description: Currently when an encryption zone (EZ) key is rotated, it only takes effect on new EDEKs. We

[jira] [Updated] (HDFS-10899) Add functionality to re-encrypt EDEKs.

2016-10-12 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10899?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-10899: - Component/s: kms > Add functionality to re-encrypt EDEKs. > -- > >

[jira] [Updated] (HDFS-10899) Add functionality to re-encrypt EDEKs.

2016-10-12 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10899?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-10899: - Attachment: Re-encrypt edek design doc.pdf Attaching a design doc. Many thanks to [~andrew.wang] for the

[jira] [Commented] (HDFS-10637) Modifications to remove the assumption that FsVolumes are backed by java.io.File.

2016-10-12 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10637?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15569550#comment-15569550 ] Arpit Agarwal commented on HDFS-10637: -- Hi [~virajith], [~eddyxu], Do you see these changes going to

[jira] [Updated] (HDFS-10912) Ozone:SCM: Add chill mode support to NodeManager.

2016-10-12 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10912?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-10912: Attachment: HDFS-10912-HDFS-7240.004.patch [~xyao] Thank you for the comments. I found more places

[jira] [Commented] (HDFS-10827) When there are unrecoverable ec block groups, Namenode Web UI shows "There are X missing blocks." but doesn't show the block names.

2016-10-12 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10827?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15569512#comment-15569512 ] Jing Zhao commented on HDFS-10827: -- [~tasanuma0829], I think you're right. We actually do not need to add

[jira] [Commented] (HDFS-10971) Distcp should not copy replication factor if source file is erasure coded

2016-10-12 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10971?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15569491#comment-15569491 ] Wei-Chiu Chuang commented on HDFS-10971: Thanks for the discussion! I filed HADOOP-13715 to work

[jira] [Commented] (HDFS-10943) rollEditLog expects empty EditsDoubleBuffer.bufCurrent which is not guaranteed

2016-10-12 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10943?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15569447#comment-15569447 ] Yongjun Zhang commented on HDFS-10943: -- Hi [~daryn], About my last comment, do you think it's a bug

[jira] [Commented] (HDFS-10999) Use more generic "low redundancy" blocks instead of "under replicated" blocks

2016-10-12 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15569421#comment-15569421 ] Andrew Wang commented on HDFS-10999: Yea, thanks for the pointer [~rakesh_r]. One idea is that we

[jira] [Commented] (HDFS-10925) Cache symlinkString in INodeSymlink

2016-10-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10925?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15569255#comment-15569255 ] Hadoop QA commented on HDFS-10925: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10789) Route webhdfs through the RPC call queue

2016-10-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10789?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15569257#comment-15569257 ] Hadoop QA commented on HDFS-10789: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (HDFS-10930) Refactor: Wrap Datanode IO related operations

2016-10-12 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10930?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15569242#comment-15569242 ] Xiaoyu Yao commented on HDFS-10930: --- Thanks [~daryn] for the feedback. I've put my answers to the

[jira] [Updated] (HDFS-10925) Cache symlinkString in INodeSymlink

2016-10-12 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10925?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-10925: - Attachment: HDFS-10925.004.patch > Cache symlinkString in INodeSymlink >

[jira] [Commented] (HDFS-10925) Cache symlinkString in INodeSymlink

2016-10-12 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10925?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15569139#comment-15569139 ] Yiqun Lin commented on HDFS-10925: -- I looked into this again, I have some other thoughts on this. I

[jira] [Commented] (HDFS-10930) Refactor: Wrap Datanode IO related operations

2016-10-12 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10930?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15569080#comment-15569080 ] Daryn Sharp commented on HDFS-10930: Took a cursory look, do we really need to move non-redundant and

[jira] [Commented] (HDFS-10987) Make Decommission less expensive when lot of blocks present.

2016-10-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10987?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15569057#comment-15569057 ] Hadoop QA commented on HDFS-10987: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-10789) Route webhdfs through the RPC call queue

2016-10-12 Thread Rushabh S Shah (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10789?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rushabh S Shah updated HDFS-10789: -- Status: Patch Available (was: Open) > Route webhdfs through the RPC call queue >

[jira] [Updated] (HDFS-10789) Route webhdfs through the RPC call queue

2016-10-12 Thread Rushabh S Shah (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10789?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rushabh S Shah updated HDFS-10789: -- Status: Open (was: Patch Available) I missed 2 checkstyle warnings again. :( > Route webhdfs

[jira] [Updated] (HDFS-10789) Route webhdfs through the RPC call queue

2016-10-12 Thread Rushabh S Shah (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10789?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rushabh S Shah updated HDFS-10789: -- Attachment: HDFS-10789-5.patch Attaching a patch fixing 2 checkstyle warnings. Hopefully the

[jira] [Commented] (HDFS-10997) Reduce number of path resolving methods

2016-10-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10997?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15568920#comment-15568920 ] Hadoop QA commented on HDFS-10997: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-10997) Reduce number of path resolving methods

2016-10-12 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10997?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daryn Sharp updated HDFS-10997: --- Attachment: HDFS-10997.1.patch Fix minor conflicts with my earlier delete op patch. > Reduce number

[jira] [Commented] (HDFS-10987) Make Decommission less expensive when lot of blocks present.

2016-10-12 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10987?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15568837#comment-15568837 ] Brahma Reddy Battula commented on HDFS-10987: - will handle in seperate jira. > Make

[jira] [Updated] (HDFS-10987) Make Decommission less expensive when lot of blocks present.

2016-10-12 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10987?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brahma Reddy Battula updated HDFS-10987: Attachment: HDFS-10987-002.patch bq. Yes. Along with that, IMO should also add

[jira] [Commented] (HDFS-10987) Make Decommission less expensive when lot of blocks present.

2016-10-12 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10987?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15568778#comment-15568778 ] Vinayakumar B commented on HDFS-10987: -- Another improvement for standby-nn I am finding is,

[jira] [Commented] (HDFS-10987) Make Decommission less expensive when lot of blocks present.

2016-10-12 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10987?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15568760#comment-15568760 ] Vinayakumar B commented on HDFS-10987: -- bq. To be precise, the number of blocks doesn't have to be

[jira] [Commented] (HDFS-10986) DFSAdmin should log detailed error message if any

2016-10-12 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10986?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15568501#comment-15568501 ] Brahma Reddy Battula commented on HDFS-10986: - Looks Good to me.. will commit tomorrow if

[jira] [Commented] (HDFS-10935) TestFileChecksum tests are failing after HDFS-10460 (Mac only?)

2016-10-12 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10935?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15568388#comment-15568388 ] Wei-Chiu Chuang commented on HDFS-10935: [~Sammi] did you see NPE like the following in your

[jira] [Commented] (HDFS-9594) DataNode threw NullPointerException

2016-10-12 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9594?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15568384#comment-15568384 ] Wei-Chiu Chuang commented on HDFS-9594: --- Maybe it's related to test failures in HDFS-10935 >

[jira] [Commented] (HDFS-9594) DataNode threw NullPointerException

2016-10-12 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9594?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15568382#comment-15568382 ] Wei-Chiu Chuang commented on HDFS-9594: --- I saw the same NPE when running tests in TestFileChecksum,

[jira] [Commented] (HDFS-10827) When there are unrecoverable ec block groups, Namenode Web UI shows "There are X missing blocks." but doesn't show the block names.

2016-10-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10827?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15568374#comment-15568374 ] Hadoop QA commented on HDFS-10827: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Comment Edited] (HDFS-10935) TestFileChecksum tests are failing after HDFS-10460 (Mac only?)

2016-10-12 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10935?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15568361#comment-15568361 ] Wei-Chiu Chuang edited comment on HDFS-10935 at 10/12/16 10:46 AM: --- I

[jira] [Commented] (HDFS-10935) TestFileChecksum tests are failing after HDFS-10460 (Mac only?)

2016-10-12 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10935?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15568361#comment-15568361 ] Wei-Chiu Chuang commented on HDFS-10935: I ran the tests in multiple JDK versions ranging from JDK

[jira] [Commented] (HDFS-10999) Use more generic "low redundancy" blocks instead of "under replicated" blocks

2016-10-12 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15568227#comment-15568227 ] Rakesh R commented on HDFS-10999: - Thanks [~jojochuang] for bringing this point. I remember there was a

[jira] [Updated] (HDFS-10827) When there are unrecoverable ec block groups, Namenode Web UI shows "There are X missing blocks." but doesn't show the block names.

2016-10-12 Thread Takanobu Asanuma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10827?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma updated HDFS-10827: Attachment: HDFS-10827.3.patch [~jingzhao] Based on my last comment, I updated the patch to

[jira] [Comment Edited] (HDFS-10827) When there are unrecoverable ec block groups, Namenode Web UI shows "There are X missing blocks." but doesn't show the block names.

2016-10-12 Thread Takanobu Asanuma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10827?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15568062#comment-15568062 ] Takanobu Asanuma edited comment on HDFS-10827 at 10/12/16 8:48 AM: ---

[jira] [Commented] (HDFS-10827) When there are unrecoverable ec block groups, Namenode Web UI shows "There are X missing blocks." but doesn't show the block names.

2016-10-12 Thread Takanobu Asanuma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10827?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15568062#comment-15568062 ] Takanobu Asanuma commented on HDFS-10827: - Thank you for your kind review, [~jingzhao]! On second

[jira] [Commented] (HDFS-10999) Use more generic "low redundancy" blocks instead of "under replicated" blocks

2016-10-12 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15568050#comment-15568050 ] Wei-Chiu Chuang commented on HDFS-10999: One thing I want to call out is metrics names. There are

[jira] [Updated] (HDFS-10999) Use more generic "low redundancy" blocks instead of "under replicated" blocks

2016-10-12 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-10999: --- Component/s: erasure-coding > Use more generic "low redundancy" blocks instead of "under

[jira] [Updated] (HDFS-10999) Use more generic "low redundancy" blocks instead of "under replicated" blocks

2016-10-12 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-10999: --- Issue Type: Sub-task (was: Improvement) Parent: HDFS-8031 > Use more generic "low

[jira] [Updated] (HDFS-10935) TestFileChecksum tests are failing after HDFS-10460 (Mac only?)

2016-10-12 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10935?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-10935: --- Environment: JDK 1.8.0_91 on Mac OS X Yosemite 10.10.5 > TestFileChecksum tests are failing

[jira] [Commented] (HDFS-10935) TestFileChecksum tests are failing after HDFS-10460 (Mac only?)

2016-10-12 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10935?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15568021#comment-15568021 ] Wei-Chiu Chuang commented on HDFS-10935: [~drankye] that's interesting. Thanks for confirming with

[jira] [Commented] (HDFS-10991) Export hdfsTruncateFile symbol in libhdfs

2016-10-12 Thread Surendra Singh Lilhore (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10991?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15568013#comment-15568013 ] Surendra Singh Lilhore commented on HDFS-10991: --- Thanks [~andrew.wang] for review and

[jira] [Commented] (HDFS-10935) TestFileChecksum tests are failing after HDFS-10460 (Mac only?)

2016-10-12 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10935?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15567858#comment-15567858 ] SammiChen commented on HDFS-10935: -- TestFileChecksum tests all passed on my Linux server. My JDK is

[jira] [Commented] (HDFS-10935) TestFileChecksum tests are failing after HDFS-10460 (Mac only?)

2016-10-12 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10935?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15567791#comment-15567791 ] SammiChen commented on HDFS-10935: -- Hi, Kai, sure, I will look into it. > TestFileChecksum tests are

[jira] [Assigned] (HDFS-10935) TestFileChecksum tests are failing after HDFS-10460 (Mac only?)

2016-10-12 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10935?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen reassigned HDFS-10935: Assignee: SammiChen > TestFileChecksum tests are failing after HDFS-10460 (Mac only?) >