[jira] [Updated] (HDFS-10219) Change the default value for dfs.namenode.reconstruction.pending.timeout-sec from -1 to 300

2017-02-03 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10219?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-10219: - Attachment: (was: HDFS-10219.003.patch) > Change the default value for

[jira] [Updated] (HDFS-10219) Change the default value for dfs.namenode.reconstruction.pending.timeout-sec from -1 to 300

2017-02-03 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10219?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-10219: - Attachment: HDFS-10219.003.patch > Change the default value for

[jira] [Updated] (HDFS-10219) Change the default value for dfs.namenode.reconstruction.pending.timeout-sec from -1 to 300

2017-02-03 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10219?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-10219: - Attachment: HDFS-10219.003.patch Thanks [~ajisakaa] for taking a look. The comment makes sense for me.

[jira] [Commented] (HDFS-10219) Change the default value for dfs.namenode.reconstruction.pending.timeout-sec from -1 to 300

2017-02-03 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10219?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15852659#comment-15852659 ] Akira Ajisaka commented on HDFS-10219: -- Would you update the following code

[jira] [Commented] (HDFS-11340) DataNode reconfigure for disks doesn't remove the failed volumes

2017-02-03 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11340?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15852647#comment-15852647 ] Yiqun Lin commented on HDFS-11340: -- Thanka [~manojg] for working on this. I haven't looked into this, but

[jira] [Commented] (HDFS-11371) Document missing metrics of erasure coding

2017-02-03 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11371?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15852569#comment-15852569 ] Hudson commented on HDFS-11371: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #11210 (See

[jira] [Updated] (HDFS-11371) Document missing metrics of erasure coding

2017-02-03 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11371?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-11371: - Hadoop Flags: Reviewed Fix Version/s: 3.0.0-alpha3 Thanks [~andrew.wang] for the review. Committed

[jira] [Updated] (HDFS-11371) Document missing metrics of erasure coding

2017-02-03 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11371?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-11371: - Resolution: Fixed Status: Resolved (was: Patch Available) > Document missing metrics of erasure

[jira] [Commented] (HDFS-11210) Enhance key rolling to guarantee new KeyVersion is returned from generateEncryptedKeys after a key is rolled

2017-02-03 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11210?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15852474#comment-15852474 ] Andrew Wang commented on HDFS-11210: Thanks for the rev Xiao, looks pretty close, mostly nitty stuff

[jira] [Commented] (HDFS-11382) Persist Erasure Coding Policy ID in a new optional field in INodeFile in FSImage

2017-02-03 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11382?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15852374#comment-15852374 ] Andrew Wang commented on HDFS-11382: Thanks for working on this Manoj! Overall looks good, some review

[jira] [Comment Edited] (HDFS-11096) Support rolling upgrade between 2.x and 3.x

2017-02-03 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11096?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15852343#comment-15852343 ] Allen Wittenauer edited comment on HDFS-11096 at 2/3/17 11:47 PM: -- I hope

[jira] [Commented] (HDFS-8498) Blocks can be committed with wrong size

2017-02-03 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8498?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15852342#comment-15852342 ] Hadoop QA commented on HDFS-8498: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11096) Support rolling upgrade between 2.x and 3.x

2017-02-03 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11096?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15852343#comment-15852343 ] Allen Wittenauer commented on HDFS-11096: - I hope folks hoping to do a rolling upgrade with

[jira] [Commented] (HDFS-11387) Socket reuse address option is not honored in PrivilegedNfsGatewayStarter

2017-02-03 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11387?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15852173#comment-15852173 ] Hudson commented on HDFS-11387: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #11208 (See

[jira] [Commented] (HDFS-11382) Persist Erasure Coding Policy ID in a new optional field in INodeFile in FSImage

2017-02-03 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11382?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15852155#comment-15852155 ] Manoj Govindassamy commented on HDFS-11382: --- Test failures doesn't look related to patch. All

[jira] [Commented] (HDFS-4025) QJM: Sychronize past log segments to JNs that missed them

2017-02-03 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4025?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15852136#comment-15852136 ] Hadoop QA commented on HDFS-4025: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11382) Persist Erasure Coding Policy ID in a new optional field in INodeFile in FSImage

2017-02-03 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11382?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15852134#comment-15852134 ] Hadoop QA commented on HDFS-11382: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11371) Document missing metrics of erasure coding

2017-02-03 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11371?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15852129#comment-15852129 ] Andrew Wang commented on HDFS-11371: LGTM +1 thanks Yiqun for working on this! > Document missing

[jira] [Updated] (HDFS-11387) Socket reuse address option is not honored in PrivilegedNfsGatewayStarter

2017-02-03 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11387?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-11387: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.9.0 Status:

[jira] [Updated] (HDFS-11387) Socket reuse address option is not honored in PrivilegedNfsGatewayStarter

2017-02-03 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11387?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-11387: - Summary: Socket reuse address option is not honored in PrivilegedNfsGatewayStarter (was: Socket

[jira] [Created] (HDFS-11389) Support rolling upgrade between 2.x and 3.x

2017-02-03 Thread Andrew Wang (JIRA)
Andrew Wang created HDFS-11389: -- Summary: Support rolling upgrade between 2.x and 3.x Key: HDFS-11389 URL: https://issues.apache.org/jira/browse/HDFS-11389 Project: Hadoop HDFS Issue Type: Task

[jira] [Updated] (HDFS-10860) Switch HttpFS from Tomcat to Jetty

2017-02-03 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10860?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-10860: --- Priority: Blocker (was: Major) Upgrading this to a blocker for alpha3, looks like we're close in any

[jira] [Commented] (HDFS-11357) Secure Delete

2017-02-03 Thread Andrew Purtell (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11357?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15851999#comment-15851999 ] Andrew Purtell commented on HDFS-11357: --- bq. Would you be accepting of introducing this on a

[jira] [Updated] (HDFS-4025) QJM: Sychronize past log segments to JNs that missed them

2017-02-03 Thread Hanisha Koneru (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4025?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hanisha Koneru updated HDFS-4025: - Attachment: HDFS-4025.011.patch Turned sync off by default in patch v11. > QJM: Sychronize past

[jira] [Updated] (HDFS-11382) Persist Erasure Coding Policy ID in a new optional field in INodeFile in FSImage

2017-02-03 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11382?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manoj Govindassamy updated HDFS-11382: -- Attachment: HDFS-11382.01.patch Attached v01 patch to address the following: 1. New

[jira] [Updated] (HDFS-11382) Persist Erasure Coding Policy ID in a new optional field in INodeFile in FSImage

2017-02-03 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11382?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manoj Govindassamy updated HDFS-11382: -- Status: Patch Available (was: Open) > Persist Erasure Coding Policy ID in a new

[jira] [Commented] (HDFS-11357) Secure Delete

2017-02-03 Thread Plamen Jeliazkov (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11357?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15851958#comment-15851958 ] Plamen Jeliazkov commented on HDFS-11357: - Current patch seems to affect entire DataNode(s).

[jira] [Commented] (HDFS-11379) DFSInputStream may infinite loop requesting block locations

2017-02-03 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11379?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15851952#comment-15851952 ] Daryn Sharp commented on HDFS-11379: Test failure not related. > DFSInputStream may infinite loop

[jira] [Created] (HDFS-11388) libhdfs++: Add an alternative to assert()

2017-02-03 Thread James Clampffer (JIRA)
James Clampffer created HDFS-11388: -- Summary: libhdfs++: Add an alternative to assert() Key: HDFS-11388 URL: https://issues.apache.org/jira/browse/HDFS-11388 Project: Hadoop HDFS Issue

[jira] [Commented] (HDFS-11340) DataNode reconfigure for disks doesn't remove the failed volumes

2017-02-03 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11340?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15851737#comment-15851737 ] Manoj Govindassamy commented on HDFS-11340: --- Test failures are not related to the patch. >

[jira] [Commented] (HDFS-9924) [umbrella] Nonblocking HDFS Access

2017-02-03 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9924?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15851725#comment-15851725 ] stack commented on HDFS-9924: - [~Apache9] Good luck (I didn't fully grok #3. It would be coolio if you could

[jira] [Commented] (HDFS-6708) StorageType should be encoded in the block token

2017-02-03 Thread Ewan Higgs (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6708?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15851502#comment-15851502 ] Ewan Higgs commented on HDFS-6708: -- The javadoc errors are due to a longstanding bug where javadoc seems

[jira] [Commented] (HDFS-6708) StorageType should be encoded in the block token

2017-02-03 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6708?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15851441#comment-15851441 ] Hadoop QA commented on HDFS-6708: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11387) Socket resuse address option is not honored in PrivilegedNfsGatewayStarter

2017-02-03 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11387?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15851308#comment-15851308 ] Hadoop QA commented on HDFS-11387: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11340) DataNode reconfigure for disks doesn't remove the failed volumes

2017-02-03 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11340?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15851301#comment-15851301 ] Hadoop QA commented on HDFS-11340: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-11387) Socket resuse address option is not honored in PrivilegedNfsGatewayStarter

2017-02-03 Thread Mukul Kumar Singh (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11387?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukul Kumar Singh updated HDFS-11387: - Status: Patch Available (was: Open) > Socket resuse address option is not honored in

[jira] [Updated] (HDFS-11387) Socket resuse address option is not honored in PrivilegedNfsGatewayStarter

2017-02-03 Thread Mukul Kumar Singh (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11387?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukul Kumar Singh updated HDFS-11387: - Attachment: HDFS-11387.001.patch > Socket resuse address option is not honored in

[jira] [Updated] (HDFS-6708) StorageType should be encoded in the block token

2017-02-03 Thread Ewan Higgs (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6708?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewan Higgs updated HDFS-6708: - Fix Version/s: 3.0.0-alpha3 Release Note: StorageTypes are now encoded in the BlockTokenIdentifier to

[jira] [Updated] (HDFS-11387) Socket resuse address option is not honored in PrivilegedNfsGatewayStarter

2017-02-03 Thread Mukul Kumar Singh (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11387?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukul Kumar Singh updated HDFS-11387: - Attachment: (was: HDFS-11387.001.patch) > Socket resuse address option is not honored

[jira] [Assigned] (HDFS-11026) Convert BlockTokenIdentifier to use Protobuf

2017-02-03 Thread Ewan Higgs (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11026?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewan Higgs reassigned HDFS-11026: - Assignee: Ewan Higgs > Convert BlockTokenIdentifier to use Protobuf >

[jira] [Assigned] (HDFS-9807) Add an optional StorageID to writes

2017-02-03 Thread Ewan Higgs (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9807?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewan Higgs reassigned HDFS-9807: Assignee: Ewan Higgs > Add an optional StorageID to writes > --- >

[jira] [Commented] (HDFS-9924) [umbrella] Nonblocking HDFS Access

2017-02-03 Thread Duo Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9924?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15851248#comment-15851248 ] Duo Zhang commented on HDFS-9924: - [~stack] Seems the performance problem belongs to grpc-go, not

[jira] [Updated] (HDFS-11387) Socket resuse address option is not honored in PrivilegedNfsGatewayStarter

2017-02-03 Thread Mukul Kumar Singh (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11387?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukul Kumar Singh updated HDFS-11387: - Attachment: HDFS-11387.001.patch This change involves binding the socket after setting

[jira] [Updated] (HDFS-11340) DataNode reconfigure for disks doesn't remove the failed volumes

2017-02-03 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11340?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manoj Govindassamy updated HDFS-11340: -- Attachment: HDFS-11340.02.patch Thanks [~eddyxu] for the review. Attaching v02 patch