[jira] [Comment Edited] (HDDS-1458) Create a maven profile to run fault injection tests

2019-05-14 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-1458?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16839564#comment-16839564 ] Eric Yang edited comment on HDDS-1458 at 5/14/19 6:48 PM: -- {quote}Can we support

[jira] [Commented] (HDFS-14447) RBF: Router should support RefreshUserMappingsProtocol

2019-05-14 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-14447?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16839732#comment-16839732 ] Íñigo Goiri commented on HDFS-14447: Thanks [~lukmajercak], I agree on fixing the spaces. On top of

[jira] [Created] (HDFS-14491) More Clarity on Namenode UI Around Blocks and Replicas

2019-05-14 Thread Alan Jackoway (JIRA)
Alan Jackoway created HDFS-14491: Summary: More Clarity on Namenode UI Around Blocks and Replicas Key: HDFS-14491 URL: https://issues.apache.org/jira/browse/HDFS-14491 Project: Hadoop HDFS

[jira] [Commented] (HDFS-14490) RBF: Remove unnecessary quota checks

2019-05-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14490?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16839632#comment-16839632 ] Hadoop QA commented on HDFS-14490: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-14440) RBF: Optimize the file write process in case of multiple destinations.

2019-05-14 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-14440?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16839654#comment-16839654 ] Íñigo Goiri commented on HDFS-14440: Sorry, I was out last week. As you can see, I still have doubts

[jira] [Updated] (HDFS-14482) Crash when using libhdfs with bad classpath

2019-05-14 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14482?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon updated HDFS-14482: --- Affects Version/s: 3.3.0 Fix Version/s: 3.3.0 > Crash when using libhdfs with bad classpath

[jira] [Resolved] (HDFS-14482) Crash when using libhdfs with bad classpath

2019-05-14 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14482?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon resolved HDFS-14482. Resolution: Fixed > Crash when using libhdfs with bad classpath >

[jira] [Commented] (HDFS-14490) RBF: Remove unnecessary quota checks

2019-05-14 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-14490?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16839735#comment-16839735 ] Íñigo Goiri commented on HDFS-14490: This makes me wonder if the default case should be without

[jira] [Commented] (HDFS-14353) Erasure Coding: metrics xmitsInProgress become to negative.

2019-05-14 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-14353?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16839642#comment-16839642 ] Íñigo Goiri commented on HDFS-14353: As this is trunk, we can use lambdas: {code}

[jira] [Commented] (HDFS-14447) RBF: Router should support RefreshUserMappingsProtocol

2019-05-14 Thread Lukas Majercak (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14447?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16839720#comment-16839720 ] Lukas Majercak commented on HDFS-14447: --- There are a couple of syntax inconsistencies in 06.patch,

[jira] [Commented] (HDFS-14313) Get hdfs used space from FsDatasetImpl#volumeMap#ReplicaInfo in memory instead of df/du

2019-05-14 Thread Lisheng Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14313?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16839140#comment-16839140 ] Lisheng Sun commented on HDFS-14313: Test failures are not caused by this patch.  > Get hdfs used

[jira] [Updated] (HDFS-14484) Ozone: Freon: Support big files larger than 2GB and introduce a "--bufferSize" parameter.

2019-05-14 Thread xudongcao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14484?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] xudongcao updated HDFS-14484: - Description: *Current problems:* 1. Freon does not support big files larger than 2GB because it use an

[jira] [Updated] (HDFS-14484) Ozone: Freon: Support big files larger than 2GB and introduce a "--bufferSize" parameter.

2019-05-14 Thread xudongcao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14484?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] xudongcao updated HDFS-14484: - Summary: Ozone: Freon: Support big files larger than 2GB and introduce a "--bufferSize" parameter.

[jira] [Updated] (HDFS-14484) Ozone: Freon: Support big files larger than 2GB and introduce a "--bufferSize" parameter.

2019-05-14 Thread xudongcao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14484?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] xudongcao updated HDFS-14484: - Description: *Current problems:* 1. Freon does not support big files larger than 2GB because it use an

[jira] [Commented] (HDFS-14486) The exception classes in some throw statements do not accurately describe why they are thrown

2019-05-14 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14486?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16839220#comment-16839220 ] Steve Loughran commented on HDFS-14486: --- FWIW, if you are interested in where many java apps make a

[jira] [Updated] (HDFS-14484) Ozone: Freon: Support big files larger than 2GB and introduce a "--bufferSize" parameter.

2019-05-14 Thread xudongcao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14484?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] xudongcao updated HDFS-14484: - Description: *Current problems:* 1. Freon does not support big files larger than 2GB because it use an

[jira] [Updated] (HDFS-14484) Ozone: Freon: Support big files larger than 2GB and introduce a "--bufferSize" parameter.

2019-05-14 Thread xudongcao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14484?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] xudongcao updated HDFS-14484: - Description: *Current problems:* 1. Freon does not support big files larger than 2GB because it use an

[jira] [Work logged] (HDDS-1522) Provide intellij runConfiguration for Ozone components

2019-05-14 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-1522?focusedWorklogId=241601=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-241601 ] ASF GitHub Bot logged work on HDDS-1522: Author: ASF GitHub Bot

[jira] [Work logged] (HDDS-1518) Use /etc/ozone for configuration inside docker-compose

2019-05-14 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-1518?focusedWorklogId=241605=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-241605 ] ASF GitHub Bot logged work on HDDS-1518: Author: ASF GitHub Bot

[jira] [Work logged] (HDDS-1496) Support partial chunk reads and checksum verification

2019-05-14 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-1496?focusedWorklogId=241551=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-241551 ] ASF GitHub Bot logged work on HDDS-1496: Author: ASF GitHub Bot

[jira] [Created] (HDFS-14489) fix naming issue for ScmBlockLocationTestingClient

2019-05-14 Thread star (JIRA)
star created HDFS-14489: --- Summary: fix naming issue for ScmBlockLocationTestingClient Key: HDFS-14489 URL: https://issues.apache.org/jira/browse/HDFS-14489 Project: Hadoop HDFS Issue Type: Bug

[jira] [Updated] (HDFS-14484) Ozone: Freon: Support big files larger than 2GB and introduce a "--bufferSize" parameter.

2019-05-14 Thread xudongcao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14484?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] xudongcao updated HDFS-14484: - Description: *Current problems:* 1. Freon does not support big files larger than 2GB because it use an

[jira] [Updated] (HDFS-14489) fix naming issue for ScmBlockLocationTestingClient

2019-05-14 Thread star (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14489?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] star updated HDFS-14489: Attachment: HDFS-14489.patch > fix naming issue for ScmBlockLocationTestingClient >

[jira] [Work logged] (HDDS-1503) Reduce garbage generated by non-netty threads in datanode ratis server

2019-05-14 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-1503?focusedWorklogId=241636=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-241636 ] ASF GitHub Bot logged work on HDDS-1503: Author: ASF GitHub Bot

[jira] [Updated] (HDFS-14484) Ozone: Freon: Support big files larger than 2GB and improve concurrent operations.

2019-05-14 Thread xudongcao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14484?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] xudongcao updated HDFS-14484: - Summary: Ozone: Freon: Support big files larger than 2GB and improve concurrent operations. (was:

[jira] [Updated] (HDFS-14484) Ozone: Freon: Support big files larger than 2GB and improve concurrent operations.

2019-05-14 Thread xudongcao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14484?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] xudongcao updated HDFS-14484: - Description: *Current problems:* 1. Freon does not support big files larger than 2GB because it use an

[jira] [Updated] (HDFS-14484) Ozone: Freon: Support big files larger than 2GB and improve concurrent framework.

2019-05-14 Thread xudongcao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14484?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] xudongcao updated HDFS-14484: - Summary: Ozone: Freon: Support big files larger than 2GB and improve concurrent framework. (was: Ozone:

[jira] [Work logged] (HDDS-1503) Reduce garbage generated by non-netty threads in datanode ratis server

2019-05-14 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-1503?focusedWorklogId=241628=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-241628 ] ASF GitHub Bot logged work on HDDS-1503: Author: ASF GitHub Bot

[jira] [Work logged] (HDDS-1503) Reduce garbage generated by non-netty threads in datanode ratis server

2019-05-14 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-1503?focusedWorklogId=241637=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-241637 ] ASF GitHub Bot logged work on HDDS-1503: Author: ASF GitHub Bot

[jira] [Work logged] (HDDS-1511) Space tracking for Open Containers in HDDS Volumes

2019-05-14 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-1511?focusedWorklogId=242191=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-242191 ] ASF GitHub Bot logged work on HDDS-1511: Author: ASF GitHub Bot

[jira] [Commented] (HDDS-700) Support rack awared node placement policy based on network topology

2019-05-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-700?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16839942#comment-16839942 ] Hadoop QA commented on HDDS-700: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-14484) Ozone: Freon: Support big files larger than 2GB and add "--bufferSize" and "--validateWrites" options.

2019-05-14 Thread xudongcao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14484?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16839946#comment-16839946 ] xudongcao commented on HDFS-14484: -- In fact, my initial change was to keep this, but I found this would

[jira] [Updated] (HDFS-14484) Ozone: Freon: Support big files larger than 2GB and add "--bufferSize" and "--validateWrites" options.

2019-05-14 Thread xudongcao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14484?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] xudongcao updated HDFS-14484: - Attachment: HDFS-14484.patch > Ozone: Freon: Support big files larger than 2GB and add "--bufferSize"

[jira] [Commented] (HDFS-14234) Limit WebHDFS to specifc user, host, directory triples

2019-05-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14234?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16839950#comment-16839950 ] Hadoop QA commented on HDFS-14234: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-14484) Ozone: Freon: Support big files larger than 2GB and add "--bufferSize" and "--validateWrites" options.

2019-05-14 Thread xudongcao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14484?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] xudongcao updated HDFS-14484: - Attachment: (was: HDFS-14484.patch) > Ozone: Freon: Support big files larger than 2GB and add

[jira] [Updated] (HDFS-14484) Ozone: Freon: Support big files larger than 2GB and add "--bufferSize" and "--validateWrites" options.

2019-05-14 Thread xudongcao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14484?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] xudongcao updated HDFS-14484: - Attachment: HDFS-14484v0.patch > Ozone: Freon: Support big files larger than 2GB and add "--bufferSize"

[jira] [Updated] (HDFS-14484) Ozone: Freon: Support big files larger than 2GB and add "--bufferSize" and "--validateWrites" options.

2019-05-14 Thread xudongcao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14484?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] xudongcao updated HDFS-14484: - Description: *Current problems:* 1. Freon does not support big files larger than 2GB because it use an

[jira] [Updated] (HDFS-14484) Ozone: Freon: Support big files larger than 2GB and add "--bufferSize" and "--validateWrites" options.

2019-05-14 Thread xudongcao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14484?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] xudongcao updated HDFS-14484: - Attachment: (was: HDFS-14484v0.patch) > Ozone: Freon: Support big files larger than 2GB and add

[jira] [Commented] (HDDS-1495) Create hadoop/ozone docker images with inline build process

2019-05-14 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-1495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16839991#comment-16839991 ] Eric Yang commented on HDDS-1495: - {quote}The current approach allows us to build the docker images

[jira] [Comment Edited] (HDDS-1495) Create hadoop/ozone docker images with inline build process

2019-05-14 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-1495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16839991#comment-16839991 ] Eric Yang edited comment on HDDS-1495 at 5/15/19 3:46 AM: -- {quote}The current

[jira] [Comment Edited] (HDDS-1495) Create hadoop/ozone docker images with inline build process

2019-05-14 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-1495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16839991#comment-16839991 ] Eric Yang edited comment on HDDS-1495 at 5/15/19 3:51 AM: -- {quote}The current

[jira] [Updated] (HDDS-1530) Ozone: Freon: Support big files larger than 2GB and add "--bufferSize" and "--validateWrites" options.

2019-05-14 Thread xudongcao (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-1530?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] xudongcao updated HDDS-1530: Attachment: HDDS-1530v0.patch > Ozone: Freon: Support big files larger than 2GB and add "--bufferSize" and

[jira] [Updated] (HDDS-1530) Ozone: Freon: Support big files larger than 2GB and add "--bufferSize" and "--validateWrites" options.

2019-05-14 Thread xudongcao (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-1530?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] xudongcao updated HDDS-1530: Attachment: (was: HDFS-14484v0.patch) > Ozone: Freon: Support big files larger than 2GB and add

[jira] [Created] (HDDS-1531) Disable the sync flag by default during chunk writes in Datanode

2019-05-14 Thread Shashikant Banerjee (JIRA)
Shashikant Banerjee created HDDS-1531: - Summary: Disable the sync flag by default during chunk writes in Datanode Key: HDDS-1531 URL: https://issues.apache.org/jira/browse/HDDS-1531 Project:

[jira] [Work stopped] (HDDS-1531) Disable the sync flag by default during chunk writes in Datanode

2019-05-14 Thread Shashikant Banerjee (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-1531?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDDS-1531 stopped by Shashikant Banerjee. - > Disable the sync flag by default during chunk writes in Datanode >

[jira] [Updated] (HDDS-1527) HDDS Datanode start fails due to datanode.id file parse error.

2019-05-14 Thread Aravindan Vijayan (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-1527?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aravindan Vijayan updated HDDS-1527: Description: * Ozone datanode start fails when there is an existing Datanode > HDDS

[jira] [Updated] (HDDS-1527) HDDS Datanode start fails due to datanode.id file read errors.

2019-05-14 Thread Aravindan Vijayan (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-1527?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aravindan Vijayan updated HDDS-1527: Summary: HDDS Datanode start fails due to datanode.id file read errors. (was: HDDS

[jira] [Work logged] (HDDS-1499) OzoneManager Cache

2019-05-14 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-1499?focusedWorklogId=242130=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-242130 ] ASF GitHub Bot logged work on HDDS-1499: Author: ASF GitHub Bot

[jira] [Work logged] (HDDS-1499) OzoneManager Cache

2019-05-14 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-1499?focusedWorklogId=242135=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-242135 ] ASF GitHub Bot logged work on HDDS-1499: Author: ASF GitHub Bot

[jira] [Work logged] (HDDS-1499) OzoneManager Cache

2019-05-14 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-1499?focusedWorklogId=242131=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-242131 ] ASF GitHub Bot logged work on HDDS-1499: Author: ASF GitHub Bot

[jira] [Work logged] (HDDS-1499) OzoneManager Cache

2019-05-14 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-1499?focusedWorklogId=242134=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-242134 ] ASF GitHub Bot logged work on HDDS-1499: Author: ASF GitHub Bot

[jira] [Commented] (HDDS-1520) Classpath assembly doesn't work if ozone is symlinked

2019-05-14 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-1520?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16839864#comment-16839864 ] Anu Engineer commented on HDDS-1520: [~eyang] Would you care to update the Jira – to reflect the real

[jira] [Work logged] (HDDS-1496) Support partial chunk reads and checksum verification

2019-05-14 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-1496?focusedWorklogId=242129=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-242129 ] ASF GitHub Bot logged work on HDDS-1496: Author: ASF GitHub Bot

[jira] [Commented] (HDFS-14484) Ozone: Freon: Support big files larger than 2GB and introduce a "--bufferSize" parameter.

2019-05-14 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14484?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16839879#comment-16839879 ] Anu Engineer commented on HDFS-14484: - {quote}3. Remove the process of appending an uuid to each key,

[jira] [Work logged] (HDDS-1511) Space tracking for Open Containers in HDDS Volumes

2019-05-14 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-1511?focusedWorklogId=242188=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-242188 ] ASF GitHub Bot logged work on HDDS-1511: Author: ASF GitHub Bot

[jira] [Work logged] (HDDS-1511) Space tracking for Open Containers in HDDS Volumes

2019-05-14 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-1511?focusedWorklogId=242196=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-242196 ] ASF GitHub Bot logged work on HDDS-1511: Author: ASF GitHub Bot

[jira] [Commented] (HDFS-14356) Implement HDFS cache on SCM with native PMDK libs

2019-05-14 Thread Sammi Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16839937#comment-16839937 ] Sammi Chen commented on HDFS-14356: --- [~PhiloHe], I will review the new patch this week. Bye the way,

[jira] [Commented] (HDDS-1495) Create hadoop/ozone docker images with inline build process

2019-05-14 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-1495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16840030#comment-16840030 ] Eric Yang commented on HDDS-1495: - {quote}IIUC there are no Ozone bits inside the docker image. The docker

[jira] [Work logged] (HDDS-1511) Space tracking for Open Containers in HDDS Volumes

2019-05-14 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-1511?focusedWorklogId=242193=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-242193 ] ASF GitHub Bot logged work on HDDS-1511: Author: ASF GitHub Bot

[jira] [Updated] (HDFS-14484) Ozone: Freon: Support big files larger than 2GB and introduce "--bufferSize" and "--validateWrites" options.

2019-05-14 Thread xudongcao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14484?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] xudongcao updated HDFS-14484: - Description: *Current problems:* 1. Freon does not support big files larger than 2GB because it use an

[jira] [Updated] (HDFS-14484) Ozone: Freon: Support big files larger than 2GB and add "--bufferSize" and "--validateWrites" options.

2019-05-14 Thread xudongcao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14484?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] xudongcao updated HDFS-14484: - Summary: Ozone: Freon: Support big files larger than 2GB and add "--bufferSize" and "--validateWrites"

[jira] [Commented] (HDDS-1495) Create hadoop/ozone docker images with inline build process

2019-05-14 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-1495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16840005#comment-16840005 ] Arpit Agarwal commented on HDDS-1495: - bq. I disagree. I shouldn't have to find out that we made a

[jira] [Updated] (HDDS-1517) AllocateBlock call fails with ContainerNotFoundException

2019-05-14 Thread Shashikant Banerjee (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-1517?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shashikant Banerjee updated HDDS-1517: -- Attachment: HDDS-1517.000.patch > AllocateBlock call fails with

[jira] [Commented] (HDFS-14447) RBF: Router should support RefreshUserMappingsProtocol

2019-05-14 Thread Shen Yinjie (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14447?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16839933#comment-16839933 ] Shen Yinjie commented on HDFS-14447: Thanks very much for your review! [~elgoiri] [~lukmajercak],I

[jira] [Updated] (HDFS-14484) Ozone: Freon: Support big files larger than 2GB and introduce "--bufferSize" and "--validateWrites" options.

2019-05-14 Thread xudongcao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14484?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] xudongcao updated HDFS-14484: - Summary: Ozone: Freon: Support big files larger than 2GB and introduce "--bufferSize" and

[jira] [Updated] (HDDS-700) Support rack awared node placement policy based on network topology

2019-05-14 Thread Sammi Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-700?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sammi Chen updated HDDS-700: Status: Patch Available (was: Open) > Support rack awared node placement policy based on network topology >

[jira] [Updated] (HDFS-14484) Ozone: Freon: Support big files larger than 2GB and add "--bufferSize" and "--validateWrites" options.

2019-05-14 Thread xudongcao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14484?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] xudongcao updated HDFS-14484: - Attachment: HDFS-14484v0.patch > Ozone: Freon: Support big files larger than 2GB and add "--bufferSize"

[jira] [Commented] (HDDS-1530) Ozone: Freon: Support big files larger than 2GB and add "--bufferSize" and "--validateWrites" options.

2019-05-14 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-1530?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16839971#comment-16839971 ] Arpit Agarwal commented on HDDS-1530: - Moved to HDDS project. > Ozone: Freon: Support big files

[jira] [Work logged] (HDDS-1501) Create a Recon task interface that is used to update the aggregate DB whenever updates from OM are received.

2019-05-14 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-1501?focusedWorklogId=242217=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-242217 ] ASF GitHub Bot logged work on HDDS-1501: Author: ASF GitHub Bot

[jira] [Assigned] (HDDS-1530) Ozone: Freon: Support big files larger than 2GB and add "--bufferSize" and "--validateWrites" options.

2019-05-14 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-1530?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal reassigned HDDS-1530: --- Assignee: xudongcao > Ozone: Freon: Support big files larger than 2GB and add "--bufferSize"

[jira] [Assigned] (HDDS-1530) Ozone: Freon: Support big files larger than 2GB and add "--bufferSize" and "--validateWrites" options.

2019-05-14 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-1530?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal reassigned HDDS-1530: --- Assignee: (was: xudongcao) Component/s: (was: benchmarks)

[jira] [Updated] (HDFS-14447) RBF: Router should support RefreshUserMappingsProtocol

2019-05-14 Thread Shen Yinjie (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14447?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shen Yinjie updated HDFS-14447: --- Attachment: HDFS-14447-HDFS-13891.07.patch > RBF: Router should support RefreshUserMappingsProtocol

[jira] [Commented] (HDDS-1525) Mapreduce failure when using Hadoop 2.7.5

2019-05-14 Thread Sammi Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-1525?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16839979#comment-16839979 ] Sammi Chen commented on HDDS-1525: -- [~elek], thanks for the information. I run the same test again after

[jira] [Commented] (HDFS-14447) RBF: Router should support RefreshUserMappingsProtocol

2019-05-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14447?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16839980#comment-16839980 ] Hadoop QA commented on HDFS-14447: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDDS-1517) AllocateBlock call fails with ContainerNotFoundException

2019-05-14 Thread Shashikant Banerjee (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-1517?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16840044#comment-16840044 ] Shashikant Banerjee commented on HDDS-1517: --- Patch v0 adds the fix. I will open up a pull

[jira] [Updated] (HDDS-1517) AllocateBlock call fails with ContainerNotFoundException

2019-05-14 Thread Shashikant Banerjee (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-1517?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shashikant Banerjee updated HDDS-1517: -- Status: Patch Available (was: Open) > AllocateBlock call fails with

[jira] [Work started] (HDDS-1531) Disable the sync flag by default during chunk writes in Datanode

2019-05-14 Thread Shashikant Banerjee (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-1531?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDDS-1531 started by Shashikant Banerjee. - > Disable the sync flag by default during chunk writes in Datanode >

[jira] [Commented] (HDDS-1517) AllocateBlock call fails with ContainerNotFoundException

2019-05-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-1517?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16840058#comment-16840058 ] Hadoop QA commented on HDDS-1517: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Assigned] (HDDS-1527) HDDS Datanode start fails due to datanode.id file read errors.

2019-05-14 Thread Siddharth Wagle (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-1527?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Wagle reassigned HDDS-1527: - Assignee: Siddharth Wagle > HDDS Datanode start fails due to datanode.id file read

[jira] [Reopened] (HDDS-1520) Classpath assembly doesn't work if ozone is symlinked

2019-05-14 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-1520?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang reopened HDDS-1520: - > Classpath assembly doesn't work if ozone is symlinked >

[jira] [Created] (HDDS-1529) BlockInputStream: Avoid buffer copy if the whole chunk is being read

2019-05-14 Thread Hanisha Koneru (JIRA)
Hanisha Koneru created HDDS-1529: Summary: BlockInputStream: Avoid buffer copy if the whole chunk is being read Key: HDDS-1529 URL: https://issues.apache.org/jira/browse/HDDS-1529 Project: Hadoop

[jira] [Work logged] (HDDS-1441) Remove usage of getRetryFailureException

2019-05-14 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-1441?focusedWorklogId=242076=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-242076 ] ASF GitHub Bot logged work on HDDS-1441: Author: ASF GitHub Bot

[jira] [Commented] (HDDS-1495) Create hadoop/ozone docker images with inline build process

2019-05-14 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-1495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16839865#comment-16839865 ] Anu Engineer commented on HDDS-1495: {quote}The goal is to fold [hadoop-docker-ozone

[jira] [Commented] (HDDS-1527) HDDS Datanode start fails due to datanode.id file read errors.

2019-05-14 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-1527?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16839869#comment-16839869 ] Anu Engineer commented on HDDS-1527: [~hanishakoneru] FYI .. Thx. > HDDS Datanode start fails due to

[jira] [Commented] (HDFS-12979) StandbyNode should upload FsImage to ObserverNode after checkpointing.

2019-05-14 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12979?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16839872#comment-16839872 ] Chen Liang commented on HDFS-12979: --- Thanks for the review [~xkrogen]. For the canceling the rest

[jira] [Work logged] (HDDS-1499) OzoneManager Cache

2019-05-14 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-1499?focusedWorklogId=242144=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-242144 ] ASF GitHub Bot logged work on HDDS-1499: Author: ASF GitHub Bot

[jira] [Commented] (HDFS-14234) Limit WebHDFS to specifc user, host, directory triples

2019-05-14 Thread Clay B. (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14234?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16839889#comment-16839889 ] Clay B. commented on HDFS-14234: Oops, I kept missing that I was failing the test

[jira] [Updated] (HDFS-14234) Limit WebHDFS to specifc user, host, directory triples

2019-05-14 Thread Clay B. (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14234?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Clay B. updated HDFS-14234: --- Attachment: 0007-HDFS-14234.-Limit-WebHDFS-to-specifc-user-host-direc.patch > Limit WebHDFS to specifc user,

[jira] [Work logged] (HDDS-1501) Create a Recon task interface that is used to update the aggregate DB whenever updates from OM are received.

2019-05-14 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-1501?focusedWorklogId=242121=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-242121 ] ASF GitHub Bot logged work on HDDS-1501: Author: ASF GitHub Bot

[jira] [Updated] (HDDS-1501) Create a Recon task interface that is used to update the aggregate DB whenever updates from OM are received.

2019-05-14 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-1501?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDDS-1501: - Labels: pull-request-available (was: ) > Create a Recon task interface that is used to update

[jira] [Work logged] (HDDS-1501) Create a Recon task interface that is used to update the aggregate DB whenever updates from OM are received.

2019-05-14 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-1501?focusedWorklogId=242128=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-242128 ] ASF GitHub Bot logged work on HDDS-1501: Author: ASF GitHub Bot

[jira] [Commented] (HDDS-1495) Create hadoop/ozone docker images with inline build process

2019-05-14 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-1495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16839877#comment-16839877 ] Anu Engineer commented on HDDS-1495: The current approach allows us to build the docker images

[jira] [Work logged] (HDDS-1501) Create a Recon task interface that is used to update the aggregate DB whenever updates from OM are received.

2019-05-14 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-1501?focusedWorklogId=242158=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-242158 ] ASF GitHub Bot logged work on HDDS-1501: Author: ASF GitHub Bot

[jira] [Work logged] (HDDS-1501) Create a Recon task interface that is used to update the aggregate DB whenever updates from OM are received.

2019-05-14 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-1501?focusedWorklogId=242173=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-242173 ] ASF GitHub Bot logged work on HDDS-1501: Author: ASF GitHub Bot

[jira] [Commented] (HDDS-1495) Create hadoop/ozone docker images with inline build process

2019-05-14 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-1495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16839804#comment-16839804 ] Eric Yang commented on HDDS-1495: - {quote} a) As I wrote earler the statement is not true, the source of

[jira] [Updated] (HDDS-1527) HDDS Datanode start fails due to datanode.id file read errors.

2019-05-14 Thread Aravindan Vijayan (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-1527?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aravindan Vijayan updated HDDS-1527: Description: * Ozone datanode start fails when there is an existing Datanode.id file which

[jira] [Commented] (HDDS-1527) HDDS Datanode start fails due to datanode.id file read errors.

2019-05-14 Thread Siddharth Wagle (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-1527?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16839809#comment-16839809 ] Siddharth Wagle commented on HDDS-1527: --- [~avijayan] Would you kindly add the exception trace from

[jira] [Comment Edited] (HDDS-1527) HDDS Datanode start fails due to datanode.id file read errors.

2019-05-14 Thread Siddharth Wagle (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-1527?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16839809#comment-16839809 ] Siddharth Wagle edited comment on HDDS-1527 at 5/14/19 9:30 PM:

[jira] [Commented] (HDDS-1520) Classpath assembly doesn't work if ozone is symlinked

2019-05-14 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-1520?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16839816#comment-16839816 ] Eric Yang commented on HDDS-1520: - This issue may have caused by how long a single argument can be in

[jira] [Created] (HDDS-1528) Buffer Pool in BlockInputStream

2019-05-14 Thread Hanisha Koneru (JIRA)
Hanisha Koneru created HDDS-1528: Summary: Buffer Pool in BlockInputStream Key: HDDS-1528 URL: https://issues.apache.org/jira/browse/HDDS-1528 Project: Hadoop Distributed Data Store Issue

  1   2   >