[GitHub] [hadoop] hadoop-yetus commented on issue #1013: HDDS-1691 : RDBTable#isExist should use Rocksdb#keyMayExist

2019-06-25 Thread GitBox
hadoop-yetus commented on issue #1013: HDDS-1691 : RDBTable#isExist should use Rocksdb#keyMayExist URL: https://github.com/apache/hadoop/pull/1013#issuecomment-505730287 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment |

[jira] [Commented] (HADOOP-16391) Duplicate values in rpcDetailedMetrics

2019-06-25 Thread Bilwa S T (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16391?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16872913#comment-16872913 ] Bilwa S T commented on HADOOP-16391: cc [~sseth] [~cgregori] [~xkrogen] > Duplicate values in

[GitHub] [hadoop] hadoop-yetus commented on issue #1016: HDDS-1672. Improve locking in OzoneManager.

2019-06-25 Thread GitBox
hadoop-yetus commented on issue #1016: HDDS-1672. Improve locking in OzoneManager. URL: https://github.com/apache/hadoop/pull/1016#issuecomment-505708480 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment |

[GitHub] [hadoop] q1007239205 opened a new pull request #1017: how to get block in mr

2019-06-25 Thread GitBox
q1007239205 opened a new pull request #1017: how to get block in mr URL: https://github.com/apache/hadoop/pull/1017 i want to know block Before mr task to do something This is an automated message from the Apache Git

[GitHub] [hadoop] bharatviswa504 commented on a change in pull request #1016: HDDS-1672. Improve locking in OzoneManager.

2019-06-25 Thread GitBox
bharatviswa504 commented on a change in pull request #1016: HDDS-1672. Improve locking in OzoneManager. URL: https://github.com/apache/hadoop/pull/1016#discussion_r297460963 ## File path:

[jira] [Updated] (HADOOP-16394) Support OpenTracing in DistCp

2019-06-25 Thread Siyao Meng (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16394?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siyao Meng updated HADOOP-16394: Summary: Support OpenTracing in DistCp (was: Support OpenTracing in DistCP) > Support

[GitHub] [hadoop] hadoop-yetus commented on issue #1015: HashMap is not thread safe. Field storageMap is typically synchronized by storageMap. However, in one place, field storageMap is not protected

2019-06-25 Thread GitBox
hadoop-yetus commented on issue #1015: HashMap is not thread safe. Field storageMap is typically synchronized by storageMap. However, in one place, field storageMap is not protected with synchronized. URL: https://github.com/apache/hadoop/pull/1015#issuecomment-505688795 :broken_heart:

[GitHub] [hadoop] hadoop-yetus commented on issue #1016: HDDS-1672. Improve locking in OzoneManager.

2019-06-25 Thread GitBox
hadoop-yetus commented on issue #1016: HDDS-1672. Improve locking in OzoneManager. URL: https://github.com/apache/hadoop/pull/1016#issuecomment-505688679 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment |

[GitHub] [hadoop] hadoop-yetus commented on issue #1016: HDDS-1672. Improve locking in OzoneManager.

2019-06-25 Thread GitBox
hadoop-yetus commented on issue #1016: HDDS-1672. Improve locking in OzoneManager. URL: https://github.com/apache/hadoop/pull/1016#issuecomment-505686273 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment |

[GitHub] [hadoop] anuengineer commented on a change in pull request #1016: HDDS-1672. Improve locking in OzoneManager.

2019-06-25 Thread GitBox
anuengineer commented on a change in pull request #1016: HDDS-1672. Improve locking in OzoneManager. URL: https://github.com/apache/hadoop/pull/1016#discussion_r297455815 ## File path:

[GitHub] [hadoop] Nem0Wang commented on issue #133: HADOOP-13681. Reduce Kafka dependencies in hadoop-kafka module

2019-06-25 Thread GitBox
Nem0Wang commented on issue #133: HADOOP-13681. Reduce Kafka dependencies in hadoop-kafka module URL: https://github.com/apache/hadoop/pull/133#issuecomment-505676481 Do you have hadoop-metrics2.properties sample for metrics-kafka-sink? Thx!

[GitHub] [hadoop] hadoop-yetus commented on issue #949: HDDS-1672. Improve locking in OzoneManager.

2019-06-25 Thread GitBox
hadoop-yetus commented on issue #949: HDDS-1672. Improve locking in OzoneManager. URL: https://github.com/apache/hadoop/pull/949#issuecomment-505675480 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment |

[GitHub] [hadoop] bharatviswa504 commented on issue #949: HDDS-1672. Improve locking in OzoneManager.

2019-06-25 Thread GitBox
bharatviswa504 commented on issue #949: HDDS-1672. Improve locking in OzoneManager. URL: https://github.com/apache/hadoop/pull/949#issuecomment-505670210 Opened #1016 This is an automated message from the Apache Git Service.

[GitHub] [hadoop] bharatviswa504 closed pull request #949: HDDS-1672. Improve locking in OzoneManager.

2019-06-25 Thread GitBox
bharatviswa504 closed pull request #949: HDDS-1672. Improve locking in OzoneManager. URL: https://github.com/apache/hadoop/pull/949 This is an automated message from the Apache Git Service. To respond to the message, please

[GitHub] [hadoop] bharatviswa504 opened a new pull request #1016: HDDS-1672. Improve locking in OzoneManager.

2019-06-25 Thread GitBox
bharatviswa504 opened a new pull request #1016: HDDS-1672. Improve locking in OzoneManager. URL: https://github.com/apache/hadoop/pull/1016 This is an automated message from the Apache Git Service. To respond to the

[GitHub] [hadoop] bharatviswa504 merged pull request #1014: HDDS-1727. Use generation of resourceName for locks in OzoneManagerLock.

2019-06-25 Thread GitBox
bharatviswa504 merged pull request #1014: HDDS-1727. Use generation of resourceName for locks in OzoneManagerLock. URL: https://github.com/apache/hadoop/pull/1014 This is an automated message from the Apache Git Service. To

[GitHub] [hadoop] bharatviswa504 commented on issue #1014: HDDS-1727. Use generation of resourceName for locks in OzoneManagerLock.

2019-06-25 Thread GitBox
bharatviswa504 commented on issue #1014: HDDS-1727. Use generation of resourceName for locks in OzoneManagerLock. URL: https://github.com/apache/hadoop/pull/1014#issuecomment-505667625 Test failures are not related to this patch. Thank You @anuengineer for the review. I will commit this

[GitHub] [hadoop] paulward24 opened a new pull request #1015: HashMap is not thread safe. Field storageMap is typically synchronized by storageMap. However, in one place, field storageMap is not prote

2019-06-25 Thread GitBox
paulward24 opened a new pull request #1015: HashMap is not thread safe. Field storageMap is typically synchronized by storageMap. However, in one place, field storageMap is not protected with synchronized. URL: https://github.com/apache/hadoop/pull/1015 The field ```storageMap``` (a

[jira] [Commented] (HADOOP-16384) Improve resilience of S3Guard prune to inconsistent DDB tables

2019-06-25 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16384?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16872802#comment-16872802 ] Hadoop QA commented on HADOOP-16384: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[GitHub] [hadoop] hadoop-yetus commented on a change in pull request #1003: HADOOP-16384: prune resilience.

2019-06-25 Thread GitBox
hadoop-yetus commented on a change in pull request #1003: HADOOP-16384: prune resilience. URL: https://github.com/apache/hadoop/pull/1003#discussion_r297437243 ## File path: hadoop-tools/hadoop-aws/src/site/markdown/tools/hadoop-aws/testing.md ## @@ -1100,6 +1100,51 @@

[GitHub] [hadoop] hadoop-yetus commented on a change in pull request #1003: HADOOP-16384: prune resilience.

2019-06-25 Thread GitBox
hadoop-yetus commented on a change in pull request #1003: HADOOP-16384: prune resilience. URL: https://github.com/apache/hadoop/pull/1003#discussion_r297437253 ## File path: hadoop-tools/hadoop-aws/src/site/markdown/tools/hadoop-aws/testing.md ## @@ -1100,6 +1100,51 @@

[GitHub] [hadoop] hadoop-yetus commented on a change in pull request #1003: HADOOP-16384: prune resilience.

2019-06-25 Thread GitBox
hadoop-yetus commented on a change in pull request #1003: HADOOP-16384: prune resilience. URL: https://github.com/apache/hadoop/pull/1003#discussion_r297437259 ## File path: hadoop-tools/hadoop-aws/src/site/markdown/tools/hadoop-aws/testing.md ## @@ -1100,6 +1100,51 @@

[GitHub] [hadoop] hadoop-yetus commented on issue #1003: HADOOP-16384: prune resilience.

2019-06-25 Thread GitBox
hadoop-yetus commented on issue #1003: HADOOP-16384: prune resilience. URL: https://github.com/apache/hadoop/pull/1003#issuecomment-505663033 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | 0

[GitHub] [hadoop] hadoop-yetus commented on a change in pull request #1003: HADOOP-16384: prune resilience.

2019-06-25 Thread GitBox
hadoop-yetus commented on a change in pull request #1003: HADOOP-16384: prune resilience. URL: https://github.com/apache/hadoop/pull/1003#discussion_r297437262 ## File path: hadoop-tools/hadoop-aws/src/site/markdown/tools/hadoop-aws/testing.md ## @@ -1100,6 +1100,51 @@

[GitHub] [hadoop] hadoop-yetus commented on issue #1014: HDDS-1727. Use generation of resourceName for locks in OzoneManagerLock.

2019-06-25 Thread GitBox
hadoop-yetus commented on issue #1014: HDDS-1727. Use generation of resourceName for locks in OzoneManagerLock. URL: https://github.com/apache/hadoop/pull/1014#issuecomment-505660402 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment |

[GitHub] [hadoop] bharatviswa504 commented on a change in pull request #1013: HDDS-1691 : RDBTable#isExist should use Rocksdb#keyMayExist

2019-06-25 Thread GitBox
bharatviswa504 commented on a change in pull request #1013: HDDS-1691 : RDBTable#isExist should use Rocksdb#keyMayExist URL: https://github.com/apache/hadoop/pull/1013#discussion_r297431352 ## File path: hadoop-hdds/common/src/main/java/org/apache/hadoop/utils/db/RDBTable.java

[GitHub] [hadoop] bharatviswa504 commented on a change in pull request #1013: HDDS-1691 : RDBTable#isExist should use Rocksdb#keyMayExist

2019-06-25 Thread GitBox
bharatviswa504 commented on a change in pull request #1013: HDDS-1691 : RDBTable#isExist should use Rocksdb#keyMayExist URL: https://github.com/apache/hadoop/pull/1013#discussion_r297431352 ## File path: hadoop-hdds/common/src/main/java/org/apache/hadoop/utils/db/RDBTable.java

[GitHub] [hadoop] avijayanhwx commented on issue #1013: HDDS-1691 : RDBTable#isExist should use Rocksdb#keyMayExist

2019-06-25 Thread GitBox
avijayanhwx commented on issue #1013: HDDS-1691 : RDBTable#isExist should use Rocksdb#keyMayExist URL: https://github.com/apache/hadoop/pull/1013#issuecomment-505656426 cc @bharatviswa504 , @mukul1987, @nandakumar131 This

[GitHub] [hadoop] avijayanhwx commented on issue #1013: HDDS-1691 : RDBTable#isExist should use Rocksdb#keyMayExist

2019-06-25 Thread GitBox
avijayanhwx commented on issue #1013: HDDS-1691 : RDBTable#isExist should use Rocksdb#keyMayExist URL: https://github.com/apache/hadoop/pull/1013#issuecomment-505656221 Test failures are unrelated. `

[GitHub] [hadoop] bharatviswa504 commented on a change in pull request #930: HDDS-1651. Create a http.policy config for Ozone

2019-06-25 Thread GitBox
bharatviswa504 commented on a change in pull request #930: HDDS-1651. Create a http.policy config for Ozone URL: https://github.com/apache/hadoop/pull/930#discussion_r297428759 ## File path: hadoop-hdds/common/src/main/java/org/apache/hadoop/hdds/HddsUtils.java ## @@

[jira] [Commented] (HADOOP-13386) Upgrade Avro to 1.8.x or later

2019-06-25 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13386?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16872779#comment-16872779 ] Steve Loughran commented on HADOOP-13386: - Real issue is that it forces people downstream to

[GitHub] [hadoop] hadoop-yetus commented on issue #1014: HDDS-1727. Use generation of resourceName for locks in OzoneManagerLock.

2019-06-25 Thread GitBox
hadoop-yetus commented on issue #1014: HDDS-1727. Use generation of resourceName for locks in OzoneManagerLock. URL: https://github.com/apache/hadoop/pull/1014#issuecomment-505643514 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment |

[GitHub] [hadoop] hadoop-yetus commented on issue #1014: HDDS-1727. Use generation of resourceName for locks in OzoneManagerLock.

2019-06-25 Thread GitBox
hadoop-yetus commented on issue #1014: HDDS-1727. Use generation of resourceName for locks in OzoneManagerLock. URL: https://github.com/apache/hadoop/pull/1014#issuecomment-505642425 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment |

[GitHub] [hadoop] hadoop-yetus commented on issue #1013: HDDS-1691 : RDBTable#isExist should use Rocksdb#keyMayExist

2019-06-25 Thread GitBox
hadoop-yetus commented on issue #1013: HDDS-1691 : RDBTable#isExist should use Rocksdb#keyMayExist URL: https://github.com/apache/hadoop/pull/1013#issuecomment-505640566 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment |

[GitHub] [hadoop] hadoop-yetus commented on issue #1014: HDDS-1727. Use generation of resourceName for locks in OzoneManagerLock.

2019-06-25 Thread GitBox
hadoop-yetus commented on issue #1014: HDDS-1727. Use generation of resourceName for locks in OzoneManagerLock. URL: https://github.com/apache/hadoop/pull/1014#issuecomment-505639689 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment |

[GitHub] [hadoop] hadoop-yetus commented on issue #1014: HDDS-1727. Use generation of resourceName for locks in OzoneManagerLock.

2019-06-25 Thread GitBox
hadoop-yetus commented on issue #1014: HDDS-1727. Use generation of resourceName for locks in OzoneManagerLock. URL: https://github.com/apache/hadoop/pull/1014#issuecomment-505634560 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment |

[jira] [Updated] (HADOOP-16350) Ability to tell HDFS client not to request KMS Information from NameNode

2019-06-25 Thread Ajay Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16350?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ajay Kumar updated HADOOP-16350: Resolution: Fixed Status: Resolved (was: Patch Available) > Ability to tell HDFS client

[jira] [Updated] (HADOOP-16350) Ability to tell HDFS client not to request KMS Information from NameNode

2019-06-25 Thread Ajay Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16350?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ajay Kumar updated HADOOP-16350: Fix Version/s: 2.8.6 > Ability to tell HDFS client not to request KMS Information from NameNode

[GitHub] [hadoop] hadoop-yetus commented on issue #1013: HDDS-1691 : RDBTable#isExist should use Rocksdb#keyMayExist

2019-06-25 Thread GitBox
hadoop-yetus commented on issue #1013: HDDS-1691 : RDBTable#isExist should use Rocksdb#keyMayExist URL: https://github.com/apache/hadoop/pull/1013#issuecomment-505628475 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment |

[GitHub] [hadoop] hadoop-yetus commented on issue #1013: HDDS-1691 : RDBTable#isExist should use Rocksdb#keyMayExist

2019-06-25 Thread GitBox
hadoop-yetus commented on issue #1013: HDDS-1691 : RDBTable#isExist should use Rocksdb#keyMayExist URL: https://github.com/apache/hadoop/pull/1013#issuecomment-505627688 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment |

[GitHub] [hadoop] hadoop-yetus commented on issue #1013: HDDS-1691 : RDBTable#isExist should use Rocksdb#keyMayExist

2019-06-25 Thread GitBox
hadoop-yetus commented on issue #1013: HDDS-1691 : RDBTable#isExist should use Rocksdb#keyMayExist URL: https://github.com/apache/hadoop/pull/1013#issuecomment-505626057 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment |

[GitHub] [hadoop] anuengineer commented on issue #993: HDDS-1709. TestScmSafeNode is flaky

2019-06-25 Thread GitBox
anuengineer commented on issue #993: HDDS-1709. TestScmSafeNode is flaky URL: https://github.com/apache/hadoop/pull/993#issuecomment-505622750 +1, Thanks for the contribution. @bharatviswa504 Thanks for the review. I have committed this to the trunk.

[GitHub] [hadoop] anuengineer closed pull request #993: HDDS-1709. TestScmSafeNode is flaky

2019-06-25 Thread GitBox
anuengineer closed pull request #993: HDDS-1709. TestScmSafeNode is flaky URL: https://github.com/apache/hadoop/pull/993 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [hadoop] hadoop-yetus commented on issue #1013: HDDS-1691 : RDBTable#isExist should use Rocksdb#keyMayExist

2019-06-25 Thread GitBox
hadoop-yetus commented on issue #1013: HDDS-1691 : RDBTable#isExist should use Rocksdb#keyMayExist URL: https://github.com/apache/hadoop/pull/1013#issuecomment-505621047 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment |

[GitHub] [hadoop] hadoop-yetus commented on issue #1014: HDDS-1727. Use generation of resourceName for locks in OzoneManagerLock.

2019-06-25 Thread GitBox
hadoop-yetus commented on issue #1014: HDDS-1727. Use generation of resourceName for locks in OzoneManagerLock. URL: https://github.com/apache/hadoop/pull/1014#issuecomment-505618679 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment |

[jira] [Commented] (HADOOP-16350) Ability to tell HDFS client not to request KMS Information from NameNode

2019-06-25 Thread Ajay Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16350?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16872699#comment-16872699 ] Ajay Kumar commented on HADOOP-16350: - findbugs and asflicense reported for hadoop-2.8 patch by

[GitHub] [hadoop] bharatviswa504 commented on issue #1014: HDDS-1727. Use generation of resourceName for locks in OzoneManagerLock.

2019-06-25 Thread GitBox
bharatviswa504 commented on issue #1014: HDDS-1727. Use generation of resourceName for locks in OzoneManagerLock. URL: https://github.com/apache/hadoop/pull/1014#issuecomment-505609729 /retest This is an automated message

[GitHub] [hadoop] avijayanhwx commented on a change in pull request #1013: HDDS-1691 : RDBTable#isExist should use Rocksdb#keyMayExist

2019-06-25 Thread GitBox
avijayanhwx commented on a change in pull request #1013: HDDS-1691 : RDBTable#isExist should use Rocksdb#keyMayExist URL: https://github.com/apache/hadoop/pull/1013#discussion_r297374441 ## File path: hadoop-hdds/common/src/test/java/org/apache/hadoop/utils/db/TestRDBStore.java

[jira] [Commented] (HADOOP-15729) [s3a] stop treat fs.s3a.max.threads as the long-term minimum

2019-06-25 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15729?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16872674#comment-16872674 ] Hadoop QA commented on HADOOP-15729: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[GitHub] [hadoop] bharatviswa504 commented on a change in pull request #1013: HDDS-1691 : RDBTable#isExist should use Rocksdb#keyMayExist

2019-06-25 Thread GitBox
bharatviswa504 commented on a change in pull request #1013: HDDS-1691 : RDBTable#isExist should use Rocksdb#keyMayExist URL: https://github.com/apache/hadoop/pull/1013#discussion_r297363945 ## File path: hadoop-hdds/common/src/test/java/org/apache/hadoop/utils/db/TestRDBStore.java

[GitHub] [hadoop] bharatviswa504 opened a new pull request #1014: HDDS-1727. Use generation of resourceName for locks in OzoneManagerLock.

2019-06-25 Thread GitBox
bharatviswa504 opened a new pull request #1014: HDDS-1727. Use generation of resourceName for locks in OzoneManagerLock. URL: https://github.com/apache/hadoop/pull/1014 This is an automated message from the Apache Git

[jira] [Updated] (HADOOP-16394) Support OpenTracing in DistCP

2019-06-25 Thread Nikhil Navadiya (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16394?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nikhil Navadiya updated HADOOP-16394: - Description: Add an OpenTracing code in DistCP module > Support OpenTracing in DistCP

[GitHub] [hadoop] avijayanhwx opened a new pull request #1013: HDDS-1691 : RDBTable#isExist should use Rocksdb#keyMayExist

2019-06-25 Thread GitBox
avijayanhwx opened a new pull request #1013: HDDS-1691 : RDBTable#isExist should use Rocksdb#keyMayExist URL: https://github.com/apache/hadoop/pull/1013 RDBTable#isExist can use Rocksdb#keyMayExist, this avoids the cost of reading the value for the key. Please refer,

[GitHub] [hadoop] hadoop-yetus commented on issue #987: HDDS-1685. Recon: Add support for 'start' query param to containers…

2019-06-25 Thread GitBox
hadoop-yetus commented on issue #987: HDDS-1685. Recon: Add support for 'start' query param to containers… URL: https://github.com/apache/hadoop/pull/987#issuecomment-505583122 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment |

[GitHub] [hadoop] avijayanhwx commented on issue #1013: HDDS-1691 : RDBTable#isExist should use Rocksdb#keyMayExist

2019-06-25 Thread GitBox
avijayanhwx commented on issue #1013: HDDS-1691 : RDBTable#isExist should use Rocksdb#keyMayExist URL: https://github.com/apache/hadoop/pull/1013#issuecomment-505583105 /label ozone This is an automated message from the

[jira] [Updated] (HADOOP-15729) [s3a] stop treat fs.s3a.max.threads as the long-term minimum

2019-06-25 Thread Sean Mackrory (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15729?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Mackrory updated HADOOP-15729: --- Status: Patch Available (was: Open) > [s3a] stop treat fs.s3a.max.threads as the

[jira] [Commented] (HADOOP-15729) [s3a] stop treat fs.s3a.max.threads as the long-term minimum

2019-06-25 Thread Sean Mackrory (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15729?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16872630#comment-16872630 ] Sean Mackrory commented on HADOOP-15729: So I tried out some of the same 1 GB uploads in the

[GitHub] [hadoop] hadoop-yetus commented on issue #1012: HADOOP-16393. S3Guard init command uses global settings, not those of target bucket

2019-06-25 Thread GitBox
hadoop-yetus commented on issue #1012: HADOOP-16393. S3Guard init command uses global settings, not those of target bucket URL: https://github.com/apache/hadoop/pull/1012#issuecomment-505579287 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Comment

[jira] [Commented] (HADOOP-16350) Ability to tell HDFS client not to request KMS Information from NameNode

2019-06-25 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16350?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16872627#comment-16872627 ] Hadoop QA commented on HADOOP-16350: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Updated] (HADOOP-15729) [s3a] stop treat fs.s3a.max.threads as the long-term minimum

2019-06-25 Thread Sean Mackrory (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15729?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Mackrory updated HADOOP-15729: --- Attachment: HADOOP-15729.002.patch > [s3a] stop treat fs.s3a.max.threads as the long-term

[GitHub] [hadoop] hadoop-yetus commented on issue #1010: HDFS-13694. Making md5 computing being in parallel with image loading.

2019-06-25 Thread GitBox
hadoop-yetus commented on issue #1010: HDFS-13694. Making md5 computing being in parallel with image loading. URL: https://github.com/apache/hadoop/pull/1010#issuecomment-505570728 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment |

[jira] [Commented] (HADOOP-15566) Support Opentracing

2019-06-25 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15566?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16872581#comment-16872581 ] Anu Engineer commented on HADOOP-15566: --- {quote}probably will be available in the next couple of

[GitHub] [hadoop] steveloughran opened a new pull request #1012: HADOOP-16393. S3Guard init command uses global settings, not those of target bucket

2019-06-25 Thread GitBox
steveloughran opened a new pull request #1012: HADOOP-16393. S3Guard init command uses global settings, not those of target bucket URL: https://github.com/apache/hadoop/pull/1012 This does the bucket propagation, and patches {{ITestS3GuardToolDynamoDB.testDynamoTableTagging}}

[jira] [Assigned] (HADOOP-16394) Support OpenTracing in DistCP

2019-06-25 Thread Nikhil Navadiya (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16394?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nikhil Navadiya reassigned HADOOP-16394: Assignee: Nikhil Navadiya > Support OpenTracing in DistCP >

[jira] [Updated] (HADOOP-16394) Support OpenTracing in DistCP

2019-06-25 Thread Nikhil Navadiya (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16394?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nikhil Navadiya updated HADOOP-16394: - Issue Type: Sub-task (was: New Feature) Parent: HADOOP-15566 > Support

[jira] [Updated] (HADOOP-16394) Support OpenTracing in DistCP

2019-06-25 Thread Nikhil Navadiya (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16394?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nikhil Navadiya updated HADOOP-16394: - Description: Add a  Summary: Support OpenTracing in DistCP (was: Support

[jira] [Updated] (HADOOP-16394) Support OpenTracing in DistCP

2019-06-25 Thread Nikhil Navadiya (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16394?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nikhil Navadiya updated HADOOP-16394: - Description: (was: Add a ) > Support OpenTracing in DistCP >

[jira] [Created] (HADOOP-16394) Support OpenTracing in HDFS

2019-06-25 Thread Nikhil Navadiya (JIRA)
Nikhil Navadiya created HADOOP-16394: Summary: Support OpenTracing in HDFS Key: HADOOP-16394 URL: https://issues.apache.org/jira/browse/HADOOP-16394 Project: Hadoop Common Issue Type:

[jira] [Commented] (HADOOP-16384) Improve resilience of S3Guard prune to inconsistent DDB tables

2019-06-25 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16384?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16872527#comment-16872527 ] Steve Loughran commented on HADOOP-16384: - Bonus treat in this: something to dump out the

[jira] [Updated] (HADOOP-16384) Improve resilience of S3Guard prune to inconsistent DDB tables

2019-06-25 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16384?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-16384: Attachment: hwdev-ireland-new.csv > Improve resilience of S3Guard prune to inconsistent

[jira] [Commented] (HADOOP-16393) S3Guard init command uses global settings, not those of target bucket

2019-06-25 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16393?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16872525#comment-16872525 ] Steve Loughran commented on HADOOP-16393: - Related bit of fun: if your site config declares a

[jira] [Commented] (HADOOP-16393) S3Guard init command uses global settings, not those of target bucket

2019-06-25 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16393?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16872504#comment-16872504 ] Steve Loughran commented on HADOOP-16393: - And if you have no table: Failure {code} bin/hadoop

[jira] [Updated] (HADOOP-16350) Ability to tell HDFS client not to request KMS Information from NameNode

2019-06-25 Thread Ajay Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16350?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ajay Kumar updated HADOOP-16350: Attachment: HADOOP-16350-branch-2.8.02.patch > Ability to tell HDFS client not to request KMS

[jira] [Updated] (HADOOP-16350) Ability to tell HDFS client not to request KMS Information from NameNode

2019-06-25 Thread Ajay Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16350?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ajay Kumar updated HADOOP-16350: Attachment: (was: HADOOP-16350-branch-2.8.patch) > Ability to tell HDFS client not to

[GitHub] [hadoop] goiri commented on issue #977: HDFS-14541. When evictableMmapped or evictable size is zero, do not throw NoSuchElementException

2019-06-25 Thread GitBox
goiri commented on issue #977: HDFS-14541. When evictableMmapped or evictable size is zero, do not throw NoSuchElementException URL: https://github.com/apache/hadoop/pull/977#issuecomment-505519599 For full disclosure, I messed up the merge of the PR and I had to do the cherry-pick by

[GitHub] [hadoop] goiri commented on a change in pull request #1010: [HDFS-13694]Making md5 computing being in parallel with image loading

2019-06-25 Thread GitBox
goiri commented on a change in pull request #1010: [HDFS-13694]Making md5 computing being in parallel with image loading URL: https://github.com/apache/hadoop/pull/1010#discussion_r297275249 ## File path:

[GitHub] [hadoop] goiri commented on a change in pull request #1010: [HDFS-13694]Making md5 computing being in parallel with image loading

2019-06-25 Thread GitBox
goiri commented on a change in pull request #1010: [HDFS-13694]Making md5 computing being in parallel with image loading URL: https://github.com/apache/hadoop/pull/1010#discussion_r297275624 ## File path:

[GitHub] [hadoop] goiri commented on a change in pull request #1010: [HDFS-13694]Making md5 computing being in parallel with image loading

2019-06-25 Thread GitBox
goiri commented on a change in pull request #1010: [HDFS-13694]Making md5 computing being in parallel with image loading URL: https://github.com/apache/hadoop/pull/1010#discussion_r297274889 ## File path:

[GitHub] [hadoop] goiri commented on a change in pull request #1010: [HDFS-13694]Making md5 computing being in parallel with image loading

2019-06-25 Thread GitBox
goiri commented on a change in pull request #1010: [HDFS-13694]Making md5 computing being in parallel with image loading URL: https://github.com/apache/hadoop/pull/1010#discussion_r297275806 ## File path:

[GitHub] [hadoop] goiri commented on a change in pull request #1010: [HDFS-13694]Making md5 computing being in parallel with image loading

2019-06-25 Thread GitBox
goiri commented on a change in pull request #1010: [HDFS-13694]Making md5 computing being in parallel with image loading URL: https://github.com/apache/hadoop/pull/1010#discussion_r297274689 ## File path:

[GitHub] [hadoop] goiri commented on a change in pull request #1010: [HDFS-13694]Making md5 computing being in parallel with image loading

2019-06-25 Thread GitBox
goiri commented on a change in pull request #1010: [HDFS-13694]Making md5 computing being in parallel with image loading URL: https://github.com/apache/hadoop/pull/1010#discussion_r297274374 ## File path:

[jira] [Commented] (HADOOP-16393) S3Guard init command uses global settings, not those of target bucket

2019-06-25 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16393?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16872489#comment-16872489 ] Steve Loughran commented on HADOOP-16393: - This leads to a fun failure. You can't instantiate a

[jira] [Commented] (HADOOP-16393) S3Guard init command uses global settings, not those of target bucket

2019-06-25 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16393?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16872491#comment-16872491 ] Steve Loughran commented on HADOOP-16393: - but you can't actually create the bucket because the

[jira] [Created] (HADOOP-16393) S3Guard init command uses global settings, not those of target bucket

2019-06-25 Thread Steve Loughran (JIRA)
Steve Loughran created HADOOP-16393: --- Summary: S3Guard init command uses global settings, not those of target bucket Key: HADOOP-16393 URL: https://issues.apache.org/jira/browse/HADOOP-16393

[GitHub] [hadoop] eyanghwx commented on a change in pull request #930: HDDS-1651. Create a http.policy config for Ozone

2019-06-25 Thread GitBox
eyanghwx commented on a change in pull request #930: HDDS-1651. Create a http.policy config for Ozone URL: https://github.com/apache/hadoop/pull/930#discussion_r297270601 ## File path: hadoop-hdds/common/src/main/java/org/apache/hadoop/hdds/HddsUtils.java ## @@ -31,6

[GitHub] [hadoop] anuengineer merged pull request #1006: HDDS-1723. Create new OzoneManagerLock class.

2019-06-25 Thread GitBox
anuengineer merged pull request #1006: HDDS-1723. Create new OzoneManagerLock class. URL: https://github.com/apache/hadoop/pull/1006 This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [hadoop] hadoop-yetus commented on issue #992: HADOOP-16357 TeraSort Job failing on S3 DirectoryStagingCommitter: destination path exists

2019-06-25 Thread GitBox
hadoop-yetus commented on issue #992: HADOOP-16357 TeraSort Job failing on S3 DirectoryStagingCommitter: destination path exists URL: https://github.com/apache/hadoop/pull/992#issuecomment-505503284 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime |

[jira] [Commented] (HADOOP-16392) S3Guard Diff tool to list+ compare the etag and version fields

2019-06-25 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16392?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16872437#comment-16872437 ] Steve Loughran commented on HADOOP-16392: - + [~ben.roling], [~gabor.bota] > S3Guard Diff tool

[jira] [Created] (HADOOP-16392) S3Guard Diff tool to list+ compare the etag and version fields

2019-06-25 Thread Steve Loughran (JIRA)
Steve Loughran created HADOOP-16392: --- Summary: S3Guard Diff tool to list+ compare the etag and version fields Key: HADOOP-16392 URL: https://issues.apache.org/jira/browse/HADOOP-16392 Project:

[jira] [Created] (HADOOP-16391) Duplicate values in rpcDetailedMetrics

2019-06-25 Thread Bilwa S T (JIRA)
Bilwa S T created HADOOP-16391: -- Summary: Duplicate values in rpcDetailedMetrics Key: HADOOP-16391 URL: https://issues.apache.org/jira/browse/HADOOP-16391 Project: Hadoop Common Issue Type: Bug

[jira] [Resolved] (HADOOP-16266) Add more fine-grained processing time metrics to the RPC layer

2019-06-25 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16266?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen resolved HADOOP-16266. -- Resolution: Fixed Just noticed this was never re-resolved after the follow-on patch, doing

[jira] [Comment Edited] (HADOOP-15729) [s3a] stop treat fs.s3a.max.threads as the long-term minimum

2019-06-25 Thread Sean Mackrory (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15729?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16872396#comment-16872396 ] Sean Mackrory edited comment on HADOOP-15729 at 6/25/19 2:55 PM: -

[jira] [Comment Edited] (HADOOP-15729) [s3a] stop treat fs.s3a.max.threads as the long-term minimum

2019-06-25 Thread Sean Mackrory (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15729?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16872396#comment-16872396 ] Sean Mackrory edited comment on HADOOP-15729 at 6/25/19 2:32 PM: -

[jira] [Commented] (HADOOP-15729) [s3a] stop treat fs.s3a.max.threads as the long-term minimum

2019-06-25 Thread Sean Mackrory (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15729?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16872396#comment-16872396 ] Sean Mackrory commented on HADOOP-15729: Having slept on it, I think we should go ahead and

[GitHub] [hadoop] steveloughran commented on issue #992: HADOOP-16357 TeraSort Job failing on S3 DirectoryStagingCommitter: destination path exists

2019-06-25 Thread GitBox
steveloughran commented on issue #992: HADOOP-16357 TeraSort Job failing on S3 DirectoryStagingCommitter: destination path exists URL: https://github.com/apache/hadoop/pull/992#issuecomment-505455143 Tested: S3A ireland All good except the root dir tests, which Gabor and I are

[jira] [Commented] (HADOOP-16357) TeraSort Job failing on S3 DirectoryStagingCommitter: destination path exists

2019-06-25 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16357?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16872364#comment-16872364 ] Steve Loughran commented on HADOOP-16357: - PR for this:

[jira] [Commented] (HADOOP-16357) TeraSort Job failing on S3 DirectoryStagingCommitter: destination path exists

2019-06-25 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16357?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16872362#comment-16872362 ] Steve Loughran commented on HADOOP-16357: - -1 to the submitted patch; breaks those unit and

[GitHub] [hadoop] hadoop-yetus commented on issue #1001: HDDS-1258 - Fix error propagation for SCM protocol

2019-06-25 Thread GitBox
hadoop-yetus commented on issue #1001: HDDS-1258 - Fix error propagation for SCM protocol URL: https://github.com/apache/hadoop/pull/1001#issuecomment-505418023 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment |

[jira] [Commented] (HADOOP-16381) The JSON License is included in binary tarball via azure-documentdb:1.16.2

2019-06-25 Thread Sushil Ks (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16381?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16872239#comment-16872239 ] Sushil Ks commented on HADOOP-16381: [~ste...@apache.org], thanks for the feedback. Will exclude

[jira] [Commented] (HADOOP-13386) Upgrade Avro to 1.8.x or later

2019-06-25 Thread Fokko Driesprong (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13386?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16872232#comment-16872232 ] Fokko Driesprong commented on HADOOP-13386: --- Do you have any examples of the

  1   2   >