[
https://issues.apache.org/jira/browse/HADOOP-16834?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xieming Li updated HADOOP-16834:
Attachment: HADOOP-16834.002.patch
Status: Patch Available (was: Open)
[~aajisaka],
[
https://issues.apache.org/jira/browse/HADOOP-16834?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xieming Li updated HADOOP-16834:
Status: Open (was: Patch Available)
> Replace com.sun.istack.Nullable with
[
https://issues.apache.org/jira/browse/HADOOP-16834?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17032139#comment-17032139
]
Akira Ajisaka commented on HADOOP-16834:
Cancelling my +1. Hi [~risyomei] , would you move the
oza edited a comment on issue #1635: HADOOP-16596. [pb-upgrade] Use shaded
protobuf classes from hadoop-thirdparty dependency
URL: https://github.com/apache/hadoop/pull/1635#issuecomment-583233219
Thank you for waiting. Tests passed on my local.
+1
(I commented on
oza edited a comment on issue #1635: HADOOP-16596. [pb-upgrade] Use shaded
protobuf classes from hadoop-thirdparty dependency
URL: https://github.com/apache/hadoop/pull/1635#issuecomment-583233219
Thank you for waiting. Tests passed on my local.
+1
(I commented on
[
https://issues.apache.org/jira/browse/HADOOP-16834?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17032135#comment-17032135
]
Akira Ajisaka commented on HADOOP-16834:
+1
javax.annotation.Nullable is in
[
https://issues.apache.org/jira/browse/HADOOP-15787?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Akira Ajisaka updated HADOOP-15787:
---
Fix Version/s: 2.9.3
Cherry-picked to branch-2.9.
> [JDK11]
[
https://issues.apache.org/jira/browse/HADOOP-12990?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17032112#comment-17032112
]
Redriver edited comment on HADOOP-12990 at 2/7/20 5:21 AM:
---
I think Spark
[
https://issues.apache.org/jira/browse/HADOOP-12990?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17032112#comment-17032112
]
Redriver commented on HADOOP-12990:
---
I think Spark writes event log with hadoop lz4 format. But I
oza commented on issue #1635: HADOOP-16596. [pb-upgrade] Use shaded protobuf
classes from hadoop-thirdparty dependency
URL: https://github.com/apache/hadoop/pull/1635#issuecomment-583233219
Thank you for waiting. Tests passed on my local.
+1
aajisaka commented on a change in pull request #1832: HDFS-13989. RBF: Add FSCK
to the Router
URL: https://github.com/apache/hadoop/pull/1832#discussion_r376213756
##
File path:
vinayakumarb commented on issue #1635: HADOOP-16596. [pb-upgrade] Use shaded
protobuf classes from hadoop-thirdparty dependency
URL: https://github.com/apache/hadoop/pull/1635#issuecomment-583232628
Thanks @steveloughran and @aajisaka for reviews.
Waiting for @oza for review as he has
[
https://issues.apache.org/jira/browse/HADOOP-16596?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17032055#comment-17032055
]
Tsuyoshi Ozawa edited comment on HADOOP-16596 at 2/7/20 4:08 AM:
-
> One
[
https://issues.apache.org/jira/browse/HADOOP-16596?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17032055#comment-17032055
]
Tsuyoshi Ozawa edited comment on HADOOP-16596 at 2/7/20 1:35 AM:
-
> One
[
https://issues.apache.org/jira/browse/HADOOP-16596?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17032055#comment-17032055
]
Tsuyoshi Ozawa commented on HADOOP-16596:
-
> One problem I come up with is ease of upgrading
[
https://issues.apache.org/jira/browse/HADOOP-16833?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17032041#comment-17032041
]
Arpit Agarwal commented on HADOOP-16833:
The v6 patch looks pretty good to me. I think the
testfixer opened a new pull request #1835: HADOOP-16847.Test can fail if
HashSet iterates in a different order
URL: https://github.com/apache/hadoop/pull/1835
HADOOP-16847. Tests can fail if the iteration order of HashSet changes.
This PR proposes to modify HashSet to LinkedHashSet
[
https://issues.apache.org/jira/browse/HADOOP-16847?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
testfixer0 updated HADOOP-16847:
Attachment: HADOOP-16847-000.patch
Status: Patch Available (was: Open)
The method
[
https://issues.apache.org/jira/browse/HADOOP-16847?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
testfixer0 updated HADOOP-16847:
Attachment: HADOOP-16847-000.patch
> Test can fail if HashSet iterates in a different order
>
[
https://issues.apache.org/jira/browse/HADOOP-16847?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
testfixer0 updated HADOOP-16847:
Description: The method `testNegativeGroupCaching` can fail if the
iteration order of HashSet
[
https://issues.apache.org/jira/browse/HADOOP-16847?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
testfixer0 updated HADOOP-16847:
Affects Version/s: 3.2.1
> Test can fail if HashSet iterates in a different order
>
goiri commented on a change in pull request #1832: HDFS-13989. RBF: Add FSCK to
the Router
URL: https://github.com/apache/hadoop/pull/1832#discussion_r376093596
##
File path:
goiri commented on a change in pull request #1832: HDFS-13989. RBF: Add FSCK to
the Router
URL: https://github.com/apache/hadoop/pull/1832#discussion_r376093205
##
File path:
goiri commented on a change in pull request #1832: HDFS-13989. RBF: Add FSCK to
the Router
URL: https://github.com/apache/hadoop/pull/1832#discussion_r376093554
##
File path:
goiri commented on a change in pull request #1832: HDFS-13989. RBF: Add FSCK to
the Router
URL: https://github.com/apache/hadoop/pull/1832#discussion_r376094092
##
File path:
[
https://issues.apache.org/jira/browse/HADOOP-16845?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Thomas Marqardt resolved HADOOP-16845.
--
Fix Version/s: 3.3.0
Resolution: Fixed
commit
[
https://issues.apache.org/jira/browse/HADOOP-16845?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17031899#comment-17031899
]
Thomas Marqardt commented on HADOOP-16845:
--
All tests passing for my account in uswest2 with
[
https://issues.apache.org/jira/browse/HADOOP-16825?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Thomas Marqardt resolved HADOOP-16825.
--
Fix Version/s: 3.3.0
Resolution: Fixed
commit
[
https://issues.apache.org/jira/browse/HADOOP-16825?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17031895#comment-17031895
]
Thomas Marqardt commented on HADOOP-16825:
--
All tests passing for my account in uswest2 with
testfixer0 created HADOOP-16847:
---
Summary: Test can fail if HashSet iterates in a different order
Key: HADOOP-16847
URL: https://issues.apache.org/jira/browse/HADOOP-16847
Project: Hadoop Common
[
https://issues.apache.org/jira/browse/HADOOP-12990?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17031853#comment-17031853
]
John Zhuge commented on HADOOP-12990:
-
[~redriver] Thanks for the info.
{quote}But it is still
[
https://issues.apache.org/jira/browse/HADOOP-16732?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Steve Loughran updated HADOOP-16732:
Fix Version/s: 3.3.0
Resolution: Fixed
Status: Resolved (was: Patch
hadoop-yetus commented on issue #1834: HADOOP-16848. Experimental directory
marker optimization.
URL: https://github.com/apache/hadoop/pull/1834#issuecomment-583023065
:confetti_ball: **+1 overall**
| Vote | Subsystem | Runtime | Comment |
hadoop-yetus commented on issue #1834: HADOOP-16848. Experimental directory
marker optimization.
URL: https://github.com/apache/hadoop/pull/1834#issuecomment-583018959
:broken_heart: **-1 overall**
| Vote | Subsystem | Runtime | Comment |
davidarcher edited a comment on issue #1823: HADOOP-16794 S3 Encryption key is
not getting set properly during put operation.
URL: https://github.com/apache/hadoop/pull/1823#issuecomment-582994184
> So what is proposed is
>
> If we have local SSE-KMS settings, use that
> fall
davidarcher edited a comment on issue #1823: HADOOP-16794 S3 Encryption key is
not getting set properly during put operation.
URL: https://github.com/apache/hadoop/pull/1823#issuecomment-582994184
> So what is proposed is
>
> If we have local SSE-KMS settings, use that
> fall
davidarcher commented on issue #1823: HADOOP-16794 S3 Encryption key is not
getting set properly during put operation.
URL: https://github.com/apache/hadoop/pull/1823#issuecomment-582994184
> So what is proposed is
>
> If we have local SSE-KMS settings, use that
> fall back to
[
https://issues.apache.org/jira/browse/HADOOP-12990?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17031726#comment-17031726
]
Redriver commented on HADOOP-12990:
---
As [~jzhuge] said, Hadoop lz4 compression used big endian. I
[
https://issues.apache.org/jira/browse/HADOOP-16835?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Work on HADOOP-16835 started by Steve Loughran.
---
> catch and downgrade all exceptions trying to load openssl native libs
[
https://issues.apache.org/jira/browse/HADOOP-16823?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Work on HADOOP-16823 started by Steve Loughran.
---
> Manage S3 Throttling exclusively in S3A client
>
hadoop-yetus commented on issue #1833: HADOOP-16493.
S3AFilesystem.initiateRename() shared parents
URL: https://github.com/apache/hadoop/pull/1833#issuecomment-582958444
:broken_heart: **-1 overall**
| Vote | Subsystem | Runtime | Comment |
steveloughran commented on issue #1834: HADOOP-16848. Experimental directory
marker optimization.
URL: https://github.com/apache/hadoop/pull/1834#issuecomment-582952466
Tested. Ireland
Tests failed; not looked into the details
* some were clearly as the #of IOPs were less
steveloughran opened a new pull request #1834: HADOOP-16848. Experimental
directory marker optimization.
URL: https://github.com/apache/hadoop/pull/1834
# Optimizes directory marker operations through:-
* Async create/clear
* An option
Steve Loughran created HADOOP-16846:
---
Summary: add experimental optimization of s3a directory marker
handling
Key: HADOOP-16846
URL: https://issues.apache.org/jira/browse/HADOOP-16846
Project:
steveloughran commented on issue #1635: HADOOP-16596. [pb-upgrade] Use shaded
protobuf classes from hadoop-thirdparty dependency
URL: https://github.com/apache/hadoop/pull/1635#issuecomment-582935372
+1 from me
This is an
hadoop-yetus removed a comment on issue #1635: HADOOP-16596. [pb-upgrade] Use
shaded protobuf classes from hadoop-thirdparty dependency
URL: https://github.com/apache/hadoop/pull/1635#issuecomment-540443877
:broken_heart: **-1 overall**
| Vote | Subsystem |
hadoop-yetus removed a comment on issue #1635: HADOOP-16596. [pb-upgrade] Use
shaded protobuf classes from hadoop-thirdparty dependency
URL: https://github.com/apache/hadoop/pull/1635#issuecomment-571855651
:broken_heart: **-1 overall**
| Vote | Subsystem |
hadoop-yetus removed a comment on issue #1635: HADOOP-16596. [pb-upgrade] Use
shaded protobuf classes from hadoop-thirdparty dependency
URL: https://github.com/apache/hadoop/pull/1635#issuecomment-571201484
:broken_heart: **-1 overall**
| Vote | Subsystem |
hadoop-yetus removed a comment on issue #1635: HADOOP-16596. [pb-upgrade] Use
shaded protobuf classes from hadoop-thirdparty dependency
URL: https://github.com/apache/hadoop/pull/1635#issuecomment-571508651
:broken_heart: **-1 overall**
| Vote | Subsystem |
hadoop-yetus removed a comment on issue #1635: HADOOP-16596. [pb-upgrade] Use
shaded protobuf classes from hadoop-thirdparty dependency
URL: https://github.com/apache/hadoop/pull/1635#issuecomment-571265883
:broken_heart: **-1 overall**
| Vote | Subsystem |
hadoop-yetus removed a comment on issue #1635: HADOOP-16596. [pb-upgrade] Use
shaded protobuf classes from hadoop-thirdparty dependency
URL: https://github.com/apache/hadoop/pull/1635#issuecomment-577852404
:broken_heart: **-1 overall**
| Vote | Subsystem |
hadoop-yetus removed a comment on issue #1821: HADOOP-16825: Checkaccess
testcase fix
URL: https://github.com/apache/hadoop/pull/1821#issuecomment-582781700
:broken_heart: **-1 overall**
| Vote | Subsystem | Runtime | Comment |
hadoop-yetus removed a comment on issue #1821: HADOOP-16825: Checkaccess
testcase fix
URL: https://github.com/apache/hadoop/pull/1821#issuecomment-582672086
:confetti_ball: **+1 overall**
| Vote | Subsystem | Runtime | Comment |
hadoop-yetus removed a comment on issue #1821: HADOOP-16825: Checkaccess
testcase fix
URL: https://github.com/apache/hadoop/pull/1821#issuecomment-579198490
:confetti_ball: **+1 overall**
| Vote | Subsystem | Runtime | Comment |
[
https://issues.apache.org/jira/browse/HADOOP-16832?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17031624#comment-17031624
]
Hudson commented on HADOOP-16832:
-
SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #17928 (See
steveloughran commented on issue #1823: HADOOP-16794 S3 Encryption key is not
getting set properly during put operation.
URL: https://github.com/apache/hadoop/pull/1823#issuecomment-582929516
So what is proposed is
1. If we have local SSE-KMS settings, use that
1. fall back to
steveloughran commented on issue #1833: HADOOP-16493.
S3AFilesystem.initiateRename() shared parents
URL: https://github.com/apache/hadoop/pull/1833#issuecomment-582927787
Testing: none yet. it should add a new test which verifies that the getFS
call count is less
steveloughran opened a new pull request #1833: HADOOP-16493.
S3AFilesystem.initiateRename() shared parents
URL: https://github.com/apache/hadoop/pull/1833
rename can skip check on dest.parent status if src has same parent;
saves three calls (as the parent is not a file or a dir marker,
[
https://issues.apache.org/jira/browse/HADOOP-16832?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17031612#comment-17031612
]
Gabor Bota commented on HADOOP-16832:
-
+1 on PR #1822, committing.
> S3Guard testing doc: Add
bgaborg merged pull request #1822: HADOOP-16832 Update S3Guard testing doc.
URL: https://github.com/apache/hadoop/pull/1822
This is an automated message from the Apache Git Service.
To respond to the message, please log on
[
https://issues.apache.org/jira/browse/HADOOP-16832?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Gabor Bota resolved HADOOP-16832.
-
Resolution: Fixed
> S3Guard testing doc: Add required parameters for S3Guard testing in IDE
>
[
https://issues.apache.org/jira/browse/HADOOP-16832?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Gabor Bota updated HADOOP-16832:
Summary: S3Guard testing doc: Add required parameters for S3Guard testing
in IDE (was:
[
https://issues.apache.org/jira/browse/HADOOP-16832?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Gabor Bota updated HADOOP-16832:
Summary: [S3Guard] Testing doc: Add required parameters for S3Guard testing
in IDE (was: Add
bgaborg removed a comment on issue #1822: HADOOP-16832 Update S3Guard testing
doc.
URL: https://github.com/apache/hadoop/pull/1822#issuecomment-582921003
LGTM. +1 committing.
This is an automated message from the Apache Git
bgaborg commented on issue #1822: HADOOP-16832 Update S3Guard testing doc.
URL: https://github.com/apache/hadoop/pull/1822#issuecomment-582921003
LGTM. +1 committing.
This is an automated message from the Apache Git Service.
[
https://issues.apache.org/jira/browse/HADOOP-16493?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Steve Loughran reassigned HADOOP-16493:
---
Assignee: Steve Loughran
> S3AFilesystem.initiateRename() can skip check on
[
https://issues.apache.org/jira/browse/HADOOP-16188?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17031610#comment-17031610
]
Steve Loughran commented on HADOOP-16188:
-
Reviewing this. We need to move off the AWS client
davidarcher commented on issue #1823: HADOOP-16794 S3 Encryption key is not
getting set properly during put operation.
URL: https://github.com/apache/hadoop/pull/1823#issuecomment-582895340
> @davidarcher Yes this could be the other solution which even I thought
initially. But looks like
hadoop-yetus commented on issue #1832: HDFS-13989. RBF: Add FSCK to the Router
URL: https://github.com/apache/hadoop/pull/1832#issuecomment-582886312
:broken_heart: **-1 overall**
| Vote | Subsystem | Runtime | Comment |
|::|--:|:|:|
[
https://issues.apache.org/jira/browse/HADOOP-16613?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17031483#comment-17031483
]
Steve Loughran commented on HADOOP-16613:
-
Fixing in HADOOP-16823 as I do things with directory
[
https://issues.apache.org/jira/browse/HADOOP-16613?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Steve Loughran reassigned HADOOP-16613:
---
Assignee: Steve Loughran
> s3a to set fake directory marker contentType to
[
https://issues.apache.org/jira/browse/HADOOP-13363?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17031444#comment-17031444
]
Tsuyoshi Ozawa commented on HADOOP-13363:
-
Commented on HADOOP-16596.
> Upgrade protobuf from
[
https://issues.apache.org/jira/browse/HADOOP-16596?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17031440#comment-17031440
]
Tsuyoshi Ozawa edited comment on HADOOP-16596 at 2/6/20 10:22 AM:
--
[
https://issues.apache.org/jira/browse/HADOOP-16596?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17031440#comment-17031440
]
Tsuyoshi Ozawa commented on HADOOP-16596:
-
[~vinayakumarb]
Thanks for your patch! I am happy
[
https://issues.apache.org/jira/browse/HADOOP-13363?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17031400#comment-17031400
]
Tsuyoshi Ozawa commented on HADOOP-13363:
-
Sure, I would like to review the code today. Please
aajisaka opened a new pull request #1832: HDFS-13989. RBF: Add FSCK to the
Router
URL: https://github.com/apache/hadoop/pull/1832
JIRA: https://issues.apache.org/jira/browse/HDFS-13989
* Refactor the code
* (hopefully) support https
* Add end-to-end unit test
Note that
hadoop-yetus commented on issue #1821: HADOOP-16825: Checkaccess testcase fix
URL: https://github.com/apache/hadoop/pull/1821#issuecomment-582803805
:confetti_ball: **+1 overall**
| Vote | Subsystem | Runtime | Comment |
|::|--:|:|:|
hadoop-yetus commented on issue #1831: Hadoop 16845:
ITestAbfsClient.testContinuationTokenHavingEqualSign failing
URL: https://github.com/apache/hadoop/pull/1831#issuecomment-582799255
:confetti_ball: **+1 overall**
| Vote | Subsystem | Runtime | Comment |
bilaharith commented on a change in pull request #1821: HADOOP-16825:
Checkaccess testcase fix
URL: https://github.com/apache/hadoop/pull/1821#discussion_r375685811
##
File path:
hadoop-tools/hadoop-azure/src/main/java/org/apache/hadoop/fs/azurebfs/AzureBlobFileSystem.java
79 matches
Mail list logo
