[
https://issues.apache.org/jira/browse/HADOOP-19052?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
liang yu updated HADOOP-19052:
--
Attachment: (was: image-2024-01-26-16-18-44-969.png)
> Hadoop use Shell command to get the count
[
https://issues.apache.org/jira/browse/HADOOP-19052?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
liang yu updated HADOOP-19052:
--
Attachment: (was: image-2024-01-26-17-19-49-805.png)
> Hadoop use Shell command to get the count
[
https://issues.apache.org/jira/browse/HADOOP-19052?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
liang yu updated HADOOP-19052:
--
Attachment: (was: image-2024-01-26-17-15-32-312.png)
> Hadoop use Shell command to get the count
[
https://issues.apache.org/jira/browse/HADOOP-19052?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
liang yu updated HADOOP-19052:
--
Description:
Using Hadoop 3.3.4
When the QPS of `append` executions is very high, at a rate of
[
https://issues.apache.org/jira/browse/HADOOP-19052?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
liang yu updated HADOOP-19052:
--
Description:
Using Hadoop 3.3.4 and Spark 2.4.0
We use Spark Streaming to append multiple files in
[
https://issues.apache.org/jira/browse/HADOOP-19052?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
liang yu updated HADOOP-19052:
--
Description:
Using Hadoop 3.3.4
We use Spark Streaming to append multiple files in hadoop
[
https://issues.apache.org/jira/browse/HADOOP-19060?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
huangzhaobo updated HADOOP-19060:
-
Description:
# Shield references to {{UserGroupInformation}} Class.
# In the future, we can
[
https://issues.apache.org/jira/browse/HADOOP-19060?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17813060#comment-17813060
]
ASF GitHub Bot commented on HADOOP-19060:
-
hadoop-yetus commented on PR #6516:
URL:
hadoop-yetus commented on PR #6516:
URL: https://github.com/apache/hadoop/pull/6516#issuecomment-1920623248
:confetti_ball: **+1 overall**
| Vote | Subsystem | Runtime | Logfile | Comment |
|::|--:|:|::|:---:|
| +0 :ok: |
[
https://issues.apache.org/jira/browse/HADOOP-19060?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
huangzhaobo updated HADOOP-19060:
-
Description:
# Shield references to {{UserGroupInformation}} Class for easier access.
# In
[
https://issues.apache.org/jira/browse/HADOOP-18781?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17813049#comment-17813049
]
Abhishek Dixit commented on HADOOP-18781:
-
[~mehakmeetSingh] Can you please clarify in which
huangzhaobo99 commented on PR #6505:
URL: https://github.com/apache/hadoop/pull/6505#issuecomment-1920575695
> > Hi @slfan1989, Is the IO exception mentioned here a fault with DN? If
so, There are currently relevant exception handling mechanisms in place, there
is to ensure that the
slfan1989 commented on PR #6505:
URL: https://github.com/apache/hadoop/pull/6505#issuecomment-1920558332
> Hi @slfan1989, Is the IO exception mentioned here a fault with DN? If so,
There are currently relevant exception handling mechanisms in place, there is
to ensure that the elements
[
https://issues.apache.org/jira/browse/HADOOP-19060?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17813040#comment-17813040
]
ASF GitHub Bot commented on HADOOP-19060:
-
huangzhaobo99 commented on PR #6516:
URL:
huangzhaobo99 commented on PR #6516:
URL: https://github.com/apache/hadoop/pull/6516#issuecomment-1920518453
Hi @tasanuma @Hexiaoqiao @zhangshuyan0 @slfan1989,
Please kindly review this PR as well if you have bandwidth, Thanks.
--
This is an automated message from the Apache Git
ritegarg commented on PR #6513:
URL: https://github.com/apache/hadoop/pull/6513#issuecomment-1920464249
Jenkins test this please
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific
hfutatzhanghb commented on PR #6517:
URL: https://github.com/apache/hadoop/pull/6517#issuecomment-1920460043
@Hexiaoqiao @zhangshuyan0 @tasanuma @tomscut Hi, sir. Could you please help
me review this PR when you are free ? Thanks a lot!
--
This is an automated message from the Apache Git
hfutatzhanghb opened a new pull request, #6517:
URL: https://github.com/apache/hadoop/pull/6517
### Description of PR
Refer to HDFS-17365.
Currently, when we write ec files. It can tolerate with at most
`numAllBlocks - numDataBlocks` failed streamers.
However, this can lead to
haiyang1987 commented on code in PR #6464:
URL: https://github.com/apache/hadoop/pull/6464#discussion_r1473755366
##
hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/datanode/fsdataset/impl/TestFsDatasetImpl.java:
##
@@ -2011,4 +2011,95 @@ public void
[
https://issues.apache.org/jira/browse/HADOOP-19060?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
huangzhaobo updated HADOOP-19060:
-
Description:
The current HDFS client keytab authentication code is as follows:
{code:java}
[
https://issues.apache.org/jira/browse/HADOOP-19060?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
huangzhaobo updated HADOOP-19060:
-
Description:
The current HDFS client keytab authentication code is as follows:
{code:java}
[
https://issues.apache.org/jira/browse/HADOOP-19060?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
ASF GitHub Bot updated HADOOP-19060:
Labels: pull-request-available (was: )
> Support hadoop client authentication through
[
https://issues.apache.org/jira/browse/HADOOP-19060?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17813017#comment-17813017
]
ASF GitHub Bot commented on HADOOP-19060:
-
huangzhaobo99 opened a new pull request, #6516:
URL:
huangzhaobo99 opened a new pull request, #6516:
URL: https://github.com/apache/hadoop/pull/6516
### Description of PR
JIRA: https://issues.apache.org/jira/browse/HADOOP-19060
### How was this patch tested?
Add UnitTest.
--
This is an automated message from the Apache Git
huangzhaobo created HADOOP-19060:
Summary: Support hadoop client authentication through keytab
configuration.
Key: HADOOP-19060
URL: https://issues.apache.org/jira/browse/HADOOP-19060
Project: Hadoop
hadoop-yetus commented on PR #6350:
URL: https://github.com/apache/hadoop/pull/6350#issuecomment-1920351199
:broken_heart: **-1 overall**
| Vote | Subsystem | Runtime | Logfile | Comment |
|::|--:|:|::|:---:|
| +0 :ok: |
[
https://issues.apache.org/jira/browse/HADOOP-19059?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17812992#comment-17812992
]
ASF GitHub Bot commented on HADOOP-19059:
-
jxhan3 commented on PR #6506:
URL:
jxhan3 commented on PR #6506:
URL: https://github.com/apache/hadoop/pull/6506#issuecomment-1920248483
http://www.w3.org/2001/XMLSchema-instance;
xsi:noNamespaceSchemaLocation="https://maven.apache.org/surefire/maven-surefire-plugin/xsd/failsafe-summary.xsd;
result="255"
[
https://issues.apache.org/jira/browse/HADOOP-19050?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17812991#comment-17812991
]
ASF GitHub Bot commented on HADOOP-19050:
-
adnanhemani commented on code in PR #6507:
URL:
adnanhemani commented on code in PR #6507:
URL: https://github.com/apache/hadoop/pull/6507#discussion_r1473617958
##
hadoop-tools/hadoop-aws/pom.xml:
##
@@ -508,6 +508,29 @@
bundle
compile
+
+ software.amazon.s3.accessgrants
Review Comment:
This
[
https://issues.apache.org/jira/browse/HADOOP-19050?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17812990#comment-17812990
]
ASF GitHub Bot commented on HADOOP-19050:
-
adnanhemani commented on PR #6507:
URL:
adnanhemani commented on PR #6507:
URL: https://github.com/apache/hadoop/pull/6507#issuecomment-1920244731
Hi @steveloughran - thanks for your time on this. We appreciate it a lot.
I've responded to your comments inline below:
> We cannot have any more unshaded aws sdk jars as
[
https://issues.apache.org/jira/browse/HADOOP-19050?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17812978#comment-17812978
]
ASF GitHub Bot commented on HADOOP-19050:
-
adnanhemani commented on code in PR #6507:
URL:
adnanhemani commented on code in PR #6507:
URL: https://github.com/apache/hadoop/pull/6507#discussion_r1473617958
##
hadoop-tools/hadoop-aws/pom.xml:
##
@@ -508,6 +508,29 @@
bundle
compile
+
+ software.amazon.s3.accessgrants
Review Comment:
This
[
https://issues.apache.org/jira/browse/HADOOP-19050?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17812977#comment-17812977
]
ASF GitHub Bot commented on HADOOP-19050:
-
hadoop-yetus commented on PR #6507:
URL:
hadoop-yetus commented on PR #6507:
URL: https://github.com/apache/hadoop/pull/6507#issuecomment-1920154192
:broken_heart: **-1 overall**
| Vote | Subsystem | Runtime | Logfile | Comment |
|::|--:|:|::|:---:|
| +0 :ok: |
[
https://issues.apache.org/jira/browse/HADOOP-18993?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17812970#comment-17812970
]
ASF GitHub Bot commented on HADOOP-18993:
-
agilelab-tmnd1991 commented on PR #6301:
URL:
agilelab-tmnd1991 commented on PR #6301:
URL: https://github.com/apache/hadoop/pull/6301#issuecomment-1920123368
`ITestS3AClosedFS` runs well "alone" (i.e. `mvn -pl hadoop-tools/hadoop-aws
verify -Dtest=none -Dit.test=ITestS3AClosedFS`) I will retry all together now
and cross fingers. 爛
hadoop-yetus commented on PR #6515:
URL: https://github.com/apache/hadoop/pull/6515#issuecomment-1920106021
:broken_heart: **-1 overall**
| Vote | Subsystem | Runtime | Logfile | Comment |
|::|--:|:|::|:---:|
| +0 :ok: |
[
https://issues.apache.org/jira/browse/HADOOP-19057?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17812963#comment-17812963
]
ASF GitHub Bot commented on HADOOP-19057:
-
hadoop-yetus commented on PR #6515:
URL:
[
https://issues.apache.org/jira/browse/HADOOP-18993?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17812858#comment-17812858
]
ASF GitHub Bot commented on HADOOP-18993:
-
steveloughran commented on PR #6301:
URL:
steveloughran commented on PR #6301:
URL: https://github.com/apache/hadoop/pull/6301#issuecomment-1919919797
ITestS3AClosedFS looks new. I'd have expected the others today (fix in
progress)
does it work on a test run on hadoop trunk without your pr
--
This is an automated message
[
https://issues.apache.org/jira/browse/HADOOP-19057?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17812857#comment-17812857
]
ASF GitHub Bot commented on HADOOP-19057:
-
steveloughran opened a new pull request, #6515:
URL:
[
https://issues.apache.org/jira/browse/HADOOP-19057?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
ASF GitHub Bot updated HADOOP-19057:
Labels: pull-request-available (was: )
> S3 public test bucket landsat-pds unreadable
steveloughran opened a new pull request, #6515:
URL: https://github.com/apache/hadoop/pull/6515
Moves to new test file/bucket
s3a://nyc-tlc/trip data/fhvhv_tripdata_2019-02.parquet
this is actually quite an interesting path as it has a space in and breaks
s3guard tool uri
[
https://issues.apache.org/jira/browse/HADOOP-18342?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17812856#comment-17812856
]
ASF GitHub Bot commented on HADOOP-18342:
-
pjfanning opened a new pull request, #4854:
URL:
pjfanning opened a new pull request, #4854:
URL: https://github.com/apache/hadoop/pull/4854
### Description of PR
Use temp version of hadoop-shaded-avro (see
https://github.com/apache/hadoop-thirdparty/pull/21)
### How was this patch tested?
### For code
[
https://issues.apache.org/jira/browse/HADOOP-19059?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17812851#comment-17812851
]
ASF GitHub Bot commented on HADOOP-19059:
-
jxhan3 commented on PR #6506:
URL:
jxhan3 commented on PR #6506:
URL: https://github.com/apache/hadoop/pull/6506#issuecomment-1919873769
running all tests with assume role, KMS encryption, us-east-1 bucket, will
post the report when it is done.
```
mvn verify -Dparallel-tests -Dprefetch -Dscale -DtestsThreadCount=8
hadoop-yetus commented on PR #6475:
URL: https://github.com/apache/hadoop/pull/6475#issuecomment-1919838617
:broken_heart: **-1 overall**
| Vote | Subsystem | Runtime | Logfile | Comment |
|::|--:|:|::|:---:|
| +0 :ok: |
[
https://issues.apache.org/jira/browse/HADOOP-19050?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17812848#comment-17812848
]
ASF GitHub Bot commented on HADOOP-19050:
-
hadoop-yetus commented on PR #6507:
URL:
hadoop-yetus commented on PR #6507:
URL: https://github.com/apache/hadoop/pull/6507#issuecomment-1919823492
:broken_heart: **-1 overall**
| Vote | Subsystem | Runtime | Logfile | Comment |
|::|--:|:|::|:---:|
| +0 :ok: |
hadoop-yetus commented on PR #6504:
URL: https://github.com/apache/hadoop/pull/6504#issuecomment-1919776967
:broken_heart: **-1 overall**
| Vote | Subsystem | Runtime | Logfile | Comment |
|::|--:|:|::|:---:|
| +0 :ok: |
[
https://issues.apache.org/jira/browse/HADOOP-19044?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17812841#comment-17812841
]
ASF GitHub Bot commented on HADOOP-19044:
-
virajjasani commented on code in PR #6479:
URL:
virajjasani commented on code in PR #6479:
URL: https://github.com/apache/hadoop/pull/6479#discussion_r1473328789
##
hadoop-tools/hadoop-aws/src/test/java/org/apache/hadoop/fs/s3a/ITestS3AEndpointRegion.java:
##
@@ -257,6 +283,83 @@ public void testWithVPCE() throws Throwable {
[
https://issues.apache.org/jira/browse/HADOOP-18682?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17812839#comment-17812839
]
ASF GitHub Bot commented on HADOOP-18682:
-
xBis7 commented on PR #6483:
URL:
xBis7 commented on PR #6483:
URL: https://github.com/apache/hadoop/pull/6483#issuecomment-1919710228
Hi @jojochuang, it's not the same as running `docker build` and building the
image. It doesn't work unless you use the `-Pdist` option, which is what takes
the extra time and not docker.
hadoop-yetus commented on PR #6514:
URL: https://github.com/apache/hadoop/pull/6514#issuecomment-1919698118
:broken_heart: **-1 overall**
| Vote | Subsystem | Runtime | Logfile | Comment |
|::|--:|:|::|:---:|
| +0 :ok: |
hadoop-yetus commented on PR #6514:
URL: https://github.com/apache/hadoop/pull/6514#issuecomment-1919623674
:broken_heart: **-1 overall**
| Vote | Subsystem | Runtime | Logfile | Comment |
|::|--:|:|::|:---:|
| +0 :ok: |
[
https://issues.apache.org/jira/browse/HADOOP-19044?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17812819#comment-17812819
]
ASF GitHub Bot commented on HADOOP-19044:
-
ahmarsuhail commented on code in PR #6479:
URL:
ahmarsuhail commented on code in PR #6479:
URL: https://github.com/apache/hadoop/pull/6479#discussion_r1473199039
##
hadoop-tools/hadoop-aws/src/test/java/org/apache/hadoop/fs/s3a/ITestS3AEndpointRegion.java:
##
@@ -257,6 +283,83 @@ public void testWithVPCE() throws Throwable {
[
https://issues.apache.org/jira/browse/HADOOP-18993?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17812816#comment-17812816
]
ASF GitHub Bot commented on HADOOP-18993:
-
hadoop-yetus commented on PR #6301:
URL:
hadoop-yetus commented on PR #6301:
URL: https://github.com/apache/hadoop/pull/6301#issuecomment-1919575320
:confetti_ball: **+1 overall**
| Vote | Subsystem | Runtime | Logfile | Comment |
|::|--:|:|::|:---:|
| +0 :ok: |
hadoop-yetus commented on PR #6509:
URL: https://github.com/apache/hadoop/pull/6509#issuecomment-1919549958
:broken_heart: **-1 overall**
| Vote | Subsystem | Runtime | Logfile | Comment |
|::|--:|:|::|:---:|
| +0 :ok: |
hadoop-yetus commented on PR #6509:
URL: https://github.com/apache/hadoop/pull/6509#issuecomment-1919545451
:broken_heart: **-1 overall**
| Vote | Subsystem | Runtime | Logfile | Comment |
|::|--:|:|::|:---:|
| +0 :ok: |
[
https://issues.apache.org/jira/browse/HADOOP-18993?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17812811#comment-17812811
]
ASF GitHub Bot commented on HADOOP-18993:
-
agilelab-tmnd1991 commented on PR #6301:
URL:
agilelab-tmnd1991 commented on PR #6301:
URL: https://github.com/apache/hadoop/pull/6301#issuecomment-1919541155
This the result of verify, looks good to me:
```
[INFO] Results:
[INFO]
[ERROR] Failures:
[ERROR] ITestS3AClosedFS.testClosedInstrumentation:111
hadoop-yetus commented on PR #6509:
URL: https://github.com/apache/hadoop/pull/6509#issuecomment-1919530517
:broken_heart: **-1 overall**
| Vote | Subsystem | Runtime | Logfile | Comment |
|::|--:|:|::|:---:|
| +0 :ok: |
[
https://issues.apache.org/jira/browse/HADOOP-19044?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17812806#comment-17812806
]
ASF GitHub Bot commented on HADOOP-19044:
-
virajjasani commented on code in PR #6479:
URL:
virajjasani commented on code in PR #6479:
URL: https://github.com/apache/hadoop/pull/6479#discussion_r1473161962
##
hadoop-tools/hadoop-aws/src/test/java/org/apache/hadoop/fs/s3a/ITestS3AEndpointRegion.java:
##
@@ -257,6 +283,83 @@ public void testWithVPCE() throws Throwable {
hadoop-yetus commented on PR #6361:
URL: https://github.com/apache/hadoop/pull/6361#issuecomment-1919525285
:confetti_ball: **+1 overall**
| Vote | Subsystem | Runtime | Logfile | Comment |
|::|--:|:|::|:---:|
| +0 :ok: |
[
https://issues.apache.org/jira/browse/HADOOP-18993?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17812800#comment-17812800
]
ASF GitHub Bot commented on HADOOP-18993:
-
hadoop-yetus commented on PR #6301:
URL:
hadoop-yetus commented on PR #6301:
URL: https://github.com/apache/hadoop/pull/6301#issuecomment-1919496989
:confetti_ball: **+1 overall**
| Vote | Subsystem | Runtime | Logfile | Comment |
|::|--:|:|::|:---:|
| +0 :ok: |
huangzhaobo99 commented on PR #6505:
URL: https://github.com/apache/hadoop/pull/6505#issuecomment-1919480906
> @huangzhaobo99 I have a question. If the IO of the machine where the DN is
located is abnormal, causing exceptions in many blocks, what will this metric
look like?
>
>
hadoop-yetus commented on PR #6509:
URL: https://github.com/apache/hadoop/pull/6509#issuecomment-1919434400
:broken_heart: **-1 overall**
| Vote | Subsystem | Runtime | Logfile | Comment |
|::|--:|:|::|:---:|
| +0 :ok: |
[
https://issues.apache.org/jira/browse/HADOOP-19050?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17812772#comment-17812772
]
ASF GitHub Bot commented on HADOOP-19050:
-
steveloughran commented on code in PR #6507:
URL:
[
https://issues.apache.org/jira/browse/HADOOP-19047?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17812771#comment-17812771
]
ASF GitHub Bot commented on HADOOP-19047:
-
shameersss1 commented on PR #6468:
URL:
steveloughran commented on code in PR #6507:
URL: https://github.com/apache/hadoop/pull/6507#discussion_r1473066304
##
hadoop-tools/hadoop-aws/pom.xml:
##
@@ -508,6 +508,29 @@
bundle
compile
+
Review Comment:
the plugin should go in bundle.jar. it's
shameersss1 commented on PR #6468:
URL: https://github.com/apache/hadoop/pull/6468#issuecomment-1919397323
@steveloughran - Could you please review the changes?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL
[
https://issues.apache.org/jira/browse/HADOOP-19059?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Steve Loughran reassigned HADOOP-19059:
---
Assignee: Jason Han
> update AWS SDK to support S3 Access Grants in S3A
>
[
https://issues.apache.org/jira/browse/HADOOP-19047?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17812770#comment-17812770
]
Syed Shameerur Rahman commented on HADOOP-19047:
[~ste...@apache.org] - Gentle
[ https://issues.apache.org/jira/browse/HADOOP-19047 ]
Syed Shameerur Rahman deleted comment on HADOOP-19047:
was (Author: srahman):
[~ste...@apache.org] i have converted draft PR to final version. Could you
please review the same
[
https://issues.apache.org/jira/browse/HADOOP-19059?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17812769#comment-17812769
]
ASF GitHub Bot commented on HADOOP-19059:
-
steveloughran commented on PR #6506:
URL:
steveloughran commented on PR #6506:
URL: https://github.com/apache/hadoop/pull/6506#issuecomment-1919394997
* this is a hadoop module; moved the jira and changed the number to the new
one issued.
* which AWS region did you run the hadoop mvn verify tests against, what
were the command
[
https://issues.apache.org/jira/browse/HADOOP-19059?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17812765#comment-17812765
]
Steve Loughran commented on HADOOP-19059:
-
moved to hadoop module, jira is now
[
https://issues.apache.org/jira/browse/HADOOP-19059?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Steve Loughran updated HADOOP-19059:
Component/s: build
> update AWS SDK to support S3 Access Grants in S3A
>
[
https://issues.apache.org/jira/browse/HADOOP-19059?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Steve Loughran moved HDFS-17350 to HADOOP-19059:
Component/s: fs/s3
(was: fs/s3)
[
https://issues.apache.org/jira/browse/HADOOP-19050?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Steve Loughran reassigned HADOOP-19050:
---
Assignee: Jason Han
> Add S3 Access Grants Support in S3A
>
[
https://issues.apache.org/jira/browse/HADOOP-19050?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17812762#comment-17812762
]
ASF GitHub Bot commented on HADOOP-19050:
-
steveloughran commented on code in PR #6507:
URL:
steveloughran commented on code in PR #6507:
URL: https://github.com/apache/hadoop/pull/6507#discussion_r1472896913
##
hadoop-tools/hadoop-aws/pom.xml:
##
@@ -508,6 +508,29 @@
bundle
compile
+
+ software.amazon.s3.accessgrants
Review Comment:
[
https://issues.apache.org/jira/browse/HADOOP-18993?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17812755#comment-17812755
]
ASF GitHub Bot commented on HADOOP-18993:
-
agilelab-tmnd1991 commented on PR #6301:
URL:
agilelab-tmnd1991 commented on PR #6301:
URL: https://github.com/apache/hadoop/pull/6301#issuecomment-1919349632
thanks for the review @steveloughran.
I addressed your concerns and rebased. Now running `mvn -pl
hadoop-tools/hadoop-aws clean verify`.
I'll let you know the result soon.
bbeaudreault opened a new pull request, #6514:
URL: https://github.com/apache/hadoop/pull/6514
### Description of PR
Follows the pattern of existing striped and hedged read shared resources.
Moves the singleton BUFFER_POOL from DFSStripedInputStream into DFSClient and
handles
[
https://issues.apache.org/jira/browse/HADOOP-19050?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17812745#comment-17812745
]
ASF GitHub Bot commented on HADOOP-19050:
-
ahmarsuhail commented on code in PR #6507:
URL:
ahmarsuhail commented on code in PR #6507:
URL: https://github.com/apache/hadoop/pull/6507#discussion_r1472858212
##
hadoop-project/pom.xml:
##
@@ -187,7 +187,7 @@
1.0-beta-1
900
1.12.599
-2.23.5
Review Comment:
cut, SDK upgrade needs to happen separately
slfan1989 commented on PR #6361:
URL: https://github.com/apache/hadoop/pull/6361#issuecomment-1919291606
@goiri Can you help review this PR? Thank you very much! I will continue to
follow the development of YARN-7402.
--
This is an automated message from the Apache Git Service.
To
slfan1989 commented on PR #6505:
URL: https://github.com/apache/hadoop/pull/6505#issuecomment-1919258861
@huangzhaobo99 I have a question. If the IO of the machine where the DN is
located is abnormal, causing access exceptions in many blocks, what will this
metric look like?
--
This is
hadoop-yetus commented on PR #6506:
URL: https://github.com/apache/hadoop/pull/6506#issuecomment-1919224550
:broken_heart: **-1 overall**
| Vote | Subsystem | Runtime | Logfile | Comment |
|::|--:|:|::|:---:|
| +0 :ok: |
hadoop-yetus commented on PR #6509:
URL: https://github.com/apache/hadoop/pull/6509#issuecomment-1919217088
:broken_heart: **-1 overall**
| Vote | Subsystem | Runtime | Logfile | Comment |
|::|--:|:|::|:---:|
| +0 :ok: |
hadoop-yetus commented on PR #6506:
URL: https://github.com/apache/hadoop/pull/6506#issuecomment-1919192511
:broken_heart: **-1 overall**
| Vote | Subsystem | Runtime | Logfile | Comment |
|::|--:|:|::|:---:|
| +0 :ok: |
1 - 100 of 128 matches
Mail list logo
