[GitHub] [hadoop] ashutoshcipher commented on pull request #3591: YARN-10991. Fix to ignore the grouping "[]" properly in parseResource…

2021-10-26 Thread GitBox
ashutoshcipher commented on pull request #3591: URL: https://github.com/apache/hadoop/pull/3591#issuecomment-952561949 Closing this PR due to incorrect source branch name -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and

[GitHub] [hadoop] ashutoshcipher closed pull request #3591: YARN-10991. Fix to ignore the grouping "[]" properly in parseResource…

2021-10-26 Thread GitBox
ashutoshcipher closed pull request #3591: URL: https://github.com/apache/hadoop/pull/3591 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [hadoop] ashutoshcipher opened a new pull request #3591: YARN-10991. Fix to ignore the grouping "[]" properly in parseResource…

2021-10-26 Thread GitBox
ashutoshcipher opened a new pull request #3591: URL: https://github.com/apache/hadoop/pull/3591 Jira: https://issues.apache.org/jira/browse/YARN-10991 Fix to ignore the grouping "[]" properly in parseResourcesString method -- This is an automated message from the Apache Git

[jira] [Work logged] (HADOOP-16905) Update jackson-databind to 2.10.3 to relieve us from the endless CVE patches

2021-10-26 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16905?focusedWorklogId=670460=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-670460 ] ASF GitHub Bot logged work on HADOOP-16905: --- Author: ASF GitHub Bot

[GitHub] [hadoop] jojochuang opened a new pull request #3590: HADOOP-16905 branch 3.2

2021-10-26 Thread GitBox
jojochuang opened a new pull request #3590: URL: https://github.com/apache/hadoop/pull/3590 Revive PR #1973. This time, with HADOOP-15775 added to make it compile. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use

[jira] [Work logged] (HADOOP-16905) Update jackson-databind to 2.10.3 to relieve us from the endless CVE patches

2021-10-26 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16905?focusedWorklogId=670459=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-670459 ] ASF GitHub Bot logged work on HADOOP-16905: --- Author: ASF GitHub Bot

[jira] [Work logged] (HADOOP-16905) Update jackson-databind to 2.10.3 to relieve us from the endless CVE patches

2021-10-26 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16905?focusedWorklogId=670458=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-670458 ] ASF GitHub Bot logged work on HADOOP-16905: --- Author: ASF GitHub Bot

[GitHub] [hadoop] jojochuang closed pull request #3589: HADOOP-16905 branch 3.2

2021-10-26 Thread GitBox
jojochuang closed pull request #3589: URL: https://github.com/apache/hadoop/pull/3589 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [hadoop] jojochuang opened a new pull request #3589: HADOOP-16905 branch 3.2

2021-10-26 Thread GitBox
jojochuang opened a new pull request #3589: URL: https://github.com/apache/hadoop/pull/3589 Revive PR #1973. This time, with HADOOP-15775 added to make it compile. ### Description of PR ### How was this patch tested? ### For code changes: - [ ] Does

[GitHub] [hadoop] hadoop-yetus commented on pull request #3587: support listObjectV2

2021-10-26 Thread GitBox
hadoop-yetus commented on pull request #3587: URL: https://github.com/apache/hadoop/pull/3587#issuecomment-952504772 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[GitHub] [hadoop] tomscut commented on pull request #3538: HDFS-16266. Add remote port information to HDFS audit log

2021-10-26 Thread GitBox
tomscut commented on pull request #3538: URL: https://github.com/apache/hadoop/pull/3538#issuecomment-952473223 Hi @tasanuma @jojochuang @ayushtkn @ferhui , could you please take a look at this PR again. Thank you very much. The code was submitted with multiple versions, resulting

[GitHub] [hadoop] tomscut commented on pull request #3564: HDFS-16279. Print detail datanode info when process first storage report

2021-10-26 Thread GitBox
tomscut commented on pull request #3564: URL: https://github.com/apache/hadoop/pull/3564#issuecomment-952467805 > ProcessReport from dead or unregistered node Thanks @tasanuma for your comment and pointing out this issue. When the instantiation of DatanodeID is

[jira] [Work logged] (HADOOP-17485) port UGI#getGroupsSet optimizations into 2.10

2021-10-26 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17485?focusedWorklogId=670370=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-670370 ] ASF GitHub Bot logged work on HADOOP-17485: --- Author: ASF GitHub Bot

[GitHub] [hadoop] hadoop-yetus commented on pull request #2631: HADOOP-17485. port UGI#getGroupsSet optimizations into 2.10

2021-10-26 Thread GitBox
hadoop-yetus commented on pull request #2631: URL: https://github.com/apache/hadoop/pull/2631#issuecomment-952344979 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 9m

[GitHub] [hadoop] hadoop-yetus commented on pull request #3538: HDFS-16266. Add remote port information to HDFS audit log

2021-10-26 Thread GitBox
hadoop-yetus commented on pull request #3538: URL: https://github.com/apache/hadoop/pull/3538#issuecomment-952317143 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[GitHub] [hadoop] hadoop-yetus commented on pull request #3550: YARN-10907. Minimize usages of AbstractCSQueue#csContext

2021-10-26 Thread GitBox
hadoop-yetus commented on pull request #3550: URL: https://github.com/apache/hadoop/pull/3550#issuecomment-952314331 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[GitHub] [hadoop] hadoop-yetus commented on pull request #2971: MAPREDUCE-7341. Intermediate Manifest Committer

2021-10-26 Thread GitBox
hadoop-yetus commented on pull request #2971: URL: https://github.com/apache/hadoop/pull/2971#issuecomment-952285237 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[GitHub] [hadoop] bbeaudreault commented on a change in pull request #3527: HDFS-16262 Async refresh of cached locations in DFSInputStream

2021-10-26 Thread GitBox
bbeaudreault commented on a change in pull request #3527: URL: https://github.com/apache/hadoop/pull/3527#discussion_r736825878 ## File path: hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/DFSInputStream.java ## @@ -228,53 +222,57 @@ boolean

[GitHub] [hadoop] hadoop-yetus commented on pull request #3564: HDFS-16279. Print detail datanode info when process first storage report

2021-10-26 Thread GitBox
hadoop-yetus commented on pull request #3564: URL: https://github.com/apache/hadoop/pull/3564#issuecomment-952207065 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[jira] [Work logged] (HADOOP-17968) Migrate checkstyle module illegalimport to maven enforcer banned-illegal-imports

2021-10-26 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17968?focusedWorklogId=670291=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-670291 ] ASF GitHub Bot logged work on HADOOP-17968: --- Author: ASF GitHub Bot

[GitHub] [hadoop] hadoop-yetus commented on pull request #3584: HADOOP-17968 Migrate checkstyle module illegalimport to maven enforcer banned-illegal-imports

2021-10-26 Thread GitBox
hadoop-yetus commented on pull request #3584: URL: https://github.com/apache/hadoop/pull/3584#issuecomment-952199145 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[jira] [Work logged] (HADOOP-17968) Migrate checkstyle module illegalimport to maven enforcer banned-illegal-imports

2021-10-26 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17968?focusedWorklogId=670242=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-670242 ] ASF GitHub Bot logged work on HADOOP-17968: --- Author: ASF GitHub Bot

[GitHub] [hadoop] hadoop-yetus commented on pull request #3584: HADOOP-17968 Migrate checkstyle module illegalimport to maven enforcer banned-illegal-imports

2021-10-26 Thread GitBox
hadoop-yetus commented on pull request #3584: URL: https://github.com/apache/hadoop/pull/3584#issuecomment-952148413 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[jira] [Work logged] (HADOOP-17968) Migrate checkstyle module illegalimport to maven enforcer banned-illegal-imports

2021-10-26 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17968?focusedWorklogId=670230=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-670230 ] ASF GitHub Bot logged work on HADOOP-17968: --- Author: ASF GitHub Bot

[GitHub] [hadoop] tasanuma commented on pull request #3584: HADOOP-17968 Migrate checkstyle module illegalimport to maven enforcer banned-illegal-imports

2021-10-26 Thread GitBox
tasanuma commented on pull request #3584: URL: https://github.com/apache/hadoop/pull/3584#issuecomment-952128256 @virajjasani Thanks for updating it. +1, pending CI. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use

[GitHub] [hadoop] tasanuma commented on pull request #3564: HDFS-16279. Print detail datanode info when process first storage report

2021-10-26 Thread GitBox
tasanuma commented on pull request #3564: URL: https://github.com/apache/hadoop/pull/3564#issuecomment-952118622 `DatanodeID` object has a lot of information. This change seems to reduce it. Before: ``` java.io.IOException: ProcessReport from dead or unregistered node:

[GitHub] [hadoop] GauthamBanasandra opened a new pull request #3588: HDFS-16285. Make HDFS ownership tools cross platform

2021-10-26 Thread GitBox
GauthamBanasandra opened a new pull request #3588: URL: https://github.com/apache/hadoop/pull/3588 ### Description of PR The source files for **hdfs_chown**, **hdfs_chmod** and **hdfs_chgrp** uses getopt for parsing the command line arguments. getopt is available only on Linux

[jira] [Work started] (HADOOP-17979) Interface EtagFromFileStatus to allow FileStatus subclasses to provide etags

2021-10-26 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17979?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HADOOP-17979 started by Steve Loughran. --- > Interface EtagFromFileStatus to allow FileStatus subclasses to

[GitHub] [hadoop] steveloughran commented on pull request #3582: HADOOP-17977 FileOutputCommitter make PENDING_DIR_NAME configurable

2021-10-26 Thread GitBox
steveloughran commented on pull request #3582: URL: https://github.com/apache/hadoop/pull/3582#issuecomment-952099811 (Avoids having to stop worrying about people creating pending dirs like "year=2021" and wondering why data is lost... I see this is actually a duplicate of

[jira] [Work logged] (HADOOP-17928) s3a: set fs.s3a.downgrade.syncable.exceptions = true by default

2021-10-26 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17928?focusedWorklogId=670194=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-670194 ] ASF GitHub Bot logged work on HADOOP-17928: --- Author: ASF GitHub Bot

[GitHub] [hadoop] sunchao commented on pull request #3585: HADOOP-17928. Syncable: S3A to warn and downgrade

2021-10-26 Thread GitBox
sunchao commented on pull request #3585: URL: https://github.com/apache/hadoop/pull/3585#issuecomment-952096253 cc @dongjoon-hyun -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[jira] [Created] (HADOOP-17979) Interface EtagFromFileStatus to allow FileStatus subclasses to provide etags

2021-10-26 Thread Steve Loughran (Jira)
Steve Loughran created HADOOP-17979: --- Summary: Interface EtagFromFileStatus to allow FileStatus subclasses to provide etags Key: HADOOP-17979 URL: https://issues.apache.org/jira/browse/HADOOP-17979

[GitHub] [hadoop] hadoop-yetus removed a comment on pull request #2971: MAPREDUCE-7341. Intermediate Manifest Committer

2021-10-26 Thread GitBox
hadoop-yetus removed a comment on pull request #2971: URL: https://github.com/apache/hadoop/pull/2971#issuecomment-949930878 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:|

[jira] [Work logged] (HADOOP-17968) Migrate checkstyle module illegalimport to maven enforcer banned-illegal-imports

2021-10-26 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17968?focusedWorklogId=670178=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-670178 ] ASF GitHub Bot logged work on HADOOP-17968: --- Author: ASF GitHub Bot

[GitHub] [hadoop] virajjasani commented on pull request #3584: HADOOP-17968 Migrate checkstyle module illegalimport to maven enforcer banned-illegal-imports

2021-10-26 Thread GitBox
virajjasani commented on pull request #3584: URL: https://github.com/apache/hadoop/pull/3584#issuecomment-952078006 @amahussein @tasanuma JFYI, the builds take almost 24 hr time (some builds timed out as well) since the change is done in hadoop-main pom. -- This is an automated message

[GitHub] [hadoop] hadoop-yetus removed a comment on pull request #2971: MAPREDUCE-7341. Intermediate Manifest Committer

2021-10-26 Thread GitBox
hadoop-yetus removed a comment on pull request #2971: URL: https://github.com/apache/hadoop/pull/2971#issuecomment-949006536 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:|

[jira] [Work logged] (HADOOP-17968) Migrate checkstyle module illegalimport to maven enforcer banned-illegal-imports

2021-10-26 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17968?focusedWorklogId=670176=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-670176 ] ASF GitHub Bot logged work on HADOOP-17968: --- Author: ASF GitHub Bot

[jira] [Work logged] (HADOOP-17968) Migrate checkstyle module illegalimport to maven enforcer banned-illegal-imports

2021-10-26 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17968?focusedWorklogId=670175=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-670175 ] ASF GitHub Bot logged work on HADOOP-17968: --- Author: ASF GitHub Bot

[GitHub] [hadoop] hadoop-yetus commented on pull request #3584: HADOOP-17968 Migrate checkstyle module illegalimport to maven enforcer banned-illegal-imports

2021-10-26 Thread GitBox
hadoop-yetus commented on pull request #3584: URL: https://github.com/apache/hadoop/pull/3584#issuecomment-952075907 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[GitHub] [hadoop] virajjasani commented on pull request #3584: HADOOP-17968 Migrate checkstyle module illegalimport to maven enforcer banned-illegal-imports

2021-10-26 Thread GitBox
virajjasani commented on pull request #3584: URL: https://github.com/apache/hadoop/pull/3584#issuecomment-952075914 Done, thanks @tasanuma -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[jira] [Work logged] (HADOOP-17968) Migrate checkstyle module illegalimport to maven enforcer banned-illegal-imports

2021-10-26 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17968?focusedWorklogId=670169=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-670169 ] ASF GitHub Bot logged work on HADOOP-17968: --- Author: ASF GitHub Bot

[GitHub] [hadoop] hadoop-yetus commented on pull request #3584: HADOOP-17968 Migrate checkstyle module illegalimport to maven enforcer banned-illegal-imports

2021-10-26 Thread GitBox
hadoop-yetus commented on pull request #3584: URL: https://github.com/apache/hadoop/pull/3584#issuecomment-952071484 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[GitHub] [hadoop] ismailsimsek commented on pull request #3582: HADOOP-17977 FileOutputCommitter make PENDING_DIR_NAME configurable

2021-10-26 Thread GitBox
ismailsimsek commented on pull request #3582: URL: https://github.com/apache/hadoop/pull/3582#issuecomment-951973018 i see, i think that's more elegant,correct way to solve it -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub

[jira] [Work logged] (HADOOP-17968) Migrate checkstyle module illegalimport to maven enforcer banned-illegal-imports

2021-10-26 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17968?focusedWorklogId=670087=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-670087 ] ASF GitHub Bot logged work on HADOOP-17968: --- Author: ASF GitHub Bot

[GitHub] [hadoop] tasanuma commented on pull request #3584: HADOOP-17968 Migrate checkstyle module illegalimport to maven enforcer banned-illegal-imports

2021-10-26 Thread GitBox
tasanuma commented on pull request #3584: URL: https://github.com/apache/hadoop/pull/3584#issuecomment-951967668 Could you match the format of the text in the reason tags with other reason tags? -- This is an automated message from the Apache Git Service. To respond to the message,

[jira] [Work logged] (HADOOP-17520) S3A to downgraded to unguarded if the DDB table cannot be found

2021-10-26 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17520?focusedWorklogId=670085=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-670085 ] ASF GitHub Bot logged work on HADOOP-17520: --- Author: ASF GitHub Bot

[jira] [Work logged] (HADOOP-17520) S3A to downgraded to unguarded if the DDB table cannot be found

2021-10-26 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17520?focusedWorklogId=670084=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-670084 ] ASF GitHub Bot logged work on HADOOP-17520: --- Author: ASF GitHub Bot

[GitHub] [hadoop] steveloughran closed pull request #2689: HADOOP-17520. Downgrade missing DDB table to unguarded client

2021-10-26 Thread GitBox
steveloughran closed pull request #2689: URL: https://github.com/apache/hadoop/pull/2689 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [hadoop] steveloughran commented on pull request #2689: HADOOP-17520. Downgrade missing DDB table to unguarded client

2021-10-26 Thread GitBox
steveloughran commented on pull request #2689: URL: https://github.com/apache/hadoop/pull/2689#issuecomment-951965955 closing as we are removing s3guard completely -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the

[GitHub] [hadoop] steveloughran commented on pull request #3582: HADOOP-17977 FileOutputCommitter make PENDING_DIR_NAME configurable

2021-10-26 Thread GitBox
steveloughran commented on pull request #3582: URL: https://github.com/apache/hadoop/pull/3582#issuecomment-951965390 one more thing. Simplest to leave everything under _temporary, but add a switch telling the CleanupStage to not delete that dir, only the job attempt dir and that of any

[jira] [Work logged] (HADOOP-17968) Migrate checkstyle module illegalimport to maven enforcer banned-illegal-imports

2021-10-26 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17968?focusedWorklogId=670080=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-670080 ] ASF GitHub Bot logged work on HADOOP-17968: --- Author: ASF GitHub Bot

[GitHub] [hadoop] tasanuma commented on pull request #3584: HADOOP-17968 Migrate checkstyle module illegalimport to maven enforcer banned-illegal-imports

2021-10-26 Thread GitBox
tasanuma commented on pull request #3584: URL: https://github.com/apache/hadoop/pull/3584#issuecomment-951964138 Since it added `com.google.common.**` to `bannedImport`, you can remove `com.google.common.(collect.Sets|collect.Lists|annotations.VisibleForTesting)` from `bannedImport`.

[GitHub] [hadoop] hadoop-yetus commented on pull request #3586: HDFS-16284: Unboxing long value in old version's block report cause full GC

2021-10-26 Thread GitBox
hadoop-yetus commented on pull request #3586: URL: https://github.com/apache/hadoop/pull/3586#issuecomment-951947440 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[jira] [Work logged] (HADOOP-17928) s3a: set fs.s3a.downgrade.syncable.exceptions = true by default

2021-10-26 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17928?focusedWorklogId=670060=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-670060 ] ASF GitHub Bot logged work on HADOOP-17928: --- Author: ASF GitHub Bot

[GitHub] [hadoop] hadoop-yetus commented on pull request #3585: HADOOP-17928. Syncable: S3A to warn and downgrade

2021-10-26 Thread GitBox
hadoop-yetus commented on pull request #3585: URL: https://github.com/apache/hadoop/pull/3585#issuecomment-951921423 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[GitHub] [hadoop] hadoop-yetus commented on pull request #3587: support listObjectV2

2021-10-26 Thread GitBox
hadoop-yetus commented on pull request #3587: URL: https://github.com/apache/hadoop/pull/3587#issuecomment-951896492 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[jira] [Updated] (HADOOP-17374) AliyunOSS: support ListObjectsV2

2021-10-26 Thread wujinhu (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17374?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wujinhu updated HADOOP-17374: - Labels: pull-request-available (was: ) > AliyunOSS: support ListObjectsV2 >

[GitHub] [hadoop] wujinhu opened a new pull request #3587: support listObjectV2

2021-10-26 Thread GitBox
wujinhu opened a new pull request #3587: URL: https://github.com/apache/hadoop/pull/3587 ### Description of PR OSS supports ListObjectsV2(https://help.aliyun.com/document_detail/187544.html?spm=a2c4g.11186623.6.1589.e0623d9fE1b64S) to optimize versioning bucket list. We should

[GitHub] [hadoop] tomscut commented on pull request #3564: HDFS-16279. Print detail datanode info when process first storage report

2021-10-26 Thread GitBox
tomscut commented on pull request #3564: URL: https://github.com/apache/hadoop/pull/3564#issuecomment-951826311 > @tomscut I think you miss the following line. Please take a look. > >

[GitHub] [hadoop] hadoop-yetus commented on pull request #3581: YARN-10924. Clean up CapacityScheduler#initScheduler

2021-10-26 Thread GitBox
hadoop-yetus commented on pull request #3581: URL: https://github.com/apache/hadoop/pull/3581#issuecomment-951815587 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[jira] [Work logged] (HADOOP-17880) Build 2.10.x with docker

2021-10-26 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17880?focusedWorklogId=670003=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-670003 ] ASF GitHub Bot logged work on HADOOP-17880: --- Author: ASF GitHub Bot

[GitHub] [hadoop] ZhendongBai commented on pull request #3535: HADOOP-17880. Build 2.10.x with docker

2021-10-26 Thread GitBox
ZhendongBai commented on pull request #3535: URL: https://github.com/apache/hadoop/pull/3535#issuecomment-951808880 > @ZhendongBai your PR has failed for asflicense check. This was fixed in trunk. I've created a PR to backport this fix - #3583. Your PR looks good now. Once I merge my PR,

[jira] [Work logged] (HADOOP-17975) Fallback to simple auth does not work for a secondary DistributedFileSystem instance

2021-10-26 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17975?focusedWorklogId=669993=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-669993 ] ASF GitHub Bot logged work on HADOOP-17975: --- Author: ASF GitHub Bot

[GitHub] [hadoop] symious commented on pull request #3579: HADOOP-17975 Fallback to simple auth does not work for a secondary DistributedFileSystem instance.

2021-10-26 Thread GitBox
symious commented on pull request #3579: URL: https://github.com/apache/hadoop/pull/3579#issuecomment-951789112 Seems the issue is caused by the ConnectionPool can't distinguish two different connections? If the value of `fallbackToSimpleAuth` is a field of Client.ConnectionId, will

[jira] [Work logged] (HADOOP-17928) s3a: set fs.s3a.downgrade.syncable.exceptions = true by default

2021-10-26 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17928?focusedWorklogId=669981=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-669981 ] ASF GitHub Bot logged work on HADOOP-17928: --- Author: ASF GitHub Bot

[GitHub] [hadoop] steveloughran commented on pull request #3585: HADOOP-17928. Syncable: S3A to warn and downgrade

2021-10-26 Thread GitBox
steveloughran commented on pull request #3585: URL: https://github.com/apache/hadoop/pull/3585#issuecomment-951764637 + @mukund-thakur @mehakmeet @bogthe @sunchao -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and

[GitHub] [hadoop] steveloughran commented on pull request #3585: HADOOP-17928. Syncable: S3A to warn and downgrade

2021-10-26 Thread GitBox
steveloughran commented on pull request #3585: URL: https://github.com/apache/hadoop/pull/3585#issuecomment-951761021 Test result, all good except for the buffer incomplete issue which happens locally for me ``` [ERROR] Failures: [ERROR]

[jira] [Work logged] (HADOOP-17928) s3a: set fs.s3a.downgrade.syncable.exceptions = true by default

2021-10-26 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17928?focusedWorklogId=669978=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-669978 ] ASF GitHub Bot logged work on HADOOP-17928: --- Author: ASF GitHub Bot

[jira] [Updated] (HADOOP-17374) AliyunOSS: support ListObjectsV2

2021-10-26 Thread wujinhu (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17374?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wujinhu updated HADOOP-17374: - Status: Patch Available (was: In Progress) > AliyunOSS: support ListObjectsV2 >

[jira] [Updated] (HADOOP-17374) AliyunOSS: support ListObjectsV2

2021-10-26 Thread wujinhu (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17374?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wujinhu updated HADOOP-17374: - Status: In Progress (was: Patch Available) > AliyunOSS: support ListObjectsV2 >

[GitHub] [hadoop] ferhui commented on pull request #3564: HDFS-16279. Print detail datanode info when process first storage report

2021-10-26 Thread GitBox
ferhui commented on pull request #3564: URL: https://github.com/apache/hadoop/pull/3564#issuecomment-951619818 @tomscut I think you miss the following line. Please take a look.

[GitHub] [hadoop] ferhui commented on pull request #3574: HDFS-16281. Fix flaky unit tests failed due to timeout

2021-10-26 Thread GitBox
ferhui commented on pull request #3574: URL: https://github.com/apache/hadoop/pull/3574#issuecomment-951616374 @tomscut Thanks for contribution. @ayushtkn Thanks for review! Merged -- This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [hadoop] ferhui merged pull request #3574: HDFS-16281. Fix flaky unit tests failed due to timeout

2021-10-26 Thread GitBox
ferhui merged pull request #3574: URL: https://github.com/apache/hadoop/pull/3574 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [hadoop] hadoop-yetus commented on pull request #3527: HDFS-16262 Async refresh of cached locations in DFSInputStream

2021-10-26 Thread GitBox
hadoop-yetus commented on pull request #3527: URL: https://github.com/apache/hadoop/pull/3527#issuecomment-951607494 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[GitHub] [hadoop] hadoop-yetus commented on pull request #3538: HDFS-16266. Add remote port information to HDFS audit log

2021-10-26 Thread GitBox
hadoop-yetus commented on pull request #3538: URL: https://github.com/apache/hadoop/pull/3538#issuecomment-95165 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[GitHub] [hadoop] Cosss7 opened a new pull request #3586: HDFS-16284: Unboxing long value in old version's block report cause full GC

2021-10-26 Thread GitBox
Cosss7 opened a new pull request #3586: URL: https://github.com/apache/hadoop/pull/3586 jira: https://issues.apache.org/jira/browse/HDFS-16284 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

[jira] [Updated] (HADOOP-17374) AliyunOSS: support ListObjectsV2

2021-10-26 Thread wujinhu (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17374?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wujinhu updated HADOOP-17374: - Attachment: HADOOP-17374.001.patch Status: Patch Available (was: Open) > AliyunOSS: support