[jira] [Work logged] (HADOOP-14451) Deadlock in NativeIO

2022-02-06 Thread ASF GitHub Bot (Jira)


 [ 
https://issues.apache.org/jira/browse/HADOOP-14451?focusedWorklogId=721744=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-721744
 ]

ASF GitHub Bot logged work on HADOOP-14451:
---

Author: ASF GitHub Bot
Created on: 07/Feb/22 05:36
Start Date: 07/Feb/22 05:36
Worklog Time Spent: 10m 
  Work Description: ashutoshcipher closed pull request #3961:
URL: https://github.com/apache/hadoop/pull/3961


   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


Issue Time Tracking
---

Worklog Id: (was: 721744)
Time Spent: 0.5h  (was: 20m)

> Deadlock in NativeIO
> 
>
> Key: HADOOP-14451
> URL: https://issues.apache.org/jira/browse/HADOOP-14451
> Project: Hadoop Common
>  Issue Type: Bug
>Affects Versions: 2.8.0, 3.0.0-alpha1
>Reporter: Ajith S
>Assignee: Vinayakumar B
>Priority: Blocker
>  Labels: pull-request-available
> Attachments: HADOOP-14451-01.patch, HADOOP-14451-02.patch, 
> HADOOP-14451-03.patch, HADOOP-14451-04.patch, Nodemanager.jstack
>
>  Time Spent: 0.5h
>  Remaining Estimate: 0h
>




--
This message was sent by Atlassian Jira
(v8.20.1#820001)

-
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org



[GitHub] [hadoop] ashutoshcipher closed pull request #3961: HADOOP-14451. Deadlock in NativeIO

2022-02-06 Thread GitBox


ashutoshcipher closed pull request #3961:
URL: https://github.com/apache/hadoop/pull/3961


   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org



-
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org



[jira] [Resolved] (HADOOP-18098) Basic verification for the release candidate vote

2022-02-06 Thread Wei-Chiu Chuang (Jira)


 [ 
https://issues.apache.org/jira/browse/HADOOP-18098?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Wei-Chiu Chuang resolved HADOOP-18098.
--
Fix Version/s: 3.4.0
   Resolution: Fixed

Merged into trunk. Thanks [~vjasani]

> Basic verification for the release candidate vote
> -
>
> Key: HADOOP-18098
> URL: https://issues.apache.org/jira/browse/HADOOP-18098
> Project: Hadoop Common
>  Issue Type: Task
>Reporter: Viraj Jasani
>Assignee: Viraj Jasani
>Priority: Major
>  Labels: pull-request-available
> Fix For: 3.4.0
>
>  Time Spent: 2h 20m
>  Remaining Estimate: 0h
>
> We should provide script for the basic sanity of Hadoop release candidates. 
> It should include:
>  * Signature
>  * Checksum
>  * Rat check
>  * Build from src
>  * Build tarball from src
>  
> Although we can include unit test as well, but overall unit test run is going 
> to be significantly higher, and precommit Jenkins builds provide better view 
> of UT sanity.



--
This message was sent by Atlassian Jira
(v8.20.1#820001)

-
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org



[jira] [Work logged] (HADOOP-18098) Basic verification for the release candidate vote

2022-02-06 Thread ASF GitHub Bot (Jira)


 [ 
https://issues.apache.org/jira/browse/HADOOP-18098?focusedWorklogId=721724=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-721724
 ]

ASF GitHub Bot logged work on HADOOP-18098:
---

Author: ASF GitHub Bot
Created on: 07/Feb/22 01:35
Start Date: 07/Feb/22 01:35
Worklog Time Spent: 10m 
  Work Description: jojochuang merged pull request #3944:
URL: https://github.com/apache/hadoop/pull/3944


   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


Issue Time Tracking
---

Worklog Id: (was: 721724)
Time Spent: 2h 20m  (was: 2h 10m)

> Basic verification for the release candidate vote
> -
>
> Key: HADOOP-18098
> URL: https://issues.apache.org/jira/browse/HADOOP-18098
> Project: Hadoop Common
>  Issue Type: Task
>Reporter: Viraj Jasani
>Assignee: Viraj Jasani
>Priority: Major
>  Labels: pull-request-available
>  Time Spent: 2h 20m
>  Remaining Estimate: 0h
>
> We should provide script for the basic sanity of Hadoop release candidates. 
> It should include:
>  * Signature
>  * Checksum
>  * Rat check
>  * Build from src
>  * Build tarball from src
>  
> Although we can include unit test as well, but overall unit test run is going 
> to be significantly higher, and precommit Jenkins builds provide better view 
> of UT sanity.



--
This message was sent by Atlassian Jira
(v8.20.1#820001)

-
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org



[GitHub] [hadoop] jojochuang merged pull request #3944: HADOOP-18098. Basic verification for the release candidate vote

2022-02-06 Thread GitBox


jojochuang merged pull request #3944:
URL: https://github.com/apache/hadoop/pull/3944


   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org



-
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org



[jira] [Work logged] (HADOOP-14451) Deadlock in NativeIO

2022-02-06 Thread ASF GitHub Bot (Jira)


 [ 
https://issues.apache.org/jira/browse/HADOOP-14451?focusedWorklogId=721710=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-721710
 ]

ASF GitHub Bot logged work on HADOOP-14451:
---

Author: ASF GitHub Bot
Created on: 06/Feb/22 23:43
Start Date: 06/Feb/22 23:43
Worklog Time Spent: 10m 
  Work Description: hadoop-yetus commented on pull request #3961:
URL: https://github.com/apache/hadoop/pull/3961#issuecomment-1030942212


   :broken_heart: **-1 overall**
   
   
   
   
   
   
   | Vote | Subsystem | Runtime |  Logfile | Comment |
   |::|--:|:|::|:---:|
   | +0 :ok: |  reexec  |   1m 32s |  |  Docker mode activated.  |
    _ Prechecks _ |
   | +1 :green_heart: |  dupname  |   0m  0s |  |  No case conflicting files 
found.  |
   | +0 :ok: |  codespell  |   0m  1s |  |  codespell was not available.  |
   | +1 :green_heart: |  @author  |   0m  0s |  |  The patch does not contain 
any @author tags.  |
   | +1 :green_heart: |  test4tests  |   0m  0s |  |  The patch appears to 
include 1 new or modified test files.  |
    _ trunk Compile Tests _ |
   | +1 :green_heart: |  mvninstall  |  37m 56s |  |  trunk passed  |
   | +1 :green_heart: |  compile  |  20m 51s |  |  trunk passed  |
   | +1 :green_heart: |  checkstyle  |   1m  3s |  |  trunk passed  |
   | +1 :green_heart: |  mvnsite  |   1m 40s |  |  trunk passed  |
   | +1 :green_heart: |  javadoc  |   1m 44s |  |  trunk passed  |
   | +1 :green_heart: |  spotbugs  |   2m 36s |  |  trunk passed  |
   | +1 :green_heart: |  shadedclient  |  24m 41s |  |  branch has no errors 
when building and testing our client artifacts.  |
    _ Patch Compile Tests _ |
   | +1 :green_heart: |  mvninstall  |   1m  1s |  |  the patch passed  |
   | +1 :green_heart: |  compile  |  20m 26s |  |  the patch passed  |
   | -1 :x: |  cc  |  20m 26s | 
[/results-compile-cc-root.txt](https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-3961/1/artifact/out/results-compile-cc-root.txt)
 |  root generated 24 new + 181 unchanged - 24 fixed = 205 total (was 205)  |
   | +1 :green_heart: |  golang  |  20m 26s |  |  the patch passed  |
   | +1 :green_heart: |  javac  |  20m 26s |  |  the patch passed  |
   | +1 :green_heart: |  blanks  |   0m  0s |  |  The patch has no blanks 
issues.  |
   | +1 :green_heart: |  checkstyle  |   1m  1s |  |  the patch passed  |
   | +1 :green_heart: |  mvnsite  |   1m 36s |  |  the patch passed  |
   | +1 :green_heart: |  javadoc  |   1m 40s |  |  the patch passed  |
   | +1 :green_heart: |  spotbugs  |   2m 42s |  |  the patch passed  |
   | +1 :green_heart: |  shadedclient  |  24m 43s |  |  patch has no errors 
when building and testing our client artifacts.  |
    _ Other Tests _ |
   | -1 :x: |  unit  |  17m 35s | 
[/patch-unit-hadoop-common-project_hadoop-common.txt](https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-3961/1/artifact/out/patch-unit-hadoop-common-project_hadoop-common.txt)
 |  hadoop-common in the patch passed.  |
   | +1 :green_heart: |  asflicense  |   0m 50s |  |  The patch does not 
generate ASF License warnings.  |
   |  |   | 162m 16s |  |  |
   
   
   | Reason | Tests |
   |---:|:--|
   | Failed junit tests | 
hadoop.crypto.TestCryptoStreamsWithOpensslSm4CtrCryptoCodec |
   |   | hadoop.crypto.TestCryptoCodec |
   |   | hadoop.service.launcher.TestServiceInterruptHandling |
   
   
   | Subsystem | Report/Notes |
   |--:|:-|
   | Docker | ClientAPI=1.41 ServerAPI=1.41 base: 
https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-3961/1/artifact/out/Dockerfile
 |
   | GITHUB PR | https://github.com/apache/hadoop/pull/3961 |
   | Optional Tests | dupname asflicense compile javac javadoc mvninstall 
mvnsite unit shadedclient spotbugs checkstyle codespell cc golang |
   | uname | Linux 7456efa2d1da 4.15.0-162-generic #170-Ubuntu SMP Mon Oct 18 
11:38:05 UTC 2021 x86_64 x86_64 x86_64 GNU/Linux |
   | Build tool | maven |
   | Personality | dev-support/bin/hadoop.sh |
   | git revision | trunk / ead4d55e645cc0ff50aefb9e62c995093567bfdb |
   | Default Java | Red Hat, Inc.-1.8.0_322-b06 |
   |  Test Results | 
https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-3961/1/testReport/ |
   | Max. process+thread count | 1251 (vs. ulimit of 5500) |
   | modules | C: hadoop-common-project/hadoop-common U: 
hadoop-common-project/hadoop-common |
   | Console output | 
https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-3961/1/console |
   | versions | git=2.9.5 maven=3.6.3 spotbugs=4.2.2 |
   | Powered by | Apache Yetus 0.14.0-SNAPSHOT https://yetus.apache.org |
   
   
   This message was automatically generated.
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: 

[GitHub] [hadoop] hadoop-yetus commented on pull request #3961: HADOOP-14451. Deadlock in NativeIO

2022-02-06 Thread GitBox


hadoop-yetus commented on pull request #3961:
URL: https://github.com/apache/hadoop/pull/3961#issuecomment-1030942212


   :broken_heart: **-1 overall**
   
   
   
   
   
   
   | Vote | Subsystem | Runtime |  Logfile | Comment |
   |::|--:|:|::|:---:|
   | +0 :ok: |  reexec  |   1m 32s |  |  Docker mode activated.  |
    _ Prechecks _ |
   | +1 :green_heart: |  dupname  |   0m  0s |  |  No case conflicting files 
found.  |
   | +0 :ok: |  codespell  |   0m  1s |  |  codespell was not available.  |
   | +1 :green_heart: |  @author  |   0m  0s |  |  The patch does not contain 
any @author tags.  |
   | +1 :green_heart: |  test4tests  |   0m  0s |  |  The patch appears to 
include 1 new or modified test files.  |
    _ trunk Compile Tests _ |
   | +1 :green_heart: |  mvninstall  |  37m 56s |  |  trunk passed  |
   | +1 :green_heart: |  compile  |  20m 51s |  |  trunk passed  |
   | +1 :green_heart: |  checkstyle  |   1m  3s |  |  trunk passed  |
   | +1 :green_heart: |  mvnsite  |   1m 40s |  |  trunk passed  |
   | +1 :green_heart: |  javadoc  |   1m 44s |  |  trunk passed  |
   | +1 :green_heart: |  spotbugs  |   2m 36s |  |  trunk passed  |
   | +1 :green_heart: |  shadedclient  |  24m 41s |  |  branch has no errors 
when building and testing our client artifacts.  |
    _ Patch Compile Tests _ |
   | +1 :green_heart: |  mvninstall  |   1m  1s |  |  the patch passed  |
   | +1 :green_heart: |  compile  |  20m 26s |  |  the patch passed  |
   | -1 :x: |  cc  |  20m 26s | 
[/results-compile-cc-root.txt](https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-3961/1/artifact/out/results-compile-cc-root.txt)
 |  root generated 24 new + 181 unchanged - 24 fixed = 205 total (was 205)  |
   | +1 :green_heart: |  golang  |  20m 26s |  |  the patch passed  |
   | +1 :green_heart: |  javac  |  20m 26s |  |  the patch passed  |
   | +1 :green_heart: |  blanks  |   0m  0s |  |  The patch has no blanks 
issues.  |
   | +1 :green_heart: |  checkstyle  |   1m  1s |  |  the patch passed  |
   | +1 :green_heart: |  mvnsite  |   1m 36s |  |  the patch passed  |
   | +1 :green_heart: |  javadoc  |   1m 40s |  |  the patch passed  |
   | +1 :green_heart: |  spotbugs  |   2m 42s |  |  the patch passed  |
   | +1 :green_heart: |  shadedclient  |  24m 43s |  |  patch has no errors 
when building and testing our client artifacts.  |
    _ Other Tests _ |
   | -1 :x: |  unit  |  17m 35s | 
[/patch-unit-hadoop-common-project_hadoop-common.txt](https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-3961/1/artifact/out/patch-unit-hadoop-common-project_hadoop-common.txt)
 |  hadoop-common in the patch passed.  |
   | +1 :green_heart: |  asflicense  |   0m 50s |  |  The patch does not 
generate ASF License warnings.  |
   |  |   | 162m 16s |  |  |
   
   
   | Reason | Tests |
   |---:|:--|
   | Failed junit tests | 
hadoop.crypto.TestCryptoStreamsWithOpensslSm4CtrCryptoCodec |
   |   | hadoop.crypto.TestCryptoCodec |
   |   | hadoop.service.launcher.TestServiceInterruptHandling |
   
   
   | Subsystem | Report/Notes |
   |--:|:-|
   | Docker | ClientAPI=1.41 ServerAPI=1.41 base: 
https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-3961/1/artifact/out/Dockerfile
 |
   | GITHUB PR | https://github.com/apache/hadoop/pull/3961 |
   | Optional Tests | dupname asflicense compile javac javadoc mvninstall 
mvnsite unit shadedclient spotbugs checkstyle codespell cc golang |
   | uname | Linux 7456efa2d1da 4.15.0-162-generic #170-Ubuntu SMP Mon Oct 18 
11:38:05 UTC 2021 x86_64 x86_64 x86_64 GNU/Linux |
   | Build tool | maven |
   | Personality | dev-support/bin/hadoop.sh |
   | git revision | trunk / ead4d55e645cc0ff50aefb9e62c995093567bfdb |
   | Default Java | Red Hat, Inc.-1.8.0_322-b06 |
   |  Test Results | 
https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-3961/1/testReport/ |
   | Max. process+thread count | 1251 (vs. ulimit of 5500) |
   | modules | C: hadoop-common-project/hadoop-common U: 
hadoop-common-project/hadoop-common |
   | Console output | 
https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-3961/1/console |
   | versions | git=2.9.5 maven=3.6.3 spotbugs=4.2.2 |
   | Powered by | Apache Yetus 0.14.0-SNAPSHOT https://yetus.apache.org |
   
   
   This message was automatically generated.
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org



-
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org



[jira] [Work logged] (HADOOP-18109) Ensure that default permissions of directories under internal ViewFS directories are the same as directories on target filesystems

2022-02-06 Thread ASF GitHub Bot (Jira)


 [ 
https://issues.apache.org/jira/browse/HADOOP-18109?focusedWorklogId=721696=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-721696
 ]

ASF GitHub Bot logged work on HADOOP-18109:
---

Author: ASF GitHub Bot
Created on: 06/Feb/22 21:55
Start Date: 06/Feb/22 21:55
Worklog Time Spent: 10m 
  Work Description: cheyu2022 commented on a change in pull request #3953:
URL: https://github.com/apache/hadoop/pull/3953#discussion_r800228490



##
File path: 
hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/fs/viewfs/TestViewFileSystemHdfs.java
##
@@ -479,4 +485,22 @@ public Object run() throws IOException {
 assertEquals("The owner did not match ", owner, 
userUgi.getShortUserName());
 otherfs.delete(user1Path, false);
   }
+
+  @Test

Review comment:
   You are right.. Looks like the permissions are inconsistent. With the 
change the default perm we use in `mkdirs` is 777 but 
`fs.getFileStatus(xxx).getPermission()` returns 755 for both internal and real 
dirs (regardless of whether we revert the change or not). I'm not sure why but 
I'll dig into this.




-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


Issue Time Tracking
---

Worklog Id: (was: 721696)
Time Spent: 1h  (was: 50m)

> Ensure that default permissions of directories under internal ViewFS 
> directories are the same as directories on target filesystems
> --
>
> Key: HADOOP-18109
> URL: https://issues.apache.org/jira/browse/HADOOP-18109
> Project: Hadoop Common
>  Issue Type: Bug
>Reporter: Chentao Yu
>Assignee: Chentao Yu
>Priority: Major
>  Labels: pull-request-available
>  Time Spent: 1h
>  Remaining Estimate: 0h
>
> * Ensure that default permissions of directories under internal ViewFS 
> directories are the same as directories on target filesystems
>  * Add new unit test



--
This message was sent by Atlassian Jira
(v8.20.1#820001)

-
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org



[GitHub] [hadoop] cheyu2022 commented on a change in pull request #3953: HADOOP-18109. Ensure that default permissions of directories under internal ViewFS directories are the same as directories on t

2022-02-06 Thread GitBox


cheyu2022 commented on a change in pull request #3953:
URL: https://github.com/apache/hadoop/pull/3953#discussion_r800228490



##
File path: 
hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/fs/viewfs/TestViewFileSystemHdfs.java
##
@@ -479,4 +485,22 @@ public Object run() throws IOException {
 assertEquals("The owner did not match ", owner, 
userUgi.getShortUserName());
 otherfs.delete(user1Path, false);
   }
+
+  @Test

Review comment:
   You are right.. Looks like the permissions are inconsistent. With the 
change the default perm we use in `mkdirs` is 777 but 
`fs.getFileStatus(xxx).getPermission()` returns 755 for both internal and real 
dirs (regardless of whether we revert the change or not). I'm not sure why but 
I'll dig into this.




-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org



-
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org



[jira] [Commented] (HADOOP-14451) Deadlock in NativeIO

2022-02-06 Thread Hadoop QA (Jira)


[ 
https://issues.apache.org/jira/browse/HADOOP-14451?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17487763#comment-17487763
 ] 

Hadoop QA commented on HADOOP-14451:


| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime ||  Logfile || Comment ||
| {color:blue}0{color} | {color:blue} reexec {color} | {color:blue}  0m  
0s{color} | {color:blue}{color} | {color:blue} Docker mode activated. {color} |
| {color:red}-1{color} | {color:red} patch {color} | {color:red}  0m 13s{color} 
| {color:red}{color} | {color:red} HADOOP-14451 does not apply to trunk. Rebase 
required? Wrong Branch? See https://wiki.apache.org/hadoop/HowToContribute for 
help. {color} |
\\
\\
|| Subsystem || Report/Notes ||
| JIRA Issue | HADOOP-14451 |
| JIRA Patch URL | 
https://issues.apache.org/jira/secure/attachment/12910549/HADOOP-14451-04.patch 
|
| Console output | 
https://ci-hadoop.apache.org/job/PreCommit-HADOOP-Build/257/console |
| versions | git=2.17.1 |
| Powered by | Apache Yetus 0.13.0-SNAPSHOT https://yetus.apache.org |


This message was automatically generated.



> Deadlock in NativeIO
> 
>
> Key: HADOOP-14451
> URL: https://issues.apache.org/jira/browse/HADOOP-14451
> Project: Hadoop Common
>  Issue Type: Bug
>Affects Versions: 2.8.0, 3.0.0-alpha1
>Reporter: Ajith S
>Assignee: Vinayakumar B
>Priority: Blocker
>  Labels: pull-request-available
> Attachments: HADOOP-14451-01.patch, HADOOP-14451-02.patch, 
> HADOOP-14451-03.patch, HADOOP-14451-04.patch, Nodemanager.jstack
>
>  Time Spent: 10m
>  Remaining Estimate: 0h
>




--
This message was sent by Atlassian Jira
(v8.20.1#820001)

-
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org



[jira] [Work logged] (HADOOP-18109) Ensure that default permissions of directories under internal ViewFS directories are the same as directories on target filesystems

2022-02-06 Thread ASF GitHub Bot (Jira)


 [ 
https://issues.apache.org/jira/browse/HADOOP-18109?focusedWorklogId=721693=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-721693
 ]

ASF GitHub Bot logged work on HADOOP-18109:
---

Author: ASF GitHub Bot
Created on: 06/Feb/22 20:21
Start Date: 06/Feb/22 20:21
Worklog Time Spent: 10m 
  Work Description: cheyu2022 commented on a change in pull request #3953:
URL: https://github.com/apache/hadoop/pull/3953#discussion_r800228490



##
File path: 
hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/fs/viewfs/TestViewFileSystemHdfs.java
##
@@ -479,4 +485,22 @@ public Object run() throws IOException {
 assertEquals("The owner did not match ", owner, 
userUgi.getShortUserName());
 otherfs.delete(user1Path, false);
   }
+
+  @Test

Review comment:
   You are right.. Looks like the permissions are inconsistent. With the 
change the default perm we use in `mkdirs` is 777 but 
`fs.getFileStatus(xxx).getPermission()` returns 751 for both internal and real 
dirs (regardless of whether we revert the change or not). I'm not sure why but 
I'll dig into this.




-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


Issue Time Tracking
---

Worklog Id: (was: 721693)
Time Spent: 50m  (was: 40m)

> Ensure that default permissions of directories under internal ViewFS 
> directories are the same as directories on target filesystems
> --
>
> Key: HADOOP-18109
> URL: https://issues.apache.org/jira/browse/HADOOP-18109
> Project: Hadoop Common
>  Issue Type: Bug
>Reporter: Chentao Yu
>Assignee: Chentao Yu
>Priority: Major
>  Labels: pull-request-available
>  Time Spent: 50m
>  Remaining Estimate: 0h
>
> * Ensure that default permissions of directories under internal ViewFS 
> directories are the same as directories on target filesystems
>  * Add new unit test



--
This message was sent by Atlassian Jira
(v8.20.1#820001)

-
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org



[GitHub] [hadoop] cheyu2022 commented on a change in pull request #3953: HADOOP-18109. Ensure that default permissions of directories under internal ViewFS directories are the same as directories on t

2022-02-06 Thread GitBox


cheyu2022 commented on a change in pull request #3953:
URL: https://github.com/apache/hadoop/pull/3953#discussion_r800228490



##
File path: 
hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/fs/viewfs/TestViewFileSystemHdfs.java
##
@@ -479,4 +485,22 @@ public Object run() throws IOException {
 assertEquals("The owner did not match ", owner, 
userUgi.getShortUserName());
 otherfs.delete(user1Path, false);
   }
+
+  @Test

Review comment:
   You are right.. Looks like the permissions are inconsistent. With the 
change the default perm we use in `mkdirs` is 777 but 
`fs.getFileStatus(xxx).getPermission()` returns 751 for both internal and real 
dirs (regardless of whether we revert the change or not). I'm not sure why but 
I'll dig into this.




-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org



-
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org



[jira] [Updated] (HADOOP-14451) Deadlock in NativeIO

2022-02-06 Thread ASF GitHub Bot (Jira)


 [ 
https://issues.apache.org/jira/browse/HADOOP-14451?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

ASF GitHub Bot updated HADOOP-14451:

Labels: pull-request-available  (was: )

> Deadlock in NativeIO
> 
>
> Key: HADOOP-14451
> URL: https://issues.apache.org/jira/browse/HADOOP-14451
> Project: Hadoop Common
>  Issue Type: Bug
>Affects Versions: 2.8.0, 3.0.0-alpha1
>Reporter: Ajith S
>Assignee: Vinayakumar B
>Priority: Blocker
>  Labels: pull-request-available
> Attachments: HADOOP-14451-01.patch, HADOOP-14451-02.patch, 
> HADOOP-14451-03.patch, HADOOP-14451-04.patch, Nodemanager.jstack
>
>  Time Spent: 10m
>  Remaining Estimate: 0h
>




--
This message was sent by Atlassian Jira
(v8.20.1#820001)

-
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org



[jira] [Work logged] (HADOOP-14451) Deadlock in NativeIO

2022-02-06 Thread ASF GitHub Bot (Jira)


 [ 
https://issues.apache.org/jira/browse/HADOOP-14451?focusedWorklogId=721655=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-721655
 ]

ASF GitHub Bot logged work on HADOOP-14451:
---

Author: ASF GitHub Bot
Created on: 06/Feb/22 15:38
Start Date: 06/Feb/22 15:38
Worklog Time Spent: 10m 
  Work Description: ashutoshcipher opened a new pull request #3961:
URL: https://github.com/apache/hadoop/pull/3961


   ### Description of PR
   Deadlock in NativeIO
   
   * JIRA: HADOOP-14451


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


Issue Time Tracking
---

Worklog Id: (was: 721655)
Remaining Estimate: 0h
Time Spent: 10m

> Deadlock in NativeIO
> 
>
> Key: HADOOP-14451
> URL: https://issues.apache.org/jira/browse/HADOOP-14451
> Project: Hadoop Common
>  Issue Type: Bug
>Affects Versions: 2.8.0, 3.0.0-alpha1
>Reporter: Ajith S
>Assignee: Vinayakumar B
>Priority: Blocker
> Attachments: HADOOP-14451-01.patch, HADOOP-14451-02.patch, 
> HADOOP-14451-03.patch, HADOOP-14451-04.patch, Nodemanager.jstack
>
>  Time Spent: 10m
>  Remaining Estimate: 0h
>




--
This message was sent by Atlassian Jira
(v8.20.1#820001)

-
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org



[GitHub] [hadoop] ashutoshcipher opened a new pull request #3961: HADOOP-14451. Deadlock in NativeIO

2022-02-06 Thread GitBox


ashutoshcipher opened a new pull request #3961:
URL: https://github.com/apache/hadoop/pull/3961


   ### Description of PR
   Deadlock in NativeIO
   
   * JIRA: HADOOP-14451


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org



-
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org