[GitHub] [hadoop] hadoop-yetus commented on pull request #2183: MAPREDUCE-7288. Fix TestLongLong#testRightShift

2020-08-02 Thread GitBox


hadoop-yetus commented on pull request #2183:
URL: https://github.com/apache/hadoop/pull/2183#issuecomment-667818947


   :confetti_ball: **+1 overall**
   
   
   
   
   
   
   | Vote | Subsystem | Runtime | Comment |
   |::|--:|:|:|
   | +0 :ok: |  reexec  |   1m  6s |  Docker mode activated.  |
   ||| _ Prechecks _ |
   | +1 :green_heart: |  dupname  |   0m  0s |  No case conflicting files 
found.  |
   | +1 :green_heart: |  @author  |   0m  0s |  The patch does not contain any 
@author tags.  |
   | +1 :green_heart: |  test4tests  |   0m  0s |  The patch appears to include 
1 new or modified test files.  |
   ||| _ trunk Compile Tests _ |
   | +1 :green_heart: |  mvninstall  |  19m 15s |  trunk passed  |
   | +1 :green_heart: |  compile  |   0m 28s |  trunk passed with JDK 
Ubuntu-11.0.8+10-post-Ubuntu-0ubuntu118.04.1  |
   | +1 :green_heart: |  compile  |   0m 27s |  trunk passed with JDK Private 
Build-1.8.0_252-8u252-b09-1~18.04-b09  |
   | +1 :green_heart: |  checkstyle  |   0m 22s |  trunk passed  |
   | +1 :green_heart: |  mvnsite  |   0m 29s |  trunk passed  |
   | +1 :green_heart: |  shadedclient  |  14m 36s |  branch has no errors when 
building and testing our client artifacts.  |
   | +1 :green_heart: |  javadoc  |   0m 28s |  trunk passed with JDK 
Ubuntu-11.0.8+10-post-Ubuntu-0ubuntu118.04.1  |
   | +1 :green_heart: |  javadoc  |   0m 26s |  trunk passed with JDK Private 
Build-1.8.0_252-8u252-b09-1~18.04-b09  |
   | +0 :ok: |  spotbugs  |   0m 45s |  Used deprecated FindBugs config; 
considering switching to SpotBugs.  |
   | +1 :green_heart: |  findbugs  |   0m 42s |  trunk passed  |
   ||| _ Patch Compile Tests _ |
   | +1 :green_heart: |  mvninstall  |   0m 25s |  the patch passed  |
   | +1 :green_heart: |  compile  |   0m 20s |  the patch passed with JDK 
Ubuntu-11.0.8+10-post-Ubuntu-0ubuntu118.04.1  |
   | +1 :green_heart: |  javac  |   0m 20s |  the patch passed  |
   | +1 :green_heart: |  compile  |   0m 20s |  the patch passed with JDK 
Private Build-1.8.0_252-8u252-b09-1~18.04-b09  |
   | +1 :green_heart: |  javac  |   0m 20s |  the patch passed  |
   | +1 :green_heart: |  checkstyle  |   0m 15s |  the patch passed  |
   | +1 :green_heart: |  mvnsite  |   0m 21s |  the patch passed  |
   | +1 :green_heart: |  whitespace  |   0m  0s |  The patch has no whitespace 
issues.  |
   | +1 :green_heart: |  shadedclient  |  13m 48s |  patch has no errors when 
building and testing our client artifacts.  |
   | +1 :green_heart: |  javadoc  |   0m 23s |  the patch passed with JDK 
Ubuntu-11.0.8+10-post-Ubuntu-0ubuntu118.04.1  |
   | +1 :green_heart: |  javadoc  |   0m 22s |  the patch passed with JDK 
Private Build-1.8.0_252-8u252-b09-1~18.04-b09  |
   | +1 :green_heart: |  findbugs  |   0m 47s |  the patch passed  |
   ||| _ Other Tests _ |
   | +1 :green_heart: |  unit  |   0m 41s |  hadoop-mapreduce-examples in the 
patch passed.  |
   | +1 :green_heart: |  asflicense  |   0m 31s |  The patch does not generate 
ASF License warnings.  |
   |  |   |  58m 50s |   |
   
   
   | Subsystem | Report/Notes |
   |--:|:-|
   | Docker | ClientAPI=1.40 ServerAPI=1.40 base: 
https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-2183/1/artifact/out/Dockerfile
 |
   | GITHUB PR | https://github.com/apache/hadoop/pull/2183 |
   | Optional Tests | dupname asflicense compile javac javadoc mvninstall 
mvnsite unit shadedclient findbugs checkstyle |
   | uname | Linux 9b4ca3cdc6ae 4.15.0-60-generic #67-Ubuntu SMP Thu Aug 22 
16:55:30 UTC 2019 x86_64 x86_64 x86_64 GNU/Linux |
   | Build tool | maven |
   | Personality | personality/hadoop.sh |
   | git revision | trunk / c40cbc57fa2 |
   | Default Java | Private Build-1.8.0_252-8u252-b09-1~18.04-b09 |
   | Multi-JDK versions | 
/usr/lib/jvm/java-11-openjdk-amd64:Ubuntu-11.0.8+10-post-Ubuntu-0ubuntu118.04.1 
/usr/lib/jvm/java-8-openjdk-amd64:Private Build-1.8.0_252-8u252-b09-1~18.04-b09 
|
   |  Test Results | 
https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-2183/1/testReport/ |
   | Max. process+thread count | 420 (vs. ulimit of 5500) |
   | modules | C: hadoop-mapreduce-project/hadoop-mapreduce-examples U: 
hadoop-mapreduce-project/hadoop-mapreduce-examples |
   | Console output | 
https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-2183/1/console |
   | versions | git=2.17.1 maven=3.6.0 findbugs=4.0.6 |
   | Powered by | Apache Yetus 0.13.0-SNAPSHOT https://yetus.apache.org |
   
   
   This message was automatically generated.
   
   



This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org



-
To unsubscribe, e-mail: 

[jira] [Commented] (HADOOP-17178) [JDK 13] Javadoc HTML5 support

2020-08-02 Thread Akira Ajisaka (Jira)


[ 
https://issues.apache.org/jira/browse/HADOOP-17178?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17169723#comment-17169723
 ] 

Akira Ajisaka commented on HADOOP-17178:


Feel free to file a subtask for each module.

> [JDK 13] Javadoc HTML5 support
> --
>
> Key: HADOOP-17178
> URL: https://issues.apache.org/jira/browse/HADOOP-17178
> Project: Hadoop Common
>  Issue Type: Improvement
>  Components: build, documentation
> Environment: Java 13 and upper
>Reporter: Akira Ajisaka
>Priority: Major
>
> javadoc -html4 option has been removed since JDK 13. We need to remove the 
> option and fix the errors.
> https://bugs.openjdk.java.net/browse/JDK-8215578



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

-
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org



[jira] [Created] (HADOOP-17178) [JDK 13] Javadoc HTML5 support

2020-08-02 Thread Akira Ajisaka (Jira)
Akira Ajisaka created HADOOP-17178:
--

 Summary: [JDK 13] Javadoc HTML5 support
 Key: HADOOP-17178
 URL: https://issues.apache.org/jira/browse/HADOOP-17178
 Project: Hadoop Common
  Issue Type: Improvement
  Components: build, documentation
 Environment: Java 13 and upper
Reporter: Akira Ajisaka


javadoc -html4 option has been removed since JDK 13. We need to remove the 
option and fix the errors.
https://bugs.openjdk.java.net/browse/JDK-8215578




--
This message was sent by Atlassian Jira
(v8.3.4#803005)

-
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org



[jira] [Updated] (HADOOP-17177) Java upstream support

2020-08-02 Thread Akira Ajisaka (Jira)


 [ 
https://issues.apache.org/jira/browse/HADOOP-17177?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Akira Ajisaka updated HADOOP-17177:
---
Description: 
Umbrella JIRA to support the latest Java version.

Latest Java version:
* 14: From March 2020 to September 2020
* 15: From September 2020 to March 2021
* 16: From March 2021 to September 2021
* 17: From September 2021

  was:
Umbrella JIRA to support the latest Java version.
Now the latest version is 14.


> Java upstream support
> -
>
> Key: HADOOP-17177
> URL: https://issues.apache.org/jira/browse/HADOOP-17177
> Project: Hadoop Common
>  Issue Type: Improvement
>  Components: build
>Reporter: Akira Ajisaka
>Priority: Major
>
> Umbrella JIRA to support the latest Java version.
> Latest Java version:
> * 14: From March 2020 to September 2020
> * 15: From September 2020 to March 2021
> * 16: From March 2021 to September 2021
> * 17: From September 2021



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

-
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org



[jira] [Commented] (HADOOP-16795) Java 11 compile support

2020-08-02 Thread Akira Ajisaka (Jira)


[ 
https://issues.apache.org/jira/browse/HADOOP-16795?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17169715#comment-17169715
 ] 

Akira Ajisaka commented on HADOOP-16795:


Filed HADOOP-17177 to support the latest Java version. If there are some issues 
in JDK12+, use this JIRA.

> Java 11 compile support
> ---
>
> Key: HADOOP-16795
> URL: https://issues.apache.org/jira/browse/HADOOP-16795
> Project: Hadoop Common
>  Issue Type: Improvement
>  Components: build
>Reporter: Akira Ajisaka
>Priority: Major
>
> Split from HADOOP-15338.
> Now Hadoop must be compiled with Java 8. This issue is to support compiling 
> Hadoop with Java 11.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

-
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org



[jira] [Created] (HADOOP-17177) Java upstream support

2020-08-02 Thread Akira Ajisaka (Jira)
Akira Ajisaka created HADOOP-17177:
--

 Summary: Java upstream support
 Key: HADOOP-17177
 URL: https://issues.apache.org/jira/browse/HADOOP-17177
 Project: Hadoop Common
  Issue Type: Improvement
  Components: build
Reporter: Akira Ajisaka


Umbrella JIRA to support the latest Java version.
Now the latest version is 14.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

-
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org



[jira] [Created] (HADOOP-17176) [JDK 11] Fix javadoc errors in hadoop-hdfs-rbf module

2020-08-02 Thread Akira Ajisaka (Jira)
Akira Ajisaka created HADOOP-17176:
--

 Summary: [JDK 11] Fix javadoc errors in hadoop-hdfs-rbf module
 Key: HADOOP-17176
 URL: https://issues.apache.org/jira/browse/HADOOP-17176
 Project: Hadoop Common
  Issue Type: Bug
  Components: documentation
Reporter: Akira Ajisaka


{noformat}
[ERROR] 
/Users/aajisaka/git/hadoop/hadoop-hdfs-project/hadoop-hdfs-rbf/src/main/java/org/apache/hadoop/hdfs/server/federation/router/security/token/package-info.java:21:
 error: reference not found
[ERROR]  * Implementations should extend {@link 
AbstractDelegationTokenSecretManager}.
[ERROR] ^
{noformat}
Full error log: 
https://gist.github.com/aajisaka/a7dde76a4ba2942f60bf6230ec9ed6e1

How to reproduce the failure:
* Remove {{true}} from pom.xml
* Run {{mvn process-sources javadoc:javadoc-no-fork}}



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

-
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org



[jira] [Commented] (HADOOP-15891) Provide Regex Based Mount Point In Inode Tree

2020-08-02 Thread zhenzhao wang (Jira)


[ 
https://issues.apache.org/jira/browse/HADOOP-15891?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17169709#comment-17169709
 ] 

zhenzhao wang commented on HADOOP-15891:


Updated pull request as the old one was close and I have no perm to reopen it. 

> Provide Regex Based Mount Point In Inode Tree
> -
>
> Key: HADOOP-15891
> URL: https://issues.apache.org/jira/browse/HADOOP-15891
> Project: Hadoop Common
>  Issue Type: New Feature
>  Components: fs
>Reporter: zhenzhao wang
>Assignee: zhenzhao wang
>Priority: Major
> Attachments: HADOOP-15891.015.patch, HDFS-13948.001.patch, 
> HDFS-13948.002.patch, HDFS-13948.003.patch, HDFS-13948.004.patch, 
> HDFS-13948.005.patch, HDFS-13948.006.patch, HDFS-13948.007.patch, 
> HDFS-13948.008.patch, HDFS-13948.009.patch, HDFS-13948.011.patch, 
> HDFS-13948.012.patch, HDFS-13948.013.patch, HDFS-13948.014.patch, HDFS-13948_ 
> Regex Link Type In Mont Table-V0.pdf, HDFS-13948_ Regex Link Type In Mount 
> Table-v1.pdf
>
>
> This jira is created to support regex based mount point in Inode Tree. We 
> noticed that mount point only support fixed target path. However, we might 
> have user cases when target needs to refer some fields from source. e.g. We 
> might want a mapping of /cluster1/user1 => /cluster1-dc1/user-nn-user1, we 
> want to refer `cluster` and `user` field in source to construct target. It's 
> impossible to archive this with current link type. Though we could set 
> one-to-one mapping, the mount table would become bloated if we have thousands 
> of users. Besides, a regex mapping would empower us more flexibility. So we 
> are going to build a regex based mount point which target could refer groups 
> from src regex mapping. 



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

-
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org



[GitHub] [hadoop] JohnZZGithub opened a new pull request #2185: HADOOP-15891. provide Regex Based Mount Point In Inode Tree

2020-08-02 Thread GitBox


JohnZZGithub opened a new pull request #2185:
URL: https://github.com/apache/hadoop/pull/2185


   Differential Revision: https://phabricator.twitter.biz/D526212
   
   ## NOTICE
   
   Please create an issue in ASF JIRA before opening a pull request,
   and you need to set the title of the pull request which starts with
   the corresponding JIRA issue number. (e.g. HADOOP-X. Fix a typo in YYY.)
   For more details, please see 
https://cwiki.apache.org/confluence/display/HADOOP/How+To+Contribute
   



This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org



-
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org



[GitHub] [hadoop] JohnZZGithub closed pull request #2184: HDFS-13948. Provide Regex Based Mount Point In Inode Tree

2020-08-02 Thread GitBox


JohnZZGithub closed pull request #2184:
URL: https://github.com/apache/hadoop/pull/2184


   



This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org



-
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org



[jira] [Commented] (HADOOP-15891) Provide Regex Based Mount Point In Inode Tree

2020-08-02 Thread Hadoop QA (Jira)


[ 
https://issues.apache.org/jira/browse/HADOOP-15891?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17169705#comment-17169705
 ] 

Hadoop QA commented on HADOOP-15891:


| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
| {color:blue}0{color} | {color:blue} reexec {color} | {color:blue}  0m  
0s{color} | {color:blue} Docker mode activated. {color} |
| {color:red}-1{color} | {color:red} patch {color} | {color:red}  0m 15s{color} 
| {color:red} HADOOP-15891 does not apply to trunk. Rebase required? Wrong 
Branch? See https://wiki.apache.org/hadoop/HowToContribute for help. {color} |
\\
\\
|| Subsystem || Report/Notes ||
| JIRA Issue | HADOOP-15891 |
| JIRA Patch URL | 
https://issues.apache.org/jira/secure/attachment/12952430/HADOOP-15891.015.patch
 |
| Console output | 
https://ci-hadoop.apache.org/job/PreCommit-HADOOP-Build/12/console |
| versions | git=2.17.1 |
| Powered by | Apache Yetus 0.12.0 https://yetus.apache.org |


This message was automatically generated.



> Provide Regex Based Mount Point In Inode Tree
> -
>
> Key: HADOOP-15891
> URL: https://issues.apache.org/jira/browse/HADOOP-15891
> Project: Hadoop Common
>  Issue Type: New Feature
>  Components: fs
>Reporter: zhenzhao wang
>Assignee: zhenzhao wang
>Priority: Major
> Attachments: HADOOP-15891.015.patch, HDFS-13948.001.patch, 
> HDFS-13948.002.patch, HDFS-13948.003.patch, HDFS-13948.004.patch, 
> HDFS-13948.005.patch, HDFS-13948.006.patch, HDFS-13948.007.patch, 
> HDFS-13948.008.patch, HDFS-13948.009.patch, HDFS-13948.011.patch, 
> HDFS-13948.012.patch, HDFS-13948.013.patch, HDFS-13948.014.patch, HDFS-13948_ 
> Regex Link Type In Mont Table-V0.pdf, HDFS-13948_ Regex Link Type In Mount 
> Table-v1.pdf
>
>
> This jira is created to support regex based mount point in Inode Tree. We 
> noticed that mount point only support fixed target path. However, we might 
> have user cases when target needs to refer some fields from source. e.g. We 
> might want a mapping of /cluster1/user1 => /cluster1-dc1/user-nn-user1, we 
> want to refer `cluster` and `user` field in source to construct target. It's 
> impossible to archive this with current link type. Though we could set 
> one-to-one mapping, the mount table would become bloated if we have thousands 
> of users. Besides, a regex mapping would empower us more flexibility. So we 
> are going to build a regex based mount point which target could refer groups 
> from src regex mapping. 



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

-
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org



[GitHub] [hadoop] JohnZZGithub opened a new pull request #2184: HDFS-13948. Provide Regex Based Mount Point In Inode Tree

2020-08-02 Thread GitBox


JohnZZGithub opened a new pull request #2184:
URL: https://github.com/apache/hadoop/pull/2184


   ## NOTICE
   
   Please create an issue in ASF JIRA before opening a pull request,
   and you need to set the title of the pull request which starts with
   the corresponding JIRA issue number. (e.g. HADOOP-X. Fix a typo in YYY.)
   For more details, please see 
https://cwiki.apache.org/confluence/display/HADOOP/How+To+Contribute
   



This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org



-
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org



[jira] [Updated] (HADOOP-17175) [JDK11] Fix javadoc errors in hadoop-common module

2020-08-02 Thread Akira Ajisaka (Jira)


 [ 
https://issues.apache.org/jira/browse/HADOOP-17175?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Akira Ajisaka updated HADOOP-17175:
---
Description: 
Full error log: 
https://gist.github.com/aajisaka/5504dd485cc4bc98a6a245830d450919

{noformat}
[ERROR] 
/Users/aajisaka/git/hadoop/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/security/ssl/DelegatingSSLSocketFactory.java:57:
 error: unexpected end tag: 
[ERROR]  * 
[ERROR]^
[ERROR] 
/Users/aajisaka/git/hadoop/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/ipc/WeightedTimeCostProvider.java:33:
 error: self-closing element not allowed
[ERROR]  * This allows for configuration of how heavily each of the 
operations
[ERROR]^
...
{noformat}

How to reproduce the failure:
* Remove {{true}} from pom.xml
* Run {{mvn process-sources javadoc:javadoc-no-fork}}

  was:
Error log: https://gist.github.com/aajisaka/5504dd485cc4bc98a6a245830d450919

{noformat}
[ERROR] 
/Users/aajisaka/git/hadoop/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/security/ssl/DelegatingSSLSocketFactory.java:57:
 error: unexpected end tag: 
[ERROR]  * 
[ERROR]^
[ERROR] 
/Users/aajisaka/git/hadoop/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/ipc/WeightedTimeCostProvider.java:33:
 error: self-closing element not allowed
[ERROR]  * This allows for configuration of how heavily each of the 
operations
[ERROR]^
...
{noformat}

How to reproduce the failure:
* Remove {{true}} from pom.xml
* Run {{mvn process-sources javadoc:javadoc-no-fork}}


> [JDK11] Fix javadoc errors in hadoop-common module
> --
>
> Key: HADOOP-17175
> URL: https://issues.apache.org/jira/browse/HADOOP-17175
> Project: Hadoop Common
>  Issue Type: Sub-task
>  Components: documentation
>Reporter: Akira Ajisaka
>Priority: Major
>
> Full error log: 
> https://gist.github.com/aajisaka/5504dd485cc4bc98a6a245830d450919
> {noformat}
> [ERROR] 
> /Users/aajisaka/git/hadoop/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/security/ssl/DelegatingSSLSocketFactory.java:57:
>  error: unexpected end tag: 
> [ERROR]  * 
> [ERROR]^
> [ERROR] 
> /Users/aajisaka/git/hadoop/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/ipc/WeightedTimeCostProvider.java:33:
>  error: self-closing element not allowed
> [ERROR]  * This allows for configuration of how heavily each of the 
> operations
> [ERROR]^
> ...
> {noformat}
> How to reproduce the failure:
> * Remove {{true}} from pom.xml
> * Run {{mvn process-sources javadoc:javadoc-no-fork}}



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

-
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org



[jira] [Updated] (HADOOP-17175) [JDK11] Fix javadoc errors in hadoop-common module

2020-08-02 Thread Akira Ajisaka (Jira)


 [ 
https://issues.apache.org/jira/browse/HADOOP-17175?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Akira Ajisaka updated HADOOP-17175:
---
Summary: [JDK11] Fix javadoc errors in hadoop-common module  (was: Fix 
javadoc errors in hadoop-common module)

> [JDK11] Fix javadoc errors in hadoop-common module
> --
>
> Key: HADOOP-17175
> URL: https://issues.apache.org/jira/browse/HADOOP-17175
> Project: Hadoop Common
>  Issue Type: Sub-task
>  Components: documentation
>Reporter: Akira Ajisaka
>Priority: Major
>
> Error log: https://gist.github.com/aajisaka/5504dd485cc4bc98a6a245830d450919
> {noformat}
> [ERROR] 
> /Users/aajisaka/git/hadoop/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/security/ssl/DelegatingSSLSocketFactory.java:57:
>  error: unexpected end tag: 
> [ERROR]  * 
> [ERROR]^
> [ERROR] 
> /Users/aajisaka/git/hadoop/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/ipc/WeightedTimeCostProvider.java:33:
>  error: self-closing element not allowed
> [ERROR]  * This allows for configuration of how heavily each of the 
> operations
> [ERROR]^
> ...
> {noformat}
> How to reproduce the failure:
> * Remove {{true}} from pom.xml
> * Run {{mvn process-sources javadoc:javadoc-no-fork}}



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

-
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org



[jira] [Created] (HADOOP-17175) Fix javadoc errors in hadoop-common module

2020-08-02 Thread Akira Ajisaka (Jira)
Akira Ajisaka created HADOOP-17175:
--

 Summary: Fix javadoc errors in hadoop-common module
 Key: HADOOP-17175
 URL: https://issues.apache.org/jira/browse/HADOOP-17175
 Project: Hadoop Common
  Issue Type: Sub-task
  Components: documentation
Reporter: Akira Ajisaka


Error log: https://gist.github.com/aajisaka/5504dd485cc4bc98a6a245830d450919

{noformat}
[ERROR] 
/Users/aajisaka/git/hadoop/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/security/ssl/DelegatingSSLSocketFactory.java:57:
 error: unexpected end tag: 
[ERROR]  * 
[ERROR]^
[ERROR] 
/Users/aajisaka/git/hadoop/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/ipc/WeightedTimeCostProvider.java:33:
 error: self-closing element not allowed
[ERROR]  * This allows for configuration of how heavily each of the 
operations
[ERROR]^
...
{noformat}

How to reproduce the failure:
* Remove {{true}} from pom.xml
* Run {{mvn process-sources javadoc:javadoc-no-fork}}



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

-
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org



[jira] [Commented] (HADOOP-17091) [JDK11] Fix Javadoc errors

2020-08-02 Thread Hudson (Jira)


[ 
https://issues.apache.org/jira/browse/HADOOP-17091?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17169671#comment-17169671
 ] 

Hudson commented on HADOOP-17091:
-

SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #18488 (See 
[https://builds.apache.org/job/Hadoop-trunk-Commit/18488/])
HADOOP-17091. [JDK11] Fix Javadoc errors (#2098) (github: rev 
c40cbc57fa20d385a971a4b07af13fa28d5908c9)
* (edit) hadoop-project/pom.xml
* (edit) hadoop-common-project/hadoop-common/pom.xml
* (edit) hadoop-hdfs-project/hadoop-hdfs-rbf/pom.xml
* (edit) hadoop-hdfs-project/hadoop-hdfs-client/pom.xml
* (edit) Jenkinsfile
* (edit) hadoop-hdfs-project/hadoop-hdfs/pom.xml
* (edit) hadoop-tools/hadoop-aws/pom.xml


> [JDK11] Fix Javadoc errors
> --
>
> Key: HADOOP-17091
> URL: https://issues.apache.org/jira/browse/HADOOP-17091
> Project: Hadoop Common
>  Issue Type: Sub-task
>  Components: build
> Environment: Java 11
>Reporter: Uma Maheswara Rao G
>Assignee: Akira Ajisaka
>Priority: Major
> Fix For: 3.4.0
>
>
> {noformat}
> [INFO] 
> 
> [INFO] BUILD FAILURE
> [INFO] 
> 
> [INFO] Total time:  17.982 s
> [INFO] Finished at: 2020-06-20T01:56:28Z
> [INFO] 
> 
> [ERROR] Failed to execute goal 
> org.apache.maven.plugins:maven-javadoc-plugin:3.0.1:javadoc (default-cli) on 
> project hadoop-hdfs: An error has occurred in Javadoc report generation: 
> [ERROR] Exit code: 1 - javadoc: warning - You have specified the HTML version 
> as HTML 4.01 by using the -html4 option.
> [ERROR] The default is currently HTML5 and the support for HTML 4.01 will be 
> removed
> [ERROR] in a future release. To suppress this warning, please ensure that any 
> HTML constructs
> [ERROR] in your comments are valid in HTML5, and remove the -html4 option.
> [ERROR] 
> /home/jenkins/jenkins-slave/workspace/hadoop-multibranch_PR-2084/src/hadoop-hdfs-project/hadoop-hdfs/target/generated-sources/java/org/apache/hadoop/hdfs/server/namenode/FsImageProto.java:25197:
>  error: cannot find symbol
> [ERROR]   com.google.protobuf.GeneratedMessageV3 implements
> [ERROR]  ^
> [ERROR]   symbol:   class GeneratedMessageV3
> [ERROR]   location: package com.google.protobuf
> [ERROR] 
> /home/jenkins/jenkins-slave/workspace/hadoop-multibranch_PR-2084/src/hadoop-hdfs-project/hadoop-hdfs/target/generated-sources/java/org/apache/hadoop/hdfs/server/namenode/FsImageProto.java:25319:
>  error: cannot find symbol
> [ERROR] com.google.protobuf.GeneratedMessageV3 implements
> [ERROR]^
> [ERROR]   symbol:   class GeneratedMessageV3
> [ERROR]   location: package com.google.protobuf
> [ERROR] 
> /home/jenkins/jenkins-slave/workspace/hadoop-multibranch_PR-2084/src/hadoop-hdfs-project/hadoop-hdfs/target/generated-sources/java/org/apache/hadoop/hdfs/server/namenode/FsImageProto.java:26068:
>  error: cannot find symbol
> [ERROR] com.google.protobuf.GeneratedMessageV3 implements
> [ERROR]^
> [ERROR]   symbol:   class GeneratedMessageV3
> [ERROR]   location: package com.google.protobuf
> [ERROR] 
> /home/jenkins/jenkins-slave/workspace/hadoop-multibranch_PR-2084/src/hadoop-hdfs-project/hadoop-hdfs/target/generated-sources/java/org/apache/hadoop/hdfs/server/namenode/FsImageProto.java:26073:
>  error: package com.google.protobuf.GeneratedMessageV3 does not exist
> [ERROR]   private 
> PersistToken(com.google.protobuf.GeneratedMessageV3.Builder builder) {
> {noformat}



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

-
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org



[jira] [Commented] (HADOOP-16862) [JDK11] Support JavaDoc

2020-08-02 Thread Akira Ajisaka (Jira)


[ 
https://issues.apache.org/jira/browse/HADOOP-16862?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17169668#comment-17169668
 ] 

Akira Ajisaka commented on HADOOP-16862:


Note that we have to run javadoc with {{mvn process-sources 
javadoc:javadoc-no-fork}} in JDK11. Please see HADOOP-17091 for the details.

> [JDK11] Support JavaDoc
> ---
>
> Key: HADOOP-16862
> URL: https://issues.apache.org/jira/browse/HADOOP-16862
> Project: Hadoop Common
>  Issue Type: Sub-task
>Reporter: Akira Ajisaka
>Assignee: Akira Ajisaka
>Priority: Major
>
> This issue is to run {{mvn javadoc:javadoc}} successfully in Apache Hadoop 
> with Java 11.
> Now there are many errors.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

-
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org



[jira] [Resolved] (HADOOP-16862) [JDK11] Support JavaDoc

2020-08-02 Thread Akira Ajisaka (Jira)


 [ 
https://issues.apache.org/jira/browse/HADOOP-16862?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Akira Ajisaka resolved HADOOP-16862.

Resolution: Duplicate

Closing this as duplicate.

> [JDK11] Support JavaDoc
> ---
>
> Key: HADOOP-16862
> URL: https://issues.apache.org/jira/browse/HADOOP-16862
> Project: Hadoop Common
>  Issue Type: Sub-task
>Reporter: Akira Ajisaka
>Assignee: Akira Ajisaka
>Priority: Major
>
> This issue is to run {{mvn javadoc:javadoc}} successfully in Apache Hadoop 
> with Java 11.
> Now there are many errors.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

-
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org



[jira] [Resolved] (HADOOP-17091) [JDK11] Fix Javadoc errors

2020-08-02 Thread Akira Ajisaka (Jira)


 [ 
https://issues.apache.org/jira/browse/HADOOP-17091?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Akira Ajisaka resolved HADOOP-17091.

Fix Version/s: 3.4.0
 Release Note: 

* Upgraded to Yetus master to change javadoc goals.
* Changed javadoc goals from `javadoc:javadoc` to `process-sources 
javadoc:javadoc-no-fork`.
* Javadoc with JDK11 fails in some modules. Ignored them for now and we will 
fix them later.
   Resolution: Fixed

Merged the PR into trunk.

> [JDK11] Fix Javadoc errors
> --
>
> Key: HADOOP-17091
> URL: https://issues.apache.org/jira/browse/HADOOP-17091
> Project: Hadoop Common
>  Issue Type: Sub-task
>  Components: build
> Environment: Java 11
>Reporter: Uma Maheswara Rao G
>Assignee: Akira Ajisaka
>Priority: Major
> Fix For: 3.4.0
>
>
> {noformat}
> [INFO] 
> 
> [INFO] BUILD FAILURE
> [INFO] 
> 
> [INFO] Total time:  17.982 s
> [INFO] Finished at: 2020-06-20T01:56:28Z
> [INFO] 
> 
> [ERROR] Failed to execute goal 
> org.apache.maven.plugins:maven-javadoc-plugin:3.0.1:javadoc (default-cli) on 
> project hadoop-hdfs: An error has occurred in Javadoc report generation: 
> [ERROR] Exit code: 1 - javadoc: warning - You have specified the HTML version 
> as HTML 4.01 by using the -html4 option.
> [ERROR] The default is currently HTML5 and the support for HTML 4.01 will be 
> removed
> [ERROR] in a future release. To suppress this warning, please ensure that any 
> HTML constructs
> [ERROR] in your comments are valid in HTML5, and remove the -html4 option.
> [ERROR] 
> /home/jenkins/jenkins-slave/workspace/hadoop-multibranch_PR-2084/src/hadoop-hdfs-project/hadoop-hdfs/target/generated-sources/java/org/apache/hadoop/hdfs/server/namenode/FsImageProto.java:25197:
>  error: cannot find symbol
> [ERROR]   com.google.protobuf.GeneratedMessageV3 implements
> [ERROR]  ^
> [ERROR]   symbol:   class GeneratedMessageV3
> [ERROR]   location: package com.google.protobuf
> [ERROR] 
> /home/jenkins/jenkins-slave/workspace/hadoop-multibranch_PR-2084/src/hadoop-hdfs-project/hadoop-hdfs/target/generated-sources/java/org/apache/hadoop/hdfs/server/namenode/FsImageProto.java:25319:
>  error: cannot find symbol
> [ERROR] com.google.protobuf.GeneratedMessageV3 implements
> [ERROR]^
> [ERROR]   symbol:   class GeneratedMessageV3
> [ERROR]   location: package com.google.protobuf
> [ERROR] 
> /home/jenkins/jenkins-slave/workspace/hadoop-multibranch_PR-2084/src/hadoop-hdfs-project/hadoop-hdfs/target/generated-sources/java/org/apache/hadoop/hdfs/server/namenode/FsImageProto.java:26068:
>  error: cannot find symbol
> [ERROR] com.google.protobuf.GeneratedMessageV3 implements
> [ERROR]^
> [ERROR]   symbol:   class GeneratedMessageV3
> [ERROR]   location: package com.google.protobuf
> [ERROR] 
> /home/jenkins/jenkins-slave/workspace/hadoop-multibranch_PR-2084/src/hadoop-hdfs-project/hadoop-hdfs/target/generated-sources/java/org/apache/hadoop/hdfs/server/namenode/FsImageProto.java:26073:
>  error: package com.google.protobuf.GeneratedMessageV3 does not exist
> [ERROR]   private 
> PersistToken(com.google.protobuf.GeneratedMessageV3.Builder builder) {
> {noformat}



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

-
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org



[jira] [Updated] (HADOOP-17091) [JDK11] Fix Javadoc errors

2020-08-02 Thread Akira Ajisaka (Jira)


 [ 
https://issues.apache.org/jira/browse/HADOOP-17091?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Akira Ajisaka updated HADOOP-17091:
---
Parent: HADOOP-16795
Issue Type: Sub-task  (was: Bug)

> [JDK11] Fix Javadoc errors
> --
>
> Key: HADOOP-17091
> URL: https://issues.apache.org/jira/browse/HADOOP-17091
> Project: Hadoop Common
>  Issue Type: Sub-task
>  Components: build
> Environment: Java 11
>Reporter: Uma Maheswara Rao G
>Assignee: Akira Ajisaka
>Priority: Major
>
> {noformat}
> [INFO] 
> 
> [INFO] BUILD FAILURE
> [INFO] 
> 
> [INFO] Total time:  17.982 s
> [INFO] Finished at: 2020-06-20T01:56:28Z
> [INFO] 
> 
> [ERROR] Failed to execute goal 
> org.apache.maven.plugins:maven-javadoc-plugin:3.0.1:javadoc (default-cli) on 
> project hadoop-hdfs: An error has occurred in Javadoc report generation: 
> [ERROR] Exit code: 1 - javadoc: warning - You have specified the HTML version 
> as HTML 4.01 by using the -html4 option.
> [ERROR] The default is currently HTML5 and the support for HTML 4.01 will be 
> removed
> [ERROR] in a future release. To suppress this warning, please ensure that any 
> HTML constructs
> [ERROR] in your comments are valid in HTML5, and remove the -html4 option.
> [ERROR] 
> /home/jenkins/jenkins-slave/workspace/hadoop-multibranch_PR-2084/src/hadoop-hdfs-project/hadoop-hdfs/target/generated-sources/java/org/apache/hadoop/hdfs/server/namenode/FsImageProto.java:25197:
>  error: cannot find symbol
> [ERROR]   com.google.protobuf.GeneratedMessageV3 implements
> [ERROR]  ^
> [ERROR]   symbol:   class GeneratedMessageV3
> [ERROR]   location: package com.google.protobuf
> [ERROR] 
> /home/jenkins/jenkins-slave/workspace/hadoop-multibranch_PR-2084/src/hadoop-hdfs-project/hadoop-hdfs/target/generated-sources/java/org/apache/hadoop/hdfs/server/namenode/FsImageProto.java:25319:
>  error: cannot find symbol
> [ERROR] com.google.protobuf.GeneratedMessageV3 implements
> [ERROR]^
> [ERROR]   symbol:   class GeneratedMessageV3
> [ERROR]   location: package com.google.protobuf
> [ERROR] 
> /home/jenkins/jenkins-slave/workspace/hadoop-multibranch_PR-2084/src/hadoop-hdfs-project/hadoop-hdfs/target/generated-sources/java/org/apache/hadoop/hdfs/server/namenode/FsImageProto.java:26068:
>  error: cannot find symbol
> [ERROR] com.google.protobuf.GeneratedMessageV3 implements
> [ERROR]^
> [ERROR]   symbol:   class GeneratedMessageV3
> [ERROR]   location: package com.google.protobuf
> [ERROR] 
> /home/jenkins/jenkins-slave/workspace/hadoop-multibranch_PR-2084/src/hadoop-hdfs-project/hadoop-hdfs/target/generated-sources/java/org/apache/hadoop/hdfs/server/namenode/FsImageProto.java:26073:
>  error: package com.google.protobuf.GeneratedMessageV3 does not exist
> [ERROR]   private 
> PersistToken(com.google.protobuf.GeneratedMessageV3.Builder builder) {
> {noformat}



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

-
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org



[jira] [Updated] (HADOOP-17091) [JDK11] Fix Javadoc errors

2020-08-02 Thread Akira Ajisaka (Jira)


 [ 
https://issues.apache.org/jira/browse/HADOOP-17091?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Akira Ajisaka updated HADOOP-17091:
---
Summary: [JDK11] Fix Javadoc errors  (was: Javadoc failing with "cannot 
find symbol  com.google.protobuf.GeneratedMessageV3 implements")

> [JDK11] Fix Javadoc errors
> --
>
> Key: HADOOP-17091
> URL: https://issues.apache.org/jira/browse/HADOOP-17091
> Project: Hadoop Common
>  Issue Type: Bug
>  Components: build
> Environment: Java 11
>Reporter: Uma Maheswara Rao G
>Assignee: Akira Ajisaka
>Priority: Major
>
> {noformat}
> [INFO] 
> 
> [INFO] BUILD FAILURE
> [INFO] 
> 
> [INFO] Total time:  17.982 s
> [INFO] Finished at: 2020-06-20T01:56:28Z
> [INFO] 
> 
> [ERROR] Failed to execute goal 
> org.apache.maven.plugins:maven-javadoc-plugin:3.0.1:javadoc (default-cli) on 
> project hadoop-hdfs: An error has occurred in Javadoc report generation: 
> [ERROR] Exit code: 1 - javadoc: warning - You have specified the HTML version 
> as HTML 4.01 by using the -html4 option.
> [ERROR] The default is currently HTML5 and the support for HTML 4.01 will be 
> removed
> [ERROR] in a future release. To suppress this warning, please ensure that any 
> HTML constructs
> [ERROR] in your comments are valid in HTML5, and remove the -html4 option.
> [ERROR] 
> /home/jenkins/jenkins-slave/workspace/hadoop-multibranch_PR-2084/src/hadoop-hdfs-project/hadoop-hdfs/target/generated-sources/java/org/apache/hadoop/hdfs/server/namenode/FsImageProto.java:25197:
>  error: cannot find symbol
> [ERROR]   com.google.protobuf.GeneratedMessageV3 implements
> [ERROR]  ^
> [ERROR]   symbol:   class GeneratedMessageV3
> [ERROR]   location: package com.google.protobuf
> [ERROR] 
> /home/jenkins/jenkins-slave/workspace/hadoop-multibranch_PR-2084/src/hadoop-hdfs-project/hadoop-hdfs/target/generated-sources/java/org/apache/hadoop/hdfs/server/namenode/FsImageProto.java:25319:
>  error: cannot find symbol
> [ERROR] com.google.protobuf.GeneratedMessageV3 implements
> [ERROR]^
> [ERROR]   symbol:   class GeneratedMessageV3
> [ERROR]   location: package com.google.protobuf
> [ERROR] 
> /home/jenkins/jenkins-slave/workspace/hadoop-multibranch_PR-2084/src/hadoop-hdfs-project/hadoop-hdfs/target/generated-sources/java/org/apache/hadoop/hdfs/server/namenode/FsImageProto.java:26068:
>  error: cannot find symbol
> [ERROR] com.google.protobuf.GeneratedMessageV3 implements
> [ERROR]^
> [ERROR]   symbol:   class GeneratedMessageV3
> [ERROR]   location: package com.google.protobuf
> [ERROR] 
> /home/jenkins/jenkins-slave/workspace/hadoop-multibranch_PR-2084/src/hadoop-hdfs-project/hadoop-hdfs/target/generated-sources/java/org/apache/hadoop/hdfs/server/namenode/FsImageProto.java:26073:
>  error: package com.google.protobuf.GeneratedMessageV3 does not exist
> [ERROR]   private 
> PersistToken(com.google.protobuf.GeneratedMessageV3.Builder builder) {
> {noformat}



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

-
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org



[GitHub] [hadoop] aajisaka commented on pull request #2098: HADOOP-17091. [JDK11] Fix Javadoc errors

2020-08-02 Thread GitBox


aajisaka commented on pull request #2098:
URL: https://github.com/apache/hadoop/pull/2098#issuecomment-667761490


   Merged. Thank you @steveloughran 



This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org



-
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org



[GitHub] [hadoop] aajisaka merged pull request #2098: HADOOP-17091. [JDK11] Fix Javadoc errors

2020-08-02 Thread GitBox


aajisaka merged pull request #2098:
URL: https://github.com/apache/hadoop/pull/2098


   



This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org



-
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org



[GitHub] [hadoop] chimney-lee closed pull request #1674: MAPREDUCE-7240.Exception 'Invalid event: TA_TOO_MANY_FETCH_FAILURE at…

2020-08-02 Thread GitBox


chimney-lee closed pull request #1674:
URL: https://github.com/apache/hadoop/pull/1674


   



This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org



-
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org



[GitHub] [hadoop] swamirishi commented on a change in pull request #2133: HADOOP-17122: Preserving Directory Attributes in DistCp with Atomic Copy

2020-08-02 Thread GitBox


swamirishi commented on a change in pull request #2133:
URL: https://github.com/apache/hadoop/pull/2133#discussion_r464147738



##
File path: 
hadoop-tools/hadoop-distcp/src/test/java/org/apache/hadoop/tools/mapred/TestCopyCommitter.java
##
@@ -177,6 +177,44 @@ public void testPreserveStatus() throws IOException {
   conf.unset(DistCpConstants.CONF_LABEL_PRESERVE_STATUS);
 }
 
+  }
+  @Test
+  public void testPreserveStatusWithAtomicCommit() throws IOException {
+TaskAttemptContext taskAttemptContext = getTaskAttemptContext(config);
+JobContext jobContext = new 
JobContextImpl(taskAttemptContext.getConfiguration(),
+taskAttemptContext.getTaskAttemptID().getJobID());
+Configuration conf = jobContext.getConfiguration();
+String sourceBase;
+String workBase;
+String targetBase;
+FileSystem fs = null;
+try {
+  OutputCommitter committer = new CopyCommitter(null, taskAttemptContext);
+  fs = FileSystem.get(conf);

Review comment:
   Can we get the code merged?





This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org



-
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org



[GitHub] [hadoop] swamirishi commented on a change in pull request #2133: HADOOP-17122: Preserving Directory Attributes in DistCp with Atomic Copy

2020-08-02 Thread GitBox


swamirishi commented on a change in pull request #2133:
URL: https://github.com/apache/hadoop/pull/2133#discussion_r464147008



##
File path: 
hadoop-tools/hadoop-distcp/src/test/java/org/apache/hadoop/tools/mapred/TestCopyCommitter.java
##
@@ -177,6 +177,44 @@ public void testPreserveStatus() throws IOException {
   conf.unset(DistCpConstants.CONF_LABEL_PRESERVE_STATUS);
 }
 
+  }
+  @Test
+  public void testPreserveStatusWithAtomicCommit() throws IOException {
+TaskAttemptContext taskAttemptContext = getTaskAttemptContext(config);
+JobContext jobContext = new 
JobContextImpl(taskAttemptContext.getConfiguration(),
+taskAttemptContext.getTaskAttemptID().getJobID());
+Configuration conf = jobContext.getConfiguration();
+String sourceBase;
+String workBase;
+String targetBase;
+FileSystem fs = null;
+try {
+  OutputCommitter committer = new CopyCommitter(null, taskAttemptContext);
+  fs = FileSystem.get(conf);

Review comment:
   Yeah, we have registered a HDFS minicluster.





This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org



-
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org



[GitHub] [hadoop] steveloughran commented on a change in pull request #2133: HADOOP-17122: Preserving Directory Attributes in DistCp with Atomic Copy

2020-08-02 Thread GitBox


steveloughran commented on a change in pull request #2133:
URL: https://github.com/apache/hadoop/pull/2133#discussion_r464114705



##
File path: 
hadoop-tools/hadoop-distcp/src/test/java/org/apache/hadoop/tools/mapred/TestCopyCommitter.java
##
@@ -177,6 +177,44 @@ public void testPreserveStatus() throws IOException {
   conf.unset(DistCpConstants.CONF_LABEL_PRESERVE_STATUS);
 }
 
+  }
+  @Test
+  public void testPreserveStatusWithAtomicCommit() throws IOException {
+TaskAttemptContext taskAttemptContext = getTaskAttemptContext(config);
+JobContext jobContext = new 
JobContextImpl(taskAttemptContext.getConfiguration(),
+taskAttemptContext.getTaskAttemptID().getJobID());
+Configuration conf = jobContext.getConfiguration();
+String sourceBase;
+String workBase;
+String targetBase;
+FileSystem fs = null;
+try {
+  OutputCommitter committer = new CopyCommitter(null, taskAttemptContext);
+  fs = FileSystem.get(conf);

Review comment:
   this wil be the HDFS minicluster, right?





This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org



-
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org



[GitHub] [hadoop] akiyamaneko closed pull request #2068: HDFS-15408. Add a new parameter to control the timeout properties of Connection in case that the command ‘hdfs fsck’ would failed with SocketTi

2020-08-02 Thread GitBox


akiyamaneko closed pull request #2068:
URL: https://github.com/apache/hadoop/pull/2068


   



This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org



-
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org



[GitHub] [hadoop] mukul1987 merged pull request #2181: HDFS-15498. Show snapshots deletion status in snapList cmd.

2020-08-02 Thread GitBox


mukul1987 merged pull request #2181:
URL: https://github.com/apache/hadoop/pull/2181


   



This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org



-
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org



[GitHub] [hadoop] mukul1987 commented on pull request #2181: HDFS-15498. Show snapshots deletion status in snapList cmd.

2020-08-02 Thread GitBox


mukul1987 commented on pull request #2181:
URL: https://github.com/apache/hadoop/pull/2181#issuecomment-667695169


   The patch looks good to me. I will commit them shortly.



This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org



-
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org



[GitHub] [hadoop] mukul1987 commented on pull request #2181: HDFS-15498. Show snapshots deletion status in snapList cmd.

2020-08-02 Thread GitBox


mukul1987 commented on pull request #2181:
URL: https://github.com/apache/hadoop/pull/2181#issuecomment-667692139


   @hemanthboyina, we are not modifying the "ls" command because the changes 
will be backward incompatible. 



This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org



-
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org