[jira] [Created] (HADOOP-13584) Merge HADOOP-12756 branch to latest trunk

[shimingfei (JIRA)]

shimingfei created HADOOP-13584:
---

 Summary: Merge HADOOP-12756 branch to latest trunk
 Key: HADOOP-13584
 URL: https://issues.apache.org/jira/browse/HADOOP-13584
 Project: Hadoop Common
  Issue Type: New Feature
  Components: fs
Affects Versions: 3.0.0-alpha1
Reporter: shimingfei
 Fix For: 3.0.0-alpha2


We have finished a round of improvement over Hadoop-12756 branch, which intends 
to incorporate Aliyun OSS support in Hadoop. This feature provides basic 
support for data access to Aliyun OSS from Hadoop applications.

In the implementation, we follow the style of S3 support in Hadooop. Besides we 
also provide FileSystem contract test over real Aliyun OSS environment. By 
simple configuration, it can be enabled/disabled.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-dev-h...@hadoop.apache.org

[jira] [Created] (HADOOP-13583) Incorporate checkcompatibility script which runs Java API Compliance Checker

[Andrew Wang (JIRA)]

Andrew Wang created HADOOP-13583:


 Summary: Incorporate checkcompatibility script which runs Java API 
Compliance Checker
 Key: HADOOP-13583
 URL: https://issues.apache.org/jira/browse/HADOOP-13583
 Project: Hadoop Common
  Issue Type: Improvement
  Components: scripts
Affects Versions: 2.6.4
Reporter: Andrew Wang
Assignee: Andrew Wang


Based on discussion at YETUS-445, this code can't go there, but it's still very 
useful for release managers. A similar variant of this script has been used for 
a while by Apache HBase and Apache Kudu, and IMO JACC output is easier to 
understand than JDiff.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-dev-h...@hadoop.apache.org

[jira] [Created] (HADOOP-13582) Implement logExpireToken in ZKDelegationTokenSecretManager

[Xiao Chen (JIRA)]

Xiao Chen created HADOOP-13582:
--

 Summary: Implement logExpireToken in ZKDelegationTokenSecretManager
 Key: HADOOP-13582
 URL: https://issues.apache.org/jira/browse/HADOOP-13582
 Project: Hadoop Common
  Issue Type: Improvement
  Components: kms
Affects Versions: 2.8.0
Reporter: Xiao Chen
Assignee: Xiao Chen
Priority: Minor


During my investigation on HADOOP-13487, I found it pretty difficult to track 
KMS DTs in ZK, even in debug level.

Adding a simple debug log to make future triages easier.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-dev-h...@hadoop.apache.org

[jira] [Created] (HADOOP-13581) Expand FileSystem specification to describe differences between FileSystem and FileContext.

[Chris Nauroth (JIRA)]

Chris Nauroth created HADOOP-13581:
--

 Summary: Expand FileSystem specification to describe differences 
between FileSystem and FileContext.
 Key: HADOOP-13581
 URL: https://issues.apache.org/jira/browse/HADOOP-13581
 Project: Hadoop Common
  Issue Type: Improvement
  Components: fs
Reporter: Chris Nauroth
Priority: Minor


Sometimes there are behavioral differences between using the {{FileSystem}} API 
and using the {{FileContext}} API.  This issue proposes to enhance the 
specification to describe these differences in more detail.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-dev-h...@hadoop.apache.org

Re: [VOTE] Release Apache Hadoop 3.0.0-alpha1 RC0

[Andrew Wang]

Thanks everyone for voting and helping to validate alpha1. The VOTE closes
with 16 +1s, 6 of them binding PMC votes, and no -1s.

I'll go ahead and wrap up the release, will send an announcement out likely
tomorrow once the mirrors have caught up.

Best,
Andrew

On Sat, Sep 3, 2016 at 6:55 PM, Akira Ajisaka 
wrote:

> Thanks Andrew for the great work.
>
> +1 (binding)
>
> - Downloaded source and verified checksum and signature
> - Compiled with -Pnative @ CentOS 7.2 and OpenJDK 8u101
> - Ran some MapReduce jobs successfully
> - Checked Web UIs and logs
> - hdfs/yarn/mapred "--daemon" option works as expected
>
> Regards,
> Akira
>
>
> On 9/4/16 09:06, Eric Payne wrote:
>
>> Thank you very much, Andrew.
>>
>> +1 (non-binding)
>>
>> - Downloaded source and built native
>> - Installed on 3-node, non-secure cluster
>> - Ran sleep jobs
>> - Ensured preemption works as expected
>>
>> -Eric Payne
>>
>>
>> - Original Message -
>> From: Andrew Wang 
>> To: "common-dev@hadoop.apache.org" ; "
>> hdfs-...@hadoop.apache.org" ; "
>> mapreduce-...@hadoop.apache.org" ; "
>> yarn-...@hadoop.apache.org" 
>> Sent: Tuesday, August 30, 2016 10:51 AM
>> Subject: [VOTE] Release Apache Hadoop 3.0.0-alpha1 RC0
>>
>> Hi all,
>>
>> Thanks to the combined work of many, many contributors, here's an RC0 for
>> 3.0.0-alpha1:
>>
>> http://home.apache.org/~wang/3.0.0-alpha1-RC0/
>>
>> alpha1 is the first in a series of planned alpha releases leading up to
>> GA.
>> The objective is to get an artifact out to downstreams for testing and to
>> iterate quickly based on their feedback. So, please keep that in mind when
>> voting; hopefully most issues can be addressed by future alphas rather
>> than
>> future RCs.
>>
>> Sorry for getting this out on a Tuesday, but I'd still like this vote to
>> run the normal 5 days, thus ending Saturday (9/3) at 9AM PDT. I'll extend
>> if we lack the votes.
>>
>> Please try it out and let me know what you think.
>>
>> Best,
>> Andrew
>>
>> -
>> To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org
>> For additional commands, e-mail: common-dev-h...@hadoop.apache.org
>>
>>
>
> -
> To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org
> For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
>
>

[jira] [Created] (HADOOP-13580) If user is unauthorized, log "unauthorized" instead of "Invalid signed text:"

[Wei-Chiu Chuang (JIRA)]

Wei-Chiu Chuang created HADOOP-13580:


 Summary: If user is unauthorized, log "unauthorized" instead of 
"Invalid signed text:"
 Key: HADOOP-13580
 URL: https://issues.apache.org/jira/browse/HADOOP-13580
 Project: Hadoop Common
  Issue Type: Improvement
  Components: security
Reporter: Wei-Chiu Chuang
Priority: Minor


If a user is unauthorized to access web interface, the signed text is empty, 
and the web interface prints 
bq. org.apache.hadoop.security.authentication.util.SignerException: Invalid 
signed text: 
This error message is obscure. It should be a more meaningful message like 
"Unauthorized access."



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-dev-h...@hadoop.apache.org

Apache Hadoop qbt Report: trunk+JDK8 on Linux/x86

[Apache Jenkins Server]

For more details, see 
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/156/

No changes




-1 overall


The following subsystems voted -1:
asflicense unit


The following subsystems voted -1 but
were configured to be filtered/ignored:
cc checkstyle javac javadoc pylint shellcheck shelldocs whitespace


The following subsystems are considered long running:
(runtime bigger than 1h  0m  0s)
unit


Specific tests:

Failed CTEST tests :

   test_test_libhdfs_threaded_hdfs_static 
   test_test_libhdfs_zerocopy_hdfs_static 

Failed junit tests :

   hadoop.hdfs.server.datanode.TestDirectoryScanner 
   hadoop.hdfs.server.datanode.TestDataNodeVolumeFailure 
   hadoop.yarn.server.applicationhistoryservice.webapp.TestAHSWebServices 
   hadoop.yarn.server.resourcemanager.security.TestDelegationTokenRenewer 
   hadoop.yarn.server.resourcemanager.TestWorkPreservingRMRestart 
   hadoop.yarn.server.TestContainerManagerSecurity 
   hadoop.yarn.server.TestMiniYarnClusterNodeUtilization 

Timed out junit tests :

   org.apache.hadoop.http.TestHttpServerLifecycle 
   org.apache.hadoop.hdfs.util.TestByteArrayManager 
   org.apache.hadoop.hdfs.TestLeaseRecovery2 
  

   cc:

   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/156/artifact/out/diff-compile-cc-root.txt
  [4.0K]

   javac:

   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/156/artifact/out/diff-compile-javac-root.txt
  [168K]

   checkstyle:

   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/156/artifact/out/diff-checkstyle-root.txt
  [16M]

   pylint:

   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/156/artifact/out/diff-patch-pylint.txt
  [16K]

   shellcheck:

   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/156/artifact/out/diff-patch-shellcheck.txt
  [20K]

   shelldocs:

   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/156/artifact/out/diff-patch-shelldocs.txt
  [16K]

   whitespace:

   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/156/artifact/out/whitespace-eol.txt
  [12M]
   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/156/artifact/out/whitespace-tabs.txt
  [1.3M]

   javadoc:

   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/156/artifact/out/diff-javadoc-javadoc-root.txt
  [2.2M]

   CTEST:

   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/156/artifact/out/patch-hadoop-hdfs-project_hadoop-hdfs-native-client-ctest.txt
  [24K]

   unit:

   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/156/artifact/out/patch-unit-hadoop-common-project_hadoop-common.txt
  [120K]
   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/156/artifact/out/patch-unit-hadoop-hdfs-project_hadoop-hdfs-client.txt
  [12K]
   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/156/artifact/out/patch-unit-hadoop-hdfs-project_hadoop-hdfs.txt
  [144K]
   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/156/artifact/out/patch-unit-hadoop-hdfs-project_hadoop-hdfs-native-client.txt
  [8.0K]
   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/156/artifact/out/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-applicationhistoryservice.txt
  [12K]
   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/156/artifact/out/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-resourcemanager.txt
  [56K]
   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/156/artifact/out/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-tests.txt
  [268K]
   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/156/artifact/out/patch-unit-hadoop-mapreduce-project_hadoop-mapreduce-client_hadoop-mapreduce-client-nativetask.txt
  [124K]

   asflicense:

   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/156/artifact/out/patch-asflicense-problems.txt
  [4.0K]

Powered by Apache Yetus 0.4.0-SNAPSHOT   http://yetus.apache.org



-
To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-dev-h...@hadoop.apache.org