[jira] [Created] (HADOOP-13794) JSON.org license is now CatX

2016-11-03 Thread Sean Busbey (JIRA)
Sean Busbey created HADOOP-13794:


 Summary: JSON.org license is now CatX
 Key: HADOOP-13794
 URL: https://issues.apache.org/jira/browse/HADOOP-13794
 Project: Hadoop Common
  Issue Type: Bug
Reporter: Sean Busbey
Priority: Blocker


per [update resolved legal|http://www.apache.org/legal/resolved.html#json]:

{quote}
CAN APACHE PRODUCTS INCLUDE WORKS LICENSED UNDER THE JSON LICENSE?

No. As of 2016-11-03 this has been moved to the 'Category X' license list. 
Prior to this, use of the JSON Java library was allowed. See Debian's page for 
a list of alternatives.
{quote}

We have a test-time transitive dependency on the {{org.json:json}} artifact in 
trunk and branch-2. AFAICT, this test time dependency doesn't get exposed to 
downstream at all (I checked assemblies and test-jar artifacts we publish to 
maven), so it can be removed or kept at our leisure. keeping it risks it being 
promoted out of test scope by maven without us noticing. We might be able to 
add an enforcer rule to check for this.

We also distribute it in bundled form through our use of the AWS Java SDK 
artifacts in trunk and branch-2. Looking at the github project, [their 
dependency on JSON.org was removed in 
1.11|https://github.com/aws/aws-sdk-java/pull/417], so if we upgrade to 1.11.0+ 
we should be good to go. (this might be hard in branch-2.6 and branch-2.7 where 
we're on 1.7.4)





--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-dev-h...@hadoop.apache.org



[jira] [Reopened] (HADOOP-7930) Kerberos relogin interval in UserGroupInformation should be configurable

2016-11-03 Thread Xiao Chen (JIRA)

 [ 
https://issues.apache.org/jira/browse/HADOOP-7930?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Xiao Chen reopened HADOOP-7930:
---

Sorry to reopen this. Seeing the 3 comments above, I decided to backport this 
to branch-2 and branch-2.8 (seems we missed branch-2.1.0-beta :) ) This will 
make the backport of HADOOP-13590 easier.

> Kerberos relogin interval in UserGroupInformation should be configurable
> 
>
> Key: HADOOP-7930
> URL: https://issues.apache.org/jira/browse/HADOOP-7930
> Project: Hadoop Common
>  Issue Type: Improvement
>  Components: security
>Affects Versions: 0.23.1
>Reporter: Alejandro Abdelnur
>Assignee: Robert Kanter
> Fix For: 3.0.0-alpha1
>
> Attachments: HADOOP-7930.patch, HADOOP-7930.patch, HADOOP-7930.patch
>
>
> Currently the check done in the *hasSufficientTimeElapsed()* method is 
> hardcoded to 10 mins wait.
> The wait time should be driven by configuration and its default value, for 
> clients should be 1 min. 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-dev-h...@hadoop.apache.org



[jira] [Created] (HADOOP-13793) s3guard: add inconsistency injection, integration tests

2016-11-03 Thread Aaron Fabbri (JIRA)
Aaron Fabbri created HADOOP-13793:
-

 Summary: s3guard: add inconsistency injection, integration tests
 Key: HADOOP-13793
 URL: https://issues.apache.org/jira/browse/HADOOP-13793
 Project: Hadoop Common
  Issue Type: Sub-task
Reporter: Aaron Fabbri


Many of us share concerns that testing the consistency features of S3Guard will 
be difficult if we depend on the rare and unpredictable occurrence of actual 
inconsistency in S3 to exercise those code paths.

I think we should have a mechanism for injecting failure to force exercising of 
the consistency codepaths in S3Guard.

Requirements:
- Integration tests that cause S3A to see the types of inconsistency we address 
with S3Guard.
- These are deterministic integration tests.

Unit tests are possible as well, if we were to stub out the S3Client.  That may 
be less bang for the buck, though.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-dev-h...@hadoop.apache.org



Apache Hadoop qbt Report: trunk+JDK8 on Linux/ppc64le

2016-11-03 Thread Apache Jenkins Server
For more details, see 
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-ppc/144/

[Nov 2, 2016 1:53:33 PM] (templedf) HADOOP-13667. Fix typing mistake of inline 
document in
[Nov 2, 2016 7:07:09 PM] (varunsaxena) YARN-5815. Random failure of
[Nov 2, 2016 8:46:33 PM] (wang) Revert "HADOOP-13717. Normalize daemonization 
behavior of the
[Nov 2, 2016 9:58:24 PM] (liuml07) HDFS-11095. BlockManagerSafeMode should 
respect extension period default
[Nov 2, 2016 11:45:25 PM] (lei) HDFS-10909. De-duplicate code in
[Nov 3, 2016 12:46:56 AM] (aengineer) HDFS-10566. Submit plan request should 
throw exception if Datanode is in
[Nov 3, 2016 1:34:33 AM] (wang) HADOOP-13784. Output javadoc inside the target 
directory.
[Nov 3, 2016 2:11:05 AM] (wang) HDFS-11080. Update HttpFS to use 
ConfigRedactor. Contributed by Sean
[Nov 3, 2016 7:02:22 AM] (naganarasimha_gr) YARN-5720. Update document for 
"rmadmin -replaceLabelOnNode".
[Nov 3, 2016 1:54:31 PM] (jlowe) YARN-4862. Handle duplicate completed 
containers in RMNodeImpl.




-1 overall


The following subsystems voted -1:
compile unit


The following subsystems voted -1 but
were configured to be filtered/ignored:
cc javac


The following subsystems are considered long running:
(runtime bigger than 1h  0m  0s)
unit


Specific tests:

Failed junit tests :

   hadoop.test.TestLambdaTestUtils 
   hadoop.hdfs.tools.TestDFSZKFailoverController 
   hadoop.hdfs.tools.offlineImageViewer.TestOfflineImageViewer 
   hadoop.hdfs.web.TestWebHdfsTimeouts 
   hadoop.yarn.server.nodemanager.recovery.TestNMLeveldbStateStoreService 
   hadoop.yarn.server.nodemanager.TestNodeManagerShutdown 
   hadoop.yarn.server.timeline.TestRollingLevelDB 
   hadoop.yarn.server.timeline.TestTimelineDataManager 
   hadoop.yarn.server.timeline.TestLeveldbTimelineStore 
   hadoop.yarn.server.timeline.recovery.TestLeveldbTimelineStateStore 
   hadoop.yarn.server.timeline.TestRollingLevelDBTimelineStore 
   
hadoop.yarn.server.applicationhistoryservice.TestApplicationHistoryServer 
   hadoop.yarn.server.timelineservice.storage.common.TestRowKeys 
   hadoop.yarn.server.timelineservice.storage.common.TestKeyConverters 
   hadoop.yarn.server.timelineservice.storage.common.TestSeparator 
   hadoop.yarn.server.resourcemanager.recovery.TestLeveldbRMStateStore 
   hadoop.yarn.server.resourcemanager.TestRMRestart 
   hadoop.yarn.server.resourcemanager.TestResourceTrackerService 
   hadoop.yarn.server.TestMiniYarnClusterNodeUtilization 
   hadoop.yarn.server.TestContainerManagerSecurity 
   hadoop.yarn.server.timeline.TestLevelDBCacheTimelineStore 
   hadoop.yarn.server.timeline.TestOverrideTimelineStoreYarnClient 
   hadoop.yarn.server.timeline.TestEntityGroupFSTimelineStore 
   hadoop.yarn.server.timelineservice.storage.TestHBaseTimelineStorageApps 
   
hadoop.yarn.server.timelineservice.storage.flow.TestHBaseStorageFlowRunCompaction
 
   
hadoop.yarn.server.timelineservice.storage.TestHBaseTimelineStorageEntities 
   hadoop.yarn.server.timelineservice.storage.flow.TestHBaseStorageFlowRun 
   
hadoop.yarn.server.timelineservice.storage.TestPhoenixOfflineAggregationWriterImpl
 
   
hadoop.yarn.server.timelineservice.reader.TestTimelineReaderWebServicesHBaseStorage
 
   
hadoop.yarn.server.timelineservice.storage.flow.TestHBaseStorageFlowActivity 
   hadoop.yarn.applications.distributedshell.TestDistributedShell 
   hadoop.mapred.TestShuffleHandler 
   hadoop.mapreduce.v2.hs.TestHistoryServerLeveldbStateStoreService 
   hadoop.mapreduce.TestMRJobClient 
   hadoop.fs.azure.TestNativeAzureFileSystemOperationsMocked 

Timed out junit tests :

   org.apache.hadoop.hdfs.server.datanode.TestFsDatasetCache 
   org.apache.hadoop.mapred.TestMRIntermediateDataEncryption 
   org.apache.hadoop.tools.TestHadoopArchives 
  

   compile:

   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-ppc/144/artifact/out/patch-compile-root.txt
  [320K]

   cc:

   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-ppc/144/artifact/out/patch-compile-root.txt
  [320K]

   javac:

   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-ppc/144/artifact/out/patch-compile-root.txt
  [320K]

   unit:

   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-ppc/144/artifact/out/patch-unit-hadoop-common-project_hadoop-common.txt
  [124K]
   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-ppc/144/artifact/out/patch-unit-hadoop-hdfs-project_hadoop-hdfs.txt
  [252K]
   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-ppc/144/artifact/out/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-nodemanager.txt
  [52K]
   

[jira] [Created] (HADOOP-13791) Filtering endpoints based on the region for Identity API v3

2016-11-03 Thread ramtin (JIRA)
ramtin created HADOOP-13791:
---

 Summary: Filtering endpoints based on the region for Identity API 
v3
 Key: HADOOP-13791
 URL: https://issues.apache.org/jira/browse/HADOOP-13791
 Project: Hadoop Common
  Issue Type: Improvement
  Components: fs/swift
Reporter: ramtin
Assignee: ramtin


Filtering endpoints based on the region for Identity API v3 authentication 
(HADOOP-12525) for OpenStack Swift



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-dev-h...@hadoop.apache.org



[jira] [Created] (HADOOP-13790) Make qbt script executable

2016-11-03 Thread Andrew Wang (JIRA)
Andrew Wang created HADOOP-13790:


 Summary: Make qbt script executable
 Key: HADOOP-13790
 URL: https://issues.apache.org/jira/browse/HADOOP-13790
 Project: Hadoop Common
  Issue Type: Improvement
  Components: scripts
Affects Versions: 3.0.0-alpha1, 2.8.0
Reporter: Andrew Wang
Assignee: Andrew Wang
Priority: Trivial
 Attachments: HADOOP-13790.001.patch

Trivial, the qbt script isn't executable, unlike the other scripts in 
{{dev-support/bin}}.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-dev-h...@hadoop.apache.org



Apache Hadoop qbt Report: trunk+JDK8 on Linux/x86

2016-11-03 Thread Apache Jenkins Server
For more details, see 
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/214/

[Nov 2, 2016 1:53:33 PM] (templedf) HADOOP-13667. Fix typing mistake of inline 
document in
[Nov 2, 2016 7:07:09 PM] (varunsaxena) YARN-5815. Random failure of
[Nov 2, 2016 8:46:33 PM] (wang) Revert "HADOOP-13717. Normalize daemonization 
behavior of the
[Nov 2, 2016 9:58:24 PM] (liuml07) HDFS-11095. BlockManagerSafeMode should 
respect extension period default
[Nov 2, 2016 11:45:25 PM] (lei) HDFS-10909. De-duplicate code in
[Nov 3, 2016 12:46:56 AM] (aengineer) HDFS-10566. Submit plan request should 
throw exception if Datanode is in
[Nov 3, 2016 1:34:33 AM] (wang) HADOOP-13784. Output javadoc inside the target 
directory.
[Nov 3, 2016 2:11:05 AM] (wang) HDFS-11080. Update HttpFS to use 
ConfigRedactor. Contributed by Sean




-1 overall


The following subsystems voted -1:
asflicense unit


The following subsystems voted -1 but
were configured to be filtered/ignored:
cc checkstyle javac javadoc pylint shellcheck shelldocs whitespace


The following subsystems are considered long running:
(runtime bigger than 1h  0m  0s)
unit


Specific tests:

Failed junit tests :

   hadoop.net.TestDNS 
   hadoop.yarn.server.TestMiniYarnClusterNodeUtilization 
   hadoop.yarn.server.TestContainerManagerSecurity 
   hadoop.fs.azure.TestNativeAzureFileSystemOperationsMocked 

Timed out junit tests :

   org.apache.hadoop.tools.TestHadoopArchives 
  

   cc:

   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/214/artifact/out/diff-compile-cc-root.txt
  [4.0K]

   javac:

   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/214/artifact/out/diff-compile-javac-root.txt
  [168K]

   checkstyle:

   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/214/artifact/out/diff-checkstyle-root.txt
  [16M]

   pylint:

   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/214/artifact/out/diff-patch-pylint.txt
  [20K]

   shellcheck:

   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/214/artifact/out/diff-patch-shellcheck.txt
  [20K]

   shelldocs:

   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/214/artifact/out/diff-patch-shelldocs.txt
  [16K]

   whitespace:

   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/214/artifact/out/whitespace-eol.txt
  [11M]
   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/214/artifact/out/whitespace-tabs.txt
  [1.3M]

   javadoc:

   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/214/artifact/out/diff-javadoc-javadoc-root.txt
  [2.2M]

   unit:

   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/214/artifact/out/patch-unit-hadoop-common-project_hadoop-common.txt
  [124K]
   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/214/artifact/out/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-tests.txt
  [316K]
   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/214/artifact/out/patch-unit-hadoop-mapreduce-project_hadoop-mapreduce-client_hadoop-mapreduce-client-nativetask.txt
  [124K]
   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/214/artifact/out/patch-unit-hadoop-tools_hadoop-archives.txt
  [8.0K]
   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/214/artifact/out/patch-unit-hadoop-tools_hadoop-azure.txt
  [16K]

   asflicense:

   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/214/artifact/out/patch-asflicense-problems.txt
  [4.0K]

Powered by Apache Yetus 0.4.0-SNAPSHOT   http://yetus.apache.org



-
To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-dev-h...@hadoop.apache.org

[jira] [Created] (HADOOP-13789) Hadoop Common includes generated test protos in both jar and test-jar

2016-11-03 Thread Sean Busbey (JIRA)
Sean Busbey created HADOOP-13789:


 Summary: Hadoop Common includes generated test protos in both jar 
and test-jar
 Key: HADOOP-13789
 URL: https://issues.apache.org/jira/browse/HADOOP-13789
 Project: Hadoop Common
  Issue Type: Bug
  Components: build, common
Reporter: Sean Busbey
Assignee: Sean Busbey


Right now our ProtocMojo always adds source directories to the main compile 
phase and we use it in hadoop-common to both generate main files as well as 
test files. This results in the test files getting added to both our test jar 
(correct) and our main jar (not correct).

We should either add a main-vs-test flag to the configuration for ProtocMojo or 
make a ProtocTestMojo that always adds as a test sources.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-dev-h...@hadoop.apache.org



[jira] [Created] (HADOOP-13788) datatransfer.Receiver.processOp error

2016-11-03 Thread xluren (JIRA)
xluren created HADOOP-13788:
---

 Summary: datatransfer.Receiver.processOp error
 Key: HADOOP-13788
 URL: https://issues.apache.org/jira/browse/HADOOP-13788
 Project: Hadoop Common
  Issue Type: Bug
Reporter: xluren






--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-dev-h...@hadoop.apache.org