[jira] [Created] (HADOOP-12911) Upgrade Hadoop MiniKDC with Kerby

[Jiajia Li (JIRA)]

Jiajia Li created HADOOP-12911:
--

 Summary: Upgrade Hadoop MiniKDC with Kerby
 Key: HADOOP-12911
 URL: https://issues.apache.org/jira/browse/HADOOP-12911
 Project: Hadoop Common
  Issue Type: Improvement
  Components: test
Reporter: Jiajia Li
Assignee: Jiajia Li


As discussed in the mailing list, we’d like to introduce Apache Kerby into 
Hadoop. Initially it’s good to start with upgrading Hadoop MiniKDC with Kerby 
offerings. Apache Kerby (https://github.com/apache/directory-kerby), as an 
Apache Directory sub project, is a Java Kerberos binding. It provides a 
SimpleKDC server that borrowed ideas from MiniKDC and implemented all the 
facilities existing in MiniKDC. Currently MiniKDC depends on the old Kerberos 
implementation in Directory Server project, but the implementation is stopped 
being maintained. Directory community has a plan to replace the implementation 
using Kerby. MiniKDC can use Kerby SimpleKDC directly to avoid depending on the 
full of Directory project. Kerby also provides nice identity backends such as 
the lightweight memory based one and the very simple json one for easy 
development and test environments.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Created] (HADOOP-12910) Add new FileSystem API to support asynchronous method calls

[Tsz Wo Nicholas Sze (JIRA)]

Tsz Wo Nicholas Sze created HADOOP-12910:


 Summary: Add new FileSystem API to support asynchronous method 
calls
 Key: HADOOP-12910
 URL: https://issues.apache.org/jira/browse/HADOOP-12910
 Project: Hadoop Common
  Issue Type: New Feature
  Components: fs
Reporter: Tsz Wo Nicholas Sze
Assignee: Xiaobing Zhou


Add a new API, namely FutureFileSystem (or AsynchronousFileSystem, if it is a 
better name).  All the APIs in FutureFileSystem are the same as FileSystem 
except that the return type is wrapped by Future and they do not throw 
IOException, e.g.
{code}
  //FileSystem
  public boolean rename(Path src, Path dst) throws IOException;

  //FutureFileSystem
  public Future rename(Path src, Path dst) throws IOException;
{code}
Note that FutureFileSystem does not extend FileSystem.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Created] (HADOOP-12909) Support asynchronous RPC calls

[Tsz Wo Nicholas Sze (JIRA)]

Tsz Wo Nicholas Sze created HADOOP-12909:


 Summary: Support asynchronous RPC calls
 Key: HADOOP-12909
 URL: https://issues.apache.org/jira/browse/HADOOP-12909
 Project: Hadoop Common
  Issue Type: New Feature
  Components: ipc
Reporter: Tsz Wo Nicholas Sze
Assignee: Xiaobing Zhou


In ipc.Client, the underlying mechanism is already supporting asynchronous 
calls -- the calls shares a connection, the call requests are sent using a 
thread pool and the responses can be out of order.  Indeed, synchronized call 
is implemented by invoking wait() in the caller thread in order to wait for the 
server response.

In this JIRA, we change ipc.Client to support asynchronous mode.  In 
asynchronous mode, it return once the request has been sent out but not wait 
for the response from the server.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Re: CHANGES.txt is gone from trunk, branch-2, branch-2.8

[Ravi Prakash]

Yaayy!! +1

On Tue, Mar 8, 2016 at 10:59 AM, Colin P. McCabe  wrote:

> +1
>
> Thanks, Andrew.  This will avoid so many spurious conflicts when
> cherry-picking changes, and so much wasted time on commit.
>
> best,
> Colin
>
> On Thu, Mar 3, 2016 at 9:11 PM, Andrew Wang 
> wrote:
> > Hi all,
> >
> > With the inclusion of HADOOP-12651 going back to branch-2.8, CHANGES.txt
> > and release notes are now generated by Yetus. I've gone ahead and deleted
> > the manually updated CHANGES.txt from trunk, branch-2, and branch-2.8
> > (HADOOP-11792). Many thanks to Allen for the releasedocmaker.py rewrite,
> > and the Yetus integration.
> >
> > I'll go ahead and update the HowToCommit and HowToRelease wiki pages, but
> > at a high-level, this means we no longer need to edit CHANGES.txt on new
> > commit, streamlining our commit process. CHANGES.txt updates will still
> be
> > necessary for backports to older release lines like 2.6.x and 2.7.x.
> >
> > Happy committing!
> >
> > Best,
> > Andrew
>

[jira] [Resolved] (HADOOP-12750) RollingFileSystemBaseTest.ErrorSink should be replaced by Mockito

[Daniel Templeton (JIRA)]

 [ 
https://issues.apache.org/jira/browse/HADOOP-12750?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Daniel Templeton resolved HADOOP-12750.
---
Resolution: Won't Fix

Because the sink is loaded by reflection by the metrics system, there's really 
no place to insert Mockito into the stack.  The current wrapper class in the 
best we're going to do.

> RollingFileSystemBaseTest.ErrorSink should be replaced by Mockito
> -
>
> Key: HADOOP-12750
> URL: https://issues.apache.org/jira/browse/HADOOP-12750
> Project: Hadoop Common
>  Issue Type: Improvement
>  Components: metrics
>Reporter: Daniel Templeton
>Assignee: Daniel Templeton
>Priority: Trivial
>
> Introduced in HADOOP-12702.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Build failed in Jenkins: Hadoop-Common-trunk #2490

[Apache Jenkins Server]

See 

Changes:

[cnauroth] HADOOP-12905. Clean up CHANGES.txt RAT exclusions from pom.xml files.

[zhz] HDFS-7866. Erasure coding: NameNode manages multiple erasure coding

[aajisaka] HADOOP-12688. Fix deadlinks in Compatibility.md. Contributed by Gabor

[arp] HADOOP-12903. IPC Server should allow suppressing exception logging by

--
[...truncated 3832 lines...]
[INFO] Building jar: 

[INFO] 
[INFO] 
[INFO] Building Apache Hadoop MiniKDC 3.0.0-SNAPSHOT
[INFO] 
[INFO] 
[INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ hadoop-minikdc ---
[INFO] Deleting 

[INFO] 
[INFO] --- findbugs-maven-plugin:3.0.0:findbugs (default-cli) @ hadoop-minikdc 
---
[INFO] 
[INFO] --- maven-checkstyle-plugin:2.15:checkstyle (default-cli) @ 
hadoop-minikdc ---
[INFO] There are 9 errors reported by Checkstyle 6.6 with 
checkstyle/checkstyle.xml ruleset.
[WARNING] Unable to locate Source XRef to link to - DISABLED
[INFO] 
[INFO] --- maven-antrun-plugin:1.7:run (create-testdirs) @ hadoop-minikdc ---
[INFO] Executing tasks

main:
[mkdir] Created dir: 

[INFO] Executed tasks
[INFO] 
[INFO] --- maven-resources-plugin:2.6:resources (default-resources) @ 
hadoop-minikdc ---
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] Copying 3 resources
[INFO] 
[INFO] --- maven-compiler-plugin:3.1:compile (default-compile) @ hadoop-minikdc 
---
[INFO] Compiling 2 source files to 

[INFO] 
[INFO] --- maven-resources-plugin:2.6:testResources (default-testResources) @ 
hadoop-minikdc ---
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] skip non existing resourceDirectory 

[INFO] 
[INFO] --- maven-compiler-plugin:3.1:testCompile (default-testCompile) @ 
hadoop-minikdc ---
[INFO] Compiling 2 source files to 

[INFO] 
[INFO] --- maven-surefire-plugin:2.17:test (default-test) @ hadoop-minikdc ---
[INFO] Surefire report directory: 


---
 T E S T S
---

---
 T E S T S
---
Running org.apache.hadoop.minikdc.TestChangeOrgNameAndDomain
Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 15.156 sec - in 
org.apache.hadoop.minikdc.TestChangeOrgNameAndDomain
Running org.apache.hadoop.minikdc.TestMiniKdc
Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 14.111 sec - in 
org.apache.hadoop.minikdc.TestMiniKdc

Results :

Tests run: 6, Failures: 0, Errors: 0, Skipped: 0

[INFO] 
[INFO] --- maven-jar-plugin:2.5:jar (default-jar) @ hadoop-minikdc ---
[INFO] Building jar: 

[INFO] 
[INFO] --- maven-source-plugin:2.3:jar-no-fork (hadoop-java-sources) @ 
hadoop-minikdc ---
[INFO] Building jar: 

[INFO] 
[INFO] --- maven-source-plugin:2.3:test-jar-no-fork (hadoop-java-sources) @ 
hadoop-minikdc ---
[INFO] Building jar: 

[INFO] 
[INFO] --- maven-enforcer-plugin:1.3.1:enforce (dist-enforce) @ hadoop-minikdc 
---
[INFO] 
[INFO] --- maven-site-plugin:3.5:attach-descriptor (attach-descriptor) @ 
hadoop-minikdc ---
[INFO] 
[INFO] --- maven-javadoc-plugin:2.8.1:jar (module-javadocs) @ hadoop-minikdc ---
[INFO] 
Loading source files for package org.apache.hadoop.minikdc...
Constructing Javadoc information...
Standard Doclet version 1.7.0_55
Building tree for all the packages and classes...
Generating