-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/26678/#review59268
-----------------------------------------------------------
Ship it!
The integration tests are failing for me:
Picked up _JAVA_OPTIONS: -Djava.awt.headless=true
Oct 30, 2014 3:24:14 PM org.apache.catalina.startup.ClassLoaderFactory
validateFileWARNING: Problem with directory
[/private/var/folders/63/m25ltdlj3dd97m9rkjgv7r600000gp/T/cargo/conf/common/classes],
exists: [false], isDirectory: [false], canRead: [false]Oct 30, 2014 3:24:14 PM
org.apache.catalina.startup.ClassLoaderFactory validateFileWARNING: Problem
with directory
[/private/var/folders/63/m25ltdlj3dd97m9rkjgv7r600000gp/T/cargo/conf/shared/classes],
exists: [false], isDirectory: [false], canRead: [false]Oct 30, 2014 3:24:14 PM
org.apache.catalina.startup.ClassLoaderFactory validateFileWARNING: Problem
with directory
[/private/var/folders/63/m25ltdlj3dd97m9rkjgv7r600000gp/T/cargo/conf/shared/lib],
exists: [false], isDirectory: [false], canRead: [false]Oct 30, 2014 3:24:15 PM
org.apache.catalina.core.AprLifecycleListener initINFO: The APR based Apache
Tomcat Native library which allows optimal performance in production
environments was not found on the java.library.path: :/op
t/oracle/instantclient_11_2:/Users/abe/Library/Java/Extensions:/Library/Java/Extensions:/Network/Library/Java/Extensions:/System/Library/Java/Extensions:/usr/lib/java:.Oct
30, 2014 3:24:15 PM org.apache.coyote.http11.Http11Protocol initINFO:
Initializing Coyote HTTP/1.1 on http-8080Oct 30, 2014 3:24:15 PM
org.apache.catalina.startup.Catalina loadINFO: Initialization processed in 504
msOct 30, 2014 3:24:15 PM org.apache.catalina.core.StandardService startINFO:
Starting service CatalinaOct 30, 2014 3:24:15 PM
org.apache.catalina.core.StandardEngine startINFO: Starting Servlet Engine:
Apache Tomcat/6.0.36Oct 30, 2014 3:24:15 PM
org.apache.catalina.startup.HostConfig deployWARINFO: Deploying web application
archive cargocpc.warOct 30, 2014 3:24:15 PM
org.apache.catalina.startup.HostConfig deployWARINFO: Deploying web application
archive sqoop.war2014-10-30 15:24:15,956 INFO
[main] core.SqoopServer (SqoopServer.java:initialize(49)) - Booting up
Sqoop server2014-10-30 15:24:15,963 INFO
[main] core.PropertiesConfigurationProvider
(PropertiesConfigurationProvider.java:initialize(96)) - Starting config file
poller threadlog4j: Parsing for [root] with value=[WARN, file].log4j: Level
token is [WARN].log4j: Category root set to WARNlog4j: Parsing appender named
"file".log4j: Parsing layout options for "file".log4j: Setting property
[conversionPattern] to [%d{ISO8601} %-5p %c{2} [%l] %m%n
].log4j: End of parsing for "file".log4j: Setting property [file] to
[/var/folders/63/m25ltdlj3dd97m9rkjgv7r600000gp/T//sqoop-cargo-tests/org.apache.sqoop.integration.connector.jdbc.generic.FromHDFSToRDBMSTest/testBasic//log/sqoop.log].log4j:
Setting property [maxBackupIndex] to [5].log4j: Setting property [maxFileSize]
to [25MB].log4j: setFile called:
/var/folders/63/m25ltdlj3dd97m9rkjgv7r600000gp/T//sqoop-cargo-tests/org.apache.sqoop.integration.connector.jdbc.generic.FromHDFSToRDBMSTest/testBasic//log/sqoop.log,
truelog4j: setFile endedlog4j: Parsed "file" options.log4j: Parsing for
[org.apache.sqoop] with value=[DEBUG].log4j: Level token is [DEBUG].log4j:
Category org.apache.sqoop set to DEBUGlog4j: Handling
log4j.additivity.org.apache.sqoop=[null]log4j: Parsing for [org.apache.derby]
with value=[INFO].log4j: Level token is [INFO].log4j: Category org.apache.derby
set to INFOlog4j: Handling log4j.additivity.org.apache.derby=[null]log4j:
Finished configuring.Sqoop failed to loa
d:java.lang.RuntimeException: Failure in server initialization
at org.apache.sqoop.core.SqoopServer.initialize(SqoopServer.java:60)
at
org.apache.sqoop.server.ServerInitializer.contextInitialized(ServerInitializer.java:38)
at
org.apache.catalina.core.StandardContext.listenerStart(StandardContext.java:4206)
at
org.apache.catalina.core.StandardContext.start(StandardContext.java:4705)
at
org.apache.catalina.core.ContainerBase.addChildInternal(ContainerBase.java:799)
at
org.apache.catalina.core.ContainerBase.addChild(ContainerBase.java:779)
at org.apache.catalina.core.StandardHost.addChild(StandardHost.java:601)
at org.apache.catalina.startup.HostConfig.deployWAR(HostConfig.java:943)
at org.apache.catalina.startup.HostConfig.deployWARs(HostConfig.java:778)
at org.apache.catalina.startup.HostConfig.deployApps(HostConfig.java:504)
at org.apache.catalina.startup.HostConfig.start(HostConfig.java:1317)
at
org.apache.catalina.startup.HostConfig.lifecycleEvent(HostConfig.java:324)
at
org.apache.catalina.util.LifecycleSupport.fireLifecycleEvent(LifecycleSupport.java:142)
at org.apache.catalina.core.ContainerBase.start(ContainerBase.java:1065)
at org.apache.catalina.core.StandardHost.start(StandardHost.java:840)
at org.apache.catalina.core.ContainerBase.start(ContainerBase.java:1057)
at org.apache.catalina.core.StandardEngine.start(StandardEngine.java:463)
at
org.apache.catalina.core.StandardService.start(StandardService.java:525)
at org.apache.catalina.core.StandardServer.start(StandardServer.java:754)
at org.apache.catalina.startup.Catalina.start(Catalina.java:595)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at org.apache.catalina.startup.Bootstrap.start(Bootstrap.java:289)
at org.apache.catalina.startup.Bootstrap.main(Bootstrap.java:414)Caused
by: org.apache.sqoop.common.SqoopException: AUTH_0004:Invalid FileSystemAccess
security mode - Authentication Handler Class: null
at
org.apache.sqoop.security.AuthenticationHandlerFactory.getAuthenticationHandler(AuthenticationHandlerFactory.java:33)
at
org.apache.sqoop.security.AuthenticationManager.initialize(AuthenticationManager.java:90)
at org.apache.sqoop.core.SqoopServer.initialize(SqoopServer.java:51)
... 25 morePicked up _JAVA_OPTIONS: -Djava.awt.headless=true
Maybe I need to set something in my config? Or the integration tests need a
default?
security/src/main/java/org/apache/sqoop/security/KerberosAuthenticationHandler.java
<https://reviews.apache.org/r/26678/#comment100534>
Copy/paste error maybe?
- Abraham Elmahrek
On Oct. 29, 2014, 2:21 a.m., richard zhou wrote:
>
> -----------------------------------------------------------
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/26678/
> -----------------------------------------------------------
>
> (Updated Oct. 29, 2014, 2:21 a.m.)
>
>
> Review request for Sqoop.
>
>
> Repository: sqoop-sqoop2
>
>
> Description
> -------
>
> Kerberos support when starting service
>
>
> Diffs
> -----
>
> core/src/main/java/org/apache/sqoop/core/SqoopServer.java
> ac836c7cee010144696ab17645ccd008aed5762d
> core/src/main/java/org/apache/sqoop/security/AuthenticationConstants.java
> PRE-CREATION
> core/src/main/java/org/apache/sqoop/security/AuthenticationError.java
> PRE-CREATION
> core/src/main/java/org/apache/sqoop/security/AuthenticationHandler.java
> PRE-CREATION
>
> core/src/main/java/org/apache/sqoop/security/AuthenticationHandlerFactory.java
> PRE-CREATION
> core/src/main/java/org/apache/sqoop/security/AuthenticationManager.java
> PRE-CREATION
> dist/src/main/server/conf/sqoop.properties
> bb010166120321899425f84edb8e1ad6512626d2
> pom.xml f25a29f6db673e6080dcd5ccd51bab76ab38bff4
> security/pom.xml PRE-CREATION
>
> security/src/main/java/org/apache/sqoop/security/KerberosAuthenticationHandler.java
> PRE-CREATION
>
> security/src/main/java/org/apache/sqoop/security/SimpleAuthenticationHandler.java
> PRE-CREATION
> server/pom.xml 67baaa57da9f69f2e8795107ca1b6186eaef2b9c
>
> Diff: https://reviews.apache.org/r/26678/diff/
>
>
> Testing
> -------
>
> No test case till now, becasue there is no minikdc lib in support Hadoop 2
> version (2.2.0).
> For Hadoop 2.2.0, there are only external KDC test cases in Hadoop itself.
> For the latest Hadoop version (2.5.1), there is minikdc lib, which makes
> internal KDC test easily, used by KMS etc. We have mentioned in last regular
> meeting.
>
> If internal KDC is a must have, there are 2 options.
> 1. write similar minikdc code in SQOOP.
> 2. add latest verion of Hadoop (2.5.1) in security component with test scope.
> (prefered)
>
> What do you think? Thanks in advance.
>
>
> Thanks,
>
> richard zhou
>
>