> On Oct. 30, 2014, 10:29 p.m., Abraham Elmahrek wrote:
> > The integration tests are failing for me:
> > Picked up _JAVA_OPTIONS: -Djava.awt.headless=true
> > Oct 30, 2014 3:24:14 PM
> > org.apache.catalina.startup.ClassLoaderFactory validateFileWARNING: Problem
> > with directory
> > [/private/var/folders/63/m25ltdlj3dd97m9rkjgv7r600000gp/T/cargo/conf/common/classes],
> > exists: [false], isDirectory: [false], canRead: [false]Oct 30, 2014
> > 3:24:14 PM org.apache.catalina.startup.ClassLoaderFactory
> > validateFileWARNING: Problem with directory
> > [/private/var/folders/63/m25ltdlj3dd97m9rkjgv7r600000gp/T/cargo/conf/shared/classes],
> > exists: [false], isDirectory: [false], canRead: [false]Oct 30, 2014
> > 3:24:14 PM org.apache.catalina.startup.ClassLoaderFactory
> > validateFileWARNING: Problem with directory
> > [/private/var/folders/63/m25ltdlj3dd97m9rkjgv7r600000gp/T/cargo/conf/shared/lib],
> > exists: [false], isDirectory: [false], canRead: [false]Oct 30, 2014
> > 3:24:15 PM org.apache.catalina.core.AprLifecycleListener initINFO: The APR
> > based Apache Tomcat Native library which allows optimal performance in
> > production environments was not found on the java.library.path:
:/opt/oracle/instantclient_11_2:/Users/abe/Library/Java/Extensions:/Library/Java/Extensions:/Network/Library/Java/Extensions:/System/Library/Java/Extensions:/usr/lib/java:.Oct
30, 2014 3:24:15 PM org.apache.coyote.http11.Http11Protocol initINFO:
Initializing Coyote HTTP/1.1 on http-8080Oct 30, 2014 3:24:15 PM
org.apache.catalina.startup.Catalina loadINFO: Initialization processed in 504
msOct 30, 2014 3:24:15 PM org.apache.catalina.core.StandardService startINFO:
Starting service CatalinaOct 30, 2014 3:24:15 PM
org.apache.catalina.core.StandardEngine startINFO: Starting Servlet Engine:
Apache Tomcat/6.0.36Oct 30, 2014 3:24:15 PM
org.apache.catalina.startup.HostConfig deployWARINFO: Deploying web application
archive cargocpc.warOct 30, 2014 3:24:15 PM
org.apache.catalina.startup.HostConfig deployWARINFO: Deploying web application
archive sqoop.war2014-10-30 15:24:15,956 INFO
> > [main] core.SqoopServer (SqoopServer.java:initialize(49)) - Booting
> > up Sqoop server2014-10-30 15:24:15,963 INFO
> > [main] core.PropertiesConfigurationProvider
> > (PropertiesConfigurationProvider.java:initialize(96)) - Starting config
> > file poller threadlog4j: Parsing for [root] with value=[WARN, file].log4j:
> > Level token is [WARN].log4j: Category root set to WARNlog4j: Parsing
> > appender named "file".log4j: Parsing layout options for "file".log4j:
> > Setting property [conversionPattern] to [%d{ISO8601} %-5p %c{2} [%l] %m%n
> > ].log4j: End of parsing for "file".log4j: Setting property [file] to
> > [/var/folders/63/m25ltdlj3dd97m9rkjgv7r600000gp/T//sqoop-cargo-tests/org.apache.sqoop.integration.connector.jdbc.generic.FromHDFSToRDBMSTest/testBasic//log/sqoop.log].log4j:
> > Setting property [maxBackupIndex] to [5].log4j: Setting property
> > [maxFileSize] to [25MB].log4j: setFile called:
> > /var/folders/63/m25ltdlj3dd97m9rkjgv7r600000gp/T//sqoop-cargo-tests/org.apache.sqoop.integration.connector.jdbc.generic.FromHDFSToRDBMSTest/testBasic//log/sqoop.log,
> > truelog4j: setFile endedlog4j: Parsed "file" options.log4j: Parsing for
> > [org.apache.sqoop] with value=[DEBUG].log4j: Level token is [DEBUG].log4j:
> > Category org.apache.sqoop set to DEBUGlog4j: Handling
> > log4j.additivity.org.apache.sqoop=[null]log4j: Parsing for
> > [org.apache.derby] with value=[INFO].log4j: Level token is [INFO].log4j:
> > Category org.apache.derby set to INFOlog4j: Handling
> > log4j.additivity.org.apache.derby=[null]log4j: Finished configuring.Sqoop
> > failed to
load:java.lang.RuntimeException: Failure in server initialization
> > at org.apache.sqoop.core.SqoopServer.initialize(SqoopServer.java:60)
> > at
> > org.apache.sqoop.server.ServerInitializer.contextInitialized(ServerInitializer.java:38)
> > at
> > org.apache.catalina.core.StandardContext.listenerStart(StandardContext.java:4206)
> > at
> > org.apache.catalina.core.StandardContext.start(StandardContext.java:4705)
> > at
> > org.apache.catalina.core.ContainerBase.addChildInternal(ContainerBase.java:799)
> > at
> > org.apache.catalina.core.ContainerBase.addChild(ContainerBase.java:779)
> > at
> > org.apache.catalina.core.StandardHost.addChild(StandardHost.java:601)
> > at
> > org.apache.catalina.startup.HostConfig.deployWAR(HostConfig.java:943)
> > at
> > org.apache.catalina.startup.HostConfig.deployWARs(HostConfig.java:778)
> > at
> > org.apache.catalina.startup.HostConfig.deployApps(HostConfig.java:504)
> > at org.apache.catalina.startup.HostConfig.start(HostConfig.java:1317)
> > at
> > org.apache.catalina.startup.HostConfig.lifecycleEvent(HostConfig.java:324)
> > at
> > org.apache.catalina.util.LifecycleSupport.fireLifecycleEvent(LifecycleSupport.java:142)
> > at
> > org.apache.catalina.core.ContainerBase.start(ContainerBase.java:1065)
> > at org.apache.catalina.core.StandardHost.start(StandardHost.java:840)
> > at
> > org.apache.catalina.core.ContainerBase.start(ContainerBase.java:1057)
> > at
> > org.apache.catalina.core.StandardEngine.start(StandardEngine.java:463)
> > at
> > org.apache.catalina.core.StandardService.start(StandardService.java:525)
> > at
> > org.apache.catalina.core.StandardServer.start(StandardServer.java:754)
> > at org.apache.catalina.startup.Catalina.start(Catalina.java:595)
> > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> > at
> > sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
> > at
> > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> > at java.lang.reflect.Method.invoke(Method.java:606)
> > at org.apache.catalina.startup.Bootstrap.start(Bootstrap.java:289)
> > at
> > org.apache.catalina.startup.Bootstrap.main(Bootstrap.java:414)Caused by:
> > org.apache.sqoop.common.SqoopException: AUTH_0004:Invalid FileSystemAccess
> > security mode - Authentication Handler Class: null
> > at
> > org.apache.sqoop.security.AuthenticationHandlerFactory.getAuthenticationHandler(AuthenticationHandlerFactory.java:33)
> > at
> > org.apache.sqoop.security.AuthenticationManager.initialize(AuthenticationManager.java:90)
> > at org.apache.sqoop.core.SqoopServer.initialize(SqoopServer.java:51)
> > ... 25 morePicked up _JAVA_OPTIONS: -Djava.awt.headless=true
> >
> > Maybe I need to set something in my config? Or the integration tests need a
> > default?
Please add below config in sqoop.properties. This should be in the diff.patch.
Not sure why you do not have such config.
==============================================================================================================
#
# Authentication configuration
#
org.apache.sqoop.authentication.type=SIMPLE
org.apache.sqoop.authentication.handler=org.apache.sqoop.security.SimpleAuthenticationHandler
#org.apache.sqoop.authentication.type=KERBEROS
#org.apache.sqoop.authentication.handler=org.apache.sqoop.security.KerberosAuthenticationHandler
#org.apache.sqoop.authentication.kerberos.principal=sqoop/_HOST@NOVALOCAL
#org.apache.sqoop.authentication.kerberos.keytab=/home/kerberos/sqoop.keytab
==============================================================================================================
- richard
-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/26678/#review59268
-----------------------------------------------------------
On Oct. 29, 2014, 2:21 a.m., richard zhou wrote:
>
> -----------------------------------------------------------
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/26678/
> -----------------------------------------------------------
>
> (Updated Oct. 29, 2014, 2:21 a.m.)
>
>
> Review request for Sqoop.
>
>
> Repository: sqoop-sqoop2
>
>
> Description
> -------
>
> Kerberos support when starting service
>
>
> Diffs
> -----
>
> core/src/main/java/org/apache/sqoop/core/SqoopServer.java
> ac836c7cee010144696ab17645ccd008aed5762d
> core/src/main/java/org/apache/sqoop/security/AuthenticationConstants.java
> PRE-CREATION
> core/src/main/java/org/apache/sqoop/security/AuthenticationError.java
> PRE-CREATION
> core/src/main/java/org/apache/sqoop/security/AuthenticationHandler.java
> PRE-CREATION
>
> core/src/main/java/org/apache/sqoop/security/AuthenticationHandlerFactory.java
> PRE-CREATION
> core/src/main/java/org/apache/sqoop/security/AuthenticationManager.java
> PRE-CREATION
> dist/src/main/server/conf/sqoop.properties
> bb010166120321899425f84edb8e1ad6512626d2
> pom.xml f25a29f6db673e6080dcd5ccd51bab76ab38bff4
> security/pom.xml PRE-CREATION
>
> security/src/main/java/org/apache/sqoop/security/KerberosAuthenticationHandler.java
> PRE-CREATION
>
> security/src/main/java/org/apache/sqoop/security/SimpleAuthenticationHandler.java
> PRE-CREATION
> server/pom.xml 67baaa57da9f69f2e8795107ca1b6186eaef2b9c
>
> Diff: https://reviews.apache.org/r/26678/diff/
>
>
> Testing
> -------
>
> No test case till now, becasue there is no minikdc lib in support Hadoop 2
> version (2.2.0).
> For Hadoop 2.2.0, there are only external KDC test cases in Hadoop itself.
> For the latest Hadoop version (2.5.1), there is minikdc lib, which makes
> internal KDC test easily, used by KMS etc. We have mentioned in last regular
> meeting.
>
> If internal KDC is a must have, there are 2 options.
> 1. write similar minikdc code in SQOOP.
> 2. add latest verion of Hadoop (2.5.1) in security component with test scope.
> (prefered)
>
> What do you think? Thanks in advance.
>
>
> Thanks,
>
> richard zhou
>
>
