[
https://issues.apache.org/jira/browse/SQOOP-1879?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14247807#comment-14247807
]
Abraham Elmahrek commented on SQOOP-1879:
-----------------------------------------
[~vybs], In general, I'm +1. I'm having trouble getting this to work though:
{noformat}
mvn clean verify
-Dsqoop.hadoop.runner.class=org.apache.sqoop.test.hadoop.HadoopLocalRunner -pl
test
...
vim
test/target/surefire-reports/TEST-org.apache.sqoop.integration.connector.jdbc.generic.FromHDFSToRDBMSTest.xml
...
java.lang.NullPointerException
at org.apache.hadoop.mapred.JobID.downgrade(JobID.java:67)
at
org.apache.hadoop.mapred.LocalJobRunner.getJobStatus(LocalJobRunner.java:762)
at org.apache.hadoop.mapreduce.Cluster.getJob(Cluster.java:183)
at org.apache.hadoop.mapred.JobClient$2.run(JobClient.java:580)
at org.apache.hadoop.mapred.JobClient$2.run(JobClient.java:578)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:415)
at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1614)
at org.apache.hadoop.mapred.JobClient.getJobUsingCluster(JobClient.java:578)
at org.apache.hadoop.mapred.JobClient.getJob(JobClient.java:596)
at
org.apache.sqoop.submission.mapreduce.MapreduceSubmissionEngine.update(MapreduceSubmissionEngine.java:427)
at
org.apache.sqoop.submission.mapreduce.MapreduceSubmissionEngine.submit(MapreduceSubmissionEngine.java:257)
at org.apache.sqoop.driver.JobManager.start(JobManager.java:287)
at
org.apache.sqoop.handler.JobRequestHandler.startJob(JobRequestHandler.java:367)
at
org.apache.sqoop.handler.JobRequestHandler.handleEvent(JobRequestHandler.java:113)
at org.apache.sqoop.server.v1.JobServlet.handlePutRequest(JobServlet.java:96)
at
org.apache.sqoop.server.SqoopProtocolServlet.doPut(SqoopProtocolServlet.java:79)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:640)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:717)
at
org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:290)
at
org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
at
org.apache.hadoop.security.authentication.server.AuthenticationFilter.doFilter(AuthenticationFilter.java:396)
at
org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235)
at
org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
at
org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:233)
at
org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:191)
at
org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:127)
at
org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:103)
at
org.apache.catalina.valves.AccessLogValve.invoke(AccessLogValve.java:615)
at
org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:109)
at
org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:293)
at org.apache.coyote.http11.Http11Processor.process(Http11Processor.java:861)
at
org.apache.coyote.http11.Http11Protocol$Http11ConnectionHandler.process(Http11Protocol.java:606)
at org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:489)
at java.lang.Thread.run(Thread.java:745)
{noformat}
Thoughts?
> Sqoop2: Submission Engine does not set all details on SubmissionRecord in
> Local mode
> ------------------------------------------------------------------------------------
>
> Key: SQOOP-1879
> URL: https://issues.apache.org/jira/browse/SQOOP-1879
> Project: Sqoop
> Issue Type: Sub-task
> Reporter: Veena Basavaraj
> Assignee: Veena Basavaraj
> Attachments: SQOOP-1879-v1.patch, SQOOP-1879-v2.patch,
> SQOOP-1879-v4.patch
>
>
> {code}
> // If we're in local mode than wait on completion. Local job runner do
> not
> // seems to be exposing API to get previously submitted job which makes
> // other methods of the submission engine quite useless.
> if(isLocal()) {
> job.waitForCompletion(true);
> } else {
> job.submit();
> }
> {code}
> the above code says that the job.waitForCompletion(true) is blocking and
> hence the other submisison engine apis are useless in this local mode.
> But we dont set the all attributes of the job run into the submission record
> in this case
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
