[
https://issues.apache.org/jira/browse/SQOOP-1627?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14217547#comment-14217547
]
Venkat Ranganathan commented on SQOOP-1627:
-------------------------------------------
There are other issues with both hadoop100 and hadoop20 profiles. We have
the tests using Hadoop 2 specific class (and that is also not public :( - I
committed the change as part of Sqlserver Upsert support.
There is another issue with Mainframe support change which is using the
Job.getInstance() but only the deprecated method is available in Hadoop 1.x
And we have a HbaseConfiguration.merge used in HBaseImportJob that breaks the
20 profile.
May be we can decide the Hadoop 1.x and hadoop 20 profile are no longer
supported. But I have added a patch to fix those. I have tested across the
profiles
> Fix Hadoop100 and Hadoop20 profile
> -----------------------------------
>
> Key: SQOOP-1627
> URL: https://issues.apache.org/jira/browse/SQOOP-1627
> Project: Sqoop
> Issue Type: Bug
> Affects Versions: 1.4.6
> Environment: hadoop100 profile
> Reporter: Venkat Ranganathan
>
> ompile:
> [mkdir] Created dir:
> /home/jenkins/jenkins-slave/workspace/Sqoop-ant-jdk-1.6-hadoop100/build/classes
> [javac]
> /home/jenkins/jenkins-slave/workspace/Sqoop-ant-jdk-1.6-hadoop100/build.xml:526:
> warning: 'includeantruntime' was not set, defaulting to
> build.sysclasspath=last; set to false for repeatable builds
> [javac] Compiling 2 source files to
> /home/jenkins/jenkins-slave/workspace/Sqoop-ant-jdk-1.6-hadoop100/build/classes
> [javac]
> /home/jenkins/jenkins-slave/workspace/Sqoop-ant-jdk-1.6-hadoop100/build.xml:539:
> warning: 'includeantruntime' was not set, defaulting to
> build.sysclasspath=last; set to false for repeatable builds
> [javac] Compiling 468 source files to
> /home/jenkins/jenkins-slave/workspace/Sqoop-ant-jdk-1.6-hadoop100/build/classes
> [javac]
> /home/jenkins/jenkins-slave/workspace/Sqoop-ant-jdk-1.6-hadoop100/src/java/org/apache/sqoop/mapreduce/mainframe/MainframeDatasetImportMapper.java:29:
> cannot find symbol
> [javac] symbol : class MultipleOutputs
> [javac] location: package org.apache.hadoop.mapreduce.lib.output
> [javac] import org.apache.hadoop.mapreduce.lib.output.MultipleOutputs;
> [javac] ^
> [javac]
> /home/jenkins/jenkins-slave/workspace/Sqoop-ant-jdk-1.6-hadoop100/src/java/org/apache/sqoop/mapreduce/mainframe/MainframeDatasetImportMapper.java:46:
> cannot find symbol
> [javac] symbol : class MultipleOutputs
> [javac] location: class
> org.apache.sqoop.mapreduce.mainframe.MainframeDatasetImportMapper
> [javac] private MultipleOutputs<Text, NullWritable> mos;
> [javac] ^
> [javac]
> /home/jenkins/jenkins-slave/workspace/Sqoop-ant-jdk-1.6-hadoop100/src/java/org/apache/sqoop/mapreduce/mainframe/MainframeImportJob.java:27:
> cannot find symbol
> [javac] symbol : class LazyOutputFormat
> [javac] location: package org.apache.hadoop.mapreduce.lib.output
> [javac] import org.apache.hadoop.mapreduce.lib.output.LazyOutputFormat;
> [javac] ^
> [javac]
> org/kitesdk/data/mapreduce/DatasetKeyInputFormat.class(org/kitesdk/data/mapreduce:DatasetKeyInputFormat.class):
> warning: Cannot find annotation method 'value()' in type
> 'edu.umd.cs.findbugs.annotations.SuppressWarnings': class file for
> edu.umd.cs.findbugs.annotations.SuppressWarnings not found
> [javac]
> org/kitesdk/data/mapreduce/DatasetKeyInputFormat.class(org/kitesdk/data/mapreduce:DatasetKeyInputFormat.class):
> warning: Cannot find annotation method 'justification()' in type
> 'edu.umd.cs.findbugs.annotations.SuppressWarnings'
> [javac]
> org/kitesdk/data/mapreduce/DatasetKeyInputFormat.class(org/kitesdk/data/mapreduce:DatasetKeyInputFormat.class):
> warning: Cannot find annotation method 'value()' in type
> 'edu.umd.cs.findbugs.annotations.SuppressWarnings'
> [javac]
> org/kitesdk/data/mapreduce/DatasetKeyInputFormat.class(org/kitesdk/data/mapreduce:DatasetKeyInputFormat.class):
> warning: Cannot find annotation method 'justification()' in type
> 'edu.umd.cs.findbugs.annotations.SuppressWarnings'
> [javac]
> /home/jenkins/jenkins-slave/workspace/Sqoop-ant-jdk-1.6-hadoop100/src/java/org/apache/sqoop/mapreduce/mainframe/MainframeDatasetImportMapper.java:63:
> cannot find symbol
> [javac] symbol : class MultipleOutputs
> [javac] location: class
> org.apache.sqoop.mapreduce.mainframe.MainframeDatasetImportMapper
> [javac] mos = new MultipleOutputs<Text, NullWritable>(context);
> [javac] ^
> [javac]
> /home/jenkins/jenkins-slave/workspace/Sqoop-ant-jdk-1.6-hadoop100/src/java/org/apache/sqoop/mapreduce/mainframe/MainframeImportJob.java:68:
> cannot find symbol
> [javac] symbol : variable LazyOutputFormat
> [javac] location: class
> org.apache.sqoop.mapreduce.mainframe.MainframeImportJob
> [javac] LazyOutputFormat.setOutputFormatClass(job,
> getOutputFormatClass());
> [javac] ^
> [javac] Note: Some input files use or override a deprecated API.
> [javac] Note: Recompile with -Xlint:deprecation for details.
> [javac] Note: Some input files use unchecked or unsafe operations.
> [javac] Note: Recompile with -Xlint:unchecked for details.
> [javac] 5 errors
> [javac] 4 warnings
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
