Arpit Shah created ATLAS-4264:
---------------------------------
Summary: SqoopHook throwing an error
Key: ATLAS-4264
URL: https://issues.apache.org/jira/browse/ATLAS-4264
Project: Atlas
Issue Type: Bug
Components: sqoop-integration
Affects Versions: 2.1.0
Environment: Linux
Reporter: Arpit Shah
Hi all,
I am exploring the apache atlas. I am trying to configure sqoop hook for Atlas
but facing the error.
I have configured Apache Atlas 2.1.0 with Hbase and elasticsearch.
I am using sqoop 1.4.7 with Hadoop version 3.3.0.
I have followed all the steps for configuring SqoopHook mentioned in the atlas
doc.
I am facing the below error after the successful completion of the map-reduce
job.
org.apache.atlas.AtlasException: Failed to load application properties
at
org.apache.atlas.ApplicationProperties.get(ApplicationProperties.java:147)
at
org.apache.atlas.ApplicationProperties.get(ApplicationProperties.java:100)
at org.apache.atlas.hook.AtlasHook.<clinit>(AtlasHook.java:80)
at org.apache.atlas.sqoop.hook.SqoopHook.<clinit>(SqoopHook.java:82)
at java.lang.Class.forName0(Native Method)
at java.lang.Class.forName(Class.java:264)
at
org.apache.sqoop.mapreduce.PublishJobData.publishJobData(PublishJobData.java:46)
at
org.apache.sqoop.mapreduce.ImportJobBase.runImport(ImportJobBase.java:284)
at org.apache.sqoop.manager.SqlManager.importTable(SqlManager.java:692)
at
org.apache.sqoop.manager.MySQLManager.importTable(MySQLManager.java:127)
at org.apache.sqoop.tool.ImportTool.importTable(ImportTool.java:520)
at org.apache.sqoop.tool.ImportTool.run(ImportTool.java:628)
at org.apache.sqoop.Sqoop.run(Sqoop.java:147)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:76)
at org.apache.sqoop.Sqoop.runSqoop(Sqoop.java:183)
at org.apache.sqoop.Sqoop.runTool(Sqoop.java:234)
at org.apache.sqoop.Sqoop.runTool(Sqoop.java:243)
at org.apache.sqoop.Sqoop.main(Sqoop.java:252)
Caused by: org.apache.commons.configuration.ConversionException:
'atlas.graph.index.search.max-result-set-size' doesn't map to a List object:
500000, a java.lang.Integer
at
org.apache.commons.configuration.AbstractConfiguration.getList(AbstractConfiguration.java:1144)
at
org.apache.commons.configuration.AbstractConfiguration.getList(AbstractConfiguration.java:1109)
at
org.apache.commons.configuration.AbstractConfiguration.interpolatedConfiguration(AbstractConfiguration.java:1274)
at
org.apache.atlas.ApplicationProperties.get(ApplicationProperties.java:142)
... 17 more
Exception in thread "main" java.lang.ExceptionInInitializerError
at org.apache.atlas.sqoop.hook.SqoopHook.<clinit>(SqoopHook.java:82)
at java.lang.Class.forName0(Native Method)
at java.lang.Class.forName(Class.java:264)
at
org.apache.sqoop.mapreduce.PublishJobData.publishJobData(PublishJobData.java:46)
at
org.apache.sqoop.mapreduce.ImportJobBase.runImport(ImportJobBase.java:284)
at org.apache.sqoop.manager.SqlManager.importTable(SqlManager.java:692)
at
org.apache.sqoop.manager.MySQLManager.importTable(MySQLManager.java:127)
at org.apache.sqoop.tool.ImportTool.importTable(ImportTool.java:520)
at org.apache.sqoop.tool.ImportTool.run(ImportTool.java:628)
at org.apache.sqoop.Sqoop.run(Sqoop.java:147)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:76)
at org.apache.sqoop.Sqoop.runSqoop(Sqoop.java:183)
at org.apache.sqoop.Sqoop.runTool(Sqoop.java:234)
at org.apache.sqoop.Sqoop.runTool(Sqoop.java:243)
at org.apache.sqoop.Sqoop.main(Sqoop.java:252)
Caused by: java.lang.NullPointerException
at org.apache.atlas.hook.AtlasHook.<clinit>(AtlasHook.java:85)
... 15 more
--
This message was sent by Atlassian Jira
(v8.3.4#803005)