[
https://issues.apache.org/jira/browse/ATLAS-4654?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17677409#comment-17677409
]
Sheetal Shah commented on ATLAS-4654:
-------------------------------------
[~O.Tougui] , we ran the same sqoop import command mentioned in description and
it ran successfully without producing any errors.
Following are the application versions with which we tested:
• Sqoop 1.4.7
• Postgresql 12
• apache-atlas 2.3.0
• sqoop hook required
jar-atlas-plugin-classloader-3.0.0-SNAPSHOT.jar,atlas-sqoop-plugin-impl,sqoop-bridge-shim-3.0.0-SNAPSHOT.jar
The property value used in application.properties file to run this command:
{code:java}
# Solr-specific configuration property
atlas.graph.index.search.max-result-set-size=150 {code}
Stack-trace produced after running this command:
{code:java}
2023-01-12 09:46:39,755 INFO mapreduce.ImportJobBase: Transferred 0 bytes in
2.2808 seconds (0 bytes/sec)
2023-01-12 09:46:39,756 INFO mapreduce.ImportJobBase: Retrieved 0 records.
2023-01-12 09:46:39,756 INFO mapreduce.ImportJobBase: Publishing Hive/Hcat
import job data to Listeners for table supplies
2023-01-12 09:46:39,842 INFO atlas.ApplicationProperties: Looking for
atlas-application.properties in classpath
2023-01-12 09:46:39,843 INFO atlas.ApplicationProperties: Loading
atlas-application.properties from
file:/usr/lib/sqoop-1.4.7.bin__hadoop-2.6.0/conf/atlas-application.properties
2023-01-12 09:46:39,883 INFO atlas.ApplicationProperties: Using graphdb backend
'janus'
2023-01-12 09:46:39,883 INFO atlas.ApplicationProperties: Using storage backend
'hbase2'
2023-01-12 09:46:39,883 INFO atlas.ApplicationProperties: Using index backend
'solr5'
2023-01-12 09:46:39,883 INFO atlas.ApplicationProperties: Setting
atlas.graph.index.search.max-result-set-size = 150
2023-01-12 09:46:39,885 INFO atlas.ApplicationProperties: Setting
atlas.graph.index.search.solr.wait-searcher = false
2023-01-12 09:46:40,540 INFO notification.LogConfigUtils: Could not infer log
path from this appender: org.apache.logging.log4j.core.appender.ConsoleAppender
2023-01-12 09:46:40,540 INFO notification.LogConfigUtils:
getFileAppenderPath(): ret=
2023-01-12 09:46:40,541 INFO notification.LogConfigUtils:
getFileAppenderPathApproach2(): ret=
2023-01-12 09:46:40,541 INFO notification.LogConfigUtils: getRootDir(): ret=null
{code}
Kindly share your atlas-application.properties file and versions of
applications that you are using.
CC : [~jayendrap]
> 'atlas.graph.index.search.max-result-set-size' doesn't map to a List object:
> 150
> --------------------------------------------------------------------------------
>
> Key: ATLAS-4654
> URL: https://issues.apache.org/jira/browse/ATLAS-4654
> Project: Atlas
> Issue Type: Bug
> Components: atlas-intg
> Affects Versions: 2.3.0
> Reporter: Omar Tougui
> Priority: Blocker
>
> when I run the following sqoop command :
>
>
> {{sqoop import --connect jdbc:postgresql://server/db --username user -P
> --table tab --hive-import --create-hive-table}}
> {{}}
> {{I get this error:}}
> {{}}
>
> {{{}22/08/01 16:44:51 INFO atlas.ApplicationProperties: Setting
> atlas.graph.index.search.max-result-set-size = 150
> 22/08/01 16:44:51 INFO atlas.ApplicationProperties: Setting
> atlas.graph.index.search.solr.wait-searcher = false
> 22/08/01 16:44:51 INFO atlas.ApplicationProperties: Property (set to default)
> atlas.graph.cache.db-cache = true
> 22/08/01 16:44:51 INFO atlas.ApplicationProperties: Property (set to default)
> atlas.graph.cache.db-cache-clean-wait = 20
> 22/08/01 16:44:51 INFO atlas.ApplicationProperties: Property (set to default)
> atlas.graph.cache.db-cache-size = 0.5
> 22/08/01 16:44:51 INFO atlas.ApplicationProperties: Property (set to default)
> atlas.graph.cache.tx-cache-size = 15000
> 22/08/01 16:44:51 INFO atlas.ApplicationProperties: Property (set to default)
> atlas.graph.cache.tx-dirty-size = 120
> 22/08/01 16:44:51 INFO hook.AtlasHook: Failed to load application properties
> org.apache.atlas.AtlasException: Failed to load application properties
> at
> org.apache.atlas.ApplicationProperties.get(ApplicationProperties.java:155)
> at
> org.apache.atlas.ApplicationProperties.get(ApplicationProperties.java:108)
> at org.apache.atlas.hook.AtlasHook.<clinit>(AtlasHook.java:82)
> at org.apache.atlas.sqoop.hook.SqoopHook.<clinit>(SqoopHook.java:86)
> at java.lang.Class.forName0(Native Method)
> at java.lang.Class.forName(Class.java:264)
> at
> org.apache.sqoop.mapreduce.PublishJobData.publishJobData(PublishJobData.java:46)
> at
> org.apache.sqoop.mapreduce.ImportJobBase.runImport(ImportJobBase.java:284)
> at
> org.apache.sqoop.manager.SqlManager.importTable(SqlManager.java:692)
> at
> org.apache.sqoop.manager.PostgresqlManager.importTable(PostgresqlManager.java:127)
> at org.apache.sqoop.tool.ImportTool.importTable(ImportTool.java:520)
> at org.apache.sqoop.tool.ImportTool.run(ImportTool.java:628)
> at org.apache.sqoop.Sqoop.run(Sqoop.java:147)
> at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
> at org.apache.sqoop.Sqoop.runSqoop(Sqoop.java:183)
> at org.apache.sqoop.Sqoop.runTool(Sqoop.java:234)
> at org.apache.sqoop.Sqoop.runTool(Sqoop.java:243)
> at org.apache.sqoop.Sqoop.main(Sqoop.java:252)
> Caused by: org.apache.commons.configuration.ConversionException:
> 'atlas.graph.index.search.max-result-set-size' doesn't map to a List object:
> 150, a java.lang.Integer
> at
> org.apache.commons.configuration.AbstractConfiguration.getList(AbstractConfiguration.java:1144)
> at
> org.apache.commons.configuration.AbstractConfiguration.getList(AbstractConfiguration.java:1109)
> at
> org.apache.commons.configuration.AbstractConfiguration.interpolatedConfiguration(AbstractConfiguration.java:1274)
> at
> org.apache.atlas.ApplicationProperties.get(ApplicationProperties.java:150)
> ... 17 more
> Exception in thread "main" java.lang.ExceptionInInitializerError
> at org.apache.atlas.sqoop.hook.SqoopHook.<clinit>(SqoopHook.java:86)
> at java.lang.Class.forName0(Native Method)
> at java.lang.Class.forName(Class.java:264)
> at
> org.apache.sqoop.mapreduce.PublishJobData.publishJobData(PublishJobData.java:46)
> at
> org.apache.sqoop.mapreduce.ImportJobBase.runImport(ImportJobBase.java:284)
> at
> org.apache.sqoop.manager.SqlManager.importTable(SqlManager.java:692)
> at
> org.apache.sqoop.manager.PostgresqlManager.importTable(PostgresqlManager.java:127)
> at org.apache.sqoop.tool.ImportTool.importTable(ImportTool.java:520)
> at org.apache.sqoop.tool.ImportTool.run(ImportTool.java:628)
> at org.apache.sqoop.Sqoop.run(Sqoop.java:147)
> at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
> at org.apache.sqoop.Sqoop.runSqoop(Sqoop.java:183)
> at org.apache.sqoop.Sqoop.runTool(Sqoop.java:234)
> at org.apache.sqoop.Sqoop.runTool(Sqoop.java:243)
> at org.apache.sqoop.Sqoop.main(Sqoop.java:252)
> Caused by: java.lang.NullPointerException
> at org.apache.atlas.hook.AtlasHook.<clinit>(AtlasHook.java:87)
> ... 15 more{}}}{{{}{}}}{{{}{}}}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
