[
https://issues.apache.org/jira/browse/GOBBLIN-700?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16792060#comment-16792060
]
Ankit Gaur commented on GOBBLIN-700:
------------------------------------
[~lesun] That would be great.
What all needs to be updated?
Do we need to update just jobconf.fullyQualifiedPath?
> Unable to run Apache Gobblin Kafka - HDFS USecase
> -------------------------------------------------
>
> Key: GOBBLIN-700
> URL: https://issues.apache.org/jira/browse/GOBBLIN-700
> Project: Apache Gobblin
> Issue Type: Bug
> Components: gobblin-kafka
> Affects Versions: 0.14.0
> Reporter: Ankit Gaur
> Assignee: Shirshanka Das
> Priority: Major
>
> When i try to run a job to ingest data from kafka and put it on HDFS i get
> the following error :-
> i am trying the example in this link :-
> https://gobblin.readthedocs.io/en/latest/case-studies/Kafka-HDFS-Ingestion/
> bash bin/gobblin run -jobName kafkaGobble -jobFile kafka_mr.job
> SLF4J: Class path contains multiple SLF4J bindings.
> SLF4J: Found binding in
> [jar:file:/data2/home-guest/a82250/projects/bom/gobblin-dist/lib/slf4j-log4j12-1.7.21.jar!/org/slf4j/impl/StaticLoggerBinder.class]
> SLF4J: Found binding in
> [jar:file:/opt/cloudera/parcels/CDH-5.12.2-1.cdh5.12.2.p0.4/jars/slf4j-log4j12-1.7.5.jar!/org/slf4j/impl/StaticLoggerBinder.class]
> SLF4J: See [http://www.slf4j.org/codes.html#multiple_bindings] for an
> explanation.
> SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory]
> 2019-03-13 01:40:05 INFO Reflections - Reflections took 477 ms to scan 48
> urls, producing 809 keys and 2849 values
> 2019-03-13 01:40:07 WARN NativeCodeLoader - Unable to load native-hadoop
> library for your platform... using builtin-java classes where applicable
> 2019-03-13 01:40:07 WARN DomainSocketFactory - The short-circuit local reads
> feature cannot be used because libhadoop cannot be loaded.
> Error: Can not create a Path from an empty string
> java.lang.IllegalArgumentException: Can not create a Path from an empty
> string
> at org.apache.hadoop.fs.Path.checkPathArg(Path.java:127)
> at org.apache.hadoop.fs.Path.<init>(Path.java:184)
> at
> org.apache.gobblin.util.PathUtils.getPathWithoutSchemeAndAuthority(PathUtils.java:68)
> at org.apache.gobblin.util.PathUtils.relativizePath(PathUtils.java:47)
> at
> org.apache.gobblin.runtime.job_catalog.ImmutableFSJobCatalog$JobSpecConverter.computeURI(ImmutableFSJobCatalog.java:267)
> at
> org.apache.gobblin.runtime.job_catalog.ImmutableFSJobCatalog$JobSpecConverter.apply(ImmutableFSJobCatalog.java:279)
> at
> org.apache.gobblin.runtime.embedded.EmbeddedGobblin.runAsync(EmbeddedGobblin.java:416)
> at
> org.apache.gobblin.runtime.embedded.EmbeddedGobblin.run(EmbeddedGobblin.java:387)
> at
> org.apache.gobblin.runtime.cli.CliEmbeddedGobblin.run(CliEmbeddedGobblin.java:101)
> at org.apache.gobblin.runtime.cli.GobblinCli.main(GobblinCli.java:43)
> [a82250@usdenprh119 gobblin-dist]$ vi kafka_mr.job
> [a82250@usdenprh119 gobblin-dist]$ hdfs dfs -put -f kafka_mr.job .
> [a82250@usdenprh119 gobblin-dist]$ bash bin/gobblin run -jobName kafkaGobble
> -jobFile kafka_mr.job
> SLF4J: Class path contains multiple SLF4J bindings.
> SLF4J: Found binding in
> [jar:file:/data2/home-guest/a82250/projects/bom/gobblin-dist/lib/slf4j-log4j12-1.7.21.jar!/org/slf4j/impl/StaticLoggerBinder.class]
> SLF4J: Found binding in
> [jar:file:/opt/cloudera/parcels/CDH-5.12.2-1.cdh5.12.2.p0.4/jars/slf4j-log4j12-1.7.5.jar!/org/slf4j/impl/StaticLoggerBinder.class]
> SLF4J: See [http://www.slf4j.org/codes.html#multiple_bindings] for an
> explanation.
> SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory]
> 2019-03-13 01:42:19 INFO Reflections - Reflections took 455 ms to scan 48
> urls, producing 809 keys and 2849 values
> 2019-03-13 01:42:21 WARN NativeCodeLoader - Unable to load native-hadoop
> library for your platform... using builtin-java classes where applicable
> 2019-03-13 01:42:21 WARN DomainSocketFactory - The short-circuit local reads
> feature cannot be used because libhadoop cannot be loaded.
> Error: Can not create a Path from an empty string
> java.lang.IllegalArgumentException: Can not create a Path from an empty
> string
> at org.apache.hadoop.fs.Path.checkPathArg(Path.java:127)
> at org.apache.hadoop.fs.Path.<init>(Path.java:184)
> at
> org.apache.gobblin.util.PathUtils.getPathWithoutSchemeAndAuthority(PathUtils.java:68)
> at org.apache.gobblin.util.PathUtils.relativizePath(PathUtils.java:47)
> at
> org.apache.gobblin.runtime.job_catalog.ImmutableFSJobCatalog$JobSpecConverter.computeURI(ImmutableFSJobCatalog.java:267)
> at
> org.apache.gobblin.runtime.job_catalog.ImmutableFSJobCatalog$JobSpecConverter.apply(ImmutableFSJobCatalog.java:279)
> at
> org.apache.gobblin.runtime.embedded.EmbeddedGobblin.runAsync(EmbeddedGobblin.java:416)
> at
> org.apache.gobblin.runtime.embedded.EmbeddedGobblin.run(EmbeddedGobblin.java:387)
> at
> org.apache.gobblin.runtime.cli.CliEmbeddedGobblin.run(CliEmbeddedGobblin.java:101)
> at org.apache.gobblin.runtime.cli.GobblinCli.main(GobblinCli.java:43)
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
