Ankit Gaur created GOBBLIN-700:
----------------------------------
Summary: Unable to run Apache Gobblin Kafka - HDFS USecase
Key: GOBBLIN-700
URL: https://issues.apache.org/jira/browse/GOBBLIN-700
Project: Apache Gobblin
Issue Type: Bug
Components: gobblin-kafka
Affects Versions: 0.14.0
Reporter: Ankit Gaur
Assignee: Shirshanka Das
When i try to run a job to ingest data from kafka and put it on HDFS i get the
following error :-
bash bin/gobblin run -jobName kafkaGobble -jobFile kafka_mr.job
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in
[jar:file:/data2/home-guest/a82250/projects/bom/gobblin-dist/lib/slf4j-log4j12-1.7.21.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in
[jar:file:/opt/cloudera/parcels/CDH-5.12.2-1.cdh5.12.2.p0.4/jars/slf4j-log4j12-1.7.5.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory]
2019-03-13 01:40:05 INFO Reflections - Reflections took 477 ms to scan 48 urls,
producing 809 keys and 2849 values
2019-03-13 01:40:07 WARN NativeCodeLoader - Unable to load native-hadoop
library for your platform... using builtin-java classes where applicable
2019-03-13 01:40:07 WARN DomainSocketFactory - The short-circuit local reads
feature cannot be used because libhadoop cannot be loaded.
Error: Can not create a Path from an empty string
java.lang.IllegalArgumentException: Can not create a Path from an empty string
at org.apache.hadoop.fs.Path.checkPathArg(Path.java:127)
at org.apache.hadoop.fs.Path.<init>(Path.java:184)
at
org.apache.gobblin.util.PathUtils.getPathWithoutSchemeAndAuthority(PathUtils.java:68)
at org.apache.gobblin.util.PathUtils.relativizePath(PathUtils.java:47)
at
org.apache.gobblin.runtime.job_catalog.ImmutableFSJobCatalog$JobSpecConverter.computeURI(ImmutableFSJobCatalog.java:267)
at
org.apache.gobblin.runtime.job_catalog.ImmutableFSJobCatalog$JobSpecConverter.apply(ImmutableFSJobCatalog.java:279)
at
org.apache.gobblin.runtime.embedded.EmbeddedGobblin.runAsync(EmbeddedGobblin.java:416)
at
org.apache.gobblin.runtime.embedded.EmbeddedGobblin.run(EmbeddedGobblin.java:387)
at
org.apache.gobblin.runtime.cli.CliEmbeddedGobblin.run(CliEmbeddedGobblin.java:101)
at org.apache.gobblin.runtime.cli.GobblinCli.main(GobblinCli.java:43)
[a82250@usdenprh119 gobblin-dist]$ vi kafka_mr.job
[a82250@usdenprh119 gobblin-dist]$ hdfs dfs -put -f kafka_mr.job .
[a82250@usdenprh119 gobblin-dist]$ bash bin/gobblin run -jobName kafkaGobble
-jobFile kafka_mr.job
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in
[jar:file:/data2/home-guest/a82250/projects/bom/gobblin-dist/lib/slf4j-log4j12-1.7.21.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in
[jar:file:/opt/cloudera/parcels/CDH-5.12.2-1.cdh5.12.2.p0.4/jars/slf4j-log4j12-1.7.5.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory]
2019-03-13 01:42:19 INFO Reflections - Reflections took 455 ms to scan 48 urls,
producing 809 keys and 2849 values
2019-03-13 01:42:21 WARN NativeCodeLoader - Unable to load native-hadoop
library for your platform... using builtin-java classes where applicable
2019-03-13 01:42:21 WARN DomainSocketFactory - The short-circuit local reads
feature cannot be used because libhadoop cannot be loaded.
Error: Can not create a Path from an empty string
java.lang.IllegalArgumentException: Can not create a Path from an empty string
at org.apache.hadoop.fs.Path.checkPathArg(Path.java:127)
at org.apache.hadoop.fs.Path.<init>(Path.java:184)
at
org.apache.gobblin.util.PathUtils.getPathWithoutSchemeAndAuthority(PathUtils.java:68)
at org.apache.gobblin.util.PathUtils.relativizePath(PathUtils.java:47)
at
org.apache.gobblin.runtime.job_catalog.ImmutableFSJobCatalog$JobSpecConverter.computeURI(ImmutableFSJobCatalog.java:267)
at
org.apache.gobblin.runtime.job_catalog.ImmutableFSJobCatalog$JobSpecConverter.apply(ImmutableFSJobCatalog.java:279)
at
org.apache.gobblin.runtime.embedded.EmbeddedGobblin.runAsync(EmbeddedGobblin.java:416)
at
org.apache.gobblin.runtime.embedded.EmbeddedGobblin.run(EmbeddedGobblin.java:387)
at
org.apache.gobblin.runtime.cli.CliEmbeddedGobblin.run(CliEmbeddedGobblin.java:101)
at org.apache.gobblin.runtime.cli.GobblinCli.main(GobblinCli.java:43)
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)