[
https://issues.apache.org/jira/browse/GOBBLIN-700?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ankit Gaur updated GOBBLIN-700:
-------------------------------
Description:
When i try to run a job to ingest data from kafka and put it on HDFS i get the
following error :-
i am trying the example in this link :-
https://gobblin.readthedocs.io/en/latest/case-studies/Kafka-HDFS-Ingestion/
bash bin/gobblin run -jobName kafkaGobble -jobFile kafka_mr.job
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in
[jar:file:/data2/home-guest/a82250/projects/bom/gobblin-dist/lib/slf4j-log4j12-1.7.21.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in
[jar:file:/opt/cloudera/parcels/CDH-5.12.2-1.cdh5.12.2.p0.4/jars/slf4j-log4j12-1.7.5.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See [http://www.slf4j.org/codes.html#multiple_bindings] for an
explanation.
SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory]
2019-03-13 01:40:05 INFO Reflections - Reflections took 477 ms to scan 48
urls, producing 809 keys and 2849 values
2019-03-13 01:40:07 WARN NativeCodeLoader - Unable to load native-hadoop
library for your platform... using builtin-java classes where applicable
2019-03-13 01:40:07 WARN DomainSocketFactory - The short-circuit local reads
feature cannot be used because libhadoop cannot be loaded.
Error: Can not create a Path from an empty string
java.lang.IllegalArgumentException: Can not create a Path from an empty string
at org.apache.hadoop.fs.Path.checkPathArg(Path.java:127)
at org.apache.hadoop.fs.Path.<init>(Path.java:184)
at
org.apache.gobblin.util.PathUtils.getPathWithoutSchemeAndAuthority(PathUtils.java:68)
at org.apache.gobblin.util.PathUtils.relativizePath(PathUtils.java:47)
at
org.apache.gobblin.runtime.job_catalog.ImmutableFSJobCatalog$JobSpecConverter.computeURI(ImmutableFSJobCatalog.java:267)
at
org.apache.gobblin.runtime.job_catalog.ImmutableFSJobCatalog$JobSpecConverter.apply(ImmutableFSJobCatalog.java:279)
at
org.apache.gobblin.runtime.embedded.EmbeddedGobblin.runAsync(EmbeddedGobblin.java:416)
at
org.apache.gobblin.runtime.embedded.EmbeddedGobblin.run(EmbeddedGobblin.java:387)
at
org.apache.gobblin.runtime.cli.CliEmbeddedGobblin.run(CliEmbeddedGobblin.java:101)
at org.apache.gobblin.runtime.cli.GobblinCli.main(GobblinCli.java:43)
[a82250@usdenprh119 gobblin-dist]$ vi kafka_mr.job
[a82250@usdenprh119 gobblin-dist]$ hdfs dfs -put -f kafka_mr.job .
[a82250@usdenprh119 gobblin-dist]$ bash bin/gobblin run -jobName kafkaGobble
-jobFile kafka_mr.job
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in
[jar:file:/data2/home-guest/a82250/projects/bom/gobblin-dist/lib/slf4j-log4j12-1.7.21.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in
[jar:file:/opt/cloudera/parcels/CDH-5.12.2-1.cdh5.12.2.p0.4/jars/slf4j-log4j12-1.7.5.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See [http://www.slf4j.org/codes.html#multiple_bindings] for an
explanation.
SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory]
2019-03-13 01:42:19 INFO Reflections - Reflections took 455 ms to scan 48
urls, producing 809 keys and 2849 values
2019-03-13 01:42:21 WARN NativeCodeLoader - Unable to load native-hadoop
library for your platform... using builtin-java classes where applicable
2019-03-13 01:42:21 WARN DomainSocketFactory - The short-circuit local reads
feature cannot be used because libhadoop cannot be loaded.
Error: Can not create a Path from an empty string
java.lang.IllegalArgumentException: Can not create a Path from an empty string
at org.apache.hadoop.fs.Path.checkPathArg(Path.java:127)
at org.apache.hadoop.fs.Path.<init>(Path.java:184)
at
org.apache.gobblin.util.PathUtils.getPathWithoutSchemeAndAuthority(PathUtils.java:68)
at org.apache.gobblin.util.PathUtils.relativizePath(PathUtils.java:47)
at
org.apache.gobblin.runtime.job_catalog.ImmutableFSJobCatalog$JobSpecConverter.computeURI(ImmutableFSJobCatalog.java:267)
at
org.apache.gobblin.runtime.job_catalog.ImmutableFSJobCatalog$JobSpecConverter.apply(ImmutableFSJobCatalog.java:279)
at
org.apache.gobblin.runtime.embedded.EmbeddedGobblin.runAsync(EmbeddedGobblin.java:416)
at
org.apache.gobblin.runtime.embedded.EmbeddedGobblin.run(EmbeddedGobblin.java:387)
at
org.apache.gobblin.runtime.cli.CliEmbeddedGobblin.run(CliEmbeddedGobblin.java:101)
at org.apache.gobblin.runtime.cli.GobblinCli.main(GobblinCli.java:43)
was:
When i try to run a job to ingest data from kafka and put it on HDFS i get the
following error :-
bash bin/gobblin run -jobName kafkaGobble -jobFile kafka_mr.job
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in
[jar:file:/data2/home-guest/a82250/projects/bom/gobblin-dist/lib/slf4j-log4j12-1.7.21.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in
[jar:file:/opt/cloudera/parcels/CDH-5.12.2-1.cdh5.12.2.p0.4/jars/slf4j-log4j12-1.7.5.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory]
2019-03-13 01:40:05 INFO Reflections - Reflections took 477 ms to scan 48 urls,
producing 809 keys and 2849 values
2019-03-13 01:40:07 WARN NativeCodeLoader - Unable to load native-hadoop
library for your platform... using builtin-java classes where applicable
2019-03-13 01:40:07 WARN DomainSocketFactory - The short-circuit local reads
feature cannot be used because libhadoop cannot be loaded.
Error: Can not create a Path from an empty string
java.lang.IllegalArgumentException: Can not create a Path from an empty string
at org.apache.hadoop.fs.Path.checkPathArg(Path.java:127)
at org.apache.hadoop.fs.Path.<init>(Path.java:184)
at
org.apache.gobblin.util.PathUtils.getPathWithoutSchemeAndAuthority(PathUtils.java:68)
at org.apache.gobblin.util.PathUtils.relativizePath(PathUtils.java:47)
at
org.apache.gobblin.runtime.job_catalog.ImmutableFSJobCatalog$JobSpecConverter.computeURI(ImmutableFSJobCatalog.java:267)
at
org.apache.gobblin.runtime.job_catalog.ImmutableFSJobCatalog$JobSpecConverter.apply(ImmutableFSJobCatalog.java:279)
at
org.apache.gobblin.runtime.embedded.EmbeddedGobblin.runAsync(EmbeddedGobblin.java:416)
at
org.apache.gobblin.runtime.embedded.EmbeddedGobblin.run(EmbeddedGobblin.java:387)
at
org.apache.gobblin.runtime.cli.CliEmbeddedGobblin.run(CliEmbeddedGobblin.java:101)
at org.apache.gobblin.runtime.cli.GobblinCli.main(GobblinCli.java:43)
[a82250@usdenprh119 gobblin-dist]$ vi kafka_mr.job
[a82250@usdenprh119 gobblin-dist]$ hdfs dfs -put -f kafka_mr.job .
[a82250@usdenprh119 gobblin-dist]$ bash bin/gobblin run -jobName kafkaGobble
-jobFile kafka_mr.job
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in
[jar:file:/data2/home-guest/a82250/projects/bom/gobblin-dist/lib/slf4j-log4j12-1.7.21.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in
[jar:file:/opt/cloudera/parcels/CDH-5.12.2-1.cdh5.12.2.p0.4/jars/slf4j-log4j12-1.7.5.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory]
2019-03-13 01:42:19 INFO Reflections - Reflections took 455 ms to scan 48 urls,
producing 809 keys and 2849 values
2019-03-13 01:42:21 WARN NativeCodeLoader - Unable to load native-hadoop
library for your platform... using builtin-java classes where applicable
2019-03-13 01:42:21 WARN DomainSocketFactory - The short-circuit local reads
feature cannot be used because libhadoop cannot be loaded.
Error: Can not create a Path from an empty string
java.lang.IllegalArgumentException: Can not create a Path from an empty string
at org.apache.hadoop.fs.Path.checkPathArg(Path.java:127)
at org.apache.hadoop.fs.Path.<init>(Path.java:184)
at
org.apache.gobblin.util.PathUtils.getPathWithoutSchemeAndAuthority(PathUtils.java:68)
at org.apache.gobblin.util.PathUtils.relativizePath(PathUtils.java:47)
at
org.apache.gobblin.runtime.job_catalog.ImmutableFSJobCatalog$JobSpecConverter.computeURI(ImmutableFSJobCatalog.java:267)
at
org.apache.gobblin.runtime.job_catalog.ImmutableFSJobCatalog$JobSpecConverter.apply(ImmutableFSJobCatalog.java:279)
at
org.apache.gobblin.runtime.embedded.EmbeddedGobblin.runAsync(EmbeddedGobblin.java:416)
at
org.apache.gobblin.runtime.embedded.EmbeddedGobblin.run(EmbeddedGobblin.java:387)
at
org.apache.gobblin.runtime.cli.CliEmbeddedGobblin.run(CliEmbeddedGobblin.java:101)
at org.apache.gobblin.runtime.cli.GobblinCli.main(GobblinCli.java:43)
> Unable to run Apache Gobblin Kafka - HDFS USecase
> -------------------------------------------------
>
> Key: GOBBLIN-700
> URL: https://issues.apache.org/jira/browse/GOBBLIN-700
> Project: Apache Gobblin
> Issue Type: Bug
> Components: gobblin-kafka
> Affects Versions: 0.14.0
> Reporter: Ankit Gaur
> Assignee: Shirshanka Das
> Priority: Major
>
> When i try to run a job to ingest data from kafka and put it on HDFS i get
> the following error :-
> i am trying the example in this link :-
> https://gobblin.readthedocs.io/en/latest/case-studies/Kafka-HDFS-Ingestion/
> bash bin/gobblin run -jobName kafkaGobble -jobFile kafka_mr.job
> SLF4J: Class path contains multiple SLF4J bindings.
> SLF4J: Found binding in
> [jar:file:/data2/home-guest/a82250/projects/bom/gobblin-dist/lib/slf4j-log4j12-1.7.21.jar!/org/slf4j/impl/StaticLoggerBinder.class]
> SLF4J: Found binding in
> [jar:file:/opt/cloudera/parcels/CDH-5.12.2-1.cdh5.12.2.p0.4/jars/slf4j-log4j12-1.7.5.jar!/org/slf4j/impl/StaticLoggerBinder.class]
> SLF4J: See [http://www.slf4j.org/codes.html#multiple_bindings] for an
> explanation.
> SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory]
> 2019-03-13 01:40:05 INFO Reflections - Reflections took 477 ms to scan 48
> urls, producing 809 keys and 2849 values
> 2019-03-13 01:40:07 WARN NativeCodeLoader - Unable to load native-hadoop
> library for your platform... using builtin-java classes where applicable
> 2019-03-13 01:40:07 WARN DomainSocketFactory - The short-circuit local reads
> feature cannot be used because libhadoop cannot be loaded.
> Error: Can not create a Path from an empty string
> java.lang.IllegalArgumentException: Can not create a Path from an empty
> string
> at org.apache.hadoop.fs.Path.checkPathArg(Path.java:127)
> at org.apache.hadoop.fs.Path.<init>(Path.java:184)
> at
> org.apache.gobblin.util.PathUtils.getPathWithoutSchemeAndAuthority(PathUtils.java:68)
> at org.apache.gobblin.util.PathUtils.relativizePath(PathUtils.java:47)
> at
> org.apache.gobblin.runtime.job_catalog.ImmutableFSJobCatalog$JobSpecConverter.computeURI(ImmutableFSJobCatalog.java:267)
> at
> org.apache.gobblin.runtime.job_catalog.ImmutableFSJobCatalog$JobSpecConverter.apply(ImmutableFSJobCatalog.java:279)
> at
> org.apache.gobblin.runtime.embedded.EmbeddedGobblin.runAsync(EmbeddedGobblin.java:416)
> at
> org.apache.gobblin.runtime.embedded.EmbeddedGobblin.run(EmbeddedGobblin.java:387)
> at
> org.apache.gobblin.runtime.cli.CliEmbeddedGobblin.run(CliEmbeddedGobblin.java:101)
> at org.apache.gobblin.runtime.cli.GobblinCli.main(GobblinCli.java:43)
> [a82250@usdenprh119 gobblin-dist]$ vi kafka_mr.job
> [a82250@usdenprh119 gobblin-dist]$ hdfs dfs -put -f kafka_mr.job .
> [a82250@usdenprh119 gobblin-dist]$ bash bin/gobblin run -jobName kafkaGobble
> -jobFile kafka_mr.job
> SLF4J: Class path contains multiple SLF4J bindings.
> SLF4J: Found binding in
> [jar:file:/data2/home-guest/a82250/projects/bom/gobblin-dist/lib/slf4j-log4j12-1.7.21.jar!/org/slf4j/impl/StaticLoggerBinder.class]
> SLF4J: Found binding in
> [jar:file:/opt/cloudera/parcels/CDH-5.12.2-1.cdh5.12.2.p0.4/jars/slf4j-log4j12-1.7.5.jar!/org/slf4j/impl/StaticLoggerBinder.class]
> SLF4J: See [http://www.slf4j.org/codes.html#multiple_bindings] for an
> explanation.
> SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory]
> 2019-03-13 01:42:19 INFO Reflections - Reflections took 455 ms to scan 48
> urls, producing 809 keys and 2849 values
> 2019-03-13 01:42:21 WARN NativeCodeLoader - Unable to load native-hadoop
> library for your platform... using builtin-java classes where applicable
> 2019-03-13 01:42:21 WARN DomainSocketFactory - The short-circuit local reads
> feature cannot be used because libhadoop cannot be loaded.
> Error: Can not create a Path from an empty string
> java.lang.IllegalArgumentException: Can not create a Path from an empty
> string
> at org.apache.hadoop.fs.Path.checkPathArg(Path.java:127)
> at org.apache.hadoop.fs.Path.<init>(Path.java:184)
> at
> org.apache.gobblin.util.PathUtils.getPathWithoutSchemeAndAuthority(PathUtils.java:68)
> at org.apache.gobblin.util.PathUtils.relativizePath(PathUtils.java:47)
> at
> org.apache.gobblin.runtime.job_catalog.ImmutableFSJobCatalog$JobSpecConverter.computeURI(ImmutableFSJobCatalog.java:267)
> at
> org.apache.gobblin.runtime.job_catalog.ImmutableFSJobCatalog$JobSpecConverter.apply(ImmutableFSJobCatalog.java:279)
> at
> org.apache.gobblin.runtime.embedded.EmbeddedGobblin.runAsync(EmbeddedGobblin.java:416)
> at
> org.apache.gobblin.runtime.embedded.EmbeddedGobblin.run(EmbeddedGobblin.java:387)
> at
> org.apache.gobblin.runtime.cli.CliEmbeddedGobblin.run(CliEmbeddedGobblin.java:101)
> at org.apache.gobblin.runtime.cli.GobblinCli.main(GobblinCli.java:43)
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
