Hi,
I'm trying to run Drill with Tachyon on top of S3.
My Drill-Source config looks like this:
{
"type": "file",
"enabled": true,
"connection": "tachyon://localhost:19998/",
"workspaces": {
"root": {
"location": "/",
"writable": true,
"defaultInputFormat": null
}
},
"formats": {
"psv": {
"type": "text",
"extensions": [
"tbl"
],
"delimiter": "|"
},
"csv": {
"type": "text",
"extensions": [
"csv"
],
"delimiter": ","
},
"tsv": {
"type": "text",
"extensions": [
"tsv"
],
"delimiter": "\t"
},
"parquet": {
"type": "parquet"
},
"json": {
"type": "json"
},
"avro": {
"type": "avro"
}
}
}
Initilly I get:
Error: SYSTEM ERROR: IOException: No FileSystem for scheme: tachyon
When I copy the tachyon client (tachyon-client-0.7.0.jar) to the
jar/3rdparty the system complains about missing tependencies (jets3).
If I copy the full Tachyon client
(tachyon-client-0.7.0-jar-with-dependencies.jar) to the jar/3rds party the
system will not start.
Exception in thread "main" java.lang.ExceptionInInitializerError
at org.apache.log4j.LogManager.getLogger(LogManager.java:44)
at org.slf4j.impl.Log4jLoggerFactory.getLogger(Log4jLoggerFactory.java:64)
at org.slf4j.LoggerFactory.getLogger(LoggerFactory.java:277)
at org.slf4j.LoggerFactory.getLogger(LoggerFactory.java:288)
at org.apache.drill.exec.server.Drillbit.<clinit>(Drillbit.java:58)
Caused by: java.lang.IllegalStateException: Detected both
log4j-over-slf4j.jar AND slf4j-log4j12.jar on the class path, preempting
StackOverflowError. See also
http://www.slf4j.org/codes.html#log4jDelegationLoop for more details.
at org.apache.log4j.Log4jLoggerFactory.<clinit>(Log4jLoggerFactory.java:51)
... 5 more
Has anyone here done this already and is willing to share some info?
Regards,
-Stefán
