Thanks Ramana for the help. I tried what you said but it did not work. Basically the storage plugin addition fails. I set the log level to debug and it didn't tell much about the problem. I will try it with TRACE log level to see what happened.
As I was not able to get the MapR Hadoop on EMR running I switched to Amazon Hadoop and it worked as per documentation. Thanks again for your reply. Thanks, Alex On Fri, Apr 3, 2015 at 1:58 PM, Ramana Inukonda <[email protected]> wrote: > Also is drill running on the same node as a MapR cluster? In that case you > just can specify maprfs:/// for the connection value. > > Regards > Ramana > > > On Fri, Apr 3, 2015 at 1:40 PM, Ramana Inukonda <[email protected]> > wrote: > > > Please check if your drill-env.sh contains the following: > > > > export DRILL_JAVA_OPTS="$DRILL_JAVA_OPTS > > -Djava.security.auth.login.config=/opt/mapr/conf/mapr.login.conf > > -Dzookeeper.sasl.client=false " > > > > > > Regards > > Ramana > > > > > > > > On Thu, Apr 2, 2015 at 8:51 PM, Alexander Zarei < > > [email protected]> wrote: > > > >> Hi, > >> > >> > >> I am suing Drill on an AWS EMR cluster and trying to connect Hive and > >> MapR-FS storage plugins. > >> > >> The hive plugin is connected successfully as inlined below; I created a > >> dummy table by hive shell and then I observed the following Drill Error > >> when browsing the dummy table with Drill Exporer: > >> > >> > >> *[30024]Query execution error. Details:[ IOException: No FileSystem for > >> scheme: maprfs* > >> > >> I tried to connect the MapR-FS storage plugin but I am not sure if the > >> port > >> number I am using is correct. > >> > >> According to Drill documentation any distributed file system included in > >> core-site.xml can be used by Drill but I do not see any information > >> related > >> to MapR-FS in this file. However, when I use the Amazon Hadoop the > >> information (hdfs nodename ip and port number ) is there and I can > connect > >> to hive storage by Drill. > >> > >> I wonder if you could let me know what I am missing in crafting the > >> storage > >> plugins below: > >> > >> Hive storage plugin: > >> > >> { > >> "type": "hive", > >> "enabled": true, > >> "configProps": { > >> "hive.metastore.uris": "thrift://localhost:9083", > >> "hive.metastore.local": "false", > >> "hive.metastore.warehouse.dir": "/user/hive/warehouse" > >> } > >> } > >> > >> and maprfs: > >> > >> { > >> "type": "file", > >> "enabled": "false", > >> "connection": "maprfs://54.224.109.121:8041/", > >> "workspaces": { > >> "root": { > >> "location": "/", > >> "writable": false, > >> "defaultInputFormat": null > >> }, > >> "tmp": { > >> "location": "/tmp", > >> "writable": true, > >> "defaultInputFormat": null > >> } > >> }, > >> "formats": { > >> "psv": { > >> "type": "text", > >> "extensions": [ > >> "tbl" > >> ], > >> "delimiter": "|" > >> }, > >> "csv": { > >> "type": "text", > >> "extensions": [ > >> "csv" > >> ], > >> "delimiter": "," > >> }, > >> "tsv": { > >> "type": "text", > >> "extensions": [ > >> "tsv" > >> ], > >> "delimiter": "\t" > >> }, > >> "parquet": { > >> "type": "parquet" > >> }, > >> "json": { > >> "type": "json" > >> } > >> } > >> } > >> > >> > >> Thanks, > >> Alex > >> > > > > >
