Hi,
Thanks!
There is one thing about "connection" that I feel confused:
In the HA Hadoop Cluster, instead of use <ip_address> and <port>, we use
<zookeeper QuorumPeerMain> and use <dfs.nameservices> to manage the
connection to HA HDFS,
Below is the hdfs-site.xml here:
==============
<property>
<name>dfs.nameservices</name>
<value>mycluster</value>
<final>true</final>
</property>
================
How to define ""connection" properly in my case?
Regards
On Wed, Jun 17, 2015 at 10:35 PM, Akif Khan <[email protected]>
wrote:
> This is the config for HDFS :
>
> {
> "type": "file",
> "enabled": true,
> "connection": "hdfs://<ip_address>:8020/",
> "workspaces": {
> "root": {
> "location": "/user/data",
> "writable": true,
> "defaultInputFormat": null
> }
> },
> "formats": {
> "psv": {
> "type": "text",
> "extensions": [
> "tbl"
> ],
> "delimiter": "|"
> },
> "csv": {
> "type": "text",
> "extensions": [
> "csv"
> ],
> "delimiter": ","
> },
> "tsv": {
> "type": "text",
> "extensions": [
> "tsv"
> ],
> "delimiter": "\t"
> },
> "parquet": {
> "type": "parquet"
> },
> "json": {
> "type": "json"
> },
> "avro": {
> "type": "avro"
> }
> }
> }
>
> On Wed, Jun 17, 2015 at 8:03 PM, Arthur Chan <[email protected]>
> wrote:
>
> > Hi,
> >
> > I am new to Drill, could anyone advise how to configure HDFS storage and
> > how to do smoke tests about Drill on HDFS?
> >
> > =============
> > {
> > "type": "file",
> > "enabled": true,
> > "connection": "file:///",
> > "workspaces": {
> > "root": {
> > "location": "/",
> > "writable": true,
> > "defaultInputFormat": null
> > },
> > "tmp": {
> > "location": "/tmp",
> > "writable": true,
> > "defaultInputFormat": null
> > }
> > },
> > "formats": {
> > "psv": {
> > "type": "text",
> > "extensions": [
> > "tbl"
> > ],
> > "delimiter": "|"
> > },
> > "csv": {
> > "type": "text",
> > "extensions": [
> > "csv"
> > ],
> > "delimiter": ","
> > },
> > "tsv": {
> > "type": "text",
> > "extensions": [
> > "tsv"
> > ],
> > "delimiter": "\t"
> > },
> > "parquet": {
> > "type": "parquet"
> > },
> > "json": {
> > "type": "json"
> > },
> > "avro": {
> > "type": "avro"
> > }
> > }
> > }
> > =============
> >
>
>
>
> --
> Regards
>
> *Akif Khan*
> *InnovAccer Inc.*
> *www.innovaccer.com <http://www.innovaccer.com>*
> *+91 8802290360*
>
