Re: Writing to the connected data source?

[Padma Penumarthy]

Workspaces are supported only for file system based storage plugins (DFS, S3).
You can create tables in workspaces, by configuring workspaces as writable. 
Table can be created as file(s) of type parquet, json, psv, csv and tsv, based 
on configuration option “store.format".
For Mongo, creating table is not supported.

Thanks,
Padma


> On Aug 11, 2017, at 8:43 PM, Akshat Jiwan Sharma  
> wrote:
> 
> Hello Everyone,
> 
> My use case is that I'd like to be able to use Drill as a proxy for my data 
> sources, not only for querying the data but also for writing the data.
> Is it possible to write data to the connected data store using apache drill 
> rest api? Or perhaps with a custom function 
> ?
> 
> As I understand there is a CTAS 
>  function allows us to 
> create new tables but there are a few restrictions
> 
> >"You cannot create tables using storage plugins, such as Hive and HBase, 
> >that do not specify a workspace."
> 
> Does this mean that there are some storage plugins that do specify a 
> workspace. I looked at the documentation of mongodb storage plugin and wasn't 
> sure if it did support workspaces? How can I determine if a storage plugin is 
> writeable or not?
> 
> Thanks,
> Akshat

Writing to the connected data source?

[Akshat Jiwan Sharma]

Hello Everyone,

My use case is that I'd like to be able to use Drill as a proxy for my 
data sources, not only for querying the data but also for writing the data.
Is it possible to write data to the connected data store using apache 
drill rest api? Or perhaps with a custom function 
?


As I understand there is a CTAS 
 function allows us 
to create new tables but there are a few restrictions


>"You cannot create tables using storage plugins, such as Hive and 
HBase, that do not specify a workspace."


Does this mean that there are some storage plugins that do specify a 
workspace. I looked at the documentation of mongodb storage plugin and 
wasn't sure if it did support workspaces? How can I determine if a 
storage plugin is writeable or not?


Thanks,
Akshat

Re: Drill on secure HDFS

[Padma Penumarthy]

Did you look at this ?
https://drill.apache.org/docs/configuring-kerberos-authentication/

Also, this JIRA has some details.
https://issues.apache.org/jira/browse/DRILL-3584

Thanks,
Padma


On Aug 12, 2017, at 5:04 AM, Ascot Moss 
> wrote:

Does Drill's File Storage Plugin (DFS Plugin) support Hadoop-Kerberos? I
cannot find any link about this.

https://drill.apache.org/docs/file-system-storage-plugin/
This document does not provide to much detail about whether Drill supports
Hadoop-Kerberos or not.

On Sat, Aug 12, 2017 at 4:09 PM, Ascot Moss  wrote:

Hi,

I have HDFS with Kerberos enabled, how to configure drill's dfs plugin in
order to enable Kerberos authentication?

regards

Error: SYSTEM ERROR: IOException: Can't get Master Kerberos principal for use as renewer

[Ascot Moss]

Hi,

I use Drill 1.11 on Hive 2.1.1 on Hadoop 2.7.2 with Kerberos.


sqlline -u
"jdbc:drill:drillbit=n1.server:31010;auth=kerberos;principal=drill/server"
-n "drill/n1.server"


use hive;
+---+---+
|  ok   |  summary  |
+---+---+
| true  | Default schema changed to [hive]  |
+---+---+

show tables;
+---+--+
| TABLE_SCHEMA  |TABLE_NAME|
+---+--+
| hive.default  | test01|
+---+--+

select * from `test01`;

Error: SYSTEM ERROR: IOException: Can't get Master Kerberos principal for
use as renewer

How can I fix this?
Regards

Error: SYSTEM ERROR: IOException: Can't get Master Kerberos principal for use as renewer

[Ascot Moss]

Hi,

I use Drill 1.11 on Hive 2.1.1 on Hadoop 2.7.2 with Kerberos.


sqlline -u
"jdbc:drill:drillbit=n1.server:31010;auth=kerberos;principal=drill/server"
-n "drill/n1.server "

use hive;

+---+---+

|  ok   |  summary  |

+---+---+

| true  | Default schema changed to [hive]  |

+---+---+

show tables;

+---+--+

| TABLE_SCHEMA  |TABLE_NAME|

+---+--+

| hive.default  | test01|

+---+--+

select * from `test01`;

Error: SYSTEM ERROR: IOException: Can't get Master Kerberos principal for
use as renewer
How can I fix this?
Regards

Re: Drill on secure HDFS

[Ascot Moss]

Does Drill's File Storage Plugin (DFS Plugin) support Hadoop-Kerberos? I
cannot find any link about this.

https://drill.apache.org/docs/file-system-storage-plugin/
This document does not provide to much detail about whether Drill supports
Hadoop-Kerberos or not.

On Sat, Aug 12, 2017 at 4:09 PM, Ascot Moss  wrote:

> Hi,
>
> I have HDFS with Kerberos enabled, how to configure drill's dfs plugin in
> order to enable Kerberos authentication?
>
> regards
>

Re: Drills' Hbase storage plugin

[Ascot Moss]

Does Drill's Hbase Storage support Hbase-Kerberos? I cannot find any link
about this.

https://drill.apache.org/docs/hbase-storage-plugin/
This link does not provide too much detail about Drills' Hbase Storage on
HBase-Kerberos.

On Sat, Aug 12, 2017 at 4:11 PM, Ascot Moss  wrote:

> Hi,
>
> I have Hbase with Kerberos enabled, how to configure drill's hbase storage
> plugin in order to access kerberos-Hbase?
>
> Regards
>

Re: Drill UI (8047) Default User and Password

[Ascot Moss]

Thanks!

By the way, how to configure hbase plugin to query kerberos-hbase?





On Fri, Aug 11, 2017 at 1:38 PM, Sorabh Hamirwasia 
wrote:

> To add on Arina's reply:
>
>
> Authentication on WebServer side happens using PLAIN mechanism with PAM
> authenticator. So when authentication is enabled [1], you can login to
> WebUI using credentials of any user present on the node to which you are
> connecting to.
>
> For example: If you are connecting to WebServer running on
> http://10.10.10.10:8047, then you can login using user bob credentials,
> provided bob is a valid user on node 10.10.10.10
>
>
> [1] https://drill.apache.org/docs/configuring-plain-security/
>
>
> Thanks,
> Sorabh
>
> 
> From: Arina Yelchiyeva 
> Sent: Thursday, August 10, 2017 5:03:49 AM
> To: user
> Subject: Re: Drill UI (8047) Default User and Password
>
> Currently if you did not configure authorization, Drill does not require
> entering login and password. All queries will be run under the user who
> started the drillbit. On Web UI, user who ran the queries will be shown as
> anonymous.
> Though if you did than it would depend on those users whom you have allowed
> access [1].
>
> [1] https://drill.apache.org/docs/securing-drill-introduction/
>
> Kind regards
> Arina
>
> On Thu, Aug 10, 2017 at 2:50 PM, Ascot Moss  wrote:
>
> > Hi,
> >
> > What is the default login name and password for drill 8047 port UI?
> >
> > (Drill version: 1.11.0)
> >
> > regards
> >
>

Drills' Hbase storage plugin

[Ascot Moss]

Hi,

I have Hbase with Kerberos enabled, how to configure drill's hbase storage
plugin in order to access kerberos-Hbase?

Regards

Drill on secure HDFS

[Ascot Moss]

Hi,

I have HDFS with Kerberos enabled, how to configure drill's dfs plugin in
order to enable Kerberos authentication?

regards