Re: Drill (CTAS) Default hadoop Replication factor on HDFS ?

2016-05-10 Thread Jason Altekruse
I think this is a bug with the config block feature. We currently apply this at the storage plugin level, but it does not appear that we are sourcing this configuration from the writers and instead creating a new configuration in each of our three current record writers. I have filed this bug to

Re: Drill (CTAS) Default hadoop Replication factor on HDFS ?

2016-05-10 Thread Shankar Mane
Thanks Abhishek Girish. Copying hdfs-site.xml into Drill conf directory (on all nodes) works for me. And also tried config options setting. It does getting applied at storage plugin level But no effects. On Sat, May 7, 2016 at 11:29 PM, Jacques Nadeau wrote: > My

Re: Drill (CTAS) Default hadoop Replication factor on HDFS ?

2016-05-07 Thread Jacques Nadeau
My suggestion would be to use Drill's capability to have config options in the storage plugin rather than copying the hdfs-site.xml everywhere. Keeps it in one place and allows you to tune per system you are interacting with (instead of globally). See here for more detail:

Re: Drill (CTAS) Default hadoop Replication factor on HDFS ?

2016-05-06 Thread Abhishek Girish
Hello, Assuming you have defined your replication factor setting inside your cluster hdfs-site.xml, it might be worth a try to copy this config file into your Drill conf directory (on all nodes). While I haven't tried this myself, i'm hoping this could help. -Abhishek On Fri, May 6, 2016 at