Drill High availability

2018-08-21 Thread pujari Satish
Hi Team, Good Evening. I am Satish i need your help regarding Apache drill high availability using Haproxy. Is it possible to make drill high availability.I am checking so many sites still i am struck . please guide me in this.please let me know how to approach in this. -Thanks, Satish

Re: Drill Hangout tomorrow 08/21

2018-08-21 Thread Oleksandr Kalinin
Hi Volodymyr, Just recalling on recent discussions in DEV list, it would be interesting to see if following topics are addressed in the Drill metadata management initiative: 1. Avoiding repetition of Hive mistakes (mainly relying on RDBMS) Just to substantiate this point of view from practical

Re: query performance with unequal drillbits

2018-08-21 Thread Ted Dunning
A cheap hack is to use multiple smaller drillbits. Put more drillbits on the hefty machines and fewer on the weaker ones. This increases overheads, but it might help you out. On Tue, Aug 21, 2018 at 1:48 PM scott wrote: > Hi community, > I am trying to find a way to tune Drill so that weaker

Re: query performance with unequal drillbits

2018-08-21 Thread Paul Rogers
Hi Scott, Drillbit symmetry is built deep into Drill's distribution model: the planner assumes Drillbits are equal. Changing this assumption is possible (you cited MapReduce as a system that handles this case), but would require complex code changes: * Distribute scan blocks based on

Re: Drill Hangout tomorrow 08/21

2018-08-21 Thread Vitalii Diravka
Hi Alex, The issues pointed by you really exist. And using of HMS is still open question. The main goal is to make Drill Metastore API, which can be used for different Drill data sources. Then to adapt current Parquet metadata cache files mechanism to this API. It will be the first