As Kunal and Padma mentioned, there are two tickets and I have added my comment there.
https://issues.apache.org/jira/browse/DRILL-2861 <https://issues.apache.org/jira/browse/DRILL-2362> https://issues.apache.org/jira/browse/DRILL-2362 https://issues.apache.org/jira/browse/DRILL-5270 In https://drill.apache.org/docs/persistent-configuration-storage, under ZooKeeper configuration it is mentioned that 'The ZooKeeper PStore provider offloads query profile data to the Drill log directory on Drill nodes'. We need to add a note on the performance impact of accumulating too many files here and the work around of purging contents manually. Regards, Rahul On Wed, Aug 30, 2017 at 10:17 PM, Paul Rogers <[email protected]> wrote: > Is a JIRA filed for this case? Should we add a note to the documentation > if we can’t fix the issue? > > Thanks, > > - Paul > > > On Aug 29, 2017, at 10:41 PM, Rahul Raj <[email protected]> > wrote: > > > > We had more than 200,000 profiles stored :) > > > > Regards, > > Rahul. > > > > On Wed, Aug 30, 2017 at 5:03 AM, Padma Penumarthy <[email protected]> > > wrote: > > > >> If these channel closed exceptions happen when you try to list profiles > >> using web UI, yes that could be related. > >> one option is to change configuration to use a new directory for saving > >> profiles. > >> You can delete the old profiles (if you don’t need them) or save them. > >> > >> Thanks, > >> Padma > >> > >> > >>> On Aug 29, 2017, at 4:05 PM, Rahul Raj <rahul.raj@option3consulting. > com> > >> wrote: > >>> > >>> Thanks for the reply. I will try deleting the files manually. > >>> > >>> I have a web application that pools connections to drill. Once this > >> happens > >>> I can see channel closed exceptions and the entire pool stale. Could > this > >>> be due to a large GC causing ZK heartbeat miss? > >>> > >>> Regards, > >>> Rahul > >>> > >>> On Tue, Aug 29, 2017 at 10:42 PM, Padma Penumarthy < > [email protected] > >>> > >>> wrote: > >>> > >>>> yes, we save each query profile as file in a single directory. > >>>> If there are large number of files in the directory, it can cause web > UI > >>>> to hang or slow down. > >>>> That is because we try to list all the files in the directory when we > >> want > >>>> to view the profiles from web UI and > >>>> that is an expensive operation. > >>>> We have some open JIRAs for this issue (DRILL-2861, DRILL-2362) > >>>> which we plan to address in the future. > >>>> For now, you have to delete these files manually if it is an issue for > >> you. > >>>> > >>>> Thanks, > >>>> Padma > >>>> > >>>>> On Aug 29, 2017, at 7:46 AM, Rahul Raj <rahul.raj@option3consulting. > >> com> > >>>> wrote: > >>>>> > >>>>> Hi, > >>>>> > >>>>> The drill profile list page(<<ip>>:8047/profiles) takes few minutes > to > >>>> load > >>>>> in one of the installation. > >>>>> > >>>>> There was a considerable amount of processor(20%) and memory(15-20%) > >>>> usage > >>>>> during this time. Immediately after displaying the results, values > >> return > >>>>> to normal. > >>>>> > >>>>> Could this be because of the values accumulated in profile storage? > Is > >> it > >>>>> possible to purge some data? > >>>>> > >>>>> Regards, > >>>>> Rahul > >>>>> > >>>>> -- > >>>>> **** This email and any files transmitted with it are confidential > and > >>>>> intended solely for the use of the individual or entity to whom it is > >>>>> addressed. If you are not the named addressee then you should not > >>>>> disseminate, distribute or copy this e-mail. Please notify the sender > >>>>> immediately and delete this e-mail from your system.**** > >>>> > >>>> > >>> > >>> -- > >>> **** This email and any files transmitted with it are confidential and > >>> intended solely for the use of the individual or entity to whom it is > >>> addressed. If you are not the named addressee then you should not > >>> disseminate, distribute or copy this e-mail. Please notify the sender > >>> immediately and delete this e-mail from your system.**** > >> > >> > > > > -- > > **** This email and any files transmitted with it are confidential and > > intended solely for the use of the individual or entity to whom it is > > addressed. If you are not the named addressee then you should not > > disseminate, distribute or copy this e-mail. Please notify the sender > > immediately and delete this e-mail from your system.**** > > -- **** This email and any files transmitted with it are confidential and intended solely for the use of the individual or entity to whom it is addressed. If you are not the named addressee then you should not disseminate, distribute or copy this e-mail. Please notify the sender immediately and delete this e-mail from your system.****
