We had more than 200,000 profiles stored :)

Regards,
Rahul.

On Wed, Aug 30, 2017 at 5:03 AM, Padma Penumarthy <[email protected]>
wrote:

> If these channel closed exceptions happen when you try to list profiles
> using web UI, yes that could be related.
> one option is to change configuration to use a new directory for saving
> profiles.
> You can delete the old profiles (if you don’t need them) or save them.
>
> Thanks,
> Padma
>
>
> > On Aug 29, 2017, at 4:05 PM, Rahul Raj <[email protected]>
> wrote:
> >
> > Thanks for the reply. I will try deleting the files manually.
> >
> > I have a web application that pools connections to drill. Once this
> happens
> > I can see channel closed exceptions and the entire pool stale. Could this
> > be due to a large GC causing ZK heartbeat miss?
> >
> > Regards,
> > Rahul
> >
> > On Tue, Aug 29, 2017 at 10:42 PM, Padma Penumarthy <[email protected]
> >
> > wrote:
> >
> >> yes, we save each query profile as file in a single directory.
> >> If there are large number of files in the directory, it can cause web UI
> >> to hang or slow down.
> >> That is because we try to list all the files in the directory when we
> want
> >> to view the profiles from web UI and
> >> that is an expensive operation.
> >> We have some open JIRAs for this issue (DRILL-2861, DRILL-2362)
> >> which we plan to address in the future.
> >> For now, you have to delete these files manually if it is an issue for
> you.
> >>
> >> Thanks,
> >> Padma
> >>
> >>> On Aug 29, 2017, at 7:46 AM, Rahul Raj <rahul.raj@option3consulting.
> com>
> >> wrote:
> >>>
> >>> Hi,
> >>>
> >>> The drill profile list page(<<ip>>:8047/profiles) takes few minutes to
> >> load
> >>> in one of the installation.
> >>>
> >>> There was a considerable amount of processor(20%) and memory(15-20%)
> >> usage
> >>> during this time. Immediately after displaying the results, values
> return
> >>> to normal.
> >>>
> >>> Could this be because of the values accumulated in profile storage? Is
> it
> >>> possible to purge some data?
> >>>
> >>> Regards,
> >>> Rahul
> >>>
> >>> --
> >>> **** This email and any files transmitted with it are confidential and
> >>> intended solely for the use of the individual or entity to whom it is
> >>> addressed. If you are not the named addressee then you should not
> >>> disseminate, distribute or copy this e-mail. Please notify the sender
> >>> immediately and delete this e-mail from your system.****
> >>
> >>
> >
> > --
> > **** This email and any files transmitted with it are confidential and
> > intended solely for the use of the individual or entity to whom it is
> > addressed. If you are not the named addressee then you should not
> > disseminate, distribute or copy this e-mail. Please notify the sender
> > immediately and delete this e-mail from your system.****
>
>

-- 
**** This email and any files transmitted with it are confidential and 
intended solely for the use of the individual or entity to whom it is 
addressed. If you are not the named addressee then you should not 
disseminate, distribute or copy this e-mail. Please notify the sender 
immediately and delete this e-mail from your system.****

Reply via email to