Re: Add total number of started threads to /threadz

[Lars Volker]

Thank you for the feedback. I opened IMPALA-5643 to track this and pushed a
change here: https://gerrit.cloudera.org/#/c/7390/

On Mon, Jul 10, 2017 at 10:25 AM, Henry Robinson  wrote:

> This seems valuable to me.
>
> On 28 June 2017 at 21:26, Lars Volker  wrote:
>
> > Hi All,
> >
> > While investigating IMPALA-5598 I added a counter with the total number
> of
> > threads to /threadz. See below for what it looks like (I hope the ASF
> > mailer won't eat the format). Does this look helpful? If someone thinks
> it
> > does, I'll create a JIRA and push the change.
> >
> > Thanks, Lars
> >
> >
> > Thread GroupsAll threads
> >  >DataStreamSender
> > : (running: 0, total created: 2500)
> >  > group?group=DataStreamSender>common
> > : (running: 2, total created: 2)
> > 
> > coordinator-fragment-rpc
> > : (running: 12, total created: 12)
> >  > fragment-rpc>disk-io-mgr
> > : (running: 34, total created: 34)
> > 
> > fragment-mgr
> > : (running: 0, total created: 2550)
> >  > >hdfs-scan-node
> > : (running: 0, total created: 2500)
> >  group?group=hdfs-scan-node
> > >hdfs-worker-pool
> > : (running: 16, total created: 16)
> >  > group?group=hdfs-worker-pool>impala-server
> > : (running: 8, total created: 8)
> >  group?group=impala-server>
> > plan-fragment-executor
> > : (running: 0, total created: 2550)
> >  group?group=plan-fragment-
> > executor>query-exec-state
> > : (running: 0, total created: 50)
> >  > group?group=query-exec-state>rpc-pool
> > : (running: 8, total created: 8)
> > 
> > scheduling
> > : (running: 1, total created: 1)
> >  > >setup-server
> > : (running: 2, total created: 2)
> >  >
> > statestore-subscriber
> > : (running: 1, total created: 1)
> >  > subscriber>thrift-server
> > : (running: 248, total created: 248)
> >  group?group=thrift-server>
> >
>

Re: Add total number of started threads to /threadz

[Henry Robinson]

This seems valuable to me.

On 28 June 2017 at 21:26, Lars Volker  wrote:

> Hi All,
>
> While investigating IMPALA-5598 I added a counter with the total number of
> threads to /threadz. See below for what it looks like (I hope the ASF
> mailer won't eat the format). Does this look helpful? If someone thinks it
> does, I'll create a JIRA and push the change.
>
> Thanks, Lars
>
>
> Thread GroupsAll threads
> DataStreamSender
> : (running: 0, total created: 2500)
>  group?group=DataStreamSender>common
> : (running: 2, total created: 2)
> 
> coordinator-fragment-rpc
> : (running: 12, total created: 12)
>  fragment-rpc>disk-io-mgr
> : (running: 34, total created: 34)
> 
> fragment-mgr
> : (running: 0, total created: 2550)
>  >hdfs-scan-node
> : (running: 0, total created: 2500)
>  >hdfs-worker-pool
> : (running: 16, total created: 16)
>  group?group=hdfs-worker-pool>impala-server
> : (running: 8, total created: 8)
> 
> plan-fragment-executor
> : (running: 0, total created: 2550)
>  executor>query-exec-state
> : (running: 0, total created: 50)
>  group?group=query-exec-state>rpc-pool
> : (running: 8, total created: 8)
> 
> scheduling
> : (running: 1, total created: 1)
>  >setup-server
> : (running: 2, total created: 2)
> 
> statestore-subscriber
> : (running: 1, total created: 1)
>  subscriber>thrift-server
> : (running: 248, total created: 248)
> 
>

Add total number of started threads to /threadz

[Lars Volker]

Hi All,

While investigating IMPALA-5598 I added a counter with the total number of
threads to /threadz. See below for what it looks like (I hope the ASF
mailer won't eat the format). Does this look helpful? If someone thinks it
does, I'll create a JIRA and push the change.

Thanks, Lars


Thread GroupsAll threads
DataStreamSender
: (running: 0, total created: 2500)
common
: (running: 2, total created: 2)
coordinator-fragment-rpc
: (running: 12, total created: 12)
disk-io-mgr
: (running: 34, total created: 34)
fragment-mgr
: (running: 0, total created: 2550)
hdfs-scan-node
: (running: 0, total created: 2500)
hdfs-worker-pool
: (running: 16, total created: 16)
impala-server
: (running: 8, total created: 8)
plan-fragment-executor
: (running: 0, total created: 2550)
query-exec-state
: (running: 0, total created: 50)
rpc-pool
: (running: 8, total created: 8)
scheduling
: (running: 1, total created: 1)
setup-server
: (running: 2, total created: 2)
statestore-subscriber
: (running: 1, total created: 1)
thrift-server
: (running: 248, total created: 248)