wangbo opened a new pull request, #37289:
URL: https://github.com/apache/doris/pull/37289
## Proposed changes
Log doris_be process's thread num at a fixed interval, when a BE cores
because of thread exhaustion, we can use this log to find which logic uses the
most threads.
```
log be thread num: pid=3545627 thread_name_count=106 total_thread_num=7103
details: RScan_auth_grou=960
RScan_normal [w=960
RScan_test_wg [=960
RemoteScanThrea=960
brpc_heavy=384
brpc_light=384
doris_be=294
Scan_normal [wo=192
Scan_auth_group=192
LimitedScanThre=192
Scan_test_wg [w=192
SpillIOThreadPo=192
local_scan=192
Pipe_test_wg [w=96
Pipe_normal [wo=96
Pipe_auth_group=96
PipeNoGSchePool=96
DownloadThreadP=64
SendReportThrea=64
SendBatchThread=64
FragmentMgrThre=64
JoinNodeThreadP=64
EvHttpServer [w=48
FragmentInstanc=48
TabletPublishTx=32
S3FileUploadThr=16
BufferedReaderP=16
NonBlockCloseTh=12
MultiGetTaskThr=10
TaskWP_PUBLISH_=8
SendTableStatsT=8
MemTableHighPri=6
MemTableFlushTh=6
wg_flush_test_w=6
wg_flush_auth_g=6
SegmentFileWrit=6
wg_flush_normal=6
WriteCooldownMe=5
TaskWP_MAKE_SNA=5
CooldownTaskThr=5
SegCompactionTa=5
TaskWP_RELEASE_=5
BaseCompactionT=4
cancel_timeout_=3
TaskWP_DELETE [=3
TaskWP_DROP_TAB=3
TaskWP_CREATE_T=3
TaskWP_CLONE [w=3
TaskWP_ALTER_TA=3
TaskWP_ALTER_IN=3
TaskWP_.PUSH [w=3
HighPriorPool.P=3
ColdDataCompact=2
memtable_memory=1
query_runtime_s=1
memory_maintena=1
memory_gc_threa=1
GroupCommitThre=1
je_purge_dirty_=1
gc_expired_cont=1
garbage_sweeper=1
evict_querying_=1
disk_stat_monit=1
cooldown_tasks_=1
compaction_task=1
cold_data_compa=1
path_gc_thread-=1
ping_worker-354=1
clean_expired_t=1
remove_unused_r=1
replay_wal-3547=1
spill_gc_thread=1
tablet_checkpoi=1
unused_rowset_m=1
update_wal_dir_=1
GroupCommitRepl=1
CumuCompactionT=1
wg_mem_refresh_=1
workload_schedu=1
TaskWP_UPDATE_T=1
TaskWP_CLEAN_UD=1
TaskWP_CLEAR_TR=1
TaskWP_CHECK_CO=1
TaskWP_DOWNLOAD=1
TaskWP_GC_BINLO=1
TabletCalcDelet=1
TaskWP_MOVE [wo=1
SingleReplicaCo=1
TaskWP_PUSH_COO=1
TaskWP_PUSH_STO=1
REPORT_TASK-354=1
TaskWP_STORAGE_=1
TaskWP_SUBMIT_T=1
clean_idle_cons=1
TaskWP_UPDATE_V=1
TaskWP_UPLOAD [=1
REPORT_OLAP_TAB=1
_update_replica=1
async_publish_v=1
be_proc_monitor=1
REPORT_DISK_STA=1
MigrationTaskTh=1
cache_clean_thr=1
calculate_metri=1
LazyReleaseMemo=1
TaskWP_CLEAN_TR=1
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
