Dear: Wechat group "Apache Linkis community Development group "chat records are as follows: 微信群"Apache Linkis 社区开发群"的聊天记录如下:
————— 2022-9-15 ————— suns 11:26 There is a big guy in the group who knows Elasticsearch, please ask for advice Mr Flash 11:30 I've used it a little... suns 11:36 The main problem is ES write performance, want to make sure that the cluster write slow is normal (in seconds), and then use asynchronous tasks in the background Mr. Flash 11:37 What do you write with? Before I was a Java client, which was very, very slow Mr. Flash 11:37 Suggest using the spark suns 11:37 My user side uses Golang, but I think it is similar suns 11:38 Then I'm not mistaken... Write slow moving Zhi-yuan liu though How slow? suns 11:38 This is what we're monitoring suns 11:39 Indexing and merging, as many as 5s Mr. Flash 11:40 I remember something like 100 million, five hours Mr. Flash 11:40 About 100 fields r@FY2 11:41 @saleox_sea_ Sun Soon I used BBOOs to measure 2W /s suns 11:41 tps? Pure and pure so May I ask what tool is used to monitor this? suns 11:42 Prometheus, ES official recommended monitoring plan r@FY2 11:42 30 fields, 2W data Zhi-yuan liu 11:42 He's officially Kibana r@FY2 11:43 Most of the fields are text, which is quite fast suns 11:43 That's visual, Prometheus for performance monitoring Zhi-yuan liu 11:44 Oh oh suns 11:44 My scenario is probably similar Pure and pure 11:44 Oh oh thank suns 11:26 群里有懂elasticsearch的大佬，有问题求教 闪电先生 11:30 我稍微用过…… suns 11:36 主要问题是es的写入性能，想确认一下，集群写入慢是不是正常的(秒级)，然后后台得用异步任务 闪电先生 11:37 你用什么写?之前我是java客户端，可以说是非常非常慢 闪电先生 11:37 建议用spark suns 11:37 我用户那边是用golang，但是我估计是差不多的 suns 11:38 那这样我是没记错了...写入慢的感人 刘志远 11:38 多慢呀？ suns 11:38 这个是我们监控的情况 suns 11:39 indexing 和 merging，多的需要到5s 闪电先生 11:40 我记得一亿这样的数据，5小时 闪电先生 11:40 100来个字段 r@FY2 11:41 @saLeox_sea_孙顺 我之前用bboos测过2w/s suns 11:41 tps? 柒柒 11:41 请问下这个是用什么工具监控的呀？ suns 11:42 prometheus，es官方推荐的监控方案 r@FY2 11:42 30个字段，2w条数据 刘志远 11:42 他官方不是kibana么 r@FY2 11:43 字段大多数是text，速度还不错 suns 11:43 那个是可视化的，性能监控还是用prometheus的 刘志远 11:44 哦哦 suns 11:44 我的场景可能差不多 柒柒 11:44 噢噢感谢 -- Best Regards ------ 康悦 ritakang GitHub：Ritakang0451 E-mail：rita0...@163.com
