cxlRay opened a new issue #9918: URL: https://github.com/apache/druid/issues/9918
when send batch query to Realtime processes tasks, the performance is too bad. TPS only have 80, response time is more than one second, max response time can be 30 second and 99% response time can be 15 second. what I confused is the data of Realtime processes are in mem, why response time of query is so long? ### Affected Version v druid-0.16.1-incubating. ### Description - Cluster size coordinator and overlord: 2 historical: 7 middleManager: 7 broker: 5 - The testing tool is jmeter - testing result thread num: 500 TPS: 107.80 average response time: 4372ms 99% response time: 15559ms max response time: 30150ms min response time: 373 - the Flame chart of Realtime task code when test  - the configuration of middleManager  - the configuration of Realtime tasks ``` { "type": "kafka", "dataSchema": { "dataSource": "xxxx", "parser": { "type": "string", "parseSpec": { "format": "json", "timestampSpec": { "column": "timestamp", "format": "posix" }, "dimensionsSpec": { "dimensions": ["tag1","tag2","tag3","tag4","tag5","tag6","tag7"], "dimensionExclusions": [ "timestamp", "value" ] } } }, "metricsSpec": [ { "name": "value", "fieldName": "value", "type": "doubleSum" } ], "granularitySpec": { "type": "uniform", "segmentGranularity": "HOUR", "queryGranularity": "NONE", "rollup" : false } }, "tuningConfig": { "type": "kafka", "intermediatePersistPeriod": "PT1H", "maxTotalRows": "245000000", "maxRowsPerSegment": 5000000 }, "ioConfig": { "topic": "xxxxx", "consumerProperties": { "bootstrap.servers": "xxxx:9092" }, "taskCount": 16, "replicas": 1, "taskDuration": "PT1H" } } ``` - about segments   ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
