dockerzhang opened a new issue #710: URL: https://github.com/apache/incubator-inlong/issues/710
<p>At present, the number of concurrent filtering copies supported by the system is about 20 under 1k Topic. This function is very popular with users after it is launched. If we can increase the number of concurrent filtering consumption, we can greatly help the business.</p> <p>1. Structured index storage: optimize the current index storage, for example, increase the structured index storage, which can be quickly retrieved through the index when in use to quickly locate the data; the increase in the index structure may make the write request slower, At the same time, it takes more time to check and restore the index when the system restarts</p> <p>2. Cross-partition consumption ability: For data that is not sensitive to partitions, when filtering consumption, it should support cross-partition consumption instead of specifying partition consumption to improve the overall filtering consumption capacity, but there must also be a way to limit this Mechanism, the specific choice should be controlled by the user</p> <i>JIRA link - <a href="https://issues.apache.org/jira/browse/INLONG-111";>[INLONG-111]</a> created by gosonzhang</i> -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
