chunshao90 opened a new issue, #1411: URL: https://github.com/apache/incubator-horaedb/issues/1411
### Describe This Problem Here are some of the features I have planned for 2024. Everyone is welcome to discuss. ### Proposal ### Distributed Solution 1. Meta Procedure Module * Refine operations such as retries and rollbacks for different procedures. 2. Automated Load Balancing Based on Real Load * Implement dynamic load information collection mechanisms, with horaedb uploading real load data. * Incorporate advanced scheduling algorithms to balance load distribution based on actual load conditions. 3. Increase chaos testing to validate system robustness. ### Query Optimization 1. Optimize PQL by supporting operator pushdown to reduce data retrieval costs. 2. Add SST-level sorted keys to improve data-fetching efficiency during queries. ## Storage Optimization 1. Improve query performance for both high and low cardinality by enhancing storage formats * Introduce inverted indexes. * Organize data along timelines. * Implement a columnar storage Memtable. 2. Compaction Offload * Outsource compaction tasks to dedicated nodes or services to minimize the impact on real-time query nodes. ### Tools 1. horaecontrol cluster command-line tool, supporting functions such as automated deployment, monitoring integration, and fault diagnosis. ### Need to discuss 1. Evaluate the feasibility of reimplementing horaemeta with Rust to unify the development language and improve development efficiency. ### Additional Context _No response_ -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
