hanahmily opened a new issue, #13330: URL: https://github.com/apache/skywalking/issues/13330
### Search before asking - [x] I had searched in the [issues](https://github.com/apache/skywalking/issues?q=is%3Aissue) and found no similar feature requirement. ### Description Develop a secondary index to support sorting and range scanning by timestamp and latency, as well as tag-based filtering. This index will complement the core storage layer, enabling complex queries. Key Features: - **Index Structure**: Use a structure similar to the core storage layer but organized by tags (e.g., `timestamp`, `latency`) instead of `traceID-spanID`. This allows grouping spans by common attributes for efficient filtering. - **Span File References**: Each entry in the secondary index must reference the corresponding span in the core storage's span file. This ensures that index queries can quickly retrieve full span data. - **Merge Dependency**: During the merge process, the core storage layer must first merge its files and generate a reference mapping between old and new span file locations. The secondary index will use this mapping to update its references, ensuring consistency. ### Use case _No response_ ### Related issues _No response_ ### Are you willing to submit a pull request to implement this on your own? - [ ] Yes I am willing to submit a pull request on my own! ### Code of Conduct - [x] I agree to follow this project's [Code of Conduct](https://www.apache.org/foundation/policies/conduct) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: notifications-unsubscr...@skywalking.apache.org.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
