This is an automated email from the ASF dual-hosted git repository.
hanahmily pushed a change to branch vectorized-query
in repository https://gitbox.apache.org/repos/asf/skywalking-banyandb.git
from 8fc4bd2a5 Merge branch 'main' into vectorized-query
add d7b1427d1 feat(queue): G9f.0 per-topic ResponseCodec + RawFrame 0x00
invariant
add b7578ae55 feat(query): G9f.1 multi-measure vec dispatch + cross-group
merge
add 4d9e8c1f3 feat(query/vectorized/measure/frame): G9f.2 columnar binary
frame encoder + 0x00 proof test
add 07c8973b1 feat(query/vectorized/measure): G9f.2 AggModeMap —
typed-column partial emit + first-fed shard reconstruction
add a48b8e9ab feat(query/vectorized/measure): G9f.2 plan-wiring — thread
AggMode through Dispatch → Analyze → GroupByAgg → BuildOperators
add 62f0a3fa2 feat(query/vectorized/measure): G9f.3 CORE — frame.Decode +
AggModeReduce + (shard,group) dedup + 36-cell topology oracle
add 593c9f696 feat(query/vectorized/measure): G9f.4 distributed
Top-over-Agg in columnar form — remove interim :281 narrowing
add 77827add7 docs(measure): G9f.5.a fail-loud wire-mode publishing on
every service + operator runbook
add c09c2c1a4 fix(measure): hold the distributed wire-mode flip until the
wire emit/receive lands
add bbe064497 feat(query): G9f.5.b/c — synchronized cluster-wire cutover
for distributed measure queries
add 54b5eb3d9 test(query/vectorized/measure): G9f.6 in-process distributed
bench — the soak proxy
add 59b300ca1 fix(query): multi-measure projection validation must union
per-group schemas
add 277bfbebb refactor(query): vec dispatch — no fall-through to row +
independent row/vec verification on standalone and distributed
add 648d3fe03 feat(query/vectorized/measure): throughput-efficient
passthrough → typed conversion at the wire egress
add ae723c7dd fix(query/vectorized/measure): wire format v2 — preserve
TagFamily on the wire + per-source decode for cross-node dedup
add 210d751a3 fix(query/vectorized/measure): emptyMIterator implements
RawFrameSource for the canonical empty-result wire path
add 3ebf16cfa refactor(query/vectorized/measure): FrameEmitter — each
MIterator owns its wire-emit, no fall-through
add 74f81055e fix(query): distributed agg under flag-on — emit partials,
not pre-reduced values
add 033a1d797 feat(query/vectorized/measure): wire format v3 —
TagValue/FieldValue proto-bytes per cell
add b366c556b feat(query/vectorized): MeasureBatch + column pool — release
lifecycle
add 399c1e6bf feat(query/vectorized/measure/plan): native distributed
measure plan with k-way heap-merge row path
add b0cc20924 feat(dquery/measure): route raw-wire measure queries through
the vec distributed plan
add c27ec30fb test(integration): distributed query benchmark — row vs vec,
scan-all + top-with-filter
add d9a9e4530 feat(query/vectorized/measure/plan): lex sort-key encoder +
OrderBy index-rule resolver
add 34ee29d57 feat(query/vectorized/measure/plan): native OrderBy by index
rule on the vec distributed plan
add ae57a3560 feat(query/vectorized/measure/plan): unioned multi-group
BatchSchema builder
add 39e3459be feat(query/vectorized/measure/plan): native multi-group
distributed measure plan
add 98254d9ec feat(query/vectorized/measure/plan): hiddenFieldsMIterator —
field-axis egress strip
add 159ee5ae0 feat(query/vectorized/measure/plan): native Top-without-Agg
on the vec distributed plan
add f36a32e08 feat(query/vectorized/measure/plan): native Raw GroupBy +
per-group Top.N Limit calibration
add b7a046c05 refactor(dquery/measure): collapse raw-mode routing to a
single boolean — vec convergence
add bb20aaa47 Merge remote-tracking branch 'origin/vectorized-query' into
vectorized-query
No new revisions were added by this update.
Summary of changes:
api/data/codec.go | 172 ++++
api/data/codec_test.go | 200 +++++
api/data/data.go | 88 +-
banyand/dquery/measure.go | 73 +-
banyand/dquery/measure_test.go | 143 ++++
banyand/measure/block_batch.go | 26 +-
banyand/measure/svc_data.go | 13 +
banyand/measure/svc_liaison.go | 13 +
banyand/measure/svc_standalone.go | 15 +
banyand/query/processor.go | 170 +++-
banyand/queue/pub/pub.go | 9 +-
banyand/queue/pub/pub_suite_test.go | 14 +-
banyand/queue/pub/pub_tls_test.go | 13 +-
banyand/queue/sub/sub.go | 26 +-
.../measure-vec-flag-off-rollback.md | 71 ++
docs/soak/g9f-runbook.md | 154 ++++
pkg/query/logical/measure/cross_group_merge.go | 131 +++
.../logical/measure/measure_plan_distributed.go | 26 +
pkg/query/logical/measure/measure_plan_merge.go | 44 +-
pkg/query/model/batch.go | 83 ++
pkg/query/vectorized/column_pool.go | 161 ++++
pkg/query/vectorized/measure/adapter.go | 57 +-
pkg/query/vectorized/measure/adapter_test.go | 28 +-
pkg/query/vectorized/measure/aggregation.go | 377 +++++++--
pkg/query/vectorized/measure/aggregation_reduce.go | 152 ++++
pkg/query/vectorized/measure/aggregation_test.go | 420 +++++++++-
pkg/query/vectorized/measure/batchsource.go | 44 +-
pkg/query/vectorized/measure/bench_test.go | 4 +-
pkg/query/vectorized/measure/frame/decode.go | 327 ++++++++
pkg/query/vectorized/measure/frame/decode_test.go | 446 ++++++++++
pkg/query/vectorized/measure/frame/encode.go | 295 +++++++
pkg/query/vectorized/measure/frame/frame.go | 187 +++++
pkg/query/vectorized/measure/frame/frame_test.go | 381 +++++++++
pkg/query/vectorized/measure/frame/validate.go | 63 ++
pkg/query/vectorized/measure/integration.go | 28 +-
pkg/query/vectorized/measure/plan.go | 15 +-
pkg/query/vectorized/measure/plan/analyzer.go | 9 +-
pkg/query/vectorized/measure/plan/analyzer_test.go | 25 +-
pkg/query/vectorized/measure/plan/build_test.go | 2 +
pkg/query/vectorized/measure/plan/dispatch.go | 110 ++-
pkg/query/vectorized/measure/plan/dispatch_test.go | 76 +-
pkg/query/vectorized/measure/plan/distributed.go | 933 +++++++++++++++++++++
.../vectorized/measure/plan/distributed_rows.go | 767 +++++++++++++++++
.../measure/plan/distributed_rows_test.go | 797 ++++++++++++++++++
.../vectorized/measure/plan/distributed_test.go | 819 ++++++++++++++++++
pkg/query/vectorized/measure/plan/executor.go | 5 +-
pkg/query/vectorized/measure/plan/executor_test.go | 3 +
pkg/query/vectorized/measure/plan/groupby_agg.go | 21 +-
pkg/query/vectorized/measure/plan/hidden_tags.go | 79 ++
.../vectorized/measure/plan/multi_group_schema.go | 255 ++++++
.../measure/plan/multi_group_schema_test.go | 298 +++++++
pkg/query/vectorized/measure/plan/orderby.go | 81 ++
pkg/query/vectorized/measure/plan/sort_key.go | 96 +++
pkg/query/vectorized/measure/plan/sort_key_test.go | 156 ++++
pkg/query/vectorized/measure/plan_test.go | 20 +-
pkg/query/vectorized/measure/raw_emit.go | 683 +++++++++++++++
.../vectorized/measure/raw_emit_bench_test.go | 214 +++++
pkg/query/vectorized/measure/raw_emit_test.go | 485 +++++++++++
pkg/query/vectorized/measure/reduce.go | 345 ++++++++
.../vectorized/measure/topology_matrix_test.go | 407 +++++++++
pkg/query/vectorized/typed_column.go | 9 +-
.../distributed/query/vectorized_test.go | 146 ++++
.../integration/distributed/querybench/Dockerfile | 15 +-
test/integration/distributed/querybench/README.md | 75 ++
.../distributed/querybench/benchmark_test.go | 305 +++++++
test/integration/distributed/querybench/config.go | 231 +++++
.../distributed/querybench/config_test.go | 161 ++++
.../distributed/querybench/orchestrate.sh | 75 ++
test/integration/distributed/querybench/profile.go | 172 ++++
test/integration/distributed/querybench/report.go | 403 +++++++++
.../distributed/querybench/report_test.go | 112 +++
.../distributed/querybench/run-docker.sh | 94 +++
.../integration/distributed/querybench/workload.go | 378 +++++++++
.../distributed/querybench/workload_test.go | 79 ++
.../standalone/query/vectorized_test.go | 43 +-
75 files changed, 13079 insertions(+), 374 deletions(-)
create mode 100644 api/data/codec.go
create mode 100644 api/data/codec_test.go
create mode 100644 banyand/dquery/measure_test.go
create mode 100644
docs/operation/troubleshooting/measure-vec-flag-off-rollback.md
create mode 100644 docs/soak/g9f-runbook.md
create mode 100644 pkg/query/logical/measure/cross_group_merge.go
create mode 100644 pkg/query/vectorized/column_pool.go
create mode 100644 pkg/query/vectorized/measure/aggregation_reduce.go
create mode 100644 pkg/query/vectorized/measure/frame/decode.go
create mode 100644 pkg/query/vectorized/measure/frame/decode_test.go
create mode 100644 pkg/query/vectorized/measure/frame/encode.go
create mode 100644 pkg/query/vectorized/measure/frame/frame.go
create mode 100644 pkg/query/vectorized/measure/frame/frame_test.go
create mode 100644 pkg/query/vectorized/measure/frame/validate.go
create mode 100644 pkg/query/vectorized/measure/plan/distributed.go
create mode 100644 pkg/query/vectorized/measure/plan/distributed_rows.go
create mode 100644 pkg/query/vectorized/measure/plan/distributed_rows_test.go
create mode 100644 pkg/query/vectorized/measure/plan/distributed_test.go
create mode 100644 pkg/query/vectorized/measure/plan/multi_group_schema.go
create mode 100644 pkg/query/vectorized/measure/plan/multi_group_schema_test.go
create mode 100644 pkg/query/vectorized/measure/plan/orderby.go
create mode 100644 pkg/query/vectorized/measure/plan/sort_key.go
create mode 100644 pkg/query/vectorized/measure/plan/sort_key_test.go
create mode 100644 pkg/query/vectorized/measure/raw_emit.go
create mode 100644 pkg/query/vectorized/measure/raw_emit_bench_test.go
create mode 100644 pkg/query/vectorized/measure/raw_emit_test.go
create mode 100644 pkg/query/vectorized/measure/reduce.go
create mode 100644 pkg/query/vectorized/measure/topology_matrix_test.go
create mode 100644 test/integration/distributed/query/vectorized_test.go
copy mcp/.gitignore => test/integration/distributed/querybench/Dockerfile (82%)
create mode 100644 test/integration/distributed/querybench/README.md
create mode 100644 test/integration/distributed/querybench/benchmark_test.go
create mode 100644 test/integration/distributed/querybench/config.go
create mode 100644 test/integration/distributed/querybench/config_test.go
create mode 100755 test/integration/distributed/querybench/orchestrate.sh
create mode 100644 test/integration/distributed/querybench/profile.go
create mode 100644 test/integration/distributed/querybench/report.go
create mode 100644 test/integration/distributed/querybench/report_test.go
create mode 100755 test/integration/distributed/querybench/run-docker.sh
create mode 100644 test/integration/distributed/querybench/workload.go
create mode 100644 test/integration/distributed/querybench/workload_test.go
