This is an automated email from the ASF dual-hosted git repository.
kxiao pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/doris.git
from ebac816e85 Revert "[improvement](bitshuffle)Enable avx512 support in
bitshuffle for performance boost (#15972)" (#24146)
add 71db844c64 [feature](invert index) add tokenizer CharFilter
preprocessing (#24102)
No new revisions were added by this update.
Summary of changes:
be/src/olap/inverted_index_parser.cpp | 36 ++++++++++
be/src/olap/inverted_index_parser.h | 8 +++
.../char_filter/char_filter_factory.h} | 28 +++-----
.../char_filter/char_replace_char_filter.cpp | 59 ++++++++++++++++
.../char_filter/char_replace_char_filter.h} | 39 +++++-----
.../rowset/segment_v2/inverted_index_writer.cpp | 13 +++-
.../char_filter/test_char_replace.out} | 34 ++++++---
.../char_filter/test_char_replace.groovy | 82 ++++++++++++++++++++++
8 files changed, 248 insertions(+), 51 deletions(-)
copy be/src/{geo/wkt_parse_type.h =>
olap/rowset/segment_v2/inverted_index/char_filter/char_filter_factory.h} (62%)
create mode 100644
be/src/olap/rowset/segment_v2/inverted_index/char_filter/char_replace_char_filter.cpp
copy be/src/{exec/schema_scanner/schema_schema_privileges_scanner.h =>
olap/rowset/segment_v2/inverted_index/char_filter/char_replace_char_filter.h}
(53%)
copy regression-test/data/{query_p2/system/test_query_sys_tables.out =>
inverted_index_p0/char_filter/test_char_replace.out} (72%)
create mode 100644
regression-test/suites/inverted_index_p0/char_filter/test_char_replace.groovy
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
