This is an automated email from the ASF dual-hosted git repository.
richox pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/auron.git
The following commit(s) were added to refs/heads/master by this push:
new 31ed89fd fix(bloom_filter): skip 1-byte marker in unfreeze_from_arrays
to fix version mismatch (#1979)
31ed89fd is described below
commit 31ed89fd5421c67cb07ab3405aceb708e8c94525
Author: Bryton Lee <[email protected]>
AuthorDate: Mon Feb 9 23:14:46 2026 +0800
fix(bloom_filter): skip 1-byte marker in unfreeze_from_arrays to fix
version mismatch (#1979)
freeze_to_arrays writes a 1-byte marker (0x01) before the BloomFilter
data, but unfreeze_from_arrays was reading directly without skipping
this marker. This caused SparkBloomFilter::read_from to interpret the
marker byte as part of the version field, resulting in "unsupported
version: 16777216" error (0x01000000 when read as big-endian i32).
The fix adds cursor.read_u8() to skip the marker before reading the
BloomFilter.
---
native-engine/datafusion-ext-plans/src/agg/bloom_filter.rs | 1 -
1 file changed, 1 deletion(-)
diff --git a/native-engine/datafusion-ext-plans/src/agg/bloom_filter.rs
b/native-engine/datafusion-ext-plans/src/agg/bloom_filter.rs
index 4688e131..85d1ba03 100644
--- a/native-engine/datafusion-ext-plans/src/agg/bloom_filter.rs
+++ b/native-engine/datafusion-ext-plans/src/agg/bloom_filter.rs
@@ -256,7 +256,6 @@ impl AccColumn for AccBloomFilterColumn {
(idx in idx) => {
if let Some(bloom_filter) = &self.bloom_filters[idx] {
let mut w = vec![];
- w.write_u8(1)?;
bloom_filter.write_to(&mut w)?;
array.push(Some(w));
} else {