This is an automated email from the ASF dual-hosted git repository.
yangjie01 pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/spark.git
The following commit(s) were added to refs/heads/master by this push:
new 67c71874bcb2 [SPARK-48661][BUILD] Upgrade `RoaringBitmap` to 1.1.0
67c71874bcb2 is described below
commit 67c71874bcb2ce6fe2f68e0e47cab72e0d37a687
Author: Wei Guo <[email protected]>
AuthorDate: Fri Jun 21 10:31:43 2024 +0800
[SPARK-48661][BUILD] Upgrade `RoaringBitmap` to 1.1.0
### What changes were proposed in this pull request?
This PR aims to upgrade `RoaringBitmap` to 1.1.0.
### Why are the changes needed?
There are some bug fixes in `RoaringBitmap` 1.1.0:
Fix RunContainer#contains(BitmapContainer)
(https://github.com/RoaringBitmap/RoaringBitmap/issues/721) by LeeWorrall in
https://github.com/RoaringBitmap/RoaringBitmap/pull/722
Fix ArrayContainer#contains(RunContainer)
(https://github.com/RoaringBitmap/RoaringBitmap/issues/723) by LeeWorrall in
https://github.com/RoaringBitmap/RoaringBitmap/pull/724
Full release note:
https://github.com/RoaringBitmap/RoaringBitmap/releases/tag/1.1.0
### Does this PR introduce _any_ user-facing change?
No.
### How was this patch tested?
Pass GA.
### Was this patch authored or co-authored using generative AI tooling?
No.
Closes #47020 from wayneguow/upgrade_RoaringBitmap.
Authored-by: Wei Guo <[email protected]>
Signed-off-by: yangjie01 <[email protected]>
---
core/benchmarks/MapStatusesConvertBenchmark-jdk21-results.txt | 8 ++++----
core/benchmarks/MapStatusesConvertBenchmark-results.txt | 8 ++++----
dev/deps/spark-deps-hadoop-3-hive-2.3 | 2 +-
pom.xml | 2 +-
4 files changed, 10 insertions(+), 10 deletions(-)
diff --git a/core/benchmarks/MapStatusesConvertBenchmark-jdk21-results.txt
b/core/benchmarks/MapStatusesConvertBenchmark-jdk21-results.txt
index 71c13a0fc5ad..a15442496b24 100644
--- a/core/benchmarks/MapStatusesConvertBenchmark-jdk21-results.txt
+++ b/core/benchmarks/MapStatusesConvertBenchmark-jdk21-results.txt
@@ -2,12 +2,12 @@
MapStatuses Convert Benchmark
================================================================================================
-OpenJDK 64-Bit Server VM 21.0.3+9-LTS on Linux 6.5.0-1018-azure
+OpenJDK 64-Bit Server VM 21.0.3+9-LTS on Linux 6.5.0-1022-azure
AMD EPYC 7763 64-Core Processor
MapStatuses Convert: Best Time(ms) Avg Time(ms)
Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-Num Maps: 50000 Fetch partitions:500 664 678
14 0.0 664277160.0 1.0X
-Num Maps: 50000 Fetch partitions:1000 1597 1616
29 0.0 1596794881.0 0.4X
-Num Maps: 50000 Fetch partitions:1500 2402 2421
18 0.0 2401654923.0 0.3X
+Num Maps: 50000 Fetch partitions:500 674 685
12 0.0 673772738.0 1.0X
+Num Maps: 50000 Fetch partitions:1000 1579 1590
12 0.0 1579383970.0 0.4X
+Num Maps: 50000 Fetch partitions:1500 2435 2472
37 0.0 2434530380.0 0.3X
diff --git a/core/benchmarks/MapStatusesConvertBenchmark-results.txt
b/core/benchmarks/MapStatusesConvertBenchmark-results.txt
index a7379aa0d4af..b9f36af4a653 100644
--- a/core/benchmarks/MapStatusesConvertBenchmark-results.txt
+++ b/core/benchmarks/MapStatusesConvertBenchmark-results.txt
@@ -2,12 +2,12 @@
MapStatuses Convert Benchmark
================================================================================================
-OpenJDK 64-Bit Server VM 17.0.11+9-LTS on Linux 6.5.0-1018-azure
+OpenJDK 64-Bit Server VM 17.0.11+9-LTS on Linux 6.5.0-1022-azure
AMD EPYC 7763 64-Core Processor
MapStatuses Convert: Best Time(ms) Avg Time(ms)
Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-Num Maps: 50000 Fetch partitions:500 699 715
14 0.0 698750825.0 1.0X
-Num Maps: 50000 Fetch partitions:1000 1653 1676
36 0.0 1653453370.0 0.4X
-Num Maps: 50000 Fetch partitions:1500 2580 2613
30 0.0 2579900318.0 0.3X
+Num Maps: 50000 Fetch partitions:500 703 716
11 0.0 703103575.0 1.0X
+Num Maps: 50000 Fetch partitions:1000 1707 1723
14 0.0 1707060398.0 0.4X
+Num Maps: 50000 Fetch partitions:1500 2626 2638
14 0.0 2625981097.0 0.3X
diff --git a/dev/deps/spark-deps-hadoop-3-hive-2.3
b/dev/deps/spark-deps-hadoop-3-hive-2.3
index c74482eb2fdb..edaf1c494d13 100644
--- a/dev/deps/spark-deps-hadoop-3-hive-2.3
+++ b/dev/deps/spark-deps-hadoop-3-hive-2.3
@@ -1,7 +1,7 @@
HikariCP/2.5.1//HikariCP-2.5.1.jar
JLargeArrays/1.5//JLargeArrays-1.5.jar
JTransforms/3.1//JTransforms-3.1.jar
-RoaringBitmap/1.0.6//RoaringBitmap-1.0.6.jar
+RoaringBitmap/1.1.0//RoaringBitmap-1.1.0.jar
ST4/4.0.4//ST4-4.0.4.jar
activation/1.1.1//activation-1.1.1.jar
aircompressor/0.27//aircompressor-0.27.jar
diff --git a/pom.xml b/pom.xml
index 8a5a5b0633c6..85fc2aefdf90 100644
--- a/pom.xml
+++ b/pom.xml
@@ -830,7 +830,7 @@
<dependency>
<groupId>org.roaringbitmap</groupId>
<artifactId>RoaringBitmap</artifactId>
- <version>1.0.6</version>
+ <version>1.1.0</version>
</dependency>
<!-- Netty Begin -->
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
