Skip to content

Commit

Permalink
[SPARK-48829][BUILD] Upgrade RoaringBitmap to 1.2.1
Browse files Browse the repository at this point in the history
### What changes were proposed in this pull request?
The pr aims to upgrade `RoaringBitmap` from `1.1.0` to `1.2.1`.

### Why are the changes needed?
- The full release notes: https://github.com/RoaringBitmap/RoaringBitmap/releases/tag/1.2.0
- The latest version has brought bug fixes and some improvements:
  improve: Optimize RoaringBitSet.get(int fromIndex, int toIndex) RoaringBitmap/RoaringBitmap#727
  fix: add bitmapOfRange (non-static) in RoaringBitmap/RoaringBitmap#728

### Does this PR introduce _any_ user-facing change?
No.

### How was this patch tested?
Pass GA.

### Was this patch authored or co-authored using generative AI tooling?
No.

Closes apache#47247 from panbingkun/SPARK-48829.

Authored-by: panbingkun <[email protected]>
Signed-off-by: yangjie01 <[email protected]>
  • Loading branch information
panbingkun authored and LuciferYang committed Jul 30, 2024
1 parent 76bbcc5 commit 6ff93ea
Show file tree
Hide file tree
Showing 4 changed files with 10 additions and 10 deletions.
8 changes: 4 additions & 4 deletions core/benchmarks/MapStatusesConvertBenchmark-jdk21-results.txt
Original file line number Diff line number Diff line change
Expand Up @@ -2,12 +2,12 @@
MapStatuses Convert Benchmark
================================================================================================

OpenJDK 64-Bit Server VM 21.0.3+9-LTS on Linux 6.5.0-1022-azure
OpenJDK 64-Bit Server VM 21.0.4+7-LTS on Linux 6.5.0-1023-azure
AMD EPYC 7763 64-Core Processor
MapStatuses Convert: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Num Maps: 50000 Fetch partitions:500 674 685 12 0.0 673772738.0 1.0X
Num Maps: 50000 Fetch partitions:1000 1579 1590 12 0.0 1579383970.0 0.4X
Num Maps: 50000 Fetch partitions:1500 2435 2472 37 0.0 2434530380.0 0.3X
Num Maps: 50000 Fetch partitions:500 697 707 10 0.0 697013793.0 1.0X
Num Maps: 50000 Fetch partitions:1000 1608 1621 16 0.0 1608250487.0 0.4X
Num Maps: 50000 Fetch partitions:1500 2443 2478 39 0.0 2443321570.0 0.3X


8 changes: 4 additions & 4 deletions core/benchmarks/MapStatusesConvertBenchmark-results.txt
Original file line number Diff line number Diff line change
Expand Up @@ -2,12 +2,12 @@
MapStatuses Convert Benchmark
================================================================================================

OpenJDK 64-Bit Server VM 17.0.11+9-LTS on Linux 6.5.0-1022-azure
OpenJDK 64-Bit Server VM 17.0.12+7-LTS on Linux 6.5.0-1023-azure
AMD EPYC 7763 64-Core Processor
MapStatuses Convert: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Num Maps: 50000 Fetch partitions:500 703 716 11 0.0 703103575.0 1.0X
Num Maps: 50000 Fetch partitions:1000 1707 1723 14 0.0 1707060398.0 0.4X
Num Maps: 50000 Fetch partitions:1500 2626 2638 14 0.0 2625981097.0 0.3X
Num Maps: 50000 Fetch partitions:500 769 772 3 0.0 769382967.0 1.0X
Num Maps: 50000 Fetch partitions:1000 1698 1715 14 0.0 1698166886.0 0.5X
Num Maps: 50000 Fetch partitions:1500 2588 2606 26 0.0 2587840071.0 0.3X


2 changes: 1 addition & 1 deletion dev/deps/spark-deps-hadoop-3-hive-2.3
Original file line number Diff line number Diff line change
@@ -1,7 +1,7 @@
HikariCP/2.5.1//HikariCP-2.5.1.jar
JLargeArrays/1.5//JLargeArrays-1.5.jar
JTransforms/3.1//JTransforms-3.1.jar
RoaringBitmap/1.1.0//RoaringBitmap-1.1.0.jar
RoaringBitmap/1.2.1//RoaringBitmap-1.2.1.jar
ST4/4.0.4//ST4-4.0.4.jar
activation/1.1.1//activation-1.1.1.jar
aircompressor/0.27//aircompressor-0.27.jar
Expand Down
2 changes: 1 addition & 1 deletion pom.xml
Original file line number Diff line number Diff line change
Expand Up @@ -830,7 +830,7 @@
<dependency>
<groupId>org.roaringbitmap</groupId>
<artifactId>RoaringBitmap</artifactId>
<version>1.1.0</version>
<version>1.2.1</version>
</dependency>

<!-- Netty Begin -->
Expand Down

0 comments on commit 6ff93ea

Please sign in to comment.