ShreyeshArangath opened a new pull request, #1955:
URL: https://github.com/apache/auron/pull/1955
<!--
- Start the PR title with the related issue ID, e.g. '[AURON #XXXX] Short
summary...'.
-->
# Which issue does this PR close?
Closes #1889
# Rationale for this change
Adds's support for non-deterministic function, as part of #1833
# What changes are included in this PR?
Implements native support for Spark's `monotonically_increasing_id()``
function in Auron.
Functionality TL;DR:
The `monotonically_increasing_id()` function generates unique, monotonically
increasing 64-bit integers across all partitions. Each partition generates IDs
using the formula:
```go
id := (partition_id << 33) | row_number
```
- Each ID is globally unique across all partitions
- IDs increase monotonically within each partition
- The upper 31 bits encode the partition ID, while the lower 33 bits encode
the row number within that partition
# Are there any user-facing changes?
N/A
# How was this patch tested?
Unit tests
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
