Kaileshwar16 opened a new pull request, #865:
URL: https://github.com/apache/wayang/pull/865

   Related to #851.
   
   ### What changes were proposed in this pull request?
   
   `JavaJoinOperator` sizes its probe table using the estimated record count, 
even though the map stores one entry per distinct key. This wastes memory for 
duplicate-heavy inputs and can cause integer overflow for estimates above 
`Integer.MAX_VALUE`.
   
   Both build paths now use the default `HashMap` capacity, allowing the map to 
grow as needed. Input estimates are still used to select the build side.
   
   **Local Java 17 benchmark results:**
   - 1M records, 8 keys: ~4 MiB fewer allocations.
   - 250K unique keys: ~1 MiB more allocations due to resizing.
   
   These are operator-level results, not end-to-end performance measurements.
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to