spark git commit: [SPARK-25904][CORE] Allocate arrays smaller than Int.MaxValue

2018-11-08 Thread irashid
Repository: spark Updated Branches: refs/heads/branch-2.4 947462f5a -> 47a668c2f [SPARK-25904][CORE] Allocate arrays smaller than Int.MaxValue JVMs can't allocate arrays of length exactly Int.MaxValue, so ensure we never try to allocate an array that big. This commit changes some defaults &

spark git commit: [SPARK-25904][CORE] Allocate arrays smaller than Int.MaxValue

2018-11-07 Thread irashid
Repository: spark Updated Branches: refs/heads/master 9e9fa2f69 -> 8fbc1830f [SPARK-25904][CORE] Allocate arrays smaller than Int.MaxValue JVMs can't allocate arrays of length exactly Int.MaxValue, so ensure we never try to allocate an array that big. This commit changes some defaults &