Github user henrify commented on the issue:
https://github.com/apache/spark/pull/19943
If i've understood Spark development process correctly, the 2.3 branch cut
date is in couple of days, and if this PR doesn't get merged to master real
soon, it'll have to wait until 2.4, about 6 months?
@dongjoon-hyun @cloud-fan Considering that the benchmarks show almost order
of magnitude improvement in performance, it would be really great to get this
in for Spark 2.3, and worry about the details of copy vs wrapper approach later.
Also, as this is anyway opt-in feature that needs to be enabled with config
option, merging this shouldn't be "dangerous".. Thanks for your efforts &
looking forward to get this PR to production!
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]