erikerlandson commented on pull request #28983: URL: https://github.com/apache/spark/pull/28983#issuecomment-653244850
The fix I coded here works if the function being used to apply to array elements is "identity". Experimentally, it seems to also work if values are being cast (e.g. array elements are float but aggregator is expecting array of double). The casting expressions I see are being added externally, like `(do map objects).toDoubleArray`. This fix will not work if there is some non-identity transform being applied to array elements. I'm not sure if that case actually arises or not. I do not think it does in the scenario of aggregator inputs. ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
