milastdbx commented on PR #48625: URL: https://github.com/apache/spark/pull/48625#issuecomment-2458350205
If postgres array has row with different array dimensionality (array_dims returning different values for different rows) - then from Spark perspective there is really no correct answer to what `array_dims` we should use given that spark cannot process this rows anyway. Given that there is no correct answer, all answers are wrong answers, so returning `rand()` is same as reading it from metadata, as for Spark these are all incorrect. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
