mridulm edited a comment on pull request #35076: URL: https://github.com/apache/spark/pull/35076#issuecomment-1008446824
I had written up my comment before your log messages @pan3793. What I had detailed is a potential bug - whether that is impacting this specific issue needs to be seen, though looks unlikely. The discrepancy between data file size and data length seems to indicate some other issue here - though I cant make much out from the details provided unfortunately: particularly the file sizes are extremely confusing observation. I will let @otterc reproduce. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
