Github user sryza commented on the pull request:
https://github.com/apache/spark/pull/4550#issuecomment-74166937
That makes sense. When we're bypassing the merge threshold, measuring the
time spent opening the partition files instead of the merged file.
However, this patch still doesn't add support for measuring the time spent
opening files in the main path where we don't bypass the merge threshold.
Unless I'm misundestanding?
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
