Github user HyukjinKwon commented on the pull request:
https://github.com/apache/spark/pull/9517#issuecomment-155020044
In this commit, I added partitioned tables for the test and sorted the
`FileStatus`es.
There are several things to mention here.
Firstly, now we do not need to change `Set` to `LinkedHashSet` and `Map` to
`LinkedHashMap` for this issue since it manually sorts the `FileStatus`es.
However, I left them as I though anyway the order of files better be in the
order as they are retrieved. If that looks weird, I would like to get it back.
Secondly, in any cases, the columns of the lexicographically first file
shows first, which might be a matter for files starting/containing with numeric
values. However, I left this as I though anyway it is deterministic.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
