Github user rxin commented on the pull request:
https://github.com/apache/spark/pull/5709#issuecomment-96494526
Those could change in shuffle I guess, but I don't think this is creating
more confusion. What we care about here is not the record ordering, but the
output of this expression is monotonic increasing. That will always be true.
This is very similar to the row id idea a lot of databases have. SQL tables
also don't have ordering, unless they are sorted.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
