Github user vanzin commented on the pull request:
https://github.com/apache/spark/pull/4821#issuecomment-76785685
@pwendell yes, that's what I'm trying to say. Even today, logs generated by
Spark 1.0, 1.1 and 1.2 (and soon 1.3) are not exactly the same - events have
different properties. The metadata allows the parsing code to know what to
expect.
(That is not a problem internally in Spark because the code handles all
added/changed event properties using optionals and things like that, but
there's no way to know whether we'll make a change in the future that prevents
code like that from working without knowing the version of the data.)
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
