Github user tgravescs commented on the issue:
https://github.com/apache/spark/pull/17658
the idea here was mine. I agree that it could be confusing but its also
confusing as is and its hard to find the version that was run. I was figuring
this way would be consistent with the live UI. If you have other suggestions I
am definitely open. I thought about just removing the version from there and
putting it elsewhere but then its less consistent.
As far as you questions on the event. I don't really know why it was made
private my assumption here is that it was for metadata only and could have
potentially changed. However this is the only place we currently store the
version and I don't really see any harm in sending this event out but it would
be good to check with others.
@andrewor14 @vanzin Do you have any issues with changing to send
SparkListenerLogStart event out?
The other option is to add a new event or put the version in with another
event but then it won't work with any of the older versions.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
