Github user JoshRosen commented on the pull request:
https://github.com/apache/spark/pull/9297#issuecomment-160766207
@vanzin, in that case, why can't those tests live in the SQL module? I
think that we should be able to add a test where we create a SparkContext +
SQLContext with event logging enabled, run some queries, stop the context, then
programmatically instantiate a HistoryServer, reconstitute the UI from the
event logs, and perform some assertions over the loaded UI (e.g. check the
number of SQL tabs, check that clicking on the SQL tab returns a page with some
expected strings, etc). We could easily define some test helper classes to make
this easy to write.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
