Github user calvinjia commented on the pull request:
https://github.com/apache/spark/pull/5354#issuecomment-94530456
@srowen
Despite Jackson being managed by dependencyManagement, lower versions make
it into managed_libs which cause issues when `mllib` tests run, since they
expect the higher version. This is why I exclude the library from hadoop-client
which brings in the lower versions.
For `httpclient`, `4.2.5` is brought in by `sql/hive` when they reference
`libthrift`. This causes selenium tests to break since it expects `4.3.2`.
Finding the perfect way to reconcile Spark's dependencies as you mentioned
before, deserves its own ticket and will require substantial effort. For
example, it is not even easy to tell that different versions of `httpclient`
are referenced in Spark.
@ScrapCodes
Let's address cleaning up the Kinesis profile in a separate PR.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
