Github user brkyvz commented on the pull request:
https://github.com/apache/spark/pull/9624#issuecomment-156914641
@JoshRosen There are so many things I couldn't figure about Ivy... The
library is practically a black box. It unfortunately doesn't have a lot of
documentation (at least for the library). There are two problems that I would
love to fix:
1) Ivy configurations. Basically, if you publish a library locally in SBT
with publishLocal, Spark won't be able to access it due to configurations.
publishM2 works fine though.
2) This cache corruption issue.
IMHO, I would suggest taking a flag, which is by default off, but on in
Jenkins that would use the shared cache. If this causes flakiness in the
SparkSubmitSuite tests, then we'll have to turn it off though :(
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
