[METRICS] Metrics names inconsistent between executions

2019-05-06 Thread Anton Kirillov
ured in metric reporters in this case). Not sure if this could potentially break Driver UI though. I'd really appreciate any feedback on this issue and would be happy to create a Jira issue/PR if this change looks sane for the community. Thanks in advance. -- *Anton Kirillov* Senior Software Engineer, Mesosphere

Re: Spark 2.4.0 tests fail with hadoop-3.1 profile: NoClassDefFoundError org.apache.hadoop.hive.conf.HiveConf

2019-04-05 Thread Anton Kirillov
Marcelo, Sean, thanks for the clarification. So in order to support Hadoop 3+ the preferred way would be to use Hadoop-free builds and provide Hadoop dependencies in the classpath, is that correct? On Fri, Apr 5, 2019 at 10:57 AM Marcelo Vanzin wrote: > The hadoop-3 profile doesn't really work

Re: Spark 2.4.0 tests fail with hadoop-3.1 profile: NoClassDefFoundError org.apache.hadoop.hive.conf.HiveConf

2019-04-05 Thread Anton Kirillov
Really sorry for the formatting. Here's the original message: Hi there! I'm trying to run Spark unit tests with the following profiles: ./build/mvn test -Pmesos "-Phadoop-3.1" -Pnetlib-lgpl -Psparkr -Phive -Phive-thriftserver And 'core' module fails with the following test failing with