-Phive is to enable hive-0.13.1 and "-Phive -Phive-0.12.0” is to enable hive-0.12.0. Note that the thrift-server is not supported yet in hive-0.13, but expected to go to upstream soon (Spark-3720).
Thanks. Zhan Zhang On Oct 28, 2014, at 9:09 PM, Stephen Boesch <java...@gmail.com> wrote: > Thanks Patrick for the heads up. > > I have not been successful to discover a combination of profiles (i.e. > enabling hive or hive-0.12.0 or hive-13.0) that works in Intellij with > maven. Anyone who knows how to handle this - a quick note here would be > appreciated. > > > > 2014-10-28 20:20 GMT-07:00 Patrick Wendell <pwend...@gmail.com>: > >> Hey Stephen, >> >> In some cases in the maven build we now have pluggable source >> directories based on profiles using the maven build helper plug-in. >> This is necessary to support cross building against different Hive >> versions, and there will be additional instances of this due to >> supporting scala 2.11 and 2.10. >> >> In these cases, you may need to add source locations explicitly to >> intellij if you want the entire project to compile there. >> >> Unfortunately as long as we support cross-building like this, it will >> be an issue. Intellij's maven support does not correctly detect our >> use of the maven-build-plugin to add source directories. >> >> We should come up with a good set of instructions on how to import the >> pom files + add the few extra source directories. Off hand I am not >> sure exactly what the correct sequence is. >> >> - Patrick >> >> On Tue, Oct 28, 2014 at 7:57 PM, Stephen Boesch <java...@gmail.com> wrote: >>> Hi Matei, >>> Until my latest pull from upstream/master it had not been necessary to >>> add the hive profile: is it now?? >>> >>> I am not using sbt gen-idea. The way to open in intellij has been to Open >>> the parent directory. IJ recognizes it as a maven project. >>> >>> There are several steps to do surgery on the yarn-parent / yarn projects >> , >>> then do a full rebuild. That was working until one week ago. >>> Intellij/maven is presently broken in two ways: this hive shim (which >> may >>> yet hopefully be a small/simple fix - let us see) and (2) the >>> "NoClassDefFoundError >>> on ThreadFactoryBuilder" from my prior emails -and which is quite a >> serious >>> problem . >>> >>> 2014-10-28 19:46 GMT-07:00 Matei Zaharia <matei.zaha...@gmail.com>: >>> >>>> Hi Stephen, >>>> >>>> How did you generate your Maven workspace? You need to make sure the >> Hive >>>> profile is enabled for it. For example sbt/sbt -Phive gen-idea. >>>> >>>> Matei >>>> >>>>> On Oct 28, 2014, at 7:42 PM, Stephen Boesch <java...@gmail.com> >> wrote: >>>>> >>>>> I have run on the command line via maven and it is fine: >>>>> >>>>> mvn -Dscalastyle.failOnViolation=false -DskipTests -Pyarn >> -Phadoop-2.3 >>>>> compile package install >>>>> >>>>> >>>>> But with the latest code Intellij builds do not work. Following is >> one of >>>>> 26 similar errors: >>>>> >>>>> >>>>> Error:(173, 38) not found: value HiveShim >>>>> >>>> Option(tableParameters.get(HiveShim.getStatsSetupConstTotalSize)) >>>>> ^ >>>> >>>> >> -- CONFIDENTIALITY NOTICE NOTICE: This message is intended for the use of the individual or entity to which it is addressed and may contain information that is confidential, privileged and exempt from disclosure under applicable law. If the reader of this message is not the intended recipient, you are hereby notified that any printing, copying, dissemination, distribution, disclosure or forwarding of this communication is strictly prohibited. If you have received this communication in error, please contact the sender immediately and delete it from your system. Thank You. --------------------------------------------------------------------- To unsubscribe, e-mail: dev-unsubscr...@spark.apache.org For additional commands, e-mail: dev-h...@spark.apache.org
