Hey Stephen, In some cases in the maven build we now have pluggable source directories based on profiles using the maven build helper plug-in. This is necessary to support cross building against different Hive versions, and there will be additional instances of this due to supporting scala 2.11 and 2.10.
In these cases, you may need to add source locations explicitly to intellij if you want the entire project to compile there. Unfortunately as long as we support cross-building like this, it will be an issue. Intellij's maven support does not correctly detect our use of the maven-build-plugin to add source directories. We should come up with a good set of instructions on how to import the pom files + add the few extra source directories. Off hand I am not sure exactly what the correct sequence is. - Patrick On Tue, Oct 28, 2014 at 7:57 PM, Stephen Boesch <java...@gmail.com> wrote: > Hi Matei, > Until my latest pull from upstream/master it had not been necessary to > add the hive profile: is it now?? > > I am not using sbt gen-idea. The way to open in intellij has been to Open > the parent directory. IJ recognizes it as a maven project. > > There are several steps to do surgery on the yarn-parent / yarn projects , > then do a full rebuild. That was working until one week ago. > Intellij/maven is presently broken in two ways: this hive shim (which may > yet hopefully be a small/simple fix - let us see) and (2) the > "NoClassDefFoundError > on ThreadFactoryBuilder" from my prior emails -and which is quite a serious > problem . > > 2014-10-28 19:46 GMT-07:00 Matei Zaharia <matei.zaha...@gmail.com>: > >> Hi Stephen, >> >> How did you generate your Maven workspace? You need to make sure the Hive >> profile is enabled for it. For example sbt/sbt -Phive gen-idea. >> >> Matei >> >> > On Oct 28, 2014, at 7:42 PM, Stephen Boesch <java...@gmail.com> wrote: >> > >> > I have run on the command line via maven and it is fine: >> > >> > mvn -Dscalastyle.failOnViolation=false -DskipTests -Pyarn -Phadoop-2.3 >> > compile package install >> > >> > >> > But with the latest code Intellij builds do not work. Following is one of >> > 26 similar errors: >> > >> > >> > Error:(173, 38) not found: value HiveShim >> > >> Option(tableParameters.get(HiveShim.getStatsSetupConstTotalSize)) >> > ^ >> >> --------------------------------------------------------------------- To unsubscribe, e-mail: dev-unsubscr...@spark.apache.org For additional commands, e-mail: dev-h...@spark.apache.org
