Hi, I find not test targets/bese that would allow for the UI or REST access to be tested, sorry. All advise is appreciated.
I'm trying to work past that and even though I know it's not standard I'm trying to run the Drillbit. It fails on Jackson mapping initilization for the sys.storage_plugins: java.lang.RuntimeException: com.fasterxml.jackson.databind.JsonMappingException: Could not resolve type id 'hbase' into a subtype of [simple type, class org.apache.drill.common.logical.StoragePluginConfig] Can you please tell me if that is something local or if it would fail like that for you as well. I ask because configuration of the mapper seems so basic/fundimental. Regards, -Stefan On Fri, Jul 17, 2015 at 11:42 PM, Jacques Nadeau <[email protected]> wrote: > The default unit tests don't start the http server by default. This is due > to the following setting in the pom.xml: > -Ddrill.exec.http.enabled=false > > If you add -Ddrill.exec.http.enabled=true then your unit tests will start > the web server. > > Then you should be able to test rest things. (You can also look in > BaseTestQuery to see how we generally recommend starting a Drillbit in a > test-- beforeclass and afterclass) > > As far as what you'd like to enhance, these sound like great ideas. You > should file some JIRAs and then we can keep track and people can provide > additional inputs. > > On Fri, Jul 17, 2015 at 4:38 PM, Stefán Baxter <[email protected]> > wrote: > > > Hi again, > > > > We are using the REST interface for now and we would like to look into > the > > following things: > > > > - Support protobuf / messagepack as an alternative to json > (query.json) > > - Stop formatting JSON output (unnecessary white-spaces are being > sent) > > - Support gziped results > > - Stop sending numeric values as strings in JSON. (otpional) > > > > Hopefully we will be able to contribute something meaningful but these, a > > long with a few issues we have created, are of specific interest to us. > > > > It looks to me like running Drillbit.java might be the way to go (I find > no > > REST Test files) but running it produces the following error: > > > > Exception in thread "main" > > org.apache.drill.exec.exception.DrillbitStartupException: Failure during > > initial startup of Drillbit. > > at org.apache.drill.exec.server.Drillbit.start(Drillbit.java:87) > > at org.apache.drill.exec.server.Drillbit.start(Drillbit.java:66) > > at org.apache.drill.exec.server.Drillbit.main(Drillbit.java:166) > > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > > at > > > > > sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) > > at > > > > > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) > > at java.lang.reflect.Method.invoke(Method.java:497) > > at com.intellij.rt.execution.application.AppMain.main(AppMain.java:140) > > Caused by: java.lang.RuntimeException: > > com.fasterxml.jackson.databind.JsonMappingException: Could not resolve > type > > id 'hbase' into a subtype of [simple type, class > > org.apache.drill.common.logical.StoragePluginConfig] > > at [Source: [B@51e7589f; line: 2, column: 3] > > at > > > > > org.apache.drill.exec.store.sys.zk.ZkAbstractStore$Iter$DeferredEntry.getValue(ZkAbstractStore.java:197) > > at > > > > > org.apache.drill.exec.store.StoragePluginRegistry.createPlugins(StoragePluginRegistry.java:168) > > at > > > > > org.apache.drill.exec.store.StoragePluginRegistry.init(StoragePluginRegistry.java:132) > > at org.apache.drill.exec.server.Drillbit.run(Drillbit.java:244) > > at org.apache.drill.exec.server.Drillbit.start(Drillbit.java:84) > > ... 7 more > > Caused by: com.fasterxml.jackson.databind.JsonMappingException: Could not > > resolve type id 'hbase' into a subtype of [simple type, class > > org.apache.drill.common.logical.StoragePluginConfig] > > at [Source: [B@51e7589f; line: 2, column: 3] > > at > > > > > com.fasterxml.jackson.databind.JsonMappingException.from(JsonMappingException.java:148) > > at > > > > > com.fasterxml.jackson.databind.DeserializationContext.unknownTypeException(DeserializationContext.java:849) > > at > > > > > com.fasterxml.jackson.databind.jsontype.impl.TypeDeserializerBase._findDeserializer(TypeDeserializerBase.java:167) > > at > > > > > com.fasterxml.jackson.databind.jsontype.impl.AsPropertyTypeDeserializer._deserializeTypedForId(AsPropertyTypeDeserializer.java:99) > > at > > > > > com.fasterxml.jackson.databind.jsontype.impl.AsPropertyTypeDeserializer.deserializeTypedFromObject(AsPropertyTypeDeserializer.java:84) > > at > > > > > com.fasterxml.jackson.databind.deser.AbstractDeserializer.deserializeWithType(AbstractDeserializer.java:132) > > at > > > > > com.fasterxml.jackson.databind.deser.impl.TypeWrappedDeserializer.deserialize(TypeWrappedDeserializer.java:41) > > at > > > > > com.fasterxml.jackson.databind.ObjectReader._bindAndClose(ObjectReader.java:1269) > > at > > > > > com.fasterxml.jackson.databind.ObjectReader.readValue(ObjectReader.java:912) > > at > > > > > org.apache.drill.exec.store.sys.serialize.JacksonSerializer.deserialize(JacksonSerializer.java:44) > > at > > > > > org.apache.drill.exec.store.sys.zk.ZkAbstractStore$Iter$DeferredEntry.getValue(ZkAbstractStore.java:195) > > ... 11 more > > > > Could you please help us with the java options/config need to run the > > drillbit in local mode (fds only). > > > > Regards, > > -Stefan > > > > > > On Fri, Jul 17, 2015 at 11:19 PM, Stefán Baxter < > [email protected] > > > > > wrote: > > > > > thank you > > > > > > On Fri, Jul 17, 2015 at 11:16 PM, Jacques Nadeau <[email protected]> > > > wrote: > > > > > >> We typically extend BaseTestQuery and use unit tests for trying out > new > > >> functionality. BaseTestQuery provides a large number of ways to build > > >> tests. You can look here for some examples using the great test > builder > > >> api that Jason put together: > > >> > > >> > > >> > > > https://github.com/apache/drill/blob/master/exec/java-exec/src/test/java/org/apache/drill/TestExampleQueries.java#L36 > > >> > > >> On Fri, Jul 17, 2015 at 3:33 PM, Stefán Baxter < > > [email protected] > > >> > > > >> wrote: > > >> > > >> > Hi, > > >> > > > >> > Yes, I have done that. > > >> > > > >> > Can you please walk me through your development setup / processes. > > >> > > > >> > I'm reluctant to believe that your development cycle includes a full > > >> build > > >> > and as we are hoping to contribute (or at least try to be helpful) > > then > > >> I > > >> > would very much like to understand how you work on top of this > without > > >> > requiring full build+packaging. > > >> > > > >> > Regards, > > >> > -Stefan > > >> > > > >> > > > >> > On Fri, Jul 17, 2015 at 10:29 PM, Jacques Nadeau < > [email protected]> > > >> > wrote: > > >> > > > >> > > There is no maven target for this. However, a full build creates > a > > >> > > directory: distribution/target/apache-drill-1.2.0-SNAPSHOT that > you > > >> can > > >> > run > > >> > > those things from. > > >> > > > > >> > > On Fri, Jul 17, 2015 at 3:11 PM, Stefán Baxter < > > >> > [email protected]> > > >> > > wrote: > > >> > > > > >> > > > Hi, > > >> > > > > > >> > > > This worked, than you. > > >> > > > > > >> > > > What maven target can I run that is the equivalent of > > >> > > bin/drill-localhost > > >> > > > or bin/drillbit.sh start ? > > >> > > > > > >> > > > Regards, > > >> > > > -Stefán > > >> > > > > > >> > > > On Fri, Jul 17, 2015 at 3:48 PM, Jacques Nadeau < > > [email protected] > > >> > > > >> > > > wrote: > > >> > > > > > >> > > > > Try to exit Idea and then do a mvn clean; mvn install > > -DskipTests. > > >> > > > > > > >> > > > > On Fri, Jul 17, 2015 at 8:40 AM, Stefán Baxter < > > >> > > > [email protected]> > > >> > > >> > > > > wrote: > > >> > > > > > > >> > > > > > Yeah, you are right. (Idea) > > >> > > > > > > > >> > > > > > I get this error when I try to run that target: > > >> > > > > > [ERROR] Failed to execute goal > > >> > > > > > org.apache.maven.plugins:maven-compiler-plugin:3.2:compile > > >> > > > > > (default-compile) on project drill-common: Compilation > > failure: > > >> > > > > Compilation > > >> > > > > > failure: > > >> > > > > > [ERROR] Picked up JAVA_TOOL_OPTIONS: > > >> > > > > > -javaagent:/usr/share/java/jayatanaag.jar > > >> > > > > > [ERROR] > > >> > > > > > > > >> > > > > > > > >> > > > > > > >> > > > > > >> > > > > >> > > > >> > > > /var/www/as/drill/common/src/main/java/org/apache/drill/common/expression/LogicalExpression.java:[73,8] > > >> > > > > > error: cannot find symbol > > >> > > > > > [ERROR] symbol: class ExprLexer > > >> > > > > > [ERROR] location: class De > > >> > > > > > [ERROR] > > >> > > > > > > > >> > > > > > > > >> > > > > > > >> > > > > > >> > > > > >> > > > >> > > > /var/www/as/drill/common/src/main/java/org/apache/drill/common/expression/LogicalExpression.java:[73,30] > > >> > > > > > error: cannot find symbol > > >> > > > > > [ERROR] symbol: class ExprLexer > > >> > > > > > [ERROR] location: class De > > >> > > > > > [ERROR] > > >> > > > > > > > >> > > > > > > > >> > > > > > > >> > > > > > >> > > > > >> > > > >> > > > /var/www/as/drill/common/src/main/java/org/apache/drill/common/expression/LogicalExpression.java:[75,8] > > >> > > > > > error: cannot find symbol > > >> > > > > > [ERROR] symbol: class ExprParser > > >> > > > > > [ERROR] location: class De > > >> > > > > > [ERROR] > > >> > > > > > > > >> > > > > > > > >> > > > > > > >> > > > > > >> > > > > >> > > > >> > > > /var/www/as/drill/common/src/main/java/org/apache/drill/common/expression/LogicalExpression.java:[75,32] > > >> > > > > > error: cannot find symbol > > >> > > > > > [ERROR] symbol: class ExprParser > > >> > > > > > [ERROR] location: class De > > >> > > > > > [ERROR] > > >> > > > > > > > >> > > > > > > > >> > > > > > > >> > > > > > >> > > > > >> > > > >> > > > /var/www/as/drill/common/src/main/java/org/apache/drill/common/expression/LogicalExpression.java:[79,8] > > >> > > > > > error: cannot find symbol > > >> > > > > > [ERROR] -> [Help 1] > > >> > > > > > [ERROR] > > >> > > > > > [ERROR] To see the full stack trace of the errors, re-run > > Maven > > >> > with > > >> > > > the > > >> > > > > -e > > >> > > > > > switch. > > >> > > > > > [ERROR] Re-run Maven using the -X switch to enable full > debug > > >> > > logging. > > >> > > > > > [ERROR] > > >> > > > > > [ERROR] For more information about the errors and possible > > >> > solutions, > > >> > > > > > please read the following articles: > > >> > > > > > [ERROR] [Help 1] > > >> > > > > > > > >> > > > > http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException > > >> > > > > > [ERROR] > > >> > > > > > [ERROR] After correcting the problems, you can resume the > > build > > >> > with > > >> > > > the > > >> > > > > > command > > >> > > > > > [ERROR] mvn <goals> -rf :drill-common > > >> > > > > > > > >> > > > > > Looks to be another version of the same error. > > >> > > > > > > > >> > > > > > Any ideas? > > >> > > > > > > > >> > > > > > Regards, > > >> > > > > > -Stefan > > >> > > > > > > > >> > > > > > On Fri, Jul 17, 2015 at 3:35 PM, Jacques Nadeau < > > >> > [email protected]> > > >> > > > > > wrote: > > >> > > > > > > > >> > > > > > > I'm guessing that you're trying to use a IDE to build. > You > > >> > should > > >> > > do > > >> > > > > one > > >> > > > > > > run of mvn install -DskipTests before trying to use an > IDE. > > >> > > > > > > > > >> > > > > > > On Fri, Jul 17, 2015 at 8:29 AM, Stefán Baxter < > > >> > > > > > [email protected]> > > >> > > > > > > wrote: > > >> > > > > > > > > >> > > > > > > > Hi, > > >> > > > > > > > > > >> > > > > > > > I now see that this is a part of the ExprLexer.g (I will > > >> sort > > >> > it > > >> > > > out) > > >> > > > > > > > > > >> > > > > > > > Thank you, > > >> > > > > > > > -Stefan > > >> > > > > > > > > > >> > > > > > > > On Fri, Jul 17, 2015 at 3:20 PM, Stefán Baxter < > > >> > > > > > > [email protected]> > > >> > > > > > > > wrote: > > >> > > > > > > > > > >> > > > > > > > > Hi, > > >> > > > > > > > > > > >> > > > > > > > > I'm trying to build Drill from master branch. > > >> > > > > > > > > > > >> > > > > > > > > Is it possible that someone has not pushed: > > >> > > > > > > > > > > >> > > > > > > > > import > > >> org.apache.drill.common.expression.parser.ExprLexer; > > >> > > > > > > > > import > > >> org.apache.drill.common.expression.parser.ExprParser; > > >> > > > > > > > > import > > >> > > > > > > > > >> > org.apache.drill.common.expression.parser.ExprParser.parse_return; > > >> > > > > > > > > > > >> > > > > > > > > Regards, > > >> > > > > > > > > -Stefán > > >> > > > > > > > > > > >> > > > > > > > > > > >> > > > > > > > > ps. Sent this again as I was not verified my dev > > >> subscription > > >> > > > when > > >> > > > > a > > >> > > > > > > > previous copy was sent (in case this is a duplicate) > > >> > > > > > > > > > > >> > > > > > > > > > > >> > > > > > > > > > >> > > > > > > > > >> > > > > > > > >> > > > > > > >> > > > > > >> > > > > >> > > > >> > > > > > > > > >
