The default unit tests don't start the http server by default. This is due to the following setting in the pom.xml: -Ddrill.exec.http.enabled=false
If you add -Ddrill.exec.http.enabled=true then your unit tests will start the web server. Then you should be able to test rest things. (You can also look in BaseTestQuery to see how we generally recommend starting a Drillbit in a test-- beforeclass and afterclass) As far as what you'd like to enhance, these sound like great ideas. You should file some JIRAs and then we can keep track and people can provide additional inputs. On Fri, Jul 17, 2015 at 4:38 PM, Stefán Baxter <[email protected]> wrote: > Hi again, > > We are using the REST interface for now and we would like to look into the > following things: > > - Support protobuf / messagepack as an alternative to json (query.json) > - Stop formatting JSON output (unnecessary white-spaces are being sent) > - Support gziped results > - Stop sending numeric values as strings in JSON. (otpional) > > Hopefully we will be able to contribute something meaningful but these, a > long with a few issues we have created, are of specific interest to us. > > It looks to me like running Drillbit.java might be the way to go (I find no > REST Test files) but running it produces the following error: > > Exception in thread "main" > org.apache.drill.exec.exception.DrillbitStartupException: Failure during > initial startup of Drillbit. > at org.apache.drill.exec.server.Drillbit.start(Drillbit.java:87) > at org.apache.drill.exec.server.Drillbit.start(Drillbit.java:66) > at org.apache.drill.exec.server.Drillbit.main(Drillbit.java:166) > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > at > > sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) > at > > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) > at java.lang.reflect.Method.invoke(Method.java:497) > at com.intellij.rt.execution.application.AppMain.main(AppMain.java:140) > Caused by: java.lang.RuntimeException: > com.fasterxml.jackson.databind.JsonMappingException: Could not resolve type > id 'hbase' into a subtype of [simple type, class > org.apache.drill.common.logical.StoragePluginConfig] > at [Source: [B@51e7589f; line: 2, column: 3] > at > > org.apache.drill.exec.store.sys.zk.ZkAbstractStore$Iter$DeferredEntry.getValue(ZkAbstractStore.java:197) > at > > org.apache.drill.exec.store.StoragePluginRegistry.createPlugins(StoragePluginRegistry.java:168) > at > > org.apache.drill.exec.store.StoragePluginRegistry.init(StoragePluginRegistry.java:132) > at org.apache.drill.exec.server.Drillbit.run(Drillbit.java:244) > at org.apache.drill.exec.server.Drillbit.start(Drillbit.java:84) > ... 7 more > Caused by: com.fasterxml.jackson.databind.JsonMappingException: Could not > resolve type id 'hbase' into a subtype of [simple type, class > org.apache.drill.common.logical.StoragePluginConfig] > at [Source: [B@51e7589f; line: 2, column: 3] > at > > com.fasterxml.jackson.databind.JsonMappingException.from(JsonMappingException.java:148) > at > > com.fasterxml.jackson.databind.DeserializationContext.unknownTypeException(DeserializationContext.java:849) > at > > com.fasterxml.jackson.databind.jsontype.impl.TypeDeserializerBase._findDeserializer(TypeDeserializerBase.java:167) > at > > com.fasterxml.jackson.databind.jsontype.impl.AsPropertyTypeDeserializer._deserializeTypedForId(AsPropertyTypeDeserializer.java:99) > at > > com.fasterxml.jackson.databind.jsontype.impl.AsPropertyTypeDeserializer.deserializeTypedFromObject(AsPropertyTypeDeserializer.java:84) > at > > com.fasterxml.jackson.databind.deser.AbstractDeserializer.deserializeWithType(AbstractDeserializer.java:132) > at > > com.fasterxml.jackson.databind.deser.impl.TypeWrappedDeserializer.deserialize(TypeWrappedDeserializer.java:41) > at > > com.fasterxml.jackson.databind.ObjectReader._bindAndClose(ObjectReader.java:1269) > at > > com.fasterxml.jackson.databind.ObjectReader.readValue(ObjectReader.java:912) > at > > org.apache.drill.exec.store.sys.serialize.JacksonSerializer.deserialize(JacksonSerializer.java:44) > at > > org.apache.drill.exec.store.sys.zk.ZkAbstractStore$Iter$DeferredEntry.getValue(ZkAbstractStore.java:195) > ... 11 more > > Could you please help us with the java options/config need to run the > drillbit in local mode (fds only). > > Regards, > -Stefan > > > On Fri, Jul 17, 2015 at 11:19 PM, Stefán Baxter <[email protected] > > > wrote: > > > thank you > > > > On Fri, Jul 17, 2015 at 11:16 PM, Jacques Nadeau <[email protected]> > > wrote: > > > >> We typically extend BaseTestQuery and use unit tests for trying out new > >> functionality. BaseTestQuery provides a large number of ways to build > >> tests. You can look here for some examples using the great test builder > >> api that Jason put together: > >> > >> > >> > https://github.com/apache/drill/blob/master/exec/java-exec/src/test/java/org/apache/drill/TestExampleQueries.java#L36 > >> > >> On Fri, Jul 17, 2015 at 3:33 PM, Stefán Baxter < > [email protected] > >> > > >> wrote: > >> > >> > Hi, > >> > > >> > Yes, I have done that. > >> > > >> > Can you please walk me through your development setup / processes. > >> > > >> > I'm reluctant to believe that your development cycle includes a full > >> build > >> > and as we are hoping to contribute (or at least try to be helpful) > then > >> I > >> > would very much like to understand how you work on top of this without > >> > requiring full build+packaging. > >> > > >> > Regards, > >> > -Stefan > >> > > >> > > >> > On Fri, Jul 17, 2015 at 10:29 PM, Jacques Nadeau <[email protected]> > >> > wrote: > >> > > >> > > There is no maven target for this. However, a full build creates a > >> > > directory: distribution/target/apache-drill-1.2.0-SNAPSHOT that you > >> can > >> > run > >> > > those things from. > >> > > > >> > > On Fri, Jul 17, 2015 at 3:11 PM, Stefán Baxter < > >> > [email protected]> > >> > > wrote: > >> > > > >> > > > Hi, > >> > > > > >> > > > This worked, than you. > >> > > > > >> > > > What maven target can I run that is the equivalent of > >> > > bin/drill-localhost > >> > > > or bin/drillbit.sh start ? > >> > > > > >> > > > Regards, > >> > > > -Stefán > >> > > > > >> > > > On Fri, Jul 17, 2015 at 3:48 PM, Jacques Nadeau < > [email protected] > >> > > >> > > > wrote: > >> > > > > >> > > > > Try to exit Idea and then do a mvn clean; mvn install > -DskipTests. > >> > > > > > >> > > > > On Fri, Jul 17, 2015 at 8:40 AM, Stefán Baxter < > >> > > > [email protected]> > >> > >> > > > > wrote: > >> > > > > > >> > > > > > Yeah, you are right. (Idea) > >> > > > > > > >> > > > > > I get this error when I try to run that target: > >> > > > > > [ERROR] Failed to execute goal > >> > > > > > org.apache.maven.plugins:maven-compiler-plugin:3.2:compile > >> > > > > > (default-compile) on project drill-common: Compilation > failure: > >> > > > > Compilation > >> > > > > > failure: > >> > > > > > [ERROR] Picked up JAVA_TOOL_OPTIONS: > >> > > > > > -javaagent:/usr/share/java/jayatanaag.jar > >> > > > > > [ERROR] > >> > > > > > > >> > > > > > > >> > > > > > >> > > > > >> > > > >> > > >> > /var/www/as/drill/common/src/main/java/org/apache/drill/common/expression/LogicalExpression.java:[73,8] > >> > > > > > error: cannot find symbol > >> > > > > > [ERROR] symbol: class ExprLexer > >> > > > > > [ERROR] location: class De > >> > > > > > [ERROR] > >> > > > > > > >> > > > > > > >> > > > > > >> > > > > >> > > > >> > > >> > /var/www/as/drill/common/src/main/java/org/apache/drill/common/expression/LogicalExpression.java:[73,30] > >> > > > > > error: cannot find symbol > >> > > > > > [ERROR] symbol: class ExprLexer > >> > > > > > [ERROR] location: class De > >> > > > > > [ERROR] > >> > > > > > > >> > > > > > > >> > > > > > >> > > > > >> > > > >> > > >> > /var/www/as/drill/common/src/main/java/org/apache/drill/common/expression/LogicalExpression.java:[75,8] > >> > > > > > error: cannot find symbol > >> > > > > > [ERROR] symbol: class ExprParser > >> > > > > > [ERROR] location: class De > >> > > > > > [ERROR] > >> > > > > > > >> > > > > > > >> > > > > > >> > > > > >> > > > >> > > >> > /var/www/as/drill/common/src/main/java/org/apache/drill/common/expression/LogicalExpression.java:[75,32] > >> > > > > > error: cannot find symbol > >> > > > > > [ERROR] symbol: class ExprParser > >> > > > > > [ERROR] location: class De > >> > > > > > [ERROR] > >> > > > > > > >> > > > > > > >> > > > > > >> > > > > >> > > > >> > > >> > /var/www/as/drill/common/src/main/java/org/apache/drill/common/expression/LogicalExpression.java:[79,8] > >> > > > > > error: cannot find symbol > >> > > > > > [ERROR] -> [Help 1] > >> > > > > > [ERROR] > >> > > > > > [ERROR] To see the full stack trace of the errors, re-run > Maven > >> > with > >> > > > the > >> > > > > -e > >> > > > > > switch. > >> > > > > > [ERROR] Re-run Maven using the -X switch to enable full debug > >> > > logging. > >> > > > > > [ERROR] > >> > > > > > [ERROR] For more information about the errors and possible > >> > solutions, > >> > > > > > please read the following articles: > >> > > > > > [ERROR] [Help 1] > >> > > > > > > >> > > > http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException > >> > > > > > [ERROR] > >> > > > > > [ERROR] After correcting the problems, you can resume the > build > >> > with > >> > > > the > >> > > > > > command > >> > > > > > [ERROR] mvn <goals> -rf :drill-common > >> > > > > > > >> > > > > > Looks to be another version of the same error. > >> > > > > > > >> > > > > > Any ideas? > >> > > > > > > >> > > > > > Regards, > >> > > > > > -Stefan > >> > > > > > > >> > > > > > On Fri, Jul 17, 2015 at 3:35 PM, Jacques Nadeau < > >> > [email protected]> > >> > > > > > wrote: > >> > > > > > > >> > > > > > > I'm guessing that you're trying to use a IDE to build. You > >> > should > >> > > do > >> > > > > one > >> > > > > > > run of mvn install -DskipTests before trying to use an IDE. > >> > > > > > > > >> > > > > > > On Fri, Jul 17, 2015 at 8:29 AM, Stefán Baxter < > >> > > > > > [email protected]> > >> > > > > > > wrote: > >> > > > > > > > >> > > > > > > > Hi, > >> > > > > > > > > >> > > > > > > > I now see that this is a part of the ExprLexer.g (I will > >> sort > >> > it > >> > > > out) > >> > > > > > > > > >> > > > > > > > Thank you, > >> > > > > > > > -Stefan > >> > > > > > > > > >> > > > > > > > On Fri, Jul 17, 2015 at 3:20 PM, Stefán Baxter < > >> > > > > > > [email protected]> > >> > > > > > > > wrote: > >> > > > > > > > > >> > > > > > > > > Hi, > >> > > > > > > > > > >> > > > > > > > > I'm trying to build Drill from master branch. > >> > > > > > > > > > >> > > > > > > > > Is it possible that someone has not pushed: > >> > > > > > > > > > >> > > > > > > > > import > >> org.apache.drill.common.expression.parser.ExprLexer; > >> > > > > > > > > import > >> org.apache.drill.common.expression.parser.ExprParser; > >> > > > > > > > > import > >> > > > > > > > >> > org.apache.drill.common.expression.parser.ExprParser.parse_return; > >> > > > > > > > > > >> > > > > > > > > Regards, > >> > > > > > > > > -Stefán > >> > > > > > > > > > >> > > > > > > > > > >> > > > > > > > > ps. Sent this again as I was not verified my dev > >> subscription > >> > > > when > >> > > > > a > >> > > > > > > > previous copy was sent (in case this is a duplicate) > >> > > > > > > > > > >> > > > > > > > > > >> > > > > > > > > >> > > > > > > > >> > > > > > > >> > > > > > >> > > > > >> > > > >> > > >> > > > > >
