Thanks for the info. However, this looks like a bloated full installation for all the drill component.
Is there a thinner way to do it with the sqlline jar and the drill fat jar file? Theoretically it should work. (the drill odbc jar worked with SQuirrel SQL) On Wed, Dec 3, 2014 at 3:06 PM, Sudhakar Thota <[email protected]> wrote: > Sorry Li, not sure why you cannot see the attachment. Here is the content > in the attachement. > > 1. Downloaded the tar file from > http://apache.claz.org/incubator/drill/drill-0.6.0-incubating/apache-drill-0.6.0-incubating.tar.gz > > as per instructions on > https://cwiki.apache.org/confluence/display/DRILL/Apache+Drill+in+10+Minutes#ApacheDrillin10Minutes-InstallingDrillonMacOSX > > > Administrators-MacBook-Pro-3:~ sthota$ cd Downloads/ > > Administrators-MacBook-Pro-3:Downloads sthota$ ls -l > apache-drill-0.6.0-incubating.tar.gz > > -rw-r-----@ 1 sthota staff 140545863 Nov 20 09:03 > apache-drill-0.6.0-incubating.tar.gz > > Administrators-MacBook-Pro-3:Downloads sthota$ pwd > > /Users/sthota/Downloads > > > 2. Untarred the file and moved the directory to drill directory under $HOME > > > Administrators-MacBook-Pro-3:Downloads sthota$ cd ../drill/ > > Administrators-MacBook-Pro-3:drill sthota$ ls -l > > total 0 > > drwxr-xr-x@ 13 sthota staff 442 Nov 24 17:00 apache-drill-0.6.0-incubating > > Administrators-MacBook-Pro-3:drill sthota$ cd apache-drill-0.6.0-incubating/ > > Administrators-MacBook-Pro-3:apache-drill-0.6.0-incubating sthota$ pwd > > /Users/sthota/drill/apache-drill-0.6.0-incubating > > > 3. Include host names in /etc/hosts file. > > > 4. Invoking sqlline on a cluster using my drill binaries as client. > > > Administrators-MacBook-Pro-3:apache-drill-0.6.0-incubating sthota$ > bin/sqlline -u > jdbc:drill:zk=sen10:5181,sen11:5181,sen12:5181/drill/se1-drillbits > > Drill log directory /var/log/drill does not exist, defaulting to > /Users/sthota/drill/apache-drill-0.6.0-incubating/log > > sqlline version 1.1.6 > > 0: jdbc:drill:zk=sen10:5181,sen11:5181,sen12:> show databases; > > +-------------+ > > | SCHEMA_NAME | > > +-------------+ > > | maprfs.apernsteiner | > > | maprfs.cmatta | > > | maprfs.default | > > | maprfs.nested | > > | maprfs.pcurtis | > > | maprfs.views | > > | maprfs.dkewley | > > | maprfs.flat | > > | maprfs.moka | > > | hive.default | > > | hive.test | > > | hive.demo_drill_v1 | > > | hive.jsun | > > | hive.frdo | > > | hive.moka | > > | hive.cc | > > | sys | > > | maprdb | > > | INFORMATION_SCHEMA | > > +-------------+ > > 19 rows selected (0.24 seconds) > > 0: jdbc:drill:zk=sen10:5181,sen11:5181,sen12:> use maprfs.cmatta; > > +------------+------------+ > > | ok | summary | > > +------------+------------+ > > | true | Default schema changed to 'maprfs.cmatta' | > > +------------+------------+ > > 1 row selected (0.097 seconds) > > 0: jdbc:drill:zk=sen10:5181,sen11:5181,sen12:> show tables; > > +--------------+------------+ > > | TABLE_SCHEMA | TABLE_NAME | > > +--------------+------------+ > > | maprfs.cmatta | HH_DIM | > > | maprfs.cmatta | testview2 | > > | maprfs.cmatta | ZIP_DIM | > > | maprfs.cmatta | DP_DIM | > > | maprfs.cmatta | testview | > > | maprfs.cmatta | AZ_DIM | > > | maprfs.cmatta | MKT_DIM | > > | maprfs.cmatta | nestedclickview | > > | maprfs.cmatta | tweets | > > | maprfs.cmatta | WMPD_FACT | > > | maprfs.cmatta | clickview | > > | maprfs.cmatta | NW_DIM | > > +--------------+------------+ > > 12 rows selected (1.232 seconds) > > 0: jdbc:drill:zk=sen10:5181,sen11:5181,sen12:> select * from ZIP_DIM limit > 10; > > +------------+------------+ > > | ZIP_ID | ZIP_CODE | > > +------------+------------+ > > | 21 | 47401 | > > | 280 | 68144 | > > | 297 | 76119 | > > | 319 | 40258 | > > | 337 | 93610 | > > | 357 | 13662 | > > | 375 | 98033 | > > | 413 | 41017 | > > | 436 | 78520 | > > | 550 | 11377 | > > +------------+------------+ > > 10 rows selected (0.248 seconds) > > 0: jdbc:drill:zk=sen10:5181,sen11:5181,sen12:> > > Thanks > Sudhakar Thota > [email protected] > > > On Tue, Dec 2, 2014 at 8:18 PM, Li HM <[email protected]> wrote: > >> Thanks Sudhakar. >> >> I don't see any attachment though. Could you please send the file to me? >> >> On Tue, Dec 2, 2014 at 7:18 PM, Sudhakar Thota <[email protected]> >> wrote: >> > Li, >> > >> > It worked for me like Jacques mentioned. I believe this file attached >> shows >> > that. Not sure if this is what you are talking about, but please take a >> look >> > at the attached file if it helps. >> > >> > >> > Thanks >> > Sudhakar Thota >> > [email protected] >> > >> > >> > On Tue, Dec 2, 2014 at 2:29 PM, Li HM <[email protected]> wrote: >> >> >> >> It isn't that simple. At least I couldn't make it work as expected. It >> >> seems the jdbc fat jar has some dependencies on other drill/3rd >> >> parties jars. Or am I missing something here? >> >> >> >> Here are the jar files I use: >> >> >> >> drill-jdbc-all-0.7.0-incubating-SNAPSHOT.jar >> >> jline-1.0.jar >> >> sqlline-1_0_2.jar >> >> >> >> >> >> JAR_DIR=$HOME/sqlline/jars >> >> $JAVA_HOME/bin/java -Dlog.path=/home/lih/sqlline/log/sqlline.log -ea >> >> -cp >> >> >> $JAR_DIR/sqlline-1_0_2.jar:$JAR_DIR/jline-1.0.jar:$JAR_DIR/drill-jdbc-all-0.7.0-incubating-SNAPSHOT.jar >> >> \ >> >> sqlline.SqlLine -d org.apache.drill.jdbc.Driver --maxWidth=10000 -u >> >> >> >> jdbc:drill:zk= >> stgace-launcher07.diy.corp.ne1.yahoo.com:2181/drill/drill-lih >> >> >> >> It seems that it can make the connection correctly. However, if I run >> >> a query, I don't get the result back >> >> >> >> Connecting to >> >> jdbc:drill:zk= >> stgace-launcher07.diy.corp.ne1.yahoo.com:2181/drill/drill-lih >> >> 22:22:33.097 [main] DEBUG o.a.drill.common.config.DrillConfig - >> >> Loading configs at the following URLs >> >> >> >> >> [jar:file:/home/lih/sqlline/jars/drill-jdbc-all-0.7.0-incubating-SNAPSHOT.jar!/drill-module.conf] >> >> 22:22:33.589 [main] DEBUG i.n.u.i.l.InternalLoggerFactory - Using >> >> SLF4J as the default logging framework >> >> 22:22:33.602 [main] DEBUG i.n.util.internal.PlatformDependent0 - >> >> java.nio.Buffer.address: available >> >> 22:22:33.603 [main] DEBUG i.n.util.internal.PlatformDependent0 - >> >> sun.misc.Unsafe.theUnsafe: available >> >> 22:22:33.604 [main] DEBUG i.n.util.internal.PlatformDependent0 - >> >> sun.misc.Unsafe.copyMemory: available >> >> 22:22:33.605 [main] DEBUG i.n.util.internal.PlatformDependent0 - >> >> java.nio.Bits.unaligned: true >> >> 22:22:33.609 [main] DEBUG i.n.util.internal.PlatformDependent - UID: >> 21499 >> >> 22:22:33.611 [main] DEBUG i.n.util.internal.PlatformDependent - Java >> >> version: 7 >> >> 22:22:33.611 [main] DEBUG i.n.util.internal.PlatformDependent - >> >> -Dio.netty.noUnsafe: false >> >> 22:22:33.611 [main] DEBUG i.n.util.internal.PlatformDependent - >> >> sun.misc.Unsafe: available >> >> 22:22:33.612 [main] DEBUG i.n.util.internal.PlatformDependent - >> >> -Dio.netty.noJavassist: false >> >> 22:22:33.780 [main] DEBUG i.n.util.internal.PlatformDependent - >> >> Javassist: available >> >> 22:22:33.781 [main] DEBUG i.n.util.internal.PlatformDependent - >> >> -Dio.netty.tmpdir: /tmp (java.io.tmpdir) >> >> 22:22:33.781 [main] DEBUG i.n.util.internal.PlatformDependent - >> >> -Dio.netty.bitMode: 64 (sun.arch.data.model) >> >> 22:22:33.781 [main] DEBUG i.n.util.internal.PlatformDependent - >> >> -Dio.netty.noPreferDirect: false >> >> 22:22:33.782 [main] DEBUG i.n.buffer.PooledByteBufAllocator - >> >> -Dio.netty.allocator.numHeapArenas: 4 >> >> 22:22:33.782 [main] DEBUG i.n.buffer.PooledByteBufAllocator - >> >> -Dio.netty.allocator.numDirectArenas: 4 >> >> 22:22:33.782 [main] DEBUG i.n.buffer.PooledByteBufAllocator - >> >> -Dio.netty.allocator.pageSize: 8192 >> >> 22:22:33.782 [main] DEBUG i.n.buffer.PooledByteBufAllocator - >> >> -Dio.netty.allocator.maxOrder: 11 >> >> 22:22:33.782 [main] DEBUG i.n.buffer.PooledByteBufAllocator - >> >> -Dio.netty.allocator.chunkSize: 16777216 >> >> 22:22:33.783 [main] DEBUG i.n.buffer.PooledByteBufAllocator - >> >> -Dio.netty.allocator.tinyCacheSize: 512 >> >> 22:22:33.783 [main] DEBUG i.n.buffer.PooledByteBufAllocator - >> >> -Dio.netty.allocator.smallCacheSize: 256 >> >> 22:22:33.783 [main] DEBUG i.n.buffer.PooledByteBufAllocator - >> >> -Dio.netty.allocator.normalCacheSize: 64 >> >> 22:22:33.783 [main] DEBUG i.n.buffer.PooledByteBufAllocator - >> >> -Dio.netty.allocator.maxCachedBufferCapacity: 32768 >> >> 22:22:33.783 [main] DEBUG i.n.buffer.PooledByteBufAllocator - >> >> -Dio.netty.allocator.cacheTrimInterval: 8192 >> >> 22:22:33.835 [main] DEBUG io.netty.util.ResourceLeakDetector - >> >> -Dio.netty.leakDetectionLevel: simple >> >> 22:22:33.867 [main] DEBUG o.a.drill.common.config.DrillConfig - >> >> Loading configs at the following URLs >> >> >> >> >> [jar:file:/home/lih/sqlline/jars/drill-jdbc-all-0.7.0-incubating-SNAPSHOT.jar!/drill-module.conf] >> >> 22:22:33.938 [main] DEBUG org.reflections.Reflections - going to scan >> >> these urls: >> >> >> >> >> jar:file:/home/lih/sqlline/jars/drill-jdbc-all-0.7.0-incubating-SNAPSHOT.jar!/ >> >> >> >> 22:22:38.791 [main] INFO org.reflections.Reflections - Reflections >> >> took 4852 ms to scan 1 urls, producing 2602 keys and 9358 values >> >> 22:22:38.805 [main] DEBUG o.a.d.c.l.data.LogicalOperatorBase - Adding >> >> Logical Operator sub types: [class >> >> org.apache.drill.common.logical.data.Store, class >> >> org.apache.drill.common.logical.data.GroupingAggregate, class >> >> org.apache.drill.common.logical.data.Project, class >> >> org.apache.drill.common.logical.data.Join, class >> >> org.apache.drill.common.logical.data.Window, class >> >> org.apache.drill.common.logical.data.Limit, class >> >> org.apache.drill.common.logical.data.Filter, class >> >> org.apache.drill.common.logical.data.Writer, class >> >> org.apache.drill.common.logical.data.Scan, class >> >> org.apache.drill.common.logical.data.Order, class >> >> org.apache.drill.common.logical.data.Union] >> >> 22:22:38.811 [main] DEBUG o.a.d.c.l.StoragePluginConfigBase - Adding >> >> Storage Engine Configs including [class >> >> org.apache.drill.exec.store.NamedStoragePluginConfig, class >> >> org.apache.drill.exec.store.sys.SystemTablePluginConfig, class >> >> org.apache.drill.exec.store.dfs.FileSystemConfig, class >> >> org.apache.drill.exec.store.ischema.InfoSchemaConfig] >> >> 22:22:38.814 [main] DEBUG o.a.d.c.l.FormatPluginConfigBase - Adding >> >> Format Plugin Configs including [class >> >> org.apache.drill.exec.store.dfs.NamedFormatPluginConfig] >> >> 22:22:38.820 [main] DEBUG o.a.d.e.c.zk.ZKClusterCoordinator - Connect >> >> stgace-launcher07.diy.corp.ne1.yahoo.com:2181, zkRoot drill, >> >> clusterId: drill-lih >> >> 22:22:38.885 [main] INFO o.a.c.f.imps.CuratorFrameworkImpl - Starting >> >> 22:22:38.889 [main] DEBUG o.a.curator.CuratorZookeeperClient - Starting >> >> 22:22:38.889 [main] DEBUG org.apache.curator.ConnectionState - Starting >> >> 22:22:38.889 [main] DEBUG org.apache.curator.ConnectionState - reset >> >> 22:22:38.903 [main] INFO org.apache.zookeeper.ZooKeeper - Client >> >> environment:zookeeper.version=3.4.6-1569965, built on 02/20/2014 09:09 >> >> GMT >> >> 22:22:38.903 [main] INFO org.apache.zookeeper.ZooKeeper - Client >> >> environment:host.name=stgace-launcher07.diy.corp.ne1.yahoo.com >> >> 22:22:38.903 [main] INFO org.apache.zookeeper.ZooKeeper - Client >> >> environment:java.version=1.7.0_17 >> >> 22:22:38.903 [main] INFO org.apache.zookeeper.ZooKeeper - Client >> >> environment:java.vendor=Oracle Corporation >> >> 22:22:38.903 [main] INFO org.apache.zookeeper.ZooKeeper - Client >> >> environment:java.home=/home/y/share/gridjdk64-1.7.0_17/jre >> >> 22:22:38.903 [main] INFO org.apache.zookeeper.ZooKeeper - Client >> >> >> >> >> environment:java.class.path=/home/lih/sqlline/jars/sqlline-1_0_2.jar:/home/lih/sqlline/jars/jline-1.0.jar:/home/lih/sqlline/jars/drill-jdbc-all-0.7.0-incubating-SNAPSHOT.jar >> >> 22:22:38.903 [main] INFO org.apache.zookeeper.ZooKeeper - Client >> >> >> >> >> environment:java.library.path=/usr/java/packages/lib/amd64:/usr/lib64:/lib64:/lib:/usr/lib >> >> 22:22:38.903 [main] INFO org.apache.zookeeper.ZooKeeper - Client >> >> environment:java.io.tmpdir=/tmp >> >> 22:22:38.903 [main] INFO org.apache.zookeeper.ZooKeeper - Client >> >> environment:java.compiler=<NA> >> >> 22:22:38.903 [main] INFO org.apache.zookeeper.ZooKeeper - Client >> >> environment:os.name=Linux >> >> 22:22:38.904 [main] INFO org.apache.zookeeper.ZooKeeper - Client >> >> environment:os.arch=amd64 >> >> 22:22:38.904 [main] INFO org.apache.zookeeper.ZooKeeper - Client >> >> environment:os.version=2.6.32-358.18.1.el6.YAHOO.20131009.x86_64 >> >> 22:22:38.904 [main] INFO org.apache.zookeeper.ZooKeeper - Client >> >> environment:user.name=lih >> >> 22:22:38.904 [main] INFO org.apache.zookeeper.ZooKeeper - Client >> >> environment:user.home=/home/lih >> >> 22:22:38.904 [main] INFO org.apache.zookeeper.ZooKeeper - Client >> >> environment:user.dir=/home/lih/sqlline >> >> 22:22:38.906 [main] INFO org.apache.zookeeper.ZooKeeper - Initiating >> >> client connection, >> >> connectString=stgace-launcher07.diy.corp.ne1.yahoo.com:2181 >> >> sessionTimeout=60000 >> >> watcher=org.apache.curator.ConnectionState@4bb526fb >> >> 22:22:38.913 [main] DEBUG org.apache.zookeeper.ClientCnxn - >> >> zookeeper.disableAutoWatchReset is false >> >> 22:22:38.960 >> >> [main-SendThread(stgace-launcher07.diy.corp.ne1.yahoo.com:2181)] >> >> INFO org.apache.zookeeper.ClientCnxn - Opening socket connection to >> >> server stgace-launcher07.diy.corp.ne1.yahoo.com/98.138.236.98:2181. >> >> Will not attempt to authenticate using SASL (unknown error) >> >> 22:22:38.972 >> >> [main-SendThread(stgace-launcher07.diy.corp.ne1.yahoo.com:2181)] >> >> INFO org.apache.zookeeper.ClientCnxn - Socket connection established >> >> to stgace-launcher07.diy.corp.ne1.yahoo.com/98.138.236.98:2181, >> >> initiating session >> >> 22:22:38.975 >> >> [main-SendThread(stgace-launcher07.diy.corp.ne1.yahoo.com:2181)] >> >> DEBUG org.apache.zookeeper.ClientCnxn - Session establishment request >> >> sent on stgace-launcher07.diy.corp.ne1.yahoo.com/98.138.236.98:2181 >> >> 22:22:38.998 >> >> [main-SendThread(stgace-launcher07.diy.corp.ne1.yahoo.com:2181)] >> >> INFO org.apache.zookeeper.ClientCnxn - Session establishment complete >> >> on server stgace-launcher07.diy.corp.ne1.yahoo.com/98.138.236.98:2181, >> >> sessionid = 0x1499166d6c30025, negotiated timeout = 40000 >> >> 22:22:39.010 [main-EventThread] INFO >> >> o.a.c.f.state.ConnectionStateManager - State change: CONNECTED >> >> 22:22:39.279 >> >> [main-SendThread(stgace-launcher07.diy.corp.ne1.yahoo.com:2181)] >> >> DEBUG org.apache.zookeeper.ClientCnxn - Reading reply >> >> sessionid:0x1499166d6c30025, packet:: clientPath:null serverPath:null >> >> finished:false header:: 1,3 replyHeader:: 1,747,0 request:: >> >> '/drill,F response:: >> >> s{2,2,1415483705440,1415483705440,0,13,0,0,0,13,705} >> >> 22:22:39.280 [main] DEBUG o.a.d.e.c.zk.ZKClusterCoordinator - Starting >> >> ZKClusterCoordination. >> >> 22:22:39.285 >> >> [main-SendThread(stgace-launcher07.diy.corp.ne1.yahoo.com:2181)] >> >> DEBUG org.apache.zookeeper.ClientCnxn - Reading reply >> >> sessionid:0x1499166d6c30025, packet:: clientPath:null serverPath:null >> >> finished:false header:: 2,3 replyHeader:: 2,747,0 request:: >> >> '/drill,F response:: >> >> s{2,2,1415483705440,1415483705440,0,13,0,0,0,13,705} >> >> 22:22:39.287 >> >> [main-SendThread(stgace-launcher07.diy.corp.ne1.yahoo.com:2181)] >> >> DEBUG org.apache.zookeeper.ClientCnxn - Reading reply >> >> sessionid:0x1499166d6c30025, packet:: clientPath:null serverPath:null >> >> finished:false header:: 3,3 replyHeader:: 3,747,0 request:: >> >> '/drill/drill-lih,F response:: >> >> s{3,3,1415483708586,1415483708586,0,15,0,0,0,1,671} >> >> 22:22:39.299 >> >> [main-SendThread(stgace-launcher07.diy.corp.ne1.yahoo.com:2181)] >> >> DEBUG org.apache.zookeeper.ClientCnxn - Reading reply >> >> sessionid:0x1499166d6c30025, packet:: clientPath:null serverPath:null >> >> finished:false header:: 4,12 replyHeader:: 4,747,0 request:: >> >> '/drill/drill-lih,F response:: >> >> >> >> >> v{'4ee938e0-2d1a-413a-a222-017265b222c0},s{3,3,1415483708586,1415483708586,0,15,0,0,0,1,671} >> >> 22:22:39.309 >> >> [main-SendThread(stgace-launcher07.diy.corp.ne1.yahoo.com:2181)] >> >> DEBUG org.apache.zookeeper.ClientCnxn - Reading reply >> >> sessionid:0x1499166d6c30025, packet:: clientPath:null serverPath:null >> >> finished:false header:: 5,4 replyHeader:: 5,747,0 request:: >> >> '/drill/drill-lih/4ee938e0-2d1a-413a-a222-017265b222c0,F response:: >> >> >> >> >> #a2434656539333865302d326431612d343133612d613232322d30313732363562323232633010ffffffb3ffffff88ffffff82ffffffb9ffffffa0291a36a287374676163652d6c61756e6368657230362e6469792e636f72702e6e65312e7961686f6f2e636f6d10ffffffa2fffffff2118ffffffa3fffffff2120ffffffa4fffffff21,s{653,653,1417458779337,1417458779337,0,0,0,92765138213601304,101,0,653} >> >> 22:22:39.336 >> >> [main-SendThread(stgace-launcher07.diy.corp.ne1.yahoo.com:2181)] >> >> DEBUG org.apache.zookeeper.ClientCnxn - Reading reply >> >> sessionid:0x1499166d6c30025, packet:: clientPath:/drill/drill-lih >> >> serverPath:/drill/drill-lih finished:false header:: 6,12 >> >> replyHeader:: 6,747,0 request:: '/drill/drill-lih,T response:: >> >> >> >> >> v{'4ee938e0-2d1a-413a-a222-017265b222c0},s{3,3,1415483708586,1415483708586,0,15,0,0,0,1,671} >> >> 22:22:39.352 >> >> [main-SendThread(stgace-launcher07.diy.corp.ne1.yahoo.com:2181)] >> >> DEBUG org.apache.zookeeper.ClientCnxn - Reading reply >> >> sessionid:0x1499166d6c30025, packet:: >> >> clientPath:/drill/drill-lih/4ee938e0-2d1a-413a-a222-017265b222c0 >> >> serverPath:/drill/drill-lih/4ee938e0-2d1a-413a-a222-017265b222c0 >> >> finished:false header:: 7,4 replyHeader:: 7,747,0 request:: >> >> '/drill/drill-lih/4ee938e0-2d1a-413a-a222-017265b222c0,T response:: >> >> >> >> >> #a2434656539333865302d326431612d343133612d613232322d30313732363562323232633010ffffffb3ffffff88ffffff82ffffffb9ffffffa0291a36a287374676163652d6c61756e6368657230362e6469792e636f72702e6e65312e7961686f6f2e636f6d10ffffffa2fffffff2118ffffffa3fffffff2120ffffffa4fffffff21,s{653,653,1417458779337,1417458779337,0,0,0,92765138213601304,101,0,653} >> >> 22:22:39.380 >> >> [main-SendThread(stgace-launcher07.diy.corp.ne1.yahoo.com:2181)] >> >> DEBUG org.apache.zookeeper.ClientCnxn - Reading reply >> >> sessionid:0x1499166d6c30025, packet:: clientPath:null serverPath:null >> >> finished:false header:: 8,12 replyHeader:: 8,747,0 request:: >> >> '/drill/drill-lih,F response:: >> >> >> >> >> v{'4ee938e0-2d1a-413a-a222-017265b222c0},s{3,3,1415483708586,1415483708586,0,15,0,0,0,1,671} >> >> 22:22:39.383 >> >> [main-SendThread(stgace-launcher07.diy.corp.ne1.yahoo.com:2181)] >> >> DEBUG org.apache.zookeeper.ClientCnxn - Reading reply >> >> sessionid:0x1499166d6c30025, packet:: clientPath:null serverPath:null >> >> finished:false header:: 9,4 replyHeader:: 9,747,0 request:: >> >> '/drill/drill-lih/4ee938e0-2d1a-413a-a222-017265b222c0,F response:: >> >> >> >> >> #a2434656539333865302d326431612d343133612d613232322d30313732363562323232633010ffffffb3ffffff88ffffff82ffffffb9ffffffa0291a36a287374676163652d6c61756e6368657230362e6469792e636f72702e6e65312e7961686f6f2e636f6d10ffffffa2fffffff2118ffffffa3fffffff2120ffffffa4fffffff21,s{653,653,1417458779337,1417458779337,0,0,0,92765138213601304,101,0,653} >> >> 22:22:39.387 [main] DEBUG o.a.d.e.c.zk.ZKClusterCoordinator - Active >> >> drillbit set changed. Now includes 1 total bits. New active >> >> drillbits: >> >> stgace-launcher06.diy.corp.ne1.yahoo.com:31010:31011:31012 >> >> >> >> 22:22:39.418 [main] DEBUG i.n.c.MultithreadEventLoopGroup - >> >> -Dio.netty.eventLoopThreads: 8 >> >> 22:22:39.449 [main] DEBUG io.netty.channel.nio.NioEventLoop - >> >> -Dio.netty.noKeySetOptimization: false >> >> 22:22:39.450 [main] DEBUG io.netty.channel.nio.NioEventLoop - >> >> -Dio.netty.selectorAutoRebuildThreshold: 512 >> >> 22:22:39.534 [main] DEBUG o.a.drill.exec.client.DrillClient - >> >> Connecting to server stgace-launcher06.diy.corp.ne1.yahoo.com:31010 >> >> 22:22:39.568 [main] DEBUG i.n.util.internal.ThreadLocalRandom - >> >> -Dio.netty.initialSeedUniquifier: 0x6b4a02a017a39a90 (took 1 ms) >> >> 22:22:39.606 [main] DEBUG io.netty.buffer.ByteBufUtil - >> >> -Dio.netty.allocator.type: unpooled >> >> 22:22:39.606 [main] DEBUG io.netty.buffer.ByteBufUtil - >> >> -Dio.netty.threadLocalDirectBufferSize: 65536 >> >> 22:22:39.636 [Client-1] DEBUG >> >> i.n.u.i.JavassistTypeParameterMatcherGenerator - Generated: >> >> io.netty.util.internal.__matchers__.io.netty.buffer.ByteBufMatcher >> >> 22:22:39.646 [Client-1] DEBUG >> >> i.n.u.i.JavassistTypeParameterMatcherGenerator - Generated: >> >> >> >> >> io.netty.util.internal.__matchers__.org.apache.drill.exec.rpc.OutboundRpcMessageMatcher >> >> 22:22:39.652 [Client-1] DEBUG >> >> i.n.u.i.JavassistTypeParameterMatcherGenerator - Generated: >> >> >> >> >> io.netty.util.internal.__matchers__.org.apache.drill.exec.rpc.InboundRpcMessageMatcher >> >> 22:22:39.677 [Client-1] DEBUG io.netty.util.Recycler - >> >> -Dio.netty.recycler.maxCapacity.default: 262144 >> >> Connected to: Optiq (version unknown version) >> >> Driver: Drill JDBC Driver (version unknown version) >> >> Autocommit status: true >> >> Transaction isolation: TRANSACTION_REPEATABLE_READ >> >> sqlline version 1.0.2 by Marc Prud'hommeaux >> >> 0: jdbc:drill:zk=stgace-launcher07.diy.corp.n> select * from >> >> dfs.tmp.`test.csv`; >> >> 22:22:47.732 [Client-1] DEBUG o.a.d.e.rpc.user.QueryResultHandler - >> >> Received QueryId part1: 3135002630360243693 >> >> part2: -6434486360344595063 >> >> succesfully. Adding listener >> >> org.apache.drill.jdbc.DrillResultSet$Listener@25ae3fd >> >> 22:22:47.833 [Client-1] DEBUG org.apache.drill.jdbc.DrillResultSet - >> >> Result arrived QueryResultBatch [header=query_id { >> >> part1: 3135002630360243693 >> >> part2: -6434486360344595063 >> >> } >> >> is_last_chunk: false >> >> row_count: 0 >> >> def { >> >> field { >> >> major_type { >> >> minor_type: VARCHAR >> >> mode: REPEATED >> >> } >> >> name_part { >> >> type: NAME >> >> name: "columns" >> >> } >> >> } >> >> } >> >> , data=null] >> >> 22:22:47.844 [Client-1] DEBUG org.apache.drill.jdbc.DrillResultSet - >> >> Result arrived QueryResultBatch [header=query_id { >> >> part1: 3135002630360243693 >> >> part2: -6434486360344595063 >> >> } >> >> is_last_chunk: false >> >> row_count: 9 >> >> def { >> >> record_count: 9 >> >> field { >> >> major_type { >> >> minor_type: VARCHAR >> >> mode: REPEATED >> >> } >> >> name_part { >> >> type: NAME >> >> name: "columns" >> >> } >> >> value_count: 27 >> >> var_byte_length: 124 >> >> group_count: 9 >> >> buffer_length: 276 >> >> } >> >> carries_two_byte_selection_vector: false >> >> } >> >> , data=DrillBuf(ridx: 0, widx: 276, cap: 276/276, unwrapped: >> >> DrillBuf(ridx: 349, widx: 349, cap: 349/349, unwrapped: >> >> UnsafeDirectLittleEndian(PooledUnsafeDirectByteBuf(ridx: 0, widx: 0, >> >> cap: 349/349))))] >> >> 22:22:47.849 [Client-1] DEBUG org.apache.drill.jdbc.DrillResultSet - >> >> Result arrived QueryResultBatch [header=query_id { >> >> part1: 3135002630360243693 >> >> part2: -6434486360344595063 >> >> } >> >> is_last_chunk: true >> >> row_count: 0 >> >> def { >> >> } >> >> , data=null] >> >> org/apache/hadoop/io/Text >> >> 0: jdbc:drill:zk=stgace-launcher07.diy.corp.n> 22:22:52.730 >> >> [main-SendThread(stgace-launcher07.diy.corp.ne1.yahoo.com:2181)] DEBUG >> >> org.apache.zookeeper.ClientCnxn - Got ping response for sessionid: >> >> 0x1499166d6c30025 >> >> >> >> On Mon, Dec 1, 2014 at 7:27 PM, Jacques Nadeau <[email protected]> >> wrote: >> >> > There isn't anything prebuilt. That being said, we use off the shelf >> >> > sqlline. As such, you should be able to simply download sqlline and >> >> > then >> >> > use Drill's JDBC client jar file and run a remote sqlline. >> >> > >> >> > On Mon, Dec 1, 2014 at 12:12 PM, Jim Scott <[email protected]> >> wrote: >> >> > >> >> >> The sqlline utility takes a parameter for a zookeeper quorum to >> connect >> >> >> to. >> >> >> >> >> >> When you run sqlline -u jdbc:drill:zk=local sqlline starts up an >> >> >> internal >> >> >> local drillbit, but if you specify a remote zk then it will connect >> to >> >> >> a >> >> >> remote drillbit. >> >> >> >> >> >> So, to answer your question, I believe you would install Drill on >> each >> >> >> of >> >> >> those other 5 servers, but don't give them a configuration which >> allows >> >> >> that installation to participate in the cluster. >> >> >> >> >> >> Alternatively, if you are asking if you can default the sqlline on >> >> >> those >> >> >> servers with -u jdbc:drill:zk=server1,server2,server3, it doesn't >> >> >> appear >> >> >> that the script currently supports that, but could likely be very >> >> >> simply >> >> >> achieved with a tiny wrapper script. >> >> >> >> >> >> >> >> >> On Mon, Dec 1, 2014 at 1:49 PM, David Tucker <[email protected]> >> >> >> wrote: >> >> >> >> >> >> > >> >> >> > Is there a process for installing the sqlline tool independent of >> the >> >> >> > complete drillbit ? The scenario I’m considering is a cluster of >> 10 >> >> >> nodes >> >> >> > where only 5 would have drill-bits installed but users will expect >> to >> >> >> > connect to the drill cluster arbitrarily from any node out of the >> 10. >> >> >> > >> >> >> > — David >> >> >> > >> >> >> > >> >> >> >> >> >> >> >> >> -- >> >> >> *Jim Scott* >> >> >> Director, Enterprise Strategy & Architecture >> >> >> +1 (347) 746-9281 >> >> >> >> >> >> <http://www.mapr.com/> >> >> >> [image: MapR Technologies] <http://www.mapr.com> >> >> >> >> > >> > >>
