Revised doc is published: https://drill.apache.org/docs/starting-drill-in-distributed-mode/
Kristine Hahn Sr. Technical Writer 415-497-8107 @krishahn skype:krishahn On Wed, Dec 30, 2015 at 1:12 PM, Kristine Hahn <[email protected]> wrote: > No, I don't think that's clear at all on the Starting Drill in > Distributed Mode > <https://drill.apache.org/docs/starting-drill-in-distributed-mode/> page. > I think the problem stems from conflating starting the daemon with Starting > the Drill Shell > <https://drill.apache.org/docs/starting-drill-in-distributed-mode/#starting-the-drill-shell> > and with Using an Ad-Hoc Connection to Drill > <https://drill.apache.org/docs/starting-drill-in-distributed-mode/#using-an-ad-hoc-connection-to-drill>. > Fixing! > > Thanks. > > Kristine Hahn > Sr. Technical Writer > 415-497-8107 @krishahn skype:krishahn > > > On Wed, Dec 30, 2015 at 12:31 PM, Jacques Nadeau <[email protected]> > wrote: > >> Do we clearly state that in distributed mode, you have to start the >> drillbit daemon on each node before attaching a client will work? >> >> -- >> Jacques Nadeau >> CTO and Co-Founder, Dremio >> >> On Wed, Dec 30, 2015 at 12:06 PM, Kristine Hahn <[email protected]> >> wrote: >> >> > Confirming that your feedback was good--thanks again. We've >> > clarified/corrected these things: >> > >> > - The intro and embedded mode installation pages now say embedded >> mode >> > is for using Drill *only* on a single node. >> > - The intro and pre-requisites pages now explicitly state that a >> > pre-installed ZooKeeper is *not *needed for the embedded mode >> > installation. >> > - The distributed mode installation prerequisites page now points to >> the >> > documentation that defines a ZooKeeper quorum. >> > - The extraneous zk= have been removed from the example startup >> script. >> > >> > Here are links to the corrected pages: >> > >> > - https://drill.apache.org/docs/install-drill-introduction/ >> > - https://drill.apache.org/docs/embedded-mode-prerequisites/ >> > - https://drill.apache.org/docs/distributed-mode-prerequisites/ >> > - >> > >> > >> https://drill.apache.org/docs/starting-drill-in-distributed-mode/#sqlline-arguments-and-connection-parameters >> > >> > >> > Kristine Hahn >> > Sr. Technical Writer >> > 415-497-8107 @krishahn skype:krishahn >> > >> > >> > On Wed, Dec 30, 2015 at 10:24 AM, <[email protected]> wrote: >> > >> > > I could be wrong in my assumptions, too. Please correct me if I am, >> I'd >> > > really appreciate that! >> > > >> > > Thanks! >> > > >> > > Sent from my iPhone >> > > >> > > > On 30-Dec-2015, at 11:11 PM, Kristine Hahn <[email protected]> >> wrote: >> > > > >> > > > Thanks for the feedback. We'll make the corrections you suggested >> right >> > > > away. Sorry for the inconvenience. We really appreciate you letting >> us >> > > know. >> > > > >> > > > Kristine Hahn >> > > > Sr. Technical Writer >> > > > 415-497-8107 @krishahn skype:krishahn >> > > > >> > > > >> > > > On Wed, Dec 30, 2015 at 4:07 AM, Rohit Kulkarni < >> > > [email protected]> >> > > > wrote: >> > > > >> > > >> Hello all, >> > > >> >> > > >> I am using Drill to aggregate various data storage nodes like S3, >> > > Redshift, >> > > >> Hive and HDFS. I followed the documentation as is and it could only >> > > take me >> > > >> so far. I needed clarifications on a couple of things below - >> > > >> >> > > >> >> > > >> - For my use case, I needed distributed drill cluster. This >> setup of >> > > >> Drill requires Zookeeper. But nowhere it is mentioned in the >> > > >> documentation >> > > >> that it should be Distributed Zookeeper, and *not Standalone. *I >> > > >> initially started zookeeper services in individual nodes and they >> > were >> > > >> started as standalone services on localhost. After starting >> > > drillbit.sh >> > > >> , >> > > >> weirdly I could see 3 out of 5 drillbits runnign in the UI. After >> > > >> restarting the number went to 4 drillbits, and next time it >> showed >> > > only >> > > >> 2. >> > > >> This unreliable set up was confusing because I'd done everything >> > > >> according >> > > >> to the documentation. Zookeeper connections for HOST1:2181, >> > HOST2:2181 >> > > >> etc >> > > >> is still cakked Zookeeper Quorum isn't it? Or it isn't a Quorum >> > unless >> > > >> you >> > > >> start Zookeeper services in distributed way? >> > > >> Also, does Drill still run in distributed fashion without >> Zookeeper >> > > set >> > > >> up in distributed mode? >> > > >> >> > > >> >> > > >> - According to this line in documentation on starting drill in >> > > >> distributed mode Using an Ad-Hoc Connection to Drill - (you can >> > Ctrl+F >> > > >> this >> > > >> line below to find location) >> > > >> >> > > >> *The following command starts the Drill shell in a cluster >> > configured >> > > to >> > > >> run ZooKeeper on three nodes:* >> > > >> >> > > >> *bin/sqlline –u >> jdbc:drill:zk=cento23,zk=centos24,zk=centos26:5181* >> > > >> >> > > >> I think it should be - >> > > >> *bin/sqlline –u jdbc:drill:zk=cento23,centos24,centos26:5181* >> > > >> >> > > >> because it worked for me and threw an error otherwise. >> > > >> >> > > >> >> > > >> Let me know if you have observed this and if I am wrong with my >> > > >> assumptions somewhere..!! >> > > >> >> > > >> PS: Awesome job with Drill 1.4, Dev team! :-) >> > > >> >> > > >> -- >> > > >> Warm Regards, >> > > >> Rohit Kulkarni >> > > >> >> > > >> > >> > >
