On these note we could REALLY use a UDF for OpenTSDB tables from Drill. -- Kind Regards, Chad Smykay | Solutions Architect | M: 210.273.2344 mapr.com
On Oct 20, 2015, at 11:41 AM, Andries Engelbrecht <[email protected]> wrote: > Thx Jim, very good info. I think Pete’s connectivity issue is that he is > using the OpenTSB port instead of the ZK port (2181 or 5181) in the Drill > plugin configuration. > > Once he fixes that Drill will be able to access the data in HBase or MapR-DB, > then will need to look into the data elements as you described. > > —Andries > >> On Oct 20, 2015, at 9:37 AM, Jim Scott <[email protected]> wrote: >> >> 4242 is the OpenTSDB Daemon port. >> >> OpenTSDB isn't a database, rather it depends on HBase or MapR-DB. In either >> case OpenTSDB connects to one of those databases and uses the tables in >> that database. So, when you are wanting to work with OpenTSDB data you are >> really wanting to query the table in HBase (ZKQuorum) / MapR-DB (MapR >> Client). >> >> You will have a problem when querying data stored in a table with OpenTSDB >> formatted data, because the table can have data stored in a combination of >> non-compacted, compacted and both compacted and non at the same time. >> >> Drill should be able to query the non-compacted form (still binary data). >> Drill cannot query the compacted form out of the box, and would require a >> special adapter to decode the blob. The mixed form would require an adapter >> to recognize both formats at the same time. >> >> Is that helpful? >> >> >> On Tue, Oct 20, 2015 at 11:19 AM, Andries Engelbrecht < >> [email protected]> wrote: >> >>> 4242 is an unusual ZK port, typically it is 2181 or 5181, is there a >>> reason it is 4242? >>> >>> The Hbase plugin can hang for a while if not configured properly and in >>> some cases cause connectivity loss through ODBC/JDBC. >>> >>> Try to access HBase plugin through sqlline first on the cluster directly >>> before using remote connections. >>> >>> —Andries >>> >>> >>>> On Oct 20, 2015, at 12:05 AM, Rajkumar Singh <[email protected]> >>> wrote: >>>> >>>> It seems that you are able to connect to drill using direct drillbit >>> connection thats why you are able to get success on the Test connection.can >>> you check whether you are able to access the zookeeper quorum from your >>> client machine. >>>>> On 20-Oct-2015, at 11:01 AM, Rajkumar Singh <[email protected]> >>> wrote: >>>>> >>>>> Did you see any exception in drillbit logs and also what is the >>> underlying Hbase version? >>>>> >>>>>> On 20-Oct-2015, at 10:30 AM, Tugdual Grall <[email protected]> wrote: >>>>>> >>>>>> Hello, >>>>>> >>>>>> Have you tried to run a simple query from SqlLine or Web UI? (with a >>>>>> limit just to be sure) >>>>>> Any error? >>>>>> >>>>>> Tug >>>>>> @tgrall >>>>>> >>>>>> On Mon, Oct 19, 2015 at 10:05 PM, De La Fuente, Pedro >>>>>> <[email protected]> wrote: >>>>>>> Hi, >>>>>>> >>>>>>> >>>>>>> I am currently trying to connect to an OpenTSDB database with Apache >>> Drill. The test works successfully in the MAPR Drill ODBC Driver DSN Setup >>> (Test button) after entering the connection type of Direct to DrillBit >>> (host:port) and no authentication type. >>>>>>> >>>>>>> >>>>>>> >>>>>>> Next, when I open drill explorer it just says processing query in a >>> separate window and never comes back. >>>>>>> >>>>>>> >>>>>>> >>>>>>> I have tried to configure the settings in Drill webpage - Storage >>> with the following settings: >>>>>>> >>>>>>> >>>>>>> >>>>>>> { >>>>>>> >>>>>>> "type": "hbase", >>>>>>> >>>>>>> "config": { >>>>>>> >>>>>>> "hbase.zookeeper.quorum": "c2ctsdrtpro", >>>>>>> >>>>>>> "hbase.zookeeper.property.clientPort": "4242" >>>>>>> >>>>>>> }, >>>>>>> >>>>>>> "size.calculator.enabled": false, >>>>>>> >>>>>>> "enabled": true >>>>>>> >>>>>>> } >>>>>>> >>>>>>> >>>>>>> >>>>>>> >>>>>>> >>>>>>> If the configurations are not set correctly, why would the test work >>> successfully? >>>>>>> >>>>>>> >>>>>>> Thanks, >>>>>>> >>>>>>> Pete >>>>> >>>> >>> >>> >> >> >> -- >> *Jim Scott* >> Director, Enterprise Strategy & Architecture >> +1 (347) 746-9281 >> @kingmesal <https://twitter.com/kingmesal> >> >> <http://www.mapr.com/> >> [image: MapR Technologies] <http://www.mapr.com> >> >> Now Available - Free Hadoop On-Demand Training >> <http://www.mapr.com/training?utm_source=Email&utm_medium=Signature&utm_campaign=Free%20available> >
