We had more than 200,000 profiles stored :)
Regards,
Rahul.
On Wed, Aug 30, 2017 at 5:03 AM, Padma Penumarthy
wrote:
> If these channel closed exceptions happen when you try to list profiles
> using web UI, yes that could be related.
> one option is to change configuration to use a new director
Thanks Anil
Can you please share more details of the approach here for querying streaming
data?
Are we going to create table mapped to Kafka Topic here and pull data from
topic at regular intervals?
Are we going to extract event from message and insert as row to table.
Data pushed to
If these channel closed exceptions happen when you try to list profiles
using web UI, yes that could be related.
one option is to change configuration to use a new directory for saving
profiles.
You can delete the old profiles (if you don’t need them) or save them.
Thanks,
Padma
> On Aug 29,
Thanks for the reply. I will try deleting the files manually.
I have a web application that pools connections to drill. Once this happens
I can see channel closed exceptions and the entire pool stale. Could this
be due to a large GC causing ZK heartbeat miss?
Regards,
Rahul
On Tue, Aug 29, 2017
That’s great. Thanks for the update. Looking forward for the presentation.
Thanks,
Padma
> On Aug 29, 2017, at 11:48 AM, AnilKumar B wrote:
>
> Hi Padma & Chetan,
>
> Just wanted to update on https://issues.apache.org/jira/browse/DRILL-4779
>
> We have developed and tested kafka integration
Hi Padma & Chetan,
Just wanted to update on https://issues.apache.org/jira/browse/DRILL-4779
We have developed and tested kafka integration and currently it's working
for JSON messages. And currently we are working on test cases and Avro
support.
We are planning to present this on Sept 18th Dril
Thanks Padma for quick response.
This will be very critical feature to support in Drill as user will look for
single SQL Engine which supports querying both batch and streaming data.
Any inputs on when support for querying streaming data will be supported?
Regards
Chetan
-Ori
Currently, we do not have support for these storage plugins.
I see an open JIRA for Kafka, not sure how much progress was made (as last
update was a while back).
https://issues.apache.org/jira/browse/DRILL-4779
Thanks,
Padma
On Aug 29, 2017, at 10:14 AM, Chetan Kothari
mailto:chetan.koth...@o
Is there any support for querying streaming data using Drill?
Presto provides out-of-box Kafka and Amazon Kinesis Connectors for querying
streaming data.
Regards
Chetan
yes, we save each query profile as file in a single directory.
If there are large number of files in the directory, it can cause web UI to
hang or slow down.
That is because we try to list all the files in the directory when we want to
view the profiles from web UI and
that is an expensive operat
This might be because that installation is possibly hosting a lot of Drill
profiles. Do you know how many profiles you have residing in the underlying
persistent store?
When a query is executed, the Foreman Drillbit (i.e. the node from where the
query is submitted) writes the final profile to t
Hi,
The drill profile list page(<>:8047/profiles) takes few minutes to load
in one of the installation.
There was a considerable amount of processor(20%) and memory(15-20%) usage
during this time. Immediately after displaying the results, values return
to normal.
Could this be because of the val
I think I sent that email to the wrong address. Reposting it here
-- Forwarded message --
From: Gonzalo Ortiz Jaureguizar
Date: 2017-08-25 11:24 GMT+02:00
Subject: Problems using Postgres datasource
To: user-ow...@drill.apache.org
Hi there,
My name is Gonzalo and I'm working a
13 matches
Mail list logo
