Yes. The reason is that "0% of 0GB" basically means 0% of the maximum direct
memory claimed so far.
Drill will consume some system memory for use in Direct and can (potentially)
return it as well. In your case, the Direct memory appears to be barely used.
So, it is very likely that the Drillbi
Hi All,
Thanks for the response. I currently see the Heap utilization go upwards of
80-90% but the Direct Memory is 0GB (0% of 0GB)
I have the following settings in drill-env.sh . Is it normal to show Direct
Memory utilization as 0GB ?
export DRILLBIT_MAX_PROC_MEM=${DRILLBIT_MAX_PROC_MEM:-"25G"
Hi Dweep,
I see that you are using the REST API to execute the queries. The
recommended way for complex queries that are resource intensive, is to
always use either the JDBC/ODBC driver to submit queries for execution.
Here is a difference for your reference. Please use JDBC/ODBC to execute
your q
Hi Dweep,
This mailing list does not support attachments. Consider filing a JIRA ticket
and attaching your images there: [1]
You mention you've assigned Drill 14 GB of heap. You also mention that your
task ran out of heap. As it turns out, Drill also uses direct memory to store
intermediate da
Hi Divya,
The size is 48 MB (after converting to Parquet)
[image: image.png]
[image: image.png]
On Fri, Jun 7, 2019 at 1:45 PM Divya Gehlot wrote:
> Can you share the more details .
> Query profile and other aspects like data size and all to have better view
> what’s happening
>
>
> Thanks
Can you share the more details .
Query profile and other aspects like data size and all to have better view
what’s happening
Thanks ,
Divya
On Fri, 7 Jun 2019 at 4:13 PM, Dweep Sharma wrote:
> Data is in JSON format.
>
> On Fri, Jun 7, 2019 at 1:39 PM Dweep Sharma
> wrote:
>
> > Hi,
> >
> > I
Data is in JSON format.
On Fri, Jun 7, 2019 at 1:39 PM Dweep Sharma wrote:
> Hi,
>
> I have a memory leak issue. 14GB memory is assigned to heap but it gets
> full within a day with just one cron running.
>
> Task is a CTAS query from Kafka to S3 once every hour. CTAS is issued via
> the Drill R
