Re: Apache drill issue - cpu spiking to 100%

2018-10-22 Thread Kunal Khatua
Hi Bala/Srihari  In the Drill query profile, I dont see the query running for more than a second. The example you gave is with 350msec. I'm not sure what the backend Mongo storage plugin is doing. You'll probably need to profile the Drillbit using something like Yourkit or JVisualVM to

Re: Apache drill issue - cpu spiking to 100%

2018-10-20 Thread Srihari Prabhakar
Hi Kunal, I have Web UI enabled, but queries are not being run from there. Queries are being run through JDBC. Attaching the Drill query, drill profile. Also I have enabled profiling on MongoDB and captured all the queries triggered by drill on MongoDB. I have grouped all MongoDB queries by shape

Re: Apache drill issue - cpu spiking to 100%

2018-10-19 Thread Kunal Khatua
Hi Bala Can you share details of the profiles itself? It might be that the MongoDB storage plugin is translating the query into 100 mongo queries because of some (100?) specific filter criteria in the Drill query? JVM Heap usage fluctuation would indicate frequent object creation and garbage