tejaskumar-cm opened a new issue #11371:
URL: https://github.com/apache/druid/issues/11371


   Hi Team,
   We are extracting and storing events in druid. In a day there will be nearly 
**6 million records**, which is of size **9GB/day**, and there are around **200 
columns** in the table.
   
   We are storing the data directly connecting to kafka and facing no problems 
in storing the data in druid.
   But when we are trying to retrieve this data using Druid SQL query, we are 
getting error and **not even able to query 1 million record** at a time.
   We tried different druid configuration as per the doc, but nothing helped us.
   
   **Can anyone guide us through the master, query and data server capacity 
required to handle this much of data, and also the druid configuration of each 
servers respectively?**
   
   I tried to find solution in different forum and didn't get any solution and 
hence I am posting a message here.
   Below I have attached some error I saw when I ran the query.
   
   1) Console error
   
![image](https://user-images.githubusercontent.com/57861380/122509475-788df700-d021-11eb-8ba3-f147b0c2a999.png)
   
![image](https://user-images.githubusercontent.com/57861380/122509500-85124f80-d021-11eb-9972-d8fc58d6dfb9.png)
   
   2) Druid broker.log
   
![image](https://user-images.githubusercontent.com/57861380/122509540-98251f80-d021-11eb-95fe-2dab7ba5cf2f.png)
   
![image](https://user-images.githubusercontent.com/57861380/122509564-9f4c2d80-d021-11eb-84f1-8eef72574dab.png)
   
   3) historical.log
   
![image](https://user-images.githubusercontent.com/57861380/122509589-ac691c80-d021-11eb-9162-04a08301c96d.png)
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
[email protected]



---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to