Re: Help needed with Production Configurations

2019-08-15 Thread Ashutosh Mestry
: Verdan Mahmood Date: Wednesday, August 14, 2019 at 10:39 AM To: "dev@atlas.apache.org" , Ashutosh Mestry Cc: "u...@atlas.apache.org" Subject: Re: Help needed with Production Configurations We are using Atlas 2.0 We do have following relations: Table(DataSet): hive_ta

Re: Help needed with Production Configurations

2019-08-14 Thread Verdan Mahmood
We are using Atlas 2.0 We do have following relations: *Table(DataSet):* *hive_table(Table):* metadata = Metadata *Metadata:* popularityScore and one of our query is FROM Table SELECT metadata.__guid ORDERBY popularityScore desc LIMIT 10 Another one is for the wildcard search Table from

Re: Help needed with Production Configurations

2019-08-14 Thread Ashutosh Mestry
What version are you using? DSL queries mostly not use indexes, hence having good configuration of Solr may not be of much value. The pre-1.0 version of DSL is not very efficient in terms of performance. What kind of queries do you have? Can you post some examples? Few things you could try: -

Help needed with Production Configurations

2019-08-14 Thread Verdan Mahmood
Hello Community, We have deployed the Atlas-Solr in our production environment recently, and have around 30k hive tables, with a couple of custom entity types. The DSL queries are pretty slow and taking an average of 15 seconds each time. Our Solr is pretty efficient and works pretty well with