Re: Using multi valued field in solr cloud Graph Traversal Query

Hi Joel, Any idea from when multi value field is supported for gatherNodes ? I am using version 6.5 ? Is it already there ? Kindly update, Ganesh -- View this message in context:

Re: Graph Visualizing tool

Tried this, but it's not working as expected. http://solr.pl/en/2016/04/25/graph-visualization-using-solr-6/ Any of you used this or any other tool ? -- View this message in context: http://lucene.472066.n3.nabble.com/Graph-Visualizing-tool-tp4347240p4347241.html Sent from the Solr - User

Graph Visualizing tool

Hello Solr Experts, Does, any one used any tool or plugin to visualize the graph data based node_ids and edge_ids ? Pls suggest, -- View this message in context: http://lucene.472066.n3.nabble.com/Graph-Visualizing-tool-tp4347240.html Sent from the Solr - User mailing list archive at

Re: Graph Visualizing tool

Hi, Thanks for suggestion. But my csv is based on the documents which has node_id and edges in the same document. But the tool which you suggested looks like asking for two different entries for nodes separately and edges separately. My documents looks like this node_id, in_edges_ss ( multi

Re: Allow Join over two sharded collection

Hi Erick, Initially I also thought of using Streaming for Joins. But looks like Joins with Streaming is not for heavy QPS sort of queries and that's my use case. Currently things are working fine with normal join for us as we have only one shard. But in coming days number of documents to be

Allow Join over two sharded collection

All, Any idea when this ticket will be addressed. https://issues.apache.org/jira/browse/SOLR-8297 One of the comments says by SOLR 7.0. Can we expect that by 7.0 ? Regards, -- View this message in context:

Re: Allow Join over two sharded collection

Hi Susheel, Currently we have around 20M documents already and we are expecting now on that every month 1M of documents. The reason why don't want to for time based implicit routing is that, all documents will end up with recent shard and so indexing will be heavy for the new shard, where as

Re: Allow Join over two sharded collection

Hi Susheel, To make use of Joins only option is I should go for manual routing. If I go for manual routing based on time, we miss the power of distributing the load while indexing. It will end up with all indexing happens in newly created shard, which we feel this will not be efficient approach

Re: Graph traversel

Dear Solr experts, Can you any one over here explain about why graph traversal is not working as expected in Solr 6.5 ? It's not traversing all the child nodes. It traverse only few nodes and not getting all the mid level and leaf nodes. As I explained below, For this query

Re: Solr performance on EC2 linux

We use Solr 6.2 in EC2 instance with Cent OS 6.2 and we don't see any difference in performance between EC2 and in local environment. -- View this message in context: http://lucene.472066.n3.nabble.com/Solr-performance-on-EC2-linux-tp4332467p4332553.html Sent from the Solr - User mailing list

Graph Query Parser

All, Is any one using graph query parser with Solr 6+ versions? Is that working fine as expected ? Can you guys guide me with some working data model and configurations to set ? I tried with sample provided over here

Using of Streaming to join between shards

Hi, So far we had only one shards so joins are working fine. And now as our data is growing, we would like to go for new shards and we would like to go with only default sharding mechanism for various reasons. Due to this, join will fail. as it's not supported if we have more than one shards.

Re: Using of Streaming to join between shards

Hi Erick, My scenario goes with two kind of SOLR documents Document #1 - Real document #D_uniqueId #D_documentId(unique), #D_documentname, #D_documentdesc, #D_documentinfo1, #D_documentInfo2, #D_documentInfo3, ... Document #2 - to hold documents ACL #P_uniqueId #P_acl_perm ( multi value field,

Re: Join not working in Solr 6.5

Thanks for bringing up performance perspective. Is there any bench mark on join performance when number of shards is more than 10 where documents are indexed based on router.field. Are you suggesting instead of router.field go for streaming expressions or use join with router.field and then go

Re: Joins using graph queries - solr 6.0

Hi, Sorry that this reply is not an answer for your post, but want to know whether graph is working fine for you as expected. is that traverse working fine in the graph ? I posted a question over here, http://lucene.472066.n3.nabble.com/Graph-traversel-td4331207.html#a4331799 but no response.

Re: Join not working in Solr 6.5

Is there any possibility of supporting joins across multiple shards in near future ? How to achieve the join when our data is spread-ed across multiple shards. This is very much mandatory when we need to scale out. Any workarounds if out-of-box possibility is not there ? Thanks, -- View

Join not working in Solr 6.5

Hi, I have following records / documents with Parent entity id,type_s,P_hid_s,P_name_s,P_pid_s 11,PERSON,11,Parent1,11 And following records / documents with child entity id,type_s,C_hid_s,C_name_s,C_pid_s 12,PERSON,12,Child2,11

Re: Join not working in Solr 6.5

Perfect ! Sorry I overlooked and missed "=" Thanks, -- View this message in context: http://lucene.472066.n3.nabble.com/Join-not-working-in-Solr-6-5-tp4336247p4336251.html Sent from the Solr - User mailing list archive at Nabble.com.

Data from 4.10 to 6.5.1

Hi, I am planning the following for moving my old solr index data created in 4.10 to new solr server with 6.5.1. Let me know whether it will work out or not. * Setup Solr and Collections with version 5.5 * Copy data folder ( in old solr server 4.10 ) to the corresponding collection's data

Re: Data from 4.10 to 6.5.1

Thanks for the reply. Sure will pay attention. Indeed our approach was also to use the latest managed schema and configs only and add our custom schema from the old version. Luckily we have only one shard of data and others are replica only and also we are not using any fields types ( pint,

Re: Data from 4.10 to 6.5.1

All, As I mentioned above, thought I will update on steps we followed to move my data from 4.10 to 6.5.1 Our setup has 6 collections containing only one shard in each and couple of replicas in each collections * Install Solr 5.5.4 * Create configs for each collection. Copied basic_configs (

Re: can't create collection using solrcloud

Couple of times I faced this issue when firewall "Endpoint security" was on. Once I disabled it then it started working. Also for creating collection, I usually do in the following way, upconfig the configuration to zookeeper using the command bin/solr zk upconfig -n collection1_configs -z

SOLR query validation

Hi, In my use case, we need to validate the solr query which is getting fired to SOLR in the solr layer. Validation like, we want few fields to be passed always in the query, we don't want few fields not to be passed in the query. Which is the right place to do in the SOLR ? Currently we are

Re: fq performance

Thanks for suggestions Erick, Micheal and all. I guess using of single field as access_control will make sense. we can have access_control_user as multi value field to hold user list ( hold permission given to user alone individually ) and another field access_control_group as multi value field to

Custom Response writer

Hi, We have requirement like in the response we would like to add description of an item with item id(this field comes from solr response by default) or employee name along with employee id ( this is just an example use case ). In the solr document what we have is only item id or employee id.

Adding shards dynamically when the automatic routing is used

All, Is there possiblity in near future in coming new releases, adding shards dynamically though compositeId ( default ) based routing is used. Currently only option is we need to split the shard, instead we should able to add shards dynamically and then on all new documents should go on new

Re: Using of Streaming to join between shards

Hi Susheel, Thanks for your reply and as you suggested we will start with innerJoin. But what I want know is that, Is Streaming can be used instead of normal default Join ? For ex. currently we fire request for every user clicks on menu in the page to show list of his documents with default

Re: Using of Streaming to join between shards

Hi Joel, Thanks for confirming that Streaming would be too costly for high qps loads. Regards, -- View this message in context: http://lucene.472066.n3.nabble.com/Using-of-Streaming-to-join-between-shards-tp4342563p4343104.html Sent from the Solr - User mailing list archive at Nabble.com.

Re: Default Index config

To add it further, in 6.5.1, while indexing... even sometimes one of solr node goes down for a while and comes up automatically. During those period all our calls to index fails. Even in the Solr admin UI, we can see node not being active for a while and coming up again. All these happens in 4

Re: docvalues set to true, and indexed is false and stored is set to false

Hi, I guess my point is not conceived correctly. Here I am talking about the field "In Place Updates " As per above link, it says that complete document will not be

Re: docvalues set to true, and indexed is false and stored is set to false

Hi, Thanks for quick response. I forgot to mention that after adding it, I have re-indexed all the data with dynamic fields Field_one, Field_two etc. In that case, by adding new field ( docvalue field ) or removing existing docvalue field, Will the whole document will re-indexed again, or

docvalues set to true, and indexed is false and stored is set to false

Hi, If I have set following in the schema What will be the impact of deleting a single field, "Fields_one" field or what's the impact of adding a new field "Fields_100" ? Will the whole document will re-indexed again, or only this field alone will be deleted and added correspondingly. Idea

Re: docvalues set to true, and indexed is false and stored is set to false

Hi, Thanks for clearing. But as per this link (Enabling DocValues) it says that it supports strField and UUID field also. Again, what you mean by it's not free for large segments. Can you point me to some

Re: docvalues set to true, and indexed is false and stored is set to false

Hi Emir, Thanks for confirming that strField is not considered / available for in place updates. As per documentation, it says... *An atomic update operation is performed using this approach only when the fields to be updated meet these three conditions: are non-indexed (indexed="false"),

In Place Updates not work as expected

All, I have (say 1M, in real time it would be more even) solr documents which has lot of fields and it's bit huge. We have a functionality, where we need to go and update a specific field or add new field in to that document. Since we have to do this for all 1M documents, it's taking up more time

Re: In Place Updates not work as expected

Hi Emir, I am using solrj to update the document. Is there any spl API to be used for in place Updates ? Yes are we are updating in Batch of 1000 documents. As I mentioned before, since I am updating only docvalues i expect it should update in faster than updating normal field. Isn't it ?

Re: Default Index config

Hi Shawn, We found following link where its mentioned like in 6.2.1 it's

Re: Default Index config

Hi Shawn, Thanks for the reply. Yes we use only one solr client. Though collection name is passed in the function, we are using same client for now. Regarding merge config, after reading lot of forums and listening to presentation of revolution 2017, idea is to reduce the merge frequency, so

Re: Default Index config

Hi Shawn, Regarding CPU high, when we are troubleshooting, we found that Merge threads are keep on running and it's take most CPU time ( as per Visual JVM ). GC is not causing any issue as we use the default GC and also tried with G1 as you suggested over here

Re: Performance & CPU Usage of 6.2.1 vs 6.5.1 & above

Regarding query times, we couldn't see big improvements. Both are more or less same. Our main worry is that, why CPU usage is so high in 6.5.1 and above ? What's going wrong ? Is any one else facing this sort of issue ? If yes, how to bring down the CPU usage? Is there any settings which we

Re: Performance & CPU Usage of 6.2.1 vs 6.5.1 & above

sed in future build for this ? Keep us posted Deepak Goel wrote > Please post the exact results. Many a times the high cpu utilisation may > be > a boon as it improves query response times > > On Tue, 17 Apr 2018, 13:55 mganeshs, > mganeshs@ > wrote: > >> Regard

Performance & CPU Usage of 6.2.1 vs 6.5.1 & above

Solr experts, We found following link where its mentioned like in 6.2.1

Re: Performance & CPU Usage of 6.2.1 vs 6.5.1 & above

Hi Bernd, We didn't change any default settings. Both 6.2.1 and 6.5.1 is running with same settings, same volume of data, same code, which means indexing rate is also same. In Case of 6.2.1 CPU is around 60 to 70%. But in 6.5.1 it's always around 95%. The CPU % in 6.5.1 is alarming for us and

Re: Default Index config

Hi Shawn, Thanks for detail mail. Yes I am behind the IndexConfig only. Regarding 5GB size of collection, it's not one document. It has almost 3M of docs in that collection. I am using the default configuration, as all solr experts say default one suits for most of the cases and so following

Re: Default Index config

Hi Shawn, Thanks again for detailed reply. Regarding auto commit, we discussed lot with our product owners and atlast we are forced to keep it to 1sec and we couldn't increase further. As this itself, sometimes our customers says that they have to refresh their pages for couple of times to get

Default Index config

Hi, I haven't changed the solr config wrt index config, which means it's all commented in the solrconfig.xml. It's something like what I pasted before. But I would like to know whats the default value of each of this. Coz.. after loading to 6.5.1 and our document size also crossed 5GB in each

Re: In Place Updates not work as expected

Hi Emir, It's normal setfield and addDocument for ex. in a for loop solrInputDocument.setField(sFieldId, fieldValue); and after this, we add the created document. solrClient.add(collectionName, solrInputDocuments); I just want to know whether, we need to do something specific for

Re: Allow Join over two sharded collection

All, Any idea, whether this will be taken care or addressed in near future ? https://issues.apache.org/jira/browse/SOLR-8297 Regards, -- Sent from: http://lucene.472066.n3.nabble.com/Solr-User-f472068.html

Solr query with best match returning high score

Hello Experts, I have a following query product:TV or os:Android or size:(55 60 65) or brand:samsung or issmart:yes or ram:[4 TO *] or rate:[10 TO *] or bezel : no or sound:dolby In Total there are 9 conditions. Now I need the document with best match should return top. Best match I mean

Fetch related documents from Custom Function

Is there a easy possibility of reading the few field from related documents from Custom function ? For ex, Project document contains, project id, project name, Project manager id ( which is nothing but employee id ). & Employee document contains field ( Employee id, Employee name ). Now while

Re: Fetch related documents from Custom Function

Yes. But being inside solr ( I mean code getting executing via Custom function ), do we have option to read the other solr documents in a easy way. -- Sent from: https://lucene.472066.n3.nabble.com/Solr-User-f472068.html

Re: Fetch related documents from Custom Function

Solr Experts, any easy way for reading other solr docs ( other docs ) from solr custom function ? -- Sent from: https://lucene.472066.n3.nabble.com/Solr-User-f472068.html