How to apply Semantic Search in Solr

2014-03-08 Thread Sohan Kalsariya
Hello, I am working on an event listing and promotions website( http://allevents.in) and I want to apply semantic search on solr. For example, if someone search : Musical Events in New York So it would give me results such as : * Musical Night at ABC place * Concerts Events *

Re: How to apply Semantic Search in Solr

2014-03-08 Thread Alexandre Rafalovitch
And how would it know to give you those results? Obviously, you have some sort of magic/algorithm in your mind. Are you doing geographic location match, category match, synonyms match? We can't really help with generic questions. You still need to figure out what semantic means for you

organize folder inside Solr

2014-03-08 Thread blach
Hello, I'm beginner in Apache Solr, My task is to organize folders inside the Solr I've read a bit about collections, cores, and all that, what I don't understand is why every document inside the collection is in XML or Json? how can I put my folder inside Solr, should I create another

Re: organize folder inside Solr

2014-03-08 Thread Erick Erickson
Well, a couple of things: 1 Solr does NOT index documents in XML, that is just the input format. Well, one of the input formats. Internally there's a complex inverted index storage format. 2 What do you mean organize into folders? The common way is just to put them all into a

Re: How to apply Semantic Search in Solr

2014-03-08 Thread Jack Krupansky
You will need to implement a sematic/text classification/categorization algorithm and annotate each document with additional fields for the categories before presenting it to Solr. For a couple of examples, see:

Re: Solrj Backward Compatibility After 4.5.1

2014-03-08 Thread Furkan KAMACI
I've added a comment at that issue. Thanks; Furkan KAMACI 2014-03-07 21:30 GMT+02:00 Shawn Heisey s...@elyograg.org: On 3/7/2014 11:58 AM, Furkan KAMACI wrote: Hi; I have a cluster as SolrCloud of 4.5.1 When I use a Solrj version greater than 4.5.1 I get an error when deleting a

Re: organize folder inside Solr

2014-03-08 Thread blach
Well, for now, I just want to put some data (binary, PDF, JPEG, ... any) inside solr, should I put them by hand (copy/past) inside \solr-4.7.0\example\solr\collection1, or there another way to do it. thanks. Med. -- View this message in context:

Re: organize folder inside Solr

2014-03-08 Thread Erick Erickson
You really have to back up and do your homework here. Please work through the tutorial below, it'll help clear up some of your confusion. For instance, you feed documents _to_ solr, after you've defined a schema, figured out your use-cases, etc. You don't just stick documents somewhere, turn Solr

Re: What is mean by Index Searcher?

2014-03-08 Thread Furkan KAMACI
Hi; At this point I suggest you to read here: http://searchhub.org/2013/08/23/understanding-transaction-logs-softcommit-and-commit-in-sorlcloud/ Thanks; Furkan KAMACI 2014-03-07 10:44 GMT+02:00 Alexandre Rafalovitch arafa...@gmail.com: Some events close and reopen the searcher. Commit is the

Re: SolrCloud with Tomcat

2014-03-08 Thread Furkan KAMACI
Hi; Could you check here: http://lucene.472066.n3.nabble.com/Error-when-creating-collection-in-Solr-4-6-td4103536.html Thanks; Furkan KAMACI 2014-03-07 9:44 GMT+02:00 Vineet Mishra clearmido...@gmail.com: Hi I am installing SolrCloud with 3 External

Re: Partial Counts in SOLR

2014-03-08 Thread Salman Akram
The issue with timeallowed is you never know if it will return minimum amount of docs or not. I do want docs to be sorted based on date but it seems its not possible that solr starts searching from recent docs and stops after finding certain no. of docs...any other tweak? Thanks On Saturday,

Re: howto count total word amount of all documents in solr index?

2014-03-08 Thread Furkan KAMACI
Hi; Dou you want that: http://localhost:8983/solr/#/collection1/schema-browser?field=text_general Thanks; Furkan KAMACI 2014-03-07 10:48 GMT+02:00 cqlangyi cqlan...@163.com: hi there, i have following questions, please help me out, very appreciate. say i have a field configured as

Re: organize folder inside Solr

2014-03-08 Thread blach
Thanks, I followed it carefully, the example in the tutorial is indexing only Xml files, and that is my problem, I want my search engine to look for other formats like pictures, music, PDF, and so on. and I'm working just on Collection1 , Med. -- View this message in context:

Re: organize folder inside Solr

2014-03-08 Thread Rafał Kuć
Hello! There are multiple tutorials on how to do this, for example: 1. http://solr.pl/en/2011/03/21/solr-and-tika-integration-part-1-basics/ 2. http://wiki.apache.org/solr/ExtractingRequestHandler -- Regards, Rafał Kuć Performance Monitoring * Log Analytics * Search Analytics Solr

Re: Caching requests to Solr

2014-03-08 Thread Tommaso Teofili
following up on this, I've created https://issues.apache.org/jira/browse/SOLR-5826 , with a draft patch. Regards, Tommaso 2014-03-05 8:50 GMT+01:00 Tommaso Teofili tommaso.teof...@gmail.com: Hi all, I have the following requirement where I have an application talking to Solr via SolrJ where

Re: solr IDF based filtering response

2014-03-08 Thread GaneshSe
request your help on the same. I am sure there should be some way to do it, there should be some way to limit the results based on relevance. Please help -- View this message in context: http://lucene.472066.n3.nabble.com/solr-IDF-based-filtering-response-tp4121271p4122268.html Sent from the

Re: How to apply Semantic Search in Solr

2014-03-08 Thread Sohan Kalsariya
Basically, when i searched it on Google I got this result : http://www.opensourceconnections.com/2013/08/25/semantic-search-with-solr-and-python-numpy/ And I am working on this. So is this useful ? On Sat, Mar 8, 2014 at 3:11 PM, Alexandre Rafalovitch arafa...@gmail.comwrote: And how would

Re: organize folder inside Solr

2014-03-08 Thread Jack Krupansky
You should consider taking a basic training course in Solr, and/or reading one of the available introductory books. Or even reading the introduction in my e-book: http://www.lulu.com/shop/jack-krupansky/solr-4x-deep-dive-early-access-release-7/ebook/product-21203548.html -- Jack Krupansky

Re: How to apply Semantic Search in Solr

2014-03-08 Thread Sujit Pal
Thanks for sharing this link Sohan, its an interesting approach. Since you have effectively defined what you mean by Semantic Search, there are couple other approaches I know of to do something like this: 1) preprocess your documents looking for terms that co-occur in the same document. The more

Re: Indexing huge data

2014-03-08 Thread Rallavagu
Thanks for all responses so far. Test runs so far does not suggest any bottleneck with Solr yet as I continue to work on different approaches. Collecting the data from different sources seems to be consuming most of the time. On 3/7/14, 5:53 PM, Erick Erickson wrote: Kranti and Susheel's

volatile write to make isCleaning visible at ConcurrentLRUCache

2014-03-08 Thread Furkan KAMACI
Hi; ConcurrentLRUCacheK,V class has that lines: ... long oldestEntry = this.oldestEntry; isCleaning = true; this.oldestEntry = oldestEntry; // volatile write to make isCleaning visible ... What does that assignment and so makes isCleaning visible? Thanks; Furkan KAMACI

Re: volatile write to make isCleaning visible at ConcurrentLRUCache

2014-03-08 Thread Yonik Seeley
On Sat, Mar 8, 2014 at 2:33 PM, Furkan KAMACI furkankam...@gmail.com wrote: ConcurrentLRUCacheK,V class has that lines: ... long oldestEntry = this.oldestEntry; isCleaning = true; this.oldestEntry = oldestEntry; // volatile write to make isCleaning visible ... What does that

Re: volatile write to make isCleaning visible at ConcurrentLRUCache

2014-03-08 Thread Shawn Heisey
On 3/8/2014 12:50 PM, Yonik Seeley wrote: On Sat, Mar 8, 2014 at 2:33 PM, Furkan KAMACI furkankam...@gmail.com wrote: ConcurrentLRUCacheK,V class has that lines: ... long oldestEntry = this.oldestEntry; isCleaning = true; this.oldestEntry = oldestEntry; // volatile write to make

Re: volatile write to make isCleaning visible at ConcurrentLRUCache

2014-03-08 Thread Yonik Seeley
On Sat, Mar 8, 2014 at 3:28 PM, Shawn Heisey s...@elyograg.org wrote: Do we have any idea whether this side effect of volatile access is part of the Java specification Yep, it's part of the JMM (Java Memory Model) and is guaranteed behavior. -Yonik http://heliosearch.org - native off-heap