Re: NRT or similar for Solr 3.5?
I followed the steps and they worked fine for me ... On further investigation I found that I had not changed the *solr.war* file in myapp/*webapps* folder to the *solr.war* with ranking algorithm .. @Steven check that out Thanks Nagendra Regards Vikram Kamath On 17 December 2011 22:35, Nagendra Nagarajayya nnagaraja...@transaxtions.com wrote: Regarding docs not showing up, can you try adding docs to the demo index (MBArtists that is available with the download). The start_solr.sh points to the index, which is under solr under the examples directory. start solr with the start_solr.sh script and add a document to the index using the load (download from here: http://tgels.org/load_test_**nrt.sh http://tgels.org/load_test_nrt.sh) script as follows: Before your run the load script: try: http://localhost:8983/solr/**select/?q=*:*rows=0http://localhost:8983/solr/select/?q=*:*rows=0 (Should show numFound=439213) http://localhost:8983/solr/**select/?q=nrtfl=scorehttp://localhost:8983/solr/select/?q=nrtfl=score (Should not find John nrt27 Davis but will list other records like nrt, etc.) Now run: bash -x /tmp/load_test_nrt.sh (You will see INFO: newest commit = 1287674272560 or similar) try: http://localhost:8983/solr/**select/?q=*:*rows=0http://localhost:8983/solr/select/?q=*:*rows=0 (Should show numFound=439214) http://localhost:8983/solr/**select/?q=nrtfl=scorehttp://localhost:8983/solr/select/?q=nrtfl=score (Should show John nrt27 Davis as the second search result) http://localhost:8983/solr/**select/?q=nrt27fl=scorehttp://localhost:8983/solr/select/?q=nrt27fl=score (Should show John nrt27 Davis as the first search result) To duplicate this, I downloaded a bundle version, changed to examples directory, started solr with start_solr.sh, and did the above steps to make sure the results change when a new doc is added. To add more documents, just open load_test_nrt.sh with an editor, and change x and y variables at the top of the script by incrementing them by 1. Run the script again, and you should see one more doc added, also be able to search nrt28, and so on ... Let me know if you have problems duplicating this. Regards, - NN On 12/17/2011 12:34 AM, vikram kamath wrote: @Steven even I have done the same thingEven I am user btw @Nagendra I have an index on about 15 million mysql records. I am using the solr-ra Solr 3.5 (NRT support) with RankingAlgorithm 1.3 (bundle 118MB) http://solr-ra.tgels.com/**solr-ra.jsphttp://solr-ra.tgels.com/solr-ra.jsp and have added my index (indexed using solr 3.4) to the same .. I have added realtime visible=1true/realtime libraryrankingalgorithm/**library rankingalgorithm algorithmsimple/algorithm /rankingalgorithm to /apache-solr-ra-3.5.0/myapp/**solr/conf/solrconfig.xml Querying seems faster but it takes about 2 mins to be able to search for a record added I don't do an commit after adding the documents upon seeing the solr logs I see that ... *Dec 17, 2011 12:08:32 AM org.apache.solr.update.**DirectUpdateHandler2 commit * *INFO: start commit(optimize=false,**waitFlush=true,waitSearcher=** true,expungeDeletes=false) * is called after a while(abt 2 mins) and the records become visible Could you please help me out? I have removed filtercache and even tried searching withcache=true but the record is visible only after the automatic commit [image: twitter]http://twitter.com/**kmarkivhttp://twitter.com/kmarkiv [image: facebook]http://facebook.com/**kmarkiv http://facebook.com/kmarkiv [image: google-buzz]http://profiles.**google.com/kmarkiv#buzzhttp://profiles.google.com/kmarkiv#buzz [**image: linkedin]http://linkedin.com/**in/vikramkamathchttp://linkedin.com/in/vikramkamathc Regards Vikram Kamath On 17 December 2011 05:10, Steven Ousteve...@gmail.com wrote: Hey Vikram, I finally got around to getting Solr-RA installed but I'm having trouble getting the NRT to work. Could you help me out? I added these four lines immediately afterconfig in solrconfig.xml: realtime visible=200true/realtime libraryrankingalgorithm/**library realtime visible=200 facet=truetrue/realtime libraryrankingalgorithm/**library Is that correct? I also read something about disabling caching, so I took out the queryResultCache. Is that right? What else do I need to do to get NRT working? Do I need to switch some engine to Solr-RA? If so, how do I do that? Are there other caches I need to disable? Any help appreciated. Thanks. -- Steven Ou | 歐偉凡 *ravn.com* | Chief Technology Officer steve...@gmail.com | +1 909-569-9880 2011/12/12 vikram kamathkmar...@gmail.com @Steven .. try some alternate email address(besides google/yahoo) and check your spam [image: twitter]http://twitter.com/**kmarkivhttp://twitter.com/kmarkiv [image: facebook]http://facebook.com/**kmarkiv http://facebook.com/kmarkiv [image: google-buzz]http://profiles
Re: NRT or similar for Solr 3.5?
@Steven even I have done the same thingEven I am user btw @Nagendra I have an index on about 15 million mysql records. I am using the solr-ra Solr 3.5 (NRT support) with RankingAlgorithm 1.3 (bundle 118MB) http://solr-ra.tgels.com/solr-ra.jsp and have added my index (indexed using solr 3.4) to the same .. I have added realtime visible=1true/realtime libraryrankingalgorithm/library rankingalgorithm algorithmsimple/algorithm /rankingalgorithm to /apache-solr-ra-3.5.0/myapp/solr/conf/solrconfig.xml Querying seems faster but it takes about 2 mins to be able to search for a record added I don't do an commit after adding the documents upon seeing the solr logs I see that ... *Dec 17, 2011 12:08:32 AM org.apache.solr.update.DirectUpdateHandler2 commit * *INFO: start commit(optimize=false,waitFlush=true,waitSearcher=true,expungeDeletes=false) * is called after a while(abt 2 mins) and the records become visible Could you please help me out? I have removed filtercache and even tried searching with cache=true but the record is visible only after the automatic commit [image: twitter] http://twitter.com/kmarkiv[image: facebook]http://facebook.com/kmarkiv[image: google-buzz] http://profiles.google.com/kmarkiv#buzz[image: linkedin]http://linkedin.com/in/vikramkamathc Regards Vikram Kamath On 17 December 2011 05:10, Steven Ou steve...@gmail.com wrote: Hey Vikram, I finally got around to getting Solr-RA installed but I'm having trouble getting the NRT to work. Could you help me out? I added these four lines immediately after config in solrconfig.xml: realtime visible=200true/realtime libraryrankingalgorithm/library realtime visible=200 facet=truetrue/realtime libraryrankingalgorithm/library Is that correct? I also read something about disabling caching, so I took out the queryResultCache. Is that right? What else do I need to do to get NRT working? Do I need to switch some engine to Solr-RA? If so, how do I do that? Are there other caches I need to disable? Any help appreciated. Thanks. -- Steven Ou | 歐偉凡 *ravn.com* | Chief Technology Officer steve...@gmail.com | +1 909-569-9880 2011/12/12 vikram kamath kmar...@gmail.com @Steven .. try some alternate email address(besides google/yahoo) and check your spam [image: twitter] http://twitter.com/kmarkiv[image: facebook]http://facebook.com/kmarkiv[image: google-buzz] http://profiles.google.com/kmarkiv#buzz[image: linkedin]http://linkedin.com/in/vikramkamathc Regards Vikram Kamath 2011/12/13 Steven Ou steve...@gmail.com Yeah, running Chrome on OSX and doesn't do anything. Just switched to Firefox and it works. *But*, also don't seem to be receiving confirmation email. -- Steven Ou | 歐偉凡 *ravn.com* | Chief Technology Officer steve...@gmail.com | +1 909-569-9880 2011/12/12 vikram kamath kmar...@gmail.com The Onclick handler does not seem to be called on google chrome (Ubuntu ). Also , I dont seem to receive the email with the confirmation link on registering (I have checked my spam) Regards Vikram Kamath 2011/12/12 Nagendra Nagarajayya nnagaraja...@transaxtions.com Steven: There is an onclick handler that allows you to download the src. BTW, an early access Solr 3.5 with RankingAlgorithm 1.3 (NRT) release is available for download. So please give it a try. Regards, - Nagendra Nagarajayya http://solr-ra.tgels.org http://rankingalgorithm.tgels.org On 12/10/2011 11:18 PM, Steven Ou wrote: All the links on the download section link to http://solr-ra.tgels.org/# -- Steven Ou | 歐偉凡 *ravn.com* | Chief Technology Officer steve...@gmail.com | +1 909-569-9880 2011/12/11 Nagendra Nagarajayya nnagaraja...@transaxtions.com Steven: Not sure why you had problems, #downloads ( http://solr-ra.tgels.org/#downloads ) should point you to the downloads section showing the different versions available for download ? Please share if this is not so ( there were downloads yesterday with no problems ) Regarding NRT, you can switch between RA and Lucene at query level or at config level; in the current version with RA, NRT is in effect while with lucene, it is not, you can get more information from here: http://solr-ra.tgels.org/papers/Solr34_with_RankingAlgorithm13.pdf Solr 3.5 with RankingAlgorithm 1.3 should be available next week. Regards, - Nagendra Nagarajayya http://solr-ra.tgels.org http://rankingalgorithm.tgels.org On 12/9/2011 4:49 PM, Steven Ou wrote: Hey Nagendra, I took a look and Solr-RA looks promising - but: - I could not figure out how to download it. It seems like all
Re: NRT or similar for Solr 3.5?
The Onclick handler does not seem to be called on google chrome (Ubuntu ). Also , I dont seem to receive the email with the confirmation link on registering (I have checked my spam) Regards Vikram Kamath 2011/12/12 Nagendra Nagarajayya nnagaraja...@transaxtions.com Steven: There is an onclick handler that allows you to download the src. BTW, an early access Solr 3.5 with RankingAlgorithm 1.3 (NRT) release is available for download. So please give it a try. Regards, - Nagendra Nagarajayya http://solr-ra.tgels.org http://rankingalgorithm.tgels.org On 12/10/2011 11:18 PM, Steven Ou wrote: All the links on the download section link to http://solr-ra.tgels.org/# -- Steven Ou | 歐偉凡 *ravn.com* | Chief Technology Officer steve...@gmail.com | +1 909-569-9880 2011/12/11 Nagendra Nagarajayya nnagaraja...@transaxtions.com Steven: Not sure why you had problems, #downloads ( http://solr-ra.tgels.org/#downloads ) should point you to the downloads section showing the different versions available for download ? Please share if this is not so ( there were downloads yesterday with no problems ) Regarding NRT, you can switch between RA and Lucene at query level or at config level; in the current version with RA, NRT is in effect while with lucene, it is not, you can get more information from here: http://solr-ra.tgels.org/papers/Solr34_with_RankingAlgorithm13.pdf Solr 3.5 with RankingAlgorithm 1.3 should be available next week. Regards, - Nagendra Nagarajayya http://solr-ra.tgels.org http://rankingalgorithm.tgels.org On 12/9/2011 4:49 PM, Steven Ou wrote: Hey Nagendra, I took a look and Solr-RA looks promising - but: - I could not figure out how to download it. It seems like all the download links just point to # - I wasn't looking for another ranking algorithm, so would it be possible for me to use NRT but *not* RA (i.e. just use the normal Lucene library)? -- Steven Ou | 歐偉凡 *ravn.com* | Chief Technology Officer steve...@gmail.com | +1 909-569-9880 On Sat, Dec 10, 2011 at 5:13 AM, Nagendra Nagarajayya nnagaraja...@transaxtions.com wrote: Steven: Please take a look at Solr with RankingAlgorithm. It offers NRT functionality. You can set your autoCommit to about 15 mins. You can get more information from here: http://solr-ra.tgels.com/wiki/**en/Near_Real_Time_Search_ver_**3.x http://solr-ra.tgels.com/wiki/en/Near_Real_Time_Search_ver_3.x Regards, - Nagendra Nagarajayya http://solr-ra.tgels.org http://rankingalgorithm.tgels.**org http://rankingalgorithm.tgels.org On 12/8/2011 9:30 PM, Steven Ou wrote: Hi guys, I'm looking for NRT functionality or similar in Solr 3.5. Is that possible? From what I understand there's NRT in Solr 4, but I can't figure out whether or not 3.5 can do it as well? If not, is it feasible to use an autoCommit every 1000ms? We don't currently process *that* much data so I wonder if it's OK to just commit very often? Obviously not scalable on a large scale, but it is feasible for a relatively small amount of data? I recently upgraded from Solr 1.4 to 3.5. I had a hard time getting everything working smoothly and the process ended up taking my site down for a couple hours. I am very hesitant to upgrade to Solr 4 if it's not necessary to get some sort of NRT functionality. Can anyone help me? Thanks! -- Steven Ou | 歐偉凡 *ravn.com* | Chief Technology Officer steve...@gmail.com | +1 909-569-9880
Re: NRT or similar for Solr 3.5?
@Steven .. try some alternate email address(besides google/yahoo) and check your spam [image: twitter] http://twitter.com/kmarkiv[image: facebook]http://facebook.com/kmarkiv[image: google-buzz] http://profiles.google.com/kmarkiv#buzz[image: linkedin]http://linkedin.com/in/vikramkamathc Regards Vikram Kamath 2011/12/13 Steven Ou steve...@gmail.com Yeah, running Chrome on OSX and doesn't do anything. Just switched to Firefox and it works. *But*, also don't seem to be receiving confirmation email. -- Steven Ou | 歐偉凡 *ravn.com* | Chief Technology Officer steve...@gmail.com | +1 909-569-9880 2011/12/12 vikram kamath kmar...@gmail.com The Onclick handler does not seem to be called on google chrome (Ubuntu ). Also , I dont seem to receive the email with the confirmation link on registering (I have checked my spam) Regards Vikram Kamath 2011/12/12 Nagendra Nagarajayya nnagaraja...@transaxtions.com Steven: There is an onclick handler that allows you to download the src. BTW, an early access Solr 3.5 with RankingAlgorithm 1.3 (NRT) release is available for download. So please give it a try. Regards, - Nagendra Nagarajayya http://solr-ra.tgels.org http://rankingalgorithm.tgels.org On 12/10/2011 11:18 PM, Steven Ou wrote: All the links on the download section link to http://solr-ra.tgels.org/# -- Steven Ou | 歐偉凡 *ravn.com* | Chief Technology Officer steve...@gmail.com | +1 909-569-9880 2011/12/11 Nagendra Nagarajayya nnagaraja...@transaxtions.com Steven: Not sure why you had problems, #downloads ( http://solr-ra.tgels.org/#downloads ) should point you to the downloads section showing the different versions available for download ? Please share if this is not so ( there were downloads yesterday with no problems ) Regarding NRT, you can switch between RA and Lucene at query level or at config level; in the current version with RA, NRT is in effect while with lucene, it is not, you can get more information from here: http://solr-ra.tgels.org/papers/Solr34_with_RankingAlgorithm13.pdf Solr 3.5 with RankingAlgorithm 1.3 should be available next week. Regards, - Nagendra Nagarajayya http://solr-ra.tgels.org http://rankingalgorithm.tgels.org On 12/9/2011 4:49 PM, Steven Ou wrote: Hey Nagendra, I took a look and Solr-RA looks promising - but: - I could not figure out how to download it. It seems like all the download links just point to # - I wasn't looking for another ranking algorithm, so would it be possible for me to use NRT but *not* RA (i.e. just use the normal Lucene library)? -- Steven Ou | 歐偉凡 *ravn.com* | Chief Technology Officer steve...@gmail.com | +1 909-569-9880 On Sat, Dec 10, 2011 at 5:13 AM, Nagendra Nagarajayya nnagaraja...@transaxtions.com wrote: Steven: Please take a look at Solr with RankingAlgorithm. It offers NRT functionality. You can set your autoCommit to about 15 mins. You can get more information from here: http://solr-ra.tgels.com/wiki/**en/Near_Real_Time_Search_ver_**3.x http://solr-ra.tgels.com/wiki/en/Near_Real_Time_Search_ver_3.x Regards, - Nagendra Nagarajayya http://solr-ra.tgels.org http://rankingalgorithm.tgels.**org http://rankingalgorithm.tgels.org On 12/8/2011 9:30 PM, Steven Ou wrote: Hi guys, I'm looking for NRT functionality or similar in Solr 3.5. Is that possible? From what I understand there's NRT in Solr 4, but I can't figure out whether or not 3.5 can do it as well? If not, is it feasible to use an autoCommit every 1000ms? We don't currently process *that* much data so I wonder if it's OK to just commit very often? Obviously not scalable on a large scale, but it is feasible for a relatively small amount of data? I recently upgraded from Solr 1.4 to 3.5. I had a hard time getting everything working smoothly and the process ended up taking my site down for a couple hours. I am very hesitant to upgrade to Solr 4 if it's not necessary to get some sort of NRT functionality. Can anyone help me? Thanks! -- Steven Ou | 歐偉凡 *ravn.com* | Chief Technology Officer steve...@gmail.com | +1 909-569-9880
