Re: Sort by payload field desc fails

2018-08-09 Thread Anurag Nilesh
I was seeing the issue with payload sort on SOLR 6.6.0 version. This issue
resolved when we started using 7.4.0 version.

On Tue, Jul 3, 2018 at 5:34 PM, Anurag Nilesh  wrote:

> Hi,
> I was trying out extracting the payload field value for a payload field
> type and then doing a sort based on that value.
>
> For some reason, the sort works with ascending order but fails with
> descending order.
>
> {
>   "responseHeader":{
> "status":500,
> "QTime":1,
> "params":{
>   "p":"payload(price_dpf, b)",
>   "q":"*:*",
>   "indent":"on",
>   "fl":"${p},item",
>   "sort":"${p} desc",
>   "rows":"10",
>   "wt":"json"}},
>   "error":{
> "msg":"-64",
> "trace":"java.lang.ArrayIndexOutOfBoundsException: -64\n\tat 
> org.apache.lucene.codecs.lucene50.ForUtil.readBlock(ForUtil.java:196)\n\tat 
> org.apache.lucene.codecs.lucene50.Lucene50PostingsReader$EverythingEnum.refillPositions(Lucene50PostingsReader.java:1024)\n\tat
>  
> org.apache.lucene.codecs.lucene50.Lucene50PostingsReader$EverythingEnum.nextPosition(Lucene50PostingsReader.java:1226)\n\tat
>  
> org.apache.solr.search.FloatPayloadValueSource$1.floatVal(FloatPayloadValueSource.java:163)\n\tat
>  
> org.apache.lucene.queries.function.docvalues.FloatDocValues.doubleVal(FloatDocValues.java:60)\n\tat
>  
> org.apache.lucene.queries.function.ValueSource$ValueSourceComparator.compareBottom(ValueSource.java:259)\n\tat
>  
> org.apache.lucene.search.TopFieldCollector$SimpleFieldCollector$1.collect(TopFieldCollector.java:117)\n\tat
>  
> org.apache.lucene.search.MatchAllDocsQuery$1$1.score(MatchAllDocsQuery.java:56)\n\tat
>  org.apache.lucene.search.BulkScorer.score(BulkScorer.java:39)\n\tat 
> org.apache.lucene.search.IndexSearcher.search(IndexSearcher.java:668)\n\tat 
> org.apache.lucene.search.IndexSearcher.search(IndexSearcher.java:472)\n\tat 
> org.apache.solr.search.SolrIndexSearcher.buildAndRunCollectorChain(SolrIndexSearcher.java:217)\n\tat
>  
> org.apache.solr.search.SolrIndexSearcher.getDocListNC(SolrIndexSearcher.java:1582)\n\tat
>  
> org.apache.solr.search.SolrIndexSearcher.getDocListC(SolrIndexSearcher.java:1399)\n\tat
>  
> org.apache.solr.search.SolrIndexSearcher.search(SolrIndexSearcher.java:566)\n\tat
>  
> org.apache.solr.handler.component.QueryComponent.process(QueryComponent.java:545)\n\tat
>  
> org.apache.solr.handler.component.SearchHandler.handleRequestBody(SearchHandler.java:296)\n\tat
>  
> org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:173)\n\tat
>  org.apache.solr.core.SolrCore.execute(SolrCore.java:2477)\n\tat 
> org.apache.solr.servlet.HttpSolrCall.execute(HttpSolrCall.java:723)\n\tat 
> org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:529)\n\tat 
> org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:361)\n\tat
>  
> org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:305)\n\tat
>  
> org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1691)\n\tat
>  
> org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:582)\n\tat
>  
> org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143)\n\tat
>  
> org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:548)\n\tat
>  
> org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:226)\n\tat
>  
> org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1180)\n\tat
>  
> org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:512)\n\tat
>  
> org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:185)\n\tat
>  
> org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1112)\n\tat
>  
> org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)\n\tat
>  
> org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:213)\n\tat
>  
> org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:119)\n\tat
>  
> org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:134)\n\tat
>  
> org.eclipse.jetty.rewrite.handler.RewriteHandler.handle(RewriteHandler.java:335)\n\tat
>  
> org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:134)\n\tat
>  org.eclipse.jetty.server.Server.handle(Server.java:534)\n\tat 
> org.eclipse.jetty.server.HttpChannel.handle(HttpChannel

Sort by payload field desc fails

2018-07-03 Thread Anurag Nilesh
readPool.runJob(QueuedThreadPool.java:671)\n\tat
org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:589)\n\tat
java.lang.Thread.run(Thread.java:748)\n",
"code":500}}


Do you guys have any pointers on how to resolve this?

Thanks,
Anurag


ant compile = not able to resolve dependencies

2015-01-10 Thread Anurag Sharma
Hi,

I am facing issue in resolving the dependency while doing 'ant compile' on
trunk, seeing following error:

[ivy:retrieve]  ::  UNRESOLVED DEPENDENCIES ::
[ivy:retrieve]  ::
[ivy:retrieve]  :: org.restlet.jee#org.restlet.ext.servlet;2.3.0:
configuration not found in org.restlet.jee#org.restlet.ext.servlet;2.3.0:
'master'. It was required from org.apache.solr#core;working@pc compile


Please suggest if anyone faced this issue.

Thanks
Anurag


Re: ant compile = not able to resolve dependencies

2015-01-10 Thread Anurag Sharma
Any directions to resolve it is also helpful.

On Sat, Jan 10, 2015 at 2:48 PM, Anurag Sharma anura...@gmail.com wrote:

 Hi,

 I am facing issue in resolving the dependency while doing 'ant compile' on
 trunk, seeing following error:

 [ivy:retrieve]  ::  UNRESOLVED DEPENDENCIES ::
 [ivy:retrieve]  ::
 [ivy:retrieve]  :: org.restlet.jee#org.restlet.ext.servlet;2.3.0:
 configuration not found in org.restlet.jee#org.restlet.ext.servlet;2.3.0:
 'master'. It was required from org.apache.solr#core;working@pc compile


 Please suggest if anyone faced this issue.

 Thanks
 Anurag



Re: Solr HTTP client authentication

2014-11-17 Thread Anurag Sharma
I think Solr encourage SSL than authentication

On Mon, Nov 17, 2014 at 6:08 PM, Bai Shen baishen.li...@gmail.com wrote:

 I am using solrj to connect to my solr server.  However I need to
 authenticate against the server and can not find out how to do so using
 solrj.  Is this possible or do I need to drop solrj?  I can manually create
 an httpclient and set up authentication but then I can't use solrj.

 Thanks.



Eclipse junit run issue after run in Cloud mode

2014-11-15 Thread Anurag Sharma
Am facing issue in running junit after 'svn up', junit works well without
any issue with a fresh trunk checkout. Only difference between fresh and
updated is that the earlier was once launched solr in cloud mode. There is
no issue in running through ant test  -Dtestcase.

Following are the log when running in the svn updated env. Does anyone
faced the same issue?

Eclipse console log:
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in
[jar:file:/C:/work/trunk/solr/core/lib/slf4j-log4j12-1.7.6.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in
[jar:file:/C:/work/trunk/solr/solrj/test-lib/slf4j-log4j12-1.7.6.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an
explanation.
SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory]
log4j:WARN No such property [conversionPattern] in
org.apache.solr.util.SolrLogLayout.
NOTE: test params are: codec=null, sim=null, locale=null, timezone=(null)
NOTE: Windows 8 6.2 amd64/Oracle Corporation 1.7.0_51
(64-bit)/cpus=4,threads=1,free=61030064,total=77594624
NOTE: All tests run in this JVM: [AtomicUpdatesTest]
NOTE: reproduce with: ant test  -Dtestcase=AtomicUpdatesTest
-Dtests.seed=7DDB6D72ED561A31 -Dtests.asserts=true
-Dtests.file.encoding=UTF-8

JUnit error in Eclipse
java.lang.VerifyError: class
org.apache.lucene.codecs.lucene40.Lucene40CompoundReader overrides final
method makeLock.(Ljava/lang/String;)Lorg/apache/lucene/store/Lock;
at java.lang.ClassLoader.defineClass1(Native Method)
at java.lang.ClassLoader.defineClass(Unknown Source)
at java.security.SecureClassLoader.defineClass(Unknown Source)
at java.net.URLClassLoader.defineClass(Unknown Source)
at java.net.URLClassLoader.access$100(Unknown Source)
at java.net.URLClassLoader$1.run(Unknown Source)
at java.net.URLClassLoader$1.run(Unknown Source)
at java.security.AccessController.doPrivileged(Native Method)
at java.net.URLClassLoader.findClass(Unknown Source)
at java.lang.ClassLoader.loadClass(Unknown Source)
at sun.misc.Launcher$AppClassLoader.loadClass(Unknown Source)
at java.lang.ClassLoader.loadClass(Unknown Source)
at
org.apache.lucene.codecs.lucene40.Lucene40Codec.init(Lucene40Codec.java:43)
at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
at sun.reflect.NativeConstructorAccessorImpl.newInstance(Unknown Source)
at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(Unknown Source)
at java.lang.reflect.Constructor.newInstance(Unknown Source)
at java.lang.Class.newInstance(Unknown Source)
at org.apache.lucene.util.NamedSPILoader.reload(NamedSPILoader.java:67)
at org.apache.lucene.util.NamedSPILoader.init(NamedSPILoader.java:47)
at org.apache.lucene.util.NamedSPILoader.init(NamedSPILoader.java:37)
at org.apache.lucene.codecs.Codec.clinit(Codec.java:42)
at
org.apache.lucene.util.TestRuleSetupAndRestoreClassEnv.before(TestRuleSetupAndRestoreClassEnv.java:152)
at
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at
org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at
com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at
org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
at
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at
org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
at java.lang.Thread.run(Unknown Source)

java.lang.NoClassDefFoundError: Could not initialize class
org.apache.lucene.codecs.Codec
at
org.apache.lucene.util.TestRuleSetupAndRestoreClassEnv.after(TestRuleSetupAndRestoreClassEnv.java:296)
at
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:52)
at
org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at
com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at

Re: solr IRC

2014-11-15 Thread Anurag Sharma
Thanks a lot Shawn for the detailed explanation. The wiki is also very
helpful. Any recommended client like pidgin, adium etc. especially for
windows.

On Sat, Nov 15, 2014 at 11:26 PM, Shawn Heisey apa...@elyograg.org wrote:

 On 11/14/2014 10:32 PM, Anurag Sharma wrote:
  Also like know, is this the only IRC or there are other's as well like
 solr
  dev, lucene dev  etc

 The freenode channels #solr and #solr-dev exist specifically for Solr.
 End users should keep their questions in #solr, because #solr-dev is for
 discussions around development of Solr itself.

 As a specific example:  Initial discussion of a possible bug should
 begin in #solr.  If you want to be part of the conversation for FIXING
 that bug, then #solr-dev would be appropriate.

 For the wider lucene ecosystem, there are #lucene and #lucene-dev, but
 Solr questions should only be asked there as a last resort, because it's
 off-topic for those channels and many residents probably don't know
 anything about Solr.

 It can take quite a while for someone to notice your question after you
 have asked it.  The person that notices your question first may not know
 the answer, though.

 I've created a wiki page about the IRC channels, and I've pinged our
 admin UI expert about using that wiki page as the landing point for the
 IRC Channel link in the Solr admin UI.

 https://wiki.apache.org/solr/IRCChannels

 Thanks,
 Shawn




Re: DIH Blob data

2014-11-14 Thread Anurag Sharma
bq: We routinely store images and pdfs in Solr. There *is* a benefit, since
you don't need to manage another storage system, you don't have to worry
about Solr getting out of sync with the other system, you can use Solr
replication for all your assets, etc.

Do the same holds good for large Blobs like image, audio, video as well?
Tika supports multiple file formats (http://tika.apache.org/1.5/formats.html)
but not sure how good is the Solr/Tika combination. Storing pdf and other
docs could be useful in Solr, tika can extract metadata from the docs and
make them discoverable.

Considering all the above cases there should also be a support for File
field type in Solr like other types Date, Float, Int, Long, String etc. but
looks like there are only two file types (
http://svn.apache.org/repos/asf/lucene/dev/trunk/solr/core/src/java/org/apache/solr/schema/)
and both re external file storage.

   - ExternalFileField.java
   
http://svn.apache.org/repos/asf/lucene/dev/trunk/solr/core/src/java/org/apache/solr/schema/ExternalFileField.java
   - ExternalFileFieldReloader.java
   
http://svn.apache.org/repos/asf/lucene/dev/trunk/solr/core/src/java/org/apache/solr/schema/ExternalFileFieldReloader.java

What type can be used in schema when storing the files internally?


On Thu, Nov 13, 2014 at 3:48 AM, Jeon Woosung jeonwoos...@gmail.com wrote:

 How about this?

 First, define a field for filter query. It should be multivalued.

 Second, implements transformer to extract json dynamic fields, and put the
 dynamic fields into the solr field.

 For example,

 fieldType name=terms class=string multivalued=true/

 Data : {a:1,b:2,c:3}

 You can split the data to a:1, b:2, c:3, and put them into terms.

 And then you can use filter query like fq=terms:a:1
 2014. 11. 13. 오전 3:59에 Michael Sokolov msoko...@safaribooksonline.com
 님이
 작성:

  We routinely store images and pdfs in Solr. There *is* a benefit, since
  you don't need to manage another storage system, you don't have to worry
  about Solr getting out of sync with the other system, you can use Solr
  replication for all your assets, etc.
 
  I don't use DIH, so personally I don't care whether it handles blobs, but
  it does seem like a natural extension for a system that indexes data from
  SQL in Solr.
 
  -Mike
 
 
  On 11/12/2014 01:31 PM, Anurag Sharma wrote:
 
  BLOB is non-searchable field so there is no benefit of storing it into
  Solr. Any external key-value store can be used to store the blob and
  reference of this blob can be stored as a string field in Solr.
 
  On Wed, Nov 12, 2014 at 5:56 PM, stockii stock.jo...@googlemail.com
  wrote:
 
   I had a similar problem and didnt find any solution to use the fields
 in
  JSON
  Blob for a filter ... Not with DIH.
 
 
 
  --
  View this message in context:
 
 http://lucene.472066.n3.nabble.com/DIH-Blob-data-tp4168896p4168925.html
  Sent from the Solr - User mailing list archive at Nabble.com.
 
 
 



Re: Restrict search to subset (a list of aprrox 40,000 ids from an external service) of corpus

2014-11-14 Thread Anurag Sharma
Is it possible to add another integer dyanmicField to the selected doc ids?
If yes, further can add update incremental/same values to these docs now
search can be done to this subset using range/filter query.

On Fri, Nov 14, 2014 at 10:21 PM, henry cleland hnoclel...@gmail.com
wrote:

 Hi guys,
 How do I search only a subset of my corpus based on a large list of non
 consecutive unique key ids (cannot do a range query).
 Is there a way around doing this  q=id:(id1 OR id2 OR id3 OR id4 ... OR
 id4 ) AND name:*

 Also what is the limit of ORs i can apply on the query if that is the
 only way out, i don't suppose it is infinity.
 Thanks



Re: DIH Blob data

2014-11-14 Thread Anurag Sharma
Thanks Michael  Eric for the succinct response.

On Sat, Nov 15, 2014 at 12:13 AM, Michael Sokolov 
msoko...@safaribooksonline.com wrote:

 There is a binary type

 -Mike

 On 11/14/2014 12:21 PM, Anurag Sharma wrote:

 bq: We routinely store images and pdfs in Solr. There *is* a benefit,
 since
 you don't need to manage another storage system, you don't have to worry
 about Solr getting out of sync with the other system, you can use Solr
 replication for all your assets, etc.

 Do the same holds good for large Blobs like image, audio, video as well?
 Tika supports multiple file formats (http://tika.apache.org/1.5/
 formats.html)
 but not sure how good is the Solr/Tika combination. Storing pdf and other
 docs could be useful in Solr, tika can extract metadata from the docs and
 make them discoverable.

 Considering all the above cases there should also be a support for File
 field type in Solr like other types Date, Float, Int, Long, String etc.
 but
 looks like there are only two file types (
 http://svn.apache.org/repos/asf/lucene/dev/trunk/solr/
 core/src/java/org/apache/solr/schema/)
 and both re external file storage.

 - ExternalFileField.java
 http://svn.apache.org/repos/asf/lucene/dev/trunk/solr/
 core/src/java/org/apache/solr/schema/ExternalFileField.java
 - ExternalFileFieldReloader.java
 http://svn.apache.org/repos/asf/lucene/dev/trunk/solr/
 core/src/java/org/apache/solr/schema/ExternalFileFieldReloader.java

 What type can be used in schema when storing the files internally?


 On Thu, Nov 13, 2014 at 3:48 AM, Jeon Woosung jeonwoos...@gmail.com
 wrote:

  How about this?

 First, define a field for filter query. It should be multivalued.

 Second, implements transformer to extract json dynamic fields, and put
 the
 dynamic fields into the solr field.

 For example,

 fieldType name=terms class=string multivalued=true/

 Data : {a:1,b:2,c:3}

 You can split the data to a:1, b:2, c:3, and put them into terms.

 And then you can use filter query like fq=terms:a:1
 2014. 11. 13. 오전 3:59에 Michael Sokolov msoko...@safaribooksonline.com

 님이

 작성:

  We routinely store images and pdfs in Solr. There *is* a benefit, since
 you don't need to manage another storage system, you don't have to worry
 about Solr getting out of sync with the other system, you can use Solr
 replication for all your assets, etc.

 I don't use DIH, so personally I don't care whether it handles blobs,
 but
 it does seem like a natural extension for a system that indexes data
 from
 SQL in Solr.

 -Mike


 On 11/12/2014 01:31 PM, Anurag Sharma wrote:

  BLOB is non-searchable field so there is no benefit of storing it into
 Solr. Any external key-value store can be used to store the blob and
 reference of this blob can be stored as a string field in Solr.

 On Wed, Nov 12, 2014 at 5:56 PM, stockii stock.jo...@googlemail.com
 wrote:

   I had a similar problem and didnt find any solution to use the fields

 in

 JSON
 Blob for a filter ... Not with DIH.



 --
 View this message in context:

  http://lucene.472066.n3.nabble.com/DIH-Blob-data-
 tp4168896p4168925.html

 Sent from the Solr - User mailing list archive at Nabble.com.






solr IRC

2014-11-14 Thread Anurag Sharma
Is this correct link to Solr IRC -
http://webchat.freenode.net/?channels=#solr
I tried couple of times using the IRC, the list of online users are always
good but never get any response on the query and also don't see any
communication/discussion.


Re: solr IRC

2014-11-14 Thread Anurag Sharma
I tried couple of weeks earlier as well. As suggested, will try again after
mid next week.

On Sat, Nov 15, 2014 at 10:53 AM, Alexandre Rafalovitch arafa...@gmail.com
wrote:

 If you tried this week it is because everybody was at the conference. Try
 again mid next week.

 Regards,
  Alex
 On 14/11/2014 11:35 pm, Anurag Sharma anura...@gmail.com wrote:

  Is this correct link to Solr IRC -
  http://webchat.freenode.net/?channels=#solr
  I tried couple of times using the IRC, the list of online users are
 always
  good but never get any response on the query and also don't see any
  communication/discussion.
 



Re: solr IRC

2014-11-14 Thread Anurag Sharma
Also like know, is this the only IRC or there are other's as well like solr
dev, lucene dev  etc

On Sat, Nov 15, 2014 at 10:59 AM, Anurag Sharma anura...@gmail.com wrote:

 I tried couple of weeks earlier as well. As suggested, will try again
 after mid next week.

 On Sat, Nov 15, 2014 at 10:53 AM, Alexandre Rafalovitch 
 arafa...@gmail.com wrote:

 If you tried this week it is because everybody was at the conference. Try
 again mid next week.

 Regards,
  Alex
 On 14/11/2014 11:35 pm, Anurag Sharma anura...@gmail.com wrote:

  Is this correct link to Solr IRC -
  http://webchat.freenode.net/?channels=#solr
  I tried couple of times using the IRC, the list of online users are
 always
  good but never get any response on the query and also don't see any
  communication/discussion.
 





Re: SOLRJ Atomic updates of String field

2014-11-12 Thread Anurag Sharma
I understood the query now.
Atomic Update and Optimistic Concurrency are independent in Solr version 
5.
Not sure about version 4.2, if they are combined in this version a
_version_ field is needed to pass in every update. The atomic/partial
update will succeed if version in the request and indexed doc matches
otherwise response will have HTTP error code 409.

You can try by passing the _version_ of indexed doc during update.

It's also good to add a unit test in Solr for partial update which
currently I see missing.

On Wed, Nov 12, 2014 at 1:00 PM, Ahmet Arslan iori...@yahoo.com.invalid
wrote:

 Hi Bbarani,

 Partial update solrJ example can be found in :
 http://find.searchhub.org/document/5b1187abfcfad33f

 Ahmet



 On Tuesday, November 11, 2014 8:51 PM, bbarani bbar...@gmail.com wrote:
 I am using the below code to do partial update (in SOLR 4.2)

 partialUpdate = new HashMapString, Object();
 partialUpdate.put(set,Object);
 doc.setField(description, partialUpdate);
 server.add(docs);
 server.commit();

 I am seeing the below description value with {set =...}, Any idea why this
 is getting added?

 str name=description
 {set=The iPhone 6 Plus features a 5.5-inch retina HD display, the A8 chip
 for faster processing and longer battery life, the M8 motion coprocessor to
 track speed, distance and elevation, and with an 8MP iSight camera, you can
 record 1080p HD Video at 60 FPS!}
 /str



 --
 View this message in context:
 http://lucene.472066.n3.nabble.com/SOLRJ-Atomic-updates-of-String-field-tp4168809.html
 Sent from the Solr - User mailing list archive at Nabble.com.




Re: DIH Blob data

2014-11-12 Thread Anurag Sharma
BLOB is non-searchable field so there is no benefit of storing it into
Solr. Any external key-value store can be used to store the blob and
reference of this blob can be stored as a string field in Solr.

On Wed, Nov 12, 2014 at 5:56 PM, stockii stock.jo...@googlemail.com wrote:

 I had a similar problem and didnt find any solution to use the fields in
 JSON
 Blob for a filter ... Not with DIH.



 --
 View this message in context:
 http://lucene.472066.n3.nabble.com/DIH-Blob-data-tp4168896p4168925.html
 Sent from the Solr - User mailing list archive at Nabble.com.



Re: Analytics result for each Result Group

2014-11-11 Thread Anurag Sharma
Probably sum and division can be applied to get the median.
If you are using ver above 5,
http://svn.apache.org/repos/asf/lucene/dev//trunk/solr/contrib/analytics/src/java/org/apache/solr/analytics/statistics/MedianStatsCollector.java
can be used directly

On Tue, Nov 11, 2014 at 5:49 PM, Talat Uyarer ta...@uyarer.com wrote:

 Hi Anurag,

 How can I find median function ? I use a lot that.

 2014-11-09 20:39 GMT+02:00 Anurag Sharma anura...@gmail.com:
  Can a function query(http://wiki.apache.org/solr/FunctionQuery) serves
 your
  use case
 
  On Wed, Nov 5, 2014 at 3:36 PM, Talat Uyarer ta...@uyarer.com wrote:
 
  I searched wiki pages about that. I do not find any documentation. If
  you help me I will be glad.
 
  Thanks
 
  2014-11-04 11:34 GMT+02:00 Talat Uyarer ta...@uyarer.com:
   Hi folks,
  
   We use Analytics Component for median, max etc. I wonder if I use
   group.field parameter with analytics component, How to calculate
   analytics for each result group ?
  
   Thanks
  
   --
   Talat UYARER
   Websitesi: http://talat.uyarer.com
   Twitter: http://twitter.com/talatuyarer
   Linkedin: http://tr.linkedin.com/pub/talat-uyarer/10/142/304
 
 
 
  --
  Talat UYARER
  Websitesi: http://talat.uyarer.com
  Twitter: http://twitter.com/talatuyarer
  Linkedin: http://tr.linkedin.com/pub/talat-uyarer/10/142/304
 



 --
 Talat UYARER
 Websitesi: http://talat.uyarer.com
 Twitter: http://twitter.com/talatuyarer
 Linkedin: http://tr.linkedin.com/pub/talat-uyarer/10/142/304



Re: SOLRJ Atomic updates of String field

2014-11-11 Thread Anurag Sharma
Sorry didn't get what you are trying to achieve and the issue.

On Wed, Nov 12, 2014 at 12:20 AM, bbarani bbar...@gmail.com wrote:

 I am using the below code to do partial update (in SOLR 4.2)

 partialUpdate = new HashMapString, Object();
 partialUpdate.put(set,Object);
 doc.setField(description, partialUpdate);
 server.add(docs);
 server.commit();

 I am seeing the below description value with {set =...}, Any idea why this
 is getting added?

 str name=description
 {set=The iPhone 6 Plus features a 5.5-inch retina HD display, the A8 chip
 for faster processing and longer battery life, the M8 motion coprocessor to
 track speed, distance and elevation, and with an 8MP iSight camera, you can
 record 1080p HD Video at 60 FPS!}
 /str



 --
 View this message in context:
 http://lucene.472066.n3.nabble.com/SOLRJ-Atomic-updates-of-String-field-tp4168809.html
 Sent from the Solr - User mailing list archive at Nabble.com.



Re: Best way to map holidays to corresponding date

2014-11-09 Thread Anurag Sharma
Not sure this is the correct way but can we use synonyms here

On Wed, Nov 5, 2014 at 6:14 PM, Jack Krupansky j...@basetechnology.com
wrote:

 Unfortunately, a date is a non-analyzed field, so you can't do something
 like a synonym.

 Further, Holidays are repeating - every year - and the dates can vary, so
 they won't match exactly.

 Use an update request processor to examine the date field at values index
 time and look up and store the holiday name in a text field so that you can
 do a query such as holiday:easter. It could be a string field, but they
 case would have to match exactly You could code this in a JavaScript script
 that has the logic or hard dates for various holidays using the stateless
 script update processor.

 -- Jack Krupansky

 -Original Message- From: Patrick Kirsch
 Sent: Wednesday, November 5, 2014 6:12 AM
 To: solr-user@lucene.apache.org
 Subject: Best way to map holidays to corresponding date


 Hey,
 maybe someone already faced the situation and could give me a hint.

 Given one query includes Easter or Sylvester I search for the best
 place to translate the string to the corresponding date.

 Is there any solr.Mapping*Factory for that?
 Do I need to implement it in a custom Solr Query Parser etc.?

 Regards,
 Patrick



Re: indexing errors when storeOffsetsWithPositions=true in solr 4.9.1

2014-11-09 Thread Anurag Sharma
Is it possible to share the sequence of steps with data causing this issue

On Wed, Nov 5, 2014 at 4:51 PM, Alan Woodward a...@flax.co.uk wrote:

 Hi Min,

 Do you have the specific bit of text that caused this exception to be
 thrown?

 Alan Woodward
 www.flax.co.uk


 On 4 Nov 2014, at 23:15, Min L wrote:

  Hi All:
 
  I am using solr 4.9.1. and trying to use PostingsSolrHighlighter. But I
 got
  errors during indexing. I thought LUCENE-5111 has fixed issues with
  WordDelimitedFilter. The error is as below:
 
  Caused by: java.lang.IllegalArgumentException: startOffset must be
  non-negative, and endOffset must be = startOffset, and offsets must
  not go backwards startOffset=31,endOffset=44,lastStartOffset=37 for
  field 'description_texts'
at
 org.apache.lucene.index.DefaultIndexingChain$PerField.invert(DefaultIndexingChain.java:630)
at
 org.apache.lucene.index.DefaultIndexingChain.processField(DefaultIndexingChain.java:342)
at
 org.apache.lucene.index.DefaultIndexingChain.processDocument(DefaultIndexingChain.java:301)
at
 org.apache.lucene.index.DocumentsWriterPerThread.updateDocument(DocumentsWriterPerThread.java:241)
at
 org.apache.lucene.index.DocumentsWriter.updateDocument(DocumentsWriter.java:451)
at
 org.apache.lucene.index.IndexWriter.updateDocument(IndexWriter.java:1539)
at
 org.apache.solr.update.DirectUpdateHandler2.addDoc0(DirectUpdateHandler2.java:240)
at
 org.apache.solr.update.DirectUpdateHandler2.addDoc(DirectUpdateHandler2.java:164)
 
 
  My schema.xml looks like below:
 
  dynamicField name=*_texts stored=true type=text multiValued=true
  indexed=true storeOffsetsWithPositions=true/
 
  fieldType name=text class=solr.TextField omitNorms=false
 
   analyzer type=index
 
 charFilter class=solr.HTMLStripCharFilterFactory/
 
 tokenizer class=solr.WhitespaceTokenizerFactory/
 
 filter class=solr.LowerCaseFilterFactory/
 
 filter class=solr.StemmerOverrideFilterFactory dictionary=
  stemdict_en.txt /
 
 filter class=solr.PatternReplaceFilterFactory pattern=
  ^(\p{Punct}*)(.*?)(\p{Punct}*)$ replacement=$2/
 
 filter class=solr.KStemFilterFactory/
 
 filter class=solr.StopFilterFactory
 words=stopwords_english.txt
  ignoreCase=true enablePositionIncrements=true /
 
 filter class=solr.WordDelimiterFilterFactory
 preserveOriginal=1
  splitOnNumerics=0 catenateWords=1 /
 
   /analyzer
 
   analyzer type=query
 
 tokenizer class=solr.WhitespaceTokenizerFactory/
 
 filter class=solr.LowerCaseFilterFactory/
 
 filter class=solr.StopFilterFactory
 words=stopwords_english.txt
  ignoreCase=true enablePositionIncrements=true /
 
 filter class=solr.WordDelimiterFilterFactory
 preserveOriginal=1
  splitOnNumerics=0 catenateWords=1 /
 
 filter class=solr.StemmerOverrideFilterFactory dictionary=
  stemdict_en.txt /
 
 filter class=solr.KStemFilterFactory/
 
   /analyzer
 
 /fieldType
 
 
  Any help is appreciated.
 
 
  Thanks.
 
  Min




Re: Analytics result for each Result Group

2014-11-09 Thread Anurag Sharma
Can a function query(http://wiki.apache.org/solr/FunctionQuery) serves your
use case

On Wed, Nov 5, 2014 at 3:36 PM, Talat Uyarer ta...@uyarer.com wrote:

 I searched wiki pages about that. I do not find any documentation. If
 you help me I will be glad.

 Thanks

 2014-11-04 11:34 GMT+02:00 Talat Uyarer ta...@uyarer.com:
  Hi folks,
 
  We use Analytics Component for median, max etc. I wonder if I use
  group.field parameter with analytics component, How to calculate
  analytics for each result group ?
 
  Thanks
 
  --
  Talat UYARER
  Websitesi: http://talat.uyarer.com
  Twitter: http://twitter.com/talatuyarer
  Linkedin: http://tr.linkedin.com/pub/talat-uyarer/10/142/304



 --
 Talat UYARER
 Websitesi: http://talat.uyarer.com
 Twitter: http://twitter.com/talatuyarer
 Linkedin: http://tr.linkedin.com/pub/talat-uyarer/10/142/304



Re: Solr exceptions during batch indexing

2014-11-08 Thread Anurag Sharma
Just trying to understand what's the challenge in returning the bad doc
id(s)?
Solr already know which doc(s) failed on update and can return their id(s)
in response or callback. Can we have JIRA ticket on it if it doesn't exist?

This looks like a common use case and every solr consumer might be writing
their own versions to handle this issue.

On Sat, Nov 8, 2014 at 1:17 AM, Walter Underwood wun...@wunderwood.org
wrote:

 Right, that is why we batch.

 When a batch of 1000 fails, drop to a batch size of 1 and start the batch
 over. Then it can report the exact document with problems.

 If you want to continue, go back to the bigger batch size. I usually fail
 the whole batch on one error.

 wunder
 Walter Underwood
 wun...@wunderwood.org
 http://observer.wunderwood.org/


 On Nov 7, 2014, at 11:44 AM, Peter Keegan peterlkee...@gmail.com wrote:

  I'm seeing 9X throughput with 1000 docs/batch vs 1 doc/batch, with a
 single
  thread, so it's certainly worth it.
 
  Thanks,
  Peter
 
 
  On Fri, Nov 7, 2014 at 2:18 PM, Erick Erickson erickerick...@gmail.com
  wrote:
 
  And Walter has also been around for a _long_ time ;)
 
  (sorry, couldn't resist)
 
  Erick
 
  On Fri, Nov 7, 2014 at 11:12 AM, Walter Underwood 
 wun...@wunderwood.org
  wrote:
  Yes, I implemented exactly that fallback for Solr 1.2 at Netflix.
 
  It isn’t to hard if the code is structured for it; retry with a batch
  size of 1.
 
  wunder
 
  On Nov 7, 2014, at 11:01 AM, Erick Erickson erickerick...@gmail.com
  wrote:
 
  Yeah, this has been an ongoing issue for a _long_ time. Basically,
  you can't. So far, people have essentially written fallback logic to
  index the docs of a failing packet one at a time and report it.
 
  I'd really like better reporting back, but we haven't gotten there
 yet.
 
  Best,
  Erick
 
  On Fri, Nov 7, 2014 at 8:25 AM, Peter Keegan peterlkee...@gmail.com
  wrote:
  How are folks handling Solr exceptions that occur during batch
  indexing?
  Solr stops parsing the docs stream when an error occurs (e.g. a doc
  with a
  missing mandatory field), and stops indexing the batch. The bad
  document is
  not identified, so it would be hard for the client to recover by
  skipping
  over it.
 
  Peter
 
 




Re: Synonymn for Numbers

2014-11-08 Thread Anurag Sharma
If you are searching for single document can a real time get on doc id
mentioned below serve your use case?
http://localhost:8983/solr/get?id=mydoc

Real time get for multiple docs:
http://localhost:8983/solr/get?id=mydocid=mydoc

On Sat, Nov 8, 2014 at 12:52 AM, EXTERNAL Taminidi Ravi (ETI,
Automotive-Service-Solutions) external.ravi.tamin...@us.bosch.com wrote:

 Hi Group,

 I am working on implementing synonym for number like
 10,2010
 14,2014

 2 digit number to get documents with four digit, I added the above lines
 in synonym and everything works. But now I have to get for one direction,

 I tried 10=2010 but it is still gets the record belongs to 10 , if I
 search 2010. I want to get only 2010 documents if I search 2010 not 10. I
 have expand=true in the synonym filter.

 filter class=solr.SynonymFilterFactory synonyms=synonyms.txt
 ignoreCase=true expand=true/


 If any help really appreciated.

 Thanks

 Ravi



Re: Delete data from stored documents

2014-11-08 Thread Anurag Sharma
Since the data already existing and need is to remove unwanted fields using
a custom update processor looks less useful here. Erick's
recommendation on re-indexing
into a new collection if at all possible looks simple and safe.



On Sat, Nov 8, 2014 at 12:44 AM, Erick Erickson erickerick...@gmail.com
wrote:

 bq: My question is if I can delete the field definition from the
 schema.xml and do an optimize and the fields “magically” disappears

 no. schema.xml is really just about regularizing how Lucene indexes
 things. Lucene (where this would have to take place) doesn't have any
 understanding of schema.xml, so changing it then optimizing (and
 optimizing is also a Lucene function) won't have any effect.

 If you
 1 change the schema
 and
 2 update documents
 the data will be purged as background merges happen.

 But really, I'd recommend re-indexing into a new collection if at all
 possible.


 Best,
 Erick

 On Fri, Nov 7, 2014 at 4:26 AM, Yago Riveiro yago.rive...@gmail.com
 wrote:
  Jack,
 
 
 
 
  I have some data indexed that I don’t need any more. My question is if I
 can delete the field definition from the schema.xml and do an optimize and
 the fields “magically” disappears (and free space from disk).
 
 
 
 
  Re-index data to delete fields is to expensive in collections with
 hundreds of millions of documents.
 
 
 
 
  Optimize operation seems to be a good place to shrink to documents ...
 
 
 
  —
  /Yago Riveiro
 
  On Fri, Nov 7, 2014 at 12:19 PM, Jack Krupansky j...@basetechnology.com
 
  wrote:
 
  Could you clarify exactly what you are trying to do, like with an
 example? I
  mean, how exactly are you determining what fields are unwanted? Are
 you
  simply asking whether fields can be deleted from the index (and schema)?
  -- Jack Krupansky
  -Original Message-
  From: yriveiro
  Sent: Thursday, November 6, 2014 9:19 AM
  To: solr-user@lucene.apache.org
  Subject: Delete data from stored documents
  Hi,
  It's possible remove store data of an index deleting the unwanted fields
  from schema.xml and after do an optimize over the index?
  Thanks,
  /yago
  -
  Best regards
  --
  View this message in context:
 
 http://lucene.472066.n3.nabble.com/Delete-data-from-stored-documents-tp4167990.html
  Sent from the Solr - User mailing list archive at Nabble.com.



Re: How to dynamically create Solr cores with schema

2014-11-08 Thread Anurag Sharma
For more advanced dynamic fields refer dynamicField elements convention
patterns for fields from the below schema.xml
http://svn.apache.org/repos/asf/lucene/dev/trunk/solr/server/solr/configsets/basic_configs/conf/schema.xml

solr create core api can be referred to create a core dynamically. e.g.
curl 
http://localhost:8080/solr/admin/cores?action=CREATEname=$nameinstanceDir=/etc/solr/conf/$name



On Fri, Nov 7, 2014 at 10:29 PM, Alexandre Rafalovitch arafa...@gmail.com
wrote:

 The usual solution to that is to have dynamic fields with suffixes
 indicating the types. So, your int fields are mapped to *_i, your date
 fields to *_d.

 Solr has schemaless support, but it is auto-detect for now. Creating
 fields of particular types via API I think is in JIRA on the trunk for
 5.0.

 Regards,
Alex.
 Personal: http://www.outerthoughts.com/ and @arafalov
 Solr resources and newsletter: http://www.solr-start.com/ and @solrstart
 Solr popularizers community: https://www.linkedin.com/groups?gid=6713853


 On 6 November 2014 10:04, Andreas Hubold andreas.hub...@coremedia.com
 wrote:
  Hi,
 
  I have a use-case where Java applications need to create Solr indexes
  dynamically. Schema fields of these indexes differ and should be defined
 by
  the Java application upon creation.
 
  So I'm trying to use the Core Admin API [1] to create new cores and the
  Schema API [2] to define fields. When creating a core, I have to specify
  solrconfig.xml (with enabled ManagedIndexSchemaFactory) and the schema to
  start with. I thought it would be a good idea to use a named config sets
 [3]
  for this purpose:
 
  curl
  '
 http://localhost:8082/solr/admin/cores?action=CREATEname=m1instanceDir=cores/m1configSet=myconfigdataDir=data
 '
 
  But when I add a field to the core m1, the field actually gets added to
  the config set. Is this a bug of feature?
 
  curl http://localhost:8082/solr/m1/schema/fields -X POST -H
  'Content-type:application/json'
--data-binary '[{
  name:foo,
  type:tdate,
  stored:true
  }]'
 
  All cores created from the config set myconfig will get the new field
  foo in their schema. So this obviously does not work to create cores
 with
  different schema.
 
  I also tried to use the config/schema parameters of the CREATE core
 command
  (instead of config sets) to specify some existing
 solrconfig.xml/schema.xml.
  I tried relative paths here (e.g. some level upwards) but I could not
 get it
  to work. The documentation [1] tells me that relative paths are allowed.
  Should this work?
 
  Next thing that would come to my mind is to use dynamic fields instead
 of a
  correct managed schema, but that does not sound as nice.
  Or maybe I should implement a custom CoreAdminHandler which takes list of
  field definitions, if that's possible somehow...?
 
  I don't know. What's your recommended approach?
 
  We're using Solr 4.10.1 non-SolrCloud. Would this be simpler or different
  with SolrCloud?
 
  Thank you,
  Andreas
 
  [1]
 
 https://cwiki.apache.org/confluence/display/solr/CoreAdmin+API#CoreAdminAPI-CREATE
  [2]
 
 https://cwiki.apache.org/confluence/display/solr/Schema+API#SchemaAPI-Modifytheschema
  [3] https://cwiki.apache.org/confluence/display/solr/Config+Sets



Re: Sort documents by exist(multivalued field)

2014-11-08 Thread Anurag Sharma
Is it possible to describe the exact use case here.

On Fri, Nov 7, 2014 at 10:26 PM, Alexandre Rafalovitch arafa...@gmail.com
wrote:

 You encode that knowledge by using UpdateRequestProcessor. Clone the
 field, replace it with true, map it to boolean. That way, you will pay
 the price once per document indexed not (documentCount*) times per
 request.

 Regards,
   Alex.
 Personal: http://www.outerthoughts.com/ and @arafalov
 Solr resources and newsletter: http://www.solr-start.com/ and @solrstart
 Solr popularizers community: https://www.linkedin.com/groups?gid=6713853


 On 7 November 2014 06:43, Nickolay41189 klin892...@yandex.ru wrote:
  I want to sort by multivalued field like boolean values.
  Something like that:
  *sort exist(multivalued field name) desc*
 
  Is it possible?
 
  P.S. I know that sorting doesn't work for multivalued fields, but it work
  for single boolean field...
 
 
 
  --
  View this message in context:
 http://lucene.472066.n3.nabble.com/Sort-documents-by-exist-multivalued-field-tp4168141.html
  Sent from the Solr - User mailing list archive at Nabble.com.



Re: Minimum Term Matching in More Like This Queries

2014-11-08 Thread Anurag Sharma
There is no direct way of retrieving doc based on minimum term match in
Solr. mlm params 'mlt.mintf' and 'mlt.match.offset' can be explored if they
meets the criteria. Refer below links for more details:
http://wiki.apache.org/solr/MoreLikeThisHandler
https://wiki.apache.org/solr/MoreLikeThis

In case you are using lucene library directly,setPercentTermsToMatch()
function can be used from MoreLikeThisQuery class.
Refer code:
https://svn.apache.org/repos/asf/lucene/dev/trunk/lucene/queries/src/java/org/apache/lucene/queries/mlt/MoreLikeThisQuery.java

On Fri, Nov 7, 2014 at 9:45 PM, Tim Hearn timseman...@gmail.com wrote:

 Hi!

 I'm fairly new to Solr.  Is there a feature which enforces minimum term
 matching for MLT Queries?  More precisely, that is, a document will match
 the MLT query if and only if at least x terms in the query are found in the
 document, with x defined by the user.  I could not find such a feature in
 the documentation, and switching to the edismax query parser and using the
 'mm' parameter does not work for me.

 Thanks!



Re: Term count in multivalue fields

2014-11-08 Thread Anurag Sharma
Since 'omitTermFremFreqAndPositions' is enabled what does a function query
'totaltermfreq(field,term)' return?

Another way, not sure this is the correct approach, while indexing add a
field containing the number. Filter and sum(function query) on the field
while querying. Range query can also be done on this field.

On Fri, Nov 7, 2014 at 7:23 PM, Nickolay41189 klin892...@yandex.ru wrote:

 Andrey, thank you for reply. Can you explain what do you mean faceting
 query
 with prefix? I'm newer in the wolrd of Solr, can you give me example of
 this query?



 --
 View this message in context:
 http://lucene.472066.n3.nabble.com/Term-count-in-multivalue-fields-tp4168138p4168167.html
 Sent from the Solr - User mailing list archive at Nabble.com.



Re: Sort documents by first value in multivalued field

2014-11-08 Thread Anurag Sharma
What is 'first value' here, any example?

On Fri, Nov 7, 2014 at 5:04 PM, Nickolay41189 klin892...@yandex.ru wrote:

 How can I sort documents by first value in multivalued field? (without
 adding
 copyField and without some changes in schema.xml)?



 --
 View this message in context:
 http://lucene.472066.n3.nabble.com/Sort-documents-by-first-value-in-multivalued-field-tp4168140.html
 Sent from the Solr - User mailing list archive at Nabble.com.



issue in launching SolrCloud windows/cygwin

2014-10-19 Thread Anurag Sharma
Here is the issue am facing issue in using the 'solr' script on Windows
with cygwin terminal:

$ bin/solr -e cloud
bin/solr: line 16: $'\r': command not found
bin/solr: line 17: $'\r': command not found
bin/solr: line 46: $'\r': command not found
which: no lsof in
(/usr/local/bin:/usr/bin:/cygdrive/c/Windows/system32:/cygdrive/c/Windows:/cygdrive/c/Windows/System32/Wbem:/cygdrive/c/Windows/System32/WindowsPowerShell/v1.0:/cygdrive/c/Program
Files/TortoiseSVN/bin:/cygdrive/c/Program
Files/Java/jdk1.7.0_51/bin:/cygdrive/c/Program
Files/apache-ant-1.9.3/bin:/cygdrive/c/Program Files
(x86)/Python-27:/cygdrive/c/Program Files (x86)/Python-27/Scripts)
bin/solr: line 52: $'\r': command not found
bin/solr: line 87: syntax error near unexpected token `$HOME/.solr.in.sh'
'in/solr: line 87: `   $HOME/.solr.in.sh \


further
$ bin/solr start -cloud -d node1 -p 8983
bin/solr: line 16: $'\r': command not found
bin/solr: line 17: $'\r': command not found
bin/solr: line 46: $'\r': command not found
which: no lsof in
(/usr/local/bin:/usr/bin:/cygdrive/c/Windows/system32:/cygdrive/c/Windows:/cygdrive/c/Windows/System32/Wbem:/cygdrive/c/Windows/System32/WindowsPowerShell/v1.0:/cygdrive/c/Program
Files/TortoiseSVN/bin:/cygdrive/c/Program
Files/Java/jdk1.7.0_51/bin:/cygdrive/c/Program
Files/apache-ant-1.9.3/bin:/cygdrive/c/Program Files
(x86)/Python-27:/cygdrive/c/Program Files (x86)/Python-27/Scripts)
bin/solr: line 52: $'\r': command not found
bin/solr: line 87: syntax error near unexpected token `$HOME/.solr.in.sh'
'in/solr: line 87: `   $HOME/.solr.in.sh \

Is there any other way I can run the SolrCloud using java -jar start.jar
options?


Re: issue in launching SolrCloud windows/cygwin

2014-10-19 Thread Anurag Sharma
Hello Jurgen,

Thanks a lot for yoru prompt response.

It solved the CRLF problem but the script is not supported on cygwin due to
severe limitations and lack of adherence to BASH standards, such as lack of
lsof, curl, and ps options.

I found there is a native solr.cmd script for windows which works without
any issue on windows shell. This solves the problem for now.

Regards,
Anurag



On Sun, Oct 19, 2014 at 12:39 PM, Jürgen Wagner (DVT) 
juergen.wag...@devoteam.com wrote:

  Hello Anurag,
   the CRLF problem with Cygwin can be cured by running the scripts all
 through this filter:

 tr -d '\r'  $script  $script.new ; mv $script.new $script

 with $script holding the path of the script to be massaged.

 Generally, however, I would advise to use the standard scripts only for
 testing or demonstration purposes as you're very likely to have to change
 parameters or settings for your production environment, anyway. Using the
 latest Jetty is one such example.

 Best regards,
 --Jürgen


 On 19.10.2014 08:51, Anurag Sharma wrote:

 Here is the issue am facing issue in using the 'solr' script on Windows
 with cygwin terminal:

 $ bin/solr -e cloud
 bin/solr: line 16: $'\r': command not found
 bin/solr: line 17: $'\r': command not found
 bin/solr: line 46: $'\r': command not found
 which: no lsof in
 (/usr/local/bin:/usr/bin:/cygdrive/c/Windows/system32:/cygdrive/c/Windows:/cygdrive/c/Windows/System32/Wbem:/cygdrive/c/Windows/System32/WindowsPowerShell/v1.0:/cygdrive/c/Program
 Files/TortoiseSVN/bin:/cygdrive/c/Program
 Files/Java/jdk1.7.0_51/bin:/cygdrive/c/Program
 Files/apache-ant-1.9.3/bin:/cygdrive/c/Program Files
 (x86)/Python-27:/cygdrive/c/Program Files (x86)/Python-27/Scripts)
 bin/solr: line 52: $'\r': command not found
 bin/solr: line 87: syntax error near unexpected token `$HOME/.solr.in.sh'
 'in/solr: line 87: `   $HOME/.solr.in.sh \


 further
 $ bin/solr start -cloud -d node1 -p 8983
 bin/solr: line 16: $'\r': command not found
 bin/solr: line 17: $'\r': command not found
 bin/solr: line 46: $'\r': command not found
 which: no lsof in
 (/usr/local/bin:/usr/bin:/cygdrive/c/Windows/system32:/cygdrive/c/Windows:/cygdrive/c/Windows/System32/Wbem:/cygdrive/c/Windows/System32/WindowsPowerShell/v1.0:/cygdrive/c/Program
 Files/TortoiseSVN/bin:/cygdrive/c/Program
 Files/Java/jdk1.7.0_51/bin:/cygdrive/c/Program
 Files/apache-ant-1.9.3/bin:/cygdrive/c/Program Files
 (x86)/Python-27:/cygdrive/c/Program Files (x86)/Python-27/Scripts)
 bin/solr: line 52: $'\r': command not found
 bin/solr: line 87: syntax error near unexpected token `$HOME/.solr.in.sh'
 'in/solr: line 87: `   $HOME/.solr.in.sh \

 Is there any other way I can run the SolrCloud using java -jar start.jar
 options?




 --

 Mit freundlichen Grüßen/Kind regards/Cordialement vôtre/Atentamente/С
 уважением
 *i.A. Jürgen Wagner*
 Head of Competence Center Intelligence
  Senior Cloud Consultant

 Devoteam GmbH, Industriestr. 3, 70565 Stuttgart, Germany
 Phone: +49 6151 868-8725, Fax: +49 711 13353-53, Mobile: +49 171 864 1543
 E-Mail: juergen.wag...@devoteam.com, URL: www.devoteam.de
 --
 Managing Board: Jürgen Hatzipantelis (CEO)
 Address of Record: 64331 Weiterstadt, Germany; Commercial Register:
 Amtsgericht Darmstadt HRB 6450; Tax Number: DE 172 993 071





Re: issue in launching SolrCloud windows/cygwin

2014-10-19 Thread Anurag Sharma
Hi Nazik,

Thanks for the response. The link mentioned by you is very useful.  I used
the windows cmd and started the cloud using solr.cmd script. The script is
very rich in taking multiple options.

Anurag

On Sun, Oct 19, 2014 at 5:01 PM, Nazik Huq nazik...@gmail.com wrote:

 Run Solr straight from the Windows cmd if CygWin isn't a requirement. For
 example, running java -jar start.jar from the example directory will
 start single instance Solr.

 To run SolrCloud follow the instructions in Simple Two-Shard Cluster on
 the Same Machine from this link http://bit.ly/1rlmYvF .

 @nazik_huq

 On Sun, Oct 19, 2014 at 2:51 AM, Anurag Sharma anura...@gmail.com wrote:

  Here is the issue am facing issue in using the 'solr' script on Windows
  with cygwin terminal:
 
  $ bin/solr -e cloud
  bin/solr: line 16: $'\r': command not found
  bin/solr: line 17: $'\r': command not found
  bin/solr: line 46: $'\r': command not found
  which: no lsof in
 
 
 (/usr/local/bin:/usr/bin:/cygdrive/c/Windows/system32:/cygdrive/c/Windows:/cygdrive/c/Windows/System32/Wbem:/cygdrive/c/Windows/System32/WindowsPowerShell/v1.0:/cygdrive/c/Program
  Files/TortoiseSVN/bin:/cygdrive/c/Program
  Files/Java/jdk1.7.0_51/bin:/cygdrive/c/Program
  Files/apache-ant-1.9.3/bin:/cygdrive/c/Program Files
  (x86)/Python-27:/cygdrive/c/Program Files (x86)/Python-27/Scripts)
  bin/solr: line 52: $'\r': command not found
  bin/solr: line 87: syntax error near unexpected token `$HOME/.
 solr.in.sh
  '
  'in/solr: line 87: `   $HOME/.solr.in.sh \
 
 
  further
  $ bin/solr start -cloud -d node1 -p 8983
  bin/solr: line 16: $'\r': command not found
  bin/solr: line 17: $'\r': command not found
  bin/solr: line 46: $'\r': command not found
  which: no lsof in
 
 
 (/usr/local/bin:/usr/bin:/cygdrive/c/Windows/system32:/cygdrive/c/Windows:/cygdrive/c/Windows/System32/Wbem:/cygdrive/c/Windows/System32/WindowsPowerShell/v1.0:/cygdrive/c/Program
  Files/TortoiseSVN/bin:/cygdrive/c/Program
  Files/Java/jdk1.7.0_51/bin:/cygdrive/c/Program
  Files/apache-ant-1.9.3/bin:/cygdrive/c/Program Files
  (x86)/Python-27:/cygdrive/c/Program Files (x86)/Python-27/Scripts)
  bin/solr: line 52: $'\r': command not found
  bin/solr: line 87: syntax error near unexpected token `$HOME/.
 solr.in.sh
  '
  'in/solr: line 87: `   $HOME/.solr.in.sh \
 
  Is there any other way I can run the SolrCloud using java -jar
 start.jar
  options?
 



Re: import solr source to eclipse

2014-10-14 Thread Anurag Sharma
Another alternative is launch the jetty server from outside and attach it
remotely from eclipse.

java -Xdebug -Xrunjdwp:transport=dt_socket,server=y,suspend=y,address=7666
-jar start.jar
The above command waits until the application attach succeed.


On Tue, Oct 14, 2014 at 12:56 PM, Rajani Maski rajinima...@gmail.com
wrote:

 Configure eclipse with Jetty plugin. Create a Solr folder under your
 Solr-Java-Project and Run the project [Run as] on Jetty Server.

 This blog[1] may help you to configure Solr within eclipse.


 [1]
 http://hokiesuns.blogspot.in/2010/01/setting-up-apache-solr-in-eclipse.html

 On Tue, Oct 14, 2014 at 12:06 PM, Ali Nazemian alinazem...@gmail.com
 wrote:

  Thank you very much for your guides but how can I run solr server inside
  eclipse?
  Best regards.
 
  On Mon, Oct 13, 2014 at 8:02 PM, Rajani Maski rajinima...@gmail.com
  wrote:
 
   Hi,
  
   The best tutorial for setting up Solr[solr 4.7] in eclipse/intellij  is
   documented in Solr In Action book, Apendix A, *Working with the Solr
   codebase*
  
  
   On Mon, Oct 13, 2014 at 6:45 AM, Tomás Fernández Löbbe 
   tomasflo...@gmail.com wrote:
  
The way I do this:
From a terminal:
svn checkout https://svn.apache.org/repos/asf/lucene/dev/trunk/
lucene-solr-trunk
cd lucene-solr-trunk
ant eclipse
   
... And then, from your Eclipse import existing java project, and
   select
the directory where you placed lucene-solr-trunk
   
On Sun, Oct 12, 2014 at 7:09 AM, Ali Nazemian alinazem...@gmail.com
 
wrote:
   
 Hi,
 I am going to import solr source code to eclipse for some
 development
 purpose. Unfortunately every tutorial that I found for this purpose
  is
 outdated and did not work. So would you please give me some hint
  about
how
 can I import solr source code to eclipse?
 Thank you very much.

 --
 A.Nazemian

   
  
 
 
 
  --
  A.Nazemian
 



solr trunk update.. build issues

2014-10-14 Thread Anurag Sharma
Just wanted to check if anyone faced below issues and how they fixed:

Solr launch issue
---
From command line ant compile, ant dist gives BUILD SUCCESSFUL
generating \solr\dist\solr-6.0.0-SNAPSHOT.war. After copying and renaming
the same file to example/start.jar on run shows below error
$ java –jar start.jar
Error: Could not find or load main class ▒jar

Problems with eclipse project
---
Also shows below problems in eclipse project:
Description Resource Path Location Type
Project 'trunk' is missing required library:
'solr/example/solr-webapp/webapp/WEB-INF/lib/protobuf-java-2.5.0.jar'
trunk Build
path Build Path Problem
Project 'trunk' is missing required library:
'solr/example/solr-webapp/webapp/WEB-INF/lib/solr-core-5.0.0-SNAPSHOT.jar'
trunk Build path Build Path Problem
Project 'trunk' is missing required library:
'solr/example/solr-webapp/webapp/WEB-INF/lib/org.restlet.ext.servlet-2.1.1.jar'
trunk Build path Build Path Problem
Project 'trunk' is missing required library:
'solr/example/solr-webapp/webapp/WEB-INF/lib/org.restlet-2.1.1.jar' trunk Build
path Build Path Problem
Project 'trunk' is missing required library:
'solr/example/solr-webapp/webapp/WEB-INF/lib/wstx-asl-3.2.7.jar' trunk Build
path Build Path Problem
Project 'trunk' is missing required library:
'solr/example/solr-webapp/webapp/WEB-INF/lib/zookeeper-3.4.6.jar' trunk Build
path Build Path Problem
Project 'trunk' is missing required library:
'solr/example/solr-webapp/webapp/WEB-INF/lib/solr-solrj-5.0.0-SNAPSHOT.jar'
trunk Build path Build Path Problem
Project 'trunk' is missing required library:
'solr/example/solr-webapp/webapp/WEB-INF/lib/spatial4j-0.4.1.jar' trunk Build
path Build Path Problem
The project cannot be built until build path errors are resolved trunk
Unknown Java Problem
Project 'trunk' is missing required library:
'solr/example/solr-webapp/webapp/WEB-INF/lib/lucene-analyzers-phonetic-5.0.0-SNAPSHOT.jar'
trunk Build path Build Path Problem
Project 'trunk' is missing required library:
'solr/example/solr-webapp/webapp/WEB-INF/lib/lucene-analyzers-kuromoji-5.0.0-SNAPSHOT.jar'
trunk Build path Build Path Problem
Project 'trunk' is missing required library:
'solr/example/solr-webapp/webapp/WEB-INF/lib/lucene-codecs-5.0.0-SNAPSHOT.jar'
trunk Build path Build Path Problem
Project 'trunk' is missing required library:
'solr/example/solr-webapp/webapp/WEB-INF/lib/lucene-backward-codecs-5.0.0-SNAPSHOT.jar'
trunk Build path Build Path Problem
Project 'trunk' is missing required library:
'solr/example/solr-webapp/webapp/WEB-INF/lib/lucene-expressions-5.0.0-SNAPSHOT.jar'
trunk Build path Build Path Problem
Project 'trunk' is missing required library:
'solr/example/solr-webapp/webapp/WEB-INF/lib/lucene-core-5.0.0-SNAPSHOT.jar'
trunk Build path Build Path Problem
Project 'trunk' is missing required library:
'solr/example/solr-webapp/webapp/WEB-INF/lib/lucene-highlighter-5.0.0-SNAPSHOT.jar'
trunk Build path Build Path Problem
Project 'trunk' is missing required library:
'solr/example/solr-webapp/webapp/WEB-INF/lib/lucene-grouping-5.0.0-SNAPSHOT.jar'
trunk Build path Build Path Problem
Project 'trunk' is missing required library:
'solr/example/solr-webapp/webapp/WEB-INF/lib/lucene-memory-5.0.0-SNAPSHOT.jar'
trunk Build path Build Path Problem
Project 'trunk' is missing required library:
'solr/example/solr-webapp/webapp/WEB-INF/lib/lucene-join-5.0.0-SNAPSHOT.jar'
trunk Build path Build Path Problem
Project 'trunk' is missing required library:
'solr/example/solr-webapp/webapp/WEB-INF/lib/lucene-queries-5.0.0-SNAPSHOT.jar'
trunk Build path Build Path Problem
Project 'trunk' is missing required library:
'solr/example/solr-webapp/webapp/WEB-INF/lib/lucene-misc-5.0.0-SNAPSHOT.jar'
trunk Build path Build Path Problem
Project 'trunk' is missing required library:
'solr/example/solr-webapp/webapp/WEB-INF/lib/lucene-spatial-5.0.0-SNAPSHOT.jar'
trunk Build path Build Path Problem
Project 'trunk' is missing required library:
'solr/example/solr-webapp/webapp/WEB-INF/lib/lucene-queryparser-5.0.0-SNAPSHOT.jar'
trunk Build path Build Path Problem
Project 'trunk' is missing required library:
'solr/example/solr-webapp/webapp/WEB-INF/lib/noggit-0.6.jar' trunk Build
path Build Path Problem
Project 'trunk' is missing required library:
'solr/example/solr-webapp/webapp/WEB-INF/lib/lucene-suggest-5.0.0-SNAPSHOT.jar'
trunk Build path Build Path Problem
Project 'trunk' is missing required library:
'solr/example/solr-webapp/webapp/WEB-INF/lib/commons-fileupload-1.2.1.jar'
trunk Build path Build Path Problem
Project 'trunk' is missing required library:
'solr/example/solr-webapp/webapp/WEB-INF/lib/commons-io-2.3.jar' trunk Build
path Build Path Problem
Project 'trunk' is missing required library:
'solr/example/solr-webapp/webapp/WEB-INF/lib/commons-lang-2.6.jar' trunk Build
path Build Path Problem
Project 'trunk' is missing required library:

Re: solr trunk update.. build issues

2014-10-14 Thread Anurag Sharma
Hi Shalin,

Sorry about the typo, actually it's renaming the war file(
\solr\dist\solr-6.0.0-SNAPSHOT.war) placed to
\trunk\solr\example\webapps\solr.war as referred in last point of step7 in
http://wiki.apache.org/solr/HowToCompileSolr
I'll also refer and try
https://cwiki.apache.org/confluence/display/solr/Running+Solr

Regarding problem#2, on running ant eclipse at /trunk (top level
directory for lucene  solr) and closing/opening the project removes all
the problems in the project but eclipse is not able to show the modified
file though it still exist. I need to explore more to find the root cause.

Thanks for the quick response.
Anurag


On Wed, Oct 15, 2014 at 12:51 AM, Shalin Shekhar Mangar 
shalinman...@gmail.com wrote:

 On Wed, Oct 15, 2014 at 12:38 AM, Anurag Sharma anura...@gmail.com
 wrote:

  Just wanted to check if anyone faced below issues and how they fixed:
 
  Solr launch issue
  ---
  From command line ant compile, ant dist gives BUILD SUCCESSFUL
  generating \solr\dist\solr-6.0.0-SNAPSHOT.war. After copying and renaming
  the same file to example/start.jar on run shows below error
  $ java –jar start.jar
  Error: Could not find or load main class ▒jar
 
 
 The start.jar contains the jetty bootstrap code. It is different from the
 war file and you shouldn't rename it to start.jar. You can use ant
 example from inside the solr directory to create a runnable example. You
 can also run ant example followed by the using the bin scripts to start
 Solr. See https://cwiki.apache.org/confluence/display/solr/Running+Solr


  Problems with eclipse project
  ---
  Also shows below problems in eclipse project:
  Description Resource Path Location Type
  Project 'trunk' is missing required library:
  'solr/example/solr-webapp/webapp/WEB-INF/lib/protobuf-java-2.5.0.jar'
  trunk Build
  path Build Path Problem
  Project 'trunk' is missing required library:
 
 'solr/example/solr-webapp/webapp/WEB-INF/lib/solr-core-5.0.0-SNAPSHOT.jar'
  trunk Build path Build Path Problem
  Project 'trunk' is missing required library:
 
 
 'solr/example/solr-webapp/webapp/WEB-INF/lib/org.restlet.ext.servlet-2.1.1.jar'
  trunk Build path Build Path Problem
  Project 'trunk' is missing required library:
  'solr/example/solr-webapp/webapp/WEB-INF/lib/org.restlet-2.1.1.jar' trunk
  Build
  path Build Path Problem
  Project 'trunk' is missing required library:
  'solr/example/solr-webapp/webapp/WEB-INF/lib/wstx-asl-3.2.7.jar' trunk
  Build
  path Build Path Problem
  Project 'trunk' is missing required library:
  'solr/example/solr-webapp/webapp/WEB-INF/lib/zookeeper-3.4.6.jar' trunk
  Build
  path Build Path Problem
  Project 'trunk' is missing required library:
 
 'solr/example/solr-webapp/webapp/WEB-INF/lib/solr-solrj-5.0.0-SNAPSHOT.jar'
  trunk Build path Build Path Problem
  Project 'trunk' is missing required library:
  'solr/example/solr-webapp/webapp/WEB-INF/lib/spatial4j-0.4.1.jar' trunk
  Build
  path Build Path Problem
  The project cannot be built until build path errors are resolved trunk
  Unknown Java Problem
  Project 'trunk' is missing required library:
 
 
 'solr/example/solr-webapp/webapp/WEB-INF/lib/lucene-analyzers-phonetic-5.0.0-SNAPSHOT.jar'
  trunk Build path Build Path Problem
  Project 'trunk' is missing required library:
 
 
 'solr/example/solr-webapp/webapp/WEB-INF/lib/lucene-analyzers-kuromoji-5.0.0-SNAPSHOT.jar'
  trunk Build path Build Path Problem
  Project 'trunk' is missing required library:
 
 
 'solr/example/solr-webapp/webapp/WEB-INF/lib/lucene-codecs-5.0.0-SNAPSHOT.jar'
  trunk Build path Build Path Problem
  Project 'trunk' is missing required library:
 
 
 'solr/example/solr-webapp/webapp/WEB-INF/lib/lucene-backward-codecs-5.0.0-SNAPSHOT.jar'
  trunk Build path Build Path Problem
  Project 'trunk' is missing required library:
 
 
 'solr/example/solr-webapp/webapp/WEB-INF/lib/lucene-expressions-5.0.0-SNAPSHOT.jar'
  trunk Build path Build Path Problem
  Project 'trunk' is missing required library:
 
 
 'solr/example/solr-webapp/webapp/WEB-INF/lib/lucene-core-5.0.0-SNAPSHOT.jar'
  trunk Build path Build Path Problem
  Project 'trunk' is missing required library:
 
 
 'solr/example/solr-webapp/webapp/WEB-INF/lib/lucene-highlighter-5.0.0-SNAPSHOT.jar'
  trunk Build path Build Path Problem
  Project 'trunk' is missing required library:
 
 
 'solr/example/solr-webapp/webapp/WEB-INF/lib/lucene-grouping-5.0.0-SNAPSHOT.jar'
  trunk Build path Build Path Problem
  Project 'trunk' is missing required library:
 
 
 'solr/example/solr-webapp/webapp/WEB-INF/lib/lucene-memory-5.0.0-SNAPSHOT.jar'
  trunk Build path Build Path Problem
  Project 'trunk' is missing required library:
 
 
 'solr/example/solr-webapp/webapp/WEB-INF/lib/lucene-join-5.0.0-SNAPSHOT.jar'
  trunk Build path Build Path Problem
  Project 'trunk' is missing required library:
 
 
 'solr/example/solr-webapp/webapp/WEB-INF/lib/lucene-queries-5.0.0-SNAPSHOT.jar'
  trunk Build path

Re: solr trunk update.. build issues

2014-10-14 Thread Anurag Sharma
I am able to launch solr example start.jar using: java –jar start.jar

The eclipse issue is also resolved now, looks like eclipse was taking time
to process all the files and was an intermittent issue. Now am able to run
the selected JUnits as well.

On Wed, Oct 15, 2014 at 1:06 AM, Anurag Sharma anura...@gmail.com wrote:

 Hi Shalin,

 Sorry about the typo, actually it's renaming the war file(
 \solr\dist\solr-6.0.0-SNAPSHOT.war) placed to
 \trunk\solr\example\webapps\solr.war as referred in last point of step7 in
 http://wiki.apache.org/solr/HowToCompileSolr
 I'll also refer and try
 https://cwiki.apache.org/confluence/display/solr/Running+Solr

 Regarding problem#2, on running ant eclipse at /trunk (top level
 directory for lucene  solr) and closing/opening the project removes all
 the problems in the project but eclipse is not able to show the modified
 file though it still exist. I need to explore more to find the root cause.

 Thanks for the quick response.
 Anurag


 On Wed, Oct 15, 2014 at 12:51 AM, Shalin Shekhar Mangar 
 shalinman...@gmail.com wrote:

 On Wed, Oct 15, 2014 at 12:38 AM, Anurag Sharma anura...@gmail.com
 wrote:

  Just wanted to check if anyone faced below issues and how they fixed:
 
  Solr launch issue
  ---
  From command line ant compile, ant dist gives BUILD SUCCESSFUL
  generating \solr\dist\solr-6.0.0-SNAPSHOT.war. After copying and
 renaming
  the same file to example/start.jar on run shows below error
  $ java –jar start.jar
  Error: Could not find or load main class ▒jar
 
 
 The start.jar contains the jetty bootstrap code. It is different from the
 war file and you shouldn't rename it to start.jar. You can use ant
 example from inside the solr directory to create a runnable example. You
 can also run ant example followed by the using the bin scripts to start
 Solr. See https://cwiki.apache.org/confluence/display/solr/Running+Solr


  Problems with eclipse project
  ---
  Also shows below problems in eclipse project:
  Description Resource Path Location Type
  Project 'trunk' is missing required library:
  'solr/example/solr-webapp/webapp/WEB-INF/lib/protobuf-java-2.5.0.jar'
  trunk Build
  path Build Path Problem
  Project 'trunk' is missing required library:
 
 'solr/example/solr-webapp/webapp/WEB-INF/lib/solr-core-5.0.0-SNAPSHOT.jar'
  trunk Build path Build Path Problem
  Project 'trunk' is missing required library:
 
 
 'solr/example/solr-webapp/webapp/WEB-INF/lib/org.restlet.ext.servlet-2.1.1.jar'
  trunk Build path Build Path Problem
  Project 'trunk' is missing required library:
  'solr/example/solr-webapp/webapp/WEB-INF/lib/org.restlet-2.1.1.jar'
 trunk
  Build
  path Build Path Problem
  Project 'trunk' is missing required library:
  'solr/example/solr-webapp/webapp/WEB-INF/lib/wstx-asl-3.2.7.jar' trunk
  Build
  path Build Path Problem
  Project 'trunk' is missing required library:
  'solr/example/solr-webapp/webapp/WEB-INF/lib/zookeeper-3.4.6.jar' trunk
  Build
  path Build Path Problem
  Project 'trunk' is missing required library:
 
 'solr/example/solr-webapp/webapp/WEB-INF/lib/solr-solrj-5.0.0-SNAPSHOT.jar'
  trunk Build path Build Path Problem
  Project 'trunk' is missing required library:
  'solr/example/solr-webapp/webapp/WEB-INF/lib/spatial4j-0.4.1.jar' trunk
  Build
  path Build Path Problem
  The project cannot be built until build path errors are resolved trunk
  Unknown Java Problem
  Project 'trunk' is missing required library:
 
 
 'solr/example/solr-webapp/webapp/WEB-INF/lib/lucene-analyzers-phonetic-5.0.0-SNAPSHOT.jar'
  trunk Build path Build Path Problem
  Project 'trunk' is missing required library:
 
 
 'solr/example/solr-webapp/webapp/WEB-INF/lib/lucene-analyzers-kuromoji-5.0.0-SNAPSHOT.jar'
  trunk Build path Build Path Problem
  Project 'trunk' is missing required library:
 
 
 'solr/example/solr-webapp/webapp/WEB-INF/lib/lucene-codecs-5.0.0-SNAPSHOT.jar'
  trunk Build path Build Path Problem
  Project 'trunk' is missing required library:
 
 
 'solr/example/solr-webapp/webapp/WEB-INF/lib/lucene-backward-codecs-5.0.0-SNAPSHOT.jar'
  trunk Build path Build Path Problem
  Project 'trunk' is missing required library:
 
 
 'solr/example/solr-webapp/webapp/WEB-INF/lib/lucene-expressions-5.0.0-SNAPSHOT.jar'
  trunk Build path Build Path Problem
  Project 'trunk' is missing required library:
 
 
 'solr/example/solr-webapp/webapp/WEB-INF/lib/lucene-core-5.0.0-SNAPSHOT.jar'
  trunk Build path Build Path Problem
  Project 'trunk' is missing required library:
 
 
 'solr/example/solr-webapp/webapp/WEB-INF/lib/lucene-highlighter-5.0.0-SNAPSHOT.jar'
  trunk Build path Build Path Problem
  Project 'trunk' is missing required library:
 
 
 'solr/example/solr-webapp/webapp/WEB-INF/lib/lucene-grouping-5.0.0-SNAPSHOT.jar'
  trunk Build path Build Path Problem
  Project 'trunk' is missing required library:
 
 
 'solr/example/solr-webapp/webapp/WEB-INF/lib/lucene-memory-5.0.0-SNAPSHOT.jar'
  trunk Build

Re: Using relative path for indexing in SOLR

2014-10-13 Thread Anurag Sharma
You can always give the relative path from your current working directory
like below:
~/solr/example/exampledocs$ java -jar post.jar ./../sourcepdf/*.pdf

This solves your issue?

On Mon, Oct 13, 2014 at 3:58 PM, bharath Raghavendran bharat...@gmail.com
wrote:

 Hi ,

 I am currently using solr-4.9.0 to index my PDF's using the default
 post.jar , start.jar provided in the examples directory.

 However i would like to modify the indexed path from absolute location to
 relative path from the base folder.

 Example :

 Absolute Path : E:\myFolder\level1\level11\myfile.PDF

 Relative Path : level11/myfile.PDF

 Let me know if this is possible to implement.

 Thanks,
 Bharath



Re: import solr source to eclipse

2014-10-12 Thread Anurag Sharma
I recently tried to run eclipse in debug mode and followed
http://wiki.apache.org/solr/HowToConfigureEclipse. It worked for me.


On Sun, Oct 12, 2014 at 7:39 PM, Ali Nazemian alinazem...@gmail.com wrote:

 Hi,
 I am going to import solr source code to eclipse for some development
 purpose. Unfortunately every tutorial that I found for this purpose is
 outdated and did not work. So would you please give me some hint about how
 can I import solr source code to eclipse?
 Thank you very much.

 --
 A.Nazemian



Re: [ANN] Lucidworks Fusion 1.0.0

2014-10-06 Thread Anurag Sharma
Ok. Thanks for the clarification.

On Mon, Oct 6, 2014 at 12:54 AM, Garth Grimm 
garthgr...@averyranchconsulting.com wrote:

 Well, the current release is only supported on Linux.  A Windows
 compatible release is planned for later this year.

 -Original Message-
 From: Anurag Sharma [mailto:anura...@gmail.com]
 Sent: Sunday, October 05, 2014 12:23 PM
 To: solr-user@lucene.apache.org
 Subject: Re: [ANN] Lucidworks Fusion 1.0.0

 I downloaded fusion and tried to run it on windows 8 using cygwin. It's
 giving Error: Unable to access jarfile
 /home/user1/fusion/jetty/home/start.jar. Also tried changing the
 permission of jar, .sh and all folder/subfolders in fusion to 777 but still
 getting the same error.

 Please share your experience if tried running fusion on windows 8 or
 facing the above issue on other port.

 Thanks
 Anurag

 On Mon, Sep 29, 2014 at 6:05 AM, Aman Tandon amantandon...@gmail.com
 wrote:

  Hi,
 
  How we can see the demo for NLP?
  On Sep 24, 2014 4:43 PM, Grant Ingersoll gsing...@apache.org wrote:
 
   Hi Thomas,
  
   Thanks for the question, yes, I give a brief demo of it in action
   during my talk and we will have demos at our booth.  I will also
   give a demo during the Webinar, which will be recorded.  As others
   have said as well, you can simply download it and try yourself.
  
   Cheers,
   Grant
  
   On Sep 23, 2014, at 2:00 AM, Thomas Egense thomas.ege...@gmail.com
   wrote:
  
Hi Grant.
Will there be a Fusion demostration/presentation  at Lucene/Solr
   Revolution
DC? (Not listed in the program yet).
   
   
Thomas Egense
   
On Mon, Sep 22, 2014 at 3:45 PM, Grant Ingersoll
gsing...@apache.org
wrote:
   
Hi All,
   
We at Lucidworks are pleased to announce the release of
Lucidworks
   Fusion
1.0.   Fusion is built to overlay on top of Solr (in fact, you can
   manage
multiple Solr clusters -- think QA, staging and production -- all
from
   our
Admin).In other words, if you already have Solr, simply point
   Fusion at
your instance and get all kinds of goodies like Banana (
https://github.com/LucidWorks/Banana -- our port of Kibana to
Solr +
  a
number of extensions that Kibana doesn't have), collaborative
  filtering
style recommendations (without the need for Hadoop or Mahout!), a
  modern
signal capture framework, analytics, NLP integration,
  Boosting/Blocking
   and
other relevance tools, flexible index and query time pipelines as
well
   as a
myriad of connectors ranging from Twitter to web crawling to
  Sharepoint.
The best part of all this?  It all leverages the infrastructure
that
  you
know and love: Solr.  Want recommendations?  Deploy more Solr.
Want
  log
analytics?  Deploy more Solr.  Want to track important system
 metrics?
Deploy more Solr.
   
Fusion represents our commitment as a company to continue to
  contribute
   a
large quantity of enhancements to the core of Solr while
complementing
   and
extending those capabilities with value adds that integrate a
number
  of
   3rd
party (e.g connectors) and home grown capabilities like an all
new, responsive UI built in AngularJS.  Fusion is not a fork of
Solr.  We
  do
   not
hide Solr in any way.  In fact, our goal is that your existing
   applications
will work out of the box with Fusion, allowing you to take
advantage
  of
   new
capabilities w/o overhauling your existing application.
   
If you want to learn more, please feel free to join our technical
   webinar
on October 2:
   http://lucidworks.com/blog/say-hello-to-lucidworks-fusion/.
If you'd like to download: http://lucidworks.com/product/fusion/.
   
Cheers,
Grant Ingersoll
   

Grant Ingersoll | CTO
gr...@lucidworks.com | @gsingers
http://www.lucidworks.com
   
   
  
   
   Grant Ingersoll | @gsingers
   http://www.lucidworks.com
  
  
  
  
  
  
 



Re: [ANN] Lucidworks Fusion 1.0.0

2014-10-05 Thread Anurag Sharma
I downloaded fusion and tried to run it on windows 8 using cygwin. It's
giving Error: Unable to access jarfile
/home/user1/fusion/jetty/home/start.jar. Also tried changing the
permission of jar, .sh and all folder/subfolders in fusion to 777 but still
getting the same error.

Please share your experience if tried running fusion on windows 8 or facing
the above issue on other port.

Thanks
Anurag

On Mon, Sep 29, 2014 at 6:05 AM, Aman Tandon amantandon...@gmail.com
wrote:

 Hi,

 How we can see the demo for NLP?
 On Sep 24, 2014 4:43 PM, Grant Ingersoll gsing...@apache.org wrote:

  Hi Thomas,
 
  Thanks for the question, yes, I give a brief demo of it in action during
  my talk and we will have demos at our booth.  I will also give a demo
  during the Webinar, which will be recorded.  As others have said as well,
  you can simply download it and try yourself.
 
  Cheers,
  Grant
 
  On Sep 23, 2014, at 2:00 AM, Thomas Egense thomas.ege...@gmail.com
  wrote:
 
   Hi Grant.
   Will there be a Fusion demostration/presentation  at Lucene/Solr
  Revolution
   DC? (Not listed in the program yet).
  
  
   Thomas Egense
  
   On Mon, Sep 22, 2014 at 3:45 PM, Grant Ingersoll gsing...@apache.org
   wrote:
  
   Hi All,
  
   We at Lucidworks are pleased to announce the release of Lucidworks
  Fusion
   1.0.   Fusion is built to overlay on top of Solr (in fact, you can
  manage
   multiple Solr clusters -- think QA, staging and production -- all from
  our
   Admin).In other words, if you already have Solr, simply point
  Fusion at
   your instance and get all kinds of goodies like Banana (
   https://github.com/LucidWorks/Banana -- our port of Kibana to Solr +
 a
   number of extensions that Kibana doesn't have), collaborative
 filtering
   style recommendations (without the need for Hadoop or Mahout!), a
 modern
   signal capture framework, analytics, NLP integration,
 Boosting/Blocking
  and
   other relevance tools, flexible index and query time pipelines as well
  as a
   myriad of connectors ranging from Twitter to web crawling to
 Sharepoint.
   The best part of all this?  It all leverages the infrastructure that
 you
   know and love: Solr.  Want recommendations?  Deploy more Solr.  Want
 log
   analytics?  Deploy more Solr.  Want to track important system metrics?
   Deploy more Solr.
  
   Fusion represents our commitment as a company to continue to
 contribute
  a
   large quantity of enhancements to the core of Solr while complementing
  and
   extending those capabilities with value adds that integrate a number
 of
  3rd
   party (e.g connectors) and home grown capabilities like an all new,
   responsive UI built in AngularJS.  Fusion is not a fork of Solr.  We
 do
  not
   hide Solr in any way.  In fact, our goal is that your existing
  applications
   will work out of the box with Fusion, allowing you to take advantage
 of
  new
   capabilities w/o overhauling your existing application.
  
   If you want to learn more, please feel free to join our technical
  webinar
   on October 2:
  http://lucidworks.com/blog/say-hello-to-lucidworks-fusion/.
   If you'd like to download: http://lucidworks.com/product/fusion/.
  
   Cheers,
   Grant Ingersoll
  
   
   Grant Ingersoll | CTO
   gr...@lucidworks.com | @gsingers
   http://www.lucidworks.com
  
  
 
  
  Grant Ingersoll | @gsingers
  http://www.lucidworks.com
 
 
 
 
 
 



applicability of schema on document

2014-09-27 Thread Anurag Sharma
I am trying to understand how the schema and it's field types gets applied
to a document. Is it based on a document Id e.g. how to specify solr to
store fields like age as integer, dateofbirth as date but not as a string
or vice versa. Also, is it possible to change the field type at runtime?

Direct update using below command adds the values even when the id doesn't
exist:
curl http://localhost:8983/solr/update\?commit\=true -H
'Content-type:application/json' -d '[{dob: {add:
[2014-02-12T12:00:00Z, 2014-07-16T12:00:00Z]}, id: }]'
My doubts in the above scenario are:

   - Is it taking some default types based on parsed values?
   - Is it also possible to store multiple types in a single field?
   - What are the rules for schema less doc

Above scenario is tried using solr.war in example/webapps Following are
multiple schema files in example directory
./example/example-DIH/solr/db/conf/schema.xml
./example/example-DIH/solr/mail/conf/schema.xml
./example/example-DIH/solr/rss/conf/schema.xml
./example/example-DIH/solr/solr/conf/schema.xml
./example/example-DIH/solr/tika/conf/schema.xml
./example/example-schemaless/solr/collection1/conf/schema.xml
./example/multicore/core0/conf/schema.xml
./example/multicore/core1/conf/schema.xml
./example/solr/collection1/conf/schema.xml


Any documentation or unit tests describing the flow, creating and using the
schema will be helpful.

Thanks
Anurag


demo app explaining solr features

2014-09-27 Thread Anurag Sharma
I am wondering if there is any demo app that can demonstrate all the
features/capabilities of solr. My intention is to understand, use and play
around all the features supported by solr.

Also looking to explore how solr fits with NLP (like open-nlp), different
datastores (like cassandra, mongodb, arangoDB, couchDB), ML engines(mahout,
prediction.io etc) and caching servers (redis, memcache).

Thanks
Anurag


Re: running solr in debug through eclipse

2014-09-21 Thread Anurag Sharma
Hi All,

Thanks a lot for your suggestions. Shalin, your direction quickly took me
to the issue, it was very insightful and helpful.
Finally am able to understand the issue I was working on and run particular
unit test class AtomicUpdatesTest around it.

On running the Solr in debug mode, I am still not able to start solr in
debug mode using:
java -Xdebug -Xrunjdwp:transport=dt_socket,server=y,suspend=y,address=7666
-jar start.jar
(Ref: http://wiki.apache.org/solr/HowToConfigureEclipse)
The command wait for hours and the server never comes up on windows without
giving any error/info message.

Please suggest if someone faced this issue. I tried restarting windows,
ensured no process running on 7666 port. In previous trials to start, I
used to get msg Debugger failed to attach: handshake failed - received
GET /solr/ HTT - expect but it stopped coming now.

Thanks
Anurag




On Fri, Sep 19, 2014 at 8:21 PM, Erick Erickson erickerick...@gmail.com
wrote:

 Yeah, it's usually pretty daunting to know where to start, the
 codebase is kinda big. Even start from junit test is often daunting,
 there are a lot of them too.

 Others have given you good places to start, good luck!

 Erick

 On Fri, Sep 19, 2014 at 12:23 AM, Bernd Fehling
 bernd.fehl...@uni-bielefeld.de wrote:
  Just start at the UpdateHandler and follow it down the line.
 
  I would start at org/apache/solr/update/UpdateHandler.java
 
  If you already know if it is add, delete or update then start with
  AddUpdateCommand.java, DeleteUpdateCommand.java or UpdateCommand.java.
 
  Just follow the red line :-)
 
  Regards
  Bernd
 
 
  Am 19.09.2014 um 08:47 schrieb Anurag Sharma:
  Thanks Bernd for your insight.
  As of now, I am focussing to fix the issue in the updater but not able
 to
  localize which code to look in for it.
 
  Regards,
  Anurag
 
  On Fri, Sep 19, 2014 at 12:09 PM, Bernd Fehling 
  bernd.fehl...@uni-bielefeld.de wrote:
 
  It depends on what you are going to do.
 
  If you are adding/modifying code and Junit tests use Junit test cases.
  If you are debugging runtime problems under load use remote debugging.
  If you are going for in deep debugging (even into Jetty and Java) use
  RunJettyRun for Eclipse.
 
  Regards
  Bernd
 
 
  Am 18.09.2014 um 20:50 schrieb Anurag Sharma:
  Dear Solr users,
 
  I am new to Solr dev community and trying to setup eclipse to debug a
  running solr server. Please suggest if anyone of you have tried doing
 the
  same.
 
  Once above is done. Also suggest the entry point in code where
 breakpoint
  can be placed.
 
  Thanks
  Anurag
 
 
 
 



Re: running solr in debug through eclipse

2014-09-19 Thread Anurag Sharma
Thanks Bernd for your insight.
As of now, I am focussing to fix the issue in the updater but not able to
localize which code to look in for it.

Regards,
Anurag

On Fri, Sep 19, 2014 at 12:09 PM, Bernd Fehling 
bernd.fehl...@uni-bielefeld.de wrote:

 It depends on what you are going to do.

 If you are adding/modifying code and Junit tests use Junit test cases.
 If you are debugging runtime problems under load use remote debugging.
 If you are going for in deep debugging (even into Jetty and Java) use
 RunJettyRun for Eclipse.

 Regards
 Bernd


 Am 18.09.2014 um 20:50 schrieb Anurag Sharma:
  Dear Solr users,
 
  I am new to Solr dev community and trying to setup eclipse to debug a
  running solr server. Please suggest if anyone of you have tried doing the
  same.
 
  Once above is done. Also suggest the entry point in code where breakpoint
  can be placed.
 
  Thanks
  Anurag
 




running solr in debug through eclipse

2014-09-18 Thread Anurag Sharma
Dear Solr users,

I am new to Solr dev community and trying to setup eclipse to debug a
running solr server. Please suggest if anyone of you have tried doing the
same.

Once above is done. Also suggest the entry point in code where breakpoint
can be placed.

Thanks
Anurag


Re: running solr in debug through eclipse

2014-09-18 Thread Anurag Sharma
Hi Erick,

Thanks a lot for your response.

I am trying to fix the issue:
https://issues.apache.org/jira/browse/SOLR-6307. I guess this require
change in the 'update' component. Am not able to locate the code for
'update' component nor the testcases.

To understand the code base I think I may need to go through both the #1 
#2 approaches.

Regards,
Anurag


On Fri, Sep 19, 2014 at 8:38 AM, Erick Erickson erickerick...@gmail.com
wrote:

 There are two approaches that work:
 1 (preferred IMO) is to debug through the Junit test cases. It's far
 easier than remote debugging usually, with quicker turnaround times.

 2 Set up remote debugging, see:
 http://wiki.apache.org/solr/HowToConfigureEclipse which is linked from
 the how to contribute page here:
 http://wiki.apache.org/solr/HowToContribute#Eclipse

 As to where to set your first breakpoint, I have no clue. You haven't
 told us a thing about what you're trying to accomplish, so somewhere
 in the code is about the best I can say ;).

 Best
 Erick

 On Thu, Sep 18, 2014 at 11:50 AM, Anurag Sharma anura...@gmail.com
 wrote:
  Dear Solr users,
 
  I am new to Solr dev community and trying to setup eclipse to debug a
  running solr server. Please suggest if anyone of you have tried doing the
  same.
 
  Once above is done. Also suggest the entry point in code where breakpoint
  can be placed.
 
  Thanks
  Anurag



Solr-Distributed search

2014-06-05 Thread Anurag Verma
Hi,
Can you please help me solr distribued search in multicore? i would
be very happy as i am stuck here.

In java code how do i implement distributed search?
-- 
Thanks  Regards
Anurag Verma


Solr Composite Unique key from existing fields in schema

2014-02-07 Thread Anurag Verma
Hi,
 I am developing a search application using SOLR. I don't have primary
key in any table. Composite key is being used in my application. How do i
implement composite key as unique key in this case. please help. i am
struggling.

-- 
Thanks  Regards
Anurag Verma
Arise! Awake! And stop not till the goal is reached!


How Whatsapp applies search techniques for conversation?

2013-12-02 Thread Anurag
I was just wondering how Whatsapp uses to implement search in the
conversations history.

Is it the same thing used for all kinds of android app supporting search on
chat/conversations?

Has anyone implemented on similar lines?


Thanks
Kumar Anurag



-
Kumar Anurag

--
View this message in context: 
http://lucene.472066.n3.nabble.com/How-Whatsapp-applies-search-techniques-for-conversation-tp4104366.html
Sent from the Solr - User mailing list archive at Nabble.com.


Solr returns the document conatining the links of the required document as top result?

2011-05-17 Thread Anurag
I have integrated solr and nutch.That is , crawling has been performed by
nutch and indexed to solr. I have been using this solr server for querying
for a long time. But some day back , i observed a strange thing. 

Rather than giving the asked or best fitted document as top result , it
shows the document containing the links of the required(best) document as
the top search result.
For example

Query=Jamia History in my local index of this domain(http://www.jmi.ac.in)
results obtained were
Top-http://www.jmi.ac.in/abouttheuniversity.htm
Lower-http://www.jmi.ac.in/HistoryofJamia.htm

The output should have been reverse because the link
http://www.jmi.ac.in/HistoryofJamia.htm is the actual document containig the
history of Jamia. And the link http://www.jmi.ac.in/abouttheuniversity.htm
just contains the link for the above mentioned documents.

I am not able to find as to why this is happening?

Please suggest some clue..

Thanks

-
Kumar Anurag

--
View this message in context: 
http://lucene.472066.n3.nabble.com/Solr-returns-the-document-conatining-the-links-of-the-required-document-as-top-result-tp2954340p2954340.html
Sent from the Solr - User mailing list archive at Nabble.com.


search by url in Solr?

2011-05-10 Thread Anurag
Hello everyone,
My Query
q=google.com
should give the ouput as
http://www.googe.com
In my search engine when i put q=google.com, it does not give the above
output, rather it shows no result.
but putting
q=url:google.com gives the correct output as http://www.google.com
Now my question how can i make this feature deafult. That's is when user
queries as google.com he gets the ouput as www.google.com , Also i want to
maintain Normal search features for the content search. That is , i dont
want to loose the existing features normal terms or say content search.

Please guide me


-
Kumar Anurag

--
View this message in context: 
http://lucene.472066.n3.nabble.com/search-by-url-in-Solr-tp2924632p2924632.html
Sent from the Solr - User mailing list archive at Nabble.com.


Re: search by url in Solr?

2011-05-10 Thread Anurag
thanks! , it worked.
Can i mention
 defaultSearchFieldurl,content/
defaultSearchField
to inlcude two default fields.?

On Wed, May 11, 2011 at 3:02 AM, Rakudten [via Lucene] 
ml-node+2924686-576776982-146...@n3.nabble.com wrote:

 Hello.

 One option is to specify a default search field in your schema.xml. If your

 query doesn´t include an specific field the query parser will use the
 default one to launch the query. You should include in your schema.xml
 something like this:


 !-- field for the QueryParser to use when an explicit fieldname is
 absent --

  defaultSearchFieldurl/defaultSearchField


 --
  If you reply to this email, your message will be added to the discussion
 below:

 http://lucene.472066.n3.nabble.com/search-by-url-in-Solr-tp2924632p2924686.html
  To unsubscribe from search by url in Solr?, click 
 herehttp://lucene.472066.n3.nabble.com/template/NamlServlet.jtp?macro=unsubscribe_by_codenode=2924632code=YW51cmFnLml0LmpvbGx5QGdtYWlsLmNvbXwyOTI0NjMyfC0yMDk4MzQ0MTk2.





-- 
Kumar Anurag


-
Kumar Anurag

--
View this message in context: 
http://lucene.472066.n3.nabble.com/search-by-url-in-Solr-tp2924632p2926107.html
Sent from the Solr - User mailing list archive at Nabble.com.

How can i use Solr based Search Engine for My University?

2011-05-06 Thread Anurag
I am a student at  http://jmi.ac.in/index.htm Jamia Millia Islamia  , a
central univeristy in India. I want to use my search engine for the benefit
of students. The university has course like undergraduate,graduate,phd etc
inlcuding Engineering . Earlier one of my teacher suggested developing
Intranet Search ( for Lan) , but i am not able to figure it out as to how to
implement it. My university uses Google as its own site search tool. 

I am in Engg department and i see students( including me ) using Xerox,
Previous year papers , Notes  etc  during exam  time. People use internet or
say google to learn if any topics is not inlucded in book. 

Please give some valuable suggestions.

Thanks

-
Kumar Anurag

--
View this message in context: 
http://lucene.472066.n3.nabble.com/How-can-i-use-Solr-based-Search-Engine-for-My-University-tp2907168p2907168.html
Sent from the Solr - User mailing list archive at Nabble.com.


Re: How can i use Solr based Search Engine for My University?

2011-05-06 Thread Anurag
In my search engine Nutch and Solr have been integrated both. Also i am
impplemented autocraling process. Whenever any one puts a http link in a
given box and then submit it, the http site address gets automatically
crawled and Indexes to solr...



On Fri, May 6, 2011 at 2:02 PM, Grijesh [via Lucene] 
ml-node+2907200-1529372386-146...@n3.nabble.com wrote:

 Use Nutch for your Intranet crawling.For more detail
 http://www.lucidimagination.com/blog/2009/03/09/nutch-solr/
 Thanx:
 Grijesh
 www.gettinhahead.co.in http://www.gettingahead.co.in


 --
  If you reply to this email, your message will be added to the discussion
 below:

 http://lucene.472066.n3.nabble.com/How-can-i-use-Solr-based-Search-Engine-for-My-University-tp2907168p2907200.html
  To unsubscribe from How can i use Solr based Search Engine for My
 University?, click 
 herehttp://lucene.472066.n3.nabble.com/template/NamlServlet.jtp?macro=unsubscribe_by_codenode=2907168code=YW51cmFnLml0LmpvbGx5QGdtYWlsLmNvbXwyOTA3MTY4fC0yMDk4MzQ0MTk2.





-- 
Kumar Anurag


-
Kumar Anurag

--
View this message in context: 
http://lucene.472066.n3.nabble.com/How-can-i-use-Solr-based-Search-Engine-for-My-University-tp2907168p2907483.html
Sent from the Solr - User mailing list archive at Nabble.com.

Re: How can i use Solr based Search Engine for My University?

2011-05-06 Thread Anurag
Thanks Aditya, i appreciate your suggestion.i will implemet your
suggestions. Besides these is there any other useful aspect that i may be
not taking into account?
Thanks a lot..

On Fri, May 6, 2011 at 4:57 PM, findbestopensource [via Lucene] 
ml-node+2907727-211212-146...@n3.nabble.com wrote:

 Hello Anurag

 Google is always there to do internet search. You need to support search
 for
 your university. My opinion would be don't crawl the sites. You require
 only
 Solr and not Nutch.

 1. Provide an interface to upload the documents by the university students.

 The documents could be previous year question paper, Notes, E-books etc.
 Scan the documents and convert it to PDF and upload them. Providing search
 on these things would be more valuable than crawling the sites.

 Regards
 Aditya
 www.findbestopensource.com



 On Fri, May 6, 2011 at 1:31 PM, Anurag [hidden 
 email]http://user/SendEmail.jtp?type=nodenode=2907727i=0by-user=t
 wrote:

  I am a student at  http://jmi.ac.in/index.htm Jamia Millia Islamia  , a
  central univeristy in India. I want to use my search engine for the
 benefit
  of students. The university has course like undergraduate,graduate,phd
 etc
  inlcuding Engineering . Earlier one of my teacher suggested developing
  Intranet Search ( for Lan) , but i am not able to figure it out as to how

  to
  implement it. My university uses Google as its own site search tool.
 
  I am in Engg department and i see students( including me ) using Xerox,
  Previous year papers , Notes  etc  during exam  time. People use internet

  or
  say google to learn if any topics is not inlucded in book.
 
  Please give some valuable suggestions.
 
  Thanks
 
  -
  Kumar Anurag
 
  --
  View this message in context:
 
 http://lucene.472066.n3.nabble.com/How-can-i-use-Solr-based-Search-Engine-for-My-University-tp2907168p2907168.htmlhttp://lucene.472066.n3.nabble.com/How-can-i-use-Solr-based-Search-Engine-for-My-University-tp2907168p2907168.html?by-user=t
  Sent from the Solr - User mailing list archive at Nabble.com.
 


 --
  If you reply to this email, your message will be added to the discussion
 below:

 http://lucene.472066.n3.nabble.com/How-can-i-use-Solr-based-Search-Engine-for-My-University-tp2907168p2907727.html
  To unsubscribe from How can i use Solr based Search Engine for My
 University?, click 
 herehttp://lucene.472066.n3.nabble.com/template/NamlServlet.jtp?macro=unsubscribe_by_codenode=2907168code=YW51cmFnLml0LmpvbGx5QGdtYWlsLmNvbXwyOTA3MTY4fC0yMDk4MzQ0MTk2.





-- 
Kumar Anurag


-
Kumar Anurag

--
View this message in context: 
http://lucene.472066.n3.nabble.com/How-can-i-use-Solr-based-Search-Engine-for-My-University-tp2907168p2908076.html
Sent from the Solr - User mailing list archive at Nabble.com.

debugQuery doesnot work with Solr-1.3.0 , is it true?

2011-03-21 Thread Anurag
i am trying to put this query on Solr-1.3.0 server which is integrated with
Nutch-1.0.
http://localhost:8983/solr/select/?q=solrversion=2.2start=0rows=10indent=ondebugQuery=on

But the results, i am getting doesnot have explaination for the score as
it should include tf, idf etc

Should i use the new  version (i checked it worked with 1.4.1) or the
solr-1.3.0 can  be made to work for solving my purpose. If later, then how
it is possible.

Please guide
Thanks

-
Kumar Anurag

--
View this message in context: 
http://lucene.472066.n3.nabble.com/debugQuery-doesnot-work-with-Solr-1-3-0-is-it-true-tp2711873p2711873.html
Sent from the Solr - User mailing list archive at Nabble.com.


How to create patch to implement my own advance search mentioned below

2011-03-19 Thread Anurag
Details
Query will be like most{t2,t3,t5,t6,t7} where most is linguistic
quantifier having some weights varying b/w a=0.3 and b=0.8
The relevancy matrix with corresponding tf*idf values for the above query is
R(relevancy Matrix)
   t2t3  t5   t6  t7
   d1   0.6   0.00.4 0.2 0.4
   d2   0.4   0.10.7 0.6 0.0
   d3   0.2   0.50.0 0.3 0.6
   d4   0.5   0.30.5 0.4 0.1
   
Difficulty 1-  How to get the above tf*idf score for all the terms in
relevant document

Using a formulae we can calculate the 5 weights as
w1=0.0,w2=0.2,w3=0.4,w4=0.4,w5=0.0

After calcualting the weights , we can multiply the terms score of each
document with weights in decreasing order( eg. for 1st document- 0.6, then
0.4, 0.4 , 0.2 , then 0.0)

This multiplication of matrix is like
(m*n)*(n*1) --- n*1 signifies single column matrix of 5 weights defined
above

After multiplication  we get result in matrix with single row called as
Query -relevancy matrix
QR=

d1  0.0*0.6+0.2*0.4+0.4*0.4+0.4*0.2+0.0*0.0
d2  0.0*0.7+0.2*0.6+0.4*0.4+0.4*0.1+0.0*0.0
d3  0.0*0.6+0.2*0.5+0.4*0.3+0.4*0.2+0.0*0.0
d4  0.0*0.5+0.2*0.5+0.4*0.4+0.4*0.3+0.0*0.1
=
d1   0.32
d2   0.32
d3   0.30
d4   0.38

difficulty 2 - where should i multiply this matrix and add to the solr?

Hence final order of documents on the basis of final score is
0.380.32=0.320.30
d4d1=d2d3

Please guide me .


-
Kumar Anurag

--
View this message in context: 
http://lucene.472066.n3.nabble.com/How-to-create-patch-to-implement-my-own-advance-search-mentioned-below-tp2701873p2701873.html
Sent from the Solr - User mailing list archive at Nabble.com.


Re: Implementing Fuzzy Search using OWA operator and Fuzzy Linguistic Quantifier

2011-03-18 Thread Anurag
]);
 System.out.println(t);
}
catch(Exception e){}

   }//for

   */
}//for

}//for

   



  //sort the relevancy matrix and multiply with weights
  
   for(int i=0;ilt;TOTAL_DOC;i++)
   {

  Arrays.sort(R[i]);
  reverse(R[i]);

   for(int j=0;jlt;1;j++)
   {
   QR[i][j]=0.0f;
   
  for(int k=0;klt;queryExpression.length;k++)
  {
   
   QR[i][j]+=(R[i][k]*Weight[k]);
   
  }
   }
}


  //print the scores of the final documents
  System.out.println(quot;Final Scores of Documentsquot;);
 
  IndexReader reader = IndexReader.open(directory);
 
  float max=0.0f,min=0.f;
  int num1=0,num2=0;
  String ds=quot;quot;,ds2=quot;quot;;
 for(int i=0;ilt;TOTAL_DOC;i++)
  {
 try{
 Document d = reader.document( i);
 
 System.out.println(quot;Document
quot;+d.get(quot;titlequot;).toString()+quot;score= quot;+QR[i][0]);
 if(QR[i][0]gt;max) {num1=i;max=QR[i][0];ds=d.get(title).toString();}
 if(QR[i][0]lt;minamp;amp;QR[i][0]gt;=0.1f)
{num2=i;min=QR[i][0];ds2=d.get(title).toString();}
 }catch(Exception e){}
 //Thread.sleep(100);
System.out.println(i);
 }

  System.out.println(num1+ +ds+ +max);
  System.out.println(num2+ +ds2+ +min);
  }//main
}//class

-
Kumar Anurag

--
View this message in context: 
http://lucene.472066.n3.nabble.com/Implementing-Fuzzy-Search-using-OWA-operator-and-Fuzzy-Linguistic-Quantifier-tp2261469p2699065.html
Sent from the Solr - User mailing list archive at Nabble.com.


Please reply how to embed code to solr

2011-03-18 Thread Anurag
http://lucene.472066.n3.nabble.com/Implementing-Fuzzy-Search-using-OWA-operator-and-Fuzzy-Linguistic-Quantifier-td2261469.html
Link 

-
Kumar Anurag

--
View this message in context: 
http://lucene.472066.n3.nabble.com/Please-reply-how-to-embed-code-to-solr-tp2699218p2699218.html
Sent from the Solr - User mailing list archive at Nabble.com.


Re: background merge hit exception

2011-03-15 Thread Anurag
Do you mean that earlier it was doing indexing well then all of sudden you
started getting this exception? 

-
Kumar Anurag

--
View this message in context: 
http://lucene.472066.n3.nabble.com/background-merge-hit-exception-tp2680625p2680979.html
Sent from the Solr - User mailing list archive at Nabble.com.


Re: Location of Main Class in Solr?

2011-03-05 Thread Anurag
Thanks.

On Sat, Mar 5, 2011 at 7:58 PM, Koji Sekiguchi [via Lucene] 
ml-node+2638122-740990375-146...@n3.nabble.com wrote:

 (11/03/04 3:30), Anurag wrote:
  I searched SolrIndexSearcher.java file but there is no main class.  I
 wanted
  to know as to where this class resides. Can i call this main class (if it

  exists)  using command line options in terminal , rather than through war

  file?

 Kumar,

 I think you may want to use EmbeddedSolrServer from your mail method.
 Please see:

 http://wiki.apache.org/solr/Solrj#EmbeddedSolrServer

 Koji
 --
 http://www.rondhuit.com/en/


 --
  If you reply to this email, your message will be added to the discussion
 below:

 http://lucene.472066.n3.nabble.com/Location-of-Main-Class-in-Solr-tp2627576p2638122.html
  To unsubscribe from Location of Main Class in Solr?, click 
 herehttp://lucene.472066.n3.nabble.com/template/NamlServlet.jtp?macro=unsubscribe_by_codenode=2627576code=YW51cmFnLml0LmpvbGx5QGdtYWlsLmNvbXwyNjI3NTc2fC0yMDk4MzQ0MTk2.





-- 
Kumar Anurag


-
Kumar Anurag

--
View this message in context: 
http://lucene.472066.n3.nabble.com/Location-of-Main-Class-in-Solr-tp2627576p2638658.html
Sent from the Solr - User mailing list archive at Nabble.com.

Re: Location of Main Class in Solr?

2011-03-05 Thread Anurag
Do you mean that a .class(DOT class) file is responsible for executing the
solr server, hence no Public Static void main is present anywhere.?

Actually i want to play with the Searcher.java file , but i am finding
difficulty as the Searcher file is very big and any changes will lead to
incompatibility with other files.

On Sat, Mar 5, 2011 at 11:00 PM, kumar anurag anurag.it.jo...@gmail.comwrote:

 Thanks.


 On Sat, Mar 5, 2011 at 7:58 PM, Koji Sekiguchi [via Lucene] 
 ml-node+2638122-740990375-146...@n3.nabble.com wrote:

 (11/03/04 3:30), Anurag wrote:
  I searched SolrIndexSearcher.java file but there is no main class.  I
 wanted
  to know as to where this class resides. Can i call this main class (if
 it
  exists)  using command line options in terminal , rather than through
 war
  file?

 Kumar,

 I think you may want to use EmbeddedSolrServer from your mail method.
 Please see:

 http://wiki.apache.org/solr/Solrj#EmbeddedSolrServer

 Koji
 --
 http://www.rondhuit.com/en/


 --
  If you reply to this email, your message will be added to the discussion
 below:

 http://lucene.472066.n3.nabble.com/Location-of-Main-Class-in-Solr-tp2627576p2638122.html
  To unsubscribe from Location of Main Class in Solr?, click 
 herehttp://lucene.472066.n3.nabble.com/template/NamlServlet.jtp?macro=unsubscribe_by_codenode=2627576code=YW51cmFnLml0LmpvbGx5QGdtYWlsLmNvbXwyNjI3NTc2fC0yMDk4MzQ0MTk2.





 --
 Kumar Anurag




-- 
Kumar Anurag


-
Kumar Anurag

--
View this message in context: 
http://lucene.472066.n3.nabble.com/Location-of-Main-Class-in-Solr-tp2627576p2638667.html
Sent from the Solr - User mailing list archive at Nabble.com.

Location of Main Class in Solr?

2011-03-03 Thread Anurag
I searched SolrIndexSearcher.java file but there is no main class.  I wanted
to know as to where this class resides. Can i call this main class (if it
exists)  using command line options in terminal , rather than through war
file?

-
Kumar Anurag

--
View this message in context: 
http://lucene.472066.n3.nabble.com/Location-of-Main-Class-in-Solr-tp2627576p2627576.html
Sent from the Solr - User mailing list archive at Nabble.com.


Re: Problem with Solr and Nutch integration

2011-03-01 Thread Anurag
i have nutch-1.0 and Apache-solr-1.3.0 (integrated these two).

On 3/1/11, Paul Rogers [via Lucene]
ml-node+2601915-1461428819-146...@n3.nabble.com wrote:


 Hi Anurag

 The request handler has been added the solrconfig file.

 I'll try your attached requesthandler and see if that helps.

 Interestingly enough the whole setup when I was using nutch 1.2/solr 1.4.1.
  It is only since moving to nutch trunk/solr branch_3x that the problem has
 occurred.  I assume that something has changed inbetween and the tutorial's
 request handler is incorrect for the later solr version.  Which versions of
 solr/nutch are you using?

 Assuming the catalina.out file is the correct log file the output I get is
 shown below.  This output occurs on restarting the solr-example after adding
 the new requesthandler.  When I access the solr admin page no additional
 logging occurs.  Can any one see the problem?

 Feb 28, 2011 6:28:59 PM org.apache.solr.core.SolrResourceLoader
 locateSolrHome

 INFO: Using JNDI solr.home: /opt/solr/example/solr

 Feb 28, 2011 6:28:59 PM org.apache.solr.core.SolrResourceLoader init

 INFO: Solr home set to '/opt/solr/example/solr/'

 Feb 28, 2011 6:28:59 PM org.apache.solr.core.SolrResourceLoader
 addToClassLoader

 SEVERE: Can't find (or read) file to add to classloader:
 /opt/solr/example/solr/./lib

 Feb 28, 2011 6:28:59 PM org.apache.solr.servlet.SolrDispatchFilter init

 INFO: SolrDispatchFilter.init()

 Feb 28, 2011 6:28:59 PM org.apache.solr.core.SolrResourceLoader
 locateSolrHome

 INFO: Using JNDI solr.home: /opt/solr/example/solr

 Feb 28, 2011 6:28:59 PM org.apache.solr.core.CoreContainer$Initializer
 initialize
 INFO: looking for solr.xml: /opt/solr/example/solr/solr.xml

 Feb 28, 2011 6:28:59 PM org.apache.solr.core.SolrResourceLoader
 locateSolrHome

 INFO: Using JNDI solr.home: /opt/solr/example/solr

 Feb 28, 2011 6:28:59 PM org.apache.solr.core.CoreContainer init

 INFO: New CoreContainer: solrHome=/opt/solr/example/solr/ instance=6794958

 Feb 28, 2011 6:28:59 PM org.apache.solr.core.SolrResourceLoader init

 INFO: Solr home set to '/opt/solr/example/solr/'

 Feb 28, 2011 6:28:59 PM org.apache.solr.core.SolrResourceLoader
 addToClassLoader

 SEVERE: Can't find (or read) file to add to classloader:
 /opt/solr/example/solr/./lib

 Feb 28, 2011 6:28:59 PM org.apache.solr.core.SolrResourceLoader init

 INFO: Solr home set to '/opt/solr/example/solr/./'

 Feb 28, 2011 6:28:59 PM org.apache.solr.core.SolrResourceLoader
 addToClassLoader

 SEVERE: Can't find (or read) file to add to classloader:
 /opt/solr/example/solr/././lib

 Feb 28, 2011 6:28:59 PM org.apache.solr.core.SolrConfig initLibs

 INFO: Adding specified lib dirs to ClassLoader

 Feb 28, 2011 6:28:59 PM org.apache.solr.core.SolrResourceLoader
 replaceClassLoader

 INFO: Adding
 'file:/opt/solr/contrib/extraction/lib/commons-compress-1.1.jar' to
 classloader
 Feb 28, 2011 6:28:59 PM org.apache.solr.core.SolrResourceLoader
 replaceClassLoader

 INFO: Adding 'file:/opt/solr/contrib/extraction/lib/log4j-1.2.14.jar' to
 classloader
 Feb 28, 2011 6:28:59 PM org.apache.solr.core.SolrResourceLoader
 replaceClassLoader

 INFO: Adding
 'file:/opt/solr/contrib/extraction/lib/commons-logging-1.1.1.jar' to
 classloader
 Feb 28, 2011 6:28:59 PM org.apache.solr.core.SolrResourceLoader
 replaceClassLoader

 INFO: Adding 'file:/opt/solr/contrib/extraction/lib/tika-parsers-0.8.jar' to
 classloader
 Feb 28, 2011 6:28:59 PM org.apache.solr.core.SolrResourceLoader
 replaceClassLoader

 INFO: Adding 'file:/opt/solr/contrib/extraction/lib/asm-3.1.jar' to
 classloader
 Feb 28, 2011 6:28:59 PM org.apache.solr.core.SolrResourceLoader
 replaceClassLoader

 INFO: Adding 'file:/opt/solr/contrib/extraction/lib/icu4j-4_6.jar' to
 classloader
 Feb 28, 2011 6:28:59 PM org.apache.solr.core.SolrResourceLoader
 replaceClassLoader

 INFO: Adding 'file:/opt/solr/contrib/extraction/lib/xercesImpl-2.8.1.jar' to
 classloader
 Feb 28, 2011 6:28:59 PM org.apache.solr.core.SolrResourceLoader
 replaceClassLoader

 INFO: Adding 'file:/opt/solr/contrib/extraction/lib/bcmail-jdk15-1.45.jar'
 to classloader
 Feb 28, 2011 6:28:59 PM org.apache.solr.core.SolrResourceLoader
 replaceClassLoader

 INFO: Adding 'file:/opt/solr/contrib/extraction/lib/fontbox-1.3.1.jar' to
 classloader
 Feb 28, 2011 6:28:59 PM org.apache.solr.core.SolrResourceLoader
 replaceClassLoader

 INFO: Adding 'file:/opt/solr/contrib/extraction/lib/poi-3.7.jar' to
 classloader
 Feb 28, 2011 6:28:59 PM org.apache.solr.core.SolrResourceLoader
 replaceClassLoader

 INFO: Adding 'file:/opt/solr/contrib/extraction/lib/dom4j-1.6.1.jar' to
 classloader
 Feb 28, 2011 6:28:59 PM org.apache.solr.core.SolrResourceLoader
 replaceClassLoader

 INFO: Adding
 'file:/opt/solr/contrib/extraction/lib/geronimo-stax-api_1.0_spec-1.0.1.jar'
 to classloader
 Feb 28, 2011 6:28:59 PM org.apache.solr.core.SolrResourceLoader
 replaceClassLoader

 INFO: Adding 'file:/opt/solr/contrib/extraction/lib/poi-ooxml-3.7.jar' to
 classloader

Re: Problem with Solr and Nutch integration

2011-02-28 Thread Anurag
Solr uses jetty server  default, do u know that? you can run solr server
without using Tomcat (using jetty server).
Please describe the steps that led to the error. Which command u executed?

On Mon, Feb 28, 2011 at 1:39 AM, Paul Rogers [via Lucene] 
ml-node+2590334-620834624-146...@n3.nabble.com wrote:

 Hi Guys

 I'm trying to integrate solr and nutch as per
 http://www.lucidimagination.com/blog/2009/03/09/nutch-solr/, using the
 branch_3x from svn on Tomcat 6.  After adding the nutch requestHandler to

 solrconfig.xml while the solr-example will start on accessing the admin
 page
 I get the following error message:

 HTTP Status 404 - missing core name in path
 --

 *type* Status report

 *message* *missing core name in path*

 *description* *The requested resource (missing core name in path) is not
 available.*

 After  googling I found the following:

 I think you are seeing the effects of SOLR-1743 masking another error ...
 have you checked your log for other errors/exceptions being logged when
 you startup solr with that solrconfig.xml?

 Chris Hostetter

 My initial question is this, am I right in thinking that solr should be
 using the Tomcat 6 logging and that logs should be found at
 $CATALINA_HOME/logs/catalina.out?

 Thanks

 Paul


 --
  If you reply to this email, your message will be added to the discussion
 below:

 http://lucene.472066.n3.nabble.com/Problem-with-Solr-and-Nutch-integration-tp2590334p2590334.html
  To start a new topic under Solr - User, email
 ml-node+472068-1941297125-146...@n3.nabble.com
 To unsubscribe from Solr - User, click 
 herehttp://lucene.472066.n3.nabble.com/template/NamlServlet.jtp?macro=unsubscribe_by_codenode=472068code=YW51cmFnLml0LmpvbGx5QGdtYWlsLmNvbXw0NzIwNjh8LTIwOTgzNDQxOTY=.





-- 
Kumar Anurag


-
Kumar Anurag

-- 
View this message in context: 
http://lucene.472066.n3.nabble.com/Problem-with-Solr-and-Nutch-integration-tp2590334p2594293.html
Sent from the Solr - User mailing list archive at Nabble.com.

Re: Problem with Solr and Nutch integration

2011-02-28 Thread Anurag
The above mentioned requesthandler lies in schema file or solrconfig file
of Solr?
I integrated solr and nutch and requesthandler lies in SolrConfig.xml.

This is my some content of my solrconfig.xml. As far as Jetty server is
concerned its working, don't know about solrtomcat.


requestHandler name=/nutch class=solr.SearchHandler 
lst name=defaults
str name=defTypedismax/str
str name=echoParamsexplicit/str
float name=tie0.01/float
str name=qf
content^0.5 anchor^1.0 title^1.2
/str
str name=pf
content^0.5 anchor^1.5 title^1.2 site^1.5
/str
str name=fl
url
/str
str name=mm
2lt;-1 5lt;-2 6lt;90%
/str
int name=ps100/int
bool hl=true/
str name=q.alt*:*/str
str name=hl.fltitle url content/str
str name=f.title.hl.fragsize0/str
str name=f.title.hl.alternateFieldtitle/str
str name=f.url.hl.fragsize0/str
str name=f.url.hl.alternateFieldurl/str
str name=f.content.hl.fragmenterregex/str
/lst
/requestHandler
requestHandler name=/nutch class=solr.SearchHandler 
lst name=defaults
str name=defTypedismax/str
str name=echoParamsexplicit/str
float name=tie0.01/float
str name=qf
content^0.5 anchor^1.0 title^1.2
/str
str name=pf
content^0.5 anchor^1.5 title^1.2 site^1.5
/str
str name=fl
url
/str
str name=mm
2lt;-1 5lt;-2 6lt;90%
/str
int name=ps100/int
bool hl=true/
str name=q.alt*:*/str
str name=hl.fltitle url content/str
str name=f.title.hl.fragsize0/str
str name=f.title.hl.alternateFieldtitle/str
str name=f.url.hl.fragsize0/str
str name=f.url.hl.alternateFieldurl/str
str name=f.content.hl.fragmenterregex/str
/lst
/requestHandler



But yeah deploying solr.war file in tomcat 6 on  my system works.


On Tue, Mar 1, 2011 at 1:56 AM, Paul Rogers [via Lucene] 
ml-node+2598137-98595181-146...@n3.nabble.com wrote:

 Hi Anurag

 Thanks for the prompt reply.

 I'm following the tutorial at

 http://www.lucidimagination.com/blog/2009/03/09/nutch-solr/

 I have built solr and the example and added it to Tomcat as per

 http://wiki.apache.org/solr/SolrTomcat

 and this (solr-example) all appears to work fine (I can access the solr
 admin page at http://localhost:8080/solr-example/admin/
 http://sol001:8080/solr-example/admin/
 and
 search using the same).

 I have copied the nutch schema.xml across and replaced the example one.
  Again everything seems to work fine.

 However when I add the request handler:

 requestHandler name=/nutch class=solr.SearchHandler 
 lst name=defaults
 str name=defTypedismax/str
 str name=echoParamsexplicit/str
 float name=tie0.01/float
 str name=qf
 content^0.5 anchor^1.0 title^1.2
 /str
 str name=pf
 content^0.5 anchor^1.5 title^1.2 site^1.5
 /str
 str name=fl
 url
 /str
 str name=mm
 2-1 5-2 690%
 /str
 int name=ps100/int
 bool hl=true/
 str name=q.alt*:*/str
 str name=hl.fltitle url content/str
 str name=f.title.hl.fragsize0/str
 str name=f.title.hl.alternateFieldtitle/str
 str name=f.url.hl.fragsize0/str
 str name=f.url.hl.alternateFieldurl/str
 str name=f.content.hl.fragmenterregex/str
 /lst
 /requestHandler


 and restart the solr-example app under tomcat I get the following error:

 HTTP Status 404 - missing core name in path
 --

 *type* Status report

 *message* *missing core name in path*

 *description* *The requested resource (missing core name in path) is not
 available.*
 *
 *
 As soon as I comment out the request handler the example appears to work
 again.

 From the previous mentioned post I understand that this error is masking
 the
 actual error and I need to check the logs.  However I'm unsure exactly
 where
 these are located.

 I was hoping if I could post them It'd allow you guys to suggest a
 solution.

 Many thanks


 Paul
 On 28 February 2011 11:37, Anurag [hidden 
 email]http://user/SendEmail.jtp?type=nodenode=2598137i=0
 wrote:

  Solr uses jetty server  default, do u know that? you can run solr server
  without using Tomcat (using jetty server).
  Please describe the steps that led to the error. Which command u
 executed?
 
 


 --
  If you reply to this email, your message will be added to the discussion
 below:

 http://lucene.472066.n3.nabble.com/Problem-with-Solr-and-Nutch-integration-tp2590334p2598137.html
  To start a new topic under Solr - User, email
 ml-node+472068-1941297125-146...@n3.nabble.com
 To unsubscribe from Solr - User, click 
 herehttp://lucene.472066.n3.nabble.com/template/NamlServlet.jtp?macro=unsubscribe_by_codenode=472068code=YW51cmFnLml0LmpvbGx5QGdtYWlsLmNvbXw0NzIwNjh8LTIwOTgzNDQxOTY=.





-- 
Kumar Anurag


-
Kumar Anurag

-- 
View this message in context: 
http://lucene.472066.n3.nabble.com/Problem-with-Solr-and-Nutch-integration-tp2590334p2598526.html
Sent from the Solr - User mailing list archive at Nabble.com.

Re: Problem with Solr and Nutch integration

2011-02-27 Thread Anurag
Which os u are using?

On Mon, Feb 28, 2011 at 1:39 AM, Paul Rogers [via Lucene] 
ml-node+2590334-620834624-146...@n3.nabble.com wrote:

 Hi Guys

 I'm trying to integrate solr and nutch as per
 http://www.lucidimagination.com/blog/2009/03/09/nutch-solr/, using the
 branch_3x from svn on Tomcat 6.  After adding the nutch requestHandler to

 solrconfig.xml while the solr-example will start on accessing the admin
 page
 I get the following error message:

 HTTP Status 404 - missing core name in path
 --

 *type* Status report

 *message* *missing core name in path*

 *description* *The requested resource (missing core name in path) is not
 available.*

 After  googling I found the following:

 I think you are seeing the effects of SOLR-1743 masking another error ...
 have you checked your log for other errors/exceptions being logged when
 you startup solr with that solrconfig.xml?

 Chris Hostetter

 My initial question is this, am I right in thinking that solr should be
 using the Tomcat 6 logging and that logs should be found at
 $CATALINA_HOME/logs/catalina.out?

 Thanks

 Paul


 --
  If you reply to this email, your message will be added to the discussion
 below:

 http://lucene.472066.n3.nabble.com/Problem-with-Solr-and-Nutch-integration-tp2590334p2590334.html
  To start a new topic under Solr - User, email
 ml-node+472068-1941297125-146...@n3.nabble.com
 To unsubscribe from Solr - User, click 
 herehttp://lucene.472066.n3.nabble.com/template/NamlServlet.jtp?macro=unsubscribe_by_codenode=472068code=YW51cmFnLml0LmpvbGx5QGdtYWlsLmNvbXw0NzIwNjh8LTIwOTgzNDQxOTY=.





-- 
Kumar Anurag


-
Kumar Anurag

-- 
View this message in context: 
http://lucene.472066.n3.nabble.com/Problem-with-Solr-and-Nutch-integration-tp2590334p2593100.html
Sent from the Solr - User mailing list archive at Nabble.com.

Studying all files of Solr SRC

2011-02-26 Thread Anurag
Is there any place where a detailed tutorial about all the Java files of
Apache Solr(under Src folder) is available.?
I want to study them as my purpose is to either write codes for my
implementation or modify the existing files to fulfill my purpose.

Actually i want to add Advance Search in my Solr based search engine. This
advance search will include options like ...at least half , as many as
possible , most etc which are linguistic operators. We can say that these
options will help the user in finding fuzziness in their search results.

The user wants show me all the documents which contains at least half  of
terms like t1,t2,t3 or show me all the documents which contains most  of
the terms like t1,t5,t7 etc...These at least half and most have been
given some weight . These advance search is different from normal boolean
search.

Thanks


-
Kumar Anurag

-- 
View this message in context: 
http://lucene.472066.n3.nabble.com/Studying-all-files-of-Solr-SRC-tp2581715p2581715.html
Sent from the Solr - User mailing list archive at Nabble.com.


Re: Spellcheck in solr-nutch integration

2011-02-05 Thread Anurag

First go thru the schema.xml file . Look at the different components.
On Sat, Feb 5, 2011 at 1:01 PM, 666 [via Lucene] 
ml-node+2429702-1399813783-146...@n3.nabble.comml-node%2b2429702-1399813783-146...@n3.nabble.com
 wrote:

 Hello Anurag, I'm facing the same problem. Will u please elaborate on how u
 solved the problem? It would be great if u give me a step by step
 description as I'm new in Solr.

 --
  If you reply to this email, your message will be added to the discussion
 below:

 http://lucene.472066.n3.nabble.com/Spellcheck-in-solr-nutch-integration-tp1953232p2429702.html
  To unsubscribe from Spellcheck in solr-nutch integration, click 
 herehttp://lucene.472066.n3.nabble.com/template/NamlServlet.jtp?macro=unsubscribe_by_codenode=1953232code=YW51cmFnLml0LmpvbGx5QGdtYWlsLmNvbXwxOTUzMjMyfC0yMDk4MzQ0MTk2.





-- 
Kumar Anurag


-
Kumar Anurag

-- 
View this message in context: 
http://lucene.472066.n3.nabble.com/Spellcheck-in-solr-nutch-integration-tp1953232p2429782.html
Sent from the Solr - User mailing list archive at Nabble.com.


Re: How to edit / compile the SOLR source code

2011-01-26 Thread Anurag

Actually i also want to edit Source Files of Solr.Does that mean i will have
to go in Src directory of Solr and then rebuild using ant? I need not
compile them or Ant will  do the whole compiling as well as updating the jar
files?
i have the following files in Solr-1.3.0 directory

/home/anurag/apache-solr-1.3.0/build
/home/anurag/apache-solr-1.3.0/client
/home/anurag/apache-solr-1.3.0/contrib
/home/anurag/apache-solr-1.3.0/dist
/home/anurag/apache-solr-1.3.0/docs
/home/anurag/apache-solr-1.3.0/example
/home/anurag/apache-solr-1.3.0/lib
/home/anurag/apache-solr-1.3.0/src
/home/anurag/apache-solr-1.3.0/build.xml
/home/anurag/apache-solr-1.3.0/CHANGES.txt
/home/anurag/apache-solr-1.3.0/common-build.xml
/home/anurag/apache-solr-1.3.0/KEYS.txt
/home/anurag/apache-solr-1.3.0/LICENSE.txt
/home/anurag/apache-solr-1.3.0/NOTICE.txt
/home/anurag/apache-solr-1.3.0/README.txt

and i want to edit the source code to implement my things. How should i
proceed?

-
Kumar Anurag

-- 
View this message in context: 
http://lucene.472066.n3.nabble.com/How-to-edit-compile-the-SOLR-source-code-tp477584p2355270.html
Sent from the Solr - User mailing list archive at Nabble.com.


Implementing Fuzzy Search using OWA operator and Fuzzy Linguistic Quantifier

2011-01-15 Thread Anurag

I am solr-1.3.0 user , where we have integrated Nutch. I want my query types
to be like
eg. at least some query, or
 most of some query

This is to be done through Fuzzy Search techniques. I know there is fuzzy
search in solr using ~(tilde ) sign like
e.g.somequery~0.8
But we want query to be of above types because its convenient to user to ask
for what he/she really mean. It happens that using AND, OR , NOT for a user
is difficult as user doesnot know where to use AND and where to use OR in
the terms. The logical operators become difficult to use in search query.

Any one have any idea on how to proceed to implement this?

Thanks 

-
Kumar Anurag

-- 
View this message in context: 
http://lucene.472066.n3.nabble.com/Implementing-Fuzzy-Search-using-OWA-operator-and-Fuzzy-Linguistic-Quantifier-tp2261469p2261469.html
Sent from the Solr - User mailing list archive at Nabble.com.


Re: Implementing Fuzzy Search using OWA operator and Fuzzy Linguistic Quantifier

2011-01-15 Thread Anurag

Please reply...I need help from you all...

-
Kumar Anurag

-- 
View this message in context: 
http://lucene.472066.n3.nabble.com/Implementing-Fuzzy-Search-using-OWA-operator-and-Fuzzy-Linguistic-Quantifier-tp2261469p2262917.html
Sent from the Solr - User mailing list archive at Nabble.com.


Re: Implementing Fuzzy Search using OWA operator and Fuzzy Linguistic Quantifier

2011-01-15 Thread Anurag

The query will be like
1.  at least (lucene) 
2.  mostly (solr) 
3. Q(query)=most(t1,t2,t3,t7)   where t1,t2,t3,t7 are terms
4. Q=(t1,0.9) and {(t2,0.5) or (t3,0.7)}

Actually the purpose to expand the query types enterd by user.


On Sun, Jan 16, 2011 at 12:55 AM, iorixxx [via Lucene] 
ml-node+2263070-1851340758-146...@n3.nabble.comml-node%2b2263070-1851340758-146...@n3.nabble.com
 wrote:

  want my query types
  to be like
  eg. at least some query, or
   most of some query

 Can you elaborate more? It is not so visible what you want.






 --
  View message @
 http://lucene.472066.n3.nabble.com/Implementing-Fuzzy-Search-using-OWA-operator-and-Fuzzy-Linguistic-Quantifier-tp2261469p2263070.html
 To unsubscribe from Implementing Fuzzy Search using OWA operator and Fuzzy
 Linguistic Quantifier, click 
 herehttp://lucene.472066.n3.nabble.com/template/NamlServlet.jtp?macro=unsubscribe_by_codenode=2261469code=YW51cmFnLml0LmpvbGx5QGdtYWlsLmNvbXwyMjYxNDY5fC0yMDk4MzQ0MTk2.





-- 
Kumar Anurag


-
Kumar Anurag

-- 
View this message in context: 
http://lucene.472066.n3.nabble.com/Implementing-Fuzzy-Search-using-OWA-operator-and-Fuzzy-Linguistic-Quantifier-tp2261469p2263161.html
Sent from the Solr - User mailing list archive at Nabble.com.


Re: MoreLikeThis search component

2011-01-05 Thread Anurag

You can go through page 182 of this book
http://books.google.co.in/books?id=m2q3PwAACAAJdq=download+solr+search+server+1.4hl=enei=inIlTaudLcHrrQfB4pmaDAsa=Xoi=book_resultct=book-thumbnailresnum=1ved=0CDEQ6wEwAA
.

On Thu, Jan 6, 2011 at 12:53 PM, Isha Garg [via Lucene] 
ml-node+2204185-699553121-146...@n3.nabble.comml-node%2b2204185-699553121-146...@n3.nabble.com
 wrote:

 Hi ,

   I am new solr user.  Can anyone tell me the detailed approach that
 works behind the MoreLikeThis solr search component and how to use this?


 Thanks!
 Isha Garg


 --
  View message @
 http://lucene.472066.n3.nabble.com/MoreLikeThis-search-component-tp2204185p2204185.html
 To start a new topic under Solr - User, email
 ml-node+472068-1941297125-146...@n3.nabble.comml-node%2b472068-1941297125-146...@n3.nabble.com
 To unsubscribe from Solr - User, click 
 herehttp://lucene.472066.n3.nabble.com/template/NamlServlet.jtp?macro=unsubscribe_by_codenode=472068code=YW51cmFnLml0LmpvbGx5QGdtYWlsLmNvbXw0NzIwNjh8LTIwOTgzNDQxOTY=.





-- 
Kumar Anurag


-
Kumar Anurag

-- 
View this message in context: 
http://lucene.472066.n3.nabble.com/MoreLikeThis-search-component-tp2204185p2204265.html
Sent from the Solr - User mailing list archive at Nabble.com.


Re: Problem of results ordering

2010-12-23 Thread Anurag

Try boosting 94305 as guitar center 94305^10
On Fri, Dec 24, 2010 at 9:23 AM, Erick Erickson [via Lucene] 
ml-node+2139685-1248268645-146...@n3.nabble.comml-node%2b2139685-1248268645-146...@n3.nabble.com
 wrote:

 What does your query look like? Especially what is the output
 when you append debugQuery=on? You can examine the
 scoring at the end of the response to gain more insight.

 Best
 Erick

 On Thu, Dec 23, 2010 at 8:34 PM, Ruixiang Zhang [hidden 
 email]http://user/SendEmail.jtp?type=nodenode=2139685i=0
 wrote:

  When I search guitar center 94305, it gives the results:
 
  guitar center guitar center Hollywood
  guitar center 94305
  guitar center 94305 location
 
  But I want results to be like this:
 
  guitar center 94305
  guitar center 94305 location
  guitar center guitar center Hollywood
 
  How can I make the results that match all keywords come first?
  Or how can I reduce the weight of the word that appears the second or
 more
  time?
 
  Thanks
  Ruixiang
 


 --
  View message @
 http://lucene.472066.n3.nabble.com/Problem-of-results-ordering-tp2139314p2139685.html

 To start a new topic under Solr - User, email
 ml-node+472068-1941297125-146...@n3.nabble.comml-node%2b472068-1941297125-146...@n3.nabble.com
 To unsubscribe from Solr - User, click 
 herehttp://lucene.472066.n3.nabble.com/template/NamlServlet.jtp?macro=unsubscribe_by_codenode=472068code=YW51cmFnLml0LmpvbGx5QGdtYWlsLmNvbXw0NzIwNjh8LTIwOTgzNDQxOTY=.





-- 
Kumar Anurag


-
Kumar Anurag

-- 
View this message in context: 
http://lucene.472066.n3.nabble.com/Problem-of-results-ordering-tp2139314p2139978.html
Sent from the Solr - User mailing list archive at Nabble.com.


Re: Solr index directory '/solr/data/index' doesn't exist. Creating new index... on Geronimo

2010-12-22 Thread Anurag
/NamlServlet.jtp?macro=unsubscribe_by_codenode=472068code=YW51cmFnLml0LmpvbGx5QGdtYWlsLmNvbXw0NzIwNjh8LTIwOTgzNDQxOTY=.





-- 
Kumar Anurag


-
Kumar Anurag

-- 
View this message in context: 
http://lucene.472066.n3.nabble.com/Dismax-score-maximu-of-any-one-field-tp2119563p2131762.html
Sent from the Solr - User mailing list archive at Nabble.com.


Re: Solr index directory '/solr/data/index' doesn't exist. Creating new index... on Geronimo

2010-12-22 Thread Anurag

So problem may be that index folder was not able to create. So try to
check the conf folder where solconfig.xml  schema.xml resides. Also u may
try to index using $java -jar post.jar *.xml files.

You may try different version like 1.3.0 or 1.4.0 to test what is wrong. It
sometimes happens that the downloaded solr may have something missing.


On Wed, Dec 22, 2010 at 9:18 PM, Bac Hoang [via Lucene] 
ml-node+2131930-846132511-146...@n3.nabble.comml-node%2b2131930-846132511-146...@n3.nabble.com
 wrote:


 Hello Anurag,

 The specific problem I faced when started solr in Geronimo 
 (http://{server}:{port}/solr)
 is /solr/data/index could not be found, then solr tried to create that
 folder but failed, even permission is granted.

 More detail got from the log: Solr index directory  '/solr/data/index'
 doesn't exist. Creating new index...
 2010-12-22 15:13:19,599 ERROR [SolrDispatchFilter] Could not start SOLR.
 Check solr/home property
 java.lang.RuntimeException: java.io.IOException: Cannot create directory:
 /solr/data/index

 You're right, I'm using solr is 1.4.1

 Thanks indeed
 Bac Hoang



 -Ursprüngliche Nachricht-
 Von: Anurag [mailto:[hidden 
 email]http://user/SendEmail.jtp?type=nodenode=2131930i=0]

 Gesendet: tư 12/22/2010 10:17 CH
 An: [hidden email] http://user/SendEmail.jtp?type=nodenode=2131930i=1
 Betreff: Re: Solr index directory '/solr/data/index' doesn't exist.
 Creating new index... on Geronimo


 What you want to ask? When this problem arises.? Is it when you try to
 index
 to solr? What are the commands that you are running? Which version of solr(

 1.4.1?).
 On Wed, Dec 22, 2010 at 5:49 PM, Bac Hoang [via Lucene] 
 [hidden email] http://user/SendEmail.jtp?type=nodenode=2131930i=2[hidden
 email] http://user/SendEmail.jtp?type=nodenode=2131930i=3
  wrote:

  Hello Erick,
 
  Could you kindly give a hand on my problem. Any ideas, hints,
  suggestions are highly appreciated. Many thanks
 
  1. The problem: Solr index directory '/solr/data/index' doesn't exist.
  Creating new index...
  2. Some other info.:
 
  - use the solr example 1.4.1
  - Geronimo 2.1.6
  - solr home: /opt/dev/config/solr
  - dataDir: /opt/dev/config/solr/data/index. I set the read, write right
  to every and each folder, from opt, dev...to the last one, index (just
  for sure ;) )
  - lockType:
   - single/ simple: Cannot create directory: /solr/data/index at
  org.apache.solr.core.SolrCore.initIndex(SolrCore.java:397)
   - native: Cannot create directory: /solr/data/index at
  org.apache.lucene.store.NativeFSLockFactory.acquireTestLock
 
  - the Geronimo log:
  ===
  2010-12-22 15:13:03,001 INFO  [SupportedModesServiceImpl] Portlet mode
  'edit' not found for portletId: '/console-base.WARModules!874780194|0'
  2010-12-22 15:13:03,001 INFO  [SupportedModesServiceImpl] Portlet mode
  'help' not found for portletId: '/console-base.WARModules!874780194|0'
  2010-12-22 15:13:07,941 INFO  [DirectoryMonitor] Hot deployer notified
  that an artifact was removed: default/solr2/1293005281314/war
  2010-12-22 15:13:09,148 INFO  [SupportedModesServiceImpl] Portlet mode
  'edit' not found for portletId: '/console-base.WARModules!874780194|0'
  2010-12-22 15:13:09,148 INFO  [SupportedModesServiceImpl] Portlet mode
  'help' not found for portletId: '/console-base.WARModules!874780194|0'
  2010-12-22 15:13:14,139 INFO  [SupportedModesServiceImpl] Portlet mode
  'edit' not found for portletId: '/plugin.Deployment!227983155|0'
  2010-12-22 15:13:18,795 WARN  [TomcatModuleBuilder] Web application .
  does not contain a WEB-INF/geronimo-web.xml deployment plan.  This may
  or may not be a problem, depending on whether you have things like
  resource references that need to be resolved.  You can also give the
  deployer a separate deployment plan file on the command line.
  2010-12-22 15:13:19,040 INFO  [SolrResourceLoader] Using JNDI solr.home:
  /opt/dev/config/solr
  2010-12-22 15:13:19,040 INFO  [SolrResourceLoader] Solr home set to
  '/opt/dev/config/solr/'
  2010-12-22 15:13:19,051 INFO  [SolrDispatchFilter]
  SolrDispatchFilter.init()
  
  2010-12-22 15:13:19,462 INFO  [IndexSchema] default search field is text
  2010-12-22 15:13:19,463 INFO  [IndexSchema] query parser default
  operator is OR
  2010-12-22 15:13:19,464 INFO  [IndexSchema] unique key field: id
  2010-12-22 15:13:19,490 INFO  [JmxMonitoredMap] JMX monitoring is
  enabled. Adding Solr mbeans to JMX Server:
  com.sun.jmx.mbeanserver.jmxmbeanser...@144752d
  2010-12-22 15:13:19,525 INFO  [SolrCore] Added SolrEventListener:
  org.apache.solr.core.QuerySenderListener{queries=[]}
  2010-12-22 15:13:19,525 INFO  [SolrCore] Added SolrEventListener:
  org.apache.solr.core.QuerySenderListener{queries=[{q=solr
  rocks,start=0,rows=10}, {q=static firstSearcher warming query from
  solrconfig.xml}]}
  2010-12-22 15:13:19,533 WARN  [SolrCore] Solr index directory
  '/solr/data/index' doesn't exist. Creating new index...
  2010-12-22 15:13:19,599

Re: improving search response time

2010-12-21 Thread Anurag

I am using spellchecker in the query part. Now my search time has become
more. say initiallly it was 1000ms now its 3000ms.I have data index of size
9GB. 
My query http://localhost:8983/solr/spellCheckCompRH/?q=
http://localhost:8983/solr/spellCheckCompRH/?q=+search+spellcheck=truefl=spellcheck,title,url,hlhl=truestart=0rows=10indent=on
 

How can i improve the search time. 
i have
1) Fedora 11 as OS
2) Solr run on Jetty Server
3) Front page (search page) is on Tomcat 6
4)Index size is 9GB
5)RAM is 1GB



-
Kumar Anurag

-- 
View this message in context: 
http://lucene.472066.n3.nabble.com/improving-search-response-time-tp1204491p2125220.html
Sent from the Solr - User mailing list archive at Nabble.com.


Re: improving search response time

2010-12-21 Thread Anurag

Thanks  a lot!
you mean i have to increase the resources.
1.Can the distributed search improve the speed.?
2.I have read from some thread that spellchecker takes time.Is spellchecker
is one of the curlprit for  more response time?

On Tue, Dec 21, 2010 at 10:20 PM, Shawn Heisey-4 [via Lucene] 
ml-node+2126869-977261384-146...@n3.nabble.comml-node%2b2126869-977261384-146...@n3.nabble.com
 wrote:

 On 12/21/2010 3:02 AM, Anurag wrote:

  I am using spellchecker in the query part. Now my search time has become
  more. say initiallly it was 1000ms now its 3000ms.I have data index of
 size
  9GB.
  My query http://localhost:8983/solr/spellCheckCompRH/?q=

  http://localhost:8983/solr/spellCheckCompRH/?q=+search+spellcheck=truefl=spellcheck,title,url,hlhl=truestart=0rows=10indent=on

 
  How can i improve the search time.
  i have
  1) Fedora 11 as OS
  2) Solr run on Jetty Server
  3) Front page (search page) is on Tomcat 6
  4)Index size is 9GB
  5)RAM is 1GB

 Install more memory.  8GB would be a good place to be, more would let
 you fit your entire index into RAM for incredible speed.  Once you get
 above 4GB RAM, it's best if you run a 64-bit OS and Java, which requires
 64-bit processors.  If your index is growing, you might want to have
 more memory than that.

 Shawn



 --
  View message @
 http://lucene.472066.n3.nabble.com/improving-search-response-time-tp1204491p2126869.html
 To unsubscribe from improving search response time, click 
 herehttp://lucene.472066.n3.nabble.com/template/NamlServlet.jtp?macro=unsubscribe_by_codenode=1204491code=YW51cmFnLml0LmpvbGx5QGdtYWlsLmNvbXwxMjA0NDkxfC0yMDk4MzQ0MTk2.





-- 
Kumar Anurag


-
Kumar Anurag

-- 
View this message in context: 
http://lucene.472066.n3.nabble.com/improving-search-response-time-tp1204491p2127198.html
Sent from the Solr - User mailing list archive at Nabble.com.


Re: [Nutch] and Solr integration

2010-12-20 Thread Anurag

why are using solrindex in the argument.? It is used when we need to index
the crawled data in Solr
For more read http://wiki.apache.org/nutch/NutchTutorial .

Also for nutch-solr integration this is very useful blog
http://www.lucidimagination.com/blog/2009/03/09/nutch-solr/
I integrated nutch and solr and it works well.

Thanks

On Tue, Dec 21, 2010 at 1:57 AM, Adam Estrada-2 [via Lucene] 
ml-node+2122347-622655030-146...@n3.nabble.comml-node%2b2122347-622655030-146...@n3.nabble.com
 wrote:

 All,

 I have a couple websites that I need to crawl and the following command
 line
 used to work I think. Solr is up and running and everything is fine there
 and I can go through and index the site but I really need the results added

 to Solr after the crawl. Does anyone have any idea on how to make that
 happen or what I'm doing wrong?  These errors are being thrown fro Hadoop
 which I am not using at all.

 $ bin/nutch crawl urls -dir crawl -threads 10 -depth 100 -topN 50
 -solrindex
 ht
 tp://localhost:8983/solr
 crawl started in: crawl
 rootUrlDir = http://localhost:8983/solr
 threads = 10
 depth = 100
 indexer=lucene
 topN = 50
 Injector: starting at 2010-12-20 15:23:25
 Injector: crawlDb: crawl/crawldb
 Injector: urlDir: http://localhost:8983/solr
 Injector: Converting injected urls to crawl db entries.
 Exception in thread main java.io.IOException: No FileSystem for scheme:
 http
 at
 org.apache.hadoop.fs.FileSystem.createFileSystem(FileSystem.java:1375
 )
 at org.apache.hadoop.fs.FileSystem.access$200(FileSystem.java:66)
 at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:1390)
 at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:196)
 at org.apache.hadoop.fs.Path.getFileSystem(Path.java:175)
 at
 org.apache.hadoop.mapred.FileInputFormat.listStatus(FileInputFormat.j
 ava:169)
 at
 org.apache.hadoop.mapred.FileInputFormat.getSplits(FileInputFormat.ja
 va:201)
 at
 org.apache.hadoop.mapred.JobClient.writeOldSplits(JobClient.java:810)

 at
 org.apache.hadoop.mapred.JobClient.submitJobInternal(JobClient.java:7
 81)
 at org.apache.hadoop.mapred.JobClient.submitJob(JobClient.java:730)

 at org.apache.hadoop.mapred.JobClient.runJob(JobClient.java:1249)
 at org.apache.nutch.crawl.Injector.inject(Injector.java:217)
 at org.apache.nutch.crawl.Crawl.main(Crawl.java:124)


 --
  View message @
 http://lucene.472066.n3.nabble.com/Nutch-and-Solr-integration-tp2122347p2122347.html
 To start a new topic under Solr - User, email
 ml-node+472068-1941297125-146...@n3.nabble.comml-node%2b472068-1941297125-146...@n3.nabble.com
 To unsubscribe from Solr - User, click 
 herehttp://lucene.472066.n3.nabble.com/template/NamlServlet.jtp?macro=unsubscribe_by_codenode=472068code=YW51cmFnLml0LmpvbGx5QGdtYWlsLmNvbXw0NzIwNjh8LTIwOTgzNDQxOTY=.





-- 
Kumar Anurag


-
Kumar Anurag

-- 
View this message in context: 
http://lucene.472066.n3.nabble.com/Nutch-and-Solr-integration-tp2122347p2122623.html
Sent from the Solr - User mailing list archive at Nabble.com.


Re: Jquery Autocomplete Json formatting ?

2010-12-16 Thread Anurag

Installed Firebug

Now getting the following error
4139 matches.call( document.documentElement, [test!='']:sizzle );

Though my solr server is running on port8983, I am not using any server to
run this jquery, its just an html file in my home folder that i am opening
in my firefox browser.



-
Kumar Anurag

-- 
View this message in context: 
http://lucene.472066.n3.nabble.com/Jquery-Autocomplete-Json-formatting-tp2101346p2101593.html
Sent from the Solr - User mailing list archive at Nabble.com.


Re: Jquery Autocomplete Json formatting ?

2010-12-16 Thread Anurag

Installed Firebug

Now getting the following error
4139 matches.call( document.documentElement, [test!='']:sizzle );

Though my solr server is running on port8983, I am not using any server to
run this jquery, its just an html file in my home folder that i am opening
in my firefox browser.



-
Kumar Anurag

-- 
View this message in context: 
http://lucene.472066.n3.nabble.com/Jquery-Autocomplete-Json-formatting-tp2101346p2101595.html
Sent from the Solr - User mailing list archive at Nabble.com.


Autosuggest terms which GOOGLE uses?

2010-12-08 Thread Anurag

How Google selects the autosuggest terms? Is that Google uses Userrs
Queries from Log files to suggest only those terms?

-
Kumar Anurag

-- 
View this message in context: 
http://lucene.472066.n3.nabble.com/Autosuggest-terms-which-GOOGLE-uses-tp2039078p2039078.html
Sent from the Solr - User mailing list archive at Nabble.com.


Re: Autosuggest terms which GOOGLE uses?

2010-12-08 Thread Anurag

Thanks a lot!!

If I want to index query terms from lof files ? Is it possible . And then
want to do autosuggest query on all those terms using termsComponentTill
now my autosuggest options are like q.prefix= or q.suffix=   which matches
the terms available in the documents. 

-
Kumar Anurag

-- 
View this message in context: 
http://lucene.472066.n3.nabble.com/Autosuggest-terms-which-GOOGLE-uses-tp2039078p2039307.html
Sent from the Solr - User mailing list archive at Nabble.com.


Re: How to update solr index.

2010-12-07 Thread Anurag

Can you clarify ur question?

-
Kumar Anurag

-- 
View this message in context: 
http://lucene.472066.n3.nabble.com/How-to-update-solr-index-tp2038480p2038580.html
Sent from the Solr - User mailing list archive at Nabble.com.


Re: How to make a client in JSP which will take output from Solr Server

2010-12-04 Thread Anurag

Ok, I solved it by just opening the connection and then parsing the output
from xml to front page. Though It has some security isuue...

-
Kumar Anurag

-- 
View this message in context: 
http://lucene.472066.n3.nabble.com/How-to-make-a-client-in-JSP-which-will-take-output-from-Solr-Server-tp1519527p2019632.html
Sent from the Solr - User mailing list archive at Nabble.com.


Re: Spellcheck in solr-nutch integration

2010-11-29 Thread Anurag

i solved the problemAll we need to modify schema file.

Also the spellcheck index is created first when spellcheck.build=true 

-
Kumar Anurag

-- 
View this message in context: 
http://lucene.472066.n3.nabble.com/Spellcheck-in-solr-nutch-integration-tp1953232p1988252.html
Sent from the Solr - User mailing list archive at Nabble.com.


Re: Spell-Check Component Functionality

2010-11-27 Thread Anurag
 a different

  analyzer/tokenizer and is used if present
   * do not do spellcheck.build=true for every request (creating the
  spellcheck index can be very expensive)
   * if you got spellcheck working embed the spellcheck component into
 your
  normal query component. otherwise you need to query 2 times ...
 
  Regards,
  Peter.
 
 
  All,
 
  I am trying apply the Solr spell check component functionality to
  our
  data.
 
  The configuration set up I needed to make for it by updating
 config.xml
  and
  schema.xml is done as follows..
  Please let me know if any errors in it.
 
   I am not getting any suggestions in suggestion tags of solr output
 xml.
 
  I indexed word Crust to the field textSpell that is enabled for
 spell
  check and then I searched for
  Curst
 
  The queries i tried were :
 
 
 http://localhost:8909/solr/spell?q=Curstspellcheck=truespellcheck.collate=truespellcheck.build=truespellcheck.q=true
 
 
 
 http://localhost:8909/solr/spell?q=Crustespellcheck=truespellcheck.collate=truespellcheck.build=truespellcheck.q=truespellcheck.dictionary=default
 
 
  The CONFIG.XML :
 
  searchComponent name=spellcheck class=solr.SpellCheckComponent
  lst name=spellchecker
str name=namedefault/str
str name=fieldspell/str
str name=spellcheckIndexDir./spellchecker/str
  /lst
 
  !-- a spellchecker that uses a different distance measure --
  lst name=spellchecker
str name=namejarowinkler/str
str name=fieldlowerfilt/str
str
 
 
 name=distanceMeasureorg.apache.lucene.search.spell.JaroWinklerDistance/str

str name=spellcheckIndexDir./spellchecker2/str
  /lst
   str name=queryAnalyzerFieldTypetextSpell/str
  /searchComponent
 
  requestHandler name=/spell class=solr.SearchHandler lazy=true
  lst name=defaults
  str name=spellcheck.dictionarydefault/str
!-- omp = Only More Popular --
str name=spellcheck.onlyMorePopularfalse/str
!-- exr = Extended Results --
str name=spellcheck.extendedResultsfalse/str
!--  The number of suggestions to return --
str name=spellcheck.count1/str
  /lst
  arr name=last-components
strspellcheck/str
  /arr
/requestHandler
 
 
 
  SCHEMA:
 
  fieldType name=textSpell class=solr.TextField
  positionIncrementGap=100
analyzer type=index
  tokenizer class=solr.StandardTokenizerFactory/
  filter class=solr.LowerCaseFilterFactory/
  filter class=solr.StandardFilterFactory/
  filter class=solr.RemoveDuplicatesTokenFilterFactory/
  /analyzer
analyzer type=query
  tokenizer class=solr.StandardTokenizerFactory/
  filter class=solr.LowerCaseFilterFactory/
  filter class=solr.StandardFilterFactory/
  filter class=solr.RemoveDuplicatesTokenFilterFactory/
  /analyzer
  /fieldType
 
 
  field name=spell  type=textSpell  indexed=true stored=true /

 
 
  If any error in above that is not enabling spell check please let me
  know.
 
  The output I am getting is like null  suggetions
 
  lst
  Suggesstions/
  /lst
 
 
  Regards,
  Rajani Maski
 
 
 
  --
  http://jetwick.com http://jetwick.com?by-user=t twitter search
 prototype
 
 
 
 


 --
  View message @
 http://lucene.472066.n3.nabble.com/Spell-Check-Component-Functionality-tp1923954p1939841.html

 To start a new topic under Solr - User, email
 ml-node+472068-1941297125-146...@n3.nabble.comml-node%2b472068-1941297125-146...@n3.nabble.com
 To unsubscribe from Solr - User, click 
 herehttp://lucene.472066.n3.nabble.com/template/NamlServlet.jtp?macro=unsubscribe_by_codenode=472068code=YW51cmFnLml0LmpvbGx5QGdtYWlsLmNvbXw0NzIwNjh8LTIwOTgzNDQxOTY=.





-- 
Kumar Anurag

?xml version=1.0 encoding=UTF-8 ?
!--
 Licensed to the Apache Software Foundation (ASF) under one or more
 contributor license agreements.  See the NOTICE file distributed with
 this work for additional information regarding copyright ownership.
 The ASF licenses this file to You under the Apache License, Version 2.0
 (the License); you may not use this file except in compliance with
 the License.  You may obtain a copy of the License at

 http://www.apache.org/licenses/LICENSE-2.0

 Unless required by applicable law or agreed to in writing, software
 distributed under the License is distributed on an AS IS BASIS,
 WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
 See the License for the specific language governing permissions and
 limitations under the License.
--

config
  !-- Set this to 'false' if you want solr to continue working after it has 
   encountered an severe configuration error.  In a production environment, 
   you may want solr to keep working even if one handler is mis-configured.

   You may also set this to false using by setting the system property:
 -Dsolr.abortOnConfigurationError=false
 --
  
abortOnConfigurationError${solr.abortOnConfigurationError:false}/abortOnConfigurationError

  !-- Used to specify an alternate

Spellcheck in solr-nutch integration

2010-11-23 Thread Anurag

I have integrated solr and nutch using 
http://www.lucidimagination.com/blog/2009/03/09/nutch-solr/ this 

As the tutorial says, the Schema.xml  SolrConfig.xml of Solr has to be
modified. I also did the same. I am using Solr-1.3.
But my problem is that i am not able to implement Spellcheck in this
Solr-nutch integration.

I have got a separate Solr-1.4 where there are options available for
Spellcheck.

What i want to ask is...
1.Indexing for spellcheck is to be done as the same time of indexing the
contents.?What are the steps to follow?

2.How can i implement spellcheck in solr-nutch integration?

please help.


-
Kumar Anurag

-- 
View this message in context: 
http://lucene.472066.n3.nabble.com/Spellcheck-in-solr-nutch-integration-tp1953232p1953232.html
Sent from the Solr - User mailing list archive at Nabble.com.


Java -cp . FileName.java Not Working

2010-09-18 Thread Anurag

Here i hv two compiled files
i am using Solr-1.4
1. SolrJExample.class
 executing $java -cp .  SolrJExample.class gives following error
[anu...@localhost ~]$ java -cp . SolrJExample
Exception in thread main java.lang.NoClassDefFoundError:
org/apache/solr/common/params/SolrParams
Caused by: java.lang.ClassNotFoundException:
org.apache.solr.common.params.SolrParams
at java.net.URLClassLoader$1.run(URLClassLoader.java:217)
at java.security.AccessController.doPrivileged(Native Method)
at java.net.URLClassLoader.findClass(URLClassLoader.java:205)
at java.lang.ClassLoader.loadClass(ClassLoader.java:321)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:294)
at java.lang.ClassLoader.loadClass(ClassLoader.java:266)
at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:334)
Could not find the main class: SolrJExample. Program will exit.



  

2.SimplePostTool.class
 executing $java -cp .SimplePostTool.class gives the following error

 [anu...@localhost ~]$ java -cp . SimplePostTool
Exception in thread main java.lang.NoClassDefFoundError: SimplePostTool
(wrong name: org/apache/solr/util/SimplePostTool)
at java.lang.ClassLoader.defineClass1(Native Method)
at java.lang.ClassLoader.defineClass(ClassLoader.java:634)
at 
java.security.SecureClassLoader.defineClass(SecureClassLoader.java:142)
at java.net.URLClassLoader.defineClass(URLClassLoader.java:277)
at java.net.URLClassLoader.access$000(URLClassLoader.java:73)
at java.net.URLClassLoader$1.run(URLClassLoader.java:212)
at java.security.AccessController.doPrivileged(Native Method)
at java.net.URLClassLoader.findClass(URLClassLoader.java:205)
at java.lang.ClassLoader.loadClass(ClassLoader.java:321)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:294)
at java.lang.ClassLoader.loadClass(ClassLoader.java:266)
at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:334)
Could not find the main class: SimplePostTool. Program will exit.

U can find the class files 
http://code.google.com/p/intranetsearchengine/downloads/list here 

Please Help in executing these programs , i am trying to make a search
client which will send the query to solr index and get the result back to
the client.

Thanks

-
Kumar Anurag

-- 
View this message in context: 
http://lucene.472066.n3.nabble.com/Java-cp-FileName-java-Not-Working-tp1519501p1519501.html
Sent from the Solr - User mailing list archive at Nabble.com.


How to make a client in JSP which will take output from Solr Server

2010-09-18 Thread Anurag

Actually i have Crwaled the data using Nutch-1.0 and Indexxed it to Solr -1.3
(using this http://www.lucidimagination.com/blog/2009/03/09/nutch-solr/ 
tutorial   )

Now i want to create a page in JSP that will be a Simple Search Form where i
need to ask Query From Users. This JSP page will be accessible via TOMCAT
server or APACHE  Web Server. Now After entering the Query the page should
http request
http://localhost:8983/solr/select?q=SomeQuery;
Then the result obtained from that Solr Server Should Come back to Search
form in JSP and The results should be displayed like in XML or XSL or JSON
format.

Please Suggest some tutorials, or Some Examples
i am thankful to u all


-
Kumar Anurag

-- 
View this message in context: 
http://lucene.472066.n3.nabble.com/How-to-make-a-client-in-JSP-which-will-take-output-from-Solr-Server-tp1519527p1519527.html
Sent from the Solr - User mailing list archive at Nabble.com.


lucene + solr: corrupt index

2010-08-23 Thread ANurag
Hi,
I am using lucene 3.0 jars and built a lucene index with 200
documents. The index files were then copied over to my solr 1.4.1
installation. I get the following error every time I start SOLR:
What could I be doing wrong?

SEVERE: Could not start SOLR. Check solr/home property
java.lang.RuntimeException:
org.apache.lucene.index.CorruptIndexException: Incompatible format
version: 2 expected 1 or lower
at org.apache.solr.core.SolrCore.getSearcher(SolrCore.java:1068)
at org.apache.solr.core.SolrCore.init(SolrCore.java:579)
at 
org.apache.solr.core.CoreContainer$Initializer.initialize(CoreContainer.java:137)
at 
org.apache.solr.servlet.SolrDispatchFilter.init(SolrDispatchFilter.java:83)
at org.mortbay.jetty.servlet.FilterHolder.doStart(FilterHolder.java:99)
at 
org.mortbay.component.AbstractLifeCycle.start(AbstractLifeCycle.java:40)
at 
org.mortbay.jetty.servlet.ServletHandler.initialize(ServletHandler.java:594)
at org.mortbay.jetty.servlet.Context.startContext(Context.java:139)
at 
org.mortbay.jetty.webapp.WebAppContext.startContext(WebAppContext.java:1218)
at 
org.mortbay.jetty.handler.ContextHandler.doStart(ContextHandler.java:500)
at 
org.mortbay.jetty.webapp.WebAppContext.doStart(WebAppContext.java:448)
at 
org.mortbay.component.AbstractLifeCycle.start(AbstractLifeCycle.java:40)
at 
org.mortbay.jetty.handler.HandlerCollection.doStart(HandlerCollection.java:147)
at 
org.mortbay.jetty.handler.ContextHandlerCollection.doStart(ContextHandlerCollection.java:161)
at 
org.mortbay.component.AbstractLifeCycle.start(AbstractLifeCycle.java:40)
at 
org.mortbay.jetty.handler.HandlerCollection.doStart(HandlerCollection.java:147)
at 
org.mortbay.component.AbstractLifeCycle.start(AbstractLifeCycle.java:40)
at 
org.mortbay.jetty.handler.HandlerWrapper.doStart(HandlerWrapper.java:117)
at org.mortbay.jetty.Server.doStart(Server.java:210)
at 
org.mortbay.component.AbstractLifeCycle.start(AbstractLifeCycle.java:40)
at org.mortbay.xml.XmlConfiguration.main(XmlConfiguration.java:929)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at org.mortbay.start.Main.invokeMain(Main.java:183)
at org.mortbay.start.Main.start(Main.java:497)
at org.mortbay.start.Main.main(Main.java:115)
Caused by: org.apache.lucene.index.CorruptIndexException: Incompatible
format version: 2 expected 1 or lower
at org.apache.lucene.index.FieldsReader.init(FieldsReader.java:117)
at 
org.apache.lucene.index.SegmentReader$CoreReaders.openDocStores(SegmentReader.java:291)
at org.apache.lucene.index.SegmentReader.get(SegmentReader.java:654)
at org.apache.lucene.index.SegmentReader.get(SegmentReader.java:613)
at 
org.apache.lucene.index.DirectoryReader.init(DirectoryReader.java:104)
at 
org.apache.lucene.index.ReadOnlyDirectoryReader.init(ReadOnlyDirectoryReader.java:27)
at 
org.apache.lucene.index.DirectoryReader$1.doBody(DirectoryReader.java:74)
at 
org.apache.lucene.index.SegmentInfos$FindSegmentsFile.run(SegmentInfos.java:683)
at org.apache.lucene.index.DirectoryReader.open(DirectoryReader.java:69)
at org.apache.lucene.index.IndexReader.open(IndexReader.java:476)
at org.apache.lucene.index.IndexReader.open(IndexReader.java:403)
at 
org.apache.solr.core.StandardIndexReaderFactory.newReader(StandardIndexReaderFactory.java:38)
at org.apache.solr.core.SolrCore.getSearcher(SolrCore.java:1057)
... 27 more


Re: lucene + solr: corrupt index

2010-08-23 Thread ANurag
Thx Koji, I tried 2.9.3 and it works :-)


On Mon, Aug 23, 2010 at 6:15 PM, Koji Sekiguchi k...@r.email.ne.jp wrote:
  (10/08/24 10:02), ANurag wrote:

 Hi,
 I am using lucene 3.0 jars and built a lucene index with 200
 documents. The index files were then copied over to my solr 1.4.1
 installation. I get the following error every time I start SOLR:
 What could I be doing wrong?

 Solr 1.4 can read Lucene 2.9 index or older.

 Koji

 --
 http://www.rondhuit.com/en/