Re: Solr performance

Alright. It turned out that defaultSearchField=title where title field is of a custom fieldType=edgyText where so if no value in the "q" parameter is passed, solr picks up default field, which is tiltle of type "edgyText" taking a very long time to return results. Is there a way to IGN

Solr performance

I have some 25 odd fields with "stored=true" in schema.xml. Retrieving back 5,000 records back takes a few secs. I also tried passing "fl" and only include one field in the response but still response time is same. What are the things to look to tune the performance. Thanks, -- View this message

Re: Custom request handler/plugin

Thanks for the response. Finally I have decided to build access intelligence into the Solr to pre filter the results by storing required attributes in the index to determine the access. -- View this message in context: http://lucene.472066.n3.nabble.com/Custom-request-handler-plugin-tp2673822p26

Re: Custom request handler/plugin

Below are the reasons why I thought it wouldn't be feasible to have pre-filtered results with filter queries. please comment. Since can't pen down direct business reqs due to confidentially contact with the client, I'll mock out scenario using an example. - There is a parent entity called "Quiz",

Custom request handler/plugin

I have a requirement to filter solr results, based on my application entitlement rules,before they are returned from Solr to the application. In order to do this, I have to implement a custom plugin, which gets entire solr results and apply my application rules (which will be exposed via web servic

Smart Pagination queries

e.g. There are 4,000 solr documents that were found for a particular word search. My app has entitlement rules applied to those 4,000 documents and it's quite possible that user is only eligible to view 3,000 results out of 4K. This is achieved through post filtering application logic. My questio

Partial search extremly slow

Since my users wanted to have a partial search functionality I had to introduce following. I have declared two EdgeNGram filters with both side "back" and "front" since they wanted to have partial search working from any side. When executing search (which brings back 4K plus reco

Numeric search in text field

Hello, I have a string "Marsh 1" (no quotes while searching). If I put "Marsh 1" in the search box with no quotes I get expected results back but when I search for just "1" (again no quotes) I don't get any results back. I use WorldDelimiterFactory as follow. Any idea? --

Boost, weight, proximity, ranking which one?

I am using solr 1.4 version. I have a requirement where need to show up all documents first which matched most words from the free text search string. e.g. If user was searching for two words with no quotes "connectivity breakup" my search results should display all documents where both words mat

HttpDataSource consume REST API with Authentication required

I have to use http://wiki.apache.org/solr/DataImportHandler#Usage_with_XML.2BAC8-HTTP_Datasource HttpDataSource to ask Solr consume my REST service and index data returned from that service. My application/service has authentication/authorization. When Solr invokes this service it MUST have vali

Good literature on search basics

Does anyone know good literature(web resources, books etc) on basics of search? I do have Solr 1.4 and Lucene books but wanted to go in more details on basics. Thanks, -- View this message in context: http://old.nabble.com/Good-literature-on-search-basics-tp27562021p27562021.html Sent from the

Re: DataImportHandler can't understand query

Note I already tried to escape < character with \< but still it throws same error. Any idea? Thanks, javaxmlsoapdev wrote: > > I have a complex query (runs fine in database), which I am trying to > include in DataImportHandler query. Query has case statements with < &

DataImportHandler can't understand query

I have a complex query (runs fine in database), which I am trying to include in DataImportHandler query. Query has case statements with < > in it e.g. case when (ASSIGNED_TO < > '' and TRANSLATE(ASSIGNED_TO, '', '0123456789')='') DataImportHandler failes to understand query with follow

Re: Any idea what could be wrong with this fq value?

t; index, and maybe even stemmed. > > Try &q=*:*&facet=on&facet.field=groupName to see all the *indexed* > values of the groupName field. > > Erik > > On Feb 3, 2010, at 10:05 AM, javaxmlsoapdev wrote: > >> >> Following is my solr URL. &g

Any idea what could be wrong with this fq value?

Following is my solr URL. http://hostname:port/solr/entities/select/?version=2.2&start=0&indent=on&qt=dismax&rows=60&fq=statusName:(Open OR Cancelled)&debugQuery=true&q=dev&fq=groupName:"Infrastructure“ “groupName” is one of the attributes I create fq (filterQuery) on. This field(groupName) is

RE: weird text stripping issue

Analyzers are default. anything in particular to look for? ANKITBHATNAGAR wrote: > > > Check you analyzers > > Ankit > > -Original Message- > From: javaxmlsoapdev [mailto:vika...@yahoo.com] > Sent: Thursday, January 28, 2010 4:46 PM > To: solr-user@luce

weird text stripping issue

I am observing very weird text stripping issue. when I search for word "Search" I get following Issue 18 Search String 4688 Issue 18 Search String2 And highliting node Issue 18 Search String2 Issue 18 Search String My actual description string is "Issue 18

Build index by consuming web service

I am in a need of a handler which consumes web serivce and builds index from return results of the service. Until now I was building index by reading data directly from database query using DataImportHandler. There are new functional requirements to index calculated fields in the index and allow

Re: Searching .msg files

1)use tika to index .msg files (Tika does support Microsoft outlook format and I am already using Tika: http://lucene.apache.org/tika/formats.html). 2)while indexing you'll have to write handler to extract To, CC, Bcc values and store it in a separate field in index. 3)when user searches on .msg

Re: store content only of documents

Anyone? javaxmlsoapdev wrote: > > I store document in a field "content" field defiend as follow in > schema.xml > multiValued="true"/> > > and following in solrconfig.xml > class="org.apache.solr.handler.extraction.ExtractingReques

store content only of documents

I store document in a field "content" field defiend as follow in schema.xml and following in solrconfig.xml content content I want to store only "content" into this field but it store other meta data of a document e.g. "Author", "timestamp", "document type" etc. how ca

how to set multiple fq while building a query in solrj

how do I create a query string witih multiple fq params using solrj SolrQuery API. e.g. I want to build a query as follow http://servername:port/solr/issues/select/?q=testing&fq=statusName:(Female OR Male)&fq=name="Joe" I am using solrj client APIs to build query and using SolrQuery as follow

Re: dismax query syntax to replace standard query

to be confused > with qf) to add a "filter query" in addition to the q parameter. > > So your text search value goes in q parameter (which searches on the > fields > you configure) and the rest of the query goes in the fq. > > Would that work? > > On Thu, D

dismax query syntax to replace standard query

I have configured dismax handler to search against both "title" & "description" fields now I have some other attributes on the page e.g. "status", "name" etc. On the search page I have three fields for user to input search values 1)Free text search field (which searchs against both "title" & "des

Solr plugin or something else for custom work?

I have a requirement where I am indexing attachements. Attachements hang off of a database entity(table). I also need to include some meta-data info from the database table as part of the index. Trying to find best way to implement using custom handler or something? where custom handler gets all r

Re: Batch file upload using solrJ API

Any suggestion/pointers on this? javaxmlsoapdev wrote: > > Is there an API to upload files over one connection versus looping through > all the files and creating new ContentStreamUpdateRequest for each file. > This, as expected, doesn't work if there are large number of files

Re: Where to put ExternalRequestHandler and Tika jars

ex the data with solrj and I > have > the same problem and could not retrieve file data. > > > On Wed, Nov 25, 2009 at 3:41 PM, javaxmlsoapdev wrote: > >> >> g. I had to include tika and related parsing jars into >> tomcat/webapps/solr/WEB-INF/lib.. thi

Batch file upload using solrJ API

Is there an API to upload files over one connection versus looping through all the files and creating new ContentStreamUpdateRequest for each file. This, as expected, doesn't work if there are large number of files and quickly run into memory problems. Please advise. Thanks, -- View this messa

Re: Where to put ExternalRequestHandler and Tika jars

g. I had to include tika and related parsing jars into tomcat/webapps/solr/WEB-INF/lib.. this was an embarrassing mistake. apologies for all the noise. Thanks, -- View this message in context: http://old.nabble.com/Where-to-put-ExternalRequestHandler-and-Tika-jars-tp26515579p26518100.h

Where to put ExternalRequestHandler and Tika jars

My SOLR_HOME =/home/solr_1_4_0/apache-solr-1.4.0/example/solr/conf in tomcat.sh POI, PDFBox, Tika and related jars are under /home/solr_1_4_0/apache-solr-1.4.0/lib When I try to index files using SolrJ API as follow, I don't see content of the file being indexed. It only indexes file size (bytes

Re: ExternalRequestHandler and ContentStreamUpdateRequest usage

to do. Please advie. let me know if you need anything else. Appreciate your help. Thanks, javaxmlsoapdev wrote: > > Following is luke response. is empty. can someone > assist to find out why file content isn't being index? > > > > > 0 > 0 > >

Re: ExternalRequestHandler and ContentStreamUpdateRequest usage

y (df) is not updated when a document is marked for deletion. df values include deleted documents. javaxmlsoapdev wrote: > > I was able to configure /docs index separately from my db data index. > > still I am seeing same behavior where it only puts .docName & its size in >

Re: ExternalRequestHandler and ContentStreamUpdateRequest usage

I was able to configure /docs index separately from my db data index. still I am seeing same behavior where it only puts .docName & its size in the "content" field (I have renamed field to "content" in this new schema) below are the only two fields I have in schema.xml Following is updat

Re: ExternalRequestHandler and ContentStreamUpdateRequest usage

; assertEquals( 1, rsp.getResults().getNumFound() ); System.out.println(rsp.getResults().get(0).getFieldValue("content")); Also from solr admin UI when I search for "doc123.txt" then only it returns me following response. not sure why its not indexing file's content into "

Re: ExternalRequestHandler and ContentStreamUpdateRequest usage

way to achieve this. thanks, Grant Ingersoll-6 wrote: > > > On Nov 23, 2009, at 5:33 PM, javaxmlsoapdev wrote: > >> >> *:* returns me 1 count but when I search for specific word (which was >> part of >> .txt file I indexed before) it doesn't return me

Re: ExternalRequestHandler and ContentStreamUpdateRequest usage

"description" attribute. Any idea? Thanks, javaxmlsoapdev wrote: > > *:* returns me 1 count but when I search for specific word (which was part > of .txt file I indexed before) it doesn't return me anything. I don't have > luke setup on my end. let me see if I ca

Re: ExternalRequestHandler and ContentStreamUpdateRequest usage

something? which maps document "content" to wrong attribute? thanks, Grant Ingersoll-6 wrote: > > > On Nov 23, 2009, at 5:04 PM, javaxmlsoapdev wrote: > >> >> Following code is from my test case where it tries to index a file (of >> ty

ExternalRequestHandler and ContentStreamUpdateRequest usage

Following code is from my test case where it tries to index a file (of type .txt) ContentStreamUpdateRequest up = new ContentStreamUpdateRequest("/update/extract"); up.addFile(fileToIndex); up.setParam("literal.key", "8978"); //key is the uniqueId up.setParam("ext.literal.docName", "doc123.txt");

Re: How to use DataImportHandler with ExtractingRequestHandler?

Anyone any idea? javaxmlsoapdev wrote: > > did you extend DIH to do this work? can you share code samples. I have > similar requirement where I need tp index database records and each record > has a column with document path so need to create another index for > documents (we

Very busy search screen

I have a client who wants to search on almost every attribute of an object (nearly 15 attributes) on the search screen. Search sreen looks very crazy/busy. I was wondering if there are better ways to address these requirements and build intelligent categorized/configurable searchs? including allow

RE: Index documents with Solr

sthandler. I know how the id will map > but not clear yet how to get that id to ExtractingRequestHandler. Would be > good to see different examples on the Wiki. Have not yet had a first > attempt - hoping to in a day or so. > > > -----Original Message- > From: javaxmlsoa

Re: How to use DataImportHandler with ExtractingRequestHandler?

did you extend DIH to do this work? can you share code samples. I have similar requirement where I need tp index database records and each record has a column with document path so need to create another index for documents (we allow users to search both index separately) in parallel with reading

Re: how to search against multiple attributes in the index

gt; > For your impatience, here's a quick starter - > > #and between two fields > solrQuery.setQuery("+field1:foo +field2:bar"); > > #or between two fields > solrQuery.setQuery("field1:foo field2:bar"); > > Cheers > Avlesh > > On Fri,

Re: how to search against multiple attributes in the index

/document/f4d91628ced293bf/lucene_query_to_solr_query > > Cheers > Avlesh > > On Fri, Nov 13, 2009 at 10:02 PM, javaxmlsoapdev > wrote: > >> >> I already did dive in before. I am using solrj API and SolrQuery object >> to >> build query. but its not clea

Re: how to search against multiple attributes in the index

> Cheers > Avlesh > > On Fri, Nov 13, 2009 at 9:39 PM, javaxmlsoapdev wrote: > >> >> I want to build AND search query against field1 AND field2 etc. Both >> these >> fields are stored in an index. I am migrating lucene code to Solr. >> Foll

how to search against multiple attributes in the index

I want to build AND search query against field1 AND field2 etc. Both these fields are stored in an index. I am migrating lucene code to Solr. Following is my existing lucene code BooleanQuery currentSearchingQuery = new BooleanQuery(); currentSearchingQuery.add(titleDescQuery,Occur.MUST); highli

Index documents with Solr

Wanted to find out how people are using Solr’s ExtractingRequestHandler to index different types of documents from a configuration file in an import fashion. I want to use this handler in a similar way how DataImportHandler works where you can issue “import” command from the URL to create an index

can't find solr.xml

I have downloaded apache-solr-1.3.0.tgz for Linux and don't see solr.xml. can someone assist. -- View this message in context: http://old.nabble.com/can%27t-find-solr.xml-tp26136630p26136630.html Sent from the Solr - User mailing list archive at Nabble.com.