Re: Hash range to shard assignment

2013-09-24 Thread Noble Paul നോബിള്‍ नोब्ळ्
That is in the pipeline. within next 3-4 months for sure On Mon, Sep 23, 2013 at 11:07 PM, lochri loc...@web.de wrote: Yes, actually that would be a very comfortable solution. Is that planned ? And if so, when will it be released ? -- View this message in context:

Re: Hash range to shard assignment

2013-09-23 Thread Noble Paul നോബിള്‍ नोब्ळ्
Custom routers is an idea that is floated around ad easy to implement. Just that it is something we resist to add another extension point. The point is we are planning other features which would obviate the need for a custom router. Something like splitting a shard by a query. Will it be a good

Re: Hash range to shard assignment

2013-09-20 Thread Noble Paul നോബിള്‍ नोब्ळ्
This would need you to plug your own router . It is not yet possible But , you can split that shard repeatedly and keep the no:of users in that shard limited On Fri, Sep 20, 2013 at 3:52 PM, lochri loc...@web.de wrote: Hello folks, we would like to have control of where certain hash values

Re: dataconfig to index ZIP Files

2013-07-01 Thread Noble Paul നോബിള്‍ नोब्ळ्
IIRC Zip files are not supported On Mon, Jul 1, 2013 at 10:30 PM, ericrs22 ericr...@yahoo.com wrote: To answer the previous Post: I was not sure what datasource=binaryFile I took it from a PDF sample thinking that would help. after setting datasource=null I'm still gett the same errors...

Re: DataImportHandler: Problems with delta-import and CachedSqlEntityProcessor

2013-06-20 Thread Noble Paul നോബിള്‍ नोब्ळ्
it is possible to create two separate root entities . one for full-import and another for delta. for the delta-import you can skip Cache that way On Thu, Jun 20, 2013 at 1:50 PM, Constantin Wolber constantin.wol...@medicalcolumbus.de wrote: Hi, i searched for a solution for quite some time

Re: DataImportHandler: Problems with delta-import and CachedSqlEntityProcessor

2013-06-20 Thread Noble Paul നോബിള്‍ नोब्ळ्
it. Regards Constantin -Ursprüngliche Nachricht- Von: Noble Paul നോബിള്‍ नोब्ळ् [mailto:noble.p...@gmail.com] Gesendet: Donnerstag, 20. Juni 2013 15:42 An: solr-user@lucene.apache.org Betreff: Re: DataImportHandler: Problems with delta-import and CachedSqlEntityProcessor

Re: Replication not working

2013-06-11 Thread Noble Paul നോബിള്‍ नोब्ळ्
can you check with the indexversion command on both mater and slave? pollInterval is set to 2 minutes. It is usually long . So you may need to wait for 2 mins for the replication to kick in On Tue, Jun 11, 2013 at 3:21 PM, thomas.poroc...@der.net wrote: Hi all, we have a setup with

Re: Replication not working

2013-06-11 Thread Noble Paul നോബിള്‍ नोब्ळ्
/response pollInterval is set to 2 minutes. It is usually long I know ;-) -Ursprüngliche Nachricht- Von: Noble Paul നോബിള്‍ नोब्ळ् [mailto:noble.p...@gmail.com] Gesendet: Dienstag, 11. Juni 2013 13:16 An: solr-user@lucene.apache.org Betreff: Re: Replication not working can you

Re: Replication not working

2013-06-11 Thread Noble Paul നോബിള്‍ नोब्ळ्
} -Ursprüngliche Nachricht- Von: Noble Paul നോബിള്‍ नोब्ळ् [mailto:noble.p...@gmail.com] Gesendet: Dienstag, 11. Juni 2013 13:41 An: solr-user@lucene.apache.org Betreff: Re: Replication not working You said polling is happening and nothing is replicated What do the logs say on slave

Re: LotsOfCores feature

2013-06-10 Thread Noble Paul നോബിള്‍ नोब्ळ्
of quick searches and found mostly older wikis that say solr replication will change in the future. Would you be able to point me to the right one? - On Fri, Jun 7, 2013 at 8:34 PM, Noble Paul നോബിള്‍ नोब्ळ् noble.p...@gmail.com wrote: We set it up like this + individual solr instances

Re: LotsOfCores feature

2013-06-07 Thread Noble Paul നോബിള്‍ नोब्ळ्
The Wiki page was built not for Cloud Solr. We have done such a deployment where less than a tenth of cores were active at any given point in time. though there were tens of million indices they were split among a large no:of hosts. If you don't insist of Cloud deployment it is possible. I'm

Re: SOLR CSV output in custom order

2013-06-07 Thread Noble Paul നോബിള്‍ नोब्ळ्
Have you tried explicitly giving the field names (fl) as parameter http://wiki.apache.org/solr/CommonQueryParameters#fl On Thu, Jun 6, 2013 at 12:41 PM, anurag.jain anurag.k...@gmail.com wrote: I want output of csv file in proper order. when I use wt=csv it gives output in random order. Is

Re: LotsOfCores feature

2013-06-07 Thread Noble Paul നോബിള്‍ नोब्ळ्
We set it up like this + individual solr instances are setup + external mapping/routing to allocate users to instances. This information can be stored in an external data store + all cores are created as transient and loadonstart as false + cores come online on demand + as and when users data get

Re: Upgrading from SOLR 3.5 to 4.2.1 Results.

2013-05-23 Thread Noble Paul നോബിള്‍ नोब्ळ्
Actually , It's pretty high end for most of the users. Rishi, u can post the real h/w details and our typical deployment . No :of cpus per node No :of disks per host Vms per host Gc params No :of cores per instance Noble Paul Sent from phone On 21 May 2013 01:47, Rishi Easwaran

Re: javabin binary format specification

2012-08-23 Thread Noble Paul നോബിള്‍ नोब्ळ्
There is no spec documented anywhere . It is all in this single file https://svn.apache.org/repos/asf/lucene/dev/trunk/solr/solrj/src/java/org/apache/solr/common/util/JavaBinCodec.java On Wed, Jul 25, 2012 at 6:47 PM, Ahmet Arslan iori...@yahoo.com wrote: Sorry, but I could not find any spec

Re: @field for child object

2011-07-06 Thread Noble Paul നോബിള്‍ नोब्ळ्
no On Mon, Jul 4, 2011 at 3:34 PM, Kiwi de coder kiwio...@gmail.com wrote: hi, i wondering solrj @Field annotation support embedded child object ? e.g. class A {  @field  string somefield;  @emebedded  B b; } regards, kiwi --

Re: Re; DIH Scheduling

2011-06-24 Thread Noble Paul നോബിള്‍ नोब्ळ्
On Thu, Jun 23, 2011 at 9:13 PM, simon mtnes...@gmail.com wrote: The Wiki page describes a design for a scheduler, which has not been committed to Solr yet (I checked). I did see a patch the other day (see https://issues.apache.org/jira/browse/SOLR-2305) but it didn't look well tested. I

Re: Where is LogTransformer log file path??

2011-06-21 Thread Noble Paul നോബിള്‍ नोब्ळ्
it will be in the solr logs On Tue, Jun 21, 2011 at 2:18 PM, Alucard alucard...@gmail.com wrote: Hi all. I follow the steps of creating a LogTransformer in DataImportHandler wiki: entity name=office_address dataSource=jdbc pk=office_add_Key transformer=LogTransformer logLevel=debug        

Re: Need help with DIH dataconfig.xml

2011-06-16 Thread Noble Paul നോബിള്‍ नोब्ळ्
Use TemplateTransformer dataConfig dataSource name = wld type=JdbcDataSource driver=com.mysql.jdbc.Driver url=jdbc:mysql://localhost/wld user=root password=pass/ document name=variants

Re: DIH entity threads

2011-06-15 Thread Noble Paul നോബിള്‍ नोब्ळ्
Sub entities can slow down indexing remarkably.What is that datasource? DB? then try using CachedSqlEntityProcessor On Tue, Jun 14, 2011 at 8:31 PM, Mark static.void@gmail.com wrote: Hello all, We are using DIH to index our data (~6M documents) and its taking an extremely long time (~24

Re: Throttling replication

2010-09-02 Thread Noble Paul നോബിള്‍ नोब्ळ्
There is no way to currently throttle replication. It consumes the whole bandwidth available. It is a nice to have feature On Thu, Sep 2, 2010 at 8:11 PM, Mark static.void@gmail.com wrote:  Is there any way or forthcoming patch that would allow configuration of how much network bandwith

Re: Dynamic dataConfig files in DIH

2010-06-12 Thread Noble Paul നോബിള്‍ नोब्ळ्
On Fri, Jun 11, 2010 at 11:13 PM, Chris Hostetter hossman_luc...@fucit.orgwrote: : Is there a way to dynamically point which dataConfig file to use to import : using DIH without using the defaults hardcoded in solrconfig.xml? what do you mean by dynamically ? ... it's a query param, so you

Re: Solr DataConfig / DIH Question

2010-06-12 Thread Noble Paul നോബിള്‍ नोब्ळ्
this looks like a common problem. I guess DIH should handle this more gracefully. Instead of firing a query and failing it should not fire a query if any of the values are missing . This can b made configurable if needed On Sun, Jun 13, 2010 at 9:14 AM, Lance Norskog goks...@gmail.com wrote:

Re: TikaEntityProcessor on Solr 1.4?

2010-05-22 Thread Noble Paul നോബിള്‍ नोब्ळ्
just copy the dih-extras jar file from the nightly should be fine On Sat, May 22, 2010 at 3:12 AM, Sixten Otto six...@sfko.com wrote: On Fri, May 21, 2010 at 5:30 PM, Chris Harris rygu...@gmail.com wrote: Actually, rather than cherry-pick just the changes from SOLR-1358 and SOLR-1583 what I

Re: TikaEntityProcessor on Solr 1.4?

2010-05-19 Thread Noble Paul നോബിള്‍ नोब्ळ्
I guess it should work because Tika Entityprocessor does not use any new 1.4 APIs On Wed, May 19, 2010 at 1:17 AM, Sixten Otto six...@sfko.com wrote: Sorry to repeat this question, but I realized that it probably belonged in its own thread: The TikaEntityProcessor class that enables

Re: Issue with delta import (not finding data in a column)

2010-05-12 Thread Noble Paul നോബിള്‍ नोब्ळ्
Are u reusing the context object? It may help if u can paste the relevant part of ur code On 10 May 2010 19:03, ahammad ahmed.ham...@gmail.com wrote: I have a Solr core that retrieves data from an Oracle DB. The DB table has a few columns, one of which is a Blob that represents a PDF document.

Re: Custom DIH EventListeners

2010-05-06 Thread Noble Paul നോബിള്‍ नोब्ळ्
nope. register any event listener and check for the context.currentProcess() to figure out what is the event On Thu, May 6, 2010 at 8:21 AM, Blargy zman...@hotmail.com wrote: I know one can create custom event listeners for update or query events, but is it possible to create one for any DIH

Re: Custom DIH variables

2010-05-06 Thread Noble Paul നോബിള്‍ नोब्ळ्
you can use the core from this API and use EmbeddedSolrServer (part of solrj) . So the calls will be in-vm On Thu, May 6, 2010 at 6:08 AM, Blargy zman...@hotmail.com wrote: Thanks Noble this is exactly what I was looking for. What is the preferred way to query solr within these sorts of

Re: Custom DIH variables

2010-05-05 Thread Noble Paul നോബിള്‍ नोब्ळ्
ok , u can't write a variable. But you may write a function (Evaluator). it will look something like ${dataimporter.functions.foo()} http://wiki.apache.org/solr/DataImportHandler#Custom_formatting_in_query_and_url_using_Functions On Wed, May 5, 2010 at 9:12 PM, Blargy zman...@hotmail.com wrote:

Re: Custom DIH variables

2010-05-04 Thread Noble Paul നോബിള്‍ नोब्ळ्
you can use custom parameters from request like , ${dataimporter.request.foo}. pass the value of foo as a request param say foo=bar On Wed, May 5, 2010 at 6:05 AM, Blargy zman...@hotmail.com wrote: Can someone please point me in the right direction (classes) on how to create my own custom dih

Re: DIH: inner select fails when outter entity is null/empty

2010-04-25 Thread Noble Paul നോബിള്‍ नोब्ळ्
do an onError=skip on the inner entity On Fri, Apr 23, 2010 at 3:56 AM, Otis Gospodnetic otis_gospodne...@yahoo.com wrote: Hello, Here is a newbie DataImportHandler question: Currently, I have entities with entities.  There are some situations where a column value from the outer entity is

Re: DIH best pratices question

2010-03-27 Thread Noble Paul നോബിള്‍ नोब्ळ्
On Sat, Mar 27, 2010 at 3:25 AM, Blargy zman...@hotmail.com wrote: I have a items table on db1 and and item_descriptions table on db2. The items table is very small in the sense that it has small columns while the item_descriptions table has a very large text field column. Both tables are

Re: expungeDeletes on commit in Dataimport

2010-03-27 Thread Noble Paul നോബിള്‍ नोब्ळ्
On Thu, Mar 25, 2010 at 10:14 PM, Ruben Chadien ruben.chad...@aspiro.com wrote: Hi I know this has been discussed before, but is there any way do expungeDeletes=true when the DataImportHandler does the commit. expungeDeletes= true is not used does not mean that the doc does not get

Re: ReplicationHandler reports incorrect replication failures

2010-03-27 Thread Noble Paul നോബിള്‍ नोब्ळ्
please create a bug On Fri, Mar 26, 2010 at 7:29 PM, Shawn Smith ssmit...@gmail.com wrote: We're using Solr 1.4 Java replication, which seems to be working nicely.  While writing production monitors to check that replication is healthy, I think we've run into a bug in the status reporting of

Re: XPath Processing Applied to Clob

2010-03-17 Thread Noble Paul നോബിള്‍ नोब्ळ्
keep in mind that the xpath is case-sensitive. paste a sample xml what is dataField=d.text it does not seem to refer to anything. where is the enclosing entity? did you mean dataField=doc.text. xpath=//BODY is a supported syntax as long as you are using Solr1.4 or higher On Thu, Mar 18,

Re: Is it possible to use ODBC with DIH?

2010-03-07 Thread Noble Paul നോബിള്‍ नोब्ळ्
if you have a jdbc-odbc bridge driver , it should be fine On Sun, Mar 7, 2010 at 4:52 AM, JavaGuy84 bbar...@gmail.com wrote: Hi, I have a ODBC driver with me for MetaMatrix DB(Redhat). I am trying to figure out a way to use DIH using the DSN which has been created in my machine with that

Re: If you could have one feature in Solr...

2010-03-06 Thread Noble Paul നോബിള്‍ नोब्ळ्
On Fri, Mar 5, 2010 at 4:34 AM, Mark Miller markrmil...@gmail.com wrote: On 03/04/2010 05:56 PM, Chris Hostetter wrote: : The ability to read solr configuration files from the classpath instead of : solr.solr.home directory. Solr has always supported this. When

Re: replication issue

2010-03-01 Thread Noble Paul നോബിള്‍ नोब्ळ्
The data/index.20100226063400 dir is a temporary dir and isc reated in the same dir where the index dir is located. I'm wondering if the symlink is causing the problem. Why don't you set the data dir as /raid/data instead of /solr/data On Sat, Feb 27, 2010 at 12:13 AM, Matthieu Labour

Re: Using XSLT with DIH for a URLDataSource

2010-02-28 Thread Noble Paul നോബിള്‍ नोब्ळ्
Paul നോബിള്‍  नोब्ळ् noble.p...@gmail.com: you are right. The StreamSource class is not throwing the proper exception Do we really have to handle this.? On Thu, Feb 25, 2010 at 9:06 AM, Lance Norskog goks...@gmail.com wrote: [Taken off the list] The problem is that the XSLT code swallows

Re: If you could have one feature in Solr...

2010-02-28 Thread Noble Paul നോബിള്‍ नोब्ळ्
On Wed, Feb 24, 2010 at 7:18 PM, Patrick Sauts patrick.via...@gmail.com wrote: Synchronisation between the slaves to switch the new index at the same time after replication. I shall open as issue for this. And let us figure out how best it should be done

Re: Using XSLT with DIH for a URLDataSource

2010-02-24 Thread Noble Paul നോബിള്‍ नोब्ळ्
you are right. The StreamSource class is not throwing the proper exception Do we really have to handle this.? On Thu, Feb 25, 2010 at 9:06 AM, Lance Norskog goks...@gmail.com wrote: [Taken off the list] The problem is that the XSLT code swallows the real exception, and does not return it as

Re: error while using the DIH handler

2010-02-23 Thread Noble Paul നോബിള്‍ नोब्ळ्
can you paste the DIH part in your solrconfig.xml ? On Tue, Feb 23, 2010 at 7:01 PM, Na_D nabam...@zaloni.com wrote: yes i did check the location of the data-config.xml its in the folder example-DIH/solr/db/conf -- View this message in context:

Re: Using XSLT with DIH for a URLDataSource

2010-02-22 Thread Noble Paul നോബിള്‍ नोब्ळ्
The xslt file looks fine . is the location of the file correct ? On Mon, Feb 22, 2010 at 2:57 PM, Roland Villemoes r...@alpha-solutions.dk wrote: Hi (thanks a lot) Yes, The full stacktrace is this: 22-02-2010 08:37:00 org.apache.solr.handler.dataimport.DataImporter doFullImport

Re: replications issue

2010-02-20 Thread Noble Paul നോബിള്‍ नोब्ळ्
wha is the problem. Is the replication not happening after you do a commit on the master? frequent polling is not a problem. frequent commits can slow down the system On Fri, Feb 19, 2010 at 2:41 PM, giskard gisk...@autistici.org wrote: Ciao, Uhm after some time a new index in data/index on

Re: @Field annotation support

2010-02-20 Thread Noble Paul നോബിള്‍ नोब्ळ्
-solrj-1.4.0.jar/org\apache\solr\client\solrj\beans\Field.class 2010/2/18 Noble Paul നോബിള്‍  नोब्ळ् noble.p...@corp.aol.com: solrj jar On Thu, Feb 18, 2010 at 10:52 PM, Pulkit Singhal pulkitsing...@gmail.com wrote: Hello All, When I use Maven or Eclipse to try and compile my bean which has

Re: @Field annotation support

2010-02-18 Thread Noble Paul നോബിള്‍ नोब्ळ्
solrj jar On Thu, Feb 18, 2010 at 10:52 PM, Pulkit Singhal pulkitsing...@gmail.com wrote: Hello All, When I use Maven or Eclipse to try and compile my bean which has the @Field annotation as specified in http://wiki.apache.org/solr/Solrj page ... the compiler doesn't find any class to

Re: Preventing mass index delete via DataImportHandler full-import

2010-02-16 Thread Noble Paul നോബിള്‍ नोब्ळ्
On Wed, Feb 17, 2010 at 8:03 AM, Chris Hostetter hossman_luc...@fucit.org wrote: : I have a small worry though. When I call the full-import functions, can : I configure Solr (via the XML files) to make sure there are rows to : index before wiping everything? What worries me is if, for some

Re: Solr 1.4: Full import FileNotFoundException

2010-02-13 Thread Noble Paul നോബിള്‍ नोब्ळ्
can we confirm that the user does not have multiple DIH configured? any request for an import, while an import is going on, is rejected On Sat, Feb 13, 2010 at 11:40 AM, Chris Hostetter hossman_luc...@fucit.org wrote: : concurrent imports are not allowed in DIH, unless u setup multiple DIH

Re: Solr 1.4: Full import FileNotFoundException

2010-02-12 Thread Noble Paul നോബിള്‍ नोब्ळ्
concurrent imports are not allowed in DIH, unless u setup multiple DIH instances On Sat, Feb 13, 2010 at 7:05 AM, Chris Hostetter hossman_luc...@fucit.org wrote: : I have noticed that when I run concurrent full-imports using DIH in Solr : 1.4, the index ends up getting corrupted. I see the

Re: DIH: delta-import not working

2010-02-09 Thread Noble Paul നോബിള്‍ नोब्ळ्
try this deltaImportQuery=select id, bytes from attachment where application = 'MYAPP' and id = '${dataimporter.delta.id}' be aware that the names are case sensitive . if the id comes as 'ID' this will not work On Tue, Feb 9, 2010 at 3:15 PM, Jorg Heymans jorg.heym...@gmail.com wrote: Hi,

Re: Call URL, simply parse the results using SolrJ

2010-02-09 Thread Noble Paul നോബിള്‍ नोब्ळ्
you can also try URL urlo = new URL(url);// ensure that the url has wt=javabin in that NamedListObject namedList = new JavaBinCodec().unmarshal(urlo.openConnection().getInputStream()); QueryResponse response = new QueryResponse(namedList, null); On Mon, Feb 8, 2010 at 11:49 PM, Jason Rutherglen

Re: How to configure multiple data import types

2010-02-08 Thread Noble Paul നോബിള്‍ नोब्ळ्
are you referring to nested entities? http://wiki.apache.org/solr/DIHQuickStart#Index_data_from_multiple_tables_into_Solr On Mon, Feb 8, 2010 at 5:42 PM, stefan.ma...@bt.com wrote: I have got a dataimport request handler configured to index data by selecting data from a DB view I now need

Re: DataImportHandlerException for custom DIH Transformer

2010-02-07 Thread Noble Paul നോബിള്‍ नोब्ळ्
On Mon, Feb 8, 2010 at 9:13 AM, Tommy Chheng tommy.chh...@gmail.com wrote:  I'm having trouble making a custom DIH transformer in solr 1.4. I compiled the General TrimTransformer into a jar. (just copy/paste sample code from http://wiki.apache.org/solr/DIHCustomTransformer) I placed the jar

Re: DataImportHandler TikaEntityProcessor FieldReaderDataSource

2010-02-05 Thread Noble Paul നോബിള്‍ नोब्ळ्
unfortunately, no On Fri, Feb 5, 2010 at 2:23 PM, Jorg Heymans jorg.heym...@gmail.com wrote: dow, thanks for that Paul :-| I suppose schema validation for data-config.xml is already in Jira somewhere ? Jorg 2010/2/5 Noble Paul നോബിള്‍ नोब्ळ् noble.p...@corp.aol.com wrong   datasource

Re: DataImportHandler - convertType attribute

2010-02-03 Thread Noble Paul നോബിള്‍ नोब्ळ्
offers it. we offer it because JDBC drivers have mechanism to do type conversion What do you mean by it is too broad?        Erik On Feb 3, 2010, at 1:16 AM, Noble Paul നോബിള്‍ नोब्ळ् wrote: implicit conversion can cause problem when Transformers are applied. It is hard for user to guess

Re: DataImportHandler - convertType attribute

2010-02-03 Thread Noble Paul നോബിള്‍ नोब्ळ्
On Wed, Feb 3, 2010 at 4:16 PM, Erik Hatcher erik.hatc...@gmail.com wrote: On Feb 3, 2010, at 5:36 AM, Noble Paul നോബിള്‍ नोब्ळ् wrote: On Wed, Feb 3, 2010 at 3:31 PM, Erik Hatcher erik.hatc...@gmail.com wrote: One thing I find awkward about convertType is that it is JdbcDataSource

Re: java.lang.NullPointerException with MySQL DataImportHandler

2010-02-03 Thread Noble Paul നോബിള്‍ नोब्ळ्
On Thu, Feb 4, 2010 at 10:50 AM, Lance Norskog goks...@gmail.com wrote: I just tested this with a DIH that does not use database input. If the DataImportHandler JDBC code does not support a schema that has optional fields, that is a major weakness. Noble/Shalin, is this true? The problem is

Re: DataImportHandler delta-import confusion

2010-02-02 Thread Noble Paul നോബിള്‍ नोब्ळ्
try deltaImportQuery=select [bunch of stuff] WHERE m.moment_id = '${dataimporter.delta.moment_id}' The key has to be same and in the same case On Tue, Feb 2, 2010 at 1:45 AM, Jon Drukman jdruk...@gmail.com wrote: First, let me just say that DataImportHandler is fantastic. It got my old

Re: DataImportHandler delta-import confusion

2010-02-02 Thread Noble Paul നോബിള്‍ नोब्ळ्
...@gmail.com [noble.p...@gmail.com] On Behalf Of Noble Paul നോബിള്‍  नोब्ळ् [noble.p...@corp.aol.com] Sent: Tuesday, February 02, 2010 2:12 AM To: solr-user@lucene.apache.org Subject: Re: DataImportHandler delta-import confusion try deltaImportQuery=select [bunch of stuff]   WHERE m.moment_id

Re: DataImportHandler - convertType attribute

2010-02-02 Thread Noble Paul നോബിള്‍ नोब्ळ्
implicit conversion can cause problem when Transformers are applied. It is hard for user to guess the type of the field by looking at the schema.xml. In Solr, String is the most commonly used type. if you wish to do numeric operations on a field convertType will cause problems. If it is

Re: DataImportHandler problem - reading XML from a file

2010-01-31 Thread Noble Paul നോബിള്‍ नोब्ळ्
It clear that the xpaths provided won't fetch anything. because there is no data in those paths. what do you really wish to be indexed ? On Sun, Jan 31, 2010 at 10:30 AM, Lance Norskog goks...@gmail.com wrote: This DataImportHandler script does not find any documents in this HTML file. The

Re: replication setup

2010-01-31 Thread Noble Paul നോബിള്‍ नोब्ळ्
it is always recommended to paste your actual configuration and startup commands, instead of saying as described in wiki . On Tue, Jan 26, 2010 at 9:52 PM, Matthieu Labour matthieu_lab...@yahoo.com wrote: Hi I have set up replication following the wiki I downloaded the latest

Re: loading an updateProcessorChain with multicore in trunk

2010-01-29 Thread Noble Paul നോബിള്‍ नोब्ळ्
I guess . default=true should not be necessary if there is only one updateRequestProcessorChain specified . Open an issue On Fri, Jan 29, 2010 at 6:06 PM, Marc Sturlese marc.sturl...@gmail.com wrote: I am testing trunk and have seen a different behaviour when loading updateProcessors wich I

Re: Help using CachedSqlEntityProcessor

2010-01-28 Thread Noble Paul നോബിള്‍ नोब्ळ्
Thanks for pointing this out. The wiki had a problem fro a while and we could not update the documentation. It is updated here http://wiki.apache.org/solr/DataImportHandler#cached On Thu, Jan 28, 2010 at 6:31 PM, KirstyS kirst...@gmail.com wrote: Thanks, I saw that mistake and I have it

Re: Solr 1.4 Replication index directories

2010-01-28 Thread Noble Paul നോബിള്‍ नोब्ळ्
the index.20100127044500/ is a temp directory should have got cleaned up if there was no problem in replication (see the logs if there was a problem) . if there is a problem the temp directory will be used as the new index directory and the old one will no more be used.at any given point only one

Re: Fastest way to use solrj

2010-01-27 Thread Noble Paul നോബിള്‍ नोब्ळ्
was a bit surprised about this. It doesn't bother me much though. At least it performs better. /Tim 2010/1/27 Noble Paul നോബിള്‍  नोब्ळ् noble.p...@corp.aol.com: if you write only a few docs you may not observe much difference in size. if you write large no:of docs you may observe a big difference

Re: Fastest way to use solrj

2010-01-27 Thread Noble Paul നോബിള്‍ नोब्ळ्
is the biggest, it contains almost all of the 5000 chars. /Tim 2010/1/27 Noble Paul നോബിള്‍  नोब्ळ् noble.p...@corp.aol.com: how many fields are there in each doc? the binary format just reduces overhead. it does not touch/compress the payload 2010/1/27 Tim Terlegård tim.terleg...@gmail.com: I

Re: Help using CachedSqlEntityProcessor

2010-01-27 Thread Noble Paul നോബിള്‍ नोब्ळ्
cacheKey and cacheLookup are required attributes . On Thu, Jan 28, 2010 at 12:51 AM, KirstyS kirst...@gmail.com wrote: Thanks. I am on 1.4..so maybe that is the problem. Will try when I get back to work tomorrow. Thanks Rolf Johansson-2 wrote: I recently had issues with

Re: DataImportHandler TikaEntityProcessor FieldReaderDataSource

2010-01-26 Thread Noble Paul നോബിള്‍ नोब्ळ्
There is no corresponding DataSurce which can be used with TikaEntityProcessor which reads from BLOB I have opened an issue.https://issues.apache.org/jira/browse/SOLR-1737 On Mon, Jan 25, 2010 at 10:57 PM, Shah, Nirmal ns...@columnit.com wrote: Hi, I am fairly new to Solr and would like to

Re: Fastest way to use solrj

2010-01-26 Thread Noble Paul നോബിള്‍ नोब्ळ्
, it doesn't look like a binary file is smaller in size than an xml file? /Tim 2010/1/27 Noble Paul നോബിള്‍  नोब्ळ् noble.p...@corp.aol.com: 2010/1/21 Tim Terlegård tim.terleg...@gmail.com: Yes, it worked! Thank you very much. But do I need to use curl or can I use CommonsHttpSolrServer

Re: Replication Handler Severe Error: Unable to move index file

2010-01-24 Thread Noble Paul നോബിള്‍ नोब्ळ्
it because we never observed renameTo failing. 2010/1/21 Noble Paul നോബിള്‍ नोब्ळ् noble.p...@corp.aol.com is it a one off case? do you observerve this frequently? On Thu, Jan 21, 2010 at 11:26 AM, Otis Gospodnetic otis_gospodne...@yahoo.com wrote: It's hard to tell without poking around, but one

Re: Replication Handler Severe Error: Unable to move index file

2010-01-21 Thread Noble Paul നോബിള്‍ नोब्ळ्
is it a one off case? do you observerve this frequently? On Thu, Jan 21, 2010 at 11:26 AM, Otis Gospodnetic otis_gospodne...@yahoo.com wrote: It's hard to tell without poking around, but one of the first things I'd do would be to look for /home/solr/cores/core8/index.20100119103919/_6qv.fnm -

Re: Fastest way to use solrj

2010-01-20 Thread Noble Paul നോബിള്‍ नोब्ळ्
2010/1/20 Tim Terlegård tim.terleg...@gmail.com: BinaryRequestWriter does not read from a file and post it Is there any other way or is this use case not supported? I tried this: $ curl host/solr/update/javabin -F stream.file=/tmp/data.bin $ curl host/solr/update -F stream.body=' commit /'

Re: Fastest way to use solrj

2010-01-19 Thread Noble Paul നോബിള്‍ नोब्ळ्
2010/1/19 Tim Terlegård tim.terleg...@gmail.com: There are a few ways to use solrj. I just learned that I can use the javabin format to get some performance gain. But when I try the binary format nothing is added to the index. This is how I try to use this:    server = new

Re: DIH delta import - last modified date

2010-01-19 Thread Noble Paul നോബിള്‍ नोब्ळ्
While invoking the delta-import you may, pass the value as a request parameter. That value can be used in the query as ${dih.request.xyz} where as xyz is the request parameter name On Wed, Jan 20, 2010 at 1:15 AM, Yao Ge yao...@gmail.com wrote: I am struggling with the concept of delta import

Re: NullPointerException in ReplicationHandler.postCommit + question about compression

2010-01-18 Thread Noble Paul നോബിള്‍ नोब्ळ्
When you copy paste config from wiki, just copy what you need. excluding documentation and comments On Wed, Jan 13, 2010 at 12:51 AM, Stephen Weiss swe...@stylesight.com wrote: Hi Solr List, We're trying to set up java-based replication with Solr 1.4 (dist tarball).  We are running this to

Re: Data Full Import Error

2010-01-12 Thread Noble Paul നോബിള്‍ नोब्ळ्
You need more memory to run dataimport. On Tue, Jan 12, 2010 at 4:46 PM, Lee Smith l...@weblee.co.uk wrote: Hi All I am trying to do a data import but I am getting the following error. INFO: [] webapp=/solr path=/dataimport params={command=status} status=0 QTime=405 2010-01-12

Re: Data Full Import Error

2010-01-12 Thread Noble Paul നോബിള്‍ नोब्ळ्
can advise ! On 12 Jan 2010, at 12:26, Noble Paul നോബിള്‍ नोब्ळ् wrote: You need more memory to run dataimport. On Tue, Jan 12, 2010 at 4:46 PM, Lee Smith l...@weblee.co.uk wrote: Hi All I am trying to do a data import but I am getting the following error. INFO: [] webapp=/solr path

Re: DataImportHandler - synchronous execution

2010-01-12 Thread Noble Paul നോബിള്‍ नोब्ळ्
it can be added On Tue, Jan 12, 2010 at 10:18 PM, Alexey Serba ase...@gmail.com wrote: Hi, I found that there's no explicit option to run DataImportHandler in a synchronous mode. I need that option to run DIH from SolrJ ( EmbeddedSolrServer ) in the same thread. Currently I pass dummy stream

Re: Synonyms from Database

2010-01-10 Thread Noble Paul നോബിള്‍ नोब्ळ्
On Sun, Jan 10, 2010 at 1:04 PM, Otis Gospodnetic otis_gospodne...@yahoo.com wrote: Ravi, I think if your synonyms were in a DB, it would be trivial to periodically dump them into a text file Solr expects.  You wouldn't want to hit the DB to look up synonyms at query time... Why query time.

Re: replication -- missing field data file

2010-01-07 Thread Noble Paul നോബിള്‍ नोब्ळ्
actually it does not. BTW, FYI, backup is just to take periodics backups not necessary for the Replicationhandler to work On Thu, Jan 7, 2010 at 2:37 AM, Giovanni Fernandez-Kincade gfernandez-kinc...@capitaliq.com wrote: How can you tell when the backup is done? -Original Message-

Re: readOnly=true IndexReader

2010-01-06 Thread Noble Paul നോബിള്‍ नोब्ळ्
On Wed, Jan 6, 2010 at 4:26 PM, Patrick Sauts patrick.via...@gmail.com wrote: In the Wiki page : http://wiki.apache.org/lucene-java/ImproveSearchingSpeed, I've found -Open the IndexReader with readOnly=true. This makes a big difference when multiple threads are sharing the same reader, as it

Re: replication -- missing field data file

2010-01-06 Thread Noble Paul നോബിള്‍ नोब्ळ्
On Wed, Jan 6, 2010 at 9:49 PM, Giovanni Fernandez-Kincade gfernandez-kinc...@capitaliq.com wrote: I set up replication between 2 cores on one master and 2 cores on one slave. Before doing this the master was working without issues, and I stopped all indexing on the master. Now that

Re: replication -- missing field data file

2010-01-06 Thread Noble Paul നോബിള്‍ नोब्ळ्
the index dir is in the name index others will be stored as indexdate-as-number On Wed, Jan 6, 2010 at 10:31 PM, Giovanni Fernandez-Kincade gfernandez-kinc...@capitaliq.com wrote: How can you differentiate between the backup and the normal index files? -Original Message- From:

Re: replicating extension JARs

2010-01-05 Thread Noble Paul നോബിള്‍ नोब्ळ्
jars are not replicated. It is by design. But that is not to say that we can't do it. open an issue . On Wed, Jan 6, 2010 at 6:20 AM, Ryan Kennedy rcken...@gmail.com wrote: Will the built-in Solr replication replicate extension JAR files in the lib directory? The documentation appears to

Re: Solr Replication Questions

2010-01-05 Thread Noble Paul നോബിള്‍ नोब्ळ्
On Wed, Jan 6, 2010 at 2:51 AM, Giovanni Fernandez-Kincade gfernandez-kinc...@capitaliq.com wrote: http://wiki.apache.org/solr/SolrReplication I've been looking over this replication wiki and I'm still unclear on a two points about Solr Replication: 1.     If there have been small changes

Re: serialize SolrInputDocument to java.io.File and back again?

2009-12-31 Thread Noble Paul നോബിള്‍ नोब्ळ्
what serialization would you wish to use? you can use java serialization or solrj helps you serialize it as xml or javabin format (org.apache.solr.client.solrj.request.JavaBinUpdateRequestCodec) On Thu, Dec 31, 2009 at 6:55 AM, Phillip Rhodes rhodebumpl...@gmail.com wrote: I want to store a

Re: fl parameter and dynamic fields

2009-12-29 Thread Noble Paul നോബിള്‍ नोब्ळ्
if you wish to search on fields using wild-card you have to use a copyField to copy all the values of Bool_* to another field and search on that field. On Tue, Dec 29, 2009 at 4:14 AM, Harsch, Timothy J. (ARC-TI)[PEROT SYSTEMS] timothy.j.har...@nasa.gov wrote: I use dynamic fields heavily in my

Re: Problem with simple use of DIH

2009-12-27 Thread Noble Paul നോബിള്‍ नोब्ळ्
did you run it w/o the debug? On Sun, Dec 27, 2009 at 6:31 PM, AHMET ARSLAN iori...@yahoo.com wrote: I'm trying to use DataImportHandler to load my index and having some strange results. I have two tables in my database. DPRODUC contains products and FSKUMAS contains the skus related to each

Re: Problem with simple use of DIH

2009-12-27 Thread Noble Paul നോബിള്‍ नोब्ळ्
and it worked. I think the column names may be case-sensitive, although I haven't proven that to be the case. I did discover that references to column names in the velocity template are case sensitive; ${dproduc.DPRPRD} works and ${dproduc.dprprd} does not. Thanks, Jay 2009/12/27 Noble Paul

Re: suggestions for DIH batchSize

2009-12-22 Thread Noble Paul നോബിള്‍ नोब्ळ्
A bigger batchSize results in increased memory usage. I guess performance should be slightly better with bigger values but not verified. On Wed, Dec 23, 2009 at 2:51 AM, Joel Nylund jnyl...@yahoo.com wrote: Hi, it looks like from looking at the code the default is 500, is the recommended

Re: Documents are indexed but not searchable

2009-12-20 Thread Noble Paul നോബിള്‍ नोब्ळ्
just search for *:* and see if the docs are indeed there in the index. --Noble On Mon, Dec 21, 2009 at 9:26 AM, krosan kro...@gmail.com wrote: Hi, I'm trying to test solr for a proof of concept project, but I'm having some problems. I indexed my document, but when I search for a word which

Re: Is DataImportHandler ThreadSafe???

2009-12-19 Thread Noble Paul നോബിള്‍ नोब्ळ्
On Sat, Dec 19, 2009 at 2:16 PM, gurudev suyalprav...@yahoo.com wrote: Hi, Just wanted to know, Is the DataImportHandler available in solr1.3 thread-safe?. I would like to use multiple instances of data import handler running concurrently and posting my various set of data from DB to Index.

Re: shards parameter

2009-12-17 Thread Noble Paul നോബിള്‍ नोब्ळ्
yes. put it under the defaults section in your standard requesthandler. On Thu, Dec 17, 2009 at 5:22 PM, pcurila p...@eea.sk wrote: Hello, is there any way to configure shards parameter in solrconfig.xml? So I do not need provide it in the url. Thanks Peter -- View this message in context:

Re: solr core size on disk

2009-12-16 Thread Noble Paul നോബിള്‍ नोब्ळ्
look at the index dir and see the size of the files . it is typically in $SOLR_HOME/data/index On Thu, Dec 17, 2009 at 2:56 AM, Matthieu Labour matth...@kikin.com wrote: Hi I am new to solr. Here is my question: How to find out the size of a solr core on disk ? Thank you matt --

Re: question regarding dynamic fields

2009-12-14 Thread Noble Paul നോബിള്‍ नोब्ळ्
use a copyField to copy those fields to another field and search on that On Mon, Dec 14, 2009 at 1:00 PM, Phanindra Reva reva.phanin...@gmail.com wrote: Hello..,             I have observed that the text or keywords which are being indexed using dynamicField concept are being searchable only

Re: Request Assistance with DIH

2009-12-14 Thread Noble Paul നോബിള്‍ नोब्ळ्
On Sat, Dec 12, 2009 at 6:15 AM, Robbin rob...@drivesajeep.com wrote: I've been trying to use the DIH with oracle and would love it if someone could give me some pointers.  I put the ojdbc14.jar in both the Tomcat lib and solr home/lib.  I created a dataimport.xml and enabled it in the

Re: apache-solr-common.jar

2009-12-14 Thread Noble Paul നോബിള്‍ नोब्ळ्
there is no solrcommon jar anymore. you may use the solrj jar which contains all the classes which were there in the comon jar. On Mon, Dec 14, 2009 at 9:22 PM, gudumba l gudumba.sm...@gmail.com wrote: Hello All,               I have been using apache-solr-common-1.3.0.jar in my module. I am

Re: Custom Field sample?

2009-12-11 Thread Noble Paul നോബിള്‍ नोब्ळ्
how exactly do you wish to query these documents? On Fri, Dec 11, 2009 at 4:35 PM, Antonio Zippo reven...@yahoo.it wrote: I need to add theese features to each document Document1 --- Argument1, positive Argument2, positive Argument3, neutral Argument4, positive Argument5,

Re: indexing XML with solr example webapp - out of java heap space

2009-12-09 Thread Noble Paul നോബിള്‍ नोब्ळ्
the post.jar does not stream. use curl if you are using *nix. --Noble On Wed, Dec 9, 2009 at 12:28 AM, Feroze Daud fero...@zillow.com wrote: Hi! I downloaded SOLR and am trying to index an XML file. This XML file is huge (500M). When I try to index it using the post.jar tool in

  1   2   3   4   5   6   7   8   9   10   >