the deltaQuery select 'product_id' and your deltaImportQuery uses
${dataimporter.delta.id}
I guess it should have been ${dataimporter.delta. product_id}
On Wed, Dec 2, 2009 at 11:52 PM, Thomas Woodard gtfo...@hotmail.com wrote:
I'm trying to get delta indexing set up. My configuration allows a
you do not need to pass the values as shown here. Make use of the
Context parameter (second implicit parameter) to get hold of the value
of ${item.category}
context.getVariableResolver().resolve('item.category'))
On Wed, Dec 2, 2009 at 7:20 PM, Joel Nylund jnyl...@yahoo.com wrote:
Hi, I have an
probably you can try out this
http://wiki.apache.org/solr/DataImportHandlerFaq#fullimportdelta
and it may give you more info on what is happeining
On Thu, Dec 3, 2009 at 10:58 PM, Thomas Woodard gtfo...@hotmail.com wrote:
Unfortunately that isn't it. I have tried id, product_id, and
are you able to hit the
http://localhost:8080/postingsmaster/replication using a browser from
the slave box. if you are able to hit it what do you see?
On Tue, Dec 8, 2009 at 3:42 AM, William Pierce evalsi...@hotmail.com wrote:
Just to make doubly sure, per tck's suggestion, I went in and
the core is a part of the uri
http://host:port/solr-app/core-name/select
say if the core name is core1 and solr app name is solr deployed at port 8983
then it would look like
http://host:8983/solr/core1/select
On Tue, Dec 8, 2009 at 3:44 AM, regany re...@newzealand.co.nz wrote:
Hello,
Can
this has to be a network problem . We have never encountered such
vastly different speeds in the same LAN.
On Tue, Dec 8, 2009 at 3:22 AM, Simon Wistow si...@thegestalt.org wrote:
I have a Master server with two Slaves populated via Solr 1.4 native
replication.
Slave1 syncs at a respectable
On Tue, Dec 8, 2009 at 2:43 PM, Thijs vonk.th...@gmail.com wrote:
Hi
I need some help setting up dynamic multicore replication.
We are changing our setup from a replicated single core index with multiple
document types, as described on the wiki[1], to a dynamic multicore setup.
We need this
we are very close to resolving SOLR-1358 . So you may be able to use it
On Tue, Dec 8, 2009 at 5:32 PM, Jorg Heymans jorg.heym...@gmail.com wrote:
Hi,
I am looking into using Solr for indexing a large database that has
documents (mostly pdf and msoffice) stored as CLOBs in several tables.
It
On Wed, Dec 9, 2009 at 6:14 AM, Jason Rutherglen
jason.rutherg...@gmail.com wrote:
Yes. I'd highly recommend using the Java replication though.
Is there a reason? I understand it's new etc, however I think one
issue with it is it's somewhat non-native access to the filesystem.
Can you
the post.jar does not stream. use curl if you are using *nix.
--Noble
On Wed, Dec 9, 2009 at 12:28 AM, Feroze Daud fero...@zillow.com wrote:
Hi!
I downloaded SOLR and am trying to index an XML file. This XML file is
huge (500M).
When I try to index it using the post.jar tool in
On Wed, Dec 9, 2009 at 3:34 PM, Lee Smith l...@weblee.co.uk wrote:
Hi All
There seems to be massive difference between the solrconfig in the DIH
example to the one in the normal example ?
Would I be correct in saying if I was to add the dataimport request handler
in the solrconfig.xml thats
, the same exception shows up in
the tomcat logs.
Thanks,
- Bill
--
From: Noble Paul നോബിള് नोब्ळ् noble.p...@corp.aol.com
Sent: Monday, December 07, 2009 9:20 PM
To: solr-user@lucene.apache.org
Subject: Re: Exception encountered during
how exactly do you wish to query these documents?
On Fri, Dec 11, 2009 at 4:35 PM, Antonio Zippo reven...@yahoo.it wrote:
I need to add theese features to each document
Document1
---
Argument1, positive
Argument2, positive
Argument3, neutral
Argument4, positive
Argument5,
use a copyField to copy those fields to another field and search on that
On Mon, Dec 14, 2009 at 1:00 PM, Phanindra Reva
reva.phanin...@gmail.com wrote:
Hello..,
I have observed that the text or keywords which are being
indexed using dynamicField concept are being searchable only
On Sat, Dec 12, 2009 at 6:15 AM, Robbin rob...@drivesajeep.com wrote:
I've been trying to use the DIH with oracle and would love it if someone
could give me some pointers. I put the ojdbc14.jar in both the Tomcat lib
and solr home/lib. I created a dataimport.xml and enabled it in the
there is no solrcommon jar anymore. you may use the solrj jar which
contains all the classes which were there in the comon jar.
On Mon, Dec 14, 2009 at 9:22 PM, gudumba l gudumba.sm...@gmail.com wrote:
Hello All,
I have been using apache-solr-common-1.3.0.jar in my module.
I am
look at the index dir and see the size of the files . it is typically
in $SOLR_HOME/data/index
On Thu, Dec 17, 2009 at 2:56 AM, Matthieu Labour matth...@kikin.com wrote:
Hi
I am new to solr. Here is my question:
How to find out the size of a solr core on disk ?
Thank you
matt
--
yes.
put it under the defaults section in your standard requesthandler.
On Thu, Dec 17, 2009 at 5:22 PM, pcurila p...@eea.sk wrote:
Hello, is there any way to configure shards parameter in solrconfig.xml? So I
do not need provide it in the url. Thanks Peter
--
View this message in context:
On Sat, Dec 19, 2009 at 2:16 PM, gurudev suyalprav...@yahoo.com wrote:
Hi,
Just wanted to know, Is the DataImportHandler available in solr1.3
thread-safe?. I would like to use multiple instances of data import handler
running concurrently and posting my various set of data from DB to Index.
just search for *:* and see if the docs are indeed there in the index.
--Noble
On Mon, Dec 21, 2009 at 9:26 AM, krosan kro...@gmail.com wrote:
Hi,
I'm trying to test solr for a proof of concept project, but I'm having some
problems.
I indexed my document, but when I search for a word which
A bigger batchSize results in increased memory usage. I guess
performance should be slightly better with bigger values but not
verified.
On Wed, Dec 23, 2009 at 2:51 AM, Joel Nylund jnyl...@yahoo.com wrote:
Hi,
it looks like from looking at the code the default is 500, is the
recommended
did you run it w/o the debug?
On Sun, Dec 27, 2009 at 6:31 PM, AHMET ARSLAN iori...@yahoo.com wrote:
I'm trying to use DataImportHandler
to load my index and having some strange
results. I have two tables in my database. DPRODUC contains
products and
FSKUMAS contains the skus related to each
and it worked.
I think the column names may be case-sensitive, although I haven't proven
that to be the case. I did discover that references to column names in the
velocity template are case sensitive; ${dproduc.DPRPRD} works
and ${dproduc.dprprd} does not.
Thanks, Jay
2009/12/27 Noble Paul
if you wish to search on fields using wild-card you have to use a
copyField to copy all the values of Bool_* to another field and
search on that field.
On Tue, Dec 29, 2009 at 4:14 AM, Harsch, Timothy J. (ARC-TI)[PEROT
SYSTEMS] timothy.j.har...@nasa.gov wrote:
I use dynamic fields heavily in my
what serialization would you wish to use?
you can use java serialization or solrj helps you serialize it as xml
or javabin format
(org.apache.solr.client.solrj.request.JavaBinUpdateRequestCodec)
On Thu, Dec 31, 2009 at 6:55 AM, Phillip Rhodes rhodebumpl...@gmail.com wrote:
I want to store a
jars are not replicated. It is by design. But that is not to say that
we can't do it. open an issue .
On Wed, Jan 6, 2010 at 6:20 AM, Ryan Kennedy rcken...@gmail.com wrote:
Will the built-in Solr replication replicate extension JAR files in
the lib directory? The documentation appears to
On Wed, Jan 6, 2010 at 2:51 AM, Giovanni Fernandez-Kincade
gfernandez-kinc...@capitaliq.com wrote:
http://wiki.apache.org/solr/SolrReplication
I've been looking over this replication wiki and I'm still unclear on a two
points about Solr Replication:
1. If there have been small changes
On Wed, Jan 6, 2010 at 4:26 PM, Patrick Sauts patrick.via...@gmail.com wrote:
In the Wiki page : http://wiki.apache.org/lucene-java/ImproveSearchingSpeed,
I've found
-Open the IndexReader with readOnly=true. This makes a big difference when
multiple threads are sharing the same reader, as it
On Wed, Jan 6, 2010 at 9:49 PM, Giovanni Fernandez-Kincade
gfernandez-kinc...@capitaliq.com wrote:
I set up replication between 2 cores on one master and 2 cores on one slave.
Before doing this the master was working without issues, and I stopped all
indexing on the master.
Now that
the index dir is in the name index others will be stored as
indexdate-as-number
On Wed, Jan 6, 2010 at 10:31 PM, Giovanni Fernandez-Kincade
gfernandez-kinc...@capitaliq.com wrote:
How can you differentiate between the backup and the normal index files?
-Original Message-
From:
actually it does not.
BTW, FYI, backup is just to take periodics backups not necessary for
the Replicationhandler to work
On Thu, Jan 7, 2010 at 2:37 AM, Giovanni Fernandez-Kincade
gfernandez-kinc...@capitaliq.com wrote:
How can you tell when the backup is done?
-Original Message-
On Sun, Jan 10, 2010 at 1:04 PM, Otis Gospodnetic
otis_gospodne...@yahoo.com wrote:
Ravi,
I think if your synonyms were in a DB, it would be trivial to periodically
dump them into a text file Solr expects. You wouldn't want to hit the DB to
look up synonyms at query time...
Why query time.
You need more memory to run dataimport.
On Tue, Jan 12, 2010 at 4:46 PM, Lee Smith l...@weblee.co.uk wrote:
Hi All
I am trying to do a data import but I am getting the following error.
INFO: [] webapp=/solr path=/dataimport params={command=status} status=0
QTime=405
2010-01-12
can advise !
On 12 Jan 2010, at 12:26, Noble Paul നോബിള് नोब्ळ् wrote:
You need more memory to run dataimport.
On Tue, Jan 12, 2010 at 4:46 PM, Lee Smith l...@weblee.co.uk wrote:
Hi All
I am trying to do a data import but I am getting the following error.
INFO: [] webapp=/solr path
it can be added
On Tue, Jan 12, 2010 at 10:18 PM, Alexey Serba ase...@gmail.com wrote:
Hi,
I found that there's no explicit option to run DataImportHandler in a
synchronous mode. I need that option to run DIH from SolrJ (
EmbeddedSolrServer ) in the same thread. Currently I pass dummy stream
When you copy paste config from wiki, just copy what you need.
excluding documentation and comments
On Wed, Jan 13, 2010 at 12:51 AM, Stephen Weiss swe...@stylesight.com wrote:
Hi Solr List,
We're trying to set up java-based replication with Solr 1.4 (dist tarball).
We are running this to
2010/1/19 Tim Terlegård tim.terleg...@gmail.com:
There are a few ways to use solrj. I just learned that I can use the
javabin format to get some performance gain. But when I try the binary
format nothing is added to the index. This is how I try to use this:
server = new
While invoking the delta-import you may, pass the value as a request
parameter. That value can be used in the query as ${dih.request.xyz}
where as xyz is the request parameter name
On Wed, Jan 20, 2010 at 1:15 AM, Yao Ge yao...@gmail.com wrote:
I am struggling with the concept of delta import
2010/1/20 Tim Terlegård tim.terleg...@gmail.com:
BinaryRequestWriter does not read from a file and post it
Is there any other way or is this use case not supported? I tried this:
$ curl host/solr/update/javabin -F stream.file=/tmp/data.bin
$ curl host/solr/update -F stream.body=' commit /'
is it a one off case? do you observerve this frequently?
On Thu, Jan 21, 2010 at 11:26 AM, Otis Gospodnetic
otis_gospodne...@yahoo.com wrote:
It's hard to tell without poking around, but one of the first things I'd do
would be to look for /home/solr/cores/core8/index.20100119103919/_6qv.fnm -
it because we never observed renameTo failing.
2010/1/21 Noble Paul നോബിള് नोब्ळ् noble.p...@corp.aol.com
is it a one off case? do you observerve this frequently?
On Thu, Jan 21, 2010 at 11:26 AM, Otis Gospodnetic
otis_gospodne...@yahoo.com wrote:
It's hard to tell without poking around, but one
There is no corresponding DataSurce which can be used with
TikaEntityProcessor which reads from BLOB
I have opened an issue.https://issues.apache.org/jira/browse/SOLR-1737
On Mon, Jan 25, 2010 at 10:57 PM, Shah, Nirmal ns...@columnit.com wrote:
Hi,
I am fairly new to Solr and would like to
, it doesn't look like a binary file is smaller in size than
an xml file?
/Tim
2010/1/27 Noble Paul നോബിള് नोब्ळ् noble.p...@corp.aol.com:
2010/1/21 Tim Terlegård tim.terleg...@gmail.com:
Yes, it worked! Thank you very much. But do I need to use curl or can
I use CommonsHttpSolrServer
was a bit surprised about this. It doesn't bother me much though. At
least it performs better.
/Tim
2010/1/27 Noble Paul നോബിള് नोब्ळ् noble.p...@corp.aol.com:
if you write only a few docs you may not observe much difference in
size. if you write large no:of docs you may observe a big difference
is the biggest, it contains almost all
of the 5000 chars.
/Tim
2010/1/27 Noble Paul നോബിള് नोब्ळ् noble.p...@corp.aol.com:
how many fields are there in each doc? the binary format just reduces
overhead. it does not touch/compress the payload
2010/1/27 Tim Terlegård tim.terleg...@gmail.com:
I
cacheKey and cacheLookup are required attributes .
On Thu, Jan 28, 2010 at 12:51 AM, KirstyS kirst...@gmail.com wrote:
Thanks. I am on 1.4..so maybe that is the problem.
Will try when I get back to work tomorrow.
Thanks
Rolf Johansson-2 wrote:
I recently had issues with
Thanks for pointing this out. The wiki had a problem fro a while and
we could not update the documentation. It is updated here
http://wiki.apache.org/solr/DataImportHandler#cached
On Thu, Jan 28, 2010 at 6:31 PM, KirstyS kirst...@gmail.com wrote:
Thanks,
I saw that mistake and I have it
the index.20100127044500/ is a temp directory should have got cleaned
up if there was no problem in replication (see the logs if there was a
problem) . if there is a problem the temp directory will be used as
the new index directory and the old one will no more be used.at any
given point only one
I guess . default=true should not be necessary if there is only one
updateRequestProcessorChain specified . Open an issue
On Fri, Jan 29, 2010 at 6:06 PM, Marc Sturlese marc.sturl...@gmail.com wrote:
I am testing trunk and have seen a different behaviour when loading
updateProcessors wich I
It clear that the xpaths provided won't fetch anything. because there
is no data in those paths. what do you really wish to be indexed ?
On Sun, Jan 31, 2010 at 10:30 AM, Lance Norskog goks...@gmail.com wrote:
This DataImportHandler script does not find any documents in this HTML
file. The
it is always recommended to paste your actual configuration and
startup commands, instead of saying as described in wiki .
On Tue, Jan 26, 2010 at 9:52 PM, Matthieu Labour
matthieu_lab...@yahoo.com wrote:
Hi
I have set up replication following the wiki
I downloaded the latest
try
deltaImportQuery=select [bunch of stuff]
WHERE m.moment_id = '${dataimporter.delta.moment_id}'
The key has to be same and in the same case
On Tue, Feb 2, 2010 at 1:45 AM, Jon Drukman jdruk...@gmail.com wrote:
First, let me just say that DataImportHandler is fantastic. It got my old
...@gmail.com [noble.p...@gmail.com] On Behalf Of Noble Paul
നോബിള് नोब्ळ् [noble.p...@corp.aol.com]
Sent: Tuesday, February 02, 2010 2:12 AM
To: solr-user@lucene.apache.org
Subject: Re: DataImportHandler delta-import confusion
try
deltaImportQuery=select [bunch of stuff]
WHERE m.moment_id
implicit conversion can cause problem when Transformers are applied.
It is hard for user to guess the type of the field by looking at the
schema.xml. In Solr, String is the most commonly used type. if you
wish to do numeric operations on a field convertType will cause
problems.
If it is
offers it. we
offer it because JDBC drivers have mechanism to do type conversion
What do you mean by it is too broad?
Erik
On Feb 3, 2010, at 1:16 AM, Noble Paul നോബിള് नोब्ळ् wrote:
implicit conversion can cause problem when Transformers are applied.
It is hard for user to guess
On Wed, Feb 3, 2010 at 4:16 PM, Erik Hatcher erik.hatc...@gmail.com wrote:
On Feb 3, 2010, at 5:36 AM, Noble Paul നോബിള് नोब्ळ् wrote:
On Wed, Feb 3, 2010 at 3:31 PM, Erik Hatcher erik.hatc...@gmail.com
wrote:
One thing I find awkward about convertType is that it is JdbcDataSource
On Thu, Feb 4, 2010 at 10:50 AM, Lance Norskog goks...@gmail.com wrote:
I just tested this with a DIH that does not use database input.
If the DataImportHandler JDBC code does not support a schema that has
optional fields, that is a major weakness. Noble/Shalin, is this true?
The problem is
unfortunately, no
On Fri, Feb 5, 2010 at 2:23 PM, Jorg Heymans jorg.heym...@gmail.com wrote:
dow, thanks for that Paul :-|
I suppose schema validation for data-config.xml is already in Jira somewhere
?
Jorg
2010/2/5 Noble Paul നോബിള് नोब्ळ् noble.p...@corp.aol.com
wrong datasource
On Mon, Feb 8, 2010 at 9:13 AM, Tommy Chheng tommy.chh...@gmail.com wrote:
I'm having trouble making a custom DIH transformer in solr 1.4.
I compiled the General TrimTransformer into a jar. (just copy/paste sample
code from http://wiki.apache.org/solr/DIHCustomTransformer)
I placed the jar
are you referring to nested entities?
http://wiki.apache.org/solr/DIHQuickStart#Index_data_from_multiple_tables_into_Solr
On Mon, Feb 8, 2010 at 5:42 PM, stefan.ma...@bt.com wrote:
I have got a dataimport request handler configured to index data by selecting
data from a DB view
I now need
try this
deltaImportQuery=select id, bytes from attachment where application =
'MYAPP' and id = '${dataimporter.delta.id}'
be aware that the names are case sensitive . if the id comes as 'ID'
this will not work
On Tue, Feb 9, 2010 at 3:15 PM, Jorg Heymans jorg.heym...@gmail.com wrote:
Hi,
you can also try
URL urlo = new URL(url);// ensure that the url has wt=javabin in that
NamedListObject namedList = new
JavaBinCodec().unmarshal(urlo.openConnection().getInputStream());
QueryResponse response = new QueryResponse(namedList, null);
On Mon, Feb 8, 2010 at 11:49 PM, Jason Rutherglen
concurrent imports are not allowed in DIH, unless u setup multiple DIH instances
On Sat, Feb 13, 2010 at 7:05 AM, Chris Hostetter
hossman_luc...@fucit.org wrote:
: I have noticed that when I run concurrent full-imports using DIH in Solr
: 1.4, the index ends up getting corrupted. I see the
can we confirm that the user does not have multiple DIH configured?
any request for an import, while an import is going on, is rejected
On Sat, Feb 13, 2010 at 11:40 AM, Chris Hostetter
hossman_luc...@fucit.org wrote:
: concurrent imports are not allowed in DIH, unless u setup multiple DIH
On Wed, Feb 17, 2010 at 8:03 AM, Chris Hostetter
hossman_luc...@fucit.org wrote:
: I have a small worry though. When I call the full-import functions, can
: I configure Solr (via the XML files) to make sure there are rows to
: index before wiping everything? What worries me is if, for some
solrj jar
On Thu, Feb 18, 2010 at 10:52 PM, Pulkit Singhal
pulkitsing...@gmail.com wrote:
Hello All,
When I use Maven or Eclipse to try and compile my bean which has the
@Field annotation as specified in http://wiki.apache.org/solr/Solrj
page ... the compiler doesn't find any class to
wha is the problem. Is the replication not happening after you do a
commit on the master?
frequent polling is not a problem. frequent commits can slow down the system
On Fri, Feb 19, 2010 at 2:41 PM, giskard gisk...@autistici.org wrote:
Ciao,
Uhm after some time a new index in data/index on
-solrj-1.4.0.jar/org\apache\solr\client\solrj\beans\Field.class
2010/2/18 Noble Paul നോബിള് नोब्ळ् noble.p...@corp.aol.com:
solrj jar
On Thu, Feb 18, 2010 at 10:52 PM, Pulkit Singhal
pulkitsing...@gmail.com wrote:
Hello All,
When I use Maven or Eclipse to try and compile my bean which has
The xslt file looks fine . is the location of the file correct ?
On Mon, Feb 22, 2010 at 2:57 PM, Roland Villemoes r...@alpha-solutions.dk
wrote:
Hi
(thanks a lot)
Yes, The full stacktrace is this:
22-02-2010 08:37:00 org.apache.solr.handler.dataimport.DataImporter
doFullImport
can you paste the DIH part in your solrconfig.xml ?
On Tue, Feb 23, 2010 at 7:01 PM, Na_D nabam...@zaloni.com wrote:
yes i did check the location of the data-config.xml
its in the folder example-DIH/solr/db/conf
--
View this message in context:
you are right. The StreamSource class is not throwing the proper exception
Do we really have to handle this.?
On Thu, Feb 25, 2010 at 9:06 AM, Lance Norskog goks...@gmail.com wrote:
[Taken off the list]
The problem is that the XSLT code swallows the real exception, and
does not return it as
Paul നോബിള് नोब्ळ् noble.p...@gmail.com:
you are right. The StreamSource class is not throwing the proper exception
Do we really have to handle this.?
On Thu, Feb 25, 2010 at 9:06 AM, Lance Norskog goks...@gmail.com wrote:
[Taken off the list]
The problem is that the XSLT code swallows
On Wed, Feb 24, 2010 at 7:18 PM, Patrick Sauts patrick.via...@gmail.com wrote:
Synchronisation between the slaves to switch the new index at the same time
after replication.
I shall open as issue for this. And let us figure out how best it should be done
The data/index.20100226063400 dir is a temporary dir and isc reated in
the same dir where the index dir is located.
I'm wondering if the symlink is causing the problem. Why don't you set
the data dir as /raid/data instead of /solr/data
On Sat, Feb 27, 2010 at 12:13 AM, Matthieu Labour
On Fri, Mar 5, 2010 at 4:34 AM, Mark Miller markrmil...@gmail.com wrote:
On 03/04/2010 05:56 PM, Chris Hostetter wrote:
: The ability to read solr configuration files from the classpath instead
of
: solr.solr.home directory.
Solr has always supported this.
When
if you have a jdbc-odbc bridge driver , it should be fine
On Sun, Mar 7, 2010 at 4:52 AM, JavaGuy84 bbar...@gmail.com wrote:
Hi,
I have a ODBC driver with me for MetaMatrix DB(Redhat). I am trying to
figure out a way to use DIH using the DSN which has been created in my
machine with that
keep in mind that the xpath is case-sensitive. paste a sample xml
what is dataField=d.text it does not seem to refer to anything.
where is the enclosing entity?
did you mean dataField=doc.text.
xpath=//BODY is a supported syntax as long as you are using Solr1.4 or higher
On Thu, Mar 18,
On Sat, Mar 27, 2010 at 3:25 AM, Blargy zman...@hotmail.com wrote:
I have a items table on db1 and and item_descriptions table on db2.
The items table is very small in the sense that it has small columns while
the item_descriptions table has a very large text field column. Both tables
are
On Thu, Mar 25, 2010 at 10:14 PM, Ruben Chadien
ruben.chad...@aspiro.com wrote:
Hi
I know this has been discussed before, but is there any way do
expungeDeletes=true when the DataImportHandler does the commit.
expungeDeletes= true is not used does not mean that the doc does not
get
please create a bug
On Fri, Mar 26, 2010 at 7:29 PM, Shawn Smith ssmit...@gmail.com wrote:
We're using Solr 1.4 Java replication, which seems to be working
nicely. While writing production monitors to check that replication
is healthy, I think we've run into a bug in the status reporting of
The DIH status says 10 rows which means only 10 rows got fetched for
that query. Do you have any custom transformers which eats up rows?
Try the debug page of DIH and see what is happening to the rest of the rows.
On Fri, Oct 10, 2008 at 5:32 PM, con [EMAIL PROTECTED] wrote:
A simple
:
(http://localhost:8983/solr/dataimport?command=full-importdebug=onverbose=on)
, But it is not all mentioning anything after the 10th document.
Thanks and regards
con
Noble Paul നോബിള് नोब्ळ् wrote:
The DIH status says 10 rows which means only 10 rows got fetched for
that query. Do you
to implement the same query. But it is returning all
the responses, 25 nos.
But the solr is still indexing only 10 rows.
Is there any optimization settings by default in the solrconfig.xml that
restricts the responses to 10 ?
thanks
con.
Noble Paul നോബിള് नोब्ळ् wrote:
template transformer does
.
But I am not able to update the index since this is available only in the
debug mode.
Can you please give some suggestions based on this.
thanks
con
Noble Paul നോബിള് नोब्ळ् wrote:
in debug mode it writes only 10 because there is a rows parameter
which is by default set to 10
make
see an example here
http://wiki.apache.org/solr/DataImportHandler#head-e68aa93c9ca7b8d261cede2bf1d6110ab1725476
On Tue, Oct 14, 2008 at 9:17 PM, Erik Hatcher
[EMAIL PROTECTED] wrote:
Solr's new DataImportHandler can index RSS (and Atom should be fine too)
feeds.
Erik
On Oct 14, 2008,
the query makes my head spin .
joining on an sql does not enable you to populate multivalued fields .
Otherwise , it is all fine
pk attribute is missing in the entity
On Tue, Oct 14, 2008 at 6:16 PM, Florian Aumeier
[EMAIL PROTECTED] wrote:
Noble Paul നോബിള് नोब्ळ् schrieb:
apparently you
The delta implementation is a bit fragile in DIH for complex queries
I recommend you do delta-import using a full-import
it can be done as follows
define a diffferent entity
dataConfig
dataSource type=JdbcDataSource driver=org.postgresql.Driver
url=jdbc:postgresql://bm02:5432/bm user=user /
] wrote:
Noble Paul നോബിള് नोब्ळ् schrieb:
Well, when doing the way you described below (full-import with the delta
query), the '${dataimporter.last_index_time}' timestamp is empty:
I guess this was fixed post 1.3 . probably you can take
dataimporthandler.jar from a nightly build (you may also
Thanks David,
I have updated the wiki documentation
http://wiki.apache.org/solr/DataImportHandler#transformer
The default transformers do not have any special privilege it is like
any normal user provided transformer.We just identified some commonly
found usecases and added transformers for that.
If it is a normal exception it is logged with the number of document
where it failed and you can put it on debugger with start=x-1rows=1
We do not catch a throwable or Error so it gets slipped through.
if you are adventurous enough wrap the RegexTranformer with your own
and apply that say
The component that writes out the values do not know if it is
multivalued or not. So if it finds only a single value it writes it
out as such
On Thu, Oct 16, 2008 at 10:52 PM, oleg_gnatovskiy
[EMAIL PROTECTED] wrote:
Hello. I have an index built in Solr with several multi-value fields. When
=sample2 /
field column=userID name=userID /
/entity
But the searching will not give all the results even if there is only one
result. whereas indexing is fine.
Thanks
con
Noble Paul നോബിള് नोब्ळ् wrote:
do you have 2 queries in 2 different entities?
On Thu, Oct 16, 2008 at 3:17
a *:* it is displaying only 9 records.
Similarly, For another entity that indexes around 500 records, a *:* gives
only 4 responces.
Why this inconsistency ? how can I fix it before deploying it in actual
production.
Thanks
con
Noble Paul നോബിള് नोब्ळ् wrote:
how do you know that indexing
do you have a nested entities? Then there is chance of firing too many
requests to MySql.
If you have nested entities try using CachedSqlEntityProcessor for the
inner ones (only for the inner ones). i am assuming you have enough
RAM to support this
--Noble
On Mon, Oct 20, 2008 at 3:13 PM,
On Tue, Oct 21, 2008 at 12:56 AM, Shalin Shekhar Mangar
[EMAIL PROTECTED] wrote:
Your data-config looks fine except for one thing -- you do not need to
escape '' character in an XML attribute. It maybe throwing off the parsing
code in DataImportHandler.
not really '' is fine in attribute
you are still doing a delta import . with the modified data-config you
must do a command=full-import
On Mon, Oct 20, 2008 at 7:31 PM, Florian Aumeier
[EMAIL PROTECTED] wrote:
sorry to bother you again, but the delta import still does not work for me
:-(
We tried:
* delta-import by
is not an expression that i know, I'm french, what
does that means ... is it when in one request you have several table and
inner join between them ?
Noble Paul നോബിള് नोब्ळ् wrote:
do you have a nested entities? Then there is chance of firing too many
requests to MySql.
If you have nested entities try
you can try out a Transformer to translate that
On Wed, Oct 22, 2008 at 2:00 PM, sunnyfr [EMAIL PROTECTED] wrote:
I've a function to clear up string which are in latin1 to UTF8, I would like
to know where exactly should I put it in the java code to clear up string
before indexing ?
Thanks a
http://wiki.apache.org/solr/DataImportHandler#head-eb523b0943596587f05532f3ebc506ea6d9a606b
On Wed, Oct 22, 2008 at 4:41 PM, sunnyfr [EMAIL PROTECTED] wrote:
Can you tell me more about it ?
Noble Paul നോബിള് नोब्ळ् wrote:
you can try out a Transformer to translate that
On Wed, Oct 22
The case in point is DIH. DIH uses the standard DOM parser that comes
w/ JDK. If it reads the xml properly do we need to complain?. I guess
that data-config.xml may not be used for any other purposes.
On Wed, Oct 22, 2008 at 10:10 PM, Walter Underwood
[EMAIL PROTECTED] wrote:
On 10/22/08 8:57
201 - 300 of 987 matches
Mail list logo
