Hi all,
Regarding configurations about every fields( stored? analyzed? sort needed?
numeric ? ), elastic search designed cluster state to hold these
configurations index wise.. solr have those configurations in xml format.
If we have data center in multiple locations, is there any better way of
ma
That helped a lot! Thanks so much Erick.
Guido
-Original Message-
From: Erick Erickson [mailto:erickerick...@gmail.com]
Sent: Friday, January 30, 2015 7:04 PM
To: java-user
Subject: Re: Project configuration issue
Why not fire the "ant eclipse" target and open the resulti
Why not fire the "ant eclipse" target and open the resulting Eclipse
config? You might take another look at the "how to contribute" page, near
the bottom are links to setting up in Eclipse and IntelliJ that should give
you some pointers. I develop with IntelliJ so I don't have detailed
knowledge o
Hi!
I've downloaded Lucene's 4.8.0 source code and attempted to set up a project in
Eclipse, but I couldn't make it work. Let me describe all the steps I have
taken:
1) Downloaded Ant 1.8.2. Added the corresponding paths to the ANT_HOME and
PATH variables.
2) Downloaded Ivy 2.0.0.
Finally we are seeing great improvement once we switch to 64-bit java and
MMapDirectory. Our Test run (multiple requests) used to take 26 minutes on
32-bit and is now improved to 10 minutes on 64-bit java.
We load stored documents from lucene and pass the documents to a third
party libray (closed
Hi Christopher,
At my environment, IndexFiles demo works fine.
May be you must give directory path including source data you want to index
after '-docs'.
For example,
$ ls /path/to/source/dir
aaa.txt bbb.txt
$ java -cp
"demo/lucene-demo-4.10.2.jar:analysis/common/lucene-analyzers-common-4.10.2
Hi all,
I am trying to get the demo for Lucene to run but I am running into a
problem. When I try to run the IndexFiles command through the command prompt
I get an ArrayOutOfBoundsException at
org.apache.lucene.demo.IndexFiles.main. The line that I put into the prompt
is
java -classpath
C:\Use
: Re: NewBie To Lucene || Perfect configuration on a 64 bit server
Hmmm, you might want to move this over to the Solr user's list. This list
is lucene, which doesn't have anything to do with post.jar ;)...
On Fri, May 30, 2014 at 8:25 AM, Erick Erickson
wrote:
> Try a cURL state
>> Thanks,
>> Shruthi Sethi
>> SR. SOFTWARE ENGINEER
>> iMedX
>> OFFICE:
>> 033-4001-5789 ext. N/A
>> MOBILE:
>> 91-9903957546
>> EMAIL:
>> sse...@imedx.com
>> WEB:
>> www.imedx.com
>>
>>
>>
>> ---
ext. N/A
> MOBILE:
> 91-9903957546
> EMAIL:
> sse...@imedx.com
> WEB:
> www.imedx.com
>
>
>
> -Original Message-
> From: Ralf Heyde [mailto:xoodrena...@gmx.de]
> Sent: Tuesday, May 27, 2014 11:56 AM
> To: java-user@lucene.apache.org
> Subject: AW: NewB
m
WEB:
www.imedx.com
-Original Message-
From: Ralf Heyde [mailto:xoodrena...@gmx.de]
Sent: Tuesday, May 27, 2014 11:56 AM
To: java-user@lucene.apache.org
Subject: AW: NewBie To Lucene || Perfect configuration on a 64 bit server
Hey,
I have several notes about your process.
1st: Ho
and delete
> it afterwards just for a "simple" search operation on a subset of your
> documents.
>
> Cheers, Ralf
>
>
>
> -Ursprüngliche Nachricht-
> Von: rulinma [mailto:ruli...@gmail.com]
> Gesendet: Dienstag, 27. Mai 2014 03:14
> An: java-use
rulinma [mailto:ruli...@gmail.com]
Gesendet: Dienstag, 27. Mai 2014 03:14
An: java-user@lucene.apache.org
Betreff: RE: NewBie To Lucene || Perfect configuration on a 64 bit server
1000+ is solr, lucenen more fast.
--
View this message in context:
http://lucene.472066.n3.nabble.com/NewB
-4001-5789 ext. N/A
MOBILE:
91-9903957546
EMAIL:
sse...@imedx.com
WEB:
www.imedx.com
-Original Message-
From: Erick Erickson [mailto:erickerick...@gmail.com]
Sent: Monday, May 26, 2014 9:46 PM
To: java-user
Subject: Re: NewBie To Lucene || Perfect configuration on a 64 bit serve
1000+ is solr, lucenen more fast.
--
View this message in context:
http://lucene.472066.n3.nabble.com/NewBie-To-Lucene-Perfect-configuration-on-a-64-bit-server-tp4136871p4138215.html
Sent from the Lucene - Java Users mailing list archive at Nabble.com
OR id2 OR id3 (solr-style, but easily done in Lucene). You
get these IDs from the DB
search. This will still be MUCH faster than indexing on the fly.
The default maxBooleanClauses of 1024 if just a configuration problem,
I've seen it at 10 times that.
And you could cache the filter if you w
ster than indexing on the fly.
The default maxBooleanClauses of 1024 if just a configuration problem,
I've seen it at 10 times that.
And you could cache the filter if you wanted and that fit your use case.
Unless you _really_ can show that this solution is untenable, I think
you're maki
java-user@lucene.apache.org
Subject: Re: NewBie To Lucene || Perfect configuration on a 64 bit server
To 2nd Vitaly's suggestion. You should consider using Apache Solr
instead - it handles such issues OOTB .
On Fri, May 23, 2014 at 7:52 PM, Vitaly Funstein wrote:
At the risk of sounding overly critica
5:55 AM
To: java-user@lucene.apache.org
Subject: Re: NewBie To Lucene || Perfect configuration on a 64 bit server
To 2nd Vitaly's suggestion. You should consider using Apache Solr
instead - it handles such issues OOTB .
On Fri, May 23, 2014 at 7:52 PM, Vitaly Funstein wrote:
> At th
-
>> From: Toke Eskildsen [mailto:t...@statsbiblioteket.dk]
>> Sent: Tuesday, May 20, 2014 3:48 PM
>> To: java-user@lucene.apache.org
>> Subject: Re: NewBie To Lucene || Perfect configuration on a 64 bit server
>>
>> On Tue, 2014-05-20 at 11:56 +0200, Shruthi wrote:
wrote:
>
>
>
>
> -Original Message-
> From: Toke Eskildsen [mailto:t...@statsbiblioteket.dk]
> Sent: Tuesday, May 20, 2014 3:48 PM
> To: java-user@lucene.apache.org
> Subject: Re: NewBie To Lucene || Perfect configuration on a 64 bit server
>
> On Tue, 2014-05-20 a
-Original Message-
From: Toke Eskildsen [mailto:t...@statsbiblioteket.dk]
Sent: Tuesday, May 20, 2014 3:48 PM
To: java-user@lucene.apache.org
Subject: Re: NewBie To Lucene || Perfect configuration on a 64 bit server
On Tue, 2014-05-20 at 11:56 +0200, Shruthi wrote:
Toke:
> Is
On Tue, 2014-05-20 at 11:56 +0200, Shruthi wrote:
Toke:
> Is 20 second an acceptable response time for your users?
>
> Shruthi: Its definitely not acceptable. PFA the piece of code that we
> are using..Its taking 20seconds. That’s why I drafted this ticket to
> see where I was going wrong.
Inde
-Original Message-
From: Toke Eskildsen [mailto:t...@statsbiblioteket.dk]
Sent: Tuesday, May 20, 2014 3:01 PM
To: java-user@lucene.apache.org
Subject: Re: NewBie To Lucene || Perfect configuration on a 64 bit server
On Tue, 2014-05-20 at 10:40 +0200, Shruthi wrote:
> Just the index
On Tue, 2014-05-20 at 10:40 +0200, Shruthi wrote:
> Just the indexing took 20 seconds L
That's more than I expected, but it leaves the same question:
Is 20 second an acceptable response time for your users?
I don't know your document size, but unless they are very large, the
response times from a
-Original Message-
From: Toke Eskildsen [mailto:t...@statsbiblioteket.dk]
Sent: Tuesday, May 20, 2014 12:57 PM
To: java-user@lucene.apache.org
Subject: Re: NewBie To Lucene || Perfect configuration on a 64 bit server
On Mon, 2014-05-19 at 12:40 +0200, Shruthi wrote:
> 1. Cli
On Mon, 2014-05-19 at 12:40 +0200, Shruthi wrote:
> 1. Client makes a request with a search phrase. Lucene
> application indexes a list of 500 documents(at max. ) and searches the
> phrase on the index constructed.
Fetching from NAS + indexing sounds like something that would take a
second o
index all over again.
4. Request can come paralleled also.
We have decided to use MMapDirectory for above requirement. Given below is our
server configuration.
System architecture - 64 bit.
OS - Windows 2008, 64 bit Virtual Machine
Java JRE - 1.6
RAM - 4 GB
CPU - 4 CPU
Can you guide us
about how to
> configure Lucene (Elasticsearch, actually, but presumably the same deal) to
> index edge ngrams for typeahead. I don't really know how filters,
> analyzers, and tokenizers work together - documentation isn't helpful on
> that count either - but I managed t
helpful on
> that count either - but I managed to cobble together the following
> configuration that I thought would work. It doesn't, though - when I index
> documents into the collection with that setting, they still only match
> whole words instead of ngrams. What am I missing?
count either - but I managed to cobble together the following
configuration that I thought would work. It doesn't, though - when I index
documents into the collection with that setting, they still only match
whole words instead of ngrams. What am I missing? *Should* this work?
How do I
ul on
that count either - but I managed to cobble together the following
configuration that I thought would work. It doesn't, though - when I index
documents into the collection with that setting, they still only match
whole words instead of ngrams. What am I missing? *Should* this work?
How do
Thanks for the input.
I am not using Solr.
Also, my index has a fixed size, I am not going to update it.
-Original Message-
From: googoo [mailto:liu...@gmail.com]
Sent: 18 July 2012 15:21
To: java-user@lucene.apache.org
Subject: Re: In memory Lucene configuration
Doron,
To verify
configuration
doron, enlighten me please!
On Wed, Jul 18, 2012 at 1:32 PM, Doron Yaacoby
wrote:
> Glad to announce the problem was on my side, and had nothing to do with
> Lucene. Indeed, looks like that MMapDirectory is the best choice for me.
>
> Thanks again.
>
> -Original M
Hi,
just to clarify:
> In additional, i don't think load whole index to memory is good idea.
Since the
> index size will always increase.
> For me, i change lucene code to disable MMapDirectory, since the index
size is
> bigger and bigger.
> And MMapDirectory will call something like c++ share me
> From: Doron Yaacoby [mailto:dor...@gingersoftware.com]
> Sent: 16 July 2012 09:43
> To: java-user@lucene.apache.org
> Subject: RE: In memory Lucene configuration
>
> I haven't tried that yet, but it's an option. The reason I'm waiting on this
> is that I a
ze
is bigger and bigger.
And MMapDirectory will call something like c++ share memory to load whole
index to ram.
--
View this message in context:
http://lucene.472066.n3.nabble.com/In-memory-Lucene-configuration-tp3995075p3995697.html
Sent from the Lucene - Java Users mailing list archive at Nabbl
@lucene.apache.org
Subject: RE: In memory Lucene configuration
I haven't tried that yet, but it's an option. The reason I'm waiting on this is
that I am expecting many concurrent requests to my application anyway, so
having multiple search threads per request might not be the best idea
08:26
> To: java-user@lucene.apache.org
> Subject: Re: In memory Lucene configuration
>
> Have you tried sharding your data? Since you have a fast multi-core box, why
> not split your indices N-ways, say the smaller one into 4, and the larger
> into 8. Then you can have a pool of dedi
Vitaly Funstein [mailto:vfunst...@gmail.com]
Sent: 16 July 2012 08:26
To: java-user@lucene.apache.org
Subject: Re: In memory Lucene configuration
Have you tried sharding your data? Since you have a fast multi-core box, why
not split your indices N-ways, say the smaller one into 4, and the larger into
]
Sent: 15 July 2012 13:40
To: java-user@lucene.apache.org; simon.willna...@gmail.com
Subject: RE: In memory Lucene configuration
Thanks for the quick input!
I ran a few more tests with your suggested configuration (-Xmx1G -Xms1G with
MMapDirectory). At the third time I ran the same test I fi
as you probably already suspect.
On Sun, Jul 15, 2012 at 3:40 AM, Doron Yaacoby
wrote:
> Thanks for the quick input!
> I ran a few more tests with your suggested configuration (-Xmx1G -Xms1G with
> MMapDirectory). At the third time I ran the same test I finally got an
> improvemen
Thanks for the quick input!
I ran a few more tests with your suggested configuration (-Xmx1G -Xms1G with
MMapDirectory). At the third time I ran the same test I finally got an
improvement - an average of ~30ms per query, although it's still not as fast as
I need it to be.
The test con
at is important for lucene if you use MMap
/ NIOFS)
Your queries are straight boolean conjunctions or do you use positions
ie phrase queries or spans?
simon
>
> Any ideas about what could be the ideal configuration for me?
> Thanks.
>
-
emove-RAMDirectory-td3601156.html>).
Using a warmed up MMapDirectory didn't help; the average query time was a bit
slower. I tried using InstantiatedIndex, but it has a huge memory consumption,
I couldn't even load the smaller 6GB index.
Any ideas about what could be the ideal configuration for me?
Thanks.
Hi all , greetings from the very south .
I just ant to know if you can tell me some good tutorial on how to
configure a lucene indexer in a Spring Container for an indexing process
a number of files at every boot.
After a little google search I found several resources, I understand
that usi
are developing a site with a 4 tier design (RP, UI, WS, DB) and on the WS
> tier are looking at how we would setup Lucene in a HA configuration i.e. so
> there is no single point of failure. The initial deployment will involve
> pairs of servers at each tier.
>
> As there are at leas
Hi,
We are developing a site with a 4 tier design (RP, UI, WS, DB) and on
the WS tier are looking at how we would setup Lucene in a HA
configuration i.e. so there is no single point of failure. The initial
deployment will involve pairs of servers at each tier.
As there are at least 2
://sematext.com/ :: Solr - Lucene - Nutch
Lucene ecosystem search :: http://search-lucene.com/
- Original Message
From: Shuai Weng
To: java-user@lucene.apache.org
Sent: Fri, August 20, 2010 5:47:31 PM
Subject: Re: lucene indexing configuration
Hey,
Currently we have indexed some biological
://search-lucene.com/
- Original Message
> From: Shuai Weng
> To: java-user@lucene.apache.org
> Sent: Fri, August 20, 2010 5:47:31 PM
> Subject: Re: lucene indexing configuration
>
>
> Hey,
>
> Currently we have indexed some biological full text pages, I wa
Hey,
Currently we have indexed some biological full text pages, I was wondering how
to config the schema.xml such that
the gene names 'met1', 'met2', 'met3' will be treated as different words.
Currently they are all mapped to 'met'.
Thanks,
Shuai
Somewhat embarrassingly I can't seem to reproduce the problem anymore! I've
tried to reproduce it for the last hour now and no luck. Sorry about that. If
it happens again then I'll post back to the list.
Thanks for your time.
Amin
On 3 Aug 2010, at 22:35, Michael McCandless wrote:
> Can yo
Can you post the full exception? And also the log output from
IndexWriter.setInfoStream.
Mike
On Tue, Aug 3, 2010 at 5:28 PM, Amin Mohammed-Coleman wrote:
> Hi
>
> Apologies for re sending this email but I was just wondering if any one might
> be able to advise on the below. I'm not sure if I'
Hi
Apologies for re sending this email but I was just wondering if any one might
be able to advise on the below. I'm not sure if I've provided enough info.
Again any help would be appreciated.
Amin
Sent from my iPhone
On 1 Aug 2010, at 20:00, Amin Mohammed-Coleman wrote:
> Hi
>
> I am cu
Hi
I am currently building an application whereby there is a remote index server
(yes it probably does sound like Solr :)) and users use my API to send
documents to the indexing server for indexing. The 2 methods primarily used is
add and commit. So the user can send requests for documents to
Thanks.
--- On Wed, 13/1/10, Otis Gospodnetic wrote:
From: Otis Gospodnetic
Subject: Re: how to follow intranet: configuration in nutch website
To: java-user@lucene.apache.org
Date: Wednesday, 13 January, 2010, 12:07 PM
Zhou,
Your question will get more attention if you send it to
nutch-u
t; To: java-user@lucene.apache.org
> Sent: Tue, January 12, 2010 10:51:59 PM
> Subject: how to follow intranet: configuration in nutch website
>
> Hi,
>
> I try to following the instruction from
> http://lucene.apache.org/nutch/tutorial8.html
> .
> Intranet: Configuration
>
Hi,
I try to following the instruction from
http://lucene.apache.org/nutch/tutorial8.html
.
Intranet: Configuration
To configure things for intranet crawling you must:1. Create a directory with a
flat file of root urls. For example, to
crawl the nutch site you might start with a file named
dy,
> I always used lucene with its default configuration values.now I want to
> know if there is any document in which initial values for configuring a
> Lucene project is specified (values for Lucene, App Server and JDK).
>
> if anyone had such experience on achieving bes
If in general, the default values should be good for general purpose.
It'll be good to know which part you want to optimize, and exactly what
problem you want to solve.
But even you get very specific, nobody can tell you what's the best
configuration.
You have to try to adjust most va
Hi everybody,
I always used lucene with its default configuration values.now I want to
know if there is any document in which initial values for configuring a
Lucene project is specified (values for Lucene, App Server and JDK).
if anyone had such experience on achieving best performance of
: Message-ID:
: <[EMAIL PROTECTED]>
: In-Reply-To: <[EMAIL PROTECTED]>
http://people.apache.org/~hossman/#threadhijack
When starting a new discussion on a mailing list, please do not reply to
an existing message, instead start a fresh email. Even if you change the
subject line of your email
Hi.
I am new to jsp and I have to integrate lucene with a jsp web
application. I am facing problems in configuring lucene in my web
application. Can someone please provide me with the correct
configuration and installations steps to do the same?
Regards,
Neha Modi
The information in
Pradeep Sharma wrote:
Still in the designing phase, and I see that we need to manage several
> user / application specific configurations and I am exploring the idea
> of storing the configuration information also in the Index, may be
> create a separate index just for the conf
configurations and I am exploring the idea of storing the
configuration information also in the Index, may be create a separate index
just for the configuration, because each module of the application will have
access to Lucene classes.
I know technically this can be done, but are there any best practises
On Jun 20, 2005, at 3:36 PM, Yousef Ourabi wrote:
Hello:
I have a couple of quesitons on configuration strategies. I have a
project where I have to deal with changing search requirements, for
example one search may want to use term-vectors to find "keywords like
this" or whatever, an
Hello:
I have a couple of quesitons on configuration strategies. I have a
project where I have to deal with changing search requirements, for
example one search may want to use term-vectors to find "keywords like
this" or whatever, and the next may not.
Another requirement is that whe
67 matches
Mail list logo
