Re: Can Apache Solr Handle TeraByte Large Data

2015-08-05 Thread Mugeesh Husain
in context: http://lucene.472066.n3.nabble.com/Can-Apache-Solr-Handle-TeraByte-Large-Data-tp3656484p4221051.html Sent from the Solr - User mailing list archive at Nabble.com.

Re: Can Apache Solr Handle TeraByte Large Data

2015-08-05 Thread Upayavira
way to parse it -- View this message in context: http://lucene.472066.n3.nabble.com/Can-Apache-Solr-Handle-TeraByte-Large-Data-tp3656484p4221051.html Sent from the Solr - User mailing list archive at Nabble.com.

Re: Can Apache Solr Handle TeraByte Large Data

2015-08-05 Thread Mugeesh Husain
interaval. Does it will take same time in compare of HTTP or bin/post ? -- View this message in context: http://lucene.472066.n3.nabble.com/Can-Apache-Solr-Handle-TeraByte-Large-Data-tp3656484p4221060.html Sent from the Solr - User mailing list archive at Nabble.com.

Re: Can Apache Solr Handle TeraByte Large Data

2015-08-05 Thread Upayavira
or bin/post ? -- View this message in context: http://lucene.472066.n3.nabble.com/Can-Apache-Solr-Handle-TeraByte-Large-Data-tp3656484p4221060.html Sent from the Solr - User mailing list archive at Nabble.com.

Re: Can Apache Solr Handle TeraByte Large Data

2015-08-05 Thread Mugeesh Husain
@Mikhail Use of data import handler ,if i define my baseDir is D:/work/folder. Will it work for sub-folder and sub-folder of sub-folder ... etc also.? -- View this message in context: http://lucene.472066.n3.nabble.com/Can-Apache-Solr-Handle-TeraByte-Large-Data-tp3656484p4221063.html Sent

Re: Can Apache Solr Handle TeraByte Large Data

2015-08-05 Thread Mugeesh Husain
.n3.nabble.com/Can-Apache-Solr-Handle-TeraByte-Large-Data-tp3656484p4221066.html Sent from the Solr - User mailing list archive at Nabble.com.

Re: Can Apache Solr Handle TeraByte Large Data

2015-08-04 Thread Upayavira
it. -- View this message in context: http://lucene.472066.n3.nabble.com/Can-Apache-Solr-Handle-TeraByte-Large-Data-tp3656484p4220552.html Sent from the Solr - User mailing list archive at Nabble.com. -- Best regards, Konstantin Gribov

Re: Can Apache Solr Handle TeraByte Large Data

2015-08-04 Thread Mugeesh Husain
. i'd google but unable to find such type of DIH Example which i can implement on my problem. -- View this message in context: http://lucene.472066.n3.nabble.com/Can-Apache-Solr-Handle-TeraByte-Large-Data-tp3656484p4220673.html Sent from the Solr - User mailing list archive at Nabble.com.

Re: Can Apache Solr Handle TeraByte Large Data

2015-08-04 Thread Erik Hatcher
operation which i needed on my requirement. i'd google but unable to find such type of DIH Example which i can implement on my problem. -- View this message in context: http://lucene.472066.n3.nabble.com/Can-Apache-Solr-Handle-TeraByte-Large-Data-tp3656484p4220673.html Sent from

Re: Can Apache Solr Handle TeraByte Large Data

2015-08-04 Thread Upayavira
On Tue, Aug 4, 2015, at 06:13 PM, Mugeesh Husain wrote: @Upayavira if i uses Solrj for indexing. autocommit or Softautocommit will work in case of SolJ There are two ways to get content into Solr: * push it in via an HTTP post. - this is what SolrJ uses, what bin/post uses, and

Re: Can Apache Solr Handle TeraByte Large Data

2015-08-04 Thread Mugeesh Husain
it. -- View this message in context: http://lucene.472066.n3.nabble.com/Can-Apache-Solr-Handle-TeraByte-Large-Data-tp3656484p4220793.html Sent from the Solr - User mailing list archive at Nabble.com.

Re: Can Apache Solr Handle TeraByte Large Data

2015-08-04 Thread Mugeesh Husain
@Upayavira if i uses Solrj for indexing. autocommit or Softautocommit will work in case of SolJ -- View this message in context: http://lucene.472066.n3.nabble.com/Can-Apache-Solr-Handle-TeraByte-Large-Data-tp3656484p4220796.html Sent from the Solr - User mailing list archive at Nabble.com.

Re: Can Apache Solr Handle TeraByte Large Data

2015-08-04 Thread Mikhail Khludnev
://blog.griddynamics.com/2015/07/how-to-import-structured-data-into-solr.html I have googled but not get such type of requirement. provide my any of link for it or some suggestion to do it. -- View this message in context: http://lucene.472066.n3.nabble.com/Can-Apache-Solr-Handle-TeraByte-Large-Data

Re: Can Apache Solr Handle TeraByte Large Data

2015-08-03 Thread Mugeesh Husain
suggest me in which way i have to do it. 1.) Should i use Solrj 1.) Should i use DIH 1.) Should i use post method(in terminal) or Is there any other way for indexing such amount of data. -- View this message in context: http://lucene.472066.n3.nabble.com/Can-Apache-Solr-Handle-TeraByte-Large

Re: Can Apache Solr Handle TeraByte Large Data

2015-08-03 Thread Alexandre Rafalovitch
.n3.nabble.com/Can-Apache-Solr-Handle-TeraByte-Large-Data-tp3656484p4220469.html Sent from the Solr - User mailing list archive at Nabble.com.

Re: Can Apache Solr Handle TeraByte Large Data

2015-08-03 Thread Konstantin Gribov
.472066.n3.nabble.com/Can-Apache-Solr-Handle-TeraByte-Large-Data-tp3656484p4220552.html Sent from the Solr - User mailing list archive at Nabble.com. -- Best regards, Konstantin Gribov

Re: Can Apache Solr Handle TeraByte Large Data

2015-08-03 Thread Upayavira
.n3.nabble.com/Can-Apache-Solr-Handle-TeraByte-Large-Data-tp3656484p4220552.html Sent from the Solr - User mailing list archive at Nabble.com.

Re: Can Apache Solr Handle TeraByte Large Data

2015-08-03 Thread Erick Erickson
: http://lucene.472066.n3.nabble.com/Can-Apache-Solr-Handle-TeraByte-Large-Data-tp3656484p4220527.html Sent from the Solr - User mailing list archive at Nabble.com.

Re: Can Apache Solr Handle TeraByte Large Data

2015-08-03 Thread Erik Hatcher
.nabble.com/Can-Apache-Solr-Handle-TeraByte-Large-Data-tp3656484p4220527.html Sent from the Solr - User mailing list archive at Nabble.com.

Re: Can Apache Solr Handle TeraByte Large Data

2015-08-03 Thread Erick Erickson
file contains(Text) to index. You Told me The answer is Yes i didn't get in which way you said Yes. Thanks -- View this message in context: http://lucene.472066.n3.nabble.com/Can-Apache-Solr-Handle-TeraByte-Large-Data-tp3656484p4220527.html Sent from the Solr - User mailing list archive

Re: Can Apache Solr Handle TeraByte Large Data

2015-08-03 Thread Alexandre Rafalovitch
and these value have to be index to the solr. 2.)Do Not need file contains(Text) to index. You Told me The answer is Yes i didn't get in which way you said Yes. Thanks -- View this message in context: http://lucene.472066.n3.nabble.com/Can-Apache-Solr-Handle-TeraByte-Large-Data-tp3656484p4220527

Re: Can Apache Solr Handle TeraByte Large Data

2015-08-03 Thread Mugeesh Husain
on which way i will start my requirement. Please told me you guys are told me yes(Is yes for Solrj ? or DIH ?) -- View this message in context: http://lucene.472066.n3.nabble.com/Can-Apache-Solr-Handle-TeraByte-Large-Data-tp3656484p4220550.html Sent from the Solr - User mailing list archive

Re: Can Apache Solr Handle TeraByte Large Data

2015-08-03 Thread Mugeesh Husain
The answer is Yes i didn't get in which way you said Yes. Thanks -- View this message in context: http://lucene.472066.n3.nabble.com/Can-Apache-Solr-Handle-TeraByte-Large-Data-tp3656484p4220527.html Sent from the Solr - User mailing list archive at Nabble.com.

Re: Can Apache Solr Handle TeraByte Large Data

2015-08-03 Thread Alexandre Rafalovitch
from it. -- View this message in context: http://lucene.472066.n3.nabble.com/Can-Apache-Solr-Handle-TeraByte-Large-Data-tp3656484p4220552.html Sent from the Solr - User mailing list archive at Nabble.com.

Re: Can Apache Solr Handle TeraByte Large Data

2015-08-03 Thread Mugeesh Husain
it. -- View this message in context: http://lucene.472066.n3.nabble.com/Can-Apache-Solr-Handle-TeraByte-Large-Data-tp3656484p4220552.html Sent from the Solr - User mailing list archive at Nabble.com.

Re: Can Apache Solr Handle TeraByte Large Data

2012-01-17 Thread Otis Gospodnetic
Sent: Tuesday, January 17, 2012 12:15 AM Subject: Re: Can Apache Solr Handle TeraByte Large Data I've been toying with the idea of setting up an experiment to index a large document set 1+ TB -- any thoughts on an open data set that one could use for this purpose? Thanks. On Mon, Jan 16, 2012 at 5

Re: Can Apache Solr Handle TeraByte Large Data

2012-01-16 Thread Otis Gospodnetic
Hello, From: mustafozbek mustafoz...@gmail.com All documents that we use are rich text documents and we parse them with tika. we need to search real time. Because of real-time requirement, you'll need to use unreleased/dev version of Solr. Robert Stewart

RE: Can Apache Solr Handle TeraByte Large Data

2012-01-16 Thread Burton-West, Tom
Hello , Searching real-time sounds difficult with that amount of data. With large documents, 3 million documents, and 5TB of data the index will be very large. With indexes that large your performance will probably be I/O bound. Do you plan on allowing phrase or proximity searches? If so,

Re: Can Apache Solr Handle TeraByte Large Data

2012-01-14 Thread Otis Gospodnetic
Hello,   Inline - Original Message - From: mustafozbek mustafoz...@gmail.com I am an apache solr user about a year. I used solr for simple search tools but now I want to use solr with 5TB of data. I assume that 5TB data will be 7TB when solr index it according to filter that I use.

Re: Can Apache Solr Handle TeraByte Large Data

2012-01-13 Thread Daniel Brügge
resourses are not a problem. -- View this message in context: http://lucene.472066.n3.nabble.com/Can-Apache-Solr-Handle-TeraByte-Large-Data-tp3656484p3656484.html Sent from the Solr - User mailing list archive at Nabble.com.

Re: Can Apache Solr Handle TeraByte Large Data

2012-01-13 Thread darren
this message in context: http://lucene.472066.n3.nabble.com/Can-Apache-Solr-Handle-TeraByte-Large-Data-tp3656484p3656484.html Sent from the Solr - User mailing list archive at Nabble.com.

Re: Can Apache Solr Handle TeraByte Large Data

2012-01-13 Thread Robert Stewart
will be the result. Note: You can assume that hardware resourses are not a problem. -- View this message in context: http://lucene.472066.n3.nabble.com/Can-Apache-Solr-Handle-TeraByte-Large-Data-tp3656484p3656484.html Sent from the Solr - User mailing list archive at Nabble.com.