Re: Regarding Indexing to elasticsearch

2018-03-02 Thread Sebastian Nagel
h], size [7], queue size [1k] >>>>> >>>>> created thread pool: name [flush], core [1], max [2], keep alive [5m] >>>>> >>>>> created thread pool: name [fetch_shard_store], core [1], max [8], keep >>>>>

Re: Regarding Indexing to elasticsearch

2018-03-02 Thread Yash Thenuan Thenuan
d to node > >>> [{tzfqJn0}{tzfqJn0sS5OPV4lKreU60w}{QCGd9doAQaGw4Q_lOqniLQ}{127.0.0.1}{ > >>> 127.0.0.1:9300}] > >>> > >>> IndexingJob: done > >>> > >>> > >>> On Wed, Feb 28, 2018 at 10:05 PM, Sebastian Nagel < >

Re: Regarding Indexing to elasticsearch

2018-03-02 Thread Sebastian Nagel
quot;indexer-elastic2" in 2.4) >>>> >>>> - expects ES 1.4.1 >>>> >>>> - available/required options are found in the log file (hadoop.log): >>>>ElasticIndexWriter >>>> elastic.cluster : elastic prefix cluster &

Re: Regarding Indexing to elasticsearch

2018-03-01 Thread Yash Thenuan Thenuan
0) > >> elastic.index : elastic index command > >> elastic.max.bulk.docs : elastic bulk index doc counts. (default > >> 250) > >> elastic.max.bulk.size : elastic bulk index length. (default > >> 2500500 ~2.5MB) > &

Re: Regarding Indexing to elasticsearch

2018-03-01 Thread Sebastian Nagel
(default >> 2500500 ~2.5MB) >> >> Sebastian >> >> On 02/28/2018 01:26 PM, Yash Thenuan Thenuan wrote: >>> Yeah >>> I was also thinking that >>> Can somebody help me with nutch 2.3? >>> >>> On 28 Feb 2018 17:53, "Yossi

Re: Regarding Indexing to elasticsearch

2018-02-28 Thread Yash Thenuan Thenuan
using Nutch 2.x and I'm answering for > >> Nutch 1.x. I'm afraid I can't help you. > >> > >>> -Original Message- > >>> From: Yash Thenuan Thenuan [mailto:rit2014...@iiita.ac.in] > >>> Sent: 28 February 2018 14:20 > >>> To: use

RE: Regarding Indexing to elasticsearch

2018-02-28 Thread Yash Thenuan Thenuan
-Original Message- > > From: Yash Thenuan Thenuan [mailto:rit2014...@iiita.ac.in] > > Sent: 28 February 2018 14:20 > > To: user@nutch.apache.org > > Subject: RE: Regarding Indexing to elasticsearch > > > > IndexingJob ( | -all |-reindex) [-crawlId ] This is

RE: Regarding Indexing to elasticsearch

2018-02-28 Thread Yossi Tamari
r CrawlDB and either the segment you want to > > index or the directory that contains all the segments you want to index. > > > > > -Original Message- > > > From: Yash Thenuan Thenuan [mailto:rit2014...@iiita.ac.in] > > > Sent: 28 February 2018 14:06 > >

RE: Regarding Indexing to elasticsearch

2018-02-28 Thread Yash Thenuan Thenuan
ments you want to index. > > > -Original Message- > > From: Yash Thenuan Thenuan [mailto:rit2014...@iiita.ac.in] > > Sent: 28 February 2018 14:06 > > To: user@nutch.apache.org > > Subject: RE: Regarding Indexing to elasticsearch > > > > All I wa

RE: Regarding Indexing to elasticsearch

2018-02-28 Thread Yash Thenuan Thenuan
Message- > From: Yash Thenuan Thenuan [mailto:rit2014...@iiita.ac.in] > Sent: 28 February 2018 13:55 > To: user@nutch.apache.org > Subject: Regarding Indexing to elasticsearch > > Can somebody please tell me what happens when we hit the bin/nutc index -all > command. > Becaus

Regarding Indexing to elasticsearch

2018-02-28 Thread Yash Thenuan Thenuan
Can somebody please tell me what happens when we hit the bin/nutc index -all command. Because I can't figure out why the write function inside the elastic-indexer is not getting executed.