Re: unable to index using elastic-hadoop plugin

2014-04-28 Thread Costin Leau
Sorry, I'm not following. Who said "unable to index" ? By querying I meant reading data from Elasticsearch not writing (aka indexing). Even if you don't configure logging [1], if you launch your job with waitForComplete(true) you'll get the Es-Hadoop statistics at the end of it: Elasticsearch

Re: unable to index using elastic-hadoop plugin

2014-04-28 Thread Chetana
I have verified the index repository by querying, so said unable to index even though there are no error On Monday, April 28, 2014 12:35:12 PM UTC+5:30, Costin Leau wrote: > If ES is not running, getting an exception is expected since one will get > a connectivity error. > As for logging,

Re: unable to index using elastic-hadoop plugin

2014-04-28 Thread Costin Leau
If ES is not running, getting an exception is expected since one will get a connectivity error. As for logging, make sure you properly configure log4j for your Hadoop environment - it depends on what version you are using and what libraries. If the job is complete, you can always tests the resu

Re: unable to index using elastic-hadoop plugin

2014-04-27 Thread Chetana
I am using now ES 1.1.1 and as before es-hadoop 1.3.0.M3. But even with latest ES I am unable to index. I don't see any log pertaining to es-hadoop in any of the log file and also not on console. Also there is no exception while running the job and the job completes successfully But if elastic

Re: unable to index using elastic-hadoop plugin

2014-04-24 Thread Costin Leau
Try es-hadoop 1.3.0.M3 - if you enable logging as indicated in the docs I've mentioned you should be seeing all the activity - namely the connection being made, the data being transmitted, the reply, etc On 4/24/14 12:21 PM, Chetana wrote: Yes, I am able to search but not able to index. I a

Re: unable to index using elastic-hadoop plugin

2014-04-24 Thread Chetana
Yes, I am able to search but not able to index. I am using 1.3.0.M2. The json file size is just 28bytes. I corrected port/host and some log setting. With all these chnages I am to run the application, but the indexing is still not happening I dont see any error messages in log files. I am us

Re: unable to index using elastic-hadoop plugin

2014-04-23 Thread Costin Leau
Hi, If I understand correctly, you can read data from ES (through es-hadoop) but you cannot write to it - am I correct? Can you confirm that you are using the latest es-hadoop, namely 1.3.0.M3? How big is the JSON file you are trying to index? Do you see any activity in the console? There are