I don't see data, but I see it searching for the shards in the log files. Other functionality regarding the JDBC rivers don't seem to be working either in 1.2.1, but its extremely hard to debug those issues when my log files are constantly being filled with the following every minute or so.
[root@254020-web1 home]# tail /var/log/elasticsearch/elasticsearch.log at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107) at sun.nio.fs.UnixFileSystemProvider.newFileChannel(UnixFileSystemProvider.java:176) at java.nio.channels.FileChannel.open(FileChannel.java:287) at java.nio.channels.FileChannel.open(FileChannel.java:334) at org.apache.lucene.store.MMapDirectory.openInput(MMapDirectory.java:193) at org.apache.lucene.store.FilterDirectory.openInput(FilterDirectory.java:80) at org.elasticsearch.index.store.Store.openInputRaw(Store.java:319) at org.elasticsearch.indices.recovery.RecoverySource$1$1.run(RecoverySource.java:189) ... 3 more [2014-06-12 02:30:01,513][WARN ][cluster.action.shard ] [Metalhead] [blurays][3] sending failed shard for [blurays][3], node[UqeMw_y7RN-FQ3tuBNEdng], [R], s[INITIALIZING], indexUUID [z6lXF3L0S1KwwNZUUaiKsw], reason [Failed to start shard, message [RecoveryFailedException[[blurays][3]: Recovery failed from [Stilt-Man][mxmoAlTaTkClmfpImcpb1A][254020-web1.8coupons.com][inet[/ 192.168.100.218:9301]] into [Metalhead][UqeMw_y7RN-FQ3tuBNEdng][ 254020-web1.8coupons.com][inet[/192.168.100.218:9300]]]; nested: RemoteTransportException[[Stilt-Man][inet[/192.168.100.218:9301]][index/shard/recovery/startRecovery]]; nested: RecoveryEngineException[[blurays][3] Phase[1] Execution failed]; nested: RecoverFilesRecoveryException[[blurays][3] Failed to transfer [1] files with total size of [71b]]; nested: NoSuchFileException[/home/programs/elasticsearch-1.2.1/data/elasticsearch/nodes/1/indices/blurays/3/index/segments_1]; ]] [root@254020-web1 home]# On Thu, Jun 12, 2014 at 9:27 AM, Mark Walkom <[email protected]> wrote: > Just to clarify, is it just the directory that appears again at > /var/lib/elasticsearch/elasticsearch/nodes/0/indices, or are you saying > the indexed data in the shards is reappearing as well? > > Regards, > Mark Walkom > > Infrastructure Engineer > Campaign Monitor > email: [email protected] > web: www.campaignmonitor.com > > > On 12 June 2014 16:24, Sebastian Okser <[email protected]> wrote: > >> Neither have data directories. I also deleted all files I could find >> located at /var/lib/elasticsearch including >> /var/lib/elasticsearch/elasticsearch/nodes/0/indices, /etc/elasticsearch, >> their parent directories and every other directory I could find. I then >> again reinstalled and the data again appears at >> /var/lib/elasticsearch/elasticsearch/nodes/0/indices. >> >> [root@254020-web1 home]# ls /usr/local/share/elasticsearch >> >> ls: /usr/local/share/elasticsearch: No such file or directory >> >> [root@254020-web1 home]# ls /usr/share/elasticsearch/ >> >> LICENSE.txt NOTICE.txt README.textile bin lib plugins >> >> >> On Thu, Jun 12, 2014 at 9:12 AM, Mark Walkom <[email protected]> >> wrote: >> >>> You may have a data directory under /usr/local/share/elasticsearch, or >>> under /usr/share/elasticsearch, if it's there and you don't want the data, >>> delete them. >>> >>> Regards, >>> Mark Walkom >>> >>> Infrastructure Engineer >>> Campaign Monitor >>> email: [email protected] >>> web: www.campaignmonitor.com >>> >>> >>> On 12 June 2014 16:10, Sebastian Okser <[email protected]> wrote: >>> >>>> I should add that I have also tried uninstalling the RPM and >>>> reinstalling it. I used rpm -e elasticsearch-1.2.1 for the uninstall. >>>> >>>> >>>> On Thu, Jun 12, 2014 at 9:09 AM, Sebastian Okser <[email protected]> >>>> wrote: >>>> >>>>> I originally installed it with: >>>>> >>>>> >>>>> >>>>> >>>>> >>>>> >>>>> cd ~ >>>>> wget >>>>> https://github.com/downloads/elasticsearch/elasticsearch/elasticsearch-0.19.9.tar.gz >>>>> -O elasticsearch.tar.gz >>>>> >>>>> >>>>> >>>>> >>>>> >>>>> >>>>> >>>>> >>>>> >>>>> >>>>> tar -xf elasticsearch.tar.gz >>>>> rm elasticsearch.tar.gz >>>>> mv elasticsearch-* elasticsearch >>>>> sudo mv elasticsearch /usr/local/share >>>>> >>>>> curl -L >>>>> http://github.com/elasticsearch/elasticsearch-servicewrapper/tarball/master >>>>> | tar -xz >>>>> >>>>> >>>>> >>>>> >>>>> >>>>> >>>>> >>>>> >>>>> >>>>> mv *servicewrapper*/service /usr/local/share/elasticsearch/bin/ >>>>> rm -Rf *servicewrapper* >>>>> sudo /usr/local/share/elasticsearch/bin/service/elasticsearch install >>>>> sudo /etc/init.d/elasticsearch start >>>>> >>>>> >>>>> I then deleted all of these directories using rm -rf as specified in >>>>> past messages. I then reinstalled it using an RPM using: >>>>> >>>>> rpm -Uvh elasticsearch-1.2.1.noarch.rpm >>>>> >>>>> It seems to me that there must be some hidden place where it is >>>>> storing all of the settings. Thanks! >>>>> >>>>> >>>>> On Thu, Jun 12, 2014 at 9:04 AM, Mark Walkom < >>>>> [email protected]> wrote: >>>>> >>>>>> Is it a single node cluster? >>>>>> >>>>>> Howe are you installing things; deb, rpm, zip? >>>>>> How are you uninstalling it? >>>>>> Exact commands for the above will be helpful :) >>>>>> >>>>>> Regards, >>>>>> Mark Walkom >>>>>> >>>>>> Infrastructure Engineer >>>>>> Campaign Monitor >>>>>> email: [email protected] >>>>>> web: www.campaignmonitor.com >>>>>> >>>>>> >>>>>> On 12 June 2014 16:00, Sebastian Okser <[email protected]> wrote: >>>>>> >>>>>>> I should add that I want to do a 100% clean install it keeps >>>>>>> trying to initiate a recovery which is creating problems. >>>>>>> >>>>>>> >>>>>>> On Thu, Jun 12, 2014 at 8:42 AM, Sebastian Okser <[email protected]> >>>>>>> wrote: >>>>>>> >>>>>>>> I tried deleting the directories an reinstalling but somehow it >>>>>>>> keeps loading in my old environment even when I try to rm -rf the >>>>>>>> directories after shutting down the server? Where is elasticsearch >>>>>>>> hiding >>>>>>>> these files? >>>>>>>> >>>>>>>> >>>>>>>> On Wed, Jun 11, 2014 at 7:41 PM, Ivan Brusic <[email protected]> >>>>>>>> wrote: >>>>>>>> >>>>>>>>> Regarding your problem, are you perhaps running into the fact that >>>>>>>>> dynamic scripts are now disabled by default since 1.2? >>>>>>>>> >>>>>>>>> >>>>>>>>> http://www.elasticsearch.org/guide/en/elasticsearch/reference/current/modules-scripting.html#_enabling_dynamic_scripting >>>>>>>>> >>>>>>>>> In terms of deleting the existing version, it all depends on how >>>>>>>>> you installed Elasticsearch. If you did not override the defaults for >>>>>>>>> the >>>>>>>>> various directories, you can just delete the directory. >>>>>>>>> >>>>>>>>> >>>>>>>>> http://www.elasticsearch.org/guide/en/elasticsearch/reference/current/setup-dir-layout.html#setup-dir-layout >>>>>>>>> >>>>>>>>> -- >>>>>>>>> Ivan >>>>>>>>> >>>>>>>>> >>>>>>>>> On Wed, Jun 11, 2014 at 12:51 AM, John <[email protected]> wrote: >>>>>>>>> >>>>>>>>>> I recently upgraded to elasticsearch 1.2.1 and have since seen >>>>>>>>>> most of my scripts stop working. Nothing seems to work properly and >>>>>>>>>> I think >>>>>>>>>> I may have messed up during the upgrade. How can I properly delete >>>>>>>>>> elasticsearch and all associated data so I can reinstall it from >>>>>>>>>> scratch >>>>>>>>>> (all data, indices, etc removed). >>>>>>>>>> >>>>>>>>>> -- >>>>>>>>>> You received this message because you are subscribed to the >>>>>>>>>> Google Groups "elasticsearch" group. >>>>>>>>>> To unsubscribe from this group and stop receiving emails from it, >>>>>>>>>> send an email to [email protected]. >>>>>>>>>> >>>>>>>>>> To view this discussion on the web visit >>>>>>>>>> https://groups.google.com/d/msgid/elasticsearch/b7ca9761-05e7-4e24-b287-f98bbaeb4713%40googlegroups.com >>>>>>>>>> <https://groups.google.com/d/msgid/elasticsearch/b7ca9761-05e7-4e24-b287-f98bbaeb4713%40googlegroups.com?utm_medium=email&utm_source=footer> >>>>>>>>>> . >>>>>>>>>> For more options, visit https://groups.google.com/d/optout. >>>>>>>>>> >>>>>>>>> >>>>>>>>> -- >>>>>>>>> You received this message because you are subscribed to a topic in >>>>>>>>> the Google Groups "elasticsearch" group. >>>>>>>>> To unsubscribe from this topic, visit >>>>>>>>> https://groups.google.com/d/topic/elasticsearch/6YzVfTg-4ng/unsubscribe >>>>>>>>> . >>>>>>>>> To unsubscribe from this group and all its topics, send an email >>>>>>>>> to [email protected]. >>>>>>>>> To view this discussion on the web visit >>>>>>>>> https://groups.google.com/d/msgid/elasticsearch/CALY%3DcQAkb1XiEK7umZReNyPiQ-uE3YGhReUivPOdKcSbz81VuA%40mail.gmail.com >>>>>>>>> <https://groups.google.com/d/msgid/elasticsearch/CALY%3DcQAkb1XiEK7umZReNyPiQ-uE3YGhReUivPOdKcSbz81VuA%40mail.gmail.com?utm_medium=email&utm_source=footer> >>>>>>>>> . >>>>>>>>> >>>>>>>>> For more options, visit https://groups.google.com/d/optout. >>>>>>>>> >>>>>>>> >>>>>>>> >>>>>>> -- >>>>>>> You received this message because you are subscribed to the Google >>>>>>> Groups "elasticsearch" group. >>>>>>> To unsubscribe from this group and stop receiving emails from it, >>>>>>> send an email to [email protected]. >>>>>>> To view this discussion on the web visit >>>>>>> https://groups.google.com/d/msgid/elasticsearch/CAPrW28-9O%2B_gomzyDymGEPpsL%2B--que7AhQr3sUODEGOZuPC6w%40mail.gmail.com >>>>>>> <https://groups.google.com/d/msgid/elasticsearch/CAPrW28-9O%2B_gomzyDymGEPpsL%2B--que7AhQr3sUODEGOZuPC6w%40mail.gmail.com?utm_medium=email&utm_source=footer> >>>>>>> . >>>>>>> >>>>>>> For more options, visit https://groups.google.com/d/optout. >>>>>>> >>>>>> >>>>>> -- >>>>>> You received this message because you are subscribed to a topic in >>>>>> the Google Groups "elasticsearch" group. >>>>>> To unsubscribe from this topic, visit >>>>>> https://groups.google.com/d/topic/elasticsearch/6YzVfTg-4ng/unsubscribe >>>>>> . >>>>>> To unsubscribe from this group and all its topics, send an email to >>>>>> [email protected]. >>>>>> To view this discussion on the web visit >>>>>> https://groups.google.com/d/msgid/elasticsearch/CAEM624ZfPSOc7GGteX6SYv03n5i5UTV9zHaTC%3D5WDBEDd0MGWQ%40mail.gmail.com >>>>>> <https://groups.google.com/d/msgid/elasticsearch/CAEM624ZfPSOc7GGteX6SYv03n5i5UTV9zHaTC%3D5WDBEDd0MGWQ%40mail.gmail.com?utm_medium=email&utm_source=footer> >>>>>> . >>>>>> >>>>>> For more options, visit https://groups.google.com/d/optout. >>>>>> >>>>> >>>>> >>>> -- >>>> You received this message because you are subscribed to the Google >>>> Groups "elasticsearch" group. >>>> To unsubscribe from this group and stop receiving emails from it, send >>>> an email to [email protected]. >>>> To view this discussion on the web visit >>>> https://groups.google.com/d/msgid/elasticsearch/CAPrW28_DNmoQJ5KonPMgnwH6QJ1eZvT6j4gXHUkgCa4_iBTUBA%40mail.gmail.com >>>> <https://groups.google.com/d/msgid/elasticsearch/CAPrW28_DNmoQJ5KonPMgnwH6QJ1eZvT6j4gXHUkgCa4_iBTUBA%40mail.gmail.com?utm_medium=email&utm_source=footer> >>>> . >>>> >>>> For more options, visit https://groups.google.com/d/optout. >>>> >>> >>> -- >>> You received this message because you are subscribed to a topic in the >>> Google Groups "elasticsearch" group. >>> To unsubscribe from this topic, visit >>> https://groups.google.com/d/topic/elasticsearch/6YzVfTg-4ng/unsubscribe. >>> To unsubscribe from this group and all its topics, send an email to >>> [email protected]. >>> To view this discussion on the web visit >>> https://groups.google.com/d/msgid/elasticsearch/CAEM624Yk2KN95ErhTy9gX-ZTJWpfwo7YYDvGmA72ceTm_QrNAQ%40mail.gmail.com >>> <https://groups.google.com/d/msgid/elasticsearch/CAEM624Yk2KN95ErhTy9gX-ZTJWpfwo7YYDvGmA72ceTm_QrNAQ%40mail.gmail.com?utm_medium=email&utm_source=footer> >>> . >>> >>> For more options, visit https://groups.google.com/d/optout. >>> >> >> -- >> You received this message because you are subscribed to the Google Groups >> "elasticsearch" group. >> To unsubscribe from this group and stop receiving emails from it, send an >> email to [email protected]. >> To view this discussion on the web visit >> https://groups.google.com/d/msgid/elasticsearch/CAPrW28-HT8BBkA8ZkkZgcKit7rsk5NBBuZXtJmN3G4PhhvY5Aw%40mail.gmail.com >> <https://groups.google.com/d/msgid/elasticsearch/CAPrW28-HT8BBkA8ZkkZgcKit7rsk5NBBuZXtJmN3G4PhhvY5Aw%40mail.gmail.com?utm_medium=email&utm_source=footer> >> . >> >> For more options, visit https://groups.google.com/d/optout. >> > > -- > You received this message because you are subscribed to a topic in the > Google Groups "elasticsearch" group. > To unsubscribe from this topic, visit > https://groups.google.com/d/topic/elasticsearch/6YzVfTg-4ng/unsubscribe. > To unsubscribe from this group and all its topics, send an email to > [email protected]. > To view this discussion on the web visit > https://groups.google.com/d/msgid/elasticsearch/CAEM624aY%3D_FJAh-FhSJRSTKPAB_6brdMhnSzQBRwaJWQe56dpA%40mail.gmail.com > <https://groups.google.com/d/msgid/elasticsearch/CAEM624aY%3D_FJAh-FhSJRSTKPAB_6brdMhnSzQBRwaJWQe56dpA%40mail.gmail.com?utm_medium=email&utm_source=footer> > . > > For more options, visit https://groups.google.com/d/optout. > -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to [email protected]. To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/CAPrW289L4z8kT01N4kPX4Gs0Y1PO9%2Bp88VMP_QP-3Ppiawd2wQ%40mail.gmail.com. For more options, visit https://groups.google.com/d/optout.
