Why does it mention this path /home/programs/elasticsearch-1.2.1/ data/elasticsearch/nodes/1/indices/blurays/3/index/segments_1
Regards, Mark Walkom Infrastructure Engineer Campaign Monitor email: [email protected] web: www.campaignmonitor.com On 12 June 2014 16:33, Sebastian Okser <[email protected]> wrote: > I don't see data, but I see it searching for the shards in the log files. > Other functionality regarding the JDBC rivers don't seem to be working > either in 1.2.1, but its extremely hard to debug those issues when my log > files are constantly being filled with the following every minute or so. > > [root@254020-web1 home]# tail /var/log/elasticsearch/elasticsearch.log > at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107) > at > sun.nio.fs.UnixFileSystemProvider.newFileChannel(UnixFileSystemProvider.java:176) > at java.nio.channels.FileChannel.open(FileChannel.java:287) > at java.nio.channels.FileChannel.open(FileChannel.java:334) > at org.apache.lucene.store.MMapDirectory.openInput(MMapDirectory.java:193) > at > org.apache.lucene.store.FilterDirectory.openInput(FilterDirectory.java:80) > at org.elasticsearch.index.store.Store.openInputRaw(Store.java:319) > at > org.elasticsearch.indices.recovery.RecoverySource$1$1.run(RecoverySource.java:189) > ... 3 more > [2014-06-12 02:30:01,513][WARN ][cluster.action.shard ] [Metalhead] > [blurays][3] sending failed shard for [blurays][3], > node[UqeMw_y7RN-FQ3tuBNEdng], [R], s[INITIALIZING], indexUUID > [z6lXF3L0S1KwwNZUUaiKsw], reason [Failed to start shard, message > [RecoveryFailedException[[blurays][3]: Recovery failed from > [Stilt-Man][mxmoAlTaTkClmfpImcpb1A][254020-web1.8coupons.com][inet[/ > 192.168.100.218:9301]] into [Metalhead][UqeMw_y7RN-FQ3tuBNEdng][ > 254020-web1.8coupons.com][inet[/192.168.100.218:9300]]]; nested: > RemoteTransportException[[Stilt-Man][inet[/192.168.100.218:9301]][index/shard/recovery/startRecovery]]; > nested: RecoveryEngineException[[blurays][3] Phase[1] Execution failed]; > nested: RecoverFilesRecoveryException[[blurays][3] Failed to transfer [1] > files with total size of [71b]]; nested: > NoSuchFileException[/home/programs/elasticsearch-1.2.1/data/elasticsearch/nodes/1/indices/blurays/3/index/segments_1]; > ]] > [root@254020-web1 home]# > > > On Thu, Jun 12, 2014 at 9:27 AM, Mark Walkom <[email protected]> > wrote: > >> Just to clarify, is it just the directory that appears again at >> /var/lib/elasticsearch/elasticsearch/nodes/0/indices, or are you saying >> the indexed data in the shards is reappearing as well? >> >> Regards, >> Mark Walkom >> >> Infrastructure Engineer >> Campaign Monitor >> email: [email protected] >> web: www.campaignmonitor.com >> >> >> On 12 June 2014 16:24, Sebastian Okser <[email protected]> wrote: >> >>> Neither have data directories. I also deleted all files I could find >>> located at /var/lib/elasticsearch including >>> /var/lib/elasticsearch/elasticsearch/nodes/0/indices, /etc/elasticsearch, >>> their parent directories and every other directory I could find. I then >>> again reinstalled and the data again appears at >>> /var/lib/elasticsearch/elasticsearch/nodes/0/indices. >>> >>> [root@254020-web1 home]# ls /usr/local/share/elasticsearch >>> >>> ls: /usr/local/share/elasticsearch: No such file or directory >>> >>> [root@254020-web1 home]# ls /usr/share/elasticsearch/ >>> >>> LICENSE.txt NOTICE.txt README.textile bin lib plugins >>> >>> >>> On Thu, Jun 12, 2014 at 9:12 AM, Mark Walkom <[email protected]> >>> wrote: >>> >>>> You may have a data directory under /usr/local/share/elasticsearch, or >>>> under /usr/share/elasticsearch, if it's there and you don't want the data, >>>> delete them. >>>> >>>> Regards, >>>> Mark Walkom >>>> >>>> Infrastructure Engineer >>>> Campaign Monitor >>>> email: [email protected] >>>> web: www.campaignmonitor.com >>>> >>>> >>>> On 12 June 2014 16:10, Sebastian Okser <[email protected]> wrote: >>>> >>>>> I should add that I have also tried uninstalling the RPM and >>>>> reinstalling it. I used rpm -e elasticsearch-1.2.1 for the uninstall. >>>>> >>>>> >>>>> On Thu, Jun 12, 2014 at 9:09 AM, Sebastian Okser <[email protected]> >>>>> wrote: >>>>> >>>>>> I originally installed it with: >>>>>> >>>>>> >>>>>> >>>>>> >>>>>> >>>>>> >>>>>> >>>>>> cd ~ >>>>>> wget >>>>>> https://github.com/downloads/elasticsearch/elasticsearch/elasticsearch-0.19.9.tar.gz >>>>>> -O elasticsearch.tar.gz >>>>>> >>>>>> >>>>>> >>>>>> >>>>>> >>>>>> >>>>>> >>>>>> >>>>>> >>>>>> >>>>>> >>>>>> >>>>>> tar -xf elasticsearch.tar.gz >>>>>> rm elasticsearch.tar.gz >>>>>> mv elasticsearch-* elasticsearch >>>>>> sudo mv elasticsearch /usr/local/share >>>>>> >>>>>> curl -L >>>>>> http://github.com/elasticsearch/elasticsearch-servicewrapper/tarball/master >>>>>> | tar -xz >>>>>> >>>>>> >>>>>> >>>>>> >>>>>> >>>>>> >>>>>> >>>>>> >>>>>> >>>>>> >>>>>> >>>>>> mv *servicewrapper*/service /usr/local/share/elasticsearch/bin/ >>>>>> rm -Rf *servicewrapper* >>>>>> sudo /usr/local/share/elasticsearch/bin/service/elasticsearch install >>>>>> sudo /etc/init.d/elasticsearch start >>>>>> >>>>>> >>>>>> I then deleted all of these directories using rm -rf as specified in >>>>>> past messages. I then reinstalled it using an RPM using: >>>>>> >>>>>> rpm -Uvh elasticsearch-1.2.1.noarch.rpm >>>>>> >>>>>> It seems to me that there must be some hidden place where it is >>>>>> storing all of the settings. Thanks! >>>>>> >>>>>> >>>>>> On Thu, Jun 12, 2014 at 9:04 AM, Mark Walkom < >>>>>> [email protected]> wrote: >>>>>> >>>>>>> Is it a single node cluster? >>>>>>> >>>>>>> Howe are you installing things; deb, rpm, zip? >>>>>>> How are you uninstalling it? >>>>>>> Exact commands for the above will be helpful :) >>>>>>> >>>>>>> Regards, >>>>>>> Mark Walkom >>>>>>> >>>>>>> Infrastructure Engineer >>>>>>> Campaign Monitor >>>>>>> email: [email protected] >>>>>>> web: www.campaignmonitor.com >>>>>>> >>>>>>> >>>>>>> On 12 June 2014 16:00, Sebastian Okser <[email protected]> wrote: >>>>>>> >>>>>>>> I should add that I want to do a 100% clean install it keeps >>>>>>>> trying to initiate a recovery which is creating problems. >>>>>>>> >>>>>>>> >>>>>>>> On Thu, Jun 12, 2014 at 8:42 AM, Sebastian Okser <[email protected]> >>>>>>>> wrote: >>>>>>>> >>>>>>>>> I tried deleting the directories an reinstalling but somehow it >>>>>>>>> keeps loading in my old environment even when I try to rm -rf the >>>>>>>>> directories after shutting down the server? Where is elasticsearch >>>>>>>>> hiding >>>>>>>>> these files? >>>>>>>>> >>>>>>>>> >>>>>>>>> On Wed, Jun 11, 2014 at 7:41 PM, Ivan Brusic <[email protected]> >>>>>>>>> wrote: >>>>>>>>> >>>>>>>>>> Regarding your problem, are you perhaps running into the fact >>>>>>>>>> that dynamic scripts are now disabled by default since 1.2? >>>>>>>>>> >>>>>>>>>> >>>>>>>>>> http://www.elasticsearch.org/guide/en/elasticsearch/reference/current/modules-scripting.html#_enabling_dynamic_scripting >>>>>>>>>> >>>>>>>>>> In terms of deleting the existing version, it all depends on how >>>>>>>>>> you installed Elasticsearch. If you did not override the defaults >>>>>>>>>> for the >>>>>>>>>> various directories, you can just delete the directory. >>>>>>>>>> >>>>>>>>>> >>>>>>>>>> http://www.elasticsearch.org/guide/en/elasticsearch/reference/current/setup-dir-layout.html#setup-dir-layout >>>>>>>>>> >>>>>>>>>> -- >>>>>>>>>> Ivan >>>>>>>>>> >>>>>>>>>> >>>>>>>>>> On Wed, Jun 11, 2014 at 12:51 AM, John <[email protected]> wrote: >>>>>>>>>> >>>>>>>>>>> I recently upgraded to elasticsearch 1.2.1 and have since seen >>>>>>>>>>> most of my scripts stop working. Nothing seems to work properly and >>>>>>>>>>> I think >>>>>>>>>>> I may have messed up during the upgrade. How can I properly delete >>>>>>>>>>> elasticsearch and all associated data so I can reinstall it from >>>>>>>>>>> scratch >>>>>>>>>>> (all data, indices, etc removed). >>>>>>>>>>> >>>>>>>>>>> -- >>>>>>>>>>> You received this message because you are subscribed to the >>>>>>>>>>> Google Groups "elasticsearch" group. >>>>>>>>>>> To unsubscribe from this group and stop receiving emails from >>>>>>>>>>> it, send an email to [email protected]. >>>>>>>>>>> >>>>>>>>>>> To view this discussion on the web visit >>>>>>>>>>> https://groups.google.com/d/msgid/elasticsearch/b7ca9761-05e7-4e24-b287-f98bbaeb4713%40googlegroups.com >>>>>>>>>>> <https://groups.google.com/d/msgid/elasticsearch/b7ca9761-05e7-4e24-b287-f98bbaeb4713%40googlegroups.com?utm_medium=email&utm_source=footer> >>>>>>>>>>> . >>>>>>>>>>> For more options, visit https://groups.google.com/d/optout. >>>>>>>>>>> >>>>>>>>>> >>>>>>>>>> -- >>>>>>>>>> You received this message because you are subscribed to a topic >>>>>>>>>> in the Google Groups "elasticsearch" group. >>>>>>>>>> To unsubscribe from this topic, visit >>>>>>>>>> https://groups.google.com/d/topic/elasticsearch/6YzVfTg-4ng/unsubscribe >>>>>>>>>> . >>>>>>>>>> To unsubscribe from this group and all its topics, send an email >>>>>>>>>> to [email protected]. >>>>>>>>>> To view this discussion on the web visit >>>>>>>>>> https://groups.google.com/d/msgid/elasticsearch/CALY%3DcQAkb1XiEK7umZReNyPiQ-uE3YGhReUivPOdKcSbz81VuA%40mail.gmail.com >>>>>>>>>> <https://groups.google.com/d/msgid/elasticsearch/CALY%3DcQAkb1XiEK7umZReNyPiQ-uE3YGhReUivPOdKcSbz81VuA%40mail.gmail.com?utm_medium=email&utm_source=footer> >>>>>>>>>> . >>>>>>>>>> >>>>>>>>>> For more options, visit https://groups.google.com/d/optout. >>>>>>>>>> >>>>>>>>> >>>>>>>>> >>>>>>>> -- >>>>>>>> You received this message because you are subscribed to the Google >>>>>>>> Groups "elasticsearch" group. >>>>>>>> To unsubscribe from this group and stop receiving emails from it, >>>>>>>> send an email to [email protected]. >>>>>>>> To view this discussion on the web visit >>>>>>>> https://groups.google.com/d/msgid/elasticsearch/CAPrW28-9O%2B_gomzyDymGEPpsL%2B--que7AhQr3sUODEGOZuPC6w%40mail.gmail.com >>>>>>>> <https://groups.google.com/d/msgid/elasticsearch/CAPrW28-9O%2B_gomzyDymGEPpsL%2B--que7AhQr3sUODEGOZuPC6w%40mail.gmail.com?utm_medium=email&utm_source=footer> >>>>>>>> . >>>>>>>> >>>>>>>> For more options, visit https://groups.google.com/d/optout. >>>>>>>> >>>>>>> >>>>>>> -- >>>>>>> You received this message because you are subscribed to a topic in >>>>>>> the Google Groups "elasticsearch" group. >>>>>>> To unsubscribe from this topic, visit >>>>>>> https://groups.google.com/d/topic/elasticsearch/6YzVfTg-4ng/unsubscribe >>>>>>> . >>>>>>> To unsubscribe from this group and all its topics, send an email to >>>>>>> [email protected]. >>>>>>> To view this discussion on the web visit >>>>>>> https://groups.google.com/d/msgid/elasticsearch/CAEM624ZfPSOc7GGteX6SYv03n5i5UTV9zHaTC%3D5WDBEDd0MGWQ%40mail.gmail.com >>>>>>> <https://groups.google.com/d/msgid/elasticsearch/CAEM624ZfPSOc7GGteX6SYv03n5i5UTV9zHaTC%3D5WDBEDd0MGWQ%40mail.gmail.com?utm_medium=email&utm_source=footer> >>>>>>> . >>>>>>> >>>>>>> For more options, visit https://groups.google.com/d/optout. >>>>>>> >>>>>> >>>>>> >>>>> -- >>>>> You received this message because you are subscribed to the Google >>>>> Groups "elasticsearch" group. >>>>> To unsubscribe from this group and stop receiving emails from it, send >>>>> an email to [email protected]. >>>>> To view this discussion on the web visit >>>>> https://groups.google.com/d/msgid/elasticsearch/CAPrW28_DNmoQJ5KonPMgnwH6QJ1eZvT6j4gXHUkgCa4_iBTUBA%40mail.gmail.com >>>>> <https://groups.google.com/d/msgid/elasticsearch/CAPrW28_DNmoQJ5KonPMgnwH6QJ1eZvT6j4gXHUkgCa4_iBTUBA%40mail.gmail.com?utm_medium=email&utm_source=footer> >>>>> . >>>>> >>>>> For more options, visit https://groups.google.com/d/optout. >>>>> >>>> >>>> -- >>>> You received this message because you are subscribed to a topic in the >>>> Google Groups "elasticsearch" group. >>>> To unsubscribe from this topic, visit >>>> https://groups.google.com/d/topic/elasticsearch/6YzVfTg-4ng/unsubscribe >>>> . >>>> To unsubscribe from this group and all its topics, send an email to >>>> [email protected]. >>>> To view this discussion on the web visit >>>> https://groups.google.com/d/msgid/elasticsearch/CAEM624Yk2KN95ErhTy9gX-ZTJWpfwo7YYDvGmA72ceTm_QrNAQ%40mail.gmail.com >>>> <https://groups.google.com/d/msgid/elasticsearch/CAEM624Yk2KN95ErhTy9gX-ZTJWpfwo7YYDvGmA72ceTm_QrNAQ%40mail.gmail.com?utm_medium=email&utm_source=footer> >>>> . >>>> >>>> For more options, visit https://groups.google.com/d/optout. >>>> >>> >>> -- >>> You received this message because you are subscribed to the Google >>> Groups "elasticsearch" group. >>> To unsubscribe from this group and stop receiving emails from it, send >>> an email to [email protected]. >>> To view this discussion on the web visit >>> https://groups.google.com/d/msgid/elasticsearch/CAPrW28-HT8BBkA8ZkkZgcKit7rsk5NBBuZXtJmN3G4PhhvY5Aw%40mail.gmail.com >>> <https://groups.google.com/d/msgid/elasticsearch/CAPrW28-HT8BBkA8ZkkZgcKit7rsk5NBBuZXtJmN3G4PhhvY5Aw%40mail.gmail.com?utm_medium=email&utm_source=footer> >>> . >>> >>> For more options, visit https://groups.google.com/d/optout. >>> >> >> -- >> You received this message because you are subscribed to a topic in the >> Google Groups "elasticsearch" group. >> To unsubscribe from this topic, visit >> https://groups.google.com/d/topic/elasticsearch/6YzVfTg-4ng/unsubscribe. >> To unsubscribe from this group and all its topics, send an email to >> [email protected]. >> To view this discussion on the web visit >> https://groups.google.com/d/msgid/elasticsearch/CAEM624aY%3D_FJAh-FhSJRSTKPAB_6brdMhnSzQBRwaJWQe56dpA%40mail.gmail.com >> <https://groups.google.com/d/msgid/elasticsearch/CAEM624aY%3D_FJAh-FhSJRSTKPAB_6brdMhnSzQBRwaJWQe56dpA%40mail.gmail.com?utm_medium=email&utm_source=footer> >> . >> >> For more options, visit https://groups.google.com/d/optout. >> > > -- > You received this message because you are subscribed to the Google Groups > "elasticsearch" group. > To unsubscribe from this group and stop receiving emails from it, send an > email to [email protected]. > To view this discussion on the web visit > https://groups.google.com/d/msgid/elasticsearch/CAPrW289L4z8kT01N4kPX4Gs0Y1PO9%2Bp88VMP_QP-3Ppiawd2wQ%40mail.gmail.com > <https://groups.google.com/d/msgid/elasticsearch/CAPrW289L4z8kT01N4kPX4Gs0Y1PO9%2Bp88VMP_QP-3Ppiawd2wQ%40mail.gmail.com?utm_medium=email&utm_source=footer> > . > For more options, visit https://groups.google.com/d/optout. > -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to [email protected]. To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/CAEM624ZuysNAkgb5ynMPG%3DhwJDiBaz35y8TBHvPOJ2mUDWHBvQ%40mail.gmail.com. For more options, visit https://groups.google.com/d/optout.
