Updating my command, could there be an issue with the write lock on the
events-production index?
[root@localhost ~]# strace -f -e trace=file,read,write -p 17197
[pid 17231]
stat("/var/lib/elasticsearch/elasticsearch/nodes/0/indices/events-production/2/index/write.lock",
{st_mode=S_IFREG|0644, st_size=0, ...}) = 0
[pid 17231] write(26, "[2014-11-03 16:18:31,244][DEBUG]"..., 138) = 138
[pid 17231]
stat("/var/lib/elasticsearch/elasticsearch/nodes/0/indices/events-production/2/translog",
{st_mode=S_IFDIR|0755, st_size=4096, ...}) = 0
[pid 17231] write(26, "[2014-11-03 16:18:31,257][DEBUG]"..., 316) = 316
[pid 17231] open("/sys/devices/system/cpu/online", O_RDONLY|O_CLOEXEC) = 142
[pid 17231] read(142, "0\n", 8192) = 2
[pid 17231] write(26, "[2014-11-03 16:18:31,273][DEBUG]"..., 179) = 179
[pid 17231] write(26, "[2014-11-03 16:18:31,274][DEBUG]"..., 116) = 116
[pid 17231] write(26, "[2014-11-03 16:18:31,275][DEBUG]"..., 207) = 207
) = ? <unavailable>
[pid 17232] +++ killed by SIGKILL +++
*-Jef Statham*
Without vices there would be no virtues.
It’s a magical world, Hobbes, ol’ buddy…Let’s go exploring!
On Mon, Nov 3, 2014 at 4:16 PM, Jef Statham <[email protected]> wrote:
> These debugging commands are neat I'm learning as we go, here's some file
> access stats:
>
>
> [root@localhost ~]# service elasticsearch start
>
> Starting elasticsearch: [ OK ]
>
> [root@localhost ~]# service elasticsearch status
>
> elasticsearch (pid 17129) is running...
>
> [root@localhost ~]# strace -f -e trace=file -p 17129
>
> Process 17129 attached with 35 threads - interrupt to quit
>
> [pid 17163] lstat("/usr", {st_mode=S_IFDIR|0755, st_size=4096, ...}) = 0
>
> [pid 17163] lstat("/usr/share", {st_mode=S_IFDIR|0755, st_size=4096, ...})
> = 0
>
> [pid 17163] lstat("/usr/share/elasticsearch", {st_mode=S_IFDIR|0777,
> st_size=4096, ...}) = 0
>
> [pid 17163] lstat("/usr/share/elasticsearch/lib", {st_mode=S_IFDIR|0777,
> st_size=4096, ...}) = 0
>
> [pid 17163] lstat("/usr/share/elasticsearch/lib/lucene-core-4.9.1.jar",
> {st_mode=S_IFREG|0777, st_size=2507813, ...}) = 0
>
> [pid 17163]
> stat("/org/apache/lucene/codecs/lucene42/Lucene42DocValuesFormat.class",
> 0x7f1b301331c0) = -1 ENOENT (No such file or directory)
>
> [pid 17151] open("/usr/java/jdk1.8.0_25/jre/lib/amd64/server/libjvm.so",
> O_RDONLY) = 95
>
> [pid 17151] open("/usr/java/jdk1.8.0_25/jre/lib/amd64/server/libjvm.so",
> O_RDONLY) = 95
>
> ) = ? <unavailable>
>
> [pid 17172] +++ killed by SIGKILL +++
>
> PANIC: handle_group_exit: 17172 leader 17129
>
> [pid 17171] +++ killed by SIGKILL +++
>
> PANIC: handle_group_exit: 17171 leader 17129
>
> [pid 17170] +++ killed by SIGKILL +++
>
> PANIC: handle_group_exit: 17170 leader 17129
>
> [pid 17169] +++ killed by SIGKILL +++
>
> PANIC: handle_group_exit: 17169 leader 17129
>
> [pid 17168] +++ killed by SIGKILL +++
>
> PANIC: handle_group_exit: 17168 leader 17129
>
> [pid 17167] +++ killed by SIGKILL +++
>
> PANIC: handle_group_exit: 17167 leader 17129
>
> [pid 17166] +++ killed by SIGKILL +++
>
> PANIC: handle_group_exit: 17166 leader 17129
>
> [pid 17165] +++ killed by SIGKILL +++
>
> PANIC: handle_group_exit: 17165 leader 17129
>
> [pid 17162] +++ killed by SIGKILL +++
>
> PANIC: handle_group_exit: 17162 leader 17129
>
> [pid 17161] +++ killed by SIGKILL +++
>
> PANIC: handle_group_exit: 17161 leader 17129
>
> [pid 17160] +++ killed by SIGKILL +++
>
> PANIC: handle_group_exit: 17160 leader 17129
>
> [pid 17159] +++ killed by SIGKILL +++
>
> PANIC: handle_group_exit: 17159 leader 17129
>
> [pid 17158] +++ killed by SIGKILL +++
>
> PANIC: handle_group_exit: 17158 leader 17129
>
> [pid 17157] +++ killed by SIGKILL +++
>
> PANIC: handle_group_exit: 17157 leader 17129
>
> [pid 17156] +++ killed by SIGKILL +++
>
> PANIC: handle_group_exit: 17156 leader 17129
>
> [pid 17155] +++ killed by SIGKILL +++
>
> PANIC: handle_group_exit: 17155 leader 17129
>
> [pid 17154] +++ killed by SIGKILL +++
>
> PANIC: handle_group_exit: 17154 leader 17129
>
> [pid 17153] +++ killed by SIGKILL +++
>
> PANIC: handle_group_exit: 17153 leader 17129
>
> [pid 17152] +++ killed by SIGKILL +++
>
> PANIC: handle_group_exit: 17152 leader 17129
>
> [pid 17142] +++ killed by SIGKILL +++
>
> PANIC: handle_group_exit: 17142 leader 17129
>
> [pid 17164] +++ killed by SIGKILL +++
>
> PANIC: handle_group_exit: 17164 leader 17129
>
> [pid 17163] +++ killed by SIGKILL +++
>
> PANIC: handle_group_exit: 17163 leader 17129
>
> [pid 17141] +++ killed by SIGKILL +++
>
> PANIC: handle_group_exit: 17141 leader 17129
>
> [pid 17140] +++ killed by SIGKILL +++
>
> PANIC: handle_group_exit: 17140 leader 17129
>
> [pid 17139] +++ killed by SIGKILL +++
>
> PANIC: handle_group_exit: 17139 leader 17129
>
> [pid 17138] +++ killed by SIGKILL +++
>
> PANIC: handle_group_exit: 17138 leader 17129
>
> [pid 17137] +++ killed by SIGKILL +++
>
> PANIC: handle_group_exit: 17137 leader 17129
>
> [pid 17136] +++ killed by SIGKILL +++
>
> PANIC: handle_group_exit: 17136 leader 17129
>
> [pid 17135] +++ killed by SIGKILL +++
>
> PANIC: handle_group_exit: 17135 leader 17129
>
> [pid 17134] +++ killed by SIGKILL +++
>
> PANIC: handle_group_exit: 17134 leader 17129
>
> [pid 17133] +++ killed by SIGKILL +++
>
> PANIC: handle_group_exit: 17133 leader 17129
>
> [pid 17132] +++ killed by SIGKILL +++
>
> PANIC: handle_group_exit: 17132 leader 17129
>
> [pid 17131] +++ killed by SIGKILL +++
>
> PANIC: handle_group_exit: 17131 leader 17129
>
> [pid 17151] +++ killed by SIGKILL +++
>
> PANIC: handle_group_exit: 17151 leader 17129
>
> +++ killed by SIGKILL +++
>
>
> *-Jef Statham*
>
> Without vices there would be no virtues.
> It’s a magical world, Hobbes, ol’ buddy…Let’s go exploring!
>
>
> On Mon, Nov 3, 2014 at 3:43 PM, Alexandre Rafalovitch <[email protected]>
> wrote:
>
>> I was actually thinking more about using trace to monitor file system
>> access (not just open, access as well).
>>
>> Regards,
>> Alex.
>>
>> On 3 November 2014 14:08, Jef Statham <[email protected]> wrote:
>> > Thanks for the strace suggestion, this is what my trace returns. I'm
>> looking
>> > into what futex is now.
>>
>>
>>
>> Personal: http://www.outerthoughts.com/ and @arafalov
>> Solr resources and newsletter: http://www.solr-start.com/ and @solrstart
>> Solr popularizers community: https://www.linkedin.com/groups?gid=6713853
>>
>> --
>> You received this message because you are subscribed to a topic in the
>> Google Groups "elasticsearch" group.
>> To unsubscribe from this topic, visit
>> https://groups.google.com/d/topic/elasticsearch/2tIe5i2b-TA/unsubscribe.
>> To unsubscribe from this group and all its topics, send an email to
>> [email protected].
>> To view this discussion on the web visit
>> https://groups.google.com/d/msgid/elasticsearch/CAEFAe-Gu8nQf%3DgfxvWvkSwX1vrN50-zkkauA8iPnWb4n8zfPcA%40mail.gmail.com
>> .
>> For more options, visit https://groups.google.com/d/optout.
>>
>
>
--
You received this message because you are subscribed to the Google Groups
"elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email
to [email protected].
To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/CABj%3DZj9a7LHywxVy6HQAgxLkG%2BKm_e2X1tVjpnRiMKtHsun9og%40mail.gmail.com.
For more options, visit https://groups.google.com/d/optout.