Important info i forgot: The same docker-compose file works fine on a Docker native Mac OSX, 1.12. Regards
On Thursday, September 1, 2016 at 4:56:06 PM UTC+2, Krate Diggah wrote: > > Hello, > > i am having issues with graylog v2 on a docker host setup. > > *First of all some system information.* > OS: Debian Jessie > Docker: Docker version 1.12.1, build 23cf638 > > Stack was built from the compose file as found here > <http://docs.graylog.org/en/2.0/pages/installation/docker.html> > > *I altered the compose file and added the following:* > 1. Larger Head, now 4 GB > 2. Exposed Ports of elasticsearch so i could do some API tests > 3. Changed GRAYLOG_REST_TRANSPORT_URI to public Docker Host ip > > New compose file (of course passwords are changed): > version: '2' > services: > mongo: > image: "mongo:3" > elasticsearch: > image: "elasticsearch:2" > command: "elasticsearch -Des.cluster.name='graylog' > -Des.logger.level=DEBUG" > environment: > ES_HEAP_SIZE: 4g > ports: > - "9200:9200" > - "9300:9300" > graylog: > image: graylog2/server:2.0.3-2 > environment: > GRAYLOG_PASSWORD_SECRET: kudos > GRAYLOG_ROOT_PASSWORD_SHA2: > c3ab8ff13720e8ad9047dd39466b3c8974e592c2fa383d4a3960714caef0c4f2 > GRAYLOG_REST_TRANSPORT_URI: http://10.0.0.75:12900 > depends_on: > - mongo > - elasticsearch > ports: > - "9000:9000" > - "12900:12900" > - "12201/udp:12201/udp" > - "1514/udp:1514/udp" > > > *What i have tried:* > 1. Restored the containers with docker-compose down > 2. Reinstalled docker host (was shaky before hand) > 3. Enabled debugging to check for exceptions > 4. Did a lot of google research > > > *Error Message*After startup i am gettign following errors (had to enable > DEBUG) which imply that the template is missing and thus the indexes can't > be created? > > ERROR: org.graylog2.indexer.indices.Indices - Unable to create the Graylog > index template: graylog-internalEnter code here... > > > *Expanded Error* > elasticsearch_1 | [2016-09-01 14:32:55,720][DEBUG][cluster.service > ] [Carmilla Black] processing [remove-index-template [graylog-internal > ]]: execute > elasticsearch_1 | [2016-09-01 14:32:55,721][DEBUG][cluster.service > ] [Carmilla Black] cluster state update task [remove-index-template [ > graylog-internal]] failed > elasticsearch_1 | IndexTemplateMissingException[index_template [graylog- > internal] missing] > elasticsearch_1 | at org.elasticsearch.cluster.metadata. > MetaDataIndexTemplateService$1.execute(MetaDataIndexTemplateService.java: > 100) > elasticsearch_1 | at org.elasticsearch.cluster. > ClusterStateUpdateTask.execute(ClusterStateUpdateTask.java:45) > elasticsearch_1 | at org.elasticsearch.cluster.service. > InternalClusterService.runTasksForExecutor(InternalClusterService.java:468 > ) > elasticsearch_1 | at org.elasticsearch.cluster.service. > InternalClusterService$UpdateTask.run(InternalClusterService.java:772) > elasticsearch_1 | at org.elasticsearch.common.util.concurrent. > PrioritizedEsThreadPoolExecutor$TieBreakingPrioritizedRunnable.runAndClean > (PrioritizedEsThreadPoolExecutor.java:231) > elasticsearch_1 | at org.elasticsearch.common.util.concurrent. > PrioritizedEsThreadPoolExecutor$TieBreakingPrioritizedRunnable.run( > PrioritizedEsThreadPoolExecutor.java:194) > elasticsearch_1 | at java.util.concurrent.ThreadPoolExecutor. > runWorker(ThreadPoolExecutor.java:1142) > elasticsearch_1 | at java.util.concurrent. > ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) > elasticsearch_1 | at java.lang.Thread.run(Thread.java:745) > elasticsearch_1 | [2016-09-01 14:32:55,721][DEBUG][action.admin.indices. > template.delete] [Carmilla Black] failed to delete templates [graylog- > internal] > elasticsearch_1 | IndexTemplateMissingException[index_template [graylog- > internal] missing] > elasticsearch_1 | at org.elasticsearch.cluster.metadata. > MetaDataIndexTemplateService$1.execute(MetaDataIndexTemplateService.java: > 100) > elasticsearch_1 | at org.elasticsearch.cluster. > ClusterStateUpdateTask.execute(ClusterStateUpdateTask.java:45) > elasticsearch_1 | at org.elasticsearch.cluster.service. > InternalClusterService.runTasksForExecutor(InternalClusterService.java:468 > ) > elasticsearch_1 | at org.elasticsearch.cluster.service. > InternalClusterService$UpdateTask.run(InternalClusterService.java:772) > elasticsearch_1 | at org.elasticsearch.common.util.concurrent. > PrioritizedEsThreadPoolExecutor$TieBreakingPrioritizedRunnable.runAndClean > (PrioritizedEsThreadPoolExecutor.java:231) > elasticsearch_1 | at org.elasticsearch.common.util.concurrent. > PrioritizedEsThreadPoolExecutor$TieBreakingPrioritizedRunnable.run( > PrioritizedEsThreadPoolExecutor.java:194) > elasticsearch_1 | at java.util.concurrent.ThreadPoolExecutor. > runWorker(ThreadPoolExecutor.java:1142) > elasticsearch_1 | at java.util.concurrent. > ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) > elasticsearch_1 | at java.lang.Thread.run(Thread.java:745) > elasticsearch_1 | [2016-09-01 14:32:55,722][DEBUG][cluster.service > ] [Carmilla Black] processing [remove-index-template [graylog-internal > ]]: took 1ms no change in cluster_state > elasticsearch_1 | [2016-09-01 14:32:55,722][DEBUG][rest.suppressed > ] path: /_template/graylog-internal, params: {name=graylog-internal} > elasticsearch_1 | IndexTemplateMissingException[index_template [graylog- > internal] missing] > elasticsearch_1 | at org.elasticsearch.cluster.metadata. > MetaDataIndexTemplateService$1.execute(MetaDataIndexTemplateService.java: > 100) > elasticsearch_1 | at org.elasticsearch.cluster. > ClusterStateUpdateTask.execute(ClusterStateUpdateTask.java:45) > elasticsearch_1 | at org.elasticsearch.cluster.service. > InternalClusterService.runTasksForExecutor(InternalClusterService.java:468 > ) > elasticsearch_1 | at org.elasticsearch.cluster.service. > InternalClusterService$UpdateTask.run(InternalClusterService.java:772) > elasticsearch_1 | at org.elasticsearch.common.util.concurrent. > PrioritizedEsThreadPoolExecutor$TieBreakingPrioritizedRunnable.runAndClean > (PrioritizedEsThreadPoolExecutor.java:231) > elasticsearch_1 | at org.elasticsearch.common.util.concurrent. > PrioritizedEsThreadPoolExecutor$TieBreakingPrioritizedRunnable.run( > PrioritizedEsThreadPoolExecutor.java:194) > elasticsearch_1 | at java.util.concurrent.ThreadPoolExecutor. > runWorker(ThreadPoolExecutor.java:1142) > elasticsearch_1 | at java.util.concurrent. > ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) > elasticsearch_1 | at java.lang.Thread.run(Thread.java:745) > > > > > *Full Stack Trace* > elasticsearch_1 | [2016-09-01 14:32:55,720][DEBUG][cluster.service > ] [Carmilla Black] processing [remove-index-template [graylog-internal > ]]: execute > elasticsearch_1 | [2016-09-01 14:32:55,721][DEBUG][cluster.service > ] [Carmilla Black] cluster state update task [remove-index-template [ > graylog-internal]] failed > elasticsearch_1 | IndexTemplateMissingException[index_template [graylog- > internal] missing] > elasticsearch_1 | at org.elasticsearch.cluster.metadata. > MetaDataIndexTemplateService$1.execute(MetaDataIndexTemplateService.java: > 100) > elasticsearch_1 | at org.elasticsearch.cluster. > ClusterStateUpdateTask.execute(ClusterStateUpdateTask.java:45) > elasticsearch_1 | at org.elasticsearch.cluster.service. > InternalClusterService.runTasksForExecutor(InternalClusterService.java:468 > ) > elasticsearch_1 | at org.elasticsearch.cluster.service. > InternalClusterService$UpdateTask.run(InternalClusterService.java:772) > elasticsearch_1 | at org.elasticsearch.common.util.concurrent. > PrioritizedEsThreadPoolExecutor$TieBreakingPrioritizedRunnable.runAndClean > (PrioritizedEsThreadPoolExecutor.java:231) > elasticsearch_1 | at org.elasticsearch.common.util.concurrent. > PrioritizedEsThreadPoolExecutor$TieBreakingPrioritizedRunnable.run( > PrioritizedEsThreadPoolExecutor.java:194) > elasticsearch_1 | at java.util.concurrent.ThreadPoolExecutor. > runWorker(ThreadPoolExecutor.java:1142) > elasticsearch_1 | at java.util.concurrent. > ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) > elasticsearch_1 | at java.lang.Thread.run(Thread.java:745) > elasticsearch_1 | [2016-09-01 14:32:55,721][DEBUG][action.admin.indices. > template.delete] [Carmilla Black] failed to delete templates [graylog- > internal] > elasticsearch_1 | IndexTemplateMissingException[index_template [graylog- > internal] missing] > elasticsearch_1 | at org.elasticsearch.cluster.metadata. > MetaDataIndexTemplateService$1.execute(MetaDataIndexTemplateService.java: > 100) > elasticsearch_1 | at org.elasticsearch.cluster. > ClusterStateUpdateTask.execute(ClusterStateUpdateTask.java:45) > elasticsearch_1 | at org.elasticsearch.cluster.service. > InternalClusterService.runTasksForExecutor(InternalClusterService.java:468 > ) > elasticsearch_1 | at org.elasticsearch.cluster.service. > InternalClusterService$UpdateTask.run(InternalClusterService.java:772) > elasticsearch_1 | at org.elasticsearch.common.util.concurrent. > PrioritizedEsThreadPoolExecutor$TieBreakingPrioritizedRunnable.runAndClean > (PrioritizedEsThreadPoolExecutor.java:231) > elasticsearch_1 | at org.elasticsearch.common.util.concurrent. > PrioritizedEsThreadPoolExecutor$TieBreakingPrioritizedRunnable.run( > PrioritizedEsThreadPoolExecutor.java:194) > elasticsearch_1 | at java.util.concurrent.ThreadPoolExecutor. > runWorker(ThreadPoolExecutor.java:1142) > elasticsearch_1 | at java.util.concurrent. > ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) > elasticsearch_1 | at java.lang.Thread.run(Thread.java:745) > elasticsearch_1 | [2016-09-01 14:32:55,722][DEBUG][cluster.service > ] [Carmilla Black] processing [remove-index-template [graylog-internal > ]]: took 1ms no change in cluster_state > elasticsearch_1 | [2016-09-01 14:32:55,722][DEBUG][rest.suppressed > ] path: /_template/graylog-internal, params: {name=graylog-internal} > elasticsearch_1 | IndexTemplateMissingException[index_template [graylog- > internal] missing] > elasticsearch_1 | at org.elasticsearch.cluster.metadata. > MetaDataIndexTemplateService$1.execute(MetaDataIndexTemplateService.java: > 100) > elasticsearch_1 | at org.elasticsearch.cluster. > ClusterStateUpdateTask.execute(ClusterStateUpdateTask.java:45) > elasticsearch_1 | at org.elasticsearch.cluster.service. > InternalClusterService.runTasksForExecutor(InternalClusterService.java:468 > ) > elasticsearch_1 | at org.elasticsearch.cluster.service. > InternalClusterService$UpdateTask.run(InternalClusterService.java:772) > elasticsearch_1 | at org.elasticsearch.common.util.concurrent. > PrioritizedEsThreadPoolExecutor$TieBreakingPrioritizedRunnable.runAndClean > (PrioritizedEsThreadPoolExecutor.java:231) > elasticsearch_1 | at org.elasticsearch.common.util.concurrent. > PrioritizedEsThreadPoolExecutor$TieBreakingPrioritizedRunnable.run( > PrioritizedEsThreadPoolExecutor.java:194) > elasticsearch_1 | at java.util.concurrent.ThreadPoolExecutor. > runWorker(ThreadPoolExecutor.java:1142) > elasticsearch_1 | at java.util.concurrent. > ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) > elasticsearch_1 | at java.lang.Thread.run(Thread.java:745) > > > > *Symptoms*No matter what search i am doing i am seeing these errors > appear for each request: > > graylog_1 | 2016-09-01 14:52:48,051 WARN : org.elasticsearch.transport > - [graylog-c1d6e150-d053-444e-ac06-b0a7e11d63eb] Transport response > handler not found of id [15030] > graylog_1 | 2016-09-01 14:52:48,055 WARN : org.elasticsearch.transport > - [graylog-c1d6e150-d053-444e-ac06-b0a7e11d63eb] Transport response > handler not found of id [15029] > graylog_1 | 2016-09-01 14:52:48,058 WARN : org.elasticsearch.transport > - [graylog-c1d6e150-d053-444e-ac06-b0a7e11d63eb] Transport response > handler not found of id [15032] > graylog_1 | 2016-09-01 14:52:48,059 WARN : org.elasticsearch.transport > - [graylog-c1d6e150-d053-444e-ac06-b0a7e11d63eb] Transport response > handler not found of id [15031] > graylog_1 | 2016-09-01 14:52:48,059 WARN : org.graylog2.rest. > resources.search.SearchResource - Unable to execute search: all shards > failed > elasticsearch_1 | [2016-09-01 14:52:50,162][DEBUG][indices.memory > ] [Carmilla Black] recalculating shard indexing buffer, total is [ > 398.7mb] with [4] active shards, each shard set to indexing=[99.6mb], > translog=[64kb] > > > *Checking for the template*Indeed the template is missing. > > clouddocker@cloud-docker:~$ curl -X GET http: > //localhost:9200/_template/graylog-internal?pretty > { } > > I guess this can be fixed by creating the template but there i am stuck. > It is strange that this install fails as it happened on a fresh host, with > zeroi messages in there and does fail out of the box. > > Your help is highly appreciated. > > Kind regards, > kd > -- You received this message because you are subscribed to the Google Groups "Graylog Users" group. To unsubscribe from this group and stop receiving emails from it, send an email to [email protected]. To view this discussion on the web visit https://groups.google.com/d/msgid/graylog2/964bd419-d227-4266-958c-c94d55fc3b75%40googlegroups.com. For more options, visit https://groups.google.com/d/optout.
