Re: Kafka : To meny files open

2018-01-03 Thread Matt Andruff
You should check the kafka docs. You need to increase your open file descriptors. Here's a link that describes how to do it. (Ignore that this is for hdp the ulimit part is what you need to pay attend to.) You can also check kafka docs too they say to change open file descriptors to 100,000 I

ZooKeeper_branch34_jdk8 - Build # 1252 - Still Failing

2018-01-03 Thread Apache Jenkins Server
See https://builds.apache.org/job/ZooKeeper_branch34_jdk8/1252/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 58.07 KB...] [junit] Running

[jira] [Commented] (ZOOKEEPER-984) jenkins failure in testSessionMoved - NPE in quorum

2018-01-03 Thread Jordan Zimmerman (JIRA)
[ https://issues.apache.org/jira/browse/ZOOKEEPER-984?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16310264#comment-16310264 ] Jordan Zimmerman commented on ZOOKEEPER-984: FWIW - we just saw this in a 3.5.3 instance.

ZooKeeper-trunk-windows-cmake - Build # 2603 - Still Failing

2018-01-03 Thread Apache Jenkins Server
See https://builds.apache.org/job/ZooKeeper-trunk-windows-cmake/2603/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 7.81 KB...] [ivy:retrieve] found

Success: ZOOKEEPER- PreCommit Build #1395

2018-01-03 Thread Apache Jenkins Server
Build: https://builds.apache.org/job/PreCommit-ZOOKEEPER-github-pr-build/1395/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 39.55 MB...] [exec]

[jira] [Commented] (ZOOKEEPER-2960) The dataDir and dataLogDir are used opposingly

2018-01-03 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/ZOOKEEPER-2960?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16309800#comment-16309800 ] Hadoop QA commented on ZOOKEEPER-2960: -- +1 overall. GitHub Pull Request Build +1

[jira] [Commented] (ZOOKEEPER-2960) The dataDir and dataLogDir are used opposingly

2018-01-03 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/ZOOKEEPER-2960?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16309741#comment-16309741 ] ASF GitHub Bot commented on ZOOKEEPER-2960: --- GitHub user anmolnar opened a pull request:

[GitHub] zookeeper pull request #441: ZOOKEEPER-2960. The dataDir and dataLogDir are ...

2018-01-03 Thread anmolnar
GitHub user anmolnar opened a pull request: https://github.com/apache/zookeeper/pull/441 ZOOKEEPER-2960. The dataDir and dataLogDir are used opposingly Previously a small refactoring has swapped the usage of dataDir and dataLogDir when QuorumPeerMain instantiates FileTxnSnapLog

Kafka : To meny files open

2018-01-03 Thread daniel brown
Hello, Currently Zookeeper and kafka do not work appropriately and the logs are not streaming to logstash. The var-log partitions across the zookeeper cluster are filled up to 100 percent. We are getting the following messages when we investigated the logs and the services status: 1 .

Bug in Zookeeper 3.4.11 release

2018-01-03 Thread Andor Molnar
Hi all, Looks like we've a pretty serious bug in 3.4.11: https://issues.apache.org/jira/browse/ZOOKEEPER-2960 In a nutshell: ZK uses dataDir and dataLogDir parameters in the wrong order, meaning it tries to access logs in the snapshot folder and vica versa. Not sure what's the process in such

[jira] [Commented] (ZOOKEEPER-2960) The dataDir and dataLogDir are used opposingly

2018-01-03 Thread Andor Molnar (JIRA)
[ https://issues.apache.org/jira/browse/ZOOKEEPER-2960?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16309472#comment-16309472 ] Andor Molnar commented on ZOOKEEPER-2960: - Looks like a pretty serious one. This was

[jira] [Comment Edited] (ZOOKEEPER-2960) The dataDir and dataLogDir are used opposingly

2018-01-03 Thread Andor Molnar (JIRA)
[ https://issues.apache.org/jira/browse/ZOOKEEPER-2960?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16309451#comment-16309451 ] Andor Molnar edited comment on ZOOKEEPER-2960 at 1/3/18 10:39 AM: -- Hi

[jira] [Comment Edited] (ZOOKEEPER-2960) The dataDir and dataLogDir are used opposingly

2018-01-03 Thread Andor Molnar (JIRA)
[ https://issues.apache.org/jira/browse/ZOOKEEPER-2960?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16309451#comment-16309451 ] Andor Molnar edited comment on ZOOKEEPER-2960 at 1/3/18 10:39 AM: -- Hi

[jira] [Commented] (ZOOKEEPER-2960) The dataDir and dataLogDir are used opposingly

2018-01-03 Thread Andor Molnar (JIRA)
[ https://issues.apache.org/jira/browse/ZOOKEEPER-2960?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16309451#comment-16309451 ] Andor Molnar commented on ZOOKEEPER-2960: - Hi [~danmilon] Looks like you're right.

ZooKeeper_branch35_jdk7 - Build # 1242 - Failure

2018-01-03 Thread Apache Jenkins Server
See https://builds.apache.org/job/ZooKeeper_branch35_jdk7/1242/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 58.49 KB...] [junit] Tests run: 1, Failures: