[
https://issues.apache.org/jira/browse/ATLAS-912?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hemanth Yamijala updated ATLAS-912:
-----------------------------------
Attachment: ATLAS-912-1.patch
Attaching a new patch file.
Some context about this issue: Kafka 0.10 was made available as a stable
release around May end
(http://www.confluent.io/blog/announcing-apache-kafka-0.10-and-confluent-platform-3.0)
and we are moving to it to keep up with the versions of dependencies.
Changes covered in this patch (including changes that [~madhan.neethiraj]
contributed:
* Moved Kafka version to 0.10.0.0
* Modified {{AdminUtils.createTopic}} API (used in ATLAS-515) as there is a new
API in 0.10.
* Modified documentation to specify mvn heap size for compilation as -Xmx1536m.
For some reason, with 1024m mvn was failing with an OutOfMemoryError with this
patch. Initially, I thought this was a problem with the ITs. However, the
mvn-failsafe-plugin forks the tests with a memory of 1024 and these are working
fine. The issue is with the mvn launcher itself, which seems to need more
memory for some reason. Following the lead on [Maven wiki
page|https://cwiki.apache.org/confluence/display/MAVEN/OutOfMemoryError], I
have bumped up memory requirements in the documentation. However, we probably
need to investigate why this is happening separately.
* {{NotificationHookConsumerKafkaTest}} is constantly failing on builds.
[~madhan.neethiraj] also reported it while testing this change. The issue seems
to be a race condition between when the embedded kafka server is ready and when
we start using it. I added a delay between the two steps and hope to see this
fix the build failures. Although, the test has never failed locally for me.
I validated the Atlas build with a Kafka 0.10 installation and also re-tested
ATLAS-515 due to the new API change.
> Update to use Kafka 0.10.0.0 (from 0.9.0.0)
> -------------------------------------------
>
> Key: ATLAS-912
> URL: https://issues.apache.org/jira/browse/ATLAS-912
> Project: Atlas
> Issue Type: Task
> Reporter: Madhan Neethiraj
> Assignee: Hemanth Yamijala
> Attachments: ATLAS-912-1.patch, ATLAS-912.patch
>
>
> Atlas currently uses Kafka version 0.9.0.0. A newer version of Kafka,
> 0.10.0.0, is available.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
