[
https://issues.apache.org/jira/browse/METRON-872?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15978883#comment-15978883
]
Otto Fowler commented on METRON-872:
------------------------------------
Maybe it has something to do with ambari and it's database, or zookeeper or
something. I would have to look at what we do in the quickdev process to
'cleanup'. It could be that that process is incomplete, but you only 'know'
because of the version change now.
> "Metron Enrichment Start" Fails in Quick Dev
> --------------------------------------------
>
> Key: METRON-872
> URL: https://issues.apache.org/jira/browse/METRON-872
> Project: Metron
> Issue Type: Bug
> Reporter: Nick Allen
>
> h3. Problem
> The "Quick Dev" deployment fails to complete deployment successfully for me.
> Ambari fails to launch the Enrichment topology with this error.
> {code}
> resource_management.core.exceptions.ExecutionFailed: Execution of
> '/usr/metron/0.3.1/bin/zk_load_configs.sh --mode PUSH -i
> /usr/metron/0.3.1/config/zookeeper -z node1:2181' returned 127. /bin/bash:
> /usr/metron/0.3.1/bin/zk_load_configs.sh: No such file or directory
> {code}
> This is confusing to me because we should be on 0.4.0, so why is it
> referencing 0.3.1?
> h3. Steps to Reproduce
> First, I had to `install` the Metron libs (which I don't remember being a
> requirement before.) Then I was able to `vagrant up`.
> {code}
> cd incubator-metron
> mvn clean install -DskipTests -T 1C
> cd metron-deployment/vagrant/quick-dev-platform
> vagrant up
> {code}
> h3. Additional Clues
> When I login to the "Quick Dev" VM, I see that there are some 0.4.0 libs and
> some 0.3.1 libs.
> {code}
> [root@node1 metron]# ls -l /usr/metron/0.3.1/lib/
> total 167800
> -rw-r--r--. 1 root root 85332259 Apr 3 21:05 metron-api-0.3.1.jar
> -rw-r--r--. 1 root root 86490682 Mar 30 13:09 metron-pcap-backend-0.3.1.jar
> [root@node1 metron]# ls -l /usr/metron/0.4.0/lib/
> total 463428
> -rw-r--r--. 1 root root 48425098 Apr 21 13:45 metron-common-0.4.0.jar
> -rw-r--r--. 1 root root 124020704 Apr 21 13:50
> metron-data-management-0.4.0.jar
> -rw-r--r--. 1 root root 114754821 Apr 21 13:50
> metron-elasticsearch-0.4.0-uber.jar
> -rw-r--r--. 1 root root 93280994 Apr 21 13:48
> metron-enrichment-0.4.0-uber.jar
> -rw-r--r--. 1 root root 94059479 Apr 21 13:50 metron-parsers-0.4.0-uber.jar
> {code}
> Where did those 0.3.1 libs come from? When I look in my local Maven
> repository on my build machine, I don't see any 0.3.1 libs at all, only 0.4.0
> {code}
> $ find ~/.m2/repository/org/apache/metron/ -name "0.3.1"
> $ find ~/.m2/repository/org/apache/metron/ -name "0.4.0"
> /Users/nallen/.m2/repository/org/apache/metron//elasticsearch-shaded/0.4.0
> /Users/nallen/.m2/repository/org/apache/metron//Metron/0.4.0
> /Users/nallen/.m2/repository/org/apache/metron//metron-analytics/0.4.0
> /Users/nallen/.m2/repository/org/apache/metron//metron-api/0.4.0
> /Users/nallen/.m2/repository/org/apache/metron//metron-common/0.4.0
> /Users/nallen/.m2/repository/org/apache/metron//metron-config/0.4.0
> /Users/nallen/.m2/repository/org/apache/metron//metron-data-management/0.4.0
> /Users/nallen/.m2/repository/org/apache/metron//metron-deployment/0.4.0
> /Users/nallen/.m2/repository/org/apache/metron//metron-docker/0.4.0
> /Users/nallen/.m2/repository/org/apache/metron//metron-elasticsearch/0.4.0
> /Users/nallen/.m2/repository/org/apache/metron//metron-enrichment/0.4.0
> /Users/nallen/.m2/repository/org/apache/metron//metron-hbase/0.4.0
> /Users/nallen/.m2/repository/org/apache/metron//metron-indexing/0.4.0
> /Users/nallen/.m2/repository/org/apache/metron//metron-integration-test/0.4.0
> /Users/nallen/.m2/repository/org/apache/metron//metron-interface/0.4.0
> /Users/nallen/.m2/repository/org/apache/metron//metron-maas-common/0.4.0
> /Users/nallen/.m2/repository/org/apache/metron//metron-maas-service/0.4.0
> /Users/nallen/.m2/repository/org/apache/metron//metron-management/0.4.0
> /Users/nallen/.m2/repository/org/apache/metron//metron-parsers/0.4.0
> /Users/nallen/.m2/repository/org/apache/metron//metron-pcap/0.4.0
> /Users/nallen/.m2/repository/org/apache/metron//metron-pcap-backend/0.4.0
> /Users/nallen/.m2/repository/org/apache/metron//metron-platform/0.4.0
> /Users/nallen/.m2/repository/org/apache/metron//metron-profiler/0.4.0
> /Users/nallen/.m2/repository/org/apache/metron//metron-profiler-client/0.4.0
> /Users/nallen/.m2/repository/org/apache/metron//metron-profiler-common/0.4.0
> /Users/nallen/.m2/repository/org/apache/metron//metron-rest/0.4.0
> /Users/nallen/.m2/repository/org/apache/metron//metron-rest-client/0.4.0
> /Users/nallen/.m2/repository/org/apache/metron//metron-solr/0.4.0
> /Users/nallen/.m2/repository/org/apache/metron//metron-statistics/0.4.0
> /Users/nallen/.m2/repository/org/apache/metron//metron-storm-kafka/0.4.0
> /Users/nallen/.m2/repository/org/apache/metron//metron-test-utilities/0.4.0
> /Users/nallen/.m2/repository/org/apache/metron//metron-writer/0.4.0
> {code}
> I seem to have the latest "Quick Dev" box image.
> {code}
> $ vagrant box update
> Running with ansible-tags: ["quick_dev", "report"]
> ==> node1: Checking for updates to 'metron/quick_dev'
> node1: Latest installed version: 0.2.0
> node1: Version constraints:
> node1: Provider: virtualbox
> ==> node1: Box 'metron/quick_dev' (v0.2.0) is running the latest version.
> {code}
> And for good measure, here is what my environment looks-like.
> {code}
> $ ./metron-deployment/scripts/platform-info.sh
> Metron 0.4.0
> --
> * master
> --
> commit 41b5b1050cf29e5dcb5d0c36b5a9dbd1cafa745e
> Author: justinjleet <[email protected]>
> Date: Mon Apr 17 15:16:49 2017 -0400
> The MPack should function in a kerberized cluster (justinleet) closes
> apache/incubator-metron#518
> --
> --
> ansible 2.0.0.2
> config file =
> configured module search path = Default w/o overrides
> --
> Vagrant 1.8.1
> --
> Python 2.7.13
> --
> Apache Maven 3.3.9 (bb52d8502b132ec0a5a3f4c09453c07478323dc5;
> 2015-11-10T11:41:47-05:00)
> Maven home: /usr/local/Cellar/maven/3.3.9/libexec
> Java version: 1.8.0_66, vendor: Oracle Corporation
> Java home: /Library/Java/JavaVirtualMachines/jdk1.8.0_66.jdk/Contents/Home/jre
> Default locale: en_US, platform encoding: UTF-8
> OS name: "mac os x", version: "10.12.4", arch: "x86_64", family: "mac"
> --
> Darwin HW12402.local 16.5.0 Darwin Kernel Version 16.5.0: Fri Mar 3 16:52:33
> PST 2017; root:xnu-3789.51.2~3/RELEASE_X86_64 x86_64
> --
> Total System Memory = 16384 MB
> Processor Model: Intel(R) Core(TM) i7-4870HQ CPU
> Processor Speed: 2.50GHz
> Total Physical Processors: 4
> Total cores: 4
> Disk information:
> /dev/disk1 465Gi 319Gi 145Gi 69% 2694524 4292272755 0% /
> {code}
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
