[ https://issues.apache.org/jira/browse/METRON-1318?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16356072#comment-16356072 ]
ASF GitHub Bot commented on METRON-1318: ---------------------------------------- Github user wardbekker commented on a diff in the pull request: https://github.com/apache/metron/pull/930#discussion_r166752716 --- Diff: metron-deployment/amazon-ec2/README.md --- @@ -41,11 +50,13 @@ Any platform that supports these tools is suitable, but the following instructio /usr/bin/ruby -e "$(curl -fsSL https://raw.githubusercontent.com/Homebrew/install/master/install)" ``` -2. With Homebrew installed, run the following command in a terminal to install all of the required tools. +2. With Homebrew installed, run the following command in a terminal to install all of the required tools and dependencies. ``` - brew cask install java - brew install maven git + brew update --- End diff -- np, thx for reviewing. > Cannot deploy into EC2 > ---------------------- > > Key: METRON-1318 > URL: https://issues.apache.org/jira/browse/METRON-1318 > Project: Metron > Issue Type: Bug > Affects Versions: 0.4.2 > Environment: AWS > Reporter: Paweł Białasiewicz > Priority: Major > > I'm trying to deploy Metron on AWS using the cloud deployment method. > It looks like it is having problems with building the master node > {code:java} > [metron-test] sensors,ambari_master,ec2,monit > {code} > I tried rebuilding the node from scratch and running the run script multiple > times, always with the same result. > During the installation I'm getting the following log: > {code:java} > TASK [setup] > ******************************************************************* > ok: [localhost] > ok: [ec2-34-227-190-43.compute-1.amazonaws.com] > ok: [ec2-34-201-150-57.compute-1.amazonaws.com] > ok: [ec2-54-162-174-97.compute-1.amazonaws.com] > ok: [ec2-34-207-187-45.compute-1.amazonaws.com] > ok: [ec2-52-91-15-158.compute-1.amazonaws.com] > ok: [ec2-34-229-153-26.compute-1.amazonaws.com] > ok: [ec2-52-73-77-81.compute-1.amazonaws.com] > ok: [ec2-54-175-242-208.compute-1.amazonaws.com] > ok: [ec2-54-85-210-26.compute-1.amazonaws.com] > ok: [ec2-34-229-86-210.compute-1.amazonaws.com] > TASK [metron-builder : Build Metron] > ******************************************* > fatal: [ec2-34-227-190-43.compute-1.amazonaws.com -> localhost]: FAILED! => > {"changed": true, "cmd": "cd > /root/metron/metron-deployment/amazon-ec2/../playbooks/../.. && mvn clean > package -DskipTests -T 2C -P HDP-2.5.0.0,mpack", "delta": "0:00:03.308032", > "end": "2017-11-16 14:04:52.835967", "failed": true, "rc": 1, "start": > "2017-11-16 14:04:49.527935", "stderr": "", "stdout": "Warning: JAVA_HOME > environment variable is not set.\n[INFO] Scanning for projects...\n[INFO] > ------------------------------------------------------------------------\n[INFO] > Reactor Build Order:\n[INFO] \n[INFO] Metron\n[INFO] metron-stellar\n[INFO] > stellar-common\n[INFO] metron-analytics\n[INFO] metron-maas-common\n[INFO] > metron-platform\n[INFO] metron-zookeeper\n[INFO] > metron-test-utilities\n[INFO] metron-integration-test\n[INFO] > metron-maas-service\n[INFO] metron-common\n[INFO] metron-statistics\n[INFO] > metron-writer\n[INFO] metron-storm-kafka-override\n[INFO] > metron-storm-kafka\n[INFO] metron-hbase\n[INFO] > metron-profiler-common\n[INFO] metron-profiler-client\n[INFO] > metron-profiler\n[INFO] metron-hbase-client\n[INFO] metron-enrichment\n[INFO] > m > etron-indexing\n[INFO] metron-solr\n[INFO] metron-pcap\n[INFO] > metron-parsers\n[INFO] metron-pcap-backend\n[INFO] > metron-data-management\n[INFO] metron-api\n[INFO] metron-management\n[INFO] > elasticsearch-shaded\n[INFO] metron-elasticsearch\n[INFO] > metron-deployment\n[INFO] Metron Ambari Management Pack\n[INFO] > metron-contrib\n[INFO] metron-docker\n[INFO] metron-interface\n[INFO] > metron-config\n[INFO] metron-alerts\n[INFO] metron-rest-client\n[INFO] > metron-rest\n[INFO] site-book\n[INFO] 3rd party Functions (just for > tests)\n[INFO] \n[INFO] Using the MultiThreadedBuilder implementation with a > thread count of 4\n[INFO] > \n[INFO] > ------------------------------------------------------------------------\n[INFO] > Building Metron 0.4.2\n[INFO] > ------------------------------------------------------------------------\n[INFO] > \n[INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ Metron > ---\n[INFO] \n[INFO] --- maven-enforcer-plugin:1.4.1:enforce > (enforce-versions) @ Metron ---\n[INFO] \n[INFO] --- > jacoco-maven-plugin:0.7.9:prepare-agent (default) @ Metron --- > \n[INFO] argLine set to > -javaagent:/root/.m2/repository/org/jacoco/org.jacoco.agent/0.7.9/org.jacoco.agent-0.7.9-runtime.jar=destfile=/root/metron/target/jacoco.exec\n[INFO] > \n[INFO] --- jacoco-maven-plugin:0.7.9:report (report) @ Metron ---\n[INFO] > Skipping JaCoCo execution due to missing execution data file.\n[INFO] > \n[INFO] > ------------------------------------------------------------------------\n[INFO] > Building metron-stellar 0.4.2\n[INFO] > ------------------------------------------------------------------------\n[INFO] > > \n[INFO] > ------------------------------------------------------------------------\n[INFO] > Building metron-analytics 0.4.2\n[INFO] > ------------------------------------------------------------------------\n[INFO] > > \n[INFO] > ------------------------------------------------------------------------\n[INFO] > Building metron-deployment 0.4.2\n[INFO] > ----------------------------------------------------- > -------------------\n[INFO] \n[INFO] --- maven-clean-plugin:2.5:clean > (default-clean) @ metron-deployment ---\n[INFO] \n[INFO] --- > maven-enforcer-plugin:1.4.1:enforce (enforce-versions) @ metron-deployment > ---\n[INFO] \n[INFO] --- jacoco-maven-plugin:0.7.9:prepare-agent (default) @ > metron-deployment ---\n[INFO] argLine set to > -javaagent:/root/.m2/repository/org/jacoco/org.jacoco.agent/0.7.9/org.jacoco.agent-0.7.9-runtime.jar=destfile=/root/metron/metron-deployment/target/jacoco.exec\n[INFO] > \n[INFO] --- jacoco-maven-plugin:0.7.9:report (report) @ metron-deployment > ---\n[INFO] > \n[INFO] Skipping JaCoCo execution due to missing execution data > file.\n[INFO] > \n[INFO] > ------------------------------------------------------------------------\n[INFO] > Building metron-contrib 0.4.2\n[INFO] > ------------------------------------------------------------------------\n[INFO] > \n[INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ metron-contrib > ---\n[INFO] \n[INFO] --- maven-enforcer-plugin:1.4 > .1:enforce (enforce-versions) @ metron-contrib ---\n[INFO] \n[INFO] --- > jacoco-maven-plugin:0.7.9:prepare-agent (default) @ metron-contrib > ---\n[INFO] > ------------------------------------------------------------------------\n[INFO] > Building metron-platform 0.4.2\n[INFO] > ------------------------------------------------------------------------\n[INFO] > argLine set to > -javaagent:/root/.m2/repository/org/jacoco/org.jacoco.agent/0.7.9/org.jacoco.agent-0.7.9-runtime.jar=destfile=/root/metron/metron-contrib/target/jacoco.exec\n[INFO] > \n[INFO] --- jacoco-maven-plugin:0.7.9:report (report) @ metron-contrib > ---\n[INFO] Skipping JaCoCo execution due to missing execution data > file.\n[INFO] > \n[INFO] > ------------------------------------------------------------------------\n[INFO] > Building metron-interface 0.4.2\n[INFO] > ------------------------------------------------------------------------\n[INFO] > > ------------------------------------------------------------------------\n[INFO] > Reactor Summary:\n[INFO] \n[INFO] Metron > ............................................. SUC > CESS [ 0.851 s]\n[INFO] metron-stellar ..................................... > SKIPPED\n[INFO] stellar-common ..................................... > SKIPPED\n[INFO] metron-analytics ................................... > SKIPPED\n[INFO] metron-maas-common ................................. > SKIPPED\n[INFO] metron-platform .................................... > SKIPPED\n[INFO] metron-zookeeper ................................... > SKIPPED\n[INFO] metron-test-utilities .............................. > SKIPPED\n[INFO] metron-integration-test ............................ > SKIPPED\n[INFO] metron-maas-service ................................ > SKIPPED\n[INFO] metron-common ...................................... > SKIPPED\n[INFO] metron-statistics .................................. > SKIPPED\n[INFO] metron-writer ...................................... > SKIPPED\n[INFO] metron-storm-kafka-override ........................ > SKIPPED\n[INFO] metron-storm-kafka ................................. > SKIPPED\n[INFO] metron-hbase ....................................... > SKIPPED\n[INFO] metron-profiler-common ............................. > SKIPPED\n[INFO] metron-prof > iler-client ............................. SKIPPED\n[INFO] metron-profiler > .................................... SKIPPED\n[INFO] metron-hbase-client > ................................ SKIPPED\n[INFO] metron-enrichment > .................................. SKIPPED\n[INFO] metron-indexing > .................................... SKIPPED\n[INFO] metron-solr > .................................. > ...... SKIPPED\n[INFO] metron-pcap ........................................ > SKIPPED\n[INFO] metron-parsers ..................................... > SKIPPED\n[INFO] metron-pcap-backend ................................ > SKIPPED\n[INFO] metron-data-management ............................. > SKIPPED\n[INFO] metron-api ......................................... > SKIPPED\n[INFO] metron-manag > ement .................................. SKIPPED\n[INFO] elasticsearch-shaded > ............................... SKIPPED\n[INFO] metron-elasticsearch > ............................... SKIPPED\n[INFO] metron-deployment > .................................. SUCCESS [ 0.005 s]\n[INFO] Metron Ambari > Management Pack ...................... SKIPPED\n[INFO] metron-contrib > .................... > ................. SUCCESS [ 0.007 s]\n[INFO] metron-docker > ...................................... SKIPPED\n[INFO] metron-interface > ................................... FAILURE [ 0.011 s]\n[INFO] metron-config > ...................................... SKIPPED\n[INFO] metron-alerts > ...................................... SKIPPED\n[INFO] metron-rest-client > ........................... > ...... SKIPPED\n[INFO] metron-rest ........................................ > SKIPPED\n[INFO] site-book .......................................... > SKIPPED\n[INFO] 3rd party Functions (just for tests) ............... > SKIPPED\n[INFO] > ------------------------------------------------------------------------\n[INFO] > BUILD FAILURE\n[INFO] ----------------------------------------------- > -------------------------\n[INFO] Total time: 1.554 s (Wall Clock)\n[INFO] > Finished at: 2017-11-16T14:04:52+00:00\n[INFO] Final Memory: 24M/177M\n[INFO] > ------------------------------------------------------------------------\n[ERROR] > Failed to execute goal on project metron-interface: Could not resolve > dependencies for project org.apache.metron:metron-interface:pom:0.4.2: Coul > d not find artifact sun.jdk:tools:jar:LATEST at specified path > /usr/lib/jvm/java-8-openjdk-amd64/jre/../lib/tools.jar -> [Help 1]\n[ERROR] > \n[ERROR] To see the full stack trace of the errors, re-run Maven with the -e > switch.\n[ERROR] Re-run Maven using the -X switch to enable full debug > logging.\n[ERROR] \n[ERROR] For more information about the errors and > possible solutions, pl > ease read the following articles:\n[ERROR] [Help 1] > http://cwiki.apache.org/confluence/display/MAVEN/DependencyResolutionException\n[ERROR] > \n[ERROR] After correcting the problems, you can resume the build with the > command\n[ERROR] mvn <goals> -rf :metron-interface\n[INFO] > \n[INFO] > ----------------------- > -------------------------------------------------\n[INFO] Skipping > site-book\n[INFO] This project has been banned from the build due to previous > failures.\n[INFO] > ------------------------------------------------------------------------\n[INFO] > > \n[INFO] ------------------------------------------------------- > -----------------\n[INFO] Skipping Metron Ambari Management Pack\n[INFO] This > project has been banned from the build due to previous failures.\n[INFO] > ------------------------------------------------------------------------\n[INFO] > > \n[INFO] ------------------------------------------------------------------- > -----\n[INFO] Skipping metron-docker\n[INFO] This project has been banned > from the build due to previous failures.\n[INFO] > ------------------------------------------------------------------------", > "stdout_lines": ["Warning: JAVA_HOME environment variable is not set.", > "[INFO] Scanning for projects...", "[INFO] > ------------------------------------------------------------------- > -----", "[INFO] Reactor Build Order:", "[INFO] ", "[INFO] Metron", "[INFO] > metron-stellar", "[INFO] stellar-common", "[INFO] metron-analytics", "[INFO] > metron-maas-common", "[INFO] metron-platform", "[INFO] metron-zookeeper", > "[INFO] metron-test-utilities", "[INFO] metron-integration-test", "[INFO] > metron-maas-service", "[INFO] metron-common", "[INFO] metron-statistics", > "[INFO > ] metron-writer", "[INFO] metron-storm-kafka-override", "[INFO] > metron-storm-kafka", "[INFO] metron-hbase", "[INFO] metron-profiler-common", > "[INFO] metron-profiler-client", "[INFO] metron-profiler", "[INFO] > metron-hbase-client", "[INFO] metron-enrichment", "[INFO] metron-indexing", > "[INFO] metron-solr", "[INFO] metron-pcap", "[INFO] metron-parsers", "[INFO] > metron-pcap-backend > ", "[INFO] metron-data-management", "[INFO] metron-api", "[INFO] > metron-management", "[INFO] elasticsearch-shaded", "[INFO] > metron-elasticsearch", "[INFO] metron-deployment", "[INFO] Metron Ambari > Management Pack", "[INFO] metron-contrib", "[INFO] metron-docker", "[INFO] > metron-interface", "[INFO] metron-config", "[INFO] metron-alerts", "[INFO] > metron-rest-client", "[INFO] metr > on-rest", "[INFO] site-book", "[INFO] 3rd party Functions (just for tests)", > "[INFO] ", "[INFO] Using the MultiThreadedBuilder implementation with a > thread count of 4", "[INFO] > ", "[INFO] > ------------------------------------------------------------------------", > "[INFO] Building Metron 0.4.2", "[INFO] ----- > -------------------------------------------------------------------", "[INFO] > ", "[INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ Metron ---", > "[INFO] ", "[INFO] --- maven-enforcer-plugin:1.4.1:enforce (enforce-versions) > @ Metron ---", "[INFO] ", "[INFO] --- jacoco-maven-plugin:0.7.9:prepare-agent > (default) @ Metron ---", "[INFO] argLine set to -javaagent:/root/.m2/re > pository/org/jacoco/org.jacoco.agent/0.7.9/org.jacoco.agent-0.7.9-runtime.jar=destfile=/root/metron/target/jacoco.exec", > "[INFO] ", "[INFO] --- jacoco-maven-plugin:0.7.9:report (report) @ Metron > ---", "[INFO] Skipping JaCoCo execution due to missing execution data file.", > "[INFO] > ", "[INFO] ---------------- > --------------------------------------------------------", "[INFO] Building > metron-stellar 0.4.2", "[INFO] > ------------------------------------------------------------------------", > "[INFO] > ", "[INFO] > ------------------------------------------------------------------------", > "[INFO] Building metron-analytic > s 0.4.2", "[INFO] > ------------------------------------------------------------------------", > "[INFO] > ", "[INFO] > ------------------------------------------------------------------------", > "[INFO] Building metron-deployment 0.4.2", "[INFO] > ---------------------------------------------------------------------- > --", "[INFO] ", "[INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ > metron-deployment ---", "[INFO] ", "[INFO] --- > maven-enforcer-plugin:1.4.1:enforce (enforce-versions) @ metron-deployment > ---", "[INFO] ", "[INFO] --- jacoco-maven-plugin:0.7.9:prepare-agent > (default) @ metron-deployment ---", "[INFO] argLine set to > -javaagent:/root/.m2/repository/org/jacoco/org.jacoco.a > gent/0.7.9/org.jacoco.agent-0.7.9-runtime.jar=destfile=/root/metron/metron-deployment/target/jacoco.exec", > "[INFO] ", "[INFO] --- jacoco-maven-plugin:0.7.9:report (report) @ > metron-deployment ---", "[INFO] > ", "[INFO] Skipping JaCoCo execution due to missing > execution data file.", "[INFO] > ", "[INFO] > ------------------------------------------------------------------------", > "[INFO] Building metron-contrib 0.4.2", "[INFO] > ------------------------------------------------------------------------", > "[INFO] ", "[INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ > metron-contrib ---", "[INFO] ", "[INFO] --- mave > n-enforcer-plugin:1.4.1:enforce (enforce-versions) @ metron-contrib ---", > "[INFO] ", "[INFO] --- jacoco-maven-plugin:0.7.9:prepare-agent (default) @ > metron-contrib ---", "[INFO] > ------------------------------------------------------------------------", > "[INFO] Building metron-platform 0.4.2", "[INFO] > ------------------------------------------------------------------------", "[I > NFO] argLine set to > -javaagent:/root/.m2/repository/org/jacoco/org.jacoco.agent/0.7.9/org.jacoco.agent-0.7.9-runtime.jar=destfile=/root/metron/metron-contrib/target/jacoco.exec", > "[INFO] ", "[INFO] --- jacoco-maven-plugin:0.7.9:report (report) @ > metron-contrib ---", "[INFO] Skipping JaCoCo execution due to missing > execution data file.", "[INFO] > ", "[INFO] > ------------------------------------------------------------------------", > "[INFO] Building metron-interface 0.4.2", "[INFO] > ------------------------------------------------------------------------", > "[INFO] > ------------------------------------------------------------------------", > "[INFO] Reactor Summary:", "[INFO] ", "[INFO] M > etron ............................................. SUCCESS [ 0.851 s]", > "[INFO] metron-stellar ..................................... SKIPPED", > "[INFO] stellar-common ..................................... SKIPPED", > "[INFO] metron-analytics ................................... SKIPPED", > "[INFO] metron-maas-common ................................. SKIPPED", > "[INFO] metron-platfor > m .................................... SKIPPED", "[INFO] metron-zookeeper > ................................... SKIPPED", "[INFO] metron-test-utilities > .............................. SKIPPED", "[INFO] metron-integration-test > ............................ SKIPPED", "[INFO] metron-maas-service > ................................ SKIPPED", "[INFO] metron-common > ......................... > ............. SKIPPED", "[INFO] metron-statistics > .................................. SKIPPED", "[INFO] metron-writer > ...................................... SKIPPED", "[INFO] > metron-storm-kafka-override ........................ SKIPPED", "[INFO] > metron-storm-kafka ................................. SKIPPED", "[INFO] > metron-hbase ....................................... SKIPPED", " > [INFO] metron-profiler-common ............................. SKIPPED", "[INFO] > metron-profiler-client ............................. SKIPPED", "[INFO] > metron-profiler .................................... SKIPPED", "[INFO] > metron-hbase-client ................................ SKIPPED", "[INFO] > metron-enrichment .................................. SKIPPED", "[INFO] > metron-indexing .. > .................................. SKIPPED", "[INFO] metron-solr > ........................................ SKIPPED", "[INFO] metron-pcap > ........................................ SKIPPED", "[INFO] metron-parsers > ..................................... SKIPPED", "[INFO] metron-pcap-backend > ................................ SKIPPED", "[INFO] metron-data-management > .................... > ......... SKIPPED", "[INFO] metron-api > ......................................... SKIPPED", "[INFO] metron-management > .................................. SKIPPED", "[INFO] elasticsearch-shaded > ............................... SKIPPED", "[INFO] metron-elasticsearch > ............................... SKIPPED", "[INFO] metron-deployment > .................................. SUCCESS [ 0.00 > 5 s]", "[INFO] Metron Ambari Management Pack ...................... SKIPPED", > "[INFO] metron-contrib ..................................... SUCCESS [ 0.007 > s]", "[INFO] metron-docker ...................................... SKIPPED", > "[INFO] metron-interface ................................... FAILURE [ 0.011 > s]", "[INFO] metron-config ...................................... SKIP > PED", "[INFO] metron-alerts ...................................... SKIPPED", > "[INFO] metron-rest-client ................................. SKIPPED", > "[INFO] metron-rest ........................................ SKIPPED", > "[INFO] site-book .......................................... SKIPPED", > "[INFO] 3rd party Functions (just for tests) ............... SKIPPED", > "[INFO] ----------- > -------------------------------------------------------------", "[INFO] BUILD > FAILURE", "[INFO] > ------------------------------------------------------------------------", > "[INFO] Total time: 1.554 s (Wall Clock)", "[INFO] Finished at: > 2017-11-16T14:04:52+00:00", "[INFO] Final Memory: 24M/177M", "[INFO] > ------------------------------------------------------------------------", " > [ERROR] Failed to execute goal on project metron-interface: Could not resolve > dependencies for project org.apache.metron:metron-interface:pom:0.4.2: Could > not find artifact sun.jdk:tools:jar:LATEST at specified path > /usr/lib/jvm/java-8-openjdk-amd64/jre/../lib/tools.jar -> [Help 1]", "[ERROR] > ", "[ERROR] To see the full stack trace of the errors, re-run Maven with the > -e switch > .", "[ERROR] Re-run Maven using the -X switch to enable full debug logging.", > "[ERROR] ", "[ERROR] For more information about the errors and possible > solutions, please read the following articles:", "[ERROR] [Help 1] > http://cwiki.apache.org/confluence/display/MAVEN/DependencyResolutionException", > "[ERROR] ", "[ERROR] After correcting the problems, you can resume the build > with > the command", "[ERROR] mvn <goals> -rf :metron-interface", "[INFO] > ", "[INFO] > ------------------------------------------------------------------------", > "[INFO] Skipping site-book", "[INFO] This project has been banned from the > build due to previous failures.", "[INFO] ------------------------------------ > ------------------------------------", "[INFO] > ", "[INFO] > ------------------------------------------------------------------------", > "[INFO] Skipping Metron Ambari Management Pack", "[INFO] This project has > been banned from the build due to previous failures.", "[INFO] > -------------------------------------- > ----------------------------------", "[INFO] > ", "[INFO] > ------------------------------------------------------------------------", > "[INFO] Skipping metron-docker", "[INFO] This project has been banned from > the build due to previous failures.", "[INFO] > -------------------------------------------------------- > ----------------"], "warnings": []} > PLAY RECAP > ********************************************************************* > ec2-34-201-150-57.compute-1.amazonaws.com : ok=16 changed=1 > unreachable=0 failed=0 > ec2-34-207-187-45.compute-1.amazonaws.com : ok=16 changed=1 > unreachable=0 failed=0 > ec2-34-227-190-43.compute-1.amazonaws.com : ok=21 changed=8 > unreachable=0 failed=1 > ec2-34-229-153-26.compute-1.amazonaws.com : ok=16 changed=1 > unreachable=0 failed=0 > ec2-34-229-86-210.compute-1.amazonaws.com : ok=16 changed=1 > unreachable=0 failed=0 > ec2-52-73-77-81.compute-1.amazonaws.com : ok=16 changed=1 unreachable=0 > failed=0 > ec2-52-91-15-158.compute-1.amazonaws.com : ok=16 changed=1 unreachable=0 > failed=0 > ec2-54-162-174-97.compute-1.amazonaws.com : ok=16 changed=1 > unreachable=0 failed=0 > ec2-54-175-242-208.compute-1.amazonaws.com : ok=16 changed=1 > unreachable=0 failed=0 > ec2-54-85-210-26.compute-1.amazonaws.com : ok=16 changed=1 unreachable=0 > failed=0 > localhost : ok=32 changed=7 unreachable=0 failed=0 > {code} -- This message was sent by Atlassian JIRA (v7.6.3#76005)