No, I'm using AWS machines, they are VMs, VT-x wouldn't be available in nested
VMs.
On Monday, November 26, 2018, 1:24:22 PM EST, Nick Allen
<[email protected]> wrote:
Are you able to spin-up the development environment in Vagrant?
cd metron-deployment/development/centosvagrant up
See the README in that directory for more information.
On Wed, Nov 21, 2018 at 12:44 PM Babak Abbaschian <[email protected]>
wrote:
Tried with Node 9.11.2 and npm 5.6.3 and also with Node 10.13.0 and npm 6.4.1
:(
"[INFO]
------------------------------------------------------------------------",
"[ERROR] internal/modules/cjs/loader.js:582",
"[ERROR] throw err;",
"[ERROR] ^",
"[ERROR] ",
"[ERROR] Error: Cannot find module
'/root/metron/metron-interface/metron-alerts/node_modules/@angular-devkit/build-angular/node_modules/node-sass/scripts/install.js'",
"[ERROR] at Function.Module._resolveFilename
(internal/modules/cjs/loader.js:580:15)",
"[ERROR] at Function.Module._load
(internal/modules/cjs/loader.js:506:25)",
"[ERROR] at Function.Module.runMain
(internal/modules/cjs/loader.js:741:12)",
"[ERROR] at startup (internal/bootstrap/node.js:285:19)",
"[INFO] ",
"[INFO] > [email protected] install
/root/metron/metron-interface/metron-alerts/node_modules/puppeteer",
"[INFO] > node install.js",
"[INFO] ",
"[ERROR] at bootstrapNodeJSCore (internal/bootstrap/node.js:739:3)",
"[ERROR] internal/modules/cjs/loader.js:582",
"[ERROR] throw err;",
"[ERROR] ^",
"[ERROR] ",
"[ERROR] Error: Cannot find module
'/root/metron/metron-interface/metron-alerts/node_modules/puppeteer/install.js'",
"[ERROR] at Function.Module._resolveFilename
(internal/modules/cjs/loader.js:580:15)",
"[ERROR] at Function.Module._load
(internal/modules/cjs/loader.js:506:25)",
"[ERROR] at Function.Module.runMain
(internal/modules/cjs/loader.js:741:12)",
"[ERROR] at startup (internal/bootstrap/node.js:285:19)",
"[ERROR] at bootstrapNodeJSCore (internal/bootstrap/node.js:739:3)",
"[ERROR] npm ERR! code ELIFECYCLE",
"[ERROR] npm ERR! errno 1",
"[ERROR] npm ERR! [email protected] install: `node install.js`",
"[ERROR] npm ERR! Exit status 1",
"[ERROR] npm ERR! ",
"[ERROR] npm ERR! Failed at the [email protected] install script.",
"[ERROR] npm ERR! This is probably not a problem with npm. There is likely
additional logging output above.",
"[ERROR] ",
"[ERROR] npm ERR! A complete log of this run can be found in:",
"[ERROR] npm ERR! /root/.npm/_logs/2018-11-21T17_37_03_712Z-debug.log",
"1/2 KB ",
"2/2 KB ",
"[ERROR] Failed to execute goal
com.github.eirslett:frontend-maven-plugin:1.3:npm (npm ci) on project
metron-config: Failed to run task: 'npm ci' failed. (error code 1) -> [Help 1]",
"[ERROR] ",
"[ERROR] To see the full stack trace of the errors, re-run Maven with the
-e switch.",
"[ERROR] Re-run Maven using the -X switch to enable full debug logging.",
"[ERROR] ",
"[ERROR] For more information about the errors and possible solutions,
please read the following articles:",
"[ERROR] [Help 1]
http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException";,
"[ERROR] ",
"[ERROR] After correcting the problems, you can resume the build with the
command",
"[ERROR] mvn <goals> -rf :metron-config"
On Wednesday, November 21, 2018, 12:09:57 PM EST, Nick Allen
<[email protected]> wrote:
Everything else there, except Node/NPM, seems OK.
Just in case I missed something this is what my environment looks like. I
happen to build on a Mac, but I know it is definitely possible to build on
Ubuntu (I know some developers do) and our Travis CI builds on Ubuntu Trusty.
$ ./scripts/platform-info.shMetron 0.6.1--...--ansible 2.5.0 config file =
None configured module search path =
[u'/Users/nallen/.ansible/plugins/modules',
u'/usr/share/ansible/plugins/modules'] ansible python module location =
/usr/local/lib/python2.7/site-packages/ansible executable location =
/usr/local/bin/ansible python version = 2.7.15 (default, Jun 26 2018,
19:46:20) [GCC 4.2.1 Compatible Apple LLVM 9.1.0 (clang-902.0.39.1)]--Vagrant
2.1.2--vagrant-hostmanager (1.8.9)--Python 2.7.15--Apache Maven 3.3.9
(bb52d8502b132ec0a5a3f4c09453c07478323dc5; 2015-11-10T11:41:47-05:00)Maven
home: /usr/local/Cellar/[email protected]/3.3.9/libexecJava version: 1.8.0_66, vendor:
Oracle CorporationJava home:
/Library/Java/JavaVirtualMachines/jdk1.8.0_66.jdk/Contents/Home/jreDefault
locale: en_US, platform encoding: UTF-8OS name: "mac os x", version: "10.13.6",
arch: "x86_64", family: "mac"--Docker version 18.09.0, build
4d60db4--nodev9.11.1--npm6.2.0--Configured with:
--prefix=/Applications/Xcode.app/Contents/Developer/usr
--with-gxx-include-dir=/Applications/Xcode.app/Contents/Developer/Platforms/MacOSX.platform/Developer/SDKs/MacOSX10.13.sdk/usr/include/c++/4.2.1Apple
LLVM version 9.1.0 (clang-902.0.39.2)Target: x86_64-apple-darwin17.7.0Thread
model: posixInstalledDir:
/Applications/Xcode.app/Contents/Developer/Toolchains/XcodeDefault.xctoolchain/usr/bin--Compiler
is C++11 compliant--Darwin HW12402.local 17.7.0 Darwin Kernel Version 17.7.0:
Thu Jun 21 22:53:14 PDT 2018; root:xnu-4570.71.2~1/RELEASE_X86_64 x86_64--Total
System Memory = 16384 MBProcessor Model: Intel(R) Core(TM) i7-4870HQ
CPUProcessor Speed: 2.50GHzTotal Physical Processors: 4Total cores: 4Disk
information:/dev/disk1s1 466Gi 250Gi 211Gi 55% 2800536
9223372036851975271 0% //dev/disk1s4 466Gi 4.0Gi 211Gi 2% 4
9223372036854775803 0% /private/var/vm/dev/disk1s3 466Gi 495Mi 211Gi
1% 14 9223372036854775793 0% /Volumes/RecoveryThis CPU appears to
support virtualization
On Wed, Nov 21, 2018 at 12:05 PM Nick Allen <[email protected]> wrote:
You probably want to try a newer version of Node/NPM. You are running
v8.10.0/v3.5.2, while for example this is what I am running.
nodev9.11.1--npm6.2.0
On Wed, Nov 21, 2018 at 11:36 AM Babak Abbaschian <[email protected]>
wrote:
Thanks, Figuring out what is wrong, I'll update the documentation on how to
install it on Ubuntu with all the details.
I guess my next step would be Manual installation of Metron on EC2
On Wednesday, November 21, 2018, 11:15:13 AM EST, Nick Allen
<[email protected]> wrote:
On the host where you are trying to build Metron, can you run the following
script and send back the output?
metron/metron-deployment/scripts/platform-info.sh
Other dependencies are documented here. Apologies, I know it is not easy for
first-timers to build Metron, but we will help you through it.
https://github.com/apache/metron/tree/master/metron-deployment/development/centos6#prerequisites
And also please be sure to read this warning about using the automated
deployment scripts to EC2.
https://github.com/apache/metron/tree/master/metron-deployment#how-do-i-deploy-metron-within-aws
On Wed, Nov 21, 2018 at 11:08 AM Babak Abbaschian <[email protected]>
wrote:
Hi, I'm trying to deploy Metron on EC2, and I'm following this link:
https://github.com/apache/metron/tree/master/metron-deployment/amazon-ec2
First I had to guess based on the errors and description for macOS! that we
need Vagrant, node and etc.
So here is the process that I take on Ubuntu 18.1:
export AWS_ACCESS_KEY_ID="XXXXXXXXXXXXX0XXXXXX"
export AWS_SECRET_ACCESS_KEY="xxxXXX0XXXxXXxX0xx0xXX0xXxxXX0xXxxX0XXxx"
JAVA_HOME=/usr/lib/jvm/java-8-openjdk-amd64
PATH=$JAVA_HOME/bin:$PATH ssh-keygen
apt install maven //Version 3.3.9
apt install python-pip
pip install ansible==2.4.1
///////////////////////////////////////////////////////////////////////////////
// Ansible versions higher than 2.4.1 will end up with this error:
// **************Task Create Virtual private cloud ***************
// fatal: [localhost]: FAILED! => {"changed": false, "msg": "This module has
been removed. The module documentation may contain
// hints for porting"}
///////////////////////////////////////////////////////////////////////////////
apt install nodejs-legacy //The system is using command node, not nodejs
apt install npm apt install virtualbox //Version 5.5.2
wget https://releases.hashicorp.com/vagrant/2.2.0/vagrant_2.2.0_x86_64.deb
///////////////////////////////////////////////////////////////////////////////
// Vagrant in apt cache is version 1.8 which has a bug installing hostmanager
///////////////////////////////////////////////////////////////////////////////
dpkg -i vagrant_2.2.0_x86_64.deb
vagrant plugin install vagrant-hostmanager
git clone https://github.com/apache/metron.git
cd metron/metron-deployment/amazon-ec2/
./run.sh
And I End up with failed master node with this error:
[ERROR]Failed to execute goal
com.github.eirslett:frontend-maven-plugin:1.3:npm (npm ci) on project
metron-config:Failed to run task:'npm ci' failed.(error code 1)->[Help1]
org.apache.maven.lifecycle.LifecycleExecutionException:Failed to execute goal
com.github.eirslett:frontend-maven-plugin:1.3:npm (npm ci) on project
metron-config:Failed to run taskat
org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:212)
at
org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:153)
at
org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:145)
at
org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:116)
at
org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:80)
Jira Issue:
https://issues.apache.org/jira/projects/METRON/issues/METRON-1876?filter=allissues
Thanks,Babak.
