[ 
https://issues.apache.org/jira/browse/METRON-500?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15582422#comment-15582422
 ] 

ASF GitHub Bot commented on METRON-500:
---------------------------------------

Github user 2xyo commented on the issue:

    https://github.com/apache/incubator-metron/pull/220
  
    I still see the issue on current master with a Centos 6 VM.
    
    Steps to reproduce the error on the ansible client:
    ```
    $ sudo -H pip uninstall -y ansible && sudo -H pip install ansible==2.0.0.2
    $ ssh-keygen -t rsa -b 4096
    $ echo "192.168.1.11 node1" | sudo tee -a /etc/hosts >/dev/null
    $ ssh-copy-id root@node1
    $ sudo add-apt-repository ppa:webupd8team/java
    $ sudo apt update
    $ sudo apt install oracle-java8-installer git oracle-java8-set-default maven
    $ . /etc/profile.d/jdk.sh 
    $ env |grep JAVA
    $ cd && git clone https://github.com/apache/incubator-metron.git
    $ cd incubator-metron && git rev-parse HEAD
    23ff817ebdd3b63be69ad9b6c493b41bb0be4880
    $ rm -rf  ~/.m2/
    $ sed -i "s#<id></id>#<id>archive</id>#g" 
metron-deployment/packaging/ambari/metron-mpack/src/main/assemblies/metron-mpack.xml
 #METRON-500
    $ mvn clean package  -DskipTests
    $ cd ~/incubator-metron/metron-deployment
    $ sed -i '/\[defaults\]/a remote_user = root'  
vagrant/full-dev-platform/ansible.cfg
    $ sed -i 's/eth1/eth0/g' inventory/full-dev-platform/group_vars/all
    $ cd ~/incubator-metron/metron-deployment/vagrant/full-dev-platform
    $ ansible-playbook  -i ../../inventory/full-dev-platform/hosts 
../../playbooks/metron_full_install.yml --skip-tags="solr,yaf" 
    
    PLAY 
***************************************************************************
    skipping: no hosts matched
    
    PLAY 
***************************************************************************
    skipping: no hosts matched
    
    PLAY 
***************************************************************************
    
    TASK [setup] 
*******************************************************************
    ok: [node1]
    ..............
    
    TASK [metron_streaming : Assign permissions of HDFS /apps/metron/patterns 
directory] ***
    changed: [node1]
    
    TASK [metron_streaming : Upload Grok Patterns to hdfs:///apps/metron] 
**********
    fatal: [node1]: FAILED! => {"changed": true, "cmd": ["hdfs", "dfs", "-put", 
"-f", "/usr/metron/0.2.1BETA/patterns", "/apps/metron"], "delta": 
"0:00:01.976636", "end": "2016-10-17 16:00:46.418570", "failed": true, "rc": 1, 
"start": "2016-10-17 16:00:44.441934", "stderr": "put: Error accessing 
file:/usr/metron/0.2.1BETA/patterns", "stdout": "", "stdout_lines": [], 
"warnings": []}
    
    PLAY RECAP 
*********************************************************************
    node1                      : ok=145  changed=41   unreachable=0    failed=1
    
    ```
    
    On the node1:
    ````
    [root@node1 ~]# tail -n 3 /var/log/messages
    Oct 17 16:00:40 node1 ansible-command: Invoked with warn=True 
executable=None chdir=None _raw_params=hdfs dfs -chown -R hdfs:hadoop 
/apps/metron/patterns removes=None creates=None _uses_shell=False
    Oct 17 16:00:42 node1 ansible-command: Invoked with warn=True 
executable=None chdir=None _raw_params=hdfs dfs -chmod -R 775 
/apps/metron/patterns removes=None creates=None _uses_shell=False
    Oct 17 16:00:44 node1 ansible-command: Invoked with warn=True 
executable=None chdir=None _raw_params=hdfs dfs -put -f 
/usr/metron/0.2.1BETA/patterns /apps/metron removes=None creates=None 
_uses_shell=False
    
    ```
    
    Let's try with the command as root:
    ```
    [root@node1 ~]# hdfs dfs -put -f /usr/metron/0.2.1BETA/patterns /apps/metron
    16/10/17 16:19:12 WARN retry.RetryInvocationHandler: Exception while 
invoking class 
org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.create 
over null. Not retrying because try once and fail.
    
org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.security.AccessControlException):
 Permission denied: user=root, access=WRITE, 
inode="/apps/metron/patterns/asa._COPYING_":hdfs:hadoop:drwxrwxr-x
            at 
org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.check(FSPermissionChecker.java:319)
            at 
org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.check(FSPermissionChecker.java:292)
            at 
org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.checkPermission(FSPermissionChecker.java:213)
    .....
            at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:76)
            at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:90)
            at org.apache.hadoop.fs.FsShell.main(FsShell.java:350)
    put: Permission denied: user=root, access=WRITE, 
inode="/apps/metron/patterns/asa._COPYING_":hdfs:hadoop:drwxrwxr-x
    
    ```
    hdfs user can't access to /usr/metron/0.2.1BETA/patterns:
    ```
    [root@node1 ~]# su  hdfs
    [hdfs@node1 ~]$ ls -lR  /usr/metron/0.2.1BETA/patterns
    ls: cannot open directory /usr/metron/0.2.1BETA/patterns: Permission denied
    ```


> Build failure - metron_mpack: Assembly id is incorrectly configured
> -------------------------------------------------------------------
>
>                 Key: METRON-500
>                 URL: https://issues.apache.org/jira/browse/METRON-500
>             Project: Metron
>          Issue Type: Bug
>    Affects Versions: 0.2.1BETA
>         Environment: Metron 0.2.1BETA
> --
> * master
> --
> commit 609ea40c2e8ab3b35b645f4238d2f66afc120fb5
> Author: cstella <ceste...@gmail.com>
> Date:   Tue Oct 11 13:59:45 2016 -0400
>     METRON-488: Snort should use a proper CSV implementation (cestella via 
> mmiklavc) closes apache/incubator-metron#297
> --
>  metron-deployment/inventory/full-dev-platform/group_vars/all                 
>         | 4 ++--
>  
> metron-deployment/packaging/ambari/metron-mpack/src/main/assemblies/metron-mpack.xml
>  | 4 ++--
>  metron-deployment/vagrant/full-dev-platform/ansible.cfg                      
>         | 1 +
>  3 files changed, 5 insertions(+), 4 deletions(-)
> --
> ansible 2.0.0.2
>   config file = 
>   configured module search path = Default w/o overrides
> --
> metron-deployment/scripts/platform-info.sh: line 52: vagrant: command not 
> found
> --
> Python 2.7.12
> --
> Apache Maven 3.3.9
> Maven home: /usr/share/maven
> Java version: 1.8.0_101, vendor: Oracle Corporation
> Java home: /usr/lib/jvm/java-8-oracle/jre
> Default locale: en_US, platform encoding: UTF-8
> OS name: "linux", version: "4.4.0-42-generic", arch: "amd64", family: "unix"
> --
> Linux yoyo-vm 4.4.0-42-generic #62-Ubuntu SMP Fri Oct 7 23:11:45 UTC 2016 
> x86_64 x86_64 x86_64 GNU/Linux
>            Reporter: Yohann
>            Priority: Minor
>
> The build on current master fails because <id></id> is empty in 
> metron-mpack.xml
> It could be related to the behavior of maven-assembly-plugin since 2.2. 
> http://maven.apache.org/plugins/maven-assembly-plugin/faq.html#required-classifiers
> {quote} In previous versions (before 2.2 final), leaving off the assembly id
> and leaving the classifier unconfigured resulted in the assembly being
> used as the project's main artifact. With the 2.2 release, this
> configuration results in a validation error.{quote}
> {code}
> yoyo@yoyo-vm:~/incubator-metron$ git rev-parse HEAD
> 609ea40c2e8ab3b35b645f4238d2f66afc120fb5
> yoyo@yoyo-vm:~/incubator-metron$ mvn clean package  -DskipTests
> ...
> [INFO] --- maven-assembly-plugin:2.4.1:single (build-tarball) @ metron_mpack 
> ---
> [INFO] Reading assembly descriptor: src/main/assemblies/metron-mpack.xml
> [INFO] 
> ------------------------------------------------------------------------
> [INFO] Reactor Summary:
> [INFO]
> [INFO] Metron ............................................. SUCCESS [  0.095 
> s]
> [INFO] metron-analytics ................................... SUCCESS [  0.002 
> s]
> [INFO] metron-maas-common ................................. SUCCESS [  1.708 
> s]
> [INFO] metron-platform .................................... SUCCESS [  0.002 
> s]
> [INFO] metron-test-utilities .............................. SUCCESS [  1.242 
> s]
> [INFO] metron-integration-test ............................ SUCCESS [  0.700 
> s]
> [INFO] metron-maas-service ................................ SUCCESS [  2.583 
> s]
> [INFO] metron-common ...................................... SUCCESS [  8.553 
> s]
> [INFO] metron-hbase ....................................... SUCCESS [  0.628 
> s]
> [INFO] metron-profiler-common ............................. SUCCESS [  0.299 
> s]
> [INFO] metron-profiler .................................... SUCCESS [ 14.017 
> s]
> [INFO] metron-profiler-client ............................. SUCCESS [  5.942 
> s]
> [INFO] metron-writer ...................................... SUCCESS [  5.278 
> s]
> [INFO] metron-enrichment .................................. SUCCESS [ 21.441 
> s]
> [INFO] metron-indexing .................................... SUCCESS [  5.087 
> s]
> [INFO] metron-solr ........................................ SUCCESS [ 10.085 
> s]
> [INFO] metron-pcap ........................................ SUCCESS [  0.511 
> s]
> [INFO] metron-parsers ..................................... SUCCESS [ 21.636 
> s]
> [INFO] metron-pcap-backend ................................ SUCCESS [ 16.211 
> s]
> [INFO] metron-data-management ............................. SUCCESS [ 25.524 
> s]
> [INFO] metron-api ......................................... SUCCESS [ 13.533 
> s]
> [INFO] metron-management .................................. SUCCESS [  1.173 
> s]
> [INFO] elasticsearch-shaded ............................... SUCCESS [  3.902 
> s]
> [INFO] metron-elasticsearch ............................... SUCCESS [ 26.950 
> s]
> [INFO] metron-deployment .................................. SUCCESS [  0.001 
> s]
> [INFO] Metron Ambari Management Pack ...................... FAILURE [  0.124 
> s]
> [INFO] 
> ------------------------------------------------------------------------
> [INFO] BUILD FAILURE
> [INFO] 
> ------------------------------------------------------------------------
> [INFO] Total time: 03:07 min
> [INFO] Finished at: 2016-10-12T21:39:18+02:00
> [INFO] Final Memory: 132M/548M
> [INFO] 
> ------------------------------------------------------------------------
> [ERROR] Failed to execute goal
> org.apache.maven.plugins:maven-assembly-plugin:2.4.1:single
> (build-tarball) on project metron_mpack: Assembly is incorrectly
> configured: Assembly is incorrectly configured:
> [ERROR] Assembly:  is not configured correctly: Assembly ID must be
> present and non-empty.
> [ERROR] -> [Help 1]
> [ERROR]
> [ERROR] To see the full stack trace of the errors, re-run Maven with
> the -e switch.
> [ERROR] Re-run Maven using the -X switch to enable full debug logging.
> [ERROR]
> [ERROR] For more information about the errors and possible solutions,
> please read the following articles:
> [ERROR] [Help 1]
> http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException
> [ERROR]
> [ERROR] After correcting the problems, you can resume the build with the 
> command
> [ERROR]   mvn <goals> -rf :metron_mpack
> {code}
> Quick-and-dirty fix:
> {code}
> yoyo@yoyo-vm:~/incubator-metron$ git diff
> metron-deployment/packaging/ambari/metron-mpack/src/main/assemblies/metron-mpack.xml
> diff --git 
> a/metron-deployment/packaging/ambari/metron-mpack/src/main/assemblies/metron-mpack.xml
> b/metron-deployment/packaging/ambari/metron-mpack/src/main/assemblies/metron-mpack.xml
> index 7de489f..ed667b8 100644
> --- 
> a/metron-deployment/packaging/ambari/metron-mpack/src/main/assemblies/metron-mpack.xml
> +++ 
> b/metron-deployment/packaging/ambari/metron-mpack/src/main/assemblies/metron-mpack.xml
> @@ -18,7 +18,7 @@
>          
> xmlns="http://maven.apache.org/plugins/maven-assembly-plugin/assembly/1.1.3";
>          xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance";
>          
> xsi:schemaLocation="http://maven.apache.org/plugins/maven-assembly-plugin/assembly/1.1.3
> http://maven.apache.org/xsd/assembly-1.1.3.xsd";>
> -    <id></id>
> +    <id>test</id>
>      <formats>
>          <format>tar.gz</format>
>      </formats>
> @@ -40,4 +40,4 @@
>      </files>
>      <dependencySets>
>      </dependencySets>
> -</assembly>
> \ No newline at end of file
> +</assembly>
> {code}
> {code}
> yoyo@yoyo-vm:~/incubator-metron$ mvn clean package  -DskipTests
> ...
> [INFO] --- maven-assembly-plugin:2.4.1:single (build-tarball) @ metron_mpack 
> ---
> [INFO] Reading assembly descriptor: src/main/assemblies/metron-mpack.xml
> [INFO] Building tar:
> /home/yoyo/incubator-metron/metron-deployment/packaging/ambari/metron-mpack/target/metron_mpack-1.0.0.0-SNAPSHOT-test.tar.gz
> [INFO] 
> ------------------------------------------------------------------------
> [INFO] Reactor Summary:
> [INFO]
> [INFO] Metron ............................................. SUCCESS [  0.118 
> s]
> [INFO] metron-analytics ................................... SUCCESS [  0.004 
> s]
> [INFO] metron-maas-common ................................. SUCCESS [  1.808 
> s]
> [INFO] metron-platform .................................... SUCCESS [  0.002 
> s]
> [INFO] metron-test-utilities .............................. SUCCESS [  1.073 
> s]
> [INFO] metron-integration-test ............................ SUCCESS [  0.767 
> s]
> [INFO] metron-maas-service ................................ SUCCESS [  2.505 
> s]
> [INFO] metron-common ...................................... SUCCESS [  8.424 
> s]
> [INFO] metron-hbase ....................................... SUCCESS [  0.719 
> s]
> [INFO] metron-profiler-common ............................. SUCCESS [  0.256 
> s]
> [INFO] metron-profiler .................................... SUCCESS [ 14.112 
> s]
> [INFO] metron-profiler-client ............................. SUCCESS [  5.942 
> s]
> [INFO] metron-writer ...................................... SUCCESS [  5.116 
> s]
> [INFO] metron-enrichment .................................. SUCCESS [ 21.109 
> s]
> [INFO] metron-indexing .................................... SUCCESS [  5.070 
> s]
> [INFO] metron-solr ........................................ SUCCESS [  9.928 
> s]
> [INFO] metron-pcap ........................................ SUCCESS [  0.461 
> s]
> [INFO] metron-parsers ..................................... SUCCESS [ 21.540 
> s]
> [INFO] metron-pcap-backend ................................ SUCCESS [ 16.251 
> s]
> [INFO] metron-data-management ............................. SUCCESS [ 25.328 
> s]
> [INFO] metron-api ......................................... SUCCESS [ 14.068 
> s]
> [INFO] metron-management .................................. SUCCESS [  1.194 
> s]
> [INFO] elasticsearch-shaded ............................... SUCCESS [  3.850 
> s]
> [INFO] metron-elasticsearch ............................... SUCCESS [ 26.453 
> s]
> [INFO] metron-deployment .................................. SUCCESS [  0.004 
> s]
> [INFO] Metron Ambari Management Pack ...................... SUCCESS [  0.135 
> s]
> [INFO] 
> ------------------------------------------------------------------------
> [INFO] BUILD SUCCESS
> [INFO] 
> ------------------------------------------------------------------------
> [INFO] Total time: 03:06 min
> [INFO] Finished at: 2016-10-12T21:47:41+02:00
> [INFO] Final Memory: 131M/554M
> [INFO] 
> ------------------------------------------------------------------------
> {code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to