We just ran into this issue with our integration tests and it has to do with the HDFS client code sorting the results of a list command differently depending on the environment. Thank you for finding this! I will file a Jira.
On Mon, Mar 6, 2017 at 11:16 AM, Laurens Vets <laur...@daemon.be> wrote: > Hi, > > The debug output is 170MB. I've pasted the last lines with the failure to > http://pastebin.com/6ZT4fAZg > > Is that enough? Is there anything else I can provide? > > On 2017-03-06 08:17, Ryan Merriman wrote: > > Can you provide the stack trace of the error that causes the BUILD FAILURE > for the metron-rest module? > > On Mon, Mar 6, 2017 at 10:15 AM, Laurens Vets <laur...@daemon.be> wrote: > >> Hi Kyle, >> >> Running 'mvn clean package' under /home/laurens/Source/incubator-metron >> results in a failure as well: >> >> ... >> >> [INFO] Metron Ambari Management Pack ...................... SUCCESS [ >> 1.181 s] >> [INFO] metron-docker ...................................... SUCCESS [ >> 1.463 s] >> [INFO] metron-interface ................................... SUCCESS [ >> 0.001 s] >> [INFO] metron-rest-client ................................. SUCCESS [ >> 0.164 s] >> [INFO] metron-rest ........................................ FAILURE >> [01:29 min] >> [INFO] ------------------------------------------------------------ >> ------------ >> [INFO] BUILD FAILURE >> [INFO] ------------------------------------------------------------ >> ------------ >> [INFO] Total time: 23:45 min >> [INFO] Finished at: 2017-03-06T10:12:35-06:00 >> [INFO] Final Memory: 200M/4083M >> [INFO] ------------------------------------------------------------ >> ------------ >> [ERROR] Failed to execute goal >> org.apache.maven.plugins:maven-surefire-plugin:2.18:test >> (unit-tests) on project metron-rest: There are test failures. >> [ERROR] >> [ERROR] Please refer to /home/laurens/Source/incubator >> -metron/metron-interface/metron-rest/target/surefire-reports for the >> individual test results. >> [ERROR] -> [Help 1] >> [ERROR] >> [ERROR] To see the full stack trace of the errors, re-run Maven with the >> -e switch. >> [ERROR] Re-run Maven using the -X switch to enable full debug logging. >> [ERROR] >> [ERROR] For more information about the errors and possible solutions, >> please read the following articles: >> [ERROR] [Help 1] http://cwiki.apache.org/conflu >> ence/display/MAVEN/MojoFailureException >> [ERROR] >> [ERROR] After correcting the problems, you can resume the build with the >> command >> [ERROR] mvn <goals> -rf :metron-rest >> laurens@lof:~/Source/incubator-metron$ >> >> >> The results of $METRON_HOME/metron-deployment/scripts/platform-info.sh >> are: >> >> laurens@lof:~/Source/incubator-metron$ metron-deployment/scripts/plat >> form-info.sh >> Metron 0.3.1 >> -- >> * master >> -- >> commit 27ee490960614dfd890acdab443c6b242ce2cdb8 >> Author: cstella <ceste...@gmail.com> >> Date: Sun Mar 5 18:29:38 2017 +0000 >> >> METRON-744: Allow Stellar functions to be loaded from HDFS this >> closes apache/incubator-metron#468 >> -- >> -- >> ansible 2.0.0.2 >> config file = /etc/ansible/ansible.cfg >> configured module search path = Default w/o overrides >> -- >> Vagrant 1.8.1 >> -- >> Python 2.7.12 >> -- >> Apache Maven 3.3.9 >> Maven home: /usr/share/maven >> Java version: 1.8.0_121, vendor: Oracle Corporation >> Java home: /usr/lib/jvm/java-8-openjdk-amd64/jre >> Default locale: en_US, platform encoding: UTF-8 >> OS name: "linux", version: "4.4.0-64-generic", arch: "amd64", family: >> "unix" >> -- >> Linux lof 4.4.0-64-generic #85-Ubuntu SMP Mon Feb 20 11:50:30 UTC 2017 >> x86_64 x86_64 x86_64 GNU/Linux >> -- >> Total System Memory = 32164.2 MB >> Processor Model: Intel(R) Xeon(R) CPU L5639 @ 2.13GHz >> Processor Speed: 1600.000 MHz >> Processor Speed: 2133.000 MHz >> Processor Speed: 1867.000 MHz >> Processor Speed: 1600.000 MHz >> Total Physical Processors: 24 >> Total cores: 144 >> Disk information: >> /dev/mapper/vg-root 1.8T 14G 1.7T 1% / >> /dev/sda5 961M 93M 820M 11% /boot >> /dev/mapper/vg-tmp 945M 1.7M 879M 1% /tmp >> laurens@lof:~/Source/incubator-metron$ >> >> Anything else I can provide? >> >> On 2017-03-06 05:04, Kyle Richardson wrote: >> >> Thanks for trying out Metron! >> >> Have you run `mvn clean package` from $METRON_HOME? (In your case, this >> looks to be /home/laurens/Source/incubator-metron/.) >> >> Can you run $METRON_HOME/metron-deployment/scripts/platform-info.sh and >> reply with the output? >> >> -Kyle >> >> On Mon, Mar 6, 2017 at 12:56 AM, Laurens Vets <laur...@daemon.be> wrote: >> >>> Hello list, >>> >>> I'm trying to install the full dev VM with the instructions posted here: >>> https://github.com/apache/incubator-metron/tree/master/metro >>> n-deployment/vagrant/full-dev-platform >>> >>> However, after a while, this fails with the following error after >>> running 'vagrant up': >>> >>> <lots of lines> >>> >>> TASK [epel : Get epel-repo rpm] ****************************** >>> ****************** >>> ok: [node1] >>> >>> TASK [epel : Install epel-repo rpm] ****************************** >>> ************** >>> ok: [node1] >>> >>> TASK [ntp : Install ntp] ****************************** >>> ************************* >>> ok: [node1] >>> >>> TASK [ntp : Ensure ntp is running and enabled] >>> ********************************* >>> ok: [node1] >>> >>> TASK [metron_common : Check OS Version] ****************************** >>> ********** >>> skipping: [node1] >>> >>> TASK [metron_common : Check for Metron jar path] >>> ******************************* >>> ok: [node1 -> localhost] >>> >>> TASK [metron_common : Verify Metron jars exist] >>> ******************************** >>> fatal: [node1]: FAILED! => {"changed": false, "failed": true, "msg": >>> "Unable to locate staged Metron jars at /home/laurens/Source/incubator >>> -metron/metron-deployment/playbooks/../../metron-platform/me >>> tron-elasticsearch/target/metron-elasticsearch-0.3.1.jar. Did you run >>> 'mvn package'?"} >>> >>> PLAY RECAP ************************************************************ >>> ********* >>> node1 : ok=41 changed=26 unreachable=0 >>> failed=1 >>> >>> Ansible failed to complete successfully. Any error output should be >>> visible above. Please fix these errors and try again. >>> laurens@lof:~/Source/incubator-metron/metron-deployment/vagr >>> ant/full-dev-platform$ >>> >>> Running 'vagrant provision' bugs out with the same error. >>> >>> Running 'mvn package' under /home/laurens/Source/incubator >>> -metron/metron-deployment/playbooks/../../metron-platform/metron-elasticsearch/target/ >>> fails with: >>> >>> Downloaded: https://repo.maven.apache.org/maven2/org/mockito/mockito-cor >>> e/1.10.19/mockito-core-1.10.19.jar (1146 KB at 494.2 KB/sec) >>> [INFO] ------------------------------------------------------------ >>> ------------ >>> [INFO] BUILD FAILURE >>> [INFO] ------------------------------------------------------------ >>> ------------ >>> [INFO] Total time: 01:56 min >>> [INFO] Finished at: 2017-03-05T23:43:01-06:00 >>> [INFO] Final Memory: 19M/443M >>> [INFO] ------------------------------------------------------------ >>> ------------ >>> [ERROR] Failed to execute goal on project metron-elasticsearch: Could >>> not resolve dependencies for project >>> org.apache.metron:metron-elasticsearch:jar:0.3.1: >>> The following artifacts could not be resolved: >>> org.apache.metron:elasticsearch-shaded:jar:0.3.1, >>> org.apache.metron:metron-enrichment:jar:0.3.1, >>> org.apache.metron:metron-integration-test:jar:0.3.1, >>> org.apache.metron:metron-indexing:jar:0.3.1, >>> org.apache.metron:metron-indexing:jar:tests:0.3.1, >>> org.apache.metron:metron-enrichment:jar:tests:0.3.1: Could not find >>> artifact org.apache.metron:elasticsearch-shaded:jar:0.3.1 in clojars.org >>> (http://clojars.org/repo) -> [Help 1] >>> [ERROR] >>> [ERROR] To see the full stack trace of the errors, re-run Maven with the >>> -e switch. >>> [ERROR] Re-run Maven using the -X switch to enable full debug logging. >>> [ERROR] >>> [ERROR] For more information about the errors and possible solutions, >>> please read the following articles: >>> [ERROR] [Help 1] http://cwiki.apache.org/conflu >>> ence/display/MAVEN/DependencyResolutionException >>> laurens@lof:~/Source/incubator-metron/metron-platform/metron >>> -elasticsearch$ >>> >>> Any ideas on what might be going wrong or how I can further troubleshoot >>> this? >> >> >> >
