[jira] [Updated] (METRON-2340) Geo Database Download failure fails build
[ https://issues.apache.org/jira/browse/METRON-2340?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tom Yerex updated METRON-2340: -- Attachment: image-2020-04-19-18-40-22-581.png > Geo Database Download failure fails build > - > > Key: METRON-2340 > URL: https://issues.apache.org/jira/browse/METRON-2340 > Project: Metron > Issue Type: Bug >Reporter: Otto Fowler >Priority: Blocker > Attachments: image-2020-04-19-18-40-22-581.png > > > Master is failing : > [INFO] Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 3.025 > s - in > org.apache.metron.dataloads.nonbulk.flatfile.SimpleFlatFileSummarizerTest > [INFO] Running > org.apache.metron.dataloads.nonbulk.geo.MaxmindDbEnrichmentLoaderTest > Downloading > file:/tmp/junit2300963143521842328/remoteDir/MaxmindDbEnrichmentLoaderTest.mmdb > to /tmp/junit2300963143521842328/tmpDirMaxmindDbEnrichmentLoaderTest.mmdb > Warning: Unable to copy remote GeoIP database to local file, attempt 0: > java.io.IOException: Invalid Gzip file > java.io.IOException: Invalid Gzip file > at > org.apache.metron.dataloads.nonbulk.geo.MaxmindDbEnrichmentLoader.downloadGeoFile(MaxmindDbEnrichmentLoader.java:243) > at > org.apache.metron.dataloads.nonbulk.geo.MaxmindDbEnrichmentLoaderTest.lambda$loader_throws_exception_on_bad_gzip_file$0(MaxmindDbEnrichmentLoaderTest.java:129) > at org.junit.jupiter.api.AssertThrows.assertThrows(AssertThrows.java:55) > at org.junit.jupiter.api.AssertThrows.assertThrows(AssertThrows.java:37) > at org.junit.jupiter.api.Assertions.assertThrows(Assertions.java:2952) > at > org.apache.metron.dataloads.nonbulk.geo.MaxmindDbEnrichmentLoaderTest.loader_throws_exception_on_bad_gzip_file(MaxmindDbEnrichmentLoaderTest.java:129) > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > at > sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) > at > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) > at java.lang.reflect.Method.invoke(Method.java:498) > at > org.junit.platform.commons.util.ReflectionUtils.invokeMethod(ReflectionUtils.java:675) > at > org.junit.jupiter.engine.execution.MethodInvocation.proceed(MethodInvocation.java:60) > at > org.junit.jupiter.engine.execution.InvocationInterceptorChain$ValidatingInvocation.proceed(InvocationInterceptorChain.java:125) > at > org.junit.jupiter.engine.extension.TimeoutExtension.intercept(TimeoutExtension.java:132) > at > org.junit.jupiter.engine.extension.TimeoutExtension.interceptTestableMethod(TimeoutExtension.java:124) > at > org.junit.jupiter.engine.extension.TimeoutExtension.interceptTestMethod(TimeoutExtension.java:74) > at > org.junit.jupiter.engine.execution.ExecutableInvoker$ReflectiveInterceptorCall.lambda$ofVoidMethod$0(ExecutableInvoker.java:115) > at > org.junit.jupiter.engine.execution.ExecutableInvoker.lambda$invoke$0(ExecutableInvoker.java:105) > at > org.junit.jupiter.engine.execution.InvocationInterceptorChain$InterceptedInvocation.proceed(InvocationInterceptorChain.java:104) > at > org.junit.jupiter.engine.execution.InvocationInterceptorChain.proceed(InvocationInterceptorChain.java:62) > at > org.junit.jupiter.engine.execution.InvocationInterceptorChain.chainAndInvoke(InvocationInterceptorChain.java:43) > at > org.junit.jupiter.engine.execution.InvocationInterceptorChain.invoke(InvocationInterceptorChain.java:35) > at > org.junit.jupiter.engine.execution.ExecutableInvoker.invoke(ExecutableInvoker.java:104) > at > org.junit.jupiter.engine.execution.ExecutableInvoker.invoke(ExecutableInvoker.java:98) > at > org.junit.jupiter.engine.descriptor.TestMethodTestDescriptor.lambda$invokeTestMethod$6(TestMethodTestDescriptor.java:202) > at > org.junit.platform.engine.support.hierarchical.ThrowableCollector.execute(ThrowableCollector.java:73) > at > org.junit.jupiter.engine.descriptor.TestMethodTestDescriptor.invokeTestMethod(TestMethodTestDescriptor.java:198) > at > org.junit.jupiter.engine.descriptor.TestMethodTestDescriptor.execute(TestMethodTestDescriptor.java:135) > at > org.junit.jupiter.engine.descriptor.TestMethodTestDescriptor.execute(TestMethodTestDescriptor.java:69) > at > org.junit.platform.engine.support.hierarchical.NodeTestTask.lambda$executeRecursively$5(NodeTestTask.java:135) > at > org.junit.platform.engine.support.hierarchical.ThrowableCollector.execute(ThrowableCollector.java:73) > at > org.junit.platform.engine.support.hierarchical.NodeTestTask.lambda$executeRecursively$7(NodeTestTask.java:125) > at > org.junit.platform.engine.support.hierarchical.Node.around(Node.java:135) > at >
[jira] [Commented] (METRON-2340) Geo Database Download failure fails build
[ https://issues.apache.org/jira/browse/METRON-2340?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17087289#comment-17087289 ] Tom Yerex commented on METRON-2340: --- Until a change has been made, a temporary work around is to sign up for a license from Maxmind, configure a local web server to download and share the required files then update the URL settings. In Ambari, select Services > Metron, the Configs tab and Enrichment tab then enter the URLs for the local site where the GeoLite2-City.tar.gz and GeoLite2-ASN.tar.gz files can be found. !image-2020-04-19-18-40-22-581.png! > Geo Database Download failure fails build > - > > Key: METRON-2340 > URL: https://issues.apache.org/jira/browse/METRON-2340 > Project: Metron > Issue Type: Bug >Reporter: Otto Fowler >Priority: Blocker > Attachments: image-2020-04-19-18-40-22-581.png > > > Master is failing : > [INFO] Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 3.025 > s - in > org.apache.metron.dataloads.nonbulk.flatfile.SimpleFlatFileSummarizerTest > [INFO] Running > org.apache.metron.dataloads.nonbulk.geo.MaxmindDbEnrichmentLoaderTest > Downloading > file:/tmp/junit2300963143521842328/remoteDir/MaxmindDbEnrichmentLoaderTest.mmdb > to /tmp/junit2300963143521842328/tmpDirMaxmindDbEnrichmentLoaderTest.mmdb > Warning: Unable to copy remote GeoIP database to local file, attempt 0: > java.io.IOException: Invalid Gzip file > java.io.IOException: Invalid Gzip file > at > org.apache.metron.dataloads.nonbulk.geo.MaxmindDbEnrichmentLoader.downloadGeoFile(MaxmindDbEnrichmentLoader.java:243) > at > org.apache.metron.dataloads.nonbulk.geo.MaxmindDbEnrichmentLoaderTest.lambda$loader_throws_exception_on_bad_gzip_file$0(MaxmindDbEnrichmentLoaderTest.java:129) > at org.junit.jupiter.api.AssertThrows.assertThrows(AssertThrows.java:55) > at org.junit.jupiter.api.AssertThrows.assertThrows(AssertThrows.java:37) > at org.junit.jupiter.api.Assertions.assertThrows(Assertions.java:2952) > at > org.apache.metron.dataloads.nonbulk.geo.MaxmindDbEnrichmentLoaderTest.loader_throws_exception_on_bad_gzip_file(MaxmindDbEnrichmentLoaderTest.java:129) > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > at > sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) > at > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) > at java.lang.reflect.Method.invoke(Method.java:498) > at > org.junit.platform.commons.util.ReflectionUtils.invokeMethod(ReflectionUtils.java:675) > at > org.junit.jupiter.engine.execution.MethodInvocation.proceed(MethodInvocation.java:60) > at > org.junit.jupiter.engine.execution.InvocationInterceptorChain$ValidatingInvocation.proceed(InvocationInterceptorChain.java:125) > at > org.junit.jupiter.engine.extension.TimeoutExtension.intercept(TimeoutExtension.java:132) > at > org.junit.jupiter.engine.extension.TimeoutExtension.interceptTestableMethod(TimeoutExtension.java:124) > at > org.junit.jupiter.engine.extension.TimeoutExtension.interceptTestMethod(TimeoutExtension.java:74) > at > org.junit.jupiter.engine.execution.ExecutableInvoker$ReflectiveInterceptorCall.lambda$ofVoidMethod$0(ExecutableInvoker.java:115) > at > org.junit.jupiter.engine.execution.ExecutableInvoker.lambda$invoke$0(ExecutableInvoker.java:105) > at > org.junit.jupiter.engine.execution.InvocationInterceptorChain$InterceptedInvocation.proceed(InvocationInterceptorChain.java:104) > at > org.junit.jupiter.engine.execution.InvocationInterceptorChain.proceed(InvocationInterceptorChain.java:62) > at > org.junit.jupiter.engine.execution.InvocationInterceptorChain.chainAndInvoke(InvocationInterceptorChain.java:43) > at > org.junit.jupiter.engine.execution.InvocationInterceptorChain.invoke(InvocationInterceptorChain.java:35) > at > org.junit.jupiter.engine.execution.ExecutableInvoker.invoke(ExecutableInvoker.java:104) > at > org.junit.jupiter.engine.execution.ExecutableInvoker.invoke(ExecutableInvoker.java:98) > at > org.junit.jupiter.engine.descriptor.TestMethodTestDescriptor.lambda$invokeTestMethod$6(TestMethodTestDescriptor.java:202) > at > org.junit.platform.engine.support.hierarchical.ThrowableCollector.execute(ThrowableCollector.java:73) > at > org.junit.jupiter.engine.descriptor.TestMethodTestDescriptor.invokeTestMethod(TestMethodTestDescriptor.java:198) > at > org.junit.jupiter.engine.descriptor.TestMethodTestDescriptor.execute(TestMethodTestDescriptor.java:135) > at > org.junit.jupiter.engine.descriptor.TestMethodTestDescriptor.execute(TestMethodTestDescriptor.java:69) > at >
[jira] [Commented] (METRON-2345) "Metron on CentOS 7" documentation does not exist
[ https://issues.apache.org/jira/browse/METRON-2345?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17087285#comment-17087285 ] Tom Yerex commented on METRON-2345: --- Added OpenJDK 1.8 to the list of components required. Many systems seem to have a more recent version of Java and it breaks the process unless the 1.8 version is installed. Included a brief comment to set JAVA_HOME as the build process would fail without it on Debian-derived Linux distro. > "Metron on CentOS 7" documentation does not exist > - > > Key: METRON-2345 > URL: https://issues.apache.org/jira/browse/METRON-2345 > Project: Metron > Issue Type: Improvement > Environment: CentOS 7 >Reporter: Tom Yerex >Assignee: Tom Yerex >Priority: Minor > Labels: documentation > Original Estimate: 168h > Remaining Estimate: 168h > > The development build for "centos7" lacks a README.md that contains a > description of how to use Vagrant to create a CentOS 7-based Metron > deployment. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (METRON-2345) "Metron on CentOS 7" documentation does not exist
[ https://issues.apache.org/jira/browse/METRON-2345?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17087224#comment-17087224 ] Tom Yerex commented on METRON-2345: --- Copy the documentation from metron-deployment/development/centos6/README.md to metron-deployment/development/centos7/README.md and update as required. > "Metron on CentOS 7" documentation does not exist > - > > Key: METRON-2345 > URL: https://issues.apache.org/jira/browse/METRON-2345 > Project: Metron > Issue Type: Improvement > Environment: CentOS 7 >Reporter: Tom Yerex >Assignee: Tom Yerex >Priority: Minor > Labels: documentation > Original Estimate: 168h > Remaining Estimate: 168h > > The development build for "centos7" lacks a README.md that contains a > description of how to use Vagrant to create a CentOS 7-based Metron > deployment. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (METRON-2345) "Metron on CentOS 7" documentation does not exist
Tom Yerex created METRON-2345: - Summary: "Metron on CentOS 7" documentation does not exist Key: METRON-2345 URL: https://issues.apache.org/jira/browse/METRON-2345 Project: Metron Issue Type: Improvement Environment: CentOS 7 Reporter: Tom Yerex Assignee: Tom Yerex The development build for "centos7" lacks a README.md that contains a description of how to use Vagrant to create a CentOS 7-based Metron deployment. -- This message was sent by Atlassian Jira (v8.3.4#803005)
