[GitHub] [metron] merrimanr opened a new pull request #1490: METRON-2169: Upgrade to Kafka 2.0.0 and Storm 1.2.1
merrimanr opened a new pull request #1490: METRON-2169: Upgrade to Kafka 2.0.0
and Storm 1.2.1
URL: https://github.com/apache/metron/pull/1490
## Contributor Comments
This PR upgrades the Kafka client dependency from 0.10.0.1 to 2.0.0 and the
Storm dependency from 1.0.3 to 1.2.1. Overall this upgrade was pretty
straightforward. The only complex changes involved upgrading the KafkaComponent
class to use new Kafka admin and testing classes.
@mmiklavc, all the comments you made on #1453 should be addressed here with
the exception of excluding Storm. I had to upgrade both Storm and Kafka
versions or I get
[this](https://github.com/apache/metron/pull/1488#issuecomment-523111756).
@nickwallen, all the comments you made on #1488 should be addressed as well.
To isolate Kafka/Storm from the rest of the components, I upgraded these
versions independently in all Maven profiles. This will allow us to test newer
client versions in full dev without having to upgrade all clients. I created a
[Jira](https://issues.apache.org/jira/browse/METRON-2223) to reconcile these
once we complete the upgrade work.
### Testing
Right now I have only verified that it builds and tests pass. I plan on
running these tests in full dev:
Verify full dev comes up without error and data is landing in ES
Verify all REST Kafka functions are working as expected
Verify all Stellar Kafka functions are working as expected
Verify Kerberos
## Pull Request Checklist
Thank you for submitting a contribution to Apache Metron.
Please refer to our [Development
Guidelines](https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=61332235)
for the complete guide to follow for contributions.
Please refer also to our [Build Verification
Guidelines](https://cwiki.apache.org/confluence/display/METRON/Verifying+Builds?show-miniview)
for complete smoke testing guides.
In order to streamline the review of the contribution we ask you follow
these guidelines and ask you to double check the following:
### For all changes:
- [x] Is there a JIRA ticket associated with this PR? If not one needs to be
created at [Metron
Jira](https://issues.apache.org/jira/browse/METRON/?selectedTab=com.atlassian.jira.jira-projects-plugin:summary-panel).
- [x] Does your PR title start with METRON- where is the JIRA
number you are trying to resolve? Pay particular attention to the hyphen "-"
character.
- [x] Has your PR been rebased against the latest commit within the target
branch (typically master)?
### For code changes:
- [x] Have you included steps to reproduce the behavior or problem that is
being changed or addressed?
- [x] Have you included steps or a guide to how the change may be verified
and tested manually?
- [x] Have you ensured that the full suite of tests and checks have been
executed in the root metron folder via:
```
mvn -q clean integration-test install &&
dev-utilities/build-utils/verify_licenses.sh
```
- [x] Have you written or updated unit tests and or integration tests to
verify your changes?
- [x] If adding new dependencies to the code, are these dependencies
licensed in a way that is compatible for inclusion under [ASF
2.0](http://www.apache.org/legal/resolved.html#category-a)?
- [ ] Have you verified the basic functionality of the build by building and
running locally with Vagrant full-dev environment or the equivalent?
### For documentation related changes:
- [x] Have you ensured that format looks appropriate for the output in which
it is rendered by building and verifying the site-book? If not then run the
following commands and the verify changes via
`site-book/target/site/index.html`:
```
cd site-book
mvn site
```
- [x] Have you ensured that any documentation diagrams have been updated,
along with their source files, using [draw.io](https://www.draw.io/)? See
[Metron Development
Guidelines](https://cwiki.apache.org/confluence/display/METRON/Development+Guidelines)
for instructions.
Note:
Please ensure that once the PR is submitted, you check travis-ci for build
issues and submit an update to your PR as soon as possible.
It is also recommended that [travis-ci](https://travis-ci.org) is set up for
your personal repository such that your branches are built there before
submitting a pull request.
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
With regards,
Apache Git Services
[GitHub] [metron] merrimanr closed pull request #1490: METRON-2169: Upgrade to Kafka 2.0.0 and Storm 1.2.1
merrimanr closed pull request #1490: METRON-2169: Upgrade to Kafka 2.0.0 and Storm 1.2.1 URL: https://github.com/apache/metron/pull/1490 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[GitHub] [metron] asfgit closed pull request #1436: METRON-2149: Shaded jar classifier is not consistent
asfgit closed pull request #1436: METRON-2149: Shaded jar classifier is not consistent URL: https://github.com/apache/metron/pull/1436 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[GitHub] [metron] merrimanr commented on issue #1490: METRON-2169: Upgrade to Kafka 2.0.0 and Storm 1.2.1
merrimanr commented on issue #1490: METRON-2169: Upgrade to Kafka 2.0.0 and Storm 1.2.1 URL: https://github.com/apache/metron/pull/1490#issuecomment-524458609 The latest commit fixes this failed test in `ProfilerIntegrationTest`: ``` 2019-08-23 19:02:50 ERROR executor:0 - java.lang.RuntimeException: java.lang.IllegalStateException: This consumer has already been closed. ``` My guess is that this upgrade changed the behavior of the Kafka Spout to close the consumer when a topology is killed. `ProfilerIntegrationTest` is unique in that it starts and stops multiple topologies whereas most integration tests (`EnrichmentIntegrationTest`) only use one. The fix I chose is to remove this step (consumer close) from the `KafkaComponent.stop` method. The `KafkaComponent.shutdownConsumer` method is still available if closing the internal client is necessary. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[GitHub] [metron] nickwallen commented on a change in pull request #1490: METRON-2169: Upgrade to Kafka 2.0.0 and Storm 1.2.1
nickwallen commented on a change in pull request #1490: METRON-2169: Upgrade to
Kafka 2.0.0 and Storm 1.2.1
URL: https://github.com/apache/metron/pull/1490#discussion_r317274792
##
File path: pom.xml
##
@@ -154,16 +155,25 @@
2.6.5.0
1.1.1
12.0
+
+
+2.0.0
+1.7.25
+1.2.1
HDP-2.5.0.0
2.5.0.0
1245
-1.2.2
-
${base_storm_version}.${hdp_version}-${build_number}
-
${base_kafka_version}.${hdp_version}-${build_number}
+
+
+
+
Review comment:
That works thanks.
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
With regards,
Apache Git Services
[jira] [Created] (METRON-2233) Deprecate Centos 6
Michael Miklavcic created METRON-2233: - Summary: Deprecate Centos 6 Key: METRON-2233 URL: https://issues.apache.org/jira/browse/METRON-2233 Project: Metron Issue Type: Sub-task Reporter: Michael Miklavcic Centos 6 will no longer work for with HDP 3.1. We have a Centos 7 setup that should replace it entirely. We will need to migrate and update any related documentation. -- This message was sent by Atlassian Jira (v8.3.2#803003)
[GitHub] [metron] merrimanr commented on a change in pull request #1490: METRON-2169: Upgrade to Kafka 2.0.0 and Storm 1.2.1
merrimanr commented on a change in pull request #1490: METRON-2169: Upgrade to
Kafka 2.0.0 and Storm 1.2.1
URL: https://github.com/apache/metron/pull/1490#discussion_r317254062
##
File path: pom.xml
##
@@ -154,16 +155,25 @@
2.6.5.0
1.1.1
12.0
+
+
+2.0.0
+1.7.25
+1.2.1
HDP-2.5.0.0
2.5.0.0
1245
-1.2.2
-
${base_storm_version}.${hdp_version}-${build_number}
-
${base_kafka_version}.${hdp_version}-${build_number}
+
+
+
+
Review comment:
I just tested full dev and it passed the build step.
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
With regards,
Apache Git Services
[GitHub] [metron] merrimanr commented on a change in pull request #1490: METRON-2169: Upgrade to Kafka 2.0.0 and Storm 1.2.1
merrimanr commented on a change in pull request #1490: METRON-2169: Upgrade to
Kafka 2.0.0 and Storm 1.2.1
URL: https://github.com/apache/metron/pull/1490#discussion_r317253380
##
File path: pom.xml
##
@@ -154,16 +155,25 @@
2.6.5.0
1.1.1
12.0
+
+
+2.0.0
+1.7.25
+1.2.1
HDP-2.5.0.0
2.5.0.0
1245
-1.2.2
-
${base_storm_version}.${hdp_version}-${build_number}
-
${base_kafka_version}.${hdp_version}-${build_number}
+
+
+
+
Review comment:
The latest commit leaves the HDP-2.5.0.0 profile as is. I set the HDP-3.1
profile active by default and added all the versions that have been upgraded so
far. We can move dependencies over from the main property section as we
upgrade them. Does that work?
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
With regards,
Apache Git Services
[GitHub] [metron] merrimanr commented on a change in pull request #1492: METRON-2225: Upgrade to Solr 7.4.0
merrimanr commented on a change in pull request #1492: METRON-2225: Upgrade to
Solr 7.4.0
URL: https://github.com/apache/metron/pull/1492#discussion_r317244005
##
File path:
metron-platform/metron-solr/metron-solr-common/src/test/java/org/apache/metron/solr/integration/components/SolrComponent.java
##
@@ -149,19 +149,16 @@ public String getZookeeperUrl() {
public void addCollection(String name, String configPath)
throws InterruptedException, IOException, KeeperException,
SolrServerException {
miniSolrCloudCluster.uploadConfigSet(new File(configPath).toPath(), name);
-CollectionAdminRequest.createCollection(name, 1, 1)
+CollectionAdminRequest.createCollection(name, name,1, 1)
Review comment:
I went into the source. It's eventually assigned to a `configName` variable.
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
With regards,
Apache Git Services
[GitHub] [metron] nickwallen commented on a change in pull request #1490: METRON-2169: Upgrade to Kafka 2.0.0 and Storm 1.2.1
nickwallen commented on a change in pull request #1490: METRON-2169: Upgrade to Kafka 2.0.0 and Storm 1.2.1 URL: https://github.com/apache/metron/pull/1490#discussion_r317236809 ## File path: pom.xml ## @@ -154,16 +155,25 @@ 2.6.5.0 1.1.1 12.0 + + +2.0.0 Review comment: Ignore this. The diff was a little off when I was looking at it. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[GitHub] [metron] merrimanr commented on a change in pull request #1490: METRON-2169: Upgrade to Kafka 2.0.0 and Storm 1.2.1
merrimanr commented on a change in pull request #1490: METRON-2169: Upgrade to Kafka 2.0.0 and Storm 1.2.1 URL: https://github.com/apache/metron/pull/1490#discussion_r317235634 ## File path: metron-platform/metron-elasticsearch/metron-elasticsearch-common/pom.xml ## @@ -147,7 +147,7 @@ slf4j-log4j12 - + Review comment: Done This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[GitHub] [metron] merrimanr commented on a change in pull request #1490: METRON-2169: Upgrade to Kafka 2.0.0 and Storm 1.2.1
merrimanr commented on a change in pull request #1490: METRON-2169: Upgrade to
Kafka 2.0.0 and Storm 1.2.1
URL: https://github.com/apache/metron/pull/1490#discussion_r317235723
##
File path:
metron-interface/metron-rest/src/test/java/org/apache/metron/rest/config/TestConfig.java
##
@@ -205,8 +218,10 @@ public RestTemplate restTemplate(StormCLIWrapper
stormCLIClientWrapper) {
}
@Bean
- public AdminUtils$ adminUtils() {
-return AdminUtils$.MODULE$;
+ public AdminClient adminUtils(KafkaComponent kafkaWithZKComponent) {
+Map adminConfig = new HashMap<>();
+adminConfig.put("bootstrap.servers", kafkaWithZKComponent.getBrokerList());
+return KafkaAdminClient.create(adminConfig);
Review comment:
Done
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
With regards,
Apache Git Services
[GitHub] [metron] merrimanr commented on a change in pull request #1490: METRON-2169: Upgrade to Kafka 2.0.0 and Storm 1.2.1
merrimanr commented on a change in pull request #1490: METRON-2169: Upgrade to
Kafka 2.0.0 and Storm 1.2.1
URL: https://github.com/apache/metron/pull/1490#discussion_r317235714
##
File path:
metron-platform/metron-integration-test/src/main/java/org/apache/metron/integration/components/KafkaComponent.java
##
@@ -137,13 +141,20 @@ public String getBrokerList() {
return createProducer(String.class, byte[].class);
}
+ public AdminClient createAdminClient() {
+Map adminConfig = new HashMap<>();
+adminConfig.put(AdminClientConfig.BOOTSTRAP_SERVERS_CONFIG,
getBrokerList());
+AdminClient adminClient = KafkaAdminClient.create(adminConfig);
Review comment:
Done
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
With regards,
Apache Git Services
[jira] [Updated] (METRON-2169) Upgrade to Kafka 2.0.0 and Storm 1.2.1
[ https://issues.apache.org/jira/browse/METRON-2169?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nick Allen updated METRON-2169: --- Summary: Upgrade to Kafka 2.0.0 and Storm 1.2.1 (was: Upgrade Kafka/Storm) > Upgrade to Kafka 2.0.0 and Storm 1.2.1 > -- > > Key: METRON-2169 > URL: https://issues.apache.org/jira/browse/METRON-2169 > Project: Metron > Issue Type: Sub-task >Reporter: Ryan Merriman >Assignee: Ryan Merriman >Priority: Major > Time Spent: 6h 10m > Remaining Estimate: 0h > > To support HDP 3.1, we need to upgrade Kafka to version 2.0.0 and Storm to > version 1.2.1. -- This message was sent by Atlassian Jira (v8.3.2#803003)
[GitHub] [metron] nickwallen commented on issue #1491: METRON-2224: Upgrade to Zeppelin 0.8.0
nickwallen commented on issue #1491: METRON-2224: Upgrade to Zeppelin 0.8.0 URL: https://github.com/apache/metron/pull/1491#issuecomment-524401018 This has been merged into the feature branch as 1a41a2cf1bd394cdf15eb83e3a182b4e1addaff5. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[GitHub] [metron] nickwallen closed pull request #1491: METRON-2224: Upgrade to Zeppelin 0.8.0
nickwallen closed pull request #1491: METRON-2224: Upgrade to Zeppelin 0.8.0 URL: https://github.com/apache/metron/pull/1491 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[GitHub] [metron] nickwallen commented on issue #1491: METRON-2224: Upgrade to Zeppelin 0.8.0
nickwallen commented on issue #1491: METRON-2224: Upgrade to Zeppelin 0.8.0 URL: https://github.com/apache/metron/pull/1491#issuecomment-524399486 +1 I have validated that this works using the Zeppelin 0.8.0 `netinst` binary package. Thanks for the updates. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[jira] [Updated] (METRON-2225) Upgrade to Solr 7.4.0
[ https://issues.apache.org/jira/browse/METRON-2225?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nick Allen updated METRON-2225: --- Summary: Upgrade to Solr 7.4.0 (was: Upgrade Solr) > Upgrade to Solr 7.4.0 > - > > Key: METRON-2225 > URL: https://issues.apache.org/jira/browse/METRON-2225 > Project: Metron > Issue Type: Sub-task >Reporter: Ryan Merriman >Assignee: Ryan Merriman >Priority: Major > Time Spent: 1h 20m > Remaining Estimate: 0h > > We need to upgrade Solr from 6.6.2 to 7.4.0 -- This message was sent by Atlassian Jira (v8.3.2#803003)
[GitHub] [metron] merrimanr commented on issue #1491: METRON-2224: Upgrade to Zeppelin 0.8.0
merrimanr commented on issue #1491: METRON-2224: Upgrade to Zeppelin 0.8.0 URL: https://github.com/apache/metron/pull/1491#issuecomment-524396606 Doc updates are done with the latest commits. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[jira] [Updated] (METRON-2224) Upgrade to Zeppelin 0.8.0
[ https://issues.apache.org/jira/browse/METRON-2224?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nick Allen updated METRON-2224: --- Summary: Upgrade to Zeppelin 0.8.0 (was: Upgrade Zeppelin) > Upgrade to Zeppelin 0.8.0 > - > > Key: METRON-2224 > URL: https://issues.apache.org/jira/browse/METRON-2224 > Project: Metron > Issue Type: Sub-task >Reporter: Ryan Merriman >Assignee: Ryan Merriman >Priority: Major > Time Spent: 0.5h > Remaining Estimate: 0h > > We need to upgrade the Zeppelin dependency from 0.7.3 to 0.8.0. -- This message was sent by Atlassian Jira (v8.3.2#803003)
[jira] [Created] (METRON-2232) Upgrade Hadoop
Michael Miklavcic created METRON-2232: - Summary: Upgrade Hadoop Key: METRON-2232 URL: https://issues.apache.org/jira/browse/METRON-2232 Project: Metron Issue Type: Sub-task Reporter: Michael Miklavcic -- This message was sent by Atlassian Jira (v8.3.2#803003)
[jira] [Created] (METRON-2231) Revert METRON-2175, METRON-2176, METRON-2177 in HDP 3.1 upgrade feature branch
Michael Miklavcic created METRON-2231: - Summary: Revert METRON-2175, METRON-2176, METRON-2177 in HDP 3.1 upgrade feature branch Key: METRON-2231 URL: https://issues.apache.org/jira/browse/METRON-2231 Project: Metron Issue Type: Sub-task Reporter: Michael Miklavcic -- This message was sent by Atlassian Jira (v8.3.2#803003)
[jira] [Assigned] (METRON-2169) Upgrade Kafka/Storm
[ https://issues.apache.org/jira/browse/METRON-2169?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Miklavcic reassigned METRON-2169: - Assignee: Michael Miklavcic (was: Ryan Merriman) > Upgrade Kafka/Storm > --- > > Key: METRON-2169 > URL: https://issues.apache.org/jira/browse/METRON-2169 > Project: Metron > Issue Type: Sub-task >Reporter: Ryan Merriman >Assignee: Michael Miklavcic >Priority: Major > Time Spent: 6h 10m > Remaining Estimate: 0h > > To support HDP 3.1, we need to upgrade Kafka to version 2.0.0 and Storm to > version 1.2.1. -- This message was sent by Atlassian Jira (v8.3.2#803003)
[jira] [Assigned] (METRON-2169) Upgrade Kafka/Storm
[ https://issues.apache.org/jira/browse/METRON-2169?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Miklavcic reassigned METRON-2169: - Assignee: Ryan Merriman (was: Michael Miklavcic) > Upgrade Kafka/Storm > --- > > Key: METRON-2169 > URL: https://issues.apache.org/jira/browse/METRON-2169 > Project: Metron > Issue Type: Sub-task >Reporter: Ryan Merriman >Assignee: Ryan Merriman >Priority: Major > Time Spent: 6h 10m > Remaining Estimate: 0h > > To support HDP 3.1, we need to upgrade Kafka to version 2.0.0 and Storm to > version 1.2.1. -- This message was sent by Atlassian Jira (v8.3.2#803003)
[jira] [Commented] (METRON-2223) Reconcile Maven versions
[ https://issues.apache.org/jira/browse/METRON-2223?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16914340#comment-16914340 ] Michael Miklavcic commented on METRON-2223: --- This is a gating task for finishing out the FB > Reconcile Maven versions > > > Key: METRON-2223 > URL: https://issues.apache.org/jira/browse/METRON-2223 > Project: Metron > Issue Type: Sub-task >Reporter: Ryan Merriman >Priority: Major > > It may be useful to upgrade a version independently of other components in > HDP 3.1. We will need to reconcile these versions before the feature branch > is merged into master. This task ensures all Maven profile dependency > versions match the correct HDP version. -- This message was sent by Atlassian Jira (v8.3.2#803003)
[GitHub] [metron] asfgit closed pull request #1464: METRON-2179: Make navigation in both UIs consistent
asfgit closed pull request #1464: METRON-2179: Make navigation in both UIs consistent URL: https://github.com/apache/metron/pull/1464 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[jira] [Assigned] (METRON-2224) Upgrade Zeppelin
[ https://issues.apache.org/jira/browse/METRON-2224?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Miklavcic reassigned METRON-2224: - Assignee: Ryan Merriman (was: Michael Miklavcic) > Upgrade Zeppelin > > > Key: METRON-2224 > URL: https://issues.apache.org/jira/browse/METRON-2224 > Project: Metron > Issue Type: Sub-task >Reporter: Ryan Merriman >Assignee: Ryan Merriman >Priority: Major > Time Spent: 0.5h > Remaining Estimate: 0h > > We need to upgrade the Zeppelin dependency from 0.7.3 to 0.8.0. -- This message was sent by Atlassian Jira (v8.3.2#803003)
[jira] [Assigned] (METRON-2225) Upgrade Solr
[ https://issues.apache.org/jira/browse/METRON-2225?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Miklavcic reassigned METRON-2225: - Assignee: Ryan Merriman > Upgrade Solr > > > Key: METRON-2225 > URL: https://issues.apache.org/jira/browse/METRON-2225 > Project: Metron > Issue Type: Sub-task >Reporter: Ryan Merriman >Assignee: Ryan Merriman >Priority: Major > Time Spent: 1h 20m > Remaining Estimate: 0h > > We need to upgrade Solr from 6.6.2 to 7.4.0 -- This message was sent by Atlassian Jira (v8.3.2#803003)
[jira] [Assigned] (METRON-2225) Upgrade Solr
[ https://issues.apache.org/jira/browse/METRON-2225?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Miklavcic reassigned METRON-2225: - Assignee: Michael Miklavcic (was: Ryan Merriman) > Upgrade Solr > > > Key: METRON-2225 > URL: https://issues.apache.org/jira/browse/METRON-2225 > Project: Metron > Issue Type: Sub-task >Reporter: Ryan Merriman >Assignee: Michael Miklavcic >Priority: Major > Time Spent: 1h 20m > Remaining Estimate: 0h > > We need to upgrade Solr from 6.6.2 to 7.4.0 -- This message was sent by Atlassian Jira (v8.3.2#803003)
[jira] [Assigned] (METRON-2225) Upgrade Solr
[ https://issues.apache.org/jira/browse/METRON-2225?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Miklavcic reassigned METRON-2225: - Assignee: Ryan Merriman (was: Michael Miklavcic) > Upgrade Solr > > > Key: METRON-2225 > URL: https://issues.apache.org/jira/browse/METRON-2225 > Project: Metron > Issue Type: Sub-task >Reporter: Ryan Merriman >Assignee: Ryan Merriman >Priority: Major > Time Spent: 1h 20m > Remaining Estimate: 0h > > We need to upgrade Solr from 6.6.2 to 7.4.0 -- This message was sent by Atlassian Jira (v8.3.2#803003)
[GitHub] [metron] nickwallen commented on a change in pull request #1492: METRON-2225: Upgrade Solr
nickwallen commented on a change in pull request #1492: METRON-2225: Upgrade Solr URL: https://github.com/apache/metron/pull/1492#discussion_r317147985 ## File path: pom.xml ## @@ -154,6 +154,7 @@ 2.6.5.0 1.1.1 12.0 +7.4.0 Review comment: Ok. That makes sense being that the changes are not backwards compatible. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[GitHub] [metron] nickwallen commented on issue #1491: METRON-2224: Upgrade Zeppelin
nickwallen commented on issue #1491: METRON-2224: Upgrade Zeppelin URL: https://github.com/apache/metron/pull/1491#issuecomment-524326787 Oh just thought of one thing. We need to update the README so that any reference to 0.7.3 is replaced with 0.8.0. I will try and run this through some testing in Full Dev today. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[GitHub] [metron] mmiklavc commented on issue #1493: METRON-2227 - Increase Kafka test harness timeout
mmiklavc commented on issue #1493: METRON-2227 - Increase Kafka test harness timeout URL: https://github.com/apache/metron/pull/1493#issuecomment-524323428 +1 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[GitHub] [metron] mmiklavc commented on issue #1464: METRON-2179: Make navigation in both UIs consistent
mmiklavc commented on issue #1464: METRON-2179: Make navigation in both UIs consistent URL: https://github.com/apache/metron/pull/1464#issuecomment-524323213 Yes, I'm still +1. Good work @sardell This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[GitHub] [metron] sardell commented on issue #1464: METRON-2179: Make navigation in both UIs consistent
sardell commented on issue #1464: METRON-2179: Make navigation in both UIs consistent URL: https://github.com/apache/metron/pull/1464#issuecomment-524250311 @mmiklavc After clearing my browser's cache and testing again for quite a while, I'm unable to reproduce the bug mentioned previously. If you're still a +1, I'll merge this in. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[GitHub] [metron] anandsubbu commented on issue #1489: METRON-2221: Notebook import fails through Zeppelin REST API
anandsubbu commented on issue #1489: METRON-2221: Notebook import fails through Zeppelin REST API URL: https://github.com/apache/metron/pull/1489#issuecomment-524214597 Kickstart Travis. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[GitHub] [metron] anandsubbu opened a new pull request #1489: METRON-2221: Notebook import fails through Zeppelin REST API
anandsubbu opened a new pull request #1489: METRON-2221: Notebook import fails
through Zeppelin REST API
URL: https://github.com/apache/metron/pull/1489
## Contributor Comments
This PR modifies the zeppelin notebook import methods to use `curl` instead
of `python-requests`.
## Testing Steps
1. Spin up full dev
2. Add Zeppelin service
3. Import notebooks using Ambari -> Metron -> Service Actions -> Zeppelin
Notebook Import
All metron related zeppelin notebooks should be visible when you login to
the Zeppelin UI.
## Testing Done
* Verified on both full dev and multi-node cluster and found that zeppelin
notebooks are being imported properly.
## Pull Request Checklist
Thank you for submitting a contribution to Apache Metron.
Please refer to our [Development
Guidelines](https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=61332235)
for the complete guide to follow for contributions.
Please refer also to our [Build Verification
Guidelines](https://cwiki.apache.org/confluence/display/METRON/Verifying+Builds?show-miniview)
for complete smoke testing guides.
In order to streamline the review of the contribution we ask you follow
these guidelines and ask you to double check the following:
### For all changes:
- [x] Is there a JIRA ticket associated with this PR? If not one needs to be
created at [Metron
Jira](https://issues.apache.org/jira/browse/METRON/?selectedTab=com.atlassian.jira.jira-projects-plugin:summary-panel).
- [x] Does your PR title start with METRON- where is the JIRA
number you are trying to resolve? Pay particular attention to the hyphen "-"
character.
- [x] Has your PR been rebased against the latest commit within the target
branch (typically master)?
### For code changes:
- [x] Have you included steps to reproduce the behavior or problem that is
being changed or addressed?
- [x] Have you included steps or a guide to how the change may be verified
and tested manually?
- [ ] Have you ensured that the full suite of tests and checks have been
executed in the root metron folder via:
```
mvn -q clean integration-test install &&
dev-utilities/build-utils/verify_licenses.sh
```
- [ ] Have you written or updated unit tests and or integration tests to
verify your changes?
- [ ] If adding new dependencies to the code, are these dependencies
licensed in a way that is compatible for inclusion under [ASF
2.0](http://www.apache.org/legal/resolved.html#category-a)?
- [ ] Have you verified the basic functionality of the build by building and
running locally with Vagrant full-dev environment or the equivalent?
### For documentation related changes:
- [ ] Have you ensured that format looks appropriate for the output in which
it is rendered by building and verifying the site-book? If not then run the
following commands and the verify changes via
`site-book/target/site/index.html`:
```
cd site-book
mvn site
```
- [ ] Have you ensured that any documentation diagrams have been updated,
along with their source files, using [draw.io](https://www.draw.io/)? See
[Metron Development
Guidelines](https://cwiki.apache.org/confluence/display/METRON/Development+Guidelines)
for instructions.
Note:
Please ensure that once the PR is submitted, you check travis-ci for build
issues and submit an update to your PR as soon as possible.
It is also recommended that [travis-ci](https://travis-ci.org) is set up for
your personal repository such that your branches are built there before
submitting a pull request.
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
With regards,
Apache Git Services
[GitHub] [metron] anandsubbu closed pull request #1489: METRON-2221: Notebook import fails through Zeppelin REST API
anandsubbu closed pull request #1489: METRON-2221: Notebook import fails through Zeppelin REST API URL: https://github.com/apache/metron/pull/1489 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
