Taylor - Thanks for the info.
Yeah, it would be great if future storm releases look at supporting mixed cluster releases -- where nimbus and/or supervisors can operate with mixed patch release versions. That would greatly simply rolling a storm cluster to a new release. Cheers, Mike On Wed, Jun 25, 2014 at 7:27 PM, P. Taylor Goetz <[email protected]> wrote: > +dev@ > > Dependency conflicts can often be an issue when upgrading. Unfortunately > we have no way to predict dependencies of user code. But there are ways to > minimize it, so reports like this one are very useful (given a little more > information about dependency versions). > > Andrey, would you mind opening a JIRA ticket for this, and detail the > versions involved? > > Fixing this should just be a matter of shading Storm's Netty dependency. > > Mike, the safest way to upgrade, if possible, is to undeploy all > topologies, clear local state, and redeploy. Obviously it is critical to > test this out in a pre-prod environment. Another option is to do a "warm > swap" between clusters running different versions, but attached to the same > data source. You basically pause one, let it drain, and activate the other. > You would need the infrastructure to do this, however. > > A lot of it depends on your data source and whether or not it can reliably > handle pending messages during the upgrade. > > It should go without saying, but I'll say it anyway: Test a lot in as > close a facsimile of your prod environment as you can muster. And keep the > relationship between dev and ops something worthy of a Hallmark card. ;) > > There is a lot of interest in rolling upgrades for Storm as well. I'll > open up JIRA tickets for both so we can track and discuss. We should at > least provide some documentation, FAQ, etc. > > -Taylor > > On Jun 25, 2014, at 5:17 PM, Andrey Yegorov <[email protected]> > wrote : > > tried it; now getting NoSuchMethodError errors from netty/v.2.0 datastax's > driver for cassandra. > fwiw, I rebuilt topology with storm 0.9.2 as dependency. reverting back. > > java.lang.NoSuchMethodError: > org.jboss.netty.handler.codec.frame.LengthFieldBasedFrameDecoder.<init>(IIIIIZ)V > at com.datastax.driver.core.Frame$Decoder.<init>(Frame.java:130) at > com.datastax.driver.core.Connection$PipelineFactory.getPipeline(Connection.java:796) > at > org.jboss.netty.bootstrap.ClientBootstrap.connect(ClientBootstrap.java:212) > at > org.jboss.netty.bootstrap.ClientBootstrap.connect(ClientBootstrap.java:188) > at com.datastax.driver.core.Connection.<init>(Connection.java:93) at > com.datastax.driver.core.Connection$Factory.open(Connection.java:432) at > com.datastax.driver.core.ControlConnection.tryConnect(ControlConnection.java:215) > at > com.datastax.driver.core.ControlConnection.reconnectInternal(ControlConnection.java:170) > at > com.datastax.driver.core.ControlConnection.connect(ControlConnection.java:78) > at > > ---------- > Andrey Yegorov > > > On Wed, Jun 25, 2014 at 1:18 PM, Mike Heffner <[email protected]> wrote: > >> Are there upgrade instructions from previous storm versions to 0.9.2? >> >> >> On Wed, Jun 25, 2014 at 1:28 PM, P. Taylor Goetz <[email protected]> >> wrote: >> >>> The Storm team is pleased to announce the release of Apache Storm >>> version 0.9.2-incubating. This is our second Apache release. >>> >>> Storm is a distributed, fault-tolerant, and high-performance realtime >>> computation system that provides strong guarantees on the processing of >>> data. You can read more about Storm on the project website: >>> >>> http://storm.incubator.apache.org >>> >>> Downloads of source and binary distributions are listed in our download >>> section: >>> >>> http://storm.incubator.apache.org/downloads.html >>> >>> You can read more about this release in the following blog post: >>> >>> http://storm.incubator.apache.org/2014/06/25/storm092-released.html >>> >>> Distribution artifacts are available in Maven Central at the following >>> coordinates: >>> >>> groupId: org.apache.storm >>> artifactId: storm-core >>> version: 0.9.2-incubating >>> >>> The full list of changes is available here[1]. Please let us know [2] if >>> you encounter any problems. >>> >>> Regards, >>> >>> The Apache Storm Team >>> >>> [1]: >>> https://github.com/apache/incubator-storm/blob/v0.9.2-incubating/CHANGELOG.md >>> (CHANGELOG) >>> [2]: https://issues.apache.org/jira/browse/STORM >>> >> >> >> >> -- >> >> Mike Heffner <[email protected]> >> Librato, Inc. >> >> > -- Mike Heffner <[email protected]> Librato, Inc.
