Just ran https://raw.githubusercontent.com/apache/yetus/master/release-doc-maker/releasedocmaker.py against STORM.
It generates CHANGES and RELEASENOTES automatically. Do they look good? It is also possible to tailor the script for STORM as well. ~Haohui On Wed, Dec 2, 2015 at 5:03 PM, 임정택 <[email protected]> wrote: > Yeah, that would be good. > (Taylor, did you mean that we'd be better to move CHANGELOG.md to official > site?) > > If we decide to maintain it from asf-site branch, I think preconditions > should be met in order to let us feel more convenient than current. > > - Pushing to asf-site branch via git repo should update our official > site. > - Yaml files should be updated automatically. > - Because pushing to asf-site requires checking out asf-site branch, > modifying yaml files, and pushing to remote, and checking out > master branch > again. > > I'm curious we can resolve preconditions, at least first one. > Any updates on this, Taylor? > > Any other opinions are appreciated! > > - Jungtaek Lim (HeartSaVioR) > > ps. Btw, if we decide to scan jira issue and create CHANGELOG, how about > adding assignee to CHANGELOG so that anyone can see huge > contributors easily? > > 2015-12-03 9:35 GMT+09:00 P. Taylor Goetz <[email protected]>: > >> IMHO we should take that out of the readme, and maintain it as part of the >> website. Better yet, automate it as haohui suggested. >> >> In the website branch in git we now have a yaml file that contains all >> that information. I'd rather maintain it there, in one place, and automate >> if we can. >> >> -Taylor >> >> > On Dec 2, 2015, at 6:06 PM, 임정택 <[email protected]> wrote: >> > >> > Hi all, >> > >> > Apache Storm project maintains committer / contributor list to >> > README.markdown >> > <https://github.com/apache/storm/blob/master/README.markdown> and >> resolved >> > JIRA issues to CHANGELOG.md >> > <https://github.com/apache/storm/blob/master/CHANGELOG.md>. >> > And recently we're adding the page "People" to official web site, >> > http://storm.apache.org/contribute/People.html, which seems not be >> updated >> > already. >> > >> > Since we occasionally missed to add those things, it would be better to >> > have more convenient way to record. >> > For now updating "People" seems annoying since we should update site via >> > applying patch and committing to SVN repo. >> > Do we feel that is it convenient to maintain these to git repo? Are there >> > more convenient ways to maintain? Could WIKI be more convenient way? >> > >> > Thanks, >> > Jungtaek Lim (HeartSaVioR) >> > > > > -- > Name : 임 정택 > Blog : http://www.heartsavior.net / http://dev.heartsavior.net > Twitter : http://twitter.com/heartsavior > LinkedIn : http://www.linkedin.com/in/heartsavior
<!--- # Licensed to the Apache Software Foundation (ASF) under one # or more contributor license agreements. See the NOTICE file # distributed with this work for additional information # regarding copyright ownership. The ASF licenses this file # to you under the Apache License, Version 2.0 (the # "License"); you may not use this file except in compliance # with the License. You may obtain a copy of the License at # # http://www.apache.org/licenses/LICENSE-2.0 # # Unless required by applicable law or agreed to in writing, software # distributed under the License is distributed on an "AS IS" BASIS, # WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. # See the License for the specific language governing permissions and # limitations under the License. --> # STORM Changelog ## Release 0.11.0 - Unreleased (as of 2015-12-07) ### INCOMPATIBLE CHANGES: | JIRA | Summary | Priority | Component | Reporter | Contributor | |:---- |:---- | :--- |:---- |:---- |:---- | ### IMPORTANT ISSUES: | JIRA | Summary | Priority | Component | Reporter | Contributor | |:---- |:---- | :--- |:---- |:---- |:---- | | [STORM-1189](https://issues.apache.org/jira/browse/STORM-1189) | client.getClusterInfo() fails with Required field 'nimbus\_uptime\_secs' is unset! | Major | storm-core | Michael Sonst | Robert Joseph Evans | | [STORM-1106](https://issues.apache.org/jira/browse/STORM-1106) | Netty Client Connection Attempts should not be limited | Blocker | storm-core | Kishor Patil | Kishor Patil | ### NEW FEATURES: | JIRA | Summary | Priority | Component | Reporter | Contributor | |:---- |:---- | :--- |:---- |:---- |:---- | | [STORM-1127](https://issues.apache.org/jira/browse/STORM-1127) | Allow a Boolean value in a constructorArgs list (Flux) | Minor | Flux | Chuck Burgess | Chuck Burgess | | [STORM-1126](https://issues.apache.org/jira/browse/STORM-1126) | Allow a configMethod that takes no arguments (Flux) | Minor | Flux | Chuck Burgess | Chuck Burgess | | [STORM-1098](https://issues.apache.org/jira/browse/STORM-1098) | Storm Nimbus Hook | Major | storm-core | Sriharsha Chintalapani | Parth Brahmbhatt | | [STORM-1007](https://issues.apache.org/jira/browse/STORM-1007) | Add more metrics to DisruptorQueue | Major | storm-core | Li Wang | Li Wang | | [STORM-902](https://issues.apache.org/jira/browse/STORM-902) | Simple Log Search | Major | storm-core | Robert Joseph Evans | Zhuo Liu | | [STORM-901](https://issues.apache.org/jira/browse/STORM-901) | Worker Artifacts Directory | Major | storm-core | Robert Joseph Evans | Zhuo Liu | | [STORM-894](https://issues.apache.org/jira/browse/STORM-894) | Basic Resource Aware Scheduling | Major | storm-core | Robert Joseph Evans | Boyang Jerry Peng | | [STORM-862](https://issues.apache.org/jira/browse/STORM-862) | Pluggable System Metrics | Major | storm-core | Robert Joseph Evans | Robert Joseph Evans | | [STORM-845](https://issues.apache.org/jira/browse/STORM-845) | Storm ElasticSearch connector | Major | storm-elasticsearch | Adrian Seungjin Lee | Adrian Seungjin Lee | | [STORM-166](https://issues.apache.org/jira/browse/STORM-166) | Highly available Nimbus | Minor | storm-core | James Xu | Parth Brahmbhatt | | [STORM-160](https://issues.apache.org/jira/browse/STORM-160) | Allow ShellBolt to set env vars (particularly PATH) | Minor | storm-multilang | James Xu | Shyam Rajendran | | [STORM-126](https://issues.apache.org/jira/browse/STORM-126) | Add Lifecycle support API for worker nodes | Minor | storm-core | James Xu | Michael Schonfeld | | [STORM-67](https://issues.apache.org/jira/browse/STORM-67) | Provide API for spouts to know how many pending messages there are | Major | storm-core | James Xu | Shyam Rajendran | ### IMPROVEMENTS: | JIRA | Summary | Priority | Component | Reporter | Contributor | |:---- |:---- | :--- |:---- |:---- |:---- | | [STORM-1364](https://issues.apache.org/jira/browse/STORM-1364) | Log storm version on daemon start | Minor | storm-core | Derek Dagit | Derek Dagit | | [STORM-1341](https://issues.apache.org/jira/browse/STORM-1341) | Better to have multilang subprocess timeout, not relying on supervisor worker timeout | Minor | storm-multilang | Jungtaek Lim | Jungtaek Lim | | [STORM-1215](https://issues.apache.org/jira/browse/STORM-1215) | Use Async Loggers to avoid locking and logging overhead | Major | storm-core | Kishor Patil | Kishor Patil | | [STORM-1196](https://issues.apache.org/jira/browse/STORM-1196) | Upgrade to thrift 0.9.3 | Major | . | Kyle Nusbaum | Kyle Nusbaum | | [STORM-1182](https://issues.apache.org/jira/browse/STORM-1182) | Removing and wrapping some exceptions in ConfigValidation | Minor | . | Boyang Jerry Peng | Boyang Jerry Peng | | [STORM-1165](https://issues.apache.org/jira/browse/STORM-1165) | normalize the scales of CPU/Mem/Net when choosing the best node for Resource Aware Scheduler | Major | . | Boyang Jerry Peng | Boyang Jerry Peng | | [STORM-1158](https://issues.apache.org/jira/browse/STORM-1158) | Storm metrics to profile various storm functions | Major | . | Boyang Jerry Peng | Boyang Jerry Peng | | [STORM-1157](https://issues.apache.org/jira/browse/STORM-1157) | Dynamic Worker Profiler - jmap, jstack, profiling and restarting worker | Major | storm-core | Kishor Patil | Kishor Patil | | [STORM-1155](https://issues.apache.org/jira/browse/STORM-1155) | Supervisor recurring health checks | Major | storm-core | Thomas Graves | Thomas Graves | | [STORM-1154](https://issues.apache.org/jira/browse/STORM-1154) | SequenceFileBolt needs unit tests | Minor | storm-hdfs | Aaron Dossett | Aaron Dossett | | [STORM-1153](https://issues.apache.org/jira/browse/STORM-1153) | Use static final instead of just static for class members | Minor | storm-core | Suresh Srinivas | Suresh Srinivas | | [STORM-1152](https://issues.apache.org/jira/browse/STORM-1152) | Change map keySet iteration to entrySet iteration for efficiency | Minor | storm-core | Suresh Srinivas | Suresh Srinivas | | [STORM-1151](https://issues.apache.org/jira/browse/STORM-1151) | Add batching to disruptor | Major | . | Robert Joseph Evans | Robert Joseph Evans | | [STORM-1145](https://issues.apache.org/jira/browse/STORM-1145) | Have the IConnection push batches instead of buffering them | Major | storm-core | Robert Joseph Evans | Robert Joseph Evans | | [STORM-1144](https://issues.apache.org/jira/browse/STORM-1144) | Display requested and assigned cpu/mem resources for schedulers in UI | Major | storm-core | Zhuo Liu | Zhuo Liu | | [STORM-1143](https://issues.apache.org/jira/browse/STORM-1143) | Validate topology Configs during topology submission | Minor | . | Boyang Jerry Peng | Boyang Jerry Peng | | [STORM-1138](https://issues.apache.org/jira/browse/STORM-1138) | Storm-hdfs README should be updated with Avro Bolt information | Minor | storm-hdfs | Aaron Dossett | Aaron Dossett | | [STORM-1128](https://issues.apache.org/jira/browse/STORM-1128) | Make Stats+metrics fast | Major | storm-core | Robert Joseph Evans | Robert Joseph Evans | | [STORM-1125](https://issues.apache.org/jira/browse/STORM-1125) | Separate ZK Write Client for Nimbus | Major | storm-core | Kishor Patil | Kishor Patil | | [STORM-1123](https://issues.apache.org/jira/browse/STORM-1123) | TupleImpl - Unnecessary variable initialization | Trivial | storm-core | Rick Kellogg | | | [STORM-1122](https://issues.apache.org/jira/browse/STORM-1122) | Fix the format issue in Utils.java | Minor | storm-core | Zhuo Liu | Zhuo Liu | | [STORM-1118](https://issues.apache.org/jira/browse/STORM-1118) | Add Test for latency vs throughput | Major | storm-core | Robert Joseph Evans | Robert Joseph Evans | | [STORM-1112](https://issues.apache.org/jira/browse/STORM-1112) | Add executor id to the thread name of the executor thread for debug | Minor | storm-core | Zhuo Liu | Zhuo Liu | | [STORM-1102](https://issues.apache.org/jira/browse/STORM-1102) | HiveBolt should have a default flush interval | Minor | storm-hive | Aaron Dossett | Aaron Dossett | | [STORM-1095](https://issues.apache.org/jira/browse/STORM-1095) | Tuple.getSourceGlobalStreamid() has wrong camel-case naming | Trivial | storm-core | Matthias J. Sax | Matthias J. Sax | | [STORM-1084](https://issues.apache.org/jira/browse/STORM-1084) | Improve Storm config validation process to use java annotations instead of \*\_SCHEMA format | Major | storm-core | Boyang Jerry Peng | Boyang Jerry Peng | | [STORM-1083](https://issues.apache.org/jira/browse/STORM-1083) | Run maven in batch mode to avoid excessive loggin in travis CI | Minor | storm-core | Haohui Mai | Haohui Mai | | [STORM-1082](https://issues.apache.org/jira/browse/STORM-1082) | Fix the property parameters used in Kafka tests | Minor | storm-kafka | Zhuo Liu | Zhuo Liu | | [STORM-1079](https://issues.apache.org/jira/browse/STORM-1079) | Batch Puts to HBase | Major | storm-hbase | Sriharsha Chintalapani | Sriharsha Chintalapani | | [STORM-1075](https://issues.apache.org/jira/browse/STORM-1075) | Storm Cassandra connector | Major | storm-core | Sriharsha Chintalapani | Florian Hussonnois | | [STORM-1074](https://issues.apache.org/jira/browse/STORM-1074) | Storm should include a bolt that writes Avro data to HDFS | Minor | storm-hdfs | Aaron Dossett | Aaron Dossett | | [STORM-1058](https://issues.apache.org/jira/browse/STORM-1058) | create CLI kill\_workers to kill workers on a supervisor node | Major | storm-core | Zhuo Liu | Zhuo Liu | | [STORM-1032](https://issues.apache.org/jira/browse/STORM-1032) | Add generics to component configuration methods | Minor | storm-core | Dean de Bree | Dean de Bree | | [STORM-1019](https://issues.apache.org/jira/browse/STORM-1019) | Added missing dependency version to use of org.codehaus.mojo:make-maven-plugin | Minor | storm-core | Rick Kellogg | Rick Kellogg | | [STORM-1016](https://issues.apache.org/jira/browse/STORM-1016) | Generate trident bolt ids with sorted group names | Major | storm-core | Jiasheng Wang | Jiasheng Wang | | [STORM-1013](https://issues.apache.org/jira/browse/STORM-1013) | [storm-elasticsearch] Expose TransportClient configuration Map to EsConfig | Minor | storm-elasticsearch | Jungtaek Lim | Alex Panov | | [STORM-1010](https://issues.apache.org/jira/browse/STORM-1010) | Each KafkaBolt could have a specified properties. | Minor | storm-kafka | Renkai Ge | Renkai Ge | | [STORM-1003](https://issues.apache.org/jira/browse/STORM-1003) | In cluster.clj replace task-id with component-id in the declaration | Minor | storm-core | Sanket Reddy | Sanket Reddy | | [STORM-1000](https://issues.apache.org/jira/browse/STORM-1000) | Use static member classes when permitted | Minor | storm-core | Yvonne Ironberg | Yvonne Ironberg | | [STORM-993](https://issues.apache.org/jira/browse/STORM-993) | Add uptime in seconds to UI REST API | Minor | storm-core | Derek Dagit | Derek Dagit | | [STORM-991](https://issues.apache.org/jira/browse/STORM-991) | General cleanup of the generics (storm.trident.spout package) | Minor | storm-core | Dean de Bree | Dean de Bree | | [STORM-990](https://issues.apache.org/jira/browse/STORM-990) | Refactored TimeCacheMap to extend RotatingMap | Minor | storm-core | Dean de Bree | Dean de Bree | | [STORM-978](https://issues.apache.org/jira/browse/STORM-978) | [storm-elasticsearch] Introduces Lookup(or Query)Bolt which emits matched documents from ES | Major | storm-elasticsearch | Jungtaek Lim | Alex Panov | | [STORM-975](https://issues.apache.org/jira/browse/STORM-975) | Storm-Kafka trident topology example | Major | storm-kafka | Arun Mahadevan | Arun Mahadevan | | [STORM-974](https://issues.apache.org/jira/browse/STORM-974) | [storm-elasticsearch] Introduces Tuple -\> ES document mapper to get rid of constant field mapping (source, index, type) | Major | storm-elasticsearch | Jungtaek Lim | Jungtaek Lim | | [STORM-969](https://issues.apache.org/jira/browse/STORM-969) | HDFS Bolt can end up in an unrecoverable state | Major | storm-hdfs | Aaron Dossett | Aaron Dossett | | [STORM-968](https://issues.apache.org/jira/browse/STORM-968) | Display the stream id in the Trident UI for the Spouts | Minor | storm-core | Nikhil Singh | Nikhil Singh | | [STORM-964](https://issues.apache.org/jira/browse/STORM-964) | Add config (with small default value) for logwriter to restrict its memory usage | Minor | storm-core | Zhuo Liu | Zhuo Liu | | [STORM-960](https://issues.apache.org/jira/browse/STORM-960) | Hive-Bolt can lose tuples when flushing data | Minor | storm-hive | Aaron Dossett | Aaron Dossett | | [STORM-958](https://issues.apache.org/jira/browse/STORM-958) | Add config for init params of group mapping service | Minor | storm-core | Derek Dagit | Derek Dagit | | [STORM-954](https://issues.apache.org/jira/browse/STORM-954) | Toplogy Event Inspector | Major | storm-core | Sriharsha Chintalapani | Arun Mahadevan | | [STORM-949](https://issues.apache.org/jira/browse/STORM-949) | On the topology summary UI page, last shown error should have the time and date | Minor | storm-core | Reza Farivar | Boyang Jerry Peng | | [STORM-943](https://issues.apache.org/jira/browse/STORM-943) | In TestHiveBolt make the collector mock slightly more precise | Trivial | storm-hive | Aaron Dossett | Aaron Dossett | | [STORM-942](https://issues.apache.org/jira/browse/STORM-942) | Add FluxParser method parseInputStream() to eliminate disk usage. | Major | Flux | Brendan W Lyon | Brendan W Lyon | | [STORM-938](https://issues.apache.org/jira/browse/STORM-938) | storm-hive add a time interval to flush tuples to hive | Major | storm-hive | Sriharsha Chintalapani | Aaron Dossett | | [STORM-937](https://issues.apache.org/jira/browse/STORM-937) | StormBoundedExponentialBackoffRetry too noisy, lower log level | Minor | storm-core | Reza Farivar | Reza Farivar | | [STORM-931](https://issues.apache.org/jira/browse/STORM-931) | Python Scritps to Produce Formatted JIRA and GitHub Joint Reports | Major | storm-core | Hugo Louro | Hugo Louro | | [STORM-926](https://issues.apache.org/jira/browse/STORM-926) | change pom to use maven-shade-plugin:2.2 and minimize the size of shade jar and fix duplicated classes warnings of flue-examples | Minor | storm-core | caofangkun | caofangkun | | [STORM-924](https://issues.apache.org/jira/browse/STORM-924) | Set the file mode of the files included when packaging release packages | Minor | storm-core | caofangkun | caofangkun | | [STORM-918](https://issues.apache.org/jira/browse/STORM-918) | Storm CLI could validate arguments/print usage | Minor | storm-core | Derek Dagit | Shyam Rajendran | | [STORM-913](https://issues.apache.org/jira/browse/STORM-913) | Use Curator's delete().deletingChildrenIfNeeded() instead of zk/delete-recursive | Minor | storm-core | caofangkun | caofangkun | | [STORM-886](https://issues.apache.org/jira/browse/STORM-886) | Automatic Back Pressure | Major | storm-core | Robert Joseph Evans | Zhuo Liu | | [STORM-885](https://issues.apache.org/jira/browse/STORM-885) | Heartbeat Server (Pacemaker) | Major | storm-core | Robert Joseph Evans | Kyle Nusbaum | | [STORM-876](https://issues.apache.org/jira/browse/STORM-876) | Dist Cache: Basic Functionality | Major | storm-core | Robert Joseph Evans | Sanket Chintapalli | | [STORM-859](https://issues.apache.org/jira/browse/STORM-859) | Add unit test to prevent regression of STORM-856 | Major | storm-core | Jungtaek Lim | Jungtaek Lim | | [STORM-854](https://issues.apache.org/jira/browse/STORM-854) | [Storm-Kafka] KafkaSpout can set the topic name as the output streamid | Major | storm-kafka | zhiwei | Rohan Agarwal | | [STORM-851](https://issues.apache.org/jira/browse/STORM-851) | Storm Solr connector | Major | storm-solr | Sriharsha Chintalapani | Hugo Louro | | [STORM-847](https://issues.apache.org/jira/browse/STORM-847) | Add cli to get the last storm error from the topology | Minor | storm-core | Nikhil Singh | Nikhil Singh | | [STORM-820](https://issues.apache.org/jira/browse/STORM-820) | UI Topology & Component Pages have long load times with large, highly-connected Topologies | Major | storm-core | Derek Dagit | Derek Dagit | | [STORM-806](https://issues.apache.org/jira/browse/STORM-806) | use storm.zookeeper.connection.timeout in storm-kafka ZkState when newCurator | Major | storm-kafka | xiajun | xiajun | | [STORM-799](https://issues.apache.org/jira/browse/STORM-799) | Consolidate IErrorReporter and reportError methods | Minor | storm-core | Simon Cooper | Aaron Dossett | | [STORM-756](https://issues.apache.org/jira/browse/STORM-756) | [multilang] Introduce overflow control mechanism | Major | storm-multilang | Jungtaek Lim | Jungtaek Lim | | [STORM-697](https://issues.apache.org/jira/browse/STORM-697) | Support for Emitting Kafka Message Offset and Partition | Major | storm-kafka | Matthew Tieman | Matthew Tieman | | [STORM-412](https://issues.apache.org/jira/browse/STORM-412) | Allow users to modify logging levels of running topologies. | Major | storm-core | Robert Joseph Evans | Kishor Patil | ### BUG FIXES: | JIRA | Summary | Priority | Component | Reporter | Contributor | |:---- |:---- | :--- |:---- |:---- |:---- | | [STORM-1375](https://issues.apache.org/jira/browse/STORM-1375) | Blobstore broke Pacemaker | Critical | storm-core | Michael Schonfeld | Ilya Ostrovskiy | | [STORM-1361](https://issues.apache.org/jira/browse/STORM-1361) | Apache License missing from two Cassandra files | Minor | . | Chuck Burgess | Chuck Burgess | | [STORM-1349](https://issues.apache.org/jira/browse/STORM-1349) | [Flux] Allow constructorArgs to take Maps as arguments | Major | Flux | P. Taylor Goetz | | | [STORM-1221](https://issues.apache.org/jira/browse/STORM-1221) | Create a common interface for all Trident spout | Major | . | Haohui Mai | Haohui Mai | | [STORM-1220](https://issues.apache.org/jira/browse/STORM-1220) | Avoid double copying in the Kafka spout | Major | . | Haohui Mai | Haohui Mai | | [STORM-1217](https://issues.apache.org/jira/browse/STORM-1217) | making small fixes in RAS | Minor | storm-core | Boyang Jerry Peng | Boyang Jerry Peng | | [STORM-1213](https://issues.apache.org/jira/browse/STORM-1213) | Remove sigar binaries from source tree | Major | . | P. Taylor Goetz | P. Taylor Goetz | | [STORM-1208](https://issues.apache.org/jira/browse/STORM-1208) | UI: NPE seen when aggregating bolt streams stats | Major | storm-core | Derek Dagit | Derek Dagit | | [STORM-1204](https://issues.apache.org/jira/browse/STORM-1204) | Logviewer should graceful report page-not-found instead of 500 for bad topo-id etc | Major | storm-core | Kishor Patil | Kishor Patil | | [STORM-1203](https://issues.apache.org/jira/browse/STORM-1203) | worker metadata file creation doesn't use storm.log.dir config | Major | . | Sriharsha Chintalapani | Sriharsha Chintalapani | | [STORM-1191](https://issues.apache.org/jira/browse/STORM-1191) | Random test failures on backtype.storm.transactional-test | Minor | . | Chuck Burgess | Chuck Burgess | | [STORM-1190](https://issues.apache.org/jira/browse/STORM-1190) | System load spikes in recent snapshot | Critical | storm-core | Michael Schonfeld | Robert Joseph Evans | | [STORM-1185](https://issues.apache.org/jira/browse/STORM-1185) | Update storm.yaml with HA configuration | Minor | . | Xin Wang | Xin Wang | | [STORM-1180](https://issues.apache.org/jira/browse/STORM-1180) | FLUX logo wasn't appearing quite right | Trivial | . | Chuck Burgess | Chuck Burgess | | [STORM-1177](https://issues.apache.org/jira/browse/STORM-1177) | Build fails because DISCLAIMER file is missing | Major | storm-core | Michael Schonfeld | | | [STORM-1170](https://issues.apache.org/jira/browse/STORM-1170) | Consistent Unit Test failure in Travis in backtype.storm.utils.DisruptorQueueTest | Minor | . | Boyang Jerry Peng | Zhuo Liu | | [STORM-1168](https://issues.apache.org/jira/browse/STORM-1168) | worker-launcher logs noisy messages when visiting files | Minor | storm-core | Derek Dagit | Derek Dagit | | [STORM-1163](https://issues.apache.org/jira/browse/STORM-1163) | supervisor try-cleanup-worker should use rmr on the worker-root dir | Major | storm-core | Thomas Graves | Zhuo Liu | | [STORM-1161](https://issues.apache.org/jira/browse/STORM-1161) | Several source files lack an Apache License | Major | . | Aaron Dossett | Aaron Dossett | | [STORM-1148](https://issues.apache.org/jira/browse/STORM-1148) | Storm.py - References to storm.incubator.apache.org | Trivial | storm-core | Rick Kellogg | Julien Nioche | | [STORM-1142](https://issues.apache.org/jira/browse/STORM-1142) | Some config validators for positive ints need to allow 0 | Major | storm-core | Boyang Jerry Peng | Boyang Jerry Peng | | [STORM-1134](https://issues.apache.org/jira/browse/STORM-1134) | Windows: Fix log4j config. | Major | . | Sriharsha Chintalapani | Sriharsha Chintalapani | | [STORM-1121](https://issues.apache.org/jira/browse/STORM-1121) | Improve Nimbus Topology submission time | Major | storm-core | Kishor Patil | Kishor Patil | | [STORM-1120](https://issues.apache.org/jira/browse/STORM-1120) | main-routes in backtype.storm.ui.core uses wrong keyword - schema | Major | storm-core | Jungtaek Lim | Jungtaek Lim | | [STORM-1117](https://issues.apache.org/jira/browse/STORM-1117) | Show Visualization broken : Missing visualization-init route in UI | Minor | storm-core | Shyam Rajendran | Derek Dagit | | [STORM-1115](https://issues.apache.org/jira/browse/STORM-1115) | Stale leader-lock key effectively bans all nodes from becoming leaders | Major | storm-core | Daniel Schonfeld | Daniel Schonfeld | | [STORM-1111](https://issues.apache.org/jira/browse/STORM-1111) | Fix Validation for lots of different configs | Major | storm-core | Robert Joseph Evans | Boyang Jerry Peng | | [STORM-1110](https://issues.apache.org/jira/browse/STORM-1110) | System Components Page is not available | Major | storm-core | Kishor Patil | Kishor Patil | | [STORM-1104](https://issues.apache.org/jira/browse/STORM-1104) | Nimbus HA fails to find newly downloaded code files | Major | storm-core | Michael Schonfeld | Michael Schonfeld | | [STORM-1103](https://issues.apache.org/jira/browse/STORM-1103) | Utils#getConfigFileInputStream can print INFO level logs each time it is called | Minor | storm-core | Derek Dagit | Derek Dagit | | [STORM-1090](https://issues.apache.org/jira/browse/STORM-1090) | Nimbus HA should support `storm.local.hostname` | Major | storm-core | Michael Schonfeld | Michael Schonfeld | | [STORM-1087](https://issues.apache.org/jira/browse/STORM-1087) | Auto Backpressure can be stuck off for a worker | Major | storm-core | Robert Joseph Evans | Robert Joseph Evans | | [STORM-1078](https://issues.apache.org/jira/browse/STORM-1078) | RateTracker.java is not thread safe | Major | storm-core | Robert Joseph Evans | Robert Joseph Evans | | [STORM-1073](https://issues.apache.org/jira/browse/STORM-1073) | SequenceFileBolt can end up in an unrecoverable state | Major | storm-hdfs | Aaron Dossett | Aaron Dossett | | [STORM-1069](https://issues.apache.org/jira/browse/STORM-1069) | Usage of System.currentTimeMillis() in KafkaSpout can create delays | Trivial | storm-kafka | Dmytro Dragan | Dmytro Dragan | | [STORM-1063](https://issues.apache.org/jira/browse/STORM-1063) | Workers cannot find log4j configuration files since default value of storm.log4j2.conf.dir is relative | Major | storm-core | Jungtaek Lim | Zhuo Liu | | [STORM-1054](https://issues.apache.org/jira/browse/STORM-1054) | Excessive logging ShellBasedGroupsMapping if the user doesn't have any groups. | Trivial | storm-core | Sriharsha Chintalapani | Sriharsha Chintalapani | | [STORM-1042](https://issues.apache.org/jira/browse/STORM-1042) | clj-time.local compilation error | Critical | storm-core | Michael Gaare | Robert Joseph Evans | | [STORM-1017](https://issues.apache.org/jira/browse/STORM-1017) | If ignoreZkOffsets set true,KafkaSpout will reset zk offset when recover from failure. | Major | storm-kafka | Renkai Ge | Priyank Shah | | [STORM-1012](https://issues.apache.org/jira/browse/STORM-1012) | Shade Jackson dependency | Major | storm-core | Parth Brahmbhatt | Robert Joseph Evans | | [STORM-1011](https://issues.apache.org/jira/browse/STORM-1011) | HBaseBolt default mapper should handle null values | Major | storm-hbase | Parth Brahmbhatt | Parth Brahmbhatt | | [STORM-988](https://issues.apache.org/jira/browse/STORM-988) | supervisor.slots.ports should not allow duplicate element values | Trivial | storm-core | caofangkun | caofangkun | | [STORM-977](https://issues.apache.org/jira/browse/STORM-977) | Incorrect signal (-9) when as-user is true | Trivial | storm-core | Derek Dagit | Gabor Liptak | | [STORM-976](https://issues.apache.org/jira/browse/STORM-976) | Config storm.logback.conf.dir is specific to previous logging framework | Minor | storm-core | Derek Dagit | Yvonne Ironberg | | [STORM-967](https://issues.apache.org/jira/browse/STORM-967) | Unable to package storm-kafka & storm-hdfs connectors in a topology | Critical | storm-hdfs, storm-kafka | Sriharsha Chintalapani | Robert Joseph Evans | | [STORM-965](https://issues.apache.org/jira/browse/STORM-965) | excessive logging in storm when non-kerberos client tries to connect. | Major | storm-core | Sriharsha Chintalapani | Priyank Shah | | [STORM-951](https://issues.apache.org/jira/browse/STORM-951) | Storm Hive connector leaking connections | Critical | storm-hive | Sriharsha Chintalapani | Sriharsha Chintalapani | | [STORM-922](https://issues.apache.org/jira/browse/STORM-922) | Storm-Core Dependencies Renamed in Shade JAR | Major | storm-core | Brian Ghigiarelli | Robert Joseph Evans | | [STORM-874](https://issues.apache.org/jira/browse/STORM-874) | Netty Threads do not handle Errors properly | Major | storm-core | Kishor Patil | Kishor Patil | | [STORM-837](https://issues.apache.org/jira/browse/STORM-837) | HdfsState ignores commits | Critical | storm-hdfs | Robert Joseph Evans | Arun Mahadevan | | [STORM-809](https://issues.apache.org/jira/browse/STORM-809) | topology.message.timeout.secs should not allow for null or \<= 0 values | Major | storm-core | Robert Joseph Evans | Robert Joseph Evans | | [STORM-794](https://issues.apache.org/jira/browse/STORM-794) | Trident Topology with some situation seems not handle deactivate during graceful shutdown | Major | storm-core | Jungtaek Lim | Jungtaek Lim | | [STORM-751](https://issues.apache.org/jira/browse/STORM-751) | Move javadoc aggregate to site phase. | Critical | storm-hbase | Ashish Singh | Ashish Singh | | [STORM-566](https://issues.apache.org/jira/browse/STORM-566) | Unexpected trident spout metadata serialization | Major | storm-core | Daniel Schonfeld | Joshua Martell | | [STORM-477](https://issues.apache.org/jira/browse/STORM-477) | Incorrectly set JAVA\_HOME is not detected | Minor | storm-core | Paul Poulosky | Paul Poulosky | ### TESTS: | JIRA | Summary | Priority | Component | Reporter | Contributor | |:---- |:---- | :--- |:---- |:---- |:---- | | [STORM-1091](https://issues.apache.org/jira/browse/STORM-1091) | Add unit test for tick tuples to HiveBolt and HdfsBolt | Minor | storm-hdfs, storm-hive | Aaron Dossett | Aaron Dossett | | [STORM-1068](https://issues.apache.org/jira/browse/STORM-1068) | Configure request.required.acks to be 1 in KafkaUtilsTest for sync | Minor | storm-kafka | Zhuo Liu | Zhuo Liu | | [STORM-921](https://issues.apache.org/jira/browse/STORM-921) | Create unit tests for worker-worker netty authentication. | Major | storm-core | Zhuo Liu | Zhuo Liu | ### SUB-TASKS: | JIRA | Summary | Priority | Component | Reporter | Contributor | |:---- |:---- | :--- |:---- |:---- |:---- | | [STORM-1207](https://issues.apache.org/jira/browse/STORM-1207) | Add flux support for handling windowed bolts | Major | . | Arun Mahadevan | Arun Mahadevan | | [STORM-1029](https://issues.apache.org/jira/browse/STORM-1029) | Finalize default sampling pct and fields to log | Major | storm-core | Arun Mahadevan | Arun Mahadevan | | [STORM-1008](https://issues.apache.org/jira/browse/STORM-1008) | Isolate the code for metric collection and retrieval from the DisruptorQueue | Major | storm-core | Li Wang | Li Wang | | [STORM-1004](https://issues.apache.org/jira/browse/STORM-1004) | Option to specifiy a sampling rate for event inspector | Major | storm-core | Arun Mahadevan | Arun Mahadevan | | [STORM-980](https://issues.apache.org/jira/browse/STORM-980) | Re-include storm-kafka tests from Travis CI build | Major | storm-kafka | Jungtaek Lim | Jungtaek Lim | | [STORM-864](https://issues.apache.org/jira/browse/STORM-864) | Exclude storm-kafka tests from Travis CI build | Minor | storm-kafka | Jungtaek Lim | Jungtaek Lim | | [STORM-726](https://issues.apache.org/jira/browse/STORM-726) | Adding nimbus.host config for backward compatibility of client config | Major | storm-core | Parth Brahmbhatt | Parth Brahmbhatt | | [STORM-655](https://issues.apache.org/jira/browse/STORM-655) | Ad replication count as part of topology summary. | Major | storm-core | Parth Brahmbhatt | Parth Brahmbhatt | | [STORM-654](https://issues.apache.org/jira/browse/STORM-654) | Create a thrift API to discover nimbus so all the clients are not forced to contact zookeeper. | Major | storm-core | Parth Brahmbhatt | Parth Brahmbhatt | ### OTHER: | JIRA | Summary | Priority | Component | Reporter | Contributor | |:---- |:---- | :--- |:---- |:---- |:---- | | [STORM-1198](https://issues.apache.org/jira/browse/STORM-1198) | Web UI to show resource usages and Total Resources on all supervisors | Minor | storm-core | Zhuo Liu | Zhuo Liu | | [STORM-1119](https://issues.apache.org/jira/browse/STORM-1119) | Create access logging for all daemons | Minor | storm-core | Sanket Reddy | Sanket Reddy | | [STORM-1093](https://issues.apache.org/jira/browse/STORM-1093) | Launching Workers with resources specified in resource-aware schedulers | Major | storm-core | Zhuo Liu | Zhuo Liu | | [STORM-1059](https://issues.apache.org/jira/browse/STORM-1059) | Upgrade Storm to use Clojure 1.7.0 | Minor | storm-core | Kyle Nusbaum | Kyle Nusbaum | | [STORM-1053](https://issues.apache.org/jira/browse/STORM-1053) | Correct storm-kafka readme file because of using new kafka-producer api | Minor | storm-kafka | Xin Wang | Xin Wang | | [STORM-1025](https://issues.apache.org/jira/browse/STORM-1025) | Invalid links at https://storm.apache.org/about/multi-language.html | Trivial | documentation | Aaron Coburn | Aaron Coburn | | [STORM-1020](https://issues.apache.org/jira/browse/STORM-1020) | Document exceptions in ITuple & Fields | Minor | documentation | Rick Kellogg | Rick Kellogg | | [STORM-934](https://issues.apache.org/jira/browse/STORM-934) | The current doc for topology ackers is outdated | Minor | documentation | Zhuo Liu | Zhuo Liu | | [STORM-831](https://issues.apache.org/jira/browse/STORM-831) | Add Jira and Central Logging URL to UI | Trivial | documentation | Kishor Patil | Kishor Patil | | [STORM-826](https://issues.apache.org/jira/browse/STORM-826) | As a storm developer I’d like to use the new kafka producer API to reduce dependencies and use long term supported kafka apis | Major | storm-kafka | Thomas Becker | Zhuo Liu | | [STORM-795](https://issues.apache.org/jira/browse/STORM-795) | To document the extlib directories and env variable changes for users to know | Major | documentation | Zhuo Liu | Zhuo Liu | | [STORM-162](https://issues.apache.org/jira/browse/STORM-162) | Load Balancing Shuffle Grouping | Minor | storm-core | James Xu | Robert Joseph Evans |
<!--- # Licensed to the Apache Software Foundation (ASF) under one # or more contributor license agreements. See the NOTICE file # distributed with this work for additional information # regarding copyright ownership. The ASF licenses this file # to you under the Apache License, Version 2.0 (the # "License"); you may not use this file except in compliance # with the License. You may obtain a copy of the License at # # http://www.apache.org/licenses/LICENSE-2.0 # # Unless required by applicable law or agreed to in writing, software # distributed under the License is distributed on an "AS IS" BASIS, # WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. # See the License for the specific language governing permissions and # limitations under the License. --> # STORM 0.11.0 Release Notes These release notes cover new developer and user-facing incompatibilities, important issues, features, and major improvements. --- * [STORM-1189](https://issues.apache.org/jira/browse/STORM-1189) | *Major* | **client.getClusterInfo() fails with Required field 'nimbus\_uptime\_secs' is unset!** Hi, we are about to upgrade our cluster from 0.9.1-incubating to 0.10.0. I'm currently testing whether the functionality is still working with 0.10.0 in VMs. On 0.10.0 the following throws the exception mentioned below: ... NimbusClient nimbusClient = NimbusClient.getConfiguredClient(readConfig); Client client = nimbusClient.getClient(); ClusterSummary clusterInfo = client.getClusterInfo(); Exception: org.apache.thrift7.protocol.TProtocolException: Required field 'nimbus\_uptime\_secs' is unset! Struct:ClusterSummary(supervisors:[SupervisorSummary(host:n3.t3k.siemens.com, uptime\_secs:24297, num\_workers:4, num\_used\_workers:0, supervisor\_id:4a87f03b-ea91-4b12-8cb9-9f7e26703b26, version:0.10.0.2.3.0.0-2557)], nimbus\_uptime\_secs:0, topologies:[]) at backtype.storm.generated.ClusterSummary.validate(ClusterSummary.java:515) at backtype.storm.generated.ClusterSummary$ClusterSummaryStandardScheme.read(ClusterSummary.java:613) at backtype.storm.generated.ClusterSummary$ClusterSummaryStandardScheme.read(ClusterSummary.java:549) at backtype.storm.generated.ClusterSummary.read(ClusterSummary.java:473) at backtype.storm.generated.Nimbus$getClusterInfo\_result$getClusterInfo\_resultStandardScheme.read(Nimbus.java:16546) at backtype.storm.generated.Nimbus$getClusterInfo\_result$getClusterInfo\_resultStandardScheme.read(Nimbus.java:16531) at backtype.storm.generated.Nimbus$getClusterInfo\_result.read(Nimbus.java:16470) at org.apache.thrift7.TServiceClient.receiveBase(TServiceClient.java:78) at backtype.storm.generated.Nimbus$Client.recv\_getClusterInfo(Nimbus.java:569) at backtype.storm.generated.Nimbus$Client.getClusterInfo(Nimbus.java:557) Switching back to 0.9.1-incubating showed, that the code still works fine there. BR Michael --- * [STORM-1106](https://issues.apache.org/jira/browse/STORM-1106) | *Blocker* | **Netty Client Connection Attempts should not be limited** The workers should not give-up making connection with other workers. This could cause the worker to be blocked forever.
