The Apache Kafka community is pleased to announce the release for Apache Kafka 1.1.0.
Kafka 1.1.0 includes a number of significant new features. Here is a summary of some notable changes: ** Kafka 1.1.0 includes significant improvements to the Kafka Controller that speed up controlled shutdown. ZooKeeper session expiration edge cases have also been fixed as part of this effort. ** Controller improvements also enable more partitions to be supported on a single cluster. KIP-227 introduced incremental fetch requests, providing more efficient replication when the number of partitions is large. ** KIP-113 added support for replica movement between log directories to enable data balancing with JBOD. ** Some of the broker configuration options like SSL keystores can now be updated dynamically without restarting the broker. See KIP-226 for details and the full list of dynamic configs. ** Delegation token based authentication (KIP-48) has been added to Kafka brokers to support large number of clients without overloading Kerberos KDCs or other authentication servers. ** Several new features have been added to Kafka Connect, including header support (KIP-145), SSL and Kafka cluster identifiers in the Connect REST interface (KIP-208 and KIP-238), validation of connector names (KIP-212) and support for topic regex in sink connectors (KIP-215). Additionally, the default maximum heap size for Connect workers was increased to 2GB. ** Several improvements have been added to the Kafka Streams API, including reducing repartition topic partitions footprint, customizable error handling for produce failures and enhanced resilience to broker unavailability. See KIPs 205, 210, 220, 224 and 239 for details. All of the changes in this release can be found in the release notes: https://www.apache.org/dist/kafka/1.1.0/RELEASE_NOTES.html You can download the source and binary releases from: http://kafka.apache.org/downloads ------------------------------------------------------------ ------------------ Apache Kafka is a distributed streaming platform with four core APIs: ** The Producer API allows an application to publish a stream records to one or more Kafka topics. ** The Consumer API allows an application to subscribe to one or more topics and process the stream of records produced to them. ** The Streams API allows an application to act as a stream processor, consuming an input stream from one or more topics and producing an output stream to one or more output topics, effectively transforming the input streams to output streams. ** The Connector API allows building and running reusable producers or consumers that connect Kafka topics to existing applications or data systems. For example, a connector to a relational database might capture every change to a table.three key capabilities: With these APIs, Kafka can be used for two broad classes of application: ** Building real-time streaming data pipelines that reliably get data between systems or applications. ** Building real-time streaming applications that transform or react to the streams of data. Apache Kafka is in use at large and small companies worldwide, including Capital One, Goldman Sachs, ING, LinkedIn, Netflix, Pinterest, Rabobank, Target, The New York Times, Uber, Yelp, and Zalando, among others. A big thank you for the following 120 contributors to this release! Adem Efe Gencer, Alex Good, Andras Beni, Andy Bryant, Antony Stubbs, Apurva Mehta, Arjun Satish, bartdevylder, Bill Bejeck, Charly Molter, Chris Egerton, Clemens Valiente, cmolter, Colin P. Mccabe, Colin Patrick McCabe, ConcurrencyPractitioner, Damian Guy, dan norwood, Daniel Wojda, Derrick Or, Dmitry Minkovsky, Dong Lin, Edoardo Comar, ekenny, Elyahou, Eugene Sevastyanov, Ewen Cheslack-Postava, Filipe Agapito, fredfp, Gavrie Philipson, Gunnar Morling, Guozhang Wang, hmcl, Hugo Louro, huxi, huxihx, Igor Kostiakov, Ismael Juma, Ivan Babrou, Jacek Laskowski, Jakub Scholz, Jason Gustafson, Jeff Klukas, Jeff Widman, Jeremy Custenborder, Jeyhun Karimov, Jiangjie (Becket) Qin, Jiangjie Qin, Jimin Hsieh, Joel Hamill, John Roesler, Jorge Quilcate Otoya, Jun Rao, Kamal C, Kamil Szymański, Koen De Groote, Konstantine Karantasis, lisa2lisa, Logan Buckley, Magnus Edenhill, Magnus Reftel, Manikumar Reddy, Manikumar Reddy O, manjuapu, Manjula K, Mats Julian Olsen, Matt Farmer, Matthias J. Sax, Matthias Wessendorf, Max Zheng, Maytee Chinavanichkit, Mickael Maison, Mikkin, mulvenna, Narendra kumar, Nick Chiu, Onur Karaman, Panuwat Anawatmongkhon, Paolo Patierno, parafiend, ppatierno, Prasanna Gautam, Radai Rosenblatt, Rajini Sivaram, Randall Hauch, Richard Yu, RichardYuSTUG, Robert Yokota, Rohan, Rohan Desai, Romain Hardouin, Ron Dagostino, sachinbhalekar, Sagar Chavan, Sandor Murakozi, Satish Duggana, Scott, Sean McCauliff, Siva Santhalingam, siva santhalingam, Soenke Liebau, Steven Aerts, Study, Tanvi Jaywant, tedyu, Tobias Gies, Tom Bentley, Tommy Becker, Travis Wellman, umesh chaudhary, Vahid Hashemian, Viktor Somogyi, Wladimir Schmidt, wushujames, Xavier Léauté, Xin Li, Yaswanth Kumar, ying-zheng, Yu, Yu-Jhe Many thanks to Damian Guy for driving this release. We welcome your help and feedback. For more information on how to report problems, and to get involved, visit the project website at http://kafka.apache.org/ Thank you! Rajini