[
https://issues.apache.org/jira/browse/STORM-208?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13964306#comment-13964306
]
ASF GitHub Bot commented on STORM-208:
--------------------------------------
GitHub user ptgoetz opened a pull request:
https://github.com/apache/incubator-storm/pull/65
STORM-208: Add storm-kafka as an external module
This adds storm-kafka as an "external" module and incorporates it into the
maven build.
This includes the commit history from the original storm-kafka from
storm-contrib as well as the commit history from
wurstmeister/storm-kafka-0.8-plus.
Aside from build incorporation, bump to kafka 0.8.1, and license headers,
the only significant change is to add the topic name to the committed path.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/ptgoetz/incubator-storm storm-kafka-module
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/incubator-storm/pull/65.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #65
----
commit d46e82e92538c0625f117c91f8fb85c7df80bb84
Author: Nathan Marz <[email protected]>
Date: 2012-01-18T10:08:22Z
untested transactionalspout implementation for kafka 0.6
commit 1c801a983b301ed72440ec8ca305906997558b0f
Author: Nathan Marz <[email protected]>
Date: 2012-01-18T10:24:30Z
add .gitignore
commit 5b6c87fb1c31436cf4db1ba399471f66dd97b2d8
Author: Nathan Marz <[email protected]>
Date: 2012-01-18T10:24:50Z
remove redundant BatchMeta
commit e12b26878d95ab02325baed7902f8c55cfb245ff
Author: Nathan Marz <[email protected]>
Date: 2012-01-18T11:28:37Z
exclude zookeeper client from storm-kafka since it's already available from
storm
commit 331d20229de450bc0930bb5ac081c4f8d638e34d
Author: Nathan Marz <[email protected]>
Date: 2012-01-18T21:55:30Z
add readme for storm-kafka
commit d6e352a2c708b63e5ef65032092ac61713fee7cf
Author: Nathan Marz <[email protected]>
Date: 2012-01-27T04:35:49Z
update to new api
commit fa4792325957dbfc71ec31961b4ec9b75fa44909
Author: Nathan Marz <[email protected]>
Date: 2012-01-27T06:49:03Z
update notes on storm-kafka
commit 40595a3641e44904053e00a3056b379f738a6100
Author: Nathan Marz <[email protected]>
Date: 2012-01-27T18:49:43Z
exclude log4j from dependencies since that's included through storm
dependency
commit ec6c752274fe954652ae77a7f9645b3a7c8fc5df
Author: Nathan Marz <[email protected]>
Date: 2012-01-29T07:14:38Z
update README
commit c0078a3597ec43555fc846f31eb50fcf4514c1e8
Author: Nathan Marz <[email protected]>
Date: 2012-01-29T10:30:42Z
note implementation is for 0.6
commit ac2143ddb9dc9e68cf1ca46a45fbfc8234983adc
Author: Nathan Marz <[email protected]>
Date: 2012-02-03T08:39:19Z
kafka 7 compatible version
commit 2708f8b74ee576e60131f10043dc19f2b65f45f3
Author: Nathan Marz <[email protected]>
Date: 2012-02-03T09:35:06Z
update README
commit 7b1eeb1b1a2b4199797416c52e425e5d893f49c7
Author: Nathan Marz <[email protected]>
Date: 2012-02-03T09:35:58Z
update README
commit 9b98f8a1c80632656b2afedeb62912fe35f61bc9
Author: Nathan Marz <[email protected]>
Date: 2012-02-03T11:14:32Z
instructions on getting getting 0.6 or 0.7 compatible version
commit 81074357185251ee61976b7f05aac4f6e61c2231
Author: Nathan Marz <[email protected]>
Date: 2012-02-12T01:44:04Z
added opaque version of spout for increased fault-tolerance
commit fc580e2fe55abd246518469d0790befb1212b475
Author: Nathan Marz <[email protected]>
Date: 2012-02-12T01:49:45Z
updated to add opaque functionality
commit 0f96d15add499fde4bad155be7d122ab52094fcc
Author: Nathan Marz <[email protected]>
Date: 2012-02-12T03:48:32Z
finished opaquetransactionalkafkaspout
commit e5009dba156f45314ba9f266b27fe982d8cab0ba
Author: Nathan Marz <[email protected]>
Date: 2012-02-12T03:48:43Z
Merge branch 'master' into kafka0.7
commit 50a021bddbadbe16e064034b43fbb99d09240176
Author: Nathan Marz <[email protected]>
Date: 2012-02-27T22:56:30Z
update dep to storm 0.7.0
commit 3ebbf278b0e85bdb4c8fac4ebb9099853b214c74
Author: Nathan Marz <[email protected]>
Date: 2012-02-27T22:57:33Z
update readme
commit d281d285eaec66b73c3ef0d2070807aaedc04861
Author: Nathan Marz <[email protected]>
Date: 2012-02-27T23:21:55Z
include clojure as a dev dep
commit ea405defdb25256119c9560a6452fca3446edb4e
Author: Nathan Marz <[email protected]>
Date: 2012-02-27T23:22:14Z
Merge branch 'master' into kafka0.7
commit 96d442dc9ad680c6e34aed4b09a79b6e402c0f62
Author: Nathan Marz <[email protected]>
Date: 2012-04-02T20:05:06Z
0.7.1 compatible
commit f4c0886a424ce730ef8553f3bd5271bf3637ac91
Author: Nathan Marz <[email protected]>
Date: 2012-04-02T20:05:22Z
0.7.1-SNAPSHOT
commit e49662519c3e697845db33c7c535df2095fc13f4
Author: Nathan Marz <[email protected]>
Date: 2012-04-02T20:05:06Z
0.7.1 compatible
commit c1e5112d7459b890bc70816e3a26a98b37f4e72a
Author: Nathan Marz <[email protected]>
Date: 2012-04-02T20:08:07Z
storm 0.7.1 compatible
commit d1157e6ac0ae5b2be1ee26713265eae204f4ac23
Author: Nathan Marz <[email protected]>
Date: 2012-04-09T00:29:01Z
fix opaquepartitionedtransactionalspotu
commit f6d464f2a02cf838e1758812239432d562683bed
Author: Nathan Marz <[email protected]>
Date: 2012-04-09T00:29:01Z
fix opaquepartitionedtransactionalspotu
commit 6074035921bbbd0ae2edf4f8c17cbd765129064d
Author: Nathan Marz <[email protected]>
Date: 2012-04-28T01:47:02Z
fix conflict
commit 55362f5a918a7fcc4b94bdd13448ded3a4fdc1ef
Author: Nathan Marz <[email protected]>
Date: 2012-04-28T08:36:30Z
fix problem with partition -> local partition mapping, added regular kafka
spout
commit 6c8487da1be2d58bd7addbd2c25418fbd687974e
Author: Nathan Marz <[email protected]>
Date: 2012-04-28T08:39:18Z
merge spoutconfig with kafkaconfig for regular spout
commit d1b0e48b7b9845b52e15ae6d3e895b279eaa52ba
Author: Nathan Marz <[email protected]>
Date: 2012-04-28T08:45:05Z
update readme
commit e0127153f70caf3afa102a289759f990556465bd
Author: Nathan Marz <[email protected]>
Date: 2012-05-02T03:55:53Z
add ability to start from a particular time, add automatic finding of
offsets
commit f04ff40d289ce5ef8b172af39a924c0d8ab1609f
Author: Nathan Marz <[email protected]>
Date: 2012-05-02T19:29:07Z
round robin only after finishing batch for one partition, fix how resetting
of offsets works
commit 2730eb89174b9976feb6ca7401eb07832f7b09d4
Author: Nathan Marz <[email protected]>
Date: 2012-05-02T19:45:09Z
fix bug
commit 8b6fb1dbcf574e975af9368a3660c6d8cd5acc15
Author: Nathan Marz <[email protected]>
Date: 2012-05-03T05:04:51Z
formatting
commit 1b519a03ef3230e0ac17c91024e53102bd61bfb1
Author: Nathan Marz <[email protected]>
Date: 2012-05-03T20:34:51Z
add noarg constructor to ZooMeta so it works with Kryo
commit 8dc6928f6fe808b6219c3d847499655848a8d3a4
Author: Nathan Marz <[email protected]>
Date: 2012-05-04T14:21:04Z
update readme
commit e258cef74bd9f828df2307acfb5dc7d99e3e75cb
Author: Nathan Marz <[email protected]>
Date: 2012-05-04T14:23:05Z
update version
commit 4063934ac0027bca38480138f2db56d508c44f7e
Author: Nathan Marz <[email protected]>
Date: 2012-05-07T05:18:46Z
update readme
commit 785ac24971acc4565d987491d239b8e9e6c2f1ca
Author: Nathan Marz <[email protected]>
Date: 2012-05-17T06:49:03Z
update storm-kafka to 0.7.2
commit 0f73b6a75def2a5cc2adca61e9a9d3c4adbb5868
Author: Nathan Marz <[email protected]>
Date: 2012-05-31T03:39:21Z
make kafka spouts more flexible to support kafka hosts on different ports
commit 6dd85c9549a51bf85d4954e33b023d7241b45882
Author: Nathan Marz <[email protected]>
Date: 2012-05-31T04:37:44Z
fix problem with hostport conversion, logging
commit 2d9db4420dd745ee9a19b2dbc04ee1f97d29ca3f
Author: Nathan Marz <[email protected]>
Date: 2012-06-12T00:33:18Z
use prior message's next offset for current message's offset rather than
trying to compute it manually
commit 880c2940f0a812d0efdb67e34bdaf66d9376452d
Author: Nathan Marz <[email protected]>
Date: 2012-06-12T00:33:28Z
use 0.7.2 dep
commit 654a4365676f61ac25f35297cdd3c2e2411b67bd
Author: Nathan Marz <[email protected]>
Date: 2012-06-12T01:24:38Z
remove test code
commit f55992d679c844e2929cbe23401cb4d3de1e21ca
Author: Nathan Marz <[email protected]>
Date: 2012-06-13T00:53:28Z
bump version
commit 5869d51f8a77099b309bca07b7a7c4eee46ef79c
Author: Argyris Zymnis <[email protected]>
Date: 2012-06-28T00:02:26Z
Add partitions that are picked up by zookeeper.
commit 0e1eb41a5988a781abfc1ef397c0708090befd21
Author: Argyris Zymnis <[email protected]>
Date: 2012-06-28T17:41:12Z
Also deal with number of hosts in partition connections class.
commit d4488c80c1aaacd685484d27bf8f5b91b77f8d33
Author: Argyris Zymnis <[email protected]>
Date: 2012-06-28T17:45:57Z
Add the newline.
commit 4a12919b66ad45ac86789c6c74300cb3e0c31d10
Author: Argyris Zymnis <[email protected]>
Date: 2012-06-28T22:56:44Z
A couple more fixes and tested to make sure that this works.
commit d745a9435dd698ba3eaa8cb8db44f864b87ddd90
Author: Nathan Marz <[email protected]>
Date: 2012-07-03T01:38:52Z
implement dynamic hosts / partitionsPerHost for KafkaSpout
commit b7ba9d9455582b8ef180b96d7f543907b74b674f
Author: Nathan Marz <[email protected]>
Date: 2012-07-03T01:42:24Z
make brokerhosts serializable
commit e4305171091ee31c906f4cac7e476fe7f7681e78
Author: Nathan Marz <[email protected]>
Date: 2012-07-03T01:46:06Z
start curator client
commit c49b687e37c323e559621b7d058de1a1e5d5eaf5
Author: Nathan Marz <[email protected]>
Date: 2012-07-03T01:55:07Z
got it working
commit 31b9e928604be16d8cc648aa8ba4afa614e66256
Author: Nathan Marz <[email protected]>
Date: 2012-07-11T09:28:46Z
change version of dynamic kafka spout
commit 887cad498014e584b7a6eca79357962bdc9a040e
Author: Nathan Marz <[email protected]>
Date: 2012-07-12T20:54:37Z
added more logging into spout, fixed bug where it would refresh zk on every
nextTuple
commit 7b5264967c855f353f4ac4f333d05a0e721f91a0
Author: Nathan Marz <[email protected]>
Date: 2012-07-12T20:54:50Z
fix version
commit d2c73f85c579f65266ba87c1efd7d07ae6735eef
Author: Nathan Marz <[email protected]>
Date: 2012-07-12T21:10:26Z
make it possible to do filtering with the spout scheme
commit 237d716003192d4ceea85e8526b25dcd38f9f49d
Author: tombrown52 <[email protected]>
Date: 2012-07-25T16:25:22Z
Update storm-kafka/src/jvm/storm/kafka/ZkCoordinator.java
Fixing a bug that causes partitions to be unassigned if the hash code of
the "HostPort" is negative.
commit c67ab70e4b8436094a743e1cc782892e8b8615e5
Author: Brian O'Neill <[email protected]>
Date: 2012-07-31T03:25:05Z
Pom file for maven support.
commit 0cf4a4ef91a7bad3256347c412a42f43fa71a744
Author: Jason Jackson <[email protected]>
Date: 2012-07-30T22:30:42Z
write kafka spout zookeeper state in JSON format
commit ad80c0140fbc9b0310e6828f6c4f89a57be2d311
Author: tombrown52 <[email protected]>
Date: 2012-07-25T16:25:22Z
Update storm-kafka/src/jvm/storm/kafka/ZkCoordinator.java
Fixing a bug that causes partitions to be unassigned if the hash code of
the "HostPort" is negative.
commit ef68dd921633b702d9e5d235b5a36d2c50c35070
Author: Jason Jackson <[email protected]>
Date: 2012-08-01T00:51:19Z
uses netflix curator framework to connect to zookeeper
commit bb542b0bf6244304e835a59f3743df9bc28535fe
Author: P. Taylor Goetz <[email protected]>
Date: 2012-08-01T02:08:57Z
merge pull request #8
commit 4a27d30a35b26630fcdd1ea1b0ba84dde3f89fa9
Author: Nathan Marz <[email protected]>
Date: 2012-08-01T21:34:21Z
fix repos
commit 1b06f21257c2b3ffff491a55e7d87b29063d8b8b
Author: Nathan Marz <[email protected]>
Date: 2012-08-01T21:35:01Z
remove pom
commit 866e020a27bae7fc0f88ec54c4593582a52c57a0
Author: Nathan Marz <[email protected]>
Date: 2012-08-01T21:35:54Z
Merge branch 'dynamic-brokers' of github.com:nathanmarz/storm-contrib into
dynamic-brokers
commit a0ca167e17695e39ac907647947737ad258ec7b6
Author: Nathan Marz <[email protected]>
Date: 2012-08-06T20:46:35Z
turn down kafka logging (don't log when num messages is 0)
commit 4e7868ef2e7d22b3649953d9ae9dc86ae0799246
Author: Nathan Marz <[email protected]>
Date: 2012-08-06T20:47:25Z
update version
commit 7bfcb121ba2ef957ace4abc4fd552bd3e7ac63b0
Author: Argyris Zymnis <[email protected]>
Date: 2012-08-06T20:49:05Z
Move to scala 2.9.2
commit e3c257fa0c51bcaa1160a2eb3e4f84fc1058167e
Author: Argyris Zymnis <[email protected]>
Date: 2012-08-06T20:52:05Z
Merge branch 'dynamic-brokers' of
https://github.com/nathanmarz/storm-contrib into dynamic_brokers_scala292
Conflicts:
storm-kafka/project.clj
commit 62f25a73b6621fac8e125c34917d25beb24019a5
Author: Argyris Zymnis <[email protected]>
Date: 2012-08-14T19:29:14Z
Switch to wip2
commit 7ca5f84fcb77833e52a619df4d0ebad509255cce
Author: Jason Jackson <[email protected]>
Date: 2012-08-22T04:28:57Z
x
commit dfae7ced8b87f3b3d0a90f1388bbc63f6427094a
Author: Jason Jackson <[email protected]>
Date: 2012-08-22T21:32:44Z
refactoring
commit 8bf8f1cd22dfae841b9ccf837b852b45ee9f3161
Author: Jason Jackson <[email protected]>
Date: 2012-08-22T23:42:15Z
clarify logic in case where no ZkState, sets last commit offset to HEAD
commit a6a0570c09d99b4ff394760963c92395845a77e7
Author: Jason Jackson <[email protected]>
Date: 2012-08-22T23:52:59Z
reversed last commit offset logic
commit de51ab19ccb7d266c248f38aa52b9b44d9fb71b7
Author: Jason Jackson <[email protected]>
Date: 2012-08-23T21:18:57Z
Merge branch 'dynamic-brokers' into jason
commit 99c7bcf801abf38fcc1df629c2700dbad5e04e35
Author: Jason Jackson <[email protected]>
Date: 2012-08-23T21:20:26Z
removed SNAPSHOT from project
commit a4bbfcd1100da64a777a834a9a8df0f26f461f99
Author: Jason Jackson <[email protected]>
Date: 2012-08-23T21:24:12Z
Merge branch 'dynamic-brokers' into jason
Conflicts:
storm-kafka/project.clj
commit 92b6a0aa112e10dc7059e40940ef7af6d696f308
Author: Nathan Marz <[email protected]>
Date: 2012-10-13T17:04:58Z
refactored reading kafka broker info from zookeeper into its own class
commit f046c2bf8a297d237e076868655e70606860de59
Author: Nathan Marz <[email protected]>
Date: 2012-10-13T17:05:36Z
remove transactional topology kafkaspout implementations
commit 58eb982708b778feba1db86aa4fd847567447195
Author: Nathan Marz <[email protected]>
Date: 2012-10-13T17:10:43Z
merge conflict
commit 32076c24839b1ea3763fc63918aeeb2897cf6b77
Author: Nathan Marz <[email protected]>
Date: 2012-10-13T20:10:39Z
moved trident-kafka into storm-kafka
commit e6f0daf07a601712e3611628876cb66f36e5f304
Author: Nathan Marz <[email protected]>
Date: 2012-10-13T20:20:49Z
Merge branch 'dynamic-brokers'
commit fbca0982d9d88c2a229bb254ffc38e1c2954df11
Author: Nathan Marz <[email protected]>
Date: 2012-10-13T22:08:18Z
implemented trident kafka spouts with dynamic brokers
commit 7e074cfe5c88dd927c2f87bff985e93228ff0b13
Author: Nathan Marz <[email protected]>
Date: 2012-10-13T22:08:56Z
bump version
commit 3641921f21d20a631cf1d24c5642d985b166accf
Author: Nathan Marz <[email protected]>
Date: 2012-10-13T22:10:29Z
depend on 0.9.0-wip1
commit 7fd0575aa305d00a88065a39d470dcfab28e245d
Author: Nathan Marz <[email protected]>
Date: 2012-10-13T22:16:15Z
fix typo
commit ae825eb9713913cf2caef742fa4dd3a52ecceec3
Author: Nathan Marz <[email protected]>
Date: 2012-10-25T18:41:42Z
update kafkaspout to write metadata into zookeeper so that lag monitoring
can be done
commit 63aaad01981cd1683a74ce81189ebf4a7a420fb0
Author: Nathan Marz <[email protected]>
Date: 2012-11-02T22:33:30Z
upgrade to 0.9.0's new logging system
commit f5938c06a55c523b39ce12aabec3c6f422fe8b3d
Author: Nathan Marz <[email protected]>
Date: 2012-11-02T22:36:11Z
0.9.0-wip2
commit 6cc99e37d1c6c4f51394f8bf7119d1ee801f159c
Author: Nathan Marz <[email protected]>
Date: 2012-11-14T00:50:40Z
make sure kafka partitions are always ordered the same way
commit d6e9e63512544d1cf5e34c83af1e9cc7d8dfd4b0
Author: Nathan Marz <[email protected]>
Date: 2012-11-14T00:52:48Z
0.9.0-wip3
commit f2d5b39551d6980c96b87d0c2f0309a8ff104218
Author: Sam Ritchie <[email protected]>
Date: 2012-11-30T01:02:40Z
multischeme.
commit aad7f4bcc1ff0b4df46d47994adc53eb36ab1009
Author: Sam Ritchie <[email protected]>
Date: 2012-12-04T01:51:39Z
version bump.
commit fecf760a4dbcf4f7f5af13b401345a93bb99417d
Author: Sam Ritchie <[email protected]>
Date: 2012-12-04T01:58:09Z
fix typo.
commit 470ec47280a9fc1afc7e5d44ef047c7f6ed58713
Author: Jason Jackson <[email protected]>
Date: 2012-12-05T09:53:45Z
multischeme related changes
commit df380fb0186aa59e4d1f2f74e8f609c3bda23dc2
Author: Jason Jackson <[email protected]>
Date: 2012-12-18T06:41:07Z
version bump 0.9.0-wip5
commit 6e8c93d27bd18edbd7a0edc6188ad81921c28b57
Author: Jason Jackson <[email protected]>
Date: 2013-01-09T08:55:43Z
removed twitter repositories from project clj
commit c40f0ce165a421d2f88f3ce28ee0615dbf19ecad
Author: Jason Jackson <[email protected]>
Date: 2013-01-11T01:01:40Z
bumped version, upgraded storm dep
commit 1e00589634d1b1fbb9aafda0c50ba7cc2ccbc624
Author: Nathan Marz <[email protected]>
Date: 2013-01-11T19:53:10Z
include offset when logging about committing offsets
commit 4d2c4dab1af86887bbe5811a2090e927ecf18305
Author: Nathan Marz <[email protected]>
Date: 2013-01-11T19:53:43Z
Merge branch 'master' of github.com:nathanmarz/storm-contrib
commit 08f779f0de6839f63af1443d7070da730db9a3b4
Author: Jason Jackson <[email protected]>
Date: 2013-01-11T07:53:08Z
lein2 upgrade
added kafkaspout lag to transactionaltridentkafkaspout
commit af2a1fc8e29aadcd12c6521261964ceb5485c0d6
Author: Jason Jackson <[email protected]>
Date: 2013-01-22T22:08:31Z
fixed bug. lastmeta data may be null in certain cases
commit 860a43b444f72bd90f3d24090907874330995bb2
Author: Jason Jackson <[email protected]>
Date: 2013-01-29T21:44:43Z
fixed concurrent modification exception
commit 7ed3d7c5317f78facdad2ca53b695205261ca777
Author: Jason Jackson <[email protected]>
Date: 2013-01-29T21:45:05Z
bump 0.9.0-wip15e-scala292
commit 76d788cd08265ba22b17632aa0629c34a86baefd
Author: Jason Jackson <[email protected]>
Date: 2013-02-11T18:55:51Z
fixed possible issue where getValueAndReset is called before
refreshPartitions is ever called
commit ddc3e8eefc881e5809c0f0d9a4b61a60af432024
Author: Jason Jackson <[email protected]>
Date: 2013-02-11T18:59:32Z
bump 0.9.0-wip15f-scala292
commit 2d78e680070a5b3181bf08926c32dca105343af4
Author: Nathan Marz <[email protected]>
Date: 2013-02-16T00:14:45Z
track average and max kafka request latencies
commit 2cc81a171dba6c47c7c347a1bb1fd3898eb500fb
Author: Nathan Marz <[email protected]>
Date: 2013-02-16T00:15:30Z
0.9.0-wip16-scala292
commit 4bf2de58f0972b731600269cd419c1a3d1869458
Author: Nathan Marz <[email protected]>
Date: 2013-02-16T00:16:22Z
forgot MaxMetric
commit 47ce0ae97830380eb85db7ae97a7f7f3adbff820
Author: Jason Jackson <[email protected]>
Date: 2013-02-16T17:40:03Z
fixed NPE in MaxMetric. bumped version 0.9.0-wip16a-scala292
commit 205bc6339f7d59ca6533231e0c92a1ad295e05f0
Author: Jason Jackson <[email protected]>
Date: 2013-04-24T16:27:55Z
add api latency metric to KafkaSpout
commit 61be2a01feb81146d89071fbe292dcf396a70c47
Author: Jason Jackson <[email protected]>
Date: 2013-04-24T17:55:45Z
bump 0.9.0-wip16b-scala292
commit b15d695bacd003927fd078432000e796b6a56919
Author: wurstmeister <[email protected]>
Date: 2013-05-09T18:33:02Z
Initial commit
commit 5f58bb35e56fac5faf13b4a6ee756cc6db442b83
Author: thomas <[email protected]>
Date: 2013-05-09T18:37:04Z
clone of nathanmarz/storm-contrib/storm-kafka
commit d55df553aa3749107e0bd9938799375ecb2cec02
Author: wurstmeister <[email protected]>
Date: 2013-05-09T20:20:55Z
updated kafka installation instructions
commit 38bde87ed3e27ee5d5dfe1fdf5e25a4640472792
Author: wurstmeister <[email protected]>
Date: 2013-05-09T20:22:26Z
fixed kafka 0.8 compilation issues
commit 005cd8b348a27267e80a3c557c6a6ae25d3f33c2
Author: wurstmeister <[email protected]>
Date: 2013-05-11T14:10:21Z
updated zookeeper dynamic broker detection
* split broker hosts into separate classes
* added test topology
commit e20dcd1d5f3fa6d6e40ac0fe6a4f401930d0a93d
Author: wurstmeister <[email protected]>
Date: 2013-05-11T18:48:12Z
extracted Coordinator to avoid code duplication
commit 4024080de5ee9d131b766f870007b13d723ee3cc
Author: wurstmeister <[email protected]>
Date: 2013-05-16T19:23:11Z
updated dynamic leader detection
* refactored partition handling
commit 9abf90b4d924e9b74c4ead612e8819ebd24fca3b
Author: wurstmeister <[email protected]>
Date: 2013-05-16T21:34:08Z
added test for reading partition leader
* moved to maven
commit f63b276ea3e99ff7257a31b68e1b7a364bf9f1ac
Author: wurstmeister <[email protected]>
Date: 2013-05-16T21:51:54Z
moved to maven
commit f8088920b71b4ab704ffc76f63dab74dc1e834cd
Author: wurstmeister <[email protected]>
Date: 2013-05-22T08:48:16Z
Refactored emitters
* extracted emitter code to single class
* downgraded curator version to avoid conflicts
commit ddee8961af3d8618610320ee5793547879c91cfa
Author: wurstmeister <[email protected]>
Date: 2013-05-22T10:43:36Z
added support for client id
* removed unused leiningen project file
commit 83f183becb4f6bd45822beac48d9b6425be7391b
Author: wurstmeister <[email protected]>
Date: 2013-07-31T21:06:00Z
Update to kafka 0.8 beta1
* updated pom and build instructions
commit 20a1167dcded98fb53bdfceb79165c6e2d296e7f
Author: wurstmeister <[email protected]>
Date: 2013-07-31T21:08:40Z
fixed formatting
commit 90a82604f8a40fb33e05f5b4d2003198d4263555
Author: wurstmeister <[email protected]>
Date: 2013-07-31T21:10:22Z
fixed formatting
commit 28789106f0b3e6f3b5ef5767df2d6a0ca6ff02cb
Author: wurstmeister <[email protected]>
Date: 2013-07-31T21:34:05Z
updated to storm 0.9.0-wip21
commit 3d058660c94d97b15e9700b615a82051b599be34
Author: wurstmeister <[email protected]>
Date: 2013-08-17T09:07:48Z
added license
commit d3eda036ed839d344415dbaab471fef4472a8d9b
Author: wurstmeister <[email protected]>
Date: 2013-08-17T11:37:43Z
fixed infinite loop in KafkaSpout
commit 572a57702dfbe8918b74247a71f5922ebbde7901
Author: wurstmeister <[email protected]>
Date: 2013-08-18T07:38:58Z
renamed GlobalPartitionId
commit d0d7acb26aee4b1f691ea3c8bdf4cc9e220f693f
Author: wurstmeister <[email protected]>
Date: 2013-08-21T21:11:30Z
removed JDK 7 dependency
commit b77057c5d0aa9e47469c86da7c01f4aba3bd5f43
Author: wurstmeister <[email protected]>
Date: 2013-12-07T10:53:18Z
updated to final version of kafka 0.8
commit e7f7feac92b4ae7045b5d1c0c8cc75bb842cc20b
Author: wurstmeister <[email protected]>
Date: 2013-12-22T12:48:49Z
updated to final version of storm 0.9.0
commit 5da87f3382f75fae4dfe13f8af06896615f80291
Author: wurstmeister <[email protected]>
Date: 2013-12-22T13:06:52Z
preparing for tag
commit a4c30ebbab9bc662877c8d063e6c89f5f78d7ad9
Author: wurstmeister <[email protected]>
Date: 2013-12-22T13:20:21Z
added distribution management
* bumped version
* updated group id
commit a440ecc05f7bae6b3cea6b6c9d0450a577b42d58
Author: wurstmeister <[email protected]>
Date: 2013-12-22T13:57:29Z
updated group id, prepared for tag
commit d35a6eee117ec401e5fea992200167ead9f764d7
Author: wurstmeister <[email protected]>
Date: 2013-12-22T14:18:19Z
updated readme
commit e8f54d63094806a2a1364adb5e209ab2ca10f0f0
Author: wurstmeister <[email protected]>
Date: 2013-12-22T15:58:01Z
use consistent formatting
commit da18bd858035c495edb41cc018fe706a3f7ef831
Author: wurstmeister <[email protected]>
Date: 2013-12-22T16:10:14Z
removed empty statement
commit 735b87f78459ec686017c538ef50d95a7db9584b
Author: wurstmeister <[email protected]>
Date: 2013-12-25T16:28:16Z
Renamed HostPort to Broker
commit b5de86ed7f966018454fba667a42010f0f73f490
Author: wurstmeister <[email protected]>
Date: 2014-01-05T12:17:55Z
Use partition id in zk path
* added topology id to logs
commit 4b6e9bcf90f52b3eef4817ff30cb8792b4c3b8e0
Author: wurstmeister <[email protected]>
Date: 2014-01-05T12:25:22Z
added changelog
commit 6b29f8f0bf56b473bf06e2fc7a0f822e5c87d9bc
Author: wurstmeister <[email protected]>
Date: 2014-01-07T08:00:36Z
Update README.md
commit 95c60dbbbc80165969bae6cbbd1926207720e59c
Author: wurstmeister <[email protected]>
Date: 2014-01-11T16:34:01Z
Added error handling for fetch request
* allow retry of fetch if offset was invalid
* updated changelog
commit 80005ba3916e2a05c82649dd67f11b0f813c41b6
Author: wurstmeister <[email protected]>
Date: 2014-01-12T18:21:56Z
added OFFSET_METADATA_TOO_LARGE error
commit 5b764cd9138dd93e7382e3472b9d3d33d4b286a3
Author: wurstmeister <[email protected]>
Date: 2014-01-18T15:25:36Z
calculate start offset for new topology consistently
commit f789091534be95c103890be6539bbfc5faf69b37
Author: wurstmeister <[email protected]>
Date: 2014-01-18T15:51:44Z
calculate start offset for new topology consistently
commit 0a6203acc6a2765049af6913b8deb070fb63a244
Author: Edison Xu <[email protected]>
Date: 2014-01-22T07:07:04Z
fix trident keep refreshing partition issue
commit 48f6840273e369000421675dfb90141c0e3ac270
Author: wurstmeister <[email protected]>
Date: 2014-01-26T21:17:20Z
Merge pull request #13 from EdisonXu/fix1
fix keep refreshing partitions issue
commit aabcd5846010ff0bc5832520bf8f59e9879728cc
Author: wurstmeister <[email protected]>
Date: 2014-01-26T21:32:13Z
use guava equals/hashCode
commit e9357eca4881704c398acbe60dda228ad4c7beec
Author: wurstmeister <[email protected]>
Date: 2014-02-02T19:24:47Z
added profile for scala 2.10 build
commit 37aa116d7aba38c7600b669589bc9458e328bb4a
Author: wurstmeister <[email protected]>
Date: 2014-02-08T08:32:25Z
preparing for tag
commit 312408a5c2d22bc2a1578d940c92417e05f94412
Author: wurstmeister <[email protected]>
Date: 2014-02-08T08:47:12Z
update to next snapshot version
commit b6b1f1d8fb5a56cf14c44ff46aa513e0fa4e99ab
Author: Danijel Schiavuzzi <[email protected]>
Date: 2014-02-11T14:28:59Z
Make the spout's Storm Metrics' time bucket size configurable via
TridentKafkaConfig. Leave the default time bucket size at 60 seconds.
commit 2a0757ace47466e4ce13f670e977128c546c0349
Author: Danijel Schiavuzzi <[email protected]>
Date: 2014-02-17T10:43:20Z
Update pom.xml
Revert custom changes
commit 71119ce131a1c618759231ed9d4aca0468ff4055
Author: wurstmeister <[email protected]>
Date: 2014-02-19T22:48:37Z
Merge pull request #22 from dschiavu/configurable-metrics-emit-interval
Make the spout's Storm metrics time bucket size configurable via
TridentKafkaConfig. Leave the default time bucket size at 60 seconds.
commit f8afa99c3036918291c694163e81fd4f22e0460b
Author: wurstmeister <[email protected]>
Date: 2014-02-19T22:55:45Z
use metricsTimeBucketSizeInSecs consistently
commit 4de85c8e7f6f4244be9eb688c6a4576a9c88c2a1
Author: wurstmeister <[email protected]>
Date: 2014-02-23T12:48:56Z
Added support for reading message key
commit bd0cc453a5d7389eb2a92bacef46c13b436a0316
Author: wurstmeister <[email protected]>
Date: 2014-02-23T16:10:38Z
fixed tests
commit c695c1b06cd1f44fbbe1181a41a6c4ffe2186e01
Author: Danijel Schiavuzzi <[email protected]>
Date: 2014-02-20T17:09:25Z
Add a new per-partition and total metric, "earliestTimeOffset". Rename
"latestTime" metric to "latestTimeOffset" to more closely conform to
other, related metrics' nomenclature.
commit f573001db106d6b8d6af2167bb2b88f38a3738e5
Author: wurstmeister <[email protected]>
Date: 2014-02-26T22:08:36Z
preparing for tag
commit 118cec43b19eec2ed1d66f6dd0aac7209edfde96
Author: wurstmeister <[email protected]>
Date: 2014-02-26T22:38:21Z
added Kafka bolt
commit 09ae97303d3faa0b4b837a3bbe18b996854d2733
Author: wurstmeister <[email protected]>
Date: 2014-02-27T22:26:35Z
Merge pull request #25 from dschiavu/new-metric-earliest-offset
Add a new per-partition and total metric, "earliestTimeOffset"
commit 9796b5270450cbb914ada62996dd631f92209f4e
Author: P. Taylor Goetz <[email protected]>
Date: 2014-03-18T15:35:33Z
Merge remote-tracking branch 'original/master' into merge
commit c62d2e115fd2fcbdb2f8030913ac8492ea59c302
Author: P. Taylor Goetz <[email protected]>
Date: 2014-03-18T15:42:48Z
update storm to 0.9.1-incubating
commit e1b6fb4db4554ba4d8cacc1d1fcdea9eabfcaa17
Author: P. Taylor Goetz <[email protected]>
Date: 2014-03-18T16:35:34Z
Merge branch 'master' of github.com:wurstmeister/storm-kafka-0.8-plus
commit 84f04c3fea11ccb6844bdef7baf8e6f654637981
Author: P. Taylor Goetz <[email protected]>
Date: 2014-03-18T19:36:09Z
align with 0.9.2-incubating dependencies.
commit 2f45866c8e011ac4804c940ff9e1d7c147591761
Author: wurstmeister <[email protected]>
Date: 2014-03-31T06:35:22Z
fixed KafkaSpout partition assignment
* added partitions -> task mapping logging
commit 9129536cd91ea2b54df5ba2a4eb524aa064c56a1
Author: wurstmeister <[email protected]>
Date: 2014-03-31T21:48:08Z
upgraded storm to 0.9.1
commit 93ca65457201948d6be1f994f5a046ea0fe477a1
Author: wurstmeister <[email protected]>
Date: 2014-04-03T20:18:08Z
Update README.md
added yourkit acknowledgement
commit 98cfe93010ff069af2f7c607b11e6735060e2405
Author: wurstmeister <[email protected]>
Date: 2014-04-05T12:19:46Z
close resources in tests
commit 9370c5ccaab437f2aa1c0f5fad55802aaa3b2b96
Author: wurstmeister <[email protected]>
Date: 2014-04-05T12:44:35Z
updated log messages
commit c8c04a6a6d9575f700d4c3db35927ddb5347a265
Author: wurstmeister <[email protected]>
Date: 2014-04-05T13:03:49Z
removed duplicated code
commit adab172a7d5621eb4497f9ec511f43c04991b2e3
Author: P. Taylor Goetz <[email protected]>
Date: 2014-04-09T13:32:23Z
Merge branch 'master' of github.com:wurstmeister/storm-kafka-0.8-plus
commit 8fafbad96bce19a3f11add249d613f9009f9cf17
Author: P. Taylor Goetz <[email protected]>
Date: 2014-04-09T13:33:50Z
Merge branch 'master' of
/Users/tgoetz/Projects/apache/../other/storm-kafka-0.8-plus
commit 7d1bf2a923f8416197f81b467d40f959b2f4f997
Author: P. Taylor Goetz <[email protected]>
Date: 2014-04-09T14:26:08Z
Add storm-kafka as an external module.
commit a72aafae503c8314b26330e0d4f440fb4632a483
Author: P. Taylor Goetz <[email protected]>
Date: 2014-04-09T14:33:16Z
update to kafka 0.8.1
commit 859a2e81be8f61720fc2965acef5f73f1449a7bb
Author: P. Taylor Goetz <[email protected]>
Date: 2014-04-09T14:57:37Z
add topic to committed path
commit 3270dd2a83f5b78d51f23ae1b8b6e3951c60b2c0
Author: P. Taylor Goetz <[email protected]>
Date: 2014-04-09T15:26:33Z
update README
commit 72dbbee75fe2524ac4ffc2da6f5166483af7ad32
Author: P. Taylor Goetz <[email protected]>
Date: 2014-04-09T15:40:53Z
apply Apache license headers
----
> Add storm-kafka as a module
> ---------------------------
>
> Key: STORM-208
> URL: https://issues.apache.org/jira/browse/STORM-208
> Project: Apache Storm (Incubating)
> Issue Type: Sub-task
> Reporter: P. Taylor Goetz
>
> Current repo is storm-contrib: https://github.com/nathanmarz/storm-contrib
> storm-kafka is still part of storm-contrib, but we can extract it to a
> separate git repo using the technique described here:
> https://github.com/nathanmarz/storm-contrib/pull/25#issuecomment-14097010
> Similar techniques can be used to incorporate it and it's commit history into
> a parent project like the apache/incubator-storm repo.
--
This message was sent by Atlassian JIRA
(v6.2#6252)
