Re: Storm elasticsearch Integration Issue
Hello.
>From elasticsearch point of view , it makes sense not specifying the
cluster name when configuring the spout. You all need to know is the target
data node when sending bulk requests.
Looks like the official document , even in the latest snapshot, is not
updated.
http://storm.apache.org/releases/2.0.0-SNAPSHOT/storm-elasticsearch.html
EsConfig params
ArgDescriptionType
clusterName Elasticsearch cluster name String (required)
nodes Elasticsearch nodes in a String array, each element should follow
{host}:{port} pattern String array (required)
additionalParameters Additional Elasticsearch Transport Client
configuration parameters Map (optional)
Client maintained by elastic might be a second choice for you.
https://www.elastic.co/guide/en/elasticsearch/hadoop/current/storm.html#storm-cfg-spout
Thanks,
Yu
On Fri, Sep 21, 2018 at 7:28 PM praveen puskar
wrote:
> Forgot to provide link to the official documnetation :
> http://storm.apache.org/releases/1.1.2/storm-elasticsearch.html
>
> On Fri, Sep 21, 2018 at 12:13 PM praveen puskar
> wrote:
>
>> Hi,
>>
>> I am using transport client in Apache Storm trident to create a bulk
>> update request to elastic search. Then i came across "Storm ElasticSearch
>> integration", while trying out i spent much time resolving compilation
>> issue.
>>
>> The official documentation says :
>>
>> EsConfig esConfig = new EsConfig(clusterName, new
>> String[]{"localhost:9300"});
>>
>>
>> But going through the git source code and history of EsConfig class. The
>> *class
>> no more takes cluster-name as an argument*, and was removed in this
>> commit
>>
>> and committed on Mar 13, 2017
>>
>> Is there a different group where i should report this issue ?
>>
>> --
>> Kind Regards
>> Praveen Puskar
>>
>>
>>
>>
>>
>> Please save TREE. Save the Environment. Make a contribution in retarding
>> Global Warming.
>>
>>Please do not print this email unless it is absolutely necessary.
>>
>
>
> --
> Regards
> Praveen Puskar
>
>
>
> Please save TREE. Save the Environment. Make a contribution in retarding
> Global Warming.
>
>Please do not print this email unless it is absolutely necessary.
>
--
Yu Watanabe
渡辺 裕
LinkedIn : jp.linkedin.com/in/yuwatanabe1
Re: [VOTE] Release Apache Storm 2.0.0 (rc1)
+1 I rebuilt the code from the git tag and all of the unit/integration tests passed. I also ran a single node cluster with both some simple functionality and performance tests and everything looked good. On a side note we just deployed a version based off of the same code as 2.0.0 to staging (think just some packaging differences and a few plugins), but with the compatibility layer to run older topologies and everything is looking good so far. Thanks, Bobby On Fri, Sep 21, 2018 at 1:25 PM P. Taylor Goetz wrote: > This is a call to vote on releasing Apache Storm 2.0.0 (rc1) > > Full list of changes in this release: > > > https://dist.apache.org/repos/dist/dev/storm/apache-storm-2.0.0-rc1/RELEASE_NOTES.html > > The tag/commit to be voted upon is v2.0.0: > > > https://git-wip-us.apache.org/repos/asf?p=storm.git;a=tree;h=062bb2f158a66b802a3ad7bdda14fb8f70cf9b88;hb=062bb2f158a66b802a3ad7bdda14fb8f70cf9b88 > > The source archive being voted upon can be found here: > > > https://dist.apache.org/repos/dist/dev/storm/apache-storm-2.0.0-rc1/apache-storm-2.0.0-src.tar.gz > > Other release files, signatures and digests can be found here: > > https://dist.apache.org/repos/dist/dev/storm/apache-storm-2.0.0-rc1/ > > The release artifacts are signed with the following key: > > > https://git-wip-us.apache.org/repos/asf?p=storm.git;a=blob_plain;f=KEYS;hb=22b832708295fa2c15c4f3c70ac0d2bc6fded4bd > > The Nexus staging repository for this release is: > > https://repository.apache.org/content/repositories/orgapachestorm-1070 > > Please vote on releasing this package as Apache Storm 2.0.0. > > When voting, please list the actions taken to verify the release. > > This vote will be open for at least 72 hours. > > [ ] +1 Release this package as Apache Storm 2.0.0 > [ ] 0 No opinion > [ ] -1 Do not release this package because... > > Thanks to everyone who contributed to this release. > > -Taylor >
[VOTE] Release Apache Storm 2.0.0 (rc1)
This is a call to vote on releasing Apache Storm 2.0.0 (rc1) Full list of changes in this release: https://dist.apache.org/repos/dist/dev/storm/apache-storm-2.0.0-rc1/RELEASE_NOTES.html The tag/commit to be voted upon is v2.0.0: https://git-wip-us.apache.org/repos/asf?p=storm.git;a=tree;h=062bb2f158a66b802a3ad7bdda14fb8f70cf9b88;hb=062bb2f158a66b802a3ad7bdda14fb8f70cf9b88 The source archive being voted upon can be found here: https://dist.apache.org/repos/dist/dev/storm/apache-storm-2.0.0-rc1/apache-storm-2.0.0-src.tar.gz Other release files, signatures and digests can be found here: https://dist.apache.org/repos/dist/dev/storm/apache-storm-2.0.0-rc1/ The release artifacts are signed with the following key: https://git-wip-us.apache.org/repos/asf?p=storm.git;a=blob_plain;f=KEYS;hb=22b832708295fa2c15c4f3c70ac0d2bc6fded4bd The Nexus staging repository for this release is: https://repository.apache.org/content/repositories/orgapachestorm-1070 Please vote on releasing this package as Apache Storm 2.0.0. When voting, please list the actions taken to verify the release. This vote will be open for at least 72 hours. [ ] +1 Release this package as Apache Storm 2.0.0 [ ] 0 No opinion [ ] -1 Do not release this package because... Thanks to everyone who contributed to this release. -Taylor signature.asc Description: Message signed with OpenPGP
Hadoop Contributor Meetup
There is a Hadoop Contributor Meetup at Oath/Yahoo on Monday in Sunnyvale CA https://www.meetup.com/Hadoop-Contributors/events/254012512/ This is short notice and we tend to be distributed very geographically as an open source project, but I am going to be there and if anyone wants to show up to talk about storm/stream processing that would be great. Also happy to talk after the event. just send me an email at bo...@apache.org and we can schedule something. Thanks, Bobby
[GitHub] storm issue #2844: STORM-3232: Display on the UI all versions of storm that ...
Github user revans2 commented on the issue: https://github.com/apache/storm/pull/2844 Some example screen shots. On the last one I had to remove the git repo and user name because of work requirements :( https://user-images.githubusercontent.com/3441321/45886457-d3199c00-bd7e-11e8-857e-cc0c4aff4ea1.png;> https://user-images.githubusercontent.com/3441321/45886476-db71d700-bd7e-11e8-9258-c2e4fe9891f4.png;> https://user-images.githubusercontent.com/3441321/45886492-e462a880-bd7e-11e8-9a7b-ce5749fc778e.png;> https://user-images.githubusercontent.com/3441321/45886565-0f4cfc80-bd7f-11e8-8f59-5e0f77b407d7.png;> ---
[GitHub] storm pull request #2844: STORM-3232: Display on the UI all versions of stor...
GitHub user revans2 opened a pull request: https://github.com/apache/storm/pull/2844 STORM-3232: Display on the UI all versions of storm that are supported Also display the full version info from STORM-621 You can merge this pull request into a Git repository by running: $ git pull https://github.com/revans2/incubator-storm STORM-3232 Alternatively you can review and apply these changes as the patch at: https://github.com/apache/storm/pull/2844.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #2844 commit 70dd313e2be5c6ea6ca7d30fbdb05960cc3c6b33 Author: Robert (Bobby) Evans Date: 2018-09-19T14:08:32Z STORM-3232: Display on the UI all the versions of storm supported. commit 1f1fb0a129a2bbf3a5065af08fc28e309612dea6 Author: Robert (Bobby) Evans Date: 2018-09-21T13:41:29Z STORM-621: Added in full version info ---
