how to get spout to re-emit in trident

2015-04-16 Thread 王天驹
hi, I am new to trident, when we use low level storm api, we call fail(tuple) to tell spout to re-emit tuple what shall we do in trident to get the spout to re-emit? throw a runtime exception? thx

An exception occured while executing the Java class. java.lang.InterruptedException

2015-04-16 Thread Chun Yuen Lim
I get my Apache Storm from http://mirror.symnds.com/software/Apache/storm/apache-storm-0.9.3/apache-storm-0.9.3.tar.gz I never modified any thing in the /home/user/storm/examples/storm-starter/ directory. When I run mvn exec:java -D storm.topology=storm.starter.WordCountTopology in the

Re: ShellBolt / Bash invocation: Source environment variables

2015-04-16 Thread Johannes Hugo Kitschke
To answer my own question (maybe it's useful for someone else): My findings are: - bash is launched as non-login, non-interactive shell for the shell bolt - in this mode bash looks for a path/file in the environment variable 'BASH_ENV', if it exists that file is sourced - now I only had to

Storm 0.9.4 on yarn

2015-04-16 Thread Sandeep Samudrala
I was running storm on yarn using https://github.com/yahoo/storm-yarn; but yahoo storm on yarn was integrated with storm-0.9.0-wip21, which is bit older version. We tried patching storm 0.9.4 with storm-on-yarn and then deploy storm on yarn cluster.The Storm UI shows up with. Page not found Is

RE: how to get spout to re-emit in trident

2015-04-16 Thread Brunner, Bill
You would throw a FailedException From: 王天驹 [mailto:wangtianju@gmail.com] Sent: Thursday, April 16, 2015 4:39 AM To: user@storm.apache.org Subject: how to get spout to re-emit in trident hi, I am new to trident, when we use low level storm api, we call fail(tuple) to tell spout to re-emit

Stuck while running storm in local mode:

2015-04-16 Thread Gaurav Pandey
I am configuring Cassendra 1.0 on CentOS 5.7 but getting stacked when running the command cassandra -f. Here is the error message- Caused by: expected 'document start', but found BlockMappingStart in 'reader', line 24, column 1: storm.zookeeper.port: 2181 ^ at

Re: Workaround until https://issues.apache.org/jira/browse/STORM-573 is fixed in a release

2015-04-16 Thread 임정택
Hello. You can try set system environment STORM_TEST_TIMEOUT_MS and run your test. It'll bind to TEST_TIMEOUT_MS and it's default timeout value of complete-topology. Hope this helps. Regards. Jungtaek Lim (HeartSaVioR) 2015-04-16 1:08 GMT+09:00 Mark Tomko mto...@broadinstitute.org: Hi, I'm

Using Storm with Kundera to write into Cassandra/HBase

2015-04-16 Thread Spico Florin
Hello! Does anyone used Kundera ( https://github.com/impetus-opensource/Kundera/wiki/Getting-Started-in-5-minutes) to write/read data from/to Cassadra/HBase? Any suggestions or github example will be appreciated. Thanks. Florin

extract storm example from 0.9.4

2015-04-16 Thread alexey yakubovich
Hi, my first time, with Storm mailing list. Good to meet you guys. How to extract the example projects from latest storm distribution (0.9.4) and have each example as a separate maven project (in eclipse)?Or, may be somebody can point me some example of storm/kafka that already have all

Re: Stuck while running storm in local mode:

2015-04-16 Thread Nishu
Since this is parsing error in storm.yaml file, check whether you have any tabspace in file. Try to remove all tab or space and rewrite. Then it should work fine. You can also validate your yaml file on yamlLint http://www.yamllint.com/. On Thu, Apr 16, 2015 at 6:35 PM, Gaurav Pandey

Regarding Storm Trident

2015-04-16 Thread Gaurav Agarwal
-- Forwarded message -- From: Gaurav Agarwal gaurav130...@gmail.com Date: Thu, 16 Apr 2015 22:40:27 +0530 Subject: Regarding Storm Trident To: us...@storm.apache.org Hello I am trying to implement trident Stream,merge,multireduce and other functions in my code . But there is no

Re: Regarding Storm Trident

2015-04-16 Thread Jake K. Dodd
https://storm.apache.org/documentation/Trident-tutorial.html https://storm.apache.org/documentation/Trident-API-Overview.html https://storm.apache.org/documentation/Trident-state Best Jake K Dodd On Apr 16, 2015, at 12:36, Gaurav Agarwal gaurav130...@gmail.com wrote: -- Forwarded

Re: Regarding Storm Trident

2015-04-16 Thread Gaurav Agarwal
i am aware of thse docs but if i have to check something about trident multireduce, merge and other methods like this where we need to go.. On 4/16/15, Jake K. Dodd j...@ontopic.io wrote: https://storm.apache.org/documentation/Trident-tutorial.html

RE: Regarding Storm Trident

2015-04-16 Thread Brunner, Bill
Its all in here: https://storm.apache.org/documentation/Trident-API-Overview.html -Original Message- From: Gaurav Agarwal [mailto:gaurav130...@gmail.com] Sent: Thursday, April 16, 2015 2:05 PM To: user@storm.apache.org Subject: Re: Regarding Storm Trident i am aware of thse docs but if

Concurrent requests to DRPC

2015-04-16 Thread Douglas Alan
Hi. We want to make a Storm topology than handles DRPC requests, and we want the requests to be handled concurrently. I.e., if a DRPC request comes into the topology at time T0 that takes a long time to complete (let's say 100 seconds), we don't want this request to block another request that

Re: Workaround until https://issues.apache.org/jira/browse/STORM-573 is fixed in a release

2015-04-16 Thread 임정택
You can refer https://github.com/apache/storm/pull/308 and below code. (def TEST-TIMEOUT-MS (let [timeout (System/getenv STORM_TEST_TIMEOUT_MS)] (parse-int (if timeout timeout 5000 Cause of some reasons, it relies system environment variable, not JVM property. 2015-04-17 2:33

Re: Supervisor repeatedly killing worker

2015-04-16 Thread Grant Overby (groverby)
I’m not, and If I had to guess I’d say it’s likely something is going wrong with the heartbeats, but how can I go about finding out? From: Paul Poulosky ppoul...@yahoo-inc.commailto:ppoul...@yahoo-inc.com Reply-To: user@storm.apache.orgmailto:user@storm.apache.org

Re: Storm is unable to connect to the network or localhost

2015-04-16 Thread Nathan Leung
The storm process is run by the same user that the supervisor is running as. On Thu, Apr 16, 2015 at 6:24 PM, Zotti, Ryan J. ryan.zo...@capitalone.com wrote: I've written a topology in Kafka and Storm. The topology works great until I try to make a Bolt that tries to either connect to the

Re: Storm is unable to connect to the network or localhost

2015-04-16 Thread Shivendra Singh
Having ip mappings in /etc/hosts is often a remedy for such issues. Maybe it can help. From: Nathan Leung ncle...@gmail.commailto:ncle...@gmail.com Reply-To: user@storm.apache.orgmailto:user@storm.apache.org user@storm.apache.orgmailto:user@storm.apache.org Date: Thursday, April 16, 2015 at

Supervisor repeatedly killing worker

2015-04-16 Thread Grant Overby (groverby)
The supervisor is reporting the worker “still hasn’t started” even though the worker is up and appears to be working. After timeout, the supervisor kills and restarts the worker. I set the timeouts really high (10 mins) to see what would happen. I though maybe a GC pause or something. The

Re: Supervisor repeatedly killing worker

2015-04-16 Thread Paul Poulosky
Are you sure the worker is writing heartbeats and the supervisor is reading them? On Thursday, April 16, 2015 1:36 PM, Grant Overby (groverby) grove...@cisco.com wrote: The supervisor is reporting the worker “still hasn’t started” even though the worker is up and appears to be