I thought the zookeeper logs were unreadable. For the worker logs, I use logrotate and keep them on the drive. Moving to S3 could be done with a cron job. Or you could look at loggly/cloudtrail. Id be curious what others are doing in production as well.
S On Mon, Mar 3, 2014 at 7:31 AM, Spico Florin <[email protected]> wrote: > Hello, Sean! > Thank you very much for your response. I would like to know how did you > manage the logs of zookeeper and also the one from storm? Have you used > Amazon S3? > Or where the logs are located (on the ephemeral drive)? > Best regards, > Florin > > > On Mon, Mar 3, 2014 at 4:19 PM, Sean Solbak <[email protected]> wrote: > >> Take a look at >> https://github.com/nathanmarz/storm/wiki/Setting-up-a-Storm-cluster >> >> I use storm deploy <https://github.com/nathanmarz/storm-deploy>. It >> takes care of most of the setup to an aws cluster. This link is also worth >> reading. >> http://blog.safaribooksonline.com/2013/12/27/storm-deploy-amazon-ec2/ >> >> What specific services from amazon you use will depend on your >> requirements for your topologies. So far all we have used is EC2 and Cloud >> Watch. >> >> S >> >> >> >> >> >> >> On Mon, Mar 3, 2014 at 2:33 AM, Spico Florin <[email protected]>wrote: >> >>> Hello! >>> I would like to deploy a storm application on Amazon Cloud. >>> Therefore, I would like to know what Amazon services should I use in >>> order to deploy? >>> For example: Amazon Elastic Cloud, Amazon S3, Amazon CloudWatch? >>> If somebody has already deployed a Storm on Amazon, can you please tell >>> me what were your setup in terms of Amazon Services? >>> I look forward for your advices and suggestions. >>> Thank you. >>> Regards, >>> Florin >>> >>> >> >> >> -- >> Thanks, >> >> Sean Solbak, BsC, MCSD >> Solbak Technologies Inc. >> 780.893.7326 (m) >> > > -- Thanks, Sean Solbak, BsC, MCSD Solbak Technologies Inc. 780.893.7326 (m)
