Hi, Since you asked.... :) We use our own Logsene for all our logs: http://sematext.com/logsene . This lets us correlate logs with metrics (SPM) and with events.
As for the original Q, you really need just EC2. Otis -- Performance Monitoring * Log Analytics * Search Analytics Solr & Elasticsearch Support * http://sematext.com/ On Mon, Mar 3, 2014 at 9:53 AM, Sean Solbak <[email protected]> wrote: > I thought the zookeeper logs were unreadable. > > For the worker logs, I use logrotate and keep them on the drive. Moving > to S3 could be done with a cron job. Or you could look at > loggly/cloudtrail. Id be curious what others are doing in production as > well. > > S > > > On Mon, Mar 3, 2014 at 7:31 AM, Spico Florin <[email protected]>wrote: > >> Hello, Sean! >> Thank you very much for your response. I would like to know how did you >> manage the logs of zookeeper and also the one from storm? Have you used >> Amazon S3? >> Or where the logs are located (on the ephemeral drive)? >> Best regards, >> Florin >> >> >> On Mon, Mar 3, 2014 at 4:19 PM, Sean Solbak <[email protected]> wrote: >> >>> Take a look at >>> https://github.com/nathanmarz/storm/wiki/Setting-up-a-Storm-cluster >>> >>> I use storm deploy <https://github.com/nathanmarz/storm-deploy>. It >>> takes care of most of the setup to an aws cluster. This link is also worth >>> reading. >>> http://blog.safaribooksonline.com/2013/12/27/storm-deploy-amazon-ec2/ >>> >>> What specific services from amazon you use will depend on your >>> requirements for your topologies. So far all we have used is EC2 and Cloud >>> Watch. >>> >>> S >>> >>> >>> >>> >>> >>> >>> On Mon, Mar 3, 2014 at 2:33 AM, Spico Florin <[email protected]>wrote: >>> >>>> Hello! >>>> I would like to deploy a storm application on Amazon Cloud. >>>> Therefore, I would like to know what Amazon services should I use in >>>> order to deploy? >>>> For example: Amazon Elastic Cloud, Amazon S3, Amazon CloudWatch? >>>> If somebody has already deployed a Storm on Amazon, can you please tell >>>> me what were your setup in terms of Amazon Services? >>>> I look forward for your advices and suggestions. >>>> Thank you. >>>> Regards, >>>> Florin >>>> >>>> >>> >>> >>> -- >>> Thanks, >>> >>> Sean Solbak, BsC, MCSD >>> Solbak Technologies Inc. >>> 780.893.7326 (m) >>> >> >> > > > -- > Thanks, > > Sean Solbak, BsC, MCSD > Solbak Technologies Inc. > 780.893.7326 (m) >
