Due to some constraints i have to get application up and running for flume 0.x. Once app is up, i will surely try flume 1.x. Shouvanik
Sent from Samsung mobile Alexander Alten-Lorenz <[email protected]> wrote: May you ask terracotta forums? http://forums.terracotta.org/forums/forums/list.page And again - we strongly kick you into Flume 1.x. Flume 0.9x will getting only security updates, when ever. Regards, Alex On Dec 11, 2012, at 1:45 PM, [email protected] wrote: > Also, when I check the terracotta logs at > "/mnt/terracotta-ee-3.6.1/bin/logs/terracotta-server.log", I get the error as > > "2012-12-11 07:44:44,000 [L2_L1:TCComm Main Selector Thread_R (listen > 0:0:0:0:0:0:0:0:9510)] INFO com.tc.net.core.CoreNIOServices - selection key > cancelled key@341752521 > 2012-12-11 07:44:54,700 [L2_L1:TCComm Main Selector Thread_R (listen > 0:0:0:0:0:0:0:0:9510)] INFO com.tc.net.core.CoreNIOServices - selection key > cancelled key@431432310 > 2012-12-11 07:45:05,071 [L2_L1:TCComm Main Selector Thread_R (listen > 0:0:0:0:0:0:0:0:9510)] INFO com.tc.net.core.CoreNIOServices - selection key > cancelled key@1169921331" > > > > > Thanks and Regards, > Shouvanik Haldar | Cloud SME Pool | Mobile:+91-9830017568 > > > -----Original Message----- > From: Haldar, Shouvanik > Sent: Tuesday, December 11, 2012 6:13 PM > To: '[email protected]' > Cc: '[email protected]' > Subject: RE: Getting weird error -> 2012-12-10 01:01:42,190 INFO > com.cloudera.flume.watchdog.Watchdog: Subprocess exited with value 1 > > Getting a weird error in > "/usr/lib/flume/logs-10.40.222.77/terracotta-client.log". > > > The error says > > "2012-12-11 07:31:13,909 [logicalNode > ec2-75-101-165-36.compute-1.amazonaws.com-19] ERROR > com.terracottatech.console - Terracotta license key is required for > Enterprise capabilities. Please place terracotta-license.key in Terracotta > installed directory or in resource path. You could also specify it through > system property -Dcom.tc.productkey.path=/path/to/key > 2012-12-11 07:31:13,914 [logicalNode > ec2-75-101-165-36.compute-1.amazonaws.com-19] ERROR > com.tc.license.LicenseManager - License key not found > org.terracotta.license.LicenseException" > > But, I am sure and it shows in terracotta log that license key is getting > loaded from the location > > "2012-12-11 07:29:48,712 INFO - Terracotta Enterprise 3.6.1, as of > 20120125-122228 (Revision 15328-19619 by cruise@su10vmo104 from 3.6.1) > 2012-12-11 07:29:49,300 INFO - Successfully loaded base configuration from > file at '/mnt/terracotta-ee-3.6.1/bin/tc-config.xml'. > 2012-12-11 07:29:49,363 INFO - Log file: > '/mnt/terracotta-ee-3.6.1/bin/logs/terracotta-server.log'. > 2012-12-11 07:29:49,422 INFO - Terracotta license loaded from > /mnt/terracotta-ee-3.6.1/terracotta-license.key > Capabilities: DCV2, TMC, authentication, ehcache, ehcache offheap, operator > console, quartz, quartz manager, quartz where, roots, search, security, > server array offheap, server striping, sessions > Date of Issue: 2012-09-24 > Edition: FX > Expiration Date: 2012-12-31 > License Number: Download Trial License - Accept > License Type: Trial > Licensee: Download Trial License - Accept > Max Client Count: 50 > Product: Enterprise Suite > ehcache.maxOffHeap: 250G > terracotta.serverArray.maxOffHeap: 250G > > 2012-12-11 07:29:51,857 INFO - Available Max Runtime Memory: 490MB > 2012-12-11 07:29:54,228 INFO - JMX Server started. Available at > URL[service:jmx:jmxmp://0.0.0.0:9520] > 2012-12-11 07:30:01,233 INFO - Becoming State[ ACTIVE-COORDINATOR ] > 2012-12-11 07:30:01,312 INFO - Terracotta Server instance has started up as > ACTIVE node on 0:0:0:0:0:0:0:0:9510 successfully, and is now ready for work." > > > But, when I see the logs at > "/var/log/flume/flume-flume-node-ip-10-40-222-77.out", I get the error as > > "2012-12-11 07:31:13,909 ERROR - Terracotta license key is required for > Enterprise capabilities. Please place terracotta-license.key in Terracotta > installed directory or in resource path. You could also specify it through > system property -Dcom.tc.productkey.path=/path/to/key" > > Please help! > > > Thanks and Regards, > Shouvanik Haldar | Cloud SME Pool | Mobile:+91-9830017568 > > > -----Original Message----- > From: Haldar, Shouvanik > Sent: Tuesday, December 11, 2012 2:05 PM > To: '[email protected]'; '[email protected]' > Cc: Haldar, Shouvanik > Subject: RE: Getting weird error -> 2012-12-10 01:01:42,190 INFO > com.cloudera.flume.watchdog.Watchdog: Subprocess exited with value 1 > > The previous error is now resolved. Actually some jars were missing which > flume requires. Some errors are still there..I will let you know in a short > while. > > > > Thanks and Regards, > Shouvanik Haldar | Cloud SME Pool | Mobile:+91-9830017568 > > > -----Original Message----- > From: Haldar, Shouvanik > Sent: Tuesday, December 11, 2012 1:42 PM > To: [email protected]; [email protected] > Subject: RE: Getting weird error -> 2012-12-10 01:01:42,190 INFO > com.cloudera.flume.watchdog.Watchdog: Subprocess exited with value 1 > > Hi, > > This error is removed. I copied flume-node as flume-master, replace all > "node" with "master" and thus it worked! Thanks > > Now, I am facing a new weird error. I had mentioned source and sink. Now, > Flume node status is set to "OPENING" and nothing else is happening even I do > a refresh. > > In the flume-master console, I executed the below mentioned commands at the > "Configure multiple nodes" textarea! > > Please help me. Which logs should I check! > > Commands at "Configure multiple nodes" textarea > --------------------------------------------------- > ec2-75-101-165-36.compute-1.amazonaws.com:tail("/var/log/flume/test1.log")|agentBESink("ec2-75-101-165-36.compute-1.amazonaws.com",35853); > ec2-75-101-165-36.compute-1.amazonaws.com:collectorSource(35853)|EHCacheSink("Y","/var/log/flume"); > > When I tail the log at "/var/log/flume/flume-flume-node-ip-10-40-222-77.log", > the logs don't move after > > "2012-12-11 02:59:48,598 INFO com.cloudera.flume.conf.SinkFactoryImpl: Found > sink decorator EHCacheDecorator in com.EHCacheDecorator > 2012-12-11 02:59:48,644 INFO com.cloudera.flume.agent.LogicalNode: Node > config successfully set to FlumeConfigData: {srcVer:'Wed Dec 31 19:00:00 EST > 1969' snkVer:'Wed Dec 31 19:00:00 EST 1969' ts='Wed Dec 31 19:00:00 EST > 1969' flowId:'null' source:'null' sink:'null' } > 2012-12-11 02:59:48,771 INFO com.cloudera.flume.agent.FlumeNode: Hadoop > Security enabled: false > 2012-12-11 02:59:53,484 INFO com.EHCacheSink: EHCacheSink: setting EHCache > Debug=Y debugfilePath=/var/log/flume > 2012-12-11 02:59:53,486 INFO com.cloudera.flume.collector.CollectorSource: > opened > 2012-12-11 02:59:53,486 INFO com.cloudera.flume.agent.LogicalNode: Node > config successfully set to FlumeConfigData: {srcVer:'Tue Dec 11 02:55:27 EST > 2012' snkVer:'Tue Dec 11 02:55:27 EST 2012' ts='Tue Dec 11 02:55:27 EST > 2012' flowId:'default-flow' source:'collectorSource( 35853 )' > sink:'EHCacheSink( "Y", "/var/log/flume" )' } > 2012-12-11 02:59:53,498 INFO > com.cloudera.flume.handlers.thrift.ThriftEventSource: Starting blocking > thread pool server on port 35853..." > > > When I do a "netstat -nlp| grep 35853" > I get > "[root@ip-10-40-222-77 bin]# netstat -nlp| grep 35853 > tcp 0 0 :::35853 :::* > LISTEN 21096/java > > " > > Please help! > > Thanks and Regards, > Shouvanik Haldar | Cloud SME Pool | Mobile:+91-9830017568 > > -----Original Message----- > From: Alexander Alten-Lorenz [mailto:[email protected]] > Sent: Tuesday, December 11, 2012 1:03 PM > To: [email protected] > Cc: [email protected] > Subject: Re: Getting weird error -> 2012-12-10 01:01:42,190 INFO > com.cloudera.flume.watchdog.Watchdog: Subprocess exited with value 1 > > Hi, > > yum remove --force <paketname> > > Or simply create a empty file called /etc/init.d/flume-master: > > echo "foo" > /etc/init.d/flume-master > > best > - Alex > > On Dec 11, 2012, at 8:27 AM, [email protected] wrote: > >> Hi, >> >> Can you please help me on one thing! Mistakenly deleted >> /etc/init.d/flume-master script. Now flume-master is not getting uninstalled >> or removed! Please help! >> >> Thanks and Regards, >> Shouvanik Haldar | Cloud SME Pool | Mobile:+91-9830017568 >> >> From: Nitin Pawar [mailto:[email protected]] >> Sent: Tuesday, December 11, 2012 12:55 PM >> To: Haldar, Shouvanik >> Cc: [email protected] >> Subject: Re: Getting weird error -> 2012-12-10 01:01:42,190 INFO >> com.cloudera.flume.watchdog.Watchdog: Subprocess exited with value 1 >> >> there is no master/slave architecture now >> >> its a simple conf file like below <@EOM> and then just start the agent. it >> will do needful >> you need to start flume like the command below >> >> >> >> >> bin/flume-ng agent --conf-file example.conf --name agent1 >> >> >> agent1.sources = tail >> agent1.channels = MemoryChannel-2 >> agent1.sinks = HDFS >> agent1.sources.tail.type = exec >> agent1.sources.tail.command = tail -F <file> >> agent1.sources.tail.channels = MemoryChannel-2 >> agent1.sources.tail.interceptors = hostint >> agent1.sources.tail.interceptors.hostint.type = >> org.apache.flume.interceptor.HostInterceptor$Builder >> agent1.sources.tail.interceptors.hostint.preserveExisting = true >> agent1.sources.tail.interceptors.hostint.useIP = true >> agent1.sinks.HDFS.channel = MemoryChannel-2 >> agent1.sinks.HDFS.type = hdfs >> agent1.sinks.HDFS.hdfs.path = hdfs://url:8020/user/flume/%{host} >> agent1.sinks.HDFS.hdfs.file.Type = SequenceFile >> agent1.sinks.HDFS.hdfs.writeFormat = Text >> agent1.sinks.HDFS.hdfs.rollInterval = 30 >> agent1.sinks.HDFS.hdfs.rollCount = 0 >> agent1.sinks.HDFS.hdfs.rollSize = 5000000000 >> agent1.channels.MemoryChannel-2.type = memory >> >> more examples at http://flume.apache.org/FlumeUserGuide.html >> >> >> On Tue, Dec 11, 2012 at 12:44 PM, >> <[email protected]<mailto:[email protected]>> >> wrote: >> Hi, >> I installed flume 1.x higher version today! But is this very much different >> from the earlier. ? Is there no master / node concept here? How do I >> configure the source and sink? >> >> Think I got screwed here! >> >> Thanks and Regards, >> Shouvanik Haldar | Cloud SME Pool | >> Mobile:+91-9830017568<tel:%2B91-9830017568> >> >> From: Nitin Pawar >> [mailto:[email protected]<mailto:[email protected]>] >> Sent: Monday, December 10, 2012 3:34 PM >> >> To: Haldar, Shouvanik >> Cc: [email protected]<mailto:[email protected]> >> Subject: Re: Getting weird error -> 2012-12-10 01:01:42,190 INFO >> com.cloudera.flume.watchdog.Watchdog: Subprocess exited with value 1 >> >> just a random question, does the user running flume agent have permission to >> read the event details out of terracotta ? >> >> from the code here >> http://grepcode.com/file/repository.cloudera.com/content/repositories/releases/com.cloudera/flume-core/0.9.4-cdh4.1.0/com/cloudera/flume/watchdog/Watchdog.java >> >> line 209 onwards, it looks like the error condition is achieved when you >> have channel set as stdin (I am not sure about this so you may need to look >> at code which part of code you are hitting depending on the flume configs >> you have) >> >> >> >> On Mon, Dec 10, 2012 at 3:01 PM, >> <[email protected]<mailto:[email protected]>> >> wrote: >> Hello, >> >> I am sure, the problem is due to Terracotta. Can you please help me? >> >> Thanks and Regards, >> Shouvanik Haldar | Cloud SME Pool | >> Mobile:+91-9830017568<tel:%2B91-9830017568> >> >> From: Nitin Pawar >> [mailto:[email protected]<mailto:[email protected]>] >> Sent: Monday, December 10, 2012 2:43 PM >> To: Haldar, Shouvanik >> Cc: [email protected]<mailto:[email protected]> >> >> Subject: Re: Getting weird error -> 2012-12-10 01:01:42,190 INFO >> com.cloudera.flume.watchdog.Watchdog: Subprocess exited with value 1 >> >> I just hope you are not hitting this >> https://issues.apache.org/jira/browse/FLUME-796 >> I would also like to recommend you to upgraded to flume 1.x asap >> >> if possible can you try changing your flume source to some random file with >> tail -f and try sinking it to some file. That will narrow the problem is on >> flume side or terracotta side >> >> Thanks, >> Nitin >> >> On Mon, Dec 10, 2012 at 1:47 PM, >> <[email protected]<mailto:[email protected]>> >> wrote: >> Hi, >> >> I am using Flume -> Flume 0.9.4-cdh3u5. >> >> Initially, the logs are ok. But when I start terracotta >> (./start-tc-server.sh) , then only I experience the above phenomena! Is it >> something to do with terracotta.! >> >> >> 2012-12-10 03:14:08,806 INFO >> com.cloudera.flume.handlers.thrift.ThriftEventSource: Starting blocking >> thread pool server on port 35853... >> 2012-12-10 03:14:08,894 INFO net.sf.ehcache.terracotta.TerracottaClient: >> Thread [logicalNode ec2-75-101-165-36.compute-1.amazonaws.com-19] >> [cacheManager: 'RTLogCacheManager']: Creating new ClusteredInstanceFactory >> >> Before starting terracotta, Flume Node status is "OPENING". >> But when I start terracotta, I got the error "INFO >> com.cloudera.flume.watchdog.Watchdog: Subprocess exited with value 1" >> >> Please help ! >> >> >> Thanks and Regards, >> Shouvanik Haldar | Cloud SME Pool | >> Mobile:+91-9830017568<tel:%2B91-9830017568> >> >> From: Nitin Pawar >> [mailto:[email protected]<mailto:[email protected]>] >> Sent: Monday, December 10, 2012 12:52 PM >> To: [email protected]<mailto:[email protected]> >> Cc: Haldar, Shouvanik >> Subject: Re: Getting weird error -> 2012-12-10 01:01:42,190 INFO >> com.cloudera.flume.watchdog.Watchdog: Subprocess exited with value 1 >> >> what version of flume are you using? If it is < 1.x then recommend you to >> upgrade to latest 1.0.3 >> If you are on 1.x then can you tell us whats the hostname for your server? >> >> On Mon, Dec 10, 2012 at 11:40 AM, >> <[email protected]<mailto:[email protected]>> >> wrote: >> Before the below mentioned error, I get a success message like >> >> 2012-12-10 01:09:14,403 INFO net.sf.ehcache.terracotta.TerracottaClient: >> Thread [logicalNode ec2-75-101-165-36.compute-1.amazonaws.com-19] >> [cacheManager: 'RTLogCacheManager']: Creating new ClusteredInstanceFactory >> >> Thanks and Regards, >> Shouvanik Haldar | Cloud SME Pool | >> Mobile:+91-9830017568<tel:%2B91-9830017568> >> >> From: Haldar, Shouvanik >> Sent: Monday, December 10, 2012 11:34 AM >> To: '[email protected]<mailto:[email protected]>' >> Subject: Getting weird error -> 2012-12-10 01:01:42,190 INFO >> com.cloudera.flume.watchdog.Watchdog: Subprocess exited with value 1 >> >> I had configured flume-master as well as flume-node on a single machine. >> Now, as I run terracotta -> L1 cache, I get the INFO below in / >> >> 2012-12-10 01:01:42,190 INFO com.cloudera.flume.watchdog.Watchdog: >> Subprocess exited with value 1 >> >> Can you please help? I am struggling with this for the past 1 day without >> success! >> >> Thanks and Regards, >> Shouvanik Haldar | Cloud SME Pool | >> Mobile:+91-9830017568<tel:%2B91-9830017568> >> >> >> ________________________________ >> This message is for the designated recipient only and may contain >> privileged, proprietary, or otherwise private information. If you have >> received it in error, please notify the sender immediately and delete the >> original. Any other use of the e-mail by you is prohibited. >> >> Where allowed by local law, electronic communications with Accenture and its >> affiliates, including e-mail and instant messaging (including content), may >> be scanned by our systems for the purposes of information security and >> assessment of internal compliance with Accenture policy. >> >> ______________________________________________________________________________________ >> >> www.accenture.com<http://www.accenture.com> >> >> >> >> -- >> Nitin Pawar >> >> >> >> -- >> Nitin Pawar >> >> >> >> -- >> Nitin Pawar >> >> >> >> -- >> Nitin Pawar > > -- > Alexander Alten-Lorenz > http://mapredit.blogspot.com > German Hadoop LinkedIn Group: http://goo.gl/N8pCF > > > -- Alexander Alten-Lorenz http://mapredit.blogspot.com German Hadoop LinkedIn Group: http://goo.gl/N8pCF
