Are you running an HDP cluster; if so what version? If you are running another Hadoop-y distribution, which one and version?
Any chance you can try with 'master'? On Wed, Jun 7, 2017 at 7:31 PM, tkg_cangkul <[email protected]> wrote: > yes i've try to run other MR job there and it's succeed. > there is no problem when i run other MR job on my cluster. > > > On 08/06/17 02:13, Nick Allen wrote: > > Are you able to run any MR jobs in your environment? You could test that > by using one of the Hadoop examples, if you don't normally run anything > else. > > > $ find /usr/hdp/ -name "*hadoop*example*.jar" > /usr/hdp/2.5.3.0-37/hadoop-mapreduce/hadoop-mapreduce-examples.jar > /usr/hdp/2.5.3.0-37/hadoop-mapreduce/hadoop-mapreduce- > examples-2.7.3.2.5.3.0-37.jar > > $ yarn jar /usr/hdp/2.5.3.0-37/hadoop-mapreduce/hadoop-mapreduce-examples.jar > pi 16 1000 > Number of Maps = 16 > Samples per Map = 1000 > Wrote input for Map #0 > Wrote input for Map #1 > ... > Job Finished in 34.842 seconds > Estimated value of Pi is 3.14250000000000000000 > > > On Wed, Jun 7, 2017 at 1:00 PM, tkg_cangkul <[email protected]> wrote: > >> I'm using metron 0.3.0 and i run on my cluster machines. >> this is the command that i run : >> >> /usr/metron/0.3.0/bin/pcap_query.sh query -st "20160617" -df "yyyyMMdd" >> -bop "/apps/metron/out" --query "ip_src_addr == '10.1.80.220' and >> ip_src_port == '6667' and ip_dst_addr == '10.1.80.221' and ip_dst_port == >> '42885' and protocol == '6'" >> >> i also have try to using pcap_query.sh with fixed option but i still got >> the message Could not initialize class java.net.NetworkInterface >> >> Best Regards, >> >> On 07/06/17 20:19, Nick Allen wrote: >> >> You need to provide more information about your environment. What >> version of Metron? How are you running Metron (metal, VM, cloud)? What >> command did you run? >> >> On Wed, Jun 7, 2017 at 3:27 AM, tkg_cangkul <[email protected]> >> wrote: >> >>> hi Nick, >>> >>> thx for your reply. >>> Ok, so i can use Zeppelin for this pcap dashboard. >>> is there any way to connected the kibana to Zeppelin? i mean is there >>> any way to select the pcap data to the kibana ui if i embed it in zeppelin? >>> >>> By the way, i've tried to use pcap_query tool. but i've found some error >>> message below : >>> >>> >>> >>> any suggestion for that? >>> >>> Best Regards, >>> >>> >>> On 29/05/17 20:49, Nick Allen wrote: >>> >>> Right now it is stored in HDFS and then retrieved with the pcap_query >>> tool. The pcap_query tool can also be embedded in a Zeppelin Notebook. Of >>> course with this data is in HDFS, you can integrate with it using your tool >>> of choice. >>> >>> If you have use cases in mind, please feel free to share. >>> >>> On Fri, May 26, 2017 at 6:47 AM, tkg_cangkul <[email protected]> >>> wrote: >>> >>>> hi, >>>> >>>> i'm trying to using PCAP on metron. i'm using pycapa now and i've >>>> success to store it into kafka and hdfs. >>>> So, what's the main function of PCAP on metron? can i show it to the >>>> dashboard? or it's just stored in hdfs only and read it by CLI.? >>>> >>>> >>>> Need Your Advice, >>>> >>>> >>>> Best Regards, >>>> >>>> Tkg_Cangkul >>>> >>> >>> >>> >> >> > >
