Re: [ANNOUNCE] Metron Apache Community Demo for Metron_0.3.1

[Jimson K James]

Hi Team,

It'd be useful if anyone can walkme through metron-docker working with a
Kafka sensor and doing basic enrichment.

Thanks & Regards,
Jimson James

On Wed, Feb 8, 2017 at 1:47 AM, Matt Foley  wrote:

> If it would be useful, I can do a quick walk-thru of the doc-book.
> --Matt
>
> On 2/7/17, 10:01 PM, "James Sirota"  wrote:
>
> Lets hold the demo of the latest Metron build from 9-AM to 10AM PST on
> Feb.10, 2017.  Please respond to this thread with the set of features that
> you would like to demo
>
> Topic: Metron Community Demo
>
>
> Join from PC, Mac, Linux, iOS or Android:
> https://hortonworks.zoom.us/j/263433204
>
> Or join by phone:
>
> +1 408 638 0968 (US Toll) or +1 646 558 8656 (US Toll)
> +1 855 880 1246 (US Toll Free)
> +1 877 369 0926 (US Toll Free)
> Meeting ID: 263 433 204
> International numbers available: https://hortonworks.zoom.us/
> zoomconference?m=TCITFbHy7jY9C0o_Ylpbpx6gzd_9L9W7
>
> ---
> Thank you,
>
> James Sirota
> PPMC- Apache Metron (Incubating)
> jsirota AT apache DOT org
>
>
>
>
>

Re: [DISCUSS] Improving quick-dev

[Jimson K James]

Really looking forward to dockerized Metron.
Thanks ahead.

On Wednesday, 19 October 2016, Kyle Richardson 
wrote:

> Sorry, I'm a bit late to the party on this one :).
>
> +1 on the four builds Nick described. Each would be useful and purpose
> built.
>
> I like the idea of using Docker, especially for local development and quick
> testing. Has anyone explored this? I'm envisioning very specific containers
> so you could spin up only the components you're actively working on.
> Certainly something I would be willing to put some cycles into if there is
> interest.
>
> -Kyle
>
> On Fri, Oct 14, 2016 at 2:15 PM, Ryan Merriman  > wrote:
>
> > +1 I like it.  Just to clarify, the scripts to run Storm topologies
> locally
> > in an IDE should be available independent of the environment running.  No
> > need for a separate build/image.
> >
> > On Fri, Oct 14, 2016 at 9:12 AM, Otto Fowler  >
> > wrote:
> >
> > > Going forward, the Demo env and data would have implications for
> testing
> > as
> > > well ( gold data sets ) etc.
> > >
> > > On October 14, 2016 at 09:52:07, Nick Allen (n...@nickallen.org
> ) wrote:
> > >
> > > I think based on everyone's input so far, we're describing 4 different
> > > builds/images/tools that would each be intended to run on a standard
> > > Mac/Linux/Windows laptop.
> > >
> > > Full Dev - A development environment that performs a full end-to-end
> > > deployment of Metron. This is intended for developers working with
> > > sensors, deployments, or validating how all Metron components interact
> > with
> > > one another.
> > >
> > >
> > > - Starts from base Linux image
> > > - Installs Hadoop-y components
> > > - Installs Metron
> > > - Installs Sensors
> > > - Nothing started by default
> > >
> > > Quick Dev - An environment intended for the developer focusing on the
> > > streaming components of Metron; parsing, enrichment, and indexing.
> > >
> > >
> > > - Starts from base image of Linux + Hadoop-y components
> > > - Installs Metron
> > > - Installs "data generator" spouts
> > > - Does not install sensors
> > > - Nothing started by default
> > >
> > > Demo - An environment intended to introduce new users to Metron. The
> > > environment should go from nothing to plenty of data in the Metron
> > > dashboard in as little "boot" time as possible.
> > >
> > >
> > > - Starts from a base image including Linux + Hadoop-y + Metron + Data
> > > Generator Spouts pre-installed
> > > - Pre-load Elasticsearch indices so the user has plenty of data to
> > > investigate in the dashboard
> > > - Does not install sensors
> > > - Everything started by default
> > >
> > > Storm Local Cluster - Otto suggested some scripts/tooling to make it
> easy
> > > to launch the core topologies on a local Storm cluster running on the
> > host
> > > OS.
> > >
> > >
> > > I'd be interested to hear if this works for everyone and how this might
> > > play into the Ambari mpack + RPM based deployment scheme.
> > >
> > >
> > > On Fri, Oct 14, 2016 at 1:45 AM, Michael Miklavcic <
> > > michael.miklav...@gmail.com > wrote:
> > >
> > > > I think this may have come up in another PR already (have to look for
> > > it).
> > > > But maybe we could maintain our flexibility in quick-dev by
> installing
> > > the
> > > > sensors and not starting them until we need them. I think it's useful
> > to
> > > > have a quick "genuine" e2e testing environment that doesn't require
> > > running
> > > > through a full install. I'm also not opposed to extracting the
> > > integration
> > > > test functionality into general purpose data generators.
> > > >
> > > > On Thu, Oct 13, 2016 at 8:31 PM, Nick Allen  >
> > wrote:
> > > >
> > > > > To Jon's point, I think it would be useful to have a Demo box that
> > uses
> > > > > generators to produce 3 or 4 types of telemetry that shows up in
> the
> > > > Metron
> > > > > Dashboard. This box would be different from Quick-Dev in that
> > > everything
> > > > > starts automatically, so that a user just has to launch it and the
> > > should
> > > > > start seeing data in the Metron Dashboard right away. In fact, we
> > could
> > > > > even pre-load the Elasticsearch indices so that the user has more
> of
> > a
> > > > > history to mine when using the Demo box.
> > > > >
> > > > > On Thu, Oct 13, 2016 at 2:04 PM, zeo...@gmail.com <
> zeo...@gmail.com >
> > > > > wrote:
> > > > >
> > > > > > +1 Ryan and Otto's comments.
> > > > > >
> > > > > > I also strongly think we need to make a demo environment easier,
> > but
> > > > that
> > > > > > should be different than quick-dev.
> > > > > >
> > > > > > Jon
> > > > > >
> > > > > > On Thu, Oct 13, 2016 at 1:15 PM Otto Fowler <
> > ottobackwa...@gmail.com 
> > > >
> > > > > > wrote:
> > > > > >
> > > > > > > - create scripts/utilities to easily run a topology 

Re: Packet capture support for Windows environment.

[Jimson K James]

Hi James,

Thank you. That's bit more promising.

Will create a JIRA ticket for the feasibility of Windows support.

Do you know any one who will be interested in Metron supporting Windows
packet captures (even as an experimental setup or for testing inside VMs) ?

On Tuesday, 31 May 2016, James Sirota <jsir...@apache.org> wrote:

> Hi Jimson,
>
> Nick is correct. We don't support Windows at this time.  With this said,
> you may want to file a Jira to add it.  A few community members may share
> you need to run PCAP capture on windows and can create this capability for
> us
>
> 31.05.2016, 07:05, "Nick Allen" <n...@nickallen.org <javascript:;>>:
> > Sorry, but we do not support Windows.
> >
> > On Sun, May 29, 2016 at 7:34 PM, Jimson K James <tomsma...@aczire.com
> <javascript:;>>
> > wrote:
> >
> >>  Hi Metron Team,
> >>
> >>  Do we have any official support for packet capture from Windows based
> >>  machines?
> >>  As of now DPDK donot have Windows support. Of course I can use pcapy
> with
> >>  WinPcap, but is that the only solution?
> >>
> >>  Looks like if we can bring the Windows packet into the picture that
> would
> >>  be cool.
> >>
> >>  Please comment.
> >>
> >>  Best Regards,
> >>  J.
> >
> > --
> > Nick Allen <n...@nickallen.org <javascript:;>>
>
> ---
> Thank you,
>
> James Sirota
> PPMC- Apache Metron (Incubating)
> jsirota AT apache DOT org
>