Re: [Discuss] - Future plans for Spot-ingest

2017-04-13 Thread Nate Smith
I was really hoping it came through ok, Oh well :) Here’s an image form: http://imgur.com/a/DUDsD > On Apr 13, 2017, at 4:05 PM, Segerlind, Nathan L > wrote: > > The diagram became garbled in the text format. > Could you resend it as a pdf? > > Thanks, > Nate >

Re: Apache Spot UI alternatives

2017-09-22 Thread Nate Smith
Hello, I'm a little confused by this sudden change, however as this comment from the original GitHub issue has stated they are changing the license to MIT. Full writeup seems to be here:

Re: [Proposal] PR voting process changes

2017-09-21 Thread Nate Smith
, Nate Smith <nathan...@apache.org> wrote: > Hello, > > From my own experience and also in talking directly with a few committers > to the project the requirement for three +1's from committers should be > reviewed. > > My understanding is that other projects in the

[Proposal] PR voting process changes

2017-09-21 Thread Nate Smith
Hello, >From my own experience and also in talking directly with a few committers to the project the requirement for three +1's from committers should be reviewed. My understanding is that other projects in the ASF simply require one vote and provide some time for review by others prior to

Re: Podling Report Reminder - October 2017

2017-10-04 Thread Nate Smith
Thank You, Report uploaded On Wed, Oct 4, 2017 at 9:51 AM, Jarek Jarcec Cecho <jar...@gmail.com> wrote: > Yup I’ve commented on the document yesterday and it’s good from my side. > > Jarcec > > > On Oct 4, 2017, at 9:42 AM, Nate Smith <nathan...@apache.org&

Re: Podling Report Reminder - October 2017

2017-10-04 Thread Nate Smith
Thanks Guys, Jarcec are you able to provide sign off? After sign off i will upload to the wiki. Nathanael On Wed, Oct 4, 2017 at 8:53 AM, Gonzalez, Victor wrote: > Looks good to me as well > > -Original Message- > From: Cesar Berho [mailto:ce...@apache.org]

[SPOT-216] please vote on PR #110

2017-09-28 Thread Nate Smith
this PR assists with running setup in a kerberized environment as well as different hadoop distros. https://github.com/apache/incubator-spot/pull/110 - Nathanael

Re: [Proposal] PR voting process changes

2017-10-18 Thread Nate Smith
t 11:54 AM, Nate Smith <natedogs...@gmail.com> wrote: > Bump, > > Do we need to take an official vote on this? > > +1 from me of course on the change, and it seems that we're all in > agreement. > > On Fri, Sep 22, 2017 at 1:59 PM, Cesar Berho <ce...@apach

Re: [VOTE] New development branch for ingestion component

2017-11-28 Thread Nate Smith
3 PM, Lujan Moreno, Gustavo < gustavo.lujan.mor...@intel.com> wrote: +1 On 11/21/17, 5:53 PM, "Mubashir Kazia" <mka...@cloudera.com> wrote: +1 On Nov 22, 2017 4:57 AM, "Nate Smith" <natedogs...@gmail.com> wrote: +1 On Nov 21, 2017, at 12:41 PM,

Re: Podling Report Reminder - December 2017

2017-12-14 Thread Nate Smith
> > Your report is missing mentor sign off. Without sign off, it will be > rejected and you will be asked to report again next month. Please mentors > review their report and sign off as appropriate. > > John > >> On 2017-12-07 18:17, Nate Smith <nathan...@ap

[VOTE] New development branch for ingestion component

2017-11-21 Thread Nate Smith
Hello, I’d like to call a vote in regards to the following: Creation of an Ingest redesign branch (name to be determined) and linkage of this branch to a Jira epic. These are the proposed requirements: 1. Extendible to any source. 2. NRT latency between ingestion and output to the

Re: [VOTE] New development branch for ingestion component

2017-11-21 Thread Nate Smith
< >> solrac...@apache.org >>> wrote: >> >>> +1 >>> >>> >>> 2017-11-21 5:12 GMT-06:00 Nate Smith <nathan...@apache.org>: >>> >>>> Hello, >>>> >>>> I’d like to call a vote in regards to the following

Re: Podling Report Reminder - December 2017

2017-12-07 Thread Nate Smith
I haven’t seen any discussion of it. I’m not sure of any major updates at this time. I don’t think anyone else has write access to the wiki but Cesar and Myself, I can upload the report when ready FYI, we have to upload a doc, then a mentor signs off via the wiki page. - Nathanael On Dec 7,

[PR #143] clean config options via configurator.py

2018-05-07 Thread Nate Smith
Hello, Please review: https://github.com/apache/incubator-spot/pull/143 - Nathanael

[PR #141] Ingestion using Spark Streaming

2018-05-07 Thread Nate Smith
I’m very interested in this, but we need more eyes. Please review and don’t let this die on the vine https://github.com/apache/incubator-spot/pull/141 - Nathanael

Re: Proposed Addition to SPOT

2018-06-26 Thread Nate Smith
+1 What would be the best medium to conduct the meetings? A recording should be made and posted and it should be open to the whole mail list - nathanael > On Jun 26, 2018, at 8:46 AM, Curtis Howard > wrote: > > +1 > > On Mon, Jun 25, 2018 at 12:27 PM Morris Hicks > wrote: > >> +1 >> >>

Re: Podling Report Reminder - June 2018

2018-06-19 Thread Nate Smith
Hello Justin, First congrats on the new role and thank you for the help. There does tend to be chatter on the Spot slack channel, I have tried on multiple occasions to redirect individuals to the dev/user list for questions with little success. We have discussed putting a bot on the channel to

Re: Configuration-driven ingest for the Open Data Model (ODM) using Spark Streaming (Envelope)

2018-05-01 Thread Nate Smith
Curtis, Have you tested this with a standard version of nfdump? Or only spot-nfdump? - Nathanael > On May 1, 2018, at 1:12 PM, Curtis Howard wrote: > > Hi all, > > We had discussed prototyping Envelope for ingest in the past - I've > submitted a PR for this which

Re: Configuration-driven ingest for the Open Data Model (ODM) using Spark Streaming (Envelope)

2018-05-01 Thread Nate Smith
Thank you for all the hard work Curtis, I will start reviewing. - Nathanael > On May 1, 2018, at 1:12 PM, Curtis Howard wrote: > > Hi all, > > We had discussed prototyping Envelope for ingest in the past - I've > submitted a PR for this which includes: > - Kafka -> Spark

[SPOT-ML] LDA options in spot.conf

2018-04-30 Thread Nate Smith
I’m adding some checks into ml_ops.sh to avoid passing spark-submit a bunch of empty variables. My question is rather the LDA_* options in spot.conf should really be SPK_LDA_*? they are variables for the spark job and yet it’s not instantly clear that they need to be included and can not be

[PODLING REPORT] February 2018

2018-01-31 Thread Nate Smith
Hello, Below I've included a draft of the podling report which is due Feb 7th. Please feel free to request any additions/changes to the report. I will post the latest version on the incubator wiki on Feb 6th. - Nathanael Draft of report below: __ Spot Apache Spot is a platform for

Re: [PODLING REPORT] February 2018

2018-02-02 Thread Nate Smith
interfaces instead of Hadoop command line tools for most interactions. - Nathanael > On Feb 2, 2018, at 7:16 AM, Sam Heywood <sam.heyw...@cloudera.com> wrote: > > Thanks for pulling this together. Is it premature to mention the kerberos > work? > > --Sam > > On Wed,

Re: [PODLING REPORT] February 2018

2018-02-07 Thread Nate Smith
The report has been uploaded, Mentors, Can you review please? https://wiki.apache.org/incubator/February2018 - Nathanael > On Feb 2, 2018, at 1:35 PM, Nate Smith <natedogs...@gmail.com> wrote: > > Well the work is done, and tested. It’s just sitting in a PR for review and >

Re: [apache/incubator-spot] One of your dependencies may have a security vulnerability

2018-02-07 Thread Nate Smith
SPOT-262 <https://issues.apache.org/jira/browse/SPOT-262> has been opened. https://issues.apache.org/jira/browse/SPOT-262 Assuming this is true: >>> update suggested: jquery ~> 3.0.0. What version should we be using besides latest? - Nathanael > On Feb 7, 2018, at 1:44 P

Re: [PODLING REPORT] February 2018

2018-02-07 Thread Nate Smith
ock Noland <br...@apache.org> wrote: > > Hi, > > I sign off. For some reason I cannot edit the page (username brocknoland) can > someone check my name? > > Brock > > On Wed, Feb 7, 2018 at 11:13 AM, Nate Smith <natedogs...@gmail.com > <mailto:natedog

Re: Spot Project Meeting - Date & Time is Set

2018-07-27 Thread Nate Smith
Thanks Mark, I will be there. - nathanael > On Jul 26, 2018, at 8:40 PM, Mark Schoeni wrote: > > Hello Everyone, > This is a reminder about tomorrow's (July 27) Spot Project meeting from > *3:30* to *4:30* (*ET*). > > We will be using Google Hangouts. > Spot Meeting Link >

Re: Spot Project Meeting - Date & Time is Set

2018-07-27 Thread Nate Smith
We’re trying to generate a new meeting without a limit, please stand by for updated links, - Nathanael > On Jul 27, 2018, at 12:38 PM, Chad Perkins wrote: > > Says call full. Not letting us in > > Chad Perkins > 214-296-2045 > >> On Jul 27, 2018, at 9:33 AM, Mark Schoeni wrote: >> >> Hi

Re: Spot Project Meeting - Date & Time is Set

2018-07-27 Thread Nate Smith
ote: > >> Hi Mark - I'll be on as well. >> >> Thanks >> Curtis >> >> On Fri, Jul 27, 2018 at 2:54 PM Austin Leahy >> wrote: >> >>> I am also able to attend >>> >>> >>> On Fri, Jul 27, 2018 at 11:27 AM Nate S

Re: Podling Report Reminder - August 2018

2018-08-06 Thread Nate Smith
It seems we are already past the deadline for a report, Has anyone drafted a proposed report yet? - Nathanael > On Aug 6, 2018, at 6:19 AM, jmcl...@apache.org wrote: > > Dear podling, > > This email was sent by an automated system on behalf of the Apache > Incubator PMC. It is an initial

Re: Podling Report Reminder - August 2018

2018-08-06 Thread Nate Smith
ssed. > I will take a stab at the report and send it out tonight for comments. > I will submit it tomorrow with any comments made. > > Please feel free to send me anything I should include. > My plan is to talk about the project meetings to start reviving the > community. > > >

March Podling Report

2018-03-07 Thread Nate Smith
Hello, I’m late on picking this up, not sure how the month has flown by and thought we had more time. I’ll be posting the podling report by this evening with more or less the same message from last month, with a few highlights such as continued ODM development and support. Recently we pulled

Re: DNS ingestion

2018-02-27 Thread Nate Smith
Hello, This email seemed to have slipped through the cracks. How is development going? Is this still something you are interested in contributing? - nathanael > On Sep 15, 2017, at 5:17 AM, Salvatore Elio wrote: > > ​Hello, > > > > for an internal project we have

[DISCUSS] ml_ops.sh MAXRESULTS instead of TOL value

2018-03-15 Thread Nate Smith
Hello, When running ml_ops.sh to kick of spot-ml, in order to use MAXRESULTS instead of TOL to adjust the amount of output you must specify both. for example: `ml_ops.sh 20160127 flow 1e-6 1000` In the usage example the order of TOL and MAXRESULTS are swapped. My question is, Rather than

Re: [DRAFT] Incubator PMC Board Report - March 2018

2018-03-15 Thread Nate Smith
Thank you Uma, I think #1 is the most important at this time. - Nathanael > On Mar 12, 2018, at 12:50 PM, Uma gangumalla wrote: > > Hi Nathanael, > > Redirecting to dev list: > > BTW, how could we improve to get more discussions in dev lists? > > Are there alternative

Spot release tar file not opening

2018-03-15 Thread Nate Smith
Hello, Has anyone had issues with the 1.0 release tar? http://spot.apache.org/download/ I’ve seen one individual download the file multiple times and not be able to unzip it. I’ve just tried this from one of the mirrors and not had an issue, but I want to

Test Message [disregard]

2018-04-10 Thread Nate Smith
Testing the mail servers, disregard

[spot.conf] name_node in spot.conf is confusing

2018-04-13 Thread Nate Smith
Should ’name_node’ in the spot.conf be changed to something like web_hdfs? In the latest version it should be the web hdfs address for use by python api’s. This makes it a bit confusing for new users, - Nathanael

Re: [Question] disabling reputation services in OA

2018-03-22 Thread Nate Smith
The answer can be found here under Enable/Disable GTI service: https://github.com/apache/incubator-spot/tree/master/spot-oa/oa/components > On Mar 22, 2018, at 12:32 PM, Nate Smith <natedogs...@gmail.com> wrote: > > Hello, > > Is there a simple way to disable reputatio

[Question] disabling reputation services in OA

2018-03-22 Thread Nate Smith
Hello, Is there a simple way to disable reputation services as a whole using only configuration? I recall there should be a way to disable reputation services easily. - Nathanael

[Question] Save/Load LDA model with Spot-ML

2018-03-01 Thread Nate Smith
Is it possible to save and load the ML model for re-use? I’m trying to understand the roadblocks to scoring streaming data using spot-ml. In theory could you be running batches/micro-batches with a scheduled job and saving the model to be picked up by a streaming job. - Nathanael