Re: [Discuss] - Future plans for Spot-ingest

I was really hoping it came through ok, Oh well :) Here’s an image form: http://imgur.com/a/DUDsD > On Apr 13, 2017, at 4:05 PM, Segerlind, Nathan L > wrote: > > The diagram became garbled in the text format. > Could you resend it as a pdf? > > Thanks, > Nate >

Re: [Proposal] PR voting process changes

, Nate Smith <nathan...@apache.org> wrote: > Hello, > > From my own experience and also in talking directly with a few committers > to the project the requirement for three +1's from committers should be > reviewed. > > My understanding is that other projects in the

[Proposal] PR voting process changes

Hello, >From my own experience and also in talking directly with a few committers to the project the requirement for three +1's from committers should be reviewed. My understanding is that other projects in the ASF simply require one vote and provide some time for review by others prior to

Re: [Proposal] PR voting process changes

t 11:54 AM, Nate Smith <natedogs...@gmail.com> wrote: > Bump, > > Do we need to take an official vote on this? > > +1 from me of course on the change, and it seems that we're all in > agreement. > > On Fri, Sep 22, 2017 at 1:59 PM, Cesar Berho <ce...@apach

Re: [VOTE] New development branch for ingestion component

3 PM, Lujan Moreno, Gustavo < gustavo.lujan.mor...@intel.com> wrote: +1 On 11/21/17, 5:53 PM, "Mubashir Kazia" <mka...@cloudera.com> wrote: +1 On Nov 22, 2017 4:57 AM, "Nate Smith" <natedogs...@gmail.com> wrote: +1 On Nov 21, 2017, at 12:41 PM,

Re: Podling Report Reminder - December 2017

> > Your report is missing mentor sign off. Without sign off, it will be > rejected and you will be asked to report again next month. Please mentors > review their report and sign off as appropriate. > > John > >> On 2017-12-07 18:17, Nate Smith <nathan...@ap

[VOTE] New development branch for ingestion component

Hello, I’d like to call a vote in regards to the following: Creation of an Ingest redesign branch (name to be determined) and linkage of this branch to a Jira epic. These are the proposed requirements: 1. Extendible to any source. 2. NRT latency between ingestion and output to the

Re: [VOTE] New development branch for ingestion component

< >> solrac...@apache.org >>> wrote: >> >>> +1 >>> >>> >>> 2017-11-21 5:12 GMT-06:00 Nate Smith <nathan...@apache.org>: >>> >>>> Hello, >>>> >>>> I’d like to call a vote in regards to the following

[PR #143] clean config options via configurator.py

Hello, Please review: https://github.com/apache/incubator-spot/pull/143 - Nathanael

[PR #141] Ingestion using Spark Streaming

I’m very interested in this, but we need more eyes. Please review and don’t let this die on the vine https://github.com/apache/incubator-spot/pull/141 - Nathanael

Re: Proposed Addition to SPOT

+1 What would be the best medium to conduct the meetings? A recording should be made and posted and it should be open to the whole mail list - nathanael > On Jun 26, 2018, at 8:46 AM, Curtis Howard > wrote: > > +1 > > On Mon, Jun 25, 2018 at 12:27 PM Morris Hicks > wrote: > >> +1 >> >>

Re: Podling Report Reminder - June 2018

Hello Justin, First congrats on the new role and thank you for the help. There does tend to be chatter on the Spot slack channel, I have tried on multiple occasions to redirect individuals to the dev/user list for questions with little success. We have discussed putting a bot on the channel to

Re: Configuration-driven ingest for the Open Data Model (ODM) using Spark Streaming (Envelope)

Curtis, Have you tested this with a standard version of nfdump? Or only spot-nfdump? - Nathanael > On May 1, 2018, at 1:12 PM, Curtis Howard wrote: > > Hi all, > > We had discussed prototyping Envelope for ingest in the past - I've > submitted a PR for this which

Re: Configuration-driven ingest for the Open Data Model (ODM) using Spark Streaming (Envelope)

Thank you for all the hard work Curtis, I will start reviewing. - Nathanael > On May 1, 2018, at 1:12 PM, Curtis Howard wrote: > > Hi all, > > We had discussed prototyping Envelope for ingest in the past - I've > submitted a PR for this which includes: > - Kafka -> Spark

[SPOT-ML] LDA options in spot.conf

I’m adding some checks into ml_ops.sh to avoid passing spark-submit a bunch of empty variables. My question is rather the LDA_* options in spot.conf should really be SPK_LDA_*? they are variables for the spark job and yet it’s not instantly clear that they need to be included and can not be

[PODLING REPORT] February 2018

Hello, Below I've included a draft of the podling report which is due Feb 7th. Please feel free to request any additions/changes to the report. I will post the latest version on the incubator wiki on Feb 6th. - Nathanael Draft of report below: __ Spot Apache Spot is a platform for

Re: [PODLING REPORT] February 2018

interfaces instead of Hadoop command line tools for most interactions. - Nathanael > On Feb 2, 2018, at 7:16 AM, Sam Heywood <sam.heyw...@cloudera.com> wrote: > > Thanks for pulling this together. Is it premature to mention the kerberos > work? > > --Sam > > On Wed,

Re: [PODLING REPORT] February 2018

The report has been uploaded, Mentors, Can you review please? https://wiki.apache.org/incubator/February2018 - Nathanael > On Feb 2, 2018, at 1:35 PM, Nate Smith <natedogs...@gmail.com> wrote: > > Well the work is done, and tested. It’s just sitting in a PR for review and >

Re: [apache/incubator-spot] One of your dependencies may have a security vulnerability

SPOT-262 <https://issues.apache.org/jira/browse/SPOT-262> has been opened. https://issues.apache.org/jira/browse/SPOT-262 Assuming this is true: >>> update suggested: jquery ~> 3.0.0. What version should we be using besides latest? - Nathanael > On Feb 7, 2018, at 1:44 P

Re: [PODLING REPORT] February 2018

ock Noland <br...@apache.org> wrote: > > Hi, > > I sign off. For some reason I cannot edit the page (username brocknoland) can > someone check my name? > > Brock > > On Wed, Feb 7, 2018 at 11:13 AM, Nate Smith <natedogs...@gmail.com > <mailto:natedog

Re: Spot Project Meeting - Date & Time is Set

ote: > >> Hi Mark - I'll be on as well. >> >> Thanks >> Curtis >> >> On Fri, Jul 27, 2018 at 2:54 PM Austin Leahy >> wrote: >> >>> I am also able to attend >>> >>> >>> On Fri, Jul 27, 2018 at 11:27 AM Nate S

Re: Podling Report Reminder - August 2018

It seems we are already past the deadline for a report, Has anyone drafted a proposed report yet? - Nathanael > On Aug 6, 2018, at 6:19 AM, jmcl...@apache.org wrote: > > Dear podling, > > This email was sent by an automated system on behalf of the Apache > Incubator PMC. It is an initial

Re: DNS ingestion

Hello, This email seemed to have slipped through the cracks. How is development going? Is this still something you are interested in contributing? - nathanael > On Sep 15, 2017, at 5:17 AM, Salvatore Elio wrote: > > ​Hello, > > > > for an internal project we have

Spot release tar file not opening

Hello, Has anyone had issues with the 1.0 release tar? http://spot.apache.org/download/ I’ve seen one individual download the file multiple times and not be able to unzip it. I’ve just tried this from one of the mirrors and not had an issue, but I want to

Test Message [disregard]

Testing the mail servers, disregard

[spot.conf] name_node in spot.conf is confusing

Should ’name_node’ in the spot.conf be changed to something like web_hdfs? In the latest version it should be the web hdfs address for use by python api’s. This makes it a bit confusing for new users, - Nathanael

Re: [Question] disabling reputation services in OA

The answer can be found here under Enable/Disable GTI service: https://github.com/apache/incubator-spot/tree/master/spot-oa/oa/components > On Mar 22, 2018, at 12:32 PM, Nate Smith <natedogs...@gmail.com> wrote: > > Hello, > > Is there a simple way to disable reputatio

[Question] disabling reputation services in OA

Hello, Is there a simple way to disable reputation services as a whole using only configuration? I recall there should be a way to disable reputation services easily. - Nathanael

Re: Spot Meeting & Notes Nov 30, 2018

DNS - I think someone with access will need to manually check the share looking for that As far as I know nothing has been deleted. - nathanael > On Nov 30, 2018, at 12:30 PM, Mark Schoeni wrote: > > Hello everyone, > Below are the updates from the past couple of weeks. > Also, we have a

Re: ODM Merge?

As I recall I think we can merge envelope without affecting the existing code. But as you pointed out there are other gaps such as the UI. At this point I say merge as much as we can (assuming no obvious code quality issues) as any movement at this point is positive. If something breaks then we

Re: nfdump install instructions seem inaccurate

I’ve not been active in this project for a while, so forgive me if this has already been addressed. I’m assuming this is for spot-nfdump? If so it’s worth saying unless someone has been maintaining it we should look at removing the dependency. Originally we cooked our own version due to

Re: [SPOT-INGEST] Ingest file organization

Perhaps separating by framework would be good, ./spot-ingest/python ./spot-ingest/spark-streaming Just my 2 cents, - nathanael > On Jan 14, 2020, at 4:45 PM, Skip Cruse wrote: > > We should keep the name /spot-ingest/ for the original ingester, but move > the new ingester to