Re: [SPOT-INGEST] Ingest file organization

[Nate Smith]

Perhaps separating by framework would be good,

./spot-ingest/python
./spot-ingest/spark-streaming

Just my 2 cents,

- nathanael 

> On Jan 14, 2020, at 4:45 PM, Skip Cruse  wrote:
> 
> We should keep the name /spot-ingest/ for the original ingester, but move 
> the new ingester to /spot-ingest-sparkstreaming/ or similar.  Hopefully we 
> can use the ticket to track down the files that were created, so we can move 
> them to a new home easily.
> 
> Get Outlook for iOS
> 
> 
> From: Tadd Wood 
> Sent: Tuesday, January 14, 2020 5:51 PM
> To: dev@spot.incubator.apache.org
> Subject: [SPOT-INGEST] Ingest file organization
> 
> I noticed that after SPOT-141 was introduced (a new kind of Spot Ingest,
> using PySpark Streaming) that it overlaid the new code on top of the old
> code on /spot-ingest/. When debugging the code, it makes it hard to
> determine which files are relevant to the new or the old ingest process. We
> should split them apart. Thoughts?
> 
> Thank you,
> Tadd Wood

Re: [SPOT-INGEST] Ingest file organization

[Skip Cruse]

We should keep the name /spot-ingest/ for the original ingester, but move the 
new ingester to /spot-ingest-sparkstreaming/ or similar.  Hopefully we can use 
the ticket to track down the files that were created, so we can move them to a 
new home easily.

Get Outlook for iOS


From: Tadd Wood 
Sent: Tuesday, January 14, 2020 5:51 PM
To: dev@spot.incubator.apache.org
Subject: [SPOT-INGEST] Ingest file organization

I noticed that after SPOT-141 was introduced (a new kind of Spot Ingest,
using PySpark Streaming) that it overlaid the new code on top of the old
code on /spot-ingest/. When debugging the code, it makes it hard to
determine which files are relevant to the new or the old ingest process. We
should split them apart. Thoughts?

Thank you,
Tadd Wood

[SPOT-INGEST] Ingest file organization

[Tadd Wood]

I noticed that after SPOT-141 was introduced (a new kind of Spot Ingest,
using PySpark Streaming) that it overlaid the new code on top of the old
code on /spot-ingest/. When debugging the code, it makes it hard to
determine which files are relevant to the new or the old ingest process. We
should split them apart. Thoughts?

Thank you,
Tadd Wood