Re: Two issues relating to a processor I'm developing

Mike, Regarding the licensing, I believe LGPL is a no-go for Apache projects. Take a look here: https://www.apache.org/legal/resolved.html#category-x -Bryan On Sat, Oct 28, 2017 at 4:47 PM, Mike Thomsen wrote: > The processor breaks down a much larger file into a huge

Two issues relating to a processor I'm developing

The processor breaks down a much larger file into a huge number of small data points. We're talking like turning a 1.1M line file into about 2.5B data points. My current approach is "read a file with GetFile, save to /tmp, break down into a bunch of large CSV record batches (like a few hundred