[GitHub] incubator-metron issue #432: METRON-682: Unify and Improve the Flat File Loa...

2017-02-03 Thread cestella
Github user cestella commented on the issue: https://github.com/apache/incubator-metron/pull/432 I'll point out as well that it'd be nice to have a decent exception there, kinda like what you'd get from jsonlint.com: ``` Error: Parse error on line 2: ... "config":

[GitHub] incubator-metron issue #432: METRON-682: Unify and Improve the Flat File Loa...

2017-02-03 Thread cestella
Github user cestella commented on the issue: https://github.com/apache/incubator-metron/pull/432 Also, I'll point out that you can make your life easier and kill pretty much everything on your vagrant and do this. The only reliance is on HBase and MR. I would suggest

[GitHub] incubator-metron issue #432: METRON-682: Unify and Improve the Flat File Loa...

2017-02-03 Thread ottobackwards
Github user ottobackwards commented on the issue: https://github.com/apache/incubator-metron/pull/432 [vagrant@node1 tmp]$ /usr/metron/0.3.0/bin/flatfile_loader.sh -i http://s3.amazonaws.com/alexa-static/top-1m.csv.zip -t enrichment -c t -e ./extractor.json -p 5 -b 128 Exception

[GitHub] incubator-metron issue #432: METRON-682: Unify and Improve the Flat File Loa...

2017-02-03 Thread ottobackwards
Github user ottobackwards commented on the issue: https://github.com/apache/incubator-metron/pull/432 I am trying to test this out - my vm is not doing well at the moment however. Hopefully I can get it straight --- If your project is set up for it, you can reply to this email and

[GitHub] incubator-metron issue #432: METRON-682: Unify and Improve the Flat File Loa...

2017-02-01 Thread cestella
Github user cestella commented on the issue: https://github.com/apache/incubator-metron/pull/432 # Testing Plan ## Preliminaries * Download the alexa 1m dataset: ``` wget http://s3.amazonaws.com/alexa-static/top-1m.csv.zip unzip top-1m.csv.zip ```

[GitHub] incubator-metron issue #432: METRON-682: Unify and Improve the Flat File Loa...

2017-02-01 Thread cestella
Github user cestella commented on the issue: https://github.com/apache/incubator-metron/pull/432 I know it seems like a lot of code changed, but a lot of this was reorganizing the flat file loader class and splitting it into separate reusable components, rather than new code. ---