Re: Maven Exec REPL with all Metron Dependencies

2017-08-31 Thread Otto Fowler
If this is over doing it based on your question, I apologize ahead of time.

There are a few things here:

* the way the stellar functions in metron are package with regards to
dependencies and usage
* the way the functions are categorized ( ie. should some functions even
try to load based on running local )
* the use cases of running local to cluster, local only, or from code
* if running local to cluster, what is the best way to execute management
functions against the cluster security and network wise?  [ see stellar /
rest api discussions ]

There are a number of things that can be done, but without having a handle
on these things it is tough.

That is why 690 is only the base functions.


On August 31, 2017 at 10:48:36, Otto Fowler (ottobackwa...@gmail.com) wrote:


So there is https://github.com/apache/metron/pull/690, but that is not what
you are asking.
The issue is that even if you -pl metron-platform/metron-management  it
does not bring in
all the dependencies ( you are getting FSDataInputStream or some other
error right?).  I can get both to load by
doing two -pl statements, but there are these problems.

While working on this PR, I had a version that *did* package management and
it’s dependencies
and deployment.  But I had questions about if it was correct or not given
the class path and hadoop configuration issues etc.
So I took it out.






On August 31, 2017 at 10:23:53, Nick Allen (n...@nickallen.org) wrote:

Previously, I found that you could run the REPL from the Metron source by
running the following command from the
​source root ​
directory. This is useful because it lets you run the REPL with the
libraries that will be available
​during Enrichment.​

mvn exec:java \
-Dexec.mainClass="org.apache.metron.stellar.common.shell.StellarShell" \
-pl metron-platform/metron-enrichment


Unfortunately, this does not include the useful management functions that
you really need to work in the REPL like SHELL_EDIT. I have tried a
million different ways to run the REPL
​directly ​
from
​ the​
Metron sources
​and​
include all Metron libraries, but have been unable to find a way.

Anyone know
​a magical incantation​
to do that?


Re: Maven Exec REPL with all Metron Dependencies

2017-08-31 Thread Otto Fowler
So there is https://github.com/apache/metron/pull/690, but that is not what
you are asking.
The issue is that even if you -pl metron-platform/metron-management  it
does not bring in
all the dependencies ( you are getting FSDataInputStream or some other
error right?).  I can get both to load by
doing two -pl statements, but there are these problems.

While working on this PR, I had a version that *did* package management and
it’s dependencies
and deployment.  But I had questions about if it was correct or not given
the class path and hadoop configuration issues etc.
So I took it out.






On August 31, 2017 at 10:23:53, Nick Allen (n...@nickallen.org) wrote:

Previously, I found that you could run the REPL from the Metron source by
running the following command from the
​source root ​
directory. This is useful because it lets you run the REPL with the
libraries that will be available
​during Enrichment.​

mvn exec:java \
-Dexec.mainClass="org.apache.metron.stellar.common.shell.StellarShell" \
-pl metron-platform/metron-enrichment


Unfortunately, this does not include the useful management functions that
you really need to work in the REPL like SHELL_EDIT. I have tried a
million different ways to run the REPL
​directly ​
from
​ the​
Metron sources
​and​
include all Metron libraries, but have been unable to find a way.

Anyone know
​a magical incantation​
to do that?


Maven Exec REPL with all Metron Dependencies

2017-08-31 Thread Nick Allen
Previously, I found that you could run the REPL from the Metron source by
running the following command from the
​source root ​
directory.  This is useful because it lets you run the REPL with the
libraries that will be available
​during Enrichment.​

mvn exec:java  \
-Dexec.mainClass="org.apache.metron.stellar.common.shell.StellarShell" \
-pl metron-platform/metron-enrichment


Unfortunately, this does not include the useful management functions that
you really need to work in the REPL like SHELL_EDIT.  I have tried a
million different ways to run the REPL
​directly ​
from
​ the​
Metron sources
​and​
 include all Metron libraries, but have been unable to find a way.

Anyone know
​a magical incantation​
 to do that?