Re: [ALL] List Replies

[Casey Stella]

+1, if it doesn't happen on the list, it doesn't happen in Apache.

On Wed, Jan 17, 2018 at 6:55 AM, Otto Fowler 
wrote:

> The goal of the user list is to foster the Apache Metron community by
> allowing for common discussion of the uses and application of Apache
> Metron.  The list’s archives also provide a valuable resource for people to
> look through for ideas and answers to questions.
>
> Unless someone specifically requests an off-list contact, please keep
> replies and discussion on the list.  That way everyone gets the benefit (
> both now and in the future through the archives ).
>
> ottO
>
>

Re: Define a function that can be used in Stellar

[Matt Foley]

Besides the example code Simon mentioned at 
https://github.com/apache/metron/tree/master/metron-stellar/stellar-3rd-party-example
 ,
there is some documentation at 
http://metron.apache.org/current-book/metron-stellar/stellar-common/3rdPartyStellar.html
 

 

From: Nick Allen 
Reply-To: "user@metron.apache.org" 
Date: Wednesday, January 17, 2018 at 4:46 AM
To: "user@metron.apache.org" 
Subject: Re: Define a function that can be used in Stellar

 

 

 

If something we have already does not fit the bill, I would recommend creating 
that function in Java.   Since you described it as "a bit complex" and "the 
logic would be complicated" I don't see any value in defining something like 
this in Stellar with named functions. 

 

Best

 

 

 

 

On Wed, Jan 17, 2018 at 7:38 AM Simon Elliston Ball 
 wrote:

Have you looked at the recent TLSH functions in Stellar? We already have that 
for similarity preserving hashes. 

 

Simon

 


On 17 Jan 2018, at 12:35, Ali Nazemian  wrote:

It is a bit complex. We want to create a function that accepts a list of 
arguments for an asset and generate an asset identifier that can be used as a 
row_key for the enrichment store. The logic would be complicated, though. We 
may need to include some sort of similarity aware hash function as a part of 
this custom function.

 

On Wed, Jan 17, 2018 at 10:32 PM, Nick Allen  wrote:

Ali - Can you describe the logic that you are trying to perform? That would be 
useful as a use case to help drive a discussion around creating named functions 
in Stellar. 

 

 

 

 

On Wed, Jan 17, 2018 at 6:29 AM Ali Nazemian  wrote:

Thanks, Simon. We have already got a script to deal with classpath management 
for the parsers. We should be able to use it for this extension as well. 

 

Yeah, I agree. It will be much easier to define functions on the fly and use 
them afterwards. It could be defined as Lambda or custom function. 

 

Regards,

Ali

 

 

 

On Wed, Jan 17, 2018 at 9:42 PM, Simon Elliston Ball 
 wrote:

https://github.com/apache/metron/tree/master/metron-stellar/stellar-3rd-party-example
 gives good details on how to add a stellar function. 

 

Stellar will pick up an annotated function on its class path, so to add 
function there is no need to rebuild metron module, but you do need your 
modules on the classpath, and, pending 777, to deal with things like class path 
clash in your dependencies. 

 

Another idea worth discussion on the dev list is probably the notion of 
defining stellar functions in stellar, which would be a much simpler solution 
than custom java functions if you can already express you logic in stellar. 

 

Simon 

 



On 17 Jan 2018, at 10:37, Ali Nazemian  wrote:

 

Hi Simon, 

 

Yes, that is exactly what we are looking for. Is there any example regarding 
adding a Stellar function in Java? Hopefully, we don't need to rebuild the 
corresponding modules for this?

 

Cheers,

Ali

 

On Wed, Jan 17, 2018 at 8:40 PM, Simon Elliston Ball 
 wrote:

At present you can certainly create custom stellar functions in Java. I’m 
guessing however that what you’re looking to do is create a kind of function 
that combines a number of stellar functions to avoid repetition, or to ensure 
consistency of certain parameters for example. Is that what you’re looking for? 
Maybe some sort of syntax to create a named stellar function similar to the way 
we create lambdas?

Simon


> On 17 Jan 2018, at 07:25, Ali Nazemian  wrote:
>
> Hi all,
>
> Is there any way that we can define a function that can be used rather than 
> duplicating a logic multiple times?
>
> Cheers,
> Ali



 

-- 

A.Nazemian

 



 

-- 

A.Nazemian



 

-- 

A.Nazemian

Re: Define a function that can be used in Stellar

[Ali Nazemian]

Hi Simon,

Yes, that is exactly what we are looking for. Is there any example
regarding adding a Stellar function in Java? Hopefully, we don't need to
rebuild the corresponding modules for this?

Cheers,
Ali

On Wed, Jan 17, 2018 at 8:40 PM, Simon Elliston Ball <
si...@simonellistonball.com> wrote:

> At present you can certainly create custom stellar functions in Java. I’m
> guessing however that what you’re looking to do is create a kind of
> function that combines a number of stellar functions to avoid repetition,
> or to ensure consistency of certain parameters for example. Is that what
> you’re looking for? Maybe some sort of syntax to create a named stellar
> function similar to the way we create lambdas?
>
> Simon
>
> > On 17 Jan 2018, at 07:25, Ali Nazemian  wrote:
> >
> > Hi all,
> >
> > Is there any way that we can define a function that can be used rather
> than duplicating a logic multiple times?
> >
> > Cheers,
> > Ali
>
>


-- 
A.Nazemian

Re: Define a function that can be used in Stellar

[Simon Elliston Ball]

https://github.com/apache/metron/tree/master/metron-stellar/stellar-3rd-party-example
 

 gives good details on how to add a stellar function.

Stellar will pick up an annotated function on its class path, so to add 
function there is no need to rebuild metron module, but you do need your 
modules on the classpath, and, pending 777, to deal with things like class path 
clash in your dependencies. 

Another idea worth discussion on the dev list is probably the notion of 
defining stellar functions in stellar, which would be a much simpler solution 
than custom java functions if you can already express you logic in stellar. 

Simon

> On 17 Jan 2018, at 10:37, Ali Nazemian  wrote:
> 
> Hi Simon,
> 
> Yes, that is exactly what we are looking for. Is there any example regarding 
> adding a Stellar function in Java? Hopefully, we don't need to rebuild the 
> corresponding modules for this?
> 
> Cheers,
> Ali
> 
> On Wed, Jan 17, 2018 at 8:40 PM, Simon Elliston Ball 
> > wrote:
> At present you can certainly create custom stellar functions in Java. I’m 
> guessing however that what you’re looking to do is create a kind of function 
> that combines a number of stellar functions to avoid repetition, or to ensure 
> consistency of certain parameters for example. Is that what you’re looking 
> for? Maybe some sort of syntax to create a named stellar function similar to 
> the way we create lambdas?
> 
> Simon
> 
> > On 17 Jan 2018, at 07:25, Ali Nazemian  > > wrote:
> >
> > Hi all,
> >
> > Is there any way that we can define a function that can be used rather than 
> > duplicating a logic multiple times?
> >
> > Cheers,
> > Ali
> 
> 
> 
> 
> -- 
> A.Nazemian

Re: Metron Install - Vagrant provision error.

[Srikanth Nagarajan]

Hi - Thanks.. Solved the issue by modifying the command line in "mvn"  to exclude the "-T 2C" (multithreading) as some of the plugin modules did not support it.  Went much further along.  Now I am struck at the stellar compilation stage.  It seems to be a java related issue but not sure what..   The following is the error.ERROR] Failed to execute goal org.apache.maven.plugins:maven-compiler-plugin:3.5.1:compile (default-compile) on project stellar-common: Fatal error compiling: CompilerException: InvocationTargetException: java.nio.file.NotDirectoryException: /Library/Java/JavaVirtualMachines/jdk-9.0.1.jdk/Contents/Home/lib/modules -> [Help 1] org.apache.maven.lifecycle.LifecycleExecutionException: Failed to execute goal org.apache.maven.plugins:maven-compiler-plugin:3.5.1:compile (default-compile) on project stellar-common: Fatal error compiling at org.apache.maven.lifecycle.internal.MojoExecutor.execute (MojoExecutor.java:213) at org.apache.maven.lifecycle.internal.MojoExecutor.execute (MojoExecutor.java:154) at org.apache.maven.lifecycle.internal.MojoExecutor.execute (MojoExecutor.java:146) at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject (LifecycleModuleBuilder.java:117) at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject (LifecycleModuleBuilder.java:81) at org.apache.maven.lifecycle.internal.builder.singlethreaded.SingleThreadedBuilder.build (SingleThreadedBuilder.java:51) at org.apache.maven.lifecycle.internal.LifecycleStarter.execute (LifecycleStarter.java:128) at org.apache.maven.DefaultMaven.doExecute (DefaultMaven.java:309) at org.apache.maven.DefaultMaven.doExecute (DefaultMaven.java:194) at org.apache.maven.DefaultMaven.execute (DefaultMaven.java:107) at org.apache.maven.cli.MavenCli.execute (MavenCli.java:955) at org.apache.maven.cli.MavenCli.doMain (MavenCli.java:290) at org.apache.maven.cli.MavenCli.main (MavenCli.java:194) at jdk.internal.reflect.NativeMethodAccessorImpl.invoke0 (Native Method) at jdk.internal.reflect.NativeMethodAccessorImpl.invoke (NativeMethodAccessorImpl.java:62) at jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke (DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke (Method.java:564) at org.codehaus.plexus.classworlds.launcher.Launcher.launchEnhanced (Launcher.java:289) at org.codehaus.plexus.classworlds.launcher.Launcher.launch (Launcher.java:229) at org.codehaus.plexus.classworlds.launcher.Launcher.mainWithExitCode (Launcher.java:415) at org.codehaus.plexus.classworlds.launcher.Launcher.main (Launcher.java:356) Caused by: org.apache.maven.plugin.MojoExecutionException: Fatal error compiling at org.apache.maven.plugin.compiler.AbstractCompilerMojo.execute (AbstractCompilerMojo.java:897) at org.apache.maven.plugin.compiler.CompilerMojo.execute (CompilerMojo.java:129) at org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo (DefaultBuildPluginManager.java:134) at org.apache.maven.lifecycle.internal.MojoExecutor.execute (MojoExecutor.java:208) at org.apache.maven.lifecycle.internal.MojoExecutor.execute (MojoExecutor.java:154) at org.apache.maven.lifecycle.internal.MojoExecutor.execute (MojoExecutor.java:146) at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject (LifecycleModuleBuilder.java:117) at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject (LifecycleModuleBuilder.java:81) at org.apache.maven.lifecycle.internal.builder.singlethreaded.SingleThreadedBuilder.build (SingleThreadedBuilder.java:51) at org.apache.maven.lifecycle.internal.LifecycleStarter.execute (LifecycleStarter.java:128) at org.apache.maven.DefaultMaven.doExecute (DefaultMaven.java:309) at org.apache.maven.DefaultMaven.doExecute (DefaultMaven.java:194) at org.apache.maven.DefaultMaven.execute (DefaultMaven.java:107) at org.apache.maven.cli.MavenCli.execute (MavenCli.java:955) at org.apache.maven.cli.MavenCli.doMain (MavenCli.java:290) at org.apache.maven.cli.MavenCli.main (MavenCli.java:194) at jdk.internal.reflect.NativeMethodAccessorImpl.invoke0 (Native Method) at jdk.internal.reflect.NativeMethodAccessorImpl.invoke (NativeMethodAccessorImpl.java:62) at jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke (DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke (Method.java:564) at org.codehaus.plexus.classworlds.launcher.Launcher.launchEnhanced (Launcher.java:289) at org.codehaus.plexus.classworlds.launcher.Launcher.launch (Launcher.java:229) at org.codehaus.plexus.classworlds.launcher.Launcher.mainWithExitCode (Launcher.java:415) at org.codehaus.plexus.classworlds.launcher.Launcher.main (Launcher.java:356) Caused by: org.codehaus.plexus.compiler.CompilerException at org.codehaus.plexus.compiler.javac.errorprone.JavacCompilerWithErrorProne.performCompile (JavacCompilerWithErrorProne.java:95) at org.apache.maven.plugin.compiler.AbstractCompilerMojo.execute (AbstractCompilerMojo.java:886) at org.apache.maven.plugin.compiler.CompilerMojo.execute 

Upgrade from 0.4.1 to 0.4.2 fails on Alerts UI

[Laurens Vets]

Hello List,

Targeting a wider audience here, see bug report 
https://issues.apache.org/jira/browse/METRON-1408.


Basically, when I upgrade from 0.4.1 to 0.4.2 I run into issues with the 
Alerts UI. I built the Metron 0.4.2 RPMs and did an upgrade of my 
current 0.4.1 install with: "rpm -Uvh metron*.rpm". This results in an 
error message related to metron-alerts-ui:


[root@metron1 localrepo]# rpm -Uvh metron*.rpm
Preparing...### 
[100%]
   1:metron-solr### 
[  7%]
   2:metron-rest### 
[ 14%]
   3:metron-profiler### 
[ 21%]
   4:metron-pcap### 
[ 29%]
   5:metron-parsers ### 
[ 36%]
   6:metron-metron-managemen### 
[ 43%]
   7:metron-maas-service### 
[ 50%]
   8:metron-indexing### 
[ 57%]
   9:metron-enrichment  ### 
[ 64%]
  10:metron-elasticsearch   ### 
[ 71%]
  11:metron-data-management ### 
[ 79%]
  12:metron-config  ### 
[ 86%]
error reading information on service metron-alerts-ui: No such file or 
directory
warning: %post(metron-config-0.4.2-201801171923.noarch) scriptlet 
failed, exit status 1
  13:metron-common  ### 
[ 93%]
  14:metron-alerts  ### 
[100%]

[root@metron1 localrepo]#

I did an upgrade of the installed mpack with: ambari-server 
upgrade-mpack 
--mpack=/root/metron/metron-deployment/packaging/ambari/metron-mpack/target/metron_mpack-0.4.2.0.tar.gz 
--verbose

This seems to work as no errors were shown.

When I now start ambari-server, I get the following error message:

[root@metron1 ~]# ambari-server start
Using python  /usr/bin/python
Starting ambari-server
Ambari Server running with administrator privileges.
Organizing resource files at /var/lib/ambari-server/resources...
Ambari database consistency check started...
DB configs consistency check failed. Run "ambari-server start 
--skip-database-check" to skip. If you use this "--skip-da
tabase-check" option, do not make any changes to your cluster topology 
or perform a cluster upgrade until you correct th
e database consistency issues. See 
"/var/log/ambari-server/ambari-server-check-database.log" for more 
details on the con

sistency issues.
Ambari database consistency check finished
[root@metron1 ~]#

When I run the check-database command, I see the following in the 
ambari-server logs:


2018-01-17 21:54:11,274  INFO - *** Check 
database started ***
2018-01-17 21:54:15,924  INFO - Checking for configs not mapped to any 
cluster
2018-01-17 21:54:16,002  INFO - Checking for configs selected more than 
once

2018-01-17 21:54:16,005  INFO - Checking for hosts without state
2018-01-17 21:54:16,006  INFO - Checking host component states count 
equals host component desired states count

2018-01-17 21:54:16,009  INFO - Checking services and their configs
2018-01-17 21:54:18,136  INFO - Processing HDP-2.5 / HDFS
2018-01-17 21:54:18,136  INFO - Processing HDP-2.5 / MAPREDUCE2
2018-01-17 21:54:18,136  INFO - Processing HDP-2.5 / TEZ
2018-01-17 21:54:18,137  INFO - Processing HDP-2.5 / SPARK
2018-01-17 21:54:18,137  INFO - Processing HDP-2.5 / ZOOKEEPER
2018-01-17 21:54:18,137  INFO - Processing HDP-2.5 / HBASE
2018-01-17 21:54:18,137  INFO - Processing HDP-2.5 / YARN
2018-01-17 21:54:18,137  INFO - Processing HDP-2.5 / METRON
2018-01-17 21:54:18,137  INFO - Processing HDP-2.5 / PIG
2018-01-17 21:54:18,137  INFO - Processing HDP-2.5 / KIBANA
2018-01-17 21:54:18,137  INFO - Processing HDP-2.5 / STORM
2018-01-17 21:54:18,137  INFO - Processing HDP-2.5 / HIVE
2018-01-17 21:54:18,137  INFO - Processing HDP-2.5 / SLIDER
2018-01-17 21:54:18,137  INFO - Processing HDP-2.5 / AMBARI_INFRA
2018-01-17 21:54:18,137  INFO - Processing HDP-2.5 / AMBARI_METRICS
2018-01-17 21:54:18,137  INFO - Processing HDP-2.5 / ZEPPELIN
2018-01-17 21:54:18,137  INFO - Processing HDP-2.5 / KAFKA
2018-01-17 21:54:18,137  INFO - Processing HDP-2.5 / FLUME
2018-01-17 21:54:18,137  INFO - Processing HDP-2.5 / ELASTICSEARCH
2018-01-17 21:54:18,138 ERROR - Required config(s): metron-alerts-ui-env 
is(are) not available for service METRON with service config version 2 
in cluster metron
2018-01-17 21:54:18,195  INFO - *** Check 
database completed ***


Running "ambari-server start --skip-database-check"

Otto asked me to look at 

Re: Define a function that can be used in Stellar

[Ali Nazemian]

Thanks, All.

Yes, Nick. It is highly related to our use case and the way that we are
going to enrich events with assets and vulnerability properties. It is not
a general case at all.

Cheers,
Ali

On Thu, Jan 18, 2018 at 5:43 AM, Matt Foley  wrote:

> Besides the example code Simon mentioned at https://github.com/apache/
> metron/tree/master/metron-stellar/stellar-3rd-party-example ,
> there is some documentation at http://metron.apache.org/
> current-book/metron-stellar/stellar-common/3rdPartyStellar.html
>
>
>
> *From: *Nick Allen 
> *Reply-To: *"user@metron.apache.org" 
> *Date: *Wednesday, January 17, 2018 at 4:46 AM
> *To: *"user@metron.apache.org" 
> *Subject: *Re: Define a function that can be used in Stellar
>
>
>
>
>
>
>
> If something we have already does not fit the bill, I would recommend
> creating that function in Java.   Since you described it as "a bit complex"
> and "the logic would be complicated" I don't see any value in defining
> something like this in Stellar with named functions.
>
>
>
> Best
>
>
>
>
>
>
>
>
>
> On Wed, Jan 17, 2018 at 7:38 AM Simon Elliston Ball <
> si...@simonellistonball.com> wrote:
>
> Have you looked at the recent TLSH functions in Stellar? We already have
> that for similarity preserving hashes.
>
>
>
> Simon
>
>
>
>
> On 17 Jan 2018, at 12:35, Ali Nazemian  wrote:
>
> It is a bit complex. We want to create a function that accepts a list of
> arguments for an asset and generate an asset identifier that can be used as
> a row_key for the enrichment store. The logic would be complicated, though.
> We may need to include some sort of similarity aware hash function as a
> part of this custom function.
>
>
>
> On Wed, Jan 17, 2018 at 10:32 PM, Nick Allen  wrote:
>
> Ali - Can you describe the logic that you are trying to perform? That
> would be useful as a use case to help drive a discussion around creating
> named functions in Stellar.
>
>
>
>
>
>
>
>
>
> On Wed, Jan 17, 2018 at 6:29 AM Ali Nazemian 
> wrote:
>
> Thanks, Simon. We have already got a script to deal with classpath
> management for the parsers. We should be able to use it for this extension
> as well.
>
>
>
> Yeah, I agree. It will be much easier to define functions on the fly and
> use them afterwards. It could be defined as Lambda or custom function.
>
>
>
> Regards,
>
> Ali
>
>
>
>
>
>
>
> On Wed, Jan 17, 2018 at 9:42 PM, Simon Elliston Ball <
> si...@simonellistonball.com> wrote:
>
> https://github.com/apache/metron/tree/master/metron-
> stellar/stellar-3rd-party-example gives good details on how to add a
> stellar function.
>
>
>
> Stellar will pick up an annotated function on its class path, so to add
> function there is no need to rebuild metron module, but you do need your
> modules on the classpath, and, pending 777, to deal with things like class
> path clash in your dependencies.
>
>
>
> Another idea worth discussion on the dev list is probably the notion of
> defining stellar functions in stellar, which would be a much simpler
> solution than custom java functions if you can already express you logic in
> stellar.
>
>
>
> Simon
>
>
>
>
>
> On 17 Jan 2018, at 10:37, Ali Nazemian  wrote:
>
>
>
> Hi Simon,
>
>
>
> Yes, that is exactly what we are looking for. Is there any example
> regarding adding a Stellar function in Java? Hopefully, we don't need to
> rebuild the corresponding modules for this?
>
>
>
> Cheers,
>
> Ali
>
>
>
> On Wed, Jan 17, 2018 at 8:40 PM, Simon Elliston Ball <
> si...@simonellistonball.com> wrote:
>
> At present you can certainly create custom stellar functions in Java. I’m
> guessing however that what you’re looking to do is create a kind of
> function that combines a number of stellar functions to avoid repetition,
> or to ensure consistency of certain parameters for example. Is that what
> you’re looking for? Maybe some sort of syntax to create a named stellar
> function similar to the way we create lambdas?
>
> Simon
>
>
> > On 17 Jan 2018, at 07:25, Ali Nazemian  wrote:
> >
> > Hi all,
> >
> > Is there any way that we can define a function that can be used rather
> than duplicating a logic multiple times?
> >
> > Cheers,
> > Ali
>
>
>
>
>
> --
>
> A.Nazemian
>
>
>
>
>
>
>
> --
>
> A.Nazemian
>
>
>
>
>
> --
>
> A.Nazemian
>
>


-- 
A.Nazemian

Re: Metron Install - Vagrant provision error.

[Srikanth Nagarajan]

What is the highest version of Java supported? 

__
Srikanth Nagarajan 
President 
Gandiva Networks Inc
732.690.1884 Mobile
s...@gandivanetworks.com
www.gandivanetworks.com

> On Jan 17, 2018, at 5:22 PM, Otto Fowler  wrote:
> 
> We do not support Java 9 yet.
> 
> 
> 
>> On January 17, 2018 at 04:25:29, Srikanth Nagarajan 
>> (s...@gandivanetworks.com) wrote:
>> 
>> InvocationTargetException: java.nio.file.NotDirectoryException: 
>> /Library/Java/JavaVirtualMachines/jdk-9.0.1.jdk/Contents/Home/lib/modules 

Re: Define a function that can be used in Stellar

[Ali Nazemian]

It is a bit complex. We want to create a function that accepts a list of
arguments for an asset and generate an asset identifier that can be used as
a row_key for the enrichment store. The logic would be complicated, though.
We may need to include some sort of similarity aware hash function as a
part of this custom function.

On Wed, Jan 17, 2018 at 10:32 PM, Nick Allen  wrote:

> Ali - Can you describe the logic that you are trying to perform? That
> would be useful as a use case to help drive a discussion around creating
> named functions in Stellar.
>
>
>
>
> On Wed, Jan 17, 2018 at 6:29 AM Ali Nazemian 
> wrote:
>
>> Thanks, Simon. We have already got a script to deal with classpath
>> management for the parsers. We should be able to use it for this extension
>> as well.
>>
>> Yeah, I agree. It will be much easier to define functions on the fly and
>> use them afterwards. It could be defined as Lambda or custom function.
>>
>> Regards,
>> Ali
>>
>>
>>
>> On Wed, Jan 17, 2018 at 9:42 PM, Simon Elliston Ball <
>> si...@simonellistonball.com> wrote:
>>
>>> https://github.com/apache/metron/tree/master/metron-
>>> stellar/stellar-3rd-party-example gives good details on how to add a
>>> stellar function.
>>>
>>> Stellar will pick up an annotated function on its class path, so to add
>>> function there is no need to rebuild metron module, but you do need your
>>> modules on the classpath, and, pending 777, to deal with things like class
>>> path clash in your dependencies.
>>>
>>> Another idea worth discussion on the dev list is probably the notion of
>>> defining stellar functions in stellar, which would be a much simpler
>>> solution than custom java functions if you can already express you logic in
>>> stellar.
>>>
>>> Simon
>>>
>>>
>>> On 17 Jan 2018, at 10:37, Ali Nazemian  wrote:
>>>
>>> Hi Simon,
>>>
>>> Yes, that is exactly what we are looking for. Is there any example
>>> regarding adding a Stellar function in Java? Hopefully, we don't need to
>>> rebuild the corresponding modules for this?
>>>
>>> Cheers,
>>> Ali
>>>
>>> On Wed, Jan 17, 2018 at 8:40 PM, Simon Elliston Ball <
>>> si...@simonellistonball.com> wrote:
>>>
 At present you can certainly create custom stellar functions in Java.
 I’m guessing however that what you’re looking to do is create a kind of
 function that combines a number of stellar functions to avoid repetition,
 or to ensure consistency of certain parameters for example. Is that what
 you’re looking for? Maybe some sort of syntax to create a named stellar
 function similar to the way we create lambdas?

 Simon

 > On 17 Jan 2018, at 07:25, Ali Nazemian  wrote:
 >
 > Hi all,
 >
 > Is there any way that we can define a function that can be used
 rather than duplicating a logic multiple times?
 >
 > Cheers,
 > Ali


>>>
>>>
>>> --
>>> A.Nazemian
>>>
>>>
>>>
>>
>>
>> --
>> A.Nazemian
>>
>


-- 
A.Nazemian

Re: Define a function that can be used in Stellar

[Simon Elliston Ball]

Have you looked at the recent TLSH functions in Stellar? We already have that 
for similarity preserving hashes.

Simon

> On 17 Jan 2018, at 12:35, Ali Nazemian  wrote:
> 
> It is a bit complex. We want to create a function that accepts a list of 
> arguments for an asset and generate an asset identifier that can be used as a 
> row_key for the enrichment store. The logic would be complicated, though. We 
> may need to include some sort of similarity aware hash function as a part of 
> this custom function.
> 
>> On Wed, Jan 17, 2018 at 10:32 PM, Nick Allen  wrote:
>> Ali - Can you describe the logic that you are trying to perform? That would 
>> be useful as a use case to help drive a discussion around creating named 
>> functions in Stellar.
>> 
>> 
>> 
>> 
>>> On Wed, Jan 17, 2018 at 6:29 AM Ali Nazemian  wrote:
>>> Thanks, Simon. We have already got a script to deal with classpath 
>>> management for the parsers. We should be able to use it for this extension 
>>> as well.
>>> 
>>> Yeah, I agree. It will be much easier to define functions on the fly and 
>>> use them afterwards. It could be defined as Lambda or custom function. 
>>> 
>>> Regards,
>>> Ali
>>> 
>>> 
>>> 
 On Wed, Jan 17, 2018 at 9:42 PM, Simon Elliston Ball 
  wrote:
 https://github.com/apache/metron/tree/master/metron-stellar/stellar-3rd-party-example
  gives good details on how to add a stellar function.
 
 Stellar will pick up an annotated function on its class path, so to add 
 function there is no need to rebuild metron module, but you do need your 
 modules on the classpath, and, pending 777, to deal with things like class 
 path clash in your dependencies. 
 
 Another idea worth discussion on the dev list is probably the notion of 
 defining stellar functions in stellar, which would be a much simpler 
 solution than custom java functions if you can already express you logic 
 in stellar. 
 
 Simon
 
 
> On 17 Jan 2018, at 10:37, Ali Nazemian  wrote:
> 
> Hi Simon,
> 
> Yes, that is exactly what we are looking for. Is there any example 
> regarding adding a Stellar function in Java? Hopefully, we don't need to 
> rebuild the corresponding modules for this?
> 
> Cheers,
> Ali
> 
>> On Wed, Jan 17, 2018 at 8:40 PM, Simon Elliston Ball 
>>  wrote:
>> At present you can certainly create custom stellar functions in Java. 
>> I’m guessing however that what you’re looking to do is create a kind of 
>> function that combines a number of stellar functions to avoid 
>> repetition, or to ensure consistency of certain parameters for example. 
>> Is that what you’re looking for? Maybe some sort of syntax to create a 
>> named stellar function similar to the way we create lambdas?
>> 
>> Simon
>> 
>> > On 17 Jan 2018, at 07:25, Ali Nazemian  wrote:
>> >
>> > Hi all,
>> >
>> > Is there any way that we can define a function that can be used rather 
>> > than duplicating a logic multiple times?
>> >
>> > Cheers,
>> > Ali
>> 
> 
> 
> 
> -- 
> A.Nazemian
 
>>> 
>>> 
>>> 
>>> -- 
>>> A.Nazemian
> 
> 
> 
> -- 
> A.Nazemian

Re: Metron Install - Vagrant provision error.

[Otto Fowler]

If the newest 8 doesn’t work that would be a bug, imho


On January 17, 2018 at 07:20:35, Srikanth Nagarajan (s...@gandivanetworks.com)
wrote:

What is the highest version of Java supported?

__
*Srikanth Nagarajan *
President
*Gandiva Networks Inc*
*732.690.1884 <732.690.1884>* Mobile
s...@gandivanetworks.com
www.gandivanetworks.com

On Jan 17, 2018, at 5:22 PM, Otto Fowler  wrote:

We do not support Java 9 yet.



On January 17, 2018 at 04:25:29, Srikanth Nagarajan (s...@gandivanetworks.com)
wrote:

InvocationTargetException: java.nio.file.NotDirectoryException:
/Library/Java/JavaVirtualMachines/jdk-9.0.1.jdk/Contents/Home/lib/modules

Re: Define a function that can be used in Stellar

[Nick Allen]

Ali - Can you describe the logic that you are trying to perform? That would
be useful as a use case to help drive a discussion around creating named
functions in Stellar.




On Wed, Jan 17, 2018 at 6:29 AM Ali Nazemian  wrote:

> Thanks, Simon. We have already got a script to deal with classpath
> management for the parsers. We should be able to use it for this extension
> as well.
>
> Yeah, I agree. It will be much easier to define functions on the fly and
> use them afterwards. It could be defined as Lambda or custom function.
>
> Regards,
> Ali
>
>
>
> On Wed, Jan 17, 2018 at 9:42 PM, Simon Elliston Ball <
> si...@simonellistonball.com> wrote:
>
>>
>> https://github.com/apache/metron/tree/master/metron-stellar/stellar-3rd-party-example
>>  gives
>> good details on how to add a stellar function.
>>
>> Stellar will pick up an annotated function on its class path, so to add
>> function there is no need to rebuild metron module, but you do need your
>> modules on the classpath, and, pending 777, to deal with things like class
>> path clash in your dependencies.
>>
>> Another idea worth discussion on the dev list is probably the notion of
>> defining stellar functions in stellar, which would be a much simpler
>> solution than custom java functions if you can already express you logic in
>> stellar.
>>
>> Simon
>>
>>
>> On 17 Jan 2018, at 10:37, Ali Nazemian  wrote:
>>
>> Hi Simon,
>>
>> Yes, that is exactly what we are looking for. Is there any example
>> regarding adding a Stellar function in Java? Hopefully, we don't need to
>> rebuild the corresponding modules for this?
>>
>> Cheers,
>> Ali
>>
>> On Wed, Jan 17, 2018 at 8:40 PM, Simon Elliston Ball <
>> si...@simonellistonball.com> wrote:
>>
>>> At present you can certainly create custom stellar functions in Java.
>>> I’m guessing however that what you’re looking to do is create a kind of
>>> function that combines a number of stellar functions to avoid repetition,
>>> or to ensure consistency of certain parameters for example. Is that what
>>> you’re looking for? Maybe some sort of syntax to create a named stellar
>>> function similar to the way we create lambdas?
>>>
>>> Simon
>>>
>>> > On 17 Jan 2018, at 07:25, Ali Nazemian  wrote:
>>> >
>>> > Hi all,
>>> >
>>> > Is there any way that we can define a function that can be used rather
>>> than duplicating a logic multiple times?
>>> >
>>> > Cheers,
>>> > Ali
>>>
>>>
>>
>>
>> --
>> A.Nazemian
>>
>>
>>
>
>
> --
> A.Nazemian
>

[ALL] List Replies

[Otto Fowler]

The goal of the user list is to foster the Apache Metron community by
allowing for common discussion of the uses and application of Apache
Metron.  The list’s archives also provide a valuable resource for people to
look through for ideas and answers to questions.

Unless someone specifically requests an off-list contact, please keep
replies and discussion on the list.  That way everyone gets the benefit (
both now and in the future through the archives ).

ottO

Re: Metron Install - Vagrant provision error.

[Otto Fowler]

We do not support Java 9 yet.



On January 17, 2018 at 04:25:29, Srikanth Nagarajan (s...@gandivanetworks.com)
wrote:

InvocationTargetException: java.nio.file.NotDirectoryException:
/Library/Java/JavaVirtualMachines/jdk-9.0.1.jdk/Contents/Home/lib/modules