[DISCUSS] Stellar REST client

2018-10-19 Thread Ryan Merriman
I want to open up discussion around adding a Stellar REST client function. There are services available to enrich security telemetry and they are commonly exposed through a REST interface. The primary purpose of this discuss thread to collect requirements from the community and agree on a general

Re: [DISCUSS] Stellar REST client

2018-10-19 Thread Casey Stella
I think it makes a lot of sense. A couple of questions: - What actions do you see the REST verbs corresponding to? I would understand GET (which is in effect "evaluate an expression", right?), but I'm not sure about the others. - We should probably be careful about caching stellar

[DISCUSS] Recurrent Large Indexing Error Messages

2018-10-19 Thread Nick Allen
I want to discuss solutions for the problem that I have described in METRON-1832; Recurrent Large Indexing Error Messages. I feel this is a very easy trap to fall into when using the default settings that currently come with Metron. ## Problem https://issues.apache.org/jira/browse/METRON-1832

Re: [DISCUSS] Stellar REST client

2018-10-19 Thread Otto Fowler
I believe the issue of introducing and supporting higher latency enrichments is a systemic one, and should be solved as such, with the rest and other higher latency enrichments build on top of that framework. On October 19, 2018 at 12:22:28, Ryan Merriman (merrim...@gmail.com) wrote: Thanks

Re: [DISCUSS] Stellar REST client

2018-10-19 Thread Ryan Merriman
Thanks Casey, good questions. As far as the verbs go, just thinking we might want to support calls other than GET at some point. For the use case stated (enriching messages from 3rd party services) GET is all we need. Probably a moot point anyways since every http library will support the

HCP in Cloud infrastructures such as AWS , GCP, AZURE

2018-10-19 Thread deepak kumar
Hi All I have a quick question around HCP deployments in cloud infra such as AWS. I am planning to run persistent cluster for all event streaming and processing. And then run transient cluster such as AWS EMR to run batch loads on the data ingested from persistent cluster. Have anyone tried this