Re: A question regarding to the default semantic meaning of join

2015-03-09 Thread Yi Pan
Hi, Julian, Thanks for the reply. I want to make sure that I understand your explanation on windows in JOIN more explicitly. For the following case: Q.1) SELECT STREAM id, cost, value, Shipments.rowtime as shiptime FROM Orders OVER (ORDER BY rowtime RANGE '3' min PROCEDING) JOIN Shipments

Storing sensitive data in the Config

2015-03-09 Thread Tommy Becker
We have some sensitive information that we are currently storing in the Samza config. Our ops guys have some concern regarding where the config is displayed (e.g. in logs, app master UI, etc). I'm curious if others have had similar concerns and if so what you did about it. Seems like we

Re: Storing sensitive data in the Config

2015-03-09 Thread Chris Riccomini
Hey Tommy, Yea, this has come up a few times. We don't currently have an answer for it. The simplest thing to do would be to have a prefix. Any config with the prefix could be stripped from the AM and logs. Another possibility is to store the configs in an encrypted way, and have the code decrypt