Re: [PROPOSAL] Apache Argus Proposal

2014-07-21 Thread Konstantin Boudnik
On Thu, Jul 17, 2014 at 11:41AM, Andrew Purtell wrote: Thank you for writing back with a detailed clarification. Regarding encryption at rest, HDFS is adding it as HDFS-6134, so likely there will be a new core feature option for the ecosystem to consider shortly. I don’t feel one

Re: [PROPOSAL] Apache Argus Proposal

2014-07-18 Thread Henry Saputra
understand them correctly. I encourage you to address concerns raised on this thread about the complexion of the initial PMC and mentorships. There have been a few suggestions worth exploring. +1 to Andrew's comment. Let us be real for a moment, when all PPMCs including mentors and

Re: [PROPOSAL] Apache Argus Proposal

2014-07-18 Thread Chris Douglas
On Wed, Jul 16, 2014 at 4:07 PM, Owen O'Malley omal...@apache.org wrote: Chris, I know you are pretty overloaded at the moment with podlings, but would you be willing to be a mentor for Argus? I don't have many cycles for this, but if it's a blocker for incubation then I'll make time. -C

Re: [PROPOSAL] Apache Argus Proposal

2014-07-18 Thread Henry Saputra
Hi Owen, Thanks for details explanation about the statement. Really appreciate the clarification. - Henry On Wed, Jul 16, 2014 at 2:46 PM, Owen O'Malley omal...@apache.org wrote: On Wed, Jul 16, 2014 at 11:29 AM, Henry Saputra henry.sapu...@gmail.com wrote: HI, Just curious if you could

Re: [PROPOSAL] Apache Argus Proposal

2014-07-18 Thread Owen O'Malley
On Fri, Jul 18, 2014 at 11:12 AM, Henry Saputra henry.sapu...@gmail.com wrote: when all PPMCs including mentors and committers are from same organizations Argus *does* have an external mentor. Jakob Homan is working at LinkedIn and has never worked at Hortonworks. I've been looking for a

Re: [PROPOSAL] Apache Argus Proposal

2014-07-18 Thread Owen O'Malley
Sorry that should be but I have not found one yet. On Fri, Jul 18, 2014 at 12:33 PM, Owen O'Malley omal...@apache.org wrote: On Fri, Jul 18, 2014 at 11:12 AM, Henry Saputra henry.sapu...@gmail.com wrote: when all PPMCs including mentors and committers are from same organizations Argus

Re: [PROPOSAL] Apache Argus Proposal

2014-07-18 Thread Daniel Gruno
On 07/18/2014 09:33 PM, Owen O'Malley wrote: Sorry that should be but I have not found one yet. On Fri, Jul 18, 2014 at 12:33 PM, Owen O'Malley omal...@apache.org wrote: On Fri, Jul 18, 2014 at 11:12 AM, Henry Saputra henry.sapu...@gmail.com wrote: when all PPMCs including mentors and

Re: [PROPOSAL] Apache Argus Proposal

2014-07-18 Thread Owen O'Malley
Thanks, Daniel. I'll add you to the proposal. .. Owen On Jul 18, 2014, at 12:36, Daniel Gruno humbed...@apache.org wrote: On 07/18/2014 09:33 PM, Owen O'Malley wrote: Sorry that should be but I have not found one yet. On Fri, Jul 18, 2014 at 12:33 PM, Owen O'Malley omal...@apache.org

Re: [PROPOSAL] Apache Argus Proposal

2014-07-17 Thread Don Bosco Durai
How do you define the 'Hadoop complex eco-system'? If that definition Agreed, complex is a relative term. I used the term complex, because now more than 20 products use Hadoop and list is growing. There are 10 products listed on http://hadoop.apache.org/. Then there are others projects like

Re: [PROPOSAL] Apache Argus Proposal

2014-07-17 Thread Andrew Purtell
Thank you for writing back with a detailed clarification. Regarding encryption at rest, HDFS is adding it as HDFS-6134, so likely there will be a new core feature option for the ecosystem to consider shortly. ​ I don’t feel one technology or one company or one small group or one approach can

Re: [PROPOSAL] Apache Argus Proposal

2014-07-17 Thread Don Bosco Durai
Andrews, thanks for your feedback. My responses are inline. Regards Bosco On Jul 17, 2014, at 11:41 AM, Andrew Purtell apurt...@apache.org wrote: Thank you for writing back with a detailed clarification. Regarding encryption at rest, HDFS is adding it as HDFS-6134, so likely there will be

Re: [PROPOSAL] Apache Argus Proposal

2014-07-17 Thread Andrew Purtell
Working this out within the community makes more sense, rather than doing this outside. Not attempting would be counterproductive. Does this not argue directly against the rationale of the Argus proposal? Please correct me if I am wrong, but this suggests addressing security concerns within

Re: [PROPOSAL] Apache Argus Proposal

2014-07-17 Thread Owen O'Malley
On Thu, Jul 17, 2014 at 2:42 PM, Andrew Purtell apurt...@apache.org wrote: Establishing trust and a track record of inclusion and openness will be essential for Argus to achieve your objectives, if I understand them correctly. I encourage you to address concerns raised on this thread about

Re: [PROPOSAL] Apache Argus Proposal

2014-07-16 Thread Konstantin Boudnik
If an objective of a podding is to build a diversified community then perhaps it should be an explicitly defined graduation criteria? In fact, earlier I have raised exactly the same question about Tez but I don't think it ever been satisfactory answered. As for chances of a project to stick with

Re: [PROPOSAL] Apache Argus Proposal

2014-07-16 Thread Jean-Baptiste Onofré
Hi, it looks interesting. Do you have an idea about the interactions with other projects (Knox, Shiro, Syncope, whatever) ? Regards JB On 07/15/2014 04:16 AM, Selvamohan Neethiraj wrote: Apache Argus Proposal (http://wiki.apache.org/incubator/ArgusProposal) == Abstract == Argus is a

Re: [PROPOSAL] Apache Argus Proposal

2014-07-16 Thread Chris Douglas
On Tue, Jul 15, 2014 at 11:30 PM, Konstantin Boudnik c...@apache.org wrote: If an objective of a podding is to build a diversified community then perhaps it should be an explicitly defined graduation criteria? In fact, earlier I have raised exactly the same question about Tez but I don't

Re: [PROPOSAL] Apache Argus Proposal

2014-07-16 Thread Ted Dunning
On Wed, Jul 16, 2014 at 1:20 AM, Chris Douglas cdoug...@apache.org wrote: So, I am fond of Henry's hope that the project will solicit a more diversified set of mentors and initial committers. The committer and PPMC list should be honest. If there is no diversity, that fact must be visible

Re: [PROPOSAL] Apache Argus Proposal

2014-07-16 Thread Henry Saputra
HI, Just curious if you could give reference to Apache encourages disjoint teams to form independent projects, even when those projects overlap in scope statement ? - Henry On Mon, Jul 14, 2014 at 7:16 PM, Selvamohan Neethiraj sneethi...@hortonworks.com wrote: Apache Argus Proposal

Re: [PROPOSAL] Apache Argus Proposal

2014-07-16 Thread Henry Saputra
Definitely +1, active members, with lack diversity, are more useful. My original comment was to suggest having mentors come from different organizations so hopefully could help provide different perspectives and inputs to the podling. Never my intention to suggest false diversity to start an

Re: [PROPOSAL] Apache Argus Proposal

2014-07-16 Thread Andreas Neumann
Is it worth a thought to require that new podlings find a champion who is not employed by the same organization? On Wed, Jul 16, 2014 at 11:53 AM, Henry Saputra henry.sapu...@gmail.com wrote: Definitely +1, active members, with lack diversity, are more useful. My original comment was to

Re: [PROPOSAL] Apache Argus Proposal

2014-07-16 Thread Alejandro Abdelnur
There is some overlap between the goals of Argus and Apache Sentry. Apache encourages disjoint teams to form independent projects, even when those projects overlap in scope. Additionally, we feel that the distinct code bases, development teams, and different approaches to the problem should

Re: [PROPOSAL] Apache Argus Proposal

2014-07-16 Thread Owen O'Malley
On Wed, Jul 16, 2014 at 11:29 AM, Henry Saputra henry.sapu...@gmail.com wrote: HI, Just curious if you could give reference to Apache encourages disjoint teams to form independent projects, even when those projects overlap in scope statement ? Henry, It generally comes from the

Re: [PROPOSAL] Apache Argus Proposal

2014-07-16 Thread Owen O'Malley
On Wed, Jul 16, 2014 at 1:20 AM, Chris Douglas cdoug...@apache.org wrote: The committer and PPMC list should be honest. If there is no diversity, that fact must be visible for it to be tracked. a big +1 Chris, I know you are pretty overloaded at the moment with podlings, but would you be

Re: [PROPOSAL] Apache Argus Proposal

2014-07-16 Thread Owen O'Malley
On Wed, Jul 16, 2014 at 2:14 PM, Alejandro Abdelnur t...@cloudera.com wrote: Have you considered reaching out to the Sentry community to see if they would be interested in bringing Argus existing code base into Sentry? We did consider it, but decided that the challenge of integrating the two

Re: [PROPOSAL] Apache Argus Proposal

2014-07-16 Thread Don Bosco Durai
Hi JB We will be centralizing the administration and auditing for Knox. And we will be also standardizing the authentication for web applications for all components within Hadoop ecosystem, for which we might consider Shiro. I would like to understand more about Syncope and see how production

Re: [PROPOSAL] Apache Argus Proposal

2014-07-16 Thread Andrew Purtell
This statement might not be quite right: Even within Hadoop complex eco-system, each components have limited or no security controls. How do you define the 'Hadoop complex eco-system'? If that definition includes projects such as HBase, we have significant security controls, so that wouldn't be

[PROPOSAL] Apache Argus Proposal

2014-07-15 Thread Selvamohan Neethiraj
Apache Argus Proposal (http://wiki.apache.org/incubator/ArgusProposal) == Abstract == Argus is a framework to enable, monitor and manage comprehensive data security across the Hadoop platform. The name “Argus” is derived from Argus Panoptes, a 100-eyed giant in Greek mythology, endowed with

Re: [PROPOSAL] Apache Argus Proposal

2014-07-15 Thread Rob Vesse
Interesting proposal, it seems like the core technology being described has a lot in common with Apache Shiro Has collaboration with that community been considered whether just in terms of reusing existing Shiro components wherever possible or something deeper e.g. inviting Shiro developers to

Re: [PROPOSAL] Apache Argus Proposal

2014-07-15 Thread Henry Saputra
Maybe we should start asking incubator project to try to build some kind of momentum or community before going to ASF incubator. All but one PPMC members for this proposal would be from Hortonworks. Personally I think this basically like hosting your project under Hortonwork Github account. I

Re: [PROPOSAL] Apache Argus Proposal

2014-07-15 Thread Owen O'Malley
On Tue, Jul 15, 2014 at 1:59 PM, Henry Saputra henry.sapu...@gmail.com wrote: Maybe we should start asking incubator project to try to build some kind of momentum or community before going to ASF incubator. Apache incubator is a great place for new projects to grow their community and

Re: [PROPOSAL] Apache Argus Proposal

2014-07-15 Thread Andrew Purtell
I had started typing up a response to Henry's mail but will discard the beginning of it to say I agree with Owen. A new project coming into the incubator quite naturally could have the initial set of committers entirely from one organization. An organization donating an existing code base, for

Re: [PROPOSAL] Apache Argus Proposal

2014-07-15 Thread Henry Saputra
Owen, thanks for the reply. If possible I would like to have mentors coming from different organizations to add some check and balance to the podling. I think most of the incubator projects that have initial members from one organization have diverse mentors from different organizations to help

Re: [PROPOSAL] Apache Argus Proposal

2014-07-15 Thread Henry Saputra
Hi Andrew, thanks for chiming in =) I like your and Owen's opinion about initial members of an incubator project. And also agree it is responsibility of the polling to achieve better diversity during its time under Apache incubator. For this particular proposal, however, the mentors mostly

Re: [PROPOSAL] Apache Argus Proposal

2014-07-15 Thread Don Bosco Durai
Rob Argus main focus is to holistically solve the security challenges within the complex ecosystem of Hadoop. Argus solution will leverage existing solutions where applicable, which might include using security from Shiro for some of the Web or REST applications authentication. Regards Bosco

Re: [PROPOSAL] Apache Argus Proposal

2014-07-15 Thread Sean Owen
I think it would be useful to expand on how this is different from Sentry too: Argus is a framework to enable, monitor and manage comprehensive data security across the Hadoop platform. The Apache Knox Gateway is a REST API Gateway for interacting with Hadoop clusters. [for the purposes of...]

Re: [PROPOSAL] Apache Argus Proposal

2014-07-15 Thread Owen O'Malley
On Tue, Jul 15, 2014 at 2:47 PM, Sean Owen sro...@apache.org wrote: The proposal just says it overlaps, and that it might be good have a different group of people reimplement some of the same things. Is there a real gap that people want to build to plug here with overlap at the edges, or is