Require write access for incubator wiki
I would like to request write access for the wiki. I need to file report for May. My userid is rahul.sharma. My apologies for mailing it again but I do not think my previous mail has reached the list . thanks, Rahul
Re: Require write access for incubator wiki
I think the mails are back in business, so I would like to request write access for the wiki. I need to file report for May. My userid is rahul.sharma. thanks, Rahul On Thu, May 8, 2014 at 8:40 AM, Rahul Sharma rahul0...@gmail.com wrote: I need to file report of HDT project for May[1]. My userid does not have write access for the same. Please provide the appropriate rights. regards Rahul [1] http://wiki.apache.org/incubator/May2014 On Wed, May 7, 2014 at 10:16 AM, Rahul Sharma rahul0...@gmail.com wrote: Hi, Can someone please provide me write access for the incubator wiki ? My userid is rahul.sharma . regards Rahul
Re: [VOTE] Accept Optiq into the incubator
+1 On Sat, May 10, 2014 at 2:03 AM, Ashutosh Chauhan hashut...@apache.orgwrote: Based on the results of the discussion thread ( http://mail-archives.apache.org/mod_mbox/incubator-general/201404.mbox/%3CCA%2BFBdFQA4TghLRdh9GgDKaMtKLQHxE_QZV%3DoZ7HfiDSA_jyqwg%40mail.gmail.com%3E ), I would like to call a vote on accepting Optiq into the incubator. [ ] +1 Accept Optiq into the Incubator [ ] +0 Indifferent to the acceptance of Stratosphere [ ] -1 Do not accept Optiq because ... The vote will be open until Tuesday May 13 18:00 UTC. https://wiki.apache.org/incubator/OptiqProposal = Optiq = == Abstract == Optiq is a framework that allows efficient translation of queries involving heterogeneous and federated data. == Proposal == Optiq is a highly customizable engine for parsing and planning queries on data in a wide variety of formats. It allows database-like access, and in particular a SQL interface and advanced query optimization, for data not residing in a traditional database. == Background == Databases were traditionally engineered in a monolithic stack, providing a data storage format, data processing algorithms, query parser, query planner, built-in functions, metadata repository and connectivity layer. They innovate in some areas but rarely in all. Modern data management systems are decomposing that stack into separate components, separating data, processing engine, metadata, and query language support. They are highly heterogeneous, with data in multiple locations and formats, caching and redundant data, different workloads, and processing occurring in different engines. Query planning (sometimes called query optimization) has always been a key function of a DBMS, because it allows the implementors to introduce new query-processing algorithms, and allows data administrators to re-organize the data without affecting applications built on that data. In a componentized system, the query planner integrates the components (data formats, engines, algorithms) without introducing unncessary coupling or performance tradeoffs. But building a query planner is hard; many systems muddle along without a planner, and indeed a SQL interface, until the demand from their customers is overwhelming. There is an opportunity to make this process more efficient by creating a re-usable framework. == Rationale == Optiq allows database-like access, and in particular a SQL interface and advanced query optimization, for data not residing in a traditional database. It is complementary to many current Hadoop and NoSQL systems, which have innovative and performant storage and runtime systems but lack a SQL interface and intelligent query translation. Optiq is already in use by several projects, including Apache Drill, Apache Hive and Cascading Lingual, and commercial products. Optiq's architecture consists of: An extensible relational algebra. * SPIs (service-provider interfaces) for metadata (schemas and tables), planner rules, statistics, cost-estimates, user-defined functions. * Built-in sets of rules for logical transformations and common data-sources. * Two query planning engines driven by rules, statistics, etc. One engine is cost-based, the other rule-based. * Optional SQL parser, validator and translator to relational algebra. * Optional JDBC driver. == Initial Goals == The initial goals are be to move the existing codebase to Apache and integrate with the Apache development process. Once this is accomplished, we plan for incremental development and releases that follow the Apache guidelines. As we move the code into the org.apache namespace, we will restructure components as necessary to allow clients to use just the components of Optiq that they need. A version 1.0 release, including pre-built binaries, will foster wider adoption. == Current Status == Optiq has had over a dozen minor releases over the last 18 months. Its core SQL parser and validator, and its planning engine and core rules, are mature and robust and are the basis for several production systems; but other components and SPIs are still undergoing rapid evolution. === Meritocracy === We plan to invest in supporting a meritocracy. We will discuss the requirements in an open forum. We encourage the companies and projects using Optiq to discuss their requirements in an open forum and to participate in development. We will encourage and monitor community participation so that privileges can be extended to those that contribute. Optiq's pluggable architecture encourages developers to contribute extensions such as adapters for data sources, new planning rules, and better statistics and cost-estimation functions. We look forward to fostering a rich ecosystem of extensions. === Community === Building a data management system requires a high degree of technical skill, and correspondingly, the community of developers directly using Optiq is
Re: May 2014 Incubator report timeline
Apologies for the missed deadline. HDT report has been updated. regards Rahul On Thu, May 8, 2014 at 7:49 PM, John D. Ament john.d.am...@gmail.comwrote: Hi all, Here's who have not reported by the deadline: BatchEE DeviceMap HDT NPanday Sirona Twill Thanks for those who have thus far. On Mon, May 5, 2014 at 8:58 PM, John D. Ament john.d.am...@gmail.com wrote: Hi all podlings Don't forget that this Wednesday the reports are due. We only have 25% of the reports in, the more the merrier though! John On Mon, Apr 28, 2014 at 8:25 PM, John D. Ament john.d.am...@gmail.com wrote: All, There was an issue with the clutch report. Please see below for corrected dates: May 2014 Incubator report timeline: http://wiki.apache.org/incubator/May2014 Wed May 07 -- Podling reports due by end of day Sun May 11 -- Shepherd reviews due by end of day Sun May 11 -- Summary due by end of day Tue May 13 -- Mentor signoff due by end of day Wed May 14 -- Report submitted to Board Wed May 21 -- Board meeting On Mon, Apr 28, 2014 at 8:03 PM, John D. Ament john.d.am...@gmail.com wrote: Hi all, May 2014 Incubator report timeline: http://wiki.apache.org/incubator/May2014 Tue May 06 -- Podling reports due by end of day Sat May 10 -- Shepherd reviews due by end of day Sat May 10 -- Summary due by end of day Mon May 12 -- Mentor signoff due by end of day Tue May 13 -- Report submitted to Board Tue May 20 -- Board meeting Shepherds, please note your assignments. I've copied them here for convenience. Please don't hesitate to let me know if you're going to be delayed. Alan D. Cabrera Sirona Andrei Savu Droids Dave Fisher NPanday John Ament Celix John Ament Hadoop Development Tools Justin Mclean Twill Matthew Franklin BatchEE Raphael Bircher Tez Roman Shaposhnik Stratosphere Ross Gardler Ripple Suresh Marru Blur Suresh Marru DeviceMap https://wiki.apache.org/incubator/DeviceMap - John
Incubator wiki access
Hi all, I need write access to the incubator wiki to post the Twill report for the board. My username is GaryHelmling. My apologies if this message shows up twice. I originally sent a request during the mail outage, but haven't seen it show up yet. Thanks, Gary
Re: Require write access for incubator wiki
On Sun, 11 May 2014, Rahul Sharma wrote: I think the mails are back in business, so I would like to request write access for the wiki. I need to file report for May. My userid is rahul.sharma. Karma granted Nick - To unsubscribe, e-mail: general-unsubscr...@incubator.apache.org For additional commands, e-mail: general-h...@incubator.apache.org
Re: Incubator wiki access
Done On 11 May 2014 07:03, Gary Helmling ghelml...@gmail.com wrote: Hi all, I need write access to the incubator wiki to post the Twill report for the board. My username is GaryHelmling. My apologies if this message shows up twice. I originally sent a request during the mail outage, but haven't seen it show up yet. Thanks, Gary - To unsubscribe, e-mail: general-unsubscr...@incubator.apache.org For additional commands, e-mail: general-h...@incubator.apache.org
Re: Shepherding: celix, stratosphere
Hi Konstantin! Don't forget to update your shepherd comments in the wiki. If you need access to the wiki, please follow the instructions on the top of the incubator page. John On Sat, May 10, 2014 at 9:29 PM, Konstantin Boudnik c...@apache.org wrote: Celix looks pretty normal; report in getting prepeared, traffic on mailing list is ok. I don't see any particular cause for concern. Celix might need to update the project site to reflect recent additions of the committers. Stratosphere dev list look pretty good, traffic is high and mentors participation is there.
Re: May 2014 Incubator report timeline
Shepherds, Just a reminder that shepherding reports are due end of day. I'll be sending out the shepherd summary tomorrow. BatchEE, you updated your report, thanks! However, i think you have a typo with a release in the future (6/6/2014). Please cross check. On Thu, May 8, 2014 at 10:19 AM, John D. Ament john.d.am...@gmail.comwrote: Hi all, Here's who have not reported by the deadline: BatchEE DeviceMap HDT NPanday Sirona Twill Thanks for those who have thus far. On Mon, May 5, 2014 at 8:58 PM, John D. Ament john.d.am...@gmail.comwrote: Hi all podlings Don't forget that this Wednesday the reports are due. We only have 25% of the reports in, the more the merrier though! John On Mon, Apr 28, 2014 at 8:25 PM, John D. Ament john.d.am...@gmail.comwrote: All, There was an issue with the clutch report. Please see below for corrected dates: May 2014 Incubator report timeline: http://wiki.apache.org/incubator/May2014 Wed May 07 -- Podling reports due by end of day Sun May 11 -- Shepherd reviews due by end of day Sun May 11 -- Summary due by end of day Tue May 13 -- Mentor signoff due by end of day Wed May 14 -- Report submitted to Board Wed May 21 -- Board meeting On Mon, Apr 28, 2014 at 8:03 PM, John D. Ament john.d.am...@gmail.comwrote: Hi all, May 2014 Incubator report timeline: http://wiki.apache.org/incubator/May2014 Tue May 06 -- Podling reports due by end of day Sat May 10 -- Shepherd reviews due by end of day Sat May 10 -- Summary due by end of day Mon May 12 -- Mentor signoff due by end of day Tue May 13 -- Report submitted to Board Tue May 20 -- Board meeting Shepherds, please note your assignments. I've copied them here for convenience. Please don't hesitate to let me know if you're going to be delayed. Alan D. Cabrera Sirona Andrei Savu Droids Dave Fisher NPanday John Ament Celix John Ament Hadoop Development Tools Justin Mclean Twill Matthew Franklin BatchEE Raphael Bircher Tez Roman Shaposhnik Stratosphere Ross Gardler Ripple Suresh Marru Blur Suresh Marru DeviceMap https://wiki.apache.org/incubator/DeviceMap - John
Re: [ANNOUNCE] Moon Soo Lee joins the MRQL PPMC
Mentors, We don't have permission to access the ID request form page. Please add Lee Moon Soo as a new MRQL committer. Thanks. On Wed, Apr 23, 2014 at 9:35 AM, Edward J. Yoon edwardy...@apache.org wrote: Please read the guidelines for new committers[1], and send a signed ICLA[2] either by postal mail, fax or by emailing a scan of the signed copy to secret...@apache.org. 1. http://www.apache.org/dev/new-committers-guide.html 2. http://www.apache.org/licenses/icla.txt On Thu, Apr 17, 2014 at 8:22 AM, moon soo Lee leemoon...@gmail.com wrote: Thanks. Hope i can understand and participate more about MRQL! On Thursday, April 17, 2014, Edward J. Yoon edwardy...@apache.org wrote: Congratz! Sent from my iPhone On 2014. 4. 17., at 오전 12:57, Alan Cabrera l...@toolazydogs.comjavascript:; wrote: Contrats! Regards, Alan On Apr 16, 2014, at 8:25 AM, Leonidas Fegaras fega...@cse.uta.edujavascript:; wrote: Greetings, The MRQL PPMC has voted to offer membership to Moon Soo Lee as an MRQL committer and PPMC member and he has accepted. Moon has provided various patches to MRQL, including refactoring the directory structure for using MRQL on Eclipse, changing the Test class to work with Junit, and rewriting the test queries/programs. In addition, Moon is building an MRQL driver for the open source project, Zeppelin. Welcome Moon! -- Best Regards, Edward J. Yoon CEO at DataSayer Co., Ltd. -- Best Regards, Edward J. Yoon CEO at DataSayer Co., Ltd. - To unsubscribe, e-mail: general-unsubscr...@incubator.apache.org For additional commands, e-mail: general-h...@incubator.apache.org
Report Clarifications
Hi Podlings! Was wondering if I could get some clarifications: - Phoneix, you're about to graduate and your reporting period was set to 1. You provided a report this month. I'm assuming it was done to provide graduation info? I'm not going to change your reporting period at this time. - Ripple, you provided a report but it didn't follow the standard template. Is this in fact the report you want to provide to the board? You're currently on monthly. If this is the report you want to provide, I'll move you to period 2 and take it as is. John
Require write access for incubator wiki
Hi, Can someone please provide me write access for the incubator wiki ? My userid is rahul.sharma . regards Rahul
Re: [PROPOSAL] Optiq
The “Relationships with Other Apache Products” section has been updated to cover Optiq’s functional overlaps with existing Apache projects. https://wiki.apache.org/incubator/OptiqProposal#Relationships_with_Other_Apache_Products Julian On May 2, 2014, at 11:23 AM, Henry Saputra henry.sapu...@gmail.com wrote: Ah sorry, I did not mean asking to update, I meant proposing to update. Thanks, - Henry On Fri, May 2, 2014 at 11:20 AM, Henry Saputra henry.sapu...@gmail.com wrote: HI Ashutosh, Since there was a question/ comment about relationship with Apache MetaModel, I am asking to update the proposal to include this discussion in either Relationships with Other Apache Products or Alignment section before going for a VOTE. Apache Slider did the same thing with relation to Apache Twill and Apache Helix projects. Thanks, - Henry On Wed, Apr 30, 2014 at 3:21 PM, Ashutosh Chauhan hashut...@apache.org wrote: I would like to propose Optiq as an Apache Incubator project. I have posted the proposal to https://wiki.apache.org/incubator/OptiqProposal and posted the text of the proposal below. Ashutosh. = Optiq = == Abstract == Optiq is a framework that allows efficient translation of queries involving heterogeneous and federated data. == Proposal == Optiq is a highly customizable engine for parsing and planning queries on data in a wide variety of formats. It allows database-like access, and in particular a SQL interface and advanced query optimization, for data not residing in a traditional database. == Background == Databases were traditionally engineered in a monolithic stack, providing a data storage format, data processing algorithms, query parser, query planner, built-in functions, metadata repository and connectivity layer. They innovate in some areas but rarely in all. Modern data management systems are decomposing that stack into separate components, separating data, processing engine, metadata, and query language support. They are highly heterogeneous, with data in multiple locations and formats, caching and redundant data, different workloads, and processing occurring in different engines. Query planning (sometimes called query optimization) has always been a key function of a DBMS, because it allows the implementors to introduce new query-processing algorithms, and allows data administrators to re-organize the data without affecting applications built on that data. In a componentized system, the query planner integrates the components (data formats, engines, algorithms) without introducing unncessary coupling or performance tradeoffs. But building a query planner is hard; many systems muddle along without a planner, and indeed a SQL interface, until the demand from their customers is overwhelming. There is an opportunity to make this process more efficient by creating a re-usable framework. == Rationale == Optiq allows database-like access, and in particular a SQL interface and advanced query optimization, for data not residing in a traditional database. It is complementary to many current Hadoop and NoSQL systems, which have innovative and performant storage and runtime systems but lack a SQL interface and intelligent query translation. Optiq is already in use by several projects, including Apache Drill, Apache Hive and Cascading Lingual, and commercial products. Optiq's architecture consists of: An extensible relational algebra. SPIs (service-provider interfaces) for metadata (schemas and tables), planner rules, statistics, cost-estimates, user-defined functions. Built-in sets of rules for logical transformations and common data-sources. Two query planning engines driven by rules, statistics, etc. One engine is cost-based, the other rule-based. Optional SQL parser, validator and translator to relational algebra. Optional JDBC driver. == Initial Goals == The initial goals are be to move the existing codebase to Apache and integrate with the Apache development process. Once this is accomplished, we plan for incremental development and releases that follow the Apache guidelines. As we move the code into the org.apache namespace, we will restructure components as necessary to allow clients to use just the components of Optiq that they need. A version 1.0 release, including pre-built binaries, will foster wider adoption. == Current Status == Optiq has had over a dozen minor releases over the last 18 months. Its core SQL parser and validator, and its planning engine and core rules, are mature and robust and are the basis for several production systems; but other components and SPIs are still undergoing rapid evolution. === Meritocracy === We plan to invest in supporting a meritocracy. We will discuss the requirements in an open forum. We encourage the companies and projects using Optiq to discuss their requirements in an open forum and to participate in
