This is an automated email from the ASF dual-hosted git repository. janardhan pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/systemds-website.git
commit 0f56551a9017b27ac48aec927d6e03bec95044bb Author: Sebastian Baunsgaard <[email protected]> AuthorDate: Wed Jul 15 10:25:38 2020 +0530 [MINOR] Refactor name from SystemML to SystemDS --- .gitignore | 3 + NOTICE | 4 +- _config.yml | 12 +- _src/_data/navigation.yml | 2 +- _src/_data/project.yml | 27 ++-- _src/_includes/themes/apache/home.html | 63 ++++++---- _src/_includes/themes/apache/partials/_footer.html | 15 +-- _src/_includes/themes/apache/partials/_head.html | 22 ++-- _src/_includes/themes/apache/partials/_header.html | 5 +- _src/community.html | 139 ++++++--------------- _src/documentation.html | 30 ++--- _src/download.html | 128 ++++++++++++++----- _src/get-started.html | 67 ++++++---- _src/index.md | 40 +----- _src/maturity.html | Bin 392578 -> 0 bytes _src/privacy-policy.html | 38 +++--- _src/roadmap.html | 116 ++++++++++------- _src/security.html | 40 +++--- 18 files changed, 386 insertions(+), 365 deletions(-) diff --git a/.gitignore b/.gitignore index f60c5ff..5a478b2 100644 --- a/.gitignore +++ b/.gitignore @@ -6,6 +6,9 @@ .project .settings/ +# VsCode +.vscode + # Intellij .idea/ .idea_modules/ diff --git a/NOTICE b/NOTICE index 1a6bb88..7b856f1 100644 --- a/NOTICE +++ b/NOTICE @@ -1,5 +1,5 @@ -Apache SystemML Website -Copyright [2015-2018] The Apache Software Foundation +Apache SystemDS Website +Copyright [2015-2020] The Apache Software Foundation This product includes software developed at The Apache Software Foundation (http://www.apache.org/). diff --git a/_config.yml b/_config.yml index 40c8d51..770e70c 100644 --- a/_config.yml +++ b/_config.yml @@ -6,14 +6,12 @@ # 'jekyll serve'. If you change this file, please restart the server process. # Site settings -author: Apache SystemML -title: Apache SystemML - Declarative Large-Scale Machine Learning -email: [email protected] -description: Apache SystemML provides an optimal workplace for Machine Learning using big data +author: Apache SystemDS +title: Apache SystemDS - Declarative Large-Scale Machine Learning +email: [email protected] +description: Apache SystemDS provides an optimal workplace for Machine Learning using big data baseurl: "" # the subpath of your site, e.g. /blog -url: "http://systemml.apache.org"; # the base hostname & protocol for your site -twitter_username: systemml -github_username: apache +url: "http://systemds.apache.org"; # the base hostname & protocol for your site # Build settings markdown: kramdown diff --git a/_src/_data/navigation.yml b/_src/_data/navigation.yml index 899d77f..ea08f54 100644 --- a/_src/_data/navigation.yml +++ b/_src/_data/navigation.yml @@ -34,7 +34,7 @@ topnav: - title: Get Involved url: /community - title: Issue Tracker - url: https://issues.apache.org/jira/browse/SYSTEMML + url: https://issues.apache.org/jira/browse/SYSTEMDS - title: Source Code url: https://github.com/apache/systemml - title: Website Source Code diff --git a/_src/_data/project.yml b/_src/_data/project.yml index e141033..d2c9452 100644 --- a/_src/_data/project.yml +++ b/_src/_data/project.yml @@ -15,9 +15,9 @@ # limitations under the License. # -name: Apache SystemML<sup id="trademark">™</sup> -short_name: SystemML<sup id="trademark">™</sup> -description: Apache SystemML<sup id="trademark">™</sup> is a distributed and declarative machine learning platform. +name: Apache SystemDS<sup id="trademark">™</sup> +short_name: SystemDS<sup id="trademark">™</sup> +description: Apache SystemDS<sup id="trademark">™</sup> is a distributed and declarative machine learning platform. dev_list: [email protected] dev_list_subscribe: [email protected] @@ -26,13 +26,6 @@ dev_list_archive: http://mail-archives.apache.org/mod_mbox/systemml-dev/ dev_list_archive_mailarchive: https://www.mail-archive.com/[email protected]/ dev_list_archive_markmail: -user_list: -user_list_subscribe: -user_list_unsubscribe: -user_list_archive: -user_list_archive_mailarchive: -user_list_archive_markmail: - commits_list: [email protected] commits_list_subscribe: [email protected] commits_list_unsubscribe: [email protected] @@ -47,19 +40,15 @@ issues_list_archive: http://mail-archives.apache.org/mod_mbox/systemml-issues/ issues_list_archive_mailarchive: https://www.mail-archive.com/[email protected]/ issues_list_archive_markmail: -jira: SYSTEMML +jira: SYSTEMDS release_name: systemml release_version: 1.2.0 -source_repository: https://git-wip-us.apache.org/repos/asf/systemml.git -source_repository_mirror: https://github.com/apache/systemml - -website_repository: https://git-wip-us.apache.org/repos/asf/systemml-website.git -website_repository_mirror: https://github.com/apache/systemml-website - -download: /download.html +source_repository: https://git-wip-us.apache.org/repos/asf/systemds.git +source_repository_mirror: https://github.com/apache/systemds -documentation: /documentation.html +website_repository: https://git-wip-us.apache.org/repos/asf/systemds-website.git +website_repository_mirror: https://github.com/apache/systemds-website podling: false diff --git a/_src/_includes/themes/apache/home.html b/_src/_includes/themes/apache/home.html index dc325f9..e22f1ec 100644 --- a/_src/_includes/themes/apache/home.html +++ b/_src/_includes/themes/apache/home.html @@ -26,7 +26,7 @@ limitations under the License. <p>A machine learning platform optimal for big data</p> </div> <div class="col col-12 content-group button-group"> - <a class="button button-primary" href="download.html">Download SystemML</a> + <a class="button button-primary" href="download.html">Download SystemDS</a> </div> </div> <!-- video background --> @@ -40,8 +40,8 @@ limitations under the License. <div class="col-4" id="award"> </div> <div class="col-8"> - <h3>The Apache Software Foundation Announces {{ site.data.project.name }} as a Top-Level-Project</h3> - <p>Learn how {{ site.data.project.name }} is advancing machine learning. <a href="https://blogs.apache.org/foundation/entry/the-apache-software-foundation-announces13"; target="_blank">Read Press Release</a></p> + <h3>Name change from SystemML to SystemDS</h3> + <p>To reflect the change of focus to the wider Data Science Lifecycle </div> </div> </section> @@ -50,14 +50,18 @@ limitations under the License. <section class="full-stripe"> <div class="ml-container ml-container--vertically-top ml-container--reverse-order"> <div class="col col-6 content-group"> - <img src="/assets/img/diagramAnim-v4.gif" alt="What is Apache SystemML?"> + <img src="/assets/img/diagramAnim-v4.gif" alt="What is Apache SystemDS?"> </div> <div class="col col-6 content-group content-group--more-padding"> <!-- bdi tag prevents reverse punctuation when rtl direction property is applied --> - <h2><bdi>What is SystemML?‎</bdi></h2> - - <p>Apache SystemML provides an optimal workplace for machine learning using big data. It can be run on top of Apache Spark, where it automatically scales your data, line by line, determining whether your code should be run on the driver or an Apache Spark cluster. Future SystemML developments include additional deep learning with GPU capabilities such as importing and running neural network architectures and pre-trained models for training.‎</p> - <p><a href="#systemml-video" class="modal-trigger jq-modal-trigger"><span class="icon play-button"></span><span>Learn more about SystemML</span></a></p> + <h2><bdi>What is SystemDS?</bdi></h2> + <p>Apache SystemDS provides an optimal workplace for machine learning using big data. + It can be run on top of Apache Spark or standalone, where it automatically scales your data, line by line, + determining whether your code should be run on the driver or an Apache Spark cluster. + SystemDS include additional deep learning with GPU capabilities such as importing and + running neural network architectures and pre-trained models for training.</p> + <p><a href="#systemml-video" class="modal-trigger jq-modal-trigger"><span + class="icon play-button"></span><span>Learn more about SystemDS</span></a></p> </div> </div> </section> @@ -66,42 +70,47 @@ limitations under the License. <section class="full-stripe full-stripe--alternate"> <div class="ml-container ml-container--vertically-centered"> <div class="col col-6 content-group content-group--more-padding"> - <img src="/assets/img/robotTutorialSm.png" alt="What is Apache SystemML?"> + <img src="/assets/img/robotTutorialSm.png" alt="What is Apache SystemDS?"> </div> <div class="col col-6 content-group content-group--more-padding button-group"> - <h2>Install SystemML</h2> - <p>New to Apache SystemML? Try our quick install guide that will walk you through setting up your environment and getting you up and going with SystemML.</p> - <a class="button button-primary" href="install-systemml.html">Install SystemML</a> - <a class="button button-secondary" href="get-started.html#sample-notebook">Notebooks</a> - <a class="button button-secondary" href="documentation.html" target="_blank">Docs</a> + <h2>Install SystemDS</h2> + <p>New to Apache SystemDS? Try our quick install guide that will walk you through setting up your environment and + getting you up and going with SystemDS.</p> + <a class="button button-primary" href="/systemds/site/install">Install SystemDS</a> + <!-- <a class="button button-secondary" href="get-started.html#sample-notebook">Notebooks</a> --> + <!-- <a class="button button-secondary" href="documentation.html" target="_blank">Docs</a> --> </div> </div> </section> <!-- Awards --> -<section class="full-stripe full-stripe--alternate-2"> +<!-- <section class="full-stripe full-stripe--alternate-2"> <div class="ml-container ml-container--narrow"> <div class="col col-4 content-group content-group--center-content vldb2016"></div> <div class="col col-8 content-group content-group--center-align content-group--center-content"> <h3>VLDB 2016 Best Paper</h3> - <p>Read Compressed Linear Algebra for Large-Scale Machine Learning.<a href="http://www.vldb.org/pvldb/vol9/p960-elgohary.pdf"; target="_blank"> Download Paper</a></p> + <p>Read Compressed Linear Algebra for Large-Scale Machine Learning.<a + href="http://www.vldb.org/pvldb/vol9/p960-elgohary.pdf"; target="_blank"> Download Paper</a></p> </div> </div> -</section> +</section> --> <!-- Contact Us --> <section class="full-stripe"> <div class="ml-container ml-container--horizontally-center"> <div class="col col-12 content-group "> <h2>Contribute</h2> - <p>Contribute to Apache SystemML<sup>TM</sup> by subscribing to our developer mailing list for updates and news. Check out <a href="community.html#mailing-list">All Mailing Lists</a>. + <p>Contribute to Apache SystemDS<sup>TM</sup> by subscribing to our developer mailing list for updates and news. + Check out <a href="community.html#mailing-list">All Mailing Lists</a>. </p> </div> <div class="col col-12 content-group button-group"> - <a href="mailto:{{ site.data.project.dev_list_subscribe }}?subject=send this email to subscribe" class="button button-primary">Subscribe</a> - <a href="{{ site.data.project.dev_list_archive }}" target="_blank" class="button button-secondary">View Archive</a> - <a href="https://systemml.apache.org/roadmap"; target="_blank" class="button button-secondary">Roadmap</a> + <a href="mailto:{{ site.data.project.dev_list_subscribe }}?subject=send this email to subscribe" + class="button button-primary">Subscribe</a> + <a href="{{ site.data.project.dev_list_archive }}" target="_blank" class="button button-secondary">View + Archive</a> + <a href="/roadmap" target="_blank" class="button button-secondary">Roadmap</a> </div> </div> </section> @@ -114,10 +123,12 @@ limitations under the License. </div> <div class="col col-12"> <ul class="link-list bullet-pointless"> - <li><a class="icon icon-youtube" href="https://www.youtube.com/channel/UCQwUHIc5SjqNIppUH6xbxXQ"; target="_blank"></a></li> - <li><a class="icon icon-github" href="{{ site.data.project.source_repository_mirror }}" target="_blank"></a></li> - <li><a class="icon icon-twitter" href="https://twitter.com/ApacheSystemML"; target="_blank"></a></li> - <li><a class="icon icon-medium" href="https://medium.com/@apachesystemml"; target="_blank"></a></li> + <li><a class="icon icon-youtube" href="https://www.youtube.com/channel/UCQwUHIc5SjqNIppUH6xbxXQ"; + target="_blank"></a></li> + <li><a class="icon icon-github" href="{{ site.data.project.source_repository_mirror }}" target="_blank"></a> + </li> + <!-- <li><a class="icon icon-twitter" href="https://twitter.com/ApacheSystemML"; target="_blank"></a></li> --> + <!-- <li><a class="icon icon-medium" href="https://medium.com/@apachesystemml"; target="_blank"></a></li> --> </ul> </div> </div> @@ -128,4 +139,4 @@ limitations under the License. <div class="video-wrapper"> <iframe src="https://www.youtube.com/embed/r-kFYkYoD_4"; frameborder="0" allowfullscreen></iframe> </div> -</div> +</div> \ No newline at end of file diff --git a/_src/_includes/themes/apache/partials/_footer.html b/_src/_includes/themes/apache/partials/_footer.html index f504a98..ea4951b 100644 --- a/_src/_includes/themes/apache/partials/_footer.html +++ b/_src/_includes/themes/apache/partials/_footer.html @@ -20,17 +20,18 @@ limitations under the License. <div class="ml-container ml-container--horizontally-center"> <div class="footer-col-wrapper"> <div style="margin-top: 20px; margin-bottom: 20px;"> - <a href="http://www.apache.org";><img src="/assets/img/apache-foundation-logo.png" alt="Apache Incubator"/></a> + <a href="http://www.apache.org";><img src="/assets/img/apache-foundation-logo.png" alt="Apache Incubator" /></a> </div> <!--Footer copyright year update credit: http://updateyourfooter.com/--> <div> - Copyright © 2015<script>new Date().getFullYear()>2015&&document.write("-"+new Date().getFullYear());</script> - <a href="http://www.apache.org";>The Apache Software Foundation</a>. - Licensed under the <a href="http://www.apache.org/licenses/LICENSE-2.0";>Apache License, Version 2.0</a>. - <br> - Apache and the Apache Feather logo are trademarks of The Apache Software Foundation. + Copyright © 2015 + <script>new Date().getFullYear() > 2015 && document.write("-" + new Date().getFullYear());</script> + <a href="http://www.apache.org";>The Apache Software Foundation</a>. + Licensed under the <a href="http://www.apache.org/licenses/LICENSE-2.0";>Apache License, Version 2.0</a>. + <br> + Apache and the Apache Feather logo are trademarks of The Apache Software Foundation. </div> </div> </div> {% include themes/apache/analytics/google-analytics %} -</footer> +</footer> \ No newline at end of file diff --git a/_src/_includes/themes/apache/partials/_head.html b/_src/_includes/themes/apache/partials/_head.html index 44474c4..3617b68 100644 --- a/_src/_includes/themes/apache/partials/_head.html +++ b/_src/_includes/themes/apache/partials/_head.html @@ -16,16 +16,15 @@ See the License for the specific language governing permissions and limitations under the License. {% endcomment %} --> + <head> <meta charset="utf-8"> <meta http-equiv="X-UA-Compatible" content="IE=edge"> <title>{{ page.title }}</title> {% if page.description %} - <meta name="description" content="{{ page.description }}"> - {% else %} - <meta name="description" content="{{ site.description }}"> - {% endif %} + <meta name="description" content="{{ page.description }}"> {% else %} + <meta name="description" content="{{ site.description }}"> {% endif %} <meta name="author" content="{{ site.author }}"> <!-- Enable responsive viewport --> @@ -34,21 +33,20 @@ limitations under the License. <!-- You can use Open Graph tags to customize link previews. Learn more: https://developers.facebook.com/docs/sharing/webmasters --> - <meta property="og:url" content="https://systemml.apache.org/"; /> - <meta property="og:type" content="website" /> - <meta property="og:title" content="{{ page.title }}" /> - <meta property="og:description" content="{{ site.description }}" /> - <meta property="og:image" content="" /> + <meta property="og:url" content="https://systemds.apache.org/"; /> + <meta property="og:type" content="website" /> + <meta property="og:title" content="{{ page.title }}" /> + <meta property="og:description" content="{{ site.description }}" /> + <meta property="og:image" content="" /> <!-- Le HTML5 shim, for IE6-8 support of HTML elements --> <!--[if lt IE 9]> - <script src="http://html5shim.googlecode.com/svn/trunk/html5.js";></script> + <script src="http://html5shim.googlecode.com/svn/trunk/html5.js";></script> <![endif]--> <!-- Le styles --> <link rel="stylesheet" href="/assets/css/main.css"> - <link rel="stylesheet" href="/assets/css/jquery-ui.css"> <!-- favicons --> <link rel="shortcut icon" href="/assets/img/favicon.png"> -</head> +</head> \ No newline at end of file diff --git a/_src/_includes/themes/apache/partials/_header.html b/_src/_includes/themes/apache/partials/_header.html index d74ac9f..97e2995 100644 --- a/_src/_includes/themes/apache/partials/_header.html +++ b/_src/_includes/themes/apache/partials/_header.html @@ -17,7 +17,8 @@ limitations under the License. {% endcomment %} --> <header class="site-header{% if page.layout != 'home' %} site-header--not-home{% endif %}"> - <h1 class="logo"><a class="url" href="/"><i class="logo-mark"></i><span class="fn org">Apache SystemML<sup id="trademark">™</sup></span></a></h1> + <h1 class="logo"><a class="url" href="/"><i class="logo-mark"></i><span class="fn org">Apache SystemDS<sup + id="trademark">™</sup></span></a></h1> <nav class="main-nav"> <ul> {% for entry in site.data.navigation.topnav %} @@ -42,4 +43,4 @@ limitations under the License. {% endfor %} </ul> </nav> -</header> +</header> \ No newline at end of file diff --git a/_src/community.html b/_src/community.html index f8cb087..d2aaf94 100644 --- a/_src/community.html +++ b/_src/community.html @@ -32,76 +32,28 @@ limitations under the License. </div> </section> -<!-- You can: - -* Use our project and provide a feedback. -* Provide us with the use-cases. -* Report bugs and submit patches. -* Contribute code, javadocs, documentation. - -Visit the [Contributing] page for more information. -### Mailing list -Get help using {{ site.data.project.short_name }} or contribute to the project on our mailing lists: - -{% if site.data.project.user_list %} - [{{ site.data.project.user_list }}](mailto:{{ site.data.project.user_list }}) is for usage questions, help, and announcements. - - [subscribe](mailto:{{ site.data.project.user_list_subscribe }}?subject=send this email to subscribe), - [unsubscribe](mailto:{{ site.data.project.user_list_unsubscribe }}?subject=send this email to unsubscribe), - [archives]({{ site.data.project.user_list_archive_mailarchive }}) - -{% endif %} - -[{{ site.data.project.dev_list }}](mailto:{{ site.data.project.dev_list }}) is for people who want to contribute code to {{ site.data.project.short_name }}. - -[subscribe](mailto:{{ site.data.project.dev_list_subscribe }}?subject=send this email to subscribe), -[unsubscribe](mailto:{{ site.data.project.dev_list_unsubscribe }}?subject=send this email to unsubscribe), -[archives]({{ site.data.project.dev_list_archive_mailarchive }}) - -[{{ site.data.project.commits_list }}](mailto:{{ site.data.project.commits_list }}) is for commit messages and patches to {{ site.data.project.short_name }}. - -[subscribe](mailto:{{ site.data.project.commits_list_subscribe }}?subject=send this email to subscribe), -[unsubscribe](mailto:{{ site.data.project.commits_list_unsubscribe }}?subject=send this email to unsubscribe), -[archives]({{ site.data.project.commits_list_archive_mailarchive }}) - -{% if site.data.project.issues_list %} - [{{ site.data.project.issues_list }}](mailto:{{ site.data.project.issues_list }}) is for issues workflow notifications. [subscribe](mailto:{{ site.data.project.issues_list_subscribe }}?subject=send this email to subscribe), - [unsubscribe](mailto:{{ site.data.project.issues_list_unsubscribe }}?subject=send this email to unsubscribe), - [archives]({{ site.data.project.issues_list_archive_mailarchive }}) -{% endif %} - -### Issue tracker - - - -#### Bug Reports - -Found bug? Enter an issue in the [Issue Tracker](https://issues.apache.org/jira/browse/{{ site.data.project.jira }}). - -Before submitting an issue, please: - -* Verify that the bug does in fact exist. -* Search the issue tracker to verify there is no existing issue reporting the bug you've found. -* Consider tracking down the bug yourself in the Wink's source and submitting a patch along with your bug report. This is a great time saver for the Wink developers and helps ensure the bug will be fixed quickly. --> - <section class="full-stripe full-stripe--alternate hero"> <div class="ml-container ml-container--three-column"> <!-- section 1 --> <div class="col col-4"> <h2>Github</h2> - <p>You can find all of Apache SystemML’s code on Github, including example algorithms and notebooks. Fork it, try it out, and contribute to SystemML yourself.</p> + <p>You can find all of Apache SystemDS’s code on Github, including example algorithms and notebooks. + Fork it, try it out, and contribute to SystemDS yourself.</p> <a href="https://github.com/apache/systemml"; target="_blank" class="button button-primary">Go To Github</a> </div> <!-- section 2 --> <div class="col col-4"> <h2>Jira</h2> - <p>Keep track of the daily updates with SystemML. Create your own Jira to report issues and bugs you come across, acting as part of the SystemML community.</p> - <a href="https://issues.apache.org/jira/browse/{{ site.data.project.jira }}" target="_blank" class="button button-primary">Go To Jira</a> + <p>Keep track of the daily updates with SystemDS. Create your own Jira to report issues and bugs you come across, + acting as part of the SystemDS community.</p> + <a href="https://issues.apache.org/jira/browse/{{ site.data.project.jira }}" target="_blank" + class="button button-primary">Go To Jira</a> </div> <!-- section 3 --> <div class="col col-4"> <h2>Roadmap</h2> - <p>View SystemML's roadmap for a comprehensive blueprint of future plans. You can also browse through a list of completed features from past versions.</p> + <p>View SystemDS's roadmap for a comprehensive blueprint of future plans. You can also browse through a list of + completed features from past versions.</p> <a href="roadmap.html" target="_blank" class="button button-primary">Go to Roadmap</a> </div> </div> @@ -113,25 +65,26 @@ Before submitting an issue, please: <section class="full-stripe"> <div class="ml-container"> <div class="col col-12 content-group content-group--center-align"> - <h2>SystemML Project Committers</h2><br> + <h2>SystemDS Project Committers</h2><br> </div> <div class="col col-12 content-g"> {% if site.data.contributors %} - {% for member in site.data.contributors %} - <div class="profile"> - <a href="http://github.com/{{ member.githubId }}"> - <img class="profile--img" src="{% unless c.avatar %}http://github.com/{{ member.githubId }}.png{% else %}{{ member.avatar }}{% endunless %}"> - </a> - <div class="profile--info"> - <a class="profile--name" href="http://github.com/{{ member.githubId }}">{{member.name}}</a> - <ul class="bullet-pointless"> - <li></li> - <li>{{member.role}}</li> - <li>{{member.org}}</li> - </ul> - </div> - </div> - {% endfor %} + {% for member in site.data.contributors %} + <div class="profile"> + <a href="http://github.com/{{ member.githubId }}"> + <img class="profile--img" + src="{% unless c.avatar %}http://github.com/{{ member.githubId }}.png{% else %}{{ member.avatar }}{% endunless %}"> + </a> + <div class="profile--info"> + <a class="profile--name" href="http://github.com/{{ member.githubId }}">{{member.name}}</a> + <ul class="bullet-pointless"> + <li></li> + <li>{{member.role}}</li> + <li>{{member.org}}</li> + </ul> + </div> + </div> + {% endfor %} {% endif %} </div> </div> @@ -144,7 +97,8 @@ Before submitting an issue, please: <div class="ml-container ml-container--horizontally-center"> <div class="col col-12 content-group"> <h2>Subscribe to Our Mailing Lists</h2> - <p>For SystemML updates and news, subscribe to our mailing lists. As SystemML grows, so will our community. To unsubscribe, change the recipient from "subscribe" to "unsubscribe."</p> + <p>For SystemDS updates and news, subscribe to our mailing lists. As SystemDS grows, so will our community. To + unsubscribe, change the recipient from "subscribe" to "unsubscribe."</p> </div> </div> @@ -152,11 +106,13 @@ Before submitting an issue, please: <div class="ml-container ml-container--narrow-list feature-content button-group"> <div class="col col-8"> <h3>Developer List</h3> - <p>Questions, feedback, and other SystemML related items are discussed on the dev mailing list.</p> + <p>Questions, feedback, and other SystemDS related items are discussed on the dev mailing list.</p> </div> <div class="col col-4"> - <a href="mailto:{{ site.data.project.dev_list_subscribe }}?subject=send this email to subscribe" class="button button-primary">Subscribe</a> - <a href="{{ site.data.project.dev_list_archive_mailarchive }}" target="_blank" class="button button-secondary">View Archives</a> + <a href="mailto:{{ site.data.project.dev_list_subscribe }}?subject=send this email to subscribe" + class="button button-primary">Subscribe</a> + <a href="{{ site.data.project.dev_list_archive_mailarchive }}" target="_blank" + class="button button-secondary">View Archives</a> </div> </div> @@ -167,8 +123,10 @@ Before submitting an issue, please: <p>JIRA notifications are sent to this list when issues are created, modified or pull requests are submitted.</p> </div> <div class="col col-4"> - <a href="mailto:{{ site.data.project.issues_list_subscribe }}?subject=send this email to subscribe" class="button button-primary">Subscribe</a> - <a href="{{ site.data.project.issues_list_archive_mailarchive }}" target="_blank" class="button button-secondary">View Archives</a> + <a href="mailto:{{ site.data.project.issues_list_subscribe }}?subject=send this email to subscribe" + class="button button-primary">Subscribe</a> + <a href="{{ site.data.project.issues_list_archive_mailarchive }}" target="_blank" + class="button button-secondary">View Archives</a> </div> </div> @@ -176,29 +134,14 @@ Before submitting an issue, please: <div class="ml-container ml-container--narrow-list feature-content button-group"> <div class="col col-8"> <h3>Commits List</h3> - <p>Notifications with code diffs are sent to this list when changes are committed to the SystemML source tree.</p> + <p>Notifications with code diffs are sent to this list when changes are committed to the SystemDS source tree.</p> </div> <div class="col col-4"> - <a href="mailto:{{ site.data.project.commits_list_subscribe }}?subject=send this email to subscribe" class="button button-primary">Subscribe</a> - <a href="{{ site.data.project.commits_list_archive_mailarchive }}" target="_blank" class="button button-secondary">View Archives</a> + <a href="mailto:{{ site.data.project.commits_list_subscribe }}?subject=send this email to subscribe" + class="button button-primary">Subscribe</a> + <a href="{{ site.data.project.commits_list_archive_mailarchive }}" target="_blank" + class="button button-secondary">View Archives</a> </div> </div> </section> - -<!-- #### Feature Requests - -Enhancement requests for new features are also welcome. The more concrete and rationale the request is, the greater the chance it will incorporated into future releases. - - - [https://issues.apache.org/jira/browse/{{ site.data.project.jira }}](https://issues.apache.org/jira/browse/{{ site.data.project.jira }}) - - -### Source Code - -The project sources are accessible via the [source code repository]({{ site.data.project.source_repository }}) which is also mirrored in [GitHub]({{ site.data.project.source_repository_mirror }}) - - -### Website Source Code - -The project website sources are accessible via the [website source code repository]({{ site.data.project.website_repository }}) which is also mirrored in [GitHub]({{ site.data.project.website_repository_mirror }}) --> diff --git a/_src/documentation.html b/_src/documentation.html index 6c19173..a5c21e4 100644 --- a/_src/documentation.html +++ b/_src/documentation.html @@ -32,21 +32,23 @@ limitations under the License. </div> </section> <!-- Publish website test --> -<section class="full-stripe full-stripe--alternate"> - <div class="ml-container"> - <div class="col col-12 content-group content-group--medium-bottom-margin"> - <h2>{{ site.data.project.name }} Documentation</h2> - <p>Documentation such as programming guides, reference guides, and API docs is available online for each version of SystemML below:</p> +<section class="full-stripe full-stripe--alternate hero"> + <div class="ml-container ml-container--three-column"> + <div class="col col-4"> + <p>Documentation such as programming guides, reference guides, and API docs is available for SystemDS below:</p> + <a class="button button-primary" href="systemds/">Latest</a> + </div> + <div class="col col-4"> + <p>each released version of SystemML:</p> <ul> - <li><a href="http://apache.github.io/systemml/";>Latest</a></li> - <li><a href="docs/1.2.0/index.html">1.2.0</a></li> - <li><a href="docs/1.1.0/index.html">1.1.0</a></li> - <li><a href="docs/1.0.0/index.html">1.0.0</a></li> - <li><a href="docs/0.15.0/index.html">0.15.0</a></li> - <li><a href="docs/0.14.0/index.html">0.14.0</a></li> - <li><a href="docs/0.13.0/index.html">0.13.0</a></li> - <li><a href="docs/0.12.0/index.html">0.12.0</a></li> + <li><a href="docs/1.2.0/index">1.2.0</a></li> + <li><a href="docs/1.1.0/index">1.1.0</a></li> + <li><a href="docs/1.0.0/index">1.0.0</a></li> + <li><a href="docs/0.15.0/index">0.15.0</a></li> + <li><a href="docs/0.14.0/index">0.14.0</a></li> + <li><a href="docs/0.13.0/index">0.13.0</a></li> + <li><a href="docs/0.12.0/index">0.12.0</a></li> </ul> </div> </div> -</section> +</section> \ No newline at end of file diff --git a/_src/download.html b/_src/download.html index 74f9604..53de875 100644 --- a/_src/download.html +++ b/_src/download.html @@ -32,79 +32,139 @@ limitations under the License. </div> </section> +<!-- Announcements Banner --> +<section class="full-stripe full-stripe--alternate"> + <div class="ml-container ml-container--narrow"> + <div class="col-8"> + <h2>Build from Source</h2> + <p>Since SystemDS is not released yet we suggest to build from source.</p> + </div> + <div class="col-4 content-group"> + <div></div> + <a class="button button-primary" href="systemds/site/install">Install SystemDS</a> + </div> + </div> +</section> + <section class="full-stripe full-stripe--alternate"> <div class="ml-container"> <div class="col col-12 content-group content-group--medium-bottom-margin"> - <h2>Downloads</h2> - <p>Apache SystemML is released as a source artifact. Binary artifacts (including the ones available in Maven) are made available for your convenience. You will be prompted for a mirror - if the file is not found on yours, please be patient, as it may take 24 hours to reach all mirrors. Apache SystemML is distributed under the <a href="http://www.apache.org/licenses/LICENSE-2.0";>Apache License, version 2.0</a>. </p> + <h2>Downloads SystemML</h2> + <p>Apache SystemML is released as a source artifact. Binary artifacts (including the ones available in Maven) are + made available for your convenience. You will be prompted for a mirror Apache SystemML is distributed under the + <a href="http://www.apache.org/licenses/LICENSE-2.0";>Apache License, version 2.0</a>. </p> </div> <div class="col col-12 content-group"> <h2>Download SystemML {{ site.data.project.release_version }} for Spark 2.0.2 and above</h2> </div> <div class="col col-12 content-group row"> - <div class="span10"> - <table class="table table-hover"> + <div class="span10"> + <table class="table table-hover"> <tr> <th><b>Name</b></th> <th><b>SHA512</b></th> <th><b>Signature</b></th> </tr> <tr> - <td><a href="http://www.apache.org/dyn/closer.lua/systemml/{{ site.data.project.release_version }}/systemml-{{ site.data.project.release_version }}-bin.tgz" target="_blank"> {{ site.data.project.release_name }}-{{ site.data.project.release_version }} (Binary tgz)</a></td> - <td><a href="https://www.apache.org/dist/systemml/{{ site.data.project.release_version }}/systemml-{{ site.data.project.release_version }}-bin.tgz.sha512">SHA512</a> </td> - <td><a href="https://www.apache.org/dist/systemml/{{ site.data.project.release_version }}/systemml-{{ site.data.project.release_version }}-bin.tgz.asc">ASC</a></td> + <td><a + href="http://www.apache.org/dyn/closer.lua/systemml/{{ site.data.project.release_version }}/systemml-{{ site.data.project.release_version }}-bin.tgz" + target="_blank"> {{ site.data.project.release_name }}-{{ site.data.project.release_version }} (Binary + tgz)</a></td> + <td><a + href="https://www.apache.org/dist/systemml/{{ site.data.project.release_version }}/systemml-{{ site.data.project.release_version }}-bin.tgz.sha512">SHA512</a> + </td> + <td><a + href="https://www.apache.org/dist/systemml/{{ site.data.project.release_version }}/systemml-{{ site.data.project.release_version }}-bin.tgz.asc">ASC</a> + </td> </tr> <tr> - <td><a href="http://www.apache.org/dyn/closer.lua/systemml/{{ site.data.project.release_version }}/systemml-{{ site.data.project.release_version }}-bin.zip" target="_blank">{{ site.data.project.release_name }}-{{ site.data.project.release_version }} (Binary zip)</a></td> - <td><a href="https://www.apache.org/dist/systemml/{{ site.data.project.release_version }}/systemml-{{ site.data.project.release_version }}-bin.zip.sha512">SHA512</a></td> - <td><a href="https://www.apache.org/dist/systemml/{{ site.data.project.release_version }}/systemml-{{ site.data.project.release_version }}-bin.zip.asc">ASC</a></td> + <td><a + href="http://www.apache.org/dyn/closer.lua/systemml/{{ site.data.project.release_version }}/systemml-{{ site.data.project.release_version }}-bin.zip" + target="_blank">{{ site.data.project.release_name }}-{{ site.data.project.release_version }} (Binary + zip)</a></td> + <td><a + href="https://www.apache.org/dist/systemml/{{ site.data.project.release_version }}/systemml-{{ site.data.project.release_version }}-bin.zip.sha512">SHA512</a> + </td> + <td><a + href="https://www.apache.org/dist/systemml/{{ site.data.project.release_version }}/systemml-{{ site.data.project.release_version }}-bin.zip.asc">ASC</a> + </td> </tr> <tr> - <td><a href="http://www.apache.org/dyn/closer.lua/systemml/{{ site.data.project.release_version }}/systemml-{{ site.data.project.release_version }}-src.tgz" target="_blank">{{ site.data.project.release_name }}-{{ site.data.project.release_version }} (Source tgz)</a></td> - <td><a href="https://www.apache.org/dist/systemml/{{ site.data.project.release_version }}/systemml-{{ site.data.project.release_version }}-src.tgz.sha512">SHA512</a></td> - <td><a href="https://www.apache.org/dist/systemml/{{ site.data.project.release_version }}/systemml-{{ site.data.project.release_version }}-src.tgz.asc">ASC</a></td> + <td><a + href="http://www.apache.org/dyn/closer.lua/systemml/{{ site.data.project.release_version }}/systemml-{{ site.data.project.release_version }}-src.tgz" + target="_blank">{{ site.data.project.release_name }}-{{ site.data.project.release_version }} (Source + tgz)</a></td> + <td><a + href="https://www.apache.org/dist/systemml/{{ site.data.project.release_version }}/systemml-{{ site.data.project.release_version }}-src.tgz.sha512">SHA512</a> + </td> + <td><a + href="https://www.apache.org/dist/systemml/{{ site.data.project.release_version }}/systemml-{{ site.data.project.release_version }}-src.tgz.asc">ASC</a> + </td> </tr> <tr> - <td><a href="http://www.apache.org/dyn/closer.lua/systemml/{{ site.data.project.release_version }}/systemml-{{ site.data.project.release_version }}-src.zip" target="_blank">{{ site.data.project.release_name }}-{{ site.data.project.release_version }} (Source zip)</a></td> - <td><a href="https://www.apache.org/dist/systemml/{{ site.data.project.release_version }}/systemml-{{ site.data.project.release_version }}-src.zip.sha512">SHA512</a></td> - <td><a href="https://www.apache.org/dist/systemml/{{ site.data.project.release_version }}/systemml-{{ site.data.project.release_version }}-src.zip.asc">ASC</a></td> + <td><a + href="http://www.apache.org/dyn/closer.lua/systemml/{{ site.data.project.release_version }}/systemml-{{ site.data.project.release_version }}-src.zip" + target="_blank">{{ site.data.project.release_name }}-{{ site.data.project.release_version }} (Source + zip)</a></td> + <td><a + href="https://www.apache.org/dist/systemml/{{ site.data.project.release_version }}/systemml-{{ site.data.project.release_version }}-src.zip.sha512">SHA512</a> + </td> + <td><a + href="https://www.apache.org/dist/systemml/{{ site.data.project.release_version }}/systemml-{{ site.data.project.release_version }}-src.zip.asc">ASC</a> + </td> </tr> <tr> - <td><a href="http://www.apache.org/dyn/closer.lua/systemml/{{ site.data.project.release_version }}/systemml-{{ site.data.project.release_version }}-python.tgz" target="_blank">{{ site.data.project.release_name }}-{{ site.data.project.release_version }} (Python package .tgz)</a></td> - <td><a href="https://www.apache.org/dist/systemml/{{ site.data.project.release_version }}/systemml-{{ site.data.project.release_version }}-python.tgz.sha512">SHA512</a></td> - <td><a href="https://www.apache.org/dist/systemml/{{ site.data.project.release_version }}/systemml-{{ site.data.project.release_version }}-python.tgz.asc">ASC</a></td> + <td><a + href="http://www.apache.org/dyn/closer.lua/systemml/{{ site.data.project.release_version }}/systemml-{{ site.data.project.release_version }}-python.tgz" + target="_blank">{{ site.data.project.release_name }}-{{ site.data.project.release_version }} (Python + package .tgz)</a></td> + <td><a + href="https://www.apache.org/dist/systemml/{{ site.data.project.release_version }}/systemml-{{ site.data.project.release_version }}-python.tgz.sha512">SHA512</a> + </td> + <td><a + href="https://www.apache.org/dist/systemml/{{ site.data.project.release_version }}/systemml-{{ site.data.project.release_version }}-python.tgz.asc">ASC</a> + </td> </tr> <tr> - <td><a href="release-notes/systemml-release-notes-{{ site.data.project.release_version }}.html">Release Notes</a></td> + <td><a href="release-notes/systemml-release-notes-{{ site.data.project.release_version }}.html">Release + Notes</a></td> <td></td> <td></td> </tr> - </table> + </table> - <p>Instructions for checking hashes and signatures is described on the <a href="http://www.apache.org/info/verification.html"; target="_blank">Verifying Apache Software Foundation Releases</a> page. - These <a href="https://www.apache.org/dist/systemml/KEYS"; target="_blank">KEYS</a> can be used to <a href="http://www.apache.org/dyn/closer.cgi#verify"; target="_blank">verify</a> the integrity of the downloaded artifact using PGP signature (.asc). - </p> + <p>Instructions for checking hashes and signatures is described on the <a + href="http://www.apache.org/info/verification.html"; target="_blank">Verifying Apache Software Foundation + Releases</a> page. + These <a href="https://www.apache.org/dist/systemml/KEYS"; target="_blank">KEYS</a> can be used to <a + href="http://www.apache.org/dyn/closer.cgi#verify"; target="_blank">verify</a> the integrity of the + downloaded artifact using PGP signature (.asc). + </p> - <h3>Using Maven</h3> + <h3>Using Maven</h3> - <p>We strongly encourage our users to configure a Maven repository mirror closer to their location. <br> - Please read <a href="http://maven.apache.org/guides/mini/guide-mirror-settings.html"; target="_blank">How to Use Mirrors for Repositories</a>. + <p>We strongly encourage our users to configure a Maven repository mirror closer to their location. <br> + Please read <a href="http://maven.apache.org/guides/mini/guide-mirror-settings.html"; target="_blank">How to + Use Mirrors for Repositories</a>. - <h4>Dependencies</h4> + <h4>Dependencies</h4> - <p>Add the following dependencies to your Maven pom.xml.</p> + <p>Add the following dependencies to your Maven pom.xml.</p> - <pre><dependency> + <pre><dependency> <groupId>org.apache.systemml</groupId> <artifactId>systemml</artifactId> <version>{{ site.data.project.release_version }}</version> </dependency></pre> - <h3>Previous Releases</h3> - <p>Previous releases of Apache SystemML can be obtained from <a href="http://archive.apache.org/dist/systemml/"; target="_blank">archives</a>. Previous incubator releases can be obtained from <a href="http://archive.apache.org/dist/incubator/systemml/"; target="_blank">incubator archives</a>. For Spark 1.6 support, please use Apache SystemML 0.12.</p> - </div> + <h3>Previous Releases</h3> + <p>Previous releases of Apache SystemML can be obtained from <a href="http://archive.apache.org/dist/systemml/"; + target="_blank">archives</a>. Previous incubator releases can be obtained from <a + href="http://archive.apache.org/dist/incubator/systemml/"; target="_blank">incubator archives</a>. For Spark + 1.6 support, please use Apache SystemML 0.12.</p> + </div> </div> </div> -</section> +</section> \ No newline at end of file diff --git a/_src/get-started.html b/_src/get-started.html index 81344d4..9541919 100644 --- a/_src/get-started.html +++ b/_src/get-started.html @@ -36,49 +36,64 @@ limitations under the License. <section class="full-stripe full-stripe--alternate"> <div class="ml-container ml-container--vertically-centered ml-container--reverse-order"> <div class="col col-6 content-group content-group--more-padding"> - <img src="/assets/img/robotTutorialSm.png" alt="What is Apache SystemML?"> + <img src="/assets/img/robotTutorialSm.png" alt="What is Apache SystemDS?"> </div> <div class="col col-6 content-group content-group--more-padding button-group"> - <h2>Install SystemML</h2> + <h2>Install SystemDS</h2> <h4><strong>Level:</strong> Beginner | <strong>Time:</strong> 20 minutes</h4><br> - <p>New to Apache SystemML? Try our quick install guide that will walk you through setting up your environment and getting you up and going with SystemML.‎</p> - <a class="button button-secondary" href="tutorials.html">Tutorials</a> - <a class="button button-primary" href="install-systemml.html">Install SystemML</a> + <p>New to Apache SystemDS? Try our quick install guide that will walk you through setting up your environment and + getting you up and going with SystemDS.‎</p> + <a class="button button-primary" href="systemds/site/install">Install SystemDS</a> </div> </div> <!-- Sample Notebooks --> - <h2 id="sample-notebook" class="text-center">Sample Notebooks</h2> + <!-- <h2 id="sample-notebook" class="text-center">Sample Notebooks</h2> <div class="flex-container"> <div class="nb-card"> - <h3>Linear Regression Algorithms Demo</h3> - <p>This notebook demonstrates the development of various linear regression algorithms in SystemML.</p> - <a class="nb-link" href="https://github.com/apache/systemml/blob/master/samples/jupyter-notebooks/Linear_Regression_Algorithms_Demo.ipynb"; target="_blank"><span class="icon jupyter-logo"></span><span>View on Github</span></a> + <h3>Linear Regression Algorithms Demo</h3> + <p>This notebook demonstrates the development of various linear regression algorithms in SystemML.</p> + <a class="nb-link" + href="https://github.com/apache/systemml/blob/master/samples/jupyter-notebooks/Linear_Regression_Algorithms_Demo.ipynb"; + target="_blank"><span class="icon jupyter-logo"></span><span>View on Github</span></a> </div> <div class="nb-card"> - <h3>Deep Learning Image Classification</h3> - <p>This notebook shows SystemML Deep Learning functionality to map images of single digit numbers to their corresponding numeric representations.</p> - <a class="nb-link" href="https://github.com/apache/systemml/blob/master/samples/jupyter-notebooks/Deep_Learning_Image_Classification.ipynb"; target="_blank"><span class="icon jupyter-logo"></span><span>View on Github</span></a> + <h3>Deep Learning Image Classification</h3> + <p>This notebook shows SystemML Deep Learning functionality to map images of single digit numbers to their + corresponding numeric representations.</p> + <a class="nb-link" + href="https://github.com/apache/systemml/blob/master/samples/jupyter-notebooks/Deep_Learning_Image_Classification.ipynb"; + target="_blank"><span class="icon jupyter-logo"></span><span>View on Github</span></a> </div> <div class="nb-card"> - <h3>SystemML PySpark Recommendation Demo</h3> - <p>This demonstrates using SystemML for product recommendation using Poisson NonNegative Matrix Factorization (PNMF) with PNMF algorithm written using R like syntax.</p> - <a class="nb-link" href="https://github.com/apache/systemml/blob/master/samples/jupyter-notebooks/SystemML-PySpark-Recommendation-Demo.ipynb"; target="_blank"><span class="icon jupyter-logo"></span><span>View on Github</span></a> + <h3>SystemML PySpark Recommendation Demo</h3> + <p>This demonstrates using SystemML for product recommendation using Poisson NonNegative Matrix Factorization + (PNMF) with PNMF algorithm written using R like syntax.</p> + <a class="nb-link" + href="https://github.com/apache/systemml/blob/master/samples/jupyter-notebooks/SystemML-PySpark-Recommendation-Demo.ipynb"; + target="_blank"><span class="icon jupyter-logo"></span><span>View on Github</span></a> </div> <div class="nb-card"> - <h3>SystemML Scala Tutorial</h3> - <p>This tutorial includes simple example to run DML script and display output.</p> - <a class="nb-link" href="https://github.com/apache/systemml/blob/master/samples/jupyter-notebooks/tutorial1.ipynb"; target="_blank"><span class="icon jupyter-logo"></span><span>View on Github</span></a> + <h3>SystemML Scala Tutorial</h3> + <p>This tutorial includes simple example to run DML script and display output.</p> + <a class="nb-link" href="https://github.com/apache/systemml/blob/master/samples/jupyter-notebooks/tutorial1.ipynb"; + target="_blank"><span class="icon jupyter-logo"></span><span>View on Github</span></a> </div> <div class="nb-card"> - <h3>Autoencoder</h3> - <p>This notebook demonstrates the invocation of the SystemML autoencoder script, and alternative ways of passing in/out data.</p> - <a class="nb-link" href="https://github.com/apache/systemml/blob/master/samples/jupyter-notebooks/Autoencoder.ipynb"; target="_blank"><span class="icon jupyter-logo"></span><span>View on Github</span></a> + <h3>Autoencoder</h3> + <p>This notebook demonstrates the invocation of the SystemML autoencoder script, and alternative ways of passing + in/out data.</p> + <a class="nb-link" + href="https://github.com/apache/systemml/blob/master/samples/jupyter-notebooks/Autoencoder.ipynb"; + target="_blank"><span class="icon jupyter-logo"></span><span>View on Github</span></a> </div> <div class="nb-card"> - <h3>DML Tips and Tricks</h3> - <p>This example shows helpful matrix processing techniques and other linear algebra operations using SystemML's Declarative Machine Learning (DML) scripting language.</p> - <a class="nb-link" href="https://github.com/apache/systemml/blob/master/samples/jupyter-notebooks/DML%20Tips%20and%20Tricks%20(aka%20Fun%20With%20DML).ipynb" target="_blank"><span class="icon jupyter-logo"></span><span>View on Github</span></a> + <h3>DML Tips and Tricks</h3> + <p>This example shows helpful matrix processing techniques and other linear algebra operations using SystemML's + Declarative Machine Learning (DML) scripting language.</p> + <a class="nb-link" + href="https://github.com/apache/systemml/blob/master/samples/jupyter-notebooks/DML%20Tips%20and%20Tricks%20(aka%20Fun%20With%20DML).ipynb" + target="_blank"><span class="icon jupyter-logo"></span><span>View on Github</span></a> </div> - </div> -</section> + </div> --> +</section> \ No newline at end of file diff --git a/_src/index.md b/_src/index.md index 33ebe6d..c8ef0ed 100644 --- a/_src/index.md +++ b/_src/index.md @@ -1,6 +1,6 @@ --- layout: home -title: Apache SystemML - Declarative Large-Scale Machine Learning +title: Apache SystemDS - Declarative Large-Scale Machine Learning type: Home --- <!-- @@ -21,41 +21,3 @@ See the License for the specific language governing permissions and limitations under the License. {% endcomment %} --> -<!-- ## Apache SystemML - -SystemML provides declarative large-scale machine learning (ML) that aims at flexible specification of ML algorithms and automatic generation of hybrid runtime plans ranging from single-node, in-memory computations, to distributed computations on Apache Hadoop and Apache Spark. - -### Algorithm Customizability - -ML algorithms are expressed in an R-like or Python-like syntax that includes linear algebra primitives, statistical functions, and ML-specific constructs. This high-level language significantly increases the productivity of data scientists as it provides (1) full flexibility in expressing custom analytics, and (2) data independence from the underlying input formats and physical data representations. Automatic optimization according to data and cluster characteristics ensures both effic [...] - -**Poisson Nonnegative Matrix Factorization in SystemML's R-like Syntax** -{% highlight r %} -while (iter < max_iterations) { - iter = iter + 1; - H = (H * (t(W) %*% (V/(W%*%H)))) / t(colSums(W)); - W = (W * ((V/(W%*%H)) %*% t(H))) / t(rowSums(H)); - obj = as.scalar(colSums(W) %*% rowSums(H)) - sum(V * log(W%*%H)); - print("iter=" + iter + " obj=" + obj); -} -{% endhighlight %} - -### Multiple Execution Modes - -SystemML computations can be executed in a variety of different modes. To begin with, SystemML can be operated in Standalone mode on a single machine, allowing data scientists to develop algorithms locally without need of a distributed cluster. Algorithms can be distributed across Hadoop or Spark. This flexibility allows the utilization of an organization's existing resources and expertise. In addition, SystemML can be operated via Java and Scala. SystemML also features an embedded [...] - -{% highlight sh %} -// Standalone -./bin/systemml test.dml - -// Spark -$SPARK_HOME/bin/spark-submit SystemML.jar -f test.dml -exec hybrid_spark - -// Hadoop MapReduce -hadoop jar SystemML.jar -f test.dml -exec hybrid -{% endhighlight %} - -### Automatic Optimization - -Algorithms specified in DML and PyDML are dynamically compiled and optimized based on data and cluster characteristics using rule-based and cost-based optimization techniques. The optimizer automatically generates hybrid runtime execution plans ranging from in-memory single-node execution to distributed computations on Spark or Hadoop. This ensures both efficiency and scalability. Automatic optimization reduces or eliminates the need to hand-tune distributed runtime execution plans an [...] - --> diff --git a/_src/maturity.html b/_src/maturity.html deleted file mode 100644 index 7c9c833..0000000 Binary files a/_src/maturity.html and /dev/null differ diff --git a/_src/privacy-policy.html b/_src/privacy-policy.html index 7c812c1..23821c2 100644 --- a/_src/privacy-policy.html +++ b/_src/privacy-policy.html @@ -1,7 +1,7 @@ --- layout: page title: Privacy Policy -description: Apache SystemML website privacy policy +description: Apache SystemDS website privacy policy group: nav-right --- <!-- @@ -24,22 +24,24 @@ limitations under the License. --> <div class="ml-container clear-header"> - - <h1>{{ site.data.project.name }} Privacy Policy</h1> - - Information about your use of this website is collected using server access logs and a tracking cookie. The collected information consists of the following: - + <h1>{{ site.data.project.name }} Privacy Policy</h1> + <p>Information about your use of this website is collected using server access logs and a tracking cookie. The + collected information consists of the following:</p> <ul> - <li>The IP address from which you access the website</li> - <li>The type of browser and operating system you use to access our site</li> - <li>The date and time you access our site</li> - <li>The pages you visit</li> - <li>The addresses of pages from where you followed a link to our site</li> + <li>The IP address from which you access the website</li> + <li>The type of browser and operating system you use to access our site</li> + <li>The date and time you access our site</li> + <li>The pages you visit</li> + <li>The addresses of pages from where you followed a link to our site</li> </ul> - - Part of this information is gathered using a tracking cookie set by the [Google Analytics](http://www.google.com/analytics/) service and handled by Google as described in their [privacy policy](http://www.google.com/privacy.html). See your browser documentation for instructions on how to disable the cookie if you prefer not to share this data with Google. - </br></br> - We use the gathered information to help us make our site more useful to visitors and to better understand how and when our site is used. We do not track or collect personally identifiable information or associate gathered data with any personally identifying information from other sources. - </br></br> - By using this website, you consent to the collection of this data in the manner and for the purpose described above. -</div> + <p>Part of this information is gathered using a tracking cookie set by the [Google + Analytics](http://www.google.com/analytics/) service and handled by Google as described in their [privacy + policy](http://www.google.com/privacy.html). See your browser documentation for instructions on how to disable the + cookie if you prefer not to share this data with Google.</p> + <p>We use the gathered information to help us make our site more useful to visitors and to better understand how and + when + our site is used. We do not track or collect personally identifiable information or associate gathered data with any + personally identifying information from other sources.</p> + <p>By using this website, you consent to the collection of this data in the manner and for the purpose described + above.</p> +</div> \ No newline at end of file diff --git a/_src/roadmap.html b/_src/roadmap.html index f247051..b95053d 100644 --- a/_src/roadmap.html +++ b/_src/roadmap.html @@ -1,7 +1,7 @@ --- layout: page title: Roadmap -description: Apache SystemML Roadmap +description: Apache SystemDS Roadmap group: nav-right --- <!-- @@ -45,7 +45,7 @@ limitations under the License. <li>NN optimization test suite with well known optimization test functions</li> <li>Model selection & hyper parameter tuning</li> <li>Additional distribution functions, e.g. weibull, gamma</li> - <li>Time Series Analysis and Anomaly Detection</li> + <li>Time Series Analysis and Anomaly Detection</li> <li>Scalable Decomposition Algorithms</li> </ul> </li> @@ -75,7 +75,7 @@ limitations under the License. <li>Ultra-sparse datasets</li> </ul> </li> - <li>Model Serving</li> + <li>Model Serving</li> <li>Misc Runtime <ul> <li>NUMA-awareness (thread pools, matrix partitioning)</li> @@ -102,21 +102,22 @@ limitations under the License. <ul> <li> <strong>SystemML 1.2.0 (<a href="release-notes/systemml-release-notes-1.2.0.html">released</a> in Aug, 2018) - <a href="https://issues.apache.org/jira/secure/ReleaseNote.jspa?version=12342959&projectId=12319522";>details</a></strong> + <a + href="https://issues.apache.org/jira/secure/ReleaseNote.jspa?version=12342959&projectId=12319522";>details</a></strong> <ul> - <li>New data type list for lists and structs</li> - <li>Built in deep learning functions, e.g. convolution, maxpooling, bias</li> - <li>DML eval function</li> - <li>Multiple new builtin functions, e.g. exists, lower.tri, upper.tri</li> - <li>Code motion, global subexpression elimination, rewrites for codegen</li> - <li>Performance improvements for ultra-sparse data and instruction generation + <li>New data type list for lists and structs</li> + <li>Built in deep learning functions, e.g. convolution, maxpooling, bias</li> + <li>DML eval function</li> + <li>Multiple new builtin functions, e.g. exists, lower.tri, upper.tri</li> + <li>Code motion, global subexpression elimination, rewrites for codegen</li> + <li>Performance improvements for ultra-sparse data and instruction generation </ul> </li> <li> Experimental Features <ul> <li>Parameter server</li> - <li>Sparsity estimators</li> + <li>Sparsity estimators</li> </ul> </li> <li> @@ -133,25 +134,32 @@ limitations under the License. <ul> <li> <strong>SystemML 1.1.0 (<a href="release-notes/systemml-release-notes-1.1.0.html">released</a> in March, 2018) - <a href="https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12319522&version=12342282";>details</a></strong> - <ul> - <li>New Builtin Functions: `ifelse`, `assert`, `eval`, `avg_pool`, `avg_pool_backward`</li> - <li>Additional Layers in NN library: average pooling, upsampling, low-rank fully connected</li> - <li>New Capabilities/Features such as dense matrix blocks >16GB, additional ParFor result aggregation operations, UDFs callable in expressions, zero rows/columns matrices, matrix-matrix multiplication over compressed matrices</li> + <a + href="https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12319522&version=12342282";>details</a></strong> + <ul> + <li>New Builtin Functions: `ifelse`, `assert`, `eval`, `avg_pool`, `avg_pool_backward`</li> + <li>Additional Layers in NN library: average pooling, upsampling, low-rank fully connected</li> + <li>New Capabilities/Features such as dense matrix blocks >16GB, additional ParFor result aggregation + operations, UDFs callable in expressions, zero rows/columns matrices, matrix-matrix multiplication over + compressed matrices</li> <li>Extended Caffe2DML and Keras2DML APIs</li> <li>Compiler & Runtime enhancements</> <li>Performance improvements</li> </ul> </li> <li> - <strong>SystemML 1.0.0 (<a href="release-notes/systemml-release-notes-1.0.0.html">released</a> in December, 2017) - <a href="https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12319522&version=12338328";>details</a></strong> + <strong>SystemML 1.0.0 (<a href="release-notes/systemml-release-notes-1.0.0.html">released</a> in December, + 2017) + <a + href="https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12319522&version=12338328";>details</a></strong> <ul> - <li>Enhanced Deep Learning support with enhanced NN layers and functions, Caffe2DML, and operator implementation</li> + <li>Enhanced Deep Learning support with enhanced NN layers and functions, Caffe2DML, and operator + implementation</li> <li>Native BLAS support</li> <li>Additional algorithms: autoencoder, enhanced PCA</li> <li>Enhanced rewrites, IPA, vectorization, and instruction generation</li> - <li>Enhanced JMLC API, e.g. prepared scripts with thread affinity for outputs and configs, script cloning, configuration management</li> + <li>Enhanced JMLC API, e.g. prepared scripts with thread affinity for outputs and configs, script cloning, + configuration management</li> <li>SystemML Lite artifact</li> <li>Compression on by default</li> </ul> @@ -161,7 +169,7 @@ limitations under the License. <ul> <li>Keras2DML.</li> <li>Enhanced code generation, code gen optimizer, and multi-threaded codegen operators/li> - <li>Enhanced GPU support</li> + <li>Enhanced GPU support</li> </ul> </li> <li> @@ -171,8 +179,10 @@ limitations under the License. </ul> </li> <li> - <strong>SystemML 0.15.0 (<a href="release-notes/systemml-release-notes-0.15.0.html">released</a> in September, 2017) - <a href="https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12319522&version=12341587";>details</a></strong> + <strong>SystemML 0.15.0 (<a href="release-notes/systemml-release-notes-0.15.0.html">released</a> in September, + 2017) + <a + href="https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12319522&version=12341587";>details</a></strong> <ul> <li>Added several new 2D convolution layers</li> <li>Graduated `nn` library from staging to `scripts/nn`</li> @@ -196,19 +206,30 @@ limitations under the License. <ul> <li> - <strong>SystemML 0.14.0-incubating (<a href="release-notes/systemml-release-notes-0.14.0-incubating.html">released</a> in May, 2017) - <a href="https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12319522&version=12340322";>details</a></strong> + <strong>SystemML 0.14.0-incubating (<a + href="release-notes/systemml-release-notes-0.14.0-incubating.html">released</a> in May, 2017) + <a + href="https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12319522&version=12340322";>details</a></strong> <ul> - <li>Runtime feature extensions (new libsvm-binary data converters, parfor spark buffer pool handling, parfor block partitioning of fixed size batches of rows or columns, native dataset support in parfor spark datapartition-execute)</li> - <li>Compiler feature extensions (improved parfor execution type selection, improved literal replacement for nrow/ncol, simplified instruction generation across back-ends, consolidated static/dynamic rewrite utilities)</li> + <li>Runtime feature extensions (new libsvm-binary data converters, parfor spark buffer pool handling, parfor + block partitioning of fixed size batches of rows or columns, native dataset support in parfor spark + datapartition-execute)</li> + <li>Compiler feature extensions (improved parfor execution type selection, improved literal replacement for + nrow/ncol, simplified instruction generation across back-ends, consolidated static/dynamic rewrite + utilities)</li> </ul> </li> <li> Experimental Features <ul> - <li>New Code Generation capabilities for automatic operator fusion (basic code generator, compiler integration, runtime integration, in-memory source code compilation, extended explain tool, support for right indexing and replace in cellwise and - row aggregate templates, support for row, column, or no aggregation in rowwise template). Note code generation provides significant performance gains with fewer read/write intermediates, reduced scans of inputs and intermediates, and enhanced - sparsity exploitation. To enable this feature, set codegen.enabled property to true in SystemML-config.xml file.</li> + <li>New Code Generation capabilities for automatic operator fusion (basic code generator, compiler + integration, runtime integration, in-memory source code compilation, extended explain tool, support for + right indexing and replace in cellwise and + row aggregate templates, support for row, column, or no aggregation in rowwise template). Note code + generation provides significant performance gains with fewer read/write intermediates, reduced scans of + inputs and intermediates, and enhanced + sparsity exploitation. To enable this feature, set codegen.enabled property to true in SystemML-config.xml + file.</li> <li>New instructions and operators for GPU support (relu_maxpooling, conv2d_bias_add, bias_multiply)</li> </ul> </li> @@ -223,8 +244,10 @@ limitations under the License. <ul> <li> - <strong>SystemML 0.13.0-incubating (<a href="release-notes/systemml-release-notes-0.13.0-incubating.html">released</a> in March, 2017) - <a href="https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12319522&version=12339247";>details</a></strong> + <strong>SystemML 0.13.0-incubating (<a + href="release-notes/systemml-release-notes-0.13.0-incubating.html">released</a> in March, 2017) + <a + href="https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12319522&version=12339247";>details</a></strong> <ul> <li>Updated build for Spark 2.1.0</li> <li>New simplification rewrites for stratstats</li> @@ -256,15 +279,18 @@ limitations under the License. <li> Experimental Features / Algorithms <ul> - <li>Compressed Linear Algebra v2 (new DDC encoding format, hardened sample-based estimators, debugging tools, new column grouping algorithm, additional operations)</li> + <li>Compressed Linear Algebra v2 (new DDC encoding format, hardened sample-based estimators, debugging + tools, new column grouping algorithm, additional operations)</li> </ul> </li> </ul> <ul> <li> - <strong>SystemML 0.12.0-incubating (<a href="release-notes/systemml-release-notes-0.12.0-incubating.html">released</a> in February, 2017) - <a href="https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12319522&version=12339246";>details</a></strong> + <strong>SystemML 0.12.0-incubating (<a + href="release-notes/systemml-release-notes-0.12.0-incubating.html">released</a> in February, 2017) + <a + href="https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12319522&version=12339246";>details</a></strong> <ul> <li>Support pip install of new python package</li> <li>Allow NumPy arrays, Pandas DataFrame and SciPy matrices as input to MLContext</li> @@ -283,8 +309,10 @@ limitations under the License. <ul> <li> - <strong>SystemML 0.11.0-incubating (<a href="release-notes/systemml-release-notes-0.11.0-incubating.html">released</a> in November, 2016) - <a href="https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12319522&version=12335820";>details</a></strong> + <strong>SystemML 0.11.0-incubating (<a + href="release-notes/systemml-release-notes-0.11.0-incubating.html">released</a> in November, 2016) + <a + href="https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12319522&version=12335820";>details</a></strong> <ul> <li>SystemML frames</li> <li>New MLContext API</li> @@ -321,8 +349,10 @@ limitations under the License. <ul> <li> - <strong>SystemML 0.10.0-incubating (<a href="release-notes/systemml-release-notes-0.10.0-incubating.html">released</a> in June, 2016) - <a href="https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12319522&version=12334651";>details</a></strong> + <strong>SystemML 0.10.0-incubating (<a + href="release-notes/systemml-release-notes-0.10.0-incubating.html">released</a> in June, 2016) + <a + href="https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12319522&version=12334651";>details</a></strong> <ul> <li>Different types of Spark Matrix Blocks: MCSR, CSR, COO</li> <li>SystemML Frame support in JMLC/CP</li> @@ -348,8 +378,10 @@ limitations under the License. <ul> <li> - <strong>SystemML 0.9.0-incubating (<a href="release-notes/systemml-release-notes-0.9.0-incubating.html">released</a> in January, 2016) - <a href="https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12319522&version=12334650";>details</a></strong> + <strong>SystemML 0.9.0-incubating (<a + href="release-notes/systemml-release-notes-0.9.0-incubating.html">released</a> in January, 2016) + <a + href="https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12319522&version=12334650";>details</a></strong> <ul> <li>Improvements to MLContext and MLPipeline wrappers</li> <li>New converter utilities for RDDs and DataFrames</li> @@ -367,4 +399,4 @@ limitations under the License. </ul> </div> </div> -</section> +</section> \ No newline at end of file diff --git a/_src/security.html b/_src/security.html index 2b7c446..f1e3377 100644 --- a/_src/security.html +++ b/_src/security.html @@ -1,7 +1,7 @@ --- layout: page -title: Apache SystemML Security -description: Apache SystemML security +title: Apache SystemDS Security +description: Apache SystemDS security group: nav-right --- <!-- @@ -24,20 +24,24 @@ limitations under the License. --> <div class="ml-container clear-header"> - - <h1>{{ site.data.project.name }} Security</h1> - <p> - The Apache Software Foundation takes a very active stance in eliminating security problems with its projects. - If you have any security concerns regarding Apache SystemML™, or believe you have uncovered a vulnerability or potential threat, contact the Apache Security Team at <a href="mailto:[email protected]?Subject=[SECURITY][SYSTEMML] My security issue">[email protected]</a>. - Include a description of the issue and try to provide steps to reproduce the problem. - The Apache SystemML™ Community and the Apache Security Team take security issues very seriously and will respond. - </p> - <p> - Note the general Apache Security mailing address <a href="mailto:[email protected]";>[email protected]</a> is private and should be used only for undisclosed vulnerabilities.</br> - <b>Please report any security problems to Apache Security Team before disclosing it publicly.</b> - </p> - <p> - The <span class="caps">ASF</span> Security team maintains a page with a description of how vulnerabilities and potential threats are handled. Refer to their <a href="http://www.apache.org/security/";>security page</a> for more information. - </p> - + <h1>{{ site.data.project.name }} Security</h1> + <p> + The Apache Software Foundation takes a very active stance in eliminating security problems with its projects. + If you have any security concerns regarding Apache SystemDS™, or believe you have uncovered a vulnerability or + potential threat, contact the Apache Security Team at <a + href="mailto:[email protected]?Subject=[SECURITY][SYSTEMML] My security issue">[email protected]</a>. + Include a description of the issue and try to provide steps to reproduce the problem. + The Apache SystemDS™ Community and the Apache Security Team take security issues very seriously and will + respond. + </p> + <p> + Note the general Apache Security mailing address <a href="mailto:[email protected]";>[email protected]</a> is + private and should be used only for undisclosed vulnerabilities.</br> + <b>Please report any security problems to Apache Security Team before disclosing it publicly.</b> + </p> + <p> + The <span class="caps">ASF</span> Security team maintains a page with a description of how vulnerabilities and + potential threats are handled. Refer to their <a href="http://www.apache.org/security/";>security page</a> for more + information. + </p> </div>
