Repository: arrow-site Updated Branches: refs/heads/asf-site 3f1ca5966 -> 3a7bab251
Update site per @kou additions Project: http://git-wip-us.apache.org/repos/asf/arrow-site/repo Commit: http://git-wip-us.apache.org/repos/asf/arrow-site/commit/3a7bab25 Tree: http://git-wip-us.apache.org/repos/asf/arrow-site/tree/3a7bab25 Diff: http://git-wip-us.apache.org/repos/asf/arrow-site/diff/3a7bab25 Branch: refs/heads/asf-site Commit: 3a7bab2514da24c7a3e98b365266b49cdf092bf2 Parents: 3f1ca59 Author: Wes McKinney <wes.mckin...@twosigma.com> Authored: Thu May 11 17:03:10 2017 -0400 Committer: Wes McKinney <wes.mckin...@twosigma.com> Committed: Thu May 11 17:03:10 2017 -0400 ---------------------------------------------------------------------- blog/2017/05/08/0.3-release-japanese/index.html | 275 +++++++++++++++++++ blog/2017/05/08/0.3-release/index.html | 6 +- blog/index.html | 10 +- feed.xml | 144 +++++++++- install/index.html | 74 ++++- 5 files changed, 501 insertions(+), 8 deletions(-) ---------------------------------------------------------------------- http://git-wip-us.apache.org/repos/asf/arrow-site/blob/3a7bab25/blog/2017/05/08/0.3-release-japanese/index.html ---------------------------------------------------------------------- diff --git a/blog/2017/05/08/0.3-release-japanese/index.html b/blog/2017/05/08/0.3-release-japanese/index.html new file mode 100644 index 0000000..b284171 --- /dev/null +++ b/blog/2017/05/08/0.3-release-japanese/index.html @@ -0,0 +1,275 @@ +<!DOCTYPE html> +<html lang="en-US"> + <head> + <meta charset="UTF-8"> + <title>Apache Arrow 0.3.0ãªãªã¼ã¹</title> + <meta http-equiv="X-UA-Compatible" content="IE=edge"> + <meta name="viewport" content="width=device-width, initial-scale=1"> + <meta name="generator" content="Jekyll v3.4.3"> + <!-- The above 3 meta tags *must* come first in the head; any other head content must come *after* these tags --> + <link rel="icon" type="image/x-icon" href="/favicon.ico"> + + <title>Apache Arrow Homepage</title> + <link rel="stylesheet" href="//fonts.googleapis.com/css?family=Lato:300,300italic,400,400italic,700,700italic,900"> + + <link href="/css/main.css" rel="stylesheet"> + <script src="https://code.jquery.com/jquery-3.2.1.min.js"; + integrity="sha256-hwg4gsxgFZhOsEEamdOYGBf13FyQuiTwlAQgxVSNgt4=" + crossorigin="anonymous"></script> + <script src="/assets/javascripts/bootstrap.min.js"></script> + </head> + + + +<body class="wrap"> + <div class="container"> + <nav class="navbar navbar-default"> + <div class="container-fluid"> + <div class="navbar-header"> + <button type="button" class="navbar-toggle" data-toggle="collapse" data-target="#arrow-navbar"> + <span class="sr-only">Toggle navigation</span> + <span class="icon-bar"></span> + <span class="icon-bar"></span> + <span class="icon-bar"></span> + </button> + <a class="navbar-brand" href="/">Apache Arrow™ </a> + </div> + + <!-- Collect the nav links, forms, and other content for toggling --> + <div class="collapse navbar-collapse" id="arrow-navbar"> + <ul class="nav navbar-nav"> + <li class="dropdown"> + <a href="#" class="dropdown-toggle" data-toggle="dropdown" + role="button" aria-haspopup="true" + aria-expanded="false">Project Links<span class="caret"></span> + </a> + <ul class="dropdown-menu"> + <li><a href="/install/">Install</a></li> + <li><a href="/blog/">Blog</a></li> + <li><a href="/release/">Releases</a></li> + <li><a href="https://issues.apache.org/jira/browse/ARROW";>Issue Tracker</a></li> + <li><a href="https://github.com/apache/arrow";>Source Code</a></li> + <li><a href="http://mail-archives.apache.org/mod_mbox/arrow-dev/";>Mailing List</a></li> + <li><a href="https://apachearrowslackin.herokuapp.com";>Slack Channel</a></li> + <li><a href="/committers/">Committers</a></li> + </ul> + </li> + <li class="dropdown"> + <a href="#" class="dropdown-toggle" data-toggle="dropdown" + role="button" aria-haspopup="true" + aria-expanded="false">Specification<span class="caret"></span> + </a> + <ul class="dropdown-menu"> + <li><a href="/docs/memory_layout.html">Memory Layout</a></li> + <li><a href="/docs/metadata.html">Metadata</a></li> + <li><a href="/docs/ipc.html">Messaging / IPC</a></li> + </ul> + </li> + + <li class="dropdown"> + <a href="#" class="dropdown-toggle" data-toggle="dropdown" + role="button" aria-haspopup="true" + aria-expanded="false">Documentation<span class="caret"></span> + </a> + <ul class="dropdown-menu"> + <li><a href="/docs/python">Python</a></li> + <li><a href="/docs/cpp">C++ API</a></li> + <li><a href="/docs/java">Java API</a></li> + <li><a href="/docs/c_glib">C GLib API</a></li> + </ul> + </li> + <!-- <li><a href="/blog">Blog</a></li> --> + <li class="dropdown"> + <a href="#" class="dropdown-toggle" data-toggle="dropdown" + role="button" aria-haspopup="true" + aria-expanded="false">ASF Links<span class="caret"></span> + </a> + <ul class="dropdown-menu"> + <li><a href="http://www.apache.org/";>ASF Website</a></li> + <li><a href="http://www.apache.org/licenses/";>License</a></li> + <li><a href="http://www.apache.org/foundation/sponsorship.html";>Donate</a></li> + <li><a href="http://www.apache.org/foundation/thanks.html";>Thanks</a></li> + <li><a href="http://www.apache.org/security/";>Security</a></li> + </ul> + </li> + </ul> + <a href="http://www.apache.org/";> + <img style="float:right;" src="/img/asf_logo.svg" width="120px"/> + </a> + </div><!-- /.navbar-collapse --> + </div> + </nav> + + + <h2> + Apache Arrow 0.3.0ãªãªã¼ã¹ + <a href="/blog/2017/05/08/0.3-release-japanese/" class="permalink" title="Permalink">â</a> + </h2> + + + + <div class="panel"> + <div class="panel-body"> + <div> + <span class="label label-default">Published</span> + <span class="published"> + <i class="fa fa-calendar"></i> + 08 May 2017 + </span> + </div> + <div> + <span class="label label-default">By</span> + <a href="http://wesmckinney.com";><i class="fa fa-user"></i> Wes McKinney (wesm)</a> + </div> + </div> + </div> + + <!-- + +--> + +<p><a href="/blog/2017/05/08/0.3-release/">åæï¼Englishï¼</a></p> + +<p>Apache Arrowãã¼ã ã¯0.3.0ã®ãªãªã¼ã¹ãã¢ãã¦ã³ã¹ã§ãã¦ããããã§ãã2æã«ãªãªã¼ã¹ãã0.2.0ãã10é±éã®æ´»çºãªéçºã®çµæãä»åã®ãªãªã¼ã¹ã§ãã<a href="https://github.com/apache/arrow/graphs/contributors";><strong>23人ã®ã³ã³ããªãã¥ã¼ã¿ã¼</strong></a>ã<a href="https://issues.apache.org/jira/issues/?jql=project%20%3D%20ARROW%20AND%20status%20in%20(Resolved%2C%20Closed)%20AND%20fixVersion%20%3D%200.3.0"><strong>306åã®JIRAã®issueã解決</strong></a>ãã¾ããã</p> + +<p>è¤æ°ã®Arrowã®å®è£ ã«ããããã®æ°ããæ©è½ã追å ãã¦ãã¾ãã2017å¹´ãç¹ã«æ³¨åãã¦éçºããã®ã¯ãã¤ã³ã¡ã¢ãªã¼ç¨ã®ãã©ã¼ããããåã®ã¡ã¿ãã¼ã¿ãã¡ãã»ã¼ã¸ã³ã°ç¨ã®ãããã³ã«ã§ããããã¯ãããã°ãã¼ã¿ã¢ããªã±ã¼ã·ã§ã³ã«<strong>å®å®ãã¦ãã¦ãããã¯ã·ã§ã³ã§ä½¿ããåºç¤</strong>ãæä¾ããããã§ããé«æ§è½IOã¨ã¤ã³ã¡ã¢ãªã¼ãã¼ã¿å¦çã«Arrowãæ´»ç¨ããããã«ã<a href="http://spark.apache.org";>Apache Spark</a>ã»<a href="http://www.geomesa.org/";>GeoMesa</a>ã³ãã¥ããã£ã¼ã¨ååãã¦ãã¦ã¨ã¦ãã¨ããµã¤ãã£ã³ã°ã§ãã</p> + +<p>ããããã®ãã©ãããã©ã¼ã ã§Arrowã使ãæ¹æ³ã¯<a href="http://arrow.apache.org/install";>ã¤ã³ã¹ãã¼ã«ãã¼ã¸</a>ãè¦ã¦ãã ããã</p> + +<p>Arrowã§ããã°ãã¼ã¿ã·ã¹ãã ãé«éåããã±ã¼ã¹ãå¢ããããã«ãè¿ããã¡ã«Apache Arrowã®ãã¼ãããããå ¬éããäºå®ã§ãã</p> + +<p>Arrowã®éçºã«åå ããã³ã³ããªãã¥ã¼ã¿ã¼ãåéãã¦ãã¾ãããã§ã«Arrowã®éçºã«åå ãã¦ããã³ãã¥ããã£ã¼ããã®ã³ã³ããªãã¥ã¼ã¿ã¼ãããã§ãããã¾ã åå ãã¦ããªãGoãRãJuliaã¨ãã£ãã³ãã¥ããã£ã¼ããã®ã³ã³ããªãã¥ã¼ã¿ã¼ãåéãã¦ãã¾ãã</p> + +<h3 id="ãã¡ã¤ã«ãã©ã¼ãããã¨ã¹ããªã¼ãã³ã°ãã©ã¼ãããã®å¼·å">ãã¡ã¤ã«ãã©ã¼ãããã¨ã¹ããªã¼ãã³ã°ãã©ã¼ãããã®å¼·å</h3> + +<p>0.2.0ã§ã¯<strong>ã©ã³ãã ã¢ã¯ã»ã¹</strong>ç¨ã¨<strong>ã¹ããªã¼ãã³ã°</strong>ç¨ã®Arrowã®ã¯ã¤ã¤ã¼ãã©ã¼ããããå°å ¥ãã¾ãããå®è£ ã®è©³ç´°ã¯<a href="http://arrow.apache.org/docs/ipc.html";>IPCä»æ§</a>ãè¦ã¦ãã ãããã¦ã¼ã¹ã±ã¼ã¹ã¯<a href="http://wesmckinney.com/blog/arrow-streaming-columnar/";>使ç¨ä¾ãç´¹ä»ããããã°</a>ãè¦ã¦ãã ããããããã®ãã©ã¼ãããã使ãã¨ä½ãªã¼ãã¼ãããã»ã³ãã¼ãªãã§Arrowã®ã¬ã³ã¼ããããã®ãã¤ãã¼ãã«ã¢ã¯ã»ã¹ã§ãã¾ãã</p> + +<p>0.3.0ã§ã¯ãã®ãã¤ããªã¼ãã©ãããã®ç´°ãã詳細ãããããåºãã¾ãããJavaãC++ãPythonéã®é£æºã®ãã¹ãããã³ããããè¨èªã§ã®åä½ãã¹ãã®æ´åãé²ãã¾ããã<a href="http://github.com/google/flatbuffers";>Google Flatbuffers</a>ã¯ãåæ¹äºææ§ãå£ããã«ã¡ã¿ãã¼ã¿ã«æ°ããæ©è½ã追å ããã®ã«é常ã«å©ããã¾ããã</p> + +<p>ã¾ã ãã¤ããªã¼ãã©ã¼ãããã®åæ¹äºææ§ãå¿ ãå£ããªãã¨ç´æã§ããç¶æ ã§ã¯ããã¾ãããï¼ããããããå¤æ´ããå¿ è¦ããããªã«ããè¦ã¤ãããããããªãï¼ãã¡ã¸ã£ã¼ãªãªã¼ã¹éã§ã¯ä¸å¿ è¦ã«äºææ§ãå£ããªãããã«åªåããã¤ããã§ããApache Arrowã®Webãµã¤ããåã³ã³ãã¼ãã³ãã®ã¦ã¼ã¶ã¼åãã®ããã¥ã¡ã³ãããã³APIããã¥ã¡ã³ãã¸ã®ã³ã³ããªãã¥ã¼ã·ã§ã³ãé常ã«æè¿ãã¾ãã</p> + +<h3 id="è¾æ¸ã¨ã³ã³ã¼ãã£ã³ã°ã®ãµãã¼ã">è¾æ¸ã¨ã³ã³ã¼ãã£ã³ã°ã®ãµãã¼ã</h3> + +<p><a href="http://www.geomesa.org/";>GeoMesa</a>ããã¸ã§ã¯ãã®<a href="https://github.com/elahrvivaz";>Emilio Lahr-Vivaz</a>ã¯Javaã®Arrowå®è£ ã«è¾æ¸ã¨ã³ã³ã¼ã対å¿ãã¯ã¿ã¼ãã³ã³ããªãã¥ã¼ããã¾ããããããåãã¦ãC++ã¨Pythonã§ããµãã¼ããã¾ãããï¼<code class="highlighter-rouge">pandas.Categorical</code>ã¨ãé£æºã§ãã¾ããï¼è¾æ¸ã¨ã³ã³ã¼ãã£ã³ã°ç¨ã®ã¤ã³ãã°ã¬ã¼ã·ã§ã³ãã¹ãï¼C++ã¨Javaéã§ãã®ãã¼ã¿ãéåä¿¡ãããã¹ãï¼ã¯ã¾ã å®æãã¦ãã¾ãããã0.4.0ã¾ã§ã«ã¯å®æããããã§ãã</p> + +<p>ããã¯ã«ãã´ãªã¼ãã¼ã¿ç¨ã®ä¸è¬çãªãã¼ã¿è¡¨ç¾ãã¯ããã¯ã§ããããã使ãã¨ãè¤æ°ã®ã¬ã³ã¼ããããã§å ±éã®ãè¾æ¸ããå ±æããåã¬ã³ã¼ããããã®å¤ã¯ãã®è¾æ¸ãåç §ããæ´æ°ã«ãªãã¾ãããã®ãã¼ã¿ã¯çµ±è¨çè¨èªï¼statistical languageï¼ã®åéã§ã¯ãã«ãã´ãªã¼ï¼categoricalï¼ãããå åï¼factorï¼ãã¨å¼ã°ãã¦ãã¾ããApache Parquetã®ãããªãã¡ã¤ã«ãã©ã¼ãããã®åéã§ã¯ãã¼ã¿å§ç¸®ã®ããã ãã«ä½¿ããã¦ãã¾ãã</p> + +<h3 id="æ¥ä»æå»åºå®é·åã®æ¡å¼µ">æ¥ä»ãæå»ãåºå®é·åã®æ¡å¼µ</h3> + +<p>0.2.0ã§ã¯ç¾å®ã«ä½¿ããã¦ããæ¥ä»ã»æå»åãã¤ã³ãã°ã¬ã¼ã·ã§ã³ãã¹ãä»ãã§å®å ¨ã«ãµãã¼ããããã¨ã諦ãã¾ããããããã¯<a href="http://parquet.apache.org";>Apache Parquet</a>ã¨Apache Sparkã¨ã®é£æºã«å¿ è¦ãªæ©è½ã§ãã</p> + +<ul> + <li><strong>æ¥ä»</strong>: 32-bitï¼æ¥åä½ï¼ã¨64-bitï¼ããªç§åä½ï¼</li> + <li><strong>æå»</strong>: åä½ä»ã64-bitæ´æ°ï¼åä½ï¼ç§ãããªç§ããã¤ã¯ãç§ãããç§ï¼</li> + <li><strong>ã¿ã¤ã ã¹ã¿ã³ãï¼UNIXã¨ããã¯ããã®çµéæéï¼</strong>: åä½ä»ã64-bitæ´æ°ã®ã¿ã¤ã ã¾ã¼ã³ä»ãã¨ã¿ã¤ã ã¾ã¼ã³ãªã</li> + <li><strong>åºå®é·ãã¤ããªã¼</strong>: 決ã¾ã£ããã¤ãæ°ã®ããªããã£ããªå¤</li> + <li><strong>åºå®é·ãªã¹ã</strong>: åè¦ç´ ãåããµã¤ãºã®ãªã¹ãï¼è¦ç´ ã®ãã¯ã¿ã¼ã¨ã¯å¥ã«ãªãã»ããã®ãã¯ã¿ã¼ãæã¤å¿ è¦ããªãï¼</li> +</ul> + +<p>C++ã®Arrowå®è£ ã§ã¯ã<a href="https://github.com/boostorg/multiprecision";>Boost.Multiprecision</a>ã使ã£ãexactãªå°æ°ã®ãµãã¼ããå®é¨çã«è¿½å ãã¾ããããã ããJavaå®è£ ã¨C++å®è£ éã§ã®å°æ°ã®ã¡ã¢ãªã¼ãã©ã¼ãããã¯ã¾ã åºã¾ã£ã¦ãã¾ããã</p> + +<h3 id="cã¨pythonã®windowsãµãã¼ã">C++ã¨Pythonã®Windowsãµãã¼ã</h3> + +<p>ä¸è¬çãªC++ã¨Pythonã§ã®éçºç¨ã«ãããã±ã¼ã¸å¨ãã®æ¹è¯ãå¤æ°å ¥ã£ã¦ãã¾ãã0.3.0ã¯Visual Studioï¼MSVCï¼2015ã¨2017ã使ã£ã¦Windowsãå®å ¨ã«ãµãã¼ãããæåã®ãã¼ã¸ã§ã³ã§ããAppveyorã§MSVCç¨ã®CIãå®è¡ãã¦ãã¾ããWindowsä¸ã§ã½ã¼ã¹ãããã«ãããããã®ã¬ã¤ããæ¸ãã¾ããã<a href="https://github.com/apache/arrow/blob/master/cpp/doc/Windows.md";>C++</a>ç¨ã¨<a href="https://github.com/apache/arrow/blob/master/python/doc/source/development.rst";>Python</a>ç¨ã</p> + +<p><a href="https://conda-forge.github.io";>conda-forge</a>ããWindowsç¨ã®Arrowã®Pythonã©ã¤ãã©ãªã¼ãã¤ã³ã¹ãã¼ã«ã§ãã¾ãã</p> + +<div class="language-shell highlighter-rouge"><pre class="highlight"><code>conda install pyarrow -c conda-forge +</code></pre> +</div> + +<h3 id="cglibãã¤ã³ãã£ã³ã°ã¨rubyluaä»ã®ãµãã¼ã">Cï¼GLibï¼ãã¤ã³ãã£ã³ã°ã¨Rubyã»Luaã»ä»ã®ãµãã¼ã</h3> + +<p><a href="http://github.com/kou";>Kouhei Sutou</a>ã¯æ°ããApache Arrowã®ã³ã³ããªãã¥ã¼ã¿ã¼ã§ããLinuxç¨ã®ï¼Arrowã®C++å®è£ ã®ï¼GLibã使ã£ãCãã¤ã³ãã£ã³ã°ãã³ã³ããªãã¥ã¼ããã¾ããã<a href="https://wiki.gnome.org/Projects/GObjectIntrospection";>GObject Introspection</a>ã¨ããCã®ããã«ã¦ã§ã¢ã使ããã¨ã§RubyãLuaãGoã<a href="https://wiki.gnome.org/Projects/GObjectIntrospection/Users";>ä»ã«ãæ§ã ãªããã°ã©ãã³ã°è¨èª</a>ã§ã·ã¼ã ã¬ã¹ã«ãã¤ã³ãã£ã³ã°ã使ããã¨ãã§ãã¾ãããããã®ãã¤ã³ãã£ã³ã°ãã©ã®ããã«åãã¦ãããããããã®ãã¤ã³ãã£ã³ã°ãã©ã®ããã«ä½¿ããã説æããããã°è¨äºãå¥éå¿ è¦ãªæ°ããã¾ãã</p> + +<h3 id="pysparkã使ã£ãapache-sparkã¨ã®é£æº">PySparkã使ã£ãApache Sparkã¨ã®é£æº</h3> + +<p><a href="https://issues.apache.org/jira/browse/SPARK-13534";>SPARK-13534</a>ã§Apache Sparkã³ãã¥ããã£ã¼ã¨ååãã¦ãã¾ããPySparkã§ã®<code class="highlighter-rouge">DataFrame.toPandas</code>ãArrowã使ã£ã¦é«éåãããã¨ãã¦ãã¾ããå¹ççãªãã¼ã¿ã®ã·ãªã¢ã©ã¤ãºã«ãã<a href="https://github.com/apache/spark/pull/15821#issuecomment-282175163";><strong>40å以ä¸é«éå</strong></a>ã§ããã±ã¼ã¹ãããã¾ãã</p> + +<p>PySparkã§Arrowã使ããã¨ã§ããã¾ã§ã§ããªãã£ãããã©ã¼ãã³ã¹æé©åã®éãéãã¾ãããç¹ã«ãUDFã®è©ä¾¡ã¾ããã§ããããããããã¨ãããã§ããããï¼ãã¨ãã°ãPythonã®ã©ã ãé¢æ°ã使ã£ã¦<code class="highlighter-rouge">map</code>ã»<code class="highlighter-rouge">filter</code>ãå®è¡ããã±ã¼ã¹ãï¼</p> + +<h3 id="pythonå®è£ ã§ã®æ°ããæ©è½ã¡ã¢ãªã¼ãã¥ã¼featherapache-parquetã®ãµãã¼ã">Pythonå®è£ ã§ã®æ°ããæ©è½ï¼ã¡ã¢ãªã¼ãã¥ã¼ãFeatherãApache Parquetã®ãµãã¼ã</h3> + +<p>Arrowã®Pythonã©ã¤ãã©ãªã¼ã§ãã<code class="highlighter-rouge">pyarrow</code>ã¯<code class="highlighter-rouge">libarrow</code>ã¨<code class="highlighter-rouge">libarrow_python</code>ã¨ããC++ã©ã¤ãã©ãªã¼ã®Cythonãã¤ã³ãã£ã³ã°ã§ãã<code class="highlighter-rouge">pyarrow</code>ã¯NumPyã¨<a href="http://pandas.pydata.org";>pandas</a>ã¨Pythonã®æ¨æºã©ã¤ãã©ãªã¼éã®ã·ã¼ã ã¬ã¹ãªé£æºãå®ç¾ãã¾ãã</p> + +<p>Arrowã®C++ã©ã¤ãã©ãªã¼ã§æãéè¦ãªãã®ã¯<code class="highlighter-rouge">arrow::Buffer</code>ãªãã¸ã§ã¯ãã§ããããã¯ã¡ã¢ãªã¼ãã¥ã¼ã管çãã¾ããã³ãã¼ãªãã®èªã¿è¾¼ã¿ã¨ã¹ã©ã¤ã¹ããµãã¼ããã¦ããç¹ãéè¦ã§ãã<a href="https://github.com/JeffKnupp";>Jeff Knupp</a>ã¯Arrowã®ãããã¡ã¼ã¨Pythonã®ãããã¡ã¼ãããã³ã«ã¨memoryviewã®é£æºå¦çãã³ã³ããªãã¥ã¼ããã¾ãããããã«ãã次ã®ãããªãã¨ãã§ããããã«ãªãã¾ããã</p> + +<div class="language-python highlighter-rouge"><pre class="highlight"><code><span class="n">In</span> <span class="p">[</span><span class="mi">6</span><span class="p">]:</span> <span class="kn">import</span> <span class="nn">pyarrow</span> <span class="kn">as</span> <span class="nn">pa</span> + +<span class="n">In</span> <span class="p">[</span><span class="mi">7</span><span class="p">]:</span> <span class="n">buf</span> <span class="o">=</span> <span class="n">pa</span><span class="o">.</span><span class="n">frombuffer</span><span class="p">(</span><span class="n">b</span><span class="s">'foobarbaz'</span><span class="p">)</span> + +<span class="n">In</span> <span class="p">[</span><span class="mi">8</span><span class="p">]:</span> <span class="n">buf</span> +<span class="n">Out</span><span class="p">[</span><span class="mi">8</span><span class="p">]:</span> <span class="o"><</span><span class="n">pyarrow</span><span class="o">.</span><span class="n">_io</span><span class="o">.</span><span class="n">Buffer</span> <span class="n">at</span> <span class="mh">0x7f6c0a84b538</span><span class="o">></span> + +<span class="n">In</span> <span class="p">[</span><span class="mi">9</span><span class="p">]:</span> <span class="n">memoryview</span><span class="p">(</span><span class="n">buf</span><span class="p">)</span> +<span class="n">Out</span><span class="p">[</span><span class="mi">9</span><span class="p">]:</span> <span class="o"><</span><span class="n">memory</span> <span class="n">at</span> <span class="mh">0x7f6c0a8c5e88</span><span class="o">></span> + +<span class="n">In</span> <span class="p">[</span><span class="mi">10</span><span class="p">]:</span> <span class="n">buf</span><span class="o">.</span><span class="n">to_pybytes</span><span class="p">()</span> +<span class="n">Out</span><span class="p">[</span><span class="mi">10</span><span class="p">]:</span> <span class="n">b</span><span class="s">'foobarbaz'</span> +</code></pre> +</div> + +<p>C++ã§ã®Parquetå®è£ ã§ãã<a href="https://github.com/apache/parquet-cpp";>parquet-cpp</a>ã使ããã¨ã§å¤§å¹ ã«<a href="http://parquet.apache.org";><strong>Apache Parquet</strong></a>ãµãã¼ããæ¹è¯ãã¾ããããã¨ãã°ããã£ã¹ã¯ä¸ã«ãããHDFSä¸ã«ãããé¢ä¿ãªãããã¼ãã£ã·ã§ã³ããããã¼ã¿ã»ããããµãã¼ããã¾ããã<a href="https://github.com/dask/dask/commit/68f9e417924a985c1f2e2a587126833c70a2e9f4";>Daskããã¸ã§ã¯ã</a>ã¯Arrowã使ã£ãParquetãµãã¼ããå®è£ ããæåã®ããã¸ã§ã¯ãã§ããDaskéçºè ã¨ã¯pandsãã¼ã¿ãåæ£å¦çããæèã§ããã«ååã§ãããã¨ã楽ãã¿ã«ãã¦ãã¾ãã</p> + +<p>pandasãæçãããããã«Arrowãæ¹è¯ãããã¨ãããã<a href="https://github.com/wesm/feather";><strong>Featherãã©ã¼ããã</strong></a>ã®å®è£ ããã¼ã¸ããã®ããã®1ã¤ã§ããFeatherãã©ã¼ãããã¯æ¬è³ªçã«ã¯Arrowã®ã©ã³ãã ã¢ã¯ã»ã¹ãã©ã¼ãããã®ç¹å¥ãªã±ã¼ã¹ã®1ã¤ã§ããArrowã®ã³ã¼ããã¼ã¹ã§Featherã®éçºãç¶ãã¾ãããã¨ãã°ãä»ã®Featherã¯Arrowã®Pythonãã¤ã³ãã£ã³ã°ã®ã¬ã¤ã¤ã¼ã使ããã¨ã§Pythonã®ãã¡ã¤ã«ãªãã¸ã§ã¯ããèªã¿æ¸ãã§ããããã«ãªã£ã¦ãã¾ãã</p> + +<p><code class="highlighter-rouge">DatetimeTZ</code>ã<code class="highlighter-rouge">Categorical</code>ã¨ãã£ãpandasåºæã®ãã¼ã¿åã®ã¡ããã¨ããï¼robustï¼ãµãã¼ããå®è£ ãã¾ããã</p> + +<h3 id="cã©ã¤ãã©ãªã¼ã§ã®ãã³ã½ã«ãµãã¼ã">C++ã©ã¤ãã©ãªã¼ã§ã®ãã³ã½ã«ãµãã¼ã</h3> + +<p>Apache Arrowã¯ã³ãã¼ãªãã§å ±æã¡ã¢ãªã¼ã管çãããã¼ã«ã¨ããå´é¢ãããã¾ããæ©æ¢°å¦ç¿ã¢ããªã±ã¼ã·ã§ã³ã®æèã§ãã®æ©è½ã¸ã®é¢å¿ãå¢ãã¦ãã¾ããUCãã¼ã¯ã¬ã¼æ ¡ã®<a href="https://rise.cs.berkeley.edu/";>RISELab</a>ã®<a href="https://github.com/ray-project/ray";>Rayããã¸ã§ã¯ã</a>ãæåã®ä¾ã§ãã</p> + +<p>æ©æ¢°å¦ç¿ã§ã¯ã¯ããã³ã½ã«ãã¨ãå¼ã°ããå¤æ¬¡å é åã¨ãããã¼ã¿æ§é ãæ±ãã¾ãããã®ãããªãã¼ã¿æ§é ã¯Arrowã®ã«ã©ã ãã©ã¼ãããããµãã¼ããã¦ãããã¼ã¿æ§é ã®ç¯å²ãè¶ ãã¦ãã¾ããä»åã®ã±ã¼ã¹ã§ã¯ã<a href="http://arrow.apache.org/docs/cpp/classarrow_1_1_tensor.html";><code class="highlighter-rouge">arrow::Tensor</code></a>ã¨ããC++ã®åã追å ã§å®è£ ãã¾ãããããã¯Arrowã®ã³ãã¼ãªãã®å ±æã¡ã¢ãªã¼æ©è½ãæ´»ç¨ãã¦å®è£ ãã¾ãããï¼ã¡ã¢ãªã¼ã®çåæéã®ç®¡çã«<code class="highlighter-rouge">arrow::Buffer</code>ã使ãã¾ãããï¼C++å®è£ ã§ã¯ãããããããå ±éã®IOã»ã¡ã¢ãªã¼ç®¡çãã¼ã«ã¨ãã¦Arrowãæ´»ç¨ã§ããããã«ããããã追å ã®ãã¼ã¿æ§é ãæä¾ããã¤ããã§ãã</p> + +<h3 id="javascripttypescriptå®è£ ã®éå§">JavaScriptï¼TypeScriptï¼å®è£ ã®éå§</h3> + +<p><a href="https://github.com/TheNeuralBit";>Brian Hulette</a>ã¯NodeJSã¨Webãã©ã¦ã¶ã¼ä¸ã§åãã¢ããªã±ã¼ã·ã§ã³ã§ä½¿ãããã«<a href="https://github.com/apache/arrow/tree/master/js";>TypeScript</a>ã§ã®Arrowã®å®è£ ãå§ãã¾ãããFlatBuffersãJavaScriptããã¡ã¼ã¹ãã¯ã©ã¹ã§ãµãã¼ããã¦ããã®ã§å®è£ ãæãã¾ãã</p> + +<h3 id="webãµã¤ãã¨éçºè ç¨ããã¥ã¡ã³ãã®æ¹è¯">Webãµã¤ãã¨éçºè ç¨ããã¥ã¡ã³ãã®æ¹è¯</h3> + +<p>0.2.0ããªãªã¼ã¹ãã¦ããããã¥ã¡ã³ãã¨ããã°ãå ¬éããããã«Webãµã¤ãã®ã·ã¹ãã ã<a href="https://jekyllrb.com";>Jekyll</a>ãã¼ã¹ã§ä½ãã¾ãããKouhei Sutouã¯<a href="https://github.com/red-data-tools/jekyll-jupyter-notebook";>Jekyll Jupyter Notebookãã©ã°ã¤ã³</a>ãä½ãã¾ãããããã«ããArrowã®Webãµã¤ãã®ã³ã³ãã³ããä½ãããã«Jupyterã使ããã¨ãã§ãã¾ãã</p> + +<p>Webãµã¤ãã«ã¯CãC++ãJavaãPythonã®APIããã¥ã¡ã³ããå ¬éãã¾ããããããã®ä¸ã«Arrowã使ãå§ããããã®æçãªæ å ±ãè¦ã¤ããããã§ãããã</p> + +<h3 id="ã³ã³ããªãã¥ã¼ã¿ã¼">ã³ã³ããªãã¥ã¼ã¿ã¼</h3> + +<p>ãã®ãªãªã¼ã¹ã«ããããã³ã³ããªãã¥ã¼ãããã¿ãªããã«æè¬ãã¾ãã</p> + +<div class="highlighter-rouge"><pre class="highlight"><code>$ git shortlog -sn apache-arrow-0.2.0..apache-arrow-0.3.0 + 119 Wes McKinney + 55 Kouhei Sutou + 18 Uwe L. Korn + 17 Julien Le Dem + 9 Phillip Cloud + 6 Bryan Cutler + 5 Philipp Moritz + 5 Emilio Lahr-Vivaz + 4 Max Risuhin + 4 Johan Mabille + 4 Jeff Knupp + 3 Steven Phillips + 3 Miki Tebeka + 2 Leif Walsh + 2 Jeff Reback + 2 Brian Hulette + 1 Tsuyoshi Ozawa + 1 rvernica + 1 Nong Li + 1 Julien Lafaye + 1 Itai Incze + 1 Holden Karau + 1 Deepak Majeti +</code></pre> +</div> + + + + <hr/> +<footer class="footer"> + <p>Apache Arrow, Arrow, Apache, the Apache feather logo, and the Apache Arrow project logo are either registered trademarks or trademarks of The Apache Software Foundation in the United States and other countries.</p> + <p>© 2017 Apache Software Foundation</p> +</footer> + + </div> +</body> +</html> http://git-wip-us.apache.org/repos/asf/arrow-site/blob/3a7bab25/blog/2017/05/08/0.3-release/index.html ---------------------------------------------------------------------- diff --git a/blog/2017/05/08/0.3-release/index.html b/blog/2017/05/08/0.3-release/index.html index a0c949c..fa65582 100644 --- a/blog/2017/05/08/0.3-release/index.html +++ b/blog/2017/05/08/0.3-release/index.html @@ -128,6 +128,8 @@ --> +<p>Translations: <a href="/blog/2017/05/08/0.3-release-japanese/">æ¥æ¬èª</a></p> + <p>The Apache Arrow team is pleased to announce the 0.3.0 release of the project. It is the product of an intense 10 weeks of development since the 0.2.0 release from this past February. It includes <a href="https://issues.apache.org/jira/issues/?jql=project%20%3D%20ARROW%20AND%20status%20in%20(Resolved%2C%20Closed)%20AND%20fixVersion%20%3D%200.3.0"><strong>306 resolved JIRAs</strong></a> @@ -208,7 +210,7 @@ to adding Appveyor continuous integration for MSVC, we have also written guides for building from source on Windows: <a href="https://github.com/apache/arrow/blob/master/cpp/doc/Windows.md";>C++</a> and <a href="https://github.com/apache/arrow/blob/master/python/doc/source/development.rst";>Python</a>.</p> <p>For the first time, you can install the Arrow Python library on Windows from -[conda-forge][31]:</p> +<a href="https://conda-forge.github.io";>conda-forge</a>:</p> <div class="language-shell highlighter-rouge"><pre class="highlight"><code>conda install pyarrow -c conda-forge </code></pre> @@ -291,7 +293,7 @@ additional data structures utilizing common IO and memory management tools.</p> <h3 id="start-of-javascript-typescript-implementation">Start of JavaScript (TypeScript) Implementation</h3> <p><a href="https://github.com/TheNeuralBit";>Brian Hulette</a> started developing an Arrow implementation in -<a href="https://conda-forge.github.io";>TypeScript</a> for use in NodeJS and browser-side applications. We are +<a href="https://github.com/apache/arrow/tree/master/js";>TypeScript</a> for use in NodeJS and browser-side applications. We are benefitting from Flatbuffersâ first class support for JavaScript.</p> <h3 id="improved-website-and-developer-documentation">Improved Website and Developer Documentation</h3> http://git-wip-us.apache.org/repos/asf/arrow-site/blob/3a7bab25/blog/index.html ---------------------------------------------------------------------- diff --git a/blog/index.html b/blog/index.html index 8ae9f9b..f2aadf2 100644 --- a/blog/index.html +++ b/blog/index.html @@ -107,6 +107,7 @@ + <div class="container"> <h2> Apache Arrow 0.3.0 Release @@ -134,6 +135,8 @@ --> +<p>Translations: <a href="/blog/2017/05/08/0.3-release-japanese/">æ¥æ¬èª</a></p> + <p>The Apache Arrow team is pleased to announce the 0.3.0 release of the project. It is the product of an intense 10 weeks of development since the 0.2.0 release from this past February. It includes <a href="https://issues.apache.org/jira/issues/?jql=project%20%3D%20ARROW%20AND%20status%20in%20(Resolved%2C%20Closed)%20AND%20fixVersion%20%3D%200.3.0"><strong>306 resolved JIRAs</strong></a> @@ -214,7 +217,7 @@ to adding Appveyor continuous integration for MSVC, we have also written guides for building from source on Windows: <a href="https://github.com/apache/arrow/blob/master/cpp/doc/Windows.md";>C++</a> and <a href="https://github.com/apache/arrow/blob/master/python/doc/source/development.rst";>Python</a>.</p> <p>For the first time, you can install the Arrow Python library on Windows from -[conda-forge][31]:</p> +<a href="https://conda-forge.github.io";>conda-forge</a>:</p> <div class="language-shell highlighter-rouge"><pre class="highlight"><code>conda install pyarrow -c conda-forge </code></pre> @@ -297,7 +300,7 @@ additional data structures utilizing common IO and memory management tools.</p> <h3 id="start-of-javascript-typescript-implementation">Start of JavaScript (TypeScript) Implementation</h3> <p><a href="https://github.com/TheNeuralBit";>Brian Hulette</a> started developing an Arrow implementation in -<a href="https://conda-forge.github.io";>TypeScript</a> for use in NodeJS and browser-side applications. We are +<a href="https://github.com/apache/arrow/tree/master/js";>TypeScript</a> for use in NodeJS and browser-side applications. We are benefitting from Flatbuffersâ first class support for JavaScript.</p> <h3 id="improved-website-and-developer-documentation">Improved Website and Developer Documentation</h3> @@ -345,6 +348,9 @@ instructions for getting started.</p> </div> + + + http://git-wip-us.apache.org/repos/asf/arrow-site/blob/3a7bab25/feed.xml ---------------------------------------------------------------------- diff --git a/feed.xml b/feed.xml index 4008b1c..c30ad1c 100644 --- a/feed.xml +++ b/feed.xml @@ -1,7 +1,9 @@ -<?xml version="1.0" encoding="utf-8"?><feed xmlns="http://www.w3.org/2005/Atom"; ><generator uri="https://jekyllrb.com/"; version="3.4.3">Jekyll</generator><link href="http://localhost:4000/feed.xml"; rel="self" type="application/atom+xml" /><link href="http://localhost:4000/"; rel="alternate" type="text/html" /><updated>2017-05-08T09:44:38-04:00</updated><id>http://localhost:4000/</id><entry><title type="html">Apache Arrow 0.3.0 Release</title><link href="http://localhost:4000/blog/2017/05/08/0.3-release/"; rel="alternate" type="text/html" title="Apache Arrow 0.3.0 Release" /><published>2017-05-08T00:00:00-04:00</published><updated>2017-05-08T00:00:00-04:00</updated><id>http://localhost:4000/blog/2017/05/08/0.3-release</id><content type="html" xml:base="http://localhost:4000/blog/2017/05/08/0.3-release/";><!-- +<?xml version="1.0" encoding="utf-8"?><feed xmlns="http://www.w3.org/2005/Atom"; ><generator uri="https://jekyllrb.com/"; version="3.4.3">Jekyll</generator><link href="/feed.xml" rel="self" type="application/atom+xml" /><link href="/" rel="alternate" type="text/html" /><updated>2017-05-11T17:02:19-04:00</updated><id>/</id><entry><title type="html">Apache Arrow 0.3.0 Release</title><link href="/blog/2017/05/08/0.3-release/" rel="alternate" type="text/html" title="Apache Arrow 0.3.0 Release" /><published>2017-05-08T00:00:00-04:00</published><updated>2017-05-08T00:00:00-04:00</updated><id>/blog/2017/05/08/0.3-release</id><content type="html" xml:base="/blog/2017/05/08/0.3-release/"><!-- --> +<p>Translations: <a href="/blog/2017/05/08/0.3-release-japanese/">æ¥æ¬èª</a></p> + <p>The Apache Arrow team is pleased to announce the 0.3.0 release of the project. It is the product of an intense 10 weeks of development since the 0.2.0 release from this past February. It includes <a href="https://issues.apache.org/jira/issues/?jql=project%20%3D%20ARROW%20AND%20status%20in%20(Resolved%2C%20Closed)%20AND%20fixVersion%20%3D%200.3.0"><strong>306 resolved JIRAs</strong></a> @@ -82,7 +84,7 @@ to adding Appveyor continuous integration for MSVC, we have also written guides for building from source on Windows: <a href="https://github.com/apache/arrow/blob/master/cpp/doc/Windows.md">C++</a> and <a href="https://github.com/apache/arrow/blob/master/python/doc/source/development.rst">Python</a>.</p> <p>For the first time, you can install the Arrow Python library on Windows from -[conda-forge][31]:</p> +<a href="https://conda-forge.github.io">conda-forge</a>:</p> <div class="language-shell highlighter-rouge"><pre class="highlight"><code>conda install pyarrow -c conda-forge </code></pre> @@ -165,7 +167,7 @@ additional data structures utilizing common IO and memory management tools.</ <h3 id="start-of-javascript-typescript-implementation">Start of JavaScript (TypeScript) Implementation</h3> <p><a href="https://github.com/TheNeuralBit">Brian Hulette</a> started developing an Arrow implementation in -<a href="https://conda-forge.github.io">TypeScript</a> for use in NodeJS and browser-side applications. We are +<a href="https://github.com/apache/arrow/tree/master/js">TypeScript</a> for use in NodeJS and browser-side applications. We are benefitting from Flatbuffersâ first class support for JavaScript.</p> <h3 id="improved-website-and-developer-documentation">Improved Website and Developer Documentation</h3> @@ -208,4 +210,140 @@ instructions for getting started.</p> 1 Holden Karau 1 Deepak Majeti </code></pre> +</div></content><author><name>wesm</name></author></entry><entry><title type="html">Apache Arrow 0.3.0ãªãªã¼ã¹</title><link href="/blog/2017/05/08/0.3-release-japanese/" rel="alternate" type="text/html" title="Apache Arrow 0.3.0ãªãªã¼ã¹" /><published>2017-05-08T00:00:00-04:00</published><updated>2017-05-08T00:00:00-04:00</updated><id>/blog/2017/05/08/0.3-release-japanese</id><content type="html" xml:base="/blog/2017/05/08/0.3-release-japanese/"><!-- + +--> + +<p><a href="/blog/2017/05/08/0.3-release/">åæï¼Englishï¼</a></p> + +<p>Apache Arrowãã¼ã ã¯0.3.0ã®ãªãªã¼ã¹ãã¢ãã¦ã³ã¹ã§ãã¦ããããã§ãã2æã«ãªãªã¼ã¹ãã0.2.0ãã10é±éã®æ´»çºãªéçºã®çµæãä»åã®ãªãªã¼ã¹ã§ãã<a href="https://github.com/apache/arrow/graphs/contributors"><strong>23人ã®ã³ã³ããªãã¥ã¼ã¿ã¼</strong></a>ã<a href="https://issues.apache.org/jira/issues/?jql=project%20%3D%20ARROW%20AND%20status%20in%20(Resolved%2C%20Closed)%20AND%20fixVersion%20%3D%200.3.0"><strong>306åã®JIRAã®issueã解決</strong></a>ãã¾ããã</p> + +<p>è¤æ°ã®Arrowã®å®è£ ã«ããããã®æ°ããæ©è½ã追å ãã¦ãã¾ãã2017å¹´ãç¹ã«æ³¨åãã¦éçºããã®ã¯ãã¤ã³ã¡ã¢ãªã¼ç¨ã®ãã©ã¼ããããåã®ã¡ã¿ãã¼ã¿ãã¡ãã»ã¼ã¸ã³ã°ç¨ã®ãããã³ã«ã§ããããã¯ãããã°ãã¼ã¿ã¢ããªã±ã¼ã·ã§ã³ã«<strong>å®å®ãã¦ãã¦ãããã¯ã·ã§ã³ã§ä½¿ããåºç¤</strong>ãæä¾ããããã§ããé«æ§è½IOã¨ã¤ã³ã¡ã¢ãªã¼ãã¼ã¿å¦çã«Arrowãæ´»ç¨ããããã«ã<a href="http://spark.apache.org">Apache Spark</a>ã»<a href="http://www.geomesa.org/">GeoMesa</a>ã³ãã¥ããã£ã¼ã¨ååãã¦ãã¦ã¨ã¦ãã¨ããµã¤ãã£ã³ã°ã§ãã</p> + +<p>ããããã®ãã©ãããã©ã¼ã ã§Arrowã使ãæ¹æ³ã¯<a href="http://arrow.apache.org/install">ã¤ã³ã¹ãã¼ã«ãã¼ã¸</a>ãè¦ã¦ãã ããã</p> + +<p>Arrowã§ããã°ãã¼ã¿ã·ã¹ãã ãé«éåããã±ã¼ã¹ãå¢ããããã«ãè¿ããã¡ã«Apache Arrowã®ãã¼ãããããå ¬éããäºå®ã§ãã</p> + +<p>Arrowã®éçºã«åå ããã³ã³ããªãã¥ã¼ã¿ã¼ãåéãã¦ãã¾ãããã§ã«Arrowã®éçºã«åå ãã¦ããã³ãã¥ããã£ã¼ããã®ã³ã³ããªãã¥ã¼ã¿ã¼ãããã§ãããã¾ã åå ãã¦ããªãGoãRãJuliaã¨ãã£ãã³ãã¥ããã£ã¼ããã®ã³ã³ããªãã¥ã¼ã¿ã¼ãåéãã¦ãã¾ãã</p> + +<h3 id="ãã¡ã¤ã«ãã©ã¼ãããã¨ã¹ããªã¼ãã³ã°ãã©ã¼ãããã®å¼·å">ãã¡ã¤ã«ãã©ã¼ãããã¨ã¹ããªã¼ãã³ã°ãã©ã¼ãããã®å¼·å</h3> + +<p>0.2.0ã§ã¯<strong>ã©ã³ãã ã¢ã¯ã»ã¹</strong>ç¨ã¨<strong>ã¹ããªã¼ãã³ã°</strong>ç¨ã®Arrowã®ã¯ã¤ã¤ã¼ãã©ã¼ããããå°å ¥ãã¾ãããå®è£ ã®è©³ç´°ã¯<a href="http://arrow.apache.org/docs/ipc.html">IPCä»æ§</a>ãè¦ã¦ãã ãããã¦ã¼ã¹ã±ã¼ã¹ã¯<a href="http://wesmckinney.com/blog/arrow-streaming-columnar/">使ç¨ä¾ãç´¹ä»ããããã°</a>ãè¦ã¦ãã ããããããã®ãã©ã¼ãããã使ãã¨ä½ãªã¼ãã¼ãããã»ã³ãã¼ãªãã§Arrowã®ã¬ã³ã¼ããããã®ãã¤ãã¼ãã«ã¢ã¯ã»ã¹ã§ãã¾ãã</p> + +<p>0.3.0ã§ã¯ãã®ãã¤ããªã¼ãã©ãããã®ç´°ãã詳細ãããããåºãã¾ãããJavaãC++ãPythonéã®é£æºã®ãã¹ãããã³ããããè¨èªã§ã®åä½ãã¹ãã®æ´åãé²ãã¾ããã<a href="http://github.com/google/flatbuffers">Google Flatbuffers</a>ã¯ãåæ¹äºææ§ãå£ããã«ã¡ã¿ãã¼ã¿ã«æ°ããæ©è½ã追å ããã®ã«é常ã«å©ããã¾ããã</p> + +<p>ã¾ã ãã¤ããªã¼ãã©ã¼ãããã®åæ¹äºææ§ãå¿ ãå£ããªãã¨ç´æã§ããç¶æ ã§ã¯ããã¾ãããï¼ããããããå¤æ´ããå¿ è¦ããããªã«ããè¦ã¤ãããããããªãï¼ãã¡ã¸ã£ã¼ãªãªã¼ã¹éã§ã¯ä¸å¿ è¦ã«äºææ§ãå£ããªãããã«åªåããã¤ããã§ããApache Arrowã®Webãµã¤ããåã³ã³ãã¼ãã³ãã®ã¦ã¼ã¶ã¼åãã®ããã¥ã¡ã³ãããã³APIããã¥ã¡ã³ãã¸ã®ã³ã³ããªãã¥ã¼ã·ã§ã³ãé常ã«æè¿ãã¾ãã</p> + +<h3 id="è¾æ¸ã¨ã³ã³ã¼ãã£ã³ã°ã®ãµãã¼ã">è¾æ¸ã¨ã³ã³ã¼ãã£ã³ã°ã®ãµãã¼ã</h3> + +<p><a href="http://www.geomesa.org/">GeoMesa</a>ããã¸ã§ã¯ãã®<a href="https://github.com/elahrvivaz">Emilio Lahr-Vivaz</a>ã¯Javaã®Arrowå®è£ ã«è¾æ¸ã¨ã³ã³ã¼ã対å¿ãã¯ã¿ã¼ãã³ã³ããªãã¥ã¼ããã¾ããããããåãã¦ãC++ã¨Pythonã§ããµãã¼ããã¾ãããï¼<code class="highlighter-rouge">pandas.Categorical</code>ã¨ãé£æºã§ãã¾ããï¼è¾æ¸ã¨ã³ã³ã¼ãã£ã³ã°ç¨ã®ã¤ã³ãã°ã¬ã¼ã·ã§ã³ãã¹ãï¼C++ã¨Javaéã§ãã®ãã¼ã¿ãéåä¿¡ãããã¹ãï¼ã¯ã¾ã å®æãã¦ãã¾ãããã0.4.0ã¾ã§ã«ã¯å®æããããã§ãã</p> + +<p>ããã¯ã«ãã´ãªã¼ãã¼ã¿ç¨ã®ä¸è¬çãªãã¼ã¿è¡¨ç¾ãã¯ããã¯ã§ããããã使ãã¨ãè¤æ°ã®ã¬ã³ã¼ããããã§å ±éã®ãè¾æ¸ããå ±æããåã¬ã³ã¼ããããã®å¤ã¯ãã®è¾æ¸ãåç §ããæ´æ°ã«ãªãã¾ãããã®ãã¼ã¿ã¯çµ±è¨çè¨èªï¼statistical languageï¼ã®åéã§ã¯ãã«ãã´ãªã¼ï¼categoricalï¼ãããå åï¼factorï¼ãã¨å¼ã°ãã¦ãã¾ããApache Parquetã®ãããªãã¡ã¤ã«ãã©ã¼ãããã®åéã§ã¯ãã¼ã¿å§ç¸®ã®ããã ãã«ä½¿ããã¦ãã¾ãã</p> + +<h3 id="æ¥ä»æå»åºå®é·åã®æ¡å¼µ">æ¥ä»ãæå»ãåºå®é·åã®æ¡å¼µ</h3> + +<p>0.2.0ã§ã¯ç¾å®ã«ä½¿ããã¦ããæ¥ä»ã»æå»åãã¤ã³ãã°ã¬ã¼ã·ã§ã³ãã¹ãä»ãã§å®å ¨ã«ãµãã¼ããããã¨ã諦ãã¾ããããããã¯<a href="http://parquet.apache.org">Apache Parquet</a>ã¨Apache Sparkã¨ã®é£æºã«å¿ è¦ãªæ©è½ã§ãã</p> + +<ul> + <li><strong>æ¥ä»</strong>: 32-bitï¼æ¥åä½ï¼ã¨64-bitï¼ããªç§åä½ï¼</li> + <li><strong>æå»</strong>: åä½ä»ã64-bitæ´æ°ï¼åä½ï¼ç§ãããªç§ããã¤ã¯ãç§ãããç§ï¼</li> + <li><strong>ã¿ã¤ã ã¹ã¿ã³ãï¼UNIXã¨ããã¯ããã®çµéæéï¼</strong>: åä½ä»ã64-bitæ´æ°ã®ã¿ã¤ã ã¾ã¼ã³ä»ãã¨ã¿ã¤ã ã¾ã¼ã³ãªã</li> + <li><strong>åºå®é·ãã¤ããªã¼</strong>: 決ã¾ã£ããã¤ãæ°ã®ããªããã£ããªå¤</li> + <li><strong>åºå®é·ãªã¹ã</strong>: åè¦ç´ ãåããµã¤ãºã®ãªã¹ãï¼è¦ç´ ã®ãã¯ã¿ã¼ã¨ã¯å¥ã«ãªãã»ããã®ãã¯ã¿ã¼ãæã¤å¿ è¦ããªãï¼</li> +</ul> + +<p>C++ã®Arrowå®è£ ã§ã¯ã<a href="https://github.com/boostorg/multiprecision">Boost.Multiprecision</a>ã使ã£ãexactãªå°æ°ã®ãµãã¼ããå®é¨çã«è¿½å ãã¾ããããã ããJavaå®è£ ã¨C++å®è£ éã§ã®å°æ°ã®ã¡ã¢ãªã¼ãã©ã¼ãããã¯ã¾ã åºã¾ã£ã¦ãã¾ããã</p> + +<h3 id="cã¨pythonã®windowsãµãã¼ã">C++ã¨Pythonã®Windowsãµãã¼ã</h3> + +<p>ä¸è¬çãªC++ã¨Pythonã§ã®éçºç¨ã«ãããã±ã¼ã¸å¨ãã®æ¹è¯ãå¤æ°å ¥ã£ã¦ãã¾ãã0.3.0ã¯Visual Studioï¼MSVCï¼2015ã¨2017ã使ã£ã¦Windowsãå®å ¨ã«ãµãã¼ãããæåã®ãã¼ã¸ã§ã³ã§ããAppveyorã§MSVCç¨ã®CIãå®è¡ãã¦ãã¾ããWindowsä¸ã§ã½ã¼ã¹ãããã«ãããããã®ã¬ã¤ããæ¸ãã¾ããã<a href="https://github.com/apache/arrow/blob/master/cpp/doc/Windows.md">C++</a>ç¨ã¨<a href="https://github.com/apache/arrow/blob/master/python/doc/source/development.rst">Python</a>ç¨ã</p> + +<p><a href="https://conda-forge.github.io">conda-forge</a>ããWindowsç¨ã®Arrowã®Pythonã©ã¤ãã©ãªã¼ãã¤ã³ã¹ãã¼ã«ã§ãã¾ãã</p> + +<div class="language-shell highlighter-rouge"><pre class="highlight"><code>conda install pyarrow -c conda-forge +</code></pre> +</div> + +<h3 id="cglibãã¤ã³ãã£ã³ã°ã¨rubyluaä»ã®ãµãã¼ã">Cï¼GLibï¼ãã¤ã³ãã£ã³ã°ã¨Rubyã»Luaã»ä»ã®ãµãã¼ã</h3> + +<p><a href="http://github.com/kou">Kouhei Sutou</a>ã¯æ°ããApache Arrowã®ã³ã³ããªãã¥ã¼ã¿ã¼ã§ããLinuxç¨ã®ï¼Arrowã®C++å®è£ ã®ï¼GLibã使ã£ãCãã¤ã³ãã£ã³ã°ãã³ã³ããªãã¥ã¼ããã¾ããã<a href="https://wiki.gnome.org/Projects/GObjectIntrospection">GObject Introspection</a>ã¨ããCã®ããã«ã¦ã§ã¢ã使ããã¨ã§RubyãLuaãGoã<a href="https://wiki.gnome.org/Projects/GObjectIntrospection/Users">ä»ã«ãæ§ã ãªããã°ã©ãã³ã°è¨èª</a>ã§ã·ã¼ã ã¬ã¹ã«ãã¤ã³ãã£ã³ã°ã使ããã¨ãã§ãã¾ãããããã®ãã¤ã³ãã£ã³ã°ãã©ã®ããã«åãã¦ãããããããã®ãã¤ã³ãã£ã³ã°ãã©ã®ããã«ä½¿ããã説æããããã°è¨äºãå¥éå¿ è¦ãªæ°ããã¾ãã</p> + +<h3 id="pysparkã使ã£ãapache-sparkã¨ã®é£æº">PySparkã使ã£ãApache Sparkã¨ã®é£æº</h3> + +<p><a href="https://issues.apache.org/jira/browse/SPARK-13534">SPARK-13534</a>ã§Apache Sparkã³ãã¥ããã£ã¼ã¨ååãã¦ãã¾ããPySparkã§ã®<code class="highlighter-rouge">DataFrame.toPandas</code>ãArrowã使ã£ã¦é«éåãããã¨ãã¦ãã¾ããå¹ççãªãã¼ã¿ã®ã·ãªã¢ã©ã¤ãºã«ãã<a href="https://github.com/apache/spark/pull/15821#issuecomment-282175163"><strong>40å以ä¸é«éå</strong></a>ã§ããã±ã¼ã¹ãããã¾ãã</p> + +<p>PySparkã§Arrowã使ããã¨ã§ããã¾ã§ã§ããªãã£ãããã©ã¼ãã³ã¹æé©åã®éãéãã¾ãããç¹ã«ãUDFã®è©ä¾¡ã¾ããã§ããããããããã¨ãããã§ããããï¼ãã¨ãã°ãPythonã®ã©ã ãé¢æ°ã使ã£ã¦<code class="highlighter-rouge">map</code>ã»<code class="highlighter-rouge">filter</code>ãå®è¡ããã±ã¼ã¹ãï¼</p> + +<h3 id="pythonå®è£ ã§ã®æ°ããæ©è½ã¡ã¢ãªã¼ãã¥ã¼featherapache-parquetã®ãµãã¼ã">Pythonå®è£ ã§ã®æ°ããæ©è½ï¼ã¡ã¢ãªã¼ãã¥ã¼ãFeatherãApache Parquetã®ãµãã¼ã</h3> + +<p>Arrowã®Pythonã©ã¤ãã©ãªã¼ã§ãã<code class="highlighter-rouge">pyarrow</code>ã¯<code class="highlighter-rouge">libarrow</code>ã¨<code class="highlighter-rouge">libarrow_python</code>ã¨ããC++ã©ã¤ãã©ãªã¼ã®Cythonãã¤ã³ãã£ã³ã°ã§ãã<code class="highlighter-rouge">pyarrow</code>ã¯NumPyã¨<a href="http://pandas.pydata.org">pandas</a>ã¨Pythonã®æ¨æºã©ã¤ãã©ãªã¼éã®ã·ã¼ã ã¬ã¹ãªé£æºãå®ç¾ãã¾ãã</p> + +<p>Arrowã®C++ã©ã¤ãã©ãªã¼ã§æãéè¦ãªãã®ã¯<code class="highlighter-rouge">arrow::Buffer</code>ãªãã¸ã§ã¯ãã§ããããã¯ã¡ã¢ãªã¼ãã¥ã¼ã管çãã¾ããã³ãã¼ãªãã®èªã¿è¾¼ã¿ã¨ã¹ã©ã¤ã¹ããµãã¼ããã¦ããç¹ãéè¦ã§ãã<a href="https://github.com/JeffKnupp">Jeff Knupp</a>ã¯Arrowã®ãããã¡ã¼ã¨Pythonã®ãããã¡ã¼ãããã³ã«ã¨memoryviewã®é£æºå¦çãã³ã³ããªãã¥ã¼ããã¾ãããããã«ãã次ã®ãããªãã¨ãã§ããããã«ãªãã¾ããã</p> + +<div class="language-python highlighter-rouge"><pre class="highlight"><code><span class="n">In</span> <span class="p">[</span><span class="mi">6</span><span class="p">]:</span> <span class="kn">import</span> <span class="nn">pyarrow</span> <span class="kn">as</span> <span class="nn">pa</span> + +<span class="n">In</span> <span class="p">[</span><span class="mi">7</span><span class="p">]:</span> <span class="n">buf</span> <span class="o">=</span> <span class="n">pa</span><span class="o">.</span><span class="n">frombuffer</span><span class="p">(</span><span class="n">b</span><span class="s">'foobarbaz'</span><span class="p">)</span> + +<span class="n">In</span> <span class="p">[</span><span class="mi">8</span><span class="p">]:</span> <span class="n">buf</span> +<span class="n">Out</span><span class="p">[</span><span class="mi">8</span><span class="p">]:</span> <span class="o">&lt;</span><span class="n">pyarrow</span><span class="o">.</span><span class="n">_io</span><span class="o">.</span><span class="n">Buffer</span> <span class="n">at</span> <span class="mh">0x7f6c0a84b538</span><span class="o">&gt;</span> + +<span class="n">In</span> <span class="p">[</span><span class="mi">9</span><span class="p">]:</span> <span class="n">memoryview</span><span class="p">(</span><span class="n">buf</span><span class="p">)</span> +<span class="n">Out</span><span class="p">[</span><span class="mi">9</span><span class="p">]:</span> <span class="o">&lt;</span><span class="n">memory</span> <span class="n">at</span> <span class="mh">0x7f6c0a8c5e88</span><span class="o">&gt;</span> + +<span class="n">In</span> <span class="p">[</span><span class="mi">10</span><span class="p">]:</span> <span class="n">buf</span><span class="o">.</span><span class="n">to_pybytes</span><span class="p">()</span> +<span class="n">Out</span><span class="p">[</span><span class="mi">10</span><span class="p">]:</span> <span class="n">b</span><span class="s">'foobarbaz'</span> +</code></pre> +</div> + +<p>C++ã§ã®Parquetå®è£ ã§ãã<a href="https://github.com/apache/parquet-cpp">parquet-cpp</a>ã使ããã¨ã§å¤§å¹ ã«<a href="http://parquet.apache.org"><strong>Apache Parquet</strong></a>ãµãã¼ããæ¹è¯ãã¾ããããã¨ãã°ããã£ã¹ã¯ä¸ã«ãããHDFSä¸ã«ãããé¢ä¿ãªãããã¼ãã£ã·ã§ã³ããããã¼ã¿ã»ããããµãã¼ããã¾ããã<a href="https://github.com/dask/dask/commit/68f9e417924a985c1f2e2a587126833c70a2e9f4">Daskããã¸ã§ã¯ã</a>ã¯Arrowã使ã£ãParquetãµãã¼ããå®è£ ããæåã®ããã¸ã§ã¯ãã§ããDaskéçºè ã¨ã¯pandsãã¼ã¿ãåæ£å¦çããæèã§ããã«ååã§ãããã¨ã楽ãã¿ã«ãã¦ãã¾ãã</p> + +<p>pandasãæçãããããã«Arrowãæ¹è¯ãããã¨ãããã<a href="https://github.com/wesm/feather"><strong>Featherãã©ã¼ããã</strong></a>ã®å®è£ ããã¼ã¸ããã®ããã®1ã¤ã§ããFeatherãã©ã¼ãããã¯æ¬è³ªçã«ã¯Arrowã®ã©ã³ãã ã¢ã¯ã»ã¹ãã©ã¼ãããã®ç¹å¥ãªã±ã¼ã¹ã®1ã¤ã§ããArrowã®ã³ã¼ããã¼ã¹ã§Featherã®éçºãç¶ãã¾ãããã¨ãã°ãä»ã®Featherã¯Arrowã®Pythonãã¤ã³ãã£ã³ã°ã®ã¬ã¤ã¤ã¼ã使ããã¨ã§Pythonã®ãã¡ã¤ã«ãªãã¸ã§ã¯ããèªã¿æ¸ãã§ããããã«ãªã£ã¦ãã¾ãã</p> + +<p><code class="highlighter-rouge">DatetimeTZ</code>ã<code class="highlighter-rouge">Categorical</code>ã¨ãã£ãpandasåºæã®ãã¼ã¿åã®ã¡ããã¨ããï¼robustï¼ãµãã¼ããå®è£ ãã¾ããã</p> + +<h3 id="cã©ã¤ãã©ãªã¼ã§ã®ãã³ã½ã«ãµãã¼ã">C++ã©ã¤ãã©ãªã¼ã§ã®ãã³ã½ã«ãµãã¼ã</h3> + +<p>Apache Arrowã¯ã³ãã¼ãªãã§å ±æã¡ã¢ãªã¼ã管çãããã¼ã«ã¨ããå´é¢ãããã¾ããæ©æ¢°å¦ç¿ã¢ããªã±ã¼ã·ã§ã³ã®æèã§ãã®æ©è½ã¸ã®é¢å¿ãå¢ãã¦ãã¾ããUCãã¼ã¯ã¬ã¼æ ¡ã®<a href="https://rise.cs.berkeley.edu/">RISELab</a>ã®<a href="https://github.com/ray-project/ray">Rayããã¸ã§ã¯ã</a>ãæåã®ä¾ã§ãã</p> + +<p>æ©æ¢°å¦ç¿ã§ã¯ã¯ããã³ã½ã«ãã¨ãå¼ã°ããå¤æ¬¡å é åã¨ãããã¼ã¿æ§é ãæ±ãã¾ãããã®ãããªãã¼ã¿æ§é ã¯Arrowã®ã«ã©ã ãã©ã¼ãããããµãã¼ããã¦ãããã¼ã¿æ§é ã®ç¯å²ãè¶ ãã¦ãã¾ããä»åã®ã±ã¼ã¹ã§ã¯ã<a href="http://arrow.apache.org/docs/cpp/classarrow_1_1_tensor.html"><code class="highlighter-rouge">arrow::Tensor</code></a>ã¨ããC++ã®åã追å ã§å®è£ ãã¾ãããããã¯Arrowã®ã³ãã¼ãªãã®å ±æã¡ã¢ãªã¼æ©è½ãæ´»ç¨ãã¦å®è£ ãã¾ãããï¼ã¡ã¢ãªã¼ã®çåæéã®ç®¡çã«<code class="highlighter-rouge">arrow::Buffer</code>ã使ãã¾ãããï¼C++å®è£ ã§ã¯ãããããããå ±éã®IOã»ã¡ã¢ãªã¼ç®¡çãã¼ã«ã¨ãã¦Arrowãæ´»ç¨ã§ããããã«ããããã追å ã®ãã¼ã¿æ§é ãæä¾ããã¤ããã§ãã</p> + +<h3 id="javascripttypescriptå®è£ ã®éå§">JavaScriptï¼TypeScriptï¼å®è£ ã®éå§</h3> + +<p><a href="https://github.com/TheNeuralBit">Brian Hulette</a>ã¯NodeJSã¨Webãã©ã¦ã¶ã¼ä¸ã§åãã¢ããªã±ã¼ã·ã§ã³ã§ä½¿ãããã«<a href="https://github.com/apache/arrow/tree/master/js">TypeScript</a>ã§ã®Arrowã®å®è£ ãå§ãã¾ãããFlatBuffersãJavaScriptããã¡ã¼ã¹ãã¯ã©ã¹ã§ãµãã¼ããã¦ããã®ã§å®è£ ãæãã¾ãã</p> + +<h3 id="webãµã¤ãã¨éçºè ç¨ããã¥ã¡ã³ãã®æ¹è¯">Webãµã¤ãã¨éçºè ç¨ããã¥ã¡ã³ãã®æ¹è¯</h3> + +<p>0.2.0ããªãªã¼ã¹ãã¦ããããã¥ã¡ã³ãã¨ããã°ãå ¬éããããã«Webãµã¤ãã®ã·ã¹ãã ã<a href="https://jekyllrb.com">Jekyll</a>ãã¼ã¹ã§ä½ãã¾ãããKouhei Sutouã¯<a href="https://github.com/red-data-tools/jekyll-jupyter-notebook">Jekyll Jupyter Notebookãã©ã°ã¤ã³</a>ãä½ãã¾ãããããã«ããArrowã®Webãµã¤ãã®ã³ã³ãã³ããä½ãããã«Jupyterã使ããã¨ãã§ãã¾ãã</p> + +<p>Webãµã¤ãã«ã¯CãC++ãJavaãPythonã®APIããã¥ã¡ã³ããå ¬éãã¾ããããããã®ä¸ã«Arrowã使ãå§ããããã®æçãªæ å ±ãè¦ã¤ããããã§ãããã</p> + +<h3 id="ã³ã³ããªãã¥ã¼ã¿ã¼">ã³ã³ããªãã¥ã¼ã¿ã¼</h3> + +<p>ãã®ãªãªã¼ã¹ã«ããããã³ã³ããªãã¥ã¼ãããã¿ãªããã«æè¬ãã¾ãã</p> + +<div class="highlighter-rouge"><pre class="highlight"><code>$ git shortlog -sn apache-arrow-0.2.0..apache-arrow-0.3.0 + 119 Wes McKinney + 55 Kouhei Sutou + 18 Uwe L. Korn + 17 Julien Le Dem + 9 Phillip Cloud + 6 Bryan Cutler + 5 Philipp Moritz + 5 Emilio Lahr-Vivaz + 4 Max Risuhin + 4 Johan Mabille + 4 Jeff Knupp + 3 Steven Phillips + 3 Miki Tebeka + 2 Leif Walsh + 2 Jeff Reback + 2 Brian Hulette + 1 Tsuyoshi Ozawa + 1 rvernica + 1 Nong Li + 1 Julien Lafaye + 1 Itai Incze + 1 Holden Karau + 1 Deepak Majeti +</code></pre> </div></content><author><name>wesm</name></author></entry></feed> \ No newline at end of file http://git-wip-us.apache.org/repos/asf/arrow-site/blob/3a7bab25/install/index.html ---------------------------------------------------------------------- diff --git a/install/index.html b/install/index.html index 75ed13a..8a1d1d1 100644 --- a/install/index.html +++ b/install/index.html @@ -100,7 +100,11 @@ </nav> - <h2 id="current-version-030">Current Version: 0.3.0</h2> + <!-- + +--> + +<h2 id="current-version-030">Current Version: 0.3.0</h2> <h3 id="released-5-may-2017">Released: 5 May 2017</h3> @@ -149,6 +153,74 @@ conda install pyarrow -c conda-forge <p>These include the Apache Arrow and Apache Parquet C++ binary libraries bundled with the wheel.</p> +<h3 id="c-and-glib-c-packages-for-debian-gnulinux-ubuntu-and-centos-unofficial">C++ and GLib (C) Packages for Debian GNU/Linux, Ubuntu and CentOS (Unofficial)</h3> + +<p>We have provided APT and Yum repositories for Apache Arrow C++ and +Apache Arrow GLib (C). Here are supported platforms:</p> + +<ul> + <li>Debian GNU/Linux Jessie</li> + <li>Ubuntu 16.04 LTS</li> + <li>Ubuntu 16.10</li> + <li>Ubuntu 17.04</li> + <li>CentOS 7</li> +</ul> + +<p>Debian GNU/Linux Jessie:</p> + +<div class="language-shell highlighter-rouge"><pre class="highlight"><code>sudo apt update +sudo apt install -y -V apt-transport-https +cat <span class="sh"><<APT_LINE | sudo tee /etc/apt/sources.list.d/groonga.list +deb https://packages.groonga.org/debian/ jessie main +deb-src https://packages.groonga.org/debian/ jessie main +APT_LINE +</span>sudo apt update +sudo apt install -y -V --allow-unauthenticated groonga-keyring +sudo apt update +sudo apt install -y -V libarrow-dev <span class="c"># For C++</span> +sudo apt install -y -V libarrow-glib-dev <span class="c"># For GLib (C)</span> +</code></pre> +</div> + +<p>Ubuntu:</p> + +<div class="language-shell highlighter-rouge"><pre class="highlight"><code>sudo apt install -y software-properties-common +sudo add-apt-repository -y ppa:groonga/ppa +sudo apt update +sudo apt install -y -V libarrow-dev <span class="c"># For C++</span> +sudo apt install -y -V libarrow-glib-dev <span class="c"># For GLib (C)</span> +</code></pre> +</div> + +<p>CentOS:</p> + +<div class="language-shell highlighter-rouge"><pre class="highlight"><code>sudo yum install -y https://packages.groonga.org/centos/groonga-release-1.3.0-1.noarch.rpm +sudo yum install -y --enablerepo<span class="o">=</span>epel arrow-devel <span class="c"># For C++</span> +sudo yum install -y --enablerepo<span class="o">=</span>epel arrow-glib-devel <span class="c"># For GLib (C)</span> +</code></pre> +</div> + +<p>These repositories also provide Apache Parquet C++ and +<a href="https://github.com/red-data-tools/parquet-glib";>Parquet GLib</a>. You can install them by the followings:</p> + +<p>Debian GNU/Linux and Ubuntu:</p> + +<div class="language-shell highlighter-rouge"><pre class="highlight"><code>sudo apt install -y -V libparquet-dev <span class="c"># For Apache Parquet C++</span> +sudo apt install -y -V libparquet-glib-dev <span class="c"># For Parquet GLib (C)</span> +</code></pre> +</div> + +<p>CentOS:</p> + +<div class="language-shell highlighter-rouge"><pre class="highlight"><code>sudo yum install -y --enablerepo<span class="o">=</span>epel parquet-devel <span class="c"># For Apache Parquet C++</span> +sudo yum install -y --enablerepo<span class="o">=</span>epel parquet-glib-devel <span class="c"># For Parquet GLib (C)</span> +</code></pre> +</div> + +<p>These repositories are managed at +<a href="https://github.com/red-data-tools/arrow-packages";>red-data-tools/arrow-packages</a>. If you have any feedback, please +send it to the project instead of Apache Arrow project.</p> + <hr/>
