[10/14] arrow git commit: ARROW-1063: [Website] Updates for 0.4.0 release, release posting

2017-05-31 Thread wesm
ARROW-1063: [Website] Updates for 0.4.0 release, release posting Author: Wes McKinney Closes #711 from wesm/ARROW-1063 and squashes the following commits: 90f33ac [Wes McKinney] Update to use dynamic mirror links 62a04e8 [Wes McKinney] Use Apache mirrors for download links ae88978 [Wes

[12/14] arrow git commit: ARROW-1066: [Python] pandas 0.20.1 deprecation of pd.lib causes a warning on import

2017-05-31 Thread wesm
ARROW-1066: [Python] pandas 0.20.1 deprecation of pd.lib causes a warning on import Author: Jeff Reback Closes #715 from jreback/pandas_compat and squashes the following commits: 842b19f [Jeff Reback] COMPAT: pandas 0.20.1 deprecation of pd.lib causes a warning on import Project: http://git

[01/14] arrow git commit: [maven-release-plugin] prepare release apache-arrow-0.4.0 [Forced Update!]

2017-05-31 Thread wesm
Repository: arrow Updated Branches: refs/heads/master 5899800f5 -> 51b6bf253 (forced update) [maven-release-plugin] prepare release apache-arrow-0.4.0 Change-Id: I976a1bb24dde7f6b7b9fc2208b4f4995b1023756 Project: http://git-wip-us.apache.org/repos/asf/arrow/repo Commit: http://git-wip-us.apa

[07/14] arrow git commit: ARROW-1049: [java] vector template cleanup

2017-05-31 Thread wesm
ARROW-1049: [java] vector template cleanup Author: Julien Le Dem Closes #703 from julienledem/template_cleanup and squashes the following commits: d67cb7e [Julien Le Dem] remove duplicated code f17e8cd [Julien Le Dem] template cleanup Project: http://git-wip-us.apache.org/repos/asf/arrow/rep

[06/14] arrow git commit: ARROW-1054: [Python] Fix test failure on pandas 0.19.2, some refactoring

2017-05-31 Thread wesm
ARROW-1054: [Python] Fix test failure on pandas 0.19.2, some refactoring For esoteric reasons, `MultiIndex.from_arrays` rejects non-writeable NumPy arrays. This problem isn't present in pandas 0.20.1 Author: Wes McKinney Closes #705 from wesm/ARROW-1054 and squashes the following co

[13/14] arrow git commit: ARROW-1069: Add instructions for publishing maven artifacts

2017-05-31 Thread wesm
ARROW-1069: Add instructions for publishing maven artifacts Author: Julien Le Dem Closes #716 from julienledem/ARROW-1069 and squashes the following commits: 8896189 [Julien Le Dem] ARROW-1069: Add instructions for publishing maven artifacts Project: http://git-wip-us.apache.org/repos/asf/ar

[02/14] arrow git commit: Increment version to 0.5.0-SNAPSHOT

2017-05-31 Thread wesm
Increment version to 0.5.0-SNAPSHOT Change-Id: I9b4a13830c41426ab728cdb2e2107c3537cd9ccf Conflicts: java/format/pom.xml java/memory/pom.xml java/pom.xml java/tools/pom.xml java/vector/pom.xml Project: http://git-wip-us.apache.org/repos/asf/arrow/repo Comm

[14/14] arrow git commit: ARROW-424: [C++] Make ReadAt, Write HDFS functions threadsafe

2017-05-31 Thread wesm
ARROW-424: [C++] Make ReadAt, Write HDFS functions threadsafe This also fixes the HDFS test suite to actually use libhdfs3 (it was not by accident) Author: Wes McKinney Closes #712 from wesm/ARROW-424 and squashes the following commits: 0894719 [Wes McKinney] Make ReadAt, Write HDFS

[03/14] arrow git commit: ARROW-897: [GLib] Extract CI configuration for GLib

2017-05-31 Thread wesm
ARROW-897: [GLib] Extract CI configuration for GLib Author: Kouhei Sutou Closes #713 from kou/glib-travis-split and squashes the following commits: 682f0bd [Kouhei Sutou] [GLib] Build only C++ libraries for GLib CI 7d02eb7 [Kouhei Sutou] [GLib] Extract CI configuration for GLib Project: http:

arrow git commit: [Doc] Change cpp api doc, std:shared_pointer_cast to std::static_pointer_cast

2017-05-31 Thread wesm
Repository: arrow Updated Branches: refs/heads/master 51b6bf253 -> ddf766db2 [Doc] Change cpp api doc, std:shared_pointer_cast to std::static_pointer_cast Change-Id: Ib5b61398cb06a5f76d701e403f61d17953a75bb8 Project: http://git-wip-us.apache.org/repos/asf/arrow/repo Commit: http://git-wip-us

arrow git commit: [Doc] Change cpp api doc, std:shared_pointer_cast to std::static_pointer_cast [Forced Update!]

2017-05-31 Thread wesm
Repository: arrow Updated Branches: refs/heads/master ddf766db2 -> 530f0da34 (forced update) [Doc] Change cpp api doc, std:shared_pointer_cast to std::static_pointer_cast Closes #717 Change-Id: Ib5b61398cb06a5f76d701e403f61d17953a75bb8 Project: http://git-wip-us.apache.org/repos/asf/arrow/r

arrow git commit: ARROW-1078: [Python] Account for Apache Parquet shared library consolidation

2017-05-31 Thread wesm
Repository: arrow Updated Branches: refs/heads/master 530f0da34 -> 8229688a6 ARROW-1078: [Python] Account for Apache Parquet shared library consolidation Author: Wes McKinney Closes #720 from wesm/ARROW-1078 and squashes the following commits: 4bcf580e [Wes McKinney] Remove move_lib

arrow git commit: ARROW-1075: [GLib] Fix build error on macOS

2017-05-31 Thread wesm
Repository: arrow Updated Branches: refs/heads/master 8229688a6 -> 5c155c353 ARROW-1075: [GLib] Fix build error on macOS int64_t is "long long" but gint64 is "long". Author: Kouhei Sutou Closes #719 from kou/glib-fix-build-error-on-macos and squashes the following commits: ee51ffb [Kouhei

arrow git commit: ARROW-990: [JS] Add tslint support for linting TypeScript

2017-06-02 Thread wesm
Repository: arrow Updated Branches: refs/heads/master 5c155c353 -> 092afb6dc ARROW-990: [JS] Add tslint support for linting TypeScript Added tslint config and `npm run tslint` script. Modified current code to pass lint tests. Currently the config disables the bitwise operation and max classe

arrow git commit: ARROW-1086: include additional pxd files during package build

2017-06-06 Thread wesm
Repository: arrow Updated Branches: refs/heads/master 4e134e5b9 -> a367fd437 ARROW-1086: include additional pxd files during package build Since this is purely a packaging change, I believe I would need to change`travis_script_python.sh` in order test it (build a wheel, set up a new conda en

arrow git commit: ARROW-1020: [Format] Revise language for Timestamp type in Schema.fbs to avoid possible confusion about tz-naive timestamps

2017-06-06 Thread wesm
Repository: arrow Updated Branches: refs/heads/master a367fd437 -> 44dba7176 ARROW-1020: [Format] Revise language for Timestamp type in Schema.fbs to avoid possible confusion about tz-naive timestamps Author: Wes McKinney Closes #731 from wesm/ARROW-1020 and squashes the following comm

arrow git commit: [Doc] Fix a few links for files moved in ARROW-957

2017-06-06 Thread wesm
Repository: arrow Updated Branches: refs/heads/master 44dba7176 -> 1a72acdf4 [Doc] Fix a few links for files moved in ARROW-957 Closes #714 Change-Id: Ic58e7ad6b0b2cf5a7d4d36859bdbffda65e13f79 Project: http://git-wip-us.apache.org/repos/asf/arrow/repo Commit: http://git-wip-us.apache.org/re

arrow git commit: ARROW-1080: C++: Add tutorial about converting to/from row-wise representation

2017-06-06 Thread wesm
Repository: arrow Updated Branches: refs/heads/master 1a72acdf4 -> 5589dda50 ARROW-1080: C++: Add tutorial about converting to/from row-wise representation Author: Uwe L. Korn Closes #721 from xhochy/ARROW-1080 and squashes the following commits: 556a37b2 [Uwe L. Korn] Fix chunk indices e7a

arrow git commit: ARROW-1090: Improve build_ext usability with --bundle-arrow-cpp

2017-06-06 Thread wesm
Repository: arrow Updated Branches: refs/heads/master 5589dda50 -> c3e865d5f ARROW-1090: Improve build_ext usability with --bundle-arrow-cpp This is based on a blackbox understanding of the build toolchain. It might be cleaner to update `FindArrow.cmake`, but I'm not sure what the consequence

arrow git commit: ARROW-1094: [C++] Always truncate buffer read in ReadableFile::Read if actual number of bytes less than request

2017-06-06 Thread wesm
Repository: arrow Updated Branches: refs/heads/master ac540758c -> 2a12482b2 ARROW-1094: [C++] Always truncate buffer read in ReadableFile::Read if actual number of bytes less than request Author: Wes McKinney Closes #737 from wesm/ARROW-1094 and squashes the following commits: fcb61

arrow git commit: ARROW-1088: [Python] Only test unicode filenames if system supports them

2017-06-06 Thread wesm
Repository: arrow Updated Branches: refs/heads/master 402baa4ec -> ac540758c ARROW-1088: [Python] Only test unicode filenames if system supports them Author: Jeff Knupp Closes #727 from jeffknupp/fmaster and squashes the following commits: c19b3dec [Jeff Knupp] ARROW-1088: [Python] Only tes

[arrow] Git Push Summary

2017-06-06 Thread wesm
Repository: arrow Updated Tags: refs/tags/apache-arrow-0.4.1 [created] ae60e5f3b

svn commit: r19908 - in /dev/arrow/apache-arrow-0.4.1-rc0: ./ apache-arrow-0.4.1.tar.gz apache-arrow-0.4.1.tar.gz.asc apache-arrow-0.4.1.tar.gz.md5 apache-arrow-0.4.1.tar.gz.sha

2017-06-06 Thread wesm
Author: wesm Date: Wed Jun 7 02:23:23 2017 New Revision: 19908 Log: Apache Arrow ${version} RC${rc} Added: dev/arrow/apache-arrow-0.4.1-rc0/ dev/arrow/apache-arrow-0.4.1-rc0/apache-arrow-0.4.1.tar.gz (with props) dev/arrow/apache-arrow-0.4.1-rc0/apache-arrow-0.4.1.tar.gz.asc

arrow git commit: ARROW-1102: Make MessageSerializer.serializeMessage() public

2017-06-08 Thread wesm
Repository: arrow Updated Branches: refs/heads/master 81c4bd695 -> 8acc14c0b ARROW-1102: Make MessageSerializer.serializeMessage() public Author: Julien Le Dem Closes #741 from julienledem/ARROW-1102 and squashes the following commits: 284eaaf1 [Julien Le Dem] ARROW-1102: Make MessageSerial

[10/12] arrow git commit: ARROW-1111: [JAVA] Make aligning buffers optional, and allow -1 for unknown null count

2017-06-11 Thread wesm
ARROW-: [JAVA] Make aligning buffers optional, and allow -1 for unknown null count Closes #747 Project: http://git-wip-us.apache.org/repos/asf/arrow/repo Commit: http://git-wip-us.apache.org/repos/asf/arrow/commit/11deee61 Tree: http://git-wip-us.apache.org/repos/asf/arrow/tree/11deee61 Dif

[05/12] arrow git commit: ARROW-1108: [JAVA] Check if ArrowBuf is empty buffer in getActualConsumedMemory() and getPossibleConsumedMemory()

2017-06-11 Thread wesm
ARROW-1108: [JAVA] Check if ArrowBuf is empty buffer in getActualConsumedMemory() and getPossibleConsumedMemory() Closes #744 Project: http://git-wip-us.apache.org/repos/asf/arrow/repo Commit: http://git-wip-us.apache.org/repos/asf/arrow/commit/06c26a2c Tree: http://git-wip-us.apache.org/repos/

[06/12] arrow git commit: ARROW-1095: Add Arrow logo PNG to website img folder

2017-06-11 Thread wesm
ARROW-1095: Add Arrow logo PNG to website img folder Author: Wes McKinney Closes #739 from wesm/ARROW-1095 and squashes the following commits: 4a89d2d [Wes McKinney] Add Arrow logo PNG Project: http://git-wip-us.apache.org/repos/asf/arrow/repo Commit: http://git-wip-us.apache.org/repos/asf

[03/12] arrow git commit: ARROW-1102: Make MessageSerializer.serializeMessage() public

2017-06-11 Thread wesm
ARROW-1102: Make MessageSerializer.serializeMessage() public Author: Julien Le Dem Closes #741 from julienledem/ARROW-1102 and squashes the following commits: 284eaaf1 [Julien Le Dem] ARROW-1102: Make MessageSerializer.serializeMessage() public Project: http://git-wip-us.apache.org/repos/asf

[11/12] arrow git commit: ARROW-1112: [JAVA] Set lastSet for VarLength and List vectors when loading

2017-06-11 Thread wesm
ARROW-1112: [JAVA] Set lastSet for VarLength and List vectors when loading Closes #748 Project: http://git-wip-us.apache.org/repos/asf/arrow/repo Commit: http://git-wip-us.apache.org/repos/asf/arrow/commit/ac648539 Tree: http://git-wip-us.apache.org/repos/asf/arrow/tree/ac648539 Diff: http://git

[07/12] arrow git commit: ARROW-1048: Use existing LD_LIBRARY_PATH in source release script to accommodate non-system toolchain libs

2017-06-11 Thread wesm
ARROW-1048: Use existing LD_LIBRARY_PATH in source release script to accommodate non-system toolchain libs Tripped on this again when cutting the 0.4.1 rc0. cc @kou Author: Wes McKinney Closes #738 from wesm/ARROW-1048 and squashes the following commits: f335c09 [Wes McKinney] Use existing

[04/12] arrow git commit: ARROW-1107: [JAVA] Fix getField() for NullableMapVector

2017-06-11 Thread wesm
ARROW-1107: [JAVA] Fix getField() for NullableMapVector Closes #743 Project: http://git-wip-us.apache.org/repos/asf/arrow/repo Commit: http://git-wip-us.apache.org/repos/asf/arrow/commit/ae6142da Tree: http://git-wip-us.apache.org/repos/asf/arrow/tree/ae6142da Diff: http://git-wip-us.apache.org/

[08/12] arrow git commit: ARROW-1110: [JAVA] make union vector naming consistent

2017-06-11 Thread wesm
ARROW-1110: [JAVA] make union vector naming consistent Closes #746 Project: http://git-wip-us.apache.org/repos/asf/arrow/repo Commit: http://git-wip-us.apache.org/repos/asf/arrow/commit/c6cf1244 Tree: http://git-wip-us.apache.org/repos/asf/arrow/tree/c6cf1244 Diff: http://git-wip-us.apache.org/r

[02/12] arrow git commit: [maven-release-plugin] prepare for next development iteration

2017-06-11 Thread wesm
[maven-release-plugin] prepare for next development iteration Change-Id: Iec07f0f0117c363e39666a76c5c99e7f94c73ab0 Project: http://git-wip-us.apache.org/repos/asf/arrow/repo Commit: http://git-wip-us.apache.org/repos/asf/arrow/commit/41b58e4f Tree: http://git-wip-us.apache.org/repos/asf/arrow/tr

[12/12] arrow git commit: ARROW-1109: [JAVA] transferOwnership fails when readerIndex is not 0

2017-06-11 Thread wesm
ARROW-1109: [JAVA] transferOwnership fails when readerIndex is not 0 Closes #745 Project: http://git-wip-us.apache.org/repos/asf/arrow/repo Commit: http://git-wip-us.apache.org/repos/asf/arrow/commit/0e680f01 Tree: http://git-wip-us.apache.org/repos/asf/arrow/tree/0e680f01 Diff: http://git-wip-u

[01/12] arrow git commit: [maven-release-plugin] prepare release apache-arrow-0.4.1 [Forced Update!]

2017-06-11 Thread wesm
Repository: arrow Updated Branches: refs/heads/master 037d78dda -> ac6485390 (forced update) [maven-release-plugin] prepare release apache-arrow-0.4.1 Change-Id: I36c4db377ed8cfc10de14604114a79454db10aa1 Project: http://git-wip-us.apache.org/repos/asf/arrow/repo Commit: http://git-wip-us.apa

[09/12] arrow git commit: ARROW-1101: Implement write(TypeHolder) methods in UnionListWriter

2017-06-11 Thread wesm
ARROW-1101: Implement write(TypeHolder) methods in UnionListWriter Author: vkorukanti Closes #740 from vkorukanti/ARROW-1101 and squashes the following commits: e2d097d [vkorukanti] ARROW-1101: Implement write(TypeHolder) methods in UnionListWriter Project: http://git-wip-us.apache.org/repos

arrow git commit: ARROW-742: [C++] std::wstring_convert exceptions handling

2017-06-12 Thread wesm
Repository: arrow Updated Branches: refs/heads/master ac6485390 -> 2a2b1094e ARROW-742: [C++] std::wstring_convert exceptions handling Author: Max Risuhin Closes #749 from MaxRis/ARROW-742 and squashes the following commits: 5479b3f4 [Max Risuhin] ARROW-742: [C++] std::wstring_convert excep

arrow git commit: ARROW-460: [C++] JSON read/write for dictionaries

2017-06-13 Thread wesm
on't use this at all in C++, so let me know what you need in Java (if anything) Author: Wes McKinney Closes #750 from wesm/ARROW-460 and squashes the following commits: 36d6019e [Wes McKinney] Put dictionaries in top level of json object 92e2a95f [Wes McKinney] Some debugging help, g

arrow git commit: ARROW-1115: [C++] use CCACHE_FOUND value for ccache path

2017-06-13 Thread wesm
Repository: arrow Updated Branches: refs/heads/master 25ba44c32 -> 1144d0200 ARROW-1115: [C++] use CCACHE_FOUND value for ccache path Change-Id: I7afa8a65d4ad1180ff7f8b85da635a68f04e62e3 Project: http://git-wip-us.apache.org/repos/asf/arrow/repo Commit: http://git-wip-us.apache.org/repos/asf

arrow git commit: ARROW-1115: [C++] use CCACHE_FOUND value for ccache path [Forced Update!]

2017-06-13 Thread wesm
Repository: arrow Updated Branches: refs/heads/master 1144d0200 -> d25ea6314 (forced update) ARROW-1115: [C++] use CCACHE_FOUND value for ccache path Closes #751 Change-Id: I7afa8a65d4ad1180ff7f8b85da635a68f04e62e3 Project: http://git-wip-us.apache.org/repos/asf/arrow/repo Commit: http://gi

svn commit: r20025 - in /release/arrow: arrow-0.4.0/ arrow-0.4.1/ arrow-0.4.1/apache-arrow-0.4.1.tar.gz arrow-0.4.1/apache-arrow-0.4.1.tar.gz.asc arrow-0.4.1/apache-arrow-0.4.1.tar.gz.md5 arrow-0.4.1/

2017-06-13 Thread wesm
Author: wesm Date: Tue Jun 13 18:54:16 2017 New Revision: 20025 Log: Apache Arrow 0.4.1 Added: release/arrow/arrow-0.4.1/ release/arrow/arrow-0.4.1/apache-arrow-0.4.1.tar.gz (with props) release/arrow/arrow-0.4.1/apache-arrow-0.4.1.tar.gz.asc release/arrow/arrow-0.4.1/apache

arrow-site git commit: Add 0.4.1 release materials

2017-06-14 Thread wesm
http://www.apache.org/foundation/thanks.html";>Thanks +http://www.apache.org/security/";>Security + + + + http://www.apache.org/";> + + + + + + + + + Apache Arrow 0.4.1 Release + ∞ + + +

arrow git commit: ARROW-1122: [Website] Add turbodbc + arrow blog post

2017-06-15 Thread wesm
Repository: arrow Updated Branches: refs/heads/master d1de66bda -> 5b66c25c9 ARROW-1122: [Website] Add turbodbc + arrow blog post Closes #757 Change-Id: Idb147f5681e725f8852108ae3a1b870afc14973c Project: http://git-wip-us.apache.org/repos/asf/arrow/repo Commit: http://git-wip-us.apache.org/

arrow git commit: ARROW-1096: [C++] CreateFileMapping maximum size calculation issue

2017-06-15 Thread wesm
Repository: arrow Updated Branches: refs/heads/master 5b66c25c9 -> 3f26dfa36 ARROW-1096: [C++] CreateFileMapping maximum size calculation issue Author: Max Risuhin Closes #756 from MaxRis/ARROW-1096 and squashes the following commits: a864fe7f [Max Risuhin] [C++] CreateFileMapping maximum s

arrow-site git commit: Add turbodbc guest blog post

2017-06-16 Thread wesm
Repository: arrow-site Updated Branches: refs/heads/asf-site 2316712e9 -> 22ab633ab Add turbodbc guest blog post Project: http://git-wip-us.apache.org/repos/asf/arrow-site/repo Commit: http://git-wip-us.apache.org/repos/asf/arrow-site/commit/22ab633a Tree: http://git-wip-us.apache.org/repos/a

arrow git commit: ARROW-1122: [Website] Change timestamp to yield correct Jekyll date

2017-06-16 Thread wesm
Repository: arrow Updated Branches: refs/heads/master 3f26dfa36 -> d54bf4829 ARROW-1122: [Website] Change timestamp to yield correct Jekyll date Change-Id: Ic221871d3fbd1c51af1544471d80b632e135c7f6 Project: http://git-wip-us.apache.org/repos/asf/arrow/repo Commit: http://git-wip-us.apache.or

arrow git commit: ARROW-1081: Fill null_bitmap correctly in TestBase

2017-06-19 Thread wesm
Repository: arrow Updated Branches: refs/heads/master 5be05ac15 -> d874d4e32 ARROW-1081: Fill null_bitmap correctly in TestBase Change-Id: I103cc31e1400491713b160b429c5491e8c82f810 Author: Uwe L. Korn Closes #760 from xhochy/ARROW-1081 and squashes the following commits: e012438 [Uwe L. Ko

arrow git commit: ARROW-1128: [Docs] command to build a wheel is not properly rendered

2017-06-19 Thread wesm
Repository: arrow Updated Branches: refs/heads/master d874d4e32 -> b5e8a4831 ARROW-1128: [Docs] command to build a wheel is not properly rendered Author: Kengo Seki Closes #762 from sekikn/ARROW-1128 and squashes the following commits: 2179516 [Kengo Seki] ARROW-1128: [Docs] command to buil

arrow git commit: ARROW-1123: Make jemalloc the default allocator

2017-06-22 Thread wesm
Repository: arrow Updated Branches: refs/heads/master f0f1ca60d -> ef579ca7e ARROW-1123: Make jemalloc the default allocator Change-Id: Ib03392431851773df3b59b2c9a4d9a7bd672d2cb Author: Uwe L. Korn Closes #761 from xhochy/ARROW-1123 and squashes the following commits: 2c75f56d [Uwe L. Korn

[2/6] arrow git commit: ARROW-1104: Integrate in-memory object store into arrow

2017-06-22 Thread wesm
http://git-wip-us.apache.org/repos/asf/arrow/blob/5e343098/cpp/src/plasma/thirdparty/dlmalloc.c -- diff --git a/cpp/src/plasma/thirdparty/dlmalloc.c b/cpp/src/plasma/thirdparty/dlmalloc.c new file mode 100644 index 000..84ccbd

[6/6] arrow git commit: ARROW-1104: Integrate in-memory object store into arrow

2017-06-22 Thread wesm
ARROW-1104: Integrate in-memory object store into arrow This supersedes https://github.com/apache/arrow/pull/467 This is ready for review. Next steps are - Integration with the arrow CI - Write docs on how to use the object store There is one remaining compilation error (it doesn't find Python.h

[4/6] arrow git commit: ARROW-1104: Integrate in-memory object store into arrow

2017-06-22 Thread wesm
http://git-wip-us.apache.org/repos/asf/arrow/blob/5e343098/cpp/src/plasma/store.cc -- diff --git a/cpp/src/plasma/store.cc b/cpp/src/plasma/store.cc new file mode 100644 index 000..5151a44 --- /dev/null +++ b/cpp/src/plasma/sto

[3/6] arrow git commit: ARROW-1104: Integrate in-memory object store into arrow

2017-06-22 Thread wesm
http://git-wip-us.apache.org/repos/asf/arrow/blob/5e343098/cpp/src/plasma/thirdparty/ae/ae_evport.c -- diff --git a/cpp/src/plasma/thirdparty/ae/ae_evport.c b/cpp/src/plasma/thirdparty/ae/ae_evport.c new file mode 100644 index 000

[1/6] arrow git commit: ARROW-1104: Integrate in-memory object store into arrow

2017-06-22 Thread wesm
Repository: arrow Updated Branches: refs/heads/master ef579ca7e -> 5e3430981 http://git-wip-us.apache.org/repos/asf/arrow/blob/5e343098/cpp/src/plasma/thirdparty/xxhash.cc -- diff --git a/cpp/src/plasma/thirdparty/xxhash.cc b/

[5/6] arrow git commit: ARROW-1104: Integrate in-memory object store into arrow

2017-06-22 Thread wesm
http://git-wip-us.apache.org/repos/asf/arrow/blob/5e343098/cpp/src/plasma/extension.cc -- diff --git a/cpp/src/plasma/extension.cc b/cpp/src/plasma/extension.cc new file mode 100644 index 000..5d61e33 --- /dev/null +++ b/cpp/sr

arrow git commit: ARROW-1140: [C++] Allow optional build of plasma

2017-06-22 Thread wesm
Repository: arrow Updated Branches: refs/heads/master 5e3430981 -> 222628c9d ARROW-1140: [C++] Allow optional build of plasma Author: Phillip Cloud Closes #767 from cpcloud/ARROW-1140 and squashes the following commits: b046215c [Phillip Cloud] ARROW-1140: [C++] Allow optional build of plas

arrow git commit: ARROW-1073: C++: Adapative integer builder

2017-06-22 Thread wesm
Repository: arrow Updated Branches: refs/heads/master 222628c9d -> 608b89e16 ARROW-1073: C++: Adapative integer builder Author: Uwe L. Korn Closes #723 from xhochy/ARROW-1073 and squashes the following commits: 5bab9c2f [Uwe L. Korn] ARROW-1073: C++: Adapative integer builder Project: htt

arrow git commit: ARROW-1137: Python: Ensure Pandas roundtrip of all-None column

2017-06-22 Thread wesm
Repository: arrow Updated Branches: refs/heads/master 608b89e16 -> a16c1246e ARROW-1137: Python: Ensure Pandas roundtrip of all-None column Change-Id: Ib815d3fa42f0a0ae6c0d9850e9b0b435bad1c331 Author: Uwe L. Korn Closes #764 from xhochy/ARROW-1137 and squashes the following commits: 59c0df

arrow git commit: ARROW-1143: C++: Fix comparison of NullArray

2017-06-23 Thread wesm
Repository: arrow Updated Branches: refs/heads/master c1ec0c723 -> 074dde41c ARROW-1143: C++: Fix comparison of NullArray Change-Id: Ib18dc6b00c9806aaf541c61cb63673ac51b0525c Author: Uwe L. Korn Closes #772 from xhochy/ARROW-1143 and squashes the following commits: eff44306 [Uwe L. Korn] A

arrow git commit: ARROW-1144: [C++] Remove unused variable

2017-06-23 Thread wesm
Repository: arrow Updated Branches: refs/heads/master 074dde41c -> e209e5865 ARROW-1144: [C++] Remove unused variable Author: Phillip Cloud Closes #774 from cpcloud/ARROW-1144 and squashes the following commits: a79aebaa [Phillip Cloud] ARROW-1144: [C++] Remove unused variable Project: ht

arrow git commit: ARROW-1139: Silence dlmalloc warning on clang-4.0

2017-06-23 Thread wesm
Repository: arrow Updated Branches: refs/heads/master e209e5865 -> 6768f5268 ARROW-1139: Silence dlmalloc warning on clang-4.0 An alternative would be to patch dlmalloc similarly to https://github.com/greg7mdp/dlmalloc Author: Philipp Moritz Closes #769 from pcmoritz/dlmalloc-fix and squas

arrow git commit: ARROW-1136: [C++] Add null checks for invalid streams

2017-06-23 Thread wesm
Repository: arrow Updated Branches: refs/heads/master 6768f5268 -> 8bf567e63 ARROW-1136: [C++] Add null checks for invalid streams Author: Wes McKinney Closes #770 from wesm/ARROW-1136 and squashes the following commits: 6ae5cd82 [Wes McKinney] Centralize null checking bc3ec207 [

arrow git commit: ARROW-1132: [Python] Unable to write pandas DataFrame w/MultiIndex containing duplicate values to parquet

2017-06-23 Thread wesm
Repository: arrow Updated Branches: refs/heads/master 8bf567e63 -> b7befeb7c ARROW-1132: [Python] Unable to write pandas DataFrame w/MultiIndex containing duplicate values to parquet Author: Phillip Cloud Closes #768 from cpcloud/ARROW-1132 and squashes the following commits: 4b42f643 [Phi

arrow git commit: ARROW-1146: Add .gitignore for *_generated.h files in src/plasma/format

2017-06-23 Thread wesm
Repository: arrow Updated Branches: refs/heads/master b7befeb7c -> 1514016a7 ARROW-1146: Add .gitignore for *_generated.h files in src/plasma/format Author: Phillip Cloud Closes #777 from cpcloud/ARROW-1146 and squashes the following commits: f97de967 [Phillip Cloud] ARROW-1146: Add .gitign

[1/2] arrow git commit: ARROW-1142: [C++] Port over compression toolchain and interfaces from parquet-cpp, use Arrow-style error handling

2017-06-23 Thread wesm
Repository: arrow Updated Branches: refs/heads/master 1514016a7 -> 98f7cac6e http://git-wip-us.apache.org/repos/asf/arrow/blob/98f7cac6/cpp/src/arrow/util/compression.h -- diff --git a/cpp/src/arrow/util/compression.h b/cpp/src

[2/2] arrow git commit: ARROW-1142: [C++] Port over compression toolchain and interfaces from parquet-cpp, use Arrow-style error handling

2017-06-23 Thread wesm
ARROW-1142: [C++] Port over compression toolchain and interfaces from parquet-cpp, use Arrow-style error handling Author: Wes McKinney Closes #771 from wesm/import-parquet-compression and squashes the following commits: b7609f8e [Wes McKinney] Boost toolchain tweaks 44e77a64 [Wes McKinney

arrow git commit: ARROW-1147: [C++] Allow optional vendoring of flatbuffers in plasma

2017-06-23 Thread wesm
Repository: arrow Updated Branches: refs/heads/master 98f7cac6e -> 73007de72 ARROW-1147: [C++] Allow optional vendoring of flatbuffers in plasma Author: Phillip Cloud Closes #780 from cpcloud/ARROW-1147 and squashes the following commits: 2deec3f2 [Phillip Cloud] Move target ea9df3a4 [Phill

arrow git commit: ARROW-1135: [C++] Use clang 4.0 in one of the Linux builds

2017-06-24 Thread wesm
Repository: arrow Updated Branches: refs/heads/master 73007de72 -> 41524d6d2 ARROW-1135: [C++] Use clang 4.0 in one of the Linux builds This will help us keep the Linux build clean on latest clang Author: Wes McKinney Closes #779 from wesm/ARROW-1135 and squashes the following comm

arrow git commit: ARROW-1145: [GLib] Add get_values()

2017-06-24 Thread wesm
Repository: arrow Updated Branches: refs/heads/master 41524d6d2 -> f3bcf76f2 ARROW-1145: [GLib] Add get_values() Author: Kouhei Sutou Closes #775 from kou/glib-get-values and squashes the following commits: 7a02ab73 [Kouhei Sutou] [GLib] Use template for common code ebb24f9e [Kouhei Sutou]

arrow git commit: ARROW-1113: [C++] Upgrade to gflags 2.2.0, use tarball instead of git tag

2017-06-24 Thread wesm
776 from wesm/gflags-ep-make-oddness and squashes the following commits: 82b163b2 [Wes McKinney] Upgrade to gflags 2.2.0, use tarball to avoid odd no-op work on subsequent builds with make or ninja Project: http://git-wip-us.apache.org/repos/asf/arrow/repo Commit: http://git-wip-us.apache.org/re

arrow git commit: ARROW-978: [Python] - Change python documentation sphinx theme to bootstrap

2017-06-26 Thread wesm
Repository: arrow Updated Branches: refs/heads/master fc3f8c2a0 -> 5de6eb5ff ARROW-978: [Python] - Change python documentation sphinx theme to bootstrap This sets the default HTML theme to the sphinx-bootstrap-theme. There were vestiges of the (improperly configured and thus unused) sphinx-rt

arrow git commit: ARROW-1151: [C++] Add branch prediction to RETURN_NOT_OK

2017-06-26 Thread wesm
Repository: arrow Updated Branches: refs/heads/master 5de6eb5ff -> ec6e183ee ARROW-1151: [C++] Add branch prediction to RETURN_NOT_OK Also added some missing status checks to builder-benchmark Author: Wes McKinney Closes #782 from wesm/ARROW-1151 and squashes the following comm

arrow git commit: ARROW-1152: [Cython] read_tensor should work with a readable file

2017-06-26 Thread wesm
Repository: arrow Updated Branches: refs/heads/master ec6e183ee -> bfe15dbf9 ARROW-1152: [Cython] read_tensor should work with a readable file Author: Philipp Moritz Closes #783 from pcmoritz/fix-read-tensor and squashes the following commits: a03b59fc [Philipp Moritz] add unit test e6fb710

arrow git commit: ARROW-1155: [Python] Add null check when user improperly instantiates ArrayValue instances

2017-06-26 Thread wesm
Repository: arrow Updated Branches: refs/heads/master bfe15dbf9 -> 3e754a0d0 ARROW-1155: [Python] Add null check when user improperly instantiates ArrayValue instances Author: Wes McKinney Closes #786 from wesm/ARROW-1155 and squashes the following commits: e496e919 [Wes McKinney]

[3/3] arrow git commit: ARROW-1154: [C++] Import miscellaneous computational utility code from parquet-cpp

2017-06-27 Thread wesm
ARROW-1154: [C++] Import miscellaneous computational utility code from parquet-cpp I will make a corresponding PR to parquet-cpp to ensure that this code migration is complete enough. Author: Wes McKinney Closes #785 from wesm/ARROW-1154 and squashes the following commits: 08b54c98 [Wes

[2/3] arrow git commit: ARROW-1154: [C++] Import miscellaneous computational utility code from parquet-cpp

2017-06-27 Thread wesm
http://git-wip-us.apache.org/repos/asf/arrow/blob/b0652287/cpp/src/arrow/util/bpacking.h -- diff --git a/cpp/src/arrow/util/bpacking.h b/cpp/src/arrow/util/bpacking.h new file mode 100644 index 000..fce5f55 --- /dev/null +++ b/

[1/3] arrow git commit: ARROW-1154: [C++] Import miscellaneous computational utility code from parquet-cpp

2017-06-27 Thread wesm
Repository: arrow Updated Branches: refs/heads/master cb5f2b953 -> b06522870 http://git-wip-us.apache.org/repos/asf/arrow/blob/b0652287/cpp/src/arrow/util/hash-util.h -- diff --git a/cpp/src/arrow/util/hash-util.h b/cpp/src/arr

arrow git commit: ARROW-1159: [C++] Use dllimport for visibility when not building Arrow library

2017-06-27 Thread wesm
job/90ahlb7eoxlch3yj Author: Wes McKinney Closes #789 from wesm/ARROW-1154-post and squashes the following commits: 985cedee [Wes McKinney] Use dllimport for visibility when not building Arrow library, this enables static members to be visible from inline functions like in cpu-info.h Proj

arrow git commit: ARROW-834: Python Support creating from iterables

2017-06-28 Thread wesm
// TODO(wesm): Error checking? - // TODO(wesm): Specialize for PyList_GET_ITEM? - OwnedRef item_ref(PySequence_GetItem(obj, i)); - PyObject* item = item_ref.obj(); - - if (PyList_Check(item)) { -RETURN_NOT_OK(Visit(item, level + 1)); - } else if (PyDict_C

arrow git commit: ARROW-1166: Fix errors in example and missing reference in Layout.md

2017-06-29 Thread wesm
Repository: arrow Updated Branches: refs/heads/master 69582528e -> af83c4519 ARROW-1166: Fix errors in example and missing reference in Layout.md Author: Fang Zheng Closes #795 from fangzheng/master and squashes the following commits: 4f9d8d8 [Fang Zheng] ARROW-1166: Fix errors in Struct ty

arrow git commit: ARROW-599: CMake support of LZ4 compression lib

2017-07-01 Thread wesm
Repository: arrow Updated Branches: refs/heads/master 9f500aff8 -> 456330f6d ARROW-599: CMake support of LZ4 compression lib Author: Max Risuhin Closes #799 from MaxRis/ARROW-599 and squashes the following commits: 2e905dae [Max Risuhin] ARROW-599: CMake support of LZ4 compression lib Pro

arrow git commit: ARROW-1169: [C++] jemalloc externalproject doesn't build with CMake's ninja generator

2017-07-01 Thread wesm
Repository: arrow Updated Branches: refs/heads/master 456330f6d -> 930db87d6 ARROW-1169: [C++] jemalloc externalproject doesn't build with CMake's ninja generator Closes #796 Change-Id: I3cbd06d774feca254183e0ed1b0e75111f7cb389 Project: http://git-wip-us.apache.org/repos/asf/arrow/repo Com

arrow git commit: ARROW-1125: partial schemas for Table.from_pandas

2017-07-01 Thread wesm
Repository: arrow Updated Branches: refs/heads/master 930db87d6 -> c294ec3db ARROW-1125: partial schemas for Table.from_pandas Author: fjetter Closes #790 from fjetter/ARROW-1125-partial-schemas and squashes the following commits: 0a58b708 [fjetter] Remove trailing whitespaces 87ccb0c4 [fj

arrow git commit: ARROW-960: Add section on how to develop with pip

2017-07-01 Thread wesm
87,6 +73,21 @@ You should now see drwxrwxr-x 12 wesm wesm 4096 Apr 15 19:19 arrow/ drwxrwxr-x 12 wesm wesm 4096 Apr 15 19:19 parquet-cpp/ +Using Conda +~~~ + +Let's create a conda environment with all the C++ build and Python dependencies +from conda-forge: + +.. code-block:: s

arrow git commit: ARROW-915: [Python] Struct Array reads limited support

2017-07-02 Thread wesm
Repository: arrow Updated Branches: refs/heads/master 96e7e9979 -> e268ce87e ARROW-915: [Python] Struct Array reads limited support Add limited struct array reading support in pyarrow. This is done to complement parquet-cpp struct reader. cc @wesm Author: Itai Incze Closes #615 f

arrow git commit: ARROW-1160: C++: Implement DictionaryBuilder

2017-07-02 Thread wesm
Repository: arrow Updated Branches: refs/heads/master e268ce87e -> 9e4906f7f ARROW-1160: C++: Implement DictionaryBuilder Author: Uwe L. Korn Closes #792 from xhochy/ARROW-1160 and squashes the following commits: cf59f3a1 [Uwe L. Korn] Add benchmarks 809cdc71 [Uwe L. Korn] Incorporate revie

arrow git commit: ARROW-1179: C++: Add missing virtual destructors

2017-07-03 Thread wesm
Repository: arrow Updated Branches: refs/heads/master 9e4906f7f -> 2e5ddfe7d ARROW-1179: C++: Add missing virtual destructors Author: Uwe L. Korn Closes #803 from xhochy/ARROW-1179 and squashes the following commits: 69f283f1 [Uwe L. Korn] Add another destructor ce71464e [Uwe L. Korn] Add v

arrow git commit: ARROW-692: Integration test data generator for dictionary types

2017-07-03 Thread wesm
his will help resolve the discrepancies Author: Wes McKinney Closes #800 from wesm/ARROW-692 and squashes the following commits: d04d0a60 [Wes McKinney] Disable dictionary case for now acd9ea4c [Wes McKinney] Start dictionary test cases from 0, since C++ does not preserve the ids through stream

arrow git commit: ARROW-1180: [GLib] Fix a returning invalid address bug in garrow_tensor_get_dimension_name()

2017-07-03 Thread wesm
Repository: arrow Updated Branches: refs/heads/master 2c3e8b09d -> a6d0c2654 ARROW-1180: [GLib] Fix a returning invalid address bug in garrow_tensor_get_dimension_name() See also: https://github.com/apache/arrow/pull/783#pullrequestreview-46377983 Author: Kouhei Sutou Closes #804 from kou/

arrow git commit: ARROW-1182: C++: Specify BUILD_BYPRODUCTS for zlib and zstd

2017-07-03 Thread wesm
Repository: arrow Updated Branches: refs/heads/master cdee23c27 -> 681479dc7 ARROW-1182: C++: Specify BUILD_BYPRODUCTS for zlib and zstd Change-Id: I7f4ce23ead7ab1b27741b80a382c0cd4d0019895 Author: Uwe L. Korn Closes #808 from xhochy/ARROW-1182 and squashes the following commits: 8dfe7b62

arrow git commit: ARROW-1098. [Format] modify document mistake

2017-07-04 Thread wesm
Repository: arrow Updated Branches: refs/heads/master 681479dc7 -> e5a08dd8f ARROW-1098. [Format] modify document mistake Author: LynnYuan Closes #811 from LynnYuanInspur/lynn-doc and squashes the following commits: b6ec6c05 [LynnYuan] ARROW-1098. [Format] modify document mistake Project:

arrow git commit: ARROW-966: [Python] Also accept Field instance in pyarrow.list_

2017-07-04 Thread wesm
Repository: arrow Updated Branches: refs/heads/master e5a08dd8f -> 7c18ddd4e ARROW-966: [Python] Also accept Field instance in pyarrow.list_ Author: Wes McKinney Closes #809 from wesm/ARROW-966 and squashes the following commits: a20f54dd [Wes McKinney] Also accept Field instance

arrow git commit: ARROW-1148: [C++] Raise minimum CMake version to 3.2

2017-07-04 Thread wesm
Repository: arrow Updated Branches: refs/heads/master 7c18ddd4e -> edcded3c6 ARROW-1148: [C++] Raise minimum CMake version to 3.2 Author: Wes McKinney Closes #805 from wesm/ARROW-1148 and squashes the following commits: db36f510 [Wes McKinney] Restore logic stripping -std=c++11 from cfl

arrow git commit: ARROW-1172: [C++] Refactor to use unique_ptr for builders

2017-07-04 Thread wesm
e a need to deal with atomic reference counts). I happened on this when looking at ARROW-1114 where there might be quite a bit of overhead dealing with `std::vector>` Author: Kouhei Sutou Author: Wes McKinney Closes #801 from wesm/builder-unique-ptr and squashes the following commits

arrow git commit: ARROW-693: [Java] Add dictionary support to JSON reader and writer

2017-07-04 Thread wesm
Repository: arrow Updated Branches: refs/heads/master cbbd04bfa -> 7d86c28e0 ARROW-693: [Java] Add dictionary support to JSON reader and writer Added support for Dictionary encoded vectors for reading and writing JSON. Also added validation to compare DictionaryEncodings and DictionaryBatche

arrow git commit: ARROW-1185: [C++] Status class cleanup, warn_unused_result attribute and Clang warning fixes

2017-07-05 Thread wesm
ied from standard use in Google projects. I simplified the implementation to bring it more in line with the Status implementation used in TensorFlow. This also addresses ARROW-111 by providing an attribute to warn in Clang if a Status is ignored Author: Wes McKinney Closes #814 from wesm/sta

arrow git commit: ARROW-462: [C++] Implement in-memory conversions between non-nested primitive types and DictionaryArray equivalent

2017-07-06 Thread wesm
Repository: arrow Updated Branches: refs/heads/master 83a4405ea -> c398fda75 ARROW-462: [C++] Implement in-memory conversions between non-nested primitive types and DictionaryArray equivalent Simple usage: ``` Array primitive_array; DictionaryBuilder builder; RETURN_NOT_OK(builder.AppendArra

arrow git commit: ARROW-1174: [GLib] Fix ListArray test failure

2017-07-07 Thread wesm
Repository: arrow Updated Branches: refs/heads/master c398fda75 -> 3309d1268 ARROW-1174: [GLib] Fix ListArray test failure Data passed into `Arrow::Buffer` isn't owned by `Arrow::Buffer`. It's GLib bindings spec for optimization. We should keep `Arrow::Buffer` data until `Arrow::Buffer` is al

arrow git commit: ARROW-1197: [GLib] Fix a bug that record batch related functions for C++ aren't included

2017-07-08 Thread wesm
Repository: arrow Updated Branches: refs/heads/master b6b876c52 -> e8945325e ARROW-1197: [GLib] Fix a bug that record batch related functions for C++ aren't included Author: Kouhei Sutou Closes #822 from kou/glib-fix-typo and squashes the following commits: 452dba8f [Kouhei Sutou] [GLib] F

arrow git commit: ARROW-1193: [C++] Support pkg-config for arrow_python.so

2017-07-08 Thread wesm
Repository: arrow Updated Branches: refs/heads/master 3309d1268 -> b6b876c52 ARROW-1193: [C++] Support pkg-config for arrow_python.so I want it to create a Ruby library that integrates Python via Apache Arrow object in the same process. [pycall](https://rubygems.org/gems/pycall) gem provides

<    5   6   7   8   9   10   11   12   13   14   >