[jira] [Created] (PARQUET-879) C++: ExternalProject compilation for Thrift fails on older CMake versions

2017-02-14 Thread Uwe L. Korn (JIRA)
Uwe L. Korn created PARQUET-879: --- Summary: C++: ExternalProject compilation for Thrift fails on older CMake versions Key: PARQUET-879 URL: https://issues.apache.org/jira/browse/PARQUET-879 Project

[jira] [Resolved] (PARQUET-877) C++: Update Arrow Hash, update Version in metadata.

2017-02-14 Thread Uwe L. Korn (JIRA)
[ https://issues.apache.org/jira/browse/PARQUET-877?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uwe L. Korn resolved PARQUET-877. - Resolution: Fixed Fix Version/s: cpp-1.0.0 Issue resolved by pull request 243 [https

[jira] [Commented] (PARQUET-878) C++: Remove setup_build_env from rc-verification script

2017-02-14 Thread Uwe L. Korn (JIRA)
[ https://issues.apache.org/jira/browse/PARQUET-878?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15865467#comment-15865467 ] Uwe L. Korn commented on PARQUET-878: - PR: https://github.com/apache/parquet

[jira] [Created] (PARQUET-878) C++: Remove setup_build_env from rc-verification script

2017-02-14 Thread Uwe L. Korn (JIRA)
Uwe L. Korn created PARQUET-878: --- Summary: C++: Remove setup_build_env from rc-verification script Key: PARQUET-878 URL: https://issues.apache.org/jira/browse/PARQUET-878 Project: Parquet

[jira] [Commented] (PARQUET-877) C++: Update Arrow Hash, update Version in metadata.

2017-02-13 Thread Uwe L. Korn (JIRA)
[ https://issues.apache.org/jira/browse/PARQUET-877?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15864175#comment-15864175 ] Uwe L. Korn commented on PARQUET-877: - PR: https://github.com/apache/parquet

[jira] [Created] (PARQUET-877) C++: Update Arrow Hash, update Version in metadata.

2017-02-13 Thread Uwe L. Korn (JIRA)
Uwe L. Korn created PARQUET-877: --- Summary: C++: Update Arrow Hash, update Version in metadata. Key: PARQUET-877 URL: https://issues.apache.org/jira/browse/PARQUET-877 Project: Parquet Issue

[jira] [Commented] (PARQUET-876) C++: Correct snapshot version

2017-02-13 Thread Uwe L. Korn (JIRA)
[ https://issues.apache.org/jira/browse/PARQUET-876?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15864031#comment-15864031 ] Uwe L. Korn commented on PARQUET-876: - PR: https://github.com/apache/parquet

[jira] [Created] (PARQUET-876) C++: Correct snapshot version

2017-02-13 Thread Uwe L. Korn (JIRA)
Uwe L. Korn created PARQUET-876: --- Summary: C++: Correct snapshot version Key: PARQUET-876 URL: https://issues.apache.org/jira/browse/PARQUET-876 Project: Parquet Issue Type: Bug

[jira] [Commented] (PARQUET-873) [C++] Reading metadata-only files (0 data rows) in parquet::arrow segfaults

2017-02-12 Thread Uwe L. Korn (JIRA)
[ https://issues.apache.org/jira/browse/PARQUET-873?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15862737#comment-15862737 ] Uwe L. Korn commented on PARQUET-873: - Actual issue: https://issues.apache.org/

[jira] [Assigned] (PARQUET-873) [C++] Reading metadata-only files (0 data rows) in parquet::arrow segfaults

2017-02-12 Thread Uwe L. Korn (JIRA)
[ https://issues.apache.org/jira/browse/PARQUET-873?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uwe L. Korn reassigned PARQUET-873: --- Assignee: Uwe L. Korn > [C++] Reading metadata-only files (0 data rows) in parquet::ar

[jira] [Commented] (PARQUET-874) [C++] Use default memory allocator from Arrow

2017-02-11 Thread Uwe L. Korn (JIRA)
[ https://issues.apache.org/jira/browse/PARQUET-874?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15862351#comment-15862351 ] Uwe L. Korn commented on PARQUET-874: - PR: https://github.com/apache/parquet

[jira] [Assigned] (PARQUET-874) [C++] Use default memory allocator from Arrow

2017-02-11 Thread Uwe L. Korn (JIRA)
[ https://issues.apache.org/jira/browse/PARQUET-874?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uwe L. Korn reassigned PARQUET-874: --- Assignee: Uwe L. Korn > [C++] Use default memory allocator from Ar

[jira] [Commented] (PARQUET-875) [C++] Fix coveralls build given changes to thirdparty build procedure

2017-02-11 Thread Uwe L. Korn (JIRA)
[ https://issues.apache.org/jira/browse/PARQUET-875?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15862334#comment-15862334 ] Uwe L. Korn commented on PARQUET-875: - PR: https://github.com/apache/parquet

[jira] [Assigned] (PARQUET-875) [C++] Fix coveralls build given changes to thirdparty build procedure

2017-02-11 Thread Uwe L. Korn (JIRA)
[ https://issues.apache.org/jira/browse/PARQUET-875?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uwe L. Korn reassigned PARQUET-875: --- Assignee: Uwe L. Korn > [C++] Fix coveralls build given changes to thirdparty bu

[jira] [Commented] (PARQUET-678) Allow for custom compression codecs

2017-02-10 Thread Uwe L. Korn (JIRA)
[ https://issues.apache.org/jira/browse/PARQUET-678?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15860944#comment-15860944 ] Uwe L. Korn commented on PARQUET-678: - [~cotton] A patch would be very welcom

[jira] [Commented] (PARQUET-678) Allow for custom compression codecs

2017-02-10 Thread Uwe L. Korn (JIRA)
[ https://issues.apache.org/jira/browse/PARQUET-678?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15860940#comment-15860940 ] Uwe L. Korn commented on PARQUET-678: - Adding them to parquet-cpp and parquet-fo

[jira] [Commented] (PARQUET-871) [C++] Mechanism to avoid passing -Werror to thirdparty libraries

2017-02-09 Thread Uwe L. Korn (JIRA)
[ https://issues.apache.org/jira/browse/PARQUET-871?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15859224#comment-15859224 ] Uwe L. Korn commented on PARQUET-871: - Two possible solutions: * We introdu

[jira] [Commented] (PARQUET-872) [C++] Having any $CXXFLAGS set overrides $SNAPPY_CXXFLAGS

2017-02-09 Thread Uwe L. Korn (JIRA)
[ https://issues.apache.org/jira/browse/PARQUET-872?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15859222#comment-15859222 ] Uwe L. Korn commented on PARQUET-872: - I tend to close this as _won't fix

[jira] [Assigned] (PARQUET-867) [C++] Support writing sliced Arrow arrays

2017-02-08 Thread Uwe L. Korn (JIRA)
[ https://issues.apache.org/jira/browse/PARQUET-867?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uwe L. Korn reassigned PARQUET-867: --- Assignee: Uwe L. Korn > [C++] Support writing sliced Arrow arr

[jira] [Commented] (PARQUET-867) [C++] Support writing sliced Arrow arrays

2017-02-08 Thread Uwe L. Korn (JIRA)
[ https://issues.apache.org/jira/browse/PARQUET-867?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15858368#comment-15858368 ] Uwe L. Korn commented on PARQUET-867: - PR: https://github.com/apache/parquet

[jira] [Commented] (PARQUET-867) [C++] Support writing sliced Arrow arrays

2017-02-08 Thread Uwe L. Korn (JIRA)
[ https://issues.apache.org/jira/browse/PARQUET-867?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15858127#comment-15858127 ] Uwe L. Korn commented on PARQUET-867: - This is actually quite an important chang

[jira] [Resolved] (PARQUET-868) C++: Build snappy with optimizations

2017-02-08 Thread Uwe L. Korn (JIRA)
[ https://issues.apache.org/jira/browse/PARQUET-868?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uwe L. Korn resolved PARQUET-868. - Resolution: Fixed Fix Version/s: cpp-1.0.0 Issue resolved by pull request 237 [https

[jira] [Commented] (PARQUET-868) C++: Build snappy with optimizations

2017-02-07 Thread Uwe L. Korn (JIRA)
[ https://issues.apache.org/jira/browse/PARQUET-868?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15856132#comment-15856132 ] Uwe L. Korn commented on PARQUET-868: - PR: https://github.com/apache/parquet

[jira] [Created] (PARQUET-868) C++: Build snappy with optimizations

2017-02-07 Thread Uwe L. Korn (JIRA)
Uwe L. Korn created PARQUET-868: --- Summary: C++: Build snappy with optimizations Key: PARQUET-868 URL: https://issues.apache.org/jira/browse/PARQUET-868 Project: Parquet Issue Type: Improvement

[jira] [Commented] (PARQUET-867) [C++] Support writing sliced Arrow arrays

2017-02-07 Thread Uwe L. Korn (JIRA)
[ https://issues.apache.org/jira/browse/PARQUET-867?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15855636#comment-15855636 ] Uwe L. Korn commented on PARQUET-867: - [~wesmckinn] I can have a shot at

Re: Parquet files on s3

2017-02-07 Thread Uwe L. Korn
Hello Cary, actually this is a feature directly built-in to Apache Parquet. The format is designed so that you only need to read the data for the columns you need inside a single file, there is no need to spread them over multiple files. Parquet's metadata contains the needed pointers to the bytes

[jira] [Commented] (PARQUET-865) C++: Pass all CXXFLAGS to Thrift ExternalProject

2017-02-05 Thread Uwe L. Korn (JIRA)
[ https://issues.apache.org/jira/browse/PARQUET-865?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15853178#comment-15853178 ] Uwe L. Korn commented on PARQUET-865: - PR: https://github.com/apache/parquet

[jira] [Created] (PARQUET-865) C++: Pass all CXXFLAGS to Thrift ExternalProject

2017-02-05 Thread Uwe L. Korn (JIRA)
Uwe L. Korn created PARQUET-865: --- Summary: C++: Pass all CXXFLAGS to Thrift ExternalProject Key: PARQUET-865 URL: https://issues.apache.org/jira/browse/PARQUET-865 Project: Parquet Issue Type

[jira] [Commented] (PARQUET-861) Document INT96 timestamps

2017-02-03 Thread Uwe L. Korn (JIRA)
[ https://issues.apache.org/jira/browse/PARQUET-861?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15851906#comment-15851906 ] Uwe L. Korn commented on PARQUET-861: - PR: https://github.com/apache/parquet-fo

[jira] [Created] (PARQUET-861) Document INT96 timestamps

2017-02-03 Thread Uwe L. Korn (JIRA)
Uwe L. Korn created PARQUET-861: --- Summary: Document INT96 timestamps Key: PARQUET-861 URL: https://issues.apache.org/jira/browse/PARQUET-861 Project: Parquet Issue Type: Improvement

Re: Next parquet sync

2017-02-02 Thread Uwe L. Korn
o do Friday 2/3 at 10AM PT if possible. > > > > > > On Mon, Jan 30, 2017 at 12:34 PM, Ryan Blue > > > wrote: > > > > Both work for me. > > > > > > > > On Sun, Jan 29, 2017 at 11:38 PM, Uwe L. Korn > > wrote: > > > > &

[jira] [Commented] (PARQUET-834) C++: Support r/w of arrow::ListArray

2017-02-02 Thread Uwe L. Korn (JIRA)
[ https://issues.apache.org/jira/browse/PARQUET-834?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15849909#comment-15849909 ] Uwe L. Korn commented on PARQUET-834: - PR: https://github.com/apache/parquet

[jira] [Created] (PARQUET-855) C++: Run unit tests with AddressSanitizer

2017-02-01 Thread Uwe L. Korn (JIRA)
Uwe L. Korn created PARQUET-855: --- Summary: C++: Run unit tests with AddressSanitizer Key: PARQUET-855 URL: https://issues.apache.org/jira/browse/PARQUET-855 Project: Parquet Issue Type: Test

Re: Next parquet sync

2017-01-29 Thread Uwe L. Korn
Both dates are fine for me, too > Am 30.01.2017 um 04:15 schrieb Wes McKinney : > > Does Monday 2/6 work? We could also do this coming Friday 2/3 > >> On Sat, Jan 28, 2017 at 1:30 AM, Julien Le Dem wrote: >> Happy to move >> What day would work? >> Julien >> >>> On Jan 26, 2017, at 19:45, Wes

[jira] [Commented] (PARQUET-847) CMake try to compile libparquet with a static version of libthrift on Debian

2017-01-28 Thread Uwe L. Korn (JIRA)
[ https://issues.apache.org/jira/browse/PARQUET-847?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15844153#comment-15844153 ] Uwe L. Korn commented on PARQUET-847: - The system {{libthrift.a}} on Debia

[jira] [Commented] (PARQUET-713) parquet-cpp 1.0.0 release

2017-01-27 Thread Uwe L. Korn (JIRA)
[ https://issues.apache.org/jira/browse/PARQUET-713?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15842421#comment-15842421 ] Uwe L. Korn commented on PARQUET-713: - Added PARQUET-834 as a blocker as it

[jira] [Commented] (PARQUET-845) Efficient storage for several INT_8 and INT_16

2017-01-26 Thread Uwe L. Korn (JIRA)
[ https://issues.apache.org/jira/browse/PARQUET-845?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15839660#comment-15839660 ] Uwe L. Korn commented on PARQUET-845: - Storagewise it should not make a differ

[jira] [Resolved] (PARQUET-842) [C++] Impala rejects DOUBLE columns if decimal metadata is set

2017-01-24 Thread Uwe L. Korn (JIRA)
[ https://issues.apache.org/jira/browse/PARQUET-842?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uwe L. Korn resolved PARQUET-842. - Resolution: Fixed Fix Version/s: cpp-0.5.0 Issue resolved by pull request 226 [https

[jira] [Commented] (PARQUET-838) [CPP] Unable to read files written by parquet-cpp from parquet-tools

2017-01-24 Thread Uwe L. Korn (JIRA)
[ https://issues.apache.org/jira/browse/PARQUET-838?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15837291#comment-15837291 ] Uwe L. Korn commented on PARQUET-838: - This problem was recently on the ML

Re: [VOTE] Release Apache Parquet 1.8.2 RC1

2017-01-23 Thread Uwe L. Korn
RC seems fine except: * I still hit the failing test because of a locale problem (fixed in master). Switching to en_US helps. No blocker for the release. * Also triggering the maven-remote-resource-plugin issue. I've run the tests on OSX, not sure if that could be the difference. (Apache Maven

[jira] [Resolved] (PARQUET-837) [C++] SerializedFile::ParseMetaData uses Seek, followed by Read, and could have race conditions

2017-01-22 Thread Uwe L. Korn (JIRA)
[ https://issues.apache.org/jira/browse/PARQUET-837?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uwe L. Korn resolved PARQUET-837. - Resolution: Fixed Fix Version/s: cpp-0.1.0 Issue resolved by pull request 221 [https

[jira] [Commented] (PARQUET-691) [C++] Write ColumnChunk metadata after each column chunk in the file

2017-01-21 Thread Uwe L. Korn (JIRA)
[ https://issues.apache.org/jira/browse/PARQUET-691?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15833064#comment-15833064 ] Uwe L. Korn commented on PARQUET-691: - Is this really meant to be after

[jira] [Commented] (PARQUET-833) C++: Provide API to write spaced arrays (e.g. Arrow)

2017-01-21 Thread Uwe L. Korn (JIRA)
[ https://issues.apache.org/jira/browse/PARQUET-833?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15833054#comment-15833054 ] Uwe L. Korn commented on PARQUET-833: - PR: https://github.com/apache/parquet

[jira] [Created] (PARQUET-834) C++: Support r/w of arrow::ListArray

2017-01-18 Thread Uwe L. Korn (JIRA)
Uwe L. Korn created PARQUET-834: --- Summary: C++: Support r/w of arrow::ListArray Key: PARQUET-834 URL: https://issues.apache.org/jira/browse/PARQUET-834 Project: Parquet Issue Type: New Feature

[jira] [Created] (PARQUET-833) C++: Provide API to write spaced arrays (e.g. Arrow)

2017-01-18 Thread Uwe L. Korn (JIRA)
Uwe L. Korn created PARQUET-833: --- Summary: C++: Provide API to write spaced arrays (e.g. Arrow) Key: PARQUET-833 URL: https://issues.apache.org/jira/browse/PARQUET-833 Project: Parquet Issue

Re: [PARQUET_CPP] Why does the arrow reader in parquet does an extra copy?

2017-01-17 Thread Uwe L. Korn
Hi Keith, just a small heads up: the pull request for the read path is merged, I'm currently looking into removing all those copies in the write as well. Cheers Uwe On Fri, Jan 13, 2017, at 02:20 AM, Keith Chapman wrote: > Cool, Thanks for the update Wes. I was wondering if there was some deign

[jira] [Resolved] (PARQUET-817) [C++] Perform Parquet reads and Arrow deserialization concurrently

2017-01-12 Thread Uwe L. Korn (JIRA)
[ https://issues.apache.org/jira/browse/PARQUET-817?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uwe L. Korn resolved PARQUET-817. - Closing this as directly reading into the Arrow layout is much faster. We should still think of

[jira] [Commented] (PARQUET-820) C++: Decoders should directly emit arrays with spacing for null entries

2017-01-12 Thread Uwe L. Korn (JIRA)
[ https://issues.apache.org/jira/browse/PARQUET-820?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15820443#comment-15820443 ] Uwe L. Korn commented on PARQUET-820: - PR: https://github.com/apache/parquet

[jira] [Resolved] (PARQUET-830) [C++] Add additional configuration options to parquet::arrow::OpenFIle

2017-01-11 Thread Uwe L. Korn (JIRA)
[ https://issues.apache.org/jira/browse/PARQUET-830?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uwe L. Korn resolved PARQUET-830. - Resolution: Fixed Fix Version/s: cpp-0.1.0 Issue resolved by pull request 219 [https

[jira] [Commented] (PARQUET-829) C++: Make use of ARROW-469

2017-01-10 Thread Uwe L. Korn (JIRA)
[ https://issues.apache.org/jira/browse/PARQUET-829?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15815064#comment-15815064 ] Uwe L. Korn commented on PARQUET-829: - PR: https://github.com/apache/parquet

[jira] [Created] (PARQUET-829) C++: Make use of ARROW-469

2017-01-10 Thread Uwe L. Korn (JIRA)
Uwe L. Korn created PARQUET-829: --- Summary: C++: Make use of ARROW-469 Key: PARQUET-829 URL: https://issues.apache.org/jira/browse/PARQUET-829 Project: Parquet Issue Type: Improvement

[jira] [Resolved] (PARQUET-828) [C++] "version" field set improperly in file metadata

2017-01-09 Thread Uwe L. Korn (JIRA)
[ https://issues.apache.org/jira/browse/PARQUET-828?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uwe L. Korn resolved PARQUET-828. - Resolution: Fixed Fix Version/s: cpp-0.1.0 Issue resolved by https://github.com/apache

[jira] [Resolved] (PARQUET-823) [C++] Update coveralls exclusions from code coverage reports

2017-01-04 Thread Uwe L. Korn (JIRA)
[ https://issues.apache.org/jira/browse/PARQUET-823?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uwe L. Korn resolved PARQUET-823. - Resolution: Duplicate > [C++] Update coveralls exclusions from code coverage repo

[jira] [Commented] (PARQUET-735) [CPP] Newer bit packing segfaults with batch_size > 128 in Release mode build

2017-01-03 Thread Uwe L. Korn (JIRA)
[ https://issues.apache.org/jira/browse/PARQUET-735?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15797498#comment-15797498 ] Uwe L. Korn commented on PARQUET-735: - No, I tried to reproduce it but it n

[jira] [Commented] (PARQUET-821) [C++] zlib download link is broken

2017-01-02 Thread Uwe L. Korn (JIRA)
[ https://issues.apache.org/jira/browse/PARQUET-821?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15794384#comment-15794384 ] Uwe L. Korn commented on PARQUET-821: - PR: https://github.com/apache/parquet

[jira] [Updated] (PARQUET-820) C++: Decoders should directly emit arrays with spacing for null entries

2016-12-30 Thread Uwe L. Korn (JIRA)
[ https://issues.apache.org/jira/browse/PARQUET-820?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uwe L. Korn updated PARQUET-820: Description: Currently the decoders all emit the data arrays in the form of the PLAIN encoding

[jira] [Created] (PARQUET-820) C++: Decoders should directly emit arrays with spacing for null entries

2016-12-30 Thread Uwe L. Korn (JIRA)
Uwe L. Korn created PARQUET-820: --- Summary: C++: Decoders should directly emit arrays with spacing for null entries Key: PARQUET-820 URL: https://issues.apache.org/jira/browse/PARQUET-820 Project

[jira] [Updated] (PARQUET-820) C++: Decoders should directly emit arrays with spacing for null entries

2016-12-30 Thread Uwe L. Korn (JIRA)
[ https://issues.apache.org/jira/browse/PARQUET-820?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uwe L. Korn updated PARQUET-820: Issue Type: Improvement (was: Bug) > C++: Decoders should directly emit arrays with spacing

[jira] [Commented] (PARQUET-819) C++: Trying to install non-existing parquet/arrow/utils.h

2016-12-30 Thread Uwe L. Korn (JIRA)
[ https://issues.apache.org/jira/browse/PARQUET-819?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15787992#comment-15787992 ] Uwe L. Korn commented on PARQUET-819: - PR: https://github.com/apache/parquet

[jira] [Created] (PARQUET-819) C++: Trying to install non-existing parquet/arrow/utils.h

2016-12-30 Thread Uwe L. Korn (JIRA)
Uwe L. Korn created PARQUET-819: --- Summary: C++: Trying to install non-existing parquet/arrow/utils.h Key: PARQUET-819 URL: https://issues.apache.org/jira/browse/PARQUET-819 Project: Parquet

[jira] [Commented] (PARQUET-806) Parquet-tools silently suppresses error messages

2016-12-30 Thread Uwe L. Korn (JIRA)
[ https://issues.apache.org/jira/browse/PARQUET-806?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15787976#comment-15787976 ] Uwe L. Korn commented on PARQUET-806: - PR: https://github.com/apache/parquet-mr/

[jira] [Updated] (PARQUET-806) Parquet-tools silently suppresses error messages

2016-12-30 Thread Uwe L. Korn (JIRA)
[ https://issues.apache.org/jira/browse/PARQUET-806?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uwe L. Korn updated PARQUET-806: Component/s: parquet-mr > Parquet-tools silently suppresses error messa

Re: IO and memory management in parquet-cpp and Arrow (C++)

2016-12-28 Thread Uwe L. Korn
Given that I/O implementations in Arrow would also benefit (from) other file formats such as Feather and the memory management of Arrow will see great improvements I don't see a need that parquet-cpp should have its own abstractions. Cheers Uwe -- Uwe L. Korn uw...@xhochy.com On Fri, De

[jira] [Commented] (PARQUET-814) C++: Remove Conda recipes

2016-12-21 Thread Uwe L. Korn (JIRA)
[ https://issues.apache.org/jira/browse/PARQUET-814?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15768296#comment-15768296 ] Uwe L. Korn commented on PARQUET-814: - PR: https://github.com/apache/parquet

[jira] [Created] (PARQUET-814) C++: Remove Conda recipes

2016-12-21 Thread Uwe L. Korn (JIRA)
Uwe L. Korn created PARQUET-814: --- Summary: C++: Remove Conda recipes Key: PARQUET-814 URL: https://issues.apache.org/jira/browse/PARQUET-814 Project: Parquet Issue Type: Task

[jira] [Commented] (PARQUET-813) C++: Build dependencies using CMake External project

2016-12-21 Thread Uwe L. Korn (JIRA)
[ https://issues.apache.org/jira/browse/PARQUET-813?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15768282#comment-15768282 ] Uwe L. Korn commented on PARQUET-813: - PR: https://github.com/apache/parquet

[jira] [Created] (PARQUET-813) C++: Build dependencies using CMake External project

2016-12-21 Thread Uwe L. Korn (JIRA)
Uwe L. Korn created PARQUET-813: --- Summary: C++: Build dependencies using CMake External project Key: PARQUET-813 URL: https://issues.apache.org/jira/browse/PARQUET-813 Project: Parquet Issue

[jira] [Updated] (PARQUET-812) [C++] Failure reading BYTE_ARRAY data from file in parquet-compatibility project

2016-12-21 Thread Uwe L. Korn (JIRA)
[ https://issues.apache.org/jira/browse/PARQUET-812?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uwe L. Korn updated PARQUET-812: Assignee: Wes McKinney > [C++] Failure reading BYTE_ARRAY data from file in parquet-compatibil

[jira] [Resolved] (PARQUET-812) [C++] Failure reading BYTE_ARRAY data from file in parquet-compatibility project

2016-12-21 Thread Uwe L. Korn (JIRA)
[ https://issues.apache.org/jira/browse/PARQUET-812?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uwe L. Korn resolved PARQUET-812. - Resolution: Fixed Fix Version/s: cpp-0.1.0 Issue resolved by pull request 206 [https

[jira] [Commented] (PARQUET-812) [C++] Failure reading BYTE_ARRAY data from file in parquet-compatibility project

2016-12-20 Thread Uwe L. Korn (JIRA)
[ https://issues.apache.org/jira/browse/PARQUET-812?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15764894#comment-15764894 ] Uwe L. Korn commented on PARQUET-812: - Oh, I see. What I mentioned in my commen

[jira] [Commented] (PARQUET-812) [C++] Failure reading BYTE_ARRAY data from file in parquet-compatibility project

2016-12-20 Thread Uwe L. Korn (JIRA)
[ https://issues.apache.org/jira/browse/PARQUET-812?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15764799#comment-15764799 ] Uwe L. Korn commented on PARQUET-812: - The mentioned commit did not introduce

[jira] [Commented] (PARQUET-805) C++: Read Int96 into Arrow Timestamp(ns)

2016-12-19 Thread Uwe L. Korn (JIRA)
[ https://issues.apache.org/jira/browse/PARQUET-805?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15762259#comment-15762259 ] Uwe L. Korn commented on PARQUET-805: - PR: https://github.com/apache/parquet

[jira] [Created] (PARQUET-805) C++: Read Int96 into Arrow Timestamp(ns)

2016-12-18 Thread Uwe L. Korn (JIRA)
Uwe L. Korn created PARQUET-805: --- Summary: C++: Read Int96 into Arrow Timestamp(ns) Key: PARQUET-805 URL: https://issues.apache.org/jira/browse/PARQUET-805 Project: Parquet Issue Type: New

[jira] [Resolved] (PARQUET-797) [C++] Update for API changes in ARROW-418

2016-12-13 Thread Uwe L. Korn (JIRA)
[ https://issues.apache.org/jira/browse/PARQUET-797?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uwe L. Korn resolved PARQUET-797. - Resolution: Fixed Fix Version/s: cpp-0.1.0 Issue resolved by pull request 202 [https

[jira] [Commented] (PARQUET-798) usage of THRIFT_HOME in build?

2016-12-12 Thread Uwe L. Korn (JIRA)
[ https://issues.apache.org/jira/browse/PARQUET-798?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15744274#comment-15744274 ] Uwe L. Korn commented on PARQUET-798: - {{THRIFT_HOME}} should tell the CMake w

[jira] [Resolved] (PARQUET-767) Add release scripts for parquet-cpp

2016-12-10 Thread Uwe L. Korn (JIRA)
[ https://issues.apache.org/jira/browse/PARQUET-767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uwe L. Korn resolved PARQUET-767. - Resolution: Fixed Issue resolved by pull request 199 [https://github.com/apache/parquet-cpp/pull

[jira] [Commented] (PARQUET-792) Skip the storage of repetition level and definition level for all-null column

2016-12-08 Thread Uwe L. Korn (JIRA)
[ https://issues.apache.org/jira/browse/PARQUET-792?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15732903#comment-15732903 ] Uwe L. Korn commented on PARQUET-792: - The main problem for you that causes

[jira] [Commented] (PARQUET-792) Skip the storage of repetition level and definition level for all-null column

2016-12-06 Thread Uwe L. Korn (JIRA)
[ https://issues.apache.org/jira/browse/PARQUET-792?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15725264#comment-15725264 ] Uwe L. Korn commented on PARQUET-792: - Repetition and definition levels should

[jira] [Commented] (PARQUET-767) Add release scripts for parquet-cpp

2016-12-03 Thread Uwe L. Korn (JIRA)
[ https://issues.apache.org/jira/browse/PARQUET-767?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15717781#comment-15717781 ] Uwe L. Korn commented on PARQUET-767: - PR: https://github.com/apache/parquet

[jira] [Commented] (PARQUET-785) C++: List conversion for Arrow Schemas

2016-12-01 Thread Uwe L. Korn (JIRA)
[ https://issues.apache.org/jira/browse/PARQUET-785?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15712948#comment-15712948 ] Uwe L. Korn commented on PARQUET-785: - PR: https://github.com/apache/parquet

[jira] [Created] (PARQUET-785) C++: List conversion for Arrow Schemas

2016-12-01 Thread Uwe L. Korn (JIRA)
Uwe L. Korn created PARQUET-785: --- Summary: C++: List conversion for Arrow Schemas Key: PARQUET-785 URL: https://issues.apache.org/jira/browse/PARQUET-785 Project: Parquet Issue Type: New

[jira] [Commented] (PARQUET-784) C++: Reference Spark, Kudu and FrameOfReference in LICENSE

2016-11-30 Thread Uwe L. Korn (JIRA)
[ https://issues.apache.org/jira/browse/PARQUET-784?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15709962#comment-15709962 ] Uwe L. Korn commented on PARQUET-784: - PR: https://github.com/apache/parquet

[jira] [Created] (PARQUET-784) C++: Reference Spark, Kudu and FrameOfReference in LICENSE

2016-11-30 Thread Uwe L. Korn (JIRA)
Uwe L. Korn created PARQUET-784: --- Summary: C++: Reference Spark, Kudu and FrameOfReference in LICENSE Key: PARQUET-784 URL: https://issues.apache.org/jira/browse/PARQUET-784 Project: Parquet

[jira] [Updated] (PARQUET-508) Add ParquetFilePrinter

2016-11-30 Thread Uwe L. Korn (JIRA)
[ https://issues.apache.org/jira/browse/PARQUET-508?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uwe L. Korn updated PARQUET-508: Fix Version/s: (was: cpp-0.1) > Add ParquetFilePrin

[jira] [Updated] (PARQUET-664) parquet_writer

2016-11-30 Thread Uwe L. Korn (JIRA)
[ https://issues.apache.org/jira/browse/PARQUET-664?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uwe L. Korn updated PARQUET-664: Fix Version/s: (was: cpp-0.1) > parquet_writer > -- > >

[jira] [Commented] (PARQUET-782) C++: Support writing to Arrow sinks

2016-11-24 Thread Uwe L. Korn (JIRA)
[ https://issues.apache.org/jira/browse/PARQUET-782?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15694948#comment-15694948 ] Uwe L. Korn commented on PARQUET-782: - PR: https://github.com/apache/parquet

[jira] [Created] (PARQUET-782) C++: Support writing to Arrow sinks

2016-11-24 Thread Uwe L. Korn (JIRA)
Uwe L. Korn created PARQUET-782: --- Summary: C++: Support writing to Arrow sinks Key: PARQUET-782 URL: https://issues.apache.org/jira/browse/PARQUET-782 Project: Parquet Issue Type: New Feature

[jira] [Commented] (PARQUET-780) WriterBatch API does not properly handle NULL values for byte array types

2016-11-23 Thread Uwe L. Korn (JIRA)
[ https://issues.apache.org/jira/browse/PARQUET-780?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15689315#comment-15689315 ] Uwe L. Korn commented on PARQUET-780: - You could add a DCHECK in {{parquet-cpp

[jira] [Commented] (PARQUET-769) C++: Add support for Brotli Compression

2016-11-21 Thread Uwe L. Korn (JIRA)
[ https://issues.apache.org/jira/browse/PARQUET-769?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15684160#comment-15684160 ] Uwe L. Korn commented on PARQUET-769: - PR: https://github.com/apache/parquet

[jira] [Resolved] (PARQUET-778) Standardize the schema output to match the parquet-mr format

2016-11-18 Thread Uwe L. Korn (JIRA)
[ https://issues.apache.org/jira/browse/PARQUET-778?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uwe L. Korn resolved PARQUET-778. - Resolution: Fixed Fix Version/s: cpp-0.1 Issue resolved by pull request 192 [https

[jira] [Resolved] (PARQUET-702) Add a writer + reader example with detailed comments

2016-11-15 Thread Uwe L. Korn (JIRA)
[ https://issues.apache.org/jira/browse/PARQUET-702?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uwe L. Korn resolved PARQUET-702. - Resolution: Fixed > Add a writer + reader example with detailed comme

[jira] [Commented] (PARQUET-775) C++: TrackingAllocator is not thread-safe

2016-11-09 Thread Uwe L. Korn (JIRA)
[ https://issues.apache.org/jira/browse/PARQUET-775?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15652025#comment-15652025 ] Uwe L. Korn commented on PARQUET-775: - PR: https://github.com/apache/parquet

[jira] [Assigned] (PARQUET-775) C++: TrackingAllocator is not thread-safe

2016-11-09 Thread Uwe L. Korn (JIRA)
[ https://issues.apache.org/jira/browse/PARQUET-775?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uwe L. Korn reassigned PARQUET-775: --- Assignee: Uwe L. Korn > C++: TrackingAllocator is not thread-s

[jira] [Created] (PARQUET-776) C++: Clear out license issues

2016-11-09 Thread Uwe L. Korn (JIRA)
Uwe L. Korn created PARQUET-776: --- Summary: C++: Clear out license issues Key: PARQUET-776 URL: https://issues.apache.org/jira/browse/PARQUET-776 Project: Parquet Issue Type: Improvement

[jira] [Created] (PARQUET-775) C++: TrackingAllocator is not thread-safe

2016-11-09 Thread Uwe L. Korn (JIRA)
Uwe L. Korn created PARQUET-775: --- Summary: C++: TrackingAllocator is not thread-safe Key: PARQUET-775 URL: https://issues.apache.org/jira/browse/PARQUET-775 Project: Parquet Issue Type: Bug

[jira] [Updated] (PARQUET-775) C++: TrackingAllocator is not thread-safe

2016-11-09 Thread Uwe L. Korn (JIRA)
[ https://issues.apache.org/jira/browse/PARQUET-775?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uwe L. Korn updated PARQUET-775: Component/s: parquet-cpp > C++: TrackingAllocator is not thread-s

[jira] [Commented] (PARQUET-773) C++: Check licenses with RAT in CI

2016-11-09 Thread Uwe L. Korn (JIRA)
[ https://issues.apache.org/jira/browse/PARQUET-773?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15650193#comment-15650193 ] Uwe L. Korn commented on PARQUET-773: - PR: https://github.com/apache/parquet

[jira] [Resolved] (PARQUET-774) Release parquet-cpp 0.1

2016-11-08 Thread Uwe L. Korn (JIRA)
[ https://issues.apache.org/jira/browse/PARQUET-774?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uwe L. Korn resolved PARQUET-774. - Resolution: Duplicate We already have https://issues.apache.org/jira/browse/PARQUET-713

[jira] [Created] (PARQUET-773) C++: Check licenses with RAT in CI

2016-11-08 Thread Uwe L. Korn (JIRA)
Uwe L. Korn created PARQUET-773: --- Summary: C++: Check licenses with RAT in CI Key: PARQUET-773 URL: https://issues.apache.org/jira/browse/PARQUET-773 Project: Parquet Issue Type: Improvement

[jira] [Commented] (PARQUET-771) C++: Sync KEYS file

2016-11-07 Thread Uwe L. Korn (JIRA)
[ https://issues.apache.org/jira/browse/PARQUET-771?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15644795#comment-15644795 ] Uwe L. Korn commented on PARQUET-771: - PR: https://github.com/apache/parquet

<    1   2   3   4   5   6   7   8   >