[jira] [Updated] (PARQUET-873) [C++] Reading metadata-only files (0 data rows) in parquet::arrow segfaults

2017-02-08 Thread Wes McKinney (JIRA)
[ https://issues.apache.org/jira/browse/PARQUET-873?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wes McKinney updated PARQUET-873: - Attachment: part-0-a3b5bd00-3dd7-4e40-952e-82b16c379195.snappy.parquet

[jira] [Created] (PARQUET-873) [C++] Reading metadata-only files (0 data rows) in parquet::arrow segfaults

2017-02-08 Thread Wes McKinney (JIRA)
Wes McKinney created PARQUET-873: Summary: [C++] Reading metadata-only files (0 data rows) in parquet::arrow segfaults Key: PARQUET-873 URL: https://issues.apache.org/jira/browse/PARQUET-873 Project:

Missing min/max statistics in file footer

2017-02-08 Thread Pradeep Gollakota
Hi folks, I generated a bunch of parquet files using spark and ParquetThriftOutputFormat. The thirft model has a column called "deviceId" which is a string column. It also has a "timestamp" column of int64. After the files have been generated, I inspected the file footers and noticed that only

[jira] [Commented] (PARQUET-872) [C++] Having any $CXXFLAGS set overrides $SNAPPY_CXXFLAGS

2017-02-08 Thread Wes McKinney (JIRA)
[ https://issues.apache.org/jira/browse/PARQUET-872?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15858892#comment-15858892 ] Wes McKinney commented on PARQUET-872: -- It seems like setting a {{$CXXFLAGS}} environment variable

[jira] [Commented] (PARQUET-872) [C++] Having any $CXXFLAGS set overrides $SNAPPY_CXXFLAGS

2017-02-08 Thread Wes McKinney (JIRA)
[ https://issues.apache.org/jira/browse/PARQUET-872?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15858623#comment-15858623 ] Wes McKinney commented on PARQUET-872: -- I spent a pretty good long time on this just now and am

[jira] [Created] (PARQUET-872) [C++] Having any $CXXFLAGS set overrides $SNAPPY_CXXFLAGS

2017-02-08 Thread Wes McKinney (JIRA)
Wes McKinney created PARQUET-872: Summary: [C++] Having any $CXXFLAGS set overrides $SNAPPY_CXXFLAGS Key: PARQUET-872 URL: https://issues.apache.org/jira/browse/PARQUET-872 Project: Parquet

Re: Unable to compile thrift

2017-02-08 Thread Pradeep Gollakota
After modifying the failing line to appropriately use reflection, the following command successfully built parquet-mr with thrift 0.9.3 LC_ALL=C mvn install -DskipTests -Dthrift.version=0.9.3 -Dsun.zip.disableMemoryMapping=true Not sure if I actually need the sun.zip.disableMemoryMapping

Re: Unable to compile thrift

2017-02-08 Thread Lars Volker
I remember trying to compile with the latest version of thrift shipped in Ubuntu 14.04 a few weeks back and got the same error. Using 0.7 worked though. Sadly I don't know why it fails on a Mac. On Feb 8, 2017 21:18, "Pradeep Gollakota" wrote: > I tried building with

Re: Unable to compile thrift

2017-02-08 Thread Pradeep Gollakota
I tried building with -Dthrift.version=0.9.3 and the build still failed with the following error: [ERROR] Failed to execute goal org.apache.maven.plugins:maven-compiler-plugin:3.1:compile (default-compile) on project parquet-thrift: Compilation failure [ERROR]

Re: Unable to compile thrift

2017-02-08 Thread Wes McKinney
hi Pradeep -- you can use Thrift 0.7 or higher (the instructions say "0.7+", perhaps we should call this out more explicitly). I recommend building Thrift 0.9.3 or 0.10 -- let us know if you have issues with these Thanks Wes On Wed, Feb 8, 2017 at 2:19 PM, Pradeep Gollakota

[jira] [Commented] (PARQUET-867) [C++] Support writing sliced Arrow arrays

2017-02-08 Thread Uwe L. Korn (JIRA)
[ https://issues.apache.org/jira/browse/PARQUET-867?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15858127#comment-15858127 ] Uwe L. Korn commented on PARQUET-867: - This is actually quite an important change as we can now get

FINAL REMINDER: CFP for ApacheCon closes February 11th

2017-02-08 Thread Rich Bowen
Dear Apache Enthusiast, This is your FINAL reminder that the Call for Papers (CFP) for ApacheCon Miami is closing this weekend - February 11th. This is your final opportunity to submit a talk for consideration at this event. This year, we are running several mini conferences in conjunction with

[jira] [Created] (PARQUET-870) ParquetFileWriter.appendFile does not close file handle - resource leak

2017-02-08 Thread George Smith (JIRA)
George Smith created PARQUET-870: Summary: ParquetFileWriter.appendFile does not close file handle - resource leak Key: PARQUET-870 URL: https://issues.apache.org/jira/browse/PARQUET-870 Project:

[jira] [Resolved] (PARQUET-868) C++: Build snappy with optimizations

2017-02-08 Thread Uwe L. Korn (JIRA)
[ https://issues.apache.org/jira/browse/PARQUET-868?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uwe L. Korn resolved PARQUET-868. - Resolution: Fixed Fix Version/s: cpp-1.0.0 Issue resolved by pull request 237