Re: Iceberg table format

2018-01-04 Thread Ryan Blue
I've also created a google group for discussion: iceberg-de...@googlegroups.com You can join the group here: https://groups.google.com/forum/#!forum/iceberg-devel rb On Thu, Jan 4, 2018 at 11:03 AM, Ryan Blue wrote: > Just made it public a minute ago. The repo is here:

Re: Iceberg table format

2018-01-04 Thread Ryan Blue
Just made it public a minute ago. The repo is here: https://github.com/Netflix/iceberg It's built with gradle and requires a Spark 2.3.0-SNAPSHOT (for Datasource V2) and Parquet 1.9.1-SNAPSHOT (for API additions and bug fixes). An early version of the spec is available for comments here:

[jira] [Commented] (PARQUET-129) AvroParquetWriter can't save object who can have link to object of same type

2018-01-04 Thread Werner Daehn (JIRA)
[ https://issues.apache.org/jira/browse/PARQUET-129?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16311854#comment-16311854 ] Werner Daehn commented on PARQUET-129: -- LogicalType.how is that used to "break the circular

[jira] [Resolved] (PARQUET-1141) IDs are dropped in metadata conversion

2018-01-04 Thread Ryan Blue (JIRA)
[ https://issues.apache.org/jira/browse/PARQUET-1141?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ryan Blue resolved PARQUET-1141. Resolution: Fixed Fix Version/s: 1.9.1 Merged #428. > IDs are dropped in metadata

[jira] [Commented] (PARQUET-129) AvroParquetWriter can't save object who can have link to object of same type

2018-01-04 Thread Ryan Blue (JIRA)
[ https://issues.apache.org/jira/browse/PARQUET-129?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16311809#comment-16311809 ] Ryan Blue commented on PARQUET-129: --- [~wdaehn], if you'd like to pick this up and implement something

[jira] [Comment Edited] (PARQUET-129) AvroParquetWriter can't save object who can have link to object of same type

2018-01-04 Thread Werner Daehn (JIRA)
[ https://issues.apache.org/jira/browse/PARQUET-129?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16311732#comment-16311732 ] Werner Daehn edited comment on PARQUET-129 at 1/4/18 5:48 PM: -- Gee, I am

[jira] [Comment Edited] (PARQUET-129) AvroParquetWriter can't save object who can have link to object of same type

2018-01-04 Thread Werner Daehn (JIRA)
[ https://issues.apache.org/jira/browse/PARQUET-129?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16311732#comment-16311732 ] Werner Daehn edited comment on PARQUET-129 at 1/4/18 5:47 PM: -- Gee, I am

[jira] [Comment Edited] (PARQUET-129) AvroParquetWriter can't save object who can have link to object of same type

2018-01-04 Thread Werner Daehn (JIRA)
[ https://issues.apache.org/jira/browse/PARQUET-129?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16311732#comment-16311732 ] Werner Daehn edited comment on PARQUET-129 at 1/4/18 5:46 PM: -- Gee, I am

[jira] [Comment Edited] (PARQUET-129) AvroParquetWriter can't save object who can have link to object of same type

2018-01-04 Thread Werner Daehn (JIRA)
[ https://issues.apache.org/jira/browse/PARQUET-129?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16311732#comment-16311732 ] Werner Daehn edited comment on PARQUET-129 at 1/4/18 5:47 PM: -- Gee, I am

[jira] [Comment Edited] (PARQUET-129) AvroParquetWriter can't save object who can have link to object of same type

2018-01-04 Thread Werner Daehn (JIRA)
[ https://issues.apache.org/jira/browse/PARQUET-129?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16311732#comment-16311732 ] Werner Daehn edited comment on PARQUET-129 at 1/4/18 5:46 PM: -- Gee, I am

[jira] [Commented] (PARQUET-129) AvroParquetWriter can't save object who can have link to object of same type

2018-01-04 Thread Werner Daehn (JIRA)
[ https://issues.apache.org/jira/browse/PARQUET-129?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16311732#comment-16311732 ] Werner Daehn commented on PARQUET-129: -- Gee, I am hitting the same old issues. Feel like stalking

Re: Next parquet sync

2018-01-04 Thread Marcel Kornacker
My preference for next week would be Tuesday as well. On Thu, Jan 4, 2018 at 8:25 AM, Zoltan Ivanfi wrote: > Hi, > > According to the latest results of the availability poll, Tuesdays seems > to work for slightly more people than Wednesdays. I'll try to post the > chart

[jira] [Updated] (PARQUET-357) Parquet-thrift generates wrong schema for Thrift binary fields

2018-01-04 Thread Zoltan Ivanfi (JIRA)
[ https://issues.apache.org/jira/browse/PARQUET-357?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zoltan Ivanfi updated PARQUET-357: -- Fix Version/s: (was: cpp-1.5.0) > Parquet-thrift generates wrong schema for Thrift binary

Re: Next parquet sync

2018-01-04 Thread Zoltan Ivanfi
Hi, According to the latest results of the availability poll, Tuesdays seems to work for slightly more people than Wednesdays. I'll try to post the chart below, let's see whether the mailing list allows it or removes it: [image: pasted1] I would suggest to either use Tuesdays or alternate

[jira] [Created] (PARQUET-1184) Make DelegatingPositionOutputStream a concrete class

2018-01-04 Thread Werner Daehn (JIRA)
Werner Daehn created PARQUET-1184: - Summary: Make DelegatingPositionOutputStream a concrete class Key: PARQUET-1184 URL: https://issues.apache.org/jira/browse/PARQUET-1184 Project: Parquet

[jira] [Created] (PARQUET-1183) AvroParquetWriter needs OutputFile based Builder

2018-01-04 Thread Werner Daehn (JIRA)
Werner Daehn created PARQUET-1183: - Summary: AvroParquetWriter needs OutputFile based Builder Key: PARQUET-1183 URL: https://issues.apache.org/jira/browse/PARQUET-1183 Project: Parquet Issue

Re: Next parquet sync

2018-01-04 Thread Lars Volker
1/10 would work for me. On Thu, Jan 4, 2018 at 3:22 AM, Julien Le Dem wrote: > Any day of the week/time preference for the next Parquet sync? > It is usually held at 9am PT (5pm UTC) on a Wednesday. >

[jira] [Closed] (PARQUET-1182) Parquet-cpp version 1.3.1 not tagged in git repo

2018-01-04 Thread Ladislav Skokan (JIRA)
[ https://issues.apache.org/jira/browse/PARQUET-1182?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ladislav Skokan closed PARQUET-1182. ok, the tag is there. I had to use " git pull --tags" Thank you. > Parquet-cpp version 1.3.1