[GitHub] [parquet-mr] hailuand closed pull request #909: PARQUET-2051: AvroWriteSupport Doesn't Pass Configuration to AvroSchemaConverter During Init

2021-05-17 Thread GitBox
hailuand closed pull request #909: URL: https://github.com/apache/parquet-mr/pull/909 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service,

[jira] [Commented] (PARQUET-2046) Upgrade Apache POM to 23

2021-05-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/PARQUET-2046?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17346364#comment-17346364 ] ASF GitHub Bot commented on PARQUET-2046: - gszadovszky merged pull request #904: URL:

[GitHub] [parquet-mr] sunchao commented on pull request #908: PARQUET-2050: Expose repetition & definition level from ColumnIO

2021-05-17 Thread GitBox
sunchao commented on pull request #908: URL: https://github.com/apache/parquet-mr/pull/908#issuecomment-842516557 Thanks for the review @gszadovszky . Added. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

[jira] [Commented] (PARQUET-2050) Expose repetition & definition level from ColumnIO

2021-05-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/PARQUET-2050?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17346310#comment-17346310 ] ASF GitHub Bot commented on PARQUET-2050: - sunchao commented on pull request #908: URL:

[jira] [Commented] (PARQUET-2051) AvroWriteSupport does not pass Configuration to AvroSchemaConverter on Creation

2021-05-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/PARQUET-2051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17346350#comment-17346350 ] ASF GitHub Bot commented on PARQUET-2051: - hailuand commented on pull request #909: URL:

[jira] [Commented] (PARQUET-2050) Expose repetition & definition level from ColumnIO

2021-05-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/PARQUET-2050?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17346343#comment-17346343 ] ASF GitHub Bot commented on PARQUET-2050: - sunchao commented on pull request #908: URL:

[GitHub] [parquet-mr] gszadovszky merged pull request #904: PARQUET-2046: Upgrade Apache POM to 23

2021-05-17 Thread GitBox
gszadovszky merged pull request #904: URL: https://github.com/apache/parquet-mr/pull/904 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service,

[jira] [Commented] (PARQUET-2051) AvroWriteSupport does not pass Configuration to AvroSchemaConverter on Creation

2021-05-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/PARQUET-2051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17346365#comment-17346365 ] ASF GitHub Bot commented on PARQUET-2051: - gszadovszky commented on pull request #909: URL:

[GitHub] [parquet-mr] gszadovszky commented on pull request #909: PARQUET-2051: AvroWriteSupport Doesn't Pass Configuration to AvroSchemaConverter During Init

2021-05-17 Thread GitBox
gszadovszky commented on pull request #909: URL: https://github.com/apache/parquet-mr/pull/909#issuecomment-842349819 @hailuand, why have you closed this? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above

[GitHub] [parquet-mr] gszadovszky merged pull request #906: PARQUET-2048: Deprecate BaseRecordReader

2021-05-17 Thread GitBox
gszadovszky merged pull request #906: URL: https://github.com/apache/parquet-mr/pull/906 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service,

[jira] [Commented] (PARQUET-2048) Deprecate BaseRecordReader

2021-05-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/PARQUET-2048?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17346340#comment-17346340 ] ASF GitHub Bot commented on PARQUET-2048: - gszadovszky merged pull request #906: URL:

[GitHub] [parquet-mr] sunchao commented on pull request #908: PARQUET-2050: Expose repetition & definition level from ColumnIO

2021-05-17 Thread GitBox
sunchao commented on pull request #908: URL: https://github.com/apache/parquet-mr/pull/908#issuecomment-842516557 Thanks for the review @gszadovszky . Added. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

[GitHub] [parquet-mr] hailuand commented on pull request #909: PARQUET-2051: AvroWriteSupport Doesn't Pass Configuration to AvroSchemaConverter During Init

2021-05-17 Thread GitBox
hailuand commented on pull request #909: URL: https://github.com/apache/parquet-mr/pull/909#issuecomment-842351895 @gszadovszky Hi Gabor, I will be re-opening this soon. I need to complete some procedures/certifications with my employer first. -- This is an automated message from the

[GitHub] [parquet-mr] shangxinli commented on pull request #908: PARQUET-2050: Expose repetition & definition level from ColumnIO

2021-05-17 Thread GitBox
shangxinli commented on pull request #908: URL: https://github.com/apache/parquet-mr/pull/908#issuecomment-841845640 @gszadovszky Is there any concern from you? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the

[jira] [Commented] (PARQUET-2050) Expose repetition & definition level from ColumnIO

2021-05-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/PARQUET-2050?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17346353#comment-17346353 ] ASF GitHub Bot commented on PARQUET-2050: - shangxinli commented on pull request #908: URL:

[jira] [Commented] (PARQUET-2051) AvroWriteSupport does not pass Configuration to AvroSchemaConverter on Creation

2021-05-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/PARQUET-2051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17346369#comment-17346369 ] ASF GitHub Bot commented on PARQUET-2051: - hailuand opened a new pull request #909: URL:

[GitHub] [parquet-mr] advancedxy commented on pull request #902: PARQUET-1633 Fix integer overflow

2021-05-17 Thread GitBox
advancedxy commented on pull request #902: URL: https://github.com/apache/parquet-mr/pull/902#issuecomment-841937603 > @advancedxy, thanks for explaining. > I think, the best option is 2. It is up to the user to provide enough resources for handling the large row groups or not writing

[jira] [Commented] (PARQUET-1633) Integer overflow in ParquetFileReader.ConsecutiveChunkList

2021-05-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/PARQUET-1633?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17346373#comment-17346373 ] ASF GitHub Bot commented on PARQUET-1633: - advancedxy commented on pull request #902: URL:

[jira] [Assigned] (PARQUET-2051) AvroWriteSupport does not pass Configuration to AvroSchemaConverter on Creation

2021-05-17 Thread Gabor Szadovszky (Jira)
[ https://issues.apache.org/jira/browse/PARQUET-2051?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Szadovszky reassigned PARQUET-2051: - Assignee: Andreas Hailu > AvroWriteSupport does not pass Configuration to

[jira] [Commented] (PARQUET-2051) AvroWriteSupport does not pass Configuration to AvroSchemaConverter on Creation

2021-05-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/PARQUET-2051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17346186#comment-17346186 ] ASF GitHub Bot commented on PARQUET-2051: - gszadovszky commented on pull request #909: URL:

[GitHub] [parquet-mr] gszadovszky commented on pull request #909: PARQUET-2051: AvroWriteSupport Doesn't Pass Configuration to AvroSchemaConverter During Init

2021-05-17 Thread GitBox
gszadovszky commented on pull request #909: URL: https://github.com/apache/parquet-mr/pull/909#issuecomment-842349819 @hailuand, why have you closed this? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above

[GitHub] [parquet-mr] gszadovszky merged pull request #906: PARQUET-2048: Deprecate BaseRecordReader

2021-05-17 Thread GitBox
gszadovszky merged pull request #906: URL: https://github.com/apache/parquet-mr/pull/906 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service,

[GitHub] [parquet-mr] gszadovszky merged pull request #904: PARQUET-2046: Upgrade Apache POM to 23

2021-05-17 Thread GitBox
gszadovszky merged pull request #904: URL: https://github.com/apache/parquet-mr/pull/904 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service,

[GitHub] [parquet-mr] hailuand commented on pull request #909: PARQUET-2051: AvroWriteSupport Doesn't Pass Configuration to AvroSchemaConverter During Init

2021-05-17 Thread GitBox
hailuand commented on pull request #909: URL: https://github.com/apache/parquet-mr/pull/909#issuecomment-842351895 @gszadovszky Hi Gabor, I will be re-opening this soon. I need to complete some procedures/certifications with my employer first. -- This is an automated message from the

[jira] [Resolved] (PARQUET-2048) Deprecate BaseRecordReader

2021-05-17 Thread Gabor Szadovszky (Jira)
[ https://issues.apache.org/jira/browse/PARQUET-2048?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Szadovszky resolved PARQUET-2048. --- Resolution: Fixed > Deprecate BaseRecordReader > -- > >

[jira] [Commented] (PARQUET-2048) Deprecate BaseRecordReader

2021-05-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/PARQUET-2048?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17346007#comment-17346007 ] ASF GitHub Bot commented on PARQUET-2048: - gszadovszky merged pull request #906: URL:

[GitHub] [parquet-mr] hailuand closed pull request #909: PARQUET-2051: AvroWriteSupport Doesn't Pass Configuration to AvroSchemaConverter During Init

2021-05-17 Thread GitBox
hailuand closed pull request #909: URL: https://github.com/apache/parquet-mr/pull/909 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service,

[jira] [Commented] (PARQUET-2051) AvroWriteSupport does not pass Configuration to AvroSchemaConverter on Creation

2021-05-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/PARQUET-2051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17346162#comment-17346162 ] ASF GitHub Bot commented on PARQUET-2051: - hailuand closed pull request #909: URL:

[jira] [Commented] (PARQUET-2051) AvroWriteSupport does not pass Configuration to AvroSchemaConverter on Creation

2021-05-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/PARQUET-2051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17346188#comment-17346188 ] ASF GitHub Bot commented on PARQUET-2051: - hailuand commented on pull request #909: URL:

[jira] [Resolved] (PARQUET-2046) Upgrade Apache POM to 23

2021-05-17 Thread Gabor Szadovszky (Jira)
[ https://issues.apache.org/jira/browse/PARQUET-2046?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Szadovszky resolved PARQUET-2046. --- Resolution: Fixed > Upgrade Apache POM to 23 > > >

[jira] [Commented] (PARQUET-2046) Upgrade Apache POM to 23

2021-05-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/PARQUET-2046?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17346011#comment-17346011 ] ASF GitHub Bot commented on PARQUET-2046: - gszadovszky merged pull request #904: URL:

[jira] [Commented] (PARQUET-1761) Lower Logging Level in ParquetOutputFormat

2021-05-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/PARQUET-1761?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17346382#comment-17346382 ] ASF GitHub Bot commented on PARQUET-1761: - belugabehr commented on pull request #745: URL:

[GitHub] [parquet-mr] belugabehr commented on pull request #745: PARQUET-1761: Lower Logging Level in ParquetOutputFormat

2021-05-17 Thread GitBox
belugabehr commented on pull request #745: URL: https://github.com/apache/parquet-mr/pull/745#issuecomment-842552941 @gszadovszky Let us start with the current change and we can re-visit later if this is still too verbose. -- This is an automated message from the Apache Git Service. To

Treatment of field_id through transformation

2021-05-17 Thread Weston Pace
Hi dev, I'm Weston, I've been working on the Arrow project lately. As the Arrow project implements more transformations of data I've been wondering how we should treat the field_id property. For some concrete examples: * Filtering a table by column (it seems the field_id should remain