[jira] [Created] (PARQUET-2263) Upgrade maven-shade-plugin to 3.4.1

2023-04-03 Thread Yuming Wang (Jira)
Yuming Wang created PARQUET-2263: Summary: Upgrade maven-shade-plugin to 3.4.1 Key: PARQUET-2263 URL: https://issues.apache.org/jira/browse/PARQUET-2263 Project: Parquet Issue Type: Improveme

[jira] [Resolved] (PARQUET-1355) Improvement Binary write performance

2022-10-27 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/PARQUET-1355?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang resolved PARQUET-1355. -- Resolution: Won't Fix > Improvement Binary write performance > --

[jira] [Created] (PARQUET-2192) Add Java 17 build test to GitHub action

2022-09-16 Thread Yuming Wang (Jira)
Yuming Wang created PARQUET-2192: Summary: Add Java 17 build test to GitHub action Key: PARQUET-2192 URL: https://issues.apache.org/jira/browse/PARQUET-2192 Project: Parquet Issue Type: Test

[jira] [Created] (PARQUET-2191) Upgrade Scala to 2.12.17

2022-09-15 Thread Yuming Wang (Jira)
Yuming Wang created PARQUET-2191: Summary: Upgrade Scala to 2.12.17 Key: PARQUET-2191 URL: https://issues.apache.org/jira/browse/PARQUET-2191 Project: Parquet Issue Type: Improvement Affe

[jira] [Commented] (PARQUET-1203) Corrupted parquet file from Spark

2021-12-03 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/PARQUET-1203?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17453288#comment-17453288 ] Yuming Wang commented on PARQUET-1203: -- It may be caused by hardware issue. You ca

[jira] [Commented] (PARQUET-1805) Refactor the configuration for bloom filters

2021-02-03 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/PARQUET-1805?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17277848#comment-17277848 ] Yuming Wang commented on PARQUET-1805: -- Thank you [~gszadovszky]   No issue for no

[jira] [Commented] (PARQUET-41) Add bloom filters to parquet statistics

2021-02-01 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/PARQUET-41?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17276854#comment-17276854 ] Yuming Wang commented on PARQUET-41: [~nchammas] You can check the related configurat

[jira] [Commented] (PARQUET-1969) Test by GithubAction

2021-02-01 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/PARQUET-1969?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17276833#comment-17276833 ] Yuming Wang commented on PARQUET-1969: -- Travis has been broken for several days. I

[jira] [Created] (PARQUET-1969) Test by GithubAction

2021-02-01 Thread Yuming Wang (Jira)
Yuming Wang created PARQUET-1969: Summary: Test by GithubAction Key: PARQUET-1969 URL: https://issues.apache.org/jira/browse/PARQUET-1969 Project: Parquet Issue Type: Improvement Co

[jira] [Created] (PARQUET-1968) FilterApi support In predicate

2021-02-01 Thread Yuming Wang (Jira)
Yuming Wang created PARQUET-1968: Summary: FilterApi support In predicate Key: PARQUET-1968 URL: https://issues.apache.org/jira/browse/PARQUET-1968 Project: Parquet Issue Type: Improvement

[jira] [Commented] (PARQUET-1805) Refactor the configuration for bloom filters

2021-02-01 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/PARQUET-1805?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17276312#comment-17276312 ] Yuming Wang commented on PARQUET-1805: -- Thank you [~gszadovszky] [~junjie] This is

[jira] [Commented] (PARQUET-1805) Refactor the configuration for bloom filters

2021-01-30 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/PARQUET-1805?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17275608#comment-17275608 ] Yuming Wang commented on PARQUET-1805: -- It seems that the previous configuration i

[jira] [Resolved] (PARQUET-1739) Make Spark SQL support Column indexes

2021-01-29 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/PARQUET-1739?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang resolved PARQUET-1739. -- Fix Version/s: 1.11.1 Resolution: Fixed > Make Spark SQL support Column indexes >

[jira] [Comment Edited] (PARQUET-1746) Changed the data order after DataFrame reuse

2021-01-20 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/PARQUET-1746?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17268661#comment-17268661 ] Yuming Wang edited comment on PARQUET-1746 at 1/21/21, 12:54 AM:

[jira] [Commented] (PARQUET-1746) Changed the data order after DataFrame reuse

2021-01-20 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/PARQUET-1746?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17268957#comment-17268957 ] Yuming Wang commented on PARQUET-1746: -- We can disable parquet.page.write-checksum

[jira] [Commented] (PARQUET-1746) Changed the data order after DataFrame reuse

2021-01-20 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/PARQUET-1746?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17268661#comment-17268661 ] Yuming Wang commented on PARQUET-1746: -- https://github.com/apache/spark/pull/26804

[jira] [Created] (PARQUET-1964) Add null check for getFilteredRecordCount

2021-01-18 Thread Yuming Wang (Jira)
Yuming Wang created PARQUET-1964: Summary: Add null check for getFilteredRecordCount Key: PARQUET-1964 URL: https://issues.apache.org/jira/browse/PARQUET-1964 Project: Parquet Issue Type: Imp

[jira] [Created] (PARQUET-1952) Upgrade Avro to 1.10.1

2020-12-14 Thread Yuming Wang (Jira)
Yuming Wang created PARQUET-1952: Summary: Upgrade Avro to 1.10.1 Key: PARQUET-1952 URL: https://issues.apache.org/jira/browse/PARQUET-1952 Project: Parquet Issue Type: Improvement

[jira] [Commented] (PARQUET-1946) Parquet File not readable by Google big query (works with Spark)

2020-12-07 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/PARQUET-1946?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17245061#comment-17245061 ] Yuming Wang commented on PARQUET-1946: -- Could you try to disable {{parquet.filter.

[jira] [Commented] (PARQUET-1739) Make Spark SQL support Column indexes

2020-07-21 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/PARQUET-1739?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17162491#comment-17162491 ] Yuming Wang commented on PARQUET-1739: -- Please see https://github.com/apache/spark

[jira] [Commented] (PARQUET-1739) Make Spark SQL support Column indexes

2020-07-20 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/PARQUET-1739?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17161683#comment-17161683 ] Yuming Wang commented on PARQUET-1739: -- [~sha...@uber.com] We can not upgrade Parq

[jira] [Commented] (PARQUET-1739) Make Spark SQL support Column indexes

2020-04-12 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/PARQUET-1739?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17081827#comment-17081827 ] Yuming Wang commented on PARQUET-1739: -- [~gszadovszky]  I found that in some cases

[jira] [Commented] (PARQUET-1739) Make Spark SQL support Column indexes

2020-04-12 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/PARQUET-1739?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17081826#comment-17081826 ] Yuming Wang commented on PARQUET-1739: -- Spark benchmark result: |Case|Parquet 1.11

[jira] [Commented] (PARQUET-1745) No result for partition key included in Parquet file

2020-01-20 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/PARQUET-1745?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17019522#comment-17019522 ] Yuming Wang commented on PARQUET-1745: -- cc [~cloud_fan] > No result for partition

[jira] [Commented] (PARQUET-1746) Changed the data order after DataFrame reuse

2020-01-10 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/PARQUET-1746?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17013368#comment-17013368 ] Yuming Wang commented on PARQUET-1746: -- It seems {{1.12.0-SNAPSHOT}} works. > Cha

[jira] [Created] (PARQUET-1748) Update current release version in README.md

2020-01-10 Thread Yuming Wang (Jira)
Yuming Wang created PARQUET-1748: Summary: Update current release version in README.md Key: PARQUET-1748 URL: https://issues.apache.org/jira/browse/PARQUET-1748 Project: Parquet Issue Type: T

[jira] [Comment Edited] (PARQUET-1745) No result for partition key included in Parquet file

2020-01-10 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/PARQUET-1745?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17012674#comment-17012674 ] Yuming Wang edited comment on PARQUET-1745 at 1/10/20 10:36 AM: -

[jira] [Updated] (PARQUET-1745) No result for partition key included in Parquet file

2020-01-10 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/PARQUET-1745?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated PARQUET-1745: - Attachment: FilterByColumnIndex.png > No result for partition key included in Parquet file > --

[jira] [Updated] (PARQUET-1745) No result for partition key included in Parquet file

2020-01-10 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/PARQUET-1745?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated PARQUET-1745: - Attachment: (was: image-2020-01-10-18-35-06-129.png) > No result for partition key included

[jira] [Updated] (PARQUET-1745) No result for partition key included in Parquet file

2020-01-10 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/PARQUET-1745?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated PARQUET-1745: - Attachment: (was: image-2020-01-10-18-34-30-039.png) > No result for partition key included

[jira] [Comment Edited] (PARQUET-1745) No result for partition key included in Parquet file

2020-01-10 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/PARQUET-1745?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17012674#comment-17012674 ] Yuming Wang edited comment on PARQUET-1745 at 1/10/20 10:35 AM: -

[jira] [Updated] (PARQUET-1745) No result for partition key included in Parquet file

2020-01-10 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/PARQUET-1745?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated PARQUET-1745: - Attachment: (was: FilterByColumnIndex.png) > No result for partition key included in Parque

[jira] [Comment Edited] (PARQUET-1745) No result for partition key included in Parquet file

2020-01-10 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/PARQUET-1745?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17012674#comment-17012674 ] Yuming Wang edited comment on PARQUET-1745 at 1/10/20 10:21 AM: -

[jira] [Commented] (PARQUET-1745) No result for partition key included in Parquet file

2020-01-10 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/PARQUET-1745?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17012674#comment-17012674 ] Yuming Wang commented on PARQUET-1745: -- [ParquetPartitionDiscoverySuite.scala#L120

[jira] [Updated] (PARQUET-1745) No result for partition key included in Parquet file

2020-01-10 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/PARQUET-1745?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated PARQUET-1745: - Attachment: FilterByColumnIndex.png > No result for partition key included in Parquet file > --

[jira] [Updated] (PARQUET-1746) Changed the data order after DataFrame reuse

2020-01-08 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/PARQUET-1746?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated PARQUET-1746: - Summary: Changed the data order after DataFrame reuse (was: Change the order after DataFrame r

[jira] [Created] (PARQUET-1746) Change the order after DataFrame reuse

2020-01-08 Thread Yuming Wang (Jira)
Yuming Wang created PARQUET-1746: Summary: Change the order after DataFrame reuse Key: PARQUET-1746 URL: https://issues.apache.org/jira/browse/PARQUET-1746 Project: Parquet Issue Type: Sub-ta

[jira] [Created] (PARQUET-1745) No result for partition key included in Parquet file

2020-01-08 Thread Yuming Wang (Jira)
Yuming Wang created PARQUET-1745: Summary: No result for partition key included in Parquet file Key: PARQUET-1745 URL: https://issues.apache.org/jira/browse/PARQUET-1745 Project: Parquet Issu

[jira] [Updated] (PARQUET-1744) Some filters throws ArrayIndexOutOfBoundsException

2020-01-08 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/PARQUET-1744?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated PARQUET-1744: - Summary: Some filters throws ArrayIndexOutOfBoundsException (was: Some filter throws ArrayInde

[jira] [Updated] (PARQUET-1744) Some filter throws ArrayIndexOutOfBoundsException

2020-01-08 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/PARQUET-1744?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated PARQUET-1744: - Description: How to reproduce: * Build Spark {code:sh} git clone https://github.com/apache/spar

[jira] [Created] (PARQUET-1744) Some filter throws ArrayIndexOutOfBoundsException

2020-01-08 Thread Yuming Wang (Jira)
Yuming Wang created PARQUET-1744: Summary: Some filter throws ArrayIndexOutOfBoundsException Key: PARQUET-1744 URL: https://issues.apache.org/jira/browse/PARQUET-1744 Project: Parquet Issue T

[jira] [Updated] (PARQUET-1740) Make ParquetFileReader.getFilteredRecordCount public

2020-01-08 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/PARQUET-1740?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated PARQUET-1740: - Description: Please see   [https://github.com/apache/spark/pull/26804/commits/4756e67dddbbf891c4

[jira] [Updated] (PARQUET-1740) Make ParquetFileReader.getFilteredRecordCount public

2020-01-08 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/PARQUET-1740?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated PARQUET-1740: - Affects Version/s: 1.11.0 > Make ParquetFileReader.getFilteredRecordCount public >

[jira] [Updated] (PARQUET-1740) Make ParquetFileReader.getFilteredRecordCount public

2020-01-08 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/PARQUET-1740?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated PARQUET-1740: - Component/s: parquet-mr > Make ParquetFileReader.getFilteredRecordCount public > --

[jira] [Created] (PARQUET-1740) Make ParquetFileReader.getFilteredRecordCount public

2020-01-08 Thread Yuming Wang (Jira)
Yuming Wang created PARQUET-1740: Summary: Make ParquetFileReader.getFilteredRecordCount public Key: PARQUET-1740 URL: https://issues.apache.org/jira/browse/PARQUET-1740 Project: Parquet Issu

[jira] [Updated] (PARQUET-1739) Make Spark SQL support Column indexes

2020-01-08 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/PARQUET-1739?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated PARQUET-1739: - Description: Make Spark SQL support  > Make Spark SQL support Column indexes >

[jira] [Updated] (PARQUET-1739) Make Spark SQL support Column indexes

2020-01-08 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/PARQUET-1739?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated PARQUET-1739: - Description: Make Spark SQL support Column indexes. (was: Make Spark SQL support ) > Make Spa

[jira] [Created] (PARQUET-1739) Make Spark SQL support Column indexes

2020-01-08 Thread Yuming Wang (Jira)
Yuming Wang created PARQUET-1739: Summary: Make Spark SQL support Column indexes Key: PARQUET-1739 URL: https://issues.apache.org/jira/browse/PARQUET-1739 Project: Parquet Issue Type: Improve

[jira] [Commented] (PARQUET-1485) Snappy Decompressor/Compressor may cause direct memory leak

2019-11-11 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/PARQUET-1485?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16971409#comment-16971409 ] Yuming Wang commented on PARQUET-1485: -- Could we backport this patch for [parquet

[jira] [Commented] (PARQUET-1638) ParquetFileReader.readFooter and ParquetFileReader.readNextRowGroup may be hang

2019-08-15 Thread Yuming Wang (JIRA)
[ https://issues.apache.org/jira/browse/PARQUET-1638?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16908097#comment-16908097 ] Yuming Wang commented on PARQUET-1638: -- The issue fixed by HDFS-10223. > ParquetF

[jira] [Resolved] (PARQUET-1638) ParquetFileReader.readFooter and ParquetFileReader.readNextRowGroup may be hang

2019-08-15 Thread Yuming Wang (JIRA)
[ https://issues.apache.org/jira/browse/PARQUET-1638?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang resolved PARQUET-1638. -- Resolution: Invalid > ParquetFileReader.readFooter and ParquetFileReader.readNextRowGroup may

[jira] [Commented] (PARQUET-1638) ParquetFileReader.readFooter and ParquetFileReader.readNextRowGroup may be hang

2019-08-15 Thread Yuming Wang (JIRA)
[ https://issues.apache.org/jira/browse/PARQUET-1638?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16907898#comment-16907898 ] Yuming Wang commented on PARQUET-1638: -- cc [~rdblue] [~gszadovszky] > ParquetFile

[jira] [Updated] (PARQUET-1638) ParquetFileReader.readFooter and ParquetFileReader.readNextRowGroup may be hang

2019-08-15 Thread Yuming Wang (JIRA)
[ https://issues.apache.org/jira/browse/PARQUET-1638?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated PARQUET-1638: - Description: It's a Spark SQL application. These 3 tasks hang for more than 1.5 hours. !image-

[jira] [Updated] (PARQUET-1638) ParquetFileReader.readFooter and ParquetFileReader.readNextRowGroup may be hang

2019-08-15 Thread Yuming Wang (JIRA)
[ https://issues.apache.org/jira/browse/PARQUET-1638?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated PARQUET-1638: - Attachment: (was: image-2019-08-15-15-39-12-288.png) > ParquetFileReader.readFooter and Par

[jira] [Updated] (PARQUET-1638) ParquetFileReader.readFooter and ParquetFileReader.readNextRowGroup may be hang

2019-08-15 Thread Yuming Wang (JIRA)
[ https://issues.apache.org/jira/browse/PARQUET-1638?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated PARQUET-1638: - Attachment: (was: image-2019-08-15-15-43-56-529.png) > ParquetFileReader.readFooter and Par

[jira] [Updated] (PARQUET-1638) ParquetFileReader.readFooter may be hang

2019-08-15 Thread Yuming Wang (JIRA)
[ https://issues.apache.org/jira/browse/PARQUET-1638?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated PARQUET-1638: - Attachment: image-2019-08-15-15-43-56-529.png > ParquetFileReader.readFooter may be hang >

[jira] [Updated] (PARQUET-1638) ParquetFileReader.readFooter and ParquetFileReader.readNextRowGroup may be hang

2019-08-15 Thread Yuming Wang (JIRA)
[ https://issues.apache.org/jira/browse/PARQUET-1638?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated PARQUET-1638: - Summary: ParquetFileReader.readFooter and ParquetFileReader.readNextRowGroup may be hang (was:

[jira] [Updated] (PARQUET-1638) ParquetFileReader.readFooter may be hang

2019-08-15 Thread Yuming Wang (JIRA)
[ https://issues.apache.org/jira/browse/PARQUET-1638?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated PARQUET-1638: - Attachment: image-2019-08-15-15-43-56-912.png > ParquetFileReader.readFooter may be hang >

[jira] [Updated] (PARQUET-1638) ParquetFileReader.readFooter may be hang

2019-08-15 Thread Yuming Wang (JIRA)
[ https://issues.apache.org/jira/browse/PARQUET-1638?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated PARQUET-1638: - Description: !image-2019-08-15-15-38-47-898.png! !image-2019-08-15-15-43-56-912.png! !image-2

[jira] [Updated] (PARQUET-1638) ParquetFileReader.readFooter may be hang

2019-08-15 Thread Yuming Wang (JIRA)
[ https://issues.apache.org/jira/browse/PARQUET-1638?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated PARQUET-1638: - Description: !image-2019-08-15-15-38-47-898.png!   !image-2019-08-15-15-39-12-288.png! !imag

[jira] [Updated] (PARQUET-1638) ParquetFileReader.readFooter may be hang

2019-08-15 Thread Yuming Wang (JIRA)
[ https://issues.apache.org/jira/browse/PARQUET-1638?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated PARQUET-1638: - Attachment: image-2019-08-15-15-41-36-878.png > ParquetFileReader.readFooter may be hang >

[jira] [Created] (PARQUET-1638) ParquetFileReader.readFooter may be hang

2019-08-15 Thread Yuming Wang (JIRA)
Yuming Wang created PARQUET-1638: Summary: ParquetFileReader.readFooter may be hang Key: PARQUET-1638 URL: https://issues.apache.org/jira/browse/PARQUET-1638 Project: Parquet Issue Type: Bug

[jira] [Commented] (PARQUET-1488) UserDefinedPredicate throw NullPointerException

2019-07-15 Thread Yuming Wang (JIRA)
[ https://issues.apache.org/jira/browse/PARQUET-1488?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16885201#comment-16885201 ] Yuming Wang commented on PARQUET-1488: -- Thank you [~gszadovszky] Please work on th

[jira] [Commented] (PARQUET-1563) cannot read 'date' datatype which write by spark

2019-04-15 Thread Yuming Wang (JIRA)
[ https://issues.apache.org/jira/browse/PARQUET-1563?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16818693#comment-16818693 ] Yuming Wang commented on PARQUET-1563: -- It's not a bug. you need convert it to dat

[jira] [Commented] (PARQUET-1143) Update Java for format 2.4.0 changes

2019-04-10 Thread Yuming Wang (JIRA)
[ https://issues.apache.org/jira/browse/PARQUET-1143?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16814281#comment-16814281 ] Yuming Wang commented on PARQUET-1143: -- [~rdblue] Should we update the *Fix Versio

[jira] [Commented] (PARQUET-1488) UserDefinedPredicate throw NullPointerException

2019-01-09 Thread Yuming Wang (JIRA)
[ https://issues.apache.org/jira/browse/PARQUET-1488?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16738424#comment-16738424 ] Yuming Wang commented on PARQUET-1488: -- [~gszadovszky] Thanks a lot. > UserDefine

[jira] [Updated] (PARQUET-1488) UserDefinedPredicate throw NullPointerException

2019-01-08 Thread Yuming Wang (JIRA)
[ https://issues.apache.org/jira/browse/PARQUET-1488?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated PARQUET-1488: - Description: It throws {{NullPointerException}} after upgrade parquet to 1.11.0 when using {{U

[jira] [Commented] (PARQUET-1488) UserDefinedPredicate throw NullPointerException

2019-01-08 Thread Yuming Wang (JIRA)
[ https://issues.apache.org/jira/browse/PARQUET-1488?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16737790#comment-16737790 ] Yuming Wang commented on PARQUET-1488: -- cc [~gszadovszky] > UserDefinedPredicate

[jira] [Created] (PARQUET-1488) UserDefinedPredicate throw NullPointerException

2019-01-08 Thread Yuming Wang (JIRA)
Yuming Wang created PARQUET-1488: Summary: UserDefinedPredicate throw NullPointerException Key: PARQUET-1488 URL: https://issues.apache.org/jira/browse/PARQUET-1488 Project: Parquet Issue Typ

[jira] [Commented] (PARQUET-1434) Release parquet-mr 1.11.0

2018-12-12 Thread Yuming Wang (JIRA)
[ https://issues.apache.org/jira/browse/PARQUET-1434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16718664#comment-16718664 ] Yuming Wang commented on PARQUET-1434: -- It didn't pushed to maven repository? > R

[jira] [Comment Edited] (PARQUET-1434) Release parquet-mr 1.11.0

2018-12-12 Thread Yuming Wang (JIRA)
[ https://issues.apache.org/jira/browse/PARQUET-1434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16718664#comment-16718664 ] Yuming Wang edited comment on PARQUET-1434 at 12/12/18 9:16 AM: -

[jira] [Created] (PARQUET-1432) ACID support

2018-10-01 Thread Yuming Wang (JIRA)
Yuming Wang created PARQUET-1432: Summary: ACID support Key: PARQUET-1432 URL: https://issues.apache.org/jira/browse/PARQUET-1432 Project: Parquet Issue Type: New Feature Components

[jira] [Commented] (PARQUET-1359) Out of Memory when reading large parquet file

2018-07-26 Thread Yuming Wang (JIRA)
[ https://issues.apache.org/jira/browse/PARQUET-1359?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16559333#comment-16559333 ] Yuming Wang commented on PARQUET-1359: -- Is it duplicate to [PARQUET-980|https://i

[jira] [Updated] (PARQUET-1355) Improvement Binary write performance

2018-07-23 Thread Yuming Wang (JIRA)
[ https://issues.apache.org/jira/browse/PARQUET-1355?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated PARQUET-1355: - Description: *Benchmark code*: {code:java} test("Parquet write benchmark") { val count = 100

[jira] [Updated] (PARQUET-1355) Improvement Binary write performance

2018-07-23 Thread Yuming Wang (JIRA)
[ https://issues.apache.org/jira/browse/PARQUET-1355?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated PARQUET-1355: - Summary: Improvement Binary write performance (was: Improvement parquet Binary write performan

[jira] [Updated] (PARQUET-1355) Improvement parquet Binary write performance

2018-07-23 Thread Yuming Wang (JIRA)
[ https://issues.apache.org/jira/browse/PARQUET-1355?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated PARQUET-1355: - Description: *Benchmark code*: {code:java} test("Parquet write benchmark") { val count = 100

[jira] [Assigned] (PARQUET-1355) Improvement parquet Binary write performance

2018-07-23 Thread Yuming Wang (JIRA)
[ https://issues.apache.org/jira/browse/PARQUET-1355?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang reassigned PARQUET-1355: Assignee: Yuming Wang > Improvement parquet Binary write performance > -

[jira] [Created] (PARQUET-1355) Improvement parquet Binary write performance

2018-07-23 Thread Yuming Wang (JIRA)
Yuming Wang created PARQUET-1355: Summary: Improvement parquet Binary write performance Key: PARQUET-1355 URL: https://issues.apache.org/jira/browse/PARQUET-1355 Project: Parquet Issue Type:

[jira] [Resolved] (PARQUET-1338) PrimitiveType.equals throw NPE

2018-06-29 Thread Yuming Wang (JIRA)
[ https://issues.apache.org/jira/browse/PARQUET-1338?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang resolved PARQUET-1338. -- Resolution: Won't Fix > PrimitiveType.equals throw NPE > -- > >

[jira] [Created] (PARQUET-1338) PrimitiveType.equals throw NPE

2018-06-25 Thread Yuming Wang (JIRA)
Yuming Wang created PARQUET-1338: Summary: PrimitiveType.equals throw NPE Key: PARQUET-1338 URL: https://issues.apache.org/jira/browse/PARQUET-1338 Project: Parquet Issue Type: Bug

[jira] [Assigned] (PARQUET-1338) PrimitiveType.equals throw NPE

2018-06-25 Thread Yuming Wang (JIRA)
[ https://issues.apache.org/jira/browse/PARQUET-1338?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang reassigned PARQUET-1338: Assignee: Yuming Wang > PrimitiveType.equals throw NPE > --

[jira] [Updated] (PARQUET-1336) PrimitiveComparator should implements Serializable

2018-06-25 Thread Yuming Wang (JIRA)
[ https://issues.apache.org/jira/browse/PARQUET-1336?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated PARQUET-1336: - Summary: PrimitiveComparator should implements Serializable (was: BinaryComparator should imp

[jira] [Assigned] (PARQUET-1336) BinaryComparator should implements Serializable

2018-06-23 Thread Yuming Wang (JIRA)
[ https://issues.apache.org/jira/browse/PARQUET-1336?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang reassigned PARQUET-1336: Assignee: Yuming Wang > BinaryComparator should implements Serializable > -

[jira] [Updated] (PARQUET-1336) BinaryComparator should implements Serializable

2018-06-23 Thread Yuming Wang (JIRA)
[ https://issues.apache.org/jira/browse/PARQUET-1336?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated PARQUET-1336: - Description: {code:java} [info] Cause: java.lang.RuntimeException: java.io.NotSerializableExcep

[jira] [Created] (PARQUET-1336) BinaryComparator should implements Serializable

2018-06-23 Thread Yuming Wang (JIRA)
Yuming Wang created PARQUET-1336: Summary: BinaryComparator should implements Serializable Key: PARQUET-1336 URL: https://issues.apache.org/jira/browse/PARQUET-1336 Project: Parquet Issue Ty

[jira] [Commented] (PARQUET-1247) org.apache.parquet.column.values.dictionary.PlainValuesDictionary$PlainLongDictionary

2018-06-23 Thread Yuming Wang (JIRA)
[ https://issues.apache.org/jira/browse/PARQUET-1247?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16521311#comment-16521311 ] Yuming Wang commented on PARQUET-1247: -- How to reproduce? > org.apache.parquet.co

[jira] [Commented] (PARQUET-1248) java.lang.UnsupportedOperationException: Unimplemented type: StringType

2018-06-05 Thread Yuming Wang (JIRA)
[ https://issues.apache.org/jira/browse/PARQUET-1248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16502780#comment-16502780 ] Yuming Wang commented on PARQUET-1248: -- [~modi.shrutika], How to reproduce this is

[jira] [Commented] (PARQUET-1238) Invalid links found in parquet site document page

2018-06-05 Thread Yuming Wang (JIRA)
[ https://issues.apache.org/jira/browse/PARQUET-1238?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16502778#comment-16502778 ] Yuming Wang commented on PARQUET-1238: -- [~xuchuanyin],  Github repo: [https://gith

[jira] [Updated] (PARQUET-1317) ParquetMetadataConverter throw NPE

2018-06-04 Thread Yuming Wang (JIRA)
[ https://issues.apache.org/jira/browse/PARQUET-1317?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated PARQUET-1317: - Description: How to reproduce: {code:scala} $ bin/spark-shell scala> spark.range(10).selectEx

[jira] [Commented] (PARQUET-1317) ParquetMetadataConverter throw NPE

2018-06-03 Thread Yuming Wang (JIRA)
[ https://issues.apache.org/jira/browse/PARQUET-1317?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16499820#comment-16499820 ] Yuming Wang commented on PARQUET-1317: -- I'm working on this. > ParquetMetadataCon

[jira] [Created] (PARQUET-1317) ParquetMetadataConverter throw NPE

2018-06-03 Thread Yuming Wang (JIRA)
Yuming Wang created PARQUET-1317: Summary: ParquetMetadataConverter throw NPE Key: PARQUET-1317 URL: https://issues.apache.org/jira/browse/PARQUET-1317 Project: Parquet Issue Type: Bug Af