[jira] [Resolved] (PARQUET-2408) Fix license header in .gitattributes
[
https://issues.apache.org/jira/browse/PARQUET-2408?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Fokko Driesprong resolved PARQUET-2408.
---
Fix Version/s: 1.14.0
Resolution: Fixed
> Fix license header in .gitattributes
>
>
> Key: PARQUET-2408
> URL: https://issues.apache.org/jira/browse/PARQUET-2408
> Project: Parquet
> Issue Type: Bug
>Reporter: Gang Wu
>Assignee: Gang Wu
>Priority: Major
> Fix For: 1.14.0
>
>
> {code:java}
> ➜ parquet-mr git:(master) ✗ git status
> (ASF) is not a valid attribute name: .gitattributes:2
> License, is not a valid attribute name: .gitattributes:6
> "License"); is not a valid attribute name: .gitattributes:7
> http://www.apache.org/licenses/LICENSE-2.0 is not a valid attribute name:
> .gitattributes:10
> writing, is not a valid attribute name: .gitattributes:12
> "AS is not a valid attribute name: .gitattributes:14
> KIND, is not a valid attribute name: .gitattributes:15
> On branch master
> Your branch is up to date with 'origin/master'.
> {code}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
[jira] [Resolved] (PARQUET-2401) Synchronize on final fields
[ https://issues.apache.org/jira/browse/PARQUET-2401?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fokko Driesprong resolved PARQUET-2401. --- Assignee: Atour Mousavi Gourabi Resolution: Fixed > Synchronize on final fields > --- > > Key: PARQUET-2401 > URL: https://issues.apache.org/jira/browse/PARQUET-2401 > Project: Parquet > Issue Type: Improvement > Components: parquet-mr >Affects Versions: 1.13.1 >Reporter: Atour Mousavi Gourabi >Assignee: Atour Mousavi Gourabi >Priority: Minor > Fix For: 1.14.0 > > -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Resolved] (PARQUET-2393) Make `ColumnIOCreatorVisitor` static
[ https://issues.apache.org/jira/browse/PARQUET-2393?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fokko Driesprong resolved PARQUET-2393. --- Resolution: Fixed > Make `ColumnIOCreatorVisitor` static > > > Key: PARQUET-2393 > URL: https://issues.apache.org/jira/browse/PARQUET-2393 > Project: Parquet > Issue Type: Improvement >Affects Versions: 1.13.1 >Reporter: Fokko Driesprong >Assignee: Fokko Driesprong >Priority: Major > Fix For: 1.14.0 > > -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Resolved] (PARQUET-2392) Remove StringBuilder in `LogicalTypeAnnotation`
[ https://issues.apache.org/jira/browse/PARQUET-2392?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fokko Driesprong resolved PARQUET-2392. --- Resolution: Fixed > Remove StringBuilder in `LogicalTypeAnnotation` > --- > > Key: PARQUET-2392 > URL: https://issues.apache.org/jira/browse/PARQUET-2392 > Project: Parquet > Issue Type: Improvement >Affects Versions: 1.13.1 >Reporter: Fokko Driesprong >Assignee: Fokko Driesprong >Priority: Major > Fix For: 1.14.0 > > -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Resolved] (PARQUET-2394) Use `computeIfAbsent` in `MessageColumnIO`
[ https://issues.apache.org/jira/browse/PARQUET-2394?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fokko Driesprong resolved PARQUET-2394. --- Resolution: Fixed > Use `computeIfAbsent` in `MessageColumnIO` > -- > > Key: PARQUET-2394 > URL: https://issues.apache.org/jira/browse/PARQUET-2394 > Project: Parquet > Issue Type: Improvement >Affects Versions: 1.13.1 >Reporter: Fokko Driesprong >Assignee: Fokko Driesprong >Priority: Major > Fix For: 1.14.0 > > -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Resolved] (PARQUET-2395) Prefer `singletonList` over `asList`
[ https://issues.apache.org/jira/browse/PARQUET-2395?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fokko Driesprong resolved PARQUET-2395. --- Resolution: Fixed > Prefer `singletonList` over `asList` > > > Key: PARQUET-2395 > URL: https://issues.apache.org/jira/browse/PARQUET-2395 > Project: Parquet > Issue Type: Improvement >Affects Versions: 1.13.1 >Reporter: Fokko Driesprong >Assignee: Fokko Driesprong >Priority: Major > Fix For: 1.14.0 > > -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Resolved] (PARQUET-2396) Refactor `ColumnIndexBuilder`
[ https://issues.apache.org/jira/browse/PARQUET-2396?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fokko Driesprong resolved PARQUET-2396. --- Resolution: Fixed > Refactor `ColumnIndexBuilder` > - > > Key: PARQUET-2396 > URL: https://issues.apache.org/jira/browse/PARQUET-2396 > Project: Parquet > Issue Type: Improvement >Affects Versions: 1.13.1 >Reporter: Fokko Driesprong >Assignee: Fokko Driesprong >Priority: Major > Fix For: 1.14.0 > > -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Resolved] (PARQUET-2391) Remove unnecessary unboxing
[ https://issues.apache.org/jira/browse/PARQUET-2391?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fokko Driesprong resolved PARQUET-2391. --- Resolution: Fixed > Remove unnecessary unboxing > --- > > Key: PARQUET-2391 > URL: https://issues.apache.org/jira/browse/PARQUET-2391 > Project: Parquet > Issue Type: Improvement >Affects Versions: 1.13.1 >Reporter: Fokko Driesprong >Assignee: Fokko Driesprong >Priority: Major > Fix For: 1.14.0 > > -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Resolved] (PARQUET-2390) Replace anonymouse functions with lambda's
[ https://issues.apache.org/jira/browse/PARQUET-2390?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fokko Driesprong resolved PARQUET-2390. --- Resolution: Fixed > Replace anonymouse functions with lambda's > -- > > Key: PARQUET-2390 > URL: https://issues.apache.org/jira/browse/PARQUET-2390 > Project: Parquet > Issue Type: Improvement >Affects Versions: 1.13.1 >Reporter: Fokko Driesprong >Assignee: Fokko Driesprong >Priority: Major > Fix For: 1.14.0 > > -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Resolved] (PARQUET-2388) Deprecate `CHARSETS` on `PlainValuesWriter`
[ https://issues.apache.org/jira/browse/PARQUET-2388?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fokko Driesprong resolved PARQUET-2388. --- Resolution: Fixed > Deprecate `CHARSETS` on `PlainValuesWriter` > --- > > Key: PARQUET-2388 > URL: https://issues.apache.org/jira/browse/PARQUET-2388 > Project: Parquet > Issue Type: Improvement >Affects Versions: 1.13.1 >Reporter: Fokko Driesprong >Assignee: Fokko Driesprong >Priority: Major > Fix For: 1.14.0 > > -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Resolved] (PARQUET-2389) Remove redundant initializers
[ https://issues.apache.org/jira/browse/PARQUET-2389?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fokko Driesprong resolved PARQUET-2389. --- Resolution: Fixed > Remove redundant initializers > - > > Key: PARQUET-2389 > URL: https://issues.apache.org/jira/browse/PARQUET-2389 > Project: Parquet > Issue Type: Improvement >Affects Versions: 1.13.1 >Reporter: Fokko Driesprong >Assignee: Fokko Driesprong >Priority: Major > Fix For: 1.14.0 > > -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Resolved] (PARQUET-2387) Simplify `hasFieldsIgnored` expression
[ https://issues.apache.org/jira/browse/PARQUET-2387?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fokko Driesprong resolved PARQUET-2387. --- Resolution: Fixed > Simplify `hasFieldsIgnored` expression > -- > > Key: PARQUET-2387 > URL: https://issues.apache.org/jira/browse/PARQUET-2387 > Project: Parquet > Issue Type: Improvement > Components: parquet-thrift >Affects Versions: 1.13.1 >Reporter: Fokko Driesprong >Assignee: Fokko Driesprong >Priority: Major > Fix For: 1.14.0 > > -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Resolved] (PARQUET-2399) Use deprecated tag in Javadoc
[ https://issues.apache.org/jira/browse/PARQUET-2399?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fokko Driesprong resolved PARQUET-2399. --- Assignee: Atour Mousavi Gourabi Resolution: Fixed > Use deprecated tag in Javadoc > - > > Key: PARQUET-2399 > URL: https://issues.apache.org/jira/browse/PARQUET-2399 > Project: Parquet > Issue Type: Improvement >Affects Versions: 1.13.1 >Reporter: Atour Mousavi Gourabi >Assignee: Atour Mousavi Gourabi >Priority: Minor > Fix For: 1.14.0 > > > In some Javadoc, we use Deprecated: instead of the deprecated tag. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Updated] (PARQUET-2399) Use deprecated tag in Javadoc
[ https://issues.apache.org/jira/browse/PARQUET-2399?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fokko Driesprong updated PARQUET-2399: -- Affects Version/s: 1.13.1 > Use deprecated tag in Javadoc > - > > Key: PARQUET-2399 > URL: https://issues.apache.org/jira/browse/PARQUET-2399 > Project: Parquet > Issue Type: Improvement >Affects Versions: 1.13.1 >Reporter: Atour Mousavi Gourabi >Priority: Minor > > In some Javadoc, we use Deprecated: instead of the deprecated tag. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Updated] (PARQUET-2399) Use deprecated tag in Javadoc
[ https://issues.apache.org/jira/browse/PARQUET-2399?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fokko Driesprong updated PARQUET-2399: -- Fix Version/s: 1.14.0 > Use deprecated tag in Javadoc > - > > Key: PARQUET-2399 > URL: https://issues.apache.org/jira/browse/PARQUET-2399 > Project: Parquet > Issue Type: Improvement >Affects Versions: 1.13.1 >Reporter: Atour Mousavi Gourabi >Priority: Minor > Fix For: 1.14.0 > > > In some Javadoc, we use Deprecated: instead of the deprecated tag. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Updated] (PARQUET-2401) Synchronize on final fields
[ https://issues.apache.org/jira/browse/PARQUET-2401?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fokko Driesprong updated PARQUET-2401: -- Affects Version/s: 1.13.1 > Synchronize on final fields > --- > > Key: PARQUET-2401 > URL: https://issues.apache.org/jira/browse/PARQUET-2401 > Project: Parquet > Issue Type: Improvement > Components: parquet-mr >Affects Versions: 1.13.1 >Reporter: Atour Mousavi Gourabi >Priority: Minor > -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Updated] (PARQUET-2401) Synchronize on final fields
[ https://issues.apache.org/jira/browse/PARQUET-2401?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fokko Driesprong updated PARQUET-2401: -- Fix Version/s: 1.14.0 > Synchronize on final fields > --- > > Key: PARQUET-2401 > URL: https://issues.apache.org/jira/browse/PARQUET-2401 > Project: Parquet > Issue Type: Improvement > Components: parquet-mr >Affects Versions: 1.13.1 >Reporter: Atour Mousavi Gourabi >Priority: Minor > Fix For: 1.14.0 > > -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (PARQUET-2398) Make static variables final
Fokko Driesprong created PARQUET-2398: - Summary: Make static variables final Key: PARQUET-2398 URL: https://issues.apache.org/jira/browse/PARQUET-2398 Project: Parquet Issue Type: Improvement Affects Versions: 1.13.1 Reporter: Fokko Driesprong Assignee: Fokko Driesprong Fix For: 1.14.0 -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Resolved] (PARQUET-2397) Make use of `isEmpty`
[ https://issues.apache.org/jira/browse/PARQUET-2397?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fokko Driesprong resolved PARQUET-2397. --- Resolution: Fixed > Make use of `isEmpty` > - > > Key: PARQUET-2397 > URL: https://issues.apache.org/jira/browse/PARQUET-2397 > Project: Parquet > Issue Type: Improvement >Affects Versions: 1.13.1 >Reporter: Fokko Driesprong >Assignee: Fokko Driesprong >Priority: Major > Fix For: 1.14.0 > > -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (PARQUET-2397) Make use of `isEmpty`
Fokko Driesprong created PARQUET-2397: - Summary: Make use of `isEmpty` Key: PARQUET-2397 URL: https://issues.apache.org/jira/browse/PARQUET-2397 Project: Parquet Issue Type: Improvement Affects Versions: 1.13.1 Reporter: Fokko Driesprong Assignee: Fokko Driesprong Fix For: 1.14.0 -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (PARQUET-2396) Refactor `ColumnIndexBuilder`
Fokko Driesprong created PARQUET-2396: - Summary: Refactor `ColumnIndexBuilder` Key: PARQUET-2396 URL: https://issues.apache.org/jira/browse/PARQUET-2396 Project: Parquet Issue Type: Improvement Affects Versions: 1.13.1 Reporter: Fokko Driesprong Assignee: Fokko Driesprong Fix For: 1.14.0 -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (PARQUET-2395) Prefer `singletonList`
Fokko Driesprong created PARQUET-2395: - Summary: Prefer `singletonList` Key: PARQUET-2395 URL: https://issues.apache.org/jira/browse/PARQUET-2395 Project: Parquet Issue Type: Improvement Affects Versions: 1.13.1 Reporter: Fokko Driesprong Assignee: Fokko Driesprong Fix For: 1.14.0 -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Updated] (PARQUET-2395) Prefer `singletonList` over `asList`
[ https://issues.apache.org/jira/browse/PARQUET-2395?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fokko Driesprong updated PARQUET-2395: -- Summary: Prefer `singletonList` over `asList` (was: Prefer `singletonList`) > Prefer `singletonList` over `asList` > > > Key: PARQUET-2395 > URL: https://issues.apache.org/jira/browse/PARQUET-2395 > Project: Parquet > Issue Type: Improvement >Affects Versions: 1.13.1 >Reporter: Fokko Driesprong >Assignee: Fokko Driesprong >Priority: Major > Fix For: 1.14.0 > > -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (PARQUET-2394) Use `computeIfAbsent` in `MessageColumnIO`
Fokko Driesprong created PARQUET-2394: - Summary: Use `computeIfAbsent` in `MessageColumnIO` Key: PARQUET-2394 URL: https://issues.apache.org/jira/browse/PARQUET-2394 Project: Parquet Issue Type: Improvement Affects Versions: 1.13.1 Reporter: Fokko Driesprong Assignee: Fokko Driesprong Fix For: 1.14.0 -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (PARQUET-2393) Make `ColumnIOCreatorVisitor` static
Fokko Driesprong created PARQUET-2393: - Summary: Make `ColumnIOCreatorVisitor` static Key: PARQUET-2393 URL: https://issues.apache.org/jira/browse/PARQUET-2393 Project: Parquet Issue Type: Improvement Affects Versions: 1.13.1 Reporter: Fokko Driesprong Assignee: Fokko Driesprong Fix For: 1.14.0 -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (PARQUET-2392) Remove StringBuilder in `LogicalTypeAnnotation`
Fokko Driesprong created PARQUET-2392: - Summary: Remove StringBuilder in `LogicalTypeAnnotation` Key: PARQUET-2392 URL: https://issues.apache.org/jira/browse/PARQUET-2392 Project: Parquet Issue Type: Improvement Affects Versions: 1.13.1 Reporter: Fokko Driesprong Assignee: Fokko Driesprong Fix For: 1.14.0 -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (PARQUET-2391) Remove unnecessary unboxing
Fokko Driesprong created PARQUET-2391: - Summary: Remove unnecessary unboxing Key: PARQUET-2391 URL: https://issues.apache.org/jira/browse/PARQUET-2391 Project: Parquet Issue Type: Improvement Affects Versions: 1.13.1 Reporter: Fokko Driesprong Assignee: Fokko Driesprong Fix For: 1.14.0 -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (PARQUET-2390) Replace anonymouse functions with lambda's
Fokko Driesprong created PARQUET-2390: - Summary: Replace anonymouse functions with lambda's Key: PARQUET-2390 URL: https://issues.apache.org/jira/browse/PARQUET-2390 Project: Parquet Issue Type: Improvement Affects Versions: 1.13.1 Reporter: Fokko Driesprong Assignee: Fokko Driesprong Fix For: 1.14.0 -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (PARQUET-2389) Remove redundant initializers
Fokko Driesprong created PARQUET-2389: - Summary: Remove redundant initializers Key: PARQUET-2389 URL: https://issues.apache.org/jira/browse/PARQUET-2389 Project: Parquet Issue Type: Improvement Affects Versions: 1.13.1 Reporter: Fokko Driesprong Assignee: Fokko Driesprong Fix For: 1.14.0 -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (PARQUET-2388) Deprecate `CHARSETS` on `PlainValuesWriter`
Fokko Driesprong created PARQUET-2388: - Summary: Deprecate `CHARSETS` on `PlainValuesWriter` Key: PARQUET-2388 URL: https://issues.apache.org/jira/browse/PARQUET-2388 Project: Parquet Issue Type: Improvement Affects Versions: 1.13.1 Reporter: Fokko Driesprong Assignee: Fokko Driesprong Fix For: 1.14.0 -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (PARQUET-2387) Simplify `hasFieldsIgnored` expression
Fokko Driesprong created PARQUET-2387: - Summary: Simplify `hasFieldsIgnored` expression Key: PARQUET-2387 URL: https://issues.apache.org/jira/browse/PARQUET-2387 Project: Parquet Issue Type: Improvement Components: parquet-thrift Affects Versions: 1.13.1 Reporter: Fokko Driesprong Assignee: Fokko Driesprong Fix For: 1.14.0 -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Resolved] (PARQUET-2296) Bump easymock from 3.4 to 5.1.0
[ https://issues.apache.org/jira/browse/PARQUET-2296?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fokko Driesprong resolved PARQUET-2296. --- Resolution: Fixed > Bump easymock from 3.4 to 5.1.0 > --- > > Key: PARQUET-2296 > URL: https://issues.apache.org/jira/browse/PARQUET-2296 > Project: Parquet > Issue Type: Improvement > Components: parquet-mr >Affects Versions: 1.13.0 >Reporter: Fokko Driesprong >Assignee: Fokko Driesprong >Priority: Major > Fix For: 1.14.0 > > -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Resolved] (PARQUET-2300) Update jackson-core 2.13.4 to a version without CVE PRISMA-2023-0067
[
https://issues.apache.org/jira/browse/PARQUET-2300?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Fokko Driesprong resolved PARQUET-2300.
---
Assignee: Gang Wu
Resolution: Fixed
> Update jackson-core 2.13.4 to a version without CVE PRISMA-2023-0067
>
>
> Key: PARQUET-2300
> URL: https://issues.apache.org/jira/browse/PARQUET-2300
> Project: Parquet
> Issue Type: Bug
> Components: parquet-mr
>Affects Versions: 1.13.0
>Reporter: Gianluca Vagnoni
>Assignee: Gang Wu
>Priority: Major
> Fix For: 1.14.0
>
>
> The library "{*}parquet-jackson{*}" version 1.13.0 and 1.13.1 contains the
> vulnerability PRISMA-2023-0067
> ([https://github.com/FasterXML/jackson-core/pull/827)]
> ([https://github.com/IBM/ibm-cos-sdk-java/issues/58)]
> Please upgrade the shaded library to jackson-core version 2.15.0 to fix it.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
[jira] [Resolved] (PARQUET-2336) Add caching key to CodecFactory
[ https://issues.apache.org/jira/browse/PARQUET-2336?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fokko Driesprong resolved PARQUET-2336. --- Resolution: Fixed > Add caching key to CodecFactory > --- > > Key: PARQUET-2336 > URL: https://issues.apache.org/jira/browse/PARQUET-2336 > Project: Parquet > Issue Type: Bug > Components: parquet-hadoop >Affects Versions: 1.13.1 >Reporter: Fokko Driesprong >Assignee: Fokko Driesprong >Priority: Major > Fix For: 1.14.0 > > -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Resolved] (PARQUET-2384) Mark toOriginalType as deprecated
[ https://issues.apache.org/jira/browse/PARQUET-2384?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fokko Driesprong resolved PARQUET-2384. --- Resolution: Fixed > Mark toOriginalType as deprecated > - > > Key: PARQUET-2384 > URL: https://issues.apache.org/jira/browse/PARQUET-2384 > Project: Parquet > Issue Type: Improvement > Components: parquet-mr >Affects Versions: 1.13.1 >Reporter: Fokko Driesprong >Assignee: Fokko Driesprong >Priority: Major > Fix For: 1.14.0 > > -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Resolved] (PARQUET-2368) Update japicmp to 1.18.1
[ https://issues.apache.org/jira/browse/PARQUET-2368?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fokko Driesprong resolved PARQUET-2368. --- Resolution: Fixed > Update japicmp to 1.18.1 > > > Key: PARQUET-2368 > URL: https://issues.apache.org/jira/browse/PARQUET-2368 > Project: Parquet > Issue Type: Improvement >Affects Versions: 1.13.1 >Reporter: Fokko Driesprong >Assignee: Fokko Driesprong >Priority: Major > Fix For: 1.14.0 > > -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Updated] (PARQUET-2382) Remove the deprecated OriginalType
[ https://issues.apache.org/jira/browse/PARQUET-2382?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fokko Driesprong updated PARQUET-2382: -- Fix Version/s: 2.0.0 (was: 1.14.0) > Remove the deprecated OriginalType > -- > > Key: PARQUET-2382 > URL: https://issues.apache.org/jira/browse/PARQUET-2382 > Project: Parquet > Issue Type: Improvement >Reporter: Fokko Driesprong >Assignee: Fokko Driesprong >Priority: Major > Fix For: 2.0.0 > > -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (PARQUET-2384) Mark toOriginalType as deprecated
Fokko Driesprong created PARQUET-2384: - Summary: Mark toOriginalType as deprecated Key: PARQUET-2384 URL: https://issues.apache.org/jira/browse/PARQUET-2384 Project: Parquet Issue Type: Improvement Components: parquet-mr Affects Versions: 1.13.1 Reporter: Fokko Driesprong Assignee: Fokko Driesprong Fix For: 1.14.0 -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Updated] (PARQUET-1942) Bump Apache Arrow 2.0.0
[ https://issues.apache.org/jira/browse/PARQUET-1942?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fokko Driesprong updated PARQUET-1942: -- Affects Version/s: 1.13.1 (was: 1.11.0) > Bump Apache Arrow 2.0.0 > --- > > Key: PARQUET-1942 > URL: https://issues.apache.org/jira/browse/PARQUET-1942 > Project: Parquet > Issue Type: Improvement > Components: parquet-mr >Affects Versions: 1.13.1 >Reporter: Fokko Driesprong >Assignee: Fokko Driesprong >Priority: Major > -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Updated] (PARQUET-1942) Bump Apache Arrow 2.0.0
[ https://issues.apache.org/jira/browse/PARQUET-1942?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fokko Driesprong updated PARQUET-1942: -- Fix Version/s: 1.14.0 > Bump Apache Arrow 2.0.0 > --- > > Key: PARQUET-1942 > URL: https://issues.apache.org/jira/browse/PARQUET-1942 > Project: Parquet > Issue Type: Improvement > Components: parquet-mr >Affects Versions: 1.13.1 >Reporter: Fokko Driesprong >Assignee: Fokko Driesprong >Priority: Major > Fix For: 1.14.0 > > -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Resolved] (PARQUET-1942) Bump Apache Arrow 2.0.0
[ https://issues.apache.org/jira/browse/PARQUET-1942?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fokko Driesprong resolved PARQUET-1942. --- Resolution: Fixed > Bump Apache Arrow 2.0.0 > --- > > Key: PARQUET-1942 > URL: https://issues.apache.org/jira/browse/PARQUET-1942 > Project: Parquet > Issue Type: Improvement > Components: parquet-mr >Affects Versions: 1.13.1 >Reporter: Fokko Driesprong >Assignee: Fokko Driesprong >Priority: Major > Fix For: 1.14.0 > > -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (PARQUET-2382) Remove the deprecated OriginalType
Fokko Driesprong created PARQUET-2382: - Summary: Remove the deprecated OriginalType Key: PARQUET-2382 URL: https://issues.apache.org/jira/browse/PARQUET-2382 Project: Parquet Issue Type: Improvement Reporter: Fokko Driesprong Assignee: Fokko Driesprong Fix For: 1.14.0 -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Resolved] (PARQUET-2274) Remove Yetus
[ https://issues.apache.org/jira/browse/PARQUET-2274?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fokko Driesprong resolved PARQUET-2274. --- Resolution: Fixed > Remove Yetus > - > > Key: PARQUET-2274 > URL: https://issues.apache.org/jira/browse/PARQUET-2274 > Project: Parquet > Issue Type: Improvement >Affects Versions: 1.13.0 >Reporter: Fokko Driesprong >Assignee: Fokko Driesprong >Priority: Major > Fix For: 1.14.0 > > -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (PARQUET-2368) Update japicmp to 1.18.1
Fokko Driesprong created PARQUET-2368: - Summary: Update japicmp to 1.18.1 Key: PARQUET-2368 URL: https://issues.apache.org/jira/browse/PARQUET-2368 Project: Parquet Issue Type: Improvement Affects Versions: 1.13.1 Reporter: Fokko Driesprong Assignee: Fokko Driesprong Fix For: 1.14.0 -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Updated] (PARQUET-2355) Deprecate parquet-thrift
[ https://issues.apache.org/jira/browse/PARQUET-2355?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fokko Driesprong updated PARQUET-2355: -- Summary: Deprecate parquet-thrift (was: Remove parquet-thrift) > Deprecate parquet-thrift > > > Key: PARQUET-2355 > URL: https://issues.apache.org/jira/browse/PARQUET-2355 > Project: Parquet > Issue Type: Improvement >Reporter: Fokko Driesprong >Assignee: Fokko Driesprong >Priority: Major > > I was in the process of updating to [the latest version of > Thrift|https://github.com/apache/parquet-mr/pull/1138] (from 0.16.0 to > 0.19.0). Mostly because it contains CVEs and makes the release process easier > because you don't have to install Thrift from source (it is just available on > homebrew etc). > > While working on this, I ran into an issue with Elephantbird, which is using > a very old version of Thrift (0.7.0). Trying to bump this I noticed that a > lot of classes that we use in the tests > [have|https://github.com/apache/parquet-mr/pull/1156] [ been made > private|https://github.com/apache/parquet-mr/pull/1156]. Therefore it is hard > to test if we break anything. > > It looks like parquet-thrift [is not used by anyone > anymore|https://mvnrepository.com/artifact/org.apache.parquet/parquet-thrift]. > I would suggest removing this from the repository unless anyone objects. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (PARQUET-2355) Remove parquet-thrift
Fokko Driesprong created PARQUET-2355: - Summary: Remove parquet-thrift Key: PARQUET-2355 URL: https://issues.apache.org/jira/browse/PARQUET-2355 Project: Parquet Issue Type: Improvement Reporter: Fokko Driesprong Assignee: Fokko Driesprong I was in the process of updating to [the latest version of Thrift|https://github.com/apache/parquet-mr/pull/1138] (from 0.16.0 to 0.19.0). Mostly because it contains CVEs and makes the release process easier because you don't have to install Thrift from source (it is just available on homebrew etc). While working on this, I ran into an issue with Elephantbird, which is using a very old version of Thrift (0.7.0). Trying to bump this I noticed that a lot of classes that we use in the tests [have|https://github.com/apache/parquet-mr/pull/1156] [ been made private|https://github.com/apache/parquet-mr/pull/1156]. Therefore it is hard to test if we break anything. It looks like parquet-thrift [is not used by anyone anymore|https://mvnrepository.com/artifact/org.apache.parquet/parquet-thrift]. I would suggest removing this from the repository unless anyone objects. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (PARQUET-2353) Avoid Hadoop interfaces and classes in codecs
[ https://issues.apache.org/jira/browse/PARQUET-2353?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17767963#comment-17767963 ] Fokko Driesprong commented on PARQUET-2353: --- Can you double check if this is still the case with the latest Parquet release? I did some relevant work a while ago: https://github.com/apache/parquet-mr/pull/1074 > Avoid Hadoop interfaces and classes in codecs > - > > Key: PARQUET-2353 > URL: https://issues.apache.org/jira/browse/PARQUET-2353 > Project: Parquet > Issue Type: Improvement > Components: parquet-mr >Reporter: Atour Mousavi Gourabi >Priority: Minor > > Currently the codecs implemented by Parquet implement the Hadoop Configurable > and CompressionCodec interfaces. As part of the effort to decouple from > Hadoop there need to be alternatives to these Hadoop implementations such > that users are not forced to load Hadoop classes for this purpose at runtime. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (PARQUET-2344) Bump to Thirft 0.19.0
Fokko Driesprong created PARQUET-2344: - Summary: Bump to Thirft 0.19.0 Key: PARQUET-2344 URL: https://issues.apache.org/jira/browse/PARQUET-2344 Project: Parquet Issue Type: Bug Components: parquet-format, parquet-mr Reporter: Fokko Driesprong -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (PARQUET-2336) Add caching key to CodecFactory
Fokko Driesprong created PARQUET-2336: - Summary: Add caching key to CodecFactory Key: PARQUET-2336 URL: https://issues.apache.org/jira/browse/PARQUET-2336 Project: Parquet Issue Type: Bug Components: parquet-hadoop Affects Versions: 1.13.1 Reporter: Fokko Driesprong Assignee: Fokko Driesprong Fix For: 1.14.0 -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Resolved] (PARQUET-2297) Encrypted files should not be checked for delta encoding problem
[ https://issues.apache.org/jira/browse/PARQUET-2297?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fokko Driesprong resolved PARQUET-2297. --- Resolution: Fixed > Encrypted files should not be checked for delta encoding problem > > > Key: PARQUET-2297 > URL: https://issues.apache.org/jira/browse/PARQUET-2297 > Project: Parquet > Issue Type: Improvement > Components: parquet-mr >Affects Versions: 1.13.0 >Reporter: Gidon Gershinsky >Assignee: Gidon Gershinsky >Priority: Major > Fix For: 1.14.0, 1.13.1 > > > Delta encoding problem (https://issues.apache.org/jira/browse/PARQUET-246) > was fixed in writers since parquet-mr-1.8. This fix also added a > `checkDeltaByteArrayProblem` method in readers, that runs over all columns > and checks for this problem in older files. > This now triggers an unrelated exception when reading encrypted files, in the > following situation: trying to read an unencrypted column, without having > keys for encrypted columns (see > https://issues.apache.org/jira/browse/PARQUET-2193). This happens in Spark, > with nested columns (files with regular columns are ok). > Possible solution: don't call the `checkDeltaByteArrayProblem` method for > encrypted files - because these files can be written only with > parquet-mr-1.12 and newer, where the delta encoding problem is already fixed. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Resolved] (PARQUET-2276) ParquetReader reads do not work with Hadoop version 2.8.5
[
https://issues.apache.org/jira/browse/PARQUET-2276?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Fokko Driesprong resolved PARQUET-2276.
---
Resolution: Fixed
> ParquetReader reads do not work with Hadoop version 2.8.5
> -
>
> Key: PARQUET-2276
> URL: https://issues.apache.org/jira/browse/PARQUET-2276
> Project: Parquet
> Issue Type: Bug
> Components: parquet-mr
>Affects Versions: 1.13.0
>Reporter: Atul Mohan
>Assignee: Fokko Driesprong
>Priority: Major
> Fix For: 1.14.0, 1.13.1
>
>
> {{ParquetReader.read() fails with the following exception on parquet-mr
> version 1.13.0 when using hadoop version 2.8.5:}}
> {code:java}
> java.lang.NoSuchMethodError: 'boolean
> org.apache.hadoop.fs.FSDataInputStream.hasCapability(java.lang.String)'
> at
> org.apache.parquet.hadoop.util.HadoopStreams.isWrappedStreamByteBufferReadable(HadoopStreams.java:74)
>
> at org.apache.parquet.hadoop.util.HadoopStreams.wrap(HadoopStreams.java:49)
> at
> org.apache.parquet.hadoop.util.HadoopInputFile.newStream(HadoopInputFile.java:69)
>
> at
> org.apache.parquet.hadoop.ParquetFileReader.(ParquetFileReader.java:787)
>
> at
> org.apache.parquet.hadoop.ParquetFileReader.open(ParquetFileReader.java:657)
> at org.apache.parquet.hadoop.ParquetReader.initReader(ParquetReader.java:162)
> org.apache.parquet.hadoop.ParquetReader.read(ParquetReader.java:135)
> {code}
>
>
>
> From an initial investigation, it looks like HadoopStreams has started using
> [FSDataInputStream.hasCapability|https://github.com/apache/parquet-mr/blob/master/parquet-hadoop/src/main/java/org/apache/parquet/hadoop/util/HadoopStreams.java#L74]
> but _FSDataInputStream_ does not have the _hasCapability_ API in [hadoop
> 2.8.x|https://hadoop.apache.org/docs/r2.8.3/api/org/apache/hadoop/fs/FSDataInputStream.html].
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
[jira] [Updated] (PARQUET-2081) Encryption translation tool - Parquet-hadoop
[ https://issues.apache.org/jira/browse/PARQUET-2081?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fokko Driesprong updated PARQUET-2081: -- Fix Version/s: 1.13.1 > Encryption translation tool - Parquet-hadoop > > > Key: PARQUET-2081 > URL: https://issues.apache.org/jira/browse/PARQUET-2081 > Project: Parquet > Issue Type: Task > Components: parquet-mr >Reporter: Xinli Shang >Assignee: Xinli Shang >Priority: Major > Fix For: 1.12.3, 1.13.1 > > > This is the implement the core part of the Encryption translation tool in > parquet-hadoop. After this, we will have another Jira/PR for parquet-cli to > integrate with key tools for encryption properties.. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (PARQUET-2296) Bump easymock from 3.4 to 5.1.0
Fokko Driesprong created PARQUET-2296: - Summary: Bump easymock from 3.4 to 5.1.0 Key: PARQUET-2296 URL: https://issues.apache.org/jira/browse/PARQUET-2296 Project: Parquet Issue Type: Improvement Components: parquet-mr Affects Versions: 1.13.0 Reporter: Fokko Driesprong Assignee: Fokko Driesprong Fix For: 1.14.0 -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (PARQUET-2295) Bump truth-proto-extension from 1.0 to 1.1.3
Fokko Driesprong created PARQUET-2295: - Summary: Bump truth-proto-extension from 1.0 to 1.1.3 Key: PARQUET-2295 URL: https://issues.apache.org/jira/browse/PARQUET-2295 Project: Parquet Issue Type: Improvement Components: parquet-mr Affects Versions: 1.13.0 Reporter: Fokko Driesprong Assignee: Fokko Driesprong Fix For: 1.14.0 -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Updated] (PARQUET-2276) ParquetReader reads do not work with Hadoop version 2.8.5
[
https://issues.apache.org/jira/browse/PARQUET-2276?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Fokko Driesprong updated PARQUET-2276:
--
Fix Version/s: 1.14.0
1.13.1
> ParquetReader reads do not work with Hadoop version 2.8.5
> -
>
> Key: PARQUET-2276
> URL: https://issues.apache.org/jira/browse/PARQUET-2276
> Project: Parquet
> Issue Type: Bug
> Components: parquet-mr
>Affects Versions: 1.13.0
>Reporter: Atul Mohan
>Assignee: Fokko Driesprong
>Priority: Major
> Fix For: 1.14.0, 1.13.1
>
>
> {{ParquetReader.read() fails with the following exception on parquet-mr
> version 1.13.0 when using hadoop version 2.8.5:}}
> {code:java}
> java.lang.NoSuchMethodError: 'boolean
> org.apache.hadoop.fs.FSDataInputStream.hasCapability(java.lang.String)'
> at
> org.apache.parquet.hadoop.util.HadoopStreams.isWrappedStreamByteBufferReadable(HadoopStreams.java:74)
>
> at org.apache.parquet.hadoop.util.HadoopStreams.wrap(HadoopStreams.java:49)
> at
> org.apache.parquet.hadoop.util.HadoopInputFile.newStream(HadoopInputFile.java:69)
>
> at
> org.apache.parquet.hadoop.ParquetFileReader.(ParquetFileReader.java:787)
>
> at
> org.apache.parquet.hadoop.ParquetFileReader.open(ParquetFileReader.java:657)
> at org.apache.parquet.hadoop.ParquetReader.initReader(ParquetReader.java:162)
> org.apache.parquet.hadoop.ParquetReader.read(ParquetReader.java:135)
> {code}
>
>
>
> From an initial investigation, it looks like HadoopStreams has started using
> [FSDataInputStream.hasCapability|https://github.com/apache/parquet-mr/blob/master/parquet-hadoop/src/main/java/org/apache/parquet/hadoop/util/HadoopStreams.java#L74]
> but _FSDataInputStream_ does not have the _hasCapability_ API in [hadoop
> 2.8.x|https://hadoop.apache.org/docs/r2.8.3/api/org/apache/hadoop/fs/FSDataInputStream.html].
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
[jira] [Assigned] (PARQUET-2276) ParquetReader reads do not work with Hadoop version 2.8.5
[
https://issues.apache.org/jira/browse/PARQUET-2276?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Fokko Driesprong reassigned PARQUET-2276:
-
Assignee: Fokko Driesprong
> ParquetReader reads do not work with Hadoop version 2.8.5
> -
>
> Key: PARQUET-2276
> URL: https://issues.apache.org/jira/browse/PARQUET-2276
> Project: Parquet
> Issue Type: Bug
> Components: parquet-mr
>Affects Versions: 1.13.0
>Reporter: Atul Mohan
>Assignee: Fokko Driesprong
>Priority: Major
>
> {{ParquetReader.read() fails with the following exception on parquet-mr
> version 1.13.0 when using hadoop version 2.8.5:}}
> {code:java}
> java.lang.NoSuchMethodError: 'boolean
> org.apache.hadoop.fs.FSDataInputStream.hasCapability(java.lang.String)'
> at
> org.apache.parquet.hadoop.util.HadoopStreams.isWrappedStreamByteBufferReadable(HadoopStreams.java:74)
>
> at org.apache.parquet.hadoop.util.HadoopStreams.wrap(HadoopStreams.java:49)
> at
> org.apache.parquet.hadoop.util.HadoopInputFile.newStream(HadoopInputFile.java:69)
>
> at
> org.apache.parquet.hadoop.ParquetFileReader.(ParquetFileReader.java:787)
>
> at
> org.apache.parquet.hadoop.ParquetFileReader.open(ParquetFileReader.java:657)
> at org.apache.parquet.hadoop.ParquetReader.initReader(ParquetReader.java:162)
> org.apache.parquet.hadoop.ParquetReader.read(ParquetReader.java:135)
> {code}
>
>
>
> From an initial investigation, it looks like HadoopStreams has started using
> [FSDataInputStream.hasCapability|https://github.com/apache/parquet-mr/blob/master/parquet-hadoop/src/main/java/org/apache/parquet/hadoop/util/HadoopStreams.java#L74]
> but _FSDataInputStream_ does not have the _hasCapability_ API in [hadoop
> 2.8.x|https://hadoop.apache.org/docs/r2.8.3/api/org/apache/hadoop/fs/FSDataInputStream.html].
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
[jira] [Commented] (PARQUET-2276) ParquetReader reads do not work with Hadoop version 2.8.5
[
https://issues.apache.org/jira/browse/PARQUET-2276?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17716304#comment-17716304
]
Fokko Driesprong commented on PARQUET-2276:
---
[~a2l] I also noticed after the release that we broke compatibility with Hadoop
<=2.8. I recently added a CI to check if we're still okay with [Hadoop
2.9|[https://github.com/apache/parquet-mr/pull/1083].] This will be backported
to 1.13.1 as well. Maybe an upgrade from 2.8 to 2.9 is easier than to Hadoop 3.
WDYT?
> ParquetReader reads do not work with Hadoop version 2.8.5
> -
>
> Key: PARQUET-2276
> URL: https://issues.apache.org/jira/browse/PARQUET-2276
> Project: Parquet
> Issue Type: Bug
> Components: parquet-mr
>Affects Versions: 1.13.0
>Reporter: Atul Mohan
>Priority: Major
>
> {{ParquetReader.read() fails with the following exception on parquet-mr
> version 1.13.0 when using hadoop version 2.8.5:}}
> {code:java}
> java.lang.NoSuchMethodError: 'boolean
> org.apache.hadoop.fs.FSDataInputStream.hasCapability(java.lang.String)'
> at
> org.apache.parquet.hadoop.util.HadoopStreams.isWrappedStreamByteBufferReadable(HadoopStreams.java:74)
>
> at org.apache.parquet.hadoop.util.HadoopStreams.wrap(HadoopStreams.java:49)
> at
> org.apache.parquet.hadoop.util.HadoopInputFile.newStream(HadoopInputFile.java:69)
>
> at
> org.apache.parquet.hadoop.ParquetFileReader.(ParquetFileReader.java:787)
>
> at
> org.apache.parquet.hadoop.ParquetFileReader.open(ParquetFileReader.java:657)
> at org.apache.parquet.hadoop.ParquetReader.initReader(ParquetReader.java:162)
> org.apache.parquet.hadoop.ParquetReader.read(ParquetReader.java:135)
> {code}
>
>
>
> From an initial investigation, it looks like HadoopStreams has started using
> [FSDataInputStream.hasCapability|https://github.com/apache/parquet-mr/blob/master/parquet-hadoop/src/main/java/org/apache/parquet/hadoop/util/HadoopStreams.java#L74]
> but _FSDataInputStream_ does not have the _hasCapability_ API in [hadoop
> 2.8.x|https://hadoop.apache.org/docs/r2.8.3/api/org/apache/hadoop/fs/FSDataInputStream.html].
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
[jira] [Updated] (PARQUET-2290) Add CI for Hadoop 2
[ https://issues.apache.org/jira/browse/PARQUET-2290?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fokko Driesprong updated PARQUET-2290: -- Fix Version/s: 1.13.1 > Add CI for Hadoop 2 > --- > > Key: PARQUET-2290 > URL: https://issues.apache.org/jira/browse/PARQUET-2290 > Project: Parquet > Issue Type: Improvement > Components: parquet-mr >Affects Versions: 1.13.0 >Reporter: Fokko Driesprong >Assignee: Fokko Driesprong >Priority: Major > Fix For: 1.14.0, 1.13.1 > > -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Resolved] (PARQUET-2290) Add CI for Hadoop 2
[ https://issues.apache.org/jira/browse/PARQUET-2290?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fokko Driesprong resolved PARQUET-2290. --- Resolution: Fixed > Add CI for Hadoop 2 > --- > > Key: PARQUET-2290 > URL: https://issues.apache.org/jira/browse/PARQUET-2290 > Project: Parquet > Issue Type: Improvement > Components: parquet-mr >Affects Versions: 1.13.0 >Reporter: Fokko Driesprong >Assignee: Fokko Driesprong >Priority: Major > Fix For: 1.14.0 > > -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Resolved] (PARQUET-2291) Remove lingering japicmp exclusions
[ https://issues.apache.org/jira/browse/PARQUET-2291?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fokko Driesprong resolved PARQUET-2291. --- Resolution: Fixed > Remove lingering japicmp exclusions > --- > > Key: PARQUET-2291 > URL: https://issues.apache.org/jira/browse/PARQUET-2291 > Project: Parquet > Issue Type: Improvement >Affects Versions: 1.13.0 >Reporter: Fokko Driesprong >Assignee: Fokko Driesprong >Priority: Major > Fix For: 1.14.0 > > -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (PARQUET-2293) Bump guava from 27.0.1-jre to 31.1-jre
Fokko Driesprong created PARQUET-2293: - Summary: Bump guava from 27.0.1-jre to 31.1-jre Key: PARQUET-2293 URL: https://issues.apache.org/jira/browse/PARQUET-2293 Project: Parquet Issue Type: Improvement Components: parquet-mr Affects Versions: 1.13.0 Reporter: Fokko Driesprong Assignee: Fokko Driesprong Fix For: 1.14.0 -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (PARQUET-2294) Bump fastutil from 8.4.2 to 8.5.12
Fokko Driesprong created PARQUET-2294: - Summary: Bump fastutil from 8.4.2 to 8.5.12 Key: PARQUET-2294 URL: https://issues.apache.org/jira/browse/PARQUET-2294 Project: Parquet Issue Type: Improvement Components: parquet-mr Affects Versions: 1.13.0 Reporter: Fokko Driesprong Assignee: Fokko Driesprong Fix For: 1.14.0 -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (PARQUET-2291) Remove lingering japicmp exclusions
Fokko Driesprong created PARQUET-2291: - Summary: Remove lingering japicmp exclusions Key: PARQUET-2291 URL: https://issues.apache.org/jira/browse/PARQUET-2291 Project: Parquet Issue Type: Improvement Affects Versions: 1.13.0 Reporter: Fokko Driesprong Assignee: Fokko Driesprong Fix For: 1.14.0 -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (PARQUET-2290) Add CI for Hadoop 2
Fokko Driesprong created PARQUET-2290: - Summary: Add CI for Hadoop 2 Key: PARQUET-2290 URL: https://issues.apache.org/jira/browse/PARQUET-2290 Project: Parquet Issue Type: Improvement Components: parquet-mr Affects Versions: 1.13.0 Reporter: Fokko Driesprong Assignee: Fokko Driesprong Fix For: 1.14.0 -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (PARQUET-2289) Avoid using hasCapability
Fokko Driesprong created PARQUET-2289: - Summary: Avoid using hasCapability Key: PARQUET-2289 URL: https://issues.apache.org/jira/browse/PARQUET-2289 Project: Parquet Issue Type: Improvement Components: parquet-mr Affects Versions: 1.13.0 Reporter: Fokko Driesprong Assignee: Fokko Driesprong Fix For: 1.14.0 -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (PARQUET-2288) Bump exec-maven-plugin from 1.2.1 to 3.1.0
Fokko Driesprong created PARQUET-2288: - Summary: Bump exec-maven-plugin from 1.2.1 to 3.1.0 Key: PARQUET-2288 URL: https://issues.apache.org/jira/browse/PARQUET-2288 Project: Parquet Issue Type: Improvement Components: parquet-format Affects Versions: 1.13.0 Reporter: Fokko Driesprong Assignee: Fokko Driesprong Fix For: 1.14.0 -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (PARQUET-2287) Bump maven-shade-plugin from 2.2 to 3.4.1
Fokko Driesprong created PARQUET-2287: - Summary: Bump maven-shade-plugin from 2.2 to 3.4.1 Key: PARQUET-2287 URL: https://issues.apache.org/jira/browse/PARQUET-2287 Project: Parquet Issue Type: Improvement Components: parquet-format Affects Versions: 1.13.0 Reporter: Fokko Driesprong Assignee: Fokko Driesprong Fix For: 1.14.0 -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (PARQUET-2286) Bump apache-rat-plugin from 0.12 to 0.15
Fokko Driesprong created PARQUET-2286: - Summary: Bump apache-rat-plugin from 0.12 to 0.15 Key: PARQUET-2286 URL: https://issues.apache.org/jira/browse/PARQUET-2286 Project: Parquet Issue Type: Improvement Components: parquet-format Affects Versions: 1.13.0 Reporter: Fokko Driesprong Assignee: Fokko Driesprong Fix For: 1.14.0 -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (PARQUET-2285) Add dependabot
Fokko Driesprong created PARQUET-2285: - Summary: Add dependabot Key: PARQUET-2285 URL: https://issues.apache.org/jira/browse/PARQUET-2285 Project: Parquet Issue Type: Improvement Components: parquet-format Affects Versions: 1.13.0 Reporter: Fokko Driesprong Assignee: Fokko Driesprong Fix For: 1.14.0 -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (PARQUET-2284) Bump junit from 4.10 to 4.13.1
Fokko Driesprong created PARQUET-2284: - Summary: Bump junit from 4.10 to 4.13.1 Key: PARQUET-2284 URL: https://issues.apache.org/jira/browse/PARQUET-2284 Project: Parquet Issue Type: Improvement Components: parquet-format Affects Versions: 1.13.0 Reporter: Fokko Driesprong Assignee: Fokko Driesprong Fix For: 1.14.0 -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Resolved] (PARQUET-2282) Dont initialize HadoopCodec
[ https://issues.apache.org/jira/browse/PARQUET-2282?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fokko Driesprong resolved PARQUET-2282. --- Resolution: Fixed > Dont initialize HadoopCodec > --- > > Key: PARQUET-2282 > URL: https://issues.apache.org/jira/browse/PARQUET-2282 > Project: Parquet > Issue Type: Improvement > Components: parquet-mr >Affects Versions: 1.13.0 >Reporter: Fokko Driesprong >Assignee: Fokko Driesprong >Priority: Major > Fix For: 1.14.0, 1.13.1 > > -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Updated] (PARQUET-2282) Dont initialize HadoopCodec
[ https://issues.apache.org/jira/browse/PARQUET-2282?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fokko Driesprong updated PARQUET-2282: -- Fix Version/s: 1.13.1 > Dont initialize HadoopCodec > --- > > Key: PARQUET-2282 > URL: https://issues.apache.org/jira/browse/PARQUET-2282 > Project: Parquet > Issue Type: Improvement > Components: parquet-mr >Affects Versions: 1.13.0 >Reporter: Fokko Driesprong >Assignee: Fokko Driesprong >Priority: Major > Fix For: 1.14.0, 1.13.1 > > -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Resolved] (PARQUET-2283) Remove Hadoop HiddenFileFilter
[ https://issues.apache.org/jira/browse/PARQUET-2283?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fokko Driesprong resolved PARQUET-2283. --- Resolution: Fixed > Remove Hadoop HiddenFileFilter > -- > > Key: PARQUET-2283 > URL: https://issues.apache.org/jira/browse/PARQUET-2283 > Project: Parquet > Issue Type: Improvement > Components: parquet-mr >Affects Versions: 1.13.0 >Reporter: Fokko Driesprong >Assignee: Fokko Driesprong >Priority: Major > Fix For: 1.14.0, 1.13.1 > > -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Updated] (PARQUET-2283) Remove Hadoop HiddenFileFilter
[ https://issues.apache.org/jira/browse/PARQUET-2283?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fokko Driesprong updated PARQUET-2283: -- Fix Version/s: 1.13.1 > Remove Hadoop HiddenFileFilter > -- > > Key: PARQUET-2283 > URL: https://issues.apache.org/jira/browse/PARQUET-2283 > Project: Parquet > Issue Type: Improvement > Components: parquet-mr >Affects Versions: 1.13.0 >Reporter: Fokko Driesprong >Assignee: Fokko Driesprong >Priority: Major > Fix For: 1.14.0, 1.13.1 > > -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (PARQUET-2283) Remove Hadoop HiddenFileFilter
Fokko Driesprong created PARQUET-2283: - Summary: Remove Hadoop HiddenFileFilter Key: PARQUET-2283 URL: https://issues.apache.org/jira/browse/PARQUET-2283 Project: Parquet Issue Type: Improvement Components: parquet-mr Affects Versions: 1.13.0 Reporter: Fokko Driesprong Assignee: Fokko Driesprong Fix For: 1.14.0 -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (PARQUET-2282) Dont initialize HadoopCodec
Fokko Driesprong created PARQUET-2282: - Summary: Dont initialize HadoopCodec Key: PARQUET-2282 URL: https://issues.apache.org/jira/browse/PARQUET-2282 Project: Parquet Issue Type: Improvement Components: parquet-mr Affects Versions: 1.13.0 Reporter: Fokko Driesprong Assignee: Fokko Driesprong Fix For: 1.14.0 -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Resolved] (PARQUET-2280) Bump h2 from 2.1.210 to 2.1.214
[ https://issues.apache.org/jira/browse/PARQUET-2280?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fokko Driesprong resolved PARQUET-2280. --- Resolution: Fixed > Bump h2 from 2.1.210 to 2.1.214 > --- > > Key: PARQUET-2280 > URL: https://issues.apache.org/jira/browse/PARQUET-2280 > Project: Parquet > Issue Type: Improvement >Affects Versions: 1.13.0 >Reporter: Fokko Driesprong >Assignee: Fokko Driesprong >Priority: Major > Fix For: 1.14.0 > > -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Resolved] (PARQUET-2279) Bump slf4j.version from 1.7.22 to 1.7.33
[ https://issues.apache.org/jira/browse/PARQUET-2279?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fokko Driesprong resolved PARQUET-2279. --- Resolution: Fixed > Bump slf4j.version from 1.7.22 to 1.7.33 > > > Key: PARQUET-2279 > URL: https://issues.apache.org/jira/browse/PARQUET-2279 > Project: Parquet > Issue Type: Improvement >Affects Versions: 1.13.0 >Reporter: Fokko Driesprong >Assignee: Fokko Driesprong >Priority: Major > Fix For: 1.14.0 > > -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (PARQUET-2279) Bump slf4j.version from 1.7.22 to 1.7.33
Fokko Driesprong created PARQUET-2279: - Summary: Bump slf4j.version from 1.7.22 to 1.7.33 Key: PARQUET-2279 URL: https://issues.apache.org/jira/browse/PARQUET-2279 Project: Parquet Issue Type: Improvement Affects Versions: 1.13.0 Reporter: Fokko Driesprong Assignee: Fokko Driesprong Fix For: 1.14.0 -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (PARQUET-2280) Bump h2 from 2.1.210 to 2.1.214
Fokko Driesprong created PARQUET-2280: - Summary: Bump h2 from 2.1.210 to 2.1.214 Key: PARQUET-2280 URL: https://issues.apache.org/jira/browse/PARQUET-2280 Project: Parquet Issue Type: Improvement Affects Versions: 1.13.0 Reporter: Fokko Driesprong Assignee: Fokko Driesprong Fix For: 1.14.0 -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (PARQUET-2278) Bump re2j from 1.1 to 1.7
Fokko Driesprong created PARQUET-2278: - Summary: Bump re2j from 1.1 to 1.7 Key: PARQUET-2278 URL: https://issues.apache.org/jira/browse/PARQUET-2278 Project: Parquet Issue Type: Improvement Affects Versions: 1.13.0 Reporter: Fokko Driesprong Assignee: Fokko Driesprong Fix For: 1.14.0 -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Resolved] (PARQUET-2277) Bump hadoop.version from 3.2.3 to 3.3.5
[ https://issues.apache.org/jira/browse/PARQUET-2277?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fokko Driesprong resolved PARQUET-2277. --- Resolution: Fixed > Bump hadoop.version from 3.2.3 to 3.3.5 > --- > > Key: PARQUET-2277 > URL: https://issues.apache.org/jira/browse/PARQUET-2277 > Project: Parquet > Issue Type: Improvement >Affects Versions: 1.13.0 >Reporter: Fokko Driesprong >Assignee: Fokko Driesprong >Priority: Major > Fix For: 1.14.0 > > -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (PARQUET-2277) Bump hadoop.version from 3.2.3 to 3.3.5
Fokko Driesprong created PARQUET-2277: - Summary: Bump hadoop.version from 3.2.3 to 3.3.5 Key: PARQUET-2277 URL: https://issues.apache.org/jira/browse/PARQUET-2277 Project: Parquet Issue Type: Improvement Affects Versions: 1.13.0 Reporter: Fokko Driesprong Assignee: Fokko Driesprong Fix For: 1.14.0 -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Resolved] (PARQUET-2267) Add dependabot to update dependencies
[ https://issues.apache.org/jira/browse/PARQUET-2267?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fokko Driesprong resolved PARQUET-2267. --- Resolution: Fixed > Add dependabot to update dependencies > - > > Key: PARQUET-2267 > URL: https://issues.apache.org/jira/browse/PARQUET-2267 > Project: Parquet > Issue Type: Improvement >Reporter: Fokko Driesprong >Assignee: Fokko Driesprong >Priority: Major > Fix For: 1.14.0 > > -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Resolved] (PARQUET-2275) Upgrade `cyclonedx-maven-plugin` to 2.7.6
[ https://issues.apache.org/jira/browse/PARQUET-2275?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fokko Driesprong resolved PARQUET-2275. --- Fix Version/s: 1.14.0 Assignee: Dongjoon Hyun Resolution: Fixed > Upgrade `cyclonedx-maven-plugin` to 2.7.6 > - > > Key: PARQUET-2275 > URL: https://issues.apache.org/jira/browse/PARQUET-2275 > Project: Parquet > Issue Type: Improvement > Components: parquet-mr >Affects Versions: 1.13.1 >Reporter: Dongjoon Hyun >Assignee: Dongjoon Hyun >Priority: Minor > Fix For: 1.14.0 > > -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (PARQUET-2274) Remove Yetus
Fokko Driesprong created PARQUET-2274: - Summary: Remove Yetus Key: PARQUET-2274 URL: https://issues.apache.org/jira/browse/PARQUET-2274 Project: Parquet Issue Type: Improvement Affects Versions: 1.13.0 Reporter: Fokko Driesprong Assignee: Fokko Driesprong Fix For: 1.14.0 -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (PARQUET-2273) Remove Travis from the repository
Fokko Driesprong created PARQUET-2273: - Summary: Remove Travis from the repository Key: PARQUET-2273 URL: https://issues.apache.org/jira/browse/PARQUET-2273 Project: Parquet Issue Type: Improvement Affects Versions: 1.13.0 Reporter: Fokko Driesprong Assignee: Fokko Driesprong Fix For: 1.14.0 -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (PARQUET-2272) Bump protobuf-java from 3.17.3 to 3.19.6
Fokko Driesprong created PARQUET-2272: - Summary: Bump protobuf-java from 3.17.3 to 3.19.6 Key: PARQUET-2272 URL: https://issues.apache.org/jira/browse/PARQUET-2272 Project: Parquet Issue Type: Improvement Components: parquet-protobuf Affects Versions: 1.13.0 Reporter: Fokko Driesprong Assignee: Fokko Driesprong Fix For: 1.14.0 -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Resolved] (PARQUET-2272) Bump protobuf-java from 3.17.3 to 3.19.6
[ https://issues.apache.org/jira/browse/PARQUET-2272?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fokko Driesprong resolved PARQUET-2272. --- Resolution: Fixed > Bump protobuf-java from 3.17.3 to 3.19.6 > > > Key: PARQUET-2272 > URL: https://issues.apache.org/jira/browse/PARQUET-2272 > Project: Parquet > Issue Type: Improvement > Components: parquet-protobuf >Affects Versions: 1.13.0 >Reporter: Fokko Driesprong >Assignee: Fokko Driesprong >Priority: Major > Fix For: 1.14.0 > > -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Resolved] (PARQUET-2263) Upgrade maven-shade-plugin to 3.4.1
[ https://issues.apache.org/jira/browse/PARQUET-2263?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fokko Driesprong resolved PARQUET-2263. --- Fix Version/s: 1.14.0 Assignee: Yuming Wang Resolution: Fixed > Upgrade maven-shade-plugin to 3.4.1 > --- > > Key: PARQUET-2263 > URL: https://issues.apache.org/jira/browse/PARQUET-2263 > Project: Parquet > Issue Type: Improvement >Affects Versions: 1.13.0 >Reporter: Yuming Wang >Assignee: Yuming Wang >Priority: Major > Fix For: 1.14.0 > > -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (PARQUET-2271) Bump Parquet POM to 29
Fokko Driesprong created PARQUET-2271: - Summary: Bump Parquet POM to 29 Key: PARQUET-2271 URL: https://issues.apache.org/jira/browse/PARQUET-2271 Project: Parquet Issue Type: Improvement Components: parquet-format Reporter: Fokko Driesprong Assignee: Fokko Driesprong -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (PARQUET-2270) Bump Thrift to 0.18.1
Fokko Driesprong created PARQUET-2270: - Summary: Bump Thrift to 0.18.1 Key: PARQUET-2270 URL: https://issues.apache.org/jira/browse/PARQUET-2270 Project: Parquet Issue Type: Improvement Components: parquet-format Reporter: Fokko Driesprong Assignee: Fokko Driesprong -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (PARQUET-2269) Update version in README.md
Fokko Driesprong created PARQUET-2269: - Summary: Update version in README.md Key: PARQUET-2269 URL: https://issues.apache.org/jira/browse/PARQUET-2269 Project: Parquet Issue Type: Improvement Reporter: Fokko Driesprong Assignee: Fokko Driesprong -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (PARQUET-2268) Bump Thrift to 0.18.1
Fokko Driesprong created PARQUET-2268: - Summary: Bump Thrift to 0.18.1 Key: PARQUET-2268 URL: https://issues.apache.org/jira/browse/PARQUET-2268 Project: Parquet Issue Type: Improvement Reporter: Fokko Driesprong Assignee: Fokko Driesprong -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (PARQUET-2267) Add dependabot to update dependencies
Fokko Driesprong created PARQUET-2267: - Summary: Add dependabot to update dependencies Key: PARQUET-2267 URL: https://issues.apache.org/jira/browse/PARQUET-2267 Project: Parquet Issue Type: Improvement Reporter: Fokko Driesprong Assignee: Fokko Driesprong -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Assigned] (PARQUET-1448) Review of ParquetFileReader
[
https://issues.apache.org/jira/browse/PARQUET-1448?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Fokko Driesprong reassigned PARQUET-1448:
-
Fix Version/s: 1.13.0
Assignee: Aaron Blake Niskode-Dossett
Resolution: Fixed
> Review of ParquetFileReader
> ---
>
> Key: PARQUET-1448
> URL: https://issues.apache.org/jira/browse/PARQUET-1448
> Project: Parquet
> Issue Type: Improvement
>Affects Versions: 1.9.0
>Reporter: David Mollitor
>Assignee: Aaron Blake Niskode-Dossett
>Priority: Minor
> Labels: pull-request-available
> Fix For: 1.13.0
>
> Attachments: PARQUET-1448.1.patch
>
>
> * Pre-Size {{ArrayList}} objects
> * Improve code readability
> * Fix some check-style issues
> * Improve use of {{Collections}} and {{Map}} API
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Resolved] (PARQUET-2020) Remove deprecated modules
[ https://issues.apache.org/jira/browse/PARQUET-2020?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fokko Driesprong resolved PARQUET-2020. --- Resolution: Fixed > Remove deprecated modules > - > > Key: PARQUET-2020 > URL: https://issues.apache.org/jira/browse/PARQUET-2020 > Project: Parquet > Issue Type: Improvement > Components: parquet-cascading >Affects Versions: 1.12.0 >Reporter: Fokko Driesprong >Assignee: Fokko Driesprong >Priority: Major > Fix For: 1.13.0 > > > Removes: > * parquet-tools-deprecated > * parquet-scrooge-deprecated > * parquet-cascading-common23-deprecated > * parquet-cascading-deprecated > * parquet-cascading3-deprecated -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (PARQUET-2025) Bump snappy to 1.1.8.3 to support Mac m1
[ https://issues.apache.org/jira/browse/PARQUET-2025?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fokko Driesprong updated PARQUET-2025: -- Affects Version/s: 1.12.0 > Bump snappy to 1.1.8.3 to support Mac m1 > > > Key: PARQUET-2025 > URL: https://issues.apache.org/jira/browse/PARQUET-2025 > Project: Parquet > Issue Type: Bug >Affects Versions: 1.12.0 >Reporter: Junjie Chen >Priority: Minor > Fix For: 1.13.0 > > > When running unit tests of iceberg on Mac m1 , it throws: > > Caused by: > java.lang.NoClassDefFoundError: Could not initialize class > org.xerial.snappy.Snappy > at > org.apache.parquet.hadoop.codec.SnappyCompressor.compress(SnappyCompressor.java:67) > at > org.apache.hadoop.io.compress.CompressorStream.compress(CompressorStream.java:81) > at > org.apache.hadoop.io.compress.CompressorStream.finish(CompressorStream.java:92) > at > org.apache.parquet.hadoop.CodecFactory$HeapBytesCompressor.compress(CodecFactory.java:165) > at > org.apache.parquet.hadoop.ColumnChunkPageWriteStore$ColumnChunkPageWriter.writePage(ColumnChunkPageWriteStore.java:122) > at > org.apache.parquet.column.impl.ColumnWriterV1.writePage(ColumnWriterV1.java:53) > at > org.apache.parquet.column.impl.ColumnWriterBase.writePage(ColumnWriterBase.java:315) > at > org.apache.parquet.column.impl.ColumnWriteStoreBase.flush(ColumnWriteStoreBase.java:152) > at > org.apache.parquet.column.impl.ColumnWriteStoreV1.flush(ColumnWriteStoreV1.java:27) > at > org.apache.parquet.hadoop.InternalParquetRecordWriter.flushRowGroupToStore(InternalParquetRecordWriter.java:172) > at > org.apache.parquet.hadoop.InternalParquetRecordWriter.close(InternalParquetRecordWriter.java:114) > at > org.apache.parquet.hadoop.ParquetRecordWriter.close(ParquetRecordWriter.java:165) > at > org.apache.spark.sql.execution.datasources.parquet.ParquetOutputWriter.close(ParquetOutputWriter.scala:42) > at > org.apache.spark.sql.execution.datasources.FileFormatDataWriter.releaseResources(FileFormatDataWriter.scala:57) > at > org.apache.spark.sql.execution.datasources.FileFormatDataWriter.commit(FileFormatDataWriter.scala:74) > at > org.apache.spark.sql.execution.datasources.FileFormatWriter$$anonfun$org$apache$spark$sql$execution$datasources$FileFormatWriter$$executeTask$3.apply(FileFormatWriter.scala:247) > at > org.apache.spark.sql.execution.datasources.FileFormatWriter$$anonfun$org$apache$spark$sql$execution$datasources$FileFormatWriter$$executeTask$3.apply(FileFormatWriter.scala:242) > at > org.apache.spark.util.Utils$.tryWithSafeFinallyAndFailureCallbacks(Utils.scala:1394) > at > org.apache.spark.sql.execution.datasources.FileFormatWriter$.org$apache$spark$sql$execution$datasources$FileFormatWriter$$executeTask(FileFormatWriter.scala:248) > ... 10 more -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Resolved] (PARQUET-2025) Bump snappy to 1.1.8.3 to support Mac m1
[ https://issues.apache.org/jira/browse/PARQUET-2025?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fokko Driesprong resolved PARQUET-2025. --- Fix Version/s: 1.13.0 Resolution: Fixed > Bump snappy to 1.1.8.3 to support Mac m1 > > > Key: PARQUET-2025 > URL: https://issues.apache.org/jira/browse/PARQUET-2025 > Project: Parquet > Issue Type: Bug >Reporter: Junjie Chen >Priority: Minor > Fix For: 1.13.0 > > > When running unit tests of iceberg on Mac m1 , it throws: > > Caused by: > java.lang.NoClassDefFoundError: Could not initialize class > org.xerial.snappy.Snappy > at > org.apache.parquet.hadoop.codec.SnappyCompressor.compress(SnappyCompressor.java:67) > at > org.apache.hadoop.io.compress.CompressorStream.compress(CompressorStream.java:81) > at > org.apache.hadoop.io.compress.CompressorStream.finish(CompressorStream.java:92) > at > org.apache.parquet.hadoop.CodecFactory$HeapBytesCompressor.compress(CodecFactory.java:165) > at > org.apache.parquet.hadoop.ColumnChunkPageWriteStore$ColumnChunkPageWriter.writePage(ColumnChunkPageWriteStore.java:122) > at > org.apache.parquet.column.impl.ColumnWriterV1.writePage(ColumnWriterV1.java:53) > at > org.apache.parquet.column.impl.ColumnWriterBase.writePage(ColumnWriterBase.java:315) > at > org.apache.parquet.column.impl.ColumnWriteStoreBase.flush(ColumnWriteStoreBase.java:152) > at > org.apache.parquet.column.impl.ColumnWriteStoreV1.flush(ColumnWriteStoreV1.java:27) > at > org.apache.parquet.hadoop.InternalParquetRecordWriter.flushRowGroupToStore(InternalParquetRecordWriter.java:172) > at > org.apache.parquet.hadoop.InternalParquetRecordWriter.close(InternalParquetRecordWriter.java:114) > at > org.apache.parquet.hadoop.ParquetRecordWriter.close(ParquetRecordWriter.java:165) > at > org.apache.spark.sql.execution.datasources.parquet.ParquetOutputWriter.close(ParquetOutputWriter.scala:42) > at > org.apache.spark.sql.execution.datasources.FileFormatDataWriter.releaseResources(FileFormatDataWriter.scala:57) > at > org.apache.spark.sql.execution.datasources.FileFormatDataWriter.commit(FileFormatDataWriter.scala:74) > at > org.apache.spark.sql.execution.datasources.FileFormatWriter$$anonfun$org$apache$spark$sql$execution$datasources$FileFormatWriter$$executeTask$3.apply(FileFormatWriter.scala:247) > at > org.apache.spark.sql.execution.datasources.FileFormatWriter$$anonfun$org$apache$spark$sql$execution$datasources$FileFormatWriter$$executeTask$3.apply(FileFormatWriter.scala:242) > at > org.apache.spark.util.Utils$.tryWithSafeFinallyAndFailureCallbacks(Utils.scala:1394) > at > org.apache.spark.sql.execution.datasources.FileFormatWriter$.org$apache$spark$sql$execution$datasources$FileFormatWriter$$executeTask(FileFormatWriter.scala:248) > ... 10 more -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (PARQUET-2020) Remove deprecated modules
[ https://issues.apache.org/jira/browse/PARQUET-2020?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fokko Driesprong updated PARQUET-2020: -- Description: Removes: * parquet-tools-deprecated * parquet-scrooge-deprecated * parquet-cascading-common23-deprecated * parquet-cascading-deprecated * parquet-cascading3-deprecated > Remove deprecated modules > - > > Key: PARQUET-2020 > URL: https://issues.apache.org/jira/browse/PARQUET-2020 > Project: Parquet > Issue Type: Improvement > Components: parquet-cascading >Affects Versions: 1.12.0 >Reporter: Fokko Driesprong >Assignee: Fokko Driesprong >Priority: Major > Fix For: 1.13.0 > > > Removes: > * parquet-tools-deprecated > * parquet-scrooge-deprecated > * parquet-cascading-common23-deprecated > * parquet-cascading-deprecated > * parquet-cascading3-deprecated -- This message was sent by Atlassian Jira (v8.3.4#803005)
