[jira] [Commented] (PARQUET-2346) Bump org.slf4j:slf4j-api from 1.7.12 to 2.0.9

2023-09-13 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/PARQUET-2346?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17764774#comment-17764774 ] Steve Loughran commented on PARQUET-2346: - I don't know what happens, but do know that (a;)

[jira] [Comment Edited] (PARQUET-2346) Bump org.slf4j:slf4j-api from 1.7.12 to 2.0.9

2023-09-13 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/PARQUET-2346?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17764774#comment-17764774 ] Steve Loughran edited comment on PARQUET-2346 at 9/13/23 4:24 PM: -- I

[jira] [Commented] (PARQUET-2346) Bump org.slf4j:slf4j-api from 1.7.12 to 2.0.9

2023-09-12 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/PARQUET-2346?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17764248#comment-17764248 ] Steve Loughran commented on PARQUET-2346: - what is this going to do in terms of trying to use

[jira] [Commented] (PARQUET-2338) CVE-2022-25168 in hadoop-common

2023-08-21 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/PARQUET-2338?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17756912#comment-17756912 ] Steve Loughran commented on PARQUET-2338: - pr #1065 did this in

[jira] [Commented] (PARQUET-2128) Bump Thrift to 0.16.0

2023-06-14 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/PARQUET-2128?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17732509#comment-17732509 ] Steve Loughran commented on PARQUET-2128: - homebrew doesn't have anything < 0..18.0, which is

[jira] [Commented] (PARQUET-2171) Implement vectored IO in parquet file format

2023-05-19 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/PARQUET-2171?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17724339#comment-17724339 ] Steve Loughran commented on PARQUET-2171: - mukund, is there a PR up for this? even though it's

[jira] [Commented] (PARQUET-2276) ParquetReader reads do not work with Hadoop version 2.8.5

2023-05-01 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/PARQUET-2276?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17718203#comment-17718203 ] Steve Loughran commented on PARQUET-2276: - [~a2l] really? hadoop 2.8? why haven't they upgraded

[jira] [Commented] (PARQUET-2289) Avoid using hasCapability

2023-04-19 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/PARQUET-2289?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17713993#comment-17713993 ] Steve Loughran commented on PARQUET-2289: - I'm not convinced here. the JIRA was about things

[jira] [Commented] (PARQUET-2276) ParquetReader reads do not work with Hadoop version 2.8.5

2023-04-14 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/PARQUET-2276?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17712325#comment-17712325 ] Steve Loughran commented on PARQUET-2276: - hadoop 2.8 shipped 5 years ago. trying to build

[jira] [Commented] (PARQUET-2277) Bump hadoop.version from 3.2.3 to 3.3.5

2023-04-14 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/PARQUET-2277?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17712323#comment-17712323 ] Steve Loughran commented on PARQUET-2277: - happy. Have you considered cutting hadoop 2 support

[jira] [Commented] (PARQUET-1989) Deep verification of encrypted files

2023-04-12 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/PARQUET-1989?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17711367#comment-17711367 ] Steve Loughran commented on PARQUET-1989: - you might want to have a design which can do the

[jira] [Commented] (PARQUET-2224) Publish SBOM artifacts

2023-03-28 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/PARQUET-2224?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17705940#comment-17705940 ] Steve Loughran commented on PARQUET-2224: - it's not spark, its a cyclone/maven thing.

[jira] [Commented] (PARQUET-2224) Publish SBOM artifacts

2023-03-27 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/PARQUET-2224?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17705646#comment-17705646 ] Steve Loughran commented on PARQUET-2224: - +SPARK-42380 > Publish SBOM artifacts >

[jira] [Commented] (PARQUET-2224) Publish SBOM artifacts

2023-03-27 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/PARQUET-2224?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17705645#comment-17705645 ] Steve Loughran commented on PARQUET-2224: - HADOOP-18641. didnt' actually break the build, just

[jira] [Commented] (PARQUET-2224) Publish SBOM artifacts

2023-03-27 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/PARQUET-2224?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17705327#comment-17705327 ] Steve Loughran commented on PARQUET-2224: - we had to roll this back from hadoop as the maven

[jira] [Commented] (PARQUET-2239) Replace log4j1 with reload4j

2023-02-06 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/PARQUET-2239?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17684607#comment-17684607 ] Steve Loughran commented on PARQUET-2239: - good, but trickier than you think as you have to do

[jira] [Resolved] (PARQUET-2173) Fix parquet build against hadoop 3.3.3+

2023-02-02 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/PARQUET-2173?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved PARQUET-2173. - Fix Version/s: 1.13.0 Resolution: Fixed > Fix parquet build against hadoop

[jira] [Commented] (PARQUET-2216) Parquet writer classes don't close underlying output stream in case of errors.

2022-12-02 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/PARQUET-2216?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17642453#comment-17642453 ] Steve Loughran commented on PARQUET-2216: - * OutputFile may not implement Closeable, but the

[jira] [Created] (PARQUET-2173) Fix parquet build against hadoop 3.3.3+

2022-08-16 Thread Steve Loughran (Jira)
Steve Loughran created PARQUET-2173: --- Summary: Fix parquet build against hadoop 3.3.3+ Key: PARQUET-2173 URL: https://issues.apache.org/jira/browse/PARQUET-2173 Project: Parquet Issue

[jira] [Commented] (PARQUET-2171) Implement vectored IO in parquet file format

2022-08-11 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/PARQUET-2171?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17578637#comment-17578637 ] Steve Loughran commented on PARQUET-2171: - bq. I have found ByteBuffer to impose a nontrivial

[jira] [Resolved] (PARQUET-2158) Upgrade Hadoop dependency to version 3.2.0

2022-08-01 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/PARQUET-2158?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved PARQUET-2158. - Fix Version/s: 1.13.0 Resolution: Fixed > Upgrade Hadoop dependency to version

[jira] [Resolved] (PARQUET-2150) parquet-protobuf to compile on mac M1

2022-07-19 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/PARQUET-2150?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved PARQUET-2150. - Resolution: Not A Problem with PARQUET-2155 this problem is implicitly fixed. >

[jira] [Updated] (PARQUET-2165) remove deprecated PathGlobPattern and DeprecatedFieldProjectionFilter to compile on hadoop 3.2+

2022-07-12 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/PARQUET-2165?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated PARQUET-2165: Summary: remove deprecated PathGlobPattern and DeprecatedFieldProjectionFilter to

[jira] [Created] (PARQUET-2165) remove deprecated PathGlobPattern to compile on hadoop 3.2+

2022-07-12 Thread Steve Loughran (Jira)
Steve Loughran created PARQUET-2165: --- Summary: remove deprecated PathGlobPattern to compile on hadoop 3.2+ Key: PARQUET-2165 URL: https://issues.apache.org/jira/browse/PARQUET-2165 Project: Parquet

[jira] [Commented] (PARQUET-2158) Upgrade Hadoop dependency to version 3.2.0

2022-06-13 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/PARQUET-2158?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17553552#comment-17553552 ] Steve Loughran commented on PARQUET-2158: - build is broken by HADOOP-12436 {code} Error:

[jira] [Created] (PARQUET-2158) Upgrade Hadoop dependency to version 3.2.0

2022-06-13 Thread Steve Loughran (Jira)
Steve Loughran created PARQUET-2158: --- Summary: Upgrade Hadoop dependency to version 3.2.0 Key: PARQUET-2158 URL: https://issues.apache.org/jira/browse/PARQUET-2158 Project: Parquet Issue

[jira] [Updated] (PARQUET-2151) Drop Hadoop 2 input stream reflection from parquet-hadoop

2022-06-07 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/PARQUET-2151?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated PARQUET-2151: Description: Parquet uses reflection to load a hadoop2 input stream, falling back to a

[jira] [Updated] (PARQUET-2151) Drop Hadoop 2 input stream reflection from parquet-hadoop

2022-06-07 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/PARQUET-2151?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated PARQUET-2151: Summary: Drop Hadoop 2 input stream reflection from parquet-hadoop (was: Drop Hadoop 1

[jira] [Updated] (PARQUET-2151) Drop Hadoop 1 input stream support from parquet-hadoop

2022-06-07 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/PARQUET-2151?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated PARQUET-2151: Description: Parquet uses reflection to load a hadoop2 input stream, falling back to a

[jira] [Updated] (PARQUET-2151) Drop Hadoop 1 input stream support from parquet-hadoop

2022-06-06 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/PARQUET-2151?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated PARQUET-2151: Summary: Drop Hadoop 1 input stream support from parquet-hadoop (was: parquet-hadoop

[jira] [Commented] (PARQUET-2134) Incorrect type checking in HadoopStreams.wrap

2022-06-06 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/PARQUET-2134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17550592#comment-17550592 ] Steve Loughran commented on PARQUET-2134: - have you a full stack trace. as IMO the issue isn't

[jira] [Created] (PARQUET-2151) parquet-hadoop to drop Hadoop 1 input stream support

2022-06-06 Thread Steve Loughran (Jira)
Steve Loughran created PARQUET-2151: --- Summary: parquet-hadoop to drop Hadoop 1 input stream support Key: PARQUET-2151 URL: https://issues.apache.org/jira/browse/PARQUET-2151 Project: Parquet

[jira] [Commented] (PARQUET-2150) parquet-protobuf to compile on mac M1

2022-05-23 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/PARQUET-2150?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17541068#comment-17541068 ] Steve Loughran commented on PARQUET-2150: - same issue and solution as HADOOP-17939 >

[jira] [Created] (PARQUET-2150) parquet-protobuf to compile on mac M1

2022-05-23 Thread Steve Loughran (Jira)
Steve Loughran created PARQUET-2150: --- Summary: parquet-protobuf to compile on mac M1 Key: PARQUET-2150 URL: https://issues.apache.org/jira/browse/PARQUET-2150 Project: Parquet Issue Type:

[jira] [Commented] (PARQUET-1615) getRecordWriter shouldn't hardcode CREAT mode when new ParquetFileWriter

2021-08-02 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/PARQUET-1615?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17391699#comment-17391699 ] Steve Loughran commented on PARQUET-1615: - just looking at this. Any specific reason not to

[jira] [Comment Edited] (PARQUET-1984) Some tests fail on windows

2021-07-08 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/PARQUET-1984?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17377466#comment-17377466 ] Steve Loughran edited comment on PARQUET-1984 at 7/8/21, 3:40 PM: --

[jira] [Commented] (PARQUET-1984) Some tests fail on windows

2021-07-08 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/PARQUET-1984?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17377466#comment-17377466 ] Steve Loughran commented on PARQUET-1984: - FYI, this change stops the test building against