[
https://issues.apache.org/jira/browse/PARQUET-1390?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16585087#comment-16585087
]
ASF GitHub Bot commented on PARQUET-1390:
-----------------------------------------
xhochy closed pull request #516: PARQUET-1390: Upgrade Arrow to 0.10.0
URL: https://github.com/apache/parquet-mr/pull/516
This is a PR merged from a forked repository.
As GitHub hides the original diff on merge, it is displayed below for
the sake of provenance:
As this is a foreign pull request (from a fork), the diff is supplied
below (as it won't show otherwise due to GitHub magic):
diff --git a/parquet-arrow/pom.xml b/parquet-arrow/pom.xml
index 232167ecb..e0f305acb 100644
--- a/parquet-arrow/pom.xml
+++ b/parquet-arrow/pom.xml
@@ -33,7 +33,7 @@
<url>https://parquet.apache.org</url>
<properties>
- <arrow.version>0.8.0</arrow.version>
+ <arrow.version>0.10.0</arrow.version>
</properties>
<dependencies>
diff --git
a/parquet-arrow/src/main/java/org/apache/parquet/arrow/schema/SchemaConverter.java
b/parquet-arrow/src/main/java/org/apache/parquet/arrow/schema/SchemaConverter.java
index a7df48cee..b0f122ce0 100644
---
a/parquet-arrow/src/main/java/org/apache/parquet/arrow/schema/SchemaConverter.java
+++
b/parquet-arrow/src/main/java/org/apache/parquet/arrow/schema/SchemaConverter.java
@@ -278,6 +278,11 @@ public TypeMapping visit(Interval type) {
return primitiveFLBA(12, INTERVAL);
}
+ @Override
+ public TypeMapping visit(ArrowType.FixedSizeBinary fixedSizeBinary) {
+ return primitive(BINARY);
+ }
+
private TypeMapping mapping(PrimitiveType parquetType) {
return new PrimitiveTypeMapping(field, parquetType);
}
@@ -663,6 +668,11 @@ public TypeMapping visit(Interval type) {
return primitive();
}
+ @Override
+ public TypeMapping visit(ArrowType.FixedSizeBinary fixedSizeBinary) {
+ return primitive();
+ }
+
private TypeMapping primitive() {
if (!parquetField.isPrimitive()) {
throw new IllegalArgumentException("Can not map schemas as one is
primitive and the other is not: " + arrowField + " != " + parquetField);
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
> [Java] Upgrade to Arrow 0.10.0
> ------------------------------
>
> Key: PARQUET-1390
> URL: https://issues.apache.org/jira/browse/PARQUET-1390
> Project: Parquet
> Issue Type: Improvement
> Components: parquet-mr
> Affects Versions: 1.10.0
> Reporter: Andy Grove
> Priority: Minor
> Labels: pull-request-available
> Original Estimate: 4h
> Remaining Estimate: 4h
>
> Parquet is using Arrow 0.8.0 but version 0.10.0 was recently released. There
> are numerous bug fixes and improvements, including building with JDK 8.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
