[
https://issues.apache.org/jira/browse/DRILL-7232?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
James Turton closed DRILL-7232.
-------------------------------
Assignee: James Turton
Resolution: Invalid
Hi thanks for this report. The stack trace you included comes from Spark SQL
not Drill. I think you're looking in the wrong place for your Parquet write
problem.
> Error while writing parquet by Drill Docker container Drill version 1.15
> ------------------------------------------------------------------------
>
> Key: DRILL-7232
> URL: https://issues.apache.org/jira/browse/DRILL-7232
> Project: Apache Drill
> Issue Type: Bug
> Reporter: Manoj Singh
> Assignee: James Turton
> Priority: Critical
>
> We are getting the below error in our application logs. We are running
> drill1.15 as a docker container.
> The Parquet location /opt/data/parquet-location has all the rights and
> permissions.
>
> Please advise what i am doing wrong here.
> 2019-05-02 07:29:02 [WARN ] [] @ Log : warn : 182 - could not write summary
> file for
> file:/opt/data/parquet-location/72AB79EC-D841-4D7D-8FEE-2FCEC6D089A7-Online_Search__Snapshot_Data.parquet
> java.lang.NullPointerException
> at
> org.apache.parquet.hadoop.ParquetFileWriter.mergeFooters(ParquetFileWriter.java:456)
> at
> org.apache.parquet.hadoop.ParquetFileWriter.writeMetadataFile(ParquetFileWriter.java:420)
> at
> org.apache.parquet.hadoop.ParquetOutputCommitter.writeMetaDataFile(ParquetOutputCommitter.java:58)
> at
> org.apache.parquet.hadoop.ParquetOutputCommitter.commitJob(ParquetOutputCommitter.java:48)
> at
> org.apache.spark.sql.execution.datasources.BaseWriterContainer.commitJob(WriterContainer.scala:208)
> at
> org.apache.spark.sql.execution.datasources.InsertIntoHadoopFsRelation$$anonfun$run$1.apply$mcV$sp(InsertIntoHadoopFsRelation.scala:151)
> at
> org.apache.spark.sql.execution.datasources.InsertIntoHadoopFsRelation$$anonfun$run$1.apply(InsertIntoHadoopFsRelation.scala:108)
> at
> org.apache.spark.sql.execution.datasources.InsertIntoHadoopFsRelation$$anonfun$run$1.apply(Inse
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
