Manoj Singh created DRILL-7232:
----------------------------------

             Summary: Error while writing parquet by Drill Docker container 
Drill version 1.15
                 Key: DRILL-7232
                 URL: https://issues.apache.org/jira/browse/DRILL-7232
             Project: Apache Drill
          Issue Type: Bug
            Reporter: Manoj Singh


We are getting the below error in our application logs. We are running 
drill1.15 as a docker container.

The Parquet location /opt/data/parquet-location has all the rights and 
permissions.

 

Please advise what i am doing wrong here.

2019-05-02 07:29:02 [WARN ] [] @ Log : warn : 182 - could not write summary 
file for 
file:/opt/data/parquet-location/72AB79EC-D841-4D7D-8FEE-2FCEC6D089A7-Online_Search__Snapshot_Data.parquet
java.lang.NullPointerException
 at 
org.apache.parquet.hadoop.ParquetFileWriter.mergeFooters(ParquetFileWriter.java:456)
 at 
org.apache.parquet.hadoop.ParquetFileWriter.writeMetadataFile(ParquetFileWriter.java:420)
 at 
org.apache.parquet.hadoop.ParquetOutputCommitter.writeMetaDataFile(ParquetOutputCommitter.java:58)
 at 
org.apache.parquet.hadoop.ParquetOutputCommitter.commitJob(ParquetOutputCommitter.java:48)
 at 
org.apache.spark.sql.execution.datasources.BaseWriterContainer.commitJob(WriterContainer.scala:208)
 at 
org.apache.spark.sql.execution.datasources.InsertIntoHadoopFsRelation$$anonfun$run$1.apply$mcV$sp(InsertIntoHadoopFsRelation.scala:151)
 at 
org.apache.spark.sql.execution.datasources.InsertIntoHadoopFsRelation$$anonfun$run$1.apply(InsertIntoHadoopFsRelation.scala:108)
 at 
org.apache.spark.sql.execution.datasources.InsertIntoHadoopFsRelation$$anonfun$run$1.apply(Inse



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Reply via email to