nandorKollar commented on issue #23721: [SPARK-26797][SQL][WIP][test-maven] Start using the new logical types API of Parquet 1.11.0 instead of the deprecated one URL: https://github.com/apache/spark/pull/23721#issuecomment-462791845 @dongjoon-hyun @squito triaged the failures: * InMemoryColumnarQuerySuite - failed because of change in Parquet file size due to column indexes * ParquetInteroperabilitySuite "parquet timestamp read path" - _had to regenerate tests files, those which are attached to the PR were generated before RC_ * HadoopFsRelationSuite "SPARK-22790: spark.sql.sources.compressionFactor takes effect" - _failed because of change in Parquet file size, due to column indexes_ * ParquetPartitionDiscoverySuite "column type inference" & "parse partitions" - _couldn't reproduce test locally, it passes on my machine_ * HDFSMetadataLogSuite "HDFSMetadataLog: metadata directory collision" - _couldn't reproduce, in Jenkins logs I could see "The await method on Waiter timed out.", maybe it is a flaky test? Looks like an unrelated failure for me._ * ParquetQuerySuite "SPARK-26677: negated null-safe equality comparison should not filter matched row groups" - _fails because PARQUET-1510 is not yet included into 1.11.0 RC3, RC4 is needed (this bug was found after RC3 was created)_
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
