vinothchandar commented on a change in pull request #599: Fixing small file
handling, inline compaction defaults
URL: https://github.com/apache/incubator-hudi/pull/599#discussion_r271046355
##########
File path: hoodie-spark/src/test/scala/DataSourceTest.scala
##########
@@ -131,6 +131,7 @@ class DataSourceTest extends AssertionsForJUnit {
val inputDF1: Dataset[Row] =
spark.read.json(spark.sparkContext.parallelize(records1, 2))
inputDF1.write.format("com.uber.hoodie")
.options(commonOpts)
+ .option("hoodie.compact.inline", "false") // else fails due to
compaction & deltacommit instant times being same
Review comment:
since test runs very quickly, the delta commit and compaction start in the
same second. Don't know how to prevent this per se.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
With regards,
Apache Git Services