garyli1019 commented on pull request #1848:
URL: https://github.com/apache/hudi/pull/1848#issuecomment-670078060
> ```
> [ERROR] Tests run: 4, Failures: 0, Errors: 1, Skipped: 0, Time elapsed:
66.614 s <<< FAILURE! - in org.apache.hudi.functional.TestCOWDataSource
> [ERROR]
org.apache.hudi.functional.TestCOWDataSource.testStructuredStreaming Time
elapsed: 25.766 s <<< ERROR!
> java.util.concurrent.ExecutionException: Boxed Error
> Caused by: org.opentest4j.AssertionFailedError: expected: <2> but was: <3>
> ```
>
> @garyli1019 this is failing now. See my last fix. just unsetting the path
filter after resolving the relation seems to help get over the issue. So the
root issue there was the path filter still kicking in for
`spark.read.format('parquet')` (which is kind of expected even)
@vinothchandar agree. I can see the InMemoryFileIndex warning on every test
following the SparkStreaming test, but don't see it if I run some COW test
alone. I will try to change the test set up to clean the spark context properly.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
