xglv1985 commented on issue #2812: URL: https://github.com/apache/hudi/issues/2812#issuecomment-839611846
sorry for late response. > While we wait for your response, can you help answer these questions too > > * Did you hit this issue right from the beginning when you start incremental query? Or do you see after some time(ie. few incremental pulls succeeded and after sometime you hit this error and after that its consistent? **Yes, right from the beginning, and each time definitely hit the error on the Spark cluster. But in my local IDEA, I did not hit the error, with only 5 hudi records. So I doubt that the error was caused by a corrupted parquet file. But until now I have not found the reason why it was damaged. https://issues.apache.org/jira/browse/SPARK-11844** > * If its later, can you give us the contents of ".hoodie". I am trying to get a sense if this happens just after compaction. If you know upfront, you can answer this one too. **Newest conclusion: the same error was raised not only in MOR, but also in COW.** thanks, I will coninue to focus on the problem. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected]
