eshu commented on issue #7192: URL: https://github.com/apache/hudi/issues/7192#issuecomment-1313110216
@xushiyan Just take a look on code: https://github.com/apache/hudi/blob/release-0.11.1/hudi-spark-datasource/hudi-spark-common/src/main/scala/org/apache/hudi/HoodieSparkSqlWriter.scala#L688-L704 ``` } else { log.error(s"${tableInstantInfo.operation} failed with errors") if (log.isTraceEnabled) { log.trace("Printing out the top 100 errors") writeResult.getWriteStatuses.rdd.filter(ws => ws.hasErrors) .take(100) .foreach(ws => { log.trace("Global error :", ws.getGlobalError) if (ws.getErrors.size() > 0) { ws.getErrors.foreach(kt => log.trace(s"Error for key: ${kt._1}", kt._2)) } }) } (false, common.util.Option.empty(), common.util.Option.empty()) } ``` Here is a writing an error message without any details and real errors appeared only when I set trace level of logs. I found that problem was null values in an array field. But job was finished successfully without any error. The problem is **again** in the hudi code, there is no reason to look for it in dependencies, setup or environment. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
