para-99 opened a new issue, #57882: URL: https://github.com/apache/doris/issues/57882
### Search before asking - [x] I had searched in the [issues](https://github.com/apache/doris/issues?q=is%3Aissue) and found no similar issues. ### Version doris 2.1, My Spark version is 3.4.3, and the Spark-Doris-Connector version is 25.1.0. ### What's Wrong? I am using the Spark-Doris-Connector to read data from Doris, then perform some computations, and finally write the results back to Doris. When I use the following Java code to read from Doris: String filterString = "cust_no = '111'"; sparkSession.read() .format("doris") .option("doris.table.identifier", "busidb.tb_tx") .option("doris.fenodes", "123") .option("user", "123") .option("password", "123") .option("doris.filter", filterString) .load(); Then I perform some computations, and finally write the result (allRslt) back to Doris using: allRslt.write() .format("doris") .option("doris.table.identifier", "busidb.tb_rslt") .option("doris.fenodes", "123") .option("user", "123") .option("password", "123") .mode(SaveMode.Append) .save(); I get the following error: query plan failed, exception: errCode = 2, detailMessage = Unknown column 'null' in 'table list' However, I have printed the columns of allRslt, and there is no column named "null" in it. More strangely, if I read the data using .read().jdbc().load()(e.g., from a traditional database like MySQL) instead of Doris, this issue does not occur. Has anyone else encountered this problem? Is this a problem with the Spark-Doris-Connector? ### What You Expected? Could you please explain what is happening here and how to fix it? ### How to Reproduce? _No response_ ### Anything Else? _No response_ ### Are you willing to submit PR? - [ ] Yes I am willing to submit a PR! ### Code of Conduct - [x] I agree to follow this project's [Code of Conduct](https://www.apache.org/foundation/policies/conduct) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
