GaryLea opened a new issue, #5676: URL: https://github.com/apache/seatunnel/issues/5676
### Search before asking - [X] I had searched in the [issues](https://github.com/apache/seatunnel/issues?q=is%3Aissue+label%3A%22bug%22) and found no similar issues. ### What happened 1. 在2.3.1版本使用mongo connector时，使用MatchQuery过滤条件，没有起作用，使用console测试仍然返回mongo全部数据，使用hdfs file connector导出数据后发现，mongo数据库中5万条数据仅有1万多条可以正确写入，但是日志返回结果还是5万条。 2. 弃用2.3.1，采用2.3.3版本，链接mongo就报错 ### SeaTunnel Version 2.3.3 ### SeaTunnel Config ```conf # Set the basic configuration of the task to be performed env { execution.parallelism = 1 job.mode = "BATCH" } source { # 读取加购表 MongoDB { #result_table_name = "cart_order" uri = "mongodb://xx-pub.mongodb.rds.aliyuncs.com:3717/test" database = "test" collection = "test_mongo" # match.query = "{_id:1703565177844592640}" } } sink { Console { } } ``` ### Running Command ```shell bash bin/seatunnel.sh --config test.conf -e local ``` ### Error Exception ```log `2023-10-19 11:58:35,900 INFO org.mongodb.driver.cluster - Monitor thread successfully connected to server with description ServerDescription{address=xx-pub.mongodb.rds.aliyuncs.com:3717, type=REPLICA_SET_PRIMARY, state=CONNECTED, ok=true, minWireVersion=0, maxWireVersion=9, maxDocumentSize=16777216, logicalSessionTimeoutMinutes=30, roundTripTimeNanos=22808930, setName='mgset-68500633', canonicalAddress=xx.xx.xx:3717, hosts=[x.xx.xx:3717, xx.xx.xx:3717], passives=[], arbiters=[], primary='xx.xxx.xx:3717', tagSet=TagSet{[]}, electionId=7fffffff0000000000000001, setVersion=3, topologyVersion=TopologyVersion{processId=64720c9d53e2250b93acee2d, counter=8}, lastWriteDate=Thu Oct 19 11:58:28 CST 2023, lastUpdateTimeNanos=16319713118547896} 2023-10-19 11:58:35,987 INFO org.mongodb.driver.connection - Opened connection [connectionId{localValue:3, serverValue:22530726}] to xx-pub.mongodb.rds.aliyuncs.com:3717 2023-10-19 11:58:36,483 WARN org.apache.seatunnel.engine.server.TaskExecutionService - [localhost]:5801 [seatunnel-511924] [5.1] Exception in org.apache.seatunnel.engine.server.task.SourceSeaTunnelTask@413af2d4 org.apache.seatunnel.connectors.seatunnel.mongodb.exception.MongodbConnectorException: ErrorCode:[COMMON-05], ErrorDescription:[Unsupported operation] - Unable to convert to <STRING> from nullable value null at org.apache.seatunnel.connectors.seatunnel.mongodb.serde.BsonToRowDataConverters$2.apply(BsonToRowDataConverters.java:89) ~[connector-mongodb-2.3.3.jar:2.3.3] at org.apache.seatunnel.connectors.seatunnel.mongodb.serde.BsonToRowDataConverters$2.apply(BsonToRowDataConverters.java:83) ~[connector-mongodb-2.3.3.jar:2.3.3] at org.apache.seatunnel.connectors.seatunnel.mongodb.serde.BsonToRowDataConverters$1.convert(BsonToRowDataConverters.java:71) ~[connector-mongodb-2.3.3.jar:2.3.3] at org.apache.seatunnel.connectors.seatunnel.mongodb.serde.DocumentRowDataDeserializer.deserialize(DocumentRowDataDeserializer.java:71) ~[connector-mongodb-2.3.3.jar:2.3.3] at org.apache.seatunnel.connectors.seatunnel.mongodb.serde.DocumentRowDataDeserializer.deserialize(DocumentRowDataDeserializer.java:32) ~[connector-mongodb-2.3.3.jar:2.3.3] at java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:193) ~[?:1.8.0_212] at java.util.Iterator.forEachRemaining(Iterator.java:116) ~[?:1.8.0_212] at java.util.Spliterators$IteratorSpliterator.forEachRemaining(Spliterators.java:1801) ~[?:1.8.0_212] at java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:481) ~[?:1.8.0_212] at java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:471) ~[?:1.8.0_212] at java.util.stream.ForEachOps$ForEachOp.evaluateSequential(ForEachOps.java:151) ~[?:1.8.0_212] at java.util.stream.ForEachOps$ForEachOp$OfRef.evaluateSequential(ForEachOps.java:174) ~[?:1.8.0_212] at java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234) ~[?:1.8.0_212] at java.util.stream.ReferencePipeline.forEach(ReferencePipeline.java:418) ~[?:1.8.0_212] at org.apache.seatunnel.connectors.seatunnel.mongodb.source.reader.MongodbReader.pollNext(MongodbReader.java:99) ~[connector-mongodb-2.3.3.jar:2.3.3] at org.apache.seatunnel.engine.server.task.flow.SourceFlowLifeCycle.collect(SourceFlowLifeCycle.java:150) ~[seatunnel-starter.jar:2.3.3] at org.apache.seatunnel.engine.server.task.SourceSeaTunnelTask.collect(SourceSeaTunnelTask.java:95) ~[seatunnel-starter.jar:2.3.3] at org.apache.seatunnel.engine.server.task.SeaTunnelTask.stateProcess(SeaTunnelTask.java:168) ~[seatunnel-starter.jar:2.3.3] at org.apache.seatunnel.engine.server.task.SourceSeaTunnelTask.call(SourceSeaTunnelTask.java:100) ~[seatunnel-starter.jar:2.3.3] at org.apache.seatunnel.engine.server.TaskExecutionService$BlockingWorker.run(TaskExecutionService.java:613) [seatunnel-starter.jar:2.3.3] at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) [?:1.8.0_212] at java.util.concurrent.FutureTask.run(FutureTask.java:266) [?:1.8.0_212] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [?:1.8.0_212] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [?:1.8.0_212] at java.lang.Thread.run(Thread.java:748) [?:1.8.0_212] 2023-10-19 11:58:36,484 INFO org.apache.seatunnel.engine.server.TaskExecutionService - [localhost]:5801 [seatunnel-511924] [5.1] taskDone, taskId = 40000, taskGroup = TaskGroupLocation{jobId=767235140857364481, pipelineId=1, taskGroupId=30000} 2023-10-19 11:58:36,484 WARN org.apache.seatunnel.engine.server.TaskExecutionService - [localhost]:5801 [seatunnel-511924] [5.1] Interrupted task 50000 - org.apache.seatunnel.engine.server.task.TransformSeaTunnelTask@13bfb0b9 2023-10-19 11:58:36,484 INFO org.apache.seatunnel.engine.server.TaskExecutionService - [localhost]:5801 [seatunnel-511924] [5.1] taskDone, taskId = 50000, taskGroup = TaskGroupLocation{jobId=7672351401, pipelineId=1, taskGroupId=30000} 2023-10-19 11:58:36,485 INFO org.apache.seatunnel.engine.server.TaskExecutionService - [localhost]:5801 [seatunnel-511924] [5.1] Task TaskGroupLocation{jobId=7672351401, pipelineId=1, taskGroupId=30000} complete with state FAILED 2023-10-19 11:58:36,485 INFO org.apache.seatunnel.engine.server.CoordinatorService - [localhost]:5801 [seatunnel-511924] [5.1] Received task end from execution TaskGroupLocation{jobId=7672351401, pipelineId=1, taskGroupId=30000}, state FAILED 2023-10-19 11:58:36,486 INFO org.apache.seatunnel.engine.server.dag.physical.PhysicalVertex - Job SeaTunnel_Job (7672351401), Pipeline: [(1/1)], task: [pipeline-1 [Source[0]-MongoDB-default-identifier]-SourceTask (1/1)] turn to end state FAILED. ` ``` ### Zeta or Flink or Spark Version _No response_ ### Java or Scala Version _No response_ ### Screenshots _No response_ ### Are you willing to submit PR? - [X] Yes I am willing to submit a PR! ### Code of Conduct - [X] I agree to follow this project's [Code of Conduct](https://www.apache.org/foundation/policies/conduct) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
