ahmedabu98 commented on PR #28591: URL: https://github.com/apache/beam/pull/28591#issuecomment-1749036123
> QQ I thought the "data validation errors" is this schema validation, isn't it? I think data validation refers to schema validation, but I don't think that specific link is related. R rows with mismatched schema do go to the DLQ. In practice most failed rows in the DLQ are due to this. I'm not sure how the behavior was before, but we don't fail the transform/pipeline now. I think the line in the link you sent checks that the coder for the `StorageApiWritePayload` object exists (this does not validate data schema). -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
